2024-07-26T11:52:11.503 INFO:root:teuthology version: 0.0.1.dev379+g53ce146 2024-07-26T11:52:11.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-26T11:52:11.612 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818804 branch: wip-vshankar-testing-20240725.121331-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} email: vshankar@redhat.com first_in_suite: false job_id: '7818804' kernel: flavor: default kdb: 1 sha1: 3e9255e907100f88049f320ca33d977e29155d12 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240725.121331-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240725.121331-debug sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5532 sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 sleep_before_teardown: 0 subset: 1001/1024 suite: fs suite_branch: wip-vshankar-testing-20240725.121331-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlA4nSh/BnUCegU3S91vpnxR5/twUKWCRkeiMSHyTtqEWssdxl7udDtZ7pjBCXEPhu60jgaHz0VQ9AX0dExxJo= smithi076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDA7yhYflaCCZcSPyiq1N0qNSPUTo1Okixskfl1e2wXvUfbMDvdGVrKFx6sy460clukSlDDDMRGyspRzEsjNI6c= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF1dKbFF3/FG/XZNQRf7B1Hl/9MPS5SrbUHsQB4DeorkrLU4goc9ImKmhuMiwfbi3oavGFzljzS9SE3Csa+kbHw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - quiescer: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 53ce1462e129f6eb4071986336534c740fdebd31 timestamp: 2024-07-26_04:18:59 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 2024-07-26T11:52:11.612 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa; will attempt to use it 2024-07-26T11:52:11.613 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks 2024-07-26T11:52:11.613 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-07-26T11:52:11.614 INFO:teuthology.task.internal:Checking packages... 2024-07-26T11:52:11.635 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528' 2024-07-26T11:52:11.635 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-07-26T11:52:11.635 INFO:teuthology.packaging:ref: None 2024-07-26T11:52:11.635 INFO:teuthology.packaging:tag: None 2024-07-26T11:52:11.636 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240725.121331-debug 2024-07-26T11:52:11.636 INFO:teuthology.packaging:sha1: e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T11:52:11.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240725.121331-debug 2024-07-26T11:52:11.785 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5320.ge8f88bb1 2024-07-26T11:52:11.787 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-07-26T11:52:11.794 INFO:teuthology.task.internal:no buildpackages task found 2024-07-26T11:52:11.794 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-07-26T11:52:11.802 INFO:teuthology.task.internal:Saving configuration 2024-07-26T11:52:11.821 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-07-26T11:52:11.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-07-26T11:52:11.853 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-26 11:46:58.294365', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlA4nSh/BnUCegU3S91vpnxR5/twUKWCRkeiMSHyTtqEWssdxl7udDtZ7pjBCXEPhu60jgaHz0VQ9AX0dExxJo='} 2024-07-26T11:52:11.877 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-26 11:46:58.296394', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDA7yhYflaCCZcSPyiq1N0qNSPUTo1Okixskfl1e2wXvUfbMDvdGVrKFx6sy460clukSlDDDMRGyspRzEsjNI6c='} 2024-07-26T11:52:11.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-26_04:18:59-fs-wip-vshankar-testing-20240725.121331-debug-testing-default-smithi/7818804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-26 11:46:58.298009', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF1dKbFF3/FG/XZNQRf7B1Hl/9MPS5SrbUHsQB4DeorkrLU4goc9ImKmhuMiwfbi3oavGFzljzS9SE3Csa+kbHw='} 2024-07-26T11:52:11.897 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-07-26T11:52:11.903 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-07-26T11:52:11.903 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-07-26T11:52:11.903 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-07-26T11:52:11.903 INFO:teuthology.run_tasks:Running task console_log... 2024-07-26T11:52:11.988 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73bd7cbac0>, signals=[15]) 2024-07-26T11:52:11.988 INFO:teuthology.run_tasks:Running task internal.connect... 2024-07-26T11:52:11.994 INFO:teuthology.task.internal:Opening connections... 2024-07-26T11:52:11.994 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-07-26T11:52:11.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:52:12.073 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2024-07-26T11:52:12.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:52:12.148 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-07-26T11:52:12.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:52:12.224 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-07-26T11:52:12.230 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-07-26T11:52:12.248 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-07-26T11:52:12.248 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-07-26T11:52:12.306 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-07-26T11:52:12.306 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-26T11:52:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-26T11:52:12.308 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-07-26T11:52:12.338 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-07-26T11:52:12.355 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-07-26T11:52:12.355 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-07-26T11:52:12.415 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-07-26T11:52:12.415 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-07-26T11:52:12.415 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-07-26T11:52:12.415 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-07-26T11:52:12.415 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-07-26T11:52:12.415 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-26T11:52:12.416 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-26T11:52:12.416 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-07-26T11:52:12.446 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-07-26T11:52:12.464 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-07-26T11:52:12.464 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-07-26T11:52:12.521 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-07-26T11:52:12.521 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-07-26T11:52:12.521 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-26T11:52:12.522 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-26T11:52:12.523 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-07-26T11:52:12.546 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-07-26T11:52:12.556 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-07-26T11:52:12.562 INFO:teuthology.task.internal:Checking for old test directory... 2024-07-26T11:52:12.562 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-07-26T11:52:12.564 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2024-07-26T11:52:12.567 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-07-26T11:52:12.583 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-07-26T11:52:12.588 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-07-26T11:52:12.588 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-07-26T11:52:12.622 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2024-07-26T11:52:12.624 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-07-26T11:52:12.714 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-07-26T11:52:12.786 INFO:teuthology.run_tasks:Running task kernel... 2024-07-26T11:52:12.816 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '3e9255e907100f88049f320ca33d977e29155d12'} 2024-07-26T11:52:12.816 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '3e9255e907100f88049f320ca33d977e29155d12'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '3e9255e907100f88049f320ca33d977e29155d12'}, 'mon.c': {'flavor': 'default', 'kdb': 1, 'sha1': '3e9255e907100f88049f320ca33d977e29155d12'}}, timeout 300 2024-07-26T11:52:12.816 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-26T11:52:12.817 DEBUG:teuthology.orchestra.run.smithi076:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-26T11:52:12.818 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-26T11:52:12.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:52:12.838 DEBUG:teuthology.task.kernel:sha1 for mon.b is 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3e9255e907100f88049f320ca33d977e29155d12"... 2024-07-26T11:52:12.838 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-07-26T11:52:12.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:52:12.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:52:12.840 DEBUG:teuthology.task.kernel:sha1 for mon.a is 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3e9255e907100f88049f320ca33d977e29155d12"... 2024-07-26T11:52:12.841 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-07-26T11:52:12.841 DEBUG:teuthology.task.kernel:sha1 for mon.c is 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.841 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "3e9255e907100f88049f320ca33d977e29155d12"... 2024-07-26T11:52:12.841 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-07-26T11:52:12.896 INFO:teuthology.orchestra.run.smithi076.stdout:5.14.0-437.el9.x86_64 2024-07-26T11:52:12.896 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.896 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-07-26T11:52:12.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.901 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-437.el9.x86_64 2024-07-26T11:52:12.901 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-437.el9.x86_64 2024-07-26T11:52:12.901 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.901 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-07-26T11:52:12.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.902 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:12.903 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-07-26T11:52:12.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:52:13.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum upgrade -y linux-firmware 2024-07-26T11:52:13.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum upgrade -y linux-firmware 2024-07-26T11:52:13.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum upgrade -y linux-firmware 2024-07-26T11:52:15.261 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-07-26T11:52:15.476 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-07-26T11:52:17.120 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-07-26T11:52:17.177 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-07-26T11:52:20.013 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-07-26T11:52:21.530 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-07-26T11:52:23.697 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 18 kB 00:00 2024-07-26T11:52:24.118 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-07-26T11:52:24.428 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-07-26T11:52:24.868 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-07-26T11:52:26.020 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 18 kB 00:00 2024-07-26T11:52:26.883 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-07-26T11:52:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-07-26T11:52:30.241 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-07-26T11:52:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 18 kB 00:00 2024-07-26T11:52:32.199 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-07-26T11:52:32.378 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-07-26T11:52:32.386 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrading: 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 1 Package 2024-07-26T11:52:32.387 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T11:52:32.388 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 383 M 2024-07-26T11:52:32.388 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-07-26T11:52:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-07-26T11:52:34.310 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-07-26T11:52:34.320 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-07-26T11:52:34.320 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-07-26T11:52:34.320 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-07-26T11:52:34.320 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 1 Package 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T11:52:34.321 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 383 M 2024-07-26T11:52:34.322 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-07-26T11:52:38.146 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-07-26T11:52:40.285 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 1 Package 2024-07-26T11:52:40.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T11:52:40.296 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 383 M 2024-07-26T11:52:40.296 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-07-26T11:52:53.171 INFO:teuthology.orchestra.run.smithi040.stdout:linux-firmware-20240716-145.el9.noarch.rpm 30 MB/s | 383 MB 00:12 2024-07-26T11:52:53.172 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-07-26T11:52:53.172 INFO:teuthology.orchestra.run.smithi040.stdout:Total 30 MB/s | 383 MB 00:12 2024-07-26T11:52:53.315 INFO:teuthology.orchestra.run.smithi146.stdout:linux-firmware-20240716-145.el9.noarch.rpm 20 MB/s | 383 MB 00:18 2024-07-26T11:52:53.315 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-07-26T11:52:53.315 INFO:teuthology.orchestra.run.smithi146.stdout:Total 20 MB/s | 383 MB 00:18 2024-07-26T11:52:56.404 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-07-26T11:52:56.407 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-07-26T11:52:56.493 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-07-26T11:52:56.493 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-07-26T11:52:56.534 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-07-26T11:52:56.534 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-07-26T11:52:59.822 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-07-26T11:52:59.822 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-07-26T11:52:59.884 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-07-26T11:52:59.885 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-07-26T11:53:08.778 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-07-26T11:53:09.043 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-07-26T11:53:09.529 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T11:53:09.620 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:09.845 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T11:53:09.934 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:10.111 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:10.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T11:53:10.696 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:10.696 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T11:53:10.848 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:10.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T11:53:10.848 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-07-26T11:53:10.848 INFO:teuthology.orchestra.run.smithi146.stdout: linux-firmware-20240716-145.el9.noarch 2024-07-26T11:53:10.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T11:53:10.849 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-07-26T11:53:11.163 INFO:teuthology.task.kernel:Downloading kernel 3e9255e907100f88049f320ca33d977e29155d12 on mon.c... 2024-07-26T11:53:11.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:53:11.311 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ 2024-07-26T11:53:11.312 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.10.0_g3e9255e90710-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ --input-file=- 2024-07-26T11:53:11.314 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2024-07-26T11:53:11.466 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:11.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T11:53:11.466 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-07-26T11:53:11.466 INFO:teuthology.orchestra.run.smithi040.stdout: linux-firmware-20240716-145.el9.noarch 2024-07-26T11:53:11.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T11:53:11.466 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-07-26T11:53:11.770 INFO:teuthology.task.kernel:Downloading kernel 3e9255e907100f88049f320ca33d977e29155d12 on mon.a... 2024-07-26T11:53:11.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:53:11.909 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ 2024-07-26T11:53:11.909 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.10.0_g3e9255e90710-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ --input-file=- 2024-07-26T11:53:11.911 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi040.front.sepia.ceph.com to complete... 2024-07-26T11:53:20.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26 11:53:20 URL:https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/kernel-6.10.0_g3e9255e90710-1.x86_64.rpm [358399635/358399635] -> "/tmp/kernel.x86_64.rpm" [1] 2024-07-26T11:53:20.234 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2024-07-26 11:53:20-- 2024-07-26T11:53:20.234 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 8.9s 2024-07-26T11:53:20.234 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 342M in 8.6s (39.6 MB/s) 2024-07-26T11:53:20.238 INFO:teuthology.task.kernel:Installing kernel 3e9255e907100f88049f320ca33d977e29155d12 on mon.c... 2024-07-26T11:53:20.238 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-07-26T11:53:22.304 INFO:teuthology.orchestra.run.smithi146.stdout:Verifying... ######################################## 2024-07-26T11:53:22.346 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing... ######################################## 2024-07-26T11:53:22.396 INFO:teuthology.orchestra.run.smithi146.stdout:Updating / installing... 2024-07-26T11:53:23.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26 11:53:23 URL:https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/kernel-6.10.0_g3e9255e90710-1.x86_64.rpm [358399635/358399635] -> "/tmp/kernel.x86_64.rpm" [1] 2024-07-26T11:53:23.508 INFO:teuthology.orchestra.run.smithi040.stderr:FINISHED --2024-07-26 11:53:23-- 2024-07-26T11:53:23.508 INFO:teuthology.orchestra.run.smithi040.stderr:Total wall clock time: 12s 2024-07-26T11:53:23.508 INFO:teuthology.orchestra.run.smithi040.stderr:Downloaded: 1 files, 342M in 11s (30.4 MB/s) 2024-07-26T11:53:23.511 INFO:teuthology.task.kernel:Installing kernel 3e9255e907100f88049f320ca33d977e29155d12 on mon.a... 2024-07-26T11:53:23.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-07-26T11:53:23.705 INFO:teuthology.orchestra.run.smithi076.stdout:linux-firmware-20240716-145.el9.noarch.rpm 7.5 MB/s | 383 MB 00:51 2024-07-26T11:53:23.705 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-07-26T11:53:23.705 INFO:teuthology.orchestra.run.smithi076.stdout:Total 7.5 MB/s | 383 MB 00:51 2024-07-26T11:53:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying... ######################################## 2024-07-26T11:53:25.724 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing... ######################################## 2024-07-26T11:53:25.778 INFO:teuthology.orchestra.run.smithi040.stdout:Updating / installing... 2024-07-26T11:53:26.789 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-07-26T11:53:26.938 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-07-26T11:53:26.938 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-07-26T11:53:30.180 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-07-26T11:53:30.180 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-07-26T11:53:30.462 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-6.10.0_g3e9255e90710-1 ######################################## 2024-07-26T11:53:34.093 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-6.10.0_g3e9255e90710-1 ######################################## 2024-07-26T11:53:39.145 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-07-26T11:53:39.887 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T11:53:39.971 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:40.524 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:40.525 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-07-26T11:53:41.245 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-07-26T11:53:41.245 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T11:53:41.245 INFO:teuthology.orchestra.run.smithi076.stdout:Upgraded: 2024-07-26T11:53:41.246 INFO:teuthology.orchestra.run.smithi076.stdout: linux-firmware-20240716-145.el9.noarch 2024-07-26T11:53:41.246 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T11:53:41.246 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-07-26T11:53:41.576 INFO:teuthology.task.kernel:Downloading kernel 3e9255e907100f88049f320ca33d977e29155d12 on mon.b... 2024-07-26T11:53:41.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3e9255e907100f88049f320ca33d977e29155d12 2024-07-26T11:53:41.728 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ 2024-07-26T11:53:41.728 DEBUG:teuthology.orchestra.run.smithi076:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.10.0_g3e9255e90710-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/ --input-file=- 2024-07-26T11:53:41.731 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi076.front.sepia.ceph.com to complete... 2024-07-26T11:53:48.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26 11:53:48 URL:https://1.chacra.ceph.com/r/kernel/testing/3e9255e907100f88049f320ca33d977e29155d12/centos/9/flavors/default/x86_64/kernel-6.10.0_g3e9255e90710-1.x86_64.rpm [358399635/358399635] -> "/tmp/kernel.x86_64.rpm" [1] 2024-07-26T11:53:48.011 INFO:teuthology.orchestra.run.smithi076.stderr:FINISHED --2024-07-26 11:53:48-- 2024-07-26T11:53:48.011 INFO:teuthology.orchestra.run.smithi076.stderr:Total wall clock time: 6.3s 2024-07-26T11:53:48.011 INFO:teuthology.orchestra.run.smithi076.stderr:Downloaded: 1 files, 342M in 6.0s (57.1 MB/s) 2024-07-26T11:53:48.015 INFO:teuthology.task.kernel:Installing kernel 3e9255e907100f88049f320ca33d977e29155d12 on mon.b... 2024-07-26T11:53:48.015 DEBUG:teuthology.orchestra.run.smithi076:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-07-26T11:53:50.067 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying... ######################################## 2024-07-26T11:53:50.125 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing... ######################################## 2024-07-26T11:53:50.175 INFO:teuthology.orchestra.run.smithi076.stdout:Updating / installing... 2024-07-26T11:53:58.202 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-6.10.0_g3e9255e90710-1 ######################################## 2024-07-26T11:54:09.798 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-07-26T11:54:09.799 DEBUG:teuthology.orchestra.run.smithi146:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-07-26T11:54:09.879 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/System.map-6.10.0-g3e9255e90710 2024-07-26T11:54:09.879 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/config-6.10.0-g3e9255e90710 2024-07-26T11:54:09.879 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/vmlinuz-6.10.0-g3e9255e90710 2024-07-26T11:54:09.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/System.map 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/config 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-07-26T11:54:09.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32c-intel.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx2.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-07-26T11:54:09.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-amd.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-intel.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ansi_cprng.ko 2024-07-26T11:54:09.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/anubis.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/arc4.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_memcpy.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_pq.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_raid6_recov.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_tx.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_xor.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/raid6test.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authenc.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authencesn.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blake2b_generic.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_common.ko 2024-07-26T11:54:09.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/camellia_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast5_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast6_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast_common.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ccm.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cmac.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crc32_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_engine.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_user.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cts.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/des_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/dh_generic.ko 2024-07-26T11:54:09.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecc.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecdh_generic.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/echainiv.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/essiv.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/fcrypt.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/khazad.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4hc.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/md4.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/michael_mic.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcbc.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcrypt.ko 2024-07-26T11:54:09.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/rmd160.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/seed.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/serpent_generic.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tcrypt.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tea.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_common.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_generic.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/vmac.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/wp512.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xcbc.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xor.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xxhash_generic.ko 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers 2024-07-26T11:54:09.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_ipmi.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_pad.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/ec_sys.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/platform_profile.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbs.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbshc.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/video.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/acard-ahci.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ahci_platform.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ata_generic.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/libahci_platform.ko 2024-07-26T11:54:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_acpi.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ali.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_amd.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_artop.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atiixp.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atp867x.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd640.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd64x.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cypress.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_efar.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt366.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt37x.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x2n.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x3.ko 2024-07-26T11:54:09.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it8213.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it821x.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_jmicron.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_marvell.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_mpiix.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_netcell.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ninja32.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87410.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87415.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_oldpiix.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_opti.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_optidma.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pcmcia.ko 2024-07-26T11:54:09.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc2027x.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_piccolo.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_rdc.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sch.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_serverworks.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sil680.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sis.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sl82c105.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_triflex.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_via.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pdc_adma.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_inic162x.ko 2024-07-26T11:54:09.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_mv.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_nv.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_promise.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_qstor.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil24.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sis.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_svw.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sx4.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_uli.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_via.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_vsc.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay/ks0108.ko 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base 2024-07-26T11:54:09.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-i2c.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-mmio.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma/bcma.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe/aoe.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/brd.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd/drbd.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/floppy.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/loop.ko 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx 2024-07-26T11:54:09.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/nbd.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk/null_blk.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/pktcdvd.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/rbd.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/virtio_blk.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkfront.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram/zram.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hangcheck-timer.ko 2024-07-26T11:54:09.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/amd-rng.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/intel-rng.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/via-rng.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/virtio-rng.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_si.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/lp.ko 2024-07-26T11:54:09.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave/mwave.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ppdev.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tlclk.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_atmel.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_infineon.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_nsc.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/uv_mmtimer.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/virtio_console.ko 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq 2024-07-26T11:54:09.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/p4-clockmod.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/powernow-k8.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/speedstep-lib.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp.ko 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common 2024-07-26T11:54:09.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-aes.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-sha.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca/dca.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw/dw_dmac.ko 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat 2024-07-26T11:54:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat/ioatdma.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/amd64_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/e752x_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/edac_mce_amd.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3000_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3200_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5100_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5400_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7300_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7core_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i82975x_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/ie31200_edac.ko 2024-07-26T11:54:09.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/sb_edac.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/x38_edac.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/edd.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/iscsi_ibft.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-ich.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-viperboard.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-appleir.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-aureal.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-axff.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-dr.ko 2024-07-26T11:54:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elecom.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elo.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-emsff.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gaff.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gt683r.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gyration.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-kbd.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-mouse.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtekff.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-hyperv.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-icade.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-keytouch.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-kye.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lcpower.ko 2024-07-26T11:54:09.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-led.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lenovo.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-dj.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-multitouch.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-ortek.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-penmount.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-petalynx.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-picolcd.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-pl.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-plantronics.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-primax.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-rmi.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-arvo.ko 2024-07-26T11:54:09.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-common.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-isku.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kone.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-konepure.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-lua.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-pyra.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-ryos.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-savu.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-saitek.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-samsung.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sensor-hub.ko 2024-07-26T11:54:09.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sjoy.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sony.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-speedlink.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-steelseries.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sunplus.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-thrustmaster.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tivo.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tmff.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-topseed.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-twinhan.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-uclogic.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-waltop.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-wiimote.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-xinmo.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zpff.ko 2024-07-26T11:54:09.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zydacron.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/uhid.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/wacom.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_balloon.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_utils.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_vmbus.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru3.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/acpi_power_meter.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7414.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7418.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adc128d818.ko 2024-07-26T11:54:09.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1025.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1026.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1029.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1031.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm9240.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ads7828.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7410.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7411.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7462.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7470.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7475.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7x10.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/amc6821.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/applesmc.ko 2024-07-26T11:54:09.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asb100.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asc7621.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asus_atk0110.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/atxp1.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/coretemp.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dme1737.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds1621.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds620.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc1403.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc6w201.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71805f.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71882fg.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f75375s.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fam15h_power.ko 2024-07-26T11:54:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fschmd.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g760a.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g762.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl518sm.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl520sm.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/hwmon-vid.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5500_temp.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5k_amb.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmaem.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmpex.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina209.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina2xx.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/it87.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k10temp.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k8temp.ko 2024-07-26T11:54:09.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lineage-pem.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm63.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm73.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm75.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm77.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm78.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm80.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm83.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm85.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm87.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm90.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm92.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm93.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95234.ko 2024-07-26T11:54:09.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95241.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95245.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc2945.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4151.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4215.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4222.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4245.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4260.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4261.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max16065.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1619.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1668.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max197.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6639.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6650.ko 2024-07-26T11:54:09.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6697.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/mcp3021.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6683.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775-core.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct7802.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87360.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87427.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pcf8591.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max16064.ko 2024-07-26T11:54:09.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max34440.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max8688.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/powr1220.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5627.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5636.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch56xx-common.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht15.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht21.ko 2024-07-26T11:54:09.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/shtc1.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sis5595.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47b397.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m1.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m192.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/thmc50.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp102.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp103.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp401.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp421.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via-cputemp.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via686a.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt1211.ko 2024-07-26T11:54:09.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt8231.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627ehf.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627hf.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83781d.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83791d.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83792d.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83793.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83795.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l785ts.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l786ng.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses 2024-07-26T11:54:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-i801.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-isch.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-07-26T11:54:09.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-parport.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-via.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-dev.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-mux.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-07-26T11:54:09.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-smbus.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-stub.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_cm.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_core.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_umad.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/iw_cm.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_cm.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4 2024-07-26T11:54:09.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp 2024-07-26T11:54:09.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/fm801-gp.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/gameport.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/joydev.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard/gpio_keys.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/appletouch.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/bcm5974.ko 2024-07-26T11:54:09.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/cyapatp.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/elan_i2c.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/sermouse.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_usb.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/vsxxxaa.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4/rmi_core.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/altera_ps2.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/arc_ps2.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/serio_raw.ko 2024-07-26T11:54:09.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/sparse-keymap.ko 2024-07-26T11:54:09.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds 2024-07-26T11:54:09.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-blinkm.ko 2024-07-26T11:54:09.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lm3530.ko 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lp3944.ko 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-ss4200.ko 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-07-26T11:54:09.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache/bcache.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-bio-prison.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache-smq.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-crypt.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-delay.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-flakey.ko 2024-07-26T11:54:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-log-userspace.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-multipath.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-queue-length.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-raid.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-round-robin.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-service-time.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-switch.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-thin-pool.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-verity.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid0.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid1.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid10.ko 2024-07-26T11:54:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid456.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptbase.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptctl.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptfc.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptlan.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptsas.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptscsih.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptspi.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_ich.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_sch.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/mfd-core.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/sm501.ko 2024-07-26T11:54:09.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/viperboard.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/vx855.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/wl1273-core.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds9802als.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds990x.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/bh1770glc.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710/cb710.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/at24.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-07-26T11:54:09.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/max6875.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/enclosure.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/hpilo.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29003.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29020.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-me.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-txe.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei.ko 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru 2024-07-26T11:54:09.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru/gru.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xp.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpc.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_7xx1.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_core.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tsl2550.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_balloon.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding 2024-07-26T11:54:09.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding/bonding.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53/b53_common.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/bcm-sf2.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6060.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dummy.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/eql.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-07-26T11:54:09.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/8390.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere/et131x.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera 2024-07-26T11:54:09.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-07-26T11:54:09.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-07-26T11:54:09.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec 2024-07-26T11:54:09.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dnet.ko 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet 2024-07-26T11:54:09.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ethoc.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/fealnx.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e100.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-07-26T11:54:09.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie 2024-07-26T11:54:09.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/jme.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/skge.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel 2024-07-26T11:54:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic 2024-07-26T11:54:09.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/atp.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-07-26T11:54:09.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis190.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis900.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro 2024-07-26T11:54:09.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/cassini.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/niu.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sungem.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti/tlan.ko 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via 2024-07-26T11:54:09.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/geneve.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154/fakelb.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ifb.ko 2024-07-26T11:54:09.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan/ipvlan.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvlan.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvtap.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-regmap.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mii.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/net_failover.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/netconsole.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/nlmon.ko 2024-07-26T11:54:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs-lynx.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/amd.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm7xxx.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm87xx.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/broadcom.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/cicada.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/davicom.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/dp83640.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/et1011c.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/icplus.ko 2024-07-26T11:54:09.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/lxt.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/marvell.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/micrel.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/national.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/phylink.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/qsemi.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/realtek.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/smsc.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/ste10Xp.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/vitesse.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/bsd_comp.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_async.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_deflate.ko 2024-07-26T11:54:09.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_generic.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_mppe.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_synctty.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppoe.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppox.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pptp.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slhc.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slip.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/sungem_phy.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tap.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_activebackup.ko 2024-07-26T11:54:09.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_broadcast.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_random.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tun.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/veth.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/virtio_net.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan/vxlan.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback/xen-netback.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netfront.ko 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb 2024-07-26T11:54:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb/ntb.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme-core.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_cs.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_pc.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_serial.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie 2024-07-26T11:54:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie/aer_inject.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/xen-pcifront.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/i82092.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/pd6729.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/yenta_socket.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acer-wmi.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acerhdf.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/apple-gmux.ko 2024-07-26T11:54:09.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-laptop.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-wmi.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/classmate-laptop.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/hdaps.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel_ips.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/msi-wmi.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/mxm-wmi.ko 2024-07-26T11:54:09.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-laptop.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-q10.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/topstar-laptop.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_haps.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi-bmof.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_common.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_msr.ko 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients 2024-07-26T11:54:09.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-gpio.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-ldisc.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps_parport.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/pps_core.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp_kvm.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/fmpm.ko 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc 2024-07-26T11:54:09.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-bq32k.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1286.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1307.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1374.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1511.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1553.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1672.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1742.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds2404.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds3232.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-em3027.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-fm3130.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl12022.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl1208.ko 2024-07-26T11:54:09.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m41t80.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t35.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t59.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-max6900.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-msm6242.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf2127.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf85063.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8523.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8563.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8583.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rp5c01.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rs5c372.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-07-26T11:54:09.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8025.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8581.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-x1205.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-9xxx.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-sas.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-xxxx.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/BusLogic.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/a100u2w.ko 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid 2024-07-26T11:54:09.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid/aacraid.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/advansys.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/am53c974.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/atp870u.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa/bfa.ko 2024-07-26T11:54:09.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ch.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor/csiostor.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dc395x.ko 2024-07-26T11:54:09.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dmx3191d.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r/esas2r.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esp_scsi.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/fcoe.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic/fnic.ko 2024-07-26T11:54:09.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hpsa.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hptiop.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hv_storvsc.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/initio.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ipr.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ips.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci/isci.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_tcp.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc/libfc.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi_tcp.ko 2024-07-26T11:54:09.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas/libsas.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc/lpfc.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas 2024-07-26T11:54:09.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas/mvsas.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvumi.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pmcraid.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla1280.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/raid_class.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_debug.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_fc.ko 2024-07-26T11:54:09.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_sas.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_spi.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_srp.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ses.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/st.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/stex.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/virtio_scsi.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/vmw_pvscsi.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/wd719x.ko 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb 2024-07-26T11:54:09.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb/ssb.ko 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback/tcm_loop.ko 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_file.ko 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_iblock.ko 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_mod.ko 2024-07-26T11:54:09.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_pscsi.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_user.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-07-26T11:54:09.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-07-26T11:54:09.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_gsm.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_hdlc.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/nozomi.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/arc_uart.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm/jsm.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core/ufshcd-core.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-07-26T11:54:09.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_aec.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_cif.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_pci_generic.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_sercos3.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-acm.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-wdm.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usblp.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usbtmc.ko 2024-07-26T11:54:09.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host/sl811-hcd.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/mdc800.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/microtek.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/adutux.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/appledisplay.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi26.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi62.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ezusb.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/idmouse.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/iowarrior.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/isight_firmware.ko 2024-07-26T11:54:09.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ldusb.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/legousbtower.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/trancevibrator.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usb3503.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usblcd.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usbsevseg.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/uss720.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/yurex.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy/phy-generic.ko 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial 2024-07-26T11:54:09.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/aircable.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ark3116.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/belkin_sa.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ch341.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cp210x.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cyberjack.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cypress_m8.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/digi_acceleport.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/empeg.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ftdi_sio.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/garmin_gps.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_edgeport.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_ti.ko 2024-07-26T11:54:09.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipaq.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipw.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ir-usb.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan_pda.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kl5kusb105.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kobil_sct.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mct_u232.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7720.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7840.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/navman.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/omninet.ko 2024-07-26T11:54:09.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/opticon.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/option.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/oti6858.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/pl2303.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcaux.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcserial.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/quatech2.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/safe_serial.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/sierra.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/spcp8x5.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ssu100.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/symbolserial.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-07-26T11:54:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_debug.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_wwan.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/visor.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/whiteheat.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/xsens_mt.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/uas.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-alauda.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-cypress.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-datafab.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-freecom.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-isd200.ko 2024-07-26T11:54:09.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-karma.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-onetouch.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-realtek.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr09.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr55.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-usbat.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/usb-storage.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-core.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-host.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci 2024-07-26T11:54:09.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_iotlb.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_net.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_scsi.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/apple_bl.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/lcd.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/platform_lcd.ko 2024-07-26T11:54:09.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_balloon.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_mmio.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_ring.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2482.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2490.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-07-26T11:54:09.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_smem.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_therm.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/wire.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim1535_wdt.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim7101_wdt.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/f71808e_wdt.ko 2024-07-26T11:54:09.976 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/hpwdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/i6300esb.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ib700wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ibmasr.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it8712f_wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it87_wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/machzwd.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/nv_tco.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_pci.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_usb.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sch311x_wdt.ko 2024-07-26T11:54:09.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/softdog.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sp5100_tco.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/via_wdt.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83877f_wdt.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83977f_wdt.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/wdt_pci.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/xen_wdt.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-acpi-processor.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-evtchn.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntalloc.ko 2024-07-26T11:54:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntdev.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-privcmd.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs/xenfs.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p/9p.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs/affs.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs/befs.ko 2024-07-26T11:54:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/binfmt_misc.ko 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs/btrfs.ko 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles/cachefiles.ko 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph/ceph.ko 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda/coda.ko 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs/cramfs.ko 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm 2024-07-26T11:54:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm/dlm.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs/ecryptfs.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs/f2fs.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/fat.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/msdos.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/vfat.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/cuse.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/fuse.ko 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2 2024-07-26T11:54:09.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2/gfs2.ko 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs/hfs.ko 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus/hfsplus.ko 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs/isofs.ko 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs/jfs.ko 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd/lockd.ko 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix 2024-07-26T11:54:09.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix/minix.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs/netfs.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfs.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv3.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv4.ko 2024-07-26T11:54:09.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/grace.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/nfs_acl.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd/nfsd.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2/nilfs2.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-celtic.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-centeuro.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-croatian.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-cyrillic.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-gaelic.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-greek.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-iceland.ko 2024-07-26T11:54:09.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-inuit.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-roman.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-romanian.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-turkish.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1250.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1251.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1255.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp737.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp775.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp850.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp852.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp855.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp857.ko 2024-07-26T11:54:09.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp860.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp861.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp862.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp863.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp864.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp865.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp866.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp869.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp874.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp932.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp936.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp949.ko 2024-07-26T11:54:09.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp950.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_euc-jp.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-1.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-13.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-14.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-15.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-2.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-3.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-4.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-5.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-6.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-7.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-9.ko 2024-07-26T11:54:09.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-r.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-ru.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-u.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_ucs2_utils.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_utf8.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-07-26T11:54:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs/overlay.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore/ramoops.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs/reiserfs.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs/romfs.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client/cifs.ko 2024-07-26T11:54:09.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_arc4.ko 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_md4.ko 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs/squashfs.ko 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv/sysv.ko 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf/udf.ko 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs/ufs.ko 2024-07-26T11:54:09.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs/xfs.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu/rcutorture.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/torture.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/asn1_encoder.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc-itu-t.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc8.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libaescfb.ko 2024-07-26T11:54:09.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libarc4.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libdes.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim/dimlib.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/libcrc32c.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lru_cache.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4_compress.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4hc_compress.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math/cordic.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6/raid6_pq.ko 2024-07-26T11:54:09.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon/reed_solomon.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_bm.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_fsm.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_kmp.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd/zstd_compress.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm/hwpoison-inject.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/6lowpan.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_dest.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_fragment.ko 2024-07-26T11:54:09.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_hop.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_ipv6.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_mobility.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_routing.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_udp.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/garp.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/mrp.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/p8022.ko 2024-07-26T11:54:09.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/psnap.ko 2024-07-26T11:54:09.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/stp.ko 2024-07-26T11:54:09.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q 2024-07-26T11:54:09.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q/8021q.ko 2024-07-26T11:54:09.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p 2024-07-26T11:54:09.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_fd.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_rdma.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_virtio.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv/batman-adv.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/br_netfilter.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/bridge.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-07-26T11:54:09.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_among.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arp.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_limit.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_log.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-07-26T11:54:09.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_snat.ko 2024-07-26T11:54:09.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_stp.ko 2024-07-26T11:54:09.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-07-26T11:54:09.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-07-26T11:54:09.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-07-26T11:54:09.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtables.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph/libceph.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/failover.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/pktgen.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp.ko 2024-07-26T11:54:09.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_diag.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv4.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv6.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver/dns_resolver.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/dsa_core.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_brcm.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_dsa.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_none.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_trailer.ko 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan 2024-07-26T11:54:10.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154_socket.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ah4.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/esp4.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/fou.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/gre.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/inet_diag.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_gre.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_tunnel.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_vti.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipcomp.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipip.ko 2024-07-26T11:54:10.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arp_tables.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_security.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-07-26T11:54:10.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_bic.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_dctcp.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_diag.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_highspeed.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_htcp.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_hybla.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_illinois.ko 2024-07-26T11:54:10.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_lp.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_scalable.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_vegas.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_veno.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_westwood.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_yeah.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tunnel4.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_diag.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_tunnel.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/xfrm4_tunnel.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ah6.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/esp6.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/fou6.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_tunnel.ko 2024-07-26T11:54:10.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_vti.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ipcomp6.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-07-26T11:54:10.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-07-26T11:54:10.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/sit.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/tunnel6.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/xfrm6_tunnel.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key/af_key.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_core.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_debugfs.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_eth.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip6.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_netlink.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ppp.ko 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc 2024-07-26T11:54:10.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc/llc.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154/mac802154.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls/mpls_gso.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-07-26T11:54:10.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-07-26T11:54:10.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conncount.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack.ko 2024-07-26T11:54:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_h323.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_irc.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sane.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sip.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_dup_netdev.ko 2024-07-26T11:54:10.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table_inet.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_log_syslog.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_amanda.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_ftp.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_irc.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_sip.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_tftp.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_synproxy_core.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_tables.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_acct.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_log.ko 2024-07-26T11:54:10.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_osf.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_queue.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_chain_nat.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_compat.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_ct.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_dup_netdev.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fib.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fwd_netdev.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_hash.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_limit.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_log.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_masq.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_nat.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_numgen.ko 2024-07-26T11:54:10.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_queue.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_quota.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_redir.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject_inet.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_socket.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_tunnel.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_AUDIT.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CHECKSUM.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CLASSIFY.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CT.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_DSCP.ko 2024-07-26T11:54:10.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HL.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HMARK.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_IDLETIMER.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LED.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LOG.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_MASQUERADE.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NETMAP.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFLOG.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFQUEUE.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_RATEEST.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_REDIRECT.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_SECMARK.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPMSS.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-07-26T11:54:10.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TEE.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TPROXY.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TRACE.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_addrtype.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_bpf.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cgroup.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cluster.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_comment.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connbytes.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlabel.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlimit.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connmark.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_conntrack.ko 2024-07-26T11:54:10.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cpu.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dccp.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_devgroup.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dscp.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ecn.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_esp.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hashlimit.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_helper.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hl.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipcomp.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_iprange.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipvs.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_l2tp.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_length.ko 2024-07-26T11:54:10.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_limit.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mac.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mark.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_multiport.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nat.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nfacct.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_osf.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_owner.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_physdev.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_pkttype.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_policy.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_quota.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_rateest.ko 2024-07-26T11:54:10.018 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_realm.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_recent.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_sctp.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_set.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_socket.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_state.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_statistic.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_string.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_tcpmss.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_time.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_u32.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink/netlink_diag.ko 2024-07-26T11:54:10.019 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh/nsh.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/openvswitch.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-geneve.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-gre.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-vxlan.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet/af_packet_diag.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_rdma.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_tcp.ko 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched 2024-07-26T11:54:10.020 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_csum.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_gact.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_mirred.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_nat.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_pedit.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_police.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_simple.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_skbedit.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_vlan.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_basic.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_bpf.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_flow.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_fw.ko 2024-07-26T11:54:10.021 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_route.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_u32.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_cmp.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_ipset.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_meta.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_nbyte.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_text.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_u32.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_choke.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_codel.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_drr.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_fq.ko 2024-07-26T11:54:10.022 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_gred.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hfsc.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hhf.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_htb.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_ingress.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio_lib.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_multiq.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_netem.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_pie.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_plug.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_prio.ko 2024-07-26T11:54:10.023 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_qfq.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_red.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfb.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfq.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_tbf.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_teql.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp_diag.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-07-26T11:54:10.024 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/sunrpc.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc_diag.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix/unix_diag.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-07-26T11:54:10.025 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock.ko 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_diag.ko 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_loopback.ko 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm/xfrm_ipcomp.ko 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys/trusted.ko 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias.bin 2024-07-26T11:54:10.026 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.alias.bin 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.bin 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.modinfo 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep.bin 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.devname 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.order 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.softdep 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols.bin 2024-07-26T11:54:10.027 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T11:54:10.031 DEBUG:teuthology.task.kernel:get_image_version: 6.10.0-g3e9255e90710 2024-07-26T11:54:10.032 DEBUG:teuthology.orchestra.run.smithi146:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout:postinstall scriptlet (using /bin/sh): 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/bin/kernel-install add 6.10.0-g3e9255e90710 /lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout:for file in vmlinuz System.map config; do 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout: if ! cmp --silent "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710"; then 2024-07-26T11:54:10.054 INFO:teuthology.orchestra.run.smithi146.stdout: cp "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710" 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout: fi 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -d "/lib/modules/6.10.0-g3e9255e90710/dtb" ] && \ 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout: ! diff -rq "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" >/dev/null 2>&1; then 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout: rm -rf "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout: cp -r "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout:if [ ! -e "/lib/modules/6.10.0-g3e9255e90710/modules.dep" ]; then 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/sbin/depmod 6.10.0-g3e9255e90710 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-07-26T11:54:10.055 INFO:teuthology.orchestra.run.smithi146.stdout:preuninstall scriptlet (using /bin/sh): 2024-07-26T11:54:10.056 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T11:54:10.056 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-install remove 6.10.0-g3e9255e90710 2024-07-26T11:54:10.056 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-07-26T11:54:10.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 68.el9 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8264254 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-26T11:54:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T11:54:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-07-26T11:54:10.130 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-26T11:54:10.130 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 6.10.0-g3e9255e90710 2024-07-26T11:54:10.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-26T11:54:10.711 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-07-26T11:54:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-26T11:54:12.085 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-07-26T11:54:12.087 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-07-26T11:54:12.102 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.kINCP53xTp 2024-07-26T11:54:12.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kINCP53xTp 2024-07-26T11:54:12.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.kINCP53xTp 2024-07-26T11:54:12.314 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.kINCP53xTp is 6KB 2024-07-26T11:54:12.364 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.kINCP53xTp 2024-07-26T11:54:12.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-07-26T11:54:12.438 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-26T11:54:12.438 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-26T11:54:12.438 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-26T11:54:12.438 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710.conf 2024-07-26T11:54:12.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710 2024-07-26T11:54:12.578 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-07-26T11:54:15.079 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-07-26T11:54:15.079 DEBUG:teuthology.orchestra.run.smithi040:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-07-26T11:54:15.156 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/System.map-6.10.0-g3e9255e90710 2024-07-26T11:54:15.156 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/config-6.10.0-g3e9255e90710 2024-07-26T11:54:15.156 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/vmlinuz-6.10.0-g3e9255e90710 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/System.map 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/config 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-07-26T11:54:15.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32c-intel.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx2.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-07-26T11:54:15.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-amd.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-intel.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ansi_cprng.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/anubis.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/arc4.ko 2024-07-26T11:54:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_memcpy.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_pq.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_raid6_recov.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_tx.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_xor.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/raid6test.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authenc.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authencesn.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blake2b_generic.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_common.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_generic.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/camellia_generic.ko 2024-07-26T11:54:15.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast5_generic.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast6_generic.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast_common.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ccm.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cmac.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crc32_generic.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_engine.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_user.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cts.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/des_generic.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/dh_generic.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecc.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecdh_generic.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/echainiv.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/essiv.ko 2024-07-26T11:54:15.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/fcrypt.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/khazad.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4hc.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/md4.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/michael_mic.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcbc.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcrypt.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/rmd160.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/seed.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/serpent_generic.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tcrypt.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tea.ko 2024-07-26T11:54:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_common.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_generic.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/vmac.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/wp512.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xcbc.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xor.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xxhash_generic.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_ipmi.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_pad.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/ec_sys.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/platform_profile.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbs.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbshc.ko 2024-07-26T11:54:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/video.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/acard-ahci.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ahci_platform.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ata_generic.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/libahci_platform.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_acpi.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ali.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_amd.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_artop.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atiixp.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atp867x.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd640.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd64x.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cypress.ko 2024-07-26T11:54:15.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_efar.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt366.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt37x.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x2n.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x3.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it8213.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it821x.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_jmicron.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_marvell.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_mpiix.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_netcell.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ninja32.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87410.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87415.ko 2024-07-26T11:54:15.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_oldpiix.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_opti.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_optidma.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pcmcia.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc2027x.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_piccolo.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_rdc.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sch.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_serverworks.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sil680.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sis.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sl82c105.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_triflex.ko 2024-07-26T11:54:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_via.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pdc_adma.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_inic162x.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_mv.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_nv.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_promise.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_qstor.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil24.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sis.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_svw.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sx4.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_uli.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_via.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_vsc.ko 2024-07-26T11:54:15.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay/ks0108.ko 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-i2c.ko 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-mmio.ko 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma/bcma.ko 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe/aoe.ko 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/brd.ko 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd 2024-07-26T11:54:15.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd/drbd.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/floppy.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/loop.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/nbd.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk/null_blk.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/pktcdvd.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/rbd.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/virtio_blk.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkfront.ko 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram 2024-07-26T11:54:15.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram/zram.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hangcheck-timer.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/amd-rng.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/intel-rng.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/via-rng.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/virtio-rng.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-07-26T11:54:15.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_si.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/lp.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave/mwave.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ppdev.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tlclk.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_atmel.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_infineon.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_nsc.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis.ko 2024-07-26T11:54:15.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/uv_mmtimer.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/virtio_console.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/p4-clockmod.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/powernow-k8.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/speedstep-lib.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp.ko 2024-07-26T11:54:15.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-aes.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-sha.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca/dca.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-07-26T11:54:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw/dw_dmac.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat/ioatdma.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/amd64_edac.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/e752x_edac.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/edac_mce_amd.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3000_edac.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3200_edac.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5100_edac.ko 2024-07-26T11:54:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5400_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7300_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7core_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i82975x_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/ie31200_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/sb_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/x38_edac.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/edd.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/iscsi_ibft.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-ich.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-viperboard.ko 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid 2024-07-26T11:54:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-appleir.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-aureal.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-axff.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-dr.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elecom.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elo.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-emsff.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gaff.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gt683r.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gyration.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-kbd.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-mouse.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtekff.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-hyperv.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-icade.ko 2024-07-26T11:54:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-keytouch.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-kye.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lcpower.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-led.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lenovo.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-dj.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-multitouch.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-ortek.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-penmount.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-petalynx.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-picolcd.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-pl.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-plantronics.ko 2024-07-26T11:54:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-primax.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-rmi.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-arvo.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-common.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-isku.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kone.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-konepure.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-lua.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-pyra.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-ryos.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-savu.ko 2024-07-26T11:54:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-saitek.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-samsung.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sensor-hub.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sjoy.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sony.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-speedlink.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-steelseries.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sunplus.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-thrustmaster.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tivo.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tmff.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-topseed.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-twinhan.ko 2024-07-26T11:54:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-uclogic.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-waltop.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-wiimote.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-xinmo.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zpff.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zydacron.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/uhid.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/wacom.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_balloon.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_utils.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_vmbus.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru3.ko 2024-07-26T11:54:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/acpi_power_meter.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7414.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7418.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adc128d818.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1025.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1026.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1029.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1031.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm9240.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ads7828.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7410.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7411.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7462.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7470.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7475.ko 2024-07-26T11:54:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7x10.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/amc6821.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/applesmc.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asb100.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asc7621.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asus_atk0110.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/atxp1.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/coretemp.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dme1737.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds1621.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds620.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc1403.ko 2024-07-26T11:54:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc6w201.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71805f.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71882fg.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f75375s.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fam15h_power.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fschmd.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g760a.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g762.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl518sm.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl520sm.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/hwmon-vid.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5500_temp.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5k_amb.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmaem.ko 2024-07-26T11:54:15.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmpex.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina209.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina2xx.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/it87.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k10temp.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k8temp.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lineage-pem.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm63.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm73.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm75.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm77.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm78.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm80.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm83.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm85.ko 2024-07-26T11:54:15.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm87.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm90.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm92.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm93.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95234.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95241.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95245.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc2945.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4151.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4215.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4222.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4245.ko 2024-07-26T11:54:15.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4260.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4261.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max16065.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1619.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1668.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max197.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6639.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6650.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6697.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/mcp3021.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6683.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775-core.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775.ko 2024-07-26T11:54:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct7802.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87360.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87427.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pcf8591.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max16064.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max34440.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max8688.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-07-26T11:54:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/powr1220.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5627.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5636.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch56xx-common.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht15.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht21.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/shtc1.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sis5595.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47b397.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m1.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m192.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/thmc50.ko 2024-07-26T11:54:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp102.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp103.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp401.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp421.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via-cputemp.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via686a.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt1211.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt8231.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627ehf.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627hf.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83781d.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83791d.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83792d.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83793.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83795.ko 2024-07-26T11:54:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l785ts.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l786ng.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-07-26T11:54:15.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-i801.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-isch.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-parport.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-07-26T11:54:15.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-via.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-dev.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-mux.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-smbus.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-stub.ko 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core 2024-07-26T11:54:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_cm.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_core.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_umad.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/iw_cm.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_cm.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5 2024-07-26T11:54:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-07-26T11:54:15.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/fm801-gp.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/gameport.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/joydev.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard/gpio_keys.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/appletouch.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/bcm5974.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/cyapatp.ko 2024-07-26T11:54:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/elan_i2c.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/sermouse.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_usb.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/vsxxxaa.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4/rmi_core.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/altera_ps2.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/arc_ps2.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/serio_raw.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/sparse-keymap.ko 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds 2024-07-26T11:54:15.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-blinkm.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lm3530.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lp3944.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-ss4200.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache 2024-07-26T11:54:15.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache/bcache.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-bio-prison.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache-smq.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-crypt.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-delay.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-flakey.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-log-userspace.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-multipath.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-queue-length.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-raid.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-round-robin.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-service-time.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-switch.ko 2024-07-26T11:54:15.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-thin-pool.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-verity.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid0.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid1.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid10.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid456.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptbase.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptctl.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptfc.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptlan.ko 2024-07-26T11:54:15.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptsas.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptscsih.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptspi.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_ich.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_sch.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/mfd-core.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/sm501.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/viperboard.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/vx855.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/wl1273-core.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds9802als.ko 2024-07-26T11:54:15.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds990x.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/bh1770glc.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710/cb710.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/at24.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/max6875.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/enclosure.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/hpilo.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29003.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29020.ko 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d 2024-07-26T11:54:15.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-me.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-txe.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru/gru.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xp.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpc.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_7xx1.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_core.ko 2024-07-26T11:54:15.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tsl2550.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_balloon.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding/bonding.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53/b53_common.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/bcm-sf2.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6060.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dummy.ko 2024-07-26T11:54:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/eql.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/8390.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere 2024-07-26T11:54:15.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere/et131x.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e 2024-07-26T11:54:15.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade 2024-07-26T11:54:15.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco 2024-07-26T11:54:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dnet.ko 2024-07-26T11:54:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ethoc.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/fealnx.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e100.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-07-26T11:54:15.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/jme.ko 2024-07-26T11:54:15.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/skge.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge 2024-07-26T11:54:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-07-26T11:54:15.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/atp.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-07-26T11:54:15.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis190.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis900.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun 2024-07-26T11:54:15.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/cassini.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/niu.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sungem.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti/tlan.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-07-26T11:54:15.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/geneve.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154/fakelb.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ifb.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan/ipvlan.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvlan.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvtap.ko 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio 2024-07-26T11:54:15.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-regmap.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mii.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/net_failover.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/netconsole.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/nlmon.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs-lynx.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/amd.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm7xxx.ko 2024-07-26T11:54:15.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm87xx.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/broadcom.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/cicada.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/davicom.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/dp83640.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/et1011c.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/icplus.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/lxt.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/marvell.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/micrel.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/national.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/phylink.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/qsemi.ko 2024-07-26T11:54:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/realtek.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/smsc.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/ste10Xp.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/vitesse.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/bsd_comp.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_async.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_deflate.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_generic.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_mppe.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_synctty.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppoe.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppox.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pptp.ko 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip 2024-07-26T11:54:15.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slhc.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slip.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/sungem_phy.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tap.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_activebackup.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_broadcast.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_random.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tun.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/veth.ko 2024-07-26T11:54:15.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/virtio_net.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan/vxlan.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback/xen-netback.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netfront.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb/ntb.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme-core.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme.ko 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport 2024-07-26T11:54:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_cs.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_pc.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_serial.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie/aer_inject.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/xen-pcifront.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/i82092.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/pd6729.ko 2024-07-26T11:54:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/yenta_socket.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acer-wmi.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acerhdf.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/apple-gmux.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-laptop.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-wmi.ko 2024-07-26T11:54:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/classmate-laptop.ko 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/hdaps.ko 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel 2024-07-26T11:54:15.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-07-26T11:54:15.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel_ips.ko 2024-07-26T11:54:15.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/msi-wmi.ko 2024-07-26T11:54:15.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/mxm-wmi.ko 2024-07-26T11:54:15.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-07-26T11:54:15.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-laptop.ko 2024-07-26T11:54:15.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-q10.ko 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/topstar-laptop.ko 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_haps.ko 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi-bmof.ko 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi.ko 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap 2024-07-26T11:54:15.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_common.ko 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_msr.ko 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-gpio.ko 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-ldisc.ko 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps_parport.ko 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/pps_core.ko 2024-07-26T11:54:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp.ko 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp_kvm.ko 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/fmpm.ko 2024-07-26T11:54:15.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-bq32k.ko 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1286.ko 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1307.ko 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1374.ko 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1511.ko 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1553.ko 2024-07-26T11:54:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1672.ko 2024-07-26T11:54:15.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1742.ko 2024-07-26T11:54:15.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds2404.ko 2024-07-26T11:54:15.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds3232.ko 2024-07-26T11:54:15.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-em3027.ko 2024-07-26T11:54:15.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-fm3130.ko 2024-07-26T11:54:15.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl12022.ko 2024-07-26T11:54:15.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl1208.ko 2024-07-26T11:54:15.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m41t80.ko 2024-07-26T11:54:15.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t35.ko 2024-07-26T11:54:15.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t59.ko 2024-07-26T11:54:15.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-max6900.ko 2024-07-26T11:54:15.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-msm6242.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf2127.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf85063.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8523.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8563.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8583.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rp5c01.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rs5c372.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8025.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8581.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-x1205.ko 2024-07-26T11:54:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-9xxx.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-sas.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-xxxx.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/BusLogic.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/a100u2w.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid/aacraid.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/advansys.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/am53c974.ko 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr 2024-07-26T11:54:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/atp870u.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa/bfa.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ch.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor/csiostor.ko 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi 2024-07-26T11:54:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dc395x.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dmx3191d.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r/esas2r.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esp_scsi.ko 2024-07-26T11:54:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/fcoe.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic/fnic.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hpsa.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hptiop.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hv_storvsc.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/initio.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ipr.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ips.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci/isci.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_tcp.ko 2024-07-26T11:54:15.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc/libfc.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi_tcp.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas/libsas.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc/lpfc.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-07-26T11:54:15.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas/mvsas.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvumi.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pmcraid.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla1280.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-07-26T11:54:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/raid_class.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_debug.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_fc.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_sas.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_spi.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_srp.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ses.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/st.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/stex.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/virtio_scsi.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/vmw_pvscsi.ko 2024-07-26T11:54:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/wd719x.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb/ssb.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback/tcm_loop.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_file.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_iblock.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_mod.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_pscsi.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_user.ko 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc 2024-07-26T11:54:15.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-07-26T11:54:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_gsm.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_hdlc.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/nozomi.ko 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial 2024-07-26T11:54:15.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/arc_uart.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm/jsm.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core/ufshcd-core.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_aec.ko 2024-07-26T11:54:15.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_cif.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_pci_generic.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_sercos3.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-acm.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-wdm.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usblp.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usbtmc.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host/sl811-hcd.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/mdc800.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/microtek.ko 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc 2024-07-26T11:54:15.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/adutux.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/appledisplay.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi26.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi62.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ezusb.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/idmouse.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/iowarrior.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/isight_firmware.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ldusb.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/legousbtower.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/trancevibrator.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usb3503.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usblcd.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usbsevseg.ko 2024-07-26T11:54:15.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/uss720.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/yurex.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy/phy-generic.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/aircable.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ark3116.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/belkin_sa.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ch341.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cp210x.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cyberjack.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cypress_m8.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/digi_acceleport.ko 2024-07-26T11:54:15.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/empeg.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ftdi_sio.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/garmin_gps.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_edgeport.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_ti.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipaq.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipw.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ir-usb.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan_pda.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kl5kusb105.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kobil_sct.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mct_u232.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7720.ko 2024-07-26T11:54:15.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7840.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/navman.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/omninet.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/opticon.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/option.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/oti6858.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/pl2303.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcaux.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcserial.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/quatech2.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/safe_serial.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/sierra.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/spcp8x5.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ssu100.ko 2024-07-26T11:54:15.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/symbolserial.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_debug.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_wwan.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/visor.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/whiteheat.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/xsens_mt.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/uas.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-alauda.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-cypress.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-datafab.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-07-26T11:54:15.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-freecom.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-isd200.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-karma.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-onetouch.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-realtek.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr09.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr55.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-usbat.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/usb-storage.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-core.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-host.ko 2024-07-26T11:54:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_iotlb.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_net.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_scsi.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/apple_bl.ko 2024-07-26T11:54:15.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/lcd.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/platform_lcd.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_balloon.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_mmio.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_ring.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2482.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2490.ko 2024-07-26T11:54:15.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_smem.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_therm.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/wire.ko 2024-07-26T11:54:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim1535_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim7101_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/f71808e_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/hpwdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/i6300esb.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ib700wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ibmasr.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it8712f_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it87_wdt.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/machzwd.ko 2024-07-26T11:54:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/nv_tco.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_pci.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_usb.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sch311x_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/softdog.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sp5100_tco.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/via_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83877f_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83977f_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/wdt_pci.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/xen_wdt.ko 2024-07-26T11:54:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-acpi-processor.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-evtchn.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntalloc.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntdev.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-privcmd.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs/xenfs.ko 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p 2024-07-26T11:54:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p/9p.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs/affs.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs/befs.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/binfmt_misc.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs/btrfs.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles/cachefiles.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph/ceph.ko 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda 2024-07-26T11:54:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda/coda.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs/cramfs.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm/dlm.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs/ecryptfs.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs/f2fs.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/fat.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/msdos.ko 2024-07-26T11:54:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/vfat.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/cuse.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/fuse.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2/gfs2.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs/hfs.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus/hfsplus.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs/isofs.ko 2024-07-26T11:54:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs/jfs.ko 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd/lockd.ko 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix/minix.ko 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs/netfs.ko 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-07-26T11:54:15.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfs.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv3.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv4.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/grace.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/nfs_acl.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd/nfsd.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2/nilfs2.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-celtic.ko 2024-07-26T11:54:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-centeuro.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-croatian.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-cyrillic.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-gaelic.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-greek.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-iceland.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-inuit.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-roman.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-romanian.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-turkish.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1250.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1251.ko 2024-07-26T11:54:15.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1255.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp737.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp775.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp850.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp852.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp855.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp857.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp860.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp861.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp862.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp863.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp864.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp865.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp866.ko 2024-07-26T11:54:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp869.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp874.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp932.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp936.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp949.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp950.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_euc-jp.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-1.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-13.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-14.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-15.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-2.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-3.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-4.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-5.ko 2024-07-26T11:54:15.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-6.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-7.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-9.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-r.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-ru.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-u.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_ucs2_utils.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_utf8.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-07-26T11:54:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs/overlay.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore/ramoops.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs/reiserfs.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs/romfs.ko 2024-07-26T11:54:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client/cifs.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_arc4.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_md4.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs/squashfs.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv/sysv.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf/udf.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs/ufs.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs/xfs.ko 2024-07-26T11:54:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu/rcutorture.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/torture.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/asn1_encoder.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc-itu-t.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc8.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libaescfb.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libarc4.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libdes.ko 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim 2024-07-26T11:54:15.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim/dimlib.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/libcrc32c.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lru_cache.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4_compress.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4hc_compress.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math/cordic.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6/raid6_pq.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon/reed_solomon.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_bm.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_fsm.ko 2024-07-26T11:54:15.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_kmp.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd/zstd_compress.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm/hwpoison-inject.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/6lowpan.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_dest.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_fragment.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_hop.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_ipv6.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_mobility.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_routing.ko 2024-07-26T11:54:15.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_udp.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/garp.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/mrp.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/p8022.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/psnap.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/stp.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q/8021q.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_fd.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_rdma.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_virtio.ko 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv 2024-07-26T11:54:15.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv/batman-adv.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/br_netfilter.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/bridge.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_among.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arp.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_limit.ko 2024-07-26T11:54:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_log.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_snat.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_stp.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtables.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-07-26T11:54:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph/libceph.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/failover.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/pktgen.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_diag.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv4.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv6.ko 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver 2024-07-26T11:54:15.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver/dns_resolver.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/dsa_core.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_brcm.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_dsa.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_none.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_trailer.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154_socket.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ah4.ko 2024-07-26T11:54:15.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/esp4.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/fou.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/gre.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/inet_diag.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_gre.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_tunnel.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_vti.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipcomp.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipip.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arp_tables.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-07-26T11:54:15.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_security.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-07-26T11:54:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_bic.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_dctcp.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_diag.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_highspeed.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_htcp.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_hybla.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_illinois.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_lp.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_scalable.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_vegas.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_veno.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_westwood.ko 2024-07-26T11:54:15.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_yeah.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tunnel4.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_diag.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_tunnel.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/xfrm4_tunnel.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ah6.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/esp6.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/fou6.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_tunnel.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_vti.ko 2024-07-26T11:54:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ipcomp6.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-07-26T11:54:15.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/sit.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/tunnel6.ko 2024-07-26T11:54:15.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/xfrm6_tunnel.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key/af_key.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_core.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_debugfs.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_eth.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip6.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_netlink.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ppp.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc/llc.ko 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154 2024-07-26T11:54:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154/mac802154.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls/mpls_gso.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-07-26T11:54:15.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-07-26T11:54:15.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conncount.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_h323.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_irc.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-07-26T11:54:15.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sane.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sip.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_dup_netdev.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table_inet.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_log_syslog.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat.ko 2024-07-26T11:54:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_amanda.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_ftp.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_irc.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_sip.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_tftp.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_synproxy_core.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_tables.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_acct.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_log.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_osf.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_queue.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_chain_nat.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_compat.ko 2024-07-26T11:54:15.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_ct.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_dup_netdev.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fib.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fwd_netdev.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_hash.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_limit.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_log.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_masq.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_nat.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_numgen.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_queue.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_quota.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_redir.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject_inet.ko 2024-07-26T11:54:15.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_socket.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_tunnel.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_AUDIT.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CHECKSUM.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CLASSIFY.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CT.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_DSCP.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HL.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HMARK.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_IDLETIMER.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LED.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LOG.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_MASQUERADE.ko 2024-07-26T11:54:15.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NETMAP.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFLOG.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFQUEUE.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_RATEEST.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_REDIRECT.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_SECMARK.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPMSS.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TEE.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TPROXY.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TRACE.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_addrtype.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_bpf.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cgroup.ko 2024-07-26T11:54:15.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cluster.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_comment.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connbytes.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlabel.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlimit.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connmark.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_conntrack.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cpu.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dccp.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_devgroup.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dscp.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ecn.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_esp.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hashlimit.ko 2024-07-26T11:54:15.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_helper.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hl.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipcomp.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_iprange.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipvs.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_l2tp.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_length.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_limit.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mac.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mark.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_multiport.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nat.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nfacct.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_osf.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_owner.ko 2024-07-26T11:54:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_physdev.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_pkttype.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_policy.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_quota.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_rateest.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_realm.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_recent.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_sctp.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_set.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_socket.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_state.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_statistic.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_string.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_tcpmss.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_time.ko 2024-07-26T11:54:15.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_u32.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink/netlink_diag.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh/nsh.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/openvswitch.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-geneve.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-gre.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-vxlan.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet/af_packet_diag.ko 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds 2024-07-26T11:54:15.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_rdma.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_tcp.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_csum.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_gact.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_mirred.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_nat.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_pedit.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_police.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_simple.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_skbedit.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_vlan.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_basic.ko 2024-07-26T11:54:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_bpf.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_flow.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_fw.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_route.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_u32.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_cmp.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_ipset.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_meta.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_nbyte.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_text.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_u32.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_choke.ko 2024-07-26T11:54:15.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_codel.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_drr.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_fq.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_gred.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hfsc.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hhf.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_htb.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_ingress.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio_lib.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_multiq.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_netem.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_pie.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_plug.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_prio.ko 2024-07-26T11:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_qfq.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_red.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfb.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfq.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_tbf.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_teql.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp_diag.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/sunrpc.ko 2024-07-26T11:54:15.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc_diag.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix/unix_diag.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_diag.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_loopback.ko 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm 2024-07-26T11:54:15.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm/xfrm_ipcomp.ko 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys/trusted.ko 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias.bin 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.alias.bin 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.bin 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.modinfo 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep 2024-07-26T11:54:15.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep.bin 2024-07-26T11:54:15.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.devname 2024-07-26T11:54:15.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.order 2024-07-26T11:54:15.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.softdep 2024-07-26T11:54:15.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols 2024-07-26T11:54:15.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols.bin 2024-07-26T11:54:15.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T11:54:15.304 DEBUG:teuthology.task.kernel:get_image_version: 6.10.0-g3e9255e90710 2024-07-26T11:54:15.304 DEBUG:teuthology.orchestra.run.smithi040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-07-26T11:54:15.328 INFO:teuthology.orchestra.run.smithi040.stdout:postinstall scriptlet (using /bin/sh): 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: /usr/bin/kernel-install add 6.10.0-g3e9255e90710 /lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:for file in vmlinuz System.map config; do 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: if ! cmp --silent "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710"; then 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: cp "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710" 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: fi 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:done 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -d "/lib/modules/6.10.0-g3e9255e90710/dtb" ] && \ 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: ! diff -rq "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" >/dev/null 2>&1; then 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: rm -rf "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: cp -r "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:if [ ! -e "/lib/modules/6.10.0-g3e9255e90710/modules.dep" ]; then 2024-07-26T11:54:15.329 INFO:teuthology.orchestra.run.smithi040.stdout: /usr/sbin/depmod 6.10.0-g3e9255e90710 2024-07-26T11:54:15.330 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-07-26T11:54:15.330 INFO:teuthology.orchestra.run.smithi040.stdout:preuninstall scriptlet (using /bin/sh): 2024-07-26T11:54:15.330 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T11:54:15.330 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-install remove 6.10.0-g3e9255e90710 2024-07-26T11:54:15.330 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-07-26T11:54:15.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-07-26T11:54:15.414 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-07-26T11:54:15.414 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-07-26T11:54:15.414 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 68.el9 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8264254 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-26T11:54:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T11:54:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-07-26T11:54:15.417 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-26T11:54:15.417 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 6.10.0-g3e9255e90710 2024-07-26T11:54:15.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-26T11:54:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-07-26T11:54:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-26T11:54:17.456 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-07-26T11:54:17.459 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-07-26T11:54:17.474 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.0MV6pjkYRH 2024-07-26T11:54:17.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0MV6pjkYRH 2024-07-26T11:54:17.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.0MV6pjkYRH 2024-07-26T11:54:17.679 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.0MV6pjkYRH is 6KB 2024-07-26T11:54:17.729 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.0MV6pjkYRH 2024-07-26T11:54:17.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-07-26T11:54:17.806 INFO:teuthology.orchestra.run.smithi040.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-26T11:54:17.806 INFO:teuthology.orchestra.run.smithi040.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-26T11:54:17.806 INFO:teuthology.orchestra.run.smithi040.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-26T11:54:17.806 INFO:teuthology.orchestra.run.smithi040.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710.conf 2024-07-26T11:54:17.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710 2024-07-26T11:54:17.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-07-26T11:54:38.587 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi076.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-07-26T11:54:38.587 DEBUG:teuthology.orchestra.run.smithi076:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-07-26T11:54:38.667 INFO:teuthology.orchestra.run.smithi076.stdout:/boot/System.map-6.10.0-g3e9255e90710 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/boot/config-6.10.0-g3e9255e90710 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/boot/vmlinuz-6.10.0-g3e9255e90710 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/System.map 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/config 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-07-26T11:54:38.668 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crc32c-intel.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-avx2.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-07-26T11:54:38.669 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-amd.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm-intel.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/arch/x86/kvm/kvm.ko 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto 2024-07-26T11:54:38.670 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ansi_cprng.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/anubis.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/arc4.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_memcpy.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_pq.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_raid6_recov.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_tx.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/async_xor.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/async_tx/raid6test.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authenc.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/authencesn.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blake2b_generic.ko 2024-07-26T11:54:38.671 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_common.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/blowfish_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/camellia_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast5_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast6_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cast_common.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ccm.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cmac.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crc32_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_engine.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/crypto_user.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/cts.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/des_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/dh_generic.ko 2024-07-26T11:54:38.672 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecc.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/ecdh_generic.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/echainiv.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/essiv.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/fcrypt.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/khazad.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/lz4hc.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/md4.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/michael_mic.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcbc.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/pcrypt.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/rmd160.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/seed.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/serpent_generic.ko 2024-07-26T11:54:38.673 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tcrypt.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/tea.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_common.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/twofish_generic.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/vmac.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/wp512.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xcbc.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xor.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/crypto/xxhash_generic.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_ipmi.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/acpi_pad.ko 2024-07-26T11:54:38.674 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/ec_sys.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/platform_profile.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbs.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/sbshc.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/acpi/video.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/acard-ahci.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ahci_platform.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/ata_generic.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/libahci_platform.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_acpi.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ali.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_amd.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_artop.ko 2024-07-26T11:54:38.675 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atiixp.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_atp867x.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd640.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cmd64x.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_cypress.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_efar.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt366.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt37x.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x2n.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_hpt3x3.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it8213.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_it821x.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_jmicron.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_marvell.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_mpiix.ko 2024-07-26T11:54:38.676 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_netcell.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ninja32.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87410.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_ns87415.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_oldpiix.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_opti.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_optidma.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pcmcia.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc2027x.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_piccolo.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_rdc.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sch.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_serverworks.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sil680.ko 2024-07-26T11:54:38.677 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sis.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_sl82c105.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_triflex.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pata_via.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/pdc_adma.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_inic162x.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_mv.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_nv.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_promise.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_qstor.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sil24.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sis.ko 2024-07-26T11:54:38.678 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_svw.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_sx4.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_uli.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_via.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ata/sata_vsc.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/auxdisplay/ks0108.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-i2c.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/base/regmap/regmap-mmio.ko 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma 2024-07-26T11:54:38.679 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/bcma/bcma.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/aoe/aoe.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/brd.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/drbd/drbd.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/floppy.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/loop.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/nbd.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/null_blk/null_blk.ko 2024-07-26T11:54:38.680 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/pktcdvd.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/rbd.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/virtio_blk.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/xen-blkfront.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/block/zram/zram.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hangcheck-timer.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/amd-rng.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/intel-rng.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-07-26T11:54:38.681 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/via-rng.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/hw_random/virtio-rng.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_si.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/lp.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/mwave/mwave.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/ppdev.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tlclk.ko 2024-07-26T11:54:38.682 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_atmel.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_infineon.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_nsc.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/uv_mmtimer.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/char/virtio_console.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/p4-clockmod.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/powernow-k8.ko 2024-07-26T11:54:38.683 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/cpufreq/speedstep-lib.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/ccp/ccp.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-aes.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/padlock-sha.ko 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio 2024-07-26T11:54:38.684 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dca/dca.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/dw/dw_dmac.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/dma/ioat/ioatdma.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/amd64_edac.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/e752x_edac.ko 2024-07-26T11:54:38.685 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/edac_mce_amd.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3000_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i3200_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5100_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i5400_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7300_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i7core_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/i82975x_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/ie31200_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/sb_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/edac/x38_edac.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/edd.ko 2024-07-26T11:54:38.686 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/firmware/iscsi_ibft.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-ich.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/gpio/gpio-viperboard.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-appleir.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-aureal.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-axff.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-dr.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elecom.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-elo.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-emsff.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gaff.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gt683r.ko 2024-07-26T11:54:38.687 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-gyration.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-kbd.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtek-mouse.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-holtekff.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-hyperv.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-icade.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-keytouch.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-kye.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lcpower.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-led.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-lenovo.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-dj.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-multitouch.ko 2024-07-26T11:54:38.688 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-ortek.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-penmount.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-petalynx.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-picolcd.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-pl.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-plantronics.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-primax.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-rmi.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-arvo.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-common.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-isku.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kone.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-07-26T11:54:38.689 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-konepure.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-lua.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-pyra.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-ryos.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat-savu.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-roccat.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-saitek.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-samsung.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sensor-hub.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sjoy.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sony.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-speedlink.ko 2024-07-26T11:54:38.690 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-steelseries.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-sunplus.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-thrustmaster.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tivo.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-tmff.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-topseed.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-twinhan.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-uclogic.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-waltop.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-wiimote.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-xinmo.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zpff.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/hid-zydacron.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/uhid.ko 2024-07-26T11:54:38.691 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hid/wacom.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_balloon.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_utils.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hv/hv_vmbus.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/abituguru3.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/acpi_power_meter.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7414.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ad7418.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adc128d818.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1025.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1026.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1029.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm1031.ko 2024-07-26T11:54:38.692 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adm9240.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ads7828.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7410.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7411.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7462.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7470.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7475.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/adt7x10.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/amc6821.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/applesmc.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asb100.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asc7621.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/asus_atk0110.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/atxp1.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/coretemp.ko 2024-07-26T11:54:38.693 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/dme1737.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds1621.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ds620.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc1403.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/emc6w201.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71805f.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f71882fg.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/f75375s.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fam15h_power.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/fschmd.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g760a.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/g762.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl518sm.ko 2024-07-26T11:54:38.694 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/gl520sm.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/hwmon-vid.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5500_temp.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/i5k_amb.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmaem.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ibmpex.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina209.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ina2xx.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/it87.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k10temp.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/k8temp.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lineage-pem.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm63.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm73.ko 2024-07-26T11:54:38.695 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm75.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm77.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm78.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm80.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm83.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm85.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm87.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm90.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm92.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm93.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95234.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95241.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/lm95245.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc2945.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4151.ko 2024-07-26T11:54:38.696 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4215.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4222.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4245.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4260.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/ltc4261.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max16065.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1619.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max1668.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max197.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6639.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6650.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/max6697.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/mcp3021.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6683.ko 2024-07-26T11:54:38.697 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775-core.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct6775.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/nct7802.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87360.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pc87427.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pcf8591.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max16064.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max34440.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/max8688.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-07-26T11:54:38.698 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/powr1220.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5627.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch5636.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sch56xx-common.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht15.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sht21.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/shtc1.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/sis5595.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47b397.ko 2024-07-26T11:54:38.699 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m1.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/smsc47m192.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/thmc50.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp102.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp103.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp401.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/tmp421.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via-cputemp.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/via686a.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt1211.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/vt8231.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627ehf.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83627hf.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83781d.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83791d.ko 2024-07-26T11:54:38.700 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83792d.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83793.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83795.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l785ts.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/hwmon/w83l786ng.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-07-26T11:54:38.701 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-i801.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-isch.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-parport.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-07-26T11:54:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-via.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-dev.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-mux.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-smbus.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/i2c/i2c-stub.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_cm.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_core.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_umad.ko 2024-07-26T11:54:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/iw_cm.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_cm.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib 2024-07-26T11:54:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/fm801-gp.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/gameport/gameport.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/joydev.ko 2024-07-26T11:54:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/keyboard/gpio_keys.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/appletouch.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/bcm5974.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/cyapatp.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/elan_i2c.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/sermouse.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/synaptics_usb.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/mouse/vsxxxaa.ko 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4 2024-07-26T11:54:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/rmi4/rmi_core.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/altera_ps2.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/arc_ps2.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/serio/serio_raw.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/input/sparse-keymap.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-blinkm.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lm3530.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-lp3944.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/leds-ss4200.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-07-26T11:54:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/bcache/bcache.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-bio-prison.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache-smq.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-cache.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-crypt.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-delay.ko 2024-07-26T11:54:38.708 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-flakey.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-log-userspace.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-multipath.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-queue-length.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-raid.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-round-robin.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-service-time.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-switch.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-thin-pool.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/dm-verity.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid0.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid1.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid10.ko 2024-07-26T11:54:38.709 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/md/raid456.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptbase.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptctl.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptfc.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptlan.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptsas.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptscsih.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/message/fusion/mptspi.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_ich.ko 2024-07-26T11:54:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/lpc_sch.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/mfd-core.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/sm501.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/viperboard.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/vx855.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/mfd/wl1273-core.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds9802als.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/apds990x.ko 2024-07-26T11:54:38.711 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/bh1770glc.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/cb710/cb710.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/at24.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/eeprom/max6875.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/enclosure.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/hpilo.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29003.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/isl29020.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-07-26T11:54:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-me.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei-txe.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/mei/mei.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-gru/gru.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xp.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpc.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_7xx1.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tifm_core.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/tsl2550.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_balloon.ko 2024-07-26T11:54:38.713 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/bonding/bonding.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/b53/b53_common.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/bcm-sf2.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6060.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/dummy.ko 2024-07-26T11:54:38.714 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/eql.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/8390.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-07-26T11:54:38.715 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/agere/et131x.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-07-26T11:54:38.716 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-07-26T11:54:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-07-26T11:54:38.718 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-07-26T11:54:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/dnet.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ethoc.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/fealnx.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e100.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e 2024-07-26T11:54:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-07-26T11:54:38.721 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/jme.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/skge.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4 2024-07-26T11:54:38.722 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-07-26T11:54:38.723 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek 2024-07-26T11:54:38.724 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/atp.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis190.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sis/sis900.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-07-26T11:54:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/cassini.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/niu.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sungem.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-07-26T11:54:38.726 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/ti/tlan.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/geneve.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154 2024-07-26T11:54:38.727 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ieee802154/fakelb.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ifb.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ipvlan/ipvlan.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvlan.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/macvtap.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mdio/mdio-regmap.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/mii.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/net_failover.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/netconsole.ko 2024-07-26T11:54:38.728 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/nlmon.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs-lynx.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/amd.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm7xxx.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/bcm87xx.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/broadcom.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/cicada.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/davicom.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/dp83640.ko 2024-07-26T11:54:38.729 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/et1011c.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/icplus.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/lxt.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/marvell.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/micrel.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/national.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/phylink.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/qsemi.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/realtek.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/smsc.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/ste10Xp.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/phy/vitesse.ko 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp 2024-07-26T11:54:38.730 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/bsd_comp.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_async.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_deflate.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_generic.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_mppe.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/ppp_synctty.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppoe.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pppox.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/ppp/pptp.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slhc.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/slip/slip.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/sungem_phy.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tap.ko 2024-07-26T11:54:38.731 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_activebackup.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_broadcast.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_random.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/tun.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/veth.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/virtio_net.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan 2024-07-26T11:54:38.732 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/vxlan/vxlan.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netback/xen-netback.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/net/xen-netfront.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ntb/ntb.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme-core.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/nvme/host/nvme.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_cs.ko 2024-07-26T11:54:38.733 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_pc.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/parport/parport_serial.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/pcie/aer_inject.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pci/xen-pcifront.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/i82092.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/pd6729.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pcmcia/yenta_socket.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-07-26T11:54:38.734 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acer-wmi.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/acerhdf.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/apple-gmux.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-laptop.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/asus-wmi.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/classmate-laptop.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/hdaps.ko 2024-07-26T11:54:38.735 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/intel_ips.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/msi-wmi.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/mxm-wmi.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-laptop.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/samsung-q10.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/topstar-laptop.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/toshiba_haps.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi-bmof.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/platform/x86/wmi.ko 2024-07-26T11:54:38.736 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_common.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/powercap/intel_rapl_msr.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-gpio.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps-ldisc.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/clients/pps_parport.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/pps/pps_core.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ptp/ptp_kvm.ko 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl 2024-07-26T11:54:38.737 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ras/amd/fmpm.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-bq32k.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1286.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1307.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1374.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1511.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1553.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1672.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds1742.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds2404.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-ds3232.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-em3027.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-fm3130.ko 2024-07-26T11:54:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl12022.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-isl1208.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m41t80.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t35.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-m48t59.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-max6900.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-msm6242.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf2127.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf85063.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8523.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8563.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-pcf8583.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rp5c01.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rs5c372.ko 2024-07-26T11:54:38.739 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8025.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-rx8581.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/rtc/rtc-x1205.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-9xxx.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-sas.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/3w-xxxx.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/BusLogic.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/a100u2w.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aacraid/aacraid.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/advansys.ko 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx 2024-07-26T11:54:38.740 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/am53c974.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/atp870u.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bfa/bfa.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-07-26T11:54:38.741 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ch.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/csiostor/csiostor.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dc395x.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-07-26T11:54:38.742 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/dmx3191d.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esas2r/esas2r.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/esp_scsi.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/fcoe.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/fnic/fnic.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hpsa.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hptiop.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/hv_storvsc.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/initio.ko 2024-07-26T11:54:38.743 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ipr.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ips.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/isci/isci.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/iscsi_tcp.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libfc/libfc.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libiscsi_tcp.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/libsas/libsas.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/lpfc/lpfc.ko 2024-07-26T11:54:38.744 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvsas/mvsas.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/mvumi.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/pmcraid.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla1280.ko 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx 2024-07-26T11:54:38.745 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/raid_class.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_debug.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_fc.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_sas.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_spi.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/scsi_transport_srp.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/ses.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/st.ko 2024-07-26T11:54:38.746 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/stex.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/virtio_scsi.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/vmw_pvscsi.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/scsi/wd719x.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ssb/ssb.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/loopback/tcm_loop.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_file.ko 2024-07-26T11:54:38.747 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_iblock.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_mod.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_pscsi.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/target_core_user.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-07-26T11:54:38.748 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless 2024-07-26T11:54:38.749 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_gsm.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/n_hdlc.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/nozomi.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/arc_uart.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/tty/serial/jsm/jsm.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/core/ufshcd-core.ko 2024-07-26T11:54:38.750 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_aec.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_cif.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_pci_generic.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/uio/uio_sercos3.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-acm.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/cdc-wdm.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usblp.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/class/usbtmc.ko 2024-07-26T11:54:38.751 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/host/sl811-hcd.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/mdc800.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/image/microtek.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/adutux.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/appledisplay.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi26.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/emi62.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ezusb.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/idmouse.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/iowarrior.ko 2024-07-26T11:54:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/isight_firmware.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/ldusb.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/legousbtower.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/trancevibrator.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usb3503.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usblcd.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/usbsevseg.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/uss720.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/misc/yurex.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/phy/phy-generic.ko 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial 2024-07-26T11:54:38.753 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/aircable.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ark3116.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/belkin_sa.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ch341.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cp210x.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cyberjack.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/cypress_m8.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/digi_acceleport.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/empeg.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ftdi_sio.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/garmin_gps.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_edgeport.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/io_ti.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipaq.ko 2024-07-26T11:54:38.754 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ipw.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ir-usb.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/keyspan_pda.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kl5kusb105.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/kobil_sct.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mct_u232.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7720.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/mos7840.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/navman.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/omninet.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/opticon.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/option.ko 2024-07-26T11:54:38.755 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/oti6858.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/pl2303.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcaux.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/qcserial.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/quatech2.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/safe_serial.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/sierra.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/spcp8x5.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ssu100.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/symbolserial.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_debug.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/usb_wwan.ko 2024-07-26T11:54:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/visor.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/whiteheat.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/serial/xsens_mt.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/uas.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-alauda.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-cypress.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-datafab.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-freecom.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-isd200.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-karma.ko 2024-07-26T11:54:38.757 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-onetouch.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-realtek.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr09.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-sddr55.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/ums-usbat.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/storage/usb-storage.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-core.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/usbip-host.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/pci/vfio-pci.ko 2024-07-26T11:54:38.758 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_iotlb.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_net.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/vhost/vhost_scsi.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/apple_bl.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/lcd.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/video/backlight/platform_lcd.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio.ko 2024-07-26T11:54:38.759 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_balloon.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_mmio.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/virtio/virtio_ring.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2482.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/masters/ds2490.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-07-26T11:54:38.760 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_smem.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/slaves/w1_therm.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/w1/wire.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim1535_wdt.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/alim7101_wdt.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/f71808e_wdt.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/hpwdt.ko 2024-07-26T11:54:38.761 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/i6300esb.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/iTCO_wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ib700wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ibmasr.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it8712f_wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/it87_wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/machzwd.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/nv_tco.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_pci.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/pcwd_usb.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sch311x_wdt.ko 2024-07-26T11:54:38.762 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/softdog.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/sp5100_tco.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/via_wdt.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83877f_wdt.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/w83977f_wdt.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/wdt_pci.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/watchdog/xen_wdt.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-acpi-processor.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-evtchn.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntalloc.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-gntdev.ko 2024-07-26T11:54:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xen-privcmd.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/drivers/xen/xenfs/xenfs.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/9p/9p.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/affs/affs.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/befs/befs.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/binfmt_misc.ko 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs 2024-07-26T11:54:38.764 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/btrfs/btrfs.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cachefiles/cachefiles.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ceph/ceph.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/coda/coda.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/cramfs/cramfs.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/dlm/dlm.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ecryptfs/ecryptfs.ko 2024-07-26T11:54:38.765 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/f2fs/f2fs.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/fat.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/msdos.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fat/vfat.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/cuse.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/fuse/fuse.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/gfs2/gfs2.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfs/hfs.ko 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus 2024-07-26T11:54:38.766 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/hfsplus/hfsplus.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/isofs/isofs.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/jfs/jfs.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/lockd/lockd.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/minix/minix.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/netfs/netfs.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout 2024-07-26T11:54:38.767 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfs.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv3.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs/nfsv4.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/grace.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfs_common/nfs_acl.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nfsd/nfsd.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nilfs2/nilfs2.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-celtic.ko 2024-07-26T11:54:38.768 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-centeuro.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-croatian.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-cyrillic.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-gaelic.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-greek.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-iceland.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-inuit.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-roman.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-romanian.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/mac-turkish.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1250.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1251.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp1255.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp737.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp775.ko 2024-07-26T11:54:38.769 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp850.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp852.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp855.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp857.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp860.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp861.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp862.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp863.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp864.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp865.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp866.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp869.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp874.ko 2024-07-26T11:54:38.770 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp932.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp936.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp949.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_cp950.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_euc-jp.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-1.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-13.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-14.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-15.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-2.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-3.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-4.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-5.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-6.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-7.ko 2024-07-26T11:54:38.771 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_iso8859-9.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-r.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-ru.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_koi8-u.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_ucs2_utils.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/nls/nls_utf8.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2.ko 2024-07-26T11:54:38.772 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/overlayfs/overlay.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/pstore/ramoops.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/reiserfs/reiserfs.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/romfs/romfs.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/client/cifs.ko 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common 2024-07-26T11:54:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_arc4.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/smb/common/cifs_md4.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/squashfs/squashfs.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/sysv/sysv.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/udf/udf.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/ufs/ufs.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/fs/xfs/xfs.ko 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu 2024-07-26T11:54:38.774 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/rcu/rcutorture.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/torture.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/asn1_encoder.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc-itu-t.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crc8.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libaescfb.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libarc4.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/crypto/libdes.ko 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim 2024-07-26T11:54:38.775 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/dim/dimlib.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/libcrc32c.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lru_cache.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4_compress.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/lz4/lz4hc_compress.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/math/cordic.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/raid6/raid6_pq.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/reed_solomon/reed_solomon.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_bm.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_fsm.ko 2024-07-26T11:54:38.776 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/ts_kmp.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/lib/zstd/zstd_compress.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/mm/hwpoison-inject.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/6lowpan.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_dest.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_fragment.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_hop.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_ipv6.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_mobility.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_routing.ko 2024-07-26T11:54:38.777 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/6lowpan/nhc_udp.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/garp.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/mrp.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/p8022.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/psnap.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/802/stp.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/8021q/8021q.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_fd.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_rdma.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/9p/9pnet_virtio.ko 2024-07-26T11:54:38.778 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/batman-adv/batman-adv.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/br_netfilter.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/bridge.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_among.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arp.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_limit.ko 2024-07-26T11:54:38.779 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_log.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_snat.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_stp.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/ebtables.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-07-26T11:54:38.780 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ceph/libceph.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/failover.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/core/pktgen.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_diag.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv4.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dccp/dccp_ipv6.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dns_resolver/dns_resolver.ko 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa 2024-07-26T11:54:38.781 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/dsa_core.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_brcm.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_dsa.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_none.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/dsa/tag_trailer.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ieee802154/ieee802154_socket.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ah4.ko 2024-07-26T11:54:38.782 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/esp4.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/fou.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/gre.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/inet_diag.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_gre.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_tunnel.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ip_vti.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipcomp.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/ipip.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arp_tables.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-07-26T11:54:38.783 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/iptable_security.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-07-26T11:54:38.784 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_bic.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_dctcp.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_diag.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_highspeed.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_htcp.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_hybla.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_illinois.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_lp.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_scalable.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_vegas.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_veno.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_westwood.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tcp_yeah.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/tunnel4.ko 2024-07-26T11:54:38.785 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_diag.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/udp_tunnel.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv4/xfrm4_tunnel.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ah6.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/esp6.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/fou6.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_tunnel.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ip6_vti.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/ipcomp6.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-07-26T11:54:38.786 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-07-26T11:54:38.787 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/sit.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/tunnel6.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/ipv6/xfrm6_tunnel.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/key/af_key.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_core.ko 2024-07-26T11:54:38.788 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_debugfs.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_eth.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ip6.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_netlink.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/l2tp/l2tp_ppp.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/llc/llc.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mac802154/mac802154.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/mpls/mpls_gso.ko 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset 2024-07-26T11:54:38.789 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-07-26T11:54:38.790 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-07-26T11:54:38.791 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conncount.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_h323.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_irc.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sane.ko 2024-07-26T11:54:38.792 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_sip.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_dup_netdev.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_flow_table_inet.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_log_syslog.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_amanda.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_ftp.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_irc.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_sip.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_nat_tftp.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_synproxy_core.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nf_tables.ko 2024-07-26T11:54:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_acct.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_log.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_osf.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nfnetlink_queue.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_chain_nat.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_compat.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_ct.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_dup_netdev.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fib.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_fwd_netdev.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_hash.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_limit.ko 2024-07-26T11:54:38.794 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_log.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_masq.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_nat.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_numgen.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_queue.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_quota.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_redir.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_reject_inet.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_socket.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/nft_tunnel.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_AUDIT.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CHECKSUM.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CLASSIFY.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_CT.ko 2024-07-26T11:54:38.795 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_DSCP.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HL.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_HMARK.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_IDLETIMER.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LED.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_LOG.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_MASQUERADE.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NETMAP.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFLOG.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_NFQUEUE.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_RATEEST.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_REDIRECT.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_SECMARK.ko 2024-07-26T11:54:38.796 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPMSS.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TEE.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TPROXY.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_TRACE.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_addrtype.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_bpf.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cgroup.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cluster.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_comment.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connbytes.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlabel.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connlimit.ko 2024-07-26T11:54:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_connmark.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_conntrack.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_cpu.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dccp.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_devgroup.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_dscp.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ecn.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_esp.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hashlimit.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_helper.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_hl.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipcomp.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_iprange.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_ipvs.ko 2024-07-26T11:54:38.798 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_l2tp.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_length.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_limit.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mac.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_mark.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_multiport.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nat.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_nfacct.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_osf.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_owner.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_physdev.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_pkttype.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_policy.ko 2024-07-26T11:54:38.799 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_quota.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_rateest.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_realm.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_recent.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_sctp.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_set.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_socket.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_state.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_statistic.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_string.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_tcpmss.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_time.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netfilter/xt_u32.ko 2024-07-26T11:54:38.800 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/netlink/netlink_diag.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/nsh/nsh.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/openvswitch.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-geneve.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-gre.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/openvswitch/vport-vxlan.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/packet/af_packet_diag.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_rdma.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/rds/rds_tcp.ko 2024-07-26T11:54:38.801 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_csum.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_gact.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_mirred.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_nat.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_pedit.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_police.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_simple.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_skbedit.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/act_vlan.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_basic.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_bpf.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_flow.ko 2024-07-26T11:54:38.802 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_fw.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_route.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/cls_u32.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_cmp.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_ipset.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_meta.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_nbyte.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_text.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/em_u32.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_choke.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_codel.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_drr.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_fq.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_gred.ko 2024-07-26T11:54:38.803 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hfsc.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_hhf.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_htb.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_ingress.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_mqprio_lib.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_multiq.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_netem.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_pie.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_plug.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_prio.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_qfq.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_red.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfb.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_sfq.ko 2024-07-26T11:54:38.804 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_tbf.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sched/sch_teql.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sctp/sctp_diag.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/sunrpc.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc.ko 2024-07-26T11:54:38.805 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/tipc/tipc_diag.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/unix/unix_diag.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_diag.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/vmw_vsock/vsock_loopback.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/net/xfrm/xfrm_ipcomp.ko 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys 2024-07-26T11:54:38.806 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/kernel/security/keys/trusted-keys/trusted.ko 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.alias.bin 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.alias.bin 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.bin 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.builtin.modinfo 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.dep.bin 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.devname 2024-07-26T11:54:38.807 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.order 2024-07-26T11:54:38.808 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.softdep 2024-07-26T11:54:38.808 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols 2024-07-26T11:54:38.808 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/modules.symbols.bin 2024-07-26T11:54:38.808 INFO:teuthology.orchestra.run.smithi076.stdout:/lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T11:54:38.811 DEBUG:teuthology.task.kernel:get_image_version: 6.10.0-g3e9255e90710 2024-07-26T11:54:38.811 DEBUG:teuthology.orchestra.run.smithi076:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-07-26T11:54:38.833 INFO:teuthology.orchestra.run.smithi076.stdout:postinstall scriptlet (using /bin/sh): 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout: /usr/bin/kernel-install add 6.10.0-g3e9255e90710 /lib/modules/6.10.0-g3e9255e90710/vmlinuz 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout:fi 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout:for file in vmlinuz System.map config; do 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout: if ! cmp --silent "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710"; then 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout: cp "/lib/modules/6.10.0-g3e9255e90710/${file}" "/boot/${file}-6.10.0-g3e9255e90710" 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout: fi 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout:done 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout:if [ -d "/lib/modules/6.10.0-g3e9255e90710/dtb" ] && \ 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout: ! diff -rq "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" >/dev/null 2>&1; then 2024-07-26T11:54:38.834 INFO:teuthology.orchestra.run.smithi076.stdout: rm -rf "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout: cp -r "/lib/modules/6.10.0-g3e9255e90710/dtb" "/boot/dtb-6.10.0-g3e9255e90710" 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:fi 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:if [ ! -e "/lib/modules/6.10.0-g3e9255e90710/modules.dep" ]; then 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout: /usr/sbin/depmod 6.10.0-g3e9255e90710 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:fi 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:preuninstall scriptlet (using /bin/sh): 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-install remove 6.10.0-g3e9255e90710 2024-07-26T11:54:38.835 INFO:teuthology.orchestra.run.smithi076.stdout:fi 2024-07-26T11:54:38.836 DEBUG:teuthology.orchestra.run.smithi076:> sudo rpm -qi grub2-tools 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Name : grub2-tools 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Epoch : 1 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Version : 2.06 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Release : 68.el9 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Architecture: x86_64 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Group : Unspecified 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:Size : 8264254 2024-07-26T11:54:38.907 INFO:teuthology.orchestra.run.smithi076.stdout:License : GPLv3+ 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Packager : builder@centos.org 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Vendor : CentOS 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Summary : Support tools for GRUB. 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:Description : 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-26T11:54:38.908 INFO:teuthology.orchestra.run.smithi076.stdout:hardware devices. 2024-07-26T11:54:38.909 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T11:54:38.909 INFO:teuthology.orchestra.run.smithi076.stdout:This subpackage provides tools for support of all platforms. 2024-07-26T11:54:38.909 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-26T11:54:38.909 INFO:teuthology.task.kernel:Updating grub on smithi076 to boot 6.10.0-g3e9255e90710 2024-07-26T11:54:38.910 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-26T11:54:39.485 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2024-07-26T11:54:40.826 INFO:teuthology.orchestra.run.smithi076.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-26T11:54:40.851 INFO:teuthology.orchestra.run.smithi076.stderr:done 2024-07-26T11:54:40.854 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2024-07-26T11:54:40.870 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.3bl3Lc49wk 2024-07-26T11:54:40.870 DEBUG:teuthology.orchestra.run.smithi076:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3bl3Lc49wk 2024-07-26T11:54:40.942 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.3bl3Lc49wk 2024-07-26T11:54:41.080 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.3bl3Lc49wk is 6KB 2024-07-26T11:54:41.130 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.3bl3Lc49wk 2024-07-26T11:54:41.144 DEBUG:teuthology.orchestra.run.smithi076:> sudo /bin/ls /boot/loader/entries || true 2024-07-26T11:54:41.215 INFO:teuthology.orchestra.run.smithi076.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-26T11:54:41.215 INFO:teuthology.orchestra.run.smithi076.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-26T11:54:41.215 INFO:teuthology.orchestra.run.smithi076.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-26T11:54:41.215 INFO:teuthology.orchestra.run.smithi076.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710.conf 2024-07-26T11:54:41.217 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.10.0-g3e9255e90710 2024-07-26T11:54:41.371 DEBUG:teuthology.orchestra.run.smithi076:> sudo shutdown -r now 2024-07-26T11:54:42.583 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-07-26T11:54:42.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-07-26T11:54:42.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:54:47.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-07-26T11:54:47.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-07-26T11:54:47.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:55:11.397 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-07-26T11:55:11.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T11:55:11.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:55:17.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-07-26T11:55:26.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-07-26T11:55:26.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:55:46.015 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-07-26T11:55:47.990 DEBUG:teuthology.orchestra.remote:timed out 2024-07-26T11:55:55.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T11:55:55.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:55:56.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-07-26T11:55:56.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:55:58.464 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-07-26T11:55:59.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-07-26T11:55:59.234 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.10.0-g3e9255e90710"... 2024-07-26T11:55:59.234 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-07-26T11:55:59.276 INFO:teuthology.orchestra.run.smithi040.stdout:6.10.0-g3e9255e90710 2024-07-26T11:55:59.277 DEBUG:teuthology.task.kernel:current kernel version is 6.10.0-g3e9255e90710 vs 6.10.0-g3e9255e90710 2024-07-26T11:55:59.277 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-26T11:55:59.277 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-26T11:56:00.278 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-07-26T11:56:00.278 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-07-26T11:56:00.396 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-07-26T11:56:00.473 DEBUG:teuthology.parallel:result is None 2024-07-26T11:56:13.406 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-07-26T11:56:25.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T11:56:25.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:56:26.101 DEBUG:teuthology.orchestra.remote:timed out 2024-07-26T11:56:28.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-07-26T11:56:38.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-07-26T11:56:38.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:56:38.553 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-07-26T11:56:39.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-07-26T11:56:39.218 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.10.0-g3e9255e90710"... 2024-07-26T11:56:39.219 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-07-26T11:56:39.270 INFO:teuthology.orchestra.run.smithi146.stdout:6.10.0-g3e9255e90710 2024-07-26T11:56:39.282 DEBUG:teuthology.task.kernel:current kernel version is 6.10.0-g3e9255e90710 vs 6.10.0-g3e9255e90710 2024-07-26T11:56:39.282 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-26T11:56:39.282 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-26T11:56:40.283 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-07-26T11:56:40.283 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-07-26T11:56:40.409 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2024-07-26T11:56:40.471 DEBUG:teuthology.parallel:result is None 2024-07-26T11:56:43.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T11:56:43.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T11:56:43.969 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-07-26T11:56:44.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T11:56:44.557 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.10.0-g3e9255e90710"... 2024-07-26T11:56:44.557 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-07-26T11:56:44.595 INFO:teuthology.orchestra.run.smithi076.stdout:6.10.0-g3e9255e90710 2024-07-26T11:56:44.595 DEBUG:teuthology.task.kernel:current kernel version is 6.10.0-g3e9255e90710 vs 6.10.0-g3e9255e90710 2024-07-26T11:56:44.596 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-26T11:56:44.596 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-26T11:56:45.596 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-07-26T11:56:45.597 DEBUG:teuthology.orchestra.run.smithi076:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-07-26T11:56:45.718 INFO:teuthology.orchestra.run.smithi076.stdout:ttyS1 2024-07-26T11:56:45.759 DEBUG:teuthology.parallel:result is None 2024-07-26T11:56:45.759 INFO:teuthology.run_tasks:Running task internal.base... 2024-07-26T11:56:45.771 INFO:teuthology.task.internal:Creating test directory... 2024-07-26T11:56:45.771 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-26T11:56:45.780 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-26T11:56:45.784 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-26T11:56:45.841 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-07-26T11:56:45.848 INFO:teuthology.run_tasks:Running task internal.archive... 2024-07-26T11:56:45.865 INFO:teuthology.task.internal:Creating archive directory... 2024-07-26T11:56:45.865 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-26T11:56:45.872 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-26T11:56:45.876 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-26T11:56:45.958 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-07-26T11:56:45.965 INFO:teuthology.task.internal:Enabling coredump saving... 2024-07-26T11:56:45.965 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-26T11:56:45.973 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-26T11:56:45.977 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-26T11:56:46.039 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T11:56:46.064 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T11:56:46.069 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T11:56:46.070 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T11:56:46.103 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T11:56:46.104 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-26T11:56:46.108 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-07-26T11:56:46.115 INFO:teuthology.task.internal:Configuring sudo... 2024-07-26T11:56:46.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-26T11:56:46.120 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-26T11:56:46.124 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-26T11:56:46.203 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-07-26T11:56:46.212 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-07-26T11:56:46.212 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-26T11:56:46.216 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-26T11:56:46.220 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-26T11:56:46.270 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T11:56:46.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T11:56:46.446 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T11:56:46.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T11:56:46.618 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T11:56:46.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-26T11:56:46.705 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T11:56:46.769 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T11:56:46.856 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T11:56:46.922 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T11:56:47.001 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T11:56:47.001 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-26T11:56:47.066 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T11:56:47.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-26T11:56:47.245 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T11:56:47.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-26T11:56:47.413 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T11:56:47.413 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-26T11:56:47.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-07-26T11:56:47.502 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2024-07-26T11:56:47.506 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-07-26T11:56:47.607 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T11:56:47.630 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T11:56:47.645 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-26T11:56:48.085 INFO:teuthology.run_tasks:Running task internal.timer... 2024-07-26T11:56:48.093 INFO:teuthology.task.internal:Starting timer... 2024-07-26T11:56:48.093 INFO:teuthology.run_tasks:Running task pcp... 2024-07-26T11:56:48.142 INFO:teuthology.run_tasks:Running task selinux... 2024-07-26T11:56:48.151 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-07-26T11:56:48.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-07-26T11:56:48.269 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-07-26T11:56:48.274 DEBUG:teuthology.orchestra.run.smithi076:> sudo service auditd rotate 2024-07-26T11:56:48.370 INFO:teuthology.orchestra.run.smithi076.stdout:Rotating logs: 2024-07-26T11:56:48.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-07-26T11:56:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-07-26T11:56:48.503 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-07-26T11:56:48.503 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-07-26T11:56:48.574 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-07-26T11:56:48.574 DEBUG:teuthology.orchestra.run.smithi076:> /usr/sbin/getenforce 2024-07-26T11:56:48.768 INFO:teuthology.orchestra.run.smithi076.stdout:Permissive 2024-07-26T11:56:48.769 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-07-26T11:56:48.822 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-07-26T11:56:48.823 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi076.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2024-07-26T11:56:48.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T11:56:48.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:56:48.907 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T11:56:48.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:56:48.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-26T11:56:49.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T11:56:49.065 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-07-26T11:56:49.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-07-26T11:56:49.156 DEBUG:teuthology.orchestra.run.smithi076:> sudo /usr/sbin/setenforce permissive 2024-07-26T11:56:49.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-07-26T11:56:49.297 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-07-26T11:56:49.307 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-07-26T11:56:49.318 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-07-26T11:56:49.319 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi076.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-07-26T12:03:22.870 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2024-07-26T12:03:22.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-07-26T12:03:22.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T12:03:22.987 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-07-26T12:03:23.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-07-26T12:03:23.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T12:03:23.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T12:03:23.249 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-07-26T12:03:23.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-07-26T12:03:23.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-07-26T12:03:23.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-26T12:03:23.545 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-07-26T12:03:23.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-07-26T12:03:23.704 INFO:teuthology.run_tasks:Running task clock... 2024-07-26T12:03:23.715 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-07-26T12:03:23.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-26T12:03:23.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T12:03:23.724 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-26T12:03:23.724 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T12:03:23.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-26T12:03:23.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-26T12:03:23.817 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-26T12:03:23.818 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-26T12:03:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-26T12:03:23.858 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-26T12:03:23.861 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-26T12:03:23.865 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-26T12:03:23.934 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: ntpd: command not found 2024-07-26T12:03:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-07-26T12:03:23.941 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-07-26T12:03:23.963 INFO:teuthology.orchestra.run.smithi076.stdout:506 Cannot talk to daemon 2024-07-26T12:03:23.969 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-07-26T12:03:23.975 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-07-26T12:03:24.002 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-26T12:03:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-26T12:03:24.018 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-26T12:03:24.043 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-26T12:03:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-26T12:03:24.060 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-26T12:03:24.182 INFO:teuthology.orchestra.run.smithi076.stderr:bash: line 1: ntpq: command not found 2024-07-26T12:03:24.183 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-07-26T12:03:24.190 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T12:03:24.190 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-07-26T12:03:24.190 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.190 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.191 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.212 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-07-26T12:03:24.222 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-26T12:03:24.222 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-07-26T12:03:24.222 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.222 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.223 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.223 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-26T12:03:24.224 INFO:teuthology.run_tasks:Running task install... 2024-07-26T12:03:24.233 DEBUG:teuthology.task.install:project ceph 2024-07-26T12:03:24.233 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528'}} 2024-07-26T12:03:24.234 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528'} 2024-07-26T12:03:24.234 INFO:teuthology.task.install:Using flavor: default 2024-07-26T12:03:24.239 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-07-26T12:03:24.239 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-07-26T12:03:24.240 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'tag': None, 'wait_for_package': False} 2024-07-26T12:03:24.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:03:24.242 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'tag': None, 'wait_for_package': False} 2024-07-26T12:03:24.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:03:24.243 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'tag': None, 'wait_for_package': False} 2024-07-26T12:03:24.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:03:24.391 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/ 2024-07-26T12:03:24.391 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5320.ge8f88bb1 2024-07-26T12:03:24.395 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/ 2024-07-26T12:03:24.395 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5320.ge8f88bb1 2024-07-26T12:03:24.398 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/ 2024-07-26T12:03:24.398 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5320.ge8f88bb1 2024-07-26T12:03:24.501 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-26T12:03:24.502 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:03:24.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-26T12:03:24.510 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-26T12:03:24.510 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:03:24.510 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-26T12:03:24.514 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-26T12:03:24.514 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:03:24.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-26T12:03:24.592 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-26T12:03:24.592 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-26T12:03:24.599 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-26T12:03:24.599 DEBUG:teuthology.orchestra.run.smithi076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-26T12:03:24.608 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-26T12:03:24.608 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-26T12:03:24.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-26T12:03:24.728 DEBUG:teuthology.orchestra.run.smithi076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-26T12:03:24.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-26T12:03:24.835 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-26T12:03:24.842 DEBUG:teuthology.orchestra.run.smithi076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-26T12:03:24.859 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-26T12:03:24.909 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-07-26T12:03:24.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-07-26T12:03:24.921 INFO:teuthology.orchestra.run.smithi076.stdout:check_obsoletes = 1 2024-07-26T12:03:24.926 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum clean all 2024-07-26T12:03:24.942 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-07-26T12:03:24.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-07-26T12:03:25.234 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-07-26T12:03:25.239 INFO:teuthology.orchestra.run.smithi076.stdout:45 files removed 2024-07-26T12:03:25.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-26T12:03:25.277 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-26T12:03:25.298 INFO:teuthology.orchestra.run.smithi040.stdout:45 files removed 2024-07-26T12:03:25.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-26T12:03:26.098 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 209 kB/s | 83 kB 00:00 2024-07-26T12:03:26.111 INFO:teuthology.orchestra.run.smithi076.stdout:ceph packages for x86_64 209 kB/s | 83 kB 00:00 2024-07-26T12:03:26.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 224 kB/s | 83 kB 00:00 2024-07-26T12:03:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 64 kB/s | 24 kB 00:00 2024-07-26T12:03:26.570 INFO:teuthology.orchestra.run.smithi076.stdout:ceph noarch packages 66 kB/s | 24 kB 00:00 2024-07-26T12:03:26.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 65 kB/s | 24 kB 00:00 2024-07-26T12:03:27.016 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-07-26T12:03:27.020 INFO:teuthology.orchestra.run.smithi076.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-07-26T12:03:27.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-07-26T12:03:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.2 MB 00:01 2024-07-26T12:03:29.330 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.2 MB 00:02 2024-07-26T12:03:30.161 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-07-26T12:03:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-07-26T12:03:33.281 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 20 MB 00:02 2024-07-26T12:03:34.045 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 20 MB 00:02 2024-07-26T12:03:37.012 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 6.5 MB 00:01 2024-07-26T12:03:38.749 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-07-26T12:03:38.889 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.5 MB 00:00 2024-07-26T12:03:38.966 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-07-26T12:03:39.865 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-07-26T12:03:40.739 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-07-26T12:03:40.825 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 18 kB 00:00 2024-07-26T12:03:42.103 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-07-26T12:03:42.139 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-07-26T12:03:46.417 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-07-26T12:03:48.468 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-07-26T12:03:48.692 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 5.3 kB/s | 1.7 kB 00:00 2024-07-26T12:03:49.039 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T12:03:49.041 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T12:03:49.059 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-26T12:03:49.060 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-26T12:03:49.061 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-26T12:03:49.062 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-26T12:03:49.065 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-26T12:03:49.068 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-26T12:03:49.069 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-26T12:03:49.144 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-07-26T12:03:49.164 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-07-26T12:03:49.164 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-07-26T12:03:49.164 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 6.6 k 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.5 M 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 872 k 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 148 k 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 1.5 M 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 149 k 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 14 M 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 7.4 M 2024-07-26T12:03:49.165 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 49 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 10 M 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 44 M 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 274 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 771 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 225 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 27 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 18 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 32 k 2024-07-26T12:03:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 765 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 127 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 188 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 372 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 355 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 116 k 2024-07-26T12:03:49.167 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 86 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 170 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-26T12:03:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.4 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 20 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 34 k 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 2.3 M 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 284 k 2024-07-26T12:03:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 4.9 M 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 18 M 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 16 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 25 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 158 k 2024-07-26T12:03:49.170 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 503 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.3 M 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-26T12:03:49.171 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 45 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 138 k 2024-07-26T12:03:49.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-26T12:03:49.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-26T12:03:49.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-26T12:03:49.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-26T12:03:49.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-26T12:03:49.177 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout:Install 148 Packages 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 12 Packages 2024-07-26T12:03:49.178 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:03:49.179 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 233 M 2024-07-26T12:03:49.179 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-07-26T12:03:50.069 INFO:teuthology.orchestra.run.smithi040.stdout:(1/160): ceph-19.0.0-5320.ge8f88bb1.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-07-26T12:03:50.385 INFO:teuthology.orchestra.run.smithi040.stdout:(2/160): ceph-base-19.0.0-5320.ge8f88bb1.el9.x8 9.0 MB/s | 5.5 MB 00:00 2024-07-26T12:03:50.427 INFO:teuthology.orchestra.run.smithi040.stdout:(3/160): ceph-fuse-19.0.0-5320.ge8f88bb1.el9.x8 2.4 MB/s | 872 kB 00:00 2024-07-26T12:03:50.461 INFO:teuthology.orchestra.run.smithi040.stdout:(4/160): ceph-immutable-object-cache-19.0.0-532 1.9 MB/s | 148 kB 00:00 2024-07-26T12:03:50.570 INFO:teuthology.orchestra.run.smithi040.stdout:(5/160): ceph-mgr-19.0.0-5320.ge8f88bb1.el9.x86 14 MB/s | 1.5 MB 00:00 2024-07-26T12:03:50.804 INFO:teuthology.orchestra.run.smithi040.stdout:(6/160): ceph-mds-19.0.0-5320.ge8f88bb1.el9.x86 6.0 MB/s | 2.3 MB 00:00 2024-07-26T12:03:51.008 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T12:03:51.010 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T12:03:51.029 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-26T12:03:51.030 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-26T12:03:51.032 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-26T12:03:51.033 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-26T12:03:51.035 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-26T12:03:51.038 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-26T12:03:51.040 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-26T12:03:51.062 INFO:teuthology.orchestra.run.smithi040.stdout:(7/160): ceph-common-19.0.0-5320.ge8f88bb1.el9. 15 MB/s | 20 MB 00:01 2024-07-26T12:03:51.111 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-07-26T12:03:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-07-26T12:03:51.133 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-07-26T12:03:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-07-26T12:03:51.133 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-07-26T12:03:51.133 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 6.6 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.5 M 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 872 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 148 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 1.5 M 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 149 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 14 M 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 7.4 M 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 49 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 10 M 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 44 M 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 274 k 2024-07-26T12:03:51.134 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 771 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 225 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 27 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 18 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 32 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 765 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 127 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-26T12:03:51.135 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 188 k 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 372 k 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 355 k 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 116 k 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 86 k 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T12:03:51.136 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 170 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.4 M 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T12:03:51.137 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 20 M 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 34 k 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 2.3 M 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 284 k 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 4.9 M 2024-07-26T12:03:51.138 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 18 M 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 16 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 25 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 158 k 2024-07-26T12:03:51.139 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 503 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.3 M 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-26T12:03:51.140 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 45 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 138 k 2024-07-26T12:03:51.141 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-26T12:03:51.142 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-26T12:03:51.143 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-26T12:03:51.144 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-26T12:03:51.145 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-26T12:03:51.146 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:Install 148 Packages 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 12 Packages 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 233 M 2024-07-26T12:03:51.147 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-07-26T12:03:51.179 INFO:teuthology.orchestra.run.smithi040.stdout:(8/160): ceph-mon-19.0.0-5320.ge8f88bb1.el9.x86 8.0 MB/s | 4.9 MB 00:00 2024-07-26T12:03:51.237 INFO:teuthology.orchestra.run.smithi040.stdout:(9/160): ceph-selinux-19.0.0-5320.ge8f88bb1.el9 440 kB/s | 25 kB 00:00 2024-07-26T12:03:51.279 INFO:teuthology.orchestra.run.smithi076.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T12:03:51.280 INFO:teuthology.orchestra.run.smithi076.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-26T12:03:51.300 INFO:teuthology.orchestra.run.smithi076.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-26T12:03:51.301 INFO:teuthology.orchestra.run.smithi076.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-26T12:03:51.303 INFO:teuthology.orchestra.run.smithi076.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-26T12:03:51.304 INFO:teuthology.orchestra.run.smithi076.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-26T12:03:51.306 INFO:teuthology.orchestra.run.smithi076.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-26T12:03:51.310 INFO:teuthology.orchestra.run.smithi076.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-26T12:03:51.311 INFO:teuthology.orchestra.run.smithi076.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-26T12:03:51.384 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout:======================================================================================= 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout:======================================================================================= 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout: ceph x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 6.6 k 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.5 M 2024-07-26T12:03:51.401 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 872 k 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 148 k 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 1.5 M 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 149 k 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 14 M 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 7.4 M 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 49 k 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 10 M 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 44 M 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 274 k 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 771 k 2024-07-26T12:03:51.402 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 225 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-shell x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 27 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-top noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 18 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 32 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 765 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 127 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-26T12:03:51.403 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 188 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 372 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 355 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 116 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 86 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 170 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrading: 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-26T12:03:51.404 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.4 M 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 3.1 M 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-26T12:03:51.405 INFO:teuthology.orchestra.run.smithi076.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 20 M 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 34 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 2.3 M 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 284 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 4.9 M 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 18 M 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5320.ge8f88bb1.el9 ceph-noarch 16 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 25 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-26T12:03:51.406 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 158 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-26T12:03:51.407 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 503 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2 x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 5.3 M 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-26T12:03:51.408 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 45 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common x86_64 2:19.0.0-5320.ge8f88bb1.el9 ceph 138 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-26T12:03:51.409 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-26T12:03:51.410 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-26T12:03:51.411 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-26T12:03:51.412 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-26T12:03:51.413 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout:Installing weak dependencies: 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:03:51.414 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-07-26T12:03:51.415 INFO:teuthology.orchestra.run.smithi076.stdout:======================================================================================= 2024-07-26T12:03:51.415 INFO:teuthology.orchestra.run.smithi076.stdout:Install 148 Packages 2024-07-26T12:03:51.415 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 12 Packages 2024-07-26T12:03:51.415 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:03:51.415 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 233 M 2024-07-26T12:03:51.415 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-07-26T12:03:51.652 INFO:teuthology.orchestra.run.smithi146.stdout:(1/160): ceph-19.0.0-5320.ge8f88bb1.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-07-26T12:03:51.696 INFO:teuthology.orchestra.run.smithi040.stdout:(10/160): ceph-radosgw-19.0.0-5320.ge8f88bb1.el 16 MB/s | 10 MB 00:00 2024-07-26T12:03:51.763 INFO:teuthology.orchestra.run.smithi040.stdout:(11/160): cephfs-mirror-19.0.0-5320.ge8f88bb1.e 3.4 MB/s | 225 kB 00:00 2024-07-26T12:03:51.847 INFO:teuthology.orchestra.run.smithi040.stdout:(12/160): cephfs-shell-19.0.0-5320.ge8f88bb1.el 328 kB/s | 27 kB 00:00 2024-07-26T12:03:51.947 INFO:teuthology.orchestra.run.smithi040.stdout:(13/160): libcephfs-devel-19.0.0-5320.ge8f88bb1 318 kB/s | 32 kB 00:00 2024-07-26T12:03:52.056 INFO:teuthology.orchestra.run.smithi040.stdout:(14/160): libcephfs2-19.0.0-5320.ge8f88bb1.el9. 7.0 MB/s | 765 kB 00:00 2024-07-26T12:03:52.077 INFO:teuthology.orchestra.run.smithi146.stdout:(2/160): ceph-base-19.0.0-5320.ge8f88bb1.el9.x8 7.5 MB/s | 5.5 MB 00:00 2024-07-26T12:03:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:(3/160): ceph-fuse-19.0.0-5320.ge8f88bb1.el9.x8 1.9 MB/s | 872 kB 00:00 2024-07-26T12:03:52.122 INFO:teuthology.orchestra.run.smithi040.stdout:(15/160): libcephsqlite-19.0.0-5320.ge8f88bb1.e 2.4 MB/s | 158 kB 00:00 2024-07-26T12:03:52.161 INFO:teuthology.orchestra.run.smithi146.stdout:(4/160): ceph-immutable-object-cache-19.0.0-532 1.8 MB/s | 148 kB 00:00 2024-07-26T12:03:52.231 INFO:teuthology.orchestra.run.smithi040.stdout:(16/160): librados-devel-19.0.0-5320.ge8f88bb1. 1.1 MB/s | 127 kB 00:00 2024-07-26T12:03:52.320 INFO:teuthology.orchestra.run.smithi146.stdout:(5/160): ceph-mds-19.0.0-5320.ge8f88bb1.el9.x86 11 MB/s | 2.3 MB 00:00 2024-07-26T12:03:52.331 INFO:teuthology.orchestra.run.smithi040.stdout:(17/160): libradosstriper1-19.0.0-5320.ge8f88bb 5.0 MB/s | 503 kB 00:00 2024-07-26T12:03:52.695 INFO:teuthology.orchestra.run.smithi146.stdout:(6/160): ceph-mon-19.0.0-5320.ge8f88bb1.el9.x86 13 MB/s | 4.9 MB 00:00 2024-07-26T12:03:52.854 INFO:teuthology.orchestra.run.smithi146.stdout:(7/160): ceph-mgr-19.0.0-5320.ge8f88bb1.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-07-26T12:03:52.885 INFO:teuthology.orchestra.run.smithi076.stdout:(1/160): ceph-19.0.0-5320.ge8f88bb1.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-07-26T12:03:53.024 INFO:teuthology.orchestra.run.smithi040.stdout:(18/160): ceph-osd-19.0.0-5320.ge8f88bb1.el9.x8 8.0 MB/s | 18 MB 00:02 2024-07-26T12:03:53.124 INFO:teuthology.orchestra.run.smithi040.stdout:(19/160): python3-ceph-argparse-19.0.0-5320.ge8 457 kB/s | 45 kB 00:00 2024-07-26T12:03:53.199 INFO:teuthology.orchestra.run.smithi040.stdout:(20/160): python3-ceph-common-19.0.0-5320.ge8f8 1.8 MB/s | 138 kB 00:00 2024-07-26T12:03:53.308 INFO:teuthology.orchestra.run.smithi040.stdout:(21/160): librgw2-19.0.0-5320.ge8f88bb1.el9.x86 5.4 MB/s | 5.3 MB 00:00 2024-07-26T12:03:53.341 INFO:teuthology.orchestra.run.smithi040.stdout:(22/160): python3-cephfs-19.0.0-5320.ge8f88bb1. 1.3 MB/s | 188 kB 00:00 2024-07-26T12:03:53.371 INFO:teuthology.orchestra.run.smithi146.stdout:(8/160): ceph-common-19.0.0-5320.ge8f88bb1.el9. 9.8 MB/s | 20 MB 00:02 2024-07-26T12:03:53.383 INFO:teuthology.orchestra.run.smithi040.stdout:(23/160): python3-rados-19.0.0-5320.ge8f88bb1.e 4.9 MB/s | 372 kB 00:00 2024-07-26T12:03:53.421 INFO:teuthology.orchestra.run.smithi146.stdout:(9/160): ceph-selinux-19.0.0-5320.ge8f88bb1.el9 515 kB/s | 25 kB 00:00 2024-07-26T12:03:53.425 INFO:teuthology.orchestra.run.smithi040.stdout:(24/160): python3-rbd-19.0.0-5320.ge8f88bb1.el9 4.2 MB/s | 355 kB 00:00 2024-07-26T12:03:53.427 INFO:teuthology.orchestra.run.smithi076.stdout:(2/160): ceph-fuse-19.0.0-5320.ge8f88bb1.el9.x8 1.6 MB/s | 872 kB 00:00 2024-07-26T12:03:53.451 INFO:teuthology.orchestra.run.smithi040.stdout:(25/160): python3-rgw-19.0.0-5320.ge8f88bb1.el9 1.7 MB/s | 116 kB 00:00 2024-07-26T12:03:53.476 INFO:teuthology.orchestra.run.smithi040.stdout:(26/160): rbd-fuse-19.0.0-5320.ge8f88bb1.el9.x8 1.7 MB/s | 86 kB 00:00 2024-07-26T12:03:53.552 INFO:teuthology.orchestra.run.smithi076.stdout:(3/160): ceph-immutable-object-cache-19.0.0-532 1.2 MB/s | 148 kB 00:00 2024-07-26T12:03:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:(27/160): rbd-nbd-19.0.0-5320.ge8f88bb1.el9.x86 1.8 MB/s | 170 kB 00:00 2024-07-26T12:03:53.676 INFO:teuthology.orchestra.run.smithi040.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5320.g 319 kB/s | 34 kB 00:00 2024-07-26T12:03:53.980 INFO:teuthology.orchestra.run.smithi146.stdout:(10/160): ceph-osd-19.0.0-5320.ge8f88bb1.el9.x8 14 MB/s | 18 MB 00:01 2024-07-26T12:03:54.038 INFO:teuthology.orchestra.run.smithi146.stdout:(11/160): cephfs-mirror-19.0.0-5320.ge8f88bb1.e 3.8 MB/s | 225 kB 00:00 2024-07-26T12:03:54.044 INFO:teuthology.orchestra.run.smithi076.stdout:(4/160): ceph-base-19.0.0-5320.ge8f88bb1.el9.x8 3.6 MB/s | 5.5 MB 00:01 2024-07-26T12:03:54.089 INFO:teuthology.orchestra.run.smithi146.stdout:(12/160): cephfs-shell-19.0.0-5320.ge8f88bb1.el 552 kB/s | 27 kB 00:00 2024-07-26T12:03:54.161 INFO:teuthology.orchestra.run.smithi076.stdout:(5/160): ceph-mds-19.0.0-5320.ge8f88bb1.el9.x86 3.7 MB/s | 2.3 MB 00:00 2024-07-26T12:03:54.164 INFO:teuthology.orchestra.run.smithi146.stdout:(13/160): libcephfs-devel-19.0.0-5320.ge8f88bb1 430 kB/s | 32 kB 00:00 2024-07-26T12:03:54.202 INFO:teuthology.orchestra.run.smithi040.stdout:(29/160): ceph-test-19.0.0-5320.ge8f88bb1.el9.x 15 MB/s | 44 MB 00:02 2024-07-26T12:03:54.235 INFO:teuthology.orchestra.run.smithi040.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5320.ge8f88bb 268 kB/s | 149 kB 00:00 2024-07-26T12:03:54.245 INFO:teuthology.orchestra.run.smithi076.stdout:(6/160): ceph-mgr-19.0.0-5320.ge8f88bb1.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-07-26T12:03:54.272 INFO:teuthology.orchestra.run.smithi146.stdout:(14/160): libcephfs2-19.0.0-5320.ge8f88bb1.el9. 7.0 MB/s | 765 kB 00:00 2024-07-26T12:03:54.336 INFO:teuthology.orchestra.run.smithi040.stdout:(31/160): rbd-mirror-19.0.0-5320.ge8f88bb1.el9. 3.5 MB/s | 3.1 MB 00:00 2024-07-26T12:03:54.348 INFO:teuthology.orchestra.run.smithi146.stdout:(15/160): libcephsqlite-19.0.0-5320.ge8f88bb1.e 2.1 MB/s | 158 kB 00:00 2024-07-26T12:03:54.428 INFO:teuthology.orchestra.run.smithi040.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5320.ge8 3.1 MB/s | 284 kB 00:00 2024-07-26T12:03:54.440 INFO:teuthology.orchestra.run.smithi146.stdout:(16/160): librados-devel-19.0.0-5320.ge8f88bb1. 1.4 MB/s | 127 kB 00:00 2024-07-26T12:03:54.520 INFO:teuthology.orchestra.run.smithi040.stdout:(33/160): ceph-mgr-rook-19.0.0-5320.ge8f88bb1.e 543 kB/s | 49 kB 00:00 2024-07-26T12:03:54.557 INFO:teuthology.orchestra.run.smithi146.stdout:(17/160): libradosstriper1-19.0.0-5320.ge8f88bb 4.2 MB/s | 503 kB 00:00 2024-07-26T12:03:54.611 INFO:teuthology.orchestra.run.smithi040.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5320.ge 181 kB/s | 16 kB 00:00 2024-07-26T12:03:55.165 INFO:teuthology.orchestra.run.smithi146.stdout:(18/160): librgw2-19.0.0-5320.ge8f88bb1.el9.x86 8.7 MB/s | 5.3 MB 00:00 2024-07-26T12:03:55.249 INFO:teuthology.orchestra.run.smithi146.stdout:(19/160): python3-ceph-argparse-19.0.0-5320.ge8 549 kB/s | 45 kB 00:00 2024-07-26T12:03:55.332 INFO:teuthology.orchestra.run.smithi146.stdout:(20/160): python3-ceph-common-19.0.0-5320.ge8f8 1.6 MB/s | 138 kB 00:00 2024-07-26T12:03:55.345 INFO:teuthology.orchestra.run.smithi076.stdout:(7/160): ceph-mon-19.0.0-5320.ge8f88bb1.el9.x86 4.1 MB/s | 4.9 MB 00:01 2024-07-26T12:03:55.416 INFO:teuthology.orchestra.run.smithi146.stdout:(21/160): python3-cephfs-19.0.0-5320.ge8f88bb1. 2.2 MB/s | 188 kB 00:00 2024-07-26T12:03:55.491 INFO:teuthology.orchestra.run.smithi146.stdout:(22/160): python3-rados-19.0.0-5320.ge8f88bb1.e 4.9 MB/s | 372 kB 00:00 2024-07-26T12:03:55.545 INFO:teuthology.orchestra.run.smithi040.stdout:(35/160): ceph-mgr-dashboard-19.0.0-5320.ge8f88 10 MB/s | 14 MB 00:01 2024-07-26T12:03:55.579 INFO:teuthology.orchestra.run.smithi040.stdout:(36/160): ceph-volume-19.0.0-5320.ge8f88bb1.el9 284 kB/s | 274 kB 00:00 2024-07-26T12:03:55.583 INFO:teuthology.orchestra.run.smithi146.stdout:(23/160): python3-rbd-19.0.0-5320.ge8f88bb1.el9 3.8 MB/s | 355 kB 00:00 2024-07-26T12:03:55.659 INFO:teuthology.orchestra.run.smithi146.stdout:(24/160): python3-rgw-19.0.0-5320.ge8f88bb1.el9 1.5 MB/s | 116 kB 00:00 2024-07-26T12:03:55.729 INFO:teuthology.orchestra.run.smithi040.stdout:(37/160): ceph-mgr-diskprediction-local-19.0.0- 5.0 MB/s | 7.4 MB 00:01 2024-07-26T12:03:55.771 INFO:teuthology.orchestra.run.smithi040.stdout:(38/160): cephadm-19.0.0-5320.ge8f88bb1.el9.noa 3.4 MB/s | 771 kB 00:00 2024-07-26T12:03:55.796 INFO:teuthology.orchestra.run.smithi040.stdout:(39/160): cephfs-top-19.0.0-5320.ge8f88bb1.el9. 84 kB/s | 18 kB 00:00 2024-07-26T12:03:55.826 INFO:teuthology.orchestra.run.smithi146.stdout:(25/160): ceph-radosgw-19.0.0-5320.ge8f88bb1.el 3.5 MB/s | 10 MB 00:02 2024-07-26T12:03:55.851 INFO:teuthology.orchestra.run.smithi146.stdout:(26/160): rbd-fuse-19.0.0-5320.ge8f88bb1.el9.x8 452 kB/s | 86 kB 00:00 2024-07-26T12:03:55.918 INFO:teuthology.orchestra.run.smithi146.stdout:(27/160): rbd-nbd-19.0.0-5320.ge8f88bb1.el9.x86 2.5 MB/s | 170 kB 00:00 2024-07-26T12:03:55.968 INFO:teuthology.orchestra.run.smithi146.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5320.g 702 kB/s | 34 kB 00:00 2024-07-26T12:03:56.044 INFO:teuthology.orchestra.run.smithi146.stdout:(29/160): ceph-mgr-cephadm-19.0.0-5320.ge8f88bb 2.0 MB/s | 149 kB 00:00 2024-07-26T12:03:56.071 INFO:teuthology.orchestra.run.smithi076.stdout:(8/160): ceph-common-19.0.0-5320.ge8f88bb1.el9. 5.6 MB/s | 20 MB 00:03 2024-07-26T12:03:56.138 INFO:teuthology.orchestra.run.smithi076.stdout:(9/160): ceph-selinux-19.0.0-5320.ge8f88bb1.el9 383 kB/s | 25 kB 00:00 2024-07-26T12:03:56.371 INFO:teuthology.orchestra.run.smithi076.stdout:(10/160): ceph-osd-19.0.0-5320.ge8f88bb1.el9.x8 8.4 MB/s | 18 MB 00:02 2024-07-26T12:03:56.402 INFO:teuthology.orchestra.run.smithi146.stdout:(30/160): rbd-mirror-19.0.0-5320.ge8f88bb1.el9. 5.4 MB/s | 3.1 MB 00:00 2024-07-26T12:03:56.430 INFO:teuthology.orchestra.run.smithi076.stdout:(11/160): cephfs-mirror-19.0.0-5320.ge8f88bb1.e 3.8 MB/s | 225 kB 00:00 2024-07-26T12:03:56.489 INFO:teuthology.orchestra.run.smithi076.stdout:(12/160): cephfs-shell-19.0.0-5320.ge8f88bb1.el 470 kB/s | 27 kB 00:00 2024-07-26T12:03:56.539 INFO:teuthology.orchestra.run.smithi076.stdout:(13/160): libcephfs-devel-19.0.0-5320.ge8f88bb1 645 kB/s | 32 kB 00:00 2024-07-26T12:03:56.631 INFO:teuthology.orchestra.run.smithi076.stdout:(14/160): libcephfs2-19.0.0-5320.ge8f88bb1.el9. 8.2 MB/s | 765 kB 00:00 2024-07-26T12:03:56.690 INFO:teuthology.orchestra.run.smithi076.stdout:(15/160): libcephsqlite-19.0.0-5320.ge8f88bb1.e 2.7 MB/s | 158 kB 00:00 2024-07-26T12:03:56.749 INFO:teuthology.orchestra.run.smithi076.stdout:(16/160): librados-devel-19.0.0-5320.ge8f88bb1. 2.1 MB/s | 127 kB 00:00 2024-07-26T12:03:56.863 INFO:teuthology.orchestra.run.smithi040.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 70 kB/s | 80 kB 00:01 2024-07-26T12:03:56.886 INFO:teuthology.orchestra.run.smithi146.stdout:(31/160): ceph-test-19.0.0-5320.ge8f88bb1.el9.x 13 MB/s | 44 MB 00:03 2024-07-26T12:03:56.941 INFO:teuthology.orchestra.run.smithi076.stdout:(17/160): ceph-radosgw-19.0.0-5320.ge8f88bb1.el 6.5 MB/s | 10 MB 00:01 2024-07-26T12:03:56.961 INFO:teuthology.orchestra.run.smithi146.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5320.ge8 3.8 MB/s | 284 kB 00:00 2024-07-26T12:03:56.983 INFO:teuthology.orchestra.run.smithi076.stdout:(18/160): libradosstriper1-19.0.0-5320.ge8f88bb 2.1 MB/s | 503 kB 00:00 2024-07-26T12:03:57.011 INFO:teuthology.orchestra.run.smithi146.stdout:(33/160): ceph-mgr-rook-19.0.0-5320.ge8f88bb1.e 1.0 MB/s | 49 kB 00:00 2024-07-26T12:03:57.042 INFO:teuthology.orchestra.run.smithi076.stdout:(19/160): python3-ceph-argparse-19.0.0-5320.ge8 786 kB/s | 45 kB 00:00 2024-07-26T12:03:57.070 INFO:teuthology.orchestra.run.smithi146.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5320.ge 289 kB/s | 16 kB 00:00 2024-07-26T12:03:57.090 INFO:teuthology.orchestra.run.smithi040.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 151 kB/s | 195 kB 00:01 2024-07-26T12:03:57.100 INFO:teuthology.orchestra.run.smithi076.stdout:(20/160): python3-ceph-common-19.0.0-5320.ge8f8 2.3 MB/s | 138 kB 00:00 2024-07-26T12:03:57.128 INFO:teuthology.orchestra.run.smithi146.stdout:(35/160): ceph-volume-19.0.0-5320.ge8f88bb1.el9 4.7 MB/s | 274 kB 00:00 2024-07-26T12:03:57.159 INFO:teuthology.orchestra.run.smithi076.stdout:(21/160): python3-cephfs-19.0.0-5320.ge8f88bb1. 3.2 MB/s | 188 kB 00:00 2024-07-26T12:03:57.226 INFO:teuthology.orchestra.run.smithi076.stdout:(22/160): python3-rados-19.0.0-5320.ge8f88bb1.e 5.5 MB/s | 372 kB 00:00 2024-07-26T12:03:57.293 INFO:teuthology.orchestra.run.smithi076.stdout:(23/160): python3-rbd-19.0.0-5320.ge8f88bb1.el9 5.3 MB/s | 355 kB 00:00 2024-07-26T12:03:57.304 INFO:teuthology.orchestra.run.smithi146.stdout:(36/160): ceph-mgr-dashboard-19.0.0-5320.ge8f88 11 MB/s | 14 MB 00:01 2024-07-26T12:03:57.352 INFO:teuthology.orchestra.run.smithi076.stdout:(24/160): python3-rgw-19.0.0-5320.ge8f88bb1.el9 2.0 MB/s | 116 kB 00:00 2024-07-26T12:03:57.396 INFO:teuthology.orchestra.run.smithi146.stdout:(37/160): cephadm-19.0.0-5320.ge8f88bb1.el9.noa 2.8 MB/s | 771 kB 00:00 2024-07-26T12:03:57.402 INFO:teuthology.orchestra.run.smithi076.stdout:(25/160): rbd-fuse-19.0.0-5320.ge8f88bb1.el9.x8 1.7 MB/s | 86 kB 00:00 2024-07-26T12:03:57.413 INFO:teuthology.orchestra.run.smithi146.stdout:(38/160): cephfs-top-19.0.0-5320.ge8f88bb1.el9. 169 kB/s | 18 kB 00:00 2024-07-26T12:03:57.561 INFO:teuthology.orchestra.run.smithi076.stdout:(26/160): librgw2-19.0.0-5320.ge8f88bb1.el9.x86 8.5 MB/s | 5.3 MB 00:00 2024-07-26T12:03:57.572 INFO:teuthology.orchestra.run.smithi146.stdout:(39/160): fuse-2.9.9-16.el9.x86_64.rpm 458 kB/s | 80 kB 00:00 2024-07-26T12:03:57.620 INFO:teuthology.orchestra.run.smithi076.stdout:(27/160): rbd-nbd-19.0.0-5320.ge8f88bb1.el9.x86 2.9 MB/s | 170 kB 00:00 2024-07-26T12:03:57.703 INFO:teuthology.orchestra.run.smithi076.stdout:(28/160): rbd-mirror-19.0.0-5320.ge8f88bb1.el9. 10 MB/s | 3.1 MB 00:00 2024-07-26T12:03:57.729 INFO:teuthology.orchestra.run.smithi076.stdout:(29/160): ceph-grafana-dashboards-19.0.0-5320.g 318 kB/s | 34 kB 00:00 2024-07-26T12:03:57.762 INFO:teuthology.orchestra.run.smithi076.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5320.ge8f88bb 2.5 MB/s | 149 kB 00:00 2024-07-26T12:03:57.763 INFO:teuthology.orchestra.run.smithi146.stdout:(40/160): ceph-mgr-diskprediction-local-19.0.0- 5.4 MB/s | 7.4 MB 00:01 2024-07-26T12:03:57.789 INFO:teuthology.orchestra.run.smithi146.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 904 kB/s | 195 kB 00:00 2024-07-26T12:03:57.839 INFO:teuthology.orchestra.run.smithi146.stdout:(42/160): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-07-26T12:03:57.873 INFO:teuthology.orchestra.run.smithi146.stdout:(43/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-07-26T12:03:57.898 INFO:teuthology.orchestra.run.smithi146.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-07-26T12:03:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-07-26T12:03:57.990 INFO:teuthology.orchestra.run.smithi146.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-07-26T12:03:58.023 INFO:teuthology.orchestra.run.smithi146.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-07-26T12:03:58.122 INFO:teuthology.orchestra.run.smithi040.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 201 kB/s | 253 kB 00:01 2024-07-26T12:03:58.149 INFO:teuthology.orchestra.run.smithi146.stdout:(48/160): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-07-26T12:03:58.191 INFO:teuthology.orchestra.run.smithi146.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-07-26T12:03:58.196 INFO:teuthology.orchestra.run.smithi076.stdout:(31/160): ceph-mgr-diskprediction-local-19.0.0- 17 MB/s | 7.4 MB 00:00 2024-07-26T12:03:58.233 INFO:teuthology.orchestra.run.smithi146.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 532 kB/s | 22 kB 00:00 2024-07-26T12:03:58.254 INFO:teuthology.orchestra.run.smithi076.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5320.ge8 4.8 MB/s | 284 kB 00:00 2024-07-26T12:03:58.291 INFO:teuthology.orchestra.run.smithi146.stdout:(51/160): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-07-26T12:03:58.305 INFO:teuthology.orchestra.run.smithi076.stdout:(33/160): ceph-mgr-rook-19.0.0-5320.ge8f88bb1.e 1.0 MB/s | 49 kB 00:00 2024-07-26T12:03:58.333 INFO:teuthology.orchestra.run.smithi146.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 801 kB/s | 33 kB 00:00 2024-07-26T12:03:58.355 INFO:teuthology.orchestra.run.smithi076.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5320.ge 334 kB/s | 16 kB 00:00 2024-07-26T12:03:58.367 INFO:teuthology.orchestra.run.smithi146.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-07-26T12:03:58.409 INFO:teuthology.orchestra.run.smithi146.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 446 kB/s | 18 kB 00:00 2024-07-26T12:03:58.414 INFO:teuthology.orchestra.run.smithi076.stdout:(35/160): ceph-volume-19.0.0-5320.ge8f88bb1.el9 4.7 MB/s | 274 kB 00:00 2024-07-26T12:03:58.451 INFO:teuthology.orchestra.run.smithi146.stdout:(55/160): libaio-devel-0.3.111-13.el9.x86_64.rp 273 kB/s | 11 kB 00:00 2024-07-26T12:03:58.501 INFO:teuthology.orchestra.run.smithi146.stdout:(56/160): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2024-07-26T12:03:58.506 INFO:teuthology.orchestra.run.smithi076.stdout:(36/160): cephadm-19.0.0-5320.ge8f88bb1.el9.noa 8.3 MB/s | 771 kB 00:00 2024-07-26T12:03:58.535 INFO:teuthology.orchestra.run.smithi146.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-07-26T12:03:58.556 INFO:teuthology.orchestra.run.smithi076.stdout:(37/160): cephfs-top-19.0.0-5320.ge8f88bb1.el9. 370 kB/s | 18 kB 00:00 2024-07-26T12:03:58.586 INFO:teuthology.orchestra.run.smithi146.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2024-07-26T12:03:58.589 INFO:teuthology.orchestra.run.smithi040.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 839 kB/s | 1.2 MB 00:01 2024-07-26T12:03:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:(44/160): libgfortran-11.4.1-3.el9.x86_64.rpm 276 kB/s | 803 kB 00:02 2024-07-26T12:03:58.744 INFO:teuthology.orchestra.run.smithi146.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-07-26T12:03:58.786 INFO:teuthology.orchestra.run.smithi146.stdout:(60/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 618 kB/s | 25 kB 00:00 2024-07-26T12:03:58.844 INFO:teuthology.orchestra.run.smithi146.stdout:(61/160): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-07-26T12:03:58.889 INFO:teuthology.orchestra.run.smithi146.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 467 kB/s | 47 kB 00:00 2024-07-26T12:03:58.986 INFO:teuthology.orchestra.run.smithi146.stdout:(63/160): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2024-07-26T12:03:59.007 INFO:teuthology.orchestra.run.smithi076.stdout:(38/160): ceph-mgr-dashboard-19.0.0-5320.ge8f88 11 MB/s | 14 MB 00:01 2024-07-26T12:03:59.020 INFO:teuthology.orchestra.run.smithi146.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 292 kB 00:00 2024-07-26T12:03:59.024 INFO:teuthology.orchestra.run.smithi076.stdout:(39/160): fuse-2.9.9-16.el9.x86_64.rpm 171 kB/s | 80 kB 00:00 2024-07-26T12:03:59.045 INFO:teuthology.orchestra.run.smithi146.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 35 kB 00:00 2024-07-26T12:03:59.146 INFO:teuthology.orchestra.run.smithi146.stdout:(66/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-07-26T12:03:59.481 INFO:teuthology.orchestra.run.smithi040.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 152 kB/s | 135 kB 00:00 2024-07-26T12:03:59.516 INFO:teuthology.orchestra.run.smithi076.stdout:(40/160): ceph-test-19.0.0-5320.ge8f88bb1.el9.x 13 MB/s | 44 MB 00:03 2024-07-26T12:03:59.550 INFO:teuthology.orchestra.run.smithi076.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 372 kB/s | 195 kB 00:00 2024-07-26T12:03:59.604 INFO:teuthology.orchestra.run.smithi146.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-07-26T12:03:59.897 INFO:teuthology.orchestra.run.smithi146.stdout:(68/160): postgresql-contrib-13.14-1.el9.x86_64 3.1 MB/s | 911 kB 00:00 2024-07-26T12:03:59.972 INFO:teuthology.orchestra.run.smithi146.stdout:(69/160): postgresql-private-libs-13.14-1.el9.x 1.8 MB/s | 133 kB 00:00 2024-07-26T12:04:00.075 INFO:teuthology.orchestra.run.smithi076.stdout:(42/160): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-07-26T12:04:00.114 INFO:teuthology.orchestra.run.smithi040.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 89 kB/s | 125 kB 00:01 2024-07-26T12:04:00.184 INFO:teuthology.orchestra.run.smithi076.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 991 kB/s | 106 kB 00:00 2024-07-26T12:04:00.209 INFO:teuthology.orchestra.run.smithi076.stdout:(44/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 366 kB/s | 253 kB 00:00 2024-07-26T12:04:00.243 INFO:teuthology.orchestra.run.smithi076.stdout:(45/160): libgfortran-11.4.1-3.el9.x86_64.rpm 651 kB/s | 803 kB 00:01 2024-07-26T12:04:00.255 INFO:teuthology.orchestra.run.smithi146.stdout:(70/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-07-26T12:04:00.285 INFO:teuthology.orchestra.run.smithi076.stdout:(46/160): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-07-26T12:04:00.318 INFO:teuthology.orchestra.run.smithi076.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-07-26T12:04:00.361 INFO:teuthology.orchestra.run.smithi076.stdout:(48/160): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-07-26T12:04:00.372 INFO:teuthology.orchestra.run.smithi146.stdout:(71/160): openblas-openmp-0.3.21-2.el9.x86_64.r 3.5 MB/s | 4.7 MB 00:01 2024-07-26T12:04:00.373 INFO:teuthology.orchestra.run.smithi040.stdout:(47/160): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-07-26T12:04:00.447 INFO:teuthology.orchestra.run.smithi146.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 87 kB 00:00 2024-07-26T12:04:00.494 INFO:teuthology.orchestra.run.smithi076.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-07-26T12:04:00.519 INFO:teuthology.orchestra.run.smithi076.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 677 kB/s | 107 kB 00:00 2024-07-26T12:04:00.553 INFO:teuthology.orchestra.run.smithi076.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-07-26T12:04:00.607 INFO:teuthology.orchestra.run.smithi040.stdout:(48/160): bison-3.7.4-5.el9.x86_64.rpm 4.0 MB/s | 943 kB 00:00 2024-07-26T12:04:00.622 INFO:teuthology.orchestra.run.smithi146.stdout:(73/160): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-07-26T12:04:00.637 INFO:teuthology.orchestra.run.smithi076.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 396 kB/s | 33 kB 00:00 2024-07-26T12:04:00.665 INFO:teuthology.orchestra.run.smithi146.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.5 MB/s | 61 kB 00:00 2024-07-26T12:04:00.665 INFO:teuthology.orchestra.run.smithi040.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-07-26T12:04:00.679 INFO:teuthology.orchestra.run.smithi076.stdout:(53/160): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-07-26T12:04:00.713 INFO:teuthology.orchestra.run.smithi076.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 1.6 MB/s | 313 kB 00:00 2024-07-26T12:04:00.715 INFO:teuthology.orchestra.run.smithi040.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 439 kB/s | 22 kB 00:00 2024-07-26T12:04:00.738 INFO:teuthology.orchestra.run.smithi076.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 314 kB/s | 18 kB 00:00 2024-07-26T12:04:00.764 INFO:teuthology.orchestra.run.smithi076.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-07-26T12:04:00.806 INFO:teuthology.orchestra.run.smithi076.stdout:(57/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-07-26T12:04:00.807 INFO:teuthology.orchestra.run.smithi040.stdout:(51/160): flex-2.6.4-9.el9.x86_64.rpm 3.4 MB/s | 313 kB 00:00 2024-07-26T12:04:00.831 INFO:teuthology.orchestra.run.smithi076.stdout:(58/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-07-26T12:04:00.857 INFO:teuthology.orchestra.run.smithi146.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-07-26T12:04:00.925 INFO:teuthology.orchestra.run.smithi040.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-07-26T12:04:00.932 INFO:teuthology.orchestra.run.smithi146.stdout:(76/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-07-26T12:04:00.940 INFO:teuthology.orchestra.run.smithi076.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-07-26T12:04:00.958 INFO:teuthology.orchestra.run.smithi040.stdout:(53/160): python3-urllib3-1.26.5-6.el9.noarch.r 145 kB/s | 215 kB 00:01 2024-07-26T12:04:00.974 INFO:teuthology.orchestra.run.smithi146.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 627 kB/s | 26 kB 00:00 2024-07-26T12:04:00.982 INFO:teuthology.orchestra.run.smithi076.stdout:(60/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 622 kB/s | 25 kB 00:00 2024-07-26T12:04:01.024 INFO:teuthology.orchestra.run.smithi076.stdout:(61/160): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-07-26T12:04:01.041 INFO:teuthology.orchestra.run.smithi146.stdout:(78/160): python3-jsonpointer-2.0-4.el9.noarch. 291 kB/s | 19 kB 00:00 2024-07-26T12:04:01.041 INFO:teuthology.orchestra.run.smithi076.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 815 kB/s | 47 kB 00:00 2024-07-26T12:04:01.042 INFO:teuthology.orchestra.run.smithi040.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 221 kB/s | 18 kB 00:00 2024-07-26T12:04:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:(55/160): libaio-devel-0.3.111-13.el9.x86_64.rp 226 kB/s | 11 kB 00:00 2024-07-26T12:04:01.108 INFO:teuthology.orchestra.run.smithi146.stdout:(79/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-07-26T12:04:01.125 INFO:teuthology.orchestra.run.smithi076.stdout:(63/160): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-07-26T12:04:01.141 INFO:teuthology.orchestra.run.smithi146.stdout:(80/160): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-07-26T12:04:01.158 INFO:teuthology.orchestra.run.smithi076.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-07-26T12:04:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:(56/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-07-26T12:04:01.184 INFO:teuthology.orchestra.run.smithi076.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 608 kB/s | 35 kB 00:00 2024-07-26T12:04:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:(57/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 785 kB/s | 45 kB 00:00 2024-07-26T12:04:01.393 INFO:teuthology.orchestra.run.smithi040.stdout:(58/160): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-07-26T12:04:01.459 INFO:teuthology.orchestra.run.smithi076.stdout:(66/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-07-26T12:04:01.543 INFO:teuthology.orchestra.run.smithi040.stdout:(59/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-07-26T12:04:01.577 INFO:teuthology.orchestra.run.smithi040.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-07-26T12:04:01.602 INFO:teuthology.orchestra.run.smithi040.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 440 kB/s | 25 kB 00:00 2024-07-26T12:04:01.627 INFO:teuthology.orchestra.run.smithi040.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2024-07-26T12:04:01.711 INFO:teuthology.orchestra.run.smithi040.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-07-26T12:04:01.745 INFO:teuthology.orchestra.run.smithi040.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-07-26T12:04:01.770 INFO:teuthology.orchestra.run.smithi040.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 607 kB/s | 35 kB 00:00 2024-07-26T12:04:01.817 INFO:teuthology.orchestra.run.smithi146.stdout:(81/160): postgresql-server-13.14-1.el9.x86_64. 3.1 MB/s | 5.8 MB 00:01 2024-07-26T12:04:01.951 INFO:teuthology.orchestra.run.smithi076.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-07-26T12:04:01.978 INFO:teuthology.orchestra.run.smithi146.stdout:(82/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.1 MB/s | 5.1 MB 00:00 2024-07-26T12:04:02.008 INFO:teuthology.orchestra.run.smithi146.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-07-26T12:04:02.042 INFO:teuthology.orchestra.run.smithi146.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-07-26T12:04:02.085 INFO:teuthology.orchestra.run.smithi146.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-07-26T12:04:02.110 INFO:teuthology.orchestra.run.smithi146.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 636 kB/s | 42 kB 00:00 2024-07-26T12:04:02.152 INFO:teuthology.orchestra.run.smithi146.stdout:(87/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.8 MB/s | 159 kB 00:00 2024-07-26T12:04:02.210 INFO:teuthology.orchestra.run.smithi146.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-07-26T12:04:02.229 INFO:teuthology.orchestra.run.smithi040.stdout:(66/160): python3-ply-3.11-14.el9.noarch.rpm 26 kB/s | 106 kB 00:04 2024-07-26T12:04:02.235 INFO:teuthology.orchestra.run.smithi076.stdout:(68/160): postgresql-contrib-13.14-1.el9.x86_64 3.1 MB/s | 911 kB 00:00 2024-07-26T12:04:02.276 INFO:teuthology.orchestra.run.smithi146.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-07-26T12:04:02.310 INFO:teuthology.orchestra.run.smithi076.stdout:(69/160): postgresql-private-libs-13.14-1.el9.x 1.8 MB/s | 133 kB 00:00 2024-07-26T12:04:02.311 INFO:teuthology.orchestra.run.smithi146.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 513 kB/s | 51 kB 00:00 2024-07-26T12:04:02.336 INFO:teuthology.orchestra.run.smithi146.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-07-26T12:04:02.378 INFO:teuthology.orchestra.run.smithi146.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-07-26T12:04:02.420 INFO:teuthology.orchestra.run.smithi146.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-07-26T12:04:02.462 INFO:teuthology.orchestra.run.smithi040.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 6.6 MB/s | 4.7 MB 00:00 2024-07-26T12:04:02.470 INFO:teuthology.orchestra.run.smithi146.stdout:(94/160): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-07-26T12:04:02.504 INFO:teuthology.orchestra.run.smithi146.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-07-26T12:04:02.575 INFO:teuthology.orchestra.run.smithi146.stdout:(96/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 678 kB/s | 47 kB 00:00 2024-07-26T12:04:02.610 INFO:teuthology.orchestra.run.smithi076.stdout:(70/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-07-26T12:04:02.629 INFO:teuthology.orchestra.run.smithi040.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-07-26T12:04:02.646 INFO:teuthology.orchestra.run.smithi146.stdout:(97/160): socat-1.7.4.1-6.el9.x86_64.rpm 4.2 MB/s | 304 kB 00:00 2024-07-26T12:04:02.680 INFO:teuthology.orchestra.run.smithi146.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-07-26T12:04:02.711 INFO:teuthology.orchestra.run.smithi076.stdout:(71/160): openblas-openmp-0.3.21-2.el9.x86_64.r 3.1 MB/s | 4.7 MB 00:01 2024-07-26T12:04:02.729 INFO:teuthology.orchestra.run.smithi040.stdout:(69/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-07-26T12:04:02.770 INFO:teuthology.orchestra.run.smithi076.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-07-26T12:04:02.780 INFO:teuthology.orchestra.run.smithi040.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 2.8 MB/s | 911 kB 00:00 2024-07-26T12:04:02.797 INFO:teuthology.orchestra.run.smithi146.stdout:(99/160): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-07-26T12:04:02.805 INFO:teuthology.orchestra.run.smithi040.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 763 kB/s | 133 kB 00:00 2024-07-26T12:04:02.822 INFO:teuthology.orchestra.run.smithi146.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 677 kB/s | 96 kB 00:00 2024-07-26T12:04:02.847 INFO:teuthology.orchestra.run.smithi146.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-07-26T12:04:02.864 INFO:teuthology.orchestra.run.smithi040.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-07-26T12:04:02.898 INFO:teuthology.orchestra.run.smithi146.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-07-26T12:04:02.997 INFO:teuthology.orchestra.run.smithi040.stdout:(73/160): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-07-26T12:04:03.003 INFO:teuthology.orchestra.run.smithi076.stdout:(73/160): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-07-26T12:04:03.056 INFO:teuthology.orchestra.run.smithi040.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-07-26T12:04:03.070 INFO:teuthology.orchestra.run.smithi076.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 931 kB/s | 61 kB 00:00 2024-07-26T12:04:03.114 INFO:teuthology.orchestra.run.smithi040.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-07-26T12:04:03.171 INFO:teuthology.orchestra.run.smithi076.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-07-26T12:04:03.173 INFO:teuthology.orchestra.run.smithi040.stdout:(76/160): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-07-26T12:04:03.223 INFO:teuthology.orchestra.run.smithi040.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 522 kB/s | 26 kB 00:00 2024-07-26T12:04:03.290 INFO:teuthology.orchestra.run.smithi040.stdout:(78/160): python3-jsonpointer-2.0-4.el9.noarch. 291 kB/s | 19 kB 00:00 2024-07-26T12:04:03.332 INFO:teuthology.orchestra.run.smithi146.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 46 kB/s | 22 kB 00:00 2024-07-26T12:04:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:(79/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-07-26T12:04:03.363 INFO:teuthology.orchestra.run.smithi076.stdout:(76/160): postgresql-server-13.14-1.el9.x86_64. 5.5 MB/s | 5.8 MB 00:01 2024-07-26T12:04:03.396 INFO:teuthology.orchestra.run.smithi076.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 1.1 MB/s | 248 kB 00:00 2024-07-26T12:04:03.399 INFO:teuthology.orchestra.run.smithi040.stdout:(80/160): python3-markupsafe-1.1.1-12.el9.x86_6 707 kB/s | 35 kB 00:00 2024-07-26T12:04:03.422 INFO:teuthology.orchestra.run.smithi076.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 444 kB/s | 26 kB 00:00 2024-07-26T12:04:03.447 INFO:teuthology.orchestra.run.smithi076.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 387 kB/s | 19 kB 00:00 2024-07-26T12:04:03.465 INFO:teuthology.orchestra.run.smithi146.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-07-26T12:04:03.481 INFO:teuthology.orchestra.run.smithi076.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-07-26T12:04:03.506 INFO:teuthology.orchestra.run.smithi076.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 600 kB/s | 35 kB 00:00 2024-07-26T12:04:03.523 INFO:teuthology.orchestra.run.smithi146.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 5.3 MB/s | 309 kB 00:00 2024-07-26T12:04:03.549 INFO:teuthology.orchestra.run.smithi146.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 806 kB/s | 19 kB 00:00 2024-07-26T12:04:03.573 INFO:teuthology.orchestra.run.smithi076.stdout:(82/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-07-26T12:04:03.690 INFO:teuthology.orchestra.run.smithi076.stdout:(83/160): python3-babel-2.9.1-2.el9.noarch.rpm 6.5 MB/s | 6.0 MB 00:00 2024-07-26T12:04:03.724 INFO:teuthology.orchestra.run.smithi076.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-07-26T12:04:03.733 INFO:teuthology.orchestra.run.smithi146.stdout:(107/160): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-07-26T12:04:03.749 INFO:teuthology.orchestra.run.smithi076.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-07-26T12:04:03.758 INFO:teuthology.orchestra.run.smithi146.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-07-26T12:04:03.775 INFO:teuthology.orchestra.run.smithi076.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 852 kB/s | 42 kB 00:00 2024-07-26T12:04:03.791 INFO:teuthology.orchestra.run.smithi040.stdout:(81/160): postgresql-server-13.14-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-07-26T12:04:03.817 INFO:teuthology.orchestra.run.smithi146.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 846 kB/s | 49 kB 00:00 2024-07-26T12:04:03.817 INFO:teuthology.orchestra.run.smithi076.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-07-26T12:04:03.842 INFO:teuthology.orchestra.run.smithi146.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 3.0 MB/s | 67 kB 00:00 2024-07-26T12:04:03.850 INFO:teuthology.orchestra.run.smithi076.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-07-26T12:04:03.884 INFO:teuthology.orchestra.run.smithi076.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-07-26T12:04:03.892 INFO:teuthology.orchestra.run.smithi146.stdout:(111/160): protobuf-compiler-3.14.0-13.el9.x86_ 869 kB/s | 863 kB 00:00 2024-07-26T12:04:03.908 INFO:teuthology.orchestra.run.smithi040.stdout:(82/160): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-07-26T12:04:03.909 INFO:teuthology.orchestra.run.smithi076.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2024-07-26T12:04:03.935 INFO:teuthology.orchestra.run.smithi076.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-07-26T12:04:03.942 INFO:teuthology.orchestra.run.smithi040.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-07-26T12:04:03.975 INFO:teuthology.orchestra.run.smithi040.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-07-26T12:04:03.977 INFO:teuthology.orchestra.run.smithi076.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-07-26T12:04:03.992 INFO:teuthology.orchestra.run.smithi146.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-07-26T12:04:04.000 INFO:teuthology.orchestra.run.smithi040.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-07-26T12:04:04.019 INFO:teuthology.orchestra.run.smithi076.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-07-26T12:04:04.035 INFO:teuthology.orchestra.run.smithi040.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 732 kB/s | 42 kB 00:00 2024-07-26T12:04:04.051 INFO:teuthology.orchestra.run.smithi146.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 10 MB/s | 548 kB 00:00 2024-07-26T12:04:04.076 INFO:teuthology.orchestra.run.smithi146.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-07-26T12:04:04.093 INFO:teuthology.orchestra.run.smithi040.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-07-26T12:04:04.119 INFO:teuthology.orchestra.run.smithi076.stdout:(94/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.0 MB/s | 5.1 MB 00:00 2024-07-26T12:04:04.126 INFO:teuthology.orchestra.run.smithi040.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-07-26T12:04:04.130 INFO:teuthology.orchestra.run.smithi146.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 606 kB/s | 32 kB 00:00 2024-07-26T12:04:04.153 INFO:teuthology.orchestra.run.smithi076.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-07-26T12:04:04.160 INFO:teuthology.orchestra.run.smithi146.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 493 kB/s | 14 kB 00:00 2024-07-26T12:04:04.178 INFO:teuthology.orchestra.run.smithi076.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 620 kB/s | 36 kB 00:00 2024-07-26T12:04:04.202 INFO:teuthology.orchestra.run.smithi146.stdout:(117/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.7 MB/s | 839 kB 00:00 2024-07-26T12:04:04.203 INFO:teuthology.orchestra.run.smithi076.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 956 kB/s | 47 kB 00:00 2024-07-26T12:04:04.227 INFO:teuthology.orchestra.run.smithi146.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-07-26T12:04:04.243 INFO:teuthology.orchestra.run.smithi040.stdout:(89/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.0 MB/s | 5.1 MB 00:00 2024-07-26T12:04:04.257 INFO:teuthology.orchestra.run.smithi076.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 3.8 MB/s | 304 kB 00:00 2024-07-26T12:04:04.269 INFO:teuthology.orchestra.run.smithi040.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 361 kB/s | 51 kB 00:00 2024-07-26T12:04:04.269 INFO:teuthology.orchestra.run.smithi146.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.3 MB/s | 303 kB 00:00 2024-07-26T12:04:04.288 INFO:teuthology.orchestra.run.smithi076.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 697 kB/s | 58 kB 00:00 2024-07-26T12:04:04.302 INFO:teuthology.orchestra.run.smithi040.stdout:(91/160): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-07-26T12:04:04.303 INFO:teuthology.orchestra.run.smithi146.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-07-26T12:04:04.313 INFO:teuthology.orchestra.run.smithi076.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.7 MB/s | 96 kB 00:00 2024-07-26T12:04:04.328 INFO:teuthology.orchestra.run.smithi040.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-07-26T12:04:04.339 INFO:teuthology.orchestra.run.smithi076.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-07-26T12:04:04.345 INFO:teuthology.orchestra.run.smithi146.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 2.8 MB/s | 216 kB 00:00 2024-07-26T12:04:04.364 INFO:teuthology.orchestra.run.smithi076.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-07-26T12:04:04.387 INFO:teuthology.orchestra.run.smithi040.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 500 kB/s | 42 kB 00:00 2024-07-26T12:04:04.395 INFO:teuthology.orchestra.run.smithi146.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 2.9 MB/s | 144 kB 00:00 2024-07-26T12:04:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 532 kB/s | 44 kB 00:00 2024-07-26T12:04:04.445 INFO:teuthology.orchestra.run.smithi040.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-07-26T12:04:04.454 INFO:teuthology.orchestra.run.smithi146.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2024-07-26T12:04:04.471 INFO:teuthology.orchestra.run.smithi040.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 619 kB/s | 36 kB 00:00 2024-07-26T12:04:04.479 INFO:teuthology.orchestra.run.smithi146.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 732 kB/s | 18 kB 00:00 2024-07-26T12:04:04.504 INFO:teuthology.orchestra.run.smithi040.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 819 kB/s | 47 kB 00:00 2024-07-26T12:04:04.513 INFO:teuthology.orchestra.run.smithi146.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 714 kB/s | 23 kB 00:00 2024-07-26T12:04:04.538 INFO:teuthology.orchestra.run.smithi146.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 805 kB/s | 19 kB 00:00 2024-07-26T12:04:04.546 INFO:teuthology.orchestra.run.smithi040.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-07-26T12:04:04.563 INFO:teuthology.orchestra.run.smithi146.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 816 kB/s | 20 kB 00:00 2024-07-26T12:04:04.571 INFO:teuthology.orchestra.run.smithi040.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 874 kB/s | 58 kB 00:00 2024-07-26T12:04:04.614 INFO:teuthology.orchestra.run.smithi040.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-07-26T12:04:04.639 INFO:teuthology.orchestra.run.smithi040.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 961 kB/s | 64 kB 00:00 2024-07-26T12:04:04.664 INFO:teuthology.orchestra.run.smithi146.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-07-26T12:04:04.672 INFO:teuthology.orchestra.run.smithi040.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 779 kB/s | 45 kB 00:00 2024-07-26T12:04:04.689 INFO:teuthology.orchestra.run.smithi146.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.9 MB/s | 46 kB 00:00 2024-07-26T12:04:04.736 INFO:teuthology.orchestra.run.smithi146.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 1.7 MB/s | 79 kB 00:00 2024-07-26T12:04:04.765 INFO:teuthology.orchestra.run.smithi146.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.0 MB/s | 58 kB 00:00 2024-07-26T12:04:04.798 INFO:teuthology.orchestra.run.smithi040.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 141 kB/s | 22 kB 00:00 2024-07-26T12:04:04.840 INFO:teuthology.orchestra.run.smithi146.stdout:(132/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-07-26T12:04:04.857 INFO:teuthology.orchestra.run.smithi146.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-07-26T12:04:04.891 INFO:teuthology.orchestra.run.smithi146.stdout:(134/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-07-26T12:04:04.916 INFO:teuthology.orchestra.run.smithi146.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-07-26T12:04:04.931 INFO:teuthology.orchestra.run.smithi040.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-07-26T12:04:04.933 INFO:teuthology.orchestra.run.smithi146.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 691 kB/s | 28 kB 00:00 2024-07-26T12:04:04.958 INFO:teuthology.orchestra.run.smithi146.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 749 kB/s | 31 kB 00:00 2024-07-26T12:04:04.973 INFO:teuthology.orchestra.run.smithi040.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 7.4 MB/s | 309 kB 00:00 2024-07-26T12:04:04.992 INFO:teuthology.orchestra.run.smithi146.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-07-26T12:04:04.998 INFO:teuthology.orchestra.run.smithi040.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 800 kB/s | 19 kB 00:00 2024-07-26T12:04:05.017 INFO:teuthology.orchestra.run.smithi146.stdout:(139/160): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-07-26T12:04:05.031 INFO:teuthology.orchestra.run.smithi076.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-07-26T12:04:05.057 INFO:teuthology.orchestra.run.smithi040.stdout:(107/160): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-07-26T12:04:05.076 INFO:teuthology.orchestra.run.smithi146.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-07-26T12:04:05.101 INFO:teuthology.orchestra.run.smithi146.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 615 kB/s | 51 kB 00:00 2024-07-26T12:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 2.7 MB/s | 90 kB 00:00 2024-07-26T12:04:05.156 INFO:teuthology.orchestra.run.smithi076.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-07-26T12:04:05.166 INFO:teuthology.orchestra.run.smithi040.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 242 kB/s | 26 kB 00:00 2024-07-26T12:04:05.168 INFO:teuthology.orchestra.run.smithi146.stdout:(143/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-07-26T12:04:05.190 INFO:teuthology.orchestra.run.smithi076.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 9.2 MB/s | 309 kB 00:00 2024-07-26T12:04:05.191 INFO:teuthology.orchestra.run.smithi040.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-07-26T12:04:05.202 INFO:teuthology.orchestra.run.smithi146.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 616 kB/s | 20 kB 00:00 2024-07-26T12:04:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-07-26T12:04:05.217 INFO:teuthology.orchestra.run.smithi076.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 730 kB/s | 19 kB 00:00 2024-07-26T12:04:05.244 INFO:teuthology.orchestra.run.smithi146.stdout:(145/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2024-07-26T12:04:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-07-26T12:04:05.269 INFO:teuthology.orchestra.run.smithi146.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-07-26T12:04:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-07-26T12:04:05.386 INFO:teuthology.orchestra.run.smithi146.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-07-26T12:04:05.392 INFO:teuthology.orchestra.run.smithi040.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-07-26T12:04:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-07-26T12:04:05.434 INFO:teuthology.orchestra.run.smithi076.stdout:(107/160): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-07-26T12:04:05.443 INFO:teuthology.orchestra.run.smithi040.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-07-26T12:04:05.468 INFO:teuthology.orchestra.run.smithi040.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 584 kB/s | 14 kB 00:00 2024-07-26T12:04:05.484 INFO:teuthology.orchestra.run.smithi076.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 525 kB/s | 26 kB 00:00 2024-07-26T12:04:05.510 INFO:teuthology.orchestra.run.smithi076.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-07-26T12:04:05.510 INFO:teuthology.orchestra.run.smithi040.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-07-26T12:04:05.535 INFO:teuthology.orchestra.run.smithi076.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-07-26T12:04:05.560 INFO:teuthology.orchestra.run.smithi040.stdout:(118/160): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2024-07-26T12:04:05.568 INFO:teuthology.orchestra.run.smithi076.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-07-26T12:04:05.611 INFO:teuthology.orchestra.run.smithi040.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-07-26T12:04:05.635 INFO:teuthology.orchestra.run.smithi076.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-07-26T12:04:05.653 INFO:teuthology.orchestra.run.smithi040.stdout:(120/160): python3-google-auth-2.32.0-1.el9.noa 5.2 MB/s | 216 kB 00:00 2024-07-26T12:04:05.677 INFO:teuthology.orchestra.run.smithi146.stdout:(148/160): librbd1-19.0.0-5320.ge8f88bb1.el9.x8 11 MB/s | 3.1 MB 00:00 2024-07-26T12:04:05.778 INFO:teuthology.orchestra.run.smithi076.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-07-26T12:04:05.778 INFO:teuthology.orchestra.run.smithi040.stdout:(121/160): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-07-26T12:04:05.803 INFO:teuthology.orchestra.run.smithi076.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-07-26T12:04:05.812 INFO:teuthology.orchestra.run.smithi040.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 4.4 MB/s | 144 kB 00:00 2024-07-26T12:04:05.828 INFO:teuthology.orchestra.run.smithi076.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.5 MB/s | 32 kB 00:00 2024-07-26T12:04:05.853 INFO:teuthology.orchestra.run.smithi076.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 580 kB/s | 14 kB 00:00 2024-07-26T12:04:05.862 INFO:teuthology.orchestra.run.smithi040.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 218 kB/s | 11 kB 00:00 2024-07-26T12:04:05.865 INFO:teuthology.orchestra.run.smithi146.stdout:(149/160): librados2-19.0.0-5320.ge8f88bb1.el9. 5.7 MB/s | 3.4 MB 00:00 2024-07-26T12:04:05.887 INFO:teuthology.orchestra.run.smithi076.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 5.2 MB/s | 172 kB 00:00 2024-07-26T12:04:05.888 INFO:teuthology.orchestra.run.smithi040.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 731 kB/s | 18 kB 00:00 2024-07-26T12:04:05.921 INFO:teuthology.orchestra.run.smithi040.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 712 kB/s | 23 kB 00:00 2024-07-26T12:04:05.929 INFO:teuthology.orchestra.run.smithi076.stdout:(118/160): python3-cherrypy-18.6.1-2.el9.noarch 8.6 MB/s | 358 kB 00:00 2024-07-26T12:04:05.947 INFO:teuthology.orchestra.run.smithi040.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 809 kB/s | 19 kB 00:00 2024-07-26T12:04:05.963 INFO:teuthology.orchestra.run.smithi076.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.0 MB/s | 303 kB 00:00 2024-07-26T12:04:05.996 INFO:teuthology.orchestra.run.smithi076.stdout:(120/160): python3-google-auth-2.32.0-1.el9.noa 6.5 MB/s | 216 kB 00:00 2024-07-26T12:04:06.021 INFO:teuthology.orchestra.run.smithi146.stdout:(150/160): NetworkManager-1.48.2-2.el9.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2024-07-26T12:04:06.080 INFO:teuthology.orchestra.run.smithi146.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 707 kB/s | 41 kB 00:00 2024-07-26T12:04:06.105 INFO:teuthology.orchestra.run.smithi076.stdout:(121/160): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-07-26T12:04:06.139 INFO:teuthology.orchestra.run.smithi076.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-07-26T12:04:06.139 INFO:teuthology.orchestra.run.smithi040.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 103 kB/s | 20 kB 00:00 2024-07-26T12:04:06.164 INFO:teuthology.orchestra.run.smithi076.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 442 kB/s | 11 kB 00:00 2024-07-26T12:04:06.171 INFO:teuthology.orchestra.run.smithi146.stdout:(152/160): NetworkManager-libnm-1.48.2-2.el9.x8 5.9 MB/s | 1.8 MB 00:00 2024-07-26T12:04:06.189 INFO:teuthology.orchestra.run.smithi076.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 738 kB/s | 18 kB 00:00 2024-07-26T12:04:06.204 INFO:teuthology.orchestra.run.smithi146.stdout:(153/160): NetworkManager-tui-1.48.2-2.el9.x86_ 1.9 MB/s | 247 kB 00:00 2024-07-26T12:04:06.214 INFO:teuthology.orchestra.run.smithi076.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 957 kB/s | 23 kB 00:00 2024-07-26T12:04:06.230 INFO:teuthology.orchestra.run.smithi146.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 634 kB/s | 37 kB 00:00 2024-07-26T12:04:06.240 INFO:teuthology.orchestra.run.smithi076.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 801 kB/s | 19 kB 00:00 2024-07-26T12:04:06.247 INFO:teuthology.orchestra.run.smithi040.stdout:(128/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-07-26T12:04:06.263 INFO:teuthology.orchestra.run.smithi146.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-07-26T12:04:06.265 INFO:teuthology.orchestra.run.smithi076.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 816 kB/s | 20 kB 00:00 2024-07-26T12:04:06.273 INFO:teuthology.orchestra.run.smithi040.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.9 MB/s | 46 kB 00:00 2024-07-26T12:04:06.306 INFO:teuthology.orchestra.run.smithi040.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.4 MB/s | 79 kB 00:00 2024-07-26T12:04:06.322 INFO:teuthology.orchestra.run.smithi146.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 2.8 MB/s | 260 kB 00:00 2024-07-26T12:04:06.340 INFO:teuthology.orchestra.run.smithi040.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-07-26T12:04:06.340 INFO:teuthology.orchestra.run.smithi076.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-07-26T12:04:06.374 INFO:teuthology.orchestra.run.smithi076.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-07-26T12:04:06.389 INFO:teuthology.orchestra.run.smithi146.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-07-26T12:04:06.390 INFO:teuthology.orchestra.run.smithi040.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-07-26T12:04:06.407 INFO:teuthology.orchestra.run.smithi076.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.4 MB/s | 79 kB 00:00 2024-07-26T12:04:06.415 INFO:teuthology.orchestra.run.smithi040.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 682 kB/s | 16 kB 00:00 2024-07-26T12:04:06.441 INFO:teuthology.orchestra.run.smithi076.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-07-26T12:04:06.449 INFO:teuthology.orchestra.run.smithi040.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.7 MB/s | 90 kB 00:00 2024-07-26T12:04:06.483 INFO:teuthology.orchestra.run.smithi076.stdout:(132/160): python3-pecan-1.4.2-3.el9.noarch.rpm 6.5 MB/s | 272 kB 00:00 2024-07-26T12:04:06.489 INFO:teuthology.orchestra.run.smithi146.stdout:(158/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-07-26T12:04:06.508 INFO:teuthology.orchestra.run.smithi076.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 672 kB/s | 16 kB 00:00 2024-07-26T12:04:06.539 INFO:teuthology.orchestra.run.smithi146.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-07-26T12:04:06.550 INFO:teuthology.orchestra.run.smithi076.stdout:(134/160): protobuf-compiler-3.14.0-13.el9.x86_ 395 kB/s | 863 kB 00:02 2024-07-26T12:04:06.584 INFO:teuthology.orchestra.run.smithi076.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-07-26T12:04:06.666 INFO:teuthology.orchestra.run.smithi040.stdout:(135/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.8 MB/s | 16 MB 00:02 2024-07-26T12:04:06.709 INFO:teuthology.orchestra.run.smithi076.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 228 kB/s | 28 kB 00:00 2024-07-26T12:04:06.743 INFO:teuthology.orchestra.run.smithi076.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 195 kB/s | 31 kB 00:00 2024-07-26T12:04:06.766 INFO:teuthology.orchestra.run.smithi040.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 89 kB/s | 28 kB 00:00 2024-07-26T12:04:06.776 INFO:teuthology.orchestra.run.smithi076.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-07-26T12:04:06.800 INFO:teuthology.orchestra.run.smithi040.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 232 kB/s | 31 kB 00:00 2024-07-26T12:04:06.802 INFO:teuthology.orchestra.run.smithi076.stdout:(139/160): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-07-26T12:04:06.827 INFO:teuthology.orchestra.run.smithi076.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-07-26T12:04:06.833 INFO:teuthology.orchestra.run.smithi040.stdout:(138/160): python3-pecan-1.4.2-3.el9.noarch.rpm 553 kB/s | 272 kB 00:00 2024-07-26T12:04:06.852 INFO:teuthology.orchestra.run.smithi076.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-26T12:04:06.859 INFO:teuthology.orchestra.run.smithi040.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-07-26T12:04:06.884 INFO:teuthology.orchestra.run.smithi040.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 719 kB/s | 36 kB 00:00 2024-07-26T12:04:06.886 INFO:teuthology.orchestra.run.smithi076.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 2.7 MB/s | 90 kB 00:00 2024-07-26T12:04:06.918 INFO:teuthology.orchestra.run.smithi040.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 881 kB/s | 51 kB 00:00 2024-07-26T12:04:06.919 INFO:teuthology.orchestra.run.smithi076.stdout:(143/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-07-26T12:04:06.945 INFO:teuthology.orchestra.run.smithi076.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 819 kB/s | 20 kB 00:00 2024-07-26T12:04:06.960 INFO:teuthology.orchestra.run.smithi040.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-07-26T12:04:06.987 INFO:teuthology.orchestra.run.smithi076.stdout:(145/160): re2-20211101-3.el9.x86_64.rpm 4.6 MB/s | 192 kB 00:00 2024-07-26T12:04:07.008 INFO:teuthology.orchestra.run.smithi040.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-07-26T12:04:07.037 INFO:teuthology.orchestra.run.smithi076.stdout:(146/160): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-07-26T12:04:07.044 INFO:teuthology.orchestra.run.smithi040.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 574 kB/s | 20 kB 00:00 2024-07-26T12:04:07.094 INFO:teuthology.orchestra.run.smithi040.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-07-26T12:04:07.121 INFO:teuthology.orchestra.run.smithi076.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-07-26T12:04:07.170 INFO:teuthology.orchestra.run.smithi040.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-07-26T12:04:07.228 INFO:teuthology.orchestra.run.smithi040.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2024-07-26T12:04:07.350 INFO:teuthology.orchestra.run.smithi040.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 6.2 MB/s | 1.6 MB 00:00 2024-07-26T12:04:07.404 INFO:teuthology.orchestra.run.smithi076.stdout:(148/160): librados2-19.0.0-5320.ge8f88bb1.el9. 9.2 MB/s | 3.4 MB 00:00 2024-07-26T12:04:07.488 INFO:teuthology.orchestra.run.smithi076.stdout:(149/160): librbd1-19.0.0-5320.ge8f88bb1.el9.x8 8.6 MB/s | 3.1 MB 00:00 2024-07-26T12:04:07.521 INFO:teuthology.orchestra.run.smithi040.stdout:(149/160): librbd1-19.0.0-5320.ge8f88bb1.el9.x8 11 MB/s | 3.1 MB 00:00 2024-07-26T12:04:07.621 INFO:teuthology.orchestra.run.smithi040.stdout:(150/160): librados2-19.0.0-5320.ge8f88bb1.el9. 7.5 MB/s | 3.4 MB 00:00 2024-07-26T12:04:08.363 INFO:teuthology.orchestra.run.smithi076.stdout:(150/160): NetworkManager-1.48.2-2.el9.x86_64.r 2.4 MB/s | 2.3 MB 00:00 2024-07-26T12:04:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:(151/160): NetworkManager-libnm-1.48.2-2.el9.x8 1.9 MB/s | 1.8 MB 00:00 2024-07-26T12:04:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:(152/160): NetworkManager-team-1.48.2-2.el9.x86 379 kB/s | 41 kB 00:00 2024-07-26T12:04:08.504 INFO:teuthology.orchestra.run.smithi040.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 50 kB/s | 41 kB 00:00 2024-07-26T12:04:08.547 INFO:teuthology.orchestra.run.smithi076.stdout:(153/160): NetworkManager-tui-1.48.2-2.el9.x86_ 2.2 MB/s | 247 kB 00:00 2024-07-26T12:04:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 340 kB/s | 37 kB 00:00 2024-07-26T12:04:08.581 INFO:teuthology.orchestra.run.smithi146.stdout:(160/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.6 MB/s | 16 MB 00:06 2024-07-26T12:04:08.593 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-07-26T12:04:08.593 INFO:teuthology.orchestra.run.smithi146.stdout:Total 13 MB/s | 233 MB 00:17 2024-07-26T12:04:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 1.9 MB/s | 207 kB 00:00 2024-07-26T12:04:08.690 INFO:teuthology.orchestra.run.smithi076.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 2.3 MB/s | 260 kB 00:00 2024-07-26T12:04:08.798 INFO:teuthology.orchestra.run.smithi076.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-07-26T12:04:08.821 INFO:teuthology.orchestra.run.smithi040.stdout:(152/160): NetworkManager-1.48.2-2.el9.x86_64.r 1.6 MB/s | 2.3 MB 00:01 2024-07-26T12:04:08.942 INFO:teuthology.orchestra.run.smithi076.stdout:(158/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.7 MB/s | 1.1 MB 00:00 2024-07-26T12:04:08.955 INFO:teuthology.orchestra.run.smithi040.stdout:(153/160): NetworkManager-libnm-1.48.2-2.el9.x8 1.3 MB/s | 1.8 MB 00:01 2024-07-26T12:04:09.522 INFO:teuthology.orchestra.run.smithi040.stdout:(154/160): NetworkManager-tui-1.48.2-2.el9.x86_ 243 kB/s | 247 kB 00:01 2024-07-26T12:04:09.614 INFO:teuthology.orchestra.run.smithi040.stdout:(155/160): elfutils-debuginfod-client-0.191-4.e 51 kB/s | 37 kB 00:00 2024-07-26T12:04:09.757 INFO:teuthology.orchestra.run.smithi076.stdout:(159/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.8 MB/s | 16 MB 00:05 2024-07-26T12:04:09.947 INFO:teuthology.orchestra.run.smithi040.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 209 kB/s | 207 kB 00:00 2024-07-26T12:04:10.132 INFO:teuthology.orchestra.run.smithi076.stdout:(160/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 1.7 MB/s | 2.4 MB 00:01 2024-07-26T12:04:10.143 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-07-26T12:04:10.144 INFO:teuthology.orchestra.run.smithi076.stdout:Total 12 MB/s | 233 MB 00:18 2024-07-26T12:04:10.506 INFO:teuthology.orchestra.run.smithi040.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 264 kB/s | 260 kB 00:00 2024-07-26T12:04:10.898 INFO:teuthology.orchestra.run.smithi040.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 1.1 MB/s | 1.4 MB 00:01 2024-07-26T12:04:11.307 INFO:teuthology.orchestra.run.smithi040.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-07-26T12:04:11.632 INFO:teuthology.orchestra.run.smithi040.stdout:(160/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 986 kB/s | 1.1 MB 00:01 2024-07-26T12:04:11.645 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-07-26T12:04:11.646 INFO:teuthology.orchestra.run.smithi040.stdout:Total 10 MB/s | 233 MB 00:22 2024-07-26T12:04:12.057 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-07-26T12:04:12.349 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-07-26T12:04:12.349 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-07-26T12:04:13.386 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-07-26T12:04:13.674 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-07-26T12:04:13.674 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-07-26T12:04:15.004 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-07-26T12:04:15.013 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-07-26T12:04:15.014 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-07-26T12:04:15.317 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-07-26T12:04:15.317 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-07-26T12:04:16.536 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-07-26T12:04:16.536 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-07-26T12:04:18.099 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-07-26T12:04:18.099 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-07-26T12:04:22.135 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-07-26T12:04:22.220 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-26T12:04:22.295 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-26T12:04:22.395 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-26T12:04:22.447 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-26T12:04:22.480 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-26T12:04:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-26T12:04:23.037 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-26T12:04:23.138 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:04:23.339 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:04:23.371 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:04:23.482 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-07-26T12:04:23.497 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:04:23.537 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T12:04:23.580 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-26T12:04:23.600 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-26T12:04:23.676 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-26T12:04:23.842 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-26T12:04:23.882 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-26T12:04:23.929 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-26T12:04:23.946 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-26T12:04:23.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:04:23.983 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-26T12:04:24.097 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-26T12:04:24.132 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:04:24.169 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T12:04:24.247 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T12:04:24.279 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T12:04:24.336 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T12:04:24.571 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-26T12:04:24.684 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T12:04:24.706 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:04:24.886 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:04:24.892 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T12:04:24.922 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-07-26T12:04:24.956 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:04:25.004 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-26T12:04:25.083 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-26T12:04:25.087 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:04:25.155 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T12:04:25.183 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-26T12:04:25.233 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-26T12:04:25.248 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-26T12:04:25.265 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-26T12:04:25.272 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-26T12:04:25.362 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-26T12:04:25.527 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T12:04:25.572 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-26T12:04:25.608 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T12:04:25.661 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-26T12:04:25.686 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:04:25.788 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:25.804 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-26T12:04:25.854 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:04:25.887 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T12:04:25.899 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:25.905 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:04:25.982 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T12:04:26.013 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T12:04:26.088 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T12:04:26.091 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:04:26.122 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:04:26.239 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:26.277 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:04:26.346 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T12:04:26.399 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T12:04:26.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-26T12:04:26.430 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-26T12:04:26.470 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-26T12:04:26.526 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-26T12:04:26.569 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T12:04:26.641 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-26T12:04:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-26T12:04:26.739 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-26T12:04:26.769 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-26T12:04:26.810 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-26T12:04:26.835 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:04:26.842 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-26T12:04:26.884 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-26T12:04:26.919 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-26T12:04:26.932 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-26T12:04:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:04:27.032 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-26T12:04:27.037 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T12:04:27.104 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T12:04:27.131 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-26T12:04:27.132 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 15/172 2024-07-26T12:04:27.163 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T12:04:27.171 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-26T12:04:27.192 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T12:04:27.219 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-26T12:04:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-26T12:04:27.324 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-26T12:04:27.380 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 35/172 2024-07-26T12:04:27.396 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:27.456 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 36/172 2024-07-26T12:04:27.490 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 37/172 2024-07-26T12:04:27.506 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:27.512 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T12:04:27.610 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-26T12:04:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-26T12:04:27.690 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-26T12:04:27.775 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-26T12:04:27.849 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:27.974 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-26T12:04:28.047 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-26T12:04:28.057 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-26T12:04:28.096 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-26T12:04:28.097 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-26T12:04:28.151 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-26T12:04:28.263 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T12:04:28.278 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-26T12:04:28.341 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-26T12:04:28.351 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-26T12:04:28.394 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-26T12:04:28.468 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-26T12:04:28.513 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-26T12:04:28.545 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:28.553 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-26T12:04:28.649 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:28.692 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-26T12:04:28.725 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-26T12:04:28.757 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-26T12:04:28.796 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-26T12:04:28.829 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-26T12:04:28.852 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-26T12:04:28.864 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-26T12:04:28.919 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-26T12:04:28.962 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-26T12:04:28.976 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-26T12:04:29.000 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 35/172 2024-07-26T12:04:29.009 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-26T12:04:29.021 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 48/172 2024-07-26T12:04:29.065 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 36/172 2024-07-26T12:04:29.094 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-26T12:04:29.098 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 37/172 2024-07-26T12:04:29.180 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-26T12:04:29.214 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-26T12:04:29.221 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-26T12:04:29.274 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-26T12:04:29.275 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-26T12:04:29.311 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-26T12:04:29.374 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-26T12:04:29.384 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-26T12:04:29.395 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-26T12:04:29.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-26T12:04:29.503 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-26T12:04:29.508 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-26T12:04:29.551 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-26T12:04:29.566 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-26T12:04:29.589 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-26T12:04:29.613 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-26T12:04:29.620 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-26T12:04:29.654 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-26T12:04:29.674 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-26T12:04:29.718 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-26T12:04:29.755 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-26T12:04:29.775 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-26T12:04:29.823 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-26T12:04:29.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-26T12:04:29.873 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-26T12:04:29.890 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-26T12:04:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-26T12:04:29.946 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-26T12:04:29.993 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-26T12:04:30.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-26T12:04:30.109 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 35/172 2024-07-26T12:04:30.175 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 36/172 2024-07-26T12:04:30.188 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-26T12:04:30.217 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 37/172 2024-07-26T12:04:30.241 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-26T12:04:30.266 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-26T12:04:30.284 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-26T12:04:30.340 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-26T12:04:30.367 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-26T12:04:30.398 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-26T12:04:30.404 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-26T12:04:30.426 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-26T12:04:30.442 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-26T12:04:30.474 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-26T12:04:30.506 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-26T12:04:30.511 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-26T12:04:30.526 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-26T12:04:30.552 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 48/172 2024-07-26T12:04:30.564 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-26T12:04:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-26T12:04:30.644 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-26T12:04:30.693 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-26T12:04:30.758 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-26T12:04:30.793 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-26T12:04:30.830 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-26T12:04:30.897 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-26T12:04:30.972 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-26T12:04:31.009 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-26T12:04:31.053 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-26T12:04:31.082 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-26T12:04:31.099 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-26T12:04:31.147 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-26T12:04:31.167 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-26T12:04:31.206 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-26T12:04:31.207 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-26T12:04:31.244 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-26T12:04:31.266 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-26T12:04:31.308 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-26T12:04:31.315 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-26T12:04:31.354 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-26T12:04:31.386 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-26T12:04:31.416 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-26T12:04:31.466 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-26T12:04:31.468 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-26T12:04:31.574 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-26T12:04:31.614 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-26T12:04:31.656 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-26T12:04:31.658 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-26T12:04:31.705 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-26T12:04:31.721 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-26T12:04:31.751 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-26T12:04:31.768 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 48/172 2024-07-26T12:04:31.844 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-26T12:04:31.882 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-26T12:04:31.897 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-26T12:04:31.921 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-26T12:04:31.953 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-26T12:04:31.982 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-26T12:04:31.999 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-26T12:04:32.020 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-26T12:04:32.053 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-26T12:04:32.066 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-26T12:04:32.139 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-26T12:04:32.231 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-26T12:04:32.247 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-26T12:04:32.251 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-26T12:04:32.283 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-26T12:04:32.406 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-26T12:04:32.431 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-26T12:04:32.441 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-26T12:04:32.476 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-26T12:04:32.477 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-26T12:04:32.512 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-26T12:04:32.543 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T12:04:32.550 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-26T12:04:32.574 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-26T12:04:32.605 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-26T12:04:32.612 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-26T12:04:32.651 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-26T12:04:32.660 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-26T12:04:32.700 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-26T12:04:32.721 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-26T12:04:32.739 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-26T12:04:32.768 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-26T12:04:32.788 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-26T12:04:32.831 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-26T12:04:32.842 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-26T12:04:32.887 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-26T12:04:32.899 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-26T12:04:33.025 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-26T12:04:33.086 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-26T12:04:33.112 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-26T12:04:33.130 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-26T12:04:33.162 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-26T12:04:33.215 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-26T12:04:33.268 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-26T12:04:33.342 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T12:04:33.354 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-26T12:04:33.393 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-26T12:04:33.443 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-26T12:04:33.485 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-26T12:04:33.507 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-26T12:04:33.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-26T12:04:33.568 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-26T12:04:33.602 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-26T12:04:33.701 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-26T12:04:33.722 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-26T12:04:33.785 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-26T12:04:33.838 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-26T12:04:33.884 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-26T12:04:33.923 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-26T12:04:33.946 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-26T12:04:33.961 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-26T12:04:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-26T12:04:34.017 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-26T12:04:34.046 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-26T12:04:34.100 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-26T12:04:34.144 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-26T12:04:34.189 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-26T12:04:34.238 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-26T12:04:34.252 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-26T12:04:34.271 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-26T12:04:34.292 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-26T12:04:34.316 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-26T12:04:34.324 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-26T12:04:34.357 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-26T12:04:34.362 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-26T12:04:34.432 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-26T12:04:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-26T12:04:34.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-26T12:04:34.540 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-26T12:04:34.569 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-26T12:04:34.593 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-26T12:04:34.612 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-26T12:04:34.692 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-26T12:04:34.743 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-26T12:04:34.754 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-26T12:04:34.816 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T12:04:34.975 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-26T12:04:35.006 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-26T12:04:35.107 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-26T12:04:35.302 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-26T12:04:35.447 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-26T12:04:35.781 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-26T12:04:35.841 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-26T12:04:35.874 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-26T12:04:35.921 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-26T12:04:36.014 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-26T12:04:36.070 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-26T12:04:36.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-26T12:04:36.130 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-26T12:04:36.242 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-26T12:04:36.293 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-26T12:04:36.537 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-26T12:04:36.589 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-26T12:04:36.703 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-26T12:04:37.029 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-26T12:04:37.139 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-26T12:04:37.176 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-26T12:04:37.211 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-26T12:04:37.608 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-26T12:04:37.620 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-26T12:04:37.633 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-26T12:04:37.660 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T12:04:37.736 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-26T12:04:37.758 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-26T12:04:37.765 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-26T12:04:37.798 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T12:04:37.800 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-26T12:04:37.833 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 105/172 2024-07-26T12:04:37.890 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-26T12:04:38.190 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-26T12:04:38.249 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T12:04:38.403 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T12:04:38.447 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 105/172 2024-07-26T12:04:38.471 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-26T12:04:38.504 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T12:04:38.513 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-26T12:04:38.633 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T12:04:38.673 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 109/172 2024-07-26T12:04:39.078 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-26T12:04:39.110 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T12:04:39.211 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T12:04:39.236 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 109/172 2024-07-26T12:04:39.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-26T12:04:39.539 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-26T12:04:39.575 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-26T12:04:39.610 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-26T12:04:40.025 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-26T12:04:40.075 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T12:04:40.206 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 104/172 2024-07-26T12:04:40.254 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 105/172 2024-07-26T12:04:40.319 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-26T12:04:40.941 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-26T12:04:41.002 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T12:04:41.107 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 108/172 2024-07-26T12:04:41.138 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 109/172 2024-07-26T12:04:41.350 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:41.410 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:41.852 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:41.899 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:42.092 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:42.147 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T12:04:42.338 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T12:04:42.338 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-26T12:04:42.338 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-26T12:04:42.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:04:42.381 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T12:04:42.552 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:42.594 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T12:04:42.756 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T12:04:42.757 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-26T12:04:42.757 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-26T12:04:42.757 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:04:42.795 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T12:04:43.889 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:43.934 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:44.623 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 110/172 2024-07-26T12:04:44.672 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T12:04:44.838 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 111/172 2024-07-26T12:04:44.839 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-26T12:04:44.839 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-26T12:04:44.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:04:44.872 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /sys 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /proc 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /mnt 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /var/tmp 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /home 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /root 2024-07-26T12:04:55.541 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /tmp 2024-07-26T12:04:55.542 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:04:55.785 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-07-26T12:04:55.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:04:55.832 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T12:04:55.832 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:55.833 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-26T12:04:55.833 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:04:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T12:04:56.087 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T12:04:56.087 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:56.087 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-26T12:04:56.087 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:04:57.597 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T12:04:57.686 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T12:04:57.686 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:57.686 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-26T12:04:57.686 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T12:04:57.687 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T12:04:57.687 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:04:57.898 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T12:04:57.947 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T12:04:57.975 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T12:04:57.975 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:57.975 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-26T12:04:57.975 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T12:04:57.975 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T12:04:57.975 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:04:58.017 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T12:04:58.017 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:58.018 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-26T12:04:58.018 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T12:04:58.018 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T12:04:58.018 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:04:58.257 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T12:04:58.328 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T12:04:58.328 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:58.328 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-26T12:04:58.328 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T12:04:58.328 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T12:04:58.328 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:04:58.523 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T12:04:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 112/172 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-07-26T12:04:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:04:58.590 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T12:04:58.590 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:58.590 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-26T12:04:58.590 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T12:04:58.590 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T12:04:58.590 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:04:58.714 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-26T12:04:58.774 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-26T12:04:58.776 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T12:04:58.827 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 113/172 2024-07-26T12:04:58.827 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:58.827 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-26T12:04:58.827 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:04:58.842 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-26T12:04:58.865 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T12:04:58.932 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T12:04:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:04:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-26T12:04:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T12:04:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T12:04:58.932 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:04:59.065 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-26T12:04:59.074 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-26T12:04:59.128 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-26T12:04:59.135 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-26T12:04:59.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-26T12:04:59.221 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-26T12:04:59.328 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-26T12:04:59.459 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-26T12:04:59.493 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-26T12:04:59.519 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-26T12:04:59.543 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-26T12:04:59.584 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-26T12:04:59.609 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-26T12:04:59.626 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-26T12:04:59.753 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-26T12:04:59.921 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-26T12:04:59.968 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-26T12:05:00.016 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-26T12:05:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-26T12:05:00.258 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T12:05:00.304 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T12:05:00.360 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 129/172 2024-07-26T12:05:00.461 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 130/172 2024-07-26T12:05:00.507 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T12:05:00.629 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T12:05:00.712 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 114/172 2024-07-26T12:05:00.712 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:00.712 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-26T12:05:00.712 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T12:05:00.713 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-26T12:05:00.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:00.744 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T12:05:00.813 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T12:05:00.866 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 129/172 2024-07-26T12:05:00.982 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 130/172 2024-07-26T12:05:00.987 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T12:05:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T12:05:01.058 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 115/172 2024-07-26T12:05:01.058 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:01.058 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-26T12:05:01.058 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T12:05:01.058 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-26T12:05:01.058 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:01.622 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T12:05:01.696 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 116/172 2024-07-26T12:05:01.696 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:01.696 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-26T12:05:01.696 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T12:05:01.696 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-26T12:05:01.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:01.849 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-26T12:05:01.913 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-26T12:05:01.989 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-26T12:05:02.243 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-26T12:05:02.311 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-26T12:05:02.411 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-26T12:05:02.540 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-26T12:05:02.720 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-26T12:05:02.768 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-26T12:05:02.816 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-26T12:05:02.849 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-26T12:05:03.420 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T12:05:03.460 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 128/172 2024-07-26T12:05:03.514 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 129/172 2024-07-26T12:05:03.632 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 130/172 2024-07-26T12:05:03.662 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T12:05:04.180 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T12:05:04.246 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T12:05:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T12:05:04.854 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T12:05:05.337 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T12:05:05.396 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T12:05:05.555 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T12:05:05.741 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 134/172 2024-07-26T12:05:05.773 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T12:05:05.842 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T12:05:05.842 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:05.843 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-26T12:05:05.843 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T12:05:05.843 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T12:05:05.843 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:05.899 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T12:05:05.937 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T12:05:05.979 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T12:05:06.037 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T12:05:06.050 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 137/172 2024-07-26T12:05:06.119 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 138/172 2024-07-26T12:05:06.198 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T12:05:06.387 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 134/172 2024-07-26T12:05:06.422 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T12:05:06.493 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T12:05:06.494 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:06.494 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-26T12:05:06.494 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T12:05:06.494 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T12:05:06.494 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:06.547 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T12:05:06.585 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T12:05:06.770 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 137/172 2024-07-26T12:05:06.847 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 138/172 2024-07-26T12:05:07.174 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-26T12:05:07.213 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T12:05:07.292 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T12:05:07.292 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:07.292 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-26T12:05:07.292 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T12:05:07.292 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T12:05:07.292 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:07.344 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T12:05:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T12:05:07.413 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:07.413 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-26T12:05:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:07.478 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T12:05:07.542 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 131/172 2024-07-26T12:05:07.580 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T12:05:07.581 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:07.581 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-26T12:05:07.581 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T12:05:07.581 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T12:05:07.581 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:07.603 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T12:05:07.984 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-26T12:05:07.986 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T12:05:08.016 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T12:05:08.075 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T12:05:08.075 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:08.076 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-26T12:05:08.076 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T12:05:08.076 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T12:05:08.076 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:08.086 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T12:05:08.087 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:08.087 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-26T12:05:08.087 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T12:05:08.087 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T12:05:08.087 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:08.159 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T12:05:08.254 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T12:05:08.254 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:08.254 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-26T12:05:08.254 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:08.334 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T12:05:08.439 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T12:05:08.439 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:08.439 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-26T12:05:08.440 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T12:05:08.440 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T12:05:08.440 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:08.763 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 132/172 2024-07-26T12:05:08.794 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T12:05:08.868 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T12:05:08.965 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 133/172 2024-07-26T12:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T12:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-26T12:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T12:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T12:05:08.967 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:09.157 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 134/172 2024-07-26T12:05:09.187 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T12:05:09.267 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 135/172 2024-07-26T12:05:09.267 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:09.267 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-26T12:05:09.267 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T12:05:09.267 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-26T12:05:09.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:09.330 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T12:05:09.369 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 136/172 2024-07-26T12:05:09.536 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 137/172 2024-07-26T12:05:09.616 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 138/172 2024-07-26T12:05:10.761 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-26T12:05:10.791 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T12:05:10.859 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 140/172 2024-07-26T12:05:10.859 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:10.859 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-26T12:05:10.859 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T12:05:10.859 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-26T12:05:10.859 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:10.908 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T12:05:10.980 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 141/172 2024-07-26T12:05:10.980 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:10.980 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-26T12:05:10.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:11.042 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T12:05:11.122 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 142/172 2024-07-26T12:05:11.122 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:11.122 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-26T12:05:11.123 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T12:05:11.123 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-26T12:05:11.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:11.542 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T12:05:11.620 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 143/172 2024-07-26T12:05:11.620 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-26T12:05:11.620 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-26T12:05:11.620 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T12:05:11.620 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-26T12:05:11.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 144/172 2024-07-26T12:05:12.904 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 145/172 2024-07-26T12:05:12.959 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 146/172 2024-07-26T12:05:12.992 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-26T12:05:13.020 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-26T12:05:13.307 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T12:05:13.363 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-26T12:05:13.398 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 151/172 2024-07-26T12:05:13.436 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-26T12:05:13.483 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T12:05:13.529 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-26T12:05:13.884 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 144/172 2024-07-26T12:05:13.968 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 145/172 2024-07-26T12:05:14.032 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 146/172 2024-07-26T12:05:14.073 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-26T12:05:14.112 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-26T12:05:14.432 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T12:05:14.471 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:14.478 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-26T12:05:14.514 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 151/172 2024-07-26T12:05:14.517 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:14.583 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:14.585 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-26T12:05:14.636 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T12:05:14.686 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-26T12:05:15.657 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:15.705 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:15.773 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:15.968 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 156/172 2024-07-26T12:05:16.068 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-26T12:05:16.113 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-26T12:05:16.236 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-26T12:05:16.277 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-26T12:05:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-26T12:05:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T12:05:16.431 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-26T12:05:16.432 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T12:05:16.578 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T12:05:16.632 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-26T12:05:16.633 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T12:05:16.666 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 144/172 2024-07-26T12:05:16.720 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 145/172 2024-07-26T12:05:16.752 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T12:05:16.775 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 146/172 2024-07-26T12:05:16.791 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-26T12:05:16.815 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-26T12:05:16.831 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:16.832 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:16.854 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-26T12:05:17.155 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 156/172 2024-07-26T12:05:17.162 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:17.162 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T12:05:17.205 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T12:05:17.256 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-26T12:05:17.263 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-26T12:05:17.299 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 151/172 2024-07-26T12:05:17.307 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T12:05:17.336 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-26T12:05:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-26T12:05:17.356 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T12:05:17.395 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-26T12:05:17.396 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T12:05:17.462 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-26T12:05:17.497 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-26T12:05:17.527 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:17.532 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-26T12:05:17.566 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-26T12:05:17.634 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T12:05:17.684 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-26T12:05:17.685 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T12:05:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:17.794 INFO:teuthology.orchestra.run.smithi076.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-07-26T12:05:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:17.831 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T12:05:17.877 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-26T12:05:17.878 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T12:05:18.030 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T12:05:18.061 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-26T12:05:18.096 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:18.387 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:18.416 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:18.416 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T12:05:18.432 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:18.491 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-26T12:05:18.574 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T12:05:18.619 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T12:05:18.656 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-26T12:05:18.788 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:19.082 INFO:teuthology.orchestra.run.smithi146.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-07-26T12:05:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:19.955 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 156/172 2024-07-26T12:05:20.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-26T12:05:20.137 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-26T12:05:20.289 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-26T12:05:20.356 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-26T12:05:20.394 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-26T12:05:20.428 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T12:05:20.480 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-26T12:05:20.480 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T12:05:20.618 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-26T12:05:20.672 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-26T12:05:20.672 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T12:05:20.859 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-26T12:05:20.898 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-26T12:05:20.943 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:20.944 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:21.302 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-26T12:05:21.302 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T12:05:21.448 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-26T12:05:21.496 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T12:05:21.535 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-26T12:05:21.681 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:21.955 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:21.956 INFO:teuthology.orchestra.run.smithi040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-07-26T12:05:21.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 1/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 3/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 4/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 5/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 6/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 7/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:05:24.530 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 11/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 12/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 13/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 15/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 16/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 17/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 18/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 19/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 20/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 21/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 22/172 2024-07-26T12:05:24.531 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 23/172 2024-07-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 24/172 2024-07-26T12:05:24.532 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 25/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 26/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 27/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 28/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 29/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 30/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 31/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 32/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 33/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 34/172 2024-07-26T12:05:24.544 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 35/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 36/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 37/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 38/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 39/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-26T12:05:24.545 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-26T12:05:24.546 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-26T12:05:24.547 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-26T12:05:24.548 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-26T12:05:24.549 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-26T12:05:24.550 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-26T12:05:24.551 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-26T12:05:24.552 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-26T12:05:24.553 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 151/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-26T12:05:24.554 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-26T12:05:24.555 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-26T12:05:24.556 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T12:05:24.556 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 1/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 3/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 4/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 5/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 6/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 7/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:05:25.179 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 11/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 12/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 13/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 15/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 16/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 17/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 18/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 19/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 20/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 21/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 22/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 23/172 2024-07-26T12:05:25.180 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 24/172 2024-07-26T12:05:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 25/172 2024-07-26T12:05:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 26/172 2024-07-26T12:05:25.181 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 27/172 2024-07-26T12:05:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 28/172 2024-07-26T12:05:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 29/172 2024-07-26T12:05:25.194 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 30/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 31/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 32/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 33/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 34/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 35/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 36/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 37/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 38/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 39/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-26T12:05:25.195 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-26T12:05:25.196 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-26T12:05:25.197 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-26T12:05:25.198 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-26T12:05:25.199 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-26T12:05:25.200 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-26T12:05:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-26T12:05:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 151/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-26T12:05:25.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-26T12:05:25.204 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-26T12:05:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-26T12:05:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-26T12:05:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T12:05:25.205 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout:Upgraded: 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-26T12:05:26.786 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: automake-1.16.2-8.el9.noarch 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: bison-3.7.4-5.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.787 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.788 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: flex-2.6.4-9.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-26T12:05:26.789 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-26T12:05:26.790 INFO:teuthology.orchestra.run.smithi076.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: lua-5.4.4-4.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-26T12:05:26.791 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-13.14-1.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-26T12:05:26.792 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-26T12:05:26.793 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-26T12:05:26.794 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ply-3.11-14.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-26T12:05:26.795 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-26T12:05:26.796 INFO:teuthology.orchestra.run.smithi076.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.797 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: re2-1:20211101-3.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-26T12:05:26.798 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-07-26T12:05:26.799 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-07-26T12:05:27.445 DEBUG:teuthology.parallel:result is None 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-26T12:05:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-26T12:05:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.14-1.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-26T12:05:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-26T12:05:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-26T12:05:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-26T12:05:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-26T12:05:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-3.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-26T12:05:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-26T12:05:27.671 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:05:27.671 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-07-26T12:05:28.340 DEBUG:teuthology.parallel:result is None 2024-07-26T12:05:28.509 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 1/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 3/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 4/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5320.ge8f88 5/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 6/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 7/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 8/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 9/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 10/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 11/172 2024-07-26T12:05:28.510 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 12/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 13/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 14/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_ 15/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 16/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 17/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_6 18/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86 19/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 20/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el 21/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9. 22/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_6 23/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 24/172 2024-07-26T12:05:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 25/172 2024-07-26T12:05:28.512 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 26/172 2024-07-26T12:05:28.512 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 27/172 2024-07-26T12:05:28.523 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 28/172 2024-07-26T12:05:28.523 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 29/172 2024-07-26T12:05:28.523 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1. 30/172 2024-07-26T12:05:28.523 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noa 31/172 2024-07-26T12:05:28.523 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.n 32/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f 33/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el 34/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 35/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.e 36/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 37/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 38/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 39/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-26T12:05:28.524 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-26T12:05:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-26T12:05:28.526 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-26T12:05:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-26T12:05:28.528 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-26T12:05:28.529 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-26T12:05:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-26T12:05:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-26T12:05:28.532 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 149/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 151/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-26T12:05:28.533 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-26T12:05:28.534 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-26T12:05:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.810 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.0.0-5320.ge8f88bb1.el9.noarch 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-26T12:05:30.811 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-26T12:05:30.813 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.14-1.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-26T12:05:30.814 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-26T12:05:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-26T12:05:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-07-26T12:05:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-26T12:05:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-26T12:05:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.0.0-5320.ge8f88bb1.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-3.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-26T12:05:30.820 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-26T12:05:30.821 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-26T12:05:30.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:05:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-07-26T12:05:31.479 DEBUG:teuthology.parallel:result is None 2024-07-26T12:05:31.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:05:31.636 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-26T12:05:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:19.0.0-5320.ge8f88bb1.el9 2024-07-26T12:05:31.691 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5320.ge8f88bb1.el9 2024-07-26T12:05:31.691 INFO:teuthology.task.install:The correct ceph version 19.0.0-5320.ge8f88bb1 is installed. 2024-07-26T12:05:31.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:05:31.843 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-26T12:05:31.917 INFO:teuthology.orchestra.run.smithi076.stdout:19.0.0-5320.ge8f88bb1.el9 2024-07-26T12:05:31.918 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5320.ge8f88bb1.el9 2024-07-26T12:05:31.918 INFO:teuthology.task.install:The correct ceph version 19.0.0-5320.ge8f88bb1 is installed. 2024-07-26T12:05:31.920 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:05:32.063 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-26T12:05:32.127 INFO:teuthology.orchestra.run.smithi146.stdout:19.0.0-5320.ge8f88bb1.el9 2024-07-26T12:05:32.127 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5320.ge8f88bb1.el9 2024-07-26T12:05:32.127 INFO:teuthology.task.install:The correct ceph version 19.0.0-5320.ge8f88bb1 is installed. 2024-07-26T12:05:32.129 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-07-26T12:05:32.129 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:05:32.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-26T12:05:32.204 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:05:32.204 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-26T12:05:32.291 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:05:32.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-26T12:05:32.370 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-07-26T12:05:32.370 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:05:32.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-07-26T12:05:32.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-26T12:05:32.541 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:05:32.541 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2024-07-26T12:05:32.633 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-26T12:05:32.760 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:05:32.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-07-26T12:05:32.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-26T12:05:32.960 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-07-26T12:05:32.960 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:05:32.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-26T12:05:33.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-26T12:05:33.132 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:05:33.132 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-26T12:05:33.215 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-26T12:05:33.342 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:05:33.342 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-26T12:05:33.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-26T12:05:33.560 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-07-26T12:05:33.560 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:05:33.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-07-26T12:05:33.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-26T12:05:33.738 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:05:33.738 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/stdin-killer 2024-07-26T12:05:33.825 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-26T12:05:33.906 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:05:33.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-07-26T12:05:34.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-26T12:05:34.134 INFO:teuthology.run_tasks:Running task cephadm... 2024-07-26T12:05:34.232 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-07-26T12:05:34.233 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:05:34.233 INFO:tasks.cephadm:Cluster fsid is 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:05:34.233 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-07-26T12:05:34.234 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.40', 'mon.b': '172.21.15.76', 'mon.c': '172.21.15.146'} 2024-07-26T12:05:34.234 INFO:tasks.cephadm:First mon is mon.a on smithi040 2024-07-26T12:05:34.234 INFO:tasks.cephadm:First mgr is x 2024-07-26T12:05:34.234 INFO:tasks.cephadm:Normalizing hostnames... 2024-07-26T12:05:34.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname $(hostname -s) 2024-07-26T12:05:34.305 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname $(hostname -s) 2024-07-26T12:05:34.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname $(hostname -s) 2024-07-26T12:05:34.485 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-07-26T12:05:34.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:05:34.627 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/81524/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5320-ge8f88bb1', 'node_name': '172.21.4.69+confusa07', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5320.ge8f88bb1'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-07-25 16:18:49.953482', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240725.121331-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/81524/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5320-ge8f88bb1', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5320.ge8f88bb1'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-07-25 15:10:42.298781', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240725.121331-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-07-26T12:05:34.768 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20240725.121331-debug, sha1 e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:05:34.769 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm 2024-07-26T12:05:34.769 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm 2024-07-26T12:05:34.770 DEBUG:teuthology.orchestra.run.smithi040:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:35.184 INFO:teuthology.orchestra.run.smithi040.stdout:-rw-r--r--. 1 ubuntu ubuntu 789811 Jul 26 12:05 /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:35.185 DEBUG:teuthology.orchestra.run.smithi076:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:35.619 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r--. 1 ubuntu ubuntu 789811 Jul 26 12:05 /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:35.619 DEBUG:teuthology.orchestra.run.smithi146:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240725.121331-debug/e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:36.074 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r--. 1 ubuntu ubuntu 789811 Jul 26 12:05 /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:36.075 DEBUG:teuthology.orchestra.run.smithi040:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:36.138 DEBUG:teuthology.orchestra.run.smithi076:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:36.198 DEBUG:teuthology.orchestra.run.smithi146:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-07-26T12:05:36.273 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 on all hosts... 2024-07-26T12:05:36.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 pull 2024-07-26T12:05:36.281 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 pull 2024-07-26T12:05:36.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 pull 2024-07-26T12:05:37.431 INFO:teuthology.orchestra.run.smithi146.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T12:05:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T12:05:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T12:06:22.817 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:06:22.818 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T12:06:22.818 INFO:teuthology.orchestra.run.smithi040.stdout: "image_id": "ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8", 2024-07-26T12:06:22.818 INFO:teuthology.orchestra.run.smithi040.stdout: "repo_digests": [ 2024-07-26T12:06:22.818 INFO:teuthology.orchestra.run.smithi040.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2" 2024-07-26T12:06:22.818 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T12:06:22.818 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:06:34.179 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-07-26T12:06:34.180 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T12:06:34.180 INFO:teuthology.orchestra.run.smithi076.stdout: "image_id": "ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8", 2024-07-26T12:06:34.180 INFO:teuthology.orchestra.run.smithi076.stdout: "repo_digests": [ 2024-07-26T12:06:34.180 INFO:teuthology.orchestra.run.smithi076.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2" 2024-07-26T12:06:34.180 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-07-26T12:06:34.180 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-07-26T12:06:36.045 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-07-26T12:06:36.046 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T12:06:36.046 INFO:teuthology.orchestra.run.smithi146.stdout: "image_id": "ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8", 2024-07-26T12:06:36.046 INFO:teuthology.orchestra.run.smithi146.stdout: "repo_digests": [ 2024-07-26T12:06:36.046 INFO:teuthology.orchestra.run.smithi146.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2" 2024-07-26T12:06:36.046 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-07-26T12:06:36.046 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-07-26T12:06:36.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph 2024-07-26T12:06:36.213 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph 2024-07-26T12:06:36.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph 2024-07-26T12:06:36.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /etc/ceph 2024-07-26T12:06:36.483 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /etc/ceph 2024-07-26T12:06:36.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /etc/ceph 2024-07-26T12:06:36.658 INFO:tasks.cephadm:Writing seed config... 2024-07-26T12:06:36.659 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-07-26T12:06:36.659 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-07-26T12:06:36.659 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-07-26T12:06:36.659 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-07-26T12:06:36.659 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-07-26T12:06:36.660 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-07-26T12:06:36.661 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-07-26T12:06:36.662 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:06:36.662 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-07-26T12:06:36.721 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5cbb9f42-4b47-11ef-bcb7-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-07-26T12:06:36.721 DEBUG:teuthology.orchestra.run.smithi040:mon.a> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a.service 2024-07-26T12:06:36.726 DEBUG:teuthology.orchestra.run.smithi040:mgr.x> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.x.service 2024-07-26T12:06:36.772 INFO:tasks.cephadm:Bootstrapping... 2024-07-26T12:06:36.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 -v bootstrap --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.40 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-07-26T12:06:37.078 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-07-26T12:06:37.078 INFO:teuthology.orchestra.run.smithi040.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', '-v', 'bootstrap', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.40', '--skip-admin-label'] 2024-07-26T12:06:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-07-26T12:06:37.078 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying podman|docker is present... 2024-07-26T12:06:37.139 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stdout 5.1.2 2024-07-26T12:06:37.139 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying lvm2 is present... 2024-07-26T12:06:37.139 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying time synchronization is in place... 2024-07-26T12:06:37.155 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-07-26T12:06:37.155 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-07-26T12:06:37.170 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-07-26T12:06:37.170 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-07-26T12:06:37.193 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout enabled 2024-07-26T12:06:37.216 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout active 2024-07-26T12:06:37.216 INFO:teuthology.orchestra.run.smithi040.stdout:Unit chronyd.service is enabled and running 2024-07-26T12:06:37.217 INFO:teuthology.orchestra.run.smithi040.stdout:Repeating the final host check... 2024-07-26T12:06:37.279 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stdout 5.1.2 2024-07-26T12:06:37.279 INFO:teuthology.orchestra.run.smithi040.stdout:podman (/bin/podman) version 5.1.2 is present 2024-07-26T12:06:37.279 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl is present 2024-07-26T12:06:37.279 INFO:teuthology.orchestra.run.smithi040.stdout:lvcreate is present 2024-07-26T12:06:37.294 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-07-26T12:06:37.294 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-07-26T12:06:37.311 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-07-26T12:06:37.311 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-07-26T12:06:37.338 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout enabled 2024-07-26T12:06:37.361 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout active 2024-07-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi040.stdout:Unit chronyd.service is enabled and running 2024-07-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi040.stdout:Host looks OK 2024-07-26T12:06:37.362 INFO:teuthology.orchestra.run.smithi040.stdout:Cluster fsid: 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi040.stdout:Acquiring lock 139861893362496 on /run/cephadm/5cbb9f42-4b47-11ef-bcb7-c7b262605968.lock 2024-07-26T12:06:37.363 INFO:teuthology.orchestra.run.smithi040.stdout:Lock 139861893362496 acquired on /run/cephadm/5cbb9f42-4b47-11ef-bcb7-c7b262605968.lock 2024-07-26T12:06:37.364 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying IP 172.21.15.40 port 3300 ... 2024-07-26T12:06:37.365 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying IP 172.21.15.40 port 6789 ... 2024-07-26T12:06:37.366 INFO:teuthology.orchestra.run.smithi040.stdout:Base mon IP(s) is [172.21.15.40:3300, 172.21.15.40:6789], mon addrv is [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-07-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.40 metric 100 2024-07-26T12:06:37.381 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.40 metric 100 2024-07-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-07-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-07-26T12:06:37.394 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-07-26T12:06:37.405 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-07-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-07-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-07-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-07-26T12:06:37.406 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-07-26T12:06:37.407 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-07-26T12:06:37.409 INFO:teuthology.orchestra.run.smithi040.stdout:Mon IP `172.21.15.40` is in CIDR network `172.21.0.0/20` 2024-07-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi040.stdout:Mon IP `172.21.15.40` is in CIDR network `172.21.0.0/20` 2024-07-26T12:06:37.410 INFO:teuthology.orchestra.run.smithi040.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-07-26T12:06:37.413 INFO:teuthology.orchestra.run.smithi040.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-07-26T12:06:37.415 INFO:teuthology.orchestra.run.smithi040.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T12:06:39.006 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stdout ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 2024-07-26T12:06:39.007 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528... 2024-07-26T12:06:39.007 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Getting image source signatures 2024-07-26T12:06:39.007 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Copying blob sha256:27b44fafaf0d8ddf6712bf077b0e069fd1632e81c2016bcdf9194ad64e762303 2024-07-26T12:06:39.008 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Copying blob sha256:43735fbce9214f061a6894341d7822563f5aafe16fc7532189f4415cff6d2d91 2024-07-26T12:06:39.008 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Copying config sha256:ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 2024-07-26T12:06:39.008 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Writing manifest to image destination 2024-07-26T12:06:40.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph: stdout ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T12:06:40.225 INFO:teuthology.orchestra.run.smithi040.stdout:Ceph version: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T12:06:40.225 INFO:teuthology.orchestra.run.smithi040.stdout:Extracting ceph user uid/gid from container image... 2024-07-26T12:06:41.382 INFO:teuthology.orchestra.run.smithi040.stdout:stat: stdout 167 167 2024-07-26T12:06:41.382 INFO:teuthology.orchestra.run.smithi040.stdout:Creating initial keys... 2024-07-26T12:06:42.522 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-authtool: stdout AQBRkaNmbNiLNRAANkSlbRkiW6mGfkBYx14ASQ== 2024-07-26T12:06:43.606 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-authtool: stdout AQBTkaNmS2jRABAAmZ13qD+RrzaCqtOAqsWH8A== 2024-07-26T12:06:55.001 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-authtool: stdout AQBUkaNmGlvbCBAAUyenChsKXxoL8EilaeZ1Dw== 2024-07-26T12:06:55.003 INFO:teuthology.orchestra.run.smithi040.stdout:Creating initial monmap... 2024-07-26T12:06:56.347 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-07-26T12:06:56.347 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool for a [v2:172.21.15.40:3300,v1:172.21.15.40:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: set fsid to 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:06:56.348 INFO:teuthology.orchestra.run.smithi040.stdout:Creating mon... 2024-07-26T12:06:57.487 INFO:teuthology.orchestra.run.smithi040.stdout:create mon.a on 2024-07-26T12:06:57.909 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-07-26T12:06:58.176 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-07-26T12:06:58.533 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968.target → /etc/systemd/system/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968.target. 2024-07-26T12:06:58.534 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968.target → /etc/systemd/system/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968.target. 2024-07-26T12:06:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a 2024-07-26T12:06:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a.service: Unit ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a.service not loaded. 2024-07-26T12:06:59.383 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968.target.wants/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a.service → /etc/systemd/system/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@.service. 2024-07-26T12:07:00.084 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:06:59 smithi040 podman[32016]: 2024-07-26 12:06:59.844215461 +0000 UTC m=+0.163226079 container create c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=) 2024-07-26T12:07:00.084 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:00 smithi040 podman[32016]: 2024-07-26 12:07:00.081366713 +0000 UTC m=+0.400377334 container init c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux ) 2024-07-26T12:07:00.208 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T12:07:00.208 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-07-26T12:07:00.228 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T12:07:00.228 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-07-26T12:07:00.228 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-07-26T12:07:00.229 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to enable service . firewalld.service is not available 2024-07-26T12:07:00.229 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mon to start... 2024-07-26T12:07:00.229 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mon... 2024-07-26T12:07:00.374 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:00 smithi040 podman[32016]: 2024-07-26 12:07:00.093016141 +0000 UTC m=+0.412026745 container start c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-07-26T12:07:00.374 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:00 smithi040 bash[32016]: c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f 2024-07-26T12:07:00.374 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:00 smithi040 systemd[1]: Started Ceph mon.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:07:00.374 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:00 smithi040 ceph-mon[32035]: mkfs 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:00.374 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:00 smithi040 ceph-mon[32035]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-26T12:07:01.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: monmap epoch 1 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: last_changed 2024-07-26T12:06:55.574734+0000 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: min_mon_release 19 (squid) 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: election_strategy: 1 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: fsmap 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: osdmap e1: 0 total, 0 up, 0 in 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: mgrmap e1: no daemons active 2024-07-26T12:07:01.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:01 smithi040 ceph-mon[32035]: from='client.? 172.21.15.40:0/2486811265' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout cluster: 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout id: 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout services: 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.732678s) 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-07-26T12:07:01.671 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout data: 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout pgs: 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:mon is available 2024-07-26T12:07:01.672 INFO:teuthology.orchestra.run.smithi040.stdout:Assimilating anything we can from ceph.conf... 2024-07-26T12:07:02.858 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:02 smithi040 ceph-mon[32035]: from='client.? 172.21.15.40:0/3300528073' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-07-26T12:07:02.858 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:02 smithi040 ceph-mon[32035]: from='client.? 172.21.15.40:0/3300528073' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-07-26T12:07:03.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [global] 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout fsid = 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [mgr] 2024-07-26T12:07:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [osd] 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-07-26T12:07:03.162 INFO:teuthology.orchestra.run.smithi040.stdout:Generating new minimal ceph.conf... 2024-07-26T12:07:04.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:03 smithi040 ceph-mon[32035]: from='client.? 172.21.15.40:0/167429119' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:07:04.513 INFO:teuthology.orchestra.run.smithi040.stdout:Restarting the monitor... 2024-07-26T12:07:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:04 smithi040 systemd[1]: Stopping Ceph mon.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:07:05.465 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:05 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a[32031]: 2024-07-26T12:07:05.063+0000 7f2f6aa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-07-26T12:07:05.466 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:05 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a[32031]: 2024-07-26T12:07:05.063+0000 7f2f6aa00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-07-26T12:07:05.466 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:05 smithi040 podman[32275]: 2024-07-26 12:07:05.156912371 +0000 UTC m=+0.234141654 container died c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-07-26T12:07:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:05 smithi040 podman[32275]: 2024-07-26 12:07:05.577792278 +0000 UTC m=+0.655021555 container cleanup c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-26T12:07:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:05 smithi040 bash[32275]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a 2024-07-26T12:07:06.228 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:05 smithi040 podman[32287]: 2024-07-26 12:07:05.756911114 +0000 UTC m=+0.582808264 container remove c6f2c47add6c993b718c54b1186435e618eece3726b2cede956930157c66416f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T12:07:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a.service: Deactivated successfully. 2024-07-26T12:07:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 systemd[1]: Stopped Ceph mon.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:07:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.a.service: Consumed 2.144s CPU time. 2024-07-26T12:07:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 systemd[1]: Starting Ceph mon.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:07:06.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 podman[32378]: 2024-07-26 12:07:06.629621114 +0000 UTC m=+0.121243440 container create de6095242ad6819e50477ba08901a21408454b01d3bfa07d6978e00308684385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-07-26T12:07:06.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 podman[32378]: 2024-07-26 12:07:06.540768233 +0000 UTC m=+0.032390542 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:07:06.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 podman[32378]: 2024-07-26 12:07:06.866203454 +0000 UTC m=+0.357825770 container init de6095242ad6819e50477ba08901a21408454b01d3bfa07d6978e00308684385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724) 2024-07-26T12:07:06.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 podman[32378]: 2024-07-26 12:07:06.877769081 +0000 UTC m=+0.369391384 container start de6095242ad6819e50477ba08901a21408454b01d3bfa07d6978e00308684385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_CLEAN=True) 2024-07-26T12:07:06.998 INFO:teuthology.orchestra.run.smithi040.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-07-26T12:07:07.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 bash[32378]: de6095242ad6819e50477ba08901a21408454b01d3bfa07d6978e00308684385 2024-07-26T12:07:07.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 systemd[1]: Started Ceph mon.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:07:07.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: set uid:gid to 167:167 (ceph:ceph) 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev), process ceph-mon, pid 2 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: pidfile_write: ignore empty --pid-file 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: load: jerasure load: lrc 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: RocksDB version: 7.9.2 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Git sha 0 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Compile date 2024-07-25 13:49:38 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: DB SUMMARY 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: DB Session ID: Q2X7J94GLHV7B0K950FR 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: CURRENT file: CURRENT 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: IDENTITY file: IDENTITY 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-07-26T12:07:07.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95227 ; 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.error_if_exists: 0 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.create_if_missing: 0 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.paranoid_checks: 1 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.flush_verify_memtable_count: 1 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.env: 0x55f9941d9280 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.fs: PosixFileSystem 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.info_log: 0x55f9af5dd060 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.max_file_opening_threads: 16 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.statistics: (nil) 2024-07-26T12:07:07.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.use_fsync: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.max_log_file_size: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.log_file_time_to_roll: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.keep_log_file_num: 1000 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.recycle_log_file_num: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.allow_fallocate: 1 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.allow_mmap_reads: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.allow_mmap_writes: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.use_direct_reads: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.create_missing_column_families: 0 2024-07-26T12:07:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.db_log_dir: 2024-07-26T12:07:07.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.wal_dir: 2024-07-26T12:07:07.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.table_cache_numshardbits: 6 2024-07-26T12:07:07.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.WAL_ttl_seconds: 0 2024-07-26T12:07:07.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.WAL_size_limit_MB: 0 2024-07-26T12:07:07.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.is_fd_close_on_exec: 1 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.advise_random_on_open: 1 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.db_write_buffer_size: 0 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.write_buffer_manager: 0x55f9af5e15e0 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.use_adaptive_mutex: 0 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.rate_limiter: (nil) 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.wal_recovery_mode: 2 2024-07-26T12:07:07.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.enable_thread_tracking: 0 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.enable_pipelined_write: 0 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.unordered_write: 0 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.row_cache: None 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.wal_filter: None 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.allow_ingest_behind: 0 2024-07-26T12:07:07.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.two_write_queues: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.manual_wal_flush: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.wal_compression: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.atomic_flush: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.persist_stats_to_disk: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:06 smithi040 ceph-mon[32397]: rocksdb: Options.write_dbid_to_manifest: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.log_readahead_size: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.best_efforts_recovery: 0 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-07-26T12:07:07.242 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.allow_data_in_errors: 0 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.db_host_id: __hostname__ 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.enforce_single_del_contracts: true 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_background_jobs: 2 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_background_compactions: -1 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_subcompactions: 1 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.delayed_write_rate : 16777216 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_total_wal_size: 0 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-07-26T12:07:07.243 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.stats_dump_period_sec: 600 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.stats_persist_period_sec: 600 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_open_files: -1 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bytes_per_sync: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.wal_bytes_per_sync: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.strict_bytes_per_sync: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_readahead_size: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_background_flushes: -1 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Compression algorithms supported: 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kZSTD supported: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kXpressCompression supported: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kBZip2Compression supported: 0 2024-07-26T12:07:07.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kLZ4Compression supported: 1 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kZlibCompression supported: 1 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kLZ4HCCompression supported: 1 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: kSnappyCompression supported: 1 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Fast CRC32 supported: Supported on x86 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: DMutex implementation: pthread_mutex_t 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.merge_operator: 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_filter: None 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_filter_factory: None 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.sst_partitioner_factory: None 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.memtable_factory: SkipListFactory 2024-07-26T12:07:07.245 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.table_factory: BlockBasedTable 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f9af5dcc00) 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: cache_index_and_filter_blocks: 1 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: pin_top_level_index_and_filter: 1 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: index_type: 0 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: data_block_index_type: 0 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: index_shortening: 1 2024-07-26T12:07:07.246 INFO:journalctl@ceph.mon.a.smithi040.stdout: data_block_hash_table_util_ratio: 0.750000 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: checksum: 4 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: no_block_cache: 0 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache: 0x55f9ab5a1610 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache_name: BinnedLRUCache 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache_options: 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: capacity : 536870912 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: num_shard_bits : 4 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: strict_capacity_limit : 0 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: high_pri_pool_ratio: 0.000 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache_compressed: (nil) 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: persistent_cache: (nil) 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_size: 4096 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_size_deviation: 10 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_restart_interval: 16 2024-07-26T12:07:07.247 INFO:journalctl@ceph.mon.a.smithi040.stdout: index_block_restart_interval: 1 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: metadata_block_size: 4096 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: partition_filters: 0 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: use_delta_encoding: 1 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: filter_policy: bloomfilter 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: whole_key_filtering: 1 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: verify_compression: 0 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: read_amp_bytes_per_bit: 0 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: format_version: 5 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: enable_index_compression: 1 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_align: 0 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: max_auto_readahead_size: 262144 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: prepopulate_block_cache: 0 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: initial_auto_readahead_size: 8192 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout: num_file_reads_for_auto_readahead: 2 2024-07-26T12:07:07.248 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.write_buffer_size: 33554432 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_write_buffer_number: 2 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression: NoCompression 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression: Disabled 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.prefix_extractor: nullptr 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.num_levels: 7 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-07-26T12:07:07.249 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-07-26T12:07:07.250 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-07-26T12:07:07.250 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-07-26T12:07:07.250 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-07-26T12:07:07.250 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.window_bits: -14 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.level: 32767 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.strategy: 0 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.enabled: false 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-07-26T12:07:07.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.target_file_size_base: 67108864 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.target_file_size_multiplier: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-07-26T12:07:07.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.arena_block_size: 1048576 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.disable_auto_compactions: 0 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-07-26T12:07:07.253 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.inplace_update_support: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.inplace_update_num_locks: 10000 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.memtable_huge_page_size: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.bloom_locality: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.max_successive_merges: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.optimize_filters_for_hits: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.paranoid_file_checks: 0 2024-07-26T12:07:07.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.force_consistency_checks: 1 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.report_bg_io_stats: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.ttl: 2592000 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.periodic_compaction_seconds: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.enable_blob_files: false 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.min_blob_size: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.blob_file_size: 268435456 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.blob_compression_type: NoCompression 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.enable_blob_garbage_collection: false 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.blob_file_starting_level: 0 2024-07-26T12:07:07.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 748253fb-ac76-42af-b7cc-3442c54f899d 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721995627000914, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721995627002882, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91384, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89425, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11704, "raw_average_key_size": 48, "raw_value_size": 82825, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1721995627, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "748253fb-ac76-42af-b7cc-3442c54f899d", "db_session_id": "Q2X7J94GLHV7B0K950FR", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721995627003211, "job": 1, "event": "recovery_finished"} 2024-07-26T12:07:07.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f9af600a80 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: DB pointer 0x55f9b03a0000 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** DB Stats ** 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T12:07:07.257 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** Compaction Stats [default] ** 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: L0 2/0 91.10 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: Sum 2/0 91.10 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** Compaction Stats [default] ** 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T12:07:07.258 INFO:journalctl@ceph.mon.a.smithi040.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(Keys): cumulative 0, interval 0 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative compaction: 0.00 GB write, 12.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval compaction: 0.00 GB write, 12.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-07-26T12:07:07.259 INFO:journalctl@ceph.mon.a.smithi040.stdout: Block cache BinnedLRUCache@0x55f9ab5a1610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.9e-05 secs_since: 0 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** File Read Latency Histogram By Level [default] ** 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: starting mon.a rank 0 at public addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] at bind addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???) e1 preinit fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).mds e1 new map 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).mds e1 print_map 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: e1 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: btime 2024-07-26T12:07:00:241237+0000 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: legacy client fscid: -1 2024-07-26T12:07:07.260 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout: No filesystems configured 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mon.a is new leader, mons a in quorum (ranks 0) 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: monmap epoch 1 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: last_changed 2024-07-26T12:06:55.574734+0000 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: min_mon_release 19 (squid) 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: election_strategy: 1 2024-07-26T12:07:07.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:07:07.262 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: fsmap 2024-07-26T12:07:07.262 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: osdmap e1: 0 total, 0 up, 0 in 2024-07-26T12:07:07.262 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:07 smithi040 ceph-mon[32397]: mgrmap e1: no daemons active 2024-07-26T12:07:08.500 INFO:teuthology.orchestra.run.smithi040.stdout:Wrote config to /etc/ceph/ceph.conf 2024-07-26T12:07:08.529 INFO:teuthology.orchestra.run.smithi040.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-07-26T12:07:08.530 INFO:teuthology.orchestra.run.smithi040.stdout:Creating mgr... 2024-07-26T12:07:08.530 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying port 0.0.0.0:9283 ... 2024-07-26T12:07:08.531 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying port 0.0.0.0:8765 ... 2024-07-26T12:07:08.971 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.x 2024-07-26T12:07:08.972 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.x.service: Unit ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.x.service not loaded. 2024-07-26T12:07:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:08 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4019993554' entity='client.admin' 2024-07-26T12:07:09.242 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968.target.wants/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@.service. 2024-07-26T12:07:09.648 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 systemd[1]: Starting Ceph mgr.x for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:07:09.969 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 podman[32608]: 2024-07-26 12:07:09.550673863 +0000 UTC m=+0.031321064 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:07:09.970 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 podman[32608]: 2024-07-26 12:07:09.648202121 +0000 UTC m=+0.128849347 container create a0805b95d7665e9f5c4a394df58c93aab00ba607e243036fb8c698e9002e827e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T12:07:09.970 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 podman[32608]: 2024-07-26 12:07:09.879411801 +0000 UTC m=+0.360059027 container init a0805b95d7665e9f5c4a394df58c93aab00ba607e243036fb8c698e9002e827e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-07-26T12:07:09.970 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 podman[32608]: 2024-07-26 12:07:09.890655916 +0000 UTC m=+0.371303121 container start a0805b95d7665e9f5c4a394df58c93aab00ba607e243036fb8c698e9002e827e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-07-26T12:07:09.970 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 bash[32608]: a0805b95d7665e9f5c4a394df58c93aab00ba607e243036fb8c698e9002e827e 2024-07-26T12:07:10.023 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T12:07:10.023 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-07-26T12:07:10.045 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T12:07:10.045 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-07-26T12:07:10.046 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-07-26T12:07:10.046 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to enable service . firewalld.service is not available 2024-07-26T12:07:10.068 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T12:07:10.068 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-07-26T12:07:10.085 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T12:07:10.085 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-07-26T12:07:10.086 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-07-26T12:07:10.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-07-26T12:07:10.086 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr to start... 2024-07-26T12:07:10.086 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr... 2024-07-26T12:07:10.233 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:09 smithi040 systemd[1]: Started Ceph mgr.x for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:07:11.171 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:10 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1704009815' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-26T12:07:11.519 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "health": { 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-26T12:07:11.521 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 0 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "a" 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:11.528 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-26T12:07:11.529 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "btime": "2024-07-26T12:07:00:241237+0000", 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": false, 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-26T12:07:11.531 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "restful" 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modified": "2024-07-26T12:07:00.242434+0000", 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-26T12:07:11.532 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:11.533 INFO:teuthology.orchestra.run.smithi040.stdout:mgr not available, waiting (1/15)... 2024-07-26T12:07:14.605 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:14 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3913034123' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-26T12:07:14.919 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "health": { 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 0 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "a" 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:14.921 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-26T12:07:14.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "btime": "2024-07-26T12:07:00:241237+0000", 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-26T12:07:14.923 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": false, 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "restful" 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T12:07:14.924 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modified": "2024-07-26T12:07:00.242434+0000", 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:mgr not available, waiting (2/15)... 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: Activating manager daemon x 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: mgrmap e2: x(active, starting, since 0.0129248s) 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T12:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: Manager daemon x is now available 2024-07-26T12:07:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T12:07:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' 2024-07-26T12:07:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T12:07:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:16 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' 2024-07-26T12:07:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:17 smithi040 ceph-mon[32397]: from='mgr.14100 172.21.15.40:0/1348679016' entity='mgr.x' 2024-07-26T12:07:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:17 smithi040 ceph-mon[32397]: mgrmap e3: x(active, since 1.02464s) 2024-07-26T12:07:18.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:18 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3403264191' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-07-26T12:07:18.479 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "health": { 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 0 2024-07-26T12:07:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "a" 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "monmap": { 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-07-26T12:07:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "btime": "2024-07-26T12:07:00:241237+0000", 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modules": [ 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "iostat", 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "nfs", 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "restful" 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-07-26T12:07:18.484 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modified": "2024-07-26T12:07:00.242434+0000", 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:mgr is available 2024-07-26T12:07:19.705 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:19 smithi040 ceph-mon[32397]: mgrmap e4: x(active, since 2s) 2024-07-26T12:07:19.706 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:19 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3303183864' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-07-26T12:07:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [global] 2024-07-26T12:07:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout fsid = 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-07-26T12:07:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-07-26T12:07:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [mgr] 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [osd] 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-07-26T12:07:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-07-26T12:07:19.997 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-07-26T12:07:19.997 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-07-26T12:07:19.997 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling cephadm module... 2024-07-26T12:07:21.294 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:20 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2588782701' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-07-26T12:07:21.295 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:21 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: ignoring --setuser ceph since I am not root 2024-07-26T12:07:21.295 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:21 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: ignoring --setgroup ceph since I am not root 2024-07-26T12:07:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:21 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2588782701' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-07-26T12:07:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:21 smithi040 ceph-mon[32397]: mgrmap e5: x(active, since 4s) 2024-07-26T12:07:23.205 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:22 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3688056826' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for the mgr to restart... 2024-07-26T12:07:23.218 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr epoch 5... 2024-07-26T12:07:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: Active manager daemon x restarted 2024-07-26T12:07:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: Activating manager daemon x 2024-07-26T12:07:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: osdmap e2: 0 total, 0 up, 0 in 2024-07-26T12:07:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: mgrmap e6: x(active, starting, since 0.012113s) 2024-07-26T12:07:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: Manager daemon x is now available 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:27 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:28 smithi040 ceph-mon[32397]: Found migration_current of "None". Setting to last migration. 2024-07-26T12:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:28 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:28 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:28 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T12:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:28 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T12:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:28 smithi040 ceph-mon[32397]: mgrmap e7: x(active, since 1.0134s) 2024-07-26T12:07:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-07-26T12:07:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "initialized": true 2024-07-26T12:07:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:mgr epoch 5 is available 2024-07-26T12:07:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:Setting orchestrator backend to cephadm... 2024-07-26T12:07:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-mon[32397]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-07-26T12:07:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-mon[32397]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-07-26T12:07:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:07:29.768+0000 7f8475600640 -1 log_channel(cephadm) log [ERR] : [26/Jul/2024:12:07:29] ENGINE Error in HTTPServer.serve 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: Traceback (most recent call last): 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self._connections.run(self.expiration_interval) 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self._run(expiration_interval) 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T12:07:30.141 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: s = self.context.wrap_socket( 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: return self.sslsocket_class._create( 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self.do_handshake() 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self._sslobj.do_handshake() 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T12:07:30.142 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:29 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: mgrmap e8: x(active, since 2s) 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: [26/Jul/2024:12:07:29] ENGINE Bus STARTING 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: [26/Jul/2024:12:07:29] ENGINE Serving on https://172.21.15.40:7150 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: [26/Jul/2024:12:07:29] ENGINE Error in HTTPServer.serve 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout: Traceback (most recent call last): 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._connections.run(self.expiration_interval) 2024-07-26T12:07:30.746 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._run(expiration_interval) 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: s = self.context.wrap_socket( 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: return self.sslsocket_class._create( 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: self.do_handshake() 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._sslobj.do_handshake() 2024-07-26T12:07:30.747 INFO:journalctl@ceph.mon.a.smithi040.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T12:07:30.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: [26/Jul/2024:12:07:29] ENGINE Serving on http://172.21.15.40:8765 2024-07-26T12:07:30.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: [26/Jul/2024:12:07:29] ENGINE Bus STARTED 2024-07-26T12:07:30.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:07:30.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:30.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:30 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:07:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:31 smithi040 ceph-mon[32397]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:32.582 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:32 smithi040 ceph-mon[32397]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout value unchanged 2024-07-26T12:07:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:Generating ssh key... 2024-07-26T12:07:34.118 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: Generating public/private rsa key pair. 2024-07-26T12:07:34.118 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: Your identification has been saved in /tmp/tmpqhrx7c1b/key 2024-07-26T12:07:34.118 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: Your public key has been saved in /tmp/tmpqhrx7c1b/key.pub 2024-07-26T12:07:34.118 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: The key fingerprint is: 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: SHA256:6lG8nl00QBwzQ3DwS8woKYssp//p1t+NJzLBeYewO/I ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: The key's randomart image is: 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: +---[RSA 3072]----+ 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | o=O. | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | . B.+ | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | . o . * | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | . . o o.. o | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: |. + . .S+..o | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | + o=.o... | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: |. .o .+ .. | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | . .ooo=+.+. | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: | .++ .+E++o. | 2024-07-26T12:07:34.119 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:33 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: +----[SHA256]-----+ 2024-07-26T12:07:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:34 smithi040 ceph-mon[32397]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:34 smithi040 ceph-mon[32397]: Generating ssh key... 2024-07-26T12:07:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:34 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:34 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:35.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:07:35.905 INFO:teuthology.orchestra.run.smithi040.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-07-26T12:07:35.905 INFO:teuthology.orchestra.run.smithi040.stdout:Adding key to root@localhost authorized_keys... 2024-07-26T12:07:35.906 INFO:teuthology.orchestra.run.smithi040.stdout:Adding host smithi040... 2024-07-26T12:07:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:36 smithi040 ceph-mon[32397]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:37 smithi040 ceph-mon[32397]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi040", "addr": "172.21.15.40", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:39.553 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:39 smithi040 ceph-mon[32397]: Deploying cephadm binary to smithi040 2024-07-26T12:07:43.119 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Added host 'smithi040' with addr '172.21.15.40' 2024-07-26T12:07:43.120 INFO:teuthology.orchestra.run.smithi040.stdout:Deploying unmanaged mon service... 2024-07-26T12:07:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:43 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:43 smithi040 ceph-mon[32397]: Added host smithi040 2024-07-26T12:07:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:43 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:07:44.654 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-07-26T12:07:44.654 INFO:teuthology.orchestra.run.smithi040.stdout:Deploying unmanaged mgr service... 2024-07-26T12:07:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:45 smithi040 ceph-mon[32397]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:45 smithi040 ceph-mon[32397]: Saving service mon spec with placement count:5 2024-07-26T12:07:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:45 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:46.522 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-07-26T12:07:46.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:46 smithi040 ceph-mon[32397]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:07:46.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:46 smithi040 ceph-mon[32397]: Saving service mgr spec with placement count:2 2024-07-26T12:07:46.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:46 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:47.968 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:47 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:47.968 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:47 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:47.968 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:47 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3325923883' entity='client.admin' 2024-07-26T12:07:49.201 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:48 smithi040 ceph-mon[32397]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:07:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling the dashboard module... 2024-07-26T12:07:50.439 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:50 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/952426240' entity='client.admin' 2024-07-26T12:07:50.439 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:50 smithi040 ceph-mon[32397]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:07:50.439 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:50 smithi040 ceph-mon[32397]: from='mgr.14118 172.21.15.40:0/668001057' entity='mgr.x' 2024-07-26T12:07:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4168949759' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-07-26T12:07:51.483 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:51 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: ignoring --setuser ceph since I am not root 2024-07-26T12:07:51.483 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:07:51 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: ignoring --setgroup ceph since I am not root 2024-07-26T12:07:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4168949759' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-07-26T12:07:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:52 smithi040 ceph-mon[32397]: mgrmap e9: x(active, since 23s) 2024-07-26T12:07:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:53 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1797482908' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-07-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-07-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": true, 2024-07-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-07-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-07-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:53.569 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for the mgr to restart... 2024-07-26T12:07:53.569 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr epoch 9... 2024-07-26T12:07:57.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: Active manager daemon x restarted 2024-07-26T12:07:57.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: Activating manager daemon x 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: osdmap e3: 0 total, 0 up, 0 in 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: mgrmap e10: x(active, starting, since 0.00720246s) 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: Manager daemon x is now available 2024-07-26T12:07:57.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:07:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-07-26T12:07:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-07-26T12:07:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:58 smithi040 ceph-mon[32397]: mgrmap e11: x(active, since 1.01054s) 2024-07-26T12:07:59.317 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-07-26T12:07:59.317 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-07-26T12:07:59.317 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "initialized": true 2024-07-26T12:07:59.317 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-07-26T12:07:59.317 INFO:teuthology.orchestra.run.smithi040.stdout:mgr epoch 9 is available 2024-07-26T12:07:59.317 INFO:teuthology.orchestra.run.smithi040.stdout:Generating a dashboard self-signed certificate... 2024-07-26T12:07:59.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:59 smithi040 ceph-mon[32397]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-07-26T12:07:59.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:07:59 smithi040 ceph-mon[32397]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-07-26T12:08:00.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:08:00.162+0000 7f98a9c00640 -1 log_channel(cephadm) log [ERR] : [26/Jul/2024:12:08:00] ENGINE Error in HTTPServer.serve 2024-07-26T12:08:00.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: Traceback (most recent call last): 2024-07-26T12:08:00.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T12:08:00.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self._connections.run(self.expiration_interval) 2024-07-26T12:08:00.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self._run(expiration_interval) 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: s = self.context.wrap_socket( 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: return self.sslsocket_class._create( 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self.do_handshake() 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T12:08:00.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: self._sslobj.do_handshake() 2024-07-26T12:08:00.236 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T12:08:00.236 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:08:00.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: mgrmap e12: x(active, since 2s) 2024-07-26T12:08:00.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: [26/Jul/2024:12:08:00] ENGINE Bus STARTING 2024-07-26T12:08:00.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: [26/Jul/2024:12:08:00] ENGINE Serving on https://172.21.15.40:7150 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: [26/Jul/2024:12:08:00] ENGINE Error in HTTPServer.serve 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: Traceback (most recent call last): 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._connections.run(self.expiration_interval) 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._run(expiration_interval) 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-07-26T12:08:00.874 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: s = self.context.wrap_socket( 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: return self.sslsocket_class._create( 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: self.do_handshake() 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._sslobj.do_handshake() 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: [26/Jul/2024:12:08:00] ENGINE Serving on http://172.21.15.40:8765 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: [26/Jul/2024:12:08:00] ENGINE Bus STARTED 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:00.875 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-07-26T12:08:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:Creating initial admin user... 2024-07-26T12:08:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:02.968 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$rDcp21f0ZO4FrDX0n7weru4y/reppJTVD62fVeCMY6Xp/c6D9ZRf6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1721995682, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-07-26T12:08:02.968 INFO:teuthology.orchestra.run.smithi040.stdout:Fetching dashboard port number... 2024-07-26T12:08:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:03 smithi040 ceph-mon[32397]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:08:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:04.465 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:04 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3611418115' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-07-26T12:08:05.196 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 8443 2024-07-26T12:08:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-07-26T12:08:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-07-26T12:08:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-07-26T12:08:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-07-26T12:08:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-07-26T12:08:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-07-26T12:08:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:Ceph Dashboard is now available at: 2024-07-26T12:08:05.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:05.253 INFO:teuthology.orchestra.run.smithi040.stdout: URL: https://smithi040.front.sepia.ceph.com:8443/ 2024-07-26T12:08:05.253 INFO:teuthology.orchestra.run.smithi040.stdout: User: admin 2024-07-26T12:08:05.253 INFO:teuthology.orchestra.run.smithi040.stdout: Password: k5z8jjjixi 2024-07-26T12:08:05.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:Saving cluster configuration to /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config directory 2024-07-26T12:08:05.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:05 smithi040 ceph-mon[32397]: mgrmap e13: x(active, since 6s) 2024-07-26T12:08:06.829 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout:Or, if you are only running a single cluster on this host: 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-07-26T12:08:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout:Please consider enabling telemetry to help improve Ceph: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: ceph telemetry on 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout:For more information see: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:06.831 INFO:teuthology.orchestra.run.smithi040.stdout:Bootstrap complete. 2024-07-26T12:08:06.917 INFO:tasks.cephadm:Fetching config... 2024-07-26T12:08:06.917 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:08:06.917 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-07-26T12:08:06.972 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-07-26T12:08:06.972 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:08:06.972 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-07-26T12:08:07.018 INFO:tasks.cephadm:Fetching mon keyring... 2024-07-26T12:08:07.019 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:08:07.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/keyring of=/dev/stdout 2024-07-26T12:08:07.131 INFO:tasks.cephadm:Fetching pub ssh key... 2024-07-26T12:08:07.131 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:08:07.131 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-07-26T12:08:07.230 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-07-26T12:08:07.230 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-26T12:08:07.342 INFO:teuthology.orchestra.run.smithi040.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:08:07.370 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2540044203' entity='client.admin' 2024-07-26T12:08:07.372 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-26T12:08:07.487 INFO:teuthology.orchestra.run.smithi076.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:08:07.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-07-26T12:08:07.657 INFO:teuthology.orchestra.run.smithi146.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXBRVkMS6uTinyKrrHk7SwyCkulmRpYMVN+7lAi9C6E43Uhg6YhgpXJABdIKPfelq4BhycpJC9Q54mEV+jjzJ5uGMxWUqbjC0PO3d3dpa6FgeA1peRaV3YhxJLYi9zXSl4OZCLq2uKixtx4sc+LeZf7JNLl96W9VMLS930hdfZtY2Ys7L/+9fLqRZem9YDwmk6HPcq+cb5MkXIB+Y7N3ocLmdPrs73Mt3odYkXac+43i66+h2UIo6962dU76YyU1/BewCCZKMdvLZMv6Wb/r+1NQTrcZm4jZHpgXLPCRq//WJ8ho7W3pKeCAyoSLSZ0u2xzjZVDAAsJyDP9D63t6eKtJKrvQg+nDVdFubYKiaMj+uXKC71+ZV7VsrfF3M8ecui6fDoxZsSRoEMwXA0uuMumU21F5Kq6ZMCgzQ6h+3/7Mtwdrl8ET52Rp/UlEn1BLnDhkOCVCfj5B69FjrVfu6Sf0EnBGeuyhdpUe4A74IfQ0VL4L2CE6e9zc89+HMwmCk= ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:08:07.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-07-26T12:08:08.162 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:10.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:10.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:10.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi040", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:08:10.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:10.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:08:10.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:11.655 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-07-26T12:08:11.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-07-26T12:08:12.104 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:11 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2414681042' entity='client.admin' 2024-07-26T12:08:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:08:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:15.052 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi076 2024-07-26T12:08:15.052 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:08:15.053 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/etc/ceph/ceph.conf 2024-07-26T12:08:15.110 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:08:15.111 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:08:15.206 INFO:tasks.cephadm:Adding host smithi076 to orchestrator... 2024-07-26T12:08:15.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch host add smithi076 2024-07-26T12:08:15.640 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:15 smithi040 ceph-mon[32397]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:08:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:08:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:08:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:08:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:15 smithi040 ceph-mon[32397]: Updating smithi040:/etc/ceph/ceph.conf 2024-07-26T12:08:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:16 smithi040 ceph-mon[32397]: Updating smithi040:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:08:17.391 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:17 smithi040 ceph-mon[32397]: Updating smithi040:/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:08:17.391 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:17 smithi040 ceph-mon[32397]: Updating smithi040:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T12:08:17.391 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:17.391 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:17.391 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:19 smithi040 ceph-mon[32397]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:19 smithi040 ceph-mon[32397]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi076", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:08:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:21 smithi040 ceph-mon[32397]: Deploying cephadm binary to smithi076 2024-07-26T12:08:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:21 smithi040 ceph-mon[32397]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:23.386 INFO:teuthology.orchestra.run.smithi040.stdout:Added host 'smithi076' with addr '172.21.15.76' 2024-07-26T12:08:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:23 smithi040 ceph-mon[32397]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:24.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch host ls --format=json 2024-07-26T12:08:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:24.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:24.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:24 smithi040 ceph-mon[32397]: Added host smithi076 2024-07-26T12:08:24.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:08:24.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:25.714 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:25 smithi040 ceph-mon[32397]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:25.714 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:26.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:26.729 INFO:teuthology.orchestra.run.smithi040.stdout:[{"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "172.21.15.76", "hostname": "smithi076", "labels": [], "status": ""}] 2024-07-26T12:08:27.464 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi146 2024-07-26T12:08:27.464 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:08:27.464 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.conf 2024-07-26T12:08:27.522 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:08:27.523 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:08:27.620 INFO:tasks.cephadm:Adding host smithi146 to orchestrator... 2024-07-26T12:08:27.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch host add smithi146 2024-07-26T12:08:27.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:27 smithi040 ceph-mon[32397]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:27.702 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:28 smithi040 ceph-mon[32397]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:08:29.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:29 smithi040 ceph-mon[32397]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi076", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:08:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:32 smithi040 ceph-mon[32397]: Updating smithi076:/etc/ceph/ceph.conf 2024-07-26T12:08:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:33 smithi040 ceph-mon[32397]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:33 smithi040 ceph-mon[32397]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:08:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:33 smithi040 ceph-mon[32397]: Deploying cephadm binary to smithi146 2024-07-26T12:08:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:34 smithi040 ceph-mon[32397]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:08:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:34 smithi040 ceph-mon[32397]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T12:08:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:35 smithi040 ceph-mon[32397]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:36.306 INFO:teuthology.orchestra.run.smithi040.stdout:Added host 'smithi146' with addr '172.21.15.146' 2024-07-26T12:08:37.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch host ls --format=json 2024-07-26T12:08:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:37.706 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:37 smithi040 ceph-mon[32397]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:37.706 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:37.706 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:37 smithi040 ceph-mon[32397]: Added host smithi146 2024-07-26T12:08:37.706 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:08:37.706 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:38 smithi040 ceph-mon[32397]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:39.842 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:08:39.842 INFO:teuthology.orchestra.run.smithi040.stdout:[{"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "172.21.15.76", "hostname": "smithi076", "labels": [], "status": ""}, {"addr": "172.21.15.146", "hostname": "smithi146", "labels": [], "status": ""}] 2024-07-26T12:08:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:40.638 INFO:tasks.cephadm:Setting crush tunables to default 2024-07-26T12:08:40.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd crush tunables default 2024-07-26T12:08:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:08:41.552 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:41 smithi040 ceph-mon[32397]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:41.552 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:41 smithi040 ceph-mon[32397]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:08:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-07-26T12:08:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:43 smithi040 ceph-mon[32397]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:43 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/674489313' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-07-26T12:08:44.095 INFO:tasks.cephadm:Adding mon.a on smithi040 2024-07-26T12:08:44.095 INFO:tasks.cephadm:Adding mon.b on smithi076 2024-07-26T12:08:44.095 INFO:tasks.cephadm:Adding mon.c on smithi146 2024-07-26T12:08:44.096 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch apply mon '3;smithi040:172.21.15.40=a;smithi076:172.21.15.76=b;smithi146:172.21.15.146=c' 2024-07-26T12:08:44.535 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /etc/ceph/ceph.conf 2024-07-26T12:08:44.633 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /etc/ceph/ceph.conf 2024-07-26T12:08:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/674489313' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-07-26T12:08:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:08:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:08:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:08:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:08:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:45 smithi040 ceph-mon[32397]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:45 smithi040 ceph-mon[32397]: Updating smithi146:/etc/ceph/ceph.conf 2024-07-26T12:08:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:46 smithi040 ceph-mon[32397]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:08:47.078 INFO:teuthology.orchestra.run.smithi146.stdout:Scheduled mon update... 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi040:172.21.15.40=a;smithi076:172.21.15.76=b;smithi146:172.21.15.146=c", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: Saving service mon spec with placement smithi040:172.21.15.40=a;smithi076:172.21.15.76=b;smithi146:172.21.15.146=c;count:3 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: Reconfiguring mon.a (unknown last config time)... 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:08:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:47 smithi040 ceph-mon[32397]: Reconfiguring daemon mon.a on smithi040 2024-07-26T12:08:47.815 DEBUG:teuthology.orchestra.run.smithi076:mon.b> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.b.service 2024-07-26T12:08:47.822 DEBUG:teuthology.orchestra.run.smithi146:mon.c> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mon.c.service 2024-07-26T12:08:47.830 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T12:08:47.830 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph mon dump -f json 2024-07-26T12:08:48.279 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:08:48.714 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:48 smithi040 ceph-mon[32397]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:08:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:08:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:08:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:50 smithi040 ceph-mon[32397]: Deploying daemon mon.c on smithi146 2024-07-26T12:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:08:50.846 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":1,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","modified":"2024-07-26T12:06:55.574734Z","created":"2024-07-26T12:06:55.574734Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-07-26T12:08:50.846 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 1 2024-07-26T12:08:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:51 smithi040 ceph-mon[32397]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/3318137659' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:08:53.436 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T12:08:53.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph mon dump -f json 2024-07-26T12:08:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:53 smithi040 ceph-mon[32397]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:08:54.049 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:08:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:08:55 smithi040 ceph-mon[32397]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:01.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:09:02.073 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":2,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","modified":"2024-07-26T12:08:56.903324Z","created":"2024-07-26T12:06:55.574734Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-07-26T12:09:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 2 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: mon.a calling monitor election 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/2400375632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: mon.c calling monitor election 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: monmap epoch 2 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: last_changed 2024-07-26T12:08:56.903324+0000 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: min_mon_release 19 (squid) 2024-07-26T12:09:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: election_strategy: 1 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: fsmap 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: mgrmap e13: x(active, since 64s) 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:02.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:03 smithi040 ceph-mon[32397]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:03 smithi040 ceph-mon[32397]: Deploying daemon mon.b on smithi076 2024-07-26T12:09:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:03.912 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T12:09:03.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph mon dump -f json 2024-07-26T12:09:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:09:05.282 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:05 smithi146 ceph-mon[35807]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:05 smithi040 ceph-mon[32397]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:06.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:09:06.699 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":2,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","modified":"2024-07-26T12:08:56.903324Z","created":"2024-07-26T12:06:55.574734Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-07-26T12:09:06.699 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 2 2024-07-26T12:09:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:07 smithi146 ceph-mon[35807]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/1970086205' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:07 smithi040 ceph-mon[32397]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/1970086205' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.286 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 podman[35382]: 2024-07-26 12:09:08.17886899 +0000 UTC m=+0.365673340 container start bb21128930b7db427bb9880ab064d86616d2907cfca9e76284a61e66267426f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mon-b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T12:09:08.286 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 bash[35382]: bb21128930b7db427bb9880ab064d86616d2907cfca9e76284a61e66267426f4 2024-07-26T12:09:08.484 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-07-26T12:09:08.484 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph mon dump -f json 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: set uid:gid to 167:167 (ceph:ceph) 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev), process ceph-mon, pid 2 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pidfile_write: ignore empty --pid-file 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: load: jerasure load: lrc 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 systemd[1]: Started Ceph mon.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: RocksDB version: 7.9.2 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Git sha 0 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Compile date 2024-07-25 13:49:38 2024-07-26T12:09:08.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: DB SUMMARY 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: DB Session ID: E86F67WI9AMQZV6KSHLN 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: CURRENT file: CURRENT 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: IDENTITY file: IDENTITY 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.error_if_exists: 0 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.create_if_missing: 0 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.paranoid_checks: 1 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.flush_verify_memtable_count: 1 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-07-26T12:09:08.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.env: 0x55bb2047a280 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.fs: PosixFileSystem 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.info_log: 0x55bb4695b060 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_file_opening_threads: 16 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.statistics: (nil) 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.use_fsync: 0 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_log_file_size: 0 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.log_file_time_to_roll: 0 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.keep_log_file_num: 1000 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.recycle_log_file_num: 0 2024-07-26T12:09:08.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.allow_fallocate: 1 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.allow_mmap_reads: 0 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.allow_mmap_writes: 0 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.use_direct_reads: 0 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.create_missing_column_families: 0 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.db_log_dir: 2024-07-26T12:09:08.588 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.wal_dir: 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.table_cache_numshardbits: 6 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.WAL_ttl_seconds: 0 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.WAL_size_limit_MB: 0 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.is_fd_close_on_exec: 1 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.advise_random_on_open: 1 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.db_write_buffer_size: 0 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.write_buffer_manager: 0x55bb4695f5e0 2024-07-26T12:09:08.589 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.use_adaptive_mutex: 0 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.rate_limiter: (nil) 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.wal_recovery_mode: 2 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.enable_thread_tracking: 0 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.enable_pipelined_write: 0 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.unordered_write: 0 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-07-26T12:09:08.590 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.row_cache: None 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.wal_filter: None 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.allow_ingest_behind: 0 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.two_write_queues: 0 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.manual_wal_flush: 0 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.wal_compression: 0 2024-07-26T12:09:08.591 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.atomic_flush: 0 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.persist_stats_to_disk: 0 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.write_dbid_to_manifest: 0 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.log_readahead_size: 0 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.best_efforts_recovery: 0 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-07-26T12:09:08.592 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.allow_data_in_errors: 0 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.db_host_id: __hostname__ 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.enforce_single_del_contracts: true 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_background_jobs: 2 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_background_compactions: -1 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_subcompactions: 1 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.delayed_write_rate : 16777216 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_total_wal_size: 0 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-07-26T12:09:08.593 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.stats_dump_period_sec: 600 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.stats_persist_period_sec: 600 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_open_files: -1 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bytes_per_sync: 0 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.wal_bytes_per_sync: 0 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.strict_bytes_per_sync: 0 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_readahead_size: 0 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_background_flushes: -1 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Compression algorithms supported: 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kZSTD supported: 0 2024-07-26T12:09:08.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kXpressCompression supported: 0 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kBZip2Compression supported: 0 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kLZ4Compression supported: 1 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kZlibCompression supported: 1 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kLZ4HCCompression supported: 1 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: kSnappyCompression supported: 1 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Fast CRC32 supported: Supported on x86 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: DMutex implementation: pthread_mutex_t 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.merge_operator: 2024-07-26T12:09:08.595 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_filter: None 2024-07-26T12:09:08.596 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_filter_factory: None 2024-07-26T12:09:08.596 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.sst_partitioner_factory: None 2024-07-26T12:09:08.596 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.memtable_factory: SkipListFactory 2024-07-26T12:09:08.596 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.table_factory: BlockBasedTable 2024-07-26T12:09:08.596 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bb4695ac00) 2024-07-26T12:09:08.596 INFO:journalctl@ceph.mon.b.smithi076.stdout: cache_index_and_filter_blocks: 1 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: pin_top_level_index_and_filter: 1 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: index_type: 0 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: data_block_index_type: 0 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: index_shortening: 1 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: data_block_hash_table_util_ratio: 0.750000 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: checksum: 4 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: no_block_cache: 0 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_cache: 0x55bb4291f610 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_cache_name: BinnedLRUCache 2024-07-26T12:09:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_cache_options: 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: capacity : 536870912 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: num_shard_bits : 4 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: strict_capacity_limit : 0 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: high_pri_pool_ratio: 0.000 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_cache_compressed: (nil) 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: persistent_cache: (nil) 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_size: 4096 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_size_deviation: 10 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_restart_interval: 16 2024-07-26T12:09:08.599 INFO:journalctl@ceph.mon.b.smithi076.stdout: index_block_restart_interval: 1 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: metadata_block_size: 4096 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: partition_filters: 0 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: use_delta_encoding: 1 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: filter_policy: bloomfilter 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: whole_key_filtering: 1 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: verify_compression: 0 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: read_amp_bytes_per_bit: 0 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: format_version: 5 2024-07-26T12:09:08.600 INFO:journalctl@ceph.mon.b.smithi076.stdout: enable_index_compression: 1 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout: block_align: 0 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout: max_auto_readahead_size: 262144 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout: prepopulate_block_cache: 0 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout: initial_auto_readahead_size: 8192 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout: num_file_reads_for_auto_readahead: 2 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.write_buffer_size: 33554432 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_write_buffer_number: 2 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression: NoCompression 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression: Disabled 2024-07-26T12:09:08.601 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.prefix_extractor: nullptr 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.num_levels: 7 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-07-26T12:09:08.602 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-07-26T12:09:08.603 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-07-26T12:09:08.603 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-07-26T12:09:08.603 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.window_bits: -14 2024-07-26T12:09:08.603 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.level: 32767 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.strategy: 0 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.enabled: false 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-07-26T12:09:08.604 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.target_file_size_base: 67108864 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.target_file_size_multiplier: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-07-26T12:09:08.605 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.arena_block_size: 1048576 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.disable_auto_compactions: 0 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-07-26T12:09:08.606 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.inplace_update_support: 0 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.inplace_update_num_locks: 10000 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.memtable_huge_page_size: 0 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.bloom_locality: 0 2024-07-26T12:09:08.607 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.max_successive_merges: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.optimize_filters_for_hits: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.paranoid_file_checks: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.force_consistency_checks: 1 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.report_bg_io_stats: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.ttl: 2592000 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.periodic_compaction_seconds: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.enable_blob_files: false 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.min_blob_size: 0 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.blob_file_size: 268435456 2024-07-26T12:09:08.608 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.blob_compression_type: NoCompression 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.enable_blob_garbage_collection: false 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.blob_file_starting_level: 0 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6ee7455c-ec59-4184-a8cf-e89e75f67ac2 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721995748303353, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721995748304463, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1721995748, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6ee7455c-ec59-4184-a8cf-e89e75f67ac2", "db_session_id": "E86F67WI9AMQZV6KSHLN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-07-26T12:09:08.609 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1721995748304756, "job": 1, "event": "recovery_finished"} 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bb4697ea80 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: DB pointer 0x55bb4771e000 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: ** DB Stats ** 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-07-26T12:09:08.610 INFO:journalctl@ceph.mon.b.smithi076.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: ** Compaction Stats [default] ** 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: ** Compaction Stats [default] ** 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-07-26T12:09:08.611 INFO:journalctl@ceph.mon.b.smithi076.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: AddFile(Keys): cumulative 0, interval 0 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: Cumulative compaction: 0.00 GB write, 0.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: Interval compaction: 0.00 GB write, 0.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-07-26T12:09:08.612 INFO:journalctl@ceph.mon.b.smithi076.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: Block cache BinnedLRUCache@0x55bb4291f610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: ** File Read Latency Histogram By Level [default] ** 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: using public_addr v2:172.21.15.76:0/0 -> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: starting mon.b rank -1 at public addrs [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] at bind addrs [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(???) e0 preinit fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).mds e1 new map 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).mds e1 print_map 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: e1 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: btime 2024-07-26T12:07:00:241237+0000 2024-07-26T12:09:08.613 INFO:journalctl@ceph.mon.b.smithi076.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout: legacy client fscid: -1 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout: 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout: No filesystems configured 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-07-26T12:09:08.614 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Added host smithi076 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:09:08.615 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi076", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi076:/etc/ceph/ceph.conf 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Deploying cephadm binary to smithi146 2024-07-26T12:09:08.616 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Added host smithi146 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.617 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/674489313' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/674489313' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:09:08.618 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi146:/etc/ceph/ceph.conf 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.619 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.client.admin.keyring 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi040:172.21.15.40=a;smithi076:172.21.15.76=b;smithi146:172.21.15.146=c", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Saving service mon spec with placement smithi040:172.21.15.40=a;smithi076:172.21.15.76=b;smithi146:172.21.15.146=c;count:3 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Reconfiguring mon.a (unknown last config time)... 2024-07-26T12:09:08.620 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Reconfiguring daemon mon.a on smithi040 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:08.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Deploying daemon mon.c on smithi146 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/3318137659' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.a calling monitor election 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/2400375632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.622 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.c calling monitor election 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: monmap epoch 2 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: last_changed 2024-07-26T12:08:56.903324+0000 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: min_mon_release 19 (squid) 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: election_strategy: 1 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-07-26T12:09:08.623 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: fsmap 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mgrmap e13: x(active, since 64s) 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: Deploying daemon mon.b on smithi076 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:08.624 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/1970086205' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:08.625 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:08 smithi076 ceph-mon[35401]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-07-26T12:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: mon.a calling monitor election 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: mon.c calling monitor election 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: mon.b calling monitor election 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: monmap epoch 3 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: last_changed 2024-07-26T12:09:08.362836+0000 2024-07-26T12:09:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: min_mon_release 19 (squid) 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: election_strategy: 1 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: 2: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.b 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: fsmap 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: mgrmap e13: x(active, since 75s) 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: mon.a calling monitor election 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: mon.c calling monitor election 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: mon.b calling monitor election 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: monmap epoch 3 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: last_changed 2024-07-26T12:09:08.362836+0000 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: min_mon_release 19 (squid) 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: election_strategy: 1 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:09:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: 2: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.b 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: fsmap 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: mgrmap e13: x(active, since 75s) 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: mon.a calling monitor election 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: mon.c calling monitor election 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: mon.b calling monitor election 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: monmap epoch 3 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: last_changed 2024-07-26T12:09:08.362836+0000 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: created 2024-07-26T12:06:55.574734+0000 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: min_mon_release 19 (squid) 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: election_strategy: 1 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-07-26T12:09:13.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: 1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.c 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: 2: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.b 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: fsmap 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: osdmap e4: 0 total, 0 up, 0 in 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: mgrmap e13: x(active, since 75s) 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:13.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-07-26T12:09:14.278 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","modified":"2024-07-26T12:09:08.362836Z","created":"2024-07-26T12:06:55.574734Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-07-26T12:09:14.278 INFO:teuthology.orchestra.run.smithi146.stderr:dumped monmap epoch 3 2024-07-26T12:09:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:14 smithi146 ceph-mon[35807]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:14 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/3754806893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:14 smithi040 ceph-mon[32397]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:14 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/3754806893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:14 smithi076 ceph-mon[35401]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:14.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:14 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/3754806893' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-07-26T12:09:14.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:09:15.101 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-07-26T12:09:15.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config generate-minimal-conf 2024-07-26T12:09:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:16.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:16.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:17 smithi040 ceph-mon[32397]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:17 smithi040 ceph-mon[32397]: Updating smithi040:/etc/ceph/ceph.conf 2024-07-26T12:09:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:17 smithi040 ceph-mon[32397]: Updating smithi076:/etc/ceph/ceph.conf 2024-07-26T12:09:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:17 smithi040 ceph-mon[32397]: Updating smithi146:/etc/ceph/ceph.conf 2024-07-26T12:09:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:17 smithi146 ceph-mon[35807]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:17 smithi146 ceph-mon[35807]: Updating smithi040:/etc/ceph/ceph.conf 2024-07-26T12:09:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:17 smithi146 ceph-mon[35807]: Updating smithi076:/etc/ceph/ceph.conf 2024-07-26T12:09:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:17 smithi146 ceph-mon[35807]: Updating smithi146:/etc/ceph/ceph.conf 2024-07-26T12:09:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:17 smithi076 ceph-mon[35401]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:17 smithi076 ceph-mon[35401]: Updating smithi040:/etc/ceph/ceph.conf 2024-07-26T12:09:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:17 smithi076 ceph-mon[35401]: Updating smithi076:/etc/ceph/ceph.conf 2024-07-26T12:09:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:17 smithi076 ceph-mon[35401]: Updating smithi146:/etc/ceph/ceph.conf 2024-07-26T12:09:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.055 INFO:teuthology.orchestra.run.smithi040.stdout:# minimal ceph.conf for 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:18.055 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-07-26T12:09:18.055 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:09:18.056 INFO:teuthology.orchestra.run.smithi040.stdout: mon_host = [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] 2024-07-26T12:09:18.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: Updating smithi040:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:18 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2248392218' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: Updating smithi040:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:18.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:18 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2248392218' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:18.823 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-07-26T12:09:18.823 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:09:18.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.conf 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: Updating smithi040:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: Updating smithi146:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: Updating smithi076:/var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/config/ceph.conf 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:18 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2248392218' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:18.902 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:09:18.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:09:19.022 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:09:19.022 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.conf 2024-07-26T12:09:19.115 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:09:19.115 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:09:19.243 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:09:19.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.conf 2024-07-26T12:09:19.340 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:09:19.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-07-26T12:09:19.465 INFO:tasks.cephadm:Adding mgr.x on smithi040 2024-07-26T12:09:19.466 INFO:tasks.cephadm:Adding mgr.y on smithi076 2024-07-26T12:09:19.466 INFO:tasks.cephadm:Adding mgr.z on smithi146 2024-07-26T12:09:19.466 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch apply mgr '3;smithi040=x;smithi076=y;smithi146=z' 2024-07-26T12:09:19.580 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:19 smithi146 ceph-mon[35807]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:19.580 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:19 smithi146 ceph-mon[35807]: Reconfiguring mon.a (monmap changed)... 2024-07-26T12:09:19.580 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:19 smithi146 ceph-mon[35807]: Reconfiguring daemon mon.a on smithi040 2024-07-26T12:09:19.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:19 smithi040 ceph-mon[32397]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:19.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:19 smithi040 ceph-mon[32397]: Reconfiguring mon.a (monmap changed)... 2024-07-26T12:09:19.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:19 smithi040 ceph-mon[32397]: Reconfiguring daemon mon.a on smithi040 2024-07-26T12:09:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:19 smithi076 ceph-mon[35401]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:19 smithi076 ceph-mon[35401]: Reconfiguring mon.a (monmap changed)... 2024-07-26T12:09:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:19 smithi076 ceph-mon[35401]: Reconfiguring daemon mon.a on smithi040 2024-07-26T12:09:19.944 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: Reconfiguring mon.b (monmap changed)... 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:21.254 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:21 smithi146 ceph-mon[35807]: Reconfiguring daemon mon.b on smithi076 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: Reconfiguring mon.b (monmap changed)... 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:21 smithi040 ceph-mon[32397]: Reconfiguring daemon mon.b on smithi076 2024-07-26T12:09:21.525 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:21.525 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:21.525 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:21.526 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: Reconfiguring mon.b (monmap changed)... 2024-07-26T12:09:21.526 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:21.526 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:21.526 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:21.526 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:21 smithi076 ceph-mon[35401]: Reconfiguring daemon mon.b on smithi076 2024-07-26T12:09:22.293 INFO:teuthology.orchestra.run.smithi146.stdout:Scheduled mgr update... 2024-07-26T12:09:23.121 DEBUG:teuthology.orchestra.run.smithi076:mgr.y> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.y.service 2024-07-26T12:09:23.129 DEBUG:teuthology.orchestra.run.smithi146:mgr.z> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mgr.z.service 2024-07-26T12:09:23.137 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-07-26T12:09:23.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-07-26T12:09:23.145 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-07-26T12:09:23.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set client debug_client 20 2024-07-26T12:09:23.191 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-07-26T12:09:23.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set client debug_ms 1 2024-07-26T12:09:23.238 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-07-26T12:09:23.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-07-26T12:09:23.254 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: Reconfiguring mon.c (monmap changed)... 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: Reconfiguring daemon mon.c on smithi146 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi076=y;smithi146=z", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: Saving service mgr spec with placement smithi040=x;smithi076=y;smithi146=z;count:3 2024-07-26T12:09:23.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.258 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-07-26T12:09:23.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-07-26T12:09:23.271 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: Reconfiguring mon.c (monmap changed)... 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: Reconfiguring daemon mon.c on smithi146 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi076=y;smithi146=z", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: Saving service mgr spec with placement smithi040=x;smithi076=y;smithi146=z;count:3 2024-07-26T12:09:23.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.305 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-07-26T12:09:23.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds debug_mds 20 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: Reconfiguring mon.c (monmap changed)... 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: Reconfiguring daemon mon.c on smithi146 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi076=y;smithi146=z", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: Saving service mgr spec with placement smithi040=x;smithi076=y;smithi146=z;count:3 2024-07-26T12:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:23.352 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-07-26T12:09:23.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-07-26T12:09:23.400 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-07-26T12:09:23.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds debug_ms 2 2024-07-26T12:09:23.453 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-07-26T12:09:23.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-07-26T12:09:23.504 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-07-26T12:09:23.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-07-26T12:09:23.561 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-07-26T12:09:23.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-07-26T12:09:23.620 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-07-26T12:09:23.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-07-26T12:09:23.672 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-07-26T12:09:23.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-07-26T12:09:23.728 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-07-26T12:09:23.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-07-26T12:09:23.783 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-07-26T12:09:23.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-07-26T12:09:23.841 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-07-26T12:09:23.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-07-26T12:09:23.903 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-07-26T12:09:23.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-07-26T12:09:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:23.940 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-07-26T12:09:23.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-07-26T12:09:23.998 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-07-26T12:09:23.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-07-26T12:09:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:24.044 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-07-26T12:09:24.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-07-26T12:09:24.105 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-07-26T12:09:24.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-07-26T12:09:24.160 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-07-26T12:09:24.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-07-26T12:09:24.223 DEBUG:tasks.cephadm:set 22 configs 2024-07-26T12:09:24.223 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi040') 2024-07-26T12:09:24.224 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:25.466 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:25.466 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.466 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.466 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:25.466 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:25.466 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:25.467 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:25 smithi146 ceph-mon[35807]: Deploying daemon mgr.z on smithi146 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T12:09:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:25 smithi040 ceph-mon[32397]: Deploying daemon mgr.z on smithi146 2024-07-26T12:09:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:25.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:25.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:25 smithi076 ceph-mon[35401]: Deploying daemon mgr.z on smithi146 2024-07-26T12:09:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:26.379 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:27.318 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:26 smithi146 systemd[1]: Starting Ceph mgr.z for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:09:27.370 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:27.376 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:27 smithi146 ceph-mon[35807]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:27.571 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 podman[37429]: 2024-07-26 12:09:27.220199807 +0000 UTC m=+0.035196801 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:09:27.571 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 podman[37429]: 2024-07-26 12:09:27.363476073 +0000 UTC m=+0.178473074 container create 4267c5929640e52c5597765528cf96eaa518849ba51ad2a5fee1a41d79ed40b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-z, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T12:09:27.572 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:27 smithi040 ceph-mon[32397]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:27 smithi076 ceph-mon[35401]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:28.071 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 podman[37429]: 2024-07-26 12:09:27.575352562 +0000 UTC m=+0.390349612 container init 4267c5929640e52c5597765528cf96eaa518849ba51ad2a5fee1a41d79ed40b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T12:09:28.071 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 podman[37429]: 2024-07-26 12:09:27.58465617 +0000 UTC m=+0.399653182 container start 4267c5929640e52c5597765528cf96eaa518849ba51ad2a5fee1a41d79ed40b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-z, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T12:09:28.071 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 ceph-mgr[37448]: -- 172.21.15.146:0/1071350231 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ecf15cd0e0 con 0x55ecf636c000 2024-07-26T12:09:28.071 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 bash[37429]: 4267c5929640e52c5597765528cf96eaa518849ba51ad2a5fee1a41d79ed40b9 2024-07-26T12:09:28.072 INFO:journalctl@ceph.mgr.z.smithi146.stdout:Jul 26 12:09:27 smithi146 systemd[1]: Started Ceph mgr.z for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:09:28.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:28.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4280793688' entity='client.admin' 2024-07-26T12:09:28.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:28.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:28.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:28.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:28.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T12:09:28.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:28.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:28.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:28 smithi040 ceph-mon[32397]: Deploying daemon mgr.y on smithi076 2024-07-26T12:09:29.004 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4280793688' entity='client.admin' 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:29.005 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:28 smithi076 ceph-mon[35401]: Deploying daemon mgr.y on smithi076 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4280793688' entity='client.admin' 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:29.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:28 smithi146 ceph-mon[35807]: Deploying daemon mgr.y on smithi076 2024-07-26T12:09:29.676 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi040') 2024-07-26T12:09:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:30 smithi040 ceph-mon[32397]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:31.019 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:30 smithi076 ceph-mon[35401]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:30 smithi146 ceph-mon[35807]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:31.274 INFO:journalctl@ceph.mgr.y.smithi076.stdout:Jul 26 12:09:31 smithi076 podman[36524]: 2024-07-26 12:09:31.260644937 +0000 UTC m=+0.373675651 container init 4d9eeb41d3d6ba7ca27280deca48a43ef9fbe174182f96d5dbfd5750d9b9e033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-y, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T12:09:31.274 INFO:journalctl@ceph.mgr.y.smithi076.stdout:Jul 26 12:09:31 smithi076 podman[36524]: 2024-07-26 12:09:31.272315641 +0000 UTC m=+0.385346337 container start 4d9eeb41d3d6ba7ca27280deca48a43ef9fbe174182f96d5dbfd5750d9b9e033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724) 2024-07-26T12:09:31.583 INFO:journalctl@ceph.mgr.y.smithi076.stdout:Jul 26 12:09:31 smithi076 bash[36524]: 4d9eeb41d3d6ba7ca27280deca48a43ef9fbe174182f96d5dbfd5750d9b9e033 2024-07-26T12:09:31.583 INFO:journalctl@ceph.mgr.y.smithi076.stdout:Jul 26 12:09:31 smithi076 systemd[1]: Started Ceph mgr.y for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:09:31.583 INFO:journalctl@ceph.mgr.y.smithi076.stdout:Jul 26 12:09:31 smithi076 ceph-mgr[36542]: -- 172.21.15.76:0/4290295670 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef44db90e0 con 0x55ef49b58000 2024-07-26T12:09:32.693 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/694498412' entity='client.admin' 2024-07-26T12:09:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/694498412' entity='client.admin' 2024-07-26T12:09:32.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/694498412' entity='client.admin' 2024-07-26T12:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:09:33.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:33.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:33.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:33.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:33.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: Standby manager daemon z started 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:34.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: Standby manager daemon z started 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: Standby manager daemon z started 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.146:0/2029042070' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:09:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:09:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: Reconfiguring mgr.x (unknown last config time)... 2024-07-26T12:09:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: Reconfiguring daemon mgr.x on smithi040 2024-07-26T12:09:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: mgrmap e14: x(active, since 97s), standbys: z 2024-07-26T12:09:35.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-26T12:09:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: Reconfiguring mgr.x (unknown last config time)... 2024-07-26T12:09:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: Reconfiguring daemon mgr.x on smithi040 2024-07-26T12:09:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: mgrmap e14: x(active, since 97s), standbys: z 2024-07-26T12:09:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: Reconfiguring mgr.x (unknown last config time)... 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: Reconfiguring daemon mgr.x on smithi040 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: mgrmap e14: x(active, since 97s), standbys: z 2024-07-26T12:09:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-07-26T12:09:36.602 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:36.612 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:36.614 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:36.860 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:36 smithi040 ceph-mon[32397]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:36 smithi146 ceph-mon[35807]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:36 smithi076 ceph-mon[35401]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:37.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:37 smithi040 ceph-mon[32397]: Standby manager daemon y started 2024-07-26T12:09:37.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:37 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-26T12:09:37.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:37 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T12:09:37.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:37 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-26T12:09:37.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:37 smithi040 ceph-mon[32397]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T12:09:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:37 smithi146 ceph-mon[35807]: Standby manager daemon y started 2024-07-26T12:09:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:37 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-26T12:09:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:37 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T12:09:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:37 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-26T12:09:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:37 smithi146 ceph-mon[35807]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T12:09:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:37 smithi076 ceph-mon[35401]: Standby manager daemon y started 2024-07-26T12:09:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:37 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-07-26T12:09:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:37 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-07-26T12:09:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:37 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-07-26T12:09:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:37 smithi076 ceph-mon[35401]: from='mgr.? 172.21.15.76:0/1409227447' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-07-26T12:09:38.519 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:38.520 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:38.524 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:38.532 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:38.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:38 smithi040 ceph-mon[32397]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:38 smithi040 ceph-mon[32397]: mgrmap e15: x(active, since 100s), standbys: z, y 2024-07-26T12:09:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-26T12:09:39.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 -- 172.21.15.40:0/2745033220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0104060 msgr2=0x7f0ee0104470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:39.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2745033220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0104060 0x7f0ee0104470 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009900 tx=0x7f0ecc02a480 comp rx=0 tx=0).stop 2024-07-26T12:09:39.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 -- 172.21.15.40:0/2745033220 shutdown_connections 2024-07-26T12:09:39.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2745033220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ee0104a00 0x7f0ee010b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2745033220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0104060 0x7f0ee0104470 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2745033220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0102fd0 0x7f0ee0103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 -- 172.21.15.40:0/2745033220 >> 172.21.15.40:0/2745033220 conn(0x7f0ee00fe940 msgr2=0x7f0ee0100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 -- 172.21.15.40:0/2745033220 shutdown_connections 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.935+0000 7f0ee7000640 1 -- 172.21.15.40:0/2745033220 wait complete. 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.936+0000 7f0ee7000640 1 Processor -- start 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 -- start start 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 0x7f0ee019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:39.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ee0104060 0x7f0ee019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0104a00 0x7f0ee019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee010e7d0 con 0x7f0ee0102fd0 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee010e650 con 0x7f0ee0104a00 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee7000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee010e950 con 0x7f0ee0104060 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 0x7f0ee019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 0x7f0ee019b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42278/0 (socket says 172.21.15.40:42278) 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.937+0000 7f0ee5c00640 1 -- 172.21.15.40:0/2315237146 learned_addr learned my addr 172.21.15.40:0/2315237146 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:39.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5200640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ee0104060 0x7f0ee019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee6600640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0104a00 0x7f0ee019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5c00640 1 -- 172.21.15.40:0/2315237146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ee0104060 msgr2=0x7f0ee019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5c00640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ee0104060 0x7f0ee019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5c00640 1 -- 172.21.15.40:0/2315237146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0104a00 msgr2=0x7f0ee019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5c00640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0104a00 0x7f0ee019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5c00640 1 -- 172.21.15.40:0/2315237146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee019d110 con 0x7f0ee0102fd0 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee6600640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0104a00 0x7f0ee019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:09:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.938+0000 7f0ee5c00640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 0x7f0ee019b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400d950 tx=0x7f0ed400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.939+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4017070 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.939+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f0ed4009c30 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.939+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400f3c0 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.939+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee019d400 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.939+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee01a3b00 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.940+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee0103440 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.943+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f0ed4010460 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.944+0000 7f0ede000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0ec80b3bc0 0x7f0ec80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.944+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0ed40e1be0 con 0x7f0ee0102fd0 2024-07-26T12:09:39.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.944+0000 7f0ee5200640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0ec80b3bc0 0x7f0ec80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:39.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.945+0000 7f0ee5200640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0ec80b3bc0 0x7f0ec80b60d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc005f70 tx=0x7f0ecc005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:39.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:38.946+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0ed40aaee0 con 0x7f0ee0102fd0 2024-07-26T12:09:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:38 smithi146 ceph-mon[35807]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:38 smithi146 ceph-mon[35807]: mgrmap e15: x(active, since 100s), standbys: z, y 2024-07-26T12:09:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-26T12:09:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:38 smithi076 ceph-mon[35401]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:38 smithi076 ceph-mon[35401]: mgrmap e15: x(active, since 100s), standbys: z, y 2024-07-26T12:09:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-07-26T12:09:39.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.174+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0ee01a3df0 con 0x7f0ee0102fd0 2024-07-26T12:09:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.187+0000 7f0ede000640 1 -- 172.21.15.40:0/2315237146 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v12)=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f0ed40b31b0 con 0x7f0ee0102fd0 2024-07-26T12:09:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0ec80b3bc0 msgr2=0x7f0ec80b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0ec80b3bc0 0x7f0ec80b60d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc005f70 tx=0x7f0ecc005d50 comp rx=0 tx=0).stop 2024-07-26T12:09:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 msgr2=0x7f0ee019b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 0x7f0ee019b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400d950 tx=0x7f0ed400de10 comp rx=0 tx=0).stop 2024-07-26T12:09:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 shutdown_connections 2024-07-26T12:09:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ee0104a00 0x7f0ee019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0ec80b3bc0 0x7f0ec80b60d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ee0104060 0x7f0ee019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 --2- 172.21.15.40:0/2315237146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ee0102fd0 0x7f0ee019b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.191+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 >> 172.21.15.40:0/2315237146 conn(0x7f0ee00fe940 msgr2=0x7f0ee0075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.192+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 shutdown_connections 2024-07-26T12:09:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.192+0000 7f0ee7000640 1 -- 172.21.15.40:0/2315237146 wait complete. 2024-07-26T12:09:40.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 -- 172.21.15.40:0/4081766168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 msgr2=0x7fe5c0078ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 --2- 172.21.15.40:0/4081766168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c0078ae0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009900 tx=0x7fe5b002a480 comp rx=0 tx=0).stop 2024-07-26T12:09:40.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 -- 172.21.15.40:0/4081766168 shutdown_connections 2024-07-26T12:09:40.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 --2- 172.21.15.40:0/4081766168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c0079070 0x7fe5c00799e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 --2- 172.21.15.40:0/4081766168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c0078ae0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 --2- 172.21.15.40:0/4081766168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5c0077640 0x7fe5c0077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 -- 172.21.15.40:0/4081766168 >> 172.21.15.40:0/4081766168 conn(0x7fe5c0100b30 msgr2=0x7fe5c0102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 -- 172.21.15.40:0/4081766168 shutdown_connections 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.204+0000 7fe5c7200640 1 -- 172.21.15.40:0/4081766168 wait complete. 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 Processor -- start 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 -- start start 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c0077640 0x7fe5c019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c01a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5c0079070 0x7fe5c01a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0114e30 con 0x7fe5c00786d0 2024-07-26T12:09:40.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0114cb0 con 0x7fe5c0079070 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0114fb0 con 0x7fe5c0077640 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.206+0000 7fe5c5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c01a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c01a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42318/0 (socket says 172.21.15.40:42318) 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 -- 172.21.15.40:0/873469590 learned_addr learned my addr 172.21.15.40:0/873469590 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5e00640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c0077640 0x7fe5c019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c6800640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5c0079070 0x7fe5c01a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 -- 172.21.15.40:0/873469590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c0077640 msgr2=0x7fe5c019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c0077640 0x7fe5c019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 -- 172.21.15.40:0/873469590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5c0079070 msgr2=0x7fe5c01a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5c0079070 0x7fe5c01a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 -- 172.21.15.40:0/873469590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c01a14b0 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.207+0000 7fe5c5400640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c01a00f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0004770 tx=0x7fe5b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.208+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b003f070 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.208+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7fe5b0003a20 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.208+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c01a1740 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.208+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0035030 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.208+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c01a7cd0 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.209+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c0078ae0 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.212+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fe5b0042070 con 0x7fe5c00786d0 2024-07-26T12:09:40.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.213+0000 7fe5b6a00640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5ac0b3b40 0x7fe5ac0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.213+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe5b0102c60 con 0x7fe5c00786d0 2024-07-26T12:09:40.424 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:40 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2315237146' entity='client.admin' 2024-07-26T12:09:40.424 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:40 smithi040 ceph-mon[32397]: from='client.? ' entity='client.admin' 2024-07-26T12:09:40.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.213+0000 7fe5c5e00640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5ac0b3b40 0x7fe5ac0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.214+0000 7fe5c5e00640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5ac0b3b40 0x7fe5ac0b6050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005c40 tx=0x7fe5b800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:40.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.215+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe5b00cbee0 con 0x7fe5c00786d0 2024-07-26T12:09:40.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.421+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe5c0112400 con 0x7fe5c00786d0 2024-07-26T12:09:40.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.430+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fe5b00cb7e0 con 0x7fe5c00786d0 2024-07-26T12:09:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.434+0000 7fe5b6a00640 1 -- 172.21.15.40:0/873469590 <== mon.0 v2:172.21.15.40:3300/0 8 ==== config(23 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fe5b00cb2f0 con 0x7fe5c00786d0 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.434+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5ac0b3b40 msgr2=0x7fe5ac0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.434+0000 7fe5c7200640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5ac0b3b40 0x7fe5ac0b6050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005c40 tx=0x7fe5b800a590 comp rx=0 tx=0).stop 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.434+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 msgr2=0x7fe5c01a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.434+0000 7fe5c7200640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c01a00f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0004770 tx=0x7fe5b0004040 comp rx=0 tx=0).stop 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 shutdown_connections 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5c0079070 0x7fe5c01a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c00786d0 0x7fe5c01a00f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5ac0b3b40 0x7fe5ac0b6050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 --2- 172.21.15.40:0/873469590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c0077640 0x7fe5c019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 >> 172.21.15.40:0/873469590 conn(0x7fe5c0100b30 msgr2=0x7fe5c010f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:40.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 shutdown_connections 2024-07-26T12:09:40.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:40.435+0000 7fe5c7200640 1 -- 172.21.15.40:0/873469590 wait complete. 2024-07-26T12:09:40.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:40 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2315237146' entity='client.admin' 2024-07-26T12:09:40.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:40 smithi146 ceph-mon[35807]: from='client.? ' entity='client.admin' 2024-07-26T12:09:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:40 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2315237146' entity='client.admin' 2024-07-26T12:09:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:40 smithi076 ceph-mon[35401]: from='client.? ' entity='client.admin' 2024-07-26T12:09:40.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 -- 172.21.15.40:0/3583485147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3350104030 msgr2=0x7f3350104440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 --2- 172.21.15.40:0/3583485147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3350104030 0x7f3350104440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f333c009900 tx=0x7f333c02a480 comp rx=0 tx=0).stop 2024-07-26T12:09:40.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 -- 172.21.15.40:0/3583485147 shutdown_connections 2024-07-26T12:09:40.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 --2- 172.21.15.40:0/3583485147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33501049d0 0x7f335010b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 --2- 172.21.15.40:0/3583485147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3350104030 0x7f3350104440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 --2- 172.21.15.40:0/3583485147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3350102fa0 0x7f3350103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 -- 172.21.15.40:0/3583485147 >> 172.21.15.40:0/3583485147 conn(0x7f33500fe8f0 msgr2=0x7f3350100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 -- 172.21.15.40:0/3583485147 shutdown_connections 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.121+0000 7f3356c00640 1 -- 172.21.15.40:0/3583485147 wait complete. 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.122+0000 7f3356c00640 1 Processor -- start 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.122+0000 7f3356c00640 1 -- start start 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 0x7f335019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3350104030 0x7f335019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33501049d0 0x7f335019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f335010e7f0 con 0x7f33501049d0 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f335010e670 con 0x7f3350104030 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f335010e970 con 0x7f3350102fa0 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3355800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 0x7f335019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3355800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 0x7f335019b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:60332/0 (socket says 172.21.15.40:60332) 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3355800640 1 -- 172.21.15.40:0/4274278121 learned_addr learned my addr 172.21.15.40:0/4274278121 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.123+0000 7f3356200640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33501049d0 0x7f335019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3354e00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3350104030 0x7f335019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3355800640 1 -- 172.21.15.40:0/4274278121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3350104030 msgr2=0x7f335019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3355800640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3350104030 0x7f335019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3355800640 1 -- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33501049d0 msgr2=0x7f335019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3355800640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33501049d0 0x7f335019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3355800640 1 -- 172.21.15.40:0/4274278121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335019d160 con 0x7f3350102fa0 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.124+0000 7f3356200640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33501049d0 0x7f335019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.125+0000 7f3355800640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 0x7f335019b730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f334400d950 tx=0x7f334400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.125+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344017070 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.125+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335019d450 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.125+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f3344009c30 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.125+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334400f3c0 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.125+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33501a3b50 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.126+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3350103410 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.130+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f3344010460 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.132+0000 7f334e000640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f33380b3b40 0x7f33380b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.132+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f33440e1b40 con 0x7f3350102fa0 2024-07-26T12:09:40.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.132+0000 7f3354e00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f33380b3b40 0x7f33380b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.133+0000 7f3354e00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f33380b3b40 0x7f33380b6050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f333c005d90 tx=0x7f333c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.143+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f33440aa770 con 0x7f3350102fa0 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.366+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f33501a4140 con 0x7f3350102fa0 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.381+0000 7f334e000640 1 -- 172.21.15.40:0/4274278121 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v13)=0 v13) ==== 127+0+0 (secure 0 0 0) 0x7f33440aecc0 con 0x7f3350102fa0 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.383+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f33380b3b40 msgr2=0x7f33380b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.383+0000 7f3356c00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f33380b3b40 0x7f33380b6050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f333c005d90 tx=0x7f333c005a20 comp rx=0 tx=0).stop 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.383+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 msgr2=0x7f335019b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.383+0000 7f3356c00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 0x7f335019b730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f334400d950 tx=0x7f334400de10 comp rx=0 tx=0).stop 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 shutdown_connections 2024-07-26T12:09:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33501049d0 0x7f335019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3350104030 0x7f335019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f33380b3b40 0x7f33380b6050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 --2- 172.21.15.40:0/4274278121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3350102fa0 0x7f335019b730 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 >> 172.21.15.40:0/4274278121 conn(0x7f33500fe8f0 msgr2=0x7f3350075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 shutdown_connections 2024-07-26T12:09:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:39.384+0000 7f3356c00640 1 -- 172.21.15.40:0/4274278121 wait complete. 2024-07-26T12:09:41.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:41 smithi040 ceph-mon[32397]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:41.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:41 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/873469590' entity='client.admin' 2024-07-26T12:09:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:41 smithi146 ceph-mon[35807]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:41 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/873469590' entity='client.admin' 2024-07-26T12:09:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:41 smithi076 ceph-mon[35401]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:41 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/873469590' entity='client.admin' 2024-07-26T12:09:43.542 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:43 smithi040 ceph-mon[32397]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:43 smithi146 ceph-mon[35807]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:43 smithi076 ceph-mon[35401]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:45 smithi076 ceph-mon[35401]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:45 smithi040 ceph-mon[32397]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:45 smithi146 ceph-mon[35807]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:47 smithi040 ceph-mon[32397]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:47 smithi146 ceph-mon[35807]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:47 smithi076 ceph-mon[35401]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:48.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.556+0000 7fa46cc00640 1 -- 172.21.15.40:0/1720639826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4681038c0 msgr2=0x7fa46810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.556+0000 7fa46cc00640 1 --2- 172.21.15.40:0/1720639826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4681038c0 0x7fa46810a260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa460009ca0 tx=0x7fa46002a950 comp rx=0 tx=0).stop 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.556+0000 7fa46cc00640 1 -- 172.21.15.40:0/1720639826 shutdown_connections 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.557+0000 7fa46cc00640 1 --2- 172.21.15.40:0/1720639826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4681038c0 0x7fa46810a260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.557+0000 7fa46cc00640 1 --2- 172.21.15.40:0/1720639826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468102f20 0x7fa468103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.557+0000 7fa46cc00640 1 --2- 172.21.15.40:0/1720639826 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa468101e90 0x7fa468102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.557+0000 7fa46cc00640 1 -- 172.21.15.40:0/1720639826 >> 172.21.15.40:0/1720639826 conn(0x7fa4680fd800 msgr2=0x7fa4680ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.557+0000 7fa46cc00640 1 -- 172.21.15.40:0/1720639826 shutdown_connections 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.557+0000 7fa46cc00640 1 -- 172.21.15.40:0/1720639826 wait complete. 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.558+0000 7fa46cc00640 1 Processor -- start 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.558+0000 7fa46cc00640 1 -- start start 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa46cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 0x7fa46819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:48.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa46cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468102f20 0x7fa46819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa46cc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4681038c0 0x7fa46819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa46cc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa46810e920 con 0x7fa468101e90 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa46cc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa46810e7a0 con 0x7fa4681038c0 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa46cc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa46810eaa0 con 0x7fa468102f20 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa467400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 0x7fa46819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa467400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 0x7fa46819b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34790/0 (socket says 172.21.15.40:34790) 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa467400640 1 -- 172.21.15.40:0/3425505437 learned_addr learned my addr 172.21.15.40:0/3425505437 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa467e00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4681038c0 0x7fa46819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.559+0000 7fa45fe00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468102f20 0x7fa46819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467400640 1 -- 172.21.15.40:0/3425505437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468102f20 msgr2=0x7fa46819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467400640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468102f20 0x7fa46819bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467400640 1 -- 172.21.15.40:0/3425505437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4681038c0 msgr2=0x7fa46819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467400640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4681038c0 0x7fa46819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467400640 1 -- 172.21.15.40:0/3425505437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46819d190 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467e00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4681038c0 0x7fa46819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa467400640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 0x7fa46819b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa45800d950 tx=0x7fa45800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458017070 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(23 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fa458009c30 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46819d480 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45800f3c0 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.560+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4681a3b80 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.562+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa468102300 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.566+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fa458010460 con 0x7fa468101e90 2024-07-26T12:09:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.568+0000 7fa464c00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa44c0b3c40 0x7fa44c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.568+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4580e1bf0 con 0x7fa468101e90 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.568+0000 7fa45fe00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa44c0b3c40 0x7fa44c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.569+0000 7fa45fe00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa44c0b3c40 0x7fa44c0b6150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa450005fd0 tx=0x7fa450005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.570+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa4580aaef0 con 0x7fa468101e90 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.789+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fa4681a3d50 con 0x7fa468101e90 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.797+0000 7fa464c00640 1 -- 172.21.15.40:0/3425505437 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7fa4580b31c0 con 0x7fa468101e90 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa44c0b3c40 msgr2=0x7fa44c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa44c0b3c40 0x7fa44c0b6150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa450005fd0 tx=0x7fa450005850 comp rx=0 tx=0).stop 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 msgr2=0x7fa46819b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 0x7fa46819b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa45800d950 tx=0x7fa45800de10 comp rx=0 tx=0).stop 2024-07-26T12:09:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 shutdown_connections 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4681038c0 0x7fa46819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa44c0b3c40 0x7fa44c0b6150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468102f20 0x7fa46819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 --2- 172.21.15.40:0/3425505437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa468101e90 0x7fa46819b760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 >> 172.21.15.40:0/3425505437 conn(0x7fa4680fd800 msgr2=0x7fa46810ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.800+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 shutdown_connections 2024-07-26T12:09:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:48.801+0000 7fa46cc00640 1 -- 172.21.15.40:0/3425505437 wait complete. 2024-07-26T12:09:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:49 smithi040 ceph-mon[32397]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:49 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3425505437' entity='client.admin' 2024-07-26T12:09:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:49 smithi146 ceph-mon[35807]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:49 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3425505437' entity='client.admin' 2024-07-26T12:09:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:49 smithi076 ceph-mon[35401]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:49 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3425505437' entity='client.admin' 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.704+0000 7f724be00640 1 -- 172.21.15.40:0/2705890554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c104030 msgr2=0x7f724c104440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.704+0000 7f724be00640 1 --2- 172.21.15.40:0/2705890554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c104030 0x7f724c104440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7238009900 tx=0x7f723802a480 comp rx=0 tx=0).stop 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 -- 172.21.15.40:0/2705890554 shutdown_connections 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 --2- 172.21.15.40:0/2705890554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c1049d0 0x7f724c10b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 --2- 172.21.15.40:0/2705890554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c104030 0x7f724c104440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 --2- 172.21.15.40:0/2705890554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f724c102fa0 0x7f724c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 -- 172.21.15.40:0/2705890554 >> 172.21.15.40:0/2705890554 conn(0x7f724c0fe8f0 msgr2=0x7f724c100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 -- 172.21.15.40:0/2705890554 shutdown_connections 2024-07-26T12:09:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.705+0000 7f724be00640 1 -- 172.21.15.40:0/2705890554 wait complete. 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.706+0000 7f724be00640 1 Processor -- start 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.706+0000 7f724be00640 1 -- start start 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.706+0000 7f724be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f724c102fa0 0x7f724c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.706+0000 7f724be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c104030 0x7f724c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 0x7f724c19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f724c10e8e0 con 0x7f724c1049d0 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f724c10e760 con 0x7f724c104030 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f724c10ea60 con 0x7f724c102fa0 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 0x7f724c19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 0x7f724c19ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34816/0 (socket says 172.21.15.40:34816) 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724b400640 1 -- 172.21.15.40:0/743104561 learned_addr learned my addr 172.21.15.40:0/743104561 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724aa00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f724c102fa0 0x7f724c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.707+0000 7f724a000640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c104030 0x7f724c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724b400640 1 -- 172.21.15.40:0/743104561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f724c102fa0 msgr2=0x7f724c19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724b400640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f724c102fa0 0x7f724c19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724b400640 1 -- 172.21.15.40:0/743104561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c104030 msgr2=0x7f724c19bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724b400640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c104030 0x7f724c19bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724b400640 1 -- 172.21.15.40:0/743104561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c19d260 con 0x7f724c1049d0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724a000640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c104030 0x7f724c19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724b400640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 0x7f724c19ca40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f724400cad0 tx=0x7f724400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724400ad60 con 0x7f724c1049d0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(23 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f7244005020 con 0x7f724c1049d0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c19d550 con 0x7f724c1049d0 2024-07-26T12:09:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.708+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724400f6b0 con 0x7f724c1049d0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.709+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c1a3c50 con 0x7f724c1049d0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.710+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c103410 con 0x7f724c1049d0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.712+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f7244004a40 con 0x7f724c1049d0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.714+0000 7f7243400640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f72300b3c40 0x7f72300b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.714+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f72440e2340 con 0x7f724c1049d0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.714+0000 7f724aa00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f72300b3c40 0x7f72300b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.715+0000 7f724aa00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f72300b3c40 0x7f72300b6150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f723c009990 tx=0x7f723c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.715+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7244014030 con 0x7f724c1049d0 2024-07-26T12:09:50.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.924+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f724c1a3e80 con 0x7f724c1049d0 2024-07-26T12:09:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.934+0000 7f7243400640 1 -- 172.21.15.40:0/743104561 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7f72440ab640 con 0x7f724c1049d0 2024-07-26T12:09:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f72300b3c40 msgr2=0x7f72300b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f72300b3c40 0x7f72300b6150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f723c009990 tx=0x7f723c009110 comp rx=0 tx=0).stop 2024-07-26T12:09:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 msgr2=0x7f724c19ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 0x7f724c19ca40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f724400cad0 tx=0x7f724400ced0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 shutdown_connections 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f724c1049d0 0x7f724c19ca40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c104030 0x7f724c19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f72300b3c40 0x7f72300b6150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 --2- 172.21.15.40:0/743104561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f724c102fa0 0x7f724c19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.937+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 >> 172.21.15.40:0/743104561 conn(0x7f724c0fe8f0 msgr2=0x7f724c075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.938+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 shutdown_connections 2024-07-26T12:09:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:50.938+0000 7f724be00640 1 -- 172.21.15.40:0/743104561 wait complete. 2024-07-26T12:09:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:09:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:51 smithi040 ceph-mon[32397]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/743104561' entity='client.admin' 2024-07-26T12:09:51.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 -- 172.21.15.40:0/2892617792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440075720 msgr2=0x7f1440075b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:51.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 --2- 172.21.15.40:0/2892617792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440075720 0x7f1440075b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1428009900 tx=0x7f142802a410 comp rx=0 tx=0).stop 2024-07-26T12:09:51.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 -- 172.21.15.40:0/2892617792 shutdown_connections 2024-07-26T12:09:51.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 --2- 172.21.15.40:0/2892617792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f144010f920 0x7f1440111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 --2- 172.21.15.40:0/2892617792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440075720 0x7f1440075b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 --2- 172.21.15.40:0/2892617792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440076b10 0x7f14400751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 -- 172.21.15.40:0/2892617792 >> 172.21.15.40:0/2892617792 conn(0x7f14400feae0 msgr2=0x7f1440100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:51.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 -- 172.21.15.40:0/2892617792 shutdown_connections 2024-07-26T12:09:51.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.653+0000 7f1446e00640 1 -- 172.21.15.40:0/2892617792 wait complete. 2024-07-26T12:09:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.654+0000 7f1446e00640 1 Processor -- start 2024-07-26T12:09:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.654+0000 7f1446e00640 1 -- start start 2024-07-26T12:09:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1446e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440075720 0x7f144019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1446e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 0x7f14401a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1446e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f144010f920 0x7f14401a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1446e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f14401151f0 con 0x7f1440076b10 2024-07-26T12:09:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1446e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1440115070 con 0x7f144010f920 2024-07-26T12:09:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1446e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1440115370 con 0x7f1440075720 2024-07-26T12:09:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1437400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 0x7f14401a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1437400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 0x7f14401a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34832/0 (socket says 172.21.15.40:34832) 2024-07-26T12:09:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1437400640 1 -- 172.21.15.40:0/1159473401 learned_addr learned my addr 172.21.15.40:0/1159473401 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f1444e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f144010f920 0x7f14401a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.655+0000 7f143fe00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440075720 0x7f144019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f1437400640 1 -- 172.21.15.40:0/1159473401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440075720 msgr2=0x7f144019fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f1437400640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440075720 0x7f144019fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f1437400640 1 -- 172.21.15.40:0/1159473401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f144010f920 msgr2=0x7f14401a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f1437400640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f144010f920 0x7f14401a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f1437400640 1 -- 172.21.15.40:0/1159473401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14401a1870 con 0x7f1440076b10 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f143fe00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440075720 0x7f144019fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.656+0000 7f1437400640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 0x7f14401a04b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f142802a930 tx=0x7f14280052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.657+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142803f070 con 0x7f1440076b10 2024-07-26T12:09:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.657+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1428003c60 con 0x7f1440076b10 2024-07-26T12:09:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.657+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14401a1b00 con 0x7f1440076b10 2024-07-26T12:09:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.657+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428035030 con 0x7f1440076b10 2024-07-26T12:09:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.657+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14401a8090 con 0x7f1440076b10 2024-07-26T12:09:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.658+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14401059b0 con 0x7f1440076b10 2024-07-26T12:09:51.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.660+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f1428042070 con 0x7f1440076b10 2024-07-26T12:09:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.662+0000 7f143d600640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f14240b3b40 0x7f14240b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.662+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1428102970 con 0x7f1440076b10 2024-07-26T12:09:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.663+0000 7f143fe00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f14240b3b40 0x7f14240b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.663+0000 7f143fe00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f14240b3b40 0x7f14240b6050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1430005fd0 tx=0x7f1430009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.666+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f14280cbbf0 con 0x7f1440076b10 2024-07-26T12:09:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:51 smithi146 ceph-mon[35807]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/743104561' entity='client.admin' 2024-07-26T12:09:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:51 smithi076 ceph-mon[35401]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/743104561' entity='client.admin' 2024-07-26T12:09:51.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.880+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f144002e0c0 con 0x7f1440076b10 2024-07-26T12:09:51.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.886+0000 7f143d600640 1 -- 172.21.15.40:0/1159473401 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f14280cb4f0 con 0x7f1440076b10 2024-07-26T12:09:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f14240b3b40 msgr2=0x7f14240b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f14240b3b40 0x7f14240b6050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1430005fd0 tx=0x7f1430009520 comp rx=0 tx=0).stop 2024-07-26T12:09:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 msgr2=0x7f14401a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 0x7f14401a04b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f142802a930 tx=0x7f14280052b0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 shutdown_connections 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f144010f920 0x7f14401a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440076b10 0x7f14401a04b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f14240b3b40 0x7f14240b6050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 --2- 172.21.15.40:0/1159473401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1440075720 0x7f144019fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.889+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 >> 172.21.15.40:0/1159473401 conn(0x7f14400feae0 msgr2=0x7f1440102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.890+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 shutdown_connections 2024-07-26T12:09:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.890+0000 7f1446e00640 1 -- 172.21.15.40:0/1159473401 wait complete. 2024-07-26T12:09:53.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 -- 172.21.15.40:0/349980409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 msgr2=0x7f83501024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:53.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 --2- 172.21.15.40:0/349980409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f83501024e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f834402a480 comp rx=0 tx=0).stop 2024-07-26T12:09:53.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 -- 172.21.15.40:0/349980409 shutdown_connections 2024-07-26T12:09:53.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 --2- 172.21.15.40:0/349980409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8350103aa0 0x7f835010a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 --2- 172.21.15.40:0/349980409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8350103100 0x7f8350103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 --2- 172.21.15.40:0/349980409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f83501024e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 -- 172.21.15.40:0/349980409 >> 172.21.15.40:0/349980409 conn(0x7f83500fd9e0 msgr2=0x7f83500ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.757+0000 7f8357800640 1 -- 172.21.15.40:0/349980409 shutdown_connections 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.758+0000 7f8357800640 1 -- 172.21.15.40:0/349980409 wait complete. 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.759+0000 7f8357800640 1 Processor -- start 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.759+0000 7f8357800640 1 -- start start 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8357800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f835010c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8357800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8350103100 0x7f835010b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8357800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8350103aa0 0x7f835010b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8357800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f835010ec20 con 0x7f8350102070 2024-07-26T12:09:53.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8357800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f835010eaa0 con 0x7f8350103100 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8357800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f835010eda0 con 0x7f8350103aa0 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8354e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f835010c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8354e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f835010c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34850/0 (socket says 172.21.15.40:34850) 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8354e00640 1 -- 172.21.15.40:0/354864270 learned_addr learned my addr 172.21.15.40:0/354864270 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f834fe00640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8350103100 0x7f835010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.760+0000 7f8355800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8350103aa0 0x7f835010b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8354e00640 1 -- 172.21.15.40:0/354864270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8350103aa0 msgr2=0x7f835010b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8354e00640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8350103aa0 0x7f835010b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8354e00640 1 -- 172.21.15.40:0/354864270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8350103100 msgr2=0x7f835010b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8354e00640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8350103100 0x7f835010b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8354e00640 1 -- 172.21.15.40:0/354864270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835010bc60 con 0x7f8350102070 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8354e00640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f835010c740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8344004770 tx=0x7f8344003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:53.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834403f070 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8344031cf0 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.761+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83501a3980 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.762+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035030 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.762+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83501a3d20 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.763+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8350109250 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.765+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f8344042070 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.767+0000 7f834d600640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83380b3c40 0x7f83380b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.767+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f83441029e0 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.767+0000 7f834fe00640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83380b3c40 0x7f83380b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.768+0000 7f834fe00640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83380b3c40 0x7f83380b6150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f833c005fd0 tx=0x7f833c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:51.771+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f83440cbc60 con 0x7f8350102070 2024-07-26T12:09:53.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.011+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f835002e0c0 con 0x7f8350102070 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.018+0000 7f834d600640 1 -- 172.21.15.40:0/354864270 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f83440cb560 con 0x7f8350102070 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83380b3c40 msgr2=0x7f83380b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83380b3c40 0x7f83380b6150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f833c005fd0 tx=0x7f833c005850 comp rx=0 tx=0).stop 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 msgr2=0x7f835010c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f835010c740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8344004770 tx=0x7f8344003d30 comp rx=0 tx=0).stop 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 shutdown_connections 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83380b3c40 0x7f83380b6150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8350103aa0 0x7f835010b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8350103100 0x7f835010b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 --2- 172.21.15.40:0/354864270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8350102070 0x7f835010c740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 >> 172.21.15.40:0/354864270 conn(0x7f83500fd9e0 msgr2=0x7f8350106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 shutdown_connections 2024-07-26T12:09:53.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:52.021+0000 7f8357800640 1 -- 172.21.15.40:0/354864270 wait complete. 2024-07-26T12:09:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:52 smithi040 ceph-mon[32397]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1159473401' entity='client.admin' 2024-07-26T12:09:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/354864270' entity='client.admin' 2024-07-26T12:09:53.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:52 smithi146 ceph-mon[35807]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:53.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1159473401' entity='client.admin' 2024-07-26T12:09:53.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/354864270' entity='client.admin' 2024-07-26T12:09:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:52 smithi076 ceph-mon[35401]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1159473401' entity='client.admin' 2024-07-26T12:09:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/354864270' entity='client.admin' 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.806+0000 7f732ee00640 1 -- 172.21.15.40:0/3030833974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7328106140 msgr2=0x7f73281085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.806+0000 7f732ee00640 1 --2- 172.21.15.40:0/3030833974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7328106140 0x7f73281085a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7314009ca0 tx=0x7f731402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 -- 172.21.15.40:0/3030833974 shutdown_connections 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 --2- 172.21.15.40:0/3030833974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7328108ce0 0x7f732810b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 --2- 172.21.15.40:0/3030833974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7328106140 0x7f73281085a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 --2- 172.21.15.40:0/3030833974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732806beb0 0x7f7328105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 -- 172.21.15.40:0/3030833974 >> 172.21.15.40:0/3030833974 conn(0x7f73280fd840 msgr2=0x7f73280ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 -- 172.21.15.40:0/3030833974 shutdown_connections 2024-07-26T12:09:54.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.807+0000 7f732ee00640 1 -- 172.21.15.40:0/3030833974 wait complete. 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.808+0000 7f732ee00640 1 Processor -- start 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.808+0000 7f732ee00640 1 -- start start 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.808+0000 7f732ee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 0x7f7328103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.808+0000 7f732ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7328106140 0x7f7328101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732ee00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7328108ce0 0x7f7328102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732ee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f732810e9e0 con 0x7f732806beb0 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732ee00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f732810e860 con 0x7f7328108ce0 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f732810eb60 con 0x7f7328106140 2024-07-26T12:09:54.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 0x7f7328103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:54.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 0x7f7328103230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34240/0 (socket says 172.21.15.40:34240) 2024-07-26T12:09:54.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732da00640 1 -- 172.21.15.40:0/2908203548 learned_addr learned my addr 172.21.15.40:0/2908203548 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:54.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732d000640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7328106140 0x7f7328101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:54.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.809+0000 7f732e400640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7328108ce0 0x7f7328102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732da00640 1 -- 172.21.15.40:0/2908203548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7328106140 msgr2=0x7f7328101b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732da00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7328106140 0x7f7328101b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732da00640 1 -- 172.21.15.40:0/2908203548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7328108ce0 msgr2=0x7f7328102040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732da00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7328108ce0 0x7f7328102040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732da00640 1 -- 172.21.15.40:0/2908203548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7328102740 con 0x7f732806beb0 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732da00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 0x7f7328103230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f731800d770 tx=0x7f731800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318017070 con 0x7f732806beb0 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f7318005490 con 0x7f732806beb0 2024-07-26T12:09:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73281a3770 con 0x7f732806beb0 2024-07-26T12:09:54.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.810+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318004bc0 con 0x7f732806beb0 2024-07-26T12:09:54.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.811+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281a3bd0 con 0x7f732806beb0 2024-07-26T12:09:54.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.812+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7328106590 con 0x7f732806beb0 2024-07-26T12:09:54.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.815+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f7318004d60 con 0x7f732806beb0 2024-07-26T12:09:54.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.816+0000 7f7326000640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f730c0b3bc0 0x7f730c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:54.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.816+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f73180e1d60 con 0x7f732806beb0 2024-07-26T12:09:54.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.817+0000 7f732d000640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f730c0b3bc0 0x7f730c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:54.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.818+0000 7f732d000640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f730c0b3bc0 0x7f730c0b60d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f73140094e0 tx=0x7f7314031850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:54.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:54.821+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f73180aaa10 con 0x7f732806beb0 2024-07-26T12:09:55.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.051+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f73280ff360 con 0x7f732806beb0 2024-07-26T12:09:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.058+0000 7f7326000640 1 -- 172.21.15.40:0/2908203548 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f73280ff360 con 0x7f732806beb0 2024-07-26T12:09:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f730c0b3bc0 msgr2=0x7f730c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f730c0b3bc0 0x7f730c0b60d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f73140094e0 tx=0x7f7314031850 comp rx=0 tx=0).stop 2024-07-26T12:09:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 msgr2=0x7f7328103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 0x7f7328103230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f731800d770 tx=0x7f731800dc30 comp rx=0 tx=0).stop 2024-07-26T12:09:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 shutdown_connections 2024-07-26T12:09:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7328108ce0 0x7f7328102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f730c0b3bc0 0x7f730c0b60d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7328106140 0x7f7328101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 --2- 172.21.15.40:0/2908203548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732806beb0 0x7f7328103230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 >> 172.21.15.40:0/2908203548 conn(0x7f73280fd840 msgr2=0x7f73281047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.061+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 shutdown_connections 2024-07-26T12:09:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:55.062+0000 7f732ee00640 1 -- 172.21.15.40:0/2908203548 wait complete. 2024-07-26T12:09:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:54 smithi076 ceph-mon[35401]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:55.164 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:54 smithi040 ceph-mon[32397]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:54 smithi146 ceph-mon[35807]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:56 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2908203548' entity='client.admin' 2024-07-26T12:09:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:56 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2908203548' entity='client.admin' 2024-07-26T12:09:56.394 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:56 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2908203548' entity='client.admin' 2024-07-26T12:09:57.325 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:57 smithi040 ceph-mon[32397]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:57 smithi076 ceph-mon[35401]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:57 smithi146 ceph-mon[35807]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.858+0000 7f66f1000640 1 -- 172.21.15.40:0/1190566684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106270 msgr2=0x7f66ec106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.858+0000 7f66f1000640 1 --2- 172.21.15.40:0/1190566684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106270 0x7f66ec106680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009900 tx=0x7f66d802a480 comp rx=0 tx=0).stop 2024-07-26T12:09:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 -- 172.21.15.40:0/1190566684 shutdown_connections 2024-07-26T12:09:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 --2- 172.21.15.40:0/1190566684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66ec106c10 0x7f66ec10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 --2- 172.21.15.40:0/1190566684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106270 0x7f66ec106680 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 --2- 172.21.15.40:0/1190566684 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66ec1051e0 0x7f66ec105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 -- 172.21.15.40:0/1190566684 >> 172.21.15.40:0/1190566684 conn(0x7f66ec100b50 msgr2=0x7f66ec103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 -- 172.21.15.40:0/1190566684 shutdown_connections 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.859+0000 7f66f1000640 1 -- 172.21.15.40:0/1190566684 wait complete. 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.860+0000 7f66f1000640 1 Processor -- start 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.860+0000 7f66f1000640 1 -- start start 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.860+0000 7f66f1000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66ec1051e0 0x7f66ec19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.860+0000 7f66f1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66ec106270 0x7f66ec19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66f1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 0x7f66ec19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66f1000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec110c20 con 0x7f66ec106c10 2024-07-26T12:09:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66f1000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec110aa0 con 0x7f66ec1051e0 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66f1000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec110da0 con 0x7f66ec106270 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 0x7f66ec19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 0x7f66ec19caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34254/0 (socket says 172.21.15.40:34254) 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66ebe00640 1 -- 172.21.15.40:0/2845115998 learned_addr learned my addr 172.21.15.40:0/2845115998 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66eaa00640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66ec106270 0x7f66ec19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.861+0000 7f66eb400640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66ec1051e0 0x7f66ec19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66ebe00640 1 -- 172.21.15.40:0/2845115998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66ec106270 msgr2=0x7f66ec19bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66ebe00640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66ec106270 0x7f66ec19bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66ebe00640 1 -- 172.21.15.40:0/2845115998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66ec1051e0 msgr2=0x7f66ec19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66ebe00640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66ec1051e0 0x7f66ec19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66ebe00640 1 -- 172.21.15.40:0/2845115998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec19d2c0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66ebe00640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 0x7f66ec19caa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66e400eaa0 tx=0x7f66e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e400cdb0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f66e4005020 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e40116d0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.862+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec19d5b0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.863+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec1a3cb0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.864+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ec10c3c0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.867+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f66e4004a40 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.868+0000 7f66e3e00640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66d00b3b40 0x7f66d00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.868+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f66e40e23e0 con 0x7f66ec106c10 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.869+0000 7f66eb400640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66d00b3b40 0x7f66d00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.869+0000 7f66eb400640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66d00b3b40 0x7f66d00b6050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bbe0 tx=0x7f66dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:56.870+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f66e4016030 con 0x7f66ec106c10 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.084+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f66ec02e0c0 con 0x7f66ec106c10 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.090+0000 7f66e3e00640 1 -- 172.21.15.40:0/2845115998 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v20)=0 v20) ==== 125+0+0 (secure 0 0 0) 0x7f66e40ab0b0 con 0x7f66ec106c10 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.093+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66d00b3b40 msgr2=0x7f66d00b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.093+0000 7f66f1000640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66d00b3b40 0x7f66d00b6050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bbe0 tx=0x7f66dc00b390 comp rx=0 tx=0).stop 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.093+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 msgr2=0x7f66ec19caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.093+0000 7f66f1000640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 0x7f66ec19caa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66e400eaa0 tx=0x7f66e400ef60 comp rx=0 tx=0).stop 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 shutdown_connections 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec106c10 0x7f66ec19caa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66d00b3b40 0x7f66d00b6050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66ec106270 0x7f66ec19bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 --2- 172.21.15.40:0/2845115998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66ec1051e0 0x7f66ec19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 >> 172.21.15.40:0/2845115998 conn(0x7f66ec100b50 msgr2=0x7f66ec109590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 shutdown_connections 2024-07-26T12:09:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.094+0000 7f66f1000640 1 -- 172.21.15.40:0/2845115998 wait complete. 2024-07-26T12:09:58.132 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:58 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2845115998' entity='client.admin' 2024-07-26T12:09:58.133 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:58 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2686512088' entity='client.admin' 2024-07-26T12:09:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 -- 172.21.15.40:0/1423907294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104076b10 msgr2=0x7f41040751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 --2- 172.21.15.40:0/1423907294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104076b10 0x7f41040751e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009ca0 tx=0x7f40f402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 -- 172.21.15.40:0/1423907294 shutdown_connections 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 --2- 172.21.15.40:0/1423907294 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f410410af40 0x7f410410d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 --2- 172.21.15.40:0/1423907294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4104075720 0x7f4104075b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 --2- 172.21.15.40:0/1423907294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4104076b10 0x7f41040751e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 -- 172.21.15.40:0/1423907294 >> 172.21.15.40:0/1423907294 conn(0x7f41040fe8f0 msgr2=0x7f4104100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 -- 172.21.15.40:0/1423907294 shutdown_connections 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.871+0000 7f4109c00640 1 -- 172.21.15.40:0/1423907294 wait complete. 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.872+0000 7f4109c00640 1 Processor -- start 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.872+0000 7f4109c00640 1 -- start start 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4104075720 0x7f410419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4104076b10 0x7f410419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 0x7f410419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4104110bd0 con 0x7f410410af40 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4104110a50 con 0x7f4104075720 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4104110d50 con 0x7f4104076b10 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 0x7f410419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 0x7f410419caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34286/0 (socket says 172.21.15.40:34286) 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4109200640 1 -- 172.21.15.40:0/2464274549 learned_addr learned my addr 172.21.15.40:0/2464274549 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f4103e00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4104075720 0x7f410419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.873+0000 7f40fb400640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4104076b10 0x7f410419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109200640 1 -- 172.21.15.40:0/2464274549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4104076b10 msgr2=0x7f410419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109200640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4104076b10 0x7f410419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109200640 1 -- 172.21.15.40:0/2464274549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4104075720 msgr2=0x7f410419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109200640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4104075720 0x7f410419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109200640 1 -- 172.21.15.40:0/2464274549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410419d2c0 con 0x7f410410af40 2024-07-26T12:09:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4103e00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4104075720 0x7f410419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109200640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 0x7f410419caa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00d750 tx=0x7f40fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc017070 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f40fc005490 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc004b20 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.874+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410419d5b0 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.875+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a3cb0 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.876+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4104075b30 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.879+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f40fc004cc0 con 0x7f410410af40 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.880+0000 7f4101600640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40e80b3b40 0x7f40e80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.880+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f40fc0e1670 con 0x7f410410af40 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.881+0000 7f4103e00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40e80b3b40 0x7f40e80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.881+0000 7f4103e00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40e80b3b40 0x7f40e80b6050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40f4031950 tx=0x7f40f4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.884+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f40fc0aa8f0 con 0x7f410410af40 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.094+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f41040639f0 con 0x7f410410af40 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.104+0000 7f4101600640 1 -- 172.21.15.40:0/2464274549 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f40fc0aa1f0 con 0x7f410410af40 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.107+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40e80b3b40 msgr2=0x7f40e80b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.107+0000 7f4109c00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40e80b3b40 0x7f40e80b6050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40f4031950 tx=0x7f40f4009360 comp rx=0 tx=0).stop 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.107+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 msgr2=0x7f410419caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.107+0000 7f4109c00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 0x7f410419caa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00d750 tx=0x7f40fc00dc10 comp rx=0 tx=0).stop 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.107+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 shutdown_connections 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.107+0000 7f4109c00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f410410af40 0x7f410419caa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.108+0000 7f4109c00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40e80b3b40 0x7f40e80b6050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.108+0000 7f4109c00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4104076b10 0x7f410419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.108+0000 7f4109c00640 1 --2- 172.21.15.40:0/2464274549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4104075720 0x7f410419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:58.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.108+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 >> 172.21.15.40:0/2464274549 conn(0x7f41040fe8f0 msgr2=0x7f4104106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:58.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.108+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 shutdown_connections 2024-07-26T12:09:58.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:58.108+0000 7f4109c00640 1 -- 172.21.15.40:0/2464274549 wait complete. 2024-07-26T12:09:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:58 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2845115998' entity='client.admin' 2024-07-26T12:09:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:58 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2686512088' entity='client.admin' 2024-07-26T12:09:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:58 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2845115998' entity='client.admin' 2024-07-26T12:09:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:58 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2686512088' entity='client.admin' 2024-07-26T12:09:59.441 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:59 smithi040 ceph-mon[32397]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:59.442 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:09:59 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2464274549' entity='client.admin' 2024-07-26T12:09:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:59 smithi146 ceph-mon[35807]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:09:59 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2464274549' entity='client.admin' 2024-07-26T12:09:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:59 smithi076 ceph-mon[35401]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:09:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:09:59 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2464274549' entity='client.admin' 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 -- 172.21.15.40:0/1989847024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed41053b0 msgr2=0x7f5ed4105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/1989847024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed41053b0 0x7f5ed4105820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009900 tx=0x7f5ec402a480 comp rx=0 tx=0).stop 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 -- 172.21.15.40:0/1989847024 shutdown_connections 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/1989847024 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ed4106de0 0x7f5ed410d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/1989847024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed4106440 0x7f5ed4106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/1989847024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed41053b0 0x7f5ed4105820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 -- 172.21.15.40:0/1989847024 >> 172.21.15.40:0/1989847024 conn(0x7f5ed4100d20 msgr2=0x7f5ed41031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 -- 172.21.15.40:0/1989847024 shutdown_connections 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.309+0000 7f5ed8a00640 1 -- 172.21.15.40:0/1989847024 wait complete. 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.310+0000 7f5ed8a00640 1 Processor -- start 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 -- start start 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ed41053b0 0x7f5ed419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed4106440 0x7f5ed419c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 0x7f5ed419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4110e40 con 0x7f5ed4106de0 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4110cc0 con 0x7f5ed41053b0 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed8a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4110fc0 con 0x7f5ed4106440 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 0x7f5ed419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 0x7f5ed419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34270/0 (socket says 172.21.15.40:34270) 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.311+0000 7f5ed2800640 1 -- 172.21.15.40:0/2686512088 learned_addr learned my addr 172.21.15.40:0/2686512088 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed1e00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ed41053b0 0x7f5ed419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed1400640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed4106440 0x7f5ed419c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed2800640 1 -- 172.21.15.40:0/2686512088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed4106440 msgr2=0x7f5ed419c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed2800640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed4106440 0x7f5ed419c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed2800640 1 -- 172.21.15.40:0/2686512088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ed41053b0 msgr2=0x7f5ed419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed2800640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ed41053b0 0x7f5ed419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed2800640 1 -- 172.21.15.40:0/2686512088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed419d460 con 0x7f5ed4106de0 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ed2800640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 0x7f5ed419cc40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00eaa0 tx=0x7f5ecc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.312+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00cdb0 con 0x7f5ed4106de0 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.313+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5ecc005020 con 0x7f5ed4106de0 2024-07-26T12:09:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.313+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0116d0 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.313+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed419d750 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.313+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41a3e50 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.314+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4105820 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.317+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f5ecc004a40 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.318+0000 7f5ecaa00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5eb80b3bc0 0x7f5eb80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.318+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5ecc0e2580 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.319+0000 7f5ed1e00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5eb80b3bc0 0x7f5eb80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.319+0000 7f5ed1e00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5eb80b3bc0 0x7f5eb80b60d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4000c00 tx=0x7f5ec4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.323+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5ecc016030 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.540+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f5ed410c590 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.545+0000 7f5ecaa00640 1 -- 172.21.15.40:0/2686512088 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f5ecc0ab880 con 0x7f5ed4106de0 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.549+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5eb80b3bc0 msgr2=0x7f5eb80b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.549+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5eb80b3bc0 0x7f5eb80b60d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4000c00 tx=0x7f5ec4005a20 comp rx=0 tx=0).stop 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.549+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 msgr2=0x7f5ed419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.549+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 0x7f5ed419cc40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00eaa0 tx=0x7f5ecc00ef60 comp rx=0 tx=0).stop 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 shutdown_connections 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed4106de0 0x7f5ed419cc40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5eb80b3bc0 0x7f5eb80b60d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ed4106440 0x7f5ed419c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 --2- 172.21.15.40:0/2686512088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ed41053b0 0x7f5ed419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 >> 172.21.15.40:0/2686512088 conn(0x7f5ed4100d20 msgr2=0x7f5ed4109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 shutdown_connections 2024-07-26T12:09:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:09:57.550+0000 7f5ed8a00640 1 -- 172.21.15.40:0/2686512088 wait complete. 2024-07-26T12:10:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:10:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T12:10:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:10:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 -- 172.21.15.40:0/3478844307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c102fc0 msgr2=0x7f264c103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 --2- 172.21.15.40:0/3478844307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c102fc0 0x7f264c103430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f263c009900 tx=0x7f263c02a480 comp rx=0 tx=0).stop 2024-07-26T12:10:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 -- 172.21.15.40:0/3478844307 shutdown_connections 2024-07-26T12:10:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 --2- 172.21.15.40:0/3478844307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c1049f0 0x7f264c10b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 --2- 172.21.15.40:0/3478844307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c104050 0x7f264c104460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 --2- 172.21.15.40:0/3478844307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c102fc0 0x7f264c103430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 -- 172.21.15.40:0/3478844307 >> 172.21.15.40:0/3478844307 conn(0x7f264c0fe930 msgr2=0x7f264c100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 -- 172.21.15.40:0/3478844307 shutdown_connections 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.818+0000 7f2650a00640 1 -- 172.21.15.40:0/3478844307 wait complete. 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.819+0000 7f2650a00640 1 Processor -- start 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.819+0000 7f2650a00640 1 -- start start 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2650a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c102fc0 0x7f264c076870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2650a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 0x7f264c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2650a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c1049f0 0x7f264c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2650a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f264c10ea50 con 0x7f264c104050 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2650a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f264c10e8d0 con 0x7f264c1049f0 2024-07-26T12:10:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2650a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f264c10ebd0 con 0x7f264c102fc0 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2643e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 0x7f264c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2643e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 0x7f264c075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34310/0 (socket says 172.21.15.40:34310) 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.820+0000 7f2643e00640 1 -- 172.21.15.40:0/2459799802 learned_addr learned my addr 172.21.15.40:0/2459799802 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f264b400640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c102fc0 0x7f264c076870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f264be00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c1049f0 0x7f264c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2643e00640 1 -- 172.21.15.40:0/2459799802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c102fc0 msgr2=0x7f264c076870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2643e00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c102fc0 0x7f264c076870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2643e00640 1 -- 172.21.15.40:0/2459799802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c1049f0 msgr2=0x7f264c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2643e00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c1049f0 0x7f264c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2643e00640 1 -- 172.21.15.40:0/2459799802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c075d80 con 0x7f264c104050 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f264be00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c1049f0 0x7f264c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2643e00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 0x7f264c075140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f263400d950 tx=0x7f263400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634017070 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2634009c30 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c1a3770 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.821+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263400f620 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.822+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c1a3bd0 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.823+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c10a1a0 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.825+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f2634010460 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.827+0000 7f2648c00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26300b3bc0 0x7f26300b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.828+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f26340e1cc0 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.828+0000 7f264b400640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26300b3bc0 0x7f26300b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.829+0000 7f264b400640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26300b3bc0 0x7f26300b60d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f263c000c00 tx=0x7f263c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:00.831+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f26340aaf40 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.047+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f264c02e0c0 con 0x7f264c104050 2024-07-26T12:10:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.053+0000 7f2648c00640 1 -- 172.21.15.40:0/2459799802 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f26340b3210 con 0x7f264c104050 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26300b3bc0 msgr2=0x7f26300b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26300b3bc0 0x7f26300b60d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f263c000c00 tx=0x7f263c005a20 comp rx=0 tx=0).stop 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 msgr2=0x7f264c075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 0x7f264c075140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f263400d950 tx=0x7f263400de10 comp rx=0 tx=0).stop 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 shutdown_connections 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f264c1049f0 0x7f264c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.056+0000 7f2650a00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f264c104050 0x7f264c075140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.057+0000 7f2650a00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26300b3bc0 0x7f26300b60d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.057+0000 7f2650a00640 1 --2- 172.21.15.40:0/2459799802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c102fc0 0x7f264c076870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.057+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 >> 172.21.15.40:0/2459799802 conn(0x7f264c0fe930 msgr2=0x7f264c107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.057+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 shutdown_connections 2024-07-26T12:10:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:01.057+0000 7f2650a00640 1 -- 172.21.15.40:0/2459799802 wait complete. 2024-07-26T12:10:01.424 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:01 smithi040 ceph-mon[32397]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:01.424 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:01 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2459799802' entity='client.admin' 2024-07-26T12:10:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:01 smithi146 ceph-mon[35807]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:01 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2459799802' entity='client.admin' 2024-07-26T12:10:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:01 smithi076 ceph-mon[35401]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:01 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2459799802' entity='client.admin' 2024-07-26T12:10:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 -- 172.21.15.40:0/1472837740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c1095d0 msgr2=0x7f712c109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 --2- 172.21.15.40:0/1472837740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c1095d0 0x7f712c109a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7120009900 tx=0x7f712002a480 comp rx=0 tx=0).stop 2024-07-26T12:10:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 -- 172.21.15.40:0/1472837740 shutdown_connections 2024-07-26T12:10:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 --2- 172.21.15.40:0/1472837740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c10b000 0x7f712c1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 --2- 172.21.15.40:0/1472837740 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c10a660 0x7f712c10aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 --2- 172.21.15.40:0/1472837740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c1095d0 0x7f712c109a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 -- 172.21.15.40:0/1472837740 >> 172.21.15.40:0/1472837740 conn(0x7f712c078970 msgr2=0x7f712c07ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 -- 172.21.15.40:0/1472837740 shutdown_connections 2024-07-26T12:10:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.283+0000 7f7131e00640 1 -- 172.21.15.40:0/1472837740 wait complete. 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.284+0000 7f7131e00640 1 Processor -- start 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 -- start start 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c1095d0 0x7f712c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 0x7f712c1a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c10b000 0x7f712c1a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f712c115020 con 0x7f712c10a660 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f712c114ea0 con 0x7f712c10b000 2024-07-26T12:10:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f7131e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1151a0 con 0x7f712c1095d0 2024-07-26T12:10:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f712be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 0x7f712c1a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f712be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 0x7f712c1a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34324/0 (socket says 172.21.15.40:34324) 2024-07-26T12:10:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.285+0000 7f712be00640 1 -- 172.21.15.40:0/3086881995 learned_addr learned my addr 172.21.15.40:0/3086881995 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f7130a00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c1095d0 0x7f712c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f7131400640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c10b000 0x7f712c1a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f712be00640 1 -- 172.21.15.40:0/3086881995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c1095d0 msgr2=0x7f712c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f712be00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c1095d0 0x7f712c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f712be00640 1 -- 172.21.15.40:0/3086881995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c10b000 msgr2=0x7f712c1a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f712be00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c10b000 0x7f712c1a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f712be00640 1 -- 172.21.15.40:0/3086881995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712c1a1700 con 0x7f712c10a660 2024-07-26T12:10:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.286+0000 7f712be00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 0x7f712c1a0340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711800d950 tx=0x7f711800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:02.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.287+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118017070 con 0x7f712c10a660 2024-07-26T12:10:02.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.287+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f7118009c30 con 0x7f712c10a660 2024-07-26T12:10:02.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.287+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712c1a19f0 con 0x7f712c10a660 2024-07-26T12:10:02.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.287+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711800f620 con 0x7f712c10a660 2024-07-26T12:10:02.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.287+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f712c1a80f0 con 0x7f712c10a660 2024-07-26T12:10:02.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.288+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712c109a40 con 0x7f712c10a660 2024-07-26T12:10:02.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.291+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f7118010460 con 0x7f712c10a660 2024-07-26T12:10:02.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.292+0000 7f7129600640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f71140b3b40 0x7f71140b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:02.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.292+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f71180e1ca0 con 0x7f712c10a660 2024-07-26T12:10:02.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.292+0000 7f7130a00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f71140b3b40 0x7f71140b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:02.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.293+0000 7f7130a00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f71140b3b40 0x7f71140b6050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7120000c00 tx=0x7f7120005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:02.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.294+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f71180aaf20 con 0x7f712c10a660 2024-07-26T12:10:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.503+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f712c1107b0 con 0x7f712c10a660 2024-07-26T12:10:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.514+0000 7f7129600640 1 -- 172.21.15.40:0/3086881995 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f712c1107b0 con 0x7f712c10a660 2024-07-26T12:10:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f71140b3b40 msgr2=0x7f71140b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f71140b3b40 0x7f71140b6050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7120000c00 tx=0x7f7120005a20 comp rx=0 tx=0).stop 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 msgr2=0x7f712c1a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 0x7f712c1a0340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711800d950 tx=0x7f711800de10 comp rx=0 tx=0).stop 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 shutdown_connections 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c10b000 0x7f712c1a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c10a660 0x7f712c1a0340 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f711800d950 tx=0x7f711800de10 comp rx=0 tx=0).stop 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f71140b3b40 0x7f71140b6050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 --2- 172.21.15.40:0/3086881995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c1095d0 0x7f712c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.517+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 >> 172.21.15.40:0/3086881995 conn(0x7f712c078970 msgr2=0x7f712c10d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.518+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 shutdown_connections 2024-07-26T12:10:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:02.518+0000 7f7131e00640 1 -- 172.21.15.40:0/3086881995 wait complete. 2024-07-26T12:10:03.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:03 smithi040 ceph-mon[32397]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:03.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:03 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3086881995' entity='client.admin' 2024-07-26T12:10:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.443+0000 7f10bde00640 1 -- 172.21.15.40:0/2796799198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8108cc0 msgr2=0x7f10b810b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.443+0000 7f10bde00640 1 --2- 172.21.15.40:0/2796799198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8108cc0 0x7f10b810b1d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009ca0 tx=0x7f10b002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 -- 172.21.15.40:0/2796799198 shutdown_connections 2024-07-26T12:10:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 --2- 172.21.15.40:0/2796799198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8108cc0 0x7f10b810b1d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 --2- 172.21.15.40:0/2796799198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10b8106180 0x7f10b81085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 --2- 172.21.15.40:0/2796799198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f10b806b350 0x7f10b8105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 -- 172.21.15.40:0/2796799198 >> 172.21.15.40:0/2796799198 conn(0x7f10b80fd800 msgr2=0x7f10b80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 -- 172.21.15.40:0/2796799198 shutdown_connections 2024-07-26T12:10:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.444+0000 7f10bde00640 1 -- 172.21.15.40:0/2796799198 wait complete. 2024-07-26T12:10:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.445+0000 7f10bde00640 1 Processor -- start 2024-07-26T12:10:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.445+0000 7f10bde00640 1 -- start start 2024-07-26T12:10:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f10b806b350 0x7f10b819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 0x7f10b819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10b8108cc0 0x7f10b819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bde00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f10b810ea10 con 0x7f10b8106180 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bde00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f10b810e890 con 0x7f10b806b350 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bde00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f10b810eb90 con 0x7f10b8108cc0 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 0x7f10b819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 0x7f10b819be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59128/0 (socket says 172.21.15.40:59128) 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10b7e00640 1 -- 172.21.15.40:0/1838866943 learned_addr learned my addr 172.21.15.40:0/1838866943 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.446+0000 7f10bca00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f10b806b350 0x7f10b819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10bd400640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10b8108cc0 0x7f10b819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10b7e00640 1 -- 172.21.15.40:0/1838866943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10b8108cc0 msgr2=0x7f10b819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10b7e00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10b8108cc0 0x7f10b819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10b7e00640 1 -- 172.21.15.40:0/1838866943 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f10b806b350 msgr2=0x7f10b819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10b7e00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f10b806b350 0x7f10b819b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10b7e00640 1 -- 172.21.15.40:0/1838866943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b819d170 con 0x7f10b8106180 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.447+0000 7f10b7e00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 0x7f10b819be40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10a400c920 tx=0x7f10a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.448+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4007c70 con 0x7f10b8106180 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.448+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f10a4007e10 con 0x7f10b8106180 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.448+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4018680 con 0x7f10b8106180 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.448+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b819d460 con 0x7f10b8106180 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.448+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b81a3a20 con 0x7f10b8106180 2024-07-26T12:10:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.450+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b810a7e0 con 0x7f10b8106180 2024-07-26T12:10:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.453+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f10a400f450 con 0x7f10b8106180 2024-07-26T12:10:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.454+0000 7f10b5600640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10a00b3b40 0x7f10a00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.455+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f10a40e2080 con 0x7f10b8106180 2024-07-26T12:10:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.455+0000 7f10bca00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10a00b3b40 0x7f10a00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.456+0000 7f10bca00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10a00b3b40 0x7f10a00b6050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00bbe0 tx=0x7f10ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.458+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f10a4014030 con 0x7f10b8106180 2024-07-26T12:10:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:03 smithi146 ceph-mon[35807]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:03 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3086881995' entity='client.admin' 2024-07-26T12:10:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:03 smithi076 ceph-mon[35401]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:03 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3086881995' entity='client.admin' 2024-07-26T12:10:03.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.664+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f10b802e0c0 con 0x7f10b8106180 2024-07-26T12:10:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.672+0000 7f10b5600640 1 -- 172.21.15.40:0/1838866943 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f10a40ab300 con 0x7f10b8106180 2024-07-26T12:10:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10a00b3b40 msgr2=0x7f10a00b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10a00b3b40 0x7f10a00b6050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00bbe0 tx=0x7f10ac00b390 comp rx=0 tx=0).stop 2024-07-26T12:10:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 msgr2=0x7f10b819be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 0x7f10b819be40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10a400c920 tx=0x7f10a400cde0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 shutdown_connections 2024-07-26T12:10:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10a00b3b40 0x7f10a00b6050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10b8108cc0 0x7f10b819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10b8106180 0x7f10b819be40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 --2- 172.21.15.40:0/1838866943 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f10b806b350 0x7f10b819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 >> 172.21.15.40:0/1838866943 conn(0x7f10b80fd800 msgr2=0x7f10b8104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 shutdown_connections 2024-07-26T12:10:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:03.675+0000 7f10bde00640 1 -- 172.21.15.40:0/1838866943 wait complete. 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 -- 172.21.15.40:0/4159857015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 msgr2=0x7fdc00105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 --2- 172.21.15.40:0/4159857015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc00105dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009900 tx=0x7fdbf002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 -- 172.21.15.40:0/4159857015 shutdown_connections 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 --2- 172.21.15.40:0/4159857015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc00108ea0 0x7fdc0010b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 --2- 172.21.15.40:0/4159857015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc00106300 0x7fdc00108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 --2- 172.21.15.40:0/4159857015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc00105dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 -- 172.21.15.40:0/4159857015 >> 172.21.15.40:0/4159857015 conn(0x7fdc000fd9e0 msgr2=0x7fdc000ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:04.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 -- 172.21.15.40:0/4159857015 shutdown_connections 2024-07-26T12:10:04.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.069+0000 7fdc06200640 1 -- 172.21.15.40:0/4159857015 wait complete. 2024-07-26T12:10:04.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.070+0000 7fdc06200640 1 Processor -- start 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.070+0000 7fdc06200640 1 -- start start 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdc06200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc0019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdc06200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc00106300 0x7fdc0019c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdc06200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc00108ea0 0x7fdc0019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdc06200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0010eba0 con 0x7fdc0006b3b0 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdc06200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0010ea20 con 0x7fdc00108ea0 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdc06200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0010ed20 con 0x7fdc00106300 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdbff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc0019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdbff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc0019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59154/0 (socket says 172.21.15.40:59154) 2024-07-26T12:10:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdbff400640 1 -- 172.21.15.40:0/830875990 learned_addr learned my addr 172.21.15.40:0/830875990 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.071+0000 7fdbfea00640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc00106300 0x7fdc0019c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbff400640 1 -- 172.21.15.40:0/830875990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc00106300 msgr2=0x7fdc0019c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbff400640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc00106300 0x7fdc0019c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbffe00640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc00108ea0 0x7fdc0019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbff400640 1 -- 172.21.15.40:0/830875990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc00108ea0 msgr2=0x7fdc0019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbff400640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc00108ea0 0x7fdc0019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbff400640 1 -- 172.21.15.40:0/830875990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0019d370 con 0x7fdc0006b3b0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbff400640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc0019b9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0006010 tx=0x7fdbf0032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf003f030 con 0x7fdc0006b3b0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fdbf0003c70 con 0x7fdc0006b3b0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.072+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0035070 con 0x7fdc0006b3b0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.073+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0019d600 con 0x7fdc0006b3b0 2024-07-26T12:10:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.073+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc001a3c20 con 0x7fdc0006b3b0 2024-07-26T12:10:04.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.074+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc00106750 con 0x7fdc0006b3b0 2024-07-26T12:10:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.076+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fdbf0042030 con 0x7fdc0006b3b0 2024-07-26T12:10:04.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.078+0000 7fdbf7e00640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdbe40b3bc0 0x7fdbe40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.078+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdbf0102850 con 0x7fdc0006b3b0 2024-07-26T12:10:04.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.079+0000 7fdbfea00640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdbe40b3bc0 0x7fdbe40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.079+0000 7fdbfea00640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdbe40b3bc0 0x7fdbe40b60d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdbec005e10 tx=0x7fdbec005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.082+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdbf0003e20 con 0x7fdc0006b3b0 2024-07-26T12:10:04.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.290+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fdc001a3df0 con 0x7fdc0006b3b0 2024-07-26T12:10:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.300+0000 7fdbf7e00640 1 -- 172.21.15.40:0/830875990 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fdbf00cbad0 con 0x7fdc0006b3b0 2024-07-26T12:10:04.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.304+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdbe40b3bc0 msgr2=0x7fdbe40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.304+0000 7fdc06200640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdbe40b3bc0 0x7fdbe40b60d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdbec005e10 tx=0x7fdbec005da0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.304+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 msgr2=0x7fdc0019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.304+0000 7fdc06200640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc0019b9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0006010 tx=0x7fdbf0032cd0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.305+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 shutdown_connections 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.305+0000 7fdc06200640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc00108ea0 0x7fdc0019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.305+0000 7fdc06200640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdbe40b3bc0 0x7fdbe40b60d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.305+0000 7fdc06200640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc00106300 0x7fdc0019c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.305+0000 7fdc06200640 1 --2- 172.21.15.40:0/830875990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0006b3b0 0x7fdc0019b9d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.305+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 >> 172.21.15.40:0/830875990 conn(0x7fdc000fd9e0 msgr2=0x7fdc000ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.306+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 shutdown_connections 2024-07-26T12:10:04.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.306+0000 7fdc06200640 1 -- 172.21.15.40:0/830875990 wait complete. 2024-07-26T12:10:04.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 -- 172.21.15.40:0/3738386220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020106310 msgr2=0x7f2020108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 --2- 172.21.15.40:0/3738386220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020106310 0x7f2020108770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f200c009900 tx=0x7f200c02a410 comp rx=0 tx=0).stop 2024-07-26T12:10:04.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 -- 172.21.15.40:0/3738386220 shutdown_connections 2024-07-26T12:10:04.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 --2- 172.21.15.40:0/3738386220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2020108eb0 0x7f202010b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 --2- 172.21.15.40:0/3738386220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020106310 0x7f2020108770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 --2- 172.21.15.40:0/3738386220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f202006c090 0x7f2020105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 -- 172.21.15.40:0/3738386220 >> 172.21.15.40:0/3738386220 conn(0x7f20200fda10 msgr2=0x7f20200ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 -- 172.21.15.40:0/3738386220 shutdown_connections 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.830+0000 7f2027a00640 1 -- 172.21.15.40:0/3738386220 wait complete. 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.831+0000 7f2027a00640 1 Processor -- start 2024-07-26T12:10:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 -- start start 2024-07-26T12:10:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f202006c090 0x7f202019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020106310 0x7f202019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 0x7f202019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f202010ebb0 con 0x7f2020108eb0 2024-07-26T12:10:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f202010ea30 con 0x7f202006c090 2024-07-26T12:10:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.832+0000 7f2027a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f202010ed30 con 0x7f2020106310 2024-07-26T12:10:04.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 0x7f202019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 0x7f202019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59174/0 (socket says 172.21.15.40:59174) 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f202006c090 0x7f202019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 -- 172.21.15.40:0/4216230054 learned_addr learned my addr 172.21.15.40:0/4216230054 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f201fe00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020106310 0x7f202019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 -- 172.21.15.40:0/4216230054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020106310 msgr2=0x7f202019c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020106310 0x7f202019c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 -- 172.21.15.40:0/4216230054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f202006c090 msgr2=0x7f202019ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f202006c090 0x7f202019ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.833+0000 7f2025a00640 1 -- 172.21.15.40:0/4216230054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202019d4b0 con 0x7f2020108eb0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.834+0000 7f2025a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 0x7f202019cc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f201800eaa0 tx=0x7f201800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.834+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201800cdb0 con 0x7f2020108eb0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.834+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(24 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2018005020 con 0x7f2020108eb0 2024-07-26T12:10:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.834+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20180116d0 con 0x7f2020108eb0 2024-07-26T12:10:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.834+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202019d7a0 con 0x7f2020108eb0 2024-07-26T12:10:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.834+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20201a3ea0 con 0x7f2020108eb0 2024-07-26T12:10:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.836+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20201a4070 con 0x7f2020108eb0 2024-07-26T12:10:04.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.839+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f2018004a40 con 0x7f2020108eb0 2024-07-26T12:10:04.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.844+0000 7f201d600640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20080b3bc0 0x7f20080b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:04.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.845+0000 7f2025000640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20080b3bc0 0x7f20080b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:04.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.845+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f20180e2060 con 0x7f2020108eb0 2024-07-26T12:10:04.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.846+0000 7f2025000640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20080b3bc0 0x7f20080b60d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2014005fd0 tx=0x7f201400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:04.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:04.849+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2018016030 con 0x7f2020108eb0 2024-07-26T12:10:04.877 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:04 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1838866943' entity='client.admin' 2024-07-26T12:10:04.877 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:04 smithi040 ceph-mon[32397]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:04.877 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:04 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/830875990' entity='client.admin' 2024-07-26T12:10:05.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.053+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f20201a4240 con 0x7f2020108eb0 2024-07-26T12:10:05.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.063+0000 7f201d600640 1 -- 172.21.15.40:0/4216230054 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v27)=0 v27) ==== 114+0+0 (secure 0 0 0) 0x7f20180aac90 con 0x7f2020108eb0 2024-07-26T12:10:05.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.066+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20080b3bc0 msgr2=0x7f20080b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:05.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.066+0000 7f2027a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20080b3bc0 0x7f20080b60d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2014005fd0 tx=0x7f201400b390 comp rx=0 tx=0).stop 2024-07-26T12:10:05.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.066+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 msgr2=0x7f202019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:05.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.066+0000 7f2027a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 0x7f202019cc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f201800eaa0 tx=0x7f201800ef60 comp rx=0 tx=0).stop 2024-07-26T12:10:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 shutdown_connections 2024-07-26T12:10:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2020108eb0 0x7f202019cc90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20080b3bc0 0x7f20080b60d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020106310 0x7f202019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 --2- 172.21.15.40:0/4216230054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f202006c090 0x7f202019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 >> 172.21.15.40:0/4216230054 conn(0x7f20200fda10 msgr2=0x7f20200ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:05.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 shutdown_connections 2024-07-26T12:10:05.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:05.067+0000 7f2027a00640 1 -- 172.21.15.40:0/4216230054 wait complete. 2024-07-26T12:10:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:04 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1838866943' entity='client.admin' 2024-07-26T12:10:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:04 smithi146 ceph-mon[35807]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:04 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/830875990' entity='client.admin' 2024-07-26T12:10:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:04 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1838866943' entity='client.admin' 2024-07-26T12:10:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:04 smithi076 ceph-mon[35401]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:04 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/830875990' entity='client.admin' 2024-07-26T12:10:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:06 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4216230054' entity='client.admin' 2024-07-26T12:10:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:06 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4216230054' entity='client.admin' 2024-07-26T12:10:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:06 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4216230054' entity='client.admin' 2024-07-26T12:10:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:07.216 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:07 smithi040 ceph-mon[32397]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:07.216 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:07.216 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:07.216 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:07 smithi146 ceph-mon[35807]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:07 smithi076 ceph-mon[35401]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 -- 172.21.15.40:0/1883046473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8101380 msgr2=0x7fd6f8101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 --2- 172.21.15.40:0/1883046473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8101380 0x7fd6f8101790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009900 tx=0x7fd6e802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 -- 172.21.15.40:0/1883046473 shutdown_connections 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 --2- 172.21.15.40:0/1883046473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f8108d80 0x7fd6f810b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 --2- 172.21.15.40:0/1883046473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6f8106420 0x7fd6f8108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 --2- 172.21.15.40:0/1883046473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8101380 0x7fd6f8101790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 -- 172.21.15.40:0/1883046473 >> 172.21.15.40:0/1883046473 conn(0x7fd6f80fcf90 msgr2=0x7fd6f80ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.121+0000 7fd6fd000640 1 -- 172.21.15.40:0/1883046473 shutdown_connections 2024-07-26T12:10:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.122+0000 7fd6fd000640 1 -- 172.21.15.40:0/1883046473 wait complete. 2024-07-26T12:10:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.123+0000 7fd6fd000640 1 Processor -- start 2024-07-26T12:10:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.123+0000 7fd6fd000640 1 -- start start 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6fd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f8101380 0x7fd6f8103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6fd000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 0x7fd6f8102320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6fd000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6f8108d80 0x7fd6f8102860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6fd000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810eac0 con 0x7fd6f8106420 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6fd000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810e940 con 0x7fd6f8108d80 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6fd000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810ec40 con 0x7fd6f8101380 2024-07-26T12:10:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 0x7fd6f8102320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 0x7fd6f8102320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59218/0 (socket says 172.21.15.40:59218) 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f6a00640 1 -- 172.21.15.40:0/3066983096 learned_addr learned my addr 172.21.15.40:0/3066983096 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f7400640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f8101380 0x7fd6f8103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f7e00640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6f8108d80 0x7fd6f8102860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f6a00640 1 -- 172.21.15.40:0/3066983096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f8101380 msgr2=0x7fd6f8103a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f6a00640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f8101380 0x7fd6f8103a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.124+0000 7fd6f6a00640 1 -- 172.21.15.40:0/3066983096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6f8108d80 msgr2=0x7fd6f8102860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6f6a00640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6f8108d80 0x7fd6f8102860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6f6a00640 1 -- 172.21.15.40:0/3066983096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f8102ed0 con 0x7fd6f8106420 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6f6a00640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 0x7fd6f8102320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400d950 tx=0x7fd6e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4017070 con 0x7fd6f8106420 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6e4009c30 con 0x7fd6f8106420 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f81a37d0 con 0x7fd6f8106420 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400f620 con 0x7fd6f8106420 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.125+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f81a3c20 con 0x7fd6f8106420 2024-07-26T12:10:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.127+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f80feab0 con 0x7fd6f8106420 2024-07-26T12:10:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.130+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fd6e4010460 con 0x7fd6f8106420 2024-07-26T12:10:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.132+0000 7fd6efe00640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6dc0b3c40 0x7fd6dc0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.132+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd6e40e1bd0 con 0x7fd6f8106420 2024-07-26T12:10:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.132+0000 7fd6f7400640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6dc0b3c40 0x7fd6dc0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.133+0000 7fd6f7400640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6dc0b3c40 0x7fd6dc0b6150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8000c00 tx=0x7fd6e8005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.136+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd6e40aae50 con 0x7fd6f8106420 2024-07-26T12:10:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:09 smithi076 ceph-mon[35401]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:09 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3579760458' entity='client.admin' 2024-07-26T12:10:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:09 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3637843302' entity='client.admin' 2024-07-26T12:10:09.333 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:09 smithi040 ceph-mon[32397]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:09.333 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:09 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3579760458' entity='client.admin' 2024-07-26T12:10:09.333 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:09 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3637843302' entity='client.admin' 2024-07-26T12:10:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.334+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fd6f802e0c0 con 0x7fd6f8106420 2024-07-26T12:10:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.343+0000 7fd6efe00640 1 -- 172.21.15.40:0/3066983096 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7fd6e4009de0 con 0x7fd6f8106420 2024-07-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6dc0b3c40 msgr2=0x7fd6dc0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6dc0b3c40 0x7fd6dc0b6150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8000c00 tx=0x7fd6e8005720 comp rx=0 tx=0).stop 2024-07-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 msgr2=0x7fd6f8102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 0x7fd6f8102320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400d950 tx=0x7fd6e400de10 comp rx=0 tx=0).stop 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 shutdown_connections 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6f8108d80 0x7fd6f8102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f8106420 0x7fd6f8102320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6dc0b3c40 0x7fd6dc0b6150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 --2- 172.21.15.40:0/3066983096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f8101380 0x7fd6f8103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 >> 172.21.15.40:0/3066983096 conn(0x7fd6f80fcf90 msgr2=0x7fd6f8107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 shutdown_connections 2024-07-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:09.346+0000 7fd6fd000640 1 -- 172.21.15.40:0/3066983096 wait complete. 2024-07-26T12:10:09.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi040') 2024-07-26T12:10:09.390 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-07-26T12:10:09.391 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-07-26T12:10:09.391 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi040') 2024-07-26T12:10:09.391 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi040') 2024-07-26T12:10:09.506 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:09 smithi146 ceph-mon[35807]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:09.506 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:09 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3579760458' entity='client.admin' 2024-07-26T12:10:09.506 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:09 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3637843302' entity='client.admin' 2024-07-26T12:10:10.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 -- 172.21.15.40:0/3028988597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 msgr2=0x7f47140751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 --2- 172.21.15.40:0/3028988597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f47140751e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4704009900 tx=0x7f470402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 -- 172.21.15.40:0/3028988597 shutdown_connections 2024-07-26T12:10:10.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 --2- 172.21.15.40:0/3028988597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f471410af70 0x7f471410d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 --2- 172.21.15.40:0/3028988597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4714075720 0x7f4714075b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 --2- 172.21.15.40:0/3028988597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f47140751e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.655+0000 7f4718e00640 1 -- 172.21.15.40:0/3028988597 >> 172.21.15.40:0/3028988597 conn(0x7f47140fe940 msgr2=0x7f4714100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.656+0000 7f4718e00640 1 -- 172.21.15.40:0/3028988597 shutdown_connections 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.656+0000 7f4718e00640 1 -- 172.21.15.40:0/3028988597 wait complete. 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.657+0000 7f4718e00640 1 Processor -- start 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.657+0000 7f4718e00640 1 -- start start 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4718e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4714075720 0x7f471419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4718e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f471419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4718e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471410af70 0x7f471419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4718e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110cd0 con 0x7f4714076b10 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4718e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110b50 con 0x7f4714075720 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4718e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110e50 con 0x7f471410af70 2024-07-26T12:10:10.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4712a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f471419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4712a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f471419bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59196/0 (socket says 172.21.15.40:59196) 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4712a00640 1 -- 172.21.15.40:0/3637843302 learned_addr learned my addr 172.21.15.40:0/3637843302 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.658+0000 7f4713400640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4714075720 0x7f471419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4713e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471410af70 0x7f471419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4712a00640 1 -- 172.21.15.40:0/3637843302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471410af70 msgr2=0x7f471419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4712a00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471410af70 0x7f471419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4712a00640 1 -- 172.21.15.40:0/3637843302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4714075720 msgr2=0x7f471419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4712a00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4714075720 0x7f471419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4712a00640 1 -- 172.21.15.40:0/3637843302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471419d3a0 con 0x7f4714076b10 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4713400640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4714075720 0x7f471419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:10:10.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.659+0000 7f4712a00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f471419bfe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f470000d770 tx=0x7f470000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.660+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700017070 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.660+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471419d690 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.660+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47000054b0 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.660+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700004c60 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.660+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a3d90 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.661+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4714075b30 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.664+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f4700004e00 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.666+0000 7f470be00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46f80b3b40 0x7f46f80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.666+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f47000e1e30 con 0x7f4714076b10 2024-07-26T12:10:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.666+0000 7f4713400640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46f80b3b40 0x7f46f80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.667+0000 7f4713400640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46f80b3b40 0x7f46f80b6050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4704000c00 tx=0x7f4704031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.668+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f47000ab150 con 0x7f4714076b10 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.896+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4714109d80 con 0x7f4714076b10 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.903+0000 7f470be00640 1 -- 172.21.15.40:0/3637843302 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7f4714109d80 con 0x7f4714076b10 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.906+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46f80b3b40 msgr2=0x7f46f80b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.906+0000 7f4718e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46f80b3b40 0x7f46f80b6050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4704000c00 tx=0x7f4704031420 comp rx=0 tx=0).stop 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.906+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 msgr2=0x7f471419bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f471419bfe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f470000d770 tx=0x7f470000dc30 comp rx=0 tx=0).stop 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 shutdown_connections 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46f80b3b40 0x7f46f80b6050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471410af70 0x7f471419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4714076b10 0x7f471419bfe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 --2- 172.21.15.40:0/3637843302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4714075720 0x7f471419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 >> 172.21.15.40:0/3637843302 conn(0x7f47140fe940 msgr2=0x7f4714106f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:10.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 shutdown_connections 2024-07-26T12:10:10.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.907+0000 7f4718e00640 1 -- 172.21.15.40:0/3637843302 wait complete. 2024-07-26T12:10:10.693 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:10 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3066983096' entity='client.admin' 2024-07-26T12:10:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:10 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3066983096' entity='client.admin' 2024-07-26T12:10:10.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.557+0000 7f1697000640 1 -- 172.21.15.40:0/3383349929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 msgr2=0x7f169010a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.557+0000 7f1697000640 1 --2- 172.21.15.40:0/3383349929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169010a9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f167c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.557+0000 7f1697000640 1 -- 172.21.15.40:0/3383349929 shutdown_connections 2024-07-26T12:10:10.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.557+0000 7f1697000640 1 --2- 172.21.15.40:0/3383349929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f169010aee0 0x7f169010d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.557+0000 7f1697000640 1 --2- 172.21.15.40:0/3383349929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169010a9a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.558+0000 7f1697000640 1 --2- 172.21.15.40:0/3383349929 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169006b180 0x7f1690108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.558+0000 7f1697000640 1 -- 172.21.15.40:0/3383349929 >> 172.21.15.40:0/3383349929 conn(0x7f16900fd800 msgr2=0x7f16900ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.558+0000 7f1697000640 1 -- 172.21.15.40:0/3383349929 shutdown_connections 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.558+0000 7f1697000640 1 -- 172.21.15.40:0/3383349929 wait complete. 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.559+0000 7f1697000640 1 Processor -- start 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.559+0000 7f1697000640 1 -- start start 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.559+0000 7f1697000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f169006b180 0x7f169019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.559+0000 7f1697000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.559+0000 7f1697000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169010aee0 0x7f169019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1697000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1690110ca0 con 0x7f1690108580 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1697000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1690110b20 con 0x7f169010aee0 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1697000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1690110e20 con 0x7f169006b180 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1695200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1695200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169019bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59184/0 (socket says 172.21.15.40:59184) 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1695200640 1 -- 172.21.15.40:0/3579760458 learned_addr learned my addr 172.21.15.40:0/3579760458 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1695c00640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f169006b180 0x7f169019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1696600640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169010aee0 0x7f169019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1695200640 1 -- 172.21.15.40:0/3579760458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f169006b180 msgr2=0x7f169019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.560+0000 7f1695200640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f169006b180 0x7f169019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f1695200640 1 -- 172.21.15.40:0/3579760458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169010aee0 msgr2=0x7f169019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f1695200640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169010aee0 0x7f169019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f1695200640 1 -- 172.21.15.40:0/3579760458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169019d340 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f1696600640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169010aee0 0x7f169019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f1695200640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169019bf80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f167c009230 tx=0x7f167c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c03f030 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f167c003c90 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169019d5d0 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.561+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c035070 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.562+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16901a3d30 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.563+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1690108040 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.565+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f167c042030 con 0x7f1690108580 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.568+0000 7f168e000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f16780b3bc0 0x7f16780b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:10.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.568+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f167c102560 con 0x7f1690108580 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.568+0000 7f1695c00640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f16780b3bc0 0x7f16780b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.569+0000 7f1695c00640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f16780b3bc0 0x7f16780b60d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1684005fd0 tx=0x7f1684009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.573+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f167c0cb7e0 con 0x7f1690108580 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.786+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f16900639f0 con 0x7f1690108580 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.793+0000 7f168e000640 1 -- 172.21.15.40:0/3579760458 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v28)=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f167c0cb0e0 con 0x7f1690108580 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.796+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f16780b3bc0 msgr2=0x7f16780b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.796+0000 7f1697000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f16780b3bc0 0x7f16780b60d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1684005fd0 tx=0x7f1684009680 comp rx=0 tx=0).stop 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.796+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 msgr2=0x7f169019bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.796+0000 7f1697000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169019bf80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f167c009230 tx=0x7f167c0042f0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 shutdown_connections 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f169010aee0 0x7f169019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1690108580 0x7f169019bf80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f16780b3bc0 0x7f16780b60d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 --2- 172.21.15.40:0/3579760458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f169006b180 0x7f169019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:10.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 >> 172.21.15.40:0/3579760458 conn(0x7f16900fd800 msgr2=0x7f1690109470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:10.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 shutdown_connections 2024-07-26T12:10:10.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:08.797+0000 7f1697000640 1 -- 172.21.15.40:0/3579760458 wait complete. 2024-07-26T12:10:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:10 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3066983096' entity='client.admin' 2024-07-26T12:10:11.429 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.429 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.429 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.429 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.429 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi040') 2024-07-26T12:10:11.620 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:11 smithi040 ceph-mon[32397]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:11 smithi146 ceph-mon[35807]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:11 smithi076 ceph-mon[35401]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:12.073 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-07-26T12:10:12.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-07-26T12:10:12.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-07-26T12:10:12.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.705+0000 7f1f36400640 1 -- 172.21.15.40:0/195953157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 msgr2=0x7f1f30077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:12.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.705+0000 7f1f36400640 1 --2- 172.21.15.40:0/195953157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f30077ab0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009900 tx=0x7f1f2002a480 comp rx=0 tx=0).stop 2024-07-26T12:10:12.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 -- 172.21.15.40:0/195953157 shutdown_connections 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 --2- 172.21.15.40:0/195953157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f30079070 0x7f1f300799e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 --2- 172.21.15.40:0/195953157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 0x7f1f30078ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 --2- 172.21.15.40:0/195953157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f30077ab0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 -- 172.21.15.40:0/195953157 >> 172.21.15.40:0/195953157 conn(0x7f1f30100d20 msgr2=0x7f1f301031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 -- 172.21.15.40:0/195953157 shutdown_connections 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.706+0000 7f1f36400640 1 -- 172.21.15.40:0/195953157 wait complete. 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.707+0000 7f1f36400640 1 Processor -- start 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.707+0000 7f1f36400640 1 -- start start 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f36400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f3019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f36400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 0x7f1f301a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f36400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f30079070 0x7f1f301a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f36400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1f30115330 con 0x7f1f30077640 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f36400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301151b0 con 0x7f1f30079070 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f36400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1f301154b0 con 0x7f1f300786d0 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f2f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f3019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f2f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f3019ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59238/0 (socket says 172.21.15.40:59238) 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f2f400640 1 -- 172.21.15.40:0/3761627759 learned_addr learned my addr 172.21.15.40:0/3761627759 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f2fe00640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f30079070 0x7f1f301a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.708+0000 7f1f2ea00640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 0x7f1f301a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2f400640 1 -- 172.21.15.40:0/3761627759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 msgr2=0x7f1f301a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2f400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 0x7f1f301a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2f400640 1 -- 172.21.15.40:0/3761627759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f30079070 msgr2=0x7f1f301a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2f400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f30079070 0x7f1f301a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2f400640 1 -- 172.21.15.40:0/3761627759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f301a1950 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2ea00640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 0x7f1f301a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f2f400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f3019ff20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f20005760 tx=0x7f1f20003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2003f070 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f20031da0 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20035030 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f301a1be0 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.709+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f301a8170 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.711+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f301125f0 con 0x7f1f30077640 2024-07-26T12:10:12.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.713+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f1f20042070 con 0x7f1f30077640 2024-07-26T12:10:12.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.715+0000 7f1f27e00640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f140b3bc0 0x7f1f140b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:12.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.715+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1f20103070 con 0x7f1f30077640 2024-07-26T12:10:12.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.715+0000 7f1f2ea00640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f140b3bc0 0x7f1f140b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:12.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.716+0000 7f1f2ea00640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f140b3bc0 0x7f1f140b60d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009b40 tx=0x7f1f1c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:12.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.718+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1f200cc2f0 con 0x7f1f30077640 2024-07-26T12:10:12.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.922+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1f3002e0c0 con 0x7f1f30077640 2024-07-26T12:10:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.931+0000 7f1f27e00640 1 -- 172.21.15.40:0/3761627759 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f1f200cbbf0 con 0x7f1f30077640 2024-07-26T12:10:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f140b3bc0 msgr2=0x7f1f140b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f140b3bc0 0x7f1f140b60d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009b40 tx=0x7f1f1c005e50 comp rx=0 tx=0).stop 2024-07-26T12:10:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 msgr2=0x7f1f3019ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f3019ff20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f20005760 tx=0x7f1f20003d50 comp rx=0 tx=0).stop 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 shutdown_connections 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f30079070 0x7f1f301a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f140b3bc0 0x7f1f140b60d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f300786d0 0x7f1f301a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 --2- 172.21.15.40:0/3761627759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f30077640 0x7f1f3019ff20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.934+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 >> 172.21.15.40:0/3761627759 conn(0x7f1f30100d20 msgr2=0x7f1f3010f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.935+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 shutdown_connections 2024-07-26T12:10:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:12.935+0000 7f1f36400640 1 -- 172.21.15.40:0/3761627759 wait complete. 2024-07-26T12:10:13.003 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi040') 2024-07-26T12:10:13.003 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi040') 2024-07-26T12:10:13.003 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5cbb9f42-4b47-11ef-bcb7-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-07-26T12:10:13.557 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:13 smithi040 ceph-mon[32397]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:13.558 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:13 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3761627759' entity='client.admin' 2024-07-26T12:10:13.616 INFO:tasks.cephadm:Deploying OSDs... 2024-07-26T12:10:13.616 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:10:13.617 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-07-26T12:10:13.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:13 smithi076 ceph-mon[35401]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:13.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:13 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3761627759' entity='client.admin' 2024-07-26T12:10:13.678 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-26T12:10:13.678 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-07-26T12:10:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-07-26 12:08:08.313022121 +0000 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-07-26 12:02:22.774675776 +0000 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-07-26 12:02:22.774675776 +0000 2024-07-26T12:10:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-07-26 12:02:22.774675776 +0000 2024-07-26T12:10:13.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-26T12:10:13.814 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-07-26T12:10:13.815 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-07-26T12:10:13.815 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000337241 s, 1.5 MB/s 2024-07-26T12:10:13.818 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-26T12:10:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:13 smithi146 ceph-mon[35807]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:13 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3761627759' entity='client.admin' 2024-07-26T12:10:13.878 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-07-26T12:10:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-26T12:10:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-07-26 12:08:08.379021319 +0000 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-07-26 12:02:23.374668614 +0000 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-07-26 12:02:23.374668614 +0000 2024-07-26T12:10:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-07-26 12:02:23.374668614 +0000 2024-07-26T12:10:13.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-07-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-07-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000363354 s, 1.4 MB/s 2024-07-26T12:10:14.024 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-26T12:10:14.082 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-07-26T12:10:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-26T12:10:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-07-26 12:08:08.445020518 +0000 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-07-26 12:02:23.965661559 +0000 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-07-26 12:02:23.965661559 +0000 2024-07-26T12:10:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-07-26 12:02:23.965661559 +0000 2024-07-26T12:10:14.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-26T12:10:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-07-26T12:10:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-07-26T12:10:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000327776 s, 1.6 MB/s 2024-07-26T12:10:14.225 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-26T12:10:14.281 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-07-26T12:10:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-26T12:10:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-07-26T12:10:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-07-26 12:08:08.497019887 +0000 2024-07-26T12:10:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-07-26 12:02:24.572654314 +0000 2024-07-26T12:10:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-07-26 12:02:24.572654314 +0000 2024-07-26T12:10:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-07-26 12:02:24.572654314 +0000 2024-07-26T12:10:14.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-26T12:10:14.422 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-07-26T12:10:14.422 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-07-26T12:10:14.422 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000358829 s, 1.4 MB/s 2024-07-26T12:10:14.427 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-26T12:10:14.479 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-07-26T12:10:14.479 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/scratch_devs of=/dev/stdout 2024-07-26T12:10:14.539 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-26T12:10:14.539 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_1 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-07-26 12:09:30.521918567 +0000 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-07-26 12:02:30.045104315 +0000 2024-07-26T12:10:14.590 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-07-26 12:02:30.045104315 +0000 2024-07-26T12:10:14.591 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-07-26 12:02:30.045104315 +0000 2024-07-26T12:10:14.591 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-26T12:10:14.670 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-07-26T12:10:14.670 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-07-26T12:10:14.670 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000338031 s, 1.5 MB/s 2024-07-26T12:10:14.673 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-26T12:10:14.724 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_2 2024-07-26T12:10:14.771 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-26T12:10:14.771 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:14.771 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-07-26T12:10:14.771 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:14.771 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:14.771 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-07-26 12:09:30.522918537 +0000 2024-07-26T12:10:14.772 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-07-26 12:02:30.639086390 +0000 2024-07-26T12:10:14.772 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-07-26 12:02:30.639086390 +0000 2024-07-26T12:10:14.772 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-07-26 12:02:30.639086390 +0000 2024-07-26T12:10:14.772 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-26T12:10:14.850 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-07-26T12:10:14.850 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-07-26T12:10:14.851 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000398613 s, 1.3 MB/s 2024-07-26T12:10:14.854 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-26T12:10:14.909 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_3 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-07-26 12:09:30.523918507 +0000 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-07-26 12:02:31.240068254 +0000 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-07-26 12:02:31.240068254 +0000 2024-07-26T12:10:14.956 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-07-26 12:02:31.240068254 +0000 2024-07-26T12:10:14.957 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-26T12:10:15.031 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-07-26T12:10:15.032 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-07-26T12:10:15.032 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000345924 s, 1.5 MB/s 2024-07-26T12:10:15.035 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-26T12:10:15.094 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_4 2024-07-26T12:10:15.144 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-07-26 12:09:30.523918507 +0000 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-07-26 12:02:31.801051325 +0000 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-07-26 12:02:31.801051325 +0000 2024-07-26T12:10:15.145 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-07-26 12:02:31.801051325 +0000 2024-07-26T12:10:15.145 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-26T12:10:15.216 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-07-26T12:10:15.216 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-07-26T12:10:15.216 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000397622 s, 1.3 MB/s 2024-07-26T12:10:15.219 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-26T12:10:15.272 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-07-26T12:10:15.273 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-07-26T12:10:15.330 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-26T12:10:15.330 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-07-26 12:09:26.802578331 +0000 2024-07-26T12:10:15.385 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-07-26 12:02:28.026441706 +0000 2024-07-26T12:10:15.386 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-07-26 12:02:28.026441706 +0000 2024-07-26T12:10:15.386 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-07-26 12:02:28.026441706 +0000 2024-07-26T12:10:15.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-26T12:10:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-07-26T12:10:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-07-26T12:10:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000517113 s, 990 kB/s 2024-07-26T12:10:15.469 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-26T12:10:15.524 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-07-26 12:09:26.803578316 +0000 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-07-26 12:02:28.597432871 +0000 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-07-26 12:02:28.597432871 +0000 2024-07-26T12:10:15.573 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-07-26 12:02:28.597432871 +0000 2024-07-26T12:10:15.574 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-26T12:10:15.637 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:15 smithi146 ceph-mon[35807]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-07-26T12:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-07-26T12:10:15.644 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000309564 s, 1.7 MB/s 2024-07-26T12:10:15.647 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-26T12:10:15.694 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-07-26T12:10:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:15 smithi040 ceph-mon[32397]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-07-26 12:09:26.803578316 +0000 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-07-26 12:02:29.157424206 +0000 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-07-26 12:02:29.157424206 +0000 2024-07-26T12:10:15.740 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-07-26 12:02:29.157424206 +0000 2024-07-26T12:10:15.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-26T12:10:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:15 smithi076 ceph-mon[35401]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-07-26T12:10:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-07-26T12:10:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000538134 s, 951 kB/s 2024-07-26T12:10:15.862 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-26T12:10:15.916 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-07-26 12:09:26.804578300 +0000 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-07-26 12:02:29.764414814 +0000 2024-07-26T12:10:15.966 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-07-26 12:02:29.764414814 +0000 2024-07-26T12:10:15.967 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-07-26 12:02:29.764414814 +0000 2024-07-26T12:10:15.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-26T12:10:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-07-26T12:10:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-07-26T12:10:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000346009 s, 1.5 MB/s 2024-07-26T12:10:16.043 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-26T12:10:16.097 INFO:tasks.cephadm:Deploying osd.0 on smithi040 with /dev/vg_nvme/lv_4... 2024-07-26T12:10:16.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-26T12:10:16.567 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:10:17.705 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:17 smithi040 ceph-mon[32397]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:17 smithi146 ceph-mon[35807]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:17 smithi076 ceph-mon[35401]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-26T12:10:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-26T12:10:19.077 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-07-26T12:10:19.077 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-07-26T12:10:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0320556 s, 327 MB/s 2024-07-26T12:10:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-07-26T12:10:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:19 smithi040 ceph-mon[32397]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:19 smithi146 ceph-mon[35807]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:19 smithi076 ceph-mon[35401]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:19.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_4 2024-07-26T12:10:20.292 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:10:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:21 smithi040 ceph-mon[32397]: pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:21 smithi146 ceph-mon[35807]: pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:21 smithi076 ceph-mon[35401]: pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.319+0000 7f3718c00640 1 -- 172.21.15.40:0/960573575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 msgr2=0x7f3714105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.319+0000 7f3718c00640 1 --2- 172.21.15.40:0/960573575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f3714105650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3704009900 tx=0x7f370402a480 comp rx=0 tx=0).stop 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 -- 172.21.15.40:0/960573575 shutdown_connections 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 --2- 172.21.15.40:0/960573575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 0x7f371410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 --2- 172.21.15.40:0/960573575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714106270 0x7f3714106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 --2- 172.21.15.40:0/960573575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f3714105650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 -- 172.21.15.40:0/960573575 >> 172.21.15.40:0/960573575 conn(0x7f3714100b50 msgr2=0x7f3714103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 -- 172.21.15.40:0/960573575 shutdown_connections 2024-07-26T12:10:22.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.320+0000 7f3718c00640 1 -- 172.21.15.40:0/960573575 wait complete. 2024-07-26T12:10:22.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 Processor -- start 2024-07-26T12:10:22.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 -- start start 2024-07-26T12:10:22.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f371419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714106270 0x7f371419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 0x7f371419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110cf0 con 0x7f37141051e0 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110b70 con 0x7f3714106c10 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.322+0000 7f3718c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110e70 con 0x7f3714106270 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f371419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f371419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50778/0 (socket says 172.21.15.40:50778) 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 -- 172.21.15.40:0/1877554824 learned_addr learned my addr 172.21.15.40:0/1877554824 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3712a00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714106270 0x7f371419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:22.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713e00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 0x7f371419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 -- 172.21.15.40:0/1877554824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714106270 msgr2=0x7f371419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714106270 0x7f371419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:22.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 -- 172.21.15.40:0/1877554824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 msgr2=0x7f371419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 0x7f371419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713400640 1 -- 172.21.15.40:0/1877554824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371419d3a0 con 0x7f37141051e0 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.323+0000 7f3713e00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 0x7f371419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.324+0000 7f3713400640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f371419b970 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3704009230 tx=0x7f37040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.324+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370403f030 con 0x7f37141051e0 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.324+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3704003c90 con 0x7f37141051e0 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.324+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371419d630 con 0x7f37141051e0 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.324+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704035070 con 0x7f37141051e0 2024-07-26T12:10:22.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.324+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37141a3bc0 con 0x7f37141051e0 2024-07-26T12:10:22.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.326+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371410c3c0 con 0x7f37141051e0 2024-07-26T12:10:22.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.330+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f3704042030 con 0x7f37141051e0 2024-07-26T12:10:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.331+0000 7f370be00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f36f80b3bc0 0x7f36f80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.332+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f37041029f0 con 0x7f37141051e0 2024-07-26T12:10:22.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.332+0000 7f3712a00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f36f80b3bc0 0x7f36f80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.333+0000 7f3712a00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f36f80b3bc0 0x7f36f80b60d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00bbe0 tx=0x7f36fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:22.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.334+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f37040cbc70 con 0x7f37141051e0 2024-07-26T12:10:22.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:22.547+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3714063230 con 0x7f36f80b3bc0 2024-07-26T12:10:23.558 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:23 smithi040 ceph-mon[32397]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:23.559 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:10:23.559 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:10:23.559 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:23 smithi146 ceph-mon[35807]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:10:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:10:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:23 smithi076 ceph-mon[35401]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:10:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:10:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:24.661 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:24 smithi040 ceph-mon[32397]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:10:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:24 smithi146 ceph-mon[35807]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:10:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:24 smithi076 ceph-mon[35401]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:10:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:25 smithi040 ceph-mon[32397]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:25 smithi146 ceph-mon[35807]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:25 smithi076 ceph-mon[35401]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3686242653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14d626d5-0f5f-47dc-b24b-2ff59d022831"}]: dispatch 2024-07-26T12:10:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3686242653' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14d626d5-0f5f-47dc-b24b-2ff59d022831"}]': finished 2024-07-26T12:10:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:26 smithi040 ceph-mon[32397]: osdmap e5: 1 total, 0 up, 1 in 2024-07-26T12:10:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3686242653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14d626d5-0f5f-47dc-b24b-2ff59d022831"}]: dispatch 2024-07-26T12:10:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3686242653' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14d626d5-0f5f-47dc-b24b-2ff59d022831"}]': finished 2024-07-26T12:10:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:26 smithi146 ceph-mon[35807]: osdmap e5: 1 total, 0 up, 1 in 2024-07-26T12:10:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3686242653' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14d626d5-0f5f-47dc-b24b-2ff59d022831"}]: dispatch 2024-07-26T12:10:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3686242653' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14d626d5-0f5f-47dc-b24b-2ff59d022831"}]': finished 2024-07-26T12:10:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:26 smithi076 ceph-mon[35401]: osdmap e5: 1 total, 0 up, 1 in 2024-07-26T12:10:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:27.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:27 smithi040 ceph-mon[32397]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:27.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:27 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4072347748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:10:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:27 smithi146 ceph-mon[35807]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:27 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4072347748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:10:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:27 smithi076 ceph-mon[35401]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:27 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4072347748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:10:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:29 smithi040 ceph-mon[32397]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:29 smithi146 ceph-mon[35807]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:29 smithi076 ceph-mon[35401]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:31 smithi040 ceph-mon[32397]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:31 smithi146 ceph-mon[35807]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:31 smithi076 ceph-mon[35401]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:33 smithi040 ceph-mon[32397]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:33 smithi146 ceph-mon[35807]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:33 smithi076 ceph-mon[35401]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:35 smithi040 ceph-mon[32397]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-26T12:10:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:35 smithi146 ceph-mon[35807]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-26T12:10:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:35 smithi076 ceph-mon[35401]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-07-26T12:10:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:36 smithi146 ceph-mon[35807]: Deploying daemon osd.0 on smithi040 2024-07-26T12:10:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:36 smithi076 ceph-mon[35401]: Deploying daemon osd.0 on smithi040 2024-07-26T12:10:36.868 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:36 smithi040 ceph-mon[32397]: Deploying daemon osd.0 on smithi040 2024-07-26T12:10:37.589 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:37 smithi040 ceph-mon[32397]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:37 smithi146 ceph-mon[35807]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:37 smithi076 ceph-mon[35401]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:38 smithi040 ceph-mon[32397]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:38 smithi146 ceph-mon[35807]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:38 smithi076 ceph-mon[35401]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:40 smithi146 ceph-mon[35807]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:40 smithi076 ceph-mon[35401]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:40 smithi040 ceph-mon[32397]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:42.869 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:42 smithi040 ceph-mon[32397]: pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:42 smithi146 ceph-mon[35807]: pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:42 smithi076 ceph-mon[35401]: pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:44.033 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:44.033 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:44.033 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:45 smithi040 ceph-mon[32397]: pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:45 smithi146 ceph-mon[35807]: pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:45 smithi076 ceph-mon[35401]: pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:47 smithi146 ceph-mon[35807]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:47 smithi076 ceph-mon[35401]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:47 smithi040 ceph-mon[32397]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:47.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:47.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:47.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:47.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.126 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 0 on host 'smithi040' 2024-07-26T12:10:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.124+0000 7f370be00640 1 -- 172.21.15.40:0/1877554824 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3714063230 con 0x7f36f80b3bc0 2024-07-26T12:10:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.128+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f36f80b3bc0 msgr2=0x7f36f80b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.128+0000 7f3718c00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f36f80b3bc0 0x7f36f80b60d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00bbe0 tx=0x7f36fc00b390 comp rx=0 tx=0).stop 2024-07-26T12:10:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.128+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 msgr2=0x7f371419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.128+0000 7f3718c00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f371419b970 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3704009230 tx=0x7f37040042f0 comp rx=0 tx=0).stop 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 shutdown_connections 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3714106c10 0x7f371419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f36f80b3bc0 0x7f36f80b60d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3714106270 0x7f371419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 --2- 172.21.15.40:0/1877554824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37141051e0 0x7f371419b970 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 >> 172.21.15.40:0/1877554824 conn(0x7f3714100b50 msgr2=0x7f3714109590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 shutdown_connections 2024-07-26T12:10:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:10:48.129+0000 7f3718c00640 1 -- 172.21.15.40:0/1877554824 wait complete. 2024-07-26T12:10:48.542 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:48 smithi040 ceph-mon[32397]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-26T12:10:48.543 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:48.543 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.543 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:48 smithi146 ceph-mon[35807]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-26T12:10:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:48 smithi076 ceph-mon[35401]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-07-26T12:10:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:10:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:48.880 DEBUG:teuthology.orchestra.run.smithi040:osd.0> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.0.service 2024-07-26T12:10:48.885 INFO:tasks.cephadm:Deploying osd.1 on smithi076 with /dev/vg_nvme/lv_4... 2024-07-26T12:10:48.885 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:10:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-mon[32397]: pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-mon[32397]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-26T12:10:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-mon[32397]: osdmap e6: 1 total, 0 up, 1 in 2024-07-26T12:10:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-mon[32397]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:10:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:49.427 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-0[47413]: 2024-07-26T12:10:49.331+0000 7f6a1ec00640 -1 osd.0 0 waiting for initial osdmap 2024-07-26T12:10:49.427 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:10:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-0[47413]: 2024-07-26T12:10:49.337+0000 7f6a19c00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:10:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:49 smithi146 ceph-mon[35807]: pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:49 smithi146 ceph-mon[35807]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-26T12:10:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:49 smithi146 ceph-mon[35807]: osdmap e6: 1 total, 0 up, 1 in 2024-07-26T12:10:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:49 smithi146 ceph-mon[35807]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:10:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:49 smithi076 ceph-mon[35401]: pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:49 smithi076 ceph-mon[35401]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-07-26T12:10:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:49 smithi076 ceph-mon[35401]: osdmap e6: 1 total, 0 up, 1 in 2024-07-26T12:10:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:49 smithi076 ceph-mon[35401]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:10:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:50.416 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:50 smithi076 ceph-mon[35401]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:10:50.416 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:50 smithi076 ceph-mon[35401]: osdmap e7: 1 total, 0 up, 1 in 2024-07-26T12:10:50.416 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:50.416 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:50.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:50 smithi040 ceph-mon[32397]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:10:50.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:50 smithi040 ceph-mon[32397]: osdmap e7: 1 total, 0 up, 1 in 2024-07-26T12:10:50.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:50.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:50 smithi146 ceph-mon[35807]: from='osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:10:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:50 smithi146 ceph-mon[35807]: osdmap e7: 1 total, 0 up, 1 in 2024-07-26T12:10:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:51.525 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-26T12:10:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:51 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:10:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:51 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:10:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:51 smithi076 ceph-mon[35401]: pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:51 smithi076 ceph-mon[35401]: osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] boot 2024-07-26T12:10:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:51 smithi076 ceph-mon[35401]: osdmap e8: 1 total, 1 up, 1 in 2024-07-26T12:10:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:51.714 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-26T12:10:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:51 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:10:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:51 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:10:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:51 smithi040 ceph-mon[32397]: pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:51 smithi040 ceph-mon[32397]: osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] boot 2024-07-26T12:10:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:51 smithi040 ceph-mon[32397]: osdmap e8: 1 total, 1 up, 1 in 2024-07-26T12:10:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:51.756 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-07-26T12:10:51.756 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-07-26T12:10:51.756 INFO:teuthology.orchestra.run.smithi076.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0329841 s, 318 MB/s 2024-07-26T12:10:51.757 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-07-26T12:10:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:51 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:10:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:51 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:10:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:51 smithi146 ceph-mon[35807]: pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-07-26T12:10:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:51 smithi146 ceph-mon[35807]: osd.0 [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] boot 2024-07-26T12:10:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:51 smithi146 ceph-mon[35807]: osdmap e8: 1 total, 1 up, 1 in 2024-07-26T12:10:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-07-26T12:10:52.487 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:52 smithi076 ceph-mon[35401]: osdmap e9: 1 total, 1 up, 1 in 2024-07-26T12:10:52.539 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_4 2024-07-26T12:10:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:52 smithi040 ceph-mon[32397]: osdmap e9: 1 total, 1 up, 1 in 2024-07-26T12:10:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:52 smithi146 ceph-mon[35807]: osdmap e9: 1 total, 1 up, 1 in 2024-07-26T12:10:52.977 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:10:53.456 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:53.456 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.456 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.456 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:10:53.456 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.457 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:53.457 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:53.457 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:10:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:10:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:54 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi040 2024-07-26T12:10:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:54 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 17094M 2024-07-26T12:10:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:54 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi040 2024-07-26T12:10:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:54 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 17094M 2024-07-26T12:10:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:54 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi040 2024-07-26T12:10:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:54 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 17094M 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.102+0000 7fa8ba000640 1 -- 172.21.15.76:0/3216977121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b4076b10 msgr2=0x7fa8b40751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.102+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3216977121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b4076b10 0x7fa8b40751e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009900 tx=0x7fa8a802a410 comp rx=0 tx=0).stop 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 -- 172.21.15.76:0/3216977121 shutdown_connections 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3216977121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b410af60 0x7fa8b410d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3216977121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b4075720 0x7fa8b4075b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3216977121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b4076b10 0x7fa8b40751e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 -- 172.21.15.76:0/3216977121 >> 172.21.15.76:0/3216977121 conn(0x7fa8b40fe930 msgr2=0x7fa8b4100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 -- 172.21.15.76:0/3216977121 shutdown_connections 2024-07-26T12:10:55.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.103+0000 7fa8ba000640 1 -- 172.21.15.76:0/3216977121 wait complete. 2024-07-26T12:10:55.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 Processor -- start 2024-07-26T12:10:55.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 -- start start 2024-07-26T12:10:55.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b4075720 0x7fa8b419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:55.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4076b10 0x7fa8b419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:55.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 0x7fa8b419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:55.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4110cc0 con 0x7fa8b4076b10 2024-07-26T12:10:55.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4110b40 con 0x7fa8b410af60 2024-07-26T12:10:55.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.104+0000 7fa8ba000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4110e40 con 0x7fa8b4075720 2024-07-26T12:10:55.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.105+0000 7fa8b9600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 0x7fa8b419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:55.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.105+0000 7fa8b9600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 0x7fa8b419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50402/0 (socket says 172.21.15.76:50402) 2024-07-26T12:10:55.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.105+0000 7fa8b9600640 1 -- 172.21.15.76:0/3593117154 learned_addr learned my addr 172.21.15.76:0/3593117154 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-07-26T12:10:55.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.105+0000 7fa8b3e00640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4076b10 0x7fa8b419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:55.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.105+0000 7fa8b8c00640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b4075720 0x7fa8b419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:55.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b9600640 1 -- 172.21.15.76:0/3593117154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b4075720 msgr2=0x7fa8b419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b9600640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b4075720 0x7fa8b419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b9600640 1 -- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4076b10 msgr2=0x7fa8b419bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b9600640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4076b10 0x7fa8b419bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b9600640 1 -- 172.21.15.76:0/3593117154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b419d380 con 0x7fa8b410af60 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b9600640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 0x7fa8b419cb60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00eb10 tx=0x7fa8ac00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac004b20 con 0x7fa8b410af60 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8ac004cc0 con 0x7fa8b410af60 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b419d670 con 0x7fa8b410af60 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.106+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac010690 con 0x7fa8b410af60 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.107+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b41a3d70 con 0x7fa8b410af60 2024-07-26T12:10:55.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.108+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b4109d70 con 0x7fa8b410af60 2024-07-26T12:10:55.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.111+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fa8ac005000 con 0x7fa8b410af60 2024-07-26T12:10:55.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.112+0000 7fa8b1600640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa89c0b3b40 0x7fa89c0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:10:55.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.112+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fa8ac0e2920 con 0x7fa8b410af60 2024-07-26T12:10:55.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.113+0000 7fa8b8c00640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa89c0b3b40 0x7fa89c0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:10:55.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.114+0000 7fa8b8c00640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa89c0b3b40 0x7fa89c0b6050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80057c0 tx=0x7fa8a8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:10:55.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.115+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa8ac055600 con 0x7fa8b410af60 2024-07-26T12:10:55.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:10:55.326+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa8b4063230 con 0x7fa89c0b3b40 2024-07-26T12:10:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:55 smithi076 ceph-mon[35401]: pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:10:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:10:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:55 smithi040 ceph-mon[32397]: pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:10:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:10:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:55 smithi146 ceph-mon[35807]: pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:10:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:10:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:10:56.455 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:56 smithi076 ceph-mon[35401]: from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:10:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:56 smithi040 ceph-mon[32397]: from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:10:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:56 smithi146 ceph-mon[35807]: from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:10:57.518 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:57 smithi076 ceph-mon[35401]: pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:57 smithi040 ceph-mon[32397]: pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:57 smithi146 ceph-mon[35807]: pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:59 smithi076 ceph-mon[35401]: pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:59 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/1954443537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]: dispatch 2024-07-26T12:10:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:59 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]: dispatch 2024-07-26T12:10:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:59 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]': finished 2024-07-26T12:10:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:59 smithi076 ceph-mon[35401]: osdmap e10: 2 total, 1 up, 2 in 2024-07-26T12:10:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:10:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:10:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:59 smithi040 ceph-mon[32397]: pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:59 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/1954443537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]: dispatch 2024-07-26T12:10:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:59 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]: dispatch 2024-07-26T12:10:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:59 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]': finished 2024-07-26T12:10:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:59 smithi040 ceph-mon[32397]: osdmap e10: 2 total, 1 up, 2 in 2024-07-26T12:10:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:10:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:10:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:59 smithi146 ceph-mon[35807]: pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:10:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:59 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/1954443537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]: dispatch 2024-07-26T12:10:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:59 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]: dispatch 2024-07-26T12:10:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:59 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ed50fe4-e7fc-48ce-823b-7d210178101e"}]': finished 2024-07-26T12:10:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:59 smithi146 ceph-mon[35807]: osdmap e10: 2 total, 1 up, 2 in 2024-07-26T12:10:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:10:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:00 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/3744550748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:11:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:00 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/3744550748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:11:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:00 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/3744550748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:11:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:01 smithi040 ceph-mon[32397]: pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:01 smithi146 ceph-mon[35807]: pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:01 smithi076 ceph-mon[35401]: pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:03.701 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:03 smithi076 ceph-mon[35401]: pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:03 smithi040 ceph-mon[32397]: pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:03 smithi146 ceph-mon[35807]: pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:05 smithi040 ceph-mon[32397]: pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:05.652 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:05 smithi076 ceph-mon[35401]: pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:05 smithi146 ceph-mon[35807]: pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:07 smithi076 ceph-mon[35401]: pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:07 smithi040 ceph-mon[32397]: pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:07 smithi146 ceph-mon[35807]: pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-26T12:11:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-26T12:11:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:08.821 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-07-26T12:11:08.821 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:09 smithi040 ceph-mon[32397]: pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:09 smithi040 ceph-mon[32397]: Deploying daemon osd.1 on smithi076 2024-07-26T12:11:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:09 smithi146 ceph-mon[35807]: pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:09 smithi146 ceph-mon[35807]: Deploying daemon osd.1 on smithi076 2024-07-26T12:11:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:09 smithi076 ceph-mon[35401]: pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:09 smithi076 ceph-mon[35401]: Deploying daemon osd.1 on smithi076 2024-07-26T12:11:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:11 smithi040 ceph-mon[32397]: pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:11 smithi146 ceph-mon[35807]: pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:11 smithi076 ceph-mon[35401]: pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:12 smithi146 ceph-mon[35807]: pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:12 smithi076 ceph-mon[35401]: pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:12 smithi040 ceph-mon[32397]: pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:14.926 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:14 smithi076 ceph-mon[35401]: pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:14 smithi040 ceph-mon[32397]: pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:14 smithi146 ceph-mon[35807]: pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:16 smithi146 ceph-mon[35807]: pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:16 smithi076 ceph-mon[35401]: pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:16 smithi040 ceph-mon[32397]: pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:18 smithi146 ceph-mon[35807]: pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:18 smithi076 ceph-mon[35401]: pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:18 smithi040 ceph-mon[32397]: pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.136+0000 7fa8b1600640 1 -- 172.21.15.76:0/3593117154 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa8b4063230 con 0x7fa89c0b3b40 2024-07-26T12:11:21.140 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 1 on host 'smithi076' 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa89c0b3b40 msgr2=0x7fa89c0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa89c0b3b40 0x7fa89c0b6050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80057c0 tx=0x7fa8a8000bc0 comp rx=0 tx=0).stop 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 msgr2=0x7fa8b419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 0x7fa8b419cb60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00eb10 tx=0x7fa8ac00c2d0 comp rx=0 tx=0).stop 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 shutdown_connections 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8b410af60 0x7fa8b419cb60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:21.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4076b10 0x7fa8b419bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:21.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa89c0b3b40 0x7fa89c0b6050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:21.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 --2- 172.21.15.76:0/3593117154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b4075720 0x7fa8b419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:21.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.141+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 >> 172.21.15.76:0/3593117154 conn(0x7fa8b40fe930 msgr2=0x7fa8b4106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:11:21.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.142+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 shutdown_connections 2024-07-26T12:11:21.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:11:21.142+0000 7fa8ba000640 1 -- 172.21.15.76:0/3593117154 wait complete. 2024-07-26T12:11:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:21 smithi040 ceph-mon[32397]: pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:21 smithi040 ceph-mon[32397]: from='osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T12:11:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:21 smithi040 ceph-mon[32397]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T12:11:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:21 smithi146 ceph-mon[35807]: pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:21 smithi146 ceph-mon[35807]: from='osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T12:11:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:21 smithi146 ceph-mon[35807]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T12:11:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.823 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:21 smithi076 ceph-mon[35401]: pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:21.823 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:21 smithi076 ceph-mon[35401]: from='osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T12:11:21.823 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:21 smithi076 ceph-mon[35401]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-07-26T12:11:21.823 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:21.823 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.823 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:21.888 DEBUG:teuthology.orchestra.run.smithi076:osd.1> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.1.service 2024-07-26T12:11:21.895 INFO:tasks.cephadm:Deploying osd.2 on smithi146 with /dev/vg_nvme/lv_4... 2024-07-26T12:11:21.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-07-26T12:11:22.341 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:11:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:22 smithi040 ceph-mon[32397]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-26T12:11:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:22 smithi040 ceph-mon[32397]: from='osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:11:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:22 smithi040 ceph-mon[32397]: osdmap e11: 2 total, 1 up, 2 in 2024-07-26T12:11:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:22 smithi040 ceph-mon[32397]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:11:22.741 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:22 smithi146 ceph-mon[35807]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-26T12:11:22.741 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:22 smithi146 ceph-mon[35807]: from='osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:11:22.741 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:22 smithi146 ceph-mon[35807]: osdmap e11: 2 total, 1 up, 2 in 2024-07-26T12:11:22.741 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:22.741 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:22 smithi146 ceph-mon[35807]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:11:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:22 smithi076 ceph-mon[35401]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-07-26T12:11:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:22 smithi076 ceph-mon[35401]: from='osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:11:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:22 smithi076 ceph-mon[35401]: osdmap e11: 2 total, 1 up, 2 in 2024-07-26T12:11:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:22 smithi076 ceph-mon[35401]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: osdmap e12: 2 total, 1 up, 2 in 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:23.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: osdmap e12: 2 total, 1 up, 2 in 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: osdmap e12: 2 total, 1 up, 2 in 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:23.782 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:23.792 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-1[40003]: 2024-07-26T12:11:23.534+0000 7f771c000640 -1 osd.1 0 waiting for initial osdmap 2024-07-26T12:11:23.792 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:11:23 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-1[40003]: 2024-07-26T12:11:23.567+0000 7f7712000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:11:24.688 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:24.688 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:24 smithi146 ceph-mon[35807]: from='osd.1 ' entity='osd.1' 2024-07-26T12:11:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:24 smithi040 ceph-mon[32397]: from='osd.1 ' entity='osd.1' 2024-07-26T12:11:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:24 smithi076 ceph-mon[35401]: from='osd.1 ' entity='osd.1' 2024-07-26T12:11:24.944 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-07-26T12:11:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-07-26T12:11:25.146 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-07-26T12:11:25.146 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-07-26T12:11:25.147 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0301571 s, 348 MB/s 2024-07-26T12:11:25.147 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-07-26T12:11:25.723 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:25 smithi076 ceph-mon[35401]: pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:25.723 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:25.723 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:25 smithi076 ceph-mon[35401]: osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] boot 2024-07-26T12:11:25.723 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:25 smithi076 ceph-mon[35401]: osdmap e13: 2 total, 2 up, 2 in 2024-07-26T12:11:25.723 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:25 smithi040 ceph-mon[32397]: pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:25 smithi040 ceph-mon[32397]: osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] boot 2024-07-26T12:11:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:25 smithi040 ceph-mon[32397]: osdmap e13: 2 total, 2 up, 2 in 2024-07-26T12:11:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:25 smithi146 ceph-mon[35807]: pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-07-26T12:11:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:25 smithi146 ceph-mon[35807]: osd.1 [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] boot 2024-07-26T12:11:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:25 smithi146 ceph-mon[35807]: osdmap e13: 2 total, 2 up, 2 in 2024-07-26T12:11:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-07-26T12:11:26.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_4 2024-07-26T12:11:26.457 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: pgmap v107: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi076 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 17089M 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.233 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:27 smithi146 ceph-mon[35807]: osdmap e14: 2 total, 2 up, 2 in 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: pgmap v107: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi076 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 17089M 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:27 smithi040 ceph-mon[32397]: osdmap e14: 2 total, 2 up, 2 in 2024-07-26T12:11:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: pgmap v107: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi076 2024-07-26T12:11:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:11:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 17089M 2024-07-26T12:11:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:27 smithi076 ceph-mon[35401]: osdmap e14: 2 total, 2 up, 2 in 2024-07-26T12:11:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 -- 172.21.15.146:0/1344066502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d81051d0 msgr2=0x7fb0d8105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 --2- 172.21.15.146:0/1344066502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d81051d0 0x7fb0d8105640 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009900 tx=0x7fb0cc02a480 comp rx=0 tx=0).stop 2024-07-26T12:11:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 -- 172.21.15.146:0/1344066502 shutdown_connections 2024-07-26T12:11:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 --2- 172.21.15.146:0/1344066502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d8106c00 0x7fb0d810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 --2- 172.21.15.146:0/1344066502 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d8106260 0x7fb0d8106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 --2- 172.21.15.146:0/1344066502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d81051d0 0x7fb0d8105640 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 -- 172.21.15.146:0/1344066502 >> 172.21.15.146:0/1344066502 conn(0x7fb0d8100b60 msgr2=0x7fb0d8102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:11:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 -- 172.21.15.146:0/1344066502 shutdown_connections 2024-07-26T12:11:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.718+0000 7fb0dee00640 1 -- 172.21.15.146:0/1344066502 wait complete. 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.719+0000 7fb0dee00640 1 Processor -- start 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.719+0000 7fb0dee00640 1 -- start start 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dee00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d81051d0 0x7fb0d819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 0x7fb0d819c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d8106c00 0x7fb0d819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8110ce0 con 0x7fb0d8106c00 2024-07-26T12:11:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dee00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8110b60 con 0x7fb0d81051d0 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8110e60 con 0x7fb0d8106260 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 0x7fb0d819c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 0x7fb0d819c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39578/0 (socket says 172.21.15.146:39578) 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dd000640 1 -- 172.21.15.146:0/3783070208 learned_addr learned my addr 172.21.15.146:0/3783070208 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dda00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d81051d0 0x7fb0d819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0de400640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d8106c00 0x7fb0d819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dd000640 1 -- 172.21.15.146:0/3783070208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d81051d0 msgr2=0x7fb0d819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.720+0000 7fb0dd000640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d81051d0 0x7fb0d819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0dd000640 1 -- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d8106c00 msgr2=0x7fb0d819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0dd000640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d8106c00 0x7fb0d819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0dd000640 1 -- 172.21.15.146:0/3783070208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d819d3e0 con 0x7fb0d8106260 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0dd000640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 0x7fb0d819c020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400d770 tx=0x7fb0c400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4017070 con 0x7fb0d8106260 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0c40054b0 con 0x7fb0d8106260 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4004c60 con 0x7fb0d8106260 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d819d6d0 con 0x7fb0d8106260 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.721+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81a3dd0 con 0x7fb0d8106260 2024-07-26T12:11:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.723+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8105640 con 0x7fb0d8106260 2024-07-26T12:11:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.725+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fb0c4004e00 con 0x7fb0d8106260 2024-07-26T12:11:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.727+0000 7fb0d6000640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0c00b3bc0 0x7fb0c00b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:11:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.727+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fb0c40e2300 con 0x7fb0d8106260 2024-07-26T12:11:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.728+0000 7fb0dda00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0c00b3bc0 0x7fb0c00b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:11:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.729+0000 7fb0dda00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0c00b3bc0 0x7fb0c00b60d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000c00 tx=0x7fb0cc005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:11:28.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.730+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb0c40ab180 con 0x7fb0d8106260 2024-07-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:28.941+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb0d8063230 con 0x7fb0c00b3bc0 2024-07-26T12:11:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:29 smithi146 ceph-mon[35807]: pgmap v109: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:11:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:11:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:29 smithi040 ceph-mon[32397]: pgmap v109: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:11:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:11:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:29 smithi076 ceph-mon[35401]: pgmap v109: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:11:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:11:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:30 smithi146 ceph-mon[35807]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:11:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:30 smithi040 ceph-mon[32397]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:11:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:30 smithi076 ceph-mon[35401]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:11:31.457 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:31 smithi146 ceph-mon[35807]: pgmap v110: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:31 smithi040 ceph-mon[32397]: pgmap v110: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:31 smithi076 ceph-mon[35401]: pgmap v110: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:33.249 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:33 smithi146 ceph-mon[35807]: pgmap v111: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:33.249 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:33 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/916133557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]: dispatch 2024-07-26T12:11:33.249 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:33 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]: dispatch 2024-07-26T12:11:33.249 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:33 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]': finished 2024-07-26T12:11:33.249 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:33 smithi146 ceph-mon[35807]: osdmap e15: 3 total, 2 up, 3 in 2024-07-26T12:11:33.249 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:33 smithi040 ceph-mon[32397]: pgmap v111: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:33 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/916133557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]: dispatch 2024-07-26T12:11:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:33 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]: dispatch 2024-07-26T12:11:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:33 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]': finished 2024-07-26T12:11:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:33 smithi040 ceph-mon[32397]: osdmap e15: 3 total, 2 up, 3 in 2024-07-26T12:11:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:33 smithi076 ceph-mon[35401]: pgmap v111: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:33 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/916133557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]: dispatch 2024-07-26T12:11:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:33 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]: dispatch 2024-07-26T12:11:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:33 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2"}]': finished 2024-07-26T12:11:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:33 smithi076 ceph-mon[35401]: osdmap e15: 3 total, 2 up, 3 in 2024-07-26T12:11:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:34 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/4140011113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:11:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:34 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/4140011113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:11:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:34 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/4140011113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:11:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:35 smithi040 ceph-mon[32397]: pgmap v113: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:35 smithi146 ceph-mon[35807]: pgmap v113: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:35 smithi076 ceph-mon[35401]: pgmap v113: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:37 smithi040 ceph-mon[32397]: pgmap v114: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:37.514 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:37 smithi146 ceph-mon[35807]: pgmap v114: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:37 smithi076 ceph-mon[35401]: pgmap v114: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:39.457 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:39 smithi146 ceph-mon[35807]: pgmap v115: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:39 smithi040 ceph-mon[32397]: pgmap v115: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:39 smithi076 ceph-mon[35401]: pgmap v115: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:41.455 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:41 smithi146 ceph-mon[35807]: pgmap v116: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:41 smithi040 ceph-mon[32397]: pgmap v116: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:41 smithi076 ceph-mon[35401]: pgmap v116: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:43.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:43 smithi146 ceph-mon[35807]: pgmap v117: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:43.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-26T12:11:43.267 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:43.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:43 smithi146 ceph-mon[35807]: Deploying daemon osd.2 on smithi146 2024-07-26T12:11:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:43 smithi040 ceph-mon[32397]: pgmap v117: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-26T12:11:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:43 smithi040 ceph-mon[32397]: Deploying daemon osd.2 on smithi146 2024-07-26T12:11:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:43 smithi076 ceph-mon[35401]: pgmap v117: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-07-26T12:11:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:43 smithi076 ceph-mon[35401]: Deploying daemon osd.2 on smithi146 2024-07-26T12:11:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:45 smithi146 ceph-mon[35807]: pgmap v118: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:45 smithi076 ceph-mon[35401]: pgmap v118: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:45 smithi040 ceph-mon[32397]: pgmap v118: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:47 smithi146 ceph-mon[35807]: pgmap v119: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:47 smithi040 ceph-mon[32397]: pgmap v119: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:47 smithi076 ceph-mon[35401]: pgmap v119: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:49.349 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:49 smithi146 ceph-mon[35807]: pgmap v120: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:49 smithi040 ceph-mon[32397]: pgmap v120: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:49 smithi076 ceph-mon[35401]: pgmap v120: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:51 smithi040 ceph-mon[32397]: pgmap v121: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:51 smithi146 ceph-mon[35807]: pgmap v121: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:51 smithi076 ceph-mon[35401]: pgmap v121: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:53 smithi040 ceph-mon[32397]: pgmap v122: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:53 smithi146 ceph-mon[35807]: pgmap v122: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:53 smithi076 ceph-mon[35401]: pgmap v122: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:55.754 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: pgmap v123: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T12:11:55.755 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:55 smithi146 ceph-mon[35807]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: pgmap v123: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T12:11:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:55 smithi076 ceph-mon[35401]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: pgmap v123: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T12:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:55 smithi040 ceph-mon[32397]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-07-26T12:11:56.194 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 2 on host 'smithi146' 2024-07-26T12:11:56.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.191+0000 7fb0d6000640 1 -- 172.21.15.146:0/3783070208 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0d8063230 con 0x7fb0c00b3bc0 2024-07-26T12:11:56.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0c00b3bc0 msgr2=0x7fb0c00b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0c00b3bc0 0x7fb0c00b60d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc000c00 tx=0x7fb0cc005720 comp rx=0 tx=0).stop 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 msgr2=0x7fb0d819c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 0x7fb0d819c020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400d770 tx=0x7fb0c400dc30 comp rx=0 tx=0).stop 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 shutdown_connections 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d8106c00 0x7fb0d819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0c00b3bc0 0x7fb0c00b60d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d8106260 0x7fb0d819c020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 --2- 172.21.15.146:0/3783070208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d81051d0 0x7fb0d819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:11:56.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 >> 172.21.15.146:0/3783070208 conn(0x7fb0d8100b60 msgr2=0x7fb0d8109580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:11:56.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 shutdown_connections 2024-07-26T12:11:56.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:11:56.195+0000 7fb0dee00640 1 -- 172.21.15.146:0/3783070208 wait complete. 2024-07-26T12:11:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-26T12:11:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:11:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: osdmap e16: 3 total, 2 up, 3 in 2024-07-26T12:11:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:11:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: pgmap v125: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: osdmap e16: 3 total, 2 up, 3 in 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: pgmap v125: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:56.927 DEBUG:teuthology.orchestra.run.smithi146:osd.2> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.2.service 2024-07-26T12:11:56.935 INFO:tasks.cephadm:Deploying osd.3 on smithi040 with /dev/vg_nvme/lv_3... 2024-07-26T12:11:56.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-26T12:11:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-07-26T12:11:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:11:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: osdmap e16: 3 total, 2 up, 3 in 2024-07-26T12:11:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:11:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: pgmap v125: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:11:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:11:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:11:57.739 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:57 smithi146 ceph-mon[35807]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:11:57.739 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:57 smithi146 ceph-mon[35807]: osdmap e17: 3 total, 2 up, 3 in 2024-07-26T12:11:57.739 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:57 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:57.739 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:57 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:57.808 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:57 smithi040 ceph-mon[32397]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:11:57.808 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:57 smithi040 ceph-mon[32397]: osdmap e17: 3 total, 2 up, 3 in 2024-07-26T12:11:57.808 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:57.808 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:57 smithi076 ceph-mon[35401]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:11:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:57 smithi076 ceph-mon[35401]: osdmap e17: 3 total, 2 up, 3 in 2024-07-26T12:11:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:57 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:57 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:58.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:11:58.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:11:58.619 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] boot 2024-07-26T12:11:58.619 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: osdmap e18: 3 total, 3 up, 3 in 2024-07-26T12:11:58.619 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:58.619 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: pgmap v128: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:58.619 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T12:11:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:11:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:11:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] boot 2024-07-26T12:11:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: osdmap e18: 3 total, 3 up, 3 in 2024-07-26T12:11:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: pgmap v128: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: osd.2 [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] boot 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: osdmap e18: 3 total, 3 up, 3 in 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: pgmap v128: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-07-26T12:11:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-07-26T12:11:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-26T12:11:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:59 smithi040 ceph-mon[32397]: osdmap e19: 3 total, 3 up, 3 in 2024-07-26T12:11:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:11:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T12:11:59.920 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-26T12:11:59.945 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-26T12:11:59.945 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:59 smithi076 ceph-mon[35401]: osdmap e19: 3 total, 3 up, 3 in 2024-07-26T12:11:59.945 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:11:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T12:12:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-07-26T12:12:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:59 smithi146 ceph-mon[35807]: osdmap e19: 3 total, 3 up, 3 in 2024-07-26T12:12:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:11:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-07-26T12:12:00.081 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-26T12:12:00.081 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51445]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51445]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51445]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51452]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51452]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.082 INFO:journalctl@ceph.osd.0.smithi040.stdout:Jul 26 12:11:59 smithi040 sudo[51452]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.125 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-07-26T12:12:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-07-26T12:12:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.034262 s, 306 MB/s 2024-07-26T12:12:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:11:59 smithi076 sudo[43863]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:11:59 smithi076 sudo[43863]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:11:59 smithi076 sudo[43863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:11:59 smithi076 sudo[43863]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43866]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43866]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.333 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.334 INFO:journalctl@ceph.osd.1.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43866]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.334 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51564]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T12:12:00.447 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42521]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42521]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42521]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42794]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42794]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.448 INFO:journalctl@ceph.osd.2.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[42794]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51564]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51564]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51567]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51567]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 sudo[51567]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[43925]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T12:12:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[43925]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[43925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[43925]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[44192]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T12:12:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[44192]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[44192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 sudo[44192]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: osdmap e20: 3 total, 3 up, 3 in 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: pgmap v131: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.824 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43869]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43869]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43869]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43872]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43872]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 sudo[43872]: pam_unix(sudo:session): session closed for user root 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: osdmap e20: 3 total, 3 up, 3 in 2024-07-26T12:12:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: pgmap v131: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:00.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: osdmap e20: 3 total, 3 up, 3 in 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: pgmap v131: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-07-26T12:12:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-07-26T12:12:01.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_3 2024-07-26T12:12:01.525 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:12:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: mgrmap e16: x(active, since 4m), standbys: z, y 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: osdmap e21: 3 total, 3 up, 3 in 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi146 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 17089M 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:01.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: mgrmap e16: x(active, since 4m), standbys: z, y 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: osdmap e21: 3 total, 3 up, 3 in 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi146 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 17089M 2024-07-26T12:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:02.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:02.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: mgrmap e16: x(active, since 4m), standbys: z, y 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: osdmap e21: 3 total, 3 up, 3 in 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi146 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 17089M 2024-07-26T12:12:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:02.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:02 smithi040 ceph-mon[32397]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:02 smithi146 ceph-mon[35807]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:02 smithi076 ceph-mon[35401]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 -- 172.21.15.40:0/1939104753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 msgr2=0x7f0a14104440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 --2- 172.21.15.40:0/1939104753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14104440 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009900 tx=0x7f0a0002a480 comp rx=0 tx=0).stop 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 -- 172.21.15.40:0/1939104753 shutdown_connections 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 --2- 172.21.15.40:0/1939104753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a141049d0 0x7f0a1410b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 --2- 172.21.15.40:0/1939104753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14104440 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 --2- 172.21.15.40:0/1939104753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a14102fa0 0x7f0a14103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 -- 172.21.15.40:0/1939104753 >> 172.21.15.40:0/1939104753 conn(0x7f0a140fe910 msgr2=0x7f0a14100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 -- 172.21.15.40:0/1939104753 shutdown_connections 2024-07-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.787+0000 7f0a13200640 1 -- 172.21.15.40:0/1939104753 wait complete. 2024-07-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.789+0000 7f0a13200640 1 Processor -- start 2024-07-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.789+0000 7f0a13200640 1 -- start start 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a13200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a14102fa0 0x7f0a14199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a13200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a13200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a141049d0 0x7f0a1419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a13200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1410eab0 con 0x7f0a14104030 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a13200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1410e930 con 0x7f0a141049d0 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a13200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1410ec30 con 0x7f0a14102fa0 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a11400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a11400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47458/0 (socket says 172.21.15.40:47458) 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a11400640 1 -- 172.21.15.40:0/2848434116 learned_addr learned my addr 172.21.15.40:0/2848434116 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a11e00640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a14102fa0 0x7f0a14199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.790+0000 7f0a12800640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a141049d0 0x7f0a1419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a11400640 1 -- 172.21.15.40:0/2848434116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a14102fa0 msgr2=0x7f0a14199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a11400640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a14102fa0 0x7f0a14199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a11400640 1 -- 172.21.15.40:0/2848434116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a141049d0 msgr2=0x7f0a1419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a11400640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a141049d0 0x7f0a1419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a11400640 1 -- 172.21.15.40:0/2848434116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1419b1a0 con 0x7f0a14104030 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a12800640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a141049d0 0x7f0a1419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a11400640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14199de0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009230 tx=0x7f0a00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.791+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00035070 con 0x7f0a14104030 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.792+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a000035f0 con 0x7f0a14104030 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.792+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00049630 con 0x7f0a14104030 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.792+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1419b430 con 0x7f0a14104030 2024-07-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.792+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a140751f0 con 0x7f0a14104030 2024-07-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.793+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a14103410 con 0x7f0a14104030 2024-07-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.796+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f0a00041b60 con 0x7f0a14104030 2024-07-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.797+0000 7f0a0aa00640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09f80b3c50 0x7f09f80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.797+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f0a0010bae0 con 0x7f0a14104030 2024-07-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.797+0000 7f0a11e00640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09f80b3c50 0x7f09f80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.798+0000 7f0a11e00640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09f80b3c50 0x7f09f80b6160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400bbe0 tx=0x7f0a0400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:03.800+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0a000d4460 con 0x7f0a14104030 2024-07-26T12:12:04.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:04.016+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0a1402e430 con 0x7f09f80b3c50 2024-07-26T12:12:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:04 smithi146 ceph-mon[35807]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:04 smithi146 ceph-mon[35807]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:12:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:12:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:12:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:05.074 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:04 smithi040 ceph-mon[32397]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:05.074 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:04 smithi040 ceph-mon[32397]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:12:05.074 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:12:05.074 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:12:05.075 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:04 smithi076 ceph-mon[35401]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:04 smithi076 ceph-mon[35401]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:12:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:12:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:12:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:06 smithi146 ceph-mon[35807]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 52 KiB/s wr, 4 op/s 2024-07-26T12:12:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:06 smithi076 ceph-mon[35401]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 52 KiB/s wr, 4 op/s 2024-07-26T12:12:07.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:06 smithi040 ceph-mon[32397]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 52 KiB/s wr, 4 op/s 2024-07-26T12:12:08.040 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1126539941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c225bd9-ee30-4bd3-b280-3237a9e899d5"}]: dispatch 2024-07-26T12:12:08.040 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1126539941' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c225bd9-ee30-4bd3-b280-3237a9e899d5"}]': finished 2024-07-26T12:12:08.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:07 smithi040 ceph-mon[32397]: osdmap e22: 4 total, 3 up, 4 in 2024-07-26T12:12:08.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1126539941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c225bd9-ee30-4bd3-b280-3237a9e899d5"}]: dispatch 2024-07-26T12:12:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1126539941' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c225bd9-ee30-4bd3-b280-3237a9e899d5"}]': finished 2024-07-26T12:12:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:07 smithi146 ceph-mon[35807]: osdmap e22: 4 total, 3 up, 4 in 2024-07-26T12:12:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:07 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1126539941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c225bd9-ee30-4bd3-b280-3237a9e899d5"}]: dispatch 2024-07-26T12:12:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:07 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1126539941' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c225bd9-ee30-4bd3-b280-3237a9e899d5"}]': finished 2024-07-26T12:12:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:07 smithi076 ceph-mon[35401]: osdmap e22: 4 total, 3 up, 4 in 2024-07-26T12:12:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:08 smithi040 ceph-mon[32397]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 37 KiB/s wr, 3 op/s 2024-07-26T12:12:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:08 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1216311886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:12:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:08 smithi146 ceph-mon[35807]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 37 KiB/s wr, 3 op/s 2024-07-26T12:12:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:08 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1216311886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:12:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:08 smithi076 ceph-mon[35401]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 37 KiB/s wr, 3 op/s 2024-07-26T12:12:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1216311886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:12:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:10 smithi146 ceph-mon[35807]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1018 B/s rd, 29 KiB/s wr, 2 op/s 2024-07-26T12:12:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:10 smithi076 ceph-mon[35401]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1018 B/s rd, 29 KiB/s wr, 2 op/s 2024-07-26T12:12:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:10 smithi040 ceph-mon[32397]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1018 B/s rd, 29 KiB/s wr, 2 op/s 2024-07-26T12:12:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:12 smithi040 ceph-mon[32397]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T12:12:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:12 smithi146 ceph-mon[35807]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T12:12:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:12 smithi076 ceph-mon[35401]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T12:12:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:14 smithi040 ceph-mon[32397]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T12:12:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:14 smithi146 ceph-mon[35807]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T12:12:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:14 smithi076 ceph-mon[35401]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-07-26T12:12:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:16 smithi146 ceph-mon[35807]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:17.077 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:16 smithi040 ceph-mon[32397]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:16 smithi076 ceph-mon[35401]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-26T12:12:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-26T12:12:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-07-26T12:12:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:18 smithi040 ceph-mon[32397]: Deploying daemon osd.3 on smithi040 2024-07-26T12:12:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:18 smithi040 ceph-mon[32397]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:18 smithi076 ceph-mon[35401]: Deploying daemon osd.3 on smithi040 2024-07-26T12:12:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:18 smithi076 ceph-mon[35401]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:18 smithi146 ceph-mon[35807]: Deploying daemon osd.3 on smithi040 2024-07-26T12:12:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:18 smithi146 ceph-mon[35807]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:20.903 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:20 smithi040 ceph-mon[32397]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:20 smithi146 ceph-mon[35807]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:20 smithi076 ceph-mon[35401]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:23.008 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:22 smithi040 ceph-mon[32397]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:22 smithi146 ceph-mon[35807]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:22 smithi076 ceph-mon[35401]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:25.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:24 smithi040 ceph-mon[32397]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:24 smithi146 ceph-mon[35807]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:24 smithi076 ceph-mon[35401]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:26.948 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:26 smithi040 ceph-mon[32397]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:26.949 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:12:26.949 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:26.949 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:26 smithi146 ceph-mon[35807]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:12:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:26 smithi076 ceph-mon[35401]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:12:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:29.072 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:28 smithi040 ceph-mon[32397]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:28 smithi146 ceph-mon[35807]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:28 smithi076 ceph-mon[35401]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:30.700 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:30.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:30.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:30 smithi040 ceph-mon[32397]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T12:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:30 smithi146 ceph-mon[35807]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T12:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:30 smithi076 ceph-mon[35401]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-07-26T12:12:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.170+0000 7f0a0aa00640 1 -- 172.21.15.40:0/2848434116 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0a1402e430 con 0x7f09f80b3c50 2024-07-26T12:12:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 3 on host 'smithi040' 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09f80b3c50 msgr2=0x7f09f80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09f80b3c50 0x7f09f80b6160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400bbe0 tx=0x7f0a0400b390 comp rx=0 tx=0).stop 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 msgr2=0x7f0a14199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14199de0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009230 tx=0x7f0a00004270 comp rx=0 tx=0).stop 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 shutdown_connections 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a141049d0 0x7f0a1419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a14104030 0x7f0a14199de0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09f80b3c50 0x7f09f80b6160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 --2- 172.21.15.40:0/2848434116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a14102fa0 0x7f0a14199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 >> 172.21.15.40:0/2848434116 conn(0x7f0a140fe910 msgr2=0x7f0a14107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:12:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 shutdown_connections 2024-07-26T12:12:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:12:31.174+0000 7f0a13200640 1 -- 172.21.15.40:0/2848434116 wait complete. 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: osdmap e23: 4 total, 3 up, 4 in 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: osdmap e23: 4 total, 3 up, 4 in 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: osdmap e23: 4 total, 3 up, 4 in 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:31.900 DEBUG:teuthology.orchestra.run.smithi040:osd.3> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.3.service 2024-07-26T12:12:31.906 INFO:tasks.cephadm:Deploying osd.4 on smithi076 with /dev/vg_nvme/lv_3... 2024-07-26T12:12:31.907 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-26T12:12:32.356 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:12:32.707 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:12:32.708 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: osdmap e24: 4 total, 3 up, 4 in 2024-07-26T12:12:32.708 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.708 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.708 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] boot 2024-07-26T12:12:32.708 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: osdmap e25: 4 total, 4 up, 4 in 2024-07-26T12:12:32.708 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: osdmap e24: 4 total, 3 up, 4 in 2024-07-26T12:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] boot 2024-07-26T12:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: osdmap e25: 4 total, 4 up, 4 in 2024-07-26T12:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: from='osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:12:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: osdmap e24: 4 total, 3 up, 4 in 2024-07-26T12:12:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: osd.3 [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] boot 2024-07-26T12:12:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: osdmap e25: 4 total, 4 up, 4 in 2024-07-26T12:12:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-07-26T12:12:33.542 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:33 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:12:33.543 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:33 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:12:33.543 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:33 smithi076 ceph-mon[35401]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:33.543 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:33 smithi076 ceph-mon[35401]: osdmap e26: 4 total, 4 up, 4 in 2024-07-26T12:12:33.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:33 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:12:33.710 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:33 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:12:33.710 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:33 smithi040 ceph-mon[32397]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:33.710 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:33 smithi040 ceph-mon[32397]: osdmap e26: 4 total, 4 up, 4 in 2024-07-26T12:12:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:33 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:12:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:33 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:12:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:33 smithi146 ceph-mon[35807]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-07-26T12:12:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:33 smithi146 ceph-mon[35807]: osdmap e26: 4 total, 4 up, 4 in 2024-07-26T12:12:34.793 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-26T12:12:34.984 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-26T12:12:35.023 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-07-26T12:12:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-07-26T12:12:35.023 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0307219 s, 341 MB/s 2024-07-26T12:12:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-07-26T12:12:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:35 smithi076 ceph-mon[35401]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:35 smithi076 ceph-mon[35401]: osdmap e27: 4 total, 4 up, 4 in 2024-07-26T12:12:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:35 smithi040 ceph-mon[32397]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:35 smithi040 ceph-mon[32397]: osdmap e27: 4 total, 4 up, 4 in 2024-07-26T12:12:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:35 smithi146 ceph-mon[35807]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:35 smithi146 ceph-mon[35807]: osdmap e27: 4 total, 4 up, 4 in 2024-07-26T12:12:35.794 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_3 2024-07-26T12:12:36.226 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi040 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 8547M 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:37.491 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:37.492 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi040 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 8547M 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi040 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 8547M 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:12:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:12:38.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 -- 172.21.15.76:0/397218770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc0104050 msgr2=0x7fdbc0104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 --2- 172.21.15.76:0/397218770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc0104050 0x7fdbc0104460 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009900 tx=0x7fdba802a480 comp rx=0 tx=0).stop 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 -- 172.21.15.76:0/397218770 shutdown_connections 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 --2- 172.21.15.76:0/397218770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbc01049f0 0x7fdbc010b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 --2- 172.21.15.76:0/397218770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc0104050 0x7fdbc0104460 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 --2- 172.21.15.76:0/397218770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0102fc0 0x7fdbc0103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 -- 172.21.15.76:0/397218770 >> 172.21.15.76:0/397218770 conn(0x7fdbc00fe930 msgr2=0x7fdbc0100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 -- 172.21.15.76:0/397218770 shutdown_connections 2024-07-26T12:12:38.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.308+0000 7fdbbf200640 1 -- 172.21.15.76:0/397218770 wait complete. 2024-07-26T12:12:38.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.309+0000 7fdbbf200640 1 Processor -- start 2024-07-26T12:12:38.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 -- start start 2024-07-26T12:12:38.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbc0102fc0 0x7fdbc0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0104050 0x7fdbc0199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 0x7fdbc019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc010eb20 con 0x7fdbc0104050 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc010e9a0 con 0x7fdbc01049f0 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbf200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc010eca0 con 0x7fdbc0102fc0 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbe800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 0x7fdbc019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbe800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 0x7fdbc019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40342/0 (socket says 172.21.15.76:40342) 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.310+0000 7fdbbe800640 1 -- 172.21.15.76:0/379147161 learned_addr learned my addr 172.21.15.76:0/379147161 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbde00640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbc0102fc0 0x7fdbc0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:38.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbd400640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0104050 0x7fdbc0199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbe800640 1 -- 172.21.15.76:0/379147161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbc0102fc0 msgr2=0x7fdbc0199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbe800640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbc0102fc0 0x7fdbc0199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbe800640 1 -- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0104050 msgr2=0x7fdbc0199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbe800640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0104050 0x7fdbc0199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbe800640 1 -- 172.21.15.76:0/379147161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc019b1c0 con 0x7fdbc01049f0 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbd400640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0104050 0x7fdbc0199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.311+0000 7fdbbe800640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 0x7fdbc019a9a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800cad0 tx=0x7fdbb800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:12:38.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.312+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800ae20 con 0x7fdbc01049f0 2024-07-26T12:12:38.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.312+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb8005020 con 0x7fdbc01049f0 2024-07-26T12:12:38.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.312+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc019b4b0 con 0x7fdbc01049f0 2024-07-26T12:12:38.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.312+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800f6b0 con 0x7fdbc01049f0 2024-07-26T12:12:38.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.312+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc01a1bb0 con 0x7fdbc01049f0 2024-07-26T12:12:38.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.313+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc010a1a0 con 0x7fdbc01049f0 2024-07-26T12:12:38.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.316+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fdbb80051d0 con 0x7fdbc01049f0 2024-07-26T12:12:38.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.317+0000 7fdbb6a00640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdba40b3bd0 0x7fdba40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:12:38.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.317+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7fdbb80e2e20 con 0x7fdbc01049f0 2024-07-26T12:12:38.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.318+0000 7fdbbde00640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdba40b3bd0 0x7fdba40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:12:38.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.319+0000 7fdbbde00640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdba40b3bd0 0x7fdba40b60e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00058c0 tx=0x7fdbb000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:12:38.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.322+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdbb8014030 con 0x7fdbc01049f0 2024-07-26T12:12:38.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:12:38.534+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fdbc0063230 con 0x7fdba40b3bd0 2024-07-26T12:12:39.546 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:39 smithi076 ceph-mon[35401]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T12:12:39.546 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:12:39.546 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:12:39.547 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:39 smithi040 ceph-mon[32397]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T12:12:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:12:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:12:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:39 smithi146 ceph-mon[35807]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T12:12:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:12:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:12:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:40 smithi076 ceph-mon[35401]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:12:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:40 smithi040 ceph-mon[32397]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:12:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:40 smithi146 ceph-mon[35807]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:12:41.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:41 smithi076 ceph-mon[35401]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-07-26T12:12:41.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:41 smithi146 ceph-mon[35807]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-07-26T12:12:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:41 smithi040 ceph-mon[32397]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-07-26T12:12:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:42 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/284027475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]: dispatch 2024-07-26T12:12:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:42 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]: dispatch 2024-07-26T12:12:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:42 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]': finished 2024-07-26T12:12:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:42 smithi040 ceph-mon[32397]: osdmap e28: 5 total, 4 up, 5 in 2024-07-26T12:12:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:42 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:12:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:42 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/284027475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]: dispatch 2024-07-26T12:12:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:42 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]: dispatch 2024-07-26T12:12:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:42 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]': finished 2024-07-26T12:12:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:42 smithi146 ceph-mon[35807]: osdmap e28: 5 total, 4 up, 5 in 2024-07-26T12:12:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:42 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:12:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:42 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/284027475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]: dispatch 2024-07-26T12:12:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:42 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]: dispatch 2024-07-26T12:12:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:42 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e"}]': finished 2024-07-26T12:12:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:42 smithi076 ceph-mon[35401]: osdmap e28: 5 total, 4 up, 5 in 2024-07-26T12:12:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:42 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:12:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:43 smithi146 ceph-mon[35807]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-07-26T12:12:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:43 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/1352056837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:12:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:43 smithi040 ceph-mon[32397]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-07-26T12:12:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:43 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/1352056837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:12:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:43 smithi076 ceph-mon[35401]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-07-26T12:12:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:43 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/1352056837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:12:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:45 smithi076 ceph-mon[35401]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-07-26T12:12:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:45 smithi040 ceph-mon[32397]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-07-26T12:12:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:45 smithi146 ceph-mon[35807]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-07-26T12:12:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:47 smithi146 ceph-mon[35807]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:47 smithi076 ceph-mon[35401]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:47 smithi040 ceph-mon[32397]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:49.776 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:49 smithi076 ceph-mon[35401]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:49 smithi146 ceph-mon[35807]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:49 smithi040 ceph-mon[32397]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:51 smithi146 ceph-mon[35807]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:51 smithi076 ceph-mon[35401]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:51 smithi040 ceph-mon[32397]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-26T12:12:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-26T12:12:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-07-26T12:12:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:12:53.801 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:53 smithi076 ceph-mon[35401]: Deploying daemon osd.4 on smithi076 2024-07-26T12:12:53.801 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:53 smithi076 ceph-mon[35401]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:53 smithi146 ceph-mon[35807]: Deploying daemon osd.4 on smithi076 2024-07-26T12:12:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:53 smithi146 ceph-mon[35807]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:53 smithi040 ceph-mon[32397]: Deploying daemon osd.4 on smithi076 2024-07-26T12:12:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:53 smithi040 ceph-mon[32397]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:54 smithi146 ceph-mon[35807]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:54 smithi076 ceph-mon[35401]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:54 smithi040 ceph-mon[32397]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:56.980 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:56 smithi076 ceph-mon[35401]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:56 smithi146 ceph-mon[35807]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:56 smithi040 ceph-mon[32397]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:59.035 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:12:58 smithi076 ceph-mon[35401]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:12:58 smithi146 ceph-mon[35807]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:12:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:12:58 smithi040 ceph-mon[32397]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:00 smithi146 ceph-mon[35807]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:00 smithi076 ceph-mon[35401]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:00 smithi040 ceph-mon[32397]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:02 smithi146 ceph-mon[35807]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:02 smithi076 ceph-mon[35401]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:03.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:02 smithi040 ceph-mon[32397]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.231 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:04.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.633+0000 7fdbb6a00640 1 -- 172.21.15.76:0/379147161 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdbc0063230 con 0x7fdba40b3bd0 2024-07-26T12:13:04.635 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 4 on host 'smithi076' 2024-07-26T12:13:04.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdba40b3bd0 msgr2=0x7fdba40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:04.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdba40b3bd0 0x7fdba40b60e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00058c0 tx=0x7fdbb000a2d0 comp rx=0 tx=0).stop 2024-07-26T12:13:04.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 msgr2=0x7fdbc019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:04.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 0x7fdbc019a9a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800cad0 tx=0x7fdbb800cf90 comp rx=0 tx=0).stop 2024-07-26T12:13:04.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 shutdown_connections 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbc01049f0 0x7fdbc019a9a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbc0104050 0x7fdbc0199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdba40b3bd0 0x7fdba40b60e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 --2- 172.21.15.76:0/379147161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbc0102fc0 0x7fdbc0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 >> 172.21.15.76:0/379147161 conn(0x7fdbc00fe930 msgr2=0x7fdbc0107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.637+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 shutdown_connections 2024-07-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:13:04.638+0000 7fdbbf200640 1 -- 172.21.15.76:0/379147161 wait complete. 2024-07-26T12:13:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:04 smithi040 ceph-mon[32397]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:04 smithi040 ceph-mon[32397]: from='osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T12:13:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:04 smithi040 ceph-mon[32397]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T12:13:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:04 smithi146 ceph-mon[35807]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:04 smithi146 ceph-mon[35807]: from='osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T12:13:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:04 smithi146 ceph-mon[35807]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T12:13:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:05.322 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:04 smithi076 ceph-mon[35401]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:05.323 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:04 smithi076 ceph-mon[35401]: from='osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T12:13:05.323 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:04 smithi076 ceph-mon[35401]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-07-26T12:13:05.323 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:05.323 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:05.323 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:05.400 DEBUG:teuthology.orchestra.run.smithi076:osd.4> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.4.service 2024-07-26T12:13:05.406 INFO:tasks.cephadm:Deploying osd.5 on smithi146 with /dev/vg_nvme/lv_3... 2024-07-26T12:13:05.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-07-26T12:13:05.856 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:13:06.207 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:05 smithi146 ceph-mon[35807]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-26T12:13:06.207 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:05 smithi146 ceph-mon[35807]: osdmap e29: 5 total, 4 up, 5 in 2024-07-26T12:13:06.207 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:05 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:06.207 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:05 smithi146 ceph-mon[35807]: from='osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:13:06.207 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:05 smithi146 ceph-mon[35807]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:13:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:05 smithi040 ceph-mon[32397]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-26T12:13:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:05 smithi040 ceph-mon[32397]: osdmap e29: 5 total, 4 up, 5 in 2024-07-26T12:13:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:05 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:05 smithi040 ceph-mon[32397]: from='osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:13:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:05 smithi040 ceph-mon[32397]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:13:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:05 smithi076 ceph-mon[35401]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-07-26T12:13:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:05 smithi076 ceph-mon[35401]: osdmap e29: 5 total, 4 up, 5 in 2024-07-26T12:13:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:05 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:05 smithi076 ceph-mon[35401]: from='osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:13:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:05 smithi076 ceph-mon[35401]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: osdmap e30: 5 total, 4 up, 5 in 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:07.202 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:07.203 INFO:journalctl@ceph.osd.4.smithi076.stdout:Jul 26 12:13:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-4[46602]: 2024-07-26T12:13:07.016+0000 7f4d9f600640 -1 osd.4 0 waiting for initial osdmap 2024-07-26T12:13:07.203 INFO:journalctl@ceph.osd.4.smithi076.stdout:Jul 26 12:13:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-4[46602]: 2024-07-26T12:13:07.049+0000 7f4d95600640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:13:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: osdmap e30: 5 total, 4 up, 5 in 2024-07-26T12:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: osdmap e30: 5 total, 4 up, 5 in 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:07.268 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:07 smithi040 ceph-mon[32397]: from='osd.4 ' entity='osd.4' 2024-07-26T12:13:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:07 smithi146 ceph-mon[35807]: from='osd.4 ' entity='osd.4' 2024-07-26T12:13:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:07 smithi076 ceph-mon[35401]: from='osd.4 ' entity='osd.4' 2024-07-26T12:13:08.421 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-07-26T12:13:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-07-26T12:13:08.671 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-07-26T12:13:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-07-26T12:13:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0349351 s, 300 MB/s 2024-07-26T12:13:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-07-26T12:13:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:08 smithi146 ceph-mon[35807]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:08 smithi146 ceph-mon[35807]: osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] boot 2024-07-26T12:13:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:08 smithi146 ceph-mon[35807]: osdmap e31: 5 total, 5 up, 5 in 2024-07-26T12:13:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:08 smithi040 ceph-mon[32397]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:08 smithi040 ceph-mon[32397]: osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] boot 2024-07-26T12:13:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:08 smithi040 ceph-mon[32397]: osdmap e31: 5 total, 5 up, 5 in 2024-07-26T12:13:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:08 smithi076 ceph-mon[35401]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-07-26T12:13:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:08 smithi076 ceph-mon[35401]: osd.4 [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] boot 2024-07-26T12:13:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:08 smithi076 ceph-mon[35401]: osdmap e31: 5 total, 5 up, 5 in 2024-07-26T12:13:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-07-26T12:13:09.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_3 2024-07-26T12:13:09.962 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi076 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 8544M 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:10.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:10.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:10.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:10 smithi146 ceph-mon[35807]: osdmap e32: 5 total, 5 up, 5 in 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi076 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 8544M 2024-07-26T12:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:10 smithi076 ceph-mon[35401]: osdmap e32: 5 total, 5 up, 5 in 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi076 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 8544M 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:10 smithi040 ceph-mon[32397]: osdmap e32: 5 total, 5 up, 5 in 2024-07-26T12:13:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 -- 172.21.15.146:0/2777002544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8104220 msgr2=0x7f62a8104630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 --2- 172.21.15.146:0/2777002544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8104220 0x7f62a8104630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6294009900 tx=0x7f629402a480 comp rx=0 tx=0).stop 2024-07-26T12:13:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 -- 172.21.15.146:0/2777002544 shutdown_connections 2024-07-26T12:13:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 --2- 172.21.15.146:0/2777002544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a8104bc0 0x7f62a810b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:12.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 --2- 172.21.15.146:0/2777002544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8104220 0x7f62a8104630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 --2- 172.21.15.146:0/2777002544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8103190 0x7f62a8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.379+0000 7f62ad600640 1 -- 172.21.15.146:0/2777002544 >> 172.21.15.146:0/2777002544 conn(0x7f62a80feae0 msgr2=0x7f62a8100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.380+0000 7f62ad600640 1 -- 172.21.15.146:0/2777002544 shutdown_connections 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.380+0000 7f62ad600640 1 -- 172.21.15.146:0/2777002544 wait complete. 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 Processor -- start 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 -- start start 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 0x7f62a819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8104220 0x7f62a819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a8104bc0 0x7f62a819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62a810eca0 con 0x7f62a8104220 2024-07-26T12:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f62a810eb20 con 0x7f62a8104bc0 2024-07-26T12:13:12.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62ad600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62a810ee20 con 0x7f62a8103190 2024-07-26T12:13:12.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.381+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 0x7f62a819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:12.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 0x7f62a819bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39504/0 (socket says 172.21.15.146:39504) 2024-07-26T12:13:12.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 -- 172.21.15.146:0/3091289214 learned_addr learned my addr 172.21.15.146:0/3091289214 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-07-26T12:13:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6000640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8104220 0x7f62a819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a7400640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a8104bc0 0x7f62a819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 -- 172.21.15.146:0/3091289214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a8104bc0 msgr2=0x7f62a819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a8104bc0 0x7f62a819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 -- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8104220 msgr2=0x7f62a819c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8104220 0x7f62a819c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6a00640 1 -- 172.21.15.146:0/3091289214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a819d570 con 0x7f62a8103190 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.382+0000 7f62a6000640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8104220 0x7f62a819c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.383+0000 7f62a6a00640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 0x7f62a819bb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f629800d950 tx=0x7f629800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.383+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298017070 con 0x7f62a8103190 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.383+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a819d860 con 0x7f62a8103190 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.383+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6298009c30 con 0x7f62a8103190 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.383+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629800f620 con 0x7f62a8103190 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.383+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a81a3f60 con 0x7f62a8103190 2024-07-26T12:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.384+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a81a4130 con 0x7f62a8103190 2024-07-26T12:13:12.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.387+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6298005030 con 0x7f62a8103190 2024-07-26T12:13:12.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.389+0000 7f629f400640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f628c0b3c50 0x7f628c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:12.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.389+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7f62980e28a0 con 0x7f62a8103190 2024-07-26T12:13:12.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.389+0000 7f62a6000640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f628c0b3c50 0x7f628c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:12.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.391+0000 7f62a6000640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f628c0b3c50 0x7f628c0b6160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6294000c00 tx=0x7f6294031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:13:12.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.396+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f62980aaec0 con 0x7f62a8103190 2024-07-26T12:13:12.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:12.607+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f62a8076740 con 0x7f628c0b3c50 2024-07-26T12:13:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:12 smithi146 ceph-mon[35807]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:13.115 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:13:13.115 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:13:13.115 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:13.116 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:12 smithi076 ceph-mon[35401]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:13.116 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:13:13.116 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:13:13.116 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:12 smithi040 ceph-mon[32397]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:13:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:13:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:13 smithi146 ceph-mon[35807]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:13:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:13 smithi076 ceph-mon[35401]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:13:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:13 smithi040 ceph-mon[32397]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:13:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:14 smithi146 ceph-mon[35807]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:14 smithi076 ceph-mon[35401]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:14 smithi040 ceph-mon[32397]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:17.018 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:16 smithi146 ceph-mon[35807]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:17.018 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:16 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/1401882954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]: dispatch 2024-07-26T12:13:17.018 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:16 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]: dispatch 2024-07-26T12:13:17.018 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:16 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]': finished 2024-07-26T12:13:17.018 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:16 smithi146 ceph-mon[35807]: osdmap e33: 6 total, 5 up, 6 in 2024-07-26T12:13:17.018 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:16 smithi076 ceph-mon[35401]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:16 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/1401882954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]: dispatch 2024-07-26T12:13:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:16 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]: dispatch 2024-07-26T12:13:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:16 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]': finished 2024-07-26T12:13:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:16 smithi076 ceph-mon[35401]: osdmap e33: 6 total, 5 up, 6 in 2024-07-26T12:13:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:16 smithi040 ceph-mon[32397]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:16 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/1401882954' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]: dispatch 2024-07-26T12:13:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:16 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]: dispatch 2024-07-26T12:13:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:16 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80c9a4cc-0633-4e04-ace3-ed165c2d9bbf"}]': finished 2024-07-26T12:13:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:16 smithi040 ceph-mon[32397]: osdmap e33: 6 total, 5 up, 6 in 2024-07-26T12:13:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/1376084992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:13:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/1376084992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:13:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/1376084992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:13:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:18 smithi040 ceph-mon[32397]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:18 smithi146 ceph-mon[35807]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:18 smithi076 ceph-mon[35401]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:20 smithi040 ceph-mon[32397]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:21.315 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:20 smithi146 ceph-mon[35807]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:20 smithi076 ceph-mon[35401]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:22 smithi040 ceph-mon[32397]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:22 smithi146 ceph-mon[35807]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:22 smithi076 ceph-mon[35401]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:25.174 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:24 smithi146 ceph-mon[35807]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:24 smithi040 ceph-mon[32397]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:24 smithi076 ceph-mon[35401]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:26 smithi040 ceph-mon[32397]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-26T12:13:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:26 smithi040 ceph-mon[32397]: Deploying daemon osd.5 on smithi146 2024-07-26T12:13:27.244 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:26 smithi076 ceph-mon[35401]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:27.244 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-26T12:13:27.244 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:27.244 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:26 smithi076 ceph-mon[35401]: Deploying daemon osd.5 on smithi146 2024-07-26T12:13:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:26 smithi146 ceph-mon[35807]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-07-26T12:13:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:26 smithi146 ceph-mon[35807]: Deploying daemon osd.5 on smithi146 2024-07-26T12:13:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:28 smithi146 ceph-mon[35807]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:28 smithi040 ceph-mon[32397]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:28 smithi076 ceph-mon[35401]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:30 smithi146 ceph-mon[35807]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:30 smithi040 ceph-mon[32397]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:30 smithi076 ceph-mon[35401]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:33.221 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:32 smithi146 ceph-mon[35807]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:32 smithi040 ceph-mon[32397]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:32 smithi076 ceph-mon[35401]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:34 smithi040 ceph-mon[32397]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:34 smithi146 ceph-mon[35807]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:34 smithi076 ceph-mon[35401]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:36.103 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:36.103 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:36.103 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:37 smithi146 ceph-mon[35807]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:37 smithi040 ceph-mon[32397]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:37 smithi076 ceph-mon[35401]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:39.435 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:39 smithi146 ceph-mon[35807]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:39.435 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.435 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.435 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:39.435 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:39.435 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:39 smithi040 ceph-mon[32397]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:39 smithi076 ceph-mon[35401]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:40.274 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 5 on host 'smithi146' 2024-07-26T12:13:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.271+0000 7f629f400640 1 -- 172.21.15.146:0/3091289214 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f62a8076740 con 0x7f628c0b3c50 2024-07-26T12:13:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.275+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f628c0b3c50 msgr2=0x7f628c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.275+0000 7f62ad600640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f628c0b3c50 0x7f628c0b6160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6294000c00 tx=0x7f6294031420 comp rx=0 tx=0).stop 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 msgr2=0x7f62a819bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 0x7f62a819bb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f629800d950 tx=0x7f629800de10 comp rx=0 tx=0).stop 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 shutdown_connections 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a8104bc0 0x7f62a819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a8104220 0x7f62a819c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f628c0b3c50 0x7f628c0b6160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 --2- 172.21.15.146:0/3091289214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8103190 0x7f62a819bb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 >> 172.21.15.146:0/3091289214 conn(0x7f62a80feae0 msgr2=0x7f62a8075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:13:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 shutdown_connections 2024-07-26T12:13:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:13:40.276+0000 7f62ad600640 1 -- 172.21.15.146:0/3091289214 wait complete. 2024-07-26T12:13:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: from='osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T12:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T12:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-26T12:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: osdmap e34: 6 total, 5 up, 6 in 2024-07-26T12:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: from='osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:40 smithi040 ceph-mon[32397]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:13:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: from='osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T12:13:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T12:13:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-26T12:13:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: osdmap e34: 6 total, 5 up, 6 in 2024-07-26T12:13:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: from='osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:13:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:40 smithi146 ceph-mon[35807]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: from='osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: osdmap e34: 6 total, 5 up, 6 in 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: from='osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:40 smithi076 ceph-mon[35401]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:13:41.184 DEBUG:teuthology.orchestra.run.smithi146:osd.5> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.5.service 2024-07-26T12:13:41.188 INFO:tasks.cephadm:Deploying osd.6 on smithi040 with /dev/vg_nvme/lv_2... 2024-07-26T12:13:41.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-26T12:13:41.419 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:41.419 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:41.420 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:41.420 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:41.420 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:13:41.420 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: osdmap e35: 6 total, 5 up, 6 in 2024-07-26T12:13:41.420 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:41.420 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: osdmap e35: 6 total, 5 up, 6 in 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: osdmap e35: 6 total, 5 up, 6 in 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:41.680 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:13:42.494 INFO:journalctl@ceph.osd.5.smithi146.stdout:Jul 26 12:13:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-5[47574]: 2024-07-26T12:13:42.135+0000 7fa33f800640 -1 osd.5 0 waiting for initial osdmap 2024-07-26T12:13:42.494 INFO:journalctl@ceph.osd.5.smithi146.stdout:Jul 26 12:13:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-5[47574]: 2024-07-26T12:13:42.165+0000 7fa335800640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:13:43.335 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:13:43.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:13:43.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:43.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: osdmap e36: 6 total, 5 up, 6 in 2024-07-26T12:13:43.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:43.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:43.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:43 smithi040 ceph-mon[32397]: from='osd.5 ' entity='osd.5' 2024-07-26T12:13:43.509 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:13:43.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:13:43.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:43.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: osdmap e36: 6 total, 5 up, 6 in 2024-07-26T12:13:43.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:43.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:43.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:43 smithi146 ceph-mon[35807]: from='osd.5 ' entity='osd.5' 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: osdmap e36: 6 total, 5 up, 6 in 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:43 smithi076 ceph-mon[35401]: from='osd.5 ' entity='osd.5' 2024-07-26T12:13:44.161 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-26T12:13:44.366 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-26T12:13:44.367 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:44 smithi040 ceph-mon[32397]: osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] boot 2024-07-26T12:13:44.367 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:44 smithi040 ceph-mon[32397]: osdmap e37: 6 total, 6 up, 6 in 2024-07-26T12:13:44.367 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:44.367 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:44 smithi040 ceph-mon[32397]: osdmap e38: 6 total, 6 up, 6 in 2024-07-26T12:13:44.409 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-07-26T12:13:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-07-26T12:13:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0358158 s, 293 MB/s 2024-07-26T12:13:44.410 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-07-26T12:13:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:44 smithi146 ceph-mon[35807]: osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] boot 2024-07-26T12:13:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:44 smithi146 ceph-mon[35807]: osdmap e37: 6 total, 6 up, 6 in 2024-07-26T12:13:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:44 smithi146 ceph-mon[35807]: osdmap e38: 6 total, 6 up, 6 in 2024-07-26T12:13:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:44 smithi076 ceph-mon[35401]: osd.5 [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] boot 2024-07-26T12:13:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:44 smithi076 ceph-mon[35401]: osdmap e37: 6 total, 6 up, 6 in 2024-07-26T12:13:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-07-26T12:13:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:44 smithi076 ceph-mon[35401]: osdmap e38: 6 total, 6 up, 6 in 2024-07-26T12:13:45.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_2 2024-07-26T12:13:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:45 smithi146 ceph-mon[35807]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:45 smithi146 ceph-mon[35807]: osdmap e39: 6 total, 6 up, 6 in 2024-07-26T12:13:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:45 smithi040 ceph-mon[32397]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:45 smithi040 ceph-mon[32397]: osdmap e39: 6 total, 6 up, 6 in 2024-07-26T12:13:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:45 smithi076 ceph-mon[35401]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:45 smithi076 ceph-mon[35401]: osdmap e39: 6 total, 6 up, 6 in 2024-07-26T12:13:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:13:47.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi146 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 8544M 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi146 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 8544M 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi146 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 8544M 2024-07-26T12:13:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:47.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:13:47.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 -- 172.21.15.40:0/2774175115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c106c00 msgr2=0x7f040c10d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 --2- 172.21.15.40:0/2774175115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c106c00 0x7f040c10d5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0404009ca0 tx=0x7f040402a950 comp rx=0 tx=0).stop 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 -- 172.21.15.40:0/2774175115 shutdown_connections 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 --2- 172.21.15.40:0/2774175115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c106c00 0x7f040c10d5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 --2- 172.21.15.40:0/2774175115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c106260 0x7f040c106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 --2- 172.21.15.40:0/2774175115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f040c1051d0 0x7f040c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 -- 172.21.15.40:0/2774175115 >> 172.21.15.40:0/2774175115 conn(0x7f040c100b60 msgr2=0x7f040c102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:13:47.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 -- 172.21.15.40:0/2774175115 shutdown_connections 2024-07-26T12:13:47.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.698+0000 7f040be00640 1 -- 172.21.15.40:0/2774175115 wait complete. 2024-07-26T12:13:47.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.699+0000 7f040be00640 1 Processor -- start 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.699+0000 7f040be00640 1 -- start start 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 0x7f040c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f040c106260 0x7f040c19bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c106c00 0x7f040c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f040c110ce0 con 0x7f040c1051d0 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f040c110b60 con 0x7f040c106260 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f040c110e60 con 0x7f040c106c00 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 0x7f040c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 0x7f040c19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33834/0 (socket says 172.21.15.40:33834) 2024-07-26T12:13:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040aa00640 1 -- 172.21.15.40:0/560361215 learned_addr learned my addr 172.21.15.40:0/560361215 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.700+0000 7f040a000640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f040c106260 0x7f040c19bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040b400640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c106c00 0x7f040c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040aa00640 1 -- 172.21.15.40:0/560361215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c106c00 msgr2=0x7f040c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040aa00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c106c00 0x7f040c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040aa00640 1 -- 172.21.15.40:0/560361215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f040c106260 msgr2=0x7f040c19bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040aa00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f040c106260 0x7f040c19bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040aa00640 1 -- 172.21.15.40:0/560361215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c19d350 con 0x7f040c1051d0 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f040aa00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 0x7f040c19b920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00d950 tx=0x7f03fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.701+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc017070 con 0x7f040c1051d0 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.702+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c19d640 con 0x7f040c1051d0 2024-07-26T12:13:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.702+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03fc009c30 con 0x7f040c1051d0 2024-07-26T12:13:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.702+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00f620 con 0x7f040c1051d0 2024-07-26T12:13:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.702+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a3d40 con 0x7f040c1051d0 2024-07-26T12:13:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.703+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c10c3b0 con 0x7f040c1051d0 2024-07-26T12:13:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.706+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f03fc010460 con 0x7f040c1051d0 2024-07-26T12:13:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.709+0000 7f0403400640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03f00b3c50 0x7f03f00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:13:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.709+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7f03fc0e2a40 con 0x7f040c1051d0 2024-07-26T12:13:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.709+0000 7f040a000640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03f00b3c50 0x7f03f00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:13:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.710+0000 7f040a000640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03f00b3c50 0x7f03f00b6160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03f8005fd0 tx=0x7f03f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:13:47.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.712+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f03fc0aaf30 con 0x7f040c1051d0 2024-07-26T12:13:47.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:13:47.925+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f040c063230 con 0x7f03f00b3c50 2024-07-26T12:13:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:13:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:13:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:13:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:13:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:13:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:13:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:13:49.211 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:48 smithi040 ceph-mon[32397]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-07-26T12:13:49.211 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:48 smithi040 ceph-mon[32397]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:13:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:48 smithi146 ceph-mon[35807]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-07-26T12:13:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:48 smithi146 ceph-mon[35807]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:13:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:48 smithi076 ceph-mon[35401]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-07-26T12:13:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:48 smithi076 ceph-mon[35401]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:13:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:50 smithi040 ceph-mon[32397]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-07-26T12:13:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:50 smithi146 ceph-mon[35807]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-07-26T12:13:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:50 smithi076 ceph-mon[35401]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-07-26T12:13:52.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1752532205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c801bf68-146c-40f3-98f0-adda7821387a"}]: dispatch 2024-07-26T12:13:52.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1752532205' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c801bf68-146c-40f3-98f0-adda7821387a"}]': finished 2024-07-26T12:13:52.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:51 smithi040 ceph-mon[32397]: osdmap e40: 7 total, 6 up, 7 in 2024-07-26T12:13:52.261 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:13:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1752532205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c801bf68-146c-40f3-98f0-adda7821387a"}]: dispatch 2024-07-26T12:13:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1752532205' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c801bf68-146c-40f3-98f0-adda7821387a"}]': finished 2024-07-26T12:13:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:51 smithi146 ceph-mon[35807]: osdmap e40: 7 total, 6 up, 7 in 2024-07-26T12:13:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:13:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1752532205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c801bf68-146c-40f3-98f0-adda7821387a"}]: dispatch 2024-07-26T12:13:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1752532205' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c801bf68-146c-40f3-98f0-adda7821387a"}]': finished 2024-07-26T12:13:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:51 smithi076 ceph-mon[35401]: osdmap e40: 7 total, 6 up, 7 in 2024-07-26T12:13:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:13:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:52 smithi040 ceph-mon[32397]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T12:13:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2926143633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:13:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:52 smithi146 ceph-mon[35807]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T12:13:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2926143633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:13:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:52 smithi076 ceph-mon[35401]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T12:13:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2926143633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:13:55.295 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:55 smithi040 ceph-mon[32397]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-07-26T12:13:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:55 smithi146 ceph-mon[35807]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-07-26T12:13:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:55 smithi076 ceph-mon[35401]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-07-26T12:13:57.048 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:57 smithi040 ceph-mon[32397]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:57 smithi146 ceph-mon[35807]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:57 smithi076 ceph-mon[35401]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:59.127 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:13:59 smithi040 ceph-mon[32397]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:13:59 smithi146 ceph-mon[35807]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:13:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:13:59 smithi076 ceph-mon[35401]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:01.207 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:01 smithi040 ceph-mon[32397]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:01 smithi146 ceph-mon[35807]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:01 smithi076 ceph-mon[35401]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-26T12:14:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:02.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-26T12:14:02.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:02.361 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-07-26T12:14:02.361 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:03 smithi146 ceph-mon[35807]: Deploying daemon osd.6 on smithi040 2024-07-26T12:14:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:03 smithi146 ceph-mon[35807]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:03 smithi076 ceph-mon[35401]: Deploying daemon osd.6 on smithi040 2024-07-26T12:14:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:03 smithi076 ceph-mon[35401]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:03.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:03 smithi040 ceph-mon[32397]: Deploying daemon osd.6 on smithi040 2024-07-26T12:14:03.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:03 smithi040 ceph-mon[32397]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:05 smithi040 ceph-mon[32397]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:05 smithi146 ceph-mon[35807]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:05 smithi076 ceph-mon[35401]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:07 smithi040 ceph-mon[32397]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:07 smithi146 ceph-mon[35807]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:07 smithi076 ceph-mon[35401]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:09 smithi146 ceph-mon[35807]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:09 smithi076 ceph-mon[35401]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:09.340 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:09 smithi040 ceph-mon[32397]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:11 smithi040 ceph-mon[32397]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:11 smithi146 ceph-mon[35807]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:11 smithi076 ceph-mon[35401]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:13 smithi146 ceph-mon[35807]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:13 smithi076 ceph-mon[35401]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:13 smithi040 ceph-mon[32397]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:14 smithi040 ceph-mon[32397]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-26T12:14:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:14 smithi146 ceph-mon[35807]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-26T12:14:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:14 smithi076 ceph-mon[35401]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-07-26T12:14:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:14.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.943+0000 7f0403400640 1 -- 172.21.15.40:0/560361215 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f040c063230 con 0x7f03f00b3c50 2024-07-26T12:14:14.946 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 6 on host 'smithi040' 2024-07-26T12:14:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03f00b3c50 msgr2=0x7f03f00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03f00b3c50 0x7f03f00b6160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03f8005fd0 tx=0x7f03f8005850 comp rx=0 tx=0).stop 2024-07-26T12:14:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 msgr2=0x7f040c19b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 0x7f040c19b920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00d950 tx=0x7f03fc00de10 comp rx=0 tx=0).stop 2024-07-26T12:14:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 shutdown_connections 2024-07-26T12:14:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03f00b3c50 0x7f03f00b6160 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c106c00 0x7f040c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f040c106260 0x7f040c19bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 --2- 172.21.15.40:0/560361215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040c1051d0 0x7f040c19b920 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.947+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 >> 172.21.15.40:0/560361215 conn(0x7f040c100b60 msgr2=0x7f040c109580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:14:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.948+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 shutdown_connections 2024-07-26T12:14:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:14:14.948+0000 7f040be00640 1 -- 172.21.15.40:0/560361215 wait complete. 2024-07-26T12:14:15.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:15.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-26T12:14:15.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: osdmap e41: 7 total, 6 up, 7 in 2024-07-26T12:14:15.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:14:15.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:15.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:15.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:15.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: osdmap e41: 7 total, 6 up, 7 in 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: osdmap e41: 7 total, 6 up, 7 in 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:15.865 DEBUG:teuthology.orchestra.run.smithi040:osd.6> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.6.service 2024-07-26T12:14:15.870 INFO:tasks.cephadm:Deploying osd.7 on smithi076 with /dev/vg_nvme/lv_2... 2024-07-26T12:14:15.871 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-26T12:14:16.338 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:14:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:16 smithi040 ceph-mon[32397]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:14:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:16 smithi040 ceph-mon[32397]: osdmap e42: 7 total, 6 up, 7 in 2024-07-26T12:14:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:16.772 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:16 smithi076 ceph-mon[35401]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:14:16.772 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:16 smithi076 ceph-mon[35401]: osdmap e42: 7 total, 6 up, 7 in 2024-07-26T12:14:16.772 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:16.772 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:16 smithi146 ceph-mon[35807]: from='osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:14:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:16 smithi146 ceph-mon[35807]: osdmap e42: 7 total, 6 up, 7 in 2024-07-26T12:14:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:17 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:17 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:17 smithi040 ceph-mon[32397]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:17 smithi040 ceph-mon[32397]: osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] boot 2024-07-26T12:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:17 smithi040 ceph-mon[32397]: osdmap e43: 7 total, 7 up, 7 in 2024-07-26T12:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:17 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:14:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:17 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:14:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:17 smithi146 ceph-mon[35807]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:17 smithi146 ceph-mon[35807]: osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] boot 2024-07-26T12:14:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:17 smithi146 ceph-mon[35807]: osdmap e43: 7 total, 7 up, 7 in 2024-07-26T12:14:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:17 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:14:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:17 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:14:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:17 smithi076 ceph-mon[35401]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-07-26T12:14:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:17 smithi076 ceph-mon[35401]: osd.6 [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] boot 2024-07-26T12:14:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:17 smithi076 ceph-mon[35401]: osdmap e43: 7 total, 7 up, 7 in 2024-07-26T12:14:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-07-26T12:14:18.713 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-26T12:14:18.760 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:18 smithi076 ceph-mon[35401]: osdmap e44: 7 total, 7 up, 7 in 2024-07-26T12:14:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:18 smithi146 ceph-mon[35807]: osdmap e44: 7 total, 7 up, 7 in 2024-07-26T12:14:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-26T12:14:18.953 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-07-26T12:14:18.953 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-07-26T12:14:18.953 INFO:teuthology.orchestra.run.smithi076.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0302546 s, 347 MB/s 2024-07-26T12:14:18.954 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-07-26T12:14:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:18 smithi040 ceph-mon[32397]: osdmap e44: 7 total, 7 up, 7 in 2024-07-26T12:14:19.671 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:19 smithi076 ceph-mon[35401]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:19.721 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_2 2024-07-26T12:14:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:19 smithi040 ceph-mon[32397]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:19 smithi146 ceph-mon[35807]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:20.166 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi040 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 5698M 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:21.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:21.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi040 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 5698M 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi040 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 5698M 2024-07-26T12:14:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:22.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 -- 172.21.15.76:0/1772554951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab8010b000 msgr2=0x7fab801119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 --2- 172.21.15.76:0/1772554951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab8010b000 0x7fab801119a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009ca0 tx=0x7fab7c02a950 comp rx=0 tx=0).stop 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 -- 172.21.15.76:0/1772554951 shutdown_connections 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 --2- 172.21.15.76:0/1772554951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab8010b000 0x7fab801119a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 --2- 172.21.15.76:0/1772554951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 0x7fab8010aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 --2- 172.21.15.76:0/1772554951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab801095d0 0x7fab80109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.220+0000 7fab87200640 1 -- 172.21.15.76:0/1772554951 >> 172.21.15.76:0/1772554951 conn(0x7fab80078970 msgr2=0x7fab8007ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.221+0000 7fab87200640 1 -- 172.21.15.76:0/1772554951 shutdown_connections 2024-07-26T12:14:22.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.221+0000 7fab87200640 1 -- 172.21.15.76:0/1772554951 wait complete. 2024-07-26T12:14:22.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.222+0000 7fab87200640 1 Processor -- start 2024-07-26T12:14:22.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.222+0000 7fab87200640 1 -- start start 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab87200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 0x7fab8019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab87200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 0x7fab801a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab87200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8010b000 0x7fab801a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab87200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fab80115100 con 0x7fab8010b000 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab87200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fab80114f80 con 0x7fab801095d0 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab87200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab80115280 con 0x7fab8010a660 2024-07-26T12:14:22.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab85e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 0x7fab8019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:22.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab85e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 0x7fab8019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53322/0 (socket says 172.21.15.76:53322) 2024-07-26T12:14:22.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab85e00640 1 -- 172.21.15.76:0/2893832344 learned_addr learned my addr 172.21.15.76:0/2893832344 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-07-26T12:14:22.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.223+0000 7fab85400640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 0x7fab801a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab86800640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8010b000 0x7fab801a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85e00640 1 -- 172.21.15.76:0/2893832344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 msgr2=0x7fab801a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85e00640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 0x7fab801a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85e00640 1 -- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8010b000 msgr2=0x7fab801a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85e00640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8010b000 0x7fab801a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85e00640 1 -- 172.21.15.76:0/2893832344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab801a16f0 con 0x7fab801095d0 2024-07-26T12:14:22.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85400640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 0x7fab801a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab85e00640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 0x7fab8019fd50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab7400d950 tx=0x7fab7400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74017070 con 0x7fab801095d0 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab74009c30 con 0x7fab801095d0 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab801a19e0 con 0x7fab801095d0 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.224+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7400f620 con 0x7fab801095d0 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.225+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab801a8170 con 0x7fab801095d0 2024-07-26T12:14:22.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.226+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab80109a40 con 0x7fab801095d0 2024-07-26T12:14:22.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.229+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fab74010460 con 0x7fab801095d0 2024-07-26T12:14:22.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.230+0000 7fab7aa00640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab680b3cd0 0x7fab680b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:22.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.230+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7fab740e2bf0 con 0x7fab801095d0 2024-07-26T12:14:22.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.231+0000 7fab85400640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab680b3cd0 0x7fab680b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:22.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.232+0000 7fab85400640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab680b3cd0 0x7fab680b61e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab7000abe0 tx=0x7fab7000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:14:22.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.232+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fab740aaf30 con 0x7fab801095d0 2024-07-26T12:14:22.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:22.442+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fab80063230 con 0x7fab680b3cd0 2024-07-26T12:14:23.494 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:23 smithi076 ceph-mon[35401]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:23.494 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:23 smithi076 ceph-mon[35401]: from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:14:23.494 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:14:23.494 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:14:23.494 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:23 smithi146 ceph-mon[35807]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:23 smithi146 ceph-mon[35807]: from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:14:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:14:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:14:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:23 smithi040 ceph-mon[32397]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:23 smithi040 ceph-mon[32397]: from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:14:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:14:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:14:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:25 smithi146 ceph-mon[35807]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:25 smithi076 ceph-mon[35401]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:25 smithi040 ceph-mon[32397]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:26.545 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/880853835' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]: dispatch 2024-07-26T12:14:26.545 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:26 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]: dispatch 2024-07-26T12:14:26.545 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:26 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]': finished 2024-07-26T12:14:26.545 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:26 smithi076 ceph-mon[35401]: osdmap e45: 8 total, 7 up, 8 in 2024-07-26T12:14:26.545 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/880853835' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]: dispatch 2024-07-26T12:14:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:26 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]: dispatch 2024-07-26T12:14:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:26 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]': finished 2024-07-26T12:14:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:26 smithi146 ceph-mon[35807]: osdmap e45: 8 total, 7 up, 8 in 2024-07-26T12:14:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/880853835' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]: dispatch 2024-07-26T12:14:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:26 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]: dispatch 2024-07-26T12:14:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:26 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "283de83d-e151-4f9f-b313-0a2e51d169e8"}]': finished 2024-07-26T12:14:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:26 smithi040 ceph-mon[32397]: osdmap e45: 8 total, 7 up, 8 in 2024-07-26T12:14:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:27 smithi076 ceph-mon[35401]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:27 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/91467707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:14:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:27 smithi146 ceph-mon[35807]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:27 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/91467707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:14:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:27 smithi040 ceph-mon[32397]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:27 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/91467707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:14:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:29 smithi146 ceph-mon[35807]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:29 smithi076 ceph-mon[35401]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:29 smithi040 ceph-mon[32397]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:31 smithi146 ceph-mon[35807]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:31 smithi076 ceph-mon[35401]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:31 smithi040 ceph-mon[32397]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:33.439 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:33 smithi076 ceph-mon[35401]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:33 smithi146 ceph-mon[35807]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:33 smithi040 ceph-mon[32397]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:35 smithi076 ceph-mon[35401]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-26T12:14:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:35 smithi040 ceph-mon[32397]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-26T12:14:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:35 smithi146 ceph-mon[35807]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-07-26T12:14:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:36 smithi040 ceph-mon[32397]: Deploying daemon osd.7 on smithi076 2024-07-26T12:14:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:36 smithi076 ceph-mon[35401]: Deploying daemon osd.7 on smithi076 2024-07-26T12:14:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:36 smithi146 ceph-mon[35807]: Deploying daemon osd.7 on smithi076 2024-07-26T12:14:37.541 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:37 smithi076 ceph-mon[35401]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:37 smithi040 ceph-mon[32397]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:37 smithi146 ceph-mon[35807]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:39.560 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:39 smithi076 ceph-mon[35401]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:39 smithi040 ceph-mon[32397]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:39 smithi146 ceph-mon[35807]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:41.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:41 smithi146 ceph-mon[35807]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:41 smithi040 ceph-mon[32397]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:41 smithi076 ceph-mon[35401]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:43.402 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:43 smithi076 ceph-mon[35401]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:43 smithi040 ceph-mon[32397]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:43.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:43 smithi146 ceph-mon[35807]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:44.682 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:44.682 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:44.682 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:45.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:45 smithi040 ceph-mon[32397]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:45.672 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:45 smithi076 ceph-mon[35401]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:45 smithi146 ceph-mon[35807]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:47.661 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:47 smithi076 ceph-mon[35401]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:47.661 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.661 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.661 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:47.662 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:47.662 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:47 smithi040 ceph-mon[32397]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:47 smithi146 ceph-mon[35807]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:48.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.537+0000 7fab7aa00640 1 -- 172.21.15.76:0/2893832344 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fab80063230 con 0x7fab680b3cd0 2024-07-26T12:14:48.539 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 7 on host 'smithi076' 2024-07-26T12:14:48.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab680b3cd0 msgr2=0x7fab680b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:48.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab680b3cd0 0x7fab680b61e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab7000abe0 tx=0x7fab7000a5c0 comp rx=0 tx=0).stop 2024-07-26T12:14:48.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 msgr2=0x7fab8019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:48.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 0x7fab8019fd50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab7400d950 tx=0x7fab7400de10 comp rx=0 tx=0).stop 2024-07-26T12:14:48.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 shutdown_connections 2024-07-26T12:14:48.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8010b000 0x7fab801a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:48.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab680b3cd0 0x7fab680b61e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:48.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8010a660 0x7fab801a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:48.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 --2- 172.21.15.76:0/2893832344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab801095d0 0x7fab8019fd50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:48.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 >> 172.21.15.76:0/2893832344 conn(0x7fab80078970 msgr2=0x7fab8010d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:14:48.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 shutdown_connections 2024-07-26T12:14:48.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:14:48.540+0000 7fab87200640 1 -- 172.21.15.76:0/2893832344 wait complete. 2024-07-26T12:14:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:48 smithi076 ceph-mon[35401]: from='osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T12:14:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:48 smithi076 ceph-mon[35401]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T12:14:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:48 smithi040 ceph-mon[32397]: from='osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T12:14:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:48 smithi040 ceph-mon[32397]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T12:14:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:48 smithi146 ceph-mon[35807]: from='osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T12:14:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:48 smithi146 ceph-mon[35807]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-07-26T12:14:49.322 DEBUG:teuthology.orchestra.run.smithi076:osd.7> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.7.service 2024-07-26T12:14:49.326 INFO:tasks.cephadm:Deploying osd.8 on smithi146 with /dev/vg_nvme/lv_2... 2024-07-26T12:14:49.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: osdmap e46: 8 total, 7 up, 8 in 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: osdmap e46: 8 total, 7 up, 8 in 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:49.786 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:14:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-07-26T12:14:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: osdmap e46: 8 total, 7 up, 8 in 2024-07-26T12:14:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:14:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:14:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:14:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:50 smithi146 ceph-mon[35807]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:14:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:50 smithi146 ceph-mon[35807]: osdmap e47: 8 total, 7 up, 8 in 2024-07-26T12:14:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:50 smithi076 ceph-mon[35401]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:14:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:50 smithi076 ceph-mon[35401]: osdmap e47: 8 total, 7 up, 8 in 2024-07-26T12:14:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:50.583 INFO:journalctl@ceph.osd.7.smithi076.stdout:Jul 26 12:14:50 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-7[53614]: 2024-07-26T12:14:50.478+0000 7fdbc8e00640 -1 osd.7 0 waiting for initial osdmap 2024-07-26T12:14:50.583 INFO:journalctl@ceph.osd.7.smithi076.stdout:Jul 26 12:14:50 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-7[53614]: 2024-07-26T12:14:50.528+0000 7fdbbee00640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:14:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:50 smithi040 ceph-mon[32397]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:14:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:50 smithi040 ceph-mon[32397]: osdmap e47: 8 total, 7 up, 8 in 2024-07-26T12:14:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:14:51.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:14:51.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:51.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: osdmap e48: 8 total, 7 up, 8 in 2024-07-26T12:14:51.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: from='osd.7 ' entity='osd.7' 2024-07-26T12:14:51.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: osdmap e48: 8 total, 7 up, 8 in 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: from='osd.7 ' entity='osd.7' 2024-07-26T12:14:51.667 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: osdmap e48: 8 total, 7 up, 8 in 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: from='osd.7 ' entity='osd.7' 2024-07-26T12:14:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-07-26T12:14:52.698 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-07-26T12:14:52.698 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:52 smithi146 ceph-mon[35807]: osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] boot 2024-07-26T12:14:52.699 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:52 smithi146 ceph-mon[35807]: osdmap e49: 8 total, 8 up, 8 in 2024-07-26T12:14:52.699 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:52.699 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:52 smithi146 ceph-mon[35807]: osdmap e50: 8 total, 8 up, 8 in 2024-07-26T12:14:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:52 smithi040 ceph-mon[32397]: osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] boot 2024-07-26T12:14:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:52 smithi040 ceph-mon[32397]: osdmap e49: 8 total, 8 up, 8 in 2024-07-26T12:14:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:52 smithi040 ceph-mon[32397]: osdmap e50: 8 total, 8 up, 8 in 2024-07-26T12:14:52.741 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-07-26T12:14:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-07-26T12:14:52.742 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0344266 s, 305 MB/s 2024-07-26T12:14:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-07-26T12:14:52.826 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:52 smithi076 ceph-mon[35401]: osd.7 [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] boot 2024-07-26T12:14:52.826 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:52 smithi076 ceph-mon[35401]: osdmap e49: 8 total, 8 up, 8 in 2024-07-26T12:14:52.827 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-07-26T12:14:52.827 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:52 smithi076 ceph-mon[35401]: osdmap e50: 8 total, 8 up, 8 in 2024-07-26T12:14:53.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:53 smithi076 ceph-mon[35401]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:53.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:53 smithi076 ceph-mon[35401]: osdmap e51: 8 total, 8 up, 8 in 2024-07-26T12:14:53.665 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_2 2024-07-26T12:14:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:53 smithi040 ceph-mon[32397]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:53 smithi040 ceph-mon[32397]: osdmap e51: 8 total, 8 up, 8 in 2024-07-26T12:14:53.734 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:53 smithi146 ceph-mon[35807]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-07-26T12:14:53.734 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:53 smithi146 ceph-mon[35807]: osdmap e51: 8 total, 8 up, 8 in 2024-07-26T12:14:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi076 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 5696M 2024-07-26T12:14:54.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:54.698 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:54.698 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:54.698 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:54.698 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:54 smithi040 ceph-mon[32397]: pgmap v249: 1 pgs: 1 peering; 0 B data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi076 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 5696M 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:54 smithi146 ceph-mon[35807]: pgmap v249: 1 pgs: 1 peering; 0 B data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi076 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:14:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 5696M 2024-07-26T12:14:55.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:55.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:14:55.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:14:55.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:54 smithi076 ceph-mon[35401]: pgmap v249: 1 pgs: 1 peering; 0 B data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 -- 172.21.15.146:0/3867626016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c74079070 msgr2=0x7f6c740799e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 --2- 172.21.15.146:0/3867626016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c74079070 0x7f6c740799e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ca0 tx=0x7f6c6c02a950 comp rx=0 tx=0).stop 2024-07-26T12:14:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 -- 172.21.15.146:0/3867626016 shutdown_connections 2024-07-26T12:14:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 --2- 172.21.15.146:0/3867626016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c74079070 0x7f6c740799e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:56.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 --2- 172.21.15.146:0/3867626016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c740786d0 0x7f6c74078ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:56.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 --2- 172.21.15.146:0/3867626016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c74077640 0x7f6c74077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:56.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 -- 172.21.15.146:0/3867626016 >> 172.21.15.146:0/3867626016 conn(0x7f6c74100b30 msgr2=0x7f6c74102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:14:56.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.411+0000 7f6c73e00640 1 -- 172.21.15.146:0/3867626016 shutdown_connections 2024-07-26T12:14:56.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.412+0000 7f6c73e00640 1 -- 172.21.15.146:0/3867626016 wait complete. 2024-07-26T12:14:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 Processor -- start 2024-07-26T12:14:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 -- start start 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c74077640 0x7f6c7419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 0x7f6c741a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74079070 0x7f6c741a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6c741150e0 con 0x7f6c74079070 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74114f60 con 0x7f6c74077640 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.413+0000 7f6c73e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74115260 con 0x7f6c740786d0 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 0x7f6c741a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 0x7f6c741a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54026/0 (socket says 172.21.15.146:54026) 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 -- 172.21.15.146:0/1846594527 learned_addr learned my addr 172.21.15.146:0/1846594527 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72a00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c74077640 0x7f6c7419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c73400640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74079070 0x7f6c741a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 -- 172.21.15.146:0/1846594527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c74077640 msgr2=0x7f6c7419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c74077640 0x7f6c7419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:56.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 -- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74079070 msgr2=0x7f6c741a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:14:56.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74079070 0x7f6c741a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:14:56.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 -- 172.21.15.146:0/1846594527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741a17d0 con 0x7f6c740786d0 2024-07-26T12:14:56.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c73400640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74079070 0x7f6c741a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.414+0000 7f6c72000640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 0x7f6c741a0410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000d950 tx=0x7f6c6000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.415+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60017070 con 0x7f6c740786d0 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.415+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c60009c30 con 0x7f6c740786d0 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.415+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000f620 con 0x7f6c740786d0 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.415+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c741a1ac0 con 0x7f6c740786d0 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.415+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c741a81c0 con 0x7f6c740786d0 2024-07-26T12:14:56.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.416+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c74078ae0 con 0x7f6c740786d0 2024-07-26T12:14:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.419+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6c60010460 con 0x7f6c740786d0 2024-07-26T12:14:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.420+0000 7f6c6b400640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6c580b3c50 0x7f6c580b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:14:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.421+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5397+0+0 (secure 0 0 0) 0x7f6c600e2da0 con 0x7f6c740786d0 2024-07-26T12:14:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.421+0000 7f6c72a00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6c580b3c50 0x7f6c580b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:14:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.422+0000 7f6c72a00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6c580b3c50 0x7f6c580b6160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005fd0 tx=0x7f6c64005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:14:56.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.423+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6c600aaf30 con 0x7f6c740786d0 2024-07-26T12:14:56.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:14:56.632+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6c74063230 con 0x7f6c580b3c50 2024-07-26T12:14:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:56 smithi146 ceph-mon[35807]: pgmap v250: 1 pgs: 1 peering; 0 B data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:14:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:14:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:56 smithi040 ceph-mon[32397]: pgmap v250: 1 pgs: 1 peering; 0 B data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:14:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:14:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:56 smithi076 ceph-mon[35401]: pgmap v250: 1 pgs: 1 peering; 0 B data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:14:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:14:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:14:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:57 smithi146 ceph-mon[35807]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:14:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:57 smithi040 ceph-mon[32397]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:14:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:57 smithi076 ceph-mon[35401]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:14:58.958 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:14:58 smithi146 ceph-mon[35807]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:14:58 smithi076 ceph-mon[35401]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:14:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:14:58 smithi040 ceph-mon[32397]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:01.209 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:00 smithi146 ceph-mon[35807]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:01.209 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:00 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/461149890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]: dispatch 2024-07-26T12:15:01.209 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:00 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]: dispatch 2024-07-26T12:15:01.209 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:00 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]': finished 2024-07-26T12:15:01.209 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:00 smithi146 ceph-mon[35807]: osdmap e52: 9 total, 8 up, 9 in 2024-07-26T12:15:01.209 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:00 smithi040 ceph-mon[32397]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:00 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/461149890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]: dispatch 2024-07-26T12:15:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:00 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]: dispatch 2024-07-26T12:15:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:00 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]': finished 2024-07-26T12:15:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:00 smithi040 ceph-mon[32397]: osdmap e52: 9 total, 8 up, 9 in 2024-07-26T12:15:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:00 smithi076 ceph-mon[35401]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:00 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/461149890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]: dispatch 2024-07-26T12:15:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:00 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]: dispatch 2024-07-26T12:15:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:00 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f180ffe2-9657-4515-8808-52eee7840f25"}]': finished 2024-07-26T12:15:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:00 smithi076 ceph-mon[35401]: osdmap e52: 9 total, 8 up, 9 in 2024-07-26T12:15:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:01 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/2979453579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:15:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:01 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/2979453579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:15:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:01 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/2979453579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:15:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:02 smithi040 ceph-mon[32397]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:02 smithi146 ceph-mon[35807]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:02 smithi076 ceph-mon[35401]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:05.212 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:04 smithi146 ceph-mon[35807]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:04 smithi040 ceph-mon[32397]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:04 smithi076 ceph-mon[35401]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:07.054 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:06 smithi146 ceph-mon[35807]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:06 smithi040 ceph-mon[32397]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:06 smithi076 ceph-mon[35401]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:08 smithi040 ceph-mon[32397]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:08 smithi146 ceph-mon[35807]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:08 smithi076 ceph-mon[35401]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-26T12:15:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-26T12:15:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-07-26T12:15:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:10 smithi040 ceph-mon[32397]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:10 smithi040 ceph-mon[32397]: Deploying daemon osd.8 on smithi146 2024-07-26T12:15:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:10 smithi146 ceph-mon[35807]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:10 smithi146 ceph-mon[35807]: Deploying daemon osd.8 on smithi146 2024-07-26T12:15:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:10 smithi076 ceph-mon[35401]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:10 smithi076 ceph-mon[35401]: Deploying daemon osd.8 on smithi146 2024-07-26T12:15:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:12 smithi146 ceph-mon[35807]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:12 smithi040 ceph-mon[32397]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:12 smithi076 ceph-mon[35401]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:15.196 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:14 smithi146 ceph-mon[35807]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:14 smithi040 ceph-mon[32397]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:14 smithi076 ceph-mon[35401]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:16 smithi040 ceph-mon[32397]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:16 smithi146 ceph-mon[35807]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:16 smithi076 ceph-mon[35401]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:18 smithi076 ceph-mon[35401]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:18 smithi146 ceph-mon[35807]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:18 smithi040 ceph-mon[32397]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:20 smithi146 ceph-mon[35807]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:20 smithi076 ceph-mon[35401]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:20 smithi040 ceph-mon[32397]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T12:15:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:23 smithi146 ceph-mon[35807]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T12:15:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T12:15:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:23 smithi076 ceph-mon[35401]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T12:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:23 smithi040 ceph-mon[32397]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-07-26T12:15:24.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.060+0000 7f6c6b400640 1 -- 172.21.15.146:0/1846594527 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6c74063230 con 0x7f6c580b3c50 2024-07-26T12:15:24.061 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 8 on host 'smithi146' 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6c580b3c50 msgr2=0x7f6c580b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6c580b3c50 0x7f6c580b6160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005fd0 tx=0x7f6c64005850 comp rx=0 tx=0).stop 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 msgr2=0x7f6c741a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 0x7f6c741a0410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000d950 tx=0x7f6c6000de10 comp rx=0 tx=0).stop 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 shutdown_connections 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74079070 0x7f6c741a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6c580b3c50 0x7f6c580b6160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c740786d0 0x7f6c741a0410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 --2- 172.21.15.146:0/1846594527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c74077640 0x7f6c7419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 >> 172.21.15.146:0/1846594527 conn(0x7f6c74100b30 msgr2=0x7f6c7410f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:15:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.064+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 shutdown_connections 2024-07-26T12:15:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:15:24.065+0000 7f6c73e00640 1 -- 172.21.15.146:0/1846594527 wait complete. 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: osdmap e53: 9 total, 8 up, 9 in 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: osdmap e53: 9 total, 8 up, 9 in 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: osdmap e53: 9 total, 8 up, 9 in 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:24.920 DEBUG:teuthology.orchestra.run.smithi146:osd.8> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.8.service 2024-07-26T12:15:24.925 INFO:tasks.cephadm:Deploying osd.9 on smithi040 with /dev/vg_nvme/lv_1... 2024-07-26T12:15:24.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-26T12:15:25.383 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:25 smithi146 ceph-mon[35807]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:25.383 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:25 smithi146 ceph-mon[35807]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:15:25.384 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:25 smithi146 ceph-mon[35807]: osdmap e54: 9 total, 8 up, 9 in 2024-07-26T12:15:25.384 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:25.384 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:25.420 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:15:25.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:25 smithi040 ceph-mon[32397]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:25.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:25 smithi040 ceph-mon[32397]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:15:25.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:25 smithi040 ceph-mon[32397]: osdmap e54: 9 total, 8 up, 9 in 2024-07-26T12:15:25.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:25.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:25 smithi076 ceph-mon[35401]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:25 smithi076 ceph-mon[35401]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:15:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:25 smithi076 ceph-mon[35401]: osdmap e54: 9 total, 8 up, 9 in 2024-07-26T12:15:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:26.552 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:26 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:15:26.553 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:26 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:15:26.553 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:26.553 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:26 smithi146 ceph-mon[35807]: osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] boot 2024-07-26T12:15:26.553 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:26 smithi146 ceph-mon[35807]: osdmap e55: 9 total, 9 up, 9 in 2024-07-26T12:15:26.553 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:26 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:26 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:26 smithi040 ceph-mon[32397]: osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] boot 2024-07-26T12:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:26 smithi040 ceph-mon[32397]: osdmap e55: 9 total, 9 up, 9 in 2024-07-26T12:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:26 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:15:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:26 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:15:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:26 smithi076 ceph-mon[35401]: osd.8 [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] boot 2024-07-26T12:15:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:26 smithi076 ceph-mon[35401]: osdmap e55: 9 total, 9 up, 9 in 2024-07-26T12:15:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-07-26T12:15:27.596 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:27 smithi040 ceph-mon[32397]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:27.596 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:27 smithi040 ceph-mon[32397]: osdmap e56: 9 total, 9 up, 9 in 2024-07-26T12:15:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:27 smithi146 ceph-mon[35807]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:27 smithi146 ceph-mon[35807]: osdmap e56: 9 total, 9 up, 9 in 2024-07-26T12:15:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:27 smithi076 ceph-mon[35401]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-07-26T12:15:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:27 smithi076 ceph-mon[35401]: osdmap e56: 9 total, 9 up, 9 in 2024-07-26T12:15:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-26T12:15:28.156 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-26T12:15:28.198 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-07-26T12:15:28.198 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-07-26T12:15:28.199 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0341526 s, 307 MB/s 2024-07-26T12:15:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-07-26T12:15:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:28 smithi040 ceph-mon[32397]: osdmap e57: 9 total, 9 up, 9 in 2024-07-26T12:15:28.753 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:28 smithi146 ceph-mon[35807]: osdmap e57: 9 total, 9 up, 9 in 2024-07-26T12:15:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:28 smithi076 ceph-mon[35401]: osdmap e57: 9 total, 9 up, 9 in 2024-07-26T12:15:28.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_1 2024-07-26T12:15:29.406 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:15:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: pgmap v272: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.711 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: pgmap v272: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:29.711 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:29.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.795 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: pgmap v272: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:29.795 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:29.796 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:30.604 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:30 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi146 2024-07-26T12:15:30.605 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:30 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 5696M 2024-07-26T12:15:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:30 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi146 2024-07-26T12:15:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:30 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 5696M 2024-07-26T12:15:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:30 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi146 2024-07-26T12:15:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:30 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 5696M 2024-07-26T12:15:31.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 -- 172.21.15.40:0/2117558671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e58108d00 msgr2=0x7f3e5810b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:31.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/2117558671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e58108d00 0x7f3e5810b210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009ca0 tx=0x7f3e5002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:15:31.591 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:31 smithi040 ceph-mon[32397]: pgmap v273: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:31.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 -- 172.21.15.40:0/2117558671 shutdown_connections 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/2117558671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e58108d00 0x7f3e5810b210 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/2117558671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e581061c0 0x7f3e581085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/2117558671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e5806bd10 0x7f3e58105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 -- 172.21.15.40:0/2117558671 >> 172.21.15.40:0/2117558671 conn(0x7f3e580fd840 msgr2=0x7f3e580ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.588+0000 7f3e5ee00640 1 -- 172.21.15.40:0/2117558671 shutdown_connections 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.589+0000 7f3e5ee00640 1 -- 172.21.15.40:0/2117558671 wait complete. 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 Processor -- start 2024-07-26T12:15:31.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 -- start start 2024-07-26T12:15:31.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 0x7f3e581996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e581061c0 0x7f3e58199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e58108d00 0x7f3e5819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5810eb20 con 0x7f3e5806bd10 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5810e9a0 con 0x7f3e58108d00 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.590+0000 7f3e5ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5810eca0 con 0x7f3e581061c0 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 0x7f3e581996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 0x7f3e581996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55964/0 (socket says 172.21.15.40:55964) 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 -- 172.21.15.40:0/3341877164 learned_addr learned my addr 172.21.15.40:0/3341877164 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5d000640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e581061c0 0x7f3e58199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:15:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5e400640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e58108d00 0x7f3e5819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 -- 172.21.15.40:0/3341877164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e581061c0 msgr2=0x7f3e58199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e581061c0 0x7f3e58199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 -- 172.21.15.40:0/3341877164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e58108d00 msgr2=0x7f3e5819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e58108d00 0x7f3e5819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5da00640 1 -- 172.21.15.40:0/3341877164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5819b100 con 0x7f3e5806bd10 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.591+0000 7f3e5e400640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e58108d00 0x7f3e5819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.592+0000 7f3e5da00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 0x7f3e581996d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00e9f0 tx=0x7f3e4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.592+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00cd80 con 0x7f3e5806bd10 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.592+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e4c0108c0 con 0x7f3e5806bd10 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.592+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0187c0 con 0x7f3e5806bd10 2024-07-26T12:15:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.592+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5819b3f0 con 0x7f3e5806bd10 2024-07-26T12:15:31.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.592+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e581a1af0 con 0x7f3e5806bd10 2024-07-26T12:15:31.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.594+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e580ff360 con 0x7f3e5806bd10 2024-07-26T12:15:31.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.598+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3e4c010430 con 0x7f3e5806bd10 2024-07-26T12:15:31.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.600+0000 7f3e56000640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e400b3c50 0x7f3e400b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:15:31.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.600+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7f3e4c0e3bf0 con 0x7f3e5806bd10 2024-07-26T12:15:31.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.600+0000 7f3e5d000640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e400b3c50 0x7f3e400b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:15:31.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.601+0000 7f3e5d000640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e400b3c50 0x7f3e400b6160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009b60 tx=0x7f3e44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:15:31.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.602+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3e4c0abb50 con 0x7f3e5806bd10 2024-07-26T12:15:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:31 smithi146 ceph-mon[35807]: pgmap v273: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:31.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:31.819+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3e58063230 con 0x7f3e400b3c50 2024-07-26T12:15:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:31 smithi076 ceph-mon[35401]: pgmap v273: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:15:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:15:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:15:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:15:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:15:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:15:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:33 smithi040 ceph-mon[32397]: pgmap v274: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:33 smithi040 ceph-mon[32397]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:15:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:33 smithi146 ceph-mon[35807]: pgmap v274: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:33 smithi146 ceph-mon[35807]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:15:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:33 smithi076 ceph-mon[35401]: pgmap v274: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-07-26T12:15:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:33 smithi076 ceph-mon[35401]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:15:34.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:34 smithi040 ceph-mon[32397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-07-26T12:15:34.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:34 smithi040 ceph-mon[32397]: Cluster is now healthy 2024-07-26T12:15:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:34 smithi146 ceph-mon[35807]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-07-26T12:15:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:34 smithi146 ceph-mon[35807]: Cluster is now healthy 2024-07-26T12:15:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:34 smithi076 ceph-mon[35401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-07-26T12:15:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:34 smithi076 ceph-mon[35401]: Cluster is now healthy 2024-07-26T12:15:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:35 smithi040 ceph-mon[32397]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T12:15:35.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:35 smithi146 ceph-mon[35807]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T12:15:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:35 smithi076 ceph-mon[35401]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-07-26T12:15:36.708 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:36 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2547558283' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4acc2a16-b98d-4c67-83bd-c74f1f1cede0"}]: dispatch 2024-07-26T12:15:36.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:36 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2547558283' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4acc2a16-b98d-4c67-83bd-c74f1f1cede0"}]': finished 2024-07-26T12:15:36.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:36 smithi040 ceph-mon[32397]: osdmap e58: 10 total, 9 up, 10 in 2024-07-26T12:15:36.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:15:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:36 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2547558283' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4acc2a16-b98d-4c67-83bd-c74f1f1cede0"}]: dispatch 2024-07-26T12:15:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:36 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2547558283' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4acc2a16-b98d-4c67-83bd-c74f1f1cede0"}]': finished 2024-07-26T12:15:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:36 smithi146 ceph-mon[35807]: osdmap e58: 10 total, 9 up, 10 in 2024-07-26T12:15:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:15:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:36 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2547558283' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4acc2a16-b98d-4c67-83bd-c74f1f1cede0"}]: dispatch 2024-07-26T12:15:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:36 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2547558283' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4acc2a16-b98d-4c67-83bd-c74f1f1cede0"}]': finished 2024-07-26T12:15:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:36 smithi076 ceph-mon[35401]: osdmap e58: 10 total, 9 up, 10 in 2024-07-26T12:15:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:15:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:37 smithi146 ceph-mon[35807]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-07-26T12:15:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:37 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2662476550' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:15:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:37 smithi076 ceph-mon[35401]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-07-26T12:15:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:37 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2662476550' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:15:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:37 smithi040 ceph-mon[32397]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-07-26T12:15:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:37 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2662476550' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:15:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:39 smithi146 ceph-mon[35807]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:39 smithi076 ceph-mon[35401]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:39 smithi040 ceph-mon[32397]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:41 smithi146 ceph-mon[35807]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:41 smithi076 ceph-mon[35401]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:41 smithi040 ceph-mon[32397]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:43 smithi146 ceph-mon[35807]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:43.807 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:43 smithi040 ceph-mon[32397]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:43 smithi076 ceph-mon[35401]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-07-26T12:15:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:45 smithi146 ceph-mon[35807]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-26T12:15:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:45 smithi076 ceph-mon[35401]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-26T12:15:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:45.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:45 smithi040 ceph-mon[32397]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:45.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-07-26T12:15:45.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:46 smithi146 ceph-mon[35807]: Deploying daemon osd.9 on smithi040 2024-07-26T12:15:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:46 smithi076 ceph-mon[35401]: Deploying daemon osd.9 on smithi040 2024-07-26T12:15:46.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:46 smithi040 ceph-mon[32397]: Deploying daemon osd.9 on smithi040 2024-07-26T12:15:47.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:47 smithi040 ceph-mon[32397]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:47 smithi146 ceph-mon[35807]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:47 smithi076 ceph-mon[35401]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:48.720 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:48 smithi040 ceph-mon[32397]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:48 smithi146 ceph-mon[35807]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:48 smithi076 ceph-mon[35401]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:50 smithi040 ceph-mon[32397]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:50 smithi146 ceph-mon[35807]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:50 smithi076 ceph-mon[35401]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:52 smithi040 ceph-mon[32397]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:52 smithi146 ceph-mon[35807]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:52 smithi076 ceph-mon[35401]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:54.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:54.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:54.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:54 smithi040 ceph-mon[32397]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:54 smithi146 ceph-mon[35807]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:54 smithi076 ceph-mon[35401]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:56 smithi040 ceph-mon[32397]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:56 smithi146 ceph-mon[35807]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:56 smithi076 ceph-mon[35401]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:58 smithi040 ceph-mon[32397]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T12:15:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:58 smithi146 ceph-mon[35807]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T12:15:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:15:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:15:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:58 smithi076 ceph-mon[35401]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-07-26T12:15:58.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.656+0000 7f3e56000640 1 -- 172.21.15.40:0/3341877164 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3e58063230 con 0x7f3e400b3c50 2024-07-26T12:15:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 9 on host 'smithi040' 2024-07-26T12:15:58.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.660+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e400b3c50 msgr2=0x7f3e400b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:58.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.660+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e400b3c50 0x7f3e400b6160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009b60 tx=0x7f3e44005f90 comp rx=0 tx=0).stop 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 msgr2=0x7f3e581996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 0x7f3e581996d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00e9f0 tx=0x7f3e4c00eeb0 comp rx=0 tx=0).stop 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 shutdown_connections 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e58108d00 0x7f3e5819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e400b3c50 0x7f3e400b6160 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e581061c0 0x7f3e58199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 --2- 172.21.15.40:0/3341877164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e5806bd10 0x7f3e581996d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:15:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 >> 172.21.15.40:0/3341877164 conn(0x7f3e580fd840 msgr2=0x7f3e581046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:15:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 shutdown_connections 2024-07-26T12:15:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:15:58.662+0000 7f3e5ee00640 1 -- 172.21.15.40:0/3341877164 wait complete. 2024-07-26T12:15:59.355 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:59.355 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-26T12:15:59.355 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: osdmap e59: 10 total, 9 up, 10 in 2024-07-26T12:15:59.355 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:15:59.356 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:15:59.356 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:59.356 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:59.356 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:15:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:59.420 DEBUG:teuthology.orchestra.run.smithi040:osd.9> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.9.service 2024-07-26T12:15:59.426 INFO:tasks.cephadm:Deploying osd.10 on smithi076 with /dev/vg_nvme/lv_1... 2024-07-26T12:15:59.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: osdmap e59: 10 total, 9 up, 10 in 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:59.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:15:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: osdmap e59: 10 total, 9 up, 10 in 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:15:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:15:59.882 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:16:00.322 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:00 smithi076 ceph-mon[35401]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:16:00.322 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:00 smithi076 ceph-mon[35401]: osdmap e60: 10 total, 9 up, 10 in 2024-07-26T12:16:00.322 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:00.322 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:00 smithi146 ceph-mon[35807]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:16:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:00 smithi146 ceph-mon[35807]: osdmap e60: 10 total, 9 up, 10 in 2024-07-26T12:16:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:00.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:00 smithi040 ceph-mon[32397]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-07-26T12:16:00.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:00 smithi040 ceph-mon[32397]: osdmap e60: 10 total, 9 up, 10 in 2024-07-26T12:16:00.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:00.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:00.656 INFO:journalctl@ceph.osd.9.smithi040.stdout:Jul 26 12:16:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-9[67581]: 2024-07-26T12:16:00.419+0000 7f8d5f600640 -1 osd.9 0 waiting for initial osdmap 2024-07-26T12:16:00.656 INFO:journalctl@ceph.osd.9.smithi040.stdout:Jul 26 12:16:00 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-9[67581]: 2024-07-26T12:16:00.471+0000 7f8d55600640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:16:01.557 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:01 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:16:01.558 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:01 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:16:01.558 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:01 smithi076 ceph-mon[35401]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:16:01.558 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:01.558 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:01 smithi076 ceph-mon[35401]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' 2024-07-26T12:16:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:01 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:16:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:01 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:16:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:01 smithi146 ceph-mon[35807]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:16:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:01 smithi146 ceph-mon[35807]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' 2024-07-26T12:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:01 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:01 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:01 smithi040 ceph-mon[32397]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:01 smithi040 ceph-mon[32397]: from='osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145]' entity='osd.9' 2024-07-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-26T12:16:02.498 INFO:teuthology.orchestra.run.smithi076.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-26T12:16:02.498 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:02.498 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:02 smithi076 ceph-mon[35401]: osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] boot 2024-07-26T12:16:02.498 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:02 smithi076 ceph-mon[35401]: osdmap e61: 10 total, 10 up, 10 in 2024-07-26T12:16:02.498 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:02.537 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10+0 records in 2024-07-26T12:16:02.537 INFO:teuthology.orchestra.run.smithi076.stderr:10+0 records out 2024-07-26T12:16:02.537 INFO:teuthology.orchestra.run.smithi076.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303892 s, 345 MB/s 2024-07-26T12:16:02.538 INFO:teuthology.orchestra.run.smithi076.stderr:--> Zapping successful for: 2024-07-26T12:16:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:02 smithi146 ceph-mon[35807]: osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] boot 2024-07-26T12:16:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:02 smithi146 ceph-mon[35807]: osdmap e61: 10 total, 10 up, 10 in 2024-07-26T12:16:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:02 smithi040 ceph-mon[32397]: osd.9 [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] boot 2024-07-26T12:16:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:02 smithi040 ceph-mon[32397]: osdmap e61: 10 total, 10 up, 10 in 2024-07-26T12:16:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-07-26T12:16:03.397 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_1 2024-07-26T12:16:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:03 smithi076 ceph-mon[35401]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:16:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:03 smithi076 ceph-mon[35401]: osdmap e62: 10 total, 10 up, 10 in 2024-07-26T12:16:03.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:03 smithi040 ceph-mon[32397]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:16:03.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:03 smithi040 ceph-mon[32397]: osdmap e62: 10 total, 10 up, 10 in 2024-07-26T12:16:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:03 smithi146 ceph-mon[35807]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-07-26T12:16:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:03 smithi146 ceph-mon[35807]: osdmap e62: 10 total, 10 up, 10 in 2024-07-26T12:16:03.829 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.b/config 2024-07-26T12:16:04.956 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi040 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 4273M 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:04.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi040 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 4273M 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi040 2024-07-26T12:16:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 4273M 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.827+0000 7f525fe00640 1 -- 172.21.15.76:0/1975313999 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f526006b1e0 msgr2=0x7f5260107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.827+0000 7f525fe00640 1 --2- 172.21.15.76:0/1975313999 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f526006b1e0 0x7f5260107fe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5250009900 tx=0x7f525002a410 comp rx=0 tx=0).stop 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.827+0000 7f525fe00640 1 -- 172.21.15.76:0/1975313999 shutdown_connections 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.828+0000 7f525fe00640 1 --2- 172.21.15.76:0/1975313999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f526010aed0 0x7f526010d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.828+0000 7f525fe00640 1 --2- 172.21.15.76:0/1975313999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5260108520 0x7f526010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.828+0000 7f525fe00640 1 --2- 172.21.15.76:0/1975313999 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f526006b1e0 0x7f5260107fe0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.828+0000 7f525fe00640 1 -- 172.21.15.76:0/1975313999 >> 172.21.15.76:0/1975313999 conn(0x7f52600fd800 msgr2=0x7f52600ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:16:05.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.828+0000 7f525fe00640 1 -- 172.21.15.76:0/1975313999 shutdown_connections 2024-07-26T12:16:05.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.828+0000 7f525fe00640 1 -- 172.21.15.76:0/1975313999 wait complete. 2024-07-26T12:16:05.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 Processor -- start 2024-07-26T12:16:05.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 -- start start 2024-07-26T12:16:05.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f526006b1e0 0x7f526019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:05.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 0x7f526019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526010aed0 0x7f526019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5260110ca0 con 0x7f526010aed0 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5260110b20 con 0x7f5260108520 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.829+0000 7f525fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5260110e20 con 0x7f526006b1e0 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 0x7f526019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 0x7f526019bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38616/0 (socket says 172.21.15.76:38616) 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 -- 172.21.15.76:0/876978179 learned_addr learned my addr 172.21.15.76:0/876978179 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525ea00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f526006b1e0 0x7f526019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525f400640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526010aed0 0x7f526019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 -- 172.21.15.76:0/876978179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f526006b1e0 msgr2=0x7f526019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f526006b1e0 0x7f526019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 -- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526010aed0 msgr2=0x7f526019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526010aed0 0x7f526019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.830+0000 7f525e000640 1 -- 172.21.15.76:0/876978179 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526019d2a0 con 0x7f5260108520 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.831+0000 7f525e000640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 0x7f526019bf70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c920 tx=0x7f524c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.831+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c007c70 con 0x7f5260108520 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.831+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526019d590 con 0x7f5260108520 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.831+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f524c007e10 con 0x7f5260108520 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.831+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0186f0 con 0x7f5260108520 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.831+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52601a3d20 con 0x7f5260108520 2024-07-26T12:16:05.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.833+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52600ff320 con 0x7f5260108520 2024-07-26T12:16:05.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.836+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f524c00f450 con 0x7f5260108520 2024-07-26T12:16:05.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.837+0000 7f5257400640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f52440b3bd0 0x7f52440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:05.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.837+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7f524c0e3680 con 0x7f5260108520 2024-07-26T12:16:05.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.838+0000 7f525ea00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f52440b3bd0 0x7f52440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:05.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.839+0000 7f525ea00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f52440b3bd0 0x7f52440b60e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52500057c0 tx=0x7f5250000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:16:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:05.842+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f524c014030 con 0x7f5260108520 2024-07-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:06.053+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5260063230 con 0x7f52440b3bd0 2024-07-26T12:16:07.080 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:06 smithi076 ceph-mon[35401]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:07.080 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:06 smithi076 ceph-mon[35401]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:16:07.080 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:16:07.080 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:16:07.081 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:06 smithi040 ceph-mon[32397]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:06 smithi040 ceph-mon[32397]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:16:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:16:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:16:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:06 smithi146 ceph-mon[35807]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:06 smithi146 ceph-mon[35807]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:16:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:16:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:16:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:09.120 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:08 smithi076 ceph-mon[35401]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:08 smithi040 ceph-mon[32397]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:08 smithi146 ceph-mon[35807]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:09 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/1215849354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]: dispatch 2024-07-26T12:16:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:09 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]: dispatch 2024-07-26T12:16:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:09 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]': finished 2024-07-26T12:16:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:09 smithi040 ceph-mon[32397]: osdmap e63: 11 total, 10 up, 11 in 2024-07-26T12:16:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:10.243 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:09 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/1215849354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]: dispatch 2024-07-26T12:16:10.243 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:09 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]: dispatch 2024-07-26T12:16:10.243 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:09 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]': finished 2024-07-26T12:16:10.243 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:09 smithi076 ceph-mon[35401]: osdmap e63: 11 total, 10 up, 11 in 2024-07-26T12:16:10.243 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:09 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/1215849354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]: dispatch 2024-07-26T12:16:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:09 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]: dispatch 2024-07-26T12:16:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:09 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "910c7cc4-df9b-40ed-8b38-4b7205cdeda2"}]': finished 2024-07-26T12:16:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:09 smithi146 ceph-mon[35807]: osdmap e63: 11 total, 10 up, 11 in 2024-07-26T12:16:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:11.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:10 smithi146 ceph-mon[35807]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:11.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:10 smithi146 ceph-mon[35807]: from='client.? 172.21.15.76:0/2036811518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:16:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:10 smithi040 ceph-mon[32397]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:10 smithi040 ceph-mon[32397]: from='client.? 172.21.15.76:0/2036811518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:16:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:10 smithi076 ceph-mon[35401]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:10 smithi076 ceph-mon[35401]: from='client.? 172.21.15.76:0/2036811518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:16:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:12 smithi040 ceph-mon[32397]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:12 smithi146 ceph-mon[35807]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:12 smithi076 ceph-mon[35401]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:14 smithi040 ceph-mon[32397]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:15.304 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:14 smithi076 ceph-mon[35401]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:14 smithi146 ceph-mon[35807]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:17.115 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:16 smithi076 ceph-mon[35401]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:16 smithi040 ceph-mon[32397]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:16 smithi146 ceph-mon[35807]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:18 smithi076 ceph-mon[35401]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-26T12:16:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:18 smithi040 ceph-mon[32397]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-26T12:16:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:18 smithi146 ceph-mon[35807]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-07-26T12:16:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:19 smithi040 ceph-mon[32397]: Deploying daemon osd.10 on smithi076 2024-07-26T12:16:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:19 smithi146 ceph-mon[35807]: Deploying daemon osd.10 on smithi076 2024-07-26T12:16:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:19 smithi076 ceph-mon[35401]: Deploying daemon osd.10 on smithi076 2024-07-26T12:16:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:20 smithi040 ceph-mon[32397]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:21.306 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:20 smithi076 ceph-mon[35401]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:20 smithi146 ceph-mon[35807]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:22 smithi040 ceph-mon[32397]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:22 smithi146 ceph-mon[35807]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:22 smithi076 ceph-mon[35401]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:24 smithi040 ceph-mon[32397]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:24 smithi146 ceph-mon[35807]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:24 smithi076 ceph-mon[35401]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:26 smithi076 ceph-mon[35401]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:26 smithi040 ceph-mon[32397]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:26 smithi146 ceph-mon[35807]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:16:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:16:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:16:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:29.218 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:28 smithi076 ceph-mon[35401]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:28 smithi040 ceph-mon[32397]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:28 smithi146 ceph-mon[35807]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:30 smithi040 ceph-mon[32397]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:30 smithi146 ceph-mon[35807]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:31.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:30 smithi076 ceph-mon[35401]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:31.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:31.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:31 smithi076 ceph-mon[35401]: from='osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T12:16:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:31 smithi076 ceph-mon[35401]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T12:16:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:31 smithi040 ceph-mon[32397]: from='osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T12:16:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:31 smithi040 ceph-mon[32397]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T12:16:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 10 on host 'smithi076' 2024-07-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.253+0000 7f5257400640 1 -- 172.21.15.76:0/876978179 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5260063230 con 0x7f52440b3bd0 2024-07-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.257+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f52440b3bd0 msgr2=0x7f52440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.257+0000 7f525fe00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f52440b3bd0 0x7f52440b60e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52500057c0 tx=0x7f5250000bc0 comp rx=0 tx=0).stop 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.257+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 msgr2=0x7f526019bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.257+0000 7f525fe00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 0x7f526019bf70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f524c00c920 tx=0x7f524c00cde0 comp rx=0 tx=0).stop 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 shutdown_connections 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526010aed0 0x7f526019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5260108520 0x7f526019bf70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f52440b3bd0 0x7f52440b60e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 --2- 172.21.15.76:0/876978179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f526006b1e0 0x7f526019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 >> 172.21.15.76:0/876978179 conn(0x7f52600fd800 msgr2=0x7f52601093f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 shutdown_connections 2024-07-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-07-26T12:16:32.258+0000 7f525fe00640 1 -- 172.21.15.76:0/876978179 wait complete. 2024-07-26T12:16:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:31 smithi146 ceph-mon[35807]: from='osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T12:16:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:31 smithi146 ceph-mon[35807]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-07-26T12:16:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:32.925 DEBUG:teuthology.orchestra.run.smithi076:osd.10> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.10.service 2024-07-26T12:16:32.929 INFO:tasks.cephadm:Deploying osd.11 on smithi146 with /dev/vg_nvme/lv_1... 2024-07-26T12:16:32.930 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-07-26T12:16:33.224 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: osdmap e64: 11 total, 10 up, 11 in 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:33.225 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:33.225 INFO:journalctl@ceph.osd.10.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-10[60637]: 2024-07-26T12:16:33.011+0000 7fbbe6a00640 -1 osd.10 0 waiting for initial osdmap 2024-07-26T12:16:33.225 INFO:journalctl@ceph.osd.10.smithi076.stdout:Jul 26 12:16:33 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-10[60637]: 2024-07-26T12:16:33.045+0000 7fbbe1a00640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: osdmap e64: 11 total, 10 up, 11 in 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:16:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: osdmap e64: 11 total, 10 up, 11 in 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:16:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:33.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:34.033 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:34 smithi076 ceph-mon[35401]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:16:34.033 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:34 smithi076 ceph-mon[35401]: osdmap e65: 11 total, 10 up, 11 in 2024-07-26T12:16:34.033 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:34.033 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:34 smithi146 ceph-mon[35807]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:16:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:34 smithi146 ceph-mon[35807]: osdmap e65: 11 total, 10 up, 11 in 2024-07-26T12:16:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:34 smithi040 ceph-mon[32397]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-07-26T12:16:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:34 smithi040 ceph-mon[32397]: osdmap e65: 11 total, 10 up, 11 in 2024-07-26T12:16:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] boot 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: osdmap e66: 11 total, 11 up, 11 in 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:35.272 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:35 smithi146 ceph-mon[35807]: osdmap e67: 11 total, 11 up, 11 in 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] boot 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: osdmap e66: 11 total, 11 up, 11 in 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:35.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:35 smithi076 ceph-mon[35401]: osdmap e67: 11 total, 11 up, 11 in 2024-07-26T12:16:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-07-26T12:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: osd.10 [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] boot 2024-07-26T12:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: osdmap e66: 11 total, 11 up, 11 in 2024-07-26T12:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-07-26T12:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:35 smithi040 ceph-mon[32397]: osdmap e67: 11 total, 11 up, 11 in 2024-07-26T12:16:36.107 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-07-26T12:16:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-07-26T12:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-07-26T12:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-07-26T12:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0305317 s, 343 MB/s 2024-07-26T12:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-07-26T12:16:37.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_1 2024-07-26T12:16:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:37 smithi146 ceph-mon[35807]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:37 smithi146 ceph-mon[35807]: osdmap e68: 11 total, 11 up, 11 in 2024-07-26T12:16:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:37 smithi076 ceph-mon[35401]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:37 smithi076 ceph-mon[35401]: osdmap e68: 11 total, 11 up, 11 in 2024-07-26T12:16:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:37 smithi040 ceph-mon[32397]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:37 smithi040 ceph-mon[32397]: osdmap e68: 11 total, 11 up, 11 in 2024-07-26T12:16:37.579 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:16:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi076 2024-07-26T12:16:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 4272M 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi076 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 4272M 2024-07-26T12:16:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi076 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:16:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 4272M 2024-07-26T12:16:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:16:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:16:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:39 smithi146 ceph-mon[35807]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-07-26T12:16:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:39 smithi040 ceph-mon[32397]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-07-26T12:16:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:39 smithi076 ceph-mon[35401]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-07-26T12:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.950+0000 7f5a4f200640 1 -- 172.21.15.146:0/844496457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50102f50 msgr2=0x7f5a50103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.950+0000 7f5a4f200640 1 --2- 172.21.15.146:0/844496457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50102f50 0x7f5a50103360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009900 tx=0x7f5a3802a480 comp rx=0 tx=0).stop 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.950+0000 7f5a4f200640 1 -- 172.21.15.146:0/844496457 shutdown_connections 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.950+0000 7f5a4f200640 1 --2- 172.21.15.146:0/844496457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 0x7f5a5010a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.950+0000 7f5a4f200640 1 --2- 172.21.15.146:0/844496457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50102f50 0x7f5a50103360 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.950+0000 7f5a4f200640 1 --2- 172.21.15.146:0/844496457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50101ec0 0x7f5a50102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.951+0000 7f5a4f200640 1 -- 172.21.15.146:0/844496457 >> 172.21.15.146:0/844496457 conn(0x7f5a500fd850 msgr2=0x7f5a500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.951+0000 7f5a4f200640 1 -- 172.21.15.146:0/844496457 shutdown_connections 2024-07-26T12:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.951+0000 7f5a4f200640 1 -- 172.21.15.146:0/844496457 wait complete. 2024-07-26T12:16:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 Processor -- start 2024-07-26T12:16:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 -- start start 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 0x7f5a5019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50102f50 0x7f5a5019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 0x7f5a5019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5010eae0 con 0x7f5a50102f50 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5010e960 con 0x7f5a501038f0 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.952+0000 7f5a4f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5010ec60 con 0x7f5a50101ec0 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 0x7f5a5019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 0x7f5a5019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59554/0 (socket says 172.21.15.146:59554) 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 -- 172.21.15.146:0/466504443 learned_addr learned my addr 172.21.15.146:0/466504443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a45400640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50102f50 0x7f5a5019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4e800640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 0x7f5a5019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 -- 172.21.15.146:0/466504443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 msgr2=0x7f5a5019caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 0x7f5a5019caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 -- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50102f50 msgr2=0x7f5a5019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50102f50 0x7f5a5019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4de00640 1 -- 172.21.15.146:0/466504443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5019d280 con 0x7f5a50101ec0 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.953+0000 7f5a4e800640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 0x7f5a5019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.954+0000 7f5a4de00640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 0x7f5a5019b8e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000c920 tx=0x7f5a4000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.954+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40007c70 con 0x7f5a50101ec0 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.954+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a40007e10 con 0x7f5a50101ec0 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.954+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40018710 con 0x7f5a50101ec0 2024-07-26T12:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.954+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5019d570 con 0x7f5a50101ec0 2024-07-26T12:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.954+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501a3b30 con 0x7f5a50101ec0 2024-07-26T12:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.955+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a501a3dc0 con 0x7f5a50101ec0 2024-07-26T12:16:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.958+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f5a4000f450 con 0x7f5a50101ec0 2024-07-26T12:16:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.959+0000 7f5a47400640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5a340b3c50 0x7f5a340b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:16:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.959+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7f5a400e3ad0 con 0x7f5a50101ec0 2024-07-26T12:16:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.960+0000 7f5a45400640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5a340b3c50 0x7f5a340b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:16:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.961+0000 7f5a45400640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5a340b3c50 0x7f5a340b6160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000c00 tx=0x7f5a38005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:16:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:39.961+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5a40014030 con 0x7f5a50101ec0 2024-07-26T12:16:40.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:16:40.172+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5a5010c4d0 con 0x7f5a340b3c50 2024-07-26T12:16:41.181 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:41 smithi146 ceph-mon[35807]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T12:16:41.181 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:41 smithi146 ceph-mon[35807]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:16:41.181 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:16:41.181 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:16:41.181 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:41 smithi040 ceph-mon[32397]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T12:16:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:41 smithi040 ceph-mon[32397]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:16:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:16:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:16:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:41 smithi076 ceph-mon[35401]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-07-26T12:16:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:41 smithi076 ceph-mon[35401]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:16:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-07-26T12:16:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-07-26T12:16:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:43 smithi146 ceph-mon[35807]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-07-26T12:16:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:43 smithi040 ceph-mon[32397]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-07-26T12:16:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:43 smithi076 ceph-mon[35401]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-07-26T12:16:44.459 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/2469552036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]: dispatch 2024-07-26T12:16:44.459 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:44 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]: dispatch 2024-07-26T12:16:44.460 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:44 smithi076 ceph-mon[35401]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]': finished 2024-07-26T12:16:44.460 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:44 smithi076 ceph-mon[35401]: osdmap e69: 12 total, 11 up, 12 in 2024-07-26T12:16:44.460 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:16:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/2469552036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]: dispatch 2024-07-26T12:16:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:44 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]: dispatch 2024-07-26T12:16:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:44 smithi040 ceph-mon[32397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]': finished 2024-07-26T12:16:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:44 smithi040 ceph-mon[32397]: osdmap e69: 12 total, 11 up, 12 in 2024-07-26T12:16:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:16:44.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/2469552036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]: dispatch 2024-07-26T12:16:44.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:44 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]: dispatch 2024-07-26T12:16:44.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:44 smithi146 ceph-mon[35807]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "722e9e08-a8ec-4d70-84c2-8bb189f05095"}]': finished 2024-07-26T12:16:44.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:44 smithi146 ceph-mon[35807]: osdmap e69: 12 total, 11 up, 12 in 2024-07-26T12:16:44.519 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:16:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:45 smithi146 ceph-mon[35807]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-07-26T12:16:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:45 smithi146 ceph-mon[35807]: from='client.? 172.21.15.146:0/4105601803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:16:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:45 smithi040 ceph-mon[32397]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-07-26T12:16:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:45 smithi040 ceph-mon[32397]: from='client.? 172.21.15.146:0/4105601803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:16:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:45 smithi076 ceph-mon[35401]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-07-26T12:16:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:45 smithi076 ceph-mon[35401]: from='client.? 172.21.15.146:0/4105601803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-07-26T12:16:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:47 smithi040 ceph-mon[32397]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-07-26T12:16:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:47 smithi146 ceph-mon[35807]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-07-26T12:16:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:47 smithi076 ceph-mon[35401]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-07-26T12:16:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:49 smithi146 ceph-mon[35807]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:49 smithi076 ceph-mon[35401]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:49 smithi040 ceph-mon[32397]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:51 smithi040 ceph-mon[32397]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:51 smithi146 ceph-mon[35807]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:51 smithi076 ceph-mon[35401]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:53.542 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:53 smithi146 ceph-mon[35807]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:53 smithi076 ceph-mon[35401]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:53 smithi040 ceph-mon[32397]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-26T12:16:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-26T12:16:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-07-26T12:16:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:16:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:55 smithi146 ceph-mon[35807]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:55 smithi146 ceph-mon[35807]: Deploying daemon osd.11 on smithi146 2024-07-26T12:16:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:55 smithi076 ceph-mon[35401]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:55 smithi076 ceph-mon[35401]: Deploying daemon osd.11 on smithi146 2024-07-26T12:16:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:55 smithi040 ceph-mon[32397]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:55 smithi040 ceph-mon[32397]: Deploying daemon osd.11 on smithi146 2024-07-26T12:16:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:57 smithi146 ceph-mon[35807]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:57 smithi076 ceph-mon[35401]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:57 smithi040 ceph-mon[32397]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:16:59 smithi146 ceph-mon[35807]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:16:59 smithi076 ceph-mon[35401]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:16:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:16:59 smithi040 ceph-mon[32397]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:01 smithi146 ceph-mon[35807]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:01 smithi076 ceph-mon[35401]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:01 smithi040 ceph-mon[32397]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:03.537 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:03 smithi040 ceph-mon[32397]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:03.537 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:03.538 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:03.538 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:03 smithi146 ceph-mon[35807]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:03 smithi076 ceph-mon[35401]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:05 smithi146 ceph-mon[35807]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:05 smithi076 ceph-mon[35401]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:05 smithi040 ceph-mon[32397]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:07 smithi146 ceph-mon[35807]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:07 smithi146 ceph-mon[35807]: from='osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T12:17:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:07 smithi146 ceph-mon[35807]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T12:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:07 smithi076 ceph-mon[35401]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:07 smithi076 ceph-mon[35401]: from='osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T12:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:07 smithi076 ceph-mon[35401]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T12:17:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:07 smithi040 ceph-mon[32397]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:07 smithi040 ceph-mon[32397]: from='osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T12:17:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:07 smithi040 ceph-mon[32397]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: osdmap e70: 12 total, 11 up, 12 in 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:17:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:08 smithi146 ceph-mon[35807]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:17:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: osdmap e70: 12 total, 11 up, 12 in 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:17:08.598 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:08 smithi076 ceph-mon[35401]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:17:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.707+0000 7f5a47400640 1 -- 172.21.15.146:0/466504443 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5a5010c4d0 con 0x7f5a340b3c50 2024-07-26T12:17:08.710 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 11 on host 'smithi146' 2024-07-26T12:17:08.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.710+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5a340b3c50 msgr2=0x7f5a340b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:08.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.710+0000 7f5a4f200640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5a340b3c50 0x7f5a340b6160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000c00 tx=0x7f5a38005720 comp rx=0 tx=0).stop 2024-07-26T12:17:08.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.710+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 msgr2=0x7f5a5019b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:08.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.710+0000 7f5a4f200640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 0x7f5a5019b8e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000c920 tx=0x7f5a4000cde0 comp rx=0 tx=0).stop 2024-07-26T12:17:08.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 shutdown_connections 2024-07-26T12:17:08.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5a501038f0 0x7f5a5019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:08.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a50102f50 0x7f5a5019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:08.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5a340b3c50 0x7f5a340b6160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:08.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 --2- 172.21.15.146:0/466504443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a50101ec0 0x7f5a5019b8e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:08.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 >> 172.21.15.146:0/466504443 conn(0x7f5a500fd850 msgr2=0x7f5a5010adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:08.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 shutdown_connections 2024-07-26T12:17:08.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:08.711+0000 7f5a4f200640 1 -- 172.21.15.146:0/466504443 wait complete. 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: osdmap e70: 12 total, 11 up, 12 in 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:17:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:08 smithi040 ceph-mon[32397]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-07-26T12:17:09.549 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: osdmap e71: 12 total, 11 up, 12 in 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:09.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:09.598 DEBUG:teuthology.orchestra.run.smithi146:osd.11> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@osd.11.service 2024-07-26T12:17:09.603 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-07-26T12:17:09.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd stat -f json 2024-07-26T12:17:09.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: osdmap e71: 12 total, 11 up, 12 in 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:09.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: osdmap e71: 12 total, 11 up, 12 in 2024-07-26T12:17:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:10.086 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:10.146 INFO:journalctl@ceph.osd.11.smithi146.stdout:Jul 26 12:17:10 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-11[60844]: 2024-07-26T12:17:10.076+0000 7f1f3a600640 -1 osd.11 0 waiting for initial osdmap 2024-07-26T12:17:10.146 INFO:journalctl@ceph.osd.11.smithi146.stdout:Jul 26 12:17:10 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-osd-11[60844]: 2024-07-26T12:17:10.116+0000 7f1f30600640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-26T12:17:10.401 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:10 smithi146 ceph-mon[35807]: purged_snaps scrub starts 2024-07-26T12:17:10.401 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:10 smithi146 ceph-mon[35807]: purged_snaps scrub ok 2024-07-26T12:17:10.402 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:10.402 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:10 smithi146 ceph-mon[35807]: from='osd.11 ' entity='osd.11' 2024-07-26T12:17:10.504 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:10 smithi040 ceph-mon[32397]: purged_snaps scrub starts 2024-07-26T12:17:10.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:10 smithi040 ceph-mon[32397]: purged_snaps scrub ok 2024-07-26T12:17:10.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:10.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:10 smithi040 ceph-mon[32397]: from='osd.11 ' entity='osd.11' 2024-07-26T12:17:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:10 smithi076 ceph-mon[35401]: purged_snaps scrub starts 2024-07-26T12:17:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:10 smithi076 ceph-mon[35401]: purged_snaps scrub ok 2024-07-26T12:17:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:10 smithi076 ceph-mon[35401]: from='osd.11 ' entity='osd.11' 2024-07-26T12:17:11.459 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:11 smithi146 ceph-mon[35807]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:11.460 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:11.460 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:11 smithi146 ceph-mon[35807]: osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] boot 2024-07-26T12:17:11.460 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:11 smithi146 ceph-mon[35807]: osdmap e72: 12 total, 12 up, 12 in 2024-07-26T12:17:11.460 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:11.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:11 smithi040 ceph-mon[32397]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:11.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:11.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:11 smithi040 ceph-mon[32397]: osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] boot 2024-07-26T12:17:11.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:11 smithi040 ceph-mon[32397]: osdmap e72: 12 total, 12 up, 12 in 2024-07-26T12:17:11.672 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:11 smithi076 ceph-mon[35401]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:11 smithi076 ceph-mon[35401]: osd.11 [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] boot 2024-07-26T12:17:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:11 smithi076 ceph-mon[35401]: osdmap e72: 12 total, 12 up, 12 in 2024-07-26T12:17:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.294+0000 7fea9e200640 1 -- 172.21.15.40:0/4237702353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98079070 msgr2=0x7fea980799e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.294+0000 7fea9e200640 1 --2- 172.21.15.40:0/4237702353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98079070 0x7fea980799e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea90009ca0 tx=0x7fea9002a950 comp rx=0 tx=0).stop 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 -- 172.21.15.40:0/4237702353 shutdown_connections 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 --2- 172.21.15.40:0/4237702353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98079070 0x7fea980799e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 --2- 172.21.15.40:0/4237702353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea980786d0 0x7fea98078ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 --2- 172.21.15.40:0/4237702353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98077640 0x7fea98077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 -- 172.21.15.40:0/4237702353 >> 172.21.15.40:0/4237702353 conn(0x7fea98100d20 msgr2=0x7fea981031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 -- 172.21.15.40:0/4237702353 shutdown_connections 2024-07-26T12:17:12.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.295+0000 7fea9e200640 1 -- 172.21.15.40:0/4237702353 wait complete. 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.296+0000 7fea9e200640 1 Processor -- start 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.296+0000 7fea9e200640 1 -- start start 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.296+0000 7fea9e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 0x7fea9819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea9e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea980786d0 0x7fea981a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea9e200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98079070 0x7fea981a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea9e200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fea981152d0 con 0x7fea98077640 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea9e200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fea98115150 con 0x7fea98079070 2024-07-26T12:17:12.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea9e200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea98115450 con 0x7fea980786d0 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 0x7fea9819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 0x7fea9819fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45554/0 (socket says 172.21.15.40:45554) 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 -- 172.21.15.40:0/1584738932 learned_addr learned my addr 172.21.15.40:0/1584738932 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97e00640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98079070 0x7fea981a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea96a00640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea980786d0 0x7fea981a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 -- 172.21.15.40:0/1584738932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea980786d0 msgr2=0x7fea981a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea980786d0 0x7fea981a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 -- 172.21.15.40:0/1584738932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98079070 msgr2=0x7fea981a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.297+0000 7fea97400640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98079070 0x7fea981a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea97400640 1 -- 172.21.15.40:0/1584738932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea981a1900 con 0x7fea98077640 2024-07-26T12:17:12.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea97e00640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98079070 0x7fea981a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:17:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea97400640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 0x7fea9819fed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea8800d950 tx=0x7fea8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88017070 con 0x7fea98077640 2024-07-26T12:17:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea88009c30 con 0x7fea98077640 2024-07-26T12:17:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8800f620 con 0x7fea98077640 2024-07-26T12:17:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea981a1bf0 con 0x7fea98077640 2024-07-26T12:17:12.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.298+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea981a82f0 con 0x7fea98077640 2024-07-26T12:17:12.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.300+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea981125f0 con 0x7fea98077640 2024-07-26T12:17:12.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.302+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fea88010460 con 0x7fea98077640 2024-07-26T12:17:12.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.304+0000 7fea8fe00640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea7c0b3c50 0x7fea7c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.304+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fea880e3460 con 0x7fea98077640 2024-07-26T12:17:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.304+0000 7fea96a00640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea7c0b3c50 0x7fea7c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.305+0000 7fea96a00640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea7c0b3c50 0x7fea7c0b6160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea84005fd0 tx=0x7fea84005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.306+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fea880aaf30 con 0x7fea98077640 2024-07-26T12:17:12.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.515+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fea9802e240 con 0x7fea98077640 2024-07-26T12:17:12.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.516+0000 7fea8fe00640 1 -- 172.21.15.40:0/1584738932 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fea880b3020 con 0x7fea98077640 2024-07-26T12:17:12.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:12.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea7c0b3c50 msgr2=0x7fea7c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:12.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea7c0b3c50 0x7fea7c0b6160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea84005fd0 tx=0x7fea84005e20 comp rx=0 tx=0).stop 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 msgr2=0x7fea9819fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 0x7fea9819fed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea8800d950 tx=0x7fea8800de10 comp rx=0 tx=0).stop 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 shutdown_connections 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea98079070 0x7fea981a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea7c0b3c50 0x7fea7c0b6160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea980786d0 0x7fea981a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 --2- 172.21.15.40:0/1584738932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea98077640 0x7fea9819fed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:12.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 >> 172.21.15.40:0/1584738932 conn(0x7fea98100d20 msgr2=0x7fea9810f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:12.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 shutdown_connections 2024-07-26T12:17:12.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:12.519+0000 7fea9e200640 1 -- 172.21.15.40:0/1584738932 wait complete. 2024-07-26T12:17:13.349 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:13 smithi040 ceph-mon[32397]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:13.349 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:13 smithi040 ceph-mon[32397]: osdmap e73: 12 total, 12 up, 12 in 2024-07-26T12:17:13.349 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:13 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1584738932' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-26T12:17:13.352 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1721996231,"num_in_osds":12,"osd_in_since":1721996204,"num_remapped_pgs":0} 2024-07-26T12:17:13.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:17:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:13 smithi146 ceph-mon[35807]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:13 smithi146 ceph-mon[35807]: osdmap e73: 12 total, 12 up, 12 in 2024-07-26T12:17:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:13 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1584738932' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-26T12:17:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:13 smithi076 ceph-mon[35401]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-07-26T12:17:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:13 smithi076 ceph-mon[35401]: osdmap e73: 12 total, 12 up, 12 in 2024-07-26T12:17:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:13 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1584738932' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-07-26T12:17:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: Detected new or changed devices on smithi146 2024-07-26T12:17:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 4272M 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: Detected new or changed devices on smithi146 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 4272M 2024-07-26T12:17:15.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:15.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:15.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: Detected new or changed devices on smithi146 2024-07-26T12:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 4272M 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:15.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 -- 172.21.15.40:0/1460009554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 msgr2=0x7f7598102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 --2- 172.21.15.40:0/1460009554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f7598102220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7590009ca0 tx=0x7f759002a950 comp rx=0 tx=0).stop 2024-07-26T12:17:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 -- 172.21.15.40:0/1460009554 shutdown_connections 2024-07-26T12:17:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 --2- 172.21.15.40:0/1460009554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f759810f9c0 0x7f7598111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 --2- 172.21.15.40:0/1460009554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7598102760 0x7f759810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 --2- 172.21.15.40:0/1460009554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f7598102220 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 -- 172.21.15.40:0/1460009554 >> 172.21.15.40:0/1460009554 conn(0x7f75980fdcf0 msgr2=0x7f7598100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 -- 172.21.15.40:0/1460009554 shutdown_connections 2024-07-26T12:17:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.970+0000 7f759f200640 1 -- 172.21.15.40:0/1460009554 wait complete. 2024-07-26T12:17:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.972+0000 7f759f200640 1 Processor -- start 2024-07-26T12:17:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.972+0000 7f759f200640 1 -- start start 2024-07-26T12:17:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f759819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598102760 0x7f759819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f759810f9c0 0x7f75981a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7598115340 con 0x7f7598101e10 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75981151c0 con 0x7f759810f9c0 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75981154c0 con 0x7f7598102760 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f759819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f759819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40988/0 (socket says 172.21.15.40:40988) 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 -- 172.21.15.40:0/2509891933 learned_addr learned my addr 172.21.15.40:0/2509891933 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759d400640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598102760 0x7f759819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759e800640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f759810f9c0 0x7f75981a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 -- 172.21.15.40:0/2509891933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598102760 msgr2=0x7f759819c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598102760 0x7f759819c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 -- 172.21.15.40:0/2509891933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f759810f9c0 msgr2=0x7f75981a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.973+0000 7f759de00640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f759810f9c0 0x7f75981a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.974+0000 7f759de00640 1 -- 172.21.15.40:0/2509891933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75981a1d40 con 0x7f7598101e10 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.974+0000 7f759de00640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f759819bdd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7590009880 tx=0x7f7590003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.974+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590034040 con 0x7f7598101e10 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.974+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75981a1fd0 con 0x7f7598101e10 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.974+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7590030850 con 0x7f7598101e10 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.974+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900046c0 con 0x7f7598101e10 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.975+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75981a8790 con 0x7f7598101e10 2024-07-26T12:17:15.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.976+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7598102220 con 0x7f7598101e10 2024-07-26T12:17:15.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.978+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f7590037020 con 0x7f7598101e10 2024-07-26T12:17:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.981+0000 7f758ea00640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75840b3c50 0x7f75840b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.981+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f75901048c0 con 0x7f7598101e10 2024-07-26T12:17:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.981+0000 7f759d400640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75840b3c50 0x7f75840b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.982+0000 7f759d400640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75840b3c50 0x7f75840b6160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7588005fd0 tx=0x7f7588005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:15.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:15.983+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f75900098b0 con 0x7f7598101e10 2024-07-26T12:17:16.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.186+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f759819cf00 con 0x7f7598101e10 2024-07-26T12:17:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.188+0000 7f758ea00640 1 -- 172.21.15.40:0/2509891933 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18408 (secure 0 0 0) 0x7f75900cc310 con 0x7f7598101e10 2024-07-26T12:17:16.190 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:16.190 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":73,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:17:12.084502+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75840b3c50 msgr2=0x7f75840b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75840b3c50 0x7f75840b6160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7588005fd0 tx=0x7f7588005850 comp rx=0 tx=0).stop 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 msgr2=0x7f759819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f759819bdd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7590009880 tx=0x7f7590003f90 comp rx=0 tx=0).stop 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 shutdown_connections 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f759810f9c0 0x7f75981a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75840b3c50 0x7f75840b6160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598102760 0x7f759819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:16.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 --2- 172.21.15.40:0/2509891933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7598101e10 0x7f759819bdd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:16.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.191+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 >> 172.21.15.40:0/2509891933 conn(0x7f75980fdcf0 msgr2=0x7f7598100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:16.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.192+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 shutdown_connections 2024-07-26T12:17:16.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:16.192+0000 7f759f200640 1 -- 172.21.15.40:0/2509891933 wait complete. 2024-07-26T12:17:17.052 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-26T12:11:57.831053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-26T12:17:17.052 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-07-26T12:17:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:17 smithi040 ceph-mon[32397]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2509891933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:17:17.552 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:17 smithi146 ceph-mon[35807]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2509891933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:17:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:17 smithi076 ceph-mon[35401]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2509891933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:17:19.438 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:19 smithi040 ceph-mon[32397]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:19 smithi146 ceph-mon[35807]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:19 smithi076 ceph-mon[35401]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 -- 172.21.15.40:0/377490196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 msgr2=0x7fb5ec111d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 --2- 172.21.15.40:0/377490196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec111d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009900 tx=0x7fb5e402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 -- 172.21.15.40:0/377490196 shutdown_connections 2024-07-26T12:17:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 --2- 172.21.15.40:0/377490196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec111d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 --2- 172.21.15.40:0/377490196 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5ec075b30 0x7fb5ec10f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 --2- 172.21.15.40:0/377490196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ec0751e0 0x7fb5ec0755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 -- 172.21.15.40:0/377490196 >> 172.21.15.40:0/377490196 conn(0x7fb5ec0fee70 msgr2=0x7fb5ec1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 -- 172.21.15.40:0/377490196 shutdown_connections 2024-07-26T12:17:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.757+0000 7fb5eb200640 1 -- 172.21.15.40:0/377490196 wait complete. 2024-07-26T12:17:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.759+0000 7fb5eb200640 1 Processor -- start 2024-07-26T12:17:19.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.759+0000 7fb5eb200640 1 -- start start 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5eb200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5ec0751e0 0x7fb5ec19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5eb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ec075b30 0x7fb5ec19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5eb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5eb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec115380 con 0x7fb5ec10f940 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5eb200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec115200 con 0x7fb5ec0751e0 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5eb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec115500 con 0x7fb5ec075b30 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec1a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40998/0 (socket says 172.21.15.40:40998) 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5ea800640 1 -- 172.21.15.40:0/1423428623 learned_addr learned my addr 172.21.15.40:0/1423428623 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5e9e00640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5ec0751e0 0x7fb5ec19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.760+0000 7fb5e9400640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ec075b30 0x7fb5ec19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:19.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.761+0000 7fb5ea800640 1 -- 172.21.15.40:0/1423428623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ec075b30 msgr2=0x7fb5ec19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.761+0000 7fb5ea800640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ec075b30 0x7fb5ec19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.761+0000 7fb5ea800640 1 -- 172.21.15.40:0/1423428623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5ec0751e0 msgr2=0x7fb5ec19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.761+0000 7fb5ea800640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5ec0751e0 0x7fb5ec19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.761+0000 7fb5ea800640 1 -- 172.21.15.40:0/1423428623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec1a1e00 con 0x7fb5ec10f940 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.761+0000 7fb5ea800640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec1a16d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4004770 tx=0x7fb5e4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.762+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e403f030 con 0x7fb5ec10f940 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.762+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5e4004440 con 0x7fb5ec10f940 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.762+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec1a2090 con 0x7fb5ec10f940 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.762+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4035070 con 0x7fb5ec10f940 2024-07-26T12:17:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.762+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec1a8850 con 0x7fb5ec10f940 2024-07-26T12:17:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.763+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ec0766f0 con 0x7fb5ec10f940 2024-07-26T12:17:19.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.765+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fb5e4042030 con 0x7fb5ec10f940 2024-07-26T12:17:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.767+0000 7fb5e2a00640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5cc0b3bd0 0x7fb5cc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:19.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.767+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb5e4103ba0 con 0x7fb5ec10f940 2024-07-26T12:17:19.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.767+0000 7fb5e9e00640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5cc0b3bd0 0x7fb5cc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:19.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.768+0000 7fb5e9e00640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5cc0b3bd0 0x7fb5cc0b60e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00bbe0 tx=0x7fb5dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:19.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.771+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb5e40cafa0 con 0x7fb5ec10f940 2024-07-26T12:17:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.973+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5ec1a8a20 con 0x7fb5ec10f940 2024-07-26T12:17:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.974+0000 7fb5e2a00640 1 -- 172.21.15.40:0/1423428623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fb5e40cf4f0 con 0x7fb5ec10f940 2024-07-26T12:17:19.975 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-07-26T12:17:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.977+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5cc0b3bd0 msgr2=0x7fb5cc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.977+0000 7fb5eb200640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5cc0b3bd0 0x7fb5cc0b60e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00bbe0 tx=0x7fb5dc00b390 comp rx=0 tx=0).stop 2024-07-26T12:17:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.977+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 msgr2=0x7fb5ec1a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.977+0000 7fb5eb200640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec1a16d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4004770 tx=0x7fb5e4004040 comp rx=0 tx=0).stop 2024-07-26T12:17:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 shutdown_connections 2024-07-26T12:17:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5ec10f940 0x7fb5ec1a16d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5cc0b3bd0 0x7fb5cc0b60e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5ec075b30 0x7fb5ec19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 --2- 172.21.15.40:0/1423428623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5ec0751e0 0x7fb5ec19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 >> 172.21.15.40:0/1423428623 conn(0x7fb5ec0fee70 msgr2=0x7fb5ec1083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 shutdown_connections 2024-07-26T12:17:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:19.978+0000 7fb5eb200640 1 -- 172.21.15.40:0/1423428623 wait complete. 2024-07-26T12:17:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:20 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1423428623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T12:17:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:20 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1423428623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T12:17:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:20 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1423428623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.a on smithi040 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.d on smithi040 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.g on smithi040 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.j on smithi040 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.b on smithi076 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.e on smithi076 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.h on smithi076 2024-07-26T12:17:20.825 INFO:tasks.cephadm:Adding mds.k on smithi076 2024-07-26T12:17:20.826 INFO:tasks.cephadm:Adding mds.c on smithi146 2024-07-26T12:17:20.826 INFO:tasks.cephadm:Adding mds.f on smithi146 2024-07-26T12:17:20.826 INFO:tasks.cephadm:Adding mds.i on smithi146 2024-07-26T12:17:20.826 INFO:tasks.cephadm:Adding mds.l on smithi146 2024-07-26T12:17:20.826 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph orch apply mds all '12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l' 2024-07-26T12:17:21.295 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.c/config 2024-07-26T12:17:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:21 smithi040 ceph-mon[32397]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:21.486 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:21 smithi146 ceph-mon[35807]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:21 smithi076 ceph-mon[35401]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:23.312 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:23 smithi146 ceph-mon[35807]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:23 smithi040 ceph-mon[32397]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:23.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 -- 172.21.15.146:0/876025447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c10b000 msgr2=0x7f9c5c1119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:23.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 --2- 172.21.15.146:0/876025447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c10b000 0x7f9c5c1119a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009ca0 tx=0x7f9c5402a950 comp rx=0 tx=0).stop 2024-07-26T12:17:23.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 -- 172.21.15.146:0/876025447 shutdown_connections 2024-07-26T12:17:23.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 --2- 172.21.15.146:0/876025447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c10b000 0x7f9c5c1119a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 --2- 172.21.15.146:0/876025447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c5c10a660 0x7f9c5c10aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 --2- 172.21.15.146:0/876025447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 -- 172.21.15.146:0/876025447 >> 172.21.15.146:0/876025447 conn(0x7f9c5c078970 msgr2=0x7f9c5c07ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:23.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 -- 172.21.15.146:0/876025447 shutdown_connections 2024-07-26T12:17:23.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.519+0000 7f9c61a00640 1 -- 172.21.15.146:0/876025447 wait complete. 2024-07-26T12:17:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.520+0000 7f9c61a00640 1 Processor -- start 2024-07-26T12:17:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 -- start start 2024-07-26T12:17:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c5c10a660 0x7f9c5c1a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5c10b000 0x7f9c5c1a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c115120 con 0x7f9c5c10b000 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c114fa0 con 0x7f9c5c10a660 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c61a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c1152a0 con 0x7f9c5c1095d0 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c5be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c5be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60494/0 (socket says 172.21.15.146:60494) 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.521+0000 7f9c5be00640 1 -- 172.21.15.146:0/1332024764 learned_addr learned my addr 172.21.15.146:0/1332024764 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c53400640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c5c10a660 0x7f9c5c1a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c61000640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5c10b000 0x7f9c5c1a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c5be00640 1 -- 172.21.15.146:0/1332024764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c5c10a660 msgr2=0x7f9c5c1a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c5be00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c5c10a660 0x7f9c5c1a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c5be00640 1 -- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5c10b000 msgr2=0x7f9c5c1a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c5be00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5c10b000 0x7f9c5c1a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c5be00640 1 -- 172.21.15.146:0/1332024764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c1a1770 con 0x7f9c5c1095d0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.522+0000 7f9c5be00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c19fd40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00d950 tx=0x7f9c4c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.523+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c017070 con 0x7f9c5c1095d0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.523+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c4c009c30 con 0x7f9c5c1095d0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.523+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00f620 con 0x7f9c5c1095d0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.523+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5c1a1a60 con 0x7f9c5c1095d0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.523+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5c1a8160 con 0x7f9c5c1095d0 2024-07-26T12:17:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.524+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5c109a40 con 0x7f9c5c1095d0 2024-07-26T12:17:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.527+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9c4c010460 con 0x7f9c5c1095d0 2024-07-26T12:17:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.528+0000 7f9c59600640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c400b3c50 0x7f9c400b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:23.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.528+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9c4c0e3460 con 0x7f9c5c1095d0 2024-07-26T12:17:23.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.529+0000 7f9c53400640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c400b3c50 0x7f9c400b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:23.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.530+0000 7f9c53400640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c400b3c50 0x7f9c400b6160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c44005fd0 tx=0x7f9c44005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:23.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.530+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9c4c0aaf30 con 0x7f9c5c1095d0 2024-07-26T12:17:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:23 smithi076 ceph-mon[35401]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:23.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.742+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}) -- 0x7f9c5c0633f0 con 0x7f9c400b3c50 2024-07-26T12:17:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.761+0000 7f9c59600640 1 -- 172.21.15.146:0/1332024764 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9c5c0633f0 con 0x7f9c400b3c50 2024-07-26T12:17:23.762 INFO:teuthology.orchestra.run.smithi146.stdout:Scheduled mds.all update... 2024-07-26T12:17:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c400b3c50 msgr2=0x7f9c400b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c400b3c50 0x7f9c400b6160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c44005fd0 tx=0x7f9c44005850 comp rx=0 tx=0).stop 2024-07-26T12:17:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 msgr2=0x7f9c5c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c19fd40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00d950 tx=0x7f9c4c00de10 comp rx=0 tx=0).stop 2024-07-26T12:17:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 shutdown_connections 2024-07-26T12:17:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5c10b000 0x7f9c5c1a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c5c10a660 0x7f9c5c1a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c400b3c50 0x7f9c400b6160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 --2- 172.21.15.146:0/1332024764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c5c1095d0 0x7f9c5c19fd40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:23.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 >> 172.21.15.146:0/1332024764 conn(0x7f9c5c078970 msgr2=0x7f9c5c10d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:23.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 shutdown_connections 2024-07-26T12:17:23.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-07-26T12:17:23.764+0000 7f9c61a00640 1 -- 172.21.15.146:0/1332024764 wait complete. 2024-07-26T12:17:24.745 DEBUG:teuthology.orchestra.run.smithi040:mds.a> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service 2024-07-26T12:17:24.753 DEBUG:teuthology.orchestra.run.smithi040:mds.d> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.d.service 2024-07-26T12:17:24.800 DEBUG:teuthology.orchestra.run.smithi040:mds.g> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service 2024-07-26T12:17:24.846 DEBUG:teuthology.orchestra.run.smithi040:mds.j> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.j.service 2024-07-26T12:17:24.891 DEBUG:teuthology.orchestra.run.smithi076:mds.b> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service 2024-07-26T12:17:24.899 DEBUG:teuthology.orchestra.run.smithi076:mds.e> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service 2024-07-26T12:17:24.945 DEBUG:teuthology.orchestra.run.smithi076:mds.h> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.h.service 2024-07-26T12:17:24.991 DEBUG:teuthology.orchestra.run.smithi076:mds.k> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service 2024-07-26T12:17:25.009 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:17:25.009 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: Saving service mds.all spec with placement smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-07-26T12:17:25.009 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:25.009 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:25.009 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:25.009 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:25.010 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:25.010 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:25.010 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:25.010 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:25.010 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: Deploying daemon mds.l on smithi146 2024-07-26T12:17:25.010 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:24 smithi076 ceph-mon[35401]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:25.013 DEBUG:teuthology.orchestra.run.smithi146:mds.c> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service 2024-07-26T12:17:25.022 DEBUG:teuthology.orchestra.run.smithi146:mds.f> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: Saving service mds.all spec with placement smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:25.044 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:25.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:25.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:25.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:25.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: Deploying daemon mds.l on smithi146 2024-07-26T12:17:25.045 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:24 smithi146 ceph-mon[35807]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:25.049 DEBUG:teuthology.orchestra.run.smithi146:mds.i> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service 2024-07-26T12:17:25.095 DEBUG:teuthology.orchestra.run.smithi146:mds.l> sudo journalctl -f -n 0 -u ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.l.service 2024-07-26T12:17:25.141 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-07-26T12:17:25.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:17:25.220 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: Saving service mds.all spec with placement smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: Deploying daemon mds.l on smithi146 2024-07-26T12:17:25.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:24 smithi040 ceph-mon[32397]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:25.622 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:26 smithi040 ceph-mon[32397]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:27.238 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:26 smithi146 ceph-mon[35807]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:26 smithi076 ceph-mon[35401]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:27.571 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:27 smithi146 systemd[1]: Starting Ceph mds.l for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:17:27.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 -- 172.21.15.40:0/3852366839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010b880 msgr2=0x7f24601120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:27.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 --2- 172.21.15.40:0/3852366839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010b880 0x7f24601120b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2458009ca0 tx=0x7f245802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:17:27.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 -- 172.21.15.40:0/3852366839 shutdown_connections 2024-07-26T12:17:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 --2- 172.21.15.40:0/3852366839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010b880 0x7f24601120b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 --2- 172.21.15.40:0/3852366839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f246010af30 0x7f246010b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 --2- 172.21.15.40:0/3852366839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24601055f0 0x7f2460105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 -- 172.21.15.40:0/3852366839 >> 172.21.15.40:0/3852366839 conn(0x7f2460101060 msgr2=0x7f24601034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 -- 172.21.15.40:0/3852366839 shutdown_connections 2024-07-26T12:17:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.803+0000 7f2466000640 1 -- 172.21.15.40:0/3852366839 wait complete. 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.804+0000 7f2466000640 1 Processor -- start 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 -- start start 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24601055f0 0x7f246019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 0x7f246019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246010b880 0x7f24601a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2460115450 con 0x7f246010af30 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f24601152d0 con 0x7f246010b880 2024-07-26T12:17:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f2466000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24601155d0 con 0x7f24601055f0 2024-07-26T12:17:27.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.805+0000 7f245fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 0x7f246019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 0x7f246019c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36774/0 (socket says 172.21.15.40:36774) 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 -- 172.21.15.40:0/2854522738 learned_addr learned my addr 172.21.15.40:0/2854522738 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f2464c00640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24601055f0 0x7f246019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f2465600640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246010b880 0x7f24601a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 -- 172.21.15.40:0/2854522738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24601055f0 msgr2=0x7f246019bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24601055f0 0x7f246019bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 -- 172.21.15.40:0/2854522738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246010b880 msgr2=0x7f24601a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246010b880 0x7f24601a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.806+0000 7f245fe00640 1 -- 172.21.15.40:0/2854522738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24601a1d50 con 0x7f246010af30 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.807+0000 7f245fe00640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 0x7f246019c380 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f244c00e9c0 tx=0x7f244c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.807+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c00ccc0 con 0x7f246010af30 2024-07-26T12:17:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.807+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24601a2040 con 0x7f246010af30 2024-07-26T12:17:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.807+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f244c0054b0 con 0x7f246010af30 2024-07-26T12:17:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.807+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c010430 con 0x7f246010af30 2024-07-26T12:17:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.807+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24601a87a0 con 0x7f246010af30 2024-07-26T12:17:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.808+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2460105a00 con 0x7f246010af30 2024-07-26T12:17:27.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.811+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f244c004f00 con 0x7f246010af30 2024-07-26T12:17:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.814+0000 7f245d600640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f24480b3bd0 0x7f24480b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.814+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f244c0e3d60 con 0x7f246010af30 2024-07-26T12:17:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.814+0000 7f2464c00640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f24480b3bd0 0x7f24480b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:27.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.815+0000 7f2464c00640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f24480b3bd0 0x7f24480b60e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2454005d00 tx=0x7f245400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:27.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:27.816+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f244c055600 con 0x7f246010af30 2024-07-26T12:17:27.919 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:27 smithi146 podman[65155]: 2024-07-26 12:17:27.494979753 +0000 UTC m=+0.033152452 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:17:27.919 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:27 smithi146 podman[65155]: 2024-07-26 12:17:27.663931689 +0000 UTC m=+0.202104400 container create 7c88f1fb029a235703266e6668688ddc3732b1836013e17ab26155120834fcec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-07-26T12:17:27.919 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:27 smithi146 podman[65155]: 2024-07-26 12:17:27.917396341 +0000 UTC m=+0.455569059 container init 7c88f1fb029a235703266e6668688ddc3732b1836013e17ab26155120834fcec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T12:17:28.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.062+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f246019cf10 con 0x7f246010af30 2024-07-26T12:17:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.064+0000 7f245d600640 1 -- 172.21.15.40:0/2854522738 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f246019cf10 con 0x7f246010af30 2024-07-26T12:17:28.065 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"btime":"2024-07-26T12:17:28:052540+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-26T12:17:28.065 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-07-26T12:17:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f24480b3bd0 msgr2=0x7f24480b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f24480b3bd0 0x7f24480b60e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2454005d00 tx=0x7f245400b410 comp rx=0 tx=0).stop 2024-07-26T12:17:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 msgr2=0x7f246019c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 0x7f246019c380 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f244c00e9c0 tx=0x7f244c00ee80 comp rx=0 tx=0).stop 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 shutdown_connections 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246010b880 0x7f24601a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246010af30 0x7f246019c380 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f24480b3bd0 0x7f24480b60e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 --2- 172.21.15.40:0/2854522738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24601055f0 0x7f246019bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.067+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 >> 172.21.15.40:0/2854522738 conn(0x7f2460101060 msgr2=0x7f2460103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.068+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 shutdown_connections 2024-07-26T12:17:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:28.068+0000 7f2466000640 1 -- 172.21.15.40:0/2854522738 wait complete. 2024-07-26T12:17:28.321 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:27 smithi146 podman[65155]: 2024-07-26 12:17:27.927241902 +0000 UTC m=+0.465414607 container start 7c88f1fb029a235703266e6668688ddc3732b1836013e17ab26155120834fcec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-l, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-07-26T12:17:28.321 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:28 smithi146 bash[65155]: 7c88f1fb029a235703266e6668688ddc3732b1836013e17ab26155120834fcec 2024-07-26T12:17:28.321 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:28 smithi146 systemd[1]: Started Ceph mds.l for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:28.321 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:28 smithi146 ceph-mds[65173]: -- 172.21.15.146:0/861264319 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a793235860 con 0x55a7973d7180 2024-07-26T12:17:28.321 INFO:journalctl@ceph.mds.l.smithi146.stdout:Jul 26 12:17:28 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-l[65169]: starting mds.l at 2024-07-26T12:17:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6832/1448706156,v1:172.21.15.146:6833/1448706156] up:boot 2024-07-26T12:17:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: fsmap 1 up:standby 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2854522738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:29 smithi040 ceph-mon[32397]: Deploying daemon mds.k on smithi076 2024-07-26T12:17:29.266 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6832/1448706156,v1:172.21.15.146:6833/1448706156] up:boot 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: fsmap 1 up:standby 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2854522738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:29.267 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:29 smithi076 ceph-mon[35401]: Deploying daemon mds.k on smithi076 2024-07-26T12:17:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6832/1448706156,v1:172.21.15.146:6833/1448706156] up:boot 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: fsmap 1 up:standby 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2854522738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:29 smithi146 ceph-mon[35807]: Deploying daemon mds.k on smithi076 2024-07-26T12:17:30.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:17:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:31 smithi146 ceph-mon[35807]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:31.326 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:31 smithi076 ceph-mon[35401]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:31.378 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:31 smithi040 ceph-mon[32397]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:31.582 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 podman[65021]: 2024-07-26 12:17:31.327671564 +0000 UTC m=+0.135052164 container create 17f99fe3e70df02059f01e297980d43a7cc6ea4b77e43989b8abfba7354efb68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD) 2024-07-26T12:17:31.583 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 podman[65021]: 2024-07-26 12:17:31.580855045 +0000 UTC m=+0.388235651 container init 17f99fe3e70df02059f01e297980d43a7cc6ea4b77e43989b8abfba7354efb68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T12:17:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 podman[65021]: 2024-07-26 12:17:31.590709781 +0000 UTC m=+0.398090353 container start 17f99fe3e70df02059f01e297980d43a7cc6ea4b77e43989b8abfba7354efb68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T12:17:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 bash[65021]: 17f99fe3e70df02059f01e297980d43a7cc6ea4b77e43989b8abfba7354efb68 2024-07-26T12:17:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 systemd[1]: Started Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 ceph-mds[65040]: -- 172.21.15.76:0/2790559229 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556da77e9860 con 0x556dab98ba80 2024-07-26T12:17:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 12:17:31 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: starting mds.k at 2024-07-26T12:17:33.045 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.045 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: Deploying daemon mds.j on smithi040 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] up:boot 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: fsmap 2 up:standby 2024-07-26T12:17:33.046 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T12:17:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: Deploying daemon mds.j on smithi040 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] up:boot 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: fsmap 2 up:standby 2024-07-26T12:17:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T12:17:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: Deploying daemon mds.j on smithi040 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] up:boot 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: fsmap 2 up:standby 2024-07-26T12:17:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.078+0000 7efd73200640 1 -- 172.21.15.40:0/774717174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 msgr2=0x7efd6c110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.078+0000 7efd73200640 1 --2- 172.21.15.40:0/774717174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c110050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd64009900 tx=0x7efd6402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 -- 172.21.15.40:0/774717174 shutdown_connections 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 --2- 172.21.15.40:0/774717174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c110050 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 --2- 172.21.15.40:0/774717174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 0x7efd6c1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 --2- 172.21.15.40:0/774717174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd6c103590 0x7efd6c1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 -- 172.21.15.40:0/774717174 >> 172.21.15.40:0/774717174 conn(0x7efd6c07b280 msgr2=0x7efd6c07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 -- 172.21.15.40:0/774717174 shutdown_connections 2024-07-26T12:17:34.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.079+0000 7efd73200640 1 -- 172.21.15.40:0/774717174 wait complete. 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.080+0000 7efd73200640 1 Processor -- start 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.080+0000 7efd73200640 1 -- start start 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd73200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd6c103590 0x7efd6c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd73200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 0x7efd6c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd73200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd73200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c113380 con 0x7efd6c109820 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd73200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c113200 con 0x7efd6c103590 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd73200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c113500 con 0x7efd6c108ed0 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd71200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd71200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c075bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56710/0 (socket says 172.21.15.40:56710) 2024-07-26T12:17:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd71200640 1 -- 172.21.15.40:0/246295538 learned_addr learned my addr 172.21.15.40:0/246295538 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd6be00640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd6c103590 0x7efd6c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.081+0000 7efd6b400640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 0x7efd6c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd71200640 1 -- 172.21.15.40:0/246295538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 msgr2=0x7efd6c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd71200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 0x7efd6c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd71200640 1 -- 172.21.15.40:0/246295538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd6c103590 msgr2=0x7efd6c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd71200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd6c103590 0x7efd6c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd71200640 1 -- 172.21.15.40:0/246295538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c1a7f60 con 0x7efd6c109820 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd6b400640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 0x7efd6c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd71200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c075bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd64005ab0 tx=0x7efd640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.082+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6403f030 con 0x7efd6c109820 2024-07-26T12:17:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.083+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd64003c90 con 0x7efd6c109820 2024-07-26T12:17:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.083+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6c1a81f0 con 0x7efd6c109820 2024-07-26T12:17:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.083+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64035070 con 0x7efd6c109820 2024-07-26T12:17:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.083+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6c1a8720 con 0x7efd6c109820 2024-07-26T12:17:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.084+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd6c1039a0 con 0x7efd6c109820 2024-07-26T12:17:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.088+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7efd64042030 con 0x7efd6c109820 2024-07-26T12:17:34.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.091+0000 7efd68c00640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efd500b3c50 0x7efd500b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:34.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.091+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7efd64104110 con 0x7efd6c109820 2024-07-26T12:17:34.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.092+0000 7efd6be00640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efd500b3c50 0x7efd500b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:34.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.092+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7efd640cbb60 con 0x7efd6c109820 2024-07-26T12:17:34.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.092+0000 7efd6be00640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efd500b3c50 0x7efd500b6160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd6c076b90 tx=0x7efd5c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.341+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd6c076440 con 0x7efd6c109820 2024-07-26T12:17:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.342+0000 7efd68c00640 1 -- 172.21.15.40:0/246295538 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7efd640cb460 con 0x7efd6c109820 2024-07-26T12:17:34.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:34.343 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"btime":"2024-07-26T12:17:32:065874+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-07-26T12:17:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efd500b3c50 msgr2=0x7efd500b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efd500b3c50 0x7efd500b6160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd6c076b90 tx=0x7efd5c0075b0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 msgr2=0x7efd6c075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c075bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd64005ab0 tx=0x7efd640042f0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 shutdown_connections 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6c109820 0x7efd6c075bc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efd500b3c50 0x7efd500b6160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6c108ed0 0x7efd6c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 --2- 172.21.15.40:0/246295538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd6c103590 0x7efd6c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 >> 172.21.15.40:0/246295538 conn(0x7efd6c07b280 msgr2=0x7efd6c106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 shutdown_connections 2024-07-26T12:17:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:34.345+0000 7efd73200640 1 -- 172.21.15.40:0/246295538 wait complete. 2024-07-26T12:17:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:34 smithi040 ceph-mon[32397]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:34 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/246295538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:34 smithi146 ceph-mon[35807]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:34 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/246295538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:34 smithi076 ceph-mon[35401]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:34 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/246295538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:36.062 INFO:journalctl@ceph.mds.j.smithi040.stdout:Jul 26 12:17:35 smithi040 podman[72828]: 2024-07-26 12:17:35.942384707 +0000 UTC m=+0.342453798 container start afa428a98542246e1efcae2d0ca2636ea98de7bd7c6a3bbff3090a63ba739e76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-j, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-26T12:17:36.482 INFO:journalctl@ceph.mds.j.smithi040.stdout:Jul 26 12:17:36 smithi040 ceph-mds[72847]: -- 172.21.15.40:0/348091790 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3581ffc20 con 0x55b35c3a1a80 2024-07-26T12:17:36.483 INFO:journalctl@ceph.mds.j.smithi040.stdout:Jul 26 12:17:36 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-j[72843]: starting mds.j at 2024-07-26T12:17:36.483 INFO:journalctl@ceph.mds.j.smithi040.stdout:Jul 26 12:17:36 smithi040 bash[72828]: afa428a98542246e1efcae2d0ca2636ea98de7bd7c6a3bbff3090a63ba739e76 2024-07-26T12:17:36.483 INFO:journalctl@ceph.mds.j.smithi040.stdout:Jul 26 12:17:36 smithi040 systemd[1]: Started Ceph mds.j for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:37.444 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:37.444 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: Deploying daemon mds.d on smithi040 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] up:boot 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: fsmap 3 up:standby 2024-07-26T12:17:37.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T12:17:37.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: Deploying daemon mds.d on smithi040 2024-07-26T12:17:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] up:boot 2024-07-26T12:17:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: fsmap 3 up:standby 2024-07-26T12:17:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T12:17:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: Deploying daemon mds.d on smithi040 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] up:boot 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: fsmap 3 up:standby 2024-07-26T12:17:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-07-26T12:17:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:38.983 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:38 smithi040 systemd[1]: Starting Ceph mds.d for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:17:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:39 smithi040 ceph-mon[32397]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:39 smithi146 ceph-mon[35807]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:39.596 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:39 smithi076 ceph-mon[35401]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:39.831 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:39 smithi040 podman[73224]: 2024-07-26 12:17:39.548981845 +0000 UTC m=+0.270916416 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:17:39.831 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:39 smithi040 podman[73224]: 2024-07-26 12:17:39.671258859 +0000 UTC m=+0.393193375 container create 75981f61bc6074f02fcdd34e4b1ab07908d2ba411ba6d2bfff2bcbddeed90dca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-d, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T12:17:40.187 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:39 smithi040 podman[73224]: 2024-07-26 12:17:39.950645239 +0000 UTC m=+0.672579817 container init 75981f61bc6074f02fcdd34e4b1ab07908d2ba411ba6d2bfff2bcbddeed90dca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-d, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-07-26T12:17:40.187 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:39 smithi040 podman[73224]: 2024-07-26 12:17:39.961350436 +0000 UTC m=+0.683284943 container start 75981f61bc6074f02fcdd34e4b1ab07908d2ba411ba6d2bfff2bcbddeed90dca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS) 2024-07-26T12:17:40.188 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:40 smithi040 ceph-mds[73263]: -- 172.21.15.40:0/3992766409 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c980b5c20 con 0x556c9c257180 2024-07-26T12:17:40.188 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:40 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-d[73257]: starting mds.d at 2024-07-26T12:17:40.478 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:40 smithi040 bash[73224]: 75981f61bc6074f02fcdd34e4b1ab07908d2ba411ba6d2bfff2bcbddeed90dca 2024-07-26T12:17:40.479 INFO:journalctl@ceph.mds.d.smithi040.stdout:Jul 26 12:17:40 smithi040 systemd[1]: Started Ceph mds.d for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:40.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 -- 172.21.15.40:0/1213184695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 msgr2=0x7f55d8112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:40.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1213184695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d8112090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009ca0 tx=0x7f55d002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 -- 172.21.15.40:0/1213184695 shutdown_connections 2024-07-26T12:17:40.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1213184695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d8112090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1213184695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55d810af10 0x7f55d810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1213184695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 0x7f55d81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 -- 172.21.15.40:0/1213184695 >> 172.21.15.40:0/1213184695 conn(0x7f55d8101040 msgr2=0x7f55d8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:40.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 -- 172.21.15.40:0/1213184695 shutdown_connections 2024-07-26T12:17:40.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.598+0000 7f55d7e00640 1 -- 172.21.15.40:0/1213184695 wait complete. 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.599+0000 7f55d7e00640 1 Processor -- start 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.599+0000 7f55d7e00640 1 -- start start 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 0x7f55d819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55d810af10 0x7f55d819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8115410 con 0x7f55d810b860 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8115290 con 0x7f55d810af10 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8115590 con 0x7f55d81055d0 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d81a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:40.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d81a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56786/0 (socket says 172.21.15.40:56786) 2024-07-26T12:17:40.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d7400640 1 -- 172.21.15.40:0/1747893181 learned_addr learned my addr 172.21.15.40:0/1747893181 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:40.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.600+0000 7f55d6000640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55d810af10 0x7f55d819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:40.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d6a00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 0x7f55d819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d7400640 1 -- 172.21.15.40:0/1747893181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 msgr2=0x7f55d819bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d7400640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 0x7f55d819bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d7400640 1 -- 172.21.15.40:0/1747893181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55d810af10 msgr2=0x7f55d819c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d7400640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55d810af10 0x7f55d819c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d7400640 1 -- 172.21.15.40:0/1747893181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d81a1d30 con 0x7f55d810b860 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d6a00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 0x7f55d819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.601+0000 7f55d7400640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d81a1600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55d0031040 tx=0x7f55d0003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.602+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0032c90 con 0x7f55d810b860 2024-07-26T12:17:40.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.602+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55d0032e30 con 0x7f55d810b860 2024-07-26T12:17:40.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.602+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d81a1fc0 con 0x7f55d810b860 2024-07-26T12:17:40.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.602+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0030b30 con 0x7f55d810b860 2024-07-26T12:17:40.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.602+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d81a8780 con 0x7f55d810b860 2024-07-26T12:17:40.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.603+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d81059e0 con 0x7f55d810b860 2024-07-26T12:17:40.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.606+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f55d0030cd0 con 0x7f55d810b860 2024-07-26T12:17:40.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.609+0000 7f55dca00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55bc0b3c50 0x7f55bc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:40.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.609+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f55d0104cb0 con 0x7f55d810b860 2024-07-26T12:17:40.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.609+0000 7f55d6a00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55bc0b3c50 0x7f55bc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:40.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.610+0000 7f55d6a00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55bc0b3c50 0x7f55bc0b6160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55c80058c0 tx=0x7f55c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:40.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.611+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f55d00cc700 con 0x7f55d810b860 2024-07-26T12:17:40.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.851+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55d810d6b0 con 0x7f55d810b860 2024-07-26T12:17:40.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.852+0000 7f55dca00640 1 -- 172.21.15.40:0/1747893181 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f55d00cc000 con 0x7f55d810b860 2024-07-26T12:17:40.853 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:40.853 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"btime":"2024-07-26T12:17:40:219335+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-07-26T12:17:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 5 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55bc0b3c50 msgr2=0x7f55bc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55bc0b3c50 0x7f55bc0b6160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55c80058c0 tx=0x7f55c8005850 comp rx=0 tx=0).stop 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 msgr2=0x7f55d81a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d81a1600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55d0031040 tx=0x7f55d0003f80 comp rx=0 tx=0).stop 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 shutdown_connections 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55d810b860 0x7f55d81a1600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55d810af10 0x7f55d819c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55bc0b3c50 0x7f55bc0b6160 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 --2- 172.21.15.40:0/1747893181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55d81055d0 0x7f55d819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 >> 172.21.15.40:0/1747893181 conn(0x7f55d8101040 msgr2=0x7f55d8103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 shutdown_connections 2024-07-26T12:17:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:40.855+0000 7f55d7e00640 1 -- 172.21.15.40:0/1747893181 wait complete. 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] up:boot 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: fsmap 4 up:standby 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: Deploying daemon mds.e on smithi076 2024-07-26T12:17:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:41 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1747893181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] up:boot 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: fsmap 4 up:standby 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: Deploying daemon mds.e on smithi076 2024-07-26T12:17:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:41 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1747893181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:41.576 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] up:boot 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: fsmap 4 up:standby 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: Deploying daemon mds.e on smithi076 2024-07-26T12:17:41.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:41 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1747893181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:43 smithi146 ceph-mon[35807]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:43 smithi076 ceph-mon[35401]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:43.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:43 smithi076 systemd[1]: Starting Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:17:43.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:17:43.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:43 smithi040 ceph-mon[32397]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:43.917 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:43 smithi076 podman[65321]: 2024-07-26 12:17:43.66188324 +0000 UTC m=+0.126998375 container create ea4d351352afbba0bd4e133a613974469520753cf351f2898773aee1bfaec1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T12:17:43.917 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:43 smithi076 podman[65321]: 2024-07-26 12:17:43.569124272 +0000 UTC m=+0.034239379 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:17:43.917 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:43 smithi076 podman[65321]: 2024-07-26 12:17:43.915402546 +0000 UTC m=+0.380517698 container init ea4d351352afbba0bd4e133a613974469520753cf351f2898773aee1bfaec1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-07-26T12:17:44.098 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:44.333 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:43 smithi076 podman[65321]: 2024-07-26 12:17:43.925439231 +0000 UTC m=+0.390554337 container start ea4d351352afbba0bd4e133a613974469520753cf351f2898773aee1bfaec1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T12:17:44.334 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:43 smithi076 bash[65321]: ea4d351352afbba0bd4e133a613974469520753cf351f2898773aee1bfaec1a7 2024-07-26T12:17:44.334 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:44 smithi076 systemd[1]: Started Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:44.334 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:44 smithi076 ceph-mds[65340]: -- 172.21.15.76:0/824358264 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca70a8b860 con 0x55ca74c2da80 2024-07-26T12:17:44.334 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 12:17:44 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: starting mds.e at 2024-07-26T12:17:45.143 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:45.143 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.143 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.143 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.143 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:45.144 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:45.144 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:45.144 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: Deploying daemon mds.f on smithi146 2024-07-26T12:17:45.144 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:boot 2024-07-26T12:17:45.144 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: fsmap 5 up:standby 2024-07-26T12:17:45.144 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T12:17:45.278 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: Deploying daemon mds.f on smithi146 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:boot 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: fsmap 5 up:standby 2024-07-26T12:17:45.279 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T12:17:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: Deploying daemon mds.f on smithi146 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:boot 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: fsmap 5 up:standby 2024-07-26T12:17:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 -- 172.21.15.40:0/3877059370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410fc80 msgr2=0x7f6c141164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/3877059370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410fc80 0x7f6c141164b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009ca0 tx=0x7f6c0c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 -- 172.21.15.40:0/3877059370 shutdown_connections 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/3877059370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410fc80 0x7f6c141164b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/3877059370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410f330 0x7f6c1410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/3877059370 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c141099f0 0x7f6c14109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 -- 172.21.15.40:0/3877059370 >> 172.21.15.40:0/3877059370 conn(0x7f6c14078ff0 msgr2=0x7f6c14107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 -- 172.21.15.40:0/3877059370 shutdown_connections 2024-07-26T12:17:46.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.263+0000 7f6c1ae00640 1 -- 172.21.15.40:0/3877059370 wait complete. 2024-07-26T12:17:46.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.264+0000 7f6c1ae00640 1 Processor -- start 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.264+0000 7f6c1ae00640 1 -- start start 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c141099f0 0x7f6c141a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 0x7f6c141a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410fc80 0x7f6c141a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1ae00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6c14119840 con 0x7f6c1410f330 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141196c0 con 0x7f6c141099f0 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141199c0 con 0x7f6c1410fc80 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c19000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 0x7f6c141a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c19000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 0x7f6c141a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51924/0 (socket says 172.21.15.40:51924) 2024-07-26T12:17:46.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c19000640 1 -- 172.21.15.40:0/2370913671 learned_addr learned my addr 172.21.15.40:0/2370913671 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:46.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c19a00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c141099f0 0x7f6c141a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:46.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.265+0000 7f6c1a400640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410fc80 0x7f6c141a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c19000640 1 -- 172.21.15.40:0/2370913671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410fc80 msgr2=0x7f6c141a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c19000640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410fc80 0x7f6c141a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c19000640 1 -- 172.21.15.40:0/2370913671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c141099f0 msgr2=0x7f6c141a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c19000640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c141099f0 0x7f6c141a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c19000640 1 -- 172.21.15.40:0/2370913671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c141a6140 con 0x7f6c1410f330 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c1a400640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410fc80 0x7f6c141a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c19000640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 0x7f6c141a0770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e9c0 tx=0x7f6c0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000ccc0 con 0x7f6c1410f330 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c000054b0 con 0x7f6c1410f330 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00010430 con 0x7f6c1410f330 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.266+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c141a6430 con 0x7f6c1410f330 2024-07-26T12:17:46.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.267+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c141acb90 con 0x7f6c1410f330 2024-07-26T12:17:46.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.268+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c14109e00 con 0x7f6c1410f330 2024-07-26T12:17:46.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.270+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6c00004f00 con 0x7f6c1410f330 2024-07-26T12:17:46.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.272+0000 7f6c12000640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6bfc0b3c50 0x7f6bfc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:46.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.272+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f6c000e3de0 con 0x7f6c1410f330 2024-07-26T12:17:46.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.272+0000 7f6c19a00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6bfc0b3c50 0x7f6bfc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:46.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.273+0000 7f6c19a00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6bfc0b3c50 0x7f6bfc0b6160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005fd0 tx=0x7f6c08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:46.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.274+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6c00055600 con 0x7f6c1410f330 2024-07-26T12:17:46.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.519+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c141a1300 con 0x7f6c1410f330 2024-07-26T12:17:46.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.520+0000 7f6c12000640 1 -- 172.21.15.40:0/2370913671 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f6c141a1300 con 0x7f6c1410f330 2024-07-26T12:17:46.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:46.522 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"btime":"2024-07-26T12:17:44:241773+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14673,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-07-26T12:17:46.522 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-07-26T12:17:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6bfc0b3c50 msgr2=0x7f6bfc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6bfc0b3c50 0x7f6bfc0b6160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005fd0 tx=0x7f6c08005850 comp rx=0 tx=0).stop 2024-07-26T12:17:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 msgr2=0x7f6c141a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 0x7f6c141a0770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e9c0 tx=0x7f6c0000ee80 comp rx=0 tx=0).stop 2024-07-26T12:17:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 shutdown_connections 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6bfc0b3c50 0x7f6bfc0b6160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1410fc80 0x7f6c141a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1410f330 0x7f6c141a0770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 --2- 172.21.15.40:0/2370913671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c141099f0 0x7f6c141a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.523+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 >> 172.21.15.40:0/2370913671 conn(0x7f6c14078ff0 msgr2=0x7f6c140796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.524+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 shutdown_connections 2024-07-26T12:17:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:46.524+0000 7f6c1ae00640 1 -- 172.21.15.40:0/2370913671 wait complete. 2024-07-26T12:17:47.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:46 smithi146 systemd[1]: Starting Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:17:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:47 smithi040 ceph-mon[32397]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:47 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2370913671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:47.385 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:47 smithi146 ceph-mon[35807]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:47.385 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:47 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2370913671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:47.386 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 podman[65472]: 2024-07-26 12:17:47.074404475 +0000 UTC m=+0.034635266 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:17:47.386 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 podman[65472]: 2024-07-26 12:17:47.23346426 +0000 UTC m=+0.193695055 container create f8dfca4499a6c5b7f002f37dae4aff874f27ae1631d2525cfeb52f11a80730f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True) 2024-07-26T12:17:47.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:47 smithi076 ceph-mon[35401]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:47.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:47 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2370913671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:47.642 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 podman[65472]: 2024-07-26 12:17:47.512366149 +0000 UTC m=+0.472596990 container init f8dfca4499a6c5b7f002f37dae4aff874f27ae1631d2525cfeb52f11a80730f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True) 2024-07-26T12:17:47.642 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 podman[65472]: 2024-07-26 12:17:47.522598697 +0000 UTC m=+0.482829495 container start f8dfca4499a6c5b7f002f37dae4aff874f27ae1631d2525cfeb52f11a80730f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724) 2024-07-26T12:17:47.642 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 bash[65472]: f8dfca4499a6c5b7f002f37dae4aff874f27ae1631d2525cfeb52f11a80730f4 2024-07-26T12:17:47.642 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 systemd[1]: Started Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:48.070 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 ceph-mds[65491]: -- 172.21.15.146:0/2563983761 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc68227860 con 0x55cc6c3c9a80 2024-07-26T12:17:48.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 12:17:47 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: starting mds.f at 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: Deploying daemon mds.c on smithi146 2024-07-26T12:17:48.792 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:48.793 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:boot 2024-07-26T12:17:48.793 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: fsmap 6 up:standby 2024-07-26T12:17:48.793 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T12:17:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: Deploying daemon mds.c on smithi146 2024-07-26T12:17:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:boot 2024-07-26T12:17:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: fsmap 6 up:standby 2024-07-26T12:17:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: Deploying daemon mds.c on smithi146 2024-07-26T12:17:49.078 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:49.079 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:boot 2024-07-26T12:17:49.079 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: fsmap 6 up:standby 2024-07-26T12:17:49.079 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T12:17:49.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:17:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:50.942 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:50 smithi040 ceph-mon[32397]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:51.046 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:50 smithi146 ceph-mon[35807]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:51.322 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 podman[65775]: 2024-07-26 12:17:51.044465246 +0000 UTC m=+0.128249756 container create abe1a57393416d2cdd7e9ce91c8787160108fae986ce86de3590407a40ed680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T12:17:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:50 smithi076 ceph-mon[35401]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:51.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 -- 172.21.15.40:0/2487337681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810b120 msgr2=0x7f628810b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 --2- 172.21.15.40:0/2487337681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810b120 0x7f628810b530 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6270009900 tx=0x7f627002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 -- 172.21.15.40:0/2487337681 shutdown_connections 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 --2- 172.21.15.40:0/2487337681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f628810ba70 0x7f62881122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 --2- 172.21.15.40:0/2487337681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810b120 0x7f628810b530 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 --2- 172.21.15.40:0/2487337681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881057e0 0x7f6288105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 -- 172.21.15.40:0/2487337681 >> 172.21.15.40:0/2487337681 conn(0x7f62881011f0 msgr2=0x7f6288103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.784+0000 7f628ec00640 1 -- 172.21.15.40:0/2487337681 shutdown_connections 2024-07-26T12:17:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.785+0000 7f628ec00640 1 -- 172.21.15.40:0/2487337681 wait complete. 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 Processor -- start 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 -- start start 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62881057e0 0x7f628819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f628810b120 0x7f628819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 0x7f62881a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62881155e0 con 0x7f628810ba70 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6288115460 con 0x7f62881057e0 2024-07-26T12:17:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.786+0000 7f628ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6288115760 con 0x7f628810b120 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 0x7f62881a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 0x7f62881a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51934/0 (socket says 172.21.15.40:51934) 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 -- 172.21.15.40:0/2799886083 learned_addr learned my addr 172.21.15.40:0/2799886083 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f6287e00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62881057e0 0x7f628819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f627fe00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f628810b120 0x7f628819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 -- 172.21.15.40:0/2799886083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f628810b120 msgr2=0x7f628819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f628810b120 0x7f628819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 -- 172.21.15.40:0/2799886083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62881057e0 msgr2=0x7f628819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62881057e0 0x7f628819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.787+0000 7f628cc00640 1 -- 172.21.15.40:0/2799886083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881a1f20 con 0x7f628810ba70 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.788+0000 7f628cc00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 0x7f62881a18b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f628000cad0 tx=0x7f628000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.788+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628000ad60 con 0x7f628810ba70 2024-07-26T12:17:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.788+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6280005020 con 0x7f628810ba70 2024-07-26T12:17:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.788+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628000f6b0 con 0x7f628810ba70 2024-07-26T12:17:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.788+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62881a2210 con 0x7f628810ba70 2024-07-26T12:17:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.788+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a8a30 con 0x7f628810ba70 2024-07-26T12:17:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.789+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6288105bf0 con 0x7f628810ba70 2024-07-26T12:17:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.792+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f62800051d0 con 0x7f628810ba70 2024-07-26T12:17:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.794+0000 7f6285600640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f626c0b3c80 0x7f626c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:51.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.794+0000 7f6287e00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f626c0b3c80 0x7f626c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:51.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.794+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f62800e3b10 con 0x7f628810ba70 2024-07-26T12:17:51.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.795+0000 7f6287e00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f626c0b3c80 0x7f626c0b6190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f627800abe0 tx=0x7f627800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:51.798+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6280014030 con 0x7f628810ba70 2024-07-26T12:17:51.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 podman[65775]: 2024-07-26 12:17:51.340879222 +0000 UTC m=+0.424663767 container init abe1a57393416d2cdd7e9ce91c8787160108fae986ce86de3590407a40ed680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T12:17:51.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 podman[65775]: 2024-07-26 12:17:51.351506797 +0000 UTC m=+0.435291295 container start abe1a57393416d2cdd7e9ce91c8787160108fae986ce86de3590407a40ed680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T12:17:51.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 bash[65775]: abe1a57393416d2cdd7e9ce91c8787160108fae986ce86de3590407a40ed680a 2024-07-26T12:17:51.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 systemd[1]: Started Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:51.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 ceph-mds[65793]: -- 172.21.15.146:0/3838599763 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba1396d860 con 0x55ba17b0f180 2024-07-26T12:17:51.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 12:17:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: starting mds.c at 2024-07-26T12:17:52.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.047+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62881a8c60 con 0x7f628810ba70 2024-07-26T12:17:52.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.048+0000 7f6285600640 1 -- 172.21.15.40:0/2799886083 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f62800ab560 con 0x7f628810ba70 2024-07-26T12:17:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:52.050 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-07-26T12:17:51:892400+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14673,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-07-26T12:17:52.051 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-07-26T12:17:52.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.050+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f626c0b3c80 msgr2=0x7f626c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:52.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.050+0000 7f628ec00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f626c0b3c80 0x7f626c0b6190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f627800abe0 tx=0x7f627800a2d0 comp rx=0 tx=0).stop 2024-07-26T12:17:52.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.050+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 msgr2=0x7f62881a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:52.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.050+0000 7f628ec00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 0x7f62881a18b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f628000cad0 tx=0x7f628000ced0 comp rx=0 tx=0).stop 2024-07-26T12:17:52.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 shutdown_connections 2024-07-26T12:17:52.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628810ba70 0x7f62881a18b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:52.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f626c0b3c80 0x7f626c0b6190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:52.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f628810b120 0x7f628819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:52.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 --2- 172.21.15.40:0/2799886083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62881057e0 0x7f628819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:52.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 >> 172.21.15.40:0/2799886083 conn(0x7f62881011f0 msgr2=0x7f62881098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:52.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 shutdown_connections 2024-07-26T12:17:52.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:52.051+0000 7f628ec00640 1 -- 172.21.15.40:0/2799886083 wait complete. 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] up:boot 2024-07-26T12:17:52.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: fsmap 7 up:standby 2024-07-26T12:17:52.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T12:17:52.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2799886083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:52.703 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.703 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.703 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.703 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:52.703 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:52.704 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:52.704 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] up:boot 2024-07-26T12:17:52.704 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: fsmap 7 up:standby 2024-07-26T12:17:52.704 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T12:17:52.704 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2799886083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] up:boot 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: fsmap 7 up:standby 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T12:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2799886083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:53 smithi146 ceph-mon[35807]: Deploying daemon mds.h on smithi076 2024-07-26T12:17:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:53 smithi146 ceph-mon[35807]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:53 smithi076 ceph-mon[35401]: Deploying daemon mds.h on smithi076 2024-07-26T12:17:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:53 smithi076 ceph-mon[35401]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:53 smithi040 ceph-mon[32397]: Deploying daemon mds.h on smithi076 2024-07-26T12:17:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:53 smithi040 ceph-mon[32397]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:54.756 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:54 smithi076 systemd[1]: Starting Ceph mds.h for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:17:54.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:17:55.043 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:54 smithi076 podman[65631]: 2024-07-26 12:17:54.665946177 +0000 UTC m=+0.043856509 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:17:55.044 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:54 smithi076 podman[65631]: 2024-07-26 12:17:54.780039253 +0000 UTC m=+0.157949562 container create e0ccfa0f1f528b8fa00cf6542fad7c67aafbcec46ad6a51b5e99b0c9c81a6854 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T12:17:55.044 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:55 smithi076 podman[65631]: 2024-07-26 12:17:55.041920408 +0000 UTC m=+0.419830730 container init e0ccfa0f1f528b8fa00cf6542fad7c67aafbcec46ad6a51b5e99b0c9c81a6854 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True) 2024-07-26T12:17:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:17:55.333 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:55 smithi076 podman[65631]: 2024-07-26 12:17:55.053284142 +0000 UTC m=+0.431194422 container start e0ccfa0f1f528b8fa00cf6542fad7c67aafbcec46ad6a51b5e99b0c9c81a6854 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-07-26T12:17:55.334 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:55 smithi076 bash[65631]: e0ccfa0f1f528b8fa00cf6542fad7c67aafbcec46ad6a51b5e99b0c9c81a6854 2024-07-26T12:17:55.334 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mds[65651]: -- 172.21.15.76:0/514234594 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648844e9860 con 0x56488868b180 2024-07-26T12:17:55.334 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-h[65647]: starting mds.h at 2024-07-26T12:17:55.334 INFO:journalctl@ceph.mds.h.smithi076.stdout:Jul 26 12:17:55 smithi076 systemd[1]: Started Ceph mds.h for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:55.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:17:56.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:17:56.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:17:56.065 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:17:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:56 smithi040 ceph-mon[32397]: Deploying daemon mds.i on smithi146 2024-07-26T12:17:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:boot 2024-07-26T12:17:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:56 smithi040 ceph-mon[32397]: fsmap 8 up:standby 2024-07-26T12:17:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T12:17:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:56 smithi040 ceph-mon[32397]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:56 smithi146 ceph-mon[35807]: Deploying daemon mds.i on smithi146 2024-07-26T12:17:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:boot 2024-07-26T12:17:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:56 smithi146 ceph-mon[35807]: fsmap 8 up:standby 2024-07-26T12:17:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T12:17:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:56 smithi146 ceph-mon[35807]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:56 smithi076 ceph-mon[35401]: Deploying daemon mds.i on smithi146 2024-07-26T12:17:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:boot 2024-07-26T12:17:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:56 smithi076 ceph-mon[35401]: fsmap 8 up:standby 2024-07-26T12:17:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-07-26T12:17:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:56 smithi076 ceph-mon[35401]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.535+0000 7ffab7200640 1 -- 172.21.15.40:0/1301137302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab810f940 msgr2=0x7ffab8111d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.535+0000 7ffab7200640 1 --2- 172.21.15.40:0/1301137302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab810f940 0x7ffab8111d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009ca0 tx=0x7ffab002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.535+0000 7ffab7200640 1 -- 172.21.15.40:0/1301137302 shutdown_connections 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.536+0000 7ffab7200640 1 --2- 172.21.15.40:0/1301137302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab810f940 0x7ffab8111d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.536+0000 7ffab7200640 1 --2- 172.21.15.40:0/1301137302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 0x7ffab810f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.536+0000 7ffab7200640 1 --2- 172.21.15.40:0/1301137302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab80751e0 0x7ffab80755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.536+0000 7ffab7200640 1 -- 172.21.15.40:0/1301137302 >> 172.21.15.40:0/1301137302 conn(0x7ffab80fee70 msgr2=0x7ffab81012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.536+0000 7ffab7200640 1 -- 172.21.15.40:0/1301137302 shutdown_connections 2024-07-26T12:17:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.536+0000 7ffab7200640 1 -- 172.21.15.40:0/1301137302 wait complete. 2024-07-26T12:17:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.537+0000 7ffab7200640 1 Processor -- start 2024-07-26T12:17:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.537+0000 7ffab7200640 1 -- start start 2024-07-26T12:17:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab7200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 0x7ffab819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 0x7ffab819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab7200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab810f940 0x7ffab81a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab7200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81153d0 con 0x7ffab80751e0 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab7200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8115250 con 0x7ffab810f940 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8115550 con 0x7ffab8075b30 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 0x7ffab819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 0x7ffab819be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38230/0 (socket says 172.21.15.40:38230) 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab5e00640 1 -- 172.21.15.40:0/2612686883 learned_addr learned my addr 172.21.15.40:0/2612686883 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab5400640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 0x7ffab819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab6800640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab810f940 0x7ffab81a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab5e00640 1 -- 172.21.15.40:0/2612686883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 msgr2=0x7ffab819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.538+0000 7ffab5e00640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 0x7ffab819c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab5e00640 1 -- 172.21.15.40:0/2612686883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab810f940 msgr2=0x7ffab81a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab5e00640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab810f940 0x7ffab81a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab5e00640 1 -- 172.21.15.40:0/2612686883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab81a1d70 con 0x7ffab80751e0 2024-07-26T12:17:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab5400640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 0x7ffab819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:17:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab5e00640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 0x7ffab819be00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800d950 tx=0x7ffaa800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8017070 con 0x7ffab80751e0 2024-07-26T12:17:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaa8009c30 con 0x7ffab80751e0 2024-07-26T12:17:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab81a2060 con 0x7ffab80751e0 2024-07-26T12:17:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800f620 con 0x7ffab80751e0 2024-07-26T12:17:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.539+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab81a87c0 con 0x7ffab80751e0 2024-07-26T12:17:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.541+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab80755f0 con 0x7ffab80751e0 2024-07-26T12:17:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.543+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ffaa8005030 con 0x7ffab80751e0 2024-07-26T12:17:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.545+0000 7ffaaea00640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa9c0b3c50 0x7ffa9c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:17:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.545+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ffaa80e3420 con 0x7ffab80751e0 2024-07-26T12:17:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.545+0000 7ffab5400640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa9c0b3c50 0x7ffa9c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:17:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.546+0000 7ffab5400640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa9c0b3c50 0x7ffa9c0b6160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffab8111c60 tx=0x7ffaa000a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:17:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.546+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffaa80aaef0 con 0x7ffab80751e0 2024-07-26T12:17:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.789+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffab819cf30 con 0x7ffab80751e0 2024-07-26T12:17:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.791+0000 7ffaaea00640 1 -- 172.21.15.40:0/2612686883 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7ffaa8009de0 con 0x7ffab80751e0 2024-07-26T12:17:57.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:17:57.793 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"btime":"2024-07-26T12:17:55:561315+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14673,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34592,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-07-26T12:17:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-07-26T12:17:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa9c0b3c50 msgr2=0x7ffa9c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa9c0b3c50 0x7ffa9c0b6160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffab8111c60 tx=0x7ffaa000a560 comp rx=0 tx=0).stop 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 msgr2=0x7ffab819be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 0x7ffab819be00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800d950 tx=0x7ffaa800de10 comp rx=0 tx=0).stop 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 shutdown_connections 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab810f940 0x7ffab81a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa9c0b3c50 0x7ffa9c0b6160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab8075b30 0x7ffab819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 --2- 172.21.15.40:0/2612686883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab80751e0 0x7ffab819be00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:17:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 >> 172.21.15.40:0/2612686883 conn(0x7ffab80fee70 msgr2=0x7ffab81094c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:17:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 shutdown_connections 2024-07-26T12:17:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:17:57.794+0000 7ffab7200640 1 -- 172.21.15.40:0/2612686883 wait complete. 2024-07-26T12:17:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:57 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2612686883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:58.171 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:57 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2612686883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:57 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2612686883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:17:58.536 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 systemd[1]: Starting Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:17:58.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 podman[66072]: 2024-07-26 12:17:58.437852331 +0000 UTC m=+0.034384399 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:17:58.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 podman[66072]: 2024-07-26 12:17:58.547802643 +0000 UTC m=+0.144334709 container create fe7d41be65c47b79abef0a70946e7a43ca7754d54ebe41e84ee39c67c9665342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724) 2024-07-26T12:17:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:17:58 smithi040 ceph-mon[32397]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:17:58 smithi146 ceph-mon[35807]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:17:59.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 podman[66072]: 2024-07-26 12:17:58.86860744 +0000 UTC m=+0.465139527 container init fe7d41be65c47b79abef0a70946e7a43ca7754d54ebe41e84ee39c67c9665342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-07-26T12:17:59.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 podman[66072]: 2024-07-26 12:17:58.879113427 +0000 UTC m=+0.475645491 container start fe7d41be65c47b79abef0a70946e7a43ca7754d54ebe41e84ee39c67c9665342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T12:17:59.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 bash[66072]: fe7d41be65c47b79abef0a70946e7a43ca7754d54ebe41e84ee39c67c9665342 2024-07-26T12:17:59.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 systemd[1]: Started Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:17:59.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 ceph-mds[66090]: -- 172.21.15.146:0/2128083137 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e69a1b9860 con 0x55e69e35ba80 2024-07-26T12:17:59.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 12:17:58 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: starting mds.i at 2024-07-26T12:17:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:17:58 smithi076 ceph-mon[35401]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:00.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.221 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:00.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:00.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:00.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: Deploying daemon mds.g on smithi040 2024-07-26T12:18:00.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] up:boot 2024-07-26T12:18:00.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: fsmap 9 up:standby 2024-07-26T12:18:00.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T12:18:00.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: Deploying daemon mds.g on smithi040 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] up:boot 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: fsmap 9 up:standby 2024-07-26T12:18:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: Deploying daemon mds.g on smithi040 2024-07-26T12:18:00.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] up:boot 2024-07-26T12:18:00.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: fsmap 9 up:standby 2024-07-26T12:18:00.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T12:18:00.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:18:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:01 smithi040 ceph-mon[32397]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:01 smithi146 ceph-mon[35807]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:01 smithi076 ceph-mon[35401]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:03.161 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 podman[74147]: 2024-07-26 12:18:03.015359346 +0000 UTC m=+0.152817841 container create d6c15625d5ca30f5f66acaee7a717cafb471ecb613a07a7ddd3380da6c89a6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-07-26T12:18:03.412 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:03 smithi040 ceph-mon[32397]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:03.413 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 podman[74147]: 2024-07-26 12:18:03.286560123 +0000 UTC m=+0.424018624 container init d6c15625d5ca30f5f66acaee7a717cafb471ecb613a07a7ddd3380da6c89a6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T12:18:03.413 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 podman[74147]: 2024-07-26 12:18:03.29553766 +0000 UTC m=+0.432996161 container start d6c15625d5ca30f5f66acaee7a717cafb471ecb613a07a7ddd3380da6c89a6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T12:18:03.413 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 bash[74147]: d6c15625d5ca30f5f66acaee7a717cafb471ecb613a07a7ddd3380da6c89a6bd 2024-07-26T12:18:03.413 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 systemd[1]: Started Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:18:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:03 smithi146 ceph-mon[35807]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:03 smithi076 ceph-mon[35401]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:03.692 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 ceph-mds[74184]: -- 172.21.15.40:0/65504643 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566f167fc20 con 0x5566f5821600 2024-07-26T12:18:03.692 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 12:18:03 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: starting mds.g at 2024-07-26T12:18:04.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 -- 172.21.15.40:0/1622513855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68101fe0 msgr2=0x7f7e681023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 --2- 172.21.15.40:0/1622513855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68101fe0 0x7f7e681023f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009930 tx=0x7f7e5c02a420 comp rx=0 tx=0).stop 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 -- 172.21.15.40:0/1622513855 shutdown_connections 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 --2- 172.21.15.40:0/1622513855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e68107420 0x7f7e68107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 --2- 172.21.15.40:0/1622513855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68102930 0x7f7e68106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 --2- 172.21.15.40:0/1622513855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68101fe0 0x7f7e681023f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 -- 172.21.15.40:0/1622513855 >> 172.21.15.40:0/1622513855 conn(0x7f7e680fdcf0 msgr2=0x7f7e68100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 -- 172.21.15.40:0/1622513855 shutdown_connections 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.049+0000 7f7e6de00640 1 -- 172.21.15.40:0/1622513855 wait complete. 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.051+0000 7f7e6de00640 1 Processor -- start 2024-07-26T12:18:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.051+0000 7f7e6de00640 1 -- start start 2024-07-26T12:18:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.051+0000 7f7e6de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68101fe0 0x7f7e681a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 0x7f7e681a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e68107420 0x7f7e681a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6de00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7e68119790 con 0x7f7e68102930 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6de00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7e68119610 con 0x7f7e68107420 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6de00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e68119910 con 0x7f7e68101fe0 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e67e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 0x7f7e681a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e67e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 0x7f7e681a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40266/0 (socket says 172.21.15.40:40266) 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e67e00640 1 -- 172.21.15.40:0/3949438445 learned_addr learned my addr 172.21.15.40:0/3949438445 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6d400640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e68107420 0x7f7e681a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.052+0000 7f7e6ca00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68101fe0 0x7f7e681a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.053+0000 7f7e67e00640 1 -- 172.21.15.40:0/3949438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68101fe0 msgr2=0x7f7e681a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.053+0000 7f7e67e00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68101fe0 0x7f7e681a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.053+0000 7f7e67e00640 1 -- 172.21.15.40:0/3949438445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e68107420 msgr2=0x7f7e681a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.053+0000 7f7e67e00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e68107420 0x7f7e681a5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.053+0000 7f7e67e00640 1 -- 172.21.15.40:0/3949438445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e681a6110 con 0x7f7e68102930 2024-07-26T12:18:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.053+0000 7f7e6ca00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68101fe0 0x7f7e681a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.054+0000 7f7e67e00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 0x7f7e681a0800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400d750 tx=0x7f7e5400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.054+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54017070 con 0x7f7e68102930 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.054+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e681a6400 con 0x7f7e68102930 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.054+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e681acc20 con 0x7f7e68102930 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.054+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e540054b0 con 0x7f7e68102930 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.054+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54004bc0 con 0x7f7e68102930 2024-07-26T12:18:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.056+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e480052c0 con 0x7f7e68102930 2024-07-26T12:18:04.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.060+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f7e54009c30 con 0x7f7e68102930 2024-07-26T12:18:04.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.063+0000 7f7e65600640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e500b3c00 0x7f7e500b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.063+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f7e540e3420 con 0x7f7e68102930 2024-07-26T12:18:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.063+0000 7f7e6ca00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e500b3c00 0x7f7e500b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.064+0000 7f7e6ca00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e500b3c00 0x7f7e500b6110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c006010 tx=0x7f7e5c005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:04.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.066+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7e540aae70 con 0x7f7e68102930 2024-07-26T12:18:04.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.326+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e480055b0 con 0x7f7e68102930 2024-07-26T12:18:04.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.328+0000 7f7e65600640 1 -- 172.21.15.40:0/3949438445 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7f7e540aa770 con 0x7f7e68102930 2024-07-26T12:18:04.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:18:04.331 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":11,"btime":"2024-07-26T12:18:04:274932+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14673,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":14715,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24610,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34592,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-07-26T12:18:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 11 2024-07-26T12:18:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e500b3c00 msgr2=0x7f7e500b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e500b3c00 0x7f7e500b6110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c006010 tx=0x7f7e5c005de0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 msgr2=0x7f7e681a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:04.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 0x7f7e681a0800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400d750 tx=0x7f7e5400dc10 comp rx=0 tx=0).stop 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 shutdown_connections 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e68107420 0x7f7e681a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e68102930 0x7f7e681a0800 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e500b3c00 0x7f7e500b6110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 --2- 172.21.15.40:0/3949438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68101fe0 0x7f7e681a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 >> 172.21.15.40:0/3949438445 conn(0x7f7e680fdcf0 msgr2=0x7f7e68104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 shutdown_connections 2024-07-26T12:18:04.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:04.331+0000 7f7e6de00640 1 -- 172.21.15.40:0/3949438445 wait complete. 2024-07-26T12:18:04.708 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.708 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: Deploying daemon mds.a on smithi040 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:boot 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: fsmap 10 up:standby 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T12:18:04.709 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:04 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3949438445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: Deploying daemon mds.a on smithi040 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:boot 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: fsmap 10 up:standby 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T12:18:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:04 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3949438445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: Deploying daemon mds.a on smithi040 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:boot 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: fsmap 10 up:standby 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T12:18:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:04 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3949438445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:05.672 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:05 smithi040 ceph-mon[32397]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:05 smithi146 ceph-mon[35807]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:05 smithi076 ceph-mon[35401]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:07.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:18:07.164 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:06 smithi040 systemd[1]: Starting Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:18:07.483 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 podman[74515]: 2024-07-26 12:18:07.084530483 +0000 UTC m=+0.042618338 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:18:07.483 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 podman[74515]: 2024-07-26 12:18:07.219191163 +0000 UTC m=+0.177279033 container create daee5aef891f8e2fe85ec43ee66bede05afc2179997e17643b0b2e3dfe858dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T12:18:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:07 smithi146 ceph-mon[35807]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:07 smithi076 ceph-mon[35401]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:07.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:07 smithi040 ceph-mon[32397]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:07.944 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 podman[74515]: 2024-07-26 12:18:07.509972595 +0000 UTC m=+0.468060465 container init daee5aef891f8e2fe85ec43ee66bede05afc2179997e17643b0b2e3dfe858dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-07-26T12:18:07.944 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 podman[74515]: 2024-07-26 12:18:07.522772608 +0000 UTC m=+0.480860444 container start daee5aef891f8e2fe85ec43ee66bede05afc2179997e17643b0b2e3dfe858dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-07-26T12:18:07.944 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 bash[74515]: daee5aef891f8e2fe85ec43ee66bede05afc2179997e17643b0b2e3dfe858dbd 2024-07-26T12:18:07.944 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 systemd[1]: Started Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:18:07.944 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 ceph-mds[74565]: -- 172.21.15.40:0/3623091992 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556728807c20 con 0x55672c9a9180 2024-07-26T12:18:07.944 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 12:18:07 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: starting mds.a at 2024-07-26T12:18:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:08.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: Deploying daemon mds.b on smithi076 2024-07-26T12:18:08.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:08.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:boot 2024-07-26T12:18:08.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: fsmap 11 up:standby 2024-07-26T12:18:08.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: Deploying daemon mds.b on smithi076 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:boot 2024-07-26T12:18:08.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: fsmap 11 up:standby 2024-07-26T12:18:08.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: Deploying daemon mds.b on smithi076 2024-07-26T12:18:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:09.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:boot 2024-07-26T12:18:09.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: fsmap 11 up:standby 2024-07-26T12:18:09.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T12:18:09.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.885+0000 7fb0d9600640 1 -- 172.21.15.40:0/2655262738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410ba70 msgr2=0x7fb0d41122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:09.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.885+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2655262738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410ba70 0x7fb0d41122a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009900 tx=0x7fb0cc02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.885+0000 7fb0d9600640 1 -- 172.21.15.40:0/2655262738 shutdown_connections 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.885+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2655262738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410ba70 0x7fb0d41122a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.886+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2655262738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410b120 0x7fb0d410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.886+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2655262738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 0x7fb0d4105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.886+0000 7fb0d9600640 1 -- 172.21.15.40:0/2655262738 >> 172.21.15.40:0/2655262738 conn(0x7fb0d41011f0 msgr2=0x7fb0d4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.886+0000 7fb0d9600640 1 -- 172.21.15.40:0/2655262738 shutdown_connections 2024-07-26T12:18:09.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.886+0000 7fb0d9600640 1 -- 172.21.15.40:0/2655262738 wait complete. 2024-07-26T12:18:09.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 Processor -- start 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 -- start start 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 0x7fb0d419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 0x7fb0d419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410ba70 0x7fb0d41a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d41155f0 con 0x7fb0d410b120 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4115470 con 0x7fb0d41057e0 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.887+0000 7fb0d9600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4115770 con 0x7fb0d410ba70 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 0x7fb0d419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 0x7fb0d419c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40302/0 (socket says 172.21.15.40:40302) 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 -- 172.21.15.40:0/2989598176 learned_addr learned my addr 172.21.15.40:0/2989598176 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:09.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0d2a00640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 0x7fb0d419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:09.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0d3400640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410ba70 0x7fb0d41a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:09.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 -- 172.21.15.40:0/2989598176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410ba70 msgr2=0x7fb0d41a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:09.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410ba70 0x7fb0d41a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 -- 172.21.15.40:0/2989598176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 msgr2=0x7fb0d419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 0x7fb0d419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0ca000640 1 -- 172.21.15.40:0/2989598176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d41a1f50 con 0x7fb0d410b120 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0d2a00640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 0x7fb0d419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.888+0000 7fb0d3400640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410ba70 0x7fb0d41a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.889+0000 7fb0ca000640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 0x7fb0d419c580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00d750 tx=0x7fb0bc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.889+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc017070 con 0x7fb0d410b120 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.889+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0bc0054b0 con 0x7fb0d410b120 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.889+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d41a2240 con 0x7fb0d410b120 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.889+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc004bc0 con 0x7fb0d410b120 2024-07-26T12:18:09.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.889+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d41a89a0 con 0x7fb0d410b120 2024-07-26T12:18:09.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.890+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d4105bf0 con 0x7fb0d410b120 2024-07-26T12:18:09.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.894+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fb0bc009c30 con 0x7fb0d410b120 2024-07-26T12:18:09.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.896+0000 7fb0cbe00640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0b80b3c50 0x7fb0b80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:09.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.896+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb0bc0e3610 con 0x7fb0d410b120 2024-07-26T12:18:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.896+0000 7fb0d2a00640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0b80b3c50 0x7fb0b80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.897+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb0bc0ab0e0 con 0x7fb0d410b120 2024-07-26T12:18:09.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:09.897+0000 7fb0d2a00640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0b80b3c50 0x7fb0b80b6160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4005fd0 tx=0x7fb0c4009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:10.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.143+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0d419d110 con 0x7fb0d410b120 2024-07-26T12:18:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.145+0000 7fb0cbe00640 1 -- 172.21.15.40:0/2989598176 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7fb0d419d110 con 0x7fb0d410b120 2024-07-26T12:18:10.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:18:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 12 2024-07-26T12:18:10.148 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":12,"btime":"2024-07-26T12:18:08:532114+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14673,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":14715,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14727,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24610,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34592,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-07-26T12:18:10.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0b80b3c50 msgr2=0x7fb0b80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0b80b3c50 0x7fb0b80b6160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4005fd0 tx=0x7fb0c4009520 comp rx=0 tx=0).stop 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 msgr2=0x7fb0d419c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 0x7fb0d419c580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00d750 tx=0x7fb0bc00dc10 comp rx=0 tx=0).stop 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 shutdown_connections 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0b80b3c50 0x7fb0b80b6160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d410ba70 0x7fb0d41a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0d410b120 0x7fb0d419c580 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 --2- 172.21.15.40:0/2989598176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0d41057e0 0x7fb0d419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 >> 172.21.15.40:0/2989598176 conn(0x7fb0d41011f0 msgr2=0x7fb0d4104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 shutdown_connections 2024-07-26T12:18:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:10.148+0000 7fb0d9600640 1 -- 172.21.15.40:0/2989598176 wait complete. 2024-07-26T12:18:10.808 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:10 smithi076 systemd[1]: Starting Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T12:18:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:10 smithi076 ceph-mon[35401]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:10 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2989598176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:11.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:10 smithi076 podman[65939]: 2024-07-26 12:18:10.811413011 +0000 UTC m=+0.032455460 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T12:18:11.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:10 smithi076 podman[65939]: 2024-07-26 12:18:10.931559033 +0000 UTC m=+0.152601521 container create 4122e0e03ee9133d5022eb5e40b128bf4721e9d5176dd7dbe29314eb6126c26a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-07-26T12:18:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:10 smithi040 ceph-mon[32397]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:10 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2989598176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:10 smithi146 ceph-mon[35807]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:10 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2989598176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:11.583 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:11 smithi076 podman[65939]: 2024-07-26 12:18:11.201933102 +0000 UTC m=+0.422975593 container init 4122e0e03ee9133d5022eb5e40b128bf4721e9d5176dd7dbe29314eb6126c26a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T12:18:11.583 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:11 smithi076 podman[65939]: 2024-07-26 12:18:11.21105952 +0000 UTC m=+0.432102005 container start 4122e0e03ee9133d5022eb5e40b128bf4721e9d5176dd7dbe29314eb6126c26a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T12:18:11.584 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:11 smithi076 bash[65939]: 4122e0e03ee9133d5022eb5e40b128bf4721e9d5176dd7dbe29314eb6126c26a 2024-07-26T12:18:11.584 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:11 smithi076 systemd[1]: Started Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T12:18:11.584 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:11 smithi076 ceph-mds[65964]: -- 172.21.15.76:0/62129088 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea03d6bc20 con 0x55ea07f0da80 2024-07-26T12:18:11.584 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: starting mds.b at 2024-07-26T12:18:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] up:boot 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: fsmap 12 up:standby 2024-07-26T12:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T12:18:12.818 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.818 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.818 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.818 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.818 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.819 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:18:12.819 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] up:boot 2024-07-26T12:18:12.819 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: fsmap 12 up:standby 2024-07-26T12:18:12.819 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T12:18:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] up:boot 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: fsmap 12 up:standby 2024-07-26T12:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T12:18:12.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:18:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:13 smithi146 ceph-mon[35807]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:13 smithi040 ceph-mon[32397]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:13 smithi076 ceph-mon[35401]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:15 smithi146 ceph-mon[35807]: pgmap v371: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:15 smithi076 ceph-mon[35401]: pgmap v371: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.615 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:15 smithi040 ceph-mon[32397]: pgmap v371: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:15.615 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.615 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.615 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:15.615 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.154+0000 7fe039200640 1 -- 172.21.15.40:0/1337892559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034107bf0 msgr2=0x7fe034108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.154+0000 7fe039200640 1 --2- 172.21.15.40:0/1337892559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034107bf0 0x7fe034108000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe020009900 tx=0x7fe02002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 -- 172.21.15.40:0/1337892559 shutdown_connections 2024-07-26T12:18:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 --2- 172.21.15.40:0/1337892559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe034108540 0x7fe03410ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 --2- 172.21.15.40:0/1337892559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034107bf0 0x7fe034108000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 --2- 172.21.15.40:0/1337892559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0341022b0 0x7fe0341026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 -- 172.21.15.40:0/1337892559 >> 172.21.15.40:0/1337892559 conn(0x7fe0340fdd00 msgr2=0x7fe034100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 -- 172.21.15.40:0/1337892559 shutdown_connections 2024-07-26T12:18:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.155+0000 7fe039200640 1 -- 172.21.15.40:0/1337892559 wait complete. 2024-07-26T12:18:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.156+0000 7fe039200640 1 Processor -- start 2024-07-26T12:18:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.156+0000 7fe039200640 1 -- start start 2024-07-26T12:18:16.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe039200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0341022b0 0x7fe03419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:16.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe039200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe034107bf0 0x7fe03419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:16.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe039200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 0x7fe0341a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:16.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe039200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe034112060 con 0x7fe034108540 2024-07-26T12:18:16.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe039200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe034111ee0 con 0x7fe0341022b0 2024-07-26T12:18:16.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe039200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341121e0 con 0x7fe034107bf0 2024-07-26T12:18:16.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe033e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 0x7fe0341a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:16.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe033e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 0x7fe0341a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34768/0 (socket says 172.21.15.40:34768) 2024-07-26T12:18:16.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.157+0000 7fe033e00640 1 -- 172.21.15.40:0/1615526198 learned_addr learned my addr 172.21.15.40:0/1615526198 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:16.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe033400640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0341022b0 0x7fe03419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:16.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe032a00640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe034107bf0 0x7fe03419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:16.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe033e00640 1 -- 172.21.15.40:0/1615526198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe034107bf0 msgr2=0x7fe03419c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:16.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe033e00640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe034107bf0 0x7fe03419c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe033e00640 1 -- 172.21.15.40:0/1615526198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0341022b0 msgr2=0x7fe03419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe033e00640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0341022b0 0x7fe03419bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.158+0000 7fe033e00640 1 -- 172.21.15.40:0/1615526198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0341a1e50 con 0x7fe034108540 2024-07-26T12:18:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.159+0000 7fe033e00640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 0x7fe0341a17e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00cad0 tx=0x7fe02c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.159+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00ad60 con 0x7fe034108540 2024-07-26T12:18:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.159+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe02c005020 con 0x7fe034108540 2024-07-26T12:18:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.159+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0341a2140 con 0x7fe034108540 2024-07-26T12:18:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.159+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00f6b0 con 0x7fe034108540 2024-07-26T12:18:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.159+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0341a2600 con 0x7fe034108540 2024-07-26T12:18:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.161+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0341026c0 con 0x7fe034108540 2024-07-26T12:18:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.163+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fe02c0051d0 con 0x7fe034108540 2024-07-26T12:18:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.165+0000 7fe02be00640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0180b3c00 0x7fe0180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.165+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe02c0e3a60 con 0x7fe034108540 2024-07-26T12:18:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.165+0000 7fe033400640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0180b3c00 0x7fe0180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.166+0000 7fe033400640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0180b3c00 0x7fe0180b6110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe02400abe0 tx=0x7fe02400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:16.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.169+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe02c014030 con 0x7fe034108540 2024-07-26T12:18:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.448+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe03419d0d0 con 0x7fe034108540 2024-07-26T12:18:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.449+0000 7fe02be00640 1 -- 172.21.15.40:0/1615526198 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7fe02c0ab4b0 con 0x7fe034108540 2024-07-26T12:18:16.451 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:18:16.452 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"btime":"2024-07-26T12:18:11:903031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14673,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":14715,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14727,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24547,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24610,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34547,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34592,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-07-26T12:18:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2024-07-26T12:18:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.452+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0180b3c00 msgr2=0x7fe0180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.452+0000 7fe039200640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0180b3c00 0x7fe0180b6110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe02400abe0 tx=0x7fe02400a2d0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.452+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 msgr2=0x7fe0341a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.452+0000 7fe039200640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 0x7fe0341a17e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00cad0 tx=0x7fe02c00ced0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 shutdown_connections 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe034108540 0x7fe0341a17e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0180b3c00 0x7fe0180b6110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe034107bf0 0x7fe03419c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 --2- 172.21.15.40:0/1615526198 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0341022b0 0x7fe03419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 >> 172.21.15.40:0/1615526198 conn(0x7fe0340fdd00 msgr2=0x7fe034106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 shutdown_connections 2024-07-26T12:18:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:16.453+0000 7fe039200640 1 -- 172.21.15.40:0/1615526198 wait complete. 2024-07-26T12:18:17.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-07-26T12:18:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:17 smithi040 ceph-mon[32397]: pgmap v372: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1615526198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:17 smithi146 ceph-mon[35807]: pgmap v372: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1615526198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:17 smithi076 ceph-mon[35401]: pgmap v372: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1615526198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:18:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:18.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:18.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:18:18.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:18.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:18:18.799 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:18.799 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:18:18.799 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:18.799 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:18:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:18:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:18:19.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:19 smithi040 ceph-mon[32397]: pgmap v373: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:19.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 -- 172.21.15.40:0/294522152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 msgr2=0x7f3d6c0755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 --2- 172.21.15.40:0/294522152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c0755f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009900 tx=0x7f3d5c02a410 comp rx=0 tx=0).stop 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 -- 172.21.15.40:0/294522152 shutdown_connections 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 --2- 172.21.15.40:0/294522152 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c10fb10 0x7f3d6c111f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 --2- 172.21.15.40:0/294522152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d6c075b30 0x7f3d6c10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 --2- 172.21.15.40:0/294522152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c0755f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 -- 172.21.15.40:0/294522152 >> 172.21.15.40:0/294522152 conn(0x7f3d6c0fefc0 msgr2=0x7f3d6c101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 -- 172.21.15.40:0/294522152 shutdown_connections 2024-07-26T12:18:19.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.779+0000 7f3d71200640 1 -- 172.21.15.40:0/294522152 wait complete. 2024-07-26T12:18:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 Processor -- start 2024-07-26T12:18:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 -- start start 2024-07-26T12:18:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c075b30 0x7f3d6c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d6c10fb10 0x7f3d6c1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c1155a0 con 0x7f3d6c0751e0 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c115420 con 0x7f3d6c075b30 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.781+0000 7f3d71200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c115720 con 0x7f3d6c10fb10 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d61400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c075b30 0x7f3d6c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c19c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34794/0 (socket says 172.21.15.40:34794) 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 -- 172.21.15.40:0/2146369814 learned_addr learned my addr 172.21.15.40:0/2146369814 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d6a800640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d6c10fb10 0x7f3d6c1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 -- 172.21.15.40:0/2146369814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d6c10fb10 msgr2=0x7f3d6c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d6c10fb10 0x7f3d6c1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 -- 172.21.15.40:0/2146369814 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c075b30 msgr2=0x7f3d6c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c075b30 0x7f3d6c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d69e00640 1 -- 172.21.15.40:0/2146369814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c1a1f80 con 0x7f3d6c0751e0 2024-07-26T12:18:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.782+0000 7f3d61400640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c075b30 0x7f3d6c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:18:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.783+0000 7f3d69e00640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c19c010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c02a930 tx=0x7f3d5c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.783+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c03f070 con 0x7f3d6c0751e0 2024-07-26T12:18:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.783+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d5c03baf0 con 0x7f3d6c0751e0 2024-07-26T12:18:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.783+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6c1a2210 con 0x7f3d6c0751e0 2024-07-26T12:18:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.783+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c035030 con 0x7f3d6c0751e0 2024-07-26T12:18:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.783+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6c1a89d0 con 0x7f3d6c0751e0 2024-07-26T12:18:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.784+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c0755f0 con 0x7f3d6c0751e0 2024-07-26T12:18:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.787+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3d5c042070 con 0x7f3d6c0751e0 2024-07-26T12:18:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.788+0000 7f3d63400640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3d500b3c50 0x7f3d500b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.789+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3d5c104120 con 0x7f3d6c0751e0 2024-07-26T12:18:19.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.789+0000 7f3d61400640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3d500b3c50 0x7f3d500b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:19.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.789+0000 7f3d61400640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3d500b3c50 0x7f3d500b6160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c102510 tx=0x7f3d54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:19.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:19.791+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3d5c0cb520 con 0x7f3d6c0751e0 2024-07-26T12:18:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:19 smithi146 ceph-mon[35807]: pgmap v373: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:19 smithi076 ceph-mon[35401]: pgmap v373: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:20.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.000+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3d6c1a8c30 con 0x7f3d6c0751e0 2024-07-26T12:18:20.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.001+0000 7f3d63400640 1 -- 172.21.15.40:0/2146369814 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f3d5c0cfa70 con 0x7f3d6c0751e0 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:18:20.003 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3d500b3c50 msgr2=0x7f3d500b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3d500b3c50 0x7f3d500b6160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c102510 tx=0x7f3d54005f90 comp rx=0 tx=0).stop 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 msgr2=0x7f3d6c19c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c19c010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c02a930 tx=0x7f3d5c003b90 comp rx=0 tx=0).stop 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 shutdown_connections 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3d500b3c50 0x7f3d500b6160 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d6c10fb10 0x7f3d6c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3d6c075b30 0x7f3d6c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:20.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 --2- 172.21.15.40:0/2146369814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c0751e0 0x7f3d6c19c010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:20.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 >> 172.21.15.40:0/2146369814 conn(0x7f3d6c0fefc0 msgr2=0x7f3d6c1096b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:20.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 shutdown_connections 2024-07-26T12:18:20.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:20.004+0000 7f3d71200640 1 -- 172.21.15.40:0/2146369814 wait complete. 2024-07-26T12:18:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:20 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2146369814' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-26T12:18:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:20 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2146369814' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-26T12:18:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:20 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2146369814' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-07-26T12:18:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:20.974 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-26T12:18:20.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-26T12:18:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:21 smithi040 ceph-mon[32397]: pgmap v374: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:21 smithi146 ceph-mon[35807]: pgmap v374: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:21 smithi076 ceph-mon[35401]: pgmap v374: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:23 smithi040 ceph-mon[32397]: pgmap v375: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:18:23.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 -- 172.21.15.40:0/1630210868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0751e0 msgr2=0x7fc22c0755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 --2- 172.21.15.40:0/1630210868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0751e0 0x7fc22c0755f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009ca0 tx=0x7fc21c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:18:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 -- 172.21.15.40:0/1630210868 shutdown_connections 2024-07-26T12:18:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 --2- 172.21.15.40:0/1630210868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c10f920 0x7fc22c111d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 --2- 172.21.15.40:0/1630210868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c075b30 0x7fc22c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 --2- 172.21.15.40:0/1630210868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0751e0 0x7fc22c0755f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 -- 172.21.15.40:0/1630210868 >> 172.21.15.40:0/1630210868 conn(0x7fc22c0fee10 msgr2=0x7fc22c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.538+0000 7fc232e00640 1 -- 172.21.15.40:0/1630210868 shutdown_connections 2024-07-26T12:18:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.539+0000 7fc232e00640 1 -- 172.21.15.40:0/1630210868 wait complete. 2024-07-26T12:18:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 Processor -- start 2024-07-26T12:18:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 -- start start 2024-07-26T12:18:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c0751e0 0x7fc22c19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c075b30 0x7fc22c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 0x7fc22c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c1153b0 con 0x7fc22c10f920 2024-07-26T12:18:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c115230 con 0x7fc22c0751e0 2024-07-26T12:18:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.540+0000 7fc232e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c115530 con 0x7fc22c075b30 2024-07-26T12:18:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 0x7fc22c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 0x7fc22c1a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43532/0 (socket says 172.21.15.40:43532) 2024-07-26T12:18:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 -- 172.21.15.40:0/1395379342 learned_addr learned my addr 172.21.15.40:0/1395379342 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc231000640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c075b30 0x7fc22c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc231a00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c0751e0 0x7fc22c19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 -- 172.21.15.40:0/1395379342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c075b30 msgr2=0x7fc22c19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c075b30 0x7fc22c19c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 -- 172.21.15.40:0/1395379342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c0751e0 msgr2=0x7fc22c19be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c0751e0 0x7fc22c19be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc232400640 1 -- 172.21.15.40:0/1395379342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c1a1d90 con 0x7fc22c10f920 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.541+0000 7fc231a00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c0751e0 0x7fc22c19be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.542+0000 7fc232400640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 0x7fc22c1a1660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc22400d750 tx=0x7fc22400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.542+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224017070 con 0x7fc22c10f920 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.542+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c1a2080 con 0x7fc22c10f920 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.542+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2240054b0 con 0x7fc22c10f920 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.542+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224004b90 con 0x7fc22c10f920 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.542+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c1a87e0 con 0x7fc22c10f920 2024-07-26T12:18:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.543+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c0755f0 con 0x7fc22c10f920 2024-07-26T12:18:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.547+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fc224004d30 con 0x7fc22c10f920 2024-07-26T12:18:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.548+0000 7fc22a000640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2100b3bd0 0x7fc2100b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.549+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc2240e3640 con 0x7fc22c10f920 2024-07-26T12:18:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.549+0000 7fc231a00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2100b3bd0 0x7fc2100b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.550+0000 7fc231a00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2100b3bd0 0x7fc2100b60e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc21c000f80 tx=0x7fc21c0314f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.550+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc2240ab090 con 0x7fc22c10f920 2024-07-26T12:18:23.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:23.754+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc22c1a8a40 con 0x7fc22c10f920 2024-07-26T12:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:23 smithi146 ceph-mon[35807]: pgmap v375: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:23 smithi076 ceph-mon[35401]: pgmap v375: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:18:24.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.468+0000 7fc22a000640 1 -- 172.21.15.40:0/1395379342 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fc2240aa990 con 0x7fc22c10f920 2024-07-26T12:18:24.471 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-07-26T12:18:24.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.472+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2100b3bd0 msgr2=0x7fc2100b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:24.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.472+0000 7fc232e00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2100b3bd0 0x7fc2100b60e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc21c000f80 tx=0x7fc21c0314f0 comp rx=0 tx=0).stop 2024-07-26T12:18:24.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.472+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 msgr2=0x7fc22c1a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:24.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.472+0000 7fc232e00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 0x7fc22c1a1660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc22400d750 tx=0x7fc22400dc10 comp rx=0 tx=0).stop 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 shutdown_connections 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c10f920 0x7fc22c1a1660 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2100b3bd0 0x7fc2100b60e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc22c075b30 0x7fc22c19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 --2- 172.21.15.40:0/1395379342 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc22c0751e0 0x7fc22c19be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 >> 172.21.15.40:0/1395379342 conn(0x7fc22c0fee10 msgr2=0x7fc22c1083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 shutdown_connections 2024-07-26T12:18:24.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:24.473+0000 7fc232e00640 1 -- 172.21.15.40:0/1395379342 wait complete. 2024-07-26T12:18:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:24 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1395379342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T12:18:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:24 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1395379342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T12:18:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:24 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1395379342' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-07-26T12:18:25.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-26T12:18:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:25 smithi146 ceph-mon[35807]: pgmap v376: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1395379342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-26T12:18:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:25 smithi146 ceph-mon[35807]: osdmap e74: 12 total, 12 up, 12 in 2024-07-26T12:18:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:25 smithi076 ceph-mon[35401]: pgmap v376: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1395379342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-26T12:18:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:25 smithi076 ceph-mon[35401]: osdmap e74: 12 total, 12 up, 12 in 2024-07-26T12:18:25.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:25 smithi040 ceph-mon[32397]: pgmap v376: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:25.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1395379342' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-07-26T12:18:25.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:25 smithi040 ceph-mon[32397]: osdmap e74: 12 total, 12 up, 12 in 2024-07-26T12:18:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:26 smithi146 ceph-mon[35807]: osdmap e75: 12 total, 12 up, 12 in 2024-07-26T12:18:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:26 smithi076 ceph-mon[35401]: osdmap e75: 12 total, 12 up, 12 in 2024-07-26T12:18:26.938 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:26 smithi040 ceph-mon[32397]: osdmap e75: 12 total, 12 up, 12 in 2024-07-26T12:18:27.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:27 smithi040 ceph-mon[32397]: pgmap v379: 33 pgs: 31 unknown, 2 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:27.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:27 smithi040 ceph-mon[32397]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T12:18:27.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:27 smithi040 ceph-mon[32397]: osdmap e76: 12 total, 12 up, 12 in 2024-07-26T12:18:27.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 -- 172.21.15.40:0/4187927811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa410af30 msgr2=0x7fdaa410b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:27.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4187927811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa410af30 0x7fdaa410b340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda90009900 tx=0x7fda9002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:18:27.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 -- 172.21.15.40:0/4187927811 shutdown_connections 2024-07-26T12:18:27.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4187927811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdaa410b880 0x7fdaa41120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:27.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4187927811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa410af30 0x7fdaa410b340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:27.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4187927811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdaa41055f0 0x7fdaa4105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:27.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 -- 172.21.15.40:0/4187927811 >> 172.21.15.40:0/4187927811 conn(0x7fdaa4101060 msgr2=0x7fdaa41034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:27.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 -- 172.21.15.40:0/4187927811 shutdown_connections 2024-07-26T12:18:27.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.795+0000 7fdaaa400640 1 -- 172.21.15.40:0/4187927811 wait complete. 2024-07-26T12:18:27.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.797+0000 7fdaaa400640 1 Processor -- start 2024-07-26T12:18:27.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.797+0000 7fdaaa400640 1 -- start start 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaaa400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 0x7fdaa419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaaa400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdaa410af30 0x7fdaa419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaaa400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdaa410b880 0x7fdaa41a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaaa400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa41153a0 con 0x7fdaa41055f0 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaaa400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4115220 con 0x7fdaa410b880 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaaa400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4115520 con 0x7fdaa410af30 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaa9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 0x7fdaa419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaa9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 0x7fdaa419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43548/0 (socket says 172.21.15.40:43548) 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaa9000640 1 -- 172.21.15.40:0/4016889787 learned_addr learned my addr 172.21.15.40:0/4016889787 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaa3e00640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdaa410af30 0x7fdaa419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.798+0000 7fdaa9a00640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdaa410b880 0x7fdaa41a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:27.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa9000640 1 -- 172.21.15.40:0/4016889787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdaa410af30 msgr2=0x7fdaa419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:27.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa9000640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdaa410af30 0x7fdaa419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa9000640 1 -- 172.21.15.40:0/4016889787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdaa410b880 msgr2=0x7fdaa41a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa9000640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdaa410b880 0x7fdaa41a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa9000640 1 -- 172.21.15.40:0/4016889787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa41a1d20 con 0x7fdaa41055f0 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa9000640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 0x7fdaa419be70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c920 tx=0x7fda9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98007c70 con 0x7fdaa41055f0 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa41a2010 con 0x7fdaa41055f0 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda98007e10 con 0x7fdaa41055f0 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.799+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980186f0 con 0x7fdaa41055f0 2024-07-26T12:18:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.800+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa41a8830 con 0x7fdaa41055f0 2024-07-26T12:18:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.801+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa4105a00 con 0x7fdaa41055f0 2024-07-26T12:18:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.804+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fda9800f450 con 0x7fdaa41055f0 2024-07-26T12:18:27.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.805+0000 7fdaa1600640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fda8c0b3c80 0x7fda8c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:27.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.806+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fda980e3d80 con 0x7fdaa41055f0 2024-07-26T12:18:27.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.806+0000 7fdaa3e00640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fda8c0b3c80 0x7fda8c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.807+0000 7fdaa3e00640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fda8c0b3c80 0x7fda8c0b6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fda900057c0 tx=0x7fda90000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:27.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:27.809+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fda98014030 con 0x7fdaa41055f0 2024-07-26T12:18:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:27 smithi146 ceph-mon[35807]: pgmap v379: 33 pgs: 31 unknown, 2 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:27 smithi146 ceph-mon[35807]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T12:18:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:27 smithi146 ceph-mon[35807]: osdmap e76: 12 total, 12 up, 12 in 2024-07-26T12:18:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:27 smithi076 ceph-mon[35401]: pgmap v379: 33 pgs: 31 unknown, 2 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:27 smithi076 ceph-mon[35401]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T12:18:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:27 smithi076 ceph-mon[35401]: osdmap e76: 12 total, 12 up, 12 in 2024-07-26T12:18:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.013+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdaa419cfa0 con 0x7fdaa41055f0 2024-07-26T12:18:28.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.514+0000 7fdaa1600640 1 -- 172.21.15.40:0/4016889787 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7fda980ab770 con 0x7fdaa41055f0 2024-07-26T12:18:28.516 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-07-26T12:18:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fda8c0b3c80 msgr2=0x7fda8c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fda8c0b3c80 0x7fda8c0b6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fda900057c0 tx=0x7fda90000bc0 comp rx=0 tx=0).stop 2024-07-26T12:18:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 msgr2=0x7fdaa419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 0x7fdaa419be70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c920 tx=0x7fda9800cde0 comp rx=0 tx=0).stop 2024-07-26T12:18:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 shutdown_connections 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdaa410b880 0x7fdaa41a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fda8c0b3c80 0x7fda8c0b6190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdaa410af30 0x7fdaa419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 --2- 172.21.15.40:0/4016889787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa41055f0 0x7fdaa419be70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 >> 172.21.15.40:0/4016889787 conn(0x7fdaa4101060 msgr2=0x7fdaa4103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.519+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 shutdown_connections 2024-07-26T12:18:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:28.520+0000 7fdaaa400640 1 -- 172.21.15.40:0/4016889787 wait complete. 2024-07-26T12:18:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:28 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4016889787' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T12:18:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:28 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4016889787' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T12:18:28.892 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:28 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4016889787' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-07-26T12:18:29.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-26T12:18:29.809 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:29 smithi146 ceph-mon[35807]: pgmap v381: 33 pgs: 14 unknown, 19 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:29 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4016889787' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-26T12:18:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:29 smithi146 ceph-mon[35807]: osdmap e77: 12 total, 12 up, 12 in 2024-07-26T12:18:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:29 smithi076 ceph-mon[35401]: pgmap v381: 33 pgs: 14 unknown, 19 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:29 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4016889787' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-26T12:18:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:29 smithi076 ceph-mon[35401]: osdmap e77: 12 total, 12 up, 12 in 2024-07-26T12:18:29.958 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:29 smithi040 ceph-mon[32397]: pgmap v381: 33 pgs: 14 unknown, 19 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:29.958 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:29 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4016889787' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-07-26T12:18:29.958 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:29 smithi040 ceph-mon[32397]: osdmap e77: 12 total, 12 up, 12 in 2024-07-26T12:18:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:30 smithi146 ceph-mon[35807]: osdmap e78: 12 total, 12 up, 12 in 2024-07-26T12:18:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:30 smithi076 ceph-mon[35401]: osdmap e78: 12 total, 12 up, 12 in 2024-07-26T12:18:30.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:30 smithi040 ceph-mon[32397]: osdmap e78: 12 total, 12 up, 12 in 2024-07-26T12:18:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:31 smithi146 ceph-mon[35807]: pgmap v384: 97 pgs: 10 creating+peering, 54 unknown, 33 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:31 smithi146 ceph-mon[35807]: osdmap e79: 12 total, 12 up, 12 in 2024-07-26T12:18:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:31 smithi076 ceph-mon[35401]: pgmap v384: 97 pgs: 10 creating+peering, 54 unknown, 33 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:31 smithi076 ceph-mon[35401]: osdmap e79: 12 total, 12 up, 12 in 2024-07-26T12:18:31.865 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:31 smithi040 ceph-mon[32397]: pgmap v384: 97 pgs: 10 creating+peering, 54 unknown, 33 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:31.865 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:31 smithi040 ceph-mon[32397]: osdmap e79: 12 total, 12 up, 12 in 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 -- 172.21.15.40:0/1884475443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0075800 msgr2=0x7f67f0075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 --2- 172.21.15.40:0/1884475443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0075800 0x7f67f0075c10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009900 tx=0x7f67d802a410 comp rx=0 tx=0).stop 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 -- 172.21.15.40:0/1884475443 shutdown_connections 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 --2- 172.21.15.40:0/1884475443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67f0113cb0 0x7f67f0116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 --2- 172.21.15.40:0/1884475443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0075800 0x7f67f0075c10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 --2- 172.21.15.40:0/1884475443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0076db0 0x7f67f00751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 -- 172.21.15.40:0/1884475443 >> 172.21.15.40:0/1884475443 conn(0x7f67f00fee70 msgr2=0x7f67f01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:32.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 -- 172.21.15.40:0/1884475443 shutdown_connections 2024-07-26T12:18:32.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.079+0000 7f67f5800640 1 -- 172.21.15.40:0/1884475443 wait complete. 2024-07-26T12:18:32.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 Processor -- start 2024-07-26T12:18:32.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 -- start start 2024-07-26T12:18:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0075800 0x7f67f01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67f0076db0 0x7f67f01a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 0x7f67f01a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01197f0 con 0x7f67f0113cb0 2024-07-26T12:18:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0119670 con 0x7f67f0075800 2024-07-26T12:18:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.081+0000 7f67f5800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0119970 con 0x7f67f0076db0 2024-07-26T12:18:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 0x7f67f01a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 0x7f67f01a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43570/0 (socket says 172.21.15.40:43570) 2024-07-26T12:18:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 -- 172.21.15.40:0/2024138936 learned_addr learned my addr 172.21.15.40:0/2024138936 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67ef400640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67f0076db0 0x7f67f01a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67efe00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0075800 0x7f67f01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 -- 172.21.15.40:0/2024138936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67f0076db0 msgr2=0x7f67f01a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67f0076db0 0x7f67f01a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 -- 172.21.15.40:0/2024138936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0075800 msgr2=0x7f67f01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0075800 0x7f67f01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67f4e00640 1 -- 172.21.15.40:0/2024138936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f01a61d0 con 0x7f67f0113cb0 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.082+0000 7f67efe00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0075800 0x7f67f01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.083+0000 7f67f4e00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 0x7f67f01a5aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d750 tx=0x7f67e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.083+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8017070 con 0x7f67f0113cb0 2024-07-26T12:18:32.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.083+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67e80054b0 con 0x7f67f0113cb0 2024-07-26T12:18:32.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.083+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f01a64c0 con 0x7f67f0113cb0 2024-07-26T12:18:32.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.083+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8004b90 con 0x7f67f0113cb0 2024-07-26T12:18:32.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.083+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f01acc20 con 0x7f67f0113cb0 2024-07-26T12:18:32.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.084+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f0075c10 con 0x7f67f0113cb0 2024-07-26T12:18:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.087+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f67e8004d30 con 0x7f67f0113cb0 2024-07-26T12:18:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.089+0000 7f67ecc00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67d40b3bd0 0x7f67d40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:32.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.089+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f67e80e38f0 con 0x7f67f0113cb0 2024-07-26T12:18:32.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.089+0000 7f67efe00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67d40b3bd0 0x7f67d40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:32.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.090+0000 7f67efe00640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67d40b3bd0 0x7f67d40b60e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005fd0 tx=0x7f67e0009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:32.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.092+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f67e80ab050 con 0x7f67f0113cb0 2024-07-26T12:18:32.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.337+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f67f01a1390 con 0x7f67f0113cb0 2024-07-26T12:18:32.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.576+0000 7f67ecc00640 1 -- 172.21.15.40:0/2024138936 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f67f01a1390 con 0x7f67f0113cb0 2024-07-26T12:18:32.578 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-07-26T12:18:32.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.579+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67d40b3bd0 msgr2=0x7f67d40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.579+0000 7f67f5800640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67d40b3bd0 0x7f67d40b60e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005fd0 tx=0x7f67e0009520 comp rx=0 tx=0).stop 2024-07-26T12:18:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.579+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 msgr2=0x7f67f01a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.579+0000 7f67f5800640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 0x7f67f01a5aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d750 tx=0x7f67e800dc10 comp rx=0 tx=0).stop 2024-07-26T12:18:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 shutdown_connections 2024-07-26T12:18:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67f0113cb0 0x7f67f01a5aa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67d40b3bd0 0x7f67d40b60e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67f0076db0 0x7f67f01a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 --2- 172.21.15.40:0/2024138936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67f0075800 0x7f67f01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 >> 172.21.15.40:0/2024138936 conn(0x7f67f00fee70 msgr2=0x7f67f010fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 shutdown_connections 2024-07-26T12:18:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:32.580+0000 7f67f5800640 1 -- 172.21.15.40:0/2024138936 wait complete. 2024-07-26T12:18:32.617 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:32 smithi040 ceph-mon[32397]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T12:18:32.617 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:32 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2024138936' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-26T12:18:32.617 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:32 smithi040 ceph-mon[32397]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-07-26T12:18:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:32 smithi076 ceph-mon[35401]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T12:18:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:32 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2024138936' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-26T12:18:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:32 smithi076 ceph-mon[35401]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-07-26T12:18:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:32 smithi146 ceph-mon[35807]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-07-26T12:18:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:32 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2024138936' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-07-26T12:18:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:32 smithi146 ceph-mon[35807]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-07-26T12:18:33.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:18:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:33 smithi040 ceph-mon[32397]: pgmap v386: 97 pgs: 10 creating+peering, 36 unknown, 51 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:33 smithi040 ceph-mon[32397]: osdmap e80: 12 total, 12 up, 12 in 2024-07-26T12:18:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:33 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2024138936' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-26T12:18:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:33 smithi040 ceph-mon[32397]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-07-26T12:18:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:33 smithi040 ceph-mon[32397]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-07-26T12:18:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:33 smithi076 ceph-mon[35401]: pgmap v386: 97 pgs: 10 creating+peering, 36 unknown, 51 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:33 smithi076 ceph-mon[35401]: osdmap e80: 12 total, 12 up, 12 in 2024-07-26T12:18:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:33 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2024138936' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-26T12:18:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:33 smithi076 ceph-mon[35401]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-07-26T12:18:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:33 smithi076 ceph-mon[35401]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-07-26T12:18:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:33 smithi146 ceph-mon[35807]: pgmap v386: 97 pgs: 10 creating+peering, 36 unknown, 51 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-07-26T12:18:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:33 smithi146 ceph-mon[35807]: osdmap e80: 12 total, 12 up, 12 in 2024-07-26T12:18:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:33 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2024138936' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-07-26T12:18:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:33 smithi146 ceph-mon[35807]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-07-26T12:18:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:33 smithi146 ceph-mon[35807]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-07-26T12:18:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:34 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] up:active 2024-07-26T12:18:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:34 smithi040 ceph-mon[32397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:34 smithi040 ceph-mon[32397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:34 smithi040 ceph-mon[32397]: pgmap v388: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 1 op/s 2024-07-26T12:18:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:34 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] up:active 2024-07-26T12:18:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:34 smithi146 ceph-mon[35807]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:34 smithi146 ceph-mon[35807]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:34 smithi146 ceph-mon[35807]: pgmap v388: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 1 op/s 2024-07-26T12:18:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:34 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] up:active 2024-07-26T12:18:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:34 smithi076 ceph-mon[35401]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:34 smithi076 ceph-mon[35401]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:34 smithi076 ceph-mon[35401]: pgmap v388: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 1 op/s 2024-07-26T12:18:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:35 smithi040 ceph-mon[32397]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-26T12:18:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:35 smithi040 ceph-mon[32397]: Cluster is now healthy 2024-07-26T12:18:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.959+0000 7f3e0f000640 1 -- 172.21.15.40:0/2202899381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08103400 msgr2=0x7f3e08103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.959+0000 7f3e0f000640 1 --2- 172.21.15.40:0/2202899381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08103400 0x7f3e08103810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009900 tx=0x7f3df802a410 comp rx=0 tx=0).stop 2024-07-26T12:18:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 -- 172.21.15.40:0/2202899381 shutdown_connections 2024-07-26T12:18:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 --2- 172.21.15.40:0/2202899381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e08109690 0x7f3e0810fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 --2- 172.21.15.40:0/2202899381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e08108d40 0x7f3e08109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 --2- 172.21.15.40:0/2202899381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08103400 0x7f3e08103810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 -- 172.21.15.40:0/2202899381 >> 172.21.15.40:0/2202899381 conn(0x7f3e080fee90 msgr2=0x7f3e081012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 -- 172.21.15.40:0/2202899381 shutdown_connections 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.960+0000 7f3e0f000640 1 -- 172.21.15.40:0/2202899381 wait complete. 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.961+0000 7f3e0f000640 1 Processor -- start 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.961+0000 7f3e0f000640 1 -- start start 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.961+0000 7f3e0f000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e08103400 0x7f3e08199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.961+0000 7f3e0f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e08108d40 0x7f3e0819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0f000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 0x7f3e0819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0f000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08113260 con 0x7f3e08109690 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0f000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081130e0 con 0x7f3e08103400 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081133e0 con 0x7f3e08108d40 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 0x7f3e0819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 0x7f3e0819f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39094/0 (socket says 172.21.15.40:39094) 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 -- 172.21.15.40:0/21716057 learned_addr learned my addr 172.21.15.40:0/21716057 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0dc00640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e08103400 0x7f3e08199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0d200640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e08108d40 0x7f3e0819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 -- 172.21.15.40:0/21716057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e08108d40 msgr2=0x7f3e0819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e08108d40 0x7f3e0819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 -- 172.21.15.40:0/21716057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e08103400 msgr2=0x7f3e08199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e08103400 0x7f3e08199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.962+0000 7f3e0e600640 1 -- 172.21.15.40:0/21716057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0819fc00 con 0x7f3e08109690 2024-07-26T12:18:35.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.963+0000 7f3e0e600640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 0x7f3e0819f4d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000e970 tx=0x7f3e0000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:35.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.963+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000ccc0 con 0x7f3e08109690 2024-07-26T12:18:35.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.963+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e0000ce60 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.963+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0819fef0 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.963+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00010430 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.963+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e081a6650 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.964+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e08103810 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.967+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3e00004ef0 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.969+0000 7f3e06000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3df00b3c50 0x7f3df00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.969+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3e000e4150 con 0x7f3e08109690 2024-07-26T12:18:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.969+0000 7f3e0dc00640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3df00b3c50 0x7f3df00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.970+0000 7f3e0dc00640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3df00b3c50 0x7f3df00b6160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3df8006010 tx=0x7f3df8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:35.971+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3e00055600 con 0x7f3e08109690 2024-07-26T12:18:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:35 smithi146 ceph-mon[35807]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-26T12:18:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:35 smithi146 ceph-mon[35807]: Cluster is now healthy 2024-07-26T12:18:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:35 smithi076 ceph-mon[35401]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-07-26T12:18:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:35 smithi076 ceph-mon[35401]: Cluster is now healthy 2024-07-26T12:18:36.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.176+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e0802e0c0 con 0x7f3e08109690 2024-07-26T12:18:36.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.178+0000 7f3e06000640 1 -- 172.21.15.40:0/21716057 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22171 (secure 0 0 0) 0x7f3e000ab850 con 0x7f3e08109690 2024-07-26T12:18:36.181 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:18:36.181 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":80,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:32.339835+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:18:36.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.182+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3df00b3c50 msgr2=0x7f3df00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:36.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.182+0000 7f3e0f000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3df00b3c50 0x7f3df00b6160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3df8006010 tx=0x7f3df8000bc0 comp rx=0 tx=0).stop 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 msgr2=0x7f3e0819f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 0x7f3e0819f4d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000e970 tx=0x7f3e0000ed70 comp rx=0 tx=0).stop 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 shutdown_connections 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e08109690 0x7f3e0819f4d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3df00b3c50 0x7f3df00b6160 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e08108d40 0x7f3e0819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 --2- 172.21.15.40:0/21716057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e08103400 0x7f3e08199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:36.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.183+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 >> 172.21.15.40:0/21716057 conn(0x7f3e080fee90 msgr2=0x7f3e081012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:36.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.184+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 shutdown_connections 2024-07-26T12:18:36.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:36.184+0000 7f3e0f000640 1 -- 172.21.15.40:0/21716057 wait complete. 2024-07-26T12:18:36.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:36 smithi040 ceph-mon[32397]: pgmap v389: 97 pgs: 97 active+clean; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-07-26T12:18:36.892 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:36 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/21716057' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:18:36.921 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:36 smithi076 ceph-mon[35401]: pgmap v389: 97 pgs: 97 active+clean; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-07-26T12:18:36.921 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:36 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/21716057' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:18:36.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:18:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:36 smithi146 ceph-mon[35807]: pgmap v389: 97 pgs: 97 active+clean; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-07-26T12:18:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:36 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/21716057' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:18:37.332 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:36 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T12:18:36.918+0000 7f716b200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-26T12:18:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:39.206 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:38 smithi040 ceph-mon[32397]: pgmap v390: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T12:18:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:38 smithi146 ceph-mon[35807]: pgmap v390: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T12:18:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:38 smithi076 ceph-mon[35401]: pgmap v390: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 -- 172.21.15.40:0/24617195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 msgr2=0x7f7d74113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 --2- 172.21.15.40:0/24617195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d74113a60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009900 tx=0x7f7d6002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 -- 172.21.15.40:0/24617195 shutdown_connections 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 --2- 172.21.15.40:0/24617195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 0x7f7d741163c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 --2- 172.21.15.40:0/24617195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d74113a60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 --2- 172.21.15.40:0/24617195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7d74077370 0x7f7d74077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 -- 172.21.15.40:0/24617195 >> 172.21.15.40:0/24617195 conn(0x7f7d741010b0 msgr2=0x7f7d74103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.567+0000 7f7d7a000640 1 -- 172.21.15.40:0/24617195 shutdown_connections 2024-07-26T12:18:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.568+0000 7f7d7a000640 1 -- 172.21.15.40:0/24617195 wait complete. 2024-07-26T12:18:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 Processor -- start 2024-07-26T12:18:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 -- start start 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7d74077370 0x7f7d741a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d741a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 0x7f7d741a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741197b0 con 0x7f7d74077cc0 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74119630 con 0x7f7d74077370 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.569+0000 7f7d7a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74119930 con 0x7f7d74113fa0 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d741a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d741a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39106/0 (socket says 172.21.15.40:39106) 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 -- 172.21.15.40:0/3533285544 learned_addr learned my addr 172.21.15.40:0/3533285544 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d78c00640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7d74077370 0x7f7d741a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d79600640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 0x7f7d741a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 -- 172.21.15.40:0/3533285544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 msgr2=0x7f7d741a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 0x7f7d741a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 -- 172.21.15.40:0/3533285544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7d74077370 msgr2=0x7f7d741a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7d74077370 0x7f7d741a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d73e00640 1 -- 172.21.15.40:0/3533285544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d741a61f0 con 0x7f7d74077cc0 2024-07-26T12:18:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.570+0000 7f7d79600640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 0x7f7d741a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.571+0000 7f7d73e00640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d741a0820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005940 tx=0x7f7d600040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.571+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6003f030 con 0x7f7d74077cc0 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.571+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d60003a80 con 0x7f7d74077cc0 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.571+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d741a6480 con 0x7f7d74077cc0 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.571+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60035070 con 0x7f7d74077cc0 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.571+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741acc40 con 0x7f7d74077cc0 2024-07-26T12:18:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.572+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d74077780 con 0x7f7d74077cc0 2024-07-26T12:18:39.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.577+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f7d60042030 con 0x7f7d74077cc0 2024-07-26T12:18:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.578+0000 7f7d71600640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7d580b3c50 0x7f7d580b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.578+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7d601044b0 con 0x7f7d74077cc0 2024-07-26T12:18:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.579+0000 7f7d78c00640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7d580b3c50 0x7f7d580b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:39.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.579+0000 7f7d78c00640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7d580b3c50 0x7f7d580b6160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005fd0 tx=0x7f7d64005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.580+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7d600cbbb0 con 0x7f7d74077cc0 2024-07-26T12:18:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.785+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d741a13b0 con 0x7f7d74077cc0 2024-07-26T12:18:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.786+0000 7f7d71600640 1 -- 172.21.15.40:0/3533285544 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22171 (secure 0 0 0) 0x7f7d600cb4b0 con 0x7f7d74077cc0 2024-07-26T12:18:39.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:18:39.788 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":80,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:32.339835+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:18:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.789+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7d580b3c50 msgr2=0x7f7d580b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.789+0000 7f7d7a000640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7d580b3c50 0x7f7d580b6160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005fd0 tx=0x7f7d64005850 comp rx=0 tx=0).stop 2024-07-26T12:18:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.789+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 msgr2=0x7f7d741a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.789+0000 7f7d7a000640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d741a0820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005940 tx=0x7f7d600040e0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 shutdown_connections 2024-07-26T12:18:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7d580b3c50 0x7f7d580b6160 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d74113fa0 0x7f7d741a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d74077cc0 0x7f7d741a0820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 --2- 172.21.15.40:0/3533285544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7d74077370 0x7f7d741a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 >> 172.21.15.40:0/3533285544 conn(0x7f7d741010b0 msgr2=0x7f7d74116120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 shutdown_connections 2024-07-26T12:18:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:39.790+0000 7f7d7a000640 1 -- 172.21.15.40:0/3533285544 wait complete. 2024-07-26T12:18:40.220 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:39 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3533285544' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:18:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:39 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3533285544' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:18:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:39 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3533285544' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:18:40.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-07-26T12:18:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:41.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:40 smithi146 ceph-mon[35807]: pgmap v391: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-07-26T12:18:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:40 smithi040 ceph-mon[32397]: pgmap v391: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-07-26T12:18:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:40 smithi076 ceph-mon[35401]: pgmap v391: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-07-26T12:18:43.212 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:42 smithi040 ceph-mon[32397]: pgmap v392: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-07-26T12:18:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:42 smithi146 ceph-mon[35807]: pgmap v392: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-07-26T12:18:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:42 smithi076 ceph-mon[35401]: pgmap v392: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 -- 172.21.15.40:0/1272496530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 msgr2=0x7f9e641122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 --2- 172.21.15.40:0/1272496530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641122a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009ca0 tx=0x7f9e5c02a8d0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 -- 172.21.15.40:0/1272496530 shutdown_connections 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 --2- 172.21.15.40:0/1272496530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641122a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 --2- 172.21.15.40:0/1272496530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6410b120 0x7f9e6410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 --2- 172.21.15.40:0/1272496530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e641057e0 0x7f9e64105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 -- 172.21.15.40:0/1272496530 >> 172.21.15.40:0/1272496530 conn(0x7f9e641011f0 msgr2=0x7f9e64103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 -- 172.21.15.40:0/1272496530 shutdown_connections 2024-07-26T12:18:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.433+0000 7f9e6a400640 1 -- 172.21.15.40:0/1272496530 wait complete. 2024-07-26T12:18:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.434+0000 7f9e6a400640 1 Processor -- start 2024-07-26T12:18:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 -- start start 2024-07-26T12:18:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e641057e0 0x7f9e6419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e6410b120 0x7f9e6419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64115620 con 0x7f9e6410ba70 2024-07-26T12:18:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641154a0 con 0x7f9e6410b120 2024-07-26T12:18:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.435+0000 7f9e6a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9e641157a0 con 0x7f9e641057e0 2024-07-26T12:18:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53494/0 (socket says 172.21.15.40:53494) 2024-07-26T12:18:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 -- 172.21.15.40:0/496183018 learned_addr learned my addr 172.21.15.40:0/496183018 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e62a00640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e6410b120 0x7f9e6419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e641057e0 0x7f9e6419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 -- 172.21.15.40:0/496183018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e641057e0 msgr2=0x7f9e6419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e641057e0 0x7f9e6419c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 -- 172.21.15.40:0/496183018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e6410b120 msgr2=0x7f9e6419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e6410b120 0x7f9e6419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.436+0000 7f9e63e00640 1 -- 172.21.15.40:0/496183018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e641a1f80 con 0x7f9e6410ba70 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.437+0000 7f9e63e00640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641a1850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009dc0 tx=0x7f9e5c030800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.437+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c030e00 con 0x7f9e6410ba70 2024-07-26T12:18:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.437+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e5c046910 con 0x7f9e6410ba70 2024-07-26T12:18:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.437+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e641a2210 con 0x7f9e6410ba70 2024-07-26T12:18:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.437+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c03b950 con 0x7f9e6410ba70 2024-07-26T12:18:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.437+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e641a89d0 con 0x7f9e6410ba70 2024-07-26T12:18:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.439+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e64105bf0 con 0x7f9e6410ba70 2024-07-26T12:18:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.441+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9e5c046480 con 0x7f9e6410ba70 2024-07-26T12:18:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.443+0000 7f9e5be00640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e480b3bd0 0x7f9e480b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.443+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f9e5c105230 con 0x7f9e6410ba70 2024-07-26T12:18:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.443+0000 7f9e63400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e480b3bd0 0x7f9e480b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:43.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.444+0000 7f9e63400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e480b3bd0 0x7f9e480b60e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9e540058c0 tx=0x7f9e5400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.447+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9e5c0cc930 con 0x7f9e6410ba70 2024-07-26T12:18:43.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.698+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9e6402e0c0 con 0x7f9e6410ba70 2024-07-26T12:18:43.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.951+0000 7f9e5be00640 1 -- 172.21.15.40:0/496183018 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9e5c0cc230 con 0x7f9e6410ba70 2024-07-26T12:18:43.952 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:43 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/496183018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e480b3bd0 msgr2=0x7f9e480b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e480b3bd0 0x7f9e480b60e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9e540058c0 tx=0x7f9e5400a4c0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 msgr2=0x7f9e641a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641a1850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009dc0 tx=0x7f9e5c030800 comp rx=0 tx=0).stop 2024-07-26T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 shutdown_connections 2024-07-26T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6410ba70 0x7f9e641a1850 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e6410b120 0x7f9e6419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e480b3bd0 0x7f9e480b60e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 --2- 172.21.15.40:0/496183018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e641057e0 0x7f9e6419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:43.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.955+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 >> 172.21.15.40:0/496183018 conn(0x7f9e641011f0 msgr2=0x7f9e64104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:43.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.956+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 shutdown_connections 2024-07-26T12:18:43.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:43.956+0000 7f9e6a400640 1 -- 172.21.15.40:0/496183018 wait complete. 2024-07-26T12:18:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:43 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/496183018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T12:18:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:43 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/496183018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-07-26T12:18:44.876 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-07-26T12:18:44.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-07-26T12:18:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:44 smithi040 ceph-mon[32397]: pgmap v393: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-07-26T12:18:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/496183018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-26T12:18:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:44 smithi040 ceph-mon[32397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:44 smithi146 ceph-mon[35807]: pgmap v393: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-07-26T12:18:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/496183018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-26T12:18:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:44 smithi146 ceph-mon[35807]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:44 smithi076 ceph-mon[35401]: pgmap v393: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-07-26T12:18:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/496183018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-07-26T12:18:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:44 smithi076 ceph-mon[35401]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:47.226 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:46 smithi040 ceph-mon[32397]: pgmap v394: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 3 op/s 2024-07-26T12:18:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:46 smithi146 ceph-mon[35807]: pgmap v394: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 3 op/s 2024-07-26T12:18:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:46 smithi076 ceph-mon[35401]: pgmap v394: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 3 op/s 2024-07-26T12:18:47.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 -- 172.21.15.40:0/4044893497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 msgr2=0x7fcf1010fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 --2- 172.21.15.40:0/4044893497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1010fd30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009ca0 tx=0x7fcf0802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 -- 172.21.15.40:0/4044893497 shutdown_connections 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 --2- 172.21.15.40:0/4044893497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1010fd30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 --2- 172.21.15.40:0/4044893497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf10104ca0 0x7fcf1010d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 --2- 172.21.15.40:0/4044893497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf10104270 0x7fcf10104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 -- 172.21.15.40:0/4044893497 >> 172.21.15.40:0/4044893497 conn(0x7fcf10079160 msgr2=0x7fcf10079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 -- 172.21.15.40:0/4044893497 shutdown_connections 2024-07-26T12:18:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.588+0000 7fcf16400640 1 -- 172.21.15.40:0/4044893497 wait complete. 2024-07-26T12:18:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 Processor -- start 2024-07-26T12:18:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 -- start start 2024-07-26T12:18:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf10104270 0x7fcf10199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf10104ca0 0x7fcf1019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:47.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf101133c0 con 0x7fcf1010d820 2024-07-26T12:18:47.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf10113240 con 0x7fcf10104ca0 2024-07-26T12:18:47.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.590+0000 7fcf16400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf10113540 con 0x7fcf10104270 2024-07-26T12:18:47.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:47.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1019f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53498/0 (socket says 172.21.15.40:53498) 2024-07-26T12:18:47.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 -- 172.21.15.40:0/4063188191 learned_addr learned my addr 172.21.15.40:0/4063188191 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0f400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf10104270 0x7fcf10199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf07e00640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf10104ca0 0x7fcf1019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 -- 172.21.15.40:0/4063188191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf10104270 msgr2=0x7fcf10199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf10104270 0x7fcf10199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 -- 172.21.15.40:0/4063188191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf10104ca0 msgr2=0x7fcf1019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf10104ca0 0x7fcf1019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.591+0000 7fcf0fe00640 1 -- 172.21.15.40:0/4063188191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1019fcc0 con 0x7fcf1010d820 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.592+0000 7fcf0fe00640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1019f650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf08031040 tx=0x7fcf08032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.592+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08004040 con 0x7fcf1010d820 2024-07-26T12:18:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.592+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf08004670 con 0x7fcf1010d820 2024-07-26T12:18:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.592+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1019ff50 con 0x7fcf1010d820 2024-07-26T12:18:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.592+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08030d90 con 0x7fcf1010d820 2024-07-26T12:18:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.592+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf101a0490 con 0x7fcf1010d820 2024-07-26T12:18:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.593+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf10104680 con 0x7fcf1010d820 2024-07-26T12:18:47.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.597+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fcf080305c0 con 0x7fcf1010d820 2024-07-26T12:18:47.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.599+0000 7fcf0cc00640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcef40b3c00 0x7fcef40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:47.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.599+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fcf081052f0 con 0x7fcf1010d820 2024-07-26T12:18:47.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.599+0000 7fcf0f400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcef40b3c00 0x7fcef40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.600+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcf080cca80 con 0x7fcf1010d820 2024-07-26T12:18:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.600+0000 7fcf0f400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcef40b3c00 0x7fcef40b6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf000058c0 tx=0x7fcf0000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:47.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.846+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fcf101a6970 con 0x7fcf1010d820 2024-07-26T12:18:47.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.974+0000 7fcf0cc00640 1 -- 172.21.15.40:0/4063188191 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fcf080cc380 con 0x7fcf1010d820 2024-07-26T12:18:47.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.977+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcef40b3c00 msgr2=0x7fcef40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.977+0000 7fcf16400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcef40b3c00 0x7fcef40b6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf000058c0 tx=0x7fcf0000a2d0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 msgr2=0x7fcf1019f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1019f650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf08031040 tx=0x7fcf08032bc0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 shutdown_connections 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf1010d820 0x7fcf1019f650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf10104ca0 0x7fcf1019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcef40b3c00 0x7fcef40b6110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 --2- 172.21.15.40:0/4063188191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf10104270 0x7fcf10199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 >> 172.21.15.40:0/4063188191 conn(0x7fcf10079160 msgr2=0x7fcf101073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 shutdown_connections 2024-07-26T12:18:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:47.978+0000 7fcf16400640 1 -- 172.21.15.40:0/4063188191 wait complete. 2024-07-26T12:18:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:47 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4063188191' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-07-26T12:18:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:47 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4063188191' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-07-26T12:18:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:47 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4063188191' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-07-26T12:18:48.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-07-26T12:18:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: pgmap v395: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 2 op/s 2024-07-26T12:18:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-07-26T12:18:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4063188191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-07-26T12:18:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-07-26T12:18:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-07-26T12:18:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:48 smithi040 ceph-mon[32397]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: pgmap v395: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 2 op/s 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4063188191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-07-26T12:18:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:48 smithi146 ceph-mon[35807]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: pgmap v395: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 2 op/s 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4063188191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-07-26T12:18:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:48 smithi076 ceph-mon[35401]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-07-26T12:18:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:49 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:active 2024-07-26T12:18:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:49 smithi040 ceph-mon[32397]: daemon mds.k assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-07-26T12:18:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:49 smithi040 ceph-mon[32397]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-07-26T12:18:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:49 smithi040 ceph-mon[32397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:creating} 9 up:standby 2024-07-26T12:18:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:49 smithi040 ceph-mon[32397]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-07-26T12:18:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:49 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:active 2024-07-26T12:18:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:49 smithi146 ceph-mon[35807]: daemon mds.k assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-07-26T12:18:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:49 smithi146 ceph-mon[35807]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-07-26T12:18:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:49 smithi146 ceph-mon[35807]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:creating} 9 up:standby 2024-07-26T12:18:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:49 smithi146 ceph-mon[35807]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-07-26T12:18:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:49 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:active 2024-07-26T12:18:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:49 smithi076 ceph-mon[35401]: daemon mds.k assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-07-26T12:18:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:49 smithi076 ceph-mon[35401]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-07-26T12:18:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:49 smithi076 ceph-mon[35401]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:creating} 9 up:standby 2024-07-26T12:18:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:49 smithi076 ceph-mon[35401]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-07-26T12:18:51.275 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:51 smithi040 ceph-mon[32397]: pgmap v396: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 2 op/s 2024-07-26T12:18:51.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:51 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] up:active 2024-07-26T12:18:51.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:51 smithi040 ceph-mon[32397]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-07-26T12:18:51.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:51 smithi040 ceph-mon[32397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 9 up:standby 2024-07-26T12:18:51.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:51 smithi040 ceph-mon[32397]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=k=up:active,3=i=up:creating} 8 up:standby 2024-07-26T12:18:51.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:51 smithi040 ceph-mon[32397]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T12:18:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:51 smithi146 ceph-mon[35807]: pgmap v396: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 2 op/s 2024-07-26T12:18:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:51 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] up:active 2024-07-26T12:18:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:51 smithi146 ceph-mon[35807]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-07-26T12:18:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:51 smithi146 ceph-mon[35807]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 9 up:standby 2024-07-26T12:18:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:51 smithi146 ceph-mon[35807]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=k=up:active,3=i=up:creating} 8 up:standby 2024-07-26T12:18:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:51 smithi146 ceph-mon[35807]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T12:18:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-mon[35401]: pgmap v396: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 2 op/s 2024-07-26T12:18:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] up:active 2024-07-26T12:18:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-mon[35401]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-07-26T12:18:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-mon[35401]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 9 up:standby 2024-07-26T12:18:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-mon[35401]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=k=up:active,3=i=up:creating} 8 up:standby 2024-07-26T12:18:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-mon[35401]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T12:18:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 -- 172.21.15.40:0/322346184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 msgr2=0x7fb70c10b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 --2- 172.21.15.40:0/322346184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c10b320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009ca0 tx=0x7fb6f802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 -- 172.21.15.40:0/322346184 shutdown_connections 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 --2- 172.21.15.40:0/322346184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb70c10b860 0x7fb70c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 --2- 172.21.15.40:0/322346184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c10b320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 --2- 172.21.15.40:0/322346184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c1055d0 0x7fb70c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 -- 172.21.15.40:0/322346184 >> 172.21.15.40:0/322346184 conn(0x7fb70c101040 msgr2=0x7fb70c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 -- 172.21.15.40:0/322346184 shutdown_connections 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.623+0000 7fb712c00640 1 -- 172.21.15.40:0/322346184 wait complete. 2024-07-26T12:18:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.625+0000 7fb712c00640 1 Processor -- start 2024-07-26T12:18:51.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.625+0000 7fb712c00640 1 -- start start 2024-07-26T12:18:51.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb70c1055d0 0x7fb70c19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:51.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:51.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c10b860 0x7fb70c1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:51.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c1153d0 con 0x7fb70c10af10 2024-07-26T12:18:51.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c115250 con 0x7fb70c10b860 2024-07-26T12:18:51.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c115550 con 0x7fb70c1055d0 2024-07-26T12:18:51.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb710e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:51.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb710e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53522/0 (socket says 172.21.15.40:53522) 2024-07-26T12:18:51.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb710e00640 1 -- 172.21.15.40:0/1376934205 learned_addr learned my addr 172.21.15.40:0/1376934205 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb711800640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb70c1055d0 0x7fb70c19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.626+0000 7fb712200640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c10b860 0x7fb70c1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb710e00640 1 -- 172.21.15.40:0/1376934205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb70c1055d0 msgr2=0x7fb70c19be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb710e00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb70c1055d0 0x7fb70c19be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb710e00640 1 -- 172.21.15.40:0/1376934205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c10b860 msgr2=0x7fb70c1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb710e00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c10b860 0x7fb70c1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb710e00640 1 -- 172.21.15.40:0/1376934205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c1a1d30 con 0x7fb70c10af10 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb712200640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c10b860 0x7fb70c1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:18:51.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.627+0000 7fb710e00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c19c420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb6f802aeb0 tx=0x7fb6f8032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:51.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.628+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8004040 con 0x7fb70c10af10 2024-07-26T12:18:51.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.628+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6f8004670 con 0x7fb70c10af10 2024-07-26T12:18:51.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.628+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c1a1fc0 con 0x7fb70c10af10 2024-07-26T12:18:51.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.628+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8030cc0 con 0x7fb70c10af10 2024-07-26T12:18:51.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.628+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c1a2500 con 0x7fb70c10af10 2024-07-26T12:18:51.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.629+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c1059e0 con 0x7fb70c10af10 2024-07-26T12:18:51.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.631+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fb6f80041e0 con 0x7fb70c10af10 2024-07-26T12:18:51.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.634+0000 7fb70a000640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6f40b3c00 0x7fb6f40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:51.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.634+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb6f8105170 con 0x7fb70c10af10 2024-07-26T12:18:51.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.634+0000 7fb711800640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6f40b3c00 0x7fb6f40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:51.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.635+0000 7fb711800640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6f40b3c00 0x7fb6f40b6110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb70000abe0 tx=0x7fb70000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:51.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.637+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb6f80cc870 con 0x7fb70c10af10 2024-07-26T12:18:51.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:51.881+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb70c02e0c0 con 0x7fb70c10af10 2024-07-26T12:18:52.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.033+0000 7fb70a000640 1 -- 172.21.15.40:0/1376934205 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7fb6f80cc170 con 0x7fb70c10af10 2024-07-26T12:18:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6f40b3c00 msgr2=0x7fb6f40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6f40b3c00 0x7fb6f40b6110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb70000abe0 tx=0x7fb70000a2d0 comp rx=0 tx=0).stop 2024-07-26T12:18:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 msgr2=0x7fb70c19c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c19c420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb6f802aeb0 tx=0x7fb6f8032c40 comp rx=0 tx=0).stop 2024-07-26T12:18:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 shutdown_connections 2024-07-26T12:18:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb70c10b860 0x7fb70c1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70c10af10 0x7fb70c19c420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6f40b3c00 0x7fb6f40b6110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 --2- 172.21.15.40:0/1376934205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb70c1055d0 0x7fb70c19be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 >> 172.21.15.40:0/1376934205 conn(0x7fb70c101040 msgr2=0x7fb70c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 shutdown_connections 2024-07-26T12:18:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:52.037+0000 7fb712c00640 1 -- 172.21.15.40:0/1376934205 wait complete. 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] up:active 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: Cluster is now healthy 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=k=up:active,3=i=up:active} 8 up:standby 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T12:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1376934205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] up:active 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: Cluster is now healthy 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=k=up:active,3=i=up:active} 8 up:standby 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T12:18:52.313 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1376934205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T12:18:51.919+0000 7f716b200640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T12:18:51.919+0000 7f716b200640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 12:18:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T12:18:51.919+0000 7f716b200640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] up:active 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: Cluster is now healthy 2024-07-26T12:18:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=k=up:active,3=i=up:active} 8 up:standby 2024-07-26T12:18:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-07-26T12:18:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T12:18:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1376934205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-07-26T12:18:52.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-07-26T12:18:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:53 smithi040 ceph-mon[32397]: pgmap v397: 97 pgs: 97 active+clean; 581 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T12:18:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:53 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1376934205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-26T12:18:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:53 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] up:active 2024-07-26T12:18:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:53 smithi040 ceph-mon[32397]: fsmap cephfs:5 7 up:standby 5 up:active 2024-07-26T12:18:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:53 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:18:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:53 smithi146 ceph-mon[35807]: pgmap v397: 97 pgs: 97 active+clean; 581 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T12:18:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:53 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1376934205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-26T12:18:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:53 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] up:active 2024-07-26T12:18:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:53 smithi146 ceph-mon[35807]: fsmap cephfs:5 7 up:standby 5 up:active 2024-07-26T12:18:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:53 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:18:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:53 smithi076 ceph-mon[35401]: pgmap v397: 97 pgs: 97 active+clean; 581 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-07-26T12:18:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:53 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1376934205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-07-26T12:18:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:53 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] up:active 2024-07-26T12:18:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:53 smithi076 ceph-mon[35401]: fsmap cephfs:5 7 up:standby 5 up:active 2024-07-26T12:18:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:53 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:18:53.381 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:55 smithi146 ceph-mon[35807]: pgmap v398: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-07-26T12:18:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:55 smithi076 ceph-mon[35401]: pgmap v398: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-07-26T12:18:55.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:55 smithi040 ceph-mon[32397]: pgmap v398: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-07-26T12:18:55.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 -- 172.21.15.40:0/3547446987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e0104d70 msgr2=0x7f44e010d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:55.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 --2- 172.21.15.40:0/3547446987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e0104d70 0x7f44e010d2c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009900 tx=0x7f44c802a410 comp rx=0 tx=0).stop 2024-07-26T12:18:55.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 -- 172.21.15.40:0/3547446987 shutdown_connections 2024-07-26T12:18:55.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 --2- 172.21.15.40:0/3547446987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e010d880 0x7f44e010fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 --2- 172.21.15.40:0/3547446987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e0104d70 0x7f44e010d2c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 --2- 172.21.15.40:0/3547446987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 0x7f44e0104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.564+0000 7f44e7200640 1 -- 172.21.15.40:0/3547446987 >> 172.21.15.40:0/3547446987 conn(0x7f44e0079210 msgr2=0x7f44e0079620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.565+0000 7f44e7200640 1 -- 172.21.15.40:0/3547446987 shutdown_connections 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.565+0000 7f44e7200640 1 -- 172.21.15.40:0/3547446987 wait complete. 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 Processor -- start 2024-07-26T12:18:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 -- start start 2024-07-26T12:18:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 0x7f44e019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e0104d70 0x7f44e019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e010d880 0x7f44e01a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01133c0 con 0x7f44e010d880 2024-07-26T12:18:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0113240 con 0x7f44e0104420 2024-07-26T12:18:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.566+0000 7f44e7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0113540 con 0x7f44e0104d70 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.567+0000 7f44dfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 0x7f44e019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.567+0000 7f44df400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e0104d70 0x7f44e019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.567+0000 7f44e5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e010d880 0x7f44e01a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.567+0000 7f44dfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 0x7f44e019c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:42832/0 (socket says 172.21.15.40:42832) 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.567+0000 7f44dfe00640 1 -- 172.21.15.40:0/2726603655 learned_addr learned my addr 172.21.15.40:0/2726603655 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e5200640 1 -- 172.21.15.40:0/2726603655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e0104d70 msgr2=0x7f44e019c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e5200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e0104d70 0x7f44e019c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e5200640 1 -- 172.21.15.40:0/2726603655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 msgr2=0x7f44e019c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e5200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 0x7f44e019c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e5200640 1 -- 172.21.15.40:0/2726603655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e01a1fc0 con 0x7f44e010d880 2024-07-26T12:18:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e5200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e010d880 0x7f44e01a1890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44d800e940 tx=0x7f44d800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8004d20 con 0x7f44e010d880 2024-07-26T12:18:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44d8005020 con 0x7f44e010d880 2024-07-26T12:18:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d80116d0 con 0x7f44e010d880 2024-07-26T12:18:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.568+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e01a22b0 con 0x7f44e010d880 2024-07-26T12:18:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.569+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a8a10 con 0x7f44e010d880 2024-07-26T12:18:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.570+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e0104830 con 0x7f44e010d880 2024-07-26T12:18:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.574+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f44d800cb20 con 0x7f44e010d880 2024-07-26T12:18:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.576+0000 7f44dcc00640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44c40b3c50 0x7f44c40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.577+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f44d80e3fa0 con 0x7f44e010d880 2024-07-26T12:18:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.577+0000 7f44dfe00640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44c40b3c50 0x7f44c40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:55.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.578+0000 7f44dfe00640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44c40b3c50 0x7f44c40b6160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44d000bc80 tx=0x7f44d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:55.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.578+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f44d8016030 con 0x7f44e010d880 2024-07-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:55.822+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f44e002e0c0 con 0x7f44e010d880 2024-07-26T12:18:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.057+0000 7f44dcc00640 1 -- 172.21.15.40:0/2726603655 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f44d800ce10 con 0x7f44e010d880 2024-07-26T12:18:56.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.060+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44c40b3c50 msgr2=0x7f44c40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:56.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.060+0000 7f44e7200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44c40b3c50 0x7f44c40b6160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44d000bc80 tx=0x7f44d000b410 comp rx=0 tx=0).stop 2024-07-26T12:18:56.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.060+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e010d880 msgr2=0x7f44e01a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:56.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.060+0000 7f44e7200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e010d880 0x7f44e01a1890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44d800e940 tx=0x7f44d800ee00 comp rx=0 tx=0).stop 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 shutdown_connections 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e010d880 0x7f44e01a1890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44c40b3c50 0x7f44c40b6160 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44e0104d70 0x7f44e019c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 --2- 172.21.15.40:0/2726603655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44e0104420 0x7f44e019c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 >> 172.21.15.40:0/2726603655 conn(0x7f44e0079210 msgr2=0x7f44e00ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 shutdown_connections 2024-07-26T12:18:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:56.061+0000 7f44e7200640 1 -- 172.21.15.40:0/2726603655 wait complete. 2024-07-26T12:18:56.090 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:56 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2726603655' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T12:18:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:56 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2726603655' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T12:18:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:56 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2726603655' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-07-26T12:18:56.815 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-07-26T12:18:56.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-07-26T12:18:57.295 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:18:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:57 smithi146 ceph-mon[35807]: pgmap v399: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-07-26T12:18:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:57 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2726603655' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-26T12:18:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:57 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:18:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:57 smithi076 ceph-mon[35401]: pgmap v399: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-07-26T12:18:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:57 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2726603655' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-26T12:18:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:57 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:18:57.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:57 smithi040 ceph-mon[32397]: pgmap v399: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-07-26T12:18:57.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:57 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2726603655' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-07-26T12:18:57.452 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:57 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]: dispatch 2024-07-26T12:18:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-07-26T12:18:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-07-26T12:18:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-07-26T12:18:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-07-26T12:18:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-07-26T12:18:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T12:18:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-07-26T12:18:58.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-07-26T12:18:58.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]: dispatch 2024-07-26T12:18:58.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]: dispatch 2024-07-26T12:18:58.351 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-07-26T12:18:59.303 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: pgmap v400: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-07-26T12:18:59.303 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-07-26T12:18:59.303 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-07-26T12:18:59.303 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-07-26T12:18:59.303 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-07-26T12:18:59.303 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-07-26T12:18:59.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-07-26T12:18:59.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-07-26T12:18:59.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-07-26T12:18:59.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-07-26T12:18:59.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-mon[32397]: osdmap e81: 12 total, 12 up, 12 in 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: pgmap v400: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-07-26T12:18:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-07-26T12:18:59.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-07-26T12:18:59.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:18:59 smithi146 ceph-mon[35807]: osdmap e81: 12 total, 12 up, 12 in 2024-07-26T12:18:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: pgmap v400: 97 pgs: 97 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-07-26T12:18:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-07-26T12:18:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-07-26T12:18:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-07-26T12:18:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-07-26T12:18:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-07-26T12:18:59.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-07-26T12:18:59.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-07-26T12:18:59.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-07-26T12:18:59.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-07-26T12:18:59.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:18:59 smithi076 ceph-mon[35401]: osdmap e81: 12 total, 12 up, 12 in 2024-07-26T12:18:59.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 -- 172.21.15.40:0/1843779259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c108730 msgr2=0x7faf6c10ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 --2- 172.21.15.40:0/1843779259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c108730 0x7faf6c10ef60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ca0 tx=0x7faf6402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 -- 172.21.15.40:0/1843779259 shutdown_connections 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 --2- 172.21.15.40:0/1843779259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c108730 0x7faf6c10ef60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 --2- 172.21.15.40:0/1843779259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faf6c107de0 0x7faf6c1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 --2- 172.21.15.40:0/1843779259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf6c1024a0 0x7faf6c1028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.617+0000 7faf71c00640 1 -- 172.21.15.40:0/1843779259 >> 172.21.15.40:0/1843779259 conn(0x7faf6c079160 msgr2=0x7faf6c079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.618+0000 7faf71c00640 1 -- 172.21.15.40:0/1843779259 shutdown_connections 2024-07-26T12:18:59.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.618+0000 7faf71c00640 1 -- 172.21.15.40:0/1843779259 wait complete. 2024-07-26T12:18:59.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.619+0000 7faf71c00640 1 Processor -- start 2024-07-26T12:18:59.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 -- start start 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 0x7faf6c19bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf6c107de0 0x7faf6c19c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faf6c108730 0x7faf6c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c1133a0 con 0x7faf6c1024a0 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c113220 con 0x7faf6c108730 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf71c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c113520 con 0x7faf6c107de0 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf6aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 0x7faf6c19bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf6aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 0x7faf6c19bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56978/0 (socket says 172.21.15.40:56978) 2024-07-26T12:18:59.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.620+0000 7faf6aa00640 1 -- 172.21.15.40:0/3050245636 learned_addr learned my addr 172.21.15.40:0/3050245636 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:18:59.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6b400640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faf6c108730 0x7faf6c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:59.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf62000640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf6c107de0 0x7faf6c19c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:59.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6aa00640 1 -- 172.21.15.40:0/3050245636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf6c107de0 msgr2=0x7faf6c19c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:59.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6aa00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf6c107de0 0x7faf6c19c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6aa00640 1 -- 172.21.15.40:0/3050245636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faf6c108730 msgr2=0x7faf6c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6aa00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faf6c108730 0x7faf6c1a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6aa00640 1 -- 172.21.15.40:0/3050245636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c1a1ee0 con 0x7faf6c1024a0 2024-07-26T12:18:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.621+0000 7faf6aa00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 0x7faf6c19bf70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00d770 tx=0x7faf5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.622+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c017070 con 0x7faf6c1024a0 2024-07-26T12:18:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.622+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c1a21d0 con 0x7faf6c1024a0 2024-07-26T12:18:59.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.622+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf5c0054b0 con 0x7faf6c1024a0 2024-07-26T12:18:59.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.622+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c004c60 con 0x7faf6c1024a0 2024-07-26T12:18:59.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.622+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c1a8930 con 0x7faf6c1024a0 2024-07-26T12:18:59.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.623+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c103720 con 0x7faf6c1024a0 2024-07-26T12:18:59.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.626+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7faf5c004e00 con 0x7faf6c1024a0 2024-07-26T12:18:59.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.627+0000 7faf63e00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faf4c0b3bd0 0x7faf4c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:18:59.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.628+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faf5c0e3b50 con 0x7faf6c1024a0 2024-07-26T12:18:59.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.628+0000 7faf62000640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faf4c0b3bd0 0x7faf4c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:18:59.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.628+0000 7faf62000640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faf4c0b3bd0 0x7faf4c0b60e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf54005fd0 tx=0x7faf54005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:18:59.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.629+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7faf5c0ab160 con 0x7faf6c1024a0 2024-07-26T12:18:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.856+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7faf6c104280 con 0x7faf4c0b3bd0 2024-07-26T12:18:59.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.925+0000 7faf63e00640 1 -- 172.21.15.40:0/3050245636 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf6c104280 con 0x7faf4c0b3bd0 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.928+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faf4c0b3bd0 msgr2=0x7faf4c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.928+0000 7faf71c00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faf4c0b3bd0 0x7faf4c0b60e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf54005fd0 tx=0x7faf54005850 comp rx=0 tx=0).stop 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.928+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 msgr2=0x7faf6c19bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.928+0000 7faf71c00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 0x7faf6c19bf70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00d770 tx=0x7faf5c00dc30 comp rx=0 tx=0).stop 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 shutdown_connections 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faf6c108730 0x7faf6c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faf4c0b3bd0 0x7faf4c0b60e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf6c107de0 0x7faf6c19c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 --2- 172.21.15.40:0/3050245636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf6c1024a0 0x7faf6c19bf70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 >> 172.21.15.40:0/3050245636 conn(0x7faf6c079160 msgr2=0x7faf6c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:18:59.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 shutdown_connections 2024-07-26T12:18:59.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:18:59.929+0000 7faf71c00640 1 -- 172.21.15.40:0/3050245636 wait complete. 2024-07-26T12:19:00.123 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:18:59.867+0000 7f98aa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T12:19:00.123 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:18:59.867+0000 7f98aa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T12:19:00.123 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:18:59.867+0000 7f98aa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T12:19:00.123 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:18:59.867+0000 7f98aa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T12:19:00.123 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Jul 26 12:18:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mgr-x[32623]: 2024-07-26T12:18:59.867+0000 7f98aa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-26T12:19:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:00 smithi040 ceph-mon[32397]: osdmap e82: 12 total, 12 up, 12 in 2024-07-26T12:19:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:00 smithi146 ceph-mon[35807]: osdmap e82: 12 total, 12 up, 12 in 2024-07-26T12:19:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:00 smithi076 ceph-mon[35401]: osdmap e82: 12 total, 12 up, 12 in 2024-07-26T12:19:00.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-07-26T12:19:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:01 smithi040 ceph-mon[32397]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:01 smithi040 ceph-mon[32397]: pgmap v403: 97 pgs: 2 peering, 95 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 22 op/s 2024-07-26T12:19:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:01 smithi040 ceph-mon[32397]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-07-26T12:19:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:01 smithi146 ceph-mon[35807]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:01 smithi146 ceph-mon[35807]: pgmap v403: 97 pgs: 2 peering, 95 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 22 op/s 2024-07-26T12:19:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:01 smithi146 ceph-mon[35807]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-07-26T12:19:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:01 smithi076 ceph-mon[35401]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:01 smithi076 ceph-mon[35401]: pgmap v403: 97 pgs: 2 peering, 95 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 22 op/s 2024-07-26T12:19:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:01 smithi076 ceph-mon[35401]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-07-26T12:19:03.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:03 smithi040 ceph-mon[32397]: pgmap v404: 97 pgs: 2 peering, 95 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 639 B/s wr, 10 op/s 2024-07-26T12:19:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:03 smithi146 ceph-mon[35807]: pgmap v404: 97 pgs: 2 peering, 95 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 639 B/s wr, 10 op/s 2024-07-26T12:19:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:03 smithi076 ceph-mon[35401]: pgmap v404: 97 pgs: 2 peering, 95 active+clean; 584 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 639 B/s wr, 10 op/s 2024-07-26T12:19:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 -- 172.21.15.40:0/1366049460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4109be0 msgr2=0x7f94e4109ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 --2- 172.21.15.40:0/1366049460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4109be0 0x7f94e4109ff0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009900 tx=0x7f94d402a410 comp rx=0 tx=0).stop 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 -- 172.21.15.40:0/1366049460 shutdown_connections 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 --2- 172.21.15.40:0/1366049460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f94e410fe70 0x7f94e41166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 --2- 172.21.15.40:0/1366049460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e410f520 0x7f94e410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 --2- 172.21.15.40:0/1366049460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4109be0 0x7f94e4109ff0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 -- 172.21.15.40:0/1366049460 >> 172.21.15.40:0/1366049460 conn(0x7f94e4077b10 msgr2=0x7f94e4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 -- 172.21.15.40:0/1366049460 shutdown_connections 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.641+0000 7f94ea000640 1 -- 172.21.15.40:0/1366049460 wait complete. 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.642+0000 7f94ea000640 1 Processor -- start 2024-07-26T12:19:03.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.642+0000 7f94ea000640 1 -- start start 2024-07-26T12:19:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.642+0000 7f94ea000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e4109be0 0x7f94e41a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94ea000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 0x7f94e41a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94ea000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f94e410fe70 0x7f94e41a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94ea000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41199e0 con 0x7f94e410f520 2024-07-26T12:19:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94ea000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4119860 con 0x7f94e410fe70 2024-07-26T12:19:03.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94ea000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4119b60 con 0x7f94e4109be0 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94dbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 0x7f94e41a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94dbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 0x7f94e41a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39250/0 (socket says 172.21.15.40:39250) 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94dbe00640 1 -- 172.21.15.40:0/3965200816 learned_addr learned my addr 172.21.15.40:0/3965200816 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94e3400640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e4109be0 0x7f94e41a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.643+0000 7f94e3e00640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f94e410fe70 0x7f94e41a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94dbe00640 1 -- 172.21.15.40:0/3965200816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e4109be0 msgr2=0x7f94e41a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94dbe00640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e4109be0 0x7f94e41a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94dbe00640 1 -- 172.21.15.40:0/3965200816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f94e410fe70 msgr2=0x7f94e41a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94dbe00640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f94e410fe70 0x7f94e41a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94dbe00640 1 -- 172.21.15.40:0/3965200816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e41a63a0 con 0x7f94e410f520 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94dbe00640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 0x7f94e41a09d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00d740 tx=0x7f94cc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:03.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc017070 con 0x7f94e410f520 2024-07-26T12:19:03.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94cc00de50 con 0x7f94e410f520 2024-07-26T12:19:03.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00f620 con 0x7f94e410f520 2024-07-26T12:19:03.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e41a6690 con 0x7f94e410f520 2024-07-26T12:19:03.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.644+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e41acdf0 con 0x7f94e410f520 2024-07-26T12:19:03.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.646+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e4109ff0 con 0x7f94e410f520 2024-07-26T12:19:03.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.651+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f94cc01a070 con 0x7f94e410f520 2024-07-26T12:19:03.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.652+0000 7f94e0c00640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f94c80b3ce0 0x7f94c80b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:03.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.652+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f94cc0e36d0 con 0x7f94e410f520 2024-07-26T12:19:03.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.652+0000 7f94e3400640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f94c80b3ce0 0x7f94c80b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:03.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.654+0000 7f94e3400640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f94c80b3ce0 0x7f94c80b61f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f94d40057c0 tx=0x7f94d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:03.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.654+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f94cc0aac00 con 0x7f94e410f520 2024-07-26T12:19:03.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.887+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f94e4111c70 con 0x7f94c80b3ce0 2024-07-26T12:19:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.960+0000 7f94e0c00640 1 -- 172.21.15.40:0/3965200816 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f94e4111c70 con 0x7f94c80b3ce0 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f94c80b3ce0 msgr2=0x7f94c80b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f94c80b3ce0 0x7f94c80b61f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f94d40057c0 tx=0x7f94d40058d0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 msgr2=0x7f94e41a09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 0x7f94e41a09d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00d740 tx=0x7f94cc00dc00 comp rx=0 tx=0).stop 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 shutdown_connections 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f94e410fe70 0x7f94e41a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e410f520 0x7f94e41a09d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f94c80b3ce0 0x7f94c80b61f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 --2- 172.21.15.40:0/3965200816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e4109be0 0x7f94e41a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 >> 172.21.15.40:0/3965200816 conn(0x7f94e4077b10 msgr2=0x7f94e4078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 shutdown_connections 2024-07-26T12:19:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:03.965+0000 7f94ea000640 1 -- 172.21.15.40:0/3965200816 wait complete. 2024-07-26T12:19:04.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-07-26T12:19:05.337 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:05 smithi146 ceph-mon[35807]: pgmap v405: 97 pgs: 2 peering, 95 active+clean; 585 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 7 op/s; 83 B/s, 1 objects/s recovering 2024-07-26T12:19:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:05 smithi146 ceph-mon[35807]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:05 smithi076 ceph-mon[35401]: pgmap v405: 97 pgs: 2 peering, 95 active+clean; 585 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 7 op/s; 83 B/s, 1 objects/s recovering 2024-07-26T12:19:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:05 smithi076 ceph-mon[35401]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:05.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:05 smithi040 ceph-mon[32397]: pgmap v405: 97 pgs: 2 peering, 95 active+clean; 585 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 7 op/s; 83 B/s, 1 objects/s recovering 2024-07-26T12:19:05.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:05 smithi040 ceph-mon[32397]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 -- 172.21.15.40:0/199016940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c1055d0 msgr2=0x7fdd6c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 --2- 172.21.15.40:0/199016940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c1055d0 0x7fdd6c1059e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009900 tx=0x7fdd6002a420 comp rx=0 tx=0).stop 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 -- 172.21.15.40:0/199016940 shutdown_connections 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 --2- 172.21.15.40:0/199016940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd6c10b860 0x7fdd6c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 --2- 172.21.15.40:0/199016940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c10af10 0x7fdd6c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 --2- 172.21.15.40:0/199016940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c1055d0 0x7fdd6c1059e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 -- 172.21.15.40:0/199016940 >> 172.21.15.40:0/199016940 conn(0x7fdd6c101040 msgr2=0x7fdd6c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 -- 172.21.15.40:0/199016940 shutdown_connections 2024-07-26T12:19:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.382+0000 7fdd72e00640 1 -- 172.21.15.40:0/199016940 wait complete. 2024-07-26T12:19:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 Processor -- start 2024-07-26T12:19:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 -- start start 2024-07-26T12:19:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 0x7fdd6c19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd6c10b860 0x7fdd6c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c1a18f0 0x7fdd6c1a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c1154e0 con 0x7fdd6c10af10 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c115360 con 0x7fdd6c1a18f0 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.384+0000 7fdd72e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c115660 con 0x7fdd6c10b860 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 0x7fdd6c19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 0x7fdd6c19c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39268/0 (socket says 172.21.15.40:39268) 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 -- 172.21.15.40:0/3205108797 learned_addr learned my addr 172.21.15.40:0/3205108797 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71000640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd6c10b860 0x7fdd6c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:07.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd72400640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c1a18f0 0x7fdd6c1a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:07.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 -- 172.21.15.40:0/3205108797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd6c10b860 msgr2=0x7fdd6c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:07.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd6c10b860 0x7fdd6c19c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 -- 172.21.15.40:0/3205108797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c1a18f0 msgr2=0x7fdd6c1a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:07.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c1a18f0 0x7fdd6c1a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd71a00640 1 -- 172.21.15.40:0/3205108797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c1a24d0 con 0x7fdd6c10af10 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.385+0000 7fdd72400640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c1a18f0 0x7fdd6c1a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.386+0000 7fdd71a00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 0x7fdd6c19c170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd60006010 tx=0x7fdd60003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.386+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6003f020 con 0x7fdd6c10af10 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.386+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd6003bd00 con 0x7fdd6c10af10 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.386+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60035070 con 0x7fdd6c10af10 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.386+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c1a8a70 con 0x7fdd6c10af10 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.387+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c1a8e90 con 0x7fdd6c10af10 2024-07-26T12:19:07.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.388+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6c10b3a0 con 0x7fdd6c10af10 2024-07-26T12:19:07.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.390+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fdd60042020 con 0x7fdd6c10af10 2024-07-26T12:19:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.393+0000 7fdd6a000640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd540b3ce0 0x7fdd540b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.393+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdd60104c00 con 0x7fdd6c10af10 2024-07-26T12:19:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.393+0000 7fdd71000640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd540b3ce0 0x7fdd540b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.394+0000 7fdd71000640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd540b3ce0 0x7fdd540b61f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c107510 tx=0x7fdd5c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:07.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.395+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdd60049020 con 0x7fdd6c10af10 2024-07-26T12:19:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:07 smithi040 ceph-mon[32397]: pgmap v406: 97 pgs: 97 active+clean; 605 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 285 B/s, 1 objects/s recovering 2024-07-26T12:19:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:07 smithi076 ceph-mon[35401]: pgmap v406: 97 pgs: 97 active+clean; 605 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 285 B/s, 1 objects/s recovering 2024-07-26T12:19:07.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.630+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fdd6c10d640 con 0x7fdd540b3ce0 2024-07-26T12:19:07.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.638+0000 7fdd6a000640 1 -- 172.21.15.40:0/3205108797 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fdd6c10d640 con 0x7fdd540b3ce0 2024-07-26T12:19:07.640 INFO:teuthology.orchestra.run.smithi040.stdout:/volumes/qa/sv_0/f8ec22a5-1dd9-4bc7-896e-f9394f2e691f 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.640+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd540b3ce0 msgr2=0x7fdd540b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.640+0000 7fdd72e00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd540b3ce0 0x7fdd540b61f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c107510 tx=0x7fdd5c009110 comp rx=0 tx=0).stop 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.640+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 msgr2=0x7fdd6c19c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.640+0000 7fdd72e00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 0x7fdd6c19c170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd60006010 tx=0x7fdd60003d30 comp rx=0 tx=0).stop 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 shutdown_connections 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd6c1a18f0 0x7fdd6c1a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd540b3ce0 0x7fdd540b61f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd6c10b860 0x7fdd6c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 --2- 172.21.15.40:0/3205108797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd6c10af10 0x7fdd6c19c170 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 >> 172.21.15.40:0/3205108797 conn(0x7fdd6c101040 msgr2=0x7fdd6c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:07.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 shutdown_connections 2024-07-26T12:19:07.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:07.641+0000 7fdd72e00640 1 -- 172.21.15.40:0/3205108797 wait complete. 2024-07-26T12:19:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:07 smithi146 ceph-mon[35807]: pgmap v406: 97 pgs: 97 active+clean; 605 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 285 B/s, 1 objects/s recovering 2024-07-26T12:19:08.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-07-26T12:19:09.011 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:09.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:09 smithi040 ceph-mon[32397]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:09.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:09 smithi040 ceph-mon[32397]: pgmap v407: 97 pgs: 97 active+clean; 605 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 9 op/s; 233 B/s, 1 objects/s recovering 2024-07-26T12:19:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:09 smithi076 ceph-mon[35401]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:09 smithi076 ceph-mon[35401]: pgmap v407: 97 pgs: 97 active+clean; 605 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 9 op/s; 233 B/s, 1 objects/s recovering 2024-07-26T12:19:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:09 smithi146 ceph-mon[35807]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:09 smithi146 ceph-mon[35807]: pgmap v407: 97 pgs: 97 active+clean; 605 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 9 op/s; 233 B/s, 1 objects/s recovering 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3964155147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe381041f0 msgr2=0x7fbe38104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3964155147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe381041f0 0x7fbe38104600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009900 tx=0x7fbe2c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3964155147 shutdown_connections 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3964155147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe3810d650 0x7fbe3810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3964155147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe38104b40 0x7fbe3810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3964155147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe381041f0 0x7fbe38104600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.119+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3964155147 >> 172.21.15.40:0/3964155147 conn(0x7fbe380fdcf0 msgr2=0x7fbe38100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.120+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3964155147 shutdown_connections 2024-07-26T12:19:11.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.120+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3964155147 wait complete. 2024-07-26T12:19:11.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.121+0000 7fbe3ee00640 1 Processor -- start 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.121+0000 7fbe3ee00640 1 -- start start 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe381041f0 0x7fbe38101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3ee00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe38104b40 0x7fbe38102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3ee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 0x7fbe381029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3ee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbe381131c0 con 0x7fbe3810d650 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3ee00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbe38113040 con 0x7fbe38104b40 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe38113340 con 0x7fbe381041f0 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3e400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 0x7fbe381029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3e400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 0x7fbe381029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39290/0 (socket says 172.21.15.40:39290) 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3e400640 1 -- 172.21.15.40:0/3893856743 learned_addr learned my addr 172.21.15.40:0/3893856743 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3da00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe381041f0 0x7fbe38101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.122+0000 7fbe3d000640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe38104b40 0x7fbe38102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3e400640 1 -- 172.21.15.40:0/3893856743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe381041f0 msgr2=0x7fbe38101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3e400640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe381041f0 0x7fbe38101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3e400640 1 -- 172.21.15.40:0/3893856743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe38104b40 msgr2=0x7fbe38102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3e400640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe38104b40 0x7fbe38102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3e400640 1 -- 172.21.15.40:0/3893856743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe381a7ef0 con 0x7fbe3810d650 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3da00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe381041f0 0x7fbe38101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3e400640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 0x7fbe381029b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000eaa0 tx=0x7fbe3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000cdb0 con 0x7fbe3810d650 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe30005020 con 0x7fbe3810d650 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe300116d0 con 0x7fbe3810d650 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.123+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe381a81e0 con 0x7fbe3810d650 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.124+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe381a86d0 con 0x7fbe3810d650 2024-07-26T12:19:11.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.125+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe38104600 con 0x7fbe3810d650 2024-07-26T12:19:11.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.127+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fbe300051d0 con 0x7fbe3810d650 2024-07-26T12:19:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.129+0000 7fbe36000640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbe200b3c60 0x7fbe200b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:11.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.129+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbe300e4070 con 0x7fbe3810d650 2024-07-26T12:19:11.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.129+0000 7fbe3da00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbe200b3c60 0x7fbe200b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:11.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.130+0000 7fbe3da00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbe200b3c60 0x7fbe200b6170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe38103980 tx=0x7fbe2c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:11.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.133+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbe30016030 con 0x7fbe3810d650 2024-07-26T12:19:11.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.365+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbe38063230 con 0x7fbe200b3c60 2024-07-26T12:19:11.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.436+0000 7fbe36000640 1 -- 172.21.15.40:0/3893856743 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbe38063230 con 0x7fbe200b3c60 2024-07-26T12:19:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbe200b3c60 msgr2=0x7fbe200b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbe200b3c60 0x7fbe200b6170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe38103980 tx=0x7fbe2c005a20 comp rx=0 tx=0).stop 2024-07-26T12:19:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 msgr2=0x7fbe381029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 0x7fbe381029b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000eaa0 tx=0x7fbe3000ef60 comp rx=0 tx=0).stop 2024-07-26T12:19:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 shutdown_connections 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3810d650 0x7fbe381029b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe38104b40 0x7fbe38102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbe200b3c60 0x7fbe200b6170 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 --2- 172.21.15.40:0/3893856743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe381041f0 0x7fbe38101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 >> 172.21.15.40:0/3893856743 conn(0x7fbe380fdcf0 msgr2=0x7fbe380fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.439+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 shutdown_connections 2024-07-26T12:19:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:11.440+0000 7fbe3ee00640 1 -- 172.21.15.40:0/3893856743 wait complete. 2024-07-26T12:19:11.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:11 smithi146 ceph-mon[35807]: pgmap v408: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 KiB/s wr, 10 op/s; 211 B/s, 1 objects/s recovering 2024-07-26T12:19:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:11 smithi040 ceph-mon[32397]: pgmap v408: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 KiB/s wr, 10 op/s; 211 B/s, 1 objects/s recovering 2024-07-26T12:19:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:11 smithi076 ceph-mon[35401]: pgmap v408: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 KiB/s wr, 10 op/s; 211 B/s, 1 objects/s recovering 2024-07-26T12:19:12.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-07-26T12:19:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:12 smithi040 ceph-mon[32397]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:12.745 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:12 smithi146 ceph-mon[35807]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:12 smithi076 ceph-mon[35401]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:13 smithi040 ceph-mon[32397]: pgmap v409: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 9 op/s; 190 B/s, 1 objects/s recovering 2024-07-26T12:19:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:13 smithi146 ceph-mon[35807]: pgmap v409: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 9 op/s; 190 B/s, 1 objects/s recovering 2024-07-26T12:19:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:13 smithi076 ceph-mon[35401]: pgmap v409: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 9 op/s; 190 B/s, 1 objects/s recovering 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.901+0000 7f0c3b000640 1 -- 172.21.15.40:0/2735263976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34107420 msgr2=0x7f0c34107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.901+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2735263976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34107420 0x7f0c34107900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009cd0 tx=0x7f0c2c02a8e0 comp rx=0 tx=0).stop 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 -- 172.21.15.40:0/2735263976 shutdown_connections 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2735263976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34107420 0x7f0c34107900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2735263976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34102930 0x7f0c34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2735263976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c34101fe0 0x7f0c341023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 -- 172.21.15.40:0/2735263976 >> 172.21.15.40:0/2735263976 conn(0x7f0c340fdcf0 msgr2=0x7f0c34100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 -- 172.21.15.40:0/2735263976 shutdown_connections 2024-07-26T12:19:14.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.902+0000 7f0c3b000640 1 -- 172.21.15.40:0/2735263976 wait complete. 2024-07-26T12:19:14.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.903+0000 7f0c3b000640 1 Processor -- start 2024-07-26T12:19:14.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.903+0000 7f0c3b000640 1 -- start start 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c3b000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 0x7f0c341a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c3b000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c34102930 0x7f0c341a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c3b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34107420 0x7f0c341a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c3b000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34119790 con 0x7f0c34101fe0 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c3b000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34119610 con 0x7f0c34102930 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c3b000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34119910 con 0x7f0c34107420 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c39c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 0x7f0c341a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c39c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 0x7f0c341a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57684/0 (socket says 172.21.15.40:57684) 2024-07-26T12:19:14.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.904+0000 7f0c39c00640 1 -- 172.21.15.40:0/2830156707 learned_addr learned my addr 172.21.15.40:0/2830156707 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:14.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39200640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c34102930 0x7f0c341a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:14.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c3a600640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34107420 0x7f0c341a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:14.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39c00640 1 -- 172.21.15.40:0/2830156707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34107420 msgr2=0x7f0c341a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:14.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39c00640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34107420 0x7f0c341a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39c00640 1 -- 172.21.15.40:0/2830156707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c34102930 msgr2=0x7f0c341a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39c00640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c34102930 0x7f0c341a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39c00640 1 -- 172.21.15.40:0/2830156707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c341a6190 con 0x7f0c34101fe0 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c3a600640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34107420 0x7f0c341a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.905+0000 7f0c39c00640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 0x7f0c341a0220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800d950 tx=0x7f0c2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.906+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28017070 con 0x7f0c34101fe0 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.906+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c341a6480 con 0x7f0c34101fe0 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.906+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c28009c30 con 0x7f0c34101fe0 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.906+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800f620 con 0x7f0c34101fe0 2024-07-26T12:19:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.906+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c341acbe0 con 0x7f0c34101fe0 2024-07-26T12:19:14.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.907+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c34106e60 con 0x7f0c34101fe0 2024-07-26T12:19:14.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.910+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0c28005030 con 0x7f0c34101fe0 2024-07-26T12:19:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.912+0000 7f0c32000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c1c0b3ce0 0x7f0c1c0b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.912+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c280e3970 con 0x7f0c34101fe0 2024-07-26T12:19:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.912+0000 7f0c39200640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c1c0b3ce0 0x7f0c1c0b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.913+0000 7f0c39200640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c1c0b3ce0 0x7f0c1c0b61f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c34107870 tx=0x7f0c2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:14.917+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0c280aaea0 con 0x7f0c34101fe0 2024-07-26T12:19:15.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.148+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0c34106550 con 0x7f0c1c0b3ce0 2024-07-26T12:19:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.160+0000 7f0c32000640 1 -- 172.21.15.40:0/2830156707 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0c34106550 con 0x7f0c1c0b3ce0 2024-07-26T12:19:15.162 INFO:teuthology.orchestra.run.smithi040.stdout:/volumes/qa/sv_1/988f53f0-7995-4721-8bd9-ccbc84496260 2024-07-26T12:19:15.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c1c0b3ce0 msgr2=0x7f0c1c0b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:15.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c1c0b3ce0 0x7f0c1c0b61f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c34107870 tx=0x7f0c2000b390 comp rx=0 tx=0).stop 2024-07-26T12:19:15.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 msgr2=0x7f0c341a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:15.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 0x7f0c341a0220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800d950 tx=0x7f0c2800de10 comp rx=0 tx=0).stop 2024-07-26T12:19:15.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 shutdown_connections 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c1c0b3ce0 0x7f0c1c0b61f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c34107420 0x7f0c341a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c34102930 0x7f0c341a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 --2- 172.21.15.40:0/2830156707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c34101fe0 0x7f0c341a0220 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.163+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 >> 172.21.15.40:0/2830156707 conn(0x7f0c340fdcf0 msgr2=0x7f0c34104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.164+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 shutdown_connections 2024-07-26T12:19:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:15.164+0000 7f0c3b000640 1 -- 172.21.15.40:0/2830156707 wait complete. 2024-07-26T12:19:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:15 smithi040 ceph-mon[32397]: pgmap v410: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 KiB/s wr, 11 op/s; 190 B/s, 1 objects/s recovering 2024-07-26T12:19:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:15 smithi146 ceph-mon[35807]: pgmap v410: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 KiB/s wr, 11 op/s; 190 B/s, 1 objects/s recovering 2024-07-26T12:19:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:15 smithi076 ceph-mon[35401]: pgmap v410: 97 pgs: 97 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 KiB/s wr, 11 op/s; 190 B/s, 1 objects/s recovering 2024-07-26T12:19:15.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:19:16.477 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:16.627 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:16 smithi040 ceph-mon[32397]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:16 smithi146 ceph-mon[35807]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:16 smithi076 ceph-mon[35401]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:19:17.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:17 smithi040 ceph-mon[32397]: pgmap v411: 97 pgs: 97 active+clean; 628 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 KiB/s wr, 12 op/s; 134 B/s, 0 objects/s recovering 2024-07-26T12:19:17.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:17 smithi076 ceph-mon[35401]: pgmap v411: 97 pgs: 97 active+clean; 628 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 KiB/s wr, 12 op/s; 134 B/s, 0 objects/s recovering 2024-07-26T12:19:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:17 smithi146 ceph-mon[35807]: pgmap v411: 97 pgs: 97 active+clean; 628 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 KiB/s wr, 12 op/s; 134 B/s, 0 objects/s recovering 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.876+0000 7f4480a00640 1 -- 172.21.15.40:0/2194759201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 msgr2=0x7f447c10b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.876+0000 7f4480a00640 1 --2- 172.21.15.40:0/2194759201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c10b500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4468009900 tx=0x7f446802a410 comp rx=0 tx=0).stop 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 -- 172.21.15.40:0/2194759201 shutdown_connections 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 --2- 172.21.15.40:0/2194759201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f447c10ba40 0x7f447c112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 --2- 172.21.15.40:0/2194759201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c10b500 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 --2- 172.21.15.40:0/2194759201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447c1057b0 0x7f447c105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 -- 172.21.15.40:0/2194759201 >> 172.21.15.40:0/2194759201 conn(0x7f447c101240 msgr2=0x7f447c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 -- 172.21.15.40:0/2194759201 shutdown_connections 2024-07-26T12:19:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.877+0000 7f4480a00640 1 -- 172.21.15.40:0/2194759201 wait complete. 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.878+0000 7f4480a00640 1 Processor -- start 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.878+0000 7f4480a00640 1 -- start start 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4480a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f447c1057b0 0x7f447c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4480a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4480a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447c10ba40 0x7f447c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4480a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1155d0 con 0x7f447c10b0f0 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4480a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f447c115450 con 0x7f447c1057b0 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4480a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f447c115750 con 0x7f447c10ba40 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4479400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4479400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57704/0 (socket says 172.21.15.40:57704) 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4479400640 1 -- 172.21.15.40:0/4081207105 learned_addr learned my addr 172.21.15.40:0/4081207105 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f4479e00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f447c1057b0 0x7f447c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.879+0000 7f447a800640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447c10ba40 0x7f447c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4479400640 1 -- 172.21.15.40:0/4081207105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447c10ba40 msgr2=0x7f447c1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4479400640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447c10ba40 0x7f447c1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4479400640 1 -- 172.21.15.40:0/4081207105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f447c1057b0 msgr2=0x7f447c19c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4479400640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f447c1057b0 0x7f447c19c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4479400640 1 -- 172.21.15.40:0/4081207105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c1a1fd0 con 0x7f447c10b0f0 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4479400640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c19c600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4468005940 tx=0x7f44680040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.880+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446803f030 con 0x7f447c10b0f0 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.881+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c1a2260 con 0x7f447c10b0f0 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.881+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4468003a80 con 0x7f447c10b0f0 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.881+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468035070 con 0x7f447c10b0f0 2024-07-26T12:19:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.881+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1a8a20 con 0x7f447c10b0f0 2024-07-26T12:19:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.882+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447c105bc0 con 0x7f447c10b0f0 2024-07-26T12:19:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.885+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4468042030 con 0x7f447c10b0f0 2024-07-26T12:19:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.886+0000 7f4472a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44600b3ce0 0x7f44600b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.886+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4468104640 con 0x7f447c10b0f0 2024-07-26T12:19:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.886+0000 7f4479e00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44600b3ce0 0x7f44600b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.887+0000 7f4479e00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44600b3ce0 0x7f44600b61f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f446c009990 tx=0x7f446c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:18.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:18.892+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f44680cbaf0 con 0x7f447c10b0f0 2024-07-26T12:19:19.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.135+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f447c19d190 con 0x7f447c10b0f0 2024-07-26T12:19:19.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.136+0000 7f4472a00640 1 -- 172.21.15.40:0/4081207105 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f447c19d190 con 0x7f447c10b0f0 2024-07-26T12:19:19.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:19.138 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"btime":"2024-07-26T12:18:56:044354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:18:55.823664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:19:19.138 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:19:19.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.139+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44600b3ce0 msgr2=0x7f44600b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:19.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.139+0000 7f4480a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44600b3ce0 0x7f44600b61f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f446c009990 tx=0x7f446c009110 comp rx=0 tx=0).stop 2024-07-26T12:19:19.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.139+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 msgr2=0x7f447c19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:19.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.139+0000 7f4480a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c19c600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4468005940 tx=0x7f44680040e0 comp rx=0 tx=0).stop 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 shutdown_connections 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44600b3ce0 0x7f44600b61f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f447c10ba40 0x7f447c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c10b0f0 0x7f447c19c600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 --2- 172.21.15.40:0/4081207105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f447c1057b0 0x7f447c19c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 >> 172.21.15.40:0/4081207105 conn(0x7f447c101240 msgr2=0x7f447c103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:19.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.140+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 shutdown_connections 2024-07-26T12:19:19.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:19.141+0000 7f4480a00640 1 -- 172.21.15.40:0/4081207105 wait complete. 2024-07-26T12:19:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:19 smithi040 ceph-mon[32397]: pgmap v412: 97 pgs: 97 active+clean; 628 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-07-26T12:19:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:19 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4081207105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:19:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:19 smithi146 ceph-mon[35807]: pgmap v412: 97 pgs: 97 active+clean; 628 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-07-26T12:19:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:19 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4081207105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:19:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:19 smithi076 ceph-mon[35401]: pgmap v412: 97 pgs: 97 active+clean; 628 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-07-26T12:19:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:19 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4081207105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:19:20.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:19:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:21.674 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:21 smithi040 ceph-mon[32397]: pgmap v413: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-07-26T12:19:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:21 smithi146 ceph-mon[35807]: pgmap v413: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-07-26T12:19:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:21 smithi076 ceph-mon[35401]: pgmap v413: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-07-26T12:19:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 -- 172.21.15.40:0/1624400278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 msgr2=0x7ffb6c1122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 --2- 172.21.15.40:0/1624400278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1122a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009ca0 tx=0x7ffb6402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 -- 172.21.15.40:0/1624400278 shutdown_connections 2024-07-26T12:19:22.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 --2- 172.21.15.40:0/1624400278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1122a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 --2- 172.21.15.40:0/1624400278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffb6c10b120 0x7ffb6c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 --2- 172.21.15.40:0/1624400278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c1057e0 0x7ffb6c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 -- 172.21.15.40:0/1624400278 >> 172.21.15.40:0/1624400278 conn(0x7ffb6c1011f0 msgr2=0x7ffb6c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 -- 172.21.15.40:0/1624400278 shutdown_connections 2024-07-26T12:19:22.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.570+0000 7ffb71e00640 1 -- 172.21.15.40:0/1624400278 wait complete. 2024-07-26T12:19:22.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.571+0000 7ffb71e00640 1 Processor -- start 2024-07-26T12:19:22.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 -- start start 2024-07-26T12:19:22.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c1057e0 0x7ffb6c19c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:22.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffb6c10b120 0x7ffb6c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:22.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c115620 con 0x7ffb6c10ba70 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c1154a0 con 0x7ffb6c10b120 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb71e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c1157a0 con 0x7ffb6c1057e0 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57722/0 (socket says 172.21.15.40:57722) 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.572+0000 7ffb6b400640 1 -- 172.21.15.40:0/306347763 learned_addr learned my addr 172.21.15.40:0/306347763 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6aa00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c1057e0 0x7ffb6c19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:22.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6a000640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffb6c10b120 0x7ffb6c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6b400640 1 -- 172.21.15.40:0/306347763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c1057e0 msgr2=0x7ffb6c19c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6b400640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c1057e0 0x7ffb6c19c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6b400640 1 -- 172.21.15.40:0/306347763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffb6c10b120 msgr2=0x7ffb6c19c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6b400640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffb6c10b120 0x7ffb6c19c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6b400640 1 -- 172.21.15.40:0/306347763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c1a1f00 con 0x7ffb6c10ba70 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.573+0000 7ffb6b400640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1a1890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb64031040 tx=0x7ffb64032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.574+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64004040 con 0x7ffb6c10ba70 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.574+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb64004670 con 0x7ffb6c10ba70 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.574+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c1a2190 con 0x7ffb6c10ba70 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.574+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64030bb0 con 0x7ffb6c10ba70 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.574+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c1a8a10 con 0x7ffb6c10ba70 2024-07-26T12:19:22.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.575+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c105bf0 con 0x7ffb6c10ba70 2024-07-26T12:19:22.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.578+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ffb640041e0 con 0x7ffb6c10ba70 2024-07-26T12:19:22.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.579+0000 7ffb70a00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffb500b3d10 0x7ffb500b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:22.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.580+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffb64105250 con 0x7ffb6c10ba70 2024-07-26T12:19:22.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.580+0000 7ffb6aa00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffb500b3d10 0x7ffb500b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:22.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.580+0000 7ffb6aa00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffb500b3d10 0x7ffb500b6220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c005e10 tx=0x7ffb5c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:22.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.582+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffb640cc810 con 0x7ffb6c10ba70 2024-07-26T12:19:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.784+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb6c19d180 con 0x7ffb6c10ba70 2024-07-26T12:19:22.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.786+0000 7ffb70a00640 1 -- 172.21.15.40:0/306347763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7ffb6c19d180 con 0x7ffb6c10ba70 2024-07-26T12:19:22.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:22.789 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:59.075766+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:19:22.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffb500b3d10 msgr2=0x7ffb500b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:22.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffb500b3d10 0x7ffb500b6220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c005e10 tx=0x7ffb5c005da0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 msgr2=0x7ffb6c1a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1a1890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb64031040 tx=0x7ffb64032bc0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 shutdown_connections 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb6c10ba70 0x7ffb6c1a1890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffb6c10b120 0x7ffb6c19c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffb500b3d10 0x7ffb500b6220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 --2- 172.21.15.40:0/306347763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb6c1057e0 0x7ffb6c19c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 >> 172.21.15.40:0/306347763 conn(0x7ffb6c1011f0 msgr2=0x7ffb6c104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 shutdown_connections 2024-07-26T12:19:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:22.789+0000 7ffb71e00640 1 -- 172.21.15.40:0/306347763 wait complete. 2024-07-26T12:19:23.586 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-26T12:19:23.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:19:23.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:23 smithi040 ceph-mon[32397]: pgmap v414: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-07-26T12:19:23.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:23 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/306347763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:23.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:19:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:23 smithi146 ceph-mon[35807]: pgmap v414: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-07-26T12:19:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:23 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/306347763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:19:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:23 smithi076 ceph-mon[35401]: pgmap v414: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-07-26T12:19:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:23 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/306347763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:19:24.398 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:24.560 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.560 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.560 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.560 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.754 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.754 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.754 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.754 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.761 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.761 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.761 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:24.761 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:25 smithi146 ceph-mon[35807]: pgmap v415: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-07-26T12:19:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:25 smithi076 ceph-mon[35401]: pgmap v415: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-07-26T12:19:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:25 smithi040 ceph-mon[32397]: pgmap v415: 97 pgs: 97 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-07-26T12:19:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 -- 172.21.15.40:0/760813156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 msgr2=0x7f8140105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 --2- 172.21.15.40:0/760813156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f8140105bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8130009900 tx=0x7f813002a410 comp rx=0 tx=0).stop 2024-07-26T12:19:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 -- 172.21.15.40:0/760813156 shutdown_connections 2024-07-26T12:19:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 --2- 172.21.15.40:0/760813156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f814010ba40 0x7f8140112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 --2- 172.21.15.40:0/760813156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f814010b0f0 0x7f814010b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 --2- 172.21.15.40:0/760813156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f8140105bc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 -- 172.21.15.40:0/760813156 >> 172.21.15.40:0/760813156 conn(0x7f8140101240 msgr2=0x7f8140103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 -- 172.21.15.40:0/760813156 shutdown_connections 2024-07-26T12:19:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.739+0000 7f8145800640 1 -- 172.21.15.40:0/760813156 wait complete. 2024-07-26T12:19:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.740+0000 7f8145800640 1 Processor -- start 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.740+0000 7f8145800640 1 -- start start 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8145800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f814019c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8145800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f814010b0f0 0x7f814019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8145800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f814010ba40 0x7f81401a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8145800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f81401155f0 con 0x7f81401057b0 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8145800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8140115470 con 0x7f814010b0f0 2024-07-26T12:19:26.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8145800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8140115770 con 0x7f814010ba40 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f813ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f814019c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f813ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f814019c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42896/0 (socket says 172.21.15.40:42896) 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f813ea00640 1 -- 172.21.15.40:0/2247837473 learned_addr learned my addr 172.21.15.40:0/2247837473 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.741+0000 7f8136000640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f814010b0f0 0x7f814019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813f400640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f814010ba40 0x7f81401a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813ea00640 1 -- 172.21.15.40:0/2247837473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f814010ba40 msgr2=0x7f81401a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813ea00640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f814010ba40 0x7f81401a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813ea00640 1 -- 172.21.15.40:0/2247837473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f814010b0f0 msgr2=0x7f814019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813ea00640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f814010b0f0 0x7f814019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813ea00640 1 -- 172.21.15.40:0/2247837473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81401a1ed0 con 0x7f81401057b0 2024-07-26T12:19:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.742+0000 7f813ea00640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f814019c020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f813002a930 tx=0x7f8130003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.743+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813003f070 con 0x7f81401057b0 2024-07-26T12:19:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.743+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81401a2160 con 0x7f81401057b0 2024-07-26T12:19:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.743+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8130003e40 con 0x7f81401057b0 2024-07-26T12:19:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.743+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130035030 con 0x7f81401057b0 2024-07-26T12:19:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.743+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81401a2640 con 0x7f81401057b0 2024-07-26T12:19:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.744+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8140105bc0 con 0x7f81401057b0 2024-07-26T12:19:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.748+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8130042070 con 0x7f81401057b0 2024-07-26T12:19:26.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.749+0000 7f8137e00640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f81240b3c90 0x7f81240b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:26.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.749+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8130104930 con 0x7f81401057b0 2024-07-26T12:19:26.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.750+0000 7f8136000640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f81240b3c90 0x7f81240b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:26.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.751+0000 7f8136000640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f81240b3c90 0x7f81240b61a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f814010aca0 tx=0x7f812800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.753+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f81300cb790 con 0x7f81401057b0 2024-07-26T12:19:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.967+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f814010d7f0 con 0x7f81240b3c90 2024-07-26T12:19:26.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.984+0000 7f8137e00640 1 -- 172.21.15.40:0/2247837473 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258832 (secure 0 0 0) 0x7f814010d7f0 con 0x7f81240b3c90 2024-07-26T12:19:26.989 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.989+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f81240b3c90 msgr2=0x7f81240b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.989+0000 7f8145800640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f81240b3c90 0x7f81240b61a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f814010aca0 tx=0x7f812800b390 comp rx=0 tx=0).stop 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.989+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 msgr2=0x7f814019c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.989+0000 7f8145800640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f814019c020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f813002a930 tx=0x7f8130003c20 comp rx=0 tx=0).stop 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.990+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 shutdown_connections 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.990+0000 7f8145800640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f81240b3c90 0x7f81240b61a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.990+0000 7f8145800640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f814010ba40 0x7f81401a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.990+0000 7f8145800640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f814010b0f0 0x7f814019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.990+0000 7f8145800640 1 --2- 172.21.15.40:0/2247837473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81401057b0 0x7f814019c020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.990+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 >> 172.21.15.40:0/2247837473 conn(0x7f8140101240 msgr2=0x7f8140103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.991+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 shutdown_connections 2024-07-26T12:19:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:26.991+0000 7f8145800640 1 -- 172.21.15.40:0/2247837473 wait complete. 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: pgmap v416: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: pgmap v416: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-07-26T12:19:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: pgmap v416: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-07-26T12:19:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":416,"stamp":"2024-07-26T12:19:25.875467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660487,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":404,"num_read_kb":299,"num_write":371,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386916,"kb_used_data":12792,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554908,"statfs":{"total":1151940427776,"available":1151544225792,"internally_reserved":0,"allocated":13099008,"data_stored":7195209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":101,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006350"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.087494+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:18:59.087494+0000","last_peered":"2024-07-26T12:18:59.087494+0000","last_clean":"2024-07-26T12:18:59.087494+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:18:59.087494+0000","last_undegraded":"2024-07-26T12:18:59.087494+0000","last_fullsized":"2024-07-26T12:18:59.087494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481111+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:18:59.481111+0000","last_peered":"2024-07-26T12:18:59.481111+0000","last_clean":"2024-07-26T12:18:59.481111+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:18:59.481111+0000","last_undegraded":"2024-07-26T12:18:59.481111+0000","last_fullsized":"2024-07-26T12:18:59.481111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.480344+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:18:59.480344+0000","last_peered":"2024-07-26T12:18:59.480344+0000","last_clean":"2024-07-26T12:18:59.480344+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:18:59.480344+0000","last_undegraded":"2024-07-26T12:18:59.480344+0000","last_fullsized":"2024-07-26T12:18:59.480344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.106366+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:18:59.106366+0000","last_peered":"2024-07-26T12:18:59.106366+0000","last_clean":"2024-07-26T12:18:59.106366+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:18:59.106366+0000","last_undegraded":"2024-07-26T12:18:59.106366+0000","last_fullsized":"2024-07-26T12:18:59.106366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094684+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:18:59.094684+0000","last_peered":"2024-07-26T12:18:59.094684+0000","last_clean":"2024-07-26T12:18:59.094684+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:18:59.094684+0000","last_undegraded":"2024-07-26T12:18:59.094684+0000","last_fullsized":"2024-07-26T12:18:59.094684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.087668+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:18:59.087668+0000","last_peered":"2024-07-26T12:18:59.087668+0000","last_clean":"2024-07-26T12:18:59.087668+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:18:59.087668+0000","last_undegraded":"2024-07-26T12:18:59.087668+0000","last_fullsized":"2024-07-26T12:18:59.087668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097040+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:18:59.097040+0000","last_peered":"2024-07-26T12:18:59.097040+0000","last_clean":"2024-07-26T12:18:59.097040+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:18:59.097040+0000","last_undegraded":"2024-07-26T12:18:59.097040+0000","last_fullsized":"2024-07-26T12:18:59.097040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094019+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:18:59.094019+0000","last_peered":"2024-07-26T12:18:59.094019+0000","last_clean":"2024-07-26T12:18:59.094019+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:18:59.094019+0000","last_undegraded":"2024-07-26T12:18:59.094019+0000","last_fullsized":"2024-07-26T12:18:59.094019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.111298+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:18:59.111298+0000","last_peered":"2024-07-26T12:18:59.111298+0000","last_clean":"2024-07-26T12:18:59.111298+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:18:59.111298+0000","last_undegraded":"2024-07-26T12:18:59.111298+0000","last_fullsized":"2024-07-26T12:18:59.111298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088720+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:18:59.088720+0000","last_peered":"2024-07-26T12:18:59.088720+0000","last_clean":"2024-07-26T12:18:59.088720+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:18:59.088720+0000","last_undegraded":"2024-07-26T12:18:59.088720+0000","last_fullsized":"2024-07-26T12:18:59.088720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097656+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:18:59.097656+0000","last_peered":"2024-07-26T12:18:59.097656+0000","last_clean":"2024-07-26T12:18:59.097656+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:18:59.097656+0000","last_undegraded":"2024-07-26T12:18:59.097656+0000","last_fullsized":"2024-07-26T12:18:59.097656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.105194+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:18:59.105194+0000","last_peered":"2024-07-26T12:18:59.105194+0000","last_clean":"2024-07-26T12:18:59.105194+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:18:59.105194+0000","last_undegraded":"2024-07-26T12:18:59.105194+0000","last_fullsized":"2024-07-26T12:18:59.105194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085094+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:18:59.085094+0000","last_peered":"2024-07-26T12:18:59.085094+0000","last_clean":"2024-07-26T12:18:59.085094+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:18:59.085094+0000","last_undegraded":"2024-07-26T12:18:59.085094+0000","last_fullsized":"2024-07-26T12:18:59.085094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.480531+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:18:59.480531+0000","last_peered":"2024-07-26T12:18:59.480531+0000","last_clean":"2024-07-26T12:18:59.480531+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:18:59.480531+0000","last_undegraded":"2024-07-26T12:18:59.480531+0000","last_fullsized":"2024-07-26T12:18:59.480531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.480056+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:18:59.480056+0000","last_peered":"2024-07-26T12:18:59.480056+0000","last_clean":"2024-07-26T12:18:59.480056+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:18:59.480056+0000","last_undegraded":"2024-07-26T12:18:59.480056+0000","last_fullsized":"2024-07-26T12:18:59.480056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.093698+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:18:59.093698+0000","last_peered":"2024-07-26T12:18:59.093698+0000","last_clean":"2024-07-26T12:18:59.093698+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:18:59.093698+0000","last_undegraded":"2024-07-26T12:18:59.093698+0000","last_fullsized":"2024-07-26T12:18:59.093698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.087727+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:18:59.087727+0000","last_peered":"2024-07-26T12:18:59.087727+0000","last_clean":"2024-07-26T12:18:59.087727+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:18:59.087727+0000","last_undegraded":"2024-07-26T12:18:59.087727+0000","last_fullsized":"2024-07-26T12:18:59.087727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092188+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:18:59.092188+0000","last_peered":"2024-07-26T12:18:59.092188+0000","last_clean":"2024-07-26T12:18:59.092188+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:18:59.092188+0000","last_undegraded":"2024-07-26T12:18:59.092188+0000","last_fullsized":"2024-07-26T12:18:59.092188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092957+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:18:59.092957+0000","last_peered":"2024-07-26T12:18:59.092957+0000","last_clean":"2024-07-26T12:18:59.092957+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:18:59.092957+0000","last_undegraded":"2024-07-26T12:18:59.092957+0000","last_fullsized":"2024-07-26T12:18:59.092957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086106+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:18:59.086106+0000","last_peered":"2024-07-26T12:18:59.086106+0000","last_clean":"2024-07-26T12:18:59.086106+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:18:59.086106+0000","last_undegraded":"2024-07-26T12:18:59.086106+0000","last_fullsized":"2024-07-26T12:18:59.086106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085239+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:18:59.085239+0000","last_peered":"2024-07-26T12:18:59.085239+0000","last_clean":"2024-07-26T12:18:59.085239+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:18:59.085239+0000","last_undegraded":"2024-07-26T12:18:59.085239+0000","last_fullsized":"2024-07-26T12:18:59.085239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094742+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:18:59.094742+0000","last_peered":"2024-07-26T12:18:59.094742+0000","last_clean":"2024-07-26T12:18:59.094742+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:18:59.094742+0000","last_undegraded":"2024-07-26T12:18:59.094742+0000","last_fullsized":"2024-07-26T12:18:59.094742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.103842+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:18:59.103842+0000","last_peered":"2024-07-26T12:18:59.103842+0000","last_clean":"2024-07-26T12:18:59.103842+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:18:59.103842+0000","last_undegraded":"2024-07-26T12:18:59.103842+0000","last_fullsized":"2024-07-26T12:18:59.103842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117879+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:18:59.117879+0000","last_peered":"2024-07-26T12:18:59.117879+0000","last_clean":"2024-07-26T12:18:59.117879+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:18:59.117879+0000","last_undegraded":"2024-07-26T12:18:59.117879+0000","last_fullsized":"2024-07-26T12:18:59.117879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096694+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:18:59.096694+0000","last_peered":"2024-07-26T12:18:59.096694+0000","last_clean":"2024-07-26T12:18:59.096694+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:18:59.096694+0000","last_undegraded":"2024-07-26T12:18:59.096694+0000","last_fullsized":"2024-07-26T12:18:59.096694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095334+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:18:59.095334+0000","last_peered":"2024-07-26T12:18:59.095334+0000","last_clean":"2024-07-26T12:18:59.095334+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:18:59.095334+0000","last_undegraded":"2024-07-26T12:18:59.095334+0000","last_fullsized":"2024-07-26T12:18:59.095334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086767+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:18:59.086767+0000","last_peered":"2024-07-26T12:18:59.086767+0000","last_clean":"2024-07-26T12:18:59.086767+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:18:59.086767+0000","last_undegraded":"2024-07-26T12:18:59.086767+0000","last_fullsized":"2024-07-26T12:18:59.086767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085329+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:18:59.085329+0000","last_peered":"2024-07-26T12:18:59.085329+0000","last_clean":"2024-07-26T12:18:59.085329+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:18:59.085329+0000","last_undegraded":"2024-07-26T12:18:59.085329+0000","last_fullsized":"2024-07-26T12:18:59.085329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481575+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:18:59.481575+0000","last_peered":"2024-07-26T12:18:59.481575+0000","last_clean":"2024-07-26T12:18:59.481575+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:18:59.481575+0000","last_undegraded":"2024-07-26T12:18:59.481575+0000","last_fullsized":"2024-07-26T12:18:59.481575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092359+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:18:59.092359+0000","last_peered":"2024-07-26T12:18:59.092359+0000","last_clean":"2024-07-26T12:18:59.092359+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:18:59.092359+0000","last_undegraded":"2024-07-26T12:18:59.092359+0000","last_fullsized":"2024-07-26T12:18:59.092359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098024+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:18:59.098024+0000","last_peered":"2024-07-26T12:18:59.098024+0000","last_clean":"2024-07-26T12:18:59.098024+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:18:59.098024+0000","last_undegraded":"2024-07-26T12:18:59.098024+0000","last_fullsized":"2024-07-26T12:18:59.098024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085960+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:18:59.085960+0000","last_peered":"2024-07-26T12:18:59.085960+0000","last_clean":"2024-07-26T12:18:59.085960+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:18:59.085960+0000","last_undegraded":"2024-07-26T12:18:59.085960+0000","last_fullsized":"2024-07-26T12:18:59.085960+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095779+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:18:59.095779+0000","last_peered":"2024-07-26T12:18:59.095779+0000","last_clean":"2024-07-26T12:18:59.095779+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:18:59.095779+0000","last_undegraded":"2024-07-26T12:18:59.095779+0000","last_fullsized":"2024-07-26T12:18:59.095779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:21.188941+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:19:21.188941+0000","last_peered":"2024-07-26T12:19:21.188941+0000","last_clean":"2024-07-26T12:19:21.188941+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:19:21.188941+0000","last_undegraded":"2024-07-26T12:19:21.188941+0000","last_fullsized":"2024-07-26T12:19:21.188941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117887+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:18:59.117887+0000","last_peered":"2024-07-26T12:18:59.117887+0000","last_clean":"2024-07-26T12:18:59.117887+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:18:59.117887+0000","last_undegraded":"2024-07-26T12:18:59.117887+0000","last_fullsized":"2024-07-26T12:18:59.117887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088167+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088167+0000","last_peered":"2024-07-26T12:18:59.088167+0000","last_clean":"2024-07-26T12:18:59.088167+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088167+0000","last_undegraded":"2024-07-26T12:18:59.088167+0000","last_fullsized":"2024-07-26T12:18:59.088167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084501+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084501+0000","last_peered":"2024-07-26T12:18:59.084501+0000","last_clean":"2024-07-26T12:18:59.084501+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084501+0000","last_undegraded":"2024-07-26T12:18:59.084501+0000","last_fullsized":"2024-07-26T12:18:59.084501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094243+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:18:59.094243+0000","last_peered":"2024-07-26T12:18:59.094243+0000","last_clean":"2024-07-26T12:18:59.094243+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:18:59.094243+0000","last_undegraded":"2024-07-26T12:18:59.094243+0000","last_fullsized":"2024-07-26T12:18:59.094243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117807+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117807+0000","last_peered":"2024-07-26T12:18:59.117807+0000","last_clean":"2024-07-26T12:18:59.117807+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117807+0000","last_undegraded":"2024-07-26T12:18:59.117807+0000","last_fullsized":"2024-07-26T12:18:59.117807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.091924+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:18:59.091924+0000","last_peered":"2024-07-26T12:18:59.091924+0000","last_clean":"2024-07-26T12:18:59.091924+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:18:59.091924+0000","last_undegraded":"2024-07-26T12:18:59.091924+0000","last_fullsized":"2024-07-26T12:18:59.091924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:23.179967+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:19:23.179967+0000","last_peered":"2024-07-26T12:19:23.179967+0000","last_clean":"2024-07-26T12:19:23.179967+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:19:23.179967+0000","last_undegraded":"2024-07-26T12:19:23.179967+0000","last_fullsized":"2024-07-26T12:19:23.179967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095751+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:18:59.095751+0000","last_peered":"2024-07-26T12:18:59.095751+0000","last_clean":"2024-07-26T12:18:59.095751+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:18:59.095751+0000","last_undegraded":"2024-07-26T12:18:59.095751+0000","last_fullsized":"2024-07-26T12:18:59.095751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096778+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096778+0000","last_peered":"2024-07-26T12:18:59.096778+0000","last_clean":"2024-07-26T12:18:59.096778+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096778+0000","last_undegraded":"2024-07-26T12:18:59.096778+0000","last_fullsized":"2024-07-26T12:18:59.096778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481494+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:18:59.481494+0000","last_peered":"2024-07-26T12:18:59.481494+0000","last_clean":"2024-07-26T12:18:59.481494+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:18:59.481494+0000","last_undegraded":"2024-07-26T12:18:59.481494+0000","last_fullsized":"2024-07-26T12:18:59.481494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118510+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118510+0000","last_peered":"2024-07-26T12:18:59.118510+0000","last_clean":"2024-07-26T12:18:59.118510+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118510+0000","last_undegraded":"2024-07-26T12:18:59.118510+0000","last_fullsized":"2024-07-26T12:18:59.118510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107470+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:18:59.107470+0000","last_peered":"2024-07-26T12:18:59.107470+0000","last_clean":"2024-07-26T12:18:59.107470+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:18:59.107470+0000","last_undegraded":"2024-07-26T12:18:59.107470+0000","last_fullsized":"2024-07-26T12:18:59.107470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:23.210360+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:19:23.210360+0000","last_peered":"2024-07-26T12:19:23.210360+0000","last_clean":"2024-07-26T12:19:23.210360+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:19:23.210360+0000","last_undegraded":"2024-07-26T12:19:23.210360+0000","last_fullsized":"2024-07-26T12:19:23.210360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":88,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096454+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:18:59.096454+0000","last_peered":"2024-07-26T12:18:59.096454+0000","last_clean":"2024-07-26T12:18:59.096454+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:18:59.096454+0000","last_undegraded":"2024-07-26T12:18:59.096454+0000","last_fullsized":"2024-07-26T12:18:59.096454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.093898+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.093898+0000","last_peered":"2024-07-26T12:18:59.093898+0000","last_clean":"2024-07-26T12:18:59.093898+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.093898+0000","last_undegraded":"2024-07-26T12:18:59.093898+0000","last_fullsized":"2024-07-26T12:18:59.093898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084754+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:18:59.084754+0000","last_peered":"2024-07-26T12:18:59.084754+0000","last_clean":"2024-07-26T12:18:59.084754+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:18:59.084754+0000","last_undegraded":"2024-07-26T12:18:59.084754+0000","last_fullsized":"2024-07-26T12:18:59.084754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117223+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117223+0000","last_peered":"2024-07-26T12:18:59.117223+0000","last_clean":"2024-07-26T12:18:59.117223+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117223+0000","last_undegraded":"2024-07-26T12:18:59.117223+0000","last_fullsized":"2024-07-26T12:18:59.117223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096173+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:18:59.096173+0000","last_peered":"2024-07-26T12:18:59.096173+0000","last_clean":"2024-07-26T12:18:59.096173+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:18:59.096173+0000","last_undegraded":"2024-07-26T12:18:59.096173+0000","last_fullsized":"2024-07-26T12:18:59.096173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:22.177751+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:19:22.177751+0000","last_peered":"2024-07-26T12:19:22.177751+0000","last_clean":"2024-07-26T12:19:22.177751+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:19:22.177751+0000","last_undegraded":"2024-07-26T12:19:22.177751+0000","last_fullsized":"2024-07-26T12:19:22.177751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095741+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:18:59.095741+0000","last_peered":"2024-07-26T12:18:59.095741+0000","last_clean":"2024-07-26T12:18:59.095741+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:18:59.095741+0000","last_undegraded":"2024-07-26T12:18:59.095741+0000","last_fullsized":"2024-07-26T12:18:59.095741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094550+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.094550+0000","last_peered":"2024-07-26T12:18:59.094550+0000","last_clean":"2024-07-26T12:18:59.094550+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.094550+0000","last_undegraded":"2024-07-26T12:18:59.094550+0000","last_fullsized":"2024-07-26T12:18:59.094550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.116989+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:18:59.116989+0000","last_peered":"2024-07-26T12:18:59.116989+0000","last_clean":"2024-07-26T12:18:59.116989+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:18:59.116989+0000","last_undegraded":"2024-07-26T12:18:59.116989+0000","last_fullsized":"2024-07-26T12:18:59.116989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.104270+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:18:59.104270+0000","last_peered":"2024-07-26T12:18:59.104270+0000","last_clean":"2024-07-26T12:18:59.104270+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:18:59.104270+0000","last_undegraded":"2024-07-26T12:18:59.104270+0000","last_fullsized":"2024-07-26T12:18:59.104270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086907+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:18:59.086907+0000","last_peered":"2024-07-26T12:18:59.086907+0000","last_clean":"2024-07-26T12:18:59.086907+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:18:59.086907+0000","last_undegraded":"2024-07-26T12:18:59.086907+0000","last_fullsized":"2024-07-26T12:18:59.086907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.120063+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.120063+0000","last_peered":"2024-07-26T12:18:59.120063+0000","last_clean":"2024-07-26T12:18:59.120063+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.120063+0000","last_undegraded":"2024-07-26T12:18:59.120063+0000","last_fullsized":"2024-07-26T12:18:59.120063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097500+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:18:59.097500+0000","last_peered":"2024-07-26T12:18:59.097500+0000","last_clean":"2024-07-26T12:18:59.097500+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:18:59.097500+0000","last_undegraded":"2024-07-26T12:18:59.097500+0000","last_fullsized":"2024-07-26T12:18:59.097500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118750+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118750+0000","last_peered":"2024-07-26T12:18:59.118750+0000","last_clean":"2024-07-26T12:18:59.118750+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118750+0000","last_undegraded":"2024-07-26T12:18:59.118750+0000","last_fullsized":"2024-07-26T12:18:59.118750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098858+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:18:59.098858+0000","last_peered":"2024-07-26T12:18:59.098858+0000","last_clean":"2024-07-26T12:18:59.098858+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:18:59.098858+0000","last_undegraded":"2024-07-26T12:18:59.098858+0000","last_fullsized":"2024-07-26T12:18:59.098858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:22.178471+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:19:22.178471+0000","last_peered":"2024-07-26T12:19:22.178471+0000","last_clean":"2024-07-26T12:19:22.178471+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:19:22.178471+0000","last_undegraded":"2024-07-26T12:19:22.178471+0000","last_fullsized":"2024-07-26T12:19:22.178471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097953+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:18:59.097953+0000","last_peered":"2024-07-26T12:18:59.097953+0000","last_clean":"2024-07-26T12:18:59.097953+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:18:59.097953+0000","last_undegraded":"2024-07-26T12:18:59.097953+0000","last_fullsized":"2024-07-26T12:18:59.097953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096638+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.096638+0000","last_peered":"2024-07-26T12:18:59.096638+0000","last_clean":"2024-07-26T12:18:59.096638+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.096638+0000","last_undegraded":"2024-07-26T12:18:59.096638+0000","last_fullsized":"2024-07-26T12:18:59.096638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.106043+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:18:59.106043+0000","last_peered":"2024-07-26T12:18:59.106043+0000","last_clean":"2024-07-26T12:18:59.106043+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:18:59.106043+0000","last_undegraded":"2024-07-26T12:18:59.106043+0000","last_fullsized":"2024-07-26T12:18:59.106043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096323+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:18:59.096323+0000","last_peered":"2024-07-26T12:18:59.096323+0000","last_clean":"2024-07-26T12:18:59.096323+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:18:59.096323+0000","last_undegraded":"2024-07-26T12:18:59.096323+0000","last_fullsized":"2024-07-26T12:18:59.096323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096274+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:18:59.096274+0000","last_peered":"2024-07-26T12:18:59.096274+0000","last_clean":"2024-07-26T12:18:59.096274+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:18:59.096274+0000","last_undegraded":"2024-07-26T12:18:59.096274+0000","last_fullsized":"2024-07-26T12:18:59.096274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084446+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:18:59.084446+0000","last_peered":"2024-07-26T12:18:59.084446+0000","last_clean":"2024-07-26T12:18:59.084446+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:18:59.084446+0000","last_undegraded":"2024-07-26T12:18:59.084446+0000","last_fullsized":"2024-07-26T12:18:59.084446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:21.172910+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:19:21.172910+0000","last_peered":"2024-07-26T12:19:21.172910+0000","last_clean":"2024-07-26T12:19:21.172910+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:19:21.172910+0000","last_undegraded":"2024-07-26T12:19:21.172910+0000","last_fullsized":"2024-07-26T12:19:21.172910+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.116977+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:18:59.116977+0000","last_peered":"2024-07-26T12:18:59.116977+0000","last_clean":"2024-07-26T12:18:59.116977+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:18:59.116977+0000","last_undegraded":"2024-07-26T12:18:59.116977+0000","last_fullsized":"2024-07-26T12:18:59.116977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:21.181916+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:19:21.181916+0000","last_peered":"2024-07-26T12:19:21.181916+0000","last_clean":"2024-07-26T12:19:21.181916+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:19:21.181916+0000","last_undegraded":"2024-07-26T12:19:21.181916+0000","last_fullsized":"2024-07-26T12:19:21.181916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.485022+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:18:59.485022+0000","last_peered":"2024-07-26T12:18:59.485022+0000","last_clean":"2024-07-26T12:18:59.485022+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:18:59.485022+0000","last_undegraded":"2024-07-26T12:18:59.485022+0000","last_fullsized":"2024-07-26T12:18:59.485022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092466+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:18:59.092466+0000","last_peered":"2024-07-26T12:18:59.092466+0000","last_clean":"2024-07-26T12:18:59.092466+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:18:59.092466+0000","last_undegraded":"2024-07-26T12:18:59.092466+0000","last_fullsized":"2024-07-26T12:18:59.092466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088062+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:18:59.088062+0000","last_peered":"2024-07-26T12:18:59.088062+0000","last_clean":"2024-07-26T12:18:59.088062+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:18:59.088062+0000","last_undegraded":"2024-07-26T12:18:59.088062+0000","last_fullsized":"2024-07-26T12:18:59.088062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096805+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:18:59.096805+0000","last_peered":"2024-07-26T12:18:59.096805+0000","last_clean":"2024-07-26T12:18:59.096805+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:18:59.096805+0000","last_undegraded":"2024-07-26T12:18:59.096805+0000","last_fullsized":"2024-07-26T12:18:59.096805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085371+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:18:59.085371+0000","last_peered":"2024-07-26T12:18:59.085371+0000","last_clean":"2024-07-26T12:18:59.085371+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:18:59.085371+0000","last_undegraded":"2024-07-26T12:18:59.085371+0000","last_fullsized":"2024-07-26T12:18:59.085371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:17.600138+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:19:17.600138+0000","last_peered":"2024-07-26T12:19:17.600138+0000","last_clean":"2024-07-26T12:19:17.600138+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:19:17.600138+0000","last_undegraded":"2024-07-26T12:19:17.600138+0000","last_fullsized":"2024-07-26T12:19:17.600138+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096919+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:18:59.096919+0000","last_peered":"2024-07-26T12:18:59.096919+0000","last_clean":"2024-07-26T12:18:59.096919+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:18:59.096919+0000","last_undegraded":"2024-07-26T12:18:59.096919+0000","last_fullsized":"2024-07-26T12:18:59.096919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107077+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107077+0000","last_peered":"2024-07-26T12:18:59.107077+0000","last_clean":"2024-07-26T12:18:59.107077+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107077+0000","last_undegraded":"2024-07-26T12:18:59.107077+0000","last_fullsized":"2024-07-26T12:18:59.107077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481085+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:18:59.481085+0000","last_peered":"2024-07-26T12:18:59.481085+0000","last_clean":"2024-07-26T12:18:59.481085+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:18:59.481085+0000","last_undegraded":"2024-07-26T12:18:59.481085+0000","last_fullsized":"2024-07-26T12:18:59.481085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.093961+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:18:59.093961+0000","last_peered":"2024-07-26T12:18:59.093961+0000","last_clean":"2024-07-26T12:18:59.093961+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:18:59.093961+0000","last_undegraded":"2024-07-26T12:18:59.093961+0000","last_fullsized":"2024-07-26T12:18:59.093961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095107+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:18:59.095107+0000","last_peered":"2024-07-26T12:18:59.095107+0000","last_clean":"2024-07-26T12:18:59.095107+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:18:59.095107+0000","last_undegraded":"2024-07-26T12:18:59.095107+0000","last_fullsized":"2024-07-26T12:18:59.095107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095389+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:18:59.095389+0000","last_peered":"2024-07-26T12:18:59.095389+0000","last_clean":"2024-07-26T12:18:59.095389+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:18:59.095389+0000","last_undegraded":"2024-07-26T12:18:59.095389+0000","last_fullsized":"2024-07-26T12:18:59.095389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086212+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:18:59.086212+0000","last_peered":"2024-07-26T12:18:59.086212+0000","last_clean":"2024-07-26T12:18:59.086212+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:18:59.086212+0000","last_undegraded":"2024-07-26T12:18:59.086212+0000","last_fullsized":"2024-07-26T12:18:59.086212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095892+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:18:59.095892+0000","last_peered":"2024-07-26T12:18:59.095892+0000","last_clean":"2024-07-26T12:18:59.095892+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:18:59.095892+0000","last_undegraded":"2024-07-26T12:18:59.095892+0000","last_fullsized":"2024-07-26T12:18:59.095892+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097778+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:18:59.097778+0000","last_peered":"2024-07-26T12:18:59.097778+0000","last_clean":"2024-07-26T12:18:59.097778+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:18:59.097778+0000","last_undegraded":"2024-07-26T12:18:59.097778+0000","last_fullsized":"2024-07-26T12:18:59.097778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.120325+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:18:59.120325+0000","last_peered":"2024-07-26T12:18:59.120325+0000","last_clean":"2024-07-26T12:18:59.120325+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:18:59.120325+0000","last_undegraded":"2024-07-26T12:18:59.120325+0000","last_fullsized":"2024-07-26T12:18:59.120325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097570+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:18:59.097570+0000","last_peered":"2024-07-26T12:18:59.097570+0000","last_clean":"2024-07-26T12:18:59.097570+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:18:59.097570+0000","last_undegraded":"2024-07-26T12:18:59.097570+0000","last_fullsized":"2024-07-26T12:18:59.097570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118495+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:18:59.118495+0000","last_peered":"2024-07-26T12:18:59.118495+0000","last_clean":"2024-07-26T12:18:59.118495+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:18:59.118495+0000","last_undegraded":"2024-07-26T12:18:59.118495+0000","last_fullsized":"2024-07-26T12:18:59.118495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098071+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.098071+0000","last_peered":"2024-07-26T12:18:59.098071+0000","last_clean":"2024-07-26T12:18:59.098071+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.098071+0000","last_undegraded":"2024-07-26T12:18:59.098071+0000","last_fullsized":"2024-07-26T12:18:59.098071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094737+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:18:59.094737+0000","last_peered":"2024-07-26T12:18:59.094737+0000","last_clean":"2024-07-26T12:18:59.094737+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:18:59.094737+0000","last_undegraded":"2024-07-26T12:18:59.094737+0000","last_fullsized":"2024-07-26T12:18:59.094737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096568+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096568+0000","last_peered":"2024-07-26T12:18:59.096568+0000","last_clean":"2024-07-26T12:18:59.096568+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096568+0000","last_undegraded":"2024-07-26T12:18:59.096568+0000","last_fullsized":"2024-07-26T12:18:59.096568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481345+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:18:59.481345+0000","last_peered":"2024-07-26T12:18:59.481345+0000","last_clean":"2024-07-26T12:18:59.481345+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:18:59.481345+0000","last_undegraded":"2024-07-26T12:18:59.481345+0000","last_fullsized":"2024-07-26T12:18:59.481345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097521+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:18:59.097521+0000","last_peered":"2024-07-26T12:18:59.097521+0000","last_clean":"2024-07-26T12:18:59.097521+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:18:59.097521+0000","last_undegraded":"2024-07-26T12:18:59.097521+0000","last_fullsized":"2024-07-26T12:18:59.097521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097172+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:18:59.097172+0000","last_peered":"2024-07-26T12:18:59.097172+0000","last_clean":"2024-07-26T12:18:59.097172+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:18:59.097172+0000","last_undegraded":"2024-07-26T12:18:59.097172+0000","last_fullsized":"2024-07-26T12:18:59.097172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:21.180175+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:19:21.180175+0000","last_peered":"2024-07-26T12:19:21.180175+0000","last_clean":"2024-07-26T12:19:21.180175+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:19:21.180175+0000","last_undegraded":"2024-07-26T12:19:21.180175+0000","last_fullsized":"2024-07-26T12:19:21.180175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69885,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":328,"num_read_kb":235,"num_write":246,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645342,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":436343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841572,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1089772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201328,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1027825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":498251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":436842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":499303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":436657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:19:27.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:19:28.287 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:28.437 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:28 smithi040 ceph-mon[32397]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:19:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:28 smithi146 ceph-mon[35807]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:19:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:28 smithi076 ceph-mon[35401]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:19:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:29 smithi040 ceph-mon[32397]: pgmap v417: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-07-26T12:19:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:19:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:19:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:29 smithi146 ceph-mon[35807]: pgmap v417: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-07-26T12:19:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:19:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:19:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:29 smithi076 ceph-mon[35401]: pgmap v417: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-07-26T12:19:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:19:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:19:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:19:30.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.439+0000 7fa17f000640 1 -- 172.21.15.40:0/1456379028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178108d20 msgr2=0x7fa178109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:30.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.439+0000 7fa17f000640 1 --2- 172.21.15.40:0/1456379028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178108d20 0x7fa178109130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa164009900 tx=0x7fa16402a400 comp rx=0 tx=0).stop 2024-07-26T12:19:30.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 -- 172.21.15.40:0/1456379028 shutdown_connections 2024-07-26T12:19:30.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 --2- 172.21.15.40:0/1456379028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa178109670 0x7fa17810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 --2- 172.21.15.40:0/1456379028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178108d20 0x7fa178109130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 --2- 172.21.15.40:0/1456379028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1781033e0 0x7fa1781037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 -- 172.21.15.40:0/1456379028 >> 172.21.15.40:0/1456379028 conn(0x7fa1780fee70 msgr2=0x7fa1781012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:30.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 -- 172.21.15.40:0/1456379028 shutdown_connections 2024-07-26T12:19:30.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.440+0000 7fa17f000640 1 -- 172.21.15.40:0/1456379028 wait complete. 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.441+0000 7fa17f000640 1 Processor -- start 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 -- start start 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1781033e0 0x7fa178199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa178108d20 0x7fa17819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 0x7fa17819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1781131e0 con 0x7fa178109670 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa178113060 con 0x7fa1781033e0 2024-07-26T12:19:30.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.442+0000 7fa17f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa178113360 con 0x7fa178108d20 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 0x7fa17819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 0x7fa17819f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42918/0 (socket says 172.21.15.40:42918) 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 -- 172.21.15.40:0/384010183 learned_addr learned my addr 172.21.15.40:0/384010183 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17dc00640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1781033e0 0x7fa178199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17d200640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa178108d20 0x7fa17819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 -- 172.21.15.40:0/384010183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa178108d20 msgr2=0x7fa17819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa178108d20 0x7fa17819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 -- 172.21.15.40:0/384010183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1781033e0 msgr2=0x7fa178199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1781033e0 0x7fa178199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.443+0000 7fa17e600640 1 -- 172.21.15.40:0/384010183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17819fbe0 con 0x7fa178109670 2024-07-26T12:19:30.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.444+0000 7fa17e600640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 0x7fa17819f4b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa17000cad0 tx=0x7fa17000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:30.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.444+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17000ae20 con 0x7fa178109670 2024-07-26T12:19:30.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.444+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa170005020 con 0x7fa178109670 2024-07-26T12:19:30.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.444+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17819fed0 con 0x7fa178109670 2024-07-26T12:19:30.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.444+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17000f6b0 con 0x7fa178109670 2024-07-26T12:19:30.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.444+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1781a6630 con 0x7fa178109670 2024-07-26T12:19:30.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.445+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1781037f0 con 0x7fa178109670 2024-07-26T12:19:30.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.448+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa1700051d0 con 0x7fa178109670 2024-07-26T12:19:30.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.449+0000 7fa176000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa15c0b3c60 0x7fa15c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:30.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.450+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa1700e4210 con 0x7fa178109670 2024-07-26T12:19:30.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.450+0000 7fa17dc00640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa15c0b3c60 0x7fa15c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:30.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.451+0000 7fa17dc00640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa15c0b3c60 0x7fa15c0b6170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa1680058c0 tx=0x7fa16800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:30.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.451+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa170014030 con 0x7fa178109670 2024-07-26T12:19:30.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.651+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa178063230 con 0x7fa15c0b3c60 2024-07-26T12:19:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.665+0000 7fa176000640 1 -- 172.21.15.40:0/384010183 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258784 (secure 0 0 0) 0x7fa178063230 con 0x7fa15c0b3c60 2024-07-26T12:19:30.673 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.672+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa15c0b3c60 msgr2=0x7fa15c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.672+0000 7fa17f000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa15c0b3c60 0x7fa15c0b6170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa1680058c0 tx=0x7fa16800a4c0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.672+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 msgr2=0x7fa17819f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.672+0000 7fa17f000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 0x7fa17819f4b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa17000cad0 tx=0x7fa17000cf90 comp rx=0 tx=0).stop 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 shutdown_connections 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa178109670 0x7fa17819f4b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa15c0b3c60 0x7fa15c0b6170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa178108d20 0x7fa17819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 --2- 172.21.15.40:0/384010183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1781033e0 0x7fa178199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 >> 172.21.15.40:0/384010183 conn(0x7fa1780fee70 msgr2=0x7fa178101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 shutdown_connections 2024-07-26T12:19:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:30.673+0000 7fa17f000640 1 -- 172.21.15.40:0/384010183 wait complete. 2024-07-26T12:19:31.450 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:31 smithi040 ceph-mon[32397]: pgmap v418: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-07-26T12:19:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-07-26T12:19:29.877188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660487,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":454,"num_read_kb":324,"num_write":371,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386916,"kb_used_data":12792,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554908,"statfs":{"total":1151940427776,"available":1151544225792,"internally_reserved":0,"allocated":13099008,"data_stored":7195209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17561,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":10,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.087494+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:18:59.087494+0000","last_peered":"2024-07-26T12:18:59.087494+0000","last_clean":"2024-07-26T12:18:59.087494+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:18:59.087494+0000","last_undegraded":"2024-07-26T12:18:59.087494+0000","last_fullsized":"2024-07-26T12:18:59.087494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481111+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:18:59.481111+0000","last_peered":"2024-07-26T12:18:59.481111+0000","last_clean":"2024-07-26T12:18:59.481111+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:18:59.481111+0000","last_undegraded":"2024-07-26T12:18:59.481111+0000","last_fullsized":"2024-07-26T12:18:59.481111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.480344+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:18:59.480344+0000","last_peered":"2024-07-26T12:18:59.480344+0000","last_clean":"2024-07-26T12:18:59.480344+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:18:59.480344+0000","last_undegraded":"2024-07-26T12:18:59.480344+0000","last_fullsized":"2024-07-26T12:18:59.480344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.106366+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:18:59.106366+0000","last_peered":"2024-07-26T12:18:59.106366+0000","last_clean":"2024-07-26T12:18:59.106366+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:18:59.106366+0000","last_undegraded":"2024-07-26T12:18:59.106366+0000","last_fullsized":"2024-07-26T12:18:59.106366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094684+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:18:59.094684+0000","last_peered":"2024-07-26T12:18:59.094684+0000","last_clean":"2024-07-26T12:18:59.094684+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:18:59.094684+0000","last_undegraded":"2024-07-26T12:18:59.094684+0000","last_fullsized":"2024-07-26T12:18:59.094684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.087668+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:18:59.087668+0000","last_peered":"2024-07-26T12:18:59.087668+0000","last_clean":"2024-07-26T12:18:59.087668+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:18:59.087668+0000","last_undegraded":"2024-07-26T12:18:59.087668+0000","last_fullsized":"2024-07-26T12:18:59.087668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097040+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:18:59.097040+0000","last_peered":"2024-07-26T12:18:59.097040+0000","last_clean":"2024-07-26T12:18:59.097040+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:18:59.097040+0000","last_undegraded":"2024-07-26T12:18:59.097040+0000","last_fullsized":"2024-07-26T12:18:59.097040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094019+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:18:59.094019+0000","last_peered":"2024-07-26T12:18:59.094019+0000","last_clean":"2024-07-26T12:18:59.094019+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:18:59.094019+0000","last_undegraded":"2024-07-26T12:18:59.094019+0000","last_fullsized":"2024-07-26T12:18:59.094019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.111298+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:18:59.111298+0000","last_peered":"2024-07-26T12:18:59.111298+0000","last_clean":"2024-07-26T12:18:59.111298+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:18:59.111298+0000","last_undegraded":"2024-07-26T12:18:59.111298+0000","last_fullsized":"2024-07-26T12:18:59.111298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088720+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:18:59.088720+0000","last_peered":"2024-07-26T12:18:59.088720+0000","last_clean":"2024-07-26T12:18:59.088720+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:18:59.088720+0000","last_undegraded":"2024-07-26T12:18:59.088720+0000","last_fullsized":"2024-07-26T12:18:59.088720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097656+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:18:59.097656+0000","last_peered":"2024-07-26T12:18:59.097656+0000","last_clean":"2024-07-26T12:18:59.097656+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:18:59.097656+0000","last_undegraded":"2024-07-26T12:18:59.097656+0000","last_fullsized":"2024-07-26T12:18:59.097656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.105194+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:18:59.105194+0000","last_peered":"2024-07-26T12:18:59.105194+0000","last_clean":"2024-07-26T12:18:59.105194+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:18:59.105194+0000","last_undegraded":"2024-07-26T12:18:59.105194+0000","last_fullsized":"2024-07-26T12:18:59.105194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085094+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:18:59.085094+0000","last_peered":"2024-07-26T12:18:59.085094+0000","last_clean":"2024-07-26T12:18:59.085094+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:18:59.085094+0000","last_undegraded":"2024-07-26T12:18:59.085094+0000","last_fullsized":"2024-07-26T12:18:59.085094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.480531+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:18:59.480531+0000","last_peered":"2024-07-26T12:18:59.480531+0000","last_clean":"2024-07-26T12:18:59.480531+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:18:59.480531+0000","last_undegraded":"2024-07-26T12:18:59.480531+0000","last_fullsized":"2024-07-26T12:18:59.480531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.480056+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:18:59.480056+0000","last_peered":"2024-07-26T12:18:59.480056+0000","last_clean":"2024-07-26T12:18:59.480056+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:18:59.480056+0000","last_undegraded":"2024-07-26T12:18:59.480056+0000","last_fullsized":"2024-07-26T12:18:59.480056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.093698+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:18:59.093698+0000","last_peered":"2024-07-26T12:18:59.093698+0000","last_clean":"2024-07-26T12:18:59.093698+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:18:59.093698+0000","last_undegraded":"2024-07-26T12:18:59.093698+0000","last_fullsized":"2024-07-26T12:18:59.093698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.087727+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:18:59.087727+0000","last_peered":"2024-07-26T12:18:59.087727+0000","last_clean":"2024-07-26T12:18:59.087727+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:18:59.087727+0000","last_undegraded":"2024-07-26T12:18:59.087727+0000","last_fullsized":"2024-07-26T12:18:59.087727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092188+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:18:59.092188+0000","last_peered":"2024-07-26T12:18:59.092188+0000","last_clean":"2024-07-26T12:18:59.092188+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:18:59.092188+0000","last_undegraded":"2024-07-26T12:18:59.092188+0000","last_fullsized":"2024-07-26T12:18:59.092188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092957+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:18:59.092957+0000","last_peered":"2024-07-26T12:18:59.092957+0000","last_clean":"2024-07-26T12:18:59.092957+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:18:59.092957+0000","last_undegraded":"2024-07-26T12:18:59.092957+0000","last_fullsized":"2024-07-26T12:18:59.092957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086106+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:18:59.086106+0000","last_peered":"2024-07-26T12:18:59.086106+0000","last_clean":"2024-07-26T12:18:59.086106+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:18:59.086106+0000","last_undegraded":"2024-07-26T12:18:59.086106+0000","last_fullsized":"2024-07-26T12:18:59.086106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085239+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:18:59.085239+0000","last_peered":"2024-07-26T12:18:59.085239+0000","last_clean":"2024-07-26T12:18:59.085239+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:18:59.085239+0000","last_undegraded":"2024-07-26T12:18:59.085239+0000","last_fullsized":"2024-07-26T12:18:59.085239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094742+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:18:59.094742+0000","last_peered":"2024-07-26T12:18:59.094742+0000","last_clean":"2024-07-26T12:18:59.094742+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:18:59.094742+0000","last_undegraded":"2024-07-26T12:18:59.094742+0000","last_fullsized":"2024-07-26T12:18:59.094742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.103842+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:18:59.103842+0000","last_peered":"2024-07-26T12:18:59.103842+0000","last_clean":"2024-07-26T12:18:59.103842+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:18:59.103842+0000","last_undegraded":"2024-07-26T12:18:59.103842+0000","last_fullsized":"2024-07-26T12:18:59.103842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117879+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:18:59.117879+0000","last_peered":"2024-07-26T12:18:59.117879+0000","last_clean":"2024-07-26T12:18:59.117879+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:18:59.117879+0000","last_undegraded":"2024-07-26T12:18:59.117879+0000","last_fullsized":"2024-07-26T12:18:59.117879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096694+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:18:59.096694+0000","last_peered":"2024-07-26T12:18:59.096694+0000","last_clean":"2024-07-26T12:18:59.096694+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:18:59.096694+0000","last_undegraded":"2024-07-26T12:18:59.096694+0000","last_fullsized":"2024-07-26T12:18:59.096694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095334+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:18:59.095334+0000","last_peered":"2024-07-26T12:18:59.095334+0000","last_clean":"2024-07-26T12:18:59.095334+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:18:59.095334+0000","last_undegraded":"2024-07-26T12:18:59.095334+0000","last_fullsized":"2024-07-26T12:18:59.095334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086767+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:18:59.086767+0000","last_peered":"2024-07-26T12:18:59.086767+0000","last_clean":"2024-07-26T12:18:59.086767+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:18:59.086767+0000","last_undegraded":"2024-07-26T12:18:59.086767+0000","last_fullsized":"2024-07-26T12:18:59.086767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085329+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:18:59.085329+0000","last_peered":"2024-07-26T12:18:59.085329+0000","last_clean":"2024-07-26T12:18:59.085329+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:18:59.085329+0000","last_undegraded":"2024-07-26T12:18:59.085329+0000","last_fullsized":"2024-07-26T12:18:59.085329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481575+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:18:59.481575+0000","last_peered":"2024-07-26T12:18:59.481575+0000","last_clean":"2024-07-26T12:18:59.481575+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:18:59.481575+0000","last_undegraded":"2024-07-26T12:18:59.481575+0000","last_fullsized":"2024-07-26T12:18:59.481575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092359+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:18:59.092359+0000","last_peered":"2024-07-26T12:18:59.092359+0000","last_clean":"2024-07-26T12:18:59.092359+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:18:59.092359+0000","last_undegraded":"2024-07-26T12:18:59.092359+0000","last_fullsized":"2024-07-26T12:18:59.092359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098024+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:18:59.098024+0000","last_peered":"2024-07-26T12:18:59.098024+0000","last_clean":"2024-07-26T12:18:59.098024+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:18:59.098024+0000","last_undegraded":"2024-07-26T12:18:59.098024+0000","last_fullsized":"2024-07-26T12:18:59.098024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085960+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:18:59.085960+0000","last_peered":"2024-07-26T12:18:59.085960+0000","last_clean":"2024-07-26T12:18:59.085960+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:18:59.085960+0000","last_undegraded":"2024-07-26T12:18:59.085960+0000","last_fullsized":"2024-07-26T12:18:59.085960+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095779+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:18:59.095779+0000","last_peered":"2024-07-26T12:18:59.095779+0000","last_clean":"2024-07-26T12:18:59.095779+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:18:59.095779+0000","last_undegraded":"2024-07-26T12:18:59.095779+0000","last_fullsized":"2024-07-26T12:18:59.095779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:26.200955+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:19:26.200955+0000","last_peered":"2024-07-26T12:19:26.200955+0000","last_clean":"2024-07-26T12:19:26.200955+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:19:26.200955+0000","last_undegraded":"2024-07-26T12:19:26.200955+0000","last_fullsized":"2024-07-26T12:19:26.200955+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117887+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:18:59.117887+0000","last_peered":"2024-07-26T12:18:59.117887+0000","last_clean":"2024-07-26T12:18:59.117887+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:18:59.117887+0000","last_undegraded":"2024-07-26T12:18:59.117887+0000","last_fullsized":"2024-07-26T12:18:59.117887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088167+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088167+0000","last_peered":"2024-07-26T12:18:59.088167+0000","last_clean":"2024-07-26T12:18:59.088167+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088167+0000","last_undegraded":"2024-07-26T12:18:59.088167+0000","last_fullsized":"2024-07-26T12:18:59.088167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084501+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084501+0000","last_peered":"2024-07-26T12:18:59.084501+0000","last_clean":"2024-07-26T12:18:59.084501+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084501+0000","last_undegraded":"2024-07-26T12:18:59.084501+0000","last_fullsized":"2024-07-26T12:18:59.084501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094243+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:18:59.094243+0000","last_peered":"2024-07-26T12:18:59.094243+0000","last_clean":"2024-07-26T12:18:59.094243+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:18:59.094243+0000","last_undegraded":"2024-07-26T12:18:59.094243+0000","last_fullsized":"2024-07-26T12:18:59.094243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117807+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117807+0000","last_peered":"2024-07-26T12:18:59.117807+0000","last_clean":"2024-07-26T12:18:59.117807+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117807+0000","last_undegraded":"2024-07-26T12:18:59.117807+0000","last_fullsized":"2024-07-26T12:18:59.117807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.091924+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:18:59.091924+0000","last_peered":"2024-07-26T12:18:59.091924+0000","last_clean":"2024-07-26T12:18:59.091924+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:18:59.091924+0000","last_undegraded":"2024-07-26T12:18:59.091924+0000","last_fullsized":"2024-07-26T12:18:59.091924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:28.192986+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:19:28.192986+0000","last_peered":"2024-07-26T12:19:28.192986+0000","last_clean":"2024-07-26T12:19:28.192986+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:19:28.192986+0000","last_undegraded":"2024-07-26T12:19:28.192986+0000","last_fullsized":"2024-07-26T12:19:28.192986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095751+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:18:59.095751+0000","last_peered":"2024-07-26T12:18:59.095751+0000","last_clean":"2024-07-26T12:18:59.095751+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:18:59.095751+0000","last_undegraded":"2024-07-26T12:18:59.095751+0000","last_fullsized":"2024-07-26T12:18:59.095751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096778+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096778+0000","last_peered":"2024-07-26T12:18:59.096778+0000","last_clean":"2024-07-26T12:18:59.096778+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096778+0000","last_undegraded":"2024-07-26T12:18:59.096778+0000","last_fullsized":"2024-07-26T12:18:59.096778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481494+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:18:59.481494+0000","last_peered":"2024-07-26T12:18:59.481494+0000","last_clean":"2024-07-26T12:18:59.481494+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:18:59.481494+0000","last_undegraded":"2024-07-26T12:18:59.481494+0000","last_fullsized":"2024-07-26T12:18:59.481494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118510+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118510+0000","last_peered":"2024-07-26T12:18:59.118510+0000","last_clean":"2024-07-26T12:18:59.118510+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118510+0000","last_undegraded":"2024-07-26T12:18:59.118510+0000","last_fullsized":"2024-07-26T12:18:59.118510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107470+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:18:59.107470+0000","last_peered":"2024-07-26T12:18:59.107470+0000","last_clean":"2024-07-26T12:18:59.107470+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:18:59.107470+0000","last_undegraded":"2024-07-26T12:18:59.107470+0000","last_fullsized":"2024-07-26T12:18:59.107470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":160,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:28.221954+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:19:28.221954+0000","last_peered":"2024-07-26T12:19:28.221954+0000","last_clean":"2024-07-26T12:19:28.221954+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:19:28.221954+0000","last_undegraded":"2024-07-26T12:19:28.221954+0000","last_fullsized":"2024-07-26T12:19:28.221954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":93,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096454+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:18:59.096454+0000","last_peered":"2024-07-26T12:18:59.096454+0000","last_clean":"2024-07-26T12:18:59.096454+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:18:59.096454+0000","last_undegraded":"2024-07-26T12:18:59.096454+0000","last_fullsized":"2024-07-26T12:18:59.096454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.093898+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.093898+0000","last_peered":"2024-07-26T12:18:59.093898+0000","last_clean":"2024-07-26T12:18:59.093898+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.093898+0000","last_undegraded":"2024-07-26T12:18:59.093898+0000","last_fullsized":"2024-07-26T12:18:59.093898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084754+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:18:59.084754+0000","last_peered":"2024-07-26T12:18:59.084754+0000","last_clean":"2024-07-26T12:18:59.084754+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:18:59.084754+0000","last_undegraded":"2024-07-26T12:18:59.084754+0000","last_fullsized":"2024-07-26T12:18:59.084754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117223+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117223+0000","last_peered":"2024-07-26T12:18:59.117223+0000","last_clean":"2024-07-26T12:18:59.117223+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117223+0000","last_undegraded":"2024-07-26T12:18:59.117223+0000","last_fullsized":"2024-07-26T12:18:59.117223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096173+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:18:59.096173+0000","last_peered":"2024-07-26T12:18:59.096173+0000","last_clean":"2024-07-26T12:18:59.096173+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:18:59.096173+0000","last_undegraded":"2024-07-26T12:18:59.096173+0000","last_fullsized":"2024-07-26T12:18:59.096173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:27.190121+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:19:27.190121+0000","last_peered":"2024-07-26T12:19:27.190121+0000","last_clean":"2024-07-26T12:19:27.190121+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:19:27.190121+0000","last_undegraded":"2024-07-26T12:19:27.190121+0000","last_fullsized":"2024-07-26T12:19:27.190121+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095741+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:18:59.095741+0000","last_peered":"2024-07-26T12:18:59.095741+0000","last_clean":"2024-07-26T12:18:59.095741+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:18:59.095741+0000","last_undegraded":"2024-07-26T12:18:59.095741+0000","last_fullsized":"2024-07-26T12:18:59.095741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094550+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.094550+0000","last_peered":"2024-07-26T12:18:59.094550+0000","last_clean":"2024-07-26T12:18:59.094550+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.094550+0000","last_undegraded":"2024-07-26T12:18:59.094550+0000","last_fullsized":"2024-07-26T12:18:59.094550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.116989+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:18:59.116989+0000","last_peered":"2024-07-26T12:18:59.116989+0000","last_clean":"2024-07-26T12:18:59.116989+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:18:59.116989+0000","last_undegraded":"2024-07-26T12:18:59.116989+0000","last_fullsized":"2024-07-26T12:18:59.116989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.104270+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:18:59.104270+0000","last_peered":"2024-07-26T12:18:59.104270+0000","last_clean":"2024-07-26T12:18:59.104270+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:18:59.104270+0000","last_undegraded":"2024-07-26T12:18:59.104270+0000","last_fullsized":"2024-07-26T12:18:59.104270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086907+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:18:59.086907+0000","last_peered":"2024-07-26T12:18:59.086907+0000","last_clean":"2024-07-26T12:18:59.086907+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:18:59.086907+0000","last_undegraded":"2024-07-26T12:18:59.086907+0000","last_fullsized":"2024-07-26T12:18:59.086907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.120063+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.120063+0000","last_peered":"2024-07-26T12:18:59.120063+0000","last_clean":"2024-07-26T12:18:59.120063+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.120063+0000","last_undegraded":"2024-07-26T12:18:59.120063+0000","last_fullsized":"2024-07-26T12:18:59.120063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097500+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:18:59.097500+0000","last_peered":"2024-07-26T12:18:59.097500+0000","last_clean":"2024-07-26T12:18:59.097500+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:18:59.097500+0000","last_undegraded":"2024-07-26T12:18:59.097500+0000","last_fullsized":"2024-07-26T12:18:59.097500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118750+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118750+0000","last_peered":"2024-07-26T12:18:59.118750+0000","last_clean":"2024-07-26T12:18:59.118750+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118750+0000","last_undegraded":"2024-07-26T12:18:59.118750+0000","last_fullsized":"2024-07-26T12:18:59.118750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098858+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:18:59.098858+0000","last_peered":"2024-07-26T12:18:59.098858+0000","last_clean":"2024-07-26T12:18:59.098858+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:18:59.098858+0000","last_undegraded":"2024-07-26T12:18:59.098858+0000","last_fullsized":"2024-07-26T12:18:59.098858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:27.191542+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:19:27.191542+0000","last_peered":"2024-07-26T12:19:27.191542+0000","last_clean":"2024-07-26T12:19:27.191542+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:19:27.191542+0000","last_undegraded":"2024-07-26T12:19:27.191542+0000","last_fullsized":"2024-07-26T12:19:27.191542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097953+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:18:59.097953+0000","last_peered":"2024-07-26T12:18:59.097953+0000","last_clean":"2024-07-26T12:18:59.097953+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:18:59.097953+0000","last_undegraded":"2024-07-26T12:18:59.097953+0000","last_fullsized":"2024-07-26T12:18:59.097953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096638+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.096638+0000","last_peered":"2024-07-26T12:18:59.096638+0000","last_clean":"2024-07-26T12:18:59.096638+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.096638+0000","last_undegraded":"2024-07-26T12:18:59.096638+0000","last_fullsized":"2024-07-26T12:18:59.096638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.106043+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:18:59.106043+0000","last_peered":"2024-07-26T12:18:59.106043+0000","last_clean":"2024-07-26T12:18:59.106043+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:18:59.106043+0000","last_undegraded":"2024-07-26T12:18:59.106043+0000","last_fullsized":"2024-07-26T12:18:59.106043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096323+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:18:59.096323+0000","last_peered":"2024-07-26T12:18:59.096323+0000","last_clean":"2024-07-26T12:18:59.096323+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:18:59.096323+0000","last_undegraded":"2024-07-26T12:18:59.096323+0000","last_fullsized":"2024-07-26T12:18:59.096323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096274+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:18:59.096274+0000","last_peered":"2024-07-26T12:18:59.096274+0000","last_clean":"2024-07-26T12:18:59.096274+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:18:59.096274+0000","last_undegraded":"2024-07-26T12:18:59.096274+0000","last_fullsized":"2024-07-26T12:18:59.096274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084446+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:18:59.084446+0000","last_peered":"2024-07-26T12:18:59.084446+0000","last_clean":"2024-07-26T12:18:59.084446+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:18:59.084446+0000","last_undegraded":"2024-07-26T12:18:59.084446+0000","last_fullsized":"2024-07-26T12:18:59.084446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:26.187110+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:19:26.187110+0000","last_peered":"2024-07-26T12:19:26.187110+0000","last_clean":"2024-07-26T12:19:26.187110+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:19:26.187110+0000","last_undegraded":"2024-07-26T12:19:26.187110+0000","last_fullsized":"2024-07-26T12:19:26.187110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.116977+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:18:59.116977+0000","last_peered":"2024-07-26T12:18:59.116977+0000","last_clean":"2024-07-26T12:18:59.116977+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:18:59.116977+0000","last_undegraded":"2024-07-26T12:18:59.116977+0000","last_fullsized":"2024-07-26T12:18:59.116977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":68,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:26.196457+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:19:26.196457+0000","last_peered":"2024-07-26T12:19:26.196457+0000","last_clean":"2024-07-26T12:19:26.196457+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:19:26.196457+0000","last_undegraded":"2024-07-26T12:19:26.196457+0000","last_fullsized":"2024-07-26T12:19:26.196457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.485022+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:18:59.485022+0000","last_peered":"2024-07-26T12:18:59.485022+0000","last_clean":"2024-07-26T12:18:59.485022+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:18:59.485022+0000","last_undegraded":"2024-07-26T12:18:59.485022+0000","last_fullsized":"2024-07-26T12:18:59.485022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092466+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:18:59.092466+0000","last_peered":"2024-07-26T12:18:59.092466+0000","last_clean":"2024-07-26T12:18:59.092466+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:18:59.092466+0000","last_undegraded":"2024-07-26T12:18:59.092466+0000","last_fullsized":"2024-07-26T12:18:59.092466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088062+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:18:59.088062+0000","last_peered":"2024-07-26T12:18:59.088062+0000","last_clean":"2024-07-26T12:18:59.088062+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:18:59.088062+0000","last_undegraded":"2024-07-26T12:18:59.088062+0000","last_fullsized":"2024-07-26T12:18:59.088062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096805+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:18:59.096805+0000","last_peered":"2024-07-26T12:18:59.096805+0000","last_clean":"2024-07-26T12:18:59.096805+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:18:59.096805+0000","last_undegraded":"2024-07-26T12:18:59.096805+0000","last_fullsized":"2024-07-26T12:18:59.096805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.085371+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:18:59.085371+0000","last_peered":"2024-07-26T12:18:59.085371+0000","last_clean":"2024-07-26T12:18:59.085371+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:18:59.085371+0000","last_undegraded":"2024-07-26T12:18:59.085371+0000","last_fullsized":"2024-07-26T12:18:59.085371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:17.600138+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:19:17.600138+0000","last_peered":"2024-07-26T12:19:17.600138+0000","last_clean":"2024-07-26T12:19:17.600138+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:19:17.600138+0000","last_undegraded":"2024-07-26T12:19:17.600138+0000","last_fullsized":"2024-07-26T12:19:17.600138+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096919+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:18:59.096919+0000","last_peered":"2024-07-26T12:18:59.096919+0000","last_clean":"2024-07-26T12:18:59.096919+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:18:59.096919+0000","last_undegraded":"2024-07-26T12:18:59.096919+0000","last_fullsized":"2024-07-26T12:18:59.096919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107077+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107077+0000","last_peered":"2024-07-26T12:18:59.107077+0000","last_clean":"2024-07-26T12:18:59.107077+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107077+0000","last_undegraded":"2024-07-26T12:18:59.107077+0000","last_fullsized":"2024-07-26T12:18:59.107077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481085+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:18:59.481085+0000","last_peered":"2024-07-26T12:18:59.481085+0000","last_clean":"2024-07-26T12:18:59.481085+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:18:59.481085+0000","last_undegraded":"2024-07-26T12:18:59.481085+0000","last_fullsized":"2024-07-26T12:18:59.481085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.093961+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:18:59.093961+0000","last_peered":"2024-07-26T12:18:59.093961+0000","last_clean":"2024-07-26T12:18:59.093961+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:18:59.093961+0000","last_undegraded":"2024-07-26T12:18:59.093961+0000","last_fullsized":"2024-07-26T12:18:59.093961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095107+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:18:59.095107+0000","last_peered":"2024-07-26T12:18:59.095107+0000","last_clean":"2024-07-26T12:18:59.095107+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:18:59.095107+0000","last_undegraded":"2024-07-26T12:18:59.095107+0000","last_fullsized":"2024-07-26T12:18:59.095107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095389+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:18:59.095389+0000","last_peered":"2024-07-26T12:18:59.095389+0000","last_clean":"2024-07-26T12:18:59.095389+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:18:59.095389+0000","last_undegraded":"2024-07-26T12:18:59.095389+0000","last_fullsized":"2024-07-26T12:18:59.095389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.086212+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:18:59.086212+0000","last_peered":"2024-07-26T12:18:59.086212+0000","last_clean":"2024-07-26T12:18:59.086212+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:18:59.086212+0000","last_undegraded":"2024-07-26T12:18:59.086212+0000","last_fullsized":"2024-07-26T12:18:59.086212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095892+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:18:59.095892+0000","last_peered":"2024-07-26T12:18:59.095892+0000","last_clean":"2024-07-26T12:18:59.095892+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:18:59.095892+0000","last_undegraded":"2024-07-26T12:18:59.095892+0000","last_fullsized":"2024-07-26T12:18:59.095892+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097778+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:18:59.097778+0000","last_peered":"2024-07-26T12:18:59.097778+0000","last_clean":"2024-07-26T12:18:59.097778+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:18:59.097778+0000","last_undegraded":"2024-07-26T12:18:59.097778+0000","last_fullsized":"2024-07-26T12:18:59.097778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.120325+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:18:59.120325+0000","last_peered":"2024-07-26T12:18:59.120325+0000","last_clean":"2024-07-26T12:18:59.120325+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:18:59.120325+0000","last_undegraded":"2024-07-26T12:18:59.120325+0000","last_fullsized":"2024-07-26T12:18:59.120325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097570+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:18:59.097570+0000","last_peered":"2024-07-26T12:18:59.097570+0000","last_clean":"2024-07-26T12:18:59.097570+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:18:59.097570+0000","last_undegraded":"2024-07-26T12:18:59.097570+0000","last_fullsized":"2024-07-26T12:18:59.097570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118495+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:18:59.118495+0000","last_peered":"2024-07-26T12:18:59.118495+0000","last_clean":"2024-07-26T12:18:59.118495+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:18:59.118495+0000","last_undegraded":"2024-07-26T12:18:59.118495+0000","last_fullsized":"2024-07-26T12:18:59.118495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098071+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.098071+0000","last_peered":"2024-07-26T12:18:59.098071+0000","last_clean":"2024-07-26T12:18:59.098071+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.098071+0000","last_undegraded":"2024-07-26T12:18:59.098071+0000","last_fullsized":"2024-07-26T12:18:59.098071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094737+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:18:59.094737+0000","last_peered":"2024-07-26T12:18:59.094737+0000","last_clean":"2024-07-26T12:18:59.094737+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:18:59.094737+0000","last_undegraded":"2024-07-26T12:18:59.094737+0000","last_fullsized":"2024-07-26T12:18:59.094737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096568+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096568+0000","last_peered":"2024-07-26T12:18:59.096568+0000","last_clean":"2024-07-26T12:18:59.096568+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096568+0000","last_undegraded":"2024-07-26T12:18:59.096568+0000","last_fullsized":"2024-07-26T12:18:59.096568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.481345+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:18:59.481345+0000","last_peered":"2024-07-26T12:18:59.481345+0000","last_clean":"2024-07-26T12:18:59.481345+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:18:59.481345+0000","last_undegraded":"2024-07-26T12:18:59.481345+0000","last_fullsized":"2024-07-26T12:18:59.481345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097521+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:18:59.097521+0000","last_peered":"2024-07-26T12:18:59.097521+0000","last_clean":"2024-07-26T12:18:59.097521+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:18:59.097521+0000","last_undegraded":"2024-07-26T12:18:59.097521+0000","last_fullsized":"2024-07-26T12:18:59.097521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097172+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:18:59.097172+0000","last_peered":"2024-07-26T12:18:59.097172+0000","last_clean":"2024-07-26T12:18:59.097172+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:18:59.097172+0000","last_undegraded":"2024-07-26T12:18:59.097172+0000","last_fullsized":"2024-07-26T12:18:59.097172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:26.195577+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:19:26.195577+0000","last_peered":"2024-07-26T12:19:26.195577+0000","last_clean":"2024-07-26T12:19:26.195577+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:19:26.195577+0000","last_undegraded":"2024-07-26T12:19:26.195577+0000","last_fullsized":"2024-07-26T12:19:26.195577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69885,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":378,"num_read_kb":260,"num_write":246,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645343,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":436343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1089772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397562,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1027825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986256,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":498251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":436842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":499303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":436657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:19:31.542 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-26T12:19:31.546 INFO:tasks.cephadm:Setting up client nodes... 2024-07-26T12:19:31.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-07-26T12:19:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:31 smithi146 ceph-mon[35807]: pgmap v418: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-07-26T12:19:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:31 smithi076 ceph-mon[35401]: pgmap v418: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-07-26T12:19:32.056 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:32.481 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:32 smithi040 ceph-mon[32397]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:19:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:32 smithi146 ceph-mon[35807]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:19:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:32 smithi076 ceph-mon[35401]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:19:33.365 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:33 smithi040 ceph-mon[32397]: pgmap v419: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-07-26T12:19:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:33 smithi146 ceph-mon[35807]: pgmap v419: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-07-26T12:19:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:33 smithi076 ceph-mon[35401]: pgmap v419: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-07-26T12:19:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.265+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3857604381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba41053b0 msgr2=0x7fbba4105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.265+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3857604381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba41053b0 0x7fbba4105820 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009900 tx=0x7fbb9402a480 comp rx=0 tx=0).stop 2024-07-26T12:19:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3857604381 shutdown_connections 2024-07-26T12:19:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3857604381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba4106de0 0x7fbba410d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3857604381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba4106440 0x7fbba4106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3857604381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba41053b0 0x7fbba4105820 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3857604381 >> 172.21.15.40:0/3857604381 conn(0x7fbba4100d40 msgr2=0x7fbba41031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3857604381 shutdown_connections 2024-07-26T12:19:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.266+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3857604381 wait complete. 2024-07-26T12:19:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.268+0000 7fbbaaa00640 1 Processor -- start 2024-07-26T12:19:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.268+0000 7fbbaaa00640 1 -- start start 2024-07-26T12:19:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.268+0000 7fbbaaa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba41053b0 0x7fbba419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.268+0000 7fbbaaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba4106440 0x7fbba419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbbaaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 0x7fbba419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbbaaa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbba4110ec0 con 0x7fbba4106de0 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbbaaa00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbba4110d40 con 0x7fbba41053b0 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbbaaa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbba4111040 con 0x7fbba4106440 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 0x7fbba419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 0x7fbba419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48576/0 (socket says 172.21.15.40:48576) 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba8a00640 1 -- 172.21.15.40:0/3592406825 learned_addr learned my addr 172.21.15.40:0/3592406825 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba3e00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba41053b0 0x7fbba419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba3400640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba4106440 0x7fbba419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba8a00640 1 -- 172.21.15.40:0/3592406825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba4106440 msgr2=0x7fbba419c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.269+0000 7fbba8a00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba4106440 0x7fbba419c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba8a00640 1 -- 172.21.15.40:0/3592406825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba41053b0 msgr2=0x7fbba419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba8a00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba41053b0 0x7fbba419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba8a00640 1 -- 172.21.15.40:0/3592406825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba419d500 con 0x7fbba4106de0 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba3e00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba41053b0 0x7fbba419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba8a00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 0x7fbba419cce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00eaa0 tx=0x7fbb9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00cdb0 con 0x7fbba4106de0 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb9c005020 con 0x7fbba4106de0 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba419d7f0 con 0x7fbba4106de0 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0116d0 con 0x7fbba4106de0 2024-07-26T12:19:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.270+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba41a3ef0 con 0x7fbba4106de0 2024-07-26T12:19:34.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.272+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba4105820 con 0x7fbba4106de0 2024-07-26T12:19:34.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.274+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fbb9c004a40 con 0x7fbba4106de0 2024-07-26T12:19:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.276+0000 7fbba0c00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbb880b3c60 0x7fbb880b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:34.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.276+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbb9c0e4070 con 0x7fbba4106de0 2024-07-26T12:19:34.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.276+0000 7fbba3e00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbb880b3c60 0x7fbb880b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:34.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.277+0000 7fbba3e00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbb880b3c60 0x7fbb880b6170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000c00 tx=0x7fbb94031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.278+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbb9c016030 con 0x7fbba4106de0 2024-07-26T12:19:34.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.554+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fbba402e470 con 0x7fbba4106de0 2024-07-26T12:19:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.562+0000 7fbba0c00640 1 -- 172.21.15.40:0/3592406825 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7fbba402e470 con 0x7fbba4106de0 2024-07-26T12:19:34.564 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-07-26T12:19:34.564 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBWlKNmwEAzIRAAJDaYj5KKqTVESWHXMDVgmw== 2024-07-26T12:19:34.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbb880b3c60 msgr2=0x7fbb880b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbb880b3c60 0x7fbb880b6170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000c00 tx=0x7fbb94031420 comp rx=0 tx=0).stop 2024-07-26T12:19:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 msgr2=0x7fbba419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 0x7fbba419cce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00eaa0 tx=0x7fbb9c00ef60 comp rx=0 tx=0).stop 2024-07-26T12:19:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 shutdown_connections 2024-07-26T12:19:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba4106de0 0x7fbba419cce0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbb880b3c60 0x7fbb880b6170 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba4106440 0x7fbba419c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 --2- 172.21.15.40:0/3592406825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbba41053b0 0x7fbba419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.565+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 >> 172.21.15.40:0/3592406825 conn(0x7fbba4100d40 msgr2=0x7fbba4109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.566+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 shutdown_connections 2024-07-26T12:19:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:34.566+0000 7fbbaaa00640 1 -- 172.21.15.40:0/3592406825 wait complete. 2024-07-26T12:19:35.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:35 smithi040 ceph-mon[32397]: pgmap v420: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-07-26T12:19:35.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:35 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3592406825' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-26T12:19:35.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:35 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3592406825' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-26T12:19:35.241 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:19:35.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-07-26T12:19:35.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-07-26T12:19:35.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph config log 1 --format=json 2024-07-26T12:19:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:35 smithi146 ceph-mon[35807]: pgmap v420: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-07-26T12:19:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:35 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3592406825' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-26T12:19:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:35 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3592406825' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-26T12:19:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:35 smithi076 ceph-mon[35401]: pgmap v420: 97 pgs: 97 active+clean; 645 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-07-26T12:19:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:35 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3592406825' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-07-26T12:19:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:35 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3592406825' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-07-26T12:19:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:37.357 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:37 smithi040 ceph-mon[32397]: pgmap v421: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:19:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:37 smithi146 ceph-mon[35807]: pgmap v421: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:19:37.594 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:37 smithi076 ceph-mon[35401]: pgmap v421: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:19:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 -- 172.21.15.40:0/398133884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 msgr2=0x7f2180075570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 --2- 172.21.15.40:0/398133884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f2180075570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2170009900 tx=0x7f217002a410 comp rx=0 tx=0).stop 2024-07-26T12:19:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 -- 172.21.15.40:0/398133884 shutdown_connections 2024-07-26T12:19:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 --2- 172.21.15.40:0/398133884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f218010fb70 0x7f2180111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 --2- 172.21.15.40:0/398133884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2180075ab0 0x7f218010f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 --2- 172.21.15.40:0/398133884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f2180075570 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:37.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 -- 172.21.15.40:0/398133884 >> 172.21.15.40:0/398133884 conn(0x7f218007b280 msgr2=0x7f218007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:37.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 -- 172.21.15.40:0/398133884 shutdown_connections 2024-07-26T12:19:37.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.920+0000 7f2184c00640 1 -- 172.21.15.40:0/398133884 wait complete. 2024-07-26T12:19:37.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 Processor -- start 2024-07-26T12:19:37.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 -- start start 2024-07-26T12:19:37.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f218019bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:37.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2180075ab0 0x7f218019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:37.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f218010fb70 0x7f21801a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:37.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2180115570 con 0x7f2180075160 2024-07-26T12:19:37.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f21801153f0 con 0x7f218010fb70 2024-07-26T12:19:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f2184c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f21801156f0 con 0x7f2180075ab0 2024-07-26T12:19:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f217de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f218019bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.922+0000 7f217de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f218019bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48592/0 (socket says 172.21.15.40:48592) 2024-07-26T12:19:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217de00640 1 -- 172.21.15.40:0/4168211358 learned_addr learned my addr 172.21.15.40:0/4168211358 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f2177e00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2180075ab0 0x7f218019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217e800640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f218010fb70 0x7f21801a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217de00640 1 -- 172.21.15.40:0/4168211358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2180075ab0 msgr2=0x7f218019c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217de00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2180075ab0 0x7f218019c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217de00640 1 -- 172.21.15.40:0/4168211358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f218010fb70 msgr2=0x7f21801a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217de00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f218010fb70 0x7f21801a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217de00640 1 -- 172.21.15.40:0/4168211358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21801a1f50 con 0x7f2180075160 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.923+0000 7f217e800640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f218010fb70 0x7f21801a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.924+0000 7f217de00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f218019bfe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2170009230 tx=0x7f2170004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.924+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217003f030 con 0x7f2180075160 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.924+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21801a21e0 con 0x7f2180075160 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.924+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2170003a80 con 0x7f2180075160 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.924+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170035070 con 0x7f2180075160 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.924+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21801a89a0 con 0x7f2180075160 2024-07-26T12:19:37.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.925+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2180075570 con 0x7f2180075160 2024-07-26T12:19:37.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.928+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f2170042030 con 0x7f2180075160 2024-07-26T12:19:37.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.930+0000 7f2176a00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21640b3c60 0x7f21640b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:37.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.931+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f21701049d0 con 0x7f2180075160 2024-07-26T12:19:37.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.931+0000 7f2177e00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21640b3c60 0x7f21640b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:37.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.932+0000 7f2177e00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21640b3c60 0x7f21640b6170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2168005fd0 tx=0x7f2168005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:37.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:37.933+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f21700cbe80 con 0x7f2180075160 2024-07-26T12:19:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.136+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f218010ad50 con 0x7f2180075160 2024-07-26T12:19:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.136+0000 7f2176a00640 1 -- 172.21.15.40:0/4168211358 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7f21700cb780 con 0x7f2180075160 2024-07-26T12:19:38.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.139+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21640b3c60 msgr2=0x7f21640b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.139+0000 7f2184c00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21640b3c60 0x7f21640b6170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2168005fd0 tx=0x7f2168005850 comp rx=0 tx=0).stop 2024-07-26T12:19:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 msgr2=0x7f218019bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f218019bfe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2170009230 tx=0x7f2170004270 comp rx=0 tx=0).stop 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 shutdown_connections 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f218010fb70 0x7f21801a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21640b3c60 0x7f21640b6170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2180075ab0 0x7f218019c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 --2- 172.21.15.40:0/4168211358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2180075160 0x7f218019bfe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 >> 172.21.15.40:0/4168211358 conn(0x7f218007b280 msgr2=0x7f2180100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.140+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 shutdown_connections 2024-07-26T12:19:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:38.141+0000 7f2184c00640 1 -- 172.21.15.40:0/4168211358 wait complete. 2024-07-26T12:19:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:38 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4168211358' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-26T12:19:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:38 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4168211358' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-26T12:19:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:38 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4168211358' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-07-26T12:19:38.945 INFO:teuthology.orchestra.run.smithi040.stdout:[{"version":50,"timestamp":"2024-07-26T12:18:11.424862+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-07-26T12:19:38.945 INFO:tasks.ceph_manager:config epoch is 50 2024-07-26T12:19:38.945 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-07-26T12:19:38.945 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-07-26T12:19:38.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph mgr dump --format=json 2024-07-26T12:19:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:39 smithi040 ceph-mon[32397]: pgmap v422: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-07-26T12:19:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:39 smithi146 ceph-mon[35807]: pgmap v422: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-07-26T12:19:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:39 smithi076 ceph-mon[35401]: pgmap v422: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-07-26T12:19:41.356 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:41 smithi040 ceph-mon[32397]: pgmap v423: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T12:19:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 -- 172.21.15.40:0/710236980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104080 msgr2=0x7f0434104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 --2- 172.21.15.40:0/710236980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104080 0x7f0434104490 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0424009900 tx=0x7f042402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 -- 172.21.15.40:0/710236980 shutdown_connections 2024-07-26T12:19:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 --2- 172.21.15.40:0/710236980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410d630 0x7f043410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 --2- 172.21.15.40:0/710236980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0434104ab0 0x7f043410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 --2- 172.21.15.40:0/710236980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104080 0x7f0434104490 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 -- 172.21.15.40:0/710236980 >> 172.21.15.40:0/710236980 conn(0x7f04340fdcf0 msgr2=0x7f0434100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 -- 172.21.15.40:0/710236980 shutdown_connections 2024-07-26T12:19:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.568+0000 7f0433200640 1 -- 172.21.15.40:0/710236980 wait complete. 2024-07-26T12:19:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:41 smithi146 ceph-mon[35807]: pgmap v423: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T12:19:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.569+0000 7f0433200640 1 Processor -- start 2024-07-26T12:19:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 -- start start 2024-07-26T12:19:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0434104080 0x7f0434101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 0x7f04341024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410d630 0x7f0434102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04341131c0 con 0x7f0434104ab0 2024-07-26T12:19:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0434113040 con 0x7f043410d630 2024-07-26T12:19:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.570+0000 7f0433200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0434113340 con 0x7f0434104080 2024-07-26T12:19:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.571+0000 7f0431400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 0x7f04341024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.571+0000 7f0431400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 0x7f04341024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48616/0 (socket says 172.21.15.40:48616) 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.571+0000 7f0431400640 1 -- 172.21.15.40:0/1136561871 learned_addr learned my addr 172.21.15.40:0/1136561871 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.571+0000 7f0432800640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410d630 0x7f0434102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0431400640 1 -- 172.21.15.40:0/1136561871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0434104080 msgr2=0x7f0434101f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0431400640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0434104080 0x7f0434101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0431400640 1 -- 172.21.15.40:0/1136561871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410d630 msgr2=0x7f0434102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0431400640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410d630 0x7f0434102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0431400640 1 -- 172.21.15.40:0/1136561871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04341a7f10 con 0x7f0434104ab0 2024-07-26T12:19:41.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0431400640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 0x7f04341024d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f042000d740 tx=0x7f042000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420017070 con 0x7f0434104ab0 2024-07-26T12:19:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f042000de50 con 0x7f0434104ab0 2024-07-26T12:19:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042000f620 con 0x7f0434104ab0 2024-07-26T12:19:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.572+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04341a8200 con 0x7f0434104ab0 2024-07-26T12:19:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.573+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04341a8740 con 0x7f0434104ab0 2024-07-26T12:19:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.574+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0434104490 con 0x7f0434104ab0 2024-07-26T12:19:41.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.578+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f042001a070 con 0x7f0434104ab0 2024-07-26T12:19:41.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.579+0000 7f042aa00640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f04180b3c60 0x7f04180b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:41.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.579+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f04200e37d0 con 0x7f0434104ab0 2024-07-26T12:19:41.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.580+0000 7f0431e00640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f04180b3c60 0x7f04180b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:41.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.580+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f04200aac80 con 0x7f0434104ab0 2024-07-26T12:19:41.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.580+0000 7f0431e00640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f04180b3c60 0x7f04180b6170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0424009230 tx=0x7f0424000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:41 smithi076 ceph-mon[35401]: pgmap v423: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T12:19:41.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.841+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f04341a8b50 con 0x7f0434104ab0 2024-07-26T12:19:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.856+0000 7f042aa00640 1 -- 172.21.15.40:0/1136561871 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+291017 (secure 0 0 0) 0x7f04200aa580 con 0x7f0434104ab0 2024-07-26T12:19:41.864 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f04180b3c60 msgr2=0x7f04180b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f04180b3c60 0x7f04180b6170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0424009230 tx=0x7f0424000bc0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 msgr2=0x7f04341024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 0x7f04341024d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f042000d740 tx=0x7f042000dc00 comp rx=0 tx=0).stop 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 shutdown_connections 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410d630 0x7f0434102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0434104ab0 0x7f04341024d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f04180b3c60 0x7f04180b6170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 --2- 172.21.15.40:0/1136561871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0434104080 0x7f0434101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:41.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 >> 172.21.15.40:0/1136561871 conn(0x7f04340fdcf0 msgr2=0x7f0434107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:41.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.864+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 shutdown_connections 2024-07-26T12:19:41.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:41.865+0000 7f0433200640 1 -- 172.21.15.40:0/1136561871 wait complete. 2024-07-26T12:19:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:42 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1136561871' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-26T12:19:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:42 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1136561871' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-26T12:19:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:42 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1136561871' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-07-26T12:19:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":4031368209},{"type":"v1","addr":"172.21.15.40:6801","nonce":4031368209}]},"active_addr":"172.21.15.40:6801/4031368209","active_change":"2024-07-26T12:07:57.642829+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.40:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":633036960}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":91641818}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2157419407}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3921483967}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":4083272799}]}]} 2024-07-26T12:19:42.602 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-07-26T12:19:42.602 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-07-26T12:19:42.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:19:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:43 smithi040 ceph-mon[32397]: pgmap v424: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-07-26T12:19:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:43 smithi146 ceph-mon[35807]: pgmap v424: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-07-26T12:19:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:43 smithi076 ceph-mon[35401]: pgmap v424: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 -- 172.21.15.40:0/1539137017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c10af10 msgr2=0x7fc99c10b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 --2- 172.21.15.40:0/1539137017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c10af10 0x7fc99c10b320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc984009900 tx=0x7fc98402a410 comp rx=0 tx=0).stop 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 -- 172.21.15.40:0/1539137017 shutdown_connections 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 --2- 172.21.15.40:0/1539137017 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc99c10b860 0x7fc99c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 --2- 172.21.15.40:0/1539137017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c10af10 0x7fc99c10b320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 --2- 172.21.15.40:0/1539137017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c1055d0 0x7fc99c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.165+0000 7fc99be00640 1 -- 172.21.15.40:0/1539137017 >> 172.21.15.40:0/1539137017 conn(0x7fc99c101040 msgr2=0x7fc99c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.166+0000 7fc99be00640 1 -- 172.21.15.40:0/1539137017 shutdown_connections 2024-07-26T12:19:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.166+0000 7fc99be00640 1 -- 172.21.15.40:0/1539137017 wait complete. 2024-07-26T12:19:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.167+0000 7fc99be00640 1 Processor -- start 2024-07-26T12:19:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.167+0000 7fc99be00640 1 -- start start 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.167+0000 7fc99be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 0x7fc99c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc99c10af10 0x7fc99c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c10b860 0x7fc99c1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1153a0 con 0x7fc99c1055d0 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c115220 con 0x7fc99c10af10 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c115520 con 0x7fc99c10b860 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 0x7fc99c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 0x7fc99c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37120/0 (socket says 172.21.15.40:37120) 2024-07-26T12:19:45.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 -- 172.21.15.40:0/2113137467 learned_addr learned my addr 172.21.15.40:0/2113137467 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc992000640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc99c10af10 0x7fc99c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99b400640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c10b860 0x7fc99c1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 -- 172.21.15.40:0/2113137467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c10b860 msgr2=0x7fc99c1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c10b860 0x7fc99c1a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 -- 172.21.15.40:0/2113137467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc99c10af10 msgr2=0x7fc99c19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc99c10af10 0x7fc99c19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99aa00640 1 -- 172.21.15.40:0/2113137467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c1a1e00 con 0x7fc99c1055d0 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.168+0000 7fc99b400640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c10b860 0x7fc99c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.169+0000 7fc99aa00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 0x7fc99c19be90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00d770 tx=0x7fc98c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.169+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c017070 con 0x7fc99c1055d0 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.169+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc98c0054b0 con 0x7fc99c1055d0 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.169+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c1a20f0 con 0x7fc99c1055d0 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.169+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c004c60 con 0x7fc99c1055d0 2024-07-26T12:19:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.169+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1a8850 con 0x7fc99c1055d0 2024-07-26T12:19:45.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.170+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c1059e0 con 0x7fc99c1055d0 2024-07-26T12:19:45.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.173+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc98c004e00 con 0x7fc99c1055d0 2024-07-26T12:19:45.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.175+0000 7fc993e00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9800b3c60 0x7fc9800b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:45.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.176+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc98c0e3c90 con 0x7fc99c1055d0 2024-07-26T12:19:45.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.176+0000 7fc992000640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9800b3c60 0x7fc9800b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:45.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.176+0000 7fc992000640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9800b3c60 0x7fc9800b6170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9840057c0 tx=0x7fc984000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:45.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.177+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc98c0ab140 con 0x7fc99c1055d0 2024-07-26T12:19:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:45 smithi040 ceph-mon[32397]: pgmap v425: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:19:45.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.384+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc99c10d080 con 0x7fc99c1055d0 2024-07-26T12:19:45.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.389+0000 7fc993e00640 1 -- 172.21.15.40:0/2113137467 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7fc98c0aaa40 con 0x7fc99c1055d0 2024-07-26T12:19:45.390 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:45.390 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:59.075766+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:19:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9800b3c60 msgr2=0x7fc9800b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9800b3c60 0x7fc9800b6170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9840057c0 tx=0x7fc984000bc0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 msgr2=0x7fc99c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 0x7fc99c19be90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00d770 tx=0x7fc98c00dc30 comp rx=0 tx=0).stop 2024-07-26T12:19:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 shutdown_connections 2024-07-26T12:19:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9800b3c60 0x7fc9800b6170 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc99c10b860 0x7fc99c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc99c10af10 0x7fc99c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 --2- 172.21.15.40:0/2113137467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99c1055d0 0x7fc99c19be90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:45.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 >> 172.21.15.40:0/2113137467 conn(0x7fc99c101040 msgr2=0x7fc99c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:45.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 shutdown_connections 2024-07-26T12:19:45.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:45.391+0000 7fc99be00640 1 -- 172.21.15.40:0/2113137467 wait complete. 2024-07-26T12:19:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:45 smithi146 ceph-mon[35807]: pgmap v425: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:19:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:45 smithi076 ceph-mon[35401]: pgmap v425: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:19:46.182 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-07-26T12:19:46.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:19:46.356 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:46 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2113137467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:46 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2113137467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:46 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2113137467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:47 smithi040 ceph-mon[32397]: pgmap v426: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:19:47.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:47 smithi076 ceph-mon[35401]: pgmap v426: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:19:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:47 smithi146 ceph-mon[35807]: pgmap v426: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:19:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.708+0000 7ff026400640 1 -- 172.21.15.40:0/1769249970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020076db0 msgr2=0x7ff0200751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.708+0000 7ff026400640 1 --2- 172.21.15.40:0/1769249970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020076db0 0x7ff0200751e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff010009900 tx=0x7ff01002a410 comp rx=0 tx=0).stop 2024-07-26T12:19:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 -- 172.21.15.40:0/1769249970 shutdown_connections 2024-07-26T12:19:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 --2- 172.21.15.40:0/1769249970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff020113cb0 0x7ff020116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 --2- 172.21.15.40:0/1769249970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff020075800 0x7ff020075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 --2- 172.21.15.40:0/1769249970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020076db0 0x7ff0200751e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 -- 172.21.15.40:0/1769249970 >> 172.21.15.40:0/1769249970 conn(0x7ff0200fee30 msgr2=0x7ff020101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:48.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 -- 172.21.15.40:0/1769249970 shutdown_connections 2024-07-26T12:19:48.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.709+0000 7ff026400640 1 -- 172.21.15.40:0/1769249970 wait complete. 2024-07-26T12:19:48.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.710+0000 7ff026400640 1 Processor -- start 2024-07-26T12:19:48.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.710+0000 7ff026400640 1 -- start start 2024-07-26T12:19:48.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.710+0000 7ff026400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff020075800 0x7ff0201a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:48.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.710+0000 7ff026400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff020076db0 0x7ff0201a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:48.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff026400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 0x7ff0201a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:48.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff026400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201197f0 con 0x7ff020113cb0 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff026400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff020119670 con 0x7ff020075800 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff026400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff020119970 con 0x7ff020076db0 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff025a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 0x7ff0201a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff025a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 0x7ff0201a5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37148/0 (socket says 172.21.15.40:37148) 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff025a00640 1 -- 172.21.15.40:0/148927244 learned_addr learned my addr 172.21.15.40:0/148927244 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff025000640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff020075800 0x7ff0201a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.711+0000 7ff017e00640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff020076db0 0x7ff0201a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff025a00640 1 -- 172.21.15.40:0/148927244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff020076db0 msgr2=0x7ff0201a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff025a00640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff020076db0 0x7ff0201a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff025a00640 1 -- 172.21.15.40:0/148927244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff020075800 msgr2=0x7ff0201a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff025a00640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff020075800 0x7ff0201a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff025a00640 1 -- 172.21.15.40:0/148927244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0201a6190 con 0x7ff020113cb0 2024-07-26T12:19:48.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff025a00640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 0x7ff0201a5a60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff01800eaa0 tx=0x7ff01800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:48.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01800cdb0 con 0x7ff020113cb0 2024-07-26T12:19:48.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff018005020 con 0x7ff020113cb0 2024-07-26T12:19:48.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0180116d0 con 0x7ff020113cb0 2024-07-26T12:19:48.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.712+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0201a6480 con 0x7ff020113cb0 2024-07-26T12:19:48.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.713+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0201acbe0 con 0x7ff020113cb0 2024-07-26T12:19:48.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.714+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff020075c10 con 0x7ff020113cb0 2024-07-26T12:19:48.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.716+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff0180051d0 con 0x7ff020113cb0 2024-07-26T12:19:48.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.718+0000 7ff01e000640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0040b3c60 0x7ff0040b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:19:48.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.718+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff0180e4200 con 0x7ff020113cb0 2024-07-26T12:19:48.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.718+0000 7ff025000640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0040b3c60 0x7ff0040b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:19:48.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.719+0000 7ff025000640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0040b3c60 0x7ff0040b6170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff010006010 tx=0x7ff010000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:19:48.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.720+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff018016030 con 0x7ff020113cb0 2024-07-26T12:19:48.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.927+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0201a1350 con 0x7ff020113cb0 2024-07-26T12:19:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.933+0000 7ff01e000640 1 -- 172.21.15.40:0/148927244 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7ff0180ab060 con 0x7ff020113cb0 2024-07-26T12:19:48.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:19:48.935 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:59.075766+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:19:48.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.935+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0040b3c60 msgr2=0x7ff0040b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.935+0000 7ff026400640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0040b3c60 0x7ff0040b6170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff010006010 tx=0x7ff010000bc0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.935+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 msgr2=0x7ff0201a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.935+0000 7ff026400640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 0x7ff0201a5a60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff01800eaa0 tx=0x7ff01800ef60 comp rx=0 tx=0).stop 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 shutdown_connections 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff020113cb0 0x7ff0201a5a60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0040b3c60 0x7ff0040b6170 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff020076db0 0x7ff0201a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 --2- 172.21.15.40:0/148927244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff020075800 0x7ff0201a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:19:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 >> 172.21.15.40:0/148927244 conn(0x7ff0200fee30 msgr2=0x7ff02010fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:19:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 shutdown_connections 2024-07-26T12:19:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:19:48.936+0000 7ff026400640 1 -- 172.21.15.40:0/148927244 wait complete. 2024-07-26T12:19:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:49 smithi040 ceph-mon[32397]: pgmap v427: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:19:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:49 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/148927244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:49 smithi146 ceph-mon[35807]: pgmap v427: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:19:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:49 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/148927244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:49 smithi076 ceph-mon[35401]: pgmap v427: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:19:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:49 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/148927244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:19:49.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-07-26T12:19:49.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-07-26T12:19:49.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-07-26T12:19:49.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-07-26T12:19:49.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-07-26T12:19:49.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-07-26T12:19:49.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-07-26T12:19:49.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-07-26T12:19:49.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-07-26T12:19:49.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-07-26T12:19:49.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-07-26T12:19:49.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-07-26T12:19:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.059 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.066 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.069 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.071 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.075 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.157 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.218 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:19:51.218 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:51 smithi040 ceph-mon[32397]: pgmap v428: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:19:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:51 smithi146 ceph-mon[35807]: pgmap v428: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:19:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:51 smithi076 ceph-mon[35401]: pgmap v428: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:19:53.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:53 smithi040 ceph-mon[32397]: pgmap v429: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:19:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:53 smithi146 ceph-mon[35807]: pgmap v429: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:19:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:53 smithi076 ceph-mon[35401]: pgmap v429: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:19:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:55 smithi040 ceph-mon[32397]: pgmap v430: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:19:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:55 smithi146 ceph-mon[35807]: pgmap v430: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:19:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:55 smithi076 ceph-mon[35401]: pgmap v430: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:19:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:57 smithi040 ceph-mon[32397]: pgmap v431: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:19:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:57 smithi146 ceph-mon[35807]: pgmap v431: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:19:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:57 smithi076 ceph-mon[35401]: pgmap v431: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:19:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:19:59 smithi040 ceph-mon[32397]: pgmap v432: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:19:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:19:59 smithi146 ceph-mon[35807]: pgmap v432: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:19:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:19:59 smithi076 ceph-mon[35401]: pgmap v432: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:00.400 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:20:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T12:20:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:20:01.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:01 smithi040 ceph-mon[32397]: pgmap v433: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:20:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:01 smithi146 ceph-mon[35807]: pgmap v433: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:20:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:01 smithi076 ceph-mon[35401]: pgmap v433: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:20:03.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:03 smithi040 ceph-mon[32397]: pgmap v434: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:03 smithi146 ceph-mon[35807]: pgmap v434: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:03 smithi076 ceph-mon[35401]: pgmap v434: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 -- 172.21.15.40:0/1683863500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 msgr2=0x7fd3181046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 --2- 172.21.15.40:0/1683863500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd3181046e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009900 tx=0x7fd30c02a410 comp rx=0 tx=0).stop 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 -- 172.21.15.40:0/1683863500 shutdown_connections 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 --2- 172.21.15.40:0/1683863500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd31810d880 0x7fd31810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 --2- 172.21.15.40:0/1683863500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd318104d00 0x7fd31810d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 --2- 172.21.15.40:0/1683863500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd3181046e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 -- 172.21.15.40:0/1683863500 >> 172.21.15.40:0/1683863500 conn(0x7fd318079160 msgr2=0x7fd318079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 -- 172.21.15.40:0/1683863500 shutdown_connections 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.984+0000 7fd320200640 1 -- 172.21.15.40:0/1683863500 wait complete. 2024-07-26T12:20:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 Processor -- start 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 -- start start 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd318199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd318104d00 0x7fd31819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd31810d880 0x7fd31819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181133a0 con 0x7fd3181042d0 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd318113220 con 0x7fd318104d00 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.986+0000 7fd320200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd318113520 con 0x7fd31810d880 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd318199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd318199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43632/0 (socket says 172.21.15.40:43632) 2024-07-26T12:20:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 -- 172.21.15.40:0/2396326538 learned_addr learned my addr 172.21.15.40:0/2396326538 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31ce00640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd318104d00 0x7fd31819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31e200640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd31810d880 0x7fd31819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 -- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd31810d880 msgr2=0x7fd31819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd31810d880 0x7fd31819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 -- 172.21.15.40:0/2396326538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd318104d00 msgr2=0x7fd31819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd318104d00 0x7fd31819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 -- 172.21.15.40:0/2396326538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31819fd40 con 0x7fd3181042d0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.987+0000 7fd31d800640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd318199dd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd30c02a930 tx=0x7fd30c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.988+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c03f070 con 0x7fd3181042d0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.988+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd30c003e10 con 0x7fd3181042d0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.988+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31819ffd0 con 0x7fd3181042d0 2024-07-26T12:20:04.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.988+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c035030 con 0x7fd3181042d0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.988+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3181a6790 con 0x7fd3181042d0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.989+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd318063540 con 0x7fd3181042d0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.992+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd30c042070 con 0x7fd3181042d0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.993+0000 7fd316000640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3000b3c60 0x7fd3000b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.993+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd30c104a30 con 0x7fd3181042d0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.993+0000 7fd31ce00640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3000b3c60 0x7fd3000b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.994+0000 7fd316000640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] conn(0x7fd3000bd8e0 0x7fd3000bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.994+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 --> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3000c04a0 con 0x7fd3000bd8e0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.994+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd30c104de0 con 0x7fd3181042d0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.994+0000 7fd31e200640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] conn(0x7fd3000bd8e0 0x7fd3000bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.994+0000 7fd31ce00640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3000b3c60 0x7fd3000b6170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd304005fd0 tx=0x7fd304005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:04.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.996+0000 7fd31e200640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] conn(0x7fd3000bd8e0 0x7fd3000bfdd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:02.998+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== osd.11 v2:172.21.15.146:6824/2525193294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3000c04a0 con 0x7fd3000bd8e0 2024-07-26T12:20:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.014+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 --> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd3180639c0 con 0x7fd3000bd8e0 2024-07-26T12:20:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd316000640 1 -- 172.21.15.40:0/2396326538 <== osd.11 v2:172.21.15.146:6824/2525193294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd3180639c0 con 0x7fd3000bd8e0 2024-07-26T12:20:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] conn(0x7fd3000bd8e0 msgr2=0x7fd3000bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd320200640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] conn(0x7fd3000bd8e0 0x7fd3000bfdd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3000b3c60 msgr2=0x7fd3000b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd320200640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3000b3c60 0x7fd3000b6170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd304005fd0 tx=0x7fd304005850 comp rx=0 tx=0).stop 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 msgr2=0x7fd318199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd320200640 1 --2- 172.21.15.40:0/2396326538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3181042d0 0x7fd318199dd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd30c02a930 tx=0x7fd30c003c20 comp rx=0 tx=0).stop 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.015+0000 7fd31e200640 1 -- 172.21.15.40:0/2396326538 reap_dead start 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.016+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 shutdown_connections 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.016+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 >> 172.21.15.40:0/2396326538 conn(0x7fd318079160 msgr2=0x7fd318100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.016+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 shutdown_connections 2024-07-26T12:20:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.016+0000 7fd320200640 1 -- 172.21.15.40:0/2396326538 wait complete. 2024-07-26T12:20:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 -- 172.21.15.40:0/666991734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a410f920 msgr2=0x7f88a4111d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 --2- 172.21.15.40:0/666991734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a410f920 0x7f88a4111d60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f889c009ca0 tx=0x7f889c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 -- 172.21.15.40:0/666991734 shutdown_connections 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 --2- 172.21.15.40:0/666991734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a410f920 0x7f88a4111d60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 --2- 172.21.15.40:0/666991734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a4075b30 0x7f88a410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 --2- 172.21.15.40:0/666991734 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88a40751e0 0x7f88a40755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.167+0000 7f88aa600640 1 -- 172.21.15.40:0/666991734 >> 172.21.15.40:0/666991734 conn(0x7f88a40fee70 msgr2=0x7f88a41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.168+0000 7f88aa600640 1 -- 172.21.15.40:0/666991734 shutdown_connections 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.168+0000 7f88aa600640 1 -- 172.21.15.40:0/666991734 wait complete. 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.169+0000 7f88aa600640 1 Processor -- start 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.169+0000 7f88aa600640 1 -- start start 2024-07-26T12:20:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.169+0000 7f88aa600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88a40751e0 0x7f88a419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.169+0000 7f88aa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a4075b30 0x7f88a419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88aa600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a410f920 0x7f88a41a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88aa600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41153d0 con 0x7f88a4075b30 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88aa600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4115250 con 0x7f88a40751e0 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88aa600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4115550 con 0x7f88a410f920 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a4075b30 0x7f88a419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a4075b30 0x7f88a419c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43658/0 (socket says 172.21.15.40:43658) 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 -- 172.21.15.40:0/579919380 learned_addr learned my addr 172.21.15.40:0/579919380 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a9200640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88a40751e0 0x7f88a419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a9c00640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a410f920 0x7f88a41a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 -- 172.21.15.40:0/579919380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a410f920 msgr2=0x7f88a41a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a410f920 0x7f88a41a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 -- 172.21.15.40:0/579919380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88a40751e0 msgr2=0x7f88a419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88a40751e0 0x7f88a419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.170+0000 7f88a3e00640 1 -- 172.21.15.40:0/579919380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a41a1d50 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.171+0000 7f88a3e00640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a4075b30 0x7f88a419c380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f889000d950 tx=0x7f889000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.171+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890017070 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.171+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8890009c30 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.171+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a41a2040 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.171+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889000f620 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.171+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a41a87a0 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.172+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88a41011f0 con 0x7f88a4075b30 2024-07-26T12:20:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.175+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f889001a070 con 0x7f88a4075b30 2024-07-26T12:20:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.176+0000 7f88a1600640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f888c0b3c60 0x7f888c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.177+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f88900e3ce0 con 0x7f88a4075b30 2024-07-26T12:20:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.177+0000 7f88a9200640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f888c0b3c60 0x7f888c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.177+0000 7f88a1600640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] conn(0x7f888c0bd8e0 0x7f888c0bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.177+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 --> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8890004470 con 0x7f888c0bd8e0 2024-07-26T12:20:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.177+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f88900e4090 con 0x7f88a4075b30 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.177+0000 7f88a9c00640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] conn(0x7f888c0bd8e0 0x7f888c0bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.178+0000 7f88a9200640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f888c0b3c60 0x7f888c0b6170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8898005fd0 tx=0x7f8898005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.178+0000 7f88a9c00640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] conn(0x7f888c0bd8e0 0x7f888c0bfdd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.179+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== osd.9 v2:172.21.15.40:6826/2884827145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8890004470 con 0x7f888c0bd8e0 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.195+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 --> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88a40766f0 con 0x7f888c0bd8e0 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.195+0000 7f88a1600640 1 -- 172.21.15.40:0/579919380 <== osd.9 v2:172.21.15.40:6826/2884827145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f88a40766f0 con 0x7f888c0bd8e0 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] conn(0x7f888c0bd8e0 msgr2=0x7f888c0bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] conn(0x7f888c0bd8e0 0x7f888c0bfdd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f888c0b3c60 msgr2=0x7f888c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f888c0b3c60 0x7f888c0b6170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8898005fd0 tx=0x7f8898005850 comp rx=0 tx=0).stop 2024-07-26T12:20:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a4075b30 msgr2=0x7f88a419c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:05.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 --2- 172.21.15.40:0/579919380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88a4075b30 0x7f88a419c380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f889000d950 tx=0x7f889000de10 comp rx=0 tx=0).stop 2024-07-26T12:20:05.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88a9c00640 1 -- 172.21.15.40:0/579919380 reap_dead start 2024-07-26T12:20:05.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 shutdown_connections 2024-07-26T12:20:05.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.196+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 >> 172.21.15.40:0/579919380 conn(0x7f88a40fee70 msgr2=0x7f88a41007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:05.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.197+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 shutdown_connections 2024-07-26T12:20:05.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:04.197+0000 7f88aa600640 1 -- 172.21.15.40:0/579919380 wait complete. 2024-07-26T12:20:05.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:05 smithi040 ceph-mon[32397]: pgmap v435: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:20:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:05 smithi146 ceph-mon[35807]: pgmap v435: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:20:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:05 smithi076 ceph-mon[35401]: pgmap v435: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 -- 172.21.15.40:0/1528220049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221810d650 msgr2=0x7f221810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 --2- 172.21.15.40:0/1528220049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221810d650 0x7f221810fb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2210009ca0 tx=0x7f221002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 -- 172.21.15.40:0/1528220049 shutdown_connections 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 --2- 172.21.15.40:0/1528220049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221810d650 0x7f221810fb40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 --2- 172.21.15.40:0/1528220049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2218104b40 0x7f221810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 --2- 172.21.15.40:0/1528220049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22181041f0 0x7f2218104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 -- 172.21.15.40:0/1528220049 >> 172.21.15.40:0/1528220049 conn(0x7f22180fdcf0 msgr2=0x7f2218100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.244+0000 7f2217e00640 1 -- 172.21.15.40:0/1528220049 shutdown_connections 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.245+0000 7f2217e00640 1 -- 172.21.15.40:0/1528220049 wait complete. 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.246+0000 7f2217e00640 1 Processor -- start 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 -- start start 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22181041f0 0x7f2218101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2218104b40 0x7f2218102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f221810d650 0x7f22181029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f22181131c0 con 0x7f22181041f0 2024-07-26T12:20:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2218113040 con 0x7f221810d650 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.247+0000 7f2217e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2218113340 con 0x7f2218104b40 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22181041f0 0x7f2218101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22181041f0 0x7f2218101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43670/0 (socket says 172.21.15.40:43670) 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 -- 172.21.15.40:0/2143927037 learned_addr learned my addr 172.21.15.40:0/2143927037 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216000640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2218104b40 0x7f2218102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2217400640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f221810d650 0x7f22181029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 -- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2218104b40 msgr2=0x7f2218102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2218104b40 0x7f2218102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 -- 172.21.15.40:0/2143927037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f221810d650 msgr2=0x7f22181029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f221810d650 0x7f22181029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.248+0000 7f2216a00640 1 -- 172.21.15.40:0/2143927037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22181a7e90 con 0x7f22181041f0 2024-07-26T12:20:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.249+0000 7f2216a00640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22181041f0 0x7f2218101f30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f220800c890 tx=0x7f220800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.249+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208004220 con 0x7f22181041f0 2024-07-26T12:20:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.249+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2208007e40 con 0x7f22181041f0 2024-07-26T12:20:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.249+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22181a8180 con 0x7f22181041f0 2024-07-26T12:20:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.249+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208004a00 con 0x7f22181041f0 2024-07-26T12:20:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.249+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22181a86c0 con 0x7f22181041f0 2024-07-26T12:20:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.250+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2218107b90 con 0x7f22181041f0 2024-07-26T12:20:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.252+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f22080079b0 con 0x7f22181041f0 2024-07-26T12:20:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.254+0000 7f220f400640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21fc0b3c60 0x7f21fc0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.254+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f22080e3f60 con 0x7f22181041f0 2024-07-26T12:20:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.254+0000 7f2216000640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21fc0b3c60 0x7f21fc0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.254+0000 7f220f400640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] conn(0x7f21fc0bd8e0 0x7f21fc0bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.254+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 --> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2208012ec0 con 0x7f21fc0bd8e0 2024-07-26T12:20:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.254+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f22080e4310 con 0x7f22181041f0 2024-07-26T12:20:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.255+0000 7f2216000640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21fc0b3c60 0x7f21fc0b6170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f221810fa40 tx=0x7f220000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.255+0000 7f2217400640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] conn(0x7f21fc0bd8e0 0x7f21fc0bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.256+0000 7f2217400640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] conn(0x7f21fc0bd8e0 0x7f21fc0bfdd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.258+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== osd.5 v2:172.21.15.146:6808/371932906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2208012ec0 con 0x7f21fc0bd8e0 2024-07-26T12:20:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.273+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 --> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f221806af90 con 0x7f21fc0bd8e0 2024-07-26T12:20:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.275+0000 7f220f400640 1 -- 172.21.15.40:0/2143927037 <== osd.5 v2:172.21.15.146:6808/371932906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f221806af90 con 0x7f21fc0bd8e0 2024-07-26T12:20:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.275+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] conn(0x7f21fc0bd8e0 msgr2=0x7f21fc0bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.275+0000 7f2217e00640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] conn(0x7f21fc0bd8e0 0x7f21fc0bfdd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21fc0b3c60 msgr2=0x7f21fc0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21fc0b3c60 0x7f21fc0b6170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f221810fa40 tx=0x7f220000a4c0 comp rx=0 tx=0).stop 2024-07-26T12:20:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22181041f0 msgr2=0x7f2218101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 --2- 172.21.15.40:0/2143927037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22181041f0 0x7f2218101f30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f220800c890 tx=0x7f220800cd50 comp rx=0 tx=0).stop 2024-07-26T12:20:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217400640 1 -- 172.21.15.40:0/2143927037 reap_dead start 2024-07-26T12:20:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 shutdown_connections 2024-07-26T12:20:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 >> 172.21.15.40:0/2143927037 conn(0x7f22180fdcf0 msgr2=0x7f2218107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 shutdown_connections 2024-07-26T12:20:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:07.276+0000 7f2217e00640 1 -- 172.21.15.40:0/2143927037 wait complete. 2024-07-26T12:20:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:07 smithi040 ceph-mon[32397]: pgmap v436: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-07-26T12:20:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:07 smithi146 ceph-mon[35807]: pgmap v436: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-07-26T12:20:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:07 smithi076 ceph-mon[35401]: pgmap v436: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-07-26T12:20:09.490 INFO:teuthology.orchestra.run.smithi040.stdout:158913790031 2024-07-26T12:20:09.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-07-26T12:20:09.553 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:09 smithi040 ceph-mon[32397]: pgmap v437: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:20:09.565 INFO:teuthology.orchestra.run.smithi040.stdout:261993005108 2024-07-26T12:20:09.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-07-26T12:20:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:09 smithi146 ceph-mon[35807]: pgmap v437: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:20:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:09 smithi076 ceph-mon[35401]: pgmap v437: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:20:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 -- 172.21.15.40:0/1699592337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc10b0f0 msgr2=0x7f8edc10b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 --2- 172.21.15.40:0/1699592337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc10b0f0 0x7f8edc10b500 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009900 tx=0x7f8ec802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 -- 172.21.15.40:0/1699592337 shutdown_connections 2024-07-26T12:20:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 --2- 172.21.15.40:0/1699592337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8edc10ba40 0x7f8edc112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 --2- 172.21.15.40:0/1699592337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc10b0f0 0x7f8edc10b500 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 --2- 172.21.15.40:0/1699592337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc1057b0 0x7f8edc105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 -- 172.21.15.40:0/1699592337 >> 172.21.15.40:0/1699592337 conn(0x7f8edc101240 msgr2=0x7f8edc103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 -- 172.21.15.40:0/1699592337 shutdown_connections 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.937+0000 7f8ee3600640 1 -- 172.21.15.40:0/1699592337 wait complete. 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 Processor -- start 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 -- start start 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc1057b0 0x7f8edc19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc10b0f0 0x7f8edc19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8edc10ba40 0x7f8edc1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1155d0 con 0x7f8edc1057b0 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc115450 con 0x7f8edc10ba40 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.939+0000 7f8ee3600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc115750 con 0x7f8edc10b0f0 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc1057b0 0x7f8edc19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc1057b0 0x7f8edc19c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43694/0 (socket says 172.21.15.40:43694) 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 -- 172.21.15.40:0/4054199703 learned_addr learned my addr 172.21.15.40:0/4054199703 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8edbe00640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc10b0f0 0x7f8edc19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee1600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8edc10ba40 0x7f8edc1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 -- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc10b0f0 msgr2=0x7f8edc19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc10b0f0 0x7f8edc19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 -- 172.21.15.40:0/4054199703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8edc10ba40 msgr2=0x7f8edc1a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8edc10ba40 0x7f8edc1a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.940+0000 7f8ee0c00640 1 -- 172.21.15.40:0/4054199703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc1a2030 con 0x7f8edc1057b0 2024-07-26T12:20:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.941+0000 7f8ee0c00640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc1057b0 0x7f8edc19c0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000d770 tx=0x7f8ed000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.941+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0017070 con 0x7f8edc1057b0 2024-07-26T12:20:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.941+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc1a2320 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.941+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc1a8a80 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.941+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ed00054b0 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.941+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0004c60 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.943+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ebc001060 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.946+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8ed0009c30 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.947+0000 7f8ed9600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ec40b3ce0 0x7f8ec40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.947+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8ed00e3b10 con 0x7f8edc1057b0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.948+0000 7f8edbe00640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ec40b3ce0 0x7f8ec40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.948+0000 7f8ed9600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] conn(0x7f8ec40bd960 0x7f8ec40bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.948+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 --> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ec40c0520 con 0x7f8ec40bd960 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.948+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f8ed00e3f00 con 0x7f8edc1057b0 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.949+0000 7f8ee1600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] conn(0x7f8ec40bd960 0x7f8ec40bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.949+0000 7f8edbe00640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ec40b3ce0 0x7f8ec40b61f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ec802a910 tx=0x7f8ec8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.950+0000 7f8ee1600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] conn(0x7f8ec40bd960 0x7f8ec40bfe50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.952+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== osd.2 v2:172.21.15.146:6800/2643488432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ec40c0520 con 0x7f8ec40bd960 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.969+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 --> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ebc002e00 con 0x7f8ec40bd960 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ed9600640 1 -- 172.21.15.40:0/4054199703 <== osd.2 v2:172.21.15.146:6800/2643488432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ebc002e00 con 0x7f8ec40bd960 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] conn(0x7f8ec40bd960 msgr2=0x7f8ec40bfe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee3600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] conn(0x7f8ec40bd960 0x7f8ec40bfe50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ec40b3ce0 msgr2=0x7f8ec40b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee3600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ec40b3ce0 0x7f8ec40b61f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ec802a910 tx=0x7f8ec8000bc0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc1057b0 msgr2=0x7f8edc19c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee3600640 1 --2- 172.21.15.40:0/4054199703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8edc1057b0 0x7f8edc19c0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000d770 tx=0x7f8ed000dc30 comp rx=0 tx=0).stop 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.970+0000 7f8ee1600640 1 -- 172.21.15.40:0/4054199703 reap_dead start 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.971+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 shutdown_connections 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.971+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 >> 172.21.15.40:0/4054199703 conn(0x7f8edc101240 msgr2=0x7f8edc103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.971+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 shutdown_connections 2024-07-26T12:20:10.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:09.971+0000 7f8ee3600640 1 -- 172.21.15.40:0/4054199703 wait complete. 2024-07-26T12:20:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 -- 172.21.15.40:0/2566063841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 msgr2=0x7f74c01039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 --2- 172.21.15.40:0/2566063841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c01039c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009900 tx=0x7f74b002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 -- 172.21.15.40:0/2566063841 shutdown_connections 2024-07-26T12:20:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 --2- 172.21.15.40:0/2566063841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74c0109840 0x7f74c0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 --2- 172.21.15.40:0/2566063841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c0108ef0 0x7f74c0109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 --2- 172.21.15.40:0/2566063841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c01039c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 -- 172.21.15.40:0/2566063841 >> 172.21.15.40:0/2566063841 conn(0x7f74c00fefc0 msgr2=0x7f74c0101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 -- 172.21.15.40:0/2566063841 shutdown_connections 2024-07-26T12:20:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.040+0000 7f74c6400640 1 -- 172.21.15.40:0/2566063841 wait complete. 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.041+0000 7f74c6400640 1 Processor -- start 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 -- start start 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c0108ef0 0x7f74c019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74c0109840 0x7f74c01a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f74c01133a0 con 0x7f74c01035b0 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0113220 con 0x7f74c0109840 2024-07-26T12:20:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74c6400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0113520 con 0x7f74c0108ef0 2024-07-26T12:20:10.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74bf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74bf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43708/0 (socket says 172.21.15.40:43708) 2024-07-26T12:20:10.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.042+0000 7f74bf400640 1 -- 172.21.15.40:0/2806733075 learned_addr learned my addr 172.21.15.40:0/2806733075 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bea00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c0108ef0 0x7f74c019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bfe00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74c0109840 0x7f74c01a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bf400640 1 -- 172.21.15.40:0/2806733075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c0108ef0 msgr2=0x7f74c019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bf400640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74c0108ef0 0x7f74c019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bf400640 1 -- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74c0109840 msgr2=0x7f74c01a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bf400640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74c0109840 0x7f74c01a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.043+0000 7f74bf400640 1 -- 172.21.15.40:0/2806733075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c01a1f20 con 0x7f74c01035b0 2024-07-26T12:20:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.044+0000 7f74bf400640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c019c070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009a20 tx=0x7f74b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.044+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b003f030 con 0x7f74c01035b0 2024-07-26T12:20:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.044+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74b00035f0 con 0x7f74c01035b0 2024-07-26T12:20:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.044+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c01a21b0 con 0x7f74c01035b0 2024-07-26T12:20:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.044+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0035070 con 0x7f74c01035b0 2024-07-26T12:20:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.044+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c01a2690 con 0x7f74c01035b0 2024-07-26T12:20:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.045+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74c01080e0 con 0x7f74c01035b0 2024-07-26T12:20:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.048+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f74b0003aa0 con 0x7f74c01035b0 2024-07-26T12:20:10.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.049+0000 7f74b7e00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74a40b3c90 0x7f74a40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.049+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f74b0104e10 con 0x7f74c01035b0 2024-07-26T12:20:10.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.050+0000 7f74bea00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74a40b3c90 0x7f74a40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.050+0000 7f74b7e00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] conn(0x7f74a40bd910 0x7f74a40bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.050+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 --> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74a40c04d0 con 0x7f74a40bd910 2024-07-26T12:20:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.050+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f74b01051c0 con 0x7f74c01035b0 2024-07-26T12:20:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.050+0000 7f74bea00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74a40b3c90 0x7f74a40b61a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74c01027e0 tx=0x7f74ac00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.050+0000 7f74bfe00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] conn(0x7f74a40bd910 0x7f74a40bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.051+0000 7f74bfe00640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] conn(0x7f74a40bd910 0x7f74a40bfe00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.054+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== osd.4 v2:172.21.15.76:6808/3287530832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74a40c04d0 con 0x7f74a40bd910 2024-07-26T12:20:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.069+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 --> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74c0104830 con 0x7f74a40bd910 2024-07-26T12:20:10.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.070+0000 7f74b7e00640 1 -- 172.21.15.40:0/2806733075 <== osd.4 v2:172.21.15.76:6808/3287530832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f74c0104830 con 0x7f74a40bd910 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] conn(0x7f74a40bd910 msgr2=0x7f74a40bfe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74c6400640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] conn(0x7f74a40bd910 0x7f74a40bfe00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74a40b3c90 msgr2=0x7f74a40b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74c6400640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74a40b3c90 0x7f74a40b61a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74c01027e0 tx=0x7f74ac00a4c0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 msgr2=0x7f74c019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74c6400640 1 --2- 172.21.15.40:0/2806733075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74c01035b0 0x7f74c019c070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009a20 tx=0x7f74b0004270 comp rx=0 tx=0).stop 2024-07-26T12:20:10.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.071+0000 7f74bfe00640 1 -- 172.21.15.40:0/2806733075 reap_dead start 2024-07-26T12:20:10.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.072+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 shutdown_connections 2024-07-26T12:20:10.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.072+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 >> 172.21.15.40:0/2806733075 conn(0x7f74c00fefc0 msgr2=0x7f74c01076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:10.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.072+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 shutdown_connections 2024-07-26T12:20:10.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:10.072+0000 7f74c6400640 1 -- 172.21.15.40:0/2806733075 wait complete. 2024-07-26T12:20:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 -- 172.21.15.40:0/1255709692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 msgr2=0x7f06781039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 --2- 172.21.15.40:0/1255709692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f06781039b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0668009900 tx=0x7f066802a410 comp rx=0 tx=0).stop 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 -- 172.21.15.40:0/1255709692 shutdown_connections 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 --2- 172.21.15.40:0/1255709692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0678109830 0x7f0678110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 --2- 172.21.15.40:0/1255709692 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0678108ee0 0x7f06781092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 --2- 172.21.15.40:0/1255709692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f06781039b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 -- 172.21.15.40:0/1255709692 >> 172.21.15.40:0/1255709692 conn(0x7f06780ff010 msgr2=0x7f0678101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 -- 172.21.15.40:0/1255709692 shutdown_connections 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.099+0000 7f067ce00640 1 -- 172.21.15.40:0/1255709692 wait complete. 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.100+0000 7f067ce00640 1 Processor -- start 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 -- start start 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f067819c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0678108ee0 0x7f067819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0678109830 0x7f06781a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0678113420 con 0x7f06781035a0 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06781132a0 con 0x7f0678109830 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f067ce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f06781135a0 con 0x7f0678108ee0 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f0675e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f067819c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f0675e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f067819c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43652/0 (socket says 172.21.15.40:43652) 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.101+0000 7f0675e00640 1 -- 172.21.15.40:0/1827578842 learned_addr learned my addr 172.21.15.40:0/1827578842 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f066fe00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0678108ee0 0x7f067819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0676800640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0678109830 0x7f06781a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0675e00640 1 -- 172.21.15.40:0/1827578842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0678108ee0 msgr2=0x7f067819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0675e00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0678108ee0 0x7f067819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0675e00640 1 -- 172.21.15.40:0/1827578842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0678109830 msgr2=0x7f06781a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0675e00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0678109830 0x7f06781a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0675e00640 1 -- 172.21.15.40:0/1827578842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06781a2060 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0676800640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0678109830 0x7f06781a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.102+0000 7f0675e00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f067819c0f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f066802a930 tx=0x7f0668003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.103+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066803f070 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.103+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0668003e40 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.103+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668035030 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.103+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06781a22f0 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.103+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06781a8ab0 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.104+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f067810f5d0 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.106+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0668042070 con 0x7f06781035a0 2024-07-26T12:20:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.108+0000 7f066ea00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3c60 0x7f065c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.108+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0668104a70 con 0x7f06781035a0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.108+0000 7f066fe00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3c60 0x7f065c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.109+0000 7f066ea00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] conn(0x7f065c0bd8e0 0x7f065c0bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.109+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 --> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f066803bde0 con 0x7f065c0bd8e0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.109+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0668104e20 con 0x7f06781035a0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.109+0000 7f0676800640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] conn(0x7f065c0bd8e0 0x7f065c0bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.109+0000 7f066fe00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3c60 0x7f065c0b6170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0660005fd0 tx=0x7f0660005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.110+0000 7f0676800640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] conn(0x7f065c0bd8e0 0x7f065c0bfdd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.111+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== osd.6 v2:172.21.15.40:6818/692210835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f066803bde0 con 0x7f065c0bd8e0 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.127+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 --> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0678104820 con 0x7f065c0bd8e0 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.127+0000 7f066ea00640 1 -- 172.21.15.40:0/1827578842 <== osd.6 v2:172.21.15.40:6818/692210835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0678104820 con 0x7f065c0bd8e0 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] conn(0x7f065c0bd8e0 msgr2=0x7f065c0bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] conn(0x7f065c0bd8e0 0x7f065c0bfdd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3c60 msgr2=0x7f065c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3c60 0x7f065c0b6170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0660005fd0 tx=0x7f0660005850 comp rx=0 tx=0).stop 2024-07-26T12:20:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 msgr2=0x7f067819c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 --2- 172.21.15.40:0/1827578842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06781035a0 0x7f067819c0f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f066802a930 tx=0x7f0668003c20 comp rx=0 tx=0).stop 2024-07-26T12:20:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f0676800640 1 -- 172.21.15.40:0/1827578842 reap_dead start 2024-07-26T12:20:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 shutdown_connections 2024-07-26T12:20:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 >> 172.21.15.40:0/1827578842 conn(0x7f06780ff010 msgr2=0x7f0678108620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 shutdown_connections 2024-07-26T12:20:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:03.128+0000 7f067ce00640 1 -- 172.21.15.40:0/1827578842 wait complete. 2024-07-26T12:20:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 -- 172.21.15.40:0/2579355314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9144075b30 msgr2=0x7f914410f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 --2- 172.21.15.40:0/2579355314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9144075b30 0x7f914410f5b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f912c009ca0 tx=0x7f912c02a8b0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 -- 172.21.15.40:0/2579355314 shutdown_connections 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 --2- 172.21.15.40:0/2579355314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914410faf0 0x7f9144111f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 --2- 172.21.15.40:0/2579355314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9144075b30 0x7f914410f5b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 --2- 172.21.15.40:0/2579355314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91440751e0 0x7f91440755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.032+0000 7f914ae00640 1 -- 172.21.15.40:0/2579355314 >> 172.21.15.40:0/2579355314 conn(0x7f914407b280 msgr2=0x7f914407b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.033+0000 7f914ae00640 1 -- 172.21.15.40:0/2579355314 shutdown_connections 2024-07-26T12:20:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.033+0000 7f914ae00640 1 -- 172.21.15.40:0/2579355314 wait complete. 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 Processor -- start 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 -- start start 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91440751e0 0x7f914419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144075b30 0x7f914419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f914410faf0 0x7f91441a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9144115520 con 0x7f914410faf0 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f91441153a0 con 0x7f91440751e0 2024-07-26T12:20:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.034+0000 7f914ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91441156a0 con 0x7f9144075b30 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f914410faf0 0x7f91441a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f914410faf0 0x7f91441a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43720/0 (socket says 172.21.15.40:43720) 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 -- 172.21.15.40:0/2890247939 learned_addr learned my addr 172.21.15.40:0/2890247939 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9143e00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91440751e0 0x7f914419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9143400640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144075b30 0x7f914419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 -- 172.21.15.40:0/2890247939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144075b30 msgr2=0x7f914419c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9144075b30 0x7f914419c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 -- 172.21.15.40:0/2890247939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91440751e0 msgr2=0x7f914419bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91440751e0 0x7f914419bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.035+0000 7f9148e00640 1 -- 172.21.15.40:0/2890247939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91441a1e60 con 0x7f914410faf0 2024-07-26T12:20:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.036+0000 7f9148e00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f914410faf0 0x7f91441a17f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c970 tx=0x7f913c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.036+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c007bb0 con 0x7f914410faf0 2024-07-26T12:20:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.036+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f913c007d50 con 0x7f914410faf0 2024-07-26T12:20:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.036+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91441a2150 con 0x7f914410faf0 2024-07-26T12:20:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.036+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c018660 con 0x7f914410faf0 2024-07-26T12:20:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.036+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91441a8970 con 0x7f914410faf0 2024-07-26T12:20:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.037+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9120001060 con 0x7f914410faf0 2024-07-26T12:20:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.040+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f913c00f450 con 0x7f914410faf0 2024-07-26T12:20:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.042+0000 7f9140c00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f91280b3c90 0x7f91280b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.042+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f913c0e42b0 con 0x7f914410faf0 2024-07-26T12:20:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.042+0000 7f9143e00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f91280b3c90 0x7f91280b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.042+0000 7f9140c00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] conn(0x7f91280bd910 0x7f91280bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.042+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 --> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91280c04d0 con 0x7f91280bd910 2024-07-26T12:20:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.042+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f913c0e4660 con 0x7f914410faf0 2024-07-26T12:20:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.043+0000 7f9143400640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] conn(0x7f91280bd910 0x7f91280bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.043+0000 7f9143e00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f91280b3c90 0x7f91280b61a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9134005e10 tx=0x7f9134005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.043+0000 7f9143400640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] conn(0x7f91280bd910 0x7f91280bfe00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.044+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== osd.0 v2:172.21.15.40:6802/336845656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91280c04d0 con 0x7f91280bd910 2024-07-26T12:20:11.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.061+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 --> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9120002e00 con 0x7f91280bd910 2024-07-26T12:20:11.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.062+0000 7f9140c00640 1 -- 172.21.15.40:0/2890247939 <== osd.0 v2:172.21.15.40:6802/336845656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9120002e00 con 0x7f91280bd910 2024-07-26T12:20:11.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.062+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] conn(0x7f91280bd910 msgr2=0x7f91280bfe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.062+0000 7f914ae00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] conn(0x7f91280bd910 0x7f91280bfe00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f91280b3c90 msgr2=0x7f91280b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f91280b3c90 0x7f91280b61a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9134005e10 tx=0x7f9134005da0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f914410faf0 msgr2=0x7f91441a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 --2- 172.21.15.40:0/2890247939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f914410faf0 0x7f91441a17f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c970 tx=0x7f913c00ce30 comp rx=0 tx=0).stop 2024-07-26T12:20:11.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f9148e00640 1 -- 172.21.15.40:0/2890247939 reap_dead start 2024-07-26T12:20:11.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 shutdown_connections 2024-07-26T12:20:11.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 >> 172.21.15.40:0/2890247939 conn(0x7f914407b280 msgr2=0x7f9144101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:11.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 shutdown_connections 2024-07-26T12:20:11.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.063+0000 7f914ae00640 1 -- 172.21.15.40:0/2890247939 wait complete. 2024-07-26T12:20:11.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 -- 172.21.15.40:0/1046630031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 msgr2=0x7fc55c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 --2- 172.21.15.40:0/1046630031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c107110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009900 tx=0x7fc54c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 -- 172.21.15.40:0/1046630031 shutdown_connections 2024-07-26T12:20:11.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 --2- 172.21.15.40:0/1046630031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55c10c280 0x7fc55c10e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 --2- 172.21.15.40:0/1046630031 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc55c102140 0x7fc55c107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 --2- 172.21.15.40:0/1046630031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c107110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 -- 172.21.15.40:0/1046630031 >> 172.21.15.40:0/1046630031 conn(0x7fc55c077230 msgr2=0x7fc55c077670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:11.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 -- 172.21.15.40:0/1046630031 shutdown_connections 2024-07-26T12:20:11.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.248+0000 7fc562000640 1 -- 172.21.15.40:0/1046630031 wait complete. 2024-07-26T12:20:11.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.249+0000 7fc562000640 1 Processor -- start 2024-07-26T12:20:11.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.249+0000 7fc562000640 1 -- start start 2024-07-26T12:20:11.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc562000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc562000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc55c102140 0x7fc55c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc562000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55c10c280 0x7fc55c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc562000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c1133d0 con 0x7fc55c069b10 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc562000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c113250 con 0x7fc55c102140 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc562000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c113550 con 0x7fc55c10c280 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc55b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc55b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43748/0 (socket says 172.21.15.40:43748) 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc55b400640 1 -- 172.21.15.40:0/3276924009 learned_addr learned my addr 172.21.15.40:0/3276924009 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.250+0000 7fc55aa00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc55c102140 0x7fc55c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55be00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55c10c280 0x7fc55c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55b400640 1 -- 172.21.15.40:0/3276924009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55c10c280 msgr2=0x7fc55c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55b400640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55c10c280 0x7fc55c19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55b400640 1 -- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc55c102140 msgr2=0x7fc55c19a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55b400640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc55c102140 0x7fc55c19a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55b400640 1 -- 172.21.15.40:0/3276924009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c19fcb0 con 0x7fc55c069b10 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc55b400640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c199e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc54c02a910 tx=0x7fc54c003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.251+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c03f070 con 0x7fc55c069b10 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.252+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc54c03bdc0 con 0x7fc55c069b10 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.252+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c035030 con 0x7fc55c069b10 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.252+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c19ff40 con 0x7fc55c069b10 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.252+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c1a03d0 con 0x7fc55c069b10 2024-07-26T12:20:11.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.253+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc55c105980 con 0x7fc55c069b10 2024-07-26T12:20:11.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.256+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fc54c042070 con 0x7fc55c069b10 2024-07-26T12:20:11.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.257+0000 7fc553e00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5400b3d10 0x7fc5400b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.258+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc54c104c40 con 0x7fc55c069b10 2024-07-26T12:20:11.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.258+0000 7fc55aa00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5400b3d10 0x7fc5400b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.258+0000 7fc553e00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] conn(0x7fc5400bd990 0x7fc5400bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.258+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 --> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5400c0550 con 0x7fc5400bd990 2024-07-26T12:20:11.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.258+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc54c104ff0 con 0x7fc55c069b10 2024-07-26T12:20:11.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.259+0000 7fc55be00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] conn(0x7fc5400bd990 0x7fc5400bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.259+0000 7fc55aa00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5400b3d10 0x7fc5400b6220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc548005e10 tx=0x7fc548005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.260+0000 7fc55be00640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] conn(0x7fc5400bd990 0x7fc5400bfe80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.263+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== osd.7 v2:172.21.15.76:6816/2514797564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5400c0550 con 0x7fc5400bd990 2024-07-26T12:20:11.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.279+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 --> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc55c102a50 con 0x7fc5400bd990 2024-07-26T12:20:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.280+0000 7fc553e00640 1 -- 172.21.15.40:0/3276924009 <== osd.7 v2:172.21.15.76:6816/2514797564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc55c102a50 con 0x7fc5400bd990 2024-07-26T12:20:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] conn(0x7fc5400bd990 msgr2=0x7fc5400bfe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] conn(0x7fc5400bd990 0x7fc5400bfe80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5400b3d10 msgr2=0x7fc5400b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5400b3d10 0x7fc5400b6220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc548005e10 tx=0x7fc548005da0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 msgr2=0x7fc55c199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 --2- 172.21.15.40:0/3276924009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55c069b10 0x7fc55c199e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc54c02a910 tx=0x7fc54c003d60 comp rx=0 tx=0).stop 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc55be00640 1 -- 172.21.15.40:0/3276924009 reap_dead start 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 shutdown_connections 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.281+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 >> 172.21.15.40:0/3276924009 conn(0x7fc55c077230 msgr2=0x7fc55c104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.282+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 shutdown_connections 2024-07-26T12:20:11.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:11.282+0000 7fc562000640 1 -- 172.21.15.40:0/3276924009 wait complete. 2024-07-26T12:20:11.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:11 smithi040 ceph-mon[32397]: pgmap v438: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-07-26T12:20:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:11 smithi146 ceph-mon[35807]: pgmap v438: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-07-26T12:20:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:11 smithi076 ceph-mon[35401]: pgmap v438: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 -- 172.21.15.40:0/511637889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 msgr2=0x7f69bc1039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 --2- 172.21.15.40:0/511637889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc1039a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009ca0 tx=0x7f69b802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 -- 172.21.15.40:0/511637889 shutdown_connections 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 --2- 172.21.15.40:0/511637889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69bc109820 0x7f69bc110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 --2- 172.21.15.40:0/511637889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69bc108ed0 0x7f69bc1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 --2- 172.21.15.40:0/511637889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc1039a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 -- 172.21.15.40:0/511637889 >> 172.21.15.40:0/511637889 conn(0x7f69bc07b280 msgr2=0x7f69bc07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 -- 172.21.15.40:0/511637889 shutdown_connections 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.838+0000 7f69c4800640 1 -- 172.21.15.40:0/511637889 wait complete. 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.839+0000 7f69c4800640 1 Processor -- start 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.839+0000 7f69c4800640 1 -- start start 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c4800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c4800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69bc108ed0 0x7f69bc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c4800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69bc109820 0x7f69bc19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c4800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1133f0 con 0x7f69bc103590 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c4800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc113270 con 0x7f69bc109820 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c4800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc113570 con 0x7f69bc108ed0 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43686/0 (socket says 172.21.15.40:43686) 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.840+0000 7f69c1e00640 1 -- 172.21.15.40:0/3965386881 learned_addr learned my addr 172.21.15.40:0/3965386881 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1400640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69bc108ed0 0x7f69bc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c2800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69bc109820 0x7f69bc19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1e00640 1 -- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69bc108ed0 msgr2=0x7f69bc19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1e00640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69bc108ed0 0x7f69bc19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1e00640 1 -- 172.21.15.40:0/3965386881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69bc109820 msgr2=0x7f69bc19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1e00640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69bc109820 0x7f69bc19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1e00640 1 -- 172.21.15.40:0/3965386881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc19fdf0 con 0x7f69bc103590 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c2800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69bc109820 0x7f69bc19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c1e00640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc199e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009dc0 tx=0x7f69b8032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8004040 con 0x7f69bc103590 2024-07-26T12:20:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b8004670 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.841+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc1a0080 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.842+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8030c80 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.842+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc1a6840 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.843+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69bc063540 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.845+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f69b80041e0 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.847+0000 7f69b2a00640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69a80b3c60 0x7f69a80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.847+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f69b81054b0 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.847+0000 7f69c1400640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69a80b3c60 0x7f69a80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.847+0000 7f69b2a00640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] conn(0x7f69a80bd8e0 0x7f69a80bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.847+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 --> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69b8034e50 con 0x7f69a80bd8e0 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.847+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f69b8105860 con 0x7f69bc103590 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.848+0000 7f69c1400640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69a80b3c60 0x7f69a80b6170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69ac005fd0 tx=0x7f69ac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.862+0000 7f69c2800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] conn(0x7f69a80bd8e0 0x7f69a80bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.863+0000 7f69c2800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] conn(0x7f69a80bd8e0 0x7f69a80bfdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.865+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== osd.8 v2:172.21.15.146:6816/1134579636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69b8034e50 con 0x7f69a80bd8e0 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.881+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 --> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69bc0639c0 con 0x7f69a80bd8e0 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.883+0000 7f69b2a00640 1 -- 172.21.15.40:0/3965386881 <== osd.8 v2:172.21.15.146:6816/1134579636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f69bc0639c0 con 0x7f69a80bd8e0 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.883+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] conn(0x7f69a80bd8e0 msgr2=0x7f69a80bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.883+0000 7f69c4800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] conn(0x7f69a80bd8e0 0x7f69a80bfdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69a80b3c60 msgr2=0x7f69a80b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69a80b3c60 0x7f69a80b6170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69ac005fd0 tx=0x7f69ac005850 comp rx=0 tx=0).stop 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 msgr2=0x7f69bc199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 --2- 172.21.15.40:0/3965386881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc103590 0x7f69bc199e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009dc0 tx=0x7f69b8032bc0 comp rx=0 tx=0).stop 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c2800640 1 -- 172.21.15.40:0/3965386881 reap_dead start 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 shutdown_connections 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 >> 172.21.15.40:0/3965386881 conn(0x7f69bc07b280 msgr2=0x7f69bc107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 shutdown_connections 2024-07-26T12:20:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:08.884+0000 7f69c4800640 1 -- 172.21.15.40:0/3965386881 wait complete. 2024-07-26T12:20:12.789 INFO:teuthology.orchestra.run.smithi040.stdout:184683593799 2024-07-26T12:20:12.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-07-26T12:20:13.330 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:13 smithi040 ceph-mon[32397]: pgmap v439: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:20:13.463 INFO:teuthology.orchestra.run.smithi040.stdout:210453397571 2024-07-26T12:20:13.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-07-26T12:20:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:13 smithi146 ceph-mon[35807]: pgmap v439: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:20:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:13 smithi076 ceph-mon[35401]: pgmap v439: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 -- 172.21.15.40:0/3084751327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410b120 msgr2=0x7fd6b410b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 --2- 172.21.15.40:0/3084751327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410b120 0x7fd6b410b530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009900 tx=0x7fd69c02a410 comp rx=0 tx=0).stop 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 -- 172.21.15.40:0/3084751327 shutdown_connections 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 --2- 172.21.15.40:0/3084751327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b410ba70 0x7fd6b41122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 --2- 172.21.15.40:0/3084751327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410b120 0x7fd6b410b530 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 --2- 172.21.15.40:0/3084751327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6b41057e0 0x7fd6b4105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 -- 172.21.15.40:0/3084751327 >> 172.21.15.40:0/3084751327 conn(0x7fd6b41011f0 msgr2=0x7fd6b4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 -- 172.21.15.40:0/3084751327 shutdown_connections 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.277+0000 7fd6baa00640 1 -- 172.21.15.40:0/3084751327 wait complete. 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.278+0000 7fd6baa00640 1 Processor -- start 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.278+0000 7fd6baa00640 1 -- start start 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6baa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6b41057e0 0x7fd6b419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6baa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b410b120 0x7fd6b419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6baa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410ba70 0x7fd6b41a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6baa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41155b0 con 0x7fd6b410ba70 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6baa00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b4115430 con 0x7fd6b41057e0 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6baa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b4115730 con 0x7fd6b410b120 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6b8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410ba70 0x7fd6b41a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6b8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410ba70 0x7fd6b41a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33756/0 (socket says 172.21.15.40:33756) 2024-07-26T12:20:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6b8a00640 1 -- 172.21.15.40:0/1660730892 learned_addr learned my addr 172.21.15.40:0/1660730892 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.279+0000 7fd6b3e00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6b41057e0 0x7fd6b419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6abe00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b410b120 0x7fd6b419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b8a00640 1 -- 172.21.15.40:0/1660730892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b410b120 msgr2=0x7fd6b419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b8a00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b410b120 0x7fd6b419c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b8a00640 1 -- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6b41057e0 msgr2=0x7fd6b419c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b8a00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6b41057e0 0x7fd6b419c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b8a00640 1 -- 172.21.15.40:0/1660730892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41a1f90 con 0x7fd6b410ba70 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b3e00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6b41057e0 0x7fd6b419c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6abe00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b410b120 0x7fd6b419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b8a00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410ba70 0x7fd6b41a1860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00eaa0 tx=0x7fd6ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00cdb0 con 0x7fd6b410ba70 2024-07-26T12:20:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b41a2280 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6ac005020 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.280+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0116d0 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.281+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b41a89e0 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.282+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b410a310 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.284+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd6ac0051d0 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.286+0000 7fd6b1600640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6980b3c60 0x7fd6980b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.286+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd6ac0e43d0 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.286+0000 7fd6b3e00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6980b3c60 0x7fd6980b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.286+0000 7fd6b1600640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] conn(0x7fd6980bd8e0 0x7fd6980bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.286+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 --> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6ac014ec0 con 0x7fd6980bd8e0 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.286+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd6ac0e4800 con 0x7fd6b410ba70 2024-07-26T12:20:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.287+0000 7fd6b3e00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6980b3c60 0x7fd6980b6170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009b40 tx=0x7fd6a4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.287+0000 7fd6abe00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] conn(0x7fd6980bd8e0 0x7fd6980bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.288+0000 7fd6abe00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] conn(0x7fd6980bd8e0 0x7fd6980bfdd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.290+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== osd.1 v2:172.21.15.76:6800/1858622261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6ac014ec0 con 0x7fd6980bd8e0 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.307+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 --> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6b4106a60 con 0x7fd6980bd8e0 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.308+0000 7fd6b1600640 1 -- 172.21.15.40:0/1660730892 <== osd.1 v2:172.21.15.76:6800/1858622261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd6b4106a60 con 0x7fd6980bd8e0 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.308+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] conn(0x7fd6980bd8e0 msgr2=0x7fd6980bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.308+0000 7fd6baa00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] conn(0x7fd6980bd8e0 0x7fd6980bfdd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6980b3c60 msgr2=0x7fd6980b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6980b3c60 0x7fd6980b6170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009b40 tx=0x7fd6a4005e50 comp rx=0 tx=0).stop 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410ba70 msgr2=0x7fd6b41a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 --2- 172.21.15.40:0/1660730892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b410ba70 0x7fd6b41a1860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00eaa0 tx=0x7fd6ac00ef60 comp rx=0 tx=0).stop 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6b8a00640 1 -- 172.21.15.40:0/1660730892 reap_dead start 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 shutdown_connections 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 >> 172.21.15.40:0/1660730892 conn(0x7fd6b41011f0 msgr2=0x7fd6b41098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 shutdown_connections 2024-07-26T12:20:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:13.309+0000 7fd6baa00640 1 -- 172.21.15.40:0/1660730892 wait complete. 2024-07-26T12:20:14.875 INFO:teuthology.orchestra.run.smithi040.stdout:55834574958 2024-07-26T12:20:14.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-07-26T12:20:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:15 smithi146 ceph-mon[35807]: pgmap v440: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:20:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:15 smithi076 ceph-mon[35401]: pgmap v440: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:20:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:15 smithi040 ceph-mon[32397]: pgmap v440: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:20:15.805 INFO:teuthology.orchestra.run.smithi040.stdout:309237645351 2024-07-26T12:20:15.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 -- 172.21.15.40:0/1264258900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe04104b40 msgr2=0x7efe0410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 --2- 172.21.15.40:0/1264258900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe04104b40 0x7efe0410d090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009900 tx=0x7efdf002a410 comp rx=0 tx=0).stop 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 -- 172.21.15.40:0/1264258900 shutdown_connections 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 --2- 172.21.15.40:0/1264258900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe0410d650 0x7efe0410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 --2- 172.21.15.40:0/1264258900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe04104b40 0x7efe0410d090 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 --2- 172.21.15.40:0/1264258900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe041041f0 0x7efe04104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:15.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 -- 172.21.15.40:0/1264258900 >> 172.21.15.40:0/1264258900 conn(0x7efe040fdcf0 msgr2=0x7efe04100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 -- 172.21.15.40:0/1264258900 shutdown_connections 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.338+0000 7efe03200640 1 -- 172.21.15.40:0/1264258900 wait complete. 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.339+0000 7efe03200640 1 Processor -- start 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.339+0000 7efe03200640 1 -- start start 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe03200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe041041f0 0x7efe0419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe03200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe04104b40 0x7efe0419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe03200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe0410d650 0x7efe041a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe03200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe04103020 con 0x7efe0410d650 2024-07-26T12:20:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe03200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efe04102ea0 con 0x7efe041041f0 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe03200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efe041031a0 con 0x7efe04104b40 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe02800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe0410d650 0x7efe041a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe02800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe0410d650 0x7efe041a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33776/0 (socket says 172.21.15.40:33776) 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.340+0000 7efe02800640 1 -- 172.21.15.40:0/2492755536 learned_addr learned my addr 172.21.15.40:0/2492755536 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe01e00640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe041041f0 0x7efe0419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe01400640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe04104b40 0x7efe0419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe02800640 1 -- 172.21.15.40:0/2492755536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe04104b40 msgr2=0x7efe0419c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe02800640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe04104b40 0x7efe0419c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe02800640 1 -- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe041041f0 msgr2=0x7efe0419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe02800640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe041041f0 0x7efe0419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe02800640 1 -- 172.21.15.40:0/2492755536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe041a1e70 con 0x7efe0410d650 2024-07-26T12:20:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.341+0000 7efe02800640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe0410d650 0x7efe041a1740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efdfc009fd0 tx=0x7efdfc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.342+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc017070 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.342+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe041a2160 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.342+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdfc003e00 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.342+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc010460 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.342+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe041a88c0 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.343+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe04063500 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.346+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7efdfc003970 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.347+0000 7efdfaa00640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efde80b3c60 0x7efde80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.348+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efdfc0e3e10 con 0x7efe0410d650 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.348+0000 7efe01e00640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efde80b3c60 0x7efde80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.348+0000 7efdfaa00640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] conn(0x7efde80bd8e0 0x7efde80bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.348+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 --> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdfc00b0b0 con 0x7efde80bd8e0 2024-07-26T12:20:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.348+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7efdfc0e41c0 con 0x7efe0410d650 2024-07-26T12:20:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.349+0000 7efe01e00640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efde80b3c60 0x7efde80b6170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdf4005fd0 tx=0x7efdf400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.349+0000 7efe01400640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] conn(0x7efde80bd8e0 0x7efde80bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.350+0000 7efe01400640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] conn(0x7efde80bd8e0 0x7efde80bfdd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.353+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== osd.10 v2:172.21.15.76:6824/2195493855 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efdfc00b0b0 con 0x7efde80bd8e0 2024-07-26T12:20:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.368+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 --> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe04063980 con 0x7efde80bd8e0 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.369+0000 7efdfaa00640 1 -- 172.21.15.40:0/2492755536 <== osd.10 v2:172.21.15.76:6824/2195493855 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efe04063980 con 0x7efde80bd8e0 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] conn(0x7efde80bd8e0 msgr2=0x7efde80bfdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] conn(0x7efde80bd8e0 0x7efde80bfdd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efde80b3c60 msgr2=0x7efde80b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efde80b3c60 0x7efde80b6170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdf4005fd0 tx=0x7efdf400b390 comp rx=0 tx=0).stop 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe0410d650 msgr2=0x7efe041a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 --2- 172.21.15.40:0/2492755536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe0410d650 0x7efe041a1740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efdfc009fd0 tx=0x7efdfc00b260 comp rx=0 tx=0).stop 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe02800640 1 -- 172.21.15.40:0/2492755536 reap_dead start 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 shutdown_connections 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.370+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 >> 172.21.15.40:0/2492755536 conn(0x7efe040fdcf0 msgr2=0x7efe04105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.371+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 shutdown_connections 2024-07-26T12:20:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:14.371+0000 7efe03200640 1 -- 172.21.15.40:0/2492755536 wait complete. 2024-07-26T12:20:16.112 INFO:teuthology.orchestra.run.smithi040.stdout:77309411429 2024-07-26T12:20:16.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-07-26T12:20:16.447 INFO:teuthology.orchestra.run.smithi040.stdout:236223201338 2024-07-26T12:20:16.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-07-26T12:20:16.966 INFO:teuthology.orchestra.run.smithi040.stdout:283467841583 2024-07-26T12:20:16.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-07-26T12:20:17.178 INFO:teuthology.orchestra.run.smithi040.stdout:133143986265 2024-07-26T12:20:17.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-07-26T12:20:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:17 smithi040 ceph-mon[32397]: pgmap v441: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-07-26T12:20:17.558 INFO:teuthology.orchestra.run.smithi040.stdout:34359738483 2024-07-26T12:20:17.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-07-26T12:20:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:17 smithi146 ceph-mon[35807]: pgmap v441: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-07-26T12:20:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:17 smithi076 ceph-mon[35401]: pgmap v441: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-07-26T12:20:18.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 -- 172.21.15.40:0/3481752069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 msgr2=0x7fb9501081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 --2- 172.21.15.40:0/3481752069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb9501081e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb938009900 tx=0x7fb93802a420 comp rx=0 tx=0).stop 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 -- 172.21.15.40:0/3481752069 shutdown_connections 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 --2- 172.21.15.40:0/3481752069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb950108720 0x7fb95010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 --2- 172.21.15.40:0/3481752069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb9501081e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 --2- 172.21.15.40:0/3481752069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb950102490 0x7fb9501028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.168+0000 7fb956000640 1 -- 172.21.15.40:0/3481752069 >> 172.21.15.40:0/3481752069 conn(0x7fb950079160 msgr2=0x7fb950079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.169+0000 7fb956000640 1 -- 172.21.15.40:0/3481752069 shutdown_connections 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.169+0000 7fb956000640 1 -- 172.21.15.40:0/3481752069 wait complete. 2024-07-26T12:20:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.173+0000 7fb956000640 1 Processor -- start 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.173+0000 7fb956000640 1 -- start start 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.175+0000 7fb956000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb950102490 0x7fb950074910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.176+0000 7fb956000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb95006dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.176+0000 7fb956000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb950108720 0x7fb95006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.176+0000 7fb956000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb950113380 con 0x7fb950108720 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.176+0000 7fb956000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb950113200 con 0x7fb950102490 2024-07-26T12:20:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.176+0000 7fb956000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb950113500 con 0x7fb950107dd0 2024-07-26T12:20:18.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb95006dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:18.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb95006dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:35066/0 (socket says 172.21.15.40:35066) 2024-07-26T12:20:18.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94ea00640 1 -- 172.21.15.40:0/3935703376 learned_addr learned my addr 172.21.15.40:0/3935703376 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:18.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94fe00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb950108720 0x7fb95006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94ea00640 1 -- 172.21.15.40:0/3935703376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb950102490 msgr2=0x7fb950074910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-26T12:20:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94ea00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb950102490 0x7fb950074910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.177+0000 7fb94ea00640 1 -- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb950108720 msgr2=0x7fb95006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.178+0000 7fb94ea00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb950108720 0x7fb95006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.178+0000 7fb94ea00640 1 -- 172.21.15.40:0/3935703376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95006ea00 con 0x7fb950107dd0 2024-07-26T12:20:18.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.178+0000 7fb94ea00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb95006dbe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb938006010 tx=0x7fb938004970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:18.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.179+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938040070 con 0x7fb950107dd0 2024-07-26T12:20:18.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.179+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb950073640 con 0x7fb950107dd0 2024-07-26T12:20:18.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.179+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb950073c50 con 0x7fb950107dd0 2024-07-26T12:20:18.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.181+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9500742c0 con 0x7fb950107dd0 2024-07-26T12:20:18.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.183+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb938004d70 con 0x7fb950107dd0 2024-07-26T12:20:18.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.183+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93803c430 con 0x7fb950107dd0 2024-07-26T12:20:18.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.191+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb938043070 con 0x7fb950107dd0 2024-07-26T12:20:18.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.197+0000 7fb947e00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9340b8170 0x7fb9340ba680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:18.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.197+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb938104a90 con 0x7fb950107dd0 2024-07-26T12:20:18.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.198+0000 7fb94f400640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9340b8170 0x7fb9340ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:18.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.198+0000 7fb947e00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] conn(0x7fb9340c1df0 0x7fb9340c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:18.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.198+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 --> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9340c49b0 con 0x7fb9340c1df0 2024-07-26T12:20:18.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.198+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb938104e80 con 0x7fb950107dd0 2024-07-26T12:20:18.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.199+0000 7fb94fe00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] conn(0x7fb9340c1df0 0x7fb9340c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:18.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.200+0000 7fb94f400640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9340b8170 0x7fb9340ba680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb948005fd0 tx=0x7fb948009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:18.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.202+0000 7fb94fe00640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] conn(0x7fb9340c1df0 0x7fb9340c42e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:18.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.204+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== osd.3 v2:172.21.15.40:6810/2975278630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb9340c49b0 con 0x7fb9340c1df0 2024-07-26T12:20:18.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.241+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 --> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb950063480 con 0x7fb9340c1df0 2024-07-26T12:20:18.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.242+0000 7fb947e00640 1 -- 172.21.15.40:0/3935703376 <== osd.3 v2:172.21.15.40:6810/2975278630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb950063480 con 0x7fb9340c1df0 2024-07-26T12:20:18.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.245+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] conn(0x7fb9340c1df0 msgr2=0x7fb9340c42e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.245+0000 7fb956000640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] conn(0x7fb9340c1df0 0x7fb9340c42e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9340b8170 msgr2=0x7fb9340ba680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9340b8170 0x7fb9340ba680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb948005fd0 tx=0x7fb948009500 comp rx=0 tx=0).stop 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 msgr2=0x7fb95006dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 --2- 172.21.15.40:0/3935703376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb950107dd0 0x7fb95006dbe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb938006010 tx=0x7fb938004970 comp rx=0 tx=0).stop 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb94fe00640 1 -- 172.21.15.40:0/3935703376 reap_dead start 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 shutdown_connections 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 >> 172.21.15.40:0/3935703376 conn(0x7fb950079160 msgr2=0x7fb950104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 shutdown_connections 2024-07-26T12:20:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:18.246+0000 7fb956000640 1 -- 172.21.15.40:0/3935703376 wait complete. 2024-07-26T12:20:18.643 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.643 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.798 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.806 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.806 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:19.184 INFO:teuthology.orchestra.run.smithi040.stdout:107374182495 2024-07-26T12:20:19.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-07-26T12:20:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:19 smithi076 ceph-mon[35401]: pgmap v442: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:19 smithi146 ceph-mon[35807]: pgmap v442: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:19.620 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:19 smithi040 ceph-mon[32397]: pgmap v442: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:21 smithi040 ceph-mon[32397]: pgmap v443: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:21 smithi076 ceph-mon[35401]: pgmap v443: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:21 smithi146 ceph-mon[35807]: pgmap v443: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:23.410 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:23 smithi040 ceph-mon[32397]: pgmap v444: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:23 smithi076 ceph-mon[35401]: pgmap v444: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:23 smithi146 ceph-mon[35807]: pgmap v444: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:25.715 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:25 smithi040 ceph-mon[32397]: pgmap v445: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:25 smithi146 ceph-mon[35807]: pgmap v445: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:25 smithi076 ceph-mon[35401]: pgmap v445: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.887+0000 7f1899200640 1 -- 172.21.15.40:0/3797641926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1894109670 msgr2=0x7f189410fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.887+0000 7f1899200640 1 --2- 172.21.15.40:0/3797641926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1894109670 0x7f189410fea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f188c009900 tx=0x7f188c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 -- 172.21.15.40:0/3797641926 shutdown_connections 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 --2- 172.21.15.40:0/3797641926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1894109670 0x7f189410fea0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 --2- 172.21.15.40:0/3797641926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 0x7f1894109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 --2- 172.21.15.40:0/3797641926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18941033e0 0x7f18941037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 -- 172.21.15.40:0/3797641926 >> 172.21.15.40:0/3797641926 conn(0x7f18940fee70 msgr2=0x7f18941012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 -- 172.21.15.40:0/3797641926 shutdown_connections 2024-07-26T12:20:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.888+0000 7f1899200640 1 -- 172.21.15.40:0/3797641926 wait complete. 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.889+0000 7f1899200640 1 Processor -- start 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.889+0000 7f1899200640 1 -- start start 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1899200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 0x7f189419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1899200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 0x7f189419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1899200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1894109670 0x7f18941a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1899200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1894113220 con 0x7f18941033e0 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1899200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f18941130a0 con 0x7f1894108d20 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1899200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18941133a0 con 0x7f1894109670 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1893400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 0x7f189419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1893400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 0x7f189419be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45554/0 (socket says 172.21.15.40:45554) 2024-07-26T12:20:27.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1893400640 1 -- 172.21.15.40:0/4289271875 learned_addr learned my addr 172.21.15.40:0/4289271875 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.890+0000 7f1892a00640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 0x7f189419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893e00640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1894109670 0x7f18941a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893400640 1 -- 172.21.15.40:0/4289271875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1894109670 msgr2=0x7f18941a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893400640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1894109670 0x7f18941a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893400640 1 -- 172.21.15.40:0/4289271875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 msgr2=0x7f189419c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893400640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 0x7f189419c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893400640 1 -- 172.21.15.40:0/4289271875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18941a1d00 con 0x7f18941033e0 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1892a00640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 0x7f189419c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f1893400640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 0x7f189419be50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f188400c890 tx=0x7f188400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:27.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.891+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884004220 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.892+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1884007e40 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.892+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18941a1ff0 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.892+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884004a00 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.892+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941a8810 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.893+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18941037f0 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.895+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f18840079b0 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.897+0000 7f188be00640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f18740b3d10 0x7f18740b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.897+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f18840e3ed0 con 0x7f18941033e0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.897+0000 7f1892a00640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f18740b3d10 0x7f18740b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.898+0000 7f1892a00640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f18740b3d10 0x7f18740b6220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f187c007350 tx=0x7f187c0072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:27.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:26.899+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1884014030 con 0x7f18941033e0 2024-07-26T12:20:27.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.111+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f18941a8b80 con 0x7f18941033e0 2024-07-26T12:20:27.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.111+0000 7f188be00640 1 -- 172.21.15.40:0/4289271875 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f18840ab400 con 0x7f18941033e0 2024-07-26T12:20:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:133143986268 2024-07-26T12:20:27.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f18740b3d10 msgr2=0x7f18740b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:27.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f18740b3d10 0x7f18740b6220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f187c007350 tx=0x7f187c0072e0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 msgr2=0x7f189419be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 0x7f189419be50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f188400c890 tx=0x7f188400cd50 comp rx=0 tx=0).stop 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 shutdown_connections 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f18740b3d10 0x7f18740b6220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1894109670 0x7f18941a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1894108d20 0x7f189419c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 --2- 172.21.15.40:0/4289271875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18941033e0 0x7f189419be50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.114+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 >> 172.21.15.40:0/4289271875 conn(0x7f18940fee70 msgr2=0x7f189410e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:27.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.115+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 shutdown_connections 2024-07-26T12:20:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:27.115+0000 7f1899200640 1 -- 172.21.15.40:0/4289271875 wait complete. 2024-07-26T12:20:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:27 smithi040 ceph-mon[32397]: pgmap v446: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:27 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4289271875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-26T12:20:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:27 smithi146 ceph-mon[35807]: pgmap v446: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:27 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4289271875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-26T12:20:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:27 smithi076 ceph-mon[35401]: pgmap v446: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:27 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4289271875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-07-26T12:20:29.610 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:29.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:29 smithi040 ceph-mon[32397]: pgmap v447: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-07-26T12:20:29.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:29 smithi040 ceph-mon[32397]: mgrmap e18: x(active, since 12m), standbys: z, y 2024-07-26T12:20:29.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:20:29.757 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:29 smithi076 ceph-mon[35401]: pgmap v447: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-07-26T12:20:29.757 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:29 smithi076 ceph-mon[35401]: mgrmap e18: x(active, since 12m), standbys: z, y 2024-07-26T12:20:29.757 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:20:29.761 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:29 smithi146 ceph-mon[35807]: pgmap v447: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-07-26T12:20:29.761 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:29 smithi146 ceph-mon[35807]: mgrmap e18: x(active, since 12m), standbys: z, y 2024-07-26T12:20:29.762 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:20:29.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.897+0000 7f034b200640 1 -- 172.21.15.40:0/1216920832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c075800 msgr2=0x7f034c075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:29.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.897+0000 7f034b200640 1 --2- 172.21.15.40:0/1216920832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c075800 0x7f034c075c10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0334009900 tx=0x7f033402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 -- 172.21.15.40:0/1216920832 shutdown_connections 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 --2- 172.21.15.40:0/1216920832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f034c113cb0 0x7f034c116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 --2- 172.21.15.40:0/1216920832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c075800 0x7f034c075c10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 --2- 172.21.15.40:0/1216920832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f034c076db0 0x7f034c0751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 -- 172.21.15.40:0/1216920832 >> 172.21.15.40:0/1216920832 conn(0x7f034c0fee70 msgr2=0x7f034c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 -- 172.21.15.40:0/1216920832 shutdown_connections 2024-07-26T12:20:29.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.898+0000 7f034b200640 1 -- 172.21.15.40:0/1216920832 wait complete. 2024-07-26T12:20:29.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.899+0000 7f034b200640 1 Processor -- start 2024-07-26T12:20:29.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.899+0000 7f034b200640 1 -- start start 2024-07-26T12:20:29.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f034b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f034c075800 0x7f034c1a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:29.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f034b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 0x7f034c1a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:29.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f034b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f034c113cb0 0x7f034c1a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:29.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f034b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1197a0 con 0x7f034c076db0 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f034b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f034c119620 con 0x7f034c075800 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f034b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f034c119920 con 0x7f034c113cb0 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f0341400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 0x7f034c1a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f0341400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 0x7f034c1a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45574/0 (socket says 172.21.15.40:45574) 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f0341400640 1 -- 172.21.15.40:0/3802621010 learned_addr learned my addr 172.21.15.40:0/3802621010 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.900+0000 7f0349e00640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f034c075800 0x7f034c1a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f034a800640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f034c113cb0 0x7f034c1a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f0341400640 1 -- 172.21.15.40:0/3802621010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f034c113cb0 msgr2=0x7f034c1a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f0341400640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f034c113cb0 0x7f034c1a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f0341400640 1 -- 172.21.15.40:0/3802621010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f034c075800 msgr2=0x7f034c1a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f0341400640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f034c075800 0x7f034c1a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f0341400640 1 -- 172.21.15.40:0/3802621010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c1a6100 con 0x7f034c076db0 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.901+0000 7f0341400640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 0x7f034c1a07f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0334005940 tx=0x7f03340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.902+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033403f030 con 0x7f034c076db0 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.902+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0334003c90 con 0x7f034c076db0 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.902+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0334035070 con 0x7f034c076db0 2024-07-26T12:20:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.902+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c1a6390 con 0x7f034c076db0 2024-07-26T12:20:29.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.902+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c1a6820 con 0x7f034c076db0 2024-07-26T12:20:29.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.903+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034c075c10 con 0x7f034c076db0 2024-07-26T12:20:29.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.906+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0334042030 con 0x7f034c076db0 2024-07-26T12:20:29.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.907+0000 7f0343400640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03300b3c80 0x7f03300b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:29.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.907+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0334104070 con 0x7f034c076db0 2024-07-26T12:20:29.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.907+0000 7f0349e00640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03300b3c80 0x7f03300b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.908+0000 7f0349e00640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03300b3c80 0x7f03300b6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f033c005fd0 tx=0x7f033c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:29.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:29.911+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f03340cb680 con 0x7f034c076db0 2024-07-26T12:20:30.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.122+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f034c112a40 con 0x7f034c076db0 2024-07-26T12:20:30.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.123+0000 7f0343400640 1 -- 172.21.15.40:0/3802621010 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f03340caf80 con 0x7f034c076db0 2024-07-26T12:20:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:283467841585 2024-07-26T12:20:30.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03300b3c80 msgr2=0x7f03300b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:30.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03300b3c80 0x7f03300b6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f033c005fd0 tx=0x7f033c009680 comp rx=0 tx=0).stop 2024-07-26T12:20:30.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 msgr2=0x7f034c1a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:30.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 0x7f034c1a07f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0334005940 tx=0x7f03340042f0 comp rx=0 tx=0).stop 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 shutdown_connections 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03300b3c80 0x7f03300b6190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f034c113cb0 0x7f034c1a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f034c076db0 0x7f034c1a07f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 --2- 172.21.15.40:0/3802621010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f034c075800 0x7f034c1a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.126+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 >> 172.21.15.40:0/3802621010 conn(0x7f034c0fee70 msgr2=0x7f034c10fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.127+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 shutdown_connections 2024-07-26T12:20:30.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.127+0000 7f034b200640 1 -- 172.21.15.40:0/3802621010 wait complete. 2024-07-26T12:20:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:30 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3802621010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-26T12:20:30.744 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986265 got 133143986268 for osd.4 2024-07-26T12:20:30.744 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:30 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3802621010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-26T12:20:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:30 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3802621010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-07-26T12:20:31.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:31 smithi040 ceph-mon[32397]: pgmap v448: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:31.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:31 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/800447207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-26T12:20:31.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:31 smithi146 ceph-mon[35807]: pgmap v448: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:31 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/800447207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-26T12:20:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:31 smithi076 ceph-mon[35401]: pgmap v448: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:31 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/800447207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-07-26T12:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 -- 172.21.15.40:0/2178728048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010af10 msgr2=0x7f42b010b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 --2- 172.21.15.40:0/2178728048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010af10 0x7f42b010b320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009900 tx=0x7f42a002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 -- 172.21.15.40:0/2178728048 shutdown_connections 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 --2- 172.21.15.40:0/2178728048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b010b860 0x7f42b0112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 --2- 172.21.15.40:0/2178728048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010af10 0x7f42b010b320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 --2- 172.21.15.40:0/2178728048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42b01055d0 0x7f42b01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.435+0000 7f42afe00640 1 -- 172.21.15.40:0/2178728048 >> 172.21.15.40:0/2178728048 conn(0x7f42b0101040 msgr2=0x7f42b0103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.436+0000 7f42afe00640 1 -- 172.21.15.40:0/2178728048 shutdown_connections 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.436+0000 7f42afe00640 1 -- 172.21.15.40:0/2178728048 wait complete. 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.437+0000 7f42afe00640 1 Processor -- start 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.437+0000 7f42afe00640 1 -- start start 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42afe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 0x7f42b019be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42afe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42b010af10 0x7f42b019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010b860 0x7f42b01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42afe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42b01153f0 con 0x7f42b01055d0 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42afe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42b0115270 con 0x7f42b010af10 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42afe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42b0115570 con 0x7f42b010b860 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42aea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 0x7f42b019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42aea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 0x7f42b019be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45584/0 (socket says 172.21.15.40:45584) 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.438+0000 7f42aea00640 1 -- 172.21.15.40:0/800447207 learned_addr learned my addr 172.21.15.40:0/800447207 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42ae000640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42b010af10 0x7f42b019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42af400640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010b860 0x7f42b01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42aea00640 1 -- 172.21.15.40:0/800447207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010b860 msgr2=0x7f42b01a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42aea00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010b860 0x7f42b01a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42aea00640 1 -- 172.21.15.40:0/800447207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42b010af10 msgr2=0x7f42b019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42aea00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42b010af10 0x7f42b019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42aea00640 1 -- 172.21.15.40:0/800447207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b01a1df0 con 0x7f42b01055d0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.439+0000 7f42aea00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 0x7f42b019be80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f429800d770 tx=0x7f429800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.440+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298017070 con 0x7f42b01055d0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.440+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4298009820 con 0x7f42b01055d0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.440+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b01a20e0 con 0x7f42b01055d0 2024-07-26T12:20:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.440+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298004b20 con 0x7f42b01055d0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.440+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b01a8840 con 0x7f42b01055d0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.441+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b01059e0 con 0x7f42b01055d0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.444+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f42980099d0 con 0x7f42b01055d0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.446+0000 7f42a7400640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42940b3c50 0x7f42940b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.446+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42980e3520 con 0x7f42b01055d0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.446+0000 7f42ae000640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42940b3c50 0x7f42940b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.447+0000 7f42ae000640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42940b3c50 0x7f42940b6160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42a002a910 tx=0x7f42a0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.449+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f42980aab30 con 0x7f42b01055d0 2024-07-26T12:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.661+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f42b002e0c0 con 0x7f42b01055d0 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:309237645356 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.661+0000 7f42a7400640 1 -- 172.21.15.40:0/800447207 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f42980aa430 con 0x7f42b01055d0 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42940b3c50 msgr2=0x7f42940b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42940b3c50 0x7f42940b6160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42a002a910 tx=0x7f42a0005a40 comp rx=0 tx=0).stop 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 msgr2=0x7f42b019be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 0x7f42b019be80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f429800d770 tx=0x7f429800db70 comp rx=0 tx=0).stop 2024-07-26T12:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 shutdown_connections 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42940b3c50 0x7f42940b6160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b010b860 0x7f42b01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42b010af10 0x7f42b019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 --2- 172.21.15.40:0/800447207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42b01055d0 0x7f42b019be80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.664+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 >> 172.21.15.40:0/800447207 conn(0x7f42b0101040 msgr2=0x7f42b0103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.665+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 shutdown_connections 2024-07-26T12:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:30.665+0000 7f42afe00640 1 -- 172.21.15.40:0/800447207 wait complete. 2024-07-26T12:20:32.919 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645351 got 309237645356 for osd.11 2024-07-26T12:20:32.920 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:33 smithi040 ceph-mon[32397]: pgmap v449: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-07-26T12:20:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:33 smithi146 ceph-mon[35807]: pgmap v449: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-07-26T12:20:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:33 smithi076 ceph-mon[35401]: pgmap v449: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-07-26T12:20:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2921020837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075160 msgr2=0x7fd7f4075570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2921020837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075160 0x7fd7f4075570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009900 tx=0x7fd7e402a410 comp rx=0 tx=0).stop 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2921020837 shutdown_connections 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2921020837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f410fb70 0x7fd7f4111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2921020837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7f4075ab0 0x7fd7f410f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2921020837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075160 0x7fd7f4075570 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2921020837 >> 172.21.15.40:0/2921020837 conn(0x7fd7f407b280 msgr2=0x7fd7f407b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2921020837 shutdown_connections 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.474+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2921020837 wait complete. 2024-07-26T12:20:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 Processor -- start 2024-07-26T12:20:34.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 -- start start 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7f4075160 0x7fd7f419c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 0x7fd7f419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f410fb70 0x7fd7f41a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41155e0 con 0x7fd7f4075ab0 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4115460 con 0x7fd7f4075160 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.476+0000 7fd7f9a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4115760 con 0x7fd7f410fb70 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 0x7fd7f419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 0x7fd7f419c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37242/0 (socket says 172.21.15.40:37242) 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 -- 172.21.15.40:0/2509506430 learned_addr learned my addr 172.21.15.40:0/2509506430 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7f4075160 0x7fd7f419c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 -- 172.21.15.40:0/2509506430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f410fb70 msgr2=0x7fd7f41a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f410fb70 0x7fd7f41a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 -- 172.21.15.40:0/2509506430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7f4075160 msgr2=0x7fd7f419c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7f4075160 0x7fd7f419c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.477+0000 7fd7f2000640 1 -- 172.21.15.40:0/2509506430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f41a1fc0 con 0x7fd7f4075ab0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.478+0000 7fd7f2000640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 0x7fd7f419c5f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000c970 tx=0x7fd7e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.478+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0007bb0 con 0x7fd7f4075ab0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.478+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f41a22b0 con 0x7fd7f4075ab0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.478+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7e0007d50 con 0x7fd7f4075ab0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.478+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f41a8a90 con 0x7fd7f4075ab0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.478+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0004d40 con 0x7fd7f4075ab0 2024-07-26T12:20:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.480+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f4075570 con 0x7fd7f4075ab0 2024-07-26T12:20:34.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.483+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd7e0005000 con 0x7fd7f4075ab0 2024-07-26T12:20:34.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.484+0000 7fd7eb400640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd7d80b3bd0 0x7fd7d80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:34.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.485+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd7e00e39c0 con 0x7fd7f4075ab0 2024-07-26T12:20:34.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.485+0000 7fd7f2a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd7d80b3bd0 0x7fd7d80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:34.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.486+0000 7fd7f2a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd7d80b3bd0 0x7fd7d80b60e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4000c00 tx=0x7fd7e4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:34.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.489+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd7e0014030 con 0x7fd7f4075ab0 2024-07-26T12:20:34.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.691+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd7f419d180 con 0x7fd7f4075ab0 2024-07-26T12:20:34.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.692+0000 7fd7eb400640 1 -- 172.21.15.40:0/2509506430 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd7e00aafd0 con 0x7fd7f4075ab0 2024-07-26T12:20:34.694 INFO:teuthology.orchestra.run.smithi040.stdout:184683593805 2024-07-26T12:20:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.694+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd7d80b3bd0 msgr2=0x7fd7d80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.694+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd7d80b3bd0 0x7fd7d80b60e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4000c00 tx=0x7fd7e4009680 comp rx=0 tx=0).stop 2024-07-26T12:20:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.694+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 msgr2=0x7fd7f419c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.694+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 0x7fd7f419c5f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000c970 tx=0x7fd7e000ce30 comp rx=0 tx=0).stop 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 shutdown_connections 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd7d80b3bd0 0x7fd7d80b60e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f410fb70 0x7fd7f41a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f4075ab0 0x7fd7f419c5f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 --2- 172.21.15.40:0/2509506430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7f4075160 0x7fd7f419c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 >> 172.21.15.40:0/2509506430 conn(0x7fd7f407b280 msgr2=0x7fd7f4100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.695+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 shutdown_connections 2024-07-26T12:20:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:34.696+0000 7fd7f9a00640 1 -- 172.21.15.40:0/2509506430 wait complete. 2024-07-26T12:20:35.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:35 smithi040 ceph-mon[32397]: pgmap v450: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:35.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:35 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2509506430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-26T12:20:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:35 smithi146 ceph-mon[35807]: pgmap v450: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:35 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2509506430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-26T12:20:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:35 smithi076 ceph-mon[35401]: pgmap v450: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:35 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2509506430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 -- 172.21.15.40:0/815496860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe690104270 msgr2=0x7fe690104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 --2- 172.21.15.40:0/815496860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe690104270 0x7fe690104680 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe680009900 tx=0x7fe68002a410 comp rx=0 tx=0).stop 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 -- 172.21.15.40:0/815496860 shutdown_connections 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 --2- 172.21.15.40:0/815496860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe69010d820 0x7fe69010fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 --2- 172.21.15.40:0/815496860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104ca0 0x7fe69010d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 --2- 172.21.15.40:0/815496860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe690104270 0x7fe690104680 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 -- 172.21.15.40:0/815496860 >> 172.21.15.40:0/815496860 conn(0x7fe690079160 msgr2=0x7fe690079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:36.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 -- 172.21.15.40:0/815496860 shutdown_connections 2024-07-26T12:20:36.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.262+0000 7fe695400640 1 -- 172.21.15.40:0/815496860 wait complete. 2024-07-26T12:20:36.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.263+0000 7fe695400640 1 Processor -- start 2024-07-26T12:20:36.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.263+0000 7fe695400640 1 -- start start 2024-07-26T12:20:36.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe695400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104270 0x7fe690102180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe695400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe690104ca0 0x7fe6901026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe695400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 0x7fe690102c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe695400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe690113380 con 0x7fe69010d820 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe695400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe690113200 con 0x7fe690104ca0 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe695400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe690113500 con 0x7fe690104270 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe68f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 0x7fe690102c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe68f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 0x7fe690102c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37250/0 (socket says 172.21.15.40:37250) 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe68f200640 1 -- 172.21.15.40:0/296626033 learned_addr learned my addr 172.21.15.40:0/296626033 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe68e800640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104270 0x7fe690102180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.264+0000 7fe68de00640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe690104ca0 0x7fe6901026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68f200640 1 -- 172.21.15.40:0/296626033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104270 msgr2=0x7fe690102180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68f200640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104270 0x7fe690102180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68f200640 1 -- 172.21.15.40:0/296626033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe690104ca0 msgr2=0x7fe6901026c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68f200640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe690104ca0 0x7fe6901026c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68f200640 1 -- 172.21.15.40:0/296626033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a8120 con 0x7fe69010d820 2024-07-26T12:20:36.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68e800640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104270 0x7fe690102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:36.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe68f200640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 0x7fe690102c00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe68800cce0 tx=0x7fe68800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:36.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.265+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68800f450 con 0x7fe69010d820 2024-07-26T12:20:36.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.266+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe68800fa80 con 0x7fe69010d820 2024-07-26T12:20:36.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.266+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a8410 con 0x7fe69010d820 2024-07-26T12:20:36.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.266+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688018ad0 con 0x7fe69010d820 2024-07-26T12:20:36.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.266+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a8900 con 0x7fe69010d820 2024-07-26T12:20:36.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.267+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe690104680 con 0x7fe69010d820 2024-07-26T12:20:36.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.270+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe68800f5f0 con 0x7fe69010d820 2024-07-26T12:20:36.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.271+0000 7fe687400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3bd0 0x7fe6740b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.271+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6880e4510 con 0x7fe69010d820 2024-07-26T12:20:36.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.271+0000 7fe68e800640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3bd0 0x7fe6740b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.272+0000 7fe68e800640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3bd0 0x7fe6740b60e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6800057c0 tx=0x7fe680005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:36.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.273+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe688014030 con 0x7fe69010d820 2024-07-26T12:20:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.488+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe690108410 con 0x7fe69010d820 2024-07-26T12:20:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.489+0000 7fe687400640 1 -- 172.21.15.40:0/296626033 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe6880abbb0 con 0x7fe69010d820 2024-07-26T12:20:36.491 INFO:teuthology.orchestra.run.smithi040.stdout:34359738488 2024-07-26T12:20:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.491+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3bd0 msgr2=0x7fe6740b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.491+0000 7fe695400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3bd0 0x7fe6740b60e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6800057c0 tx=0x7fe680005de0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.491+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 msgr2=0x7fe690102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.491+0000 7fe695400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 0x7fe690102c00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe68800cce0 tx=0x7fe68800a620 comp rx=0 tx=0).stop 2024-07-26T12:20:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.492+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 shutdown_connections 2024-07-26T12:20:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.492+0000 7fe695400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010d820 0x7fe690102c00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.492+0000 7fe695400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe690104ca0 0x7fe6901026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.492+0000 7fe695400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3bd0 0x7fe6740b60e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.492+0000 7fe695400640 1 --2- 172.21.15.40:0/296626033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe690104270 0x7fe690102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.492+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 >> 172.21.15.40:0/296626033 conn(0x7fe690079160 msgr2=0x7fe6900ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.493+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 shutdown_connections 2024-07-26T12:20:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.493+0000 7fe695400640 1 -- 172.21.15.40:0/296626033 wait complete. 2024-07-26T12:20:36.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 -- 172.21.15.40:0/1766161097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0108ed0 msgr2=0x7f65c01092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1766161097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0108ed0 0x7f65c01092e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009900 tx=0x7f65ac02a410 comp rx=0 tx=0).stop 2024-07-26T12:20:36.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 -- 172.21.15.40:0/1766161097 shutdown_connections 2024-07-26T12:20:36.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1766161097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65c0109820 0x7f65c0110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1766161097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0108ed0 0x7f65c01092e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1766161097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65c0103590 0x7f65c01039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 -- 172.21.15.40:0/1766161097 >> 172.21.15.40:0/1766161097 conn(0x7f65c007b280 msgr2=0x7f65c007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:36.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 -- 172.21.15.40:0/1766161097 shutdown_connections 2024-07-26T12:20:36.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.568+0000 7f65c5a00640 1 -- 172.21.15.40:0/1766161097 wait complete. 2024-07-26T12:20:36.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.570+0000 7f65c5a00640 1 Processor -- start 2024-07-26T12:20:36.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.570+0000 7f65c5a00640 1 -- start start 2024-07-26T12:20:36.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.570+0000 7f65c5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 0x7f65c01a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.570+0000 7f65c5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65c0108ed0 0x7f65c01a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65c5a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65c0109820 0x7f65c01ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65c5a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0113390 con 0x7f65c0103590 2024-07-26T12:20:36.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65c5a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0113210 con 0x7f65c0109820 2024-07-26T12:20:36.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65c5a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65c0113510 con 0x7f65c0108ed0 2024-07-26T12:20:36.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65bea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 0x7f65c01a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65bea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 0x7f65c01a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37268/0 (socket says 172.21.15.40:37268) 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65bea00640 1 -- 172.21.15.40:0/1031226741 learned_addr learned my addr 172.21.15.40:0/1031226741 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65bf400640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65c0109820 0x7f65c01ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.571+0000 7f65be000640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65c0108ed0 0x7f65c01a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.572+0000 7f65bea00640 1 -- 172.21.15.40:0/1031226741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65c0108ed0 msgr2=0x7f65c01a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.572+0000 7f65bea00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65c0108ed0 0x7f65c01a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.572+0000 7f65bea00640 1 -- 172.21.15.40:0/1031226741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65c0109820 msgr2=0x7f65c01ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.572+0000 7f65bea00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65c0109820 0x7f65c01ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.572+0000 7f65bea00640 1 -- 172.21.15.40:0/1031226741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c01ac630 con 0x7f65c0103590 2024-07-26T12:20:36.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.572+0000 7f65bea00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 0x7f65c01a1070 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65b000d950 tx=0x7f65b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:36.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.573+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0017070 con 0x7f65c0103590 2024-07-26T12:20:36.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.573+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65b0009c30 con 0x7f65c0103590 2024-07-26T12:20:36.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.573+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c01ac800 con 0x7f65c0103590 2024-07-26T12:20:36.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.573+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b000f620 con 0x7f65c0103590 2024-07-26T12:20:36.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.573+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c01accb0 con 0x7f65c0103590 2024-07-26T12:20:36.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.574+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c0104810 con 0x7f65c0103590 2024-07-26T12:20:36.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.577+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f65b0010460 con 0x7f65c0103590 2024-07-26T12:20:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.578+0000 7f65b7400640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65a40b3bd0 0x7f65a40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.579+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65b00e3870 con 0x7f65c0103590 2024-07-26T12:20:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.579+0000 7f65be000640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65a40b3bd0 0x7f65a40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:36.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.580+0000 7f65be000640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65a40b3bd0 0x7f65a40b60e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65ac02a930 tx=0x7f65ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.580+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f65b00aae80 con 0x7f65c0103590 2024-07-26T12:20:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.789+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f65c01ad040 con 0x7f65c0103590 2024-07-26T12:20:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.790+0000 7f65b7400640 1 -- 172.21.15.40:0/1031226741 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f65b00aa780 con 0x7f65c0103590 2024-07-26T12:20:36.792 INFO:teuthology.orchestra.run.smithi040.stdout:158913790037 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.792+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65a40b3bd0 msgr2=0x7f65a40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.792+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65a40b3bd0 0x7f65a40b60e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65ac02a930 tx=0x7f65ac000bc0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.792+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 msgr2=0x7f65c01a1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.792+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 0x7f65c01a1070 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65b000d950 tx=0x7f65b000de10 comp rx=0 tx=0).stop 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 shutdown_connections 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65c0109820 0x7f65c01ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65a40b3bd0 0x7f65a40b60e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65c0108ed0 0x7f65c01a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 --2- 172.21.15.40:0/1031226741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65c0103590 0x7f65c01a1070 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 >> 172.21.15.40:0/1031226741 conn(0x7f65c007b280 msgr2=0x7f65c0106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 shutdown_connections 2024-07-26T12:20:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:36.793+0000 7f65c5a00640 1 -- 172.21.15.40:0/1031226741 wait complete. 2024-07-26T12:20:37.167 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841583 got 283467841585 for osd.10 2024-07-26T12:20:37.168 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:37 smithi040 ceph-mon[32397]: pgmap v451: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:37 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/296626033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-26T12:20:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:37 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1031226741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-26T12:20:37.797 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738483 got 34359738488 for osd.0 2024-07-26T12:20:37.797 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:37 smithi146 ceph-mon[35807]: pgmap v451: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:37 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/296626033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-26T12:20:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:37 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1031226741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-26T12:20:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:37 smithi076 ceph-mon[35401]: pgmap v451: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:37 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/296626033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-07-26T12:20:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:37 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1031226741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-07-26T12:20:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 -- 172.21.15.40:0/769775496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c1033e0 msgr2=0x7fdf4c1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 --2- 172.21.15.40:0/769775496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c1037f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009900 tx=0x7fdf3c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 -- 172.21.15.40:0/769775496 shutdown_connections 2024-07-26T12:20:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 --2- 172.21.15.40:0/769775496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf4c109670 0x7fdf4c10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 --2- 172.21.15.40:0/769775496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c108d20 0x7fdf4c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 --2- 172.21.15.40:0/769775496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c1037f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 -- 172.21.15.40:0/769775496 >> 172.21.15.40:0/769775496 conn(0x7fdf4c0fee70 msgr2=0x7fdf4c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 -- 172.21.15.40:0/769775496 shutdown_connections 2024-07-26T12:20:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.586+0000 7fdf51400640 1 -- 172.21.15.40:0/769775496 wait complete. 2024-07-26T12:20:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.587+0000 7fdf51400640 1 Processor -- start 2024-07-26T12:20:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.587+0000 7fdf51400640 1 -- start start 2024-07-26T12:20:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf51400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf51400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf4c108d20 0x7fdf4c19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf51400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 0x7fdf4c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf51400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c1131d0 con 0x7fdf4c109670 2024-07-26T12:20:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf51400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c113050 con 0x7fdf4c1033e0 2024-07-26T12:20:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf51400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c113350 con 0x7fdf4c108d20 2024-07-26T12:20:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf50a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 0x7fdf4c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf50a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 0x7fdf4c1a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37294/0 (socket says 172.21.15.40:37294) 2024-07-26T12:20:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf50a00640 1 -- 172.21.15.40:0/2398456398 learned_addr learned my addr 172.21.15.40:0/2398456398 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.588+0000 7fdf4be00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf43400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf4c108d20 0x7fdf4c19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf50a00640 1 -- 172.21.15.40:0/2398456398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf4c108d20 msgr2=0x7fdf4c19c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf50a00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf4c108d20 0x7fdf4c19c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf50a00640 1 -- 172.21.15.40:0/2398456398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c1033e0 msgr2=0x7fdf4c19bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf50a00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c19bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf50a00640 1 -- 172.21.15.40:0/2398456398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c1a1d50 con 0x7fdf4c109670 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf4be00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.589+0000 7fdf50a00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 0x7fdf4c1a16e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400cad0 tx=0x7fdf4400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.590+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400ad60 con 0x7fdf4c109670 2024-07-26T12:20:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.590+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf44005020 con 0x7fdf4c109670 2024-07-26T12:20:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.590+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c1a2040 con 0x7fdf4c109670 2024-07-26T12:20:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.590+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400f6b0 con 0x7fdf4c109670 2024-07-26T12:20:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.590+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c1a8860 con 0x7fdf4c109670 2024-07-26T12:20:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.591+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c1037f0 con 0x7fdf4c109670 2024-07-26T12:20:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.594+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdf440051d0 con 0x7fdf4c109670 2024-07-26T12:20:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.595+0000 7fdf49600640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf300b3c80 0x7fdf300b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.596+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf440e3f50 con 0x7fdf4c109670 2024-07-26T12:20:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.596+0000 7fdf4be00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf300b3c80 0x7fdf300b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.597+0000 7fdf4be00640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf300b3c80 0x7fdf300b6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c000c00 tx=0x7fdf3c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.600+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdf44014030 con 0x7fdf4c109670 2024-07-26T12:20:38.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.808+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdf4c1a8b40 con 0x7fdf4c109670 2024-07-26T12:20:38.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.809+0000 7fdf49600640 1 -- 172.21.15.40:0/2398456398 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf440ab560 con 0x7fdf4c109670 2024-07-26T12:20:38.811 INFO:teuthology.orchestra.run.smithi040.stdout:77309411434 2024-07-26T12:20:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf300b3c80 msgr2=0x7fdf300b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf300b3c80 0x7fdf300b6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c000c00 tx=0x7fdf3c005a20 comp rx=0 tx=0).stop 2024-07-26T12:20:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 msgr2=0x7fdf4c1a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 0x7fdf4c1a16e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400cad0 tx=0x7fdf4400ced0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 shutdown_connections 2024-07-26T12:20:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf4c109670 0x7fdf4c1a16e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf300b3c80 0x7fdf300b6190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf4c108d20 0x7fdf4c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 --2- 172.21.15.40:0/2398456398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf4c1033e0 0x7fdf4c19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:38.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 >> 172.21.15.40:0/2398456398 conn(0x7fdf4c0fee70 msgr2=0x7fdf4c10e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:38.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 shutdown_connections 2024-07-26T12:20:38.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:38.812+0000 7fdf51400640 1 -- 172.21.15.40:0/2398456398 wait complete. 2024-07-26T12:20:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 -- 172.21.15.40:0/4194373012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4108730 msgr2=0x7f20c410ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 --2- 172.21.15.40:0/4194373012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4108730 0x7f20c410ef60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009ca0 tx=0x7f20bc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 -- 172.21.15.40:0/4194373012 shutdown_connections 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 --2- 172.21.15.40:0/4194373012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4108730 0x7f20c410ef60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 --2- 172.21.15.40:0/4194373012 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20c4107de0 0x7f20c41081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 --2- 172.21.15.40:0/4194373012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c41024f0 0x7f20c4102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.296+0000 7f20cc600640 1 -- 172.21.15.40:0/4194373012 >> 172.21.15.40:0/4194373012 conn(0x7f20c4079150 msgr2=0x7f20c4079560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.297+0000 7f20cc600640 1 -- 172.21.15.40:0/4194373012 shutdown_connections 2024-07-26T12:20:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.297+0000 7f20cc600640 1 -- 172.21.15.40:0/4194373012 wait complete. 2024-07-26T12:20:39.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.298+0000 7f20cc600640 1 Processor -- start 2024-07-26T12:20:39.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.298+0000 7f20cc600640 1 -- start start 2024-07-26T12:20:39.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20cc600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 0x7f20c4199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20cc600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c4107de0 0x7f20c419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20cc600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20c4108730 0x7f20c419f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20cc600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20c406bc90 con 0x7f20c41024f0 2024-07-26T12:20:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20cc600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20c406bb10 con 0x7f20c4108730 2024-07-26T12:20:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20cc600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20c406be10 con 0x7f20c4107de0 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20c9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 0x7f20c4199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20c9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 0x7f20c4199d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37320/0 (socket says 172.21.15.40:37320) 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.299+0000 7f20c9c00640 1 -- 172.21.15.40:0/1823588811 learned_addr learned my addr 172.21.15.40:0/1823588811 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9200640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c4107de0 0x7f20c419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20ca600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20c4108730 0x7f20c419f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9c00640 1 -- 172.21.15.40:0/1823588811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c4107de0 msgr2=0x7f20c419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9c00640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c4107de0 0x7f20c419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9c00640 1 -- 172.21.15.40:0/1823588811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20c4108730 msgr2=0x7f20c419f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9c00640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20c4108730 0x7f20c419f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9c00640 1 -- 172.21.15.40:0/1823588811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c419fc40 con 0x7f20c41024f0 2024-07-26T12:20:39.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.300+0000 7f20c9c00640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 0x7f20c4199d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20b800d770 tx=0x7f20b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:39.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.301+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8017070 con 0x7f20c41024f0 2024-07-26T12:20:39.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.301+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20b80054b0 con 0x7f20c41024f0 2024-07-26T12:20:39.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.301+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8004c60 con 0x7f20c41024f0 2024-07-26T12:20:39.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.301+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c419ff30 con 0x7f20c41024f0 2024-07-26T12:20:39.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.301+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c41a6750 con 0x7f20c41024f0 2024-07-26T12:20:39.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.302+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c4102900 con 0x7f20c41024f0 2024-07-26T12:20:39.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.305+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f20b8004e00 con 0x7f20c41024f0 2024-07-26T12:20:39.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.306+0000 7f20c2000640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20ac0b3c80 0x7f20ac0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.307+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f20b80e3af0 con 0x7f20c41024f0 2024-07-26T12:20:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.307+0000 7f20c9200640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20ac0b3c80 0x7f20ac0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.308+0000 7f20c9200640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20ac0b3c80 0x7f20ac0b6190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20b0005e10 tx=0x7f20b0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:39.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.309+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f20b80ab180 con 0x7f20c41024f0 2024-07-26T12:20:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 -- 172.21.15.40:0/2346117459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc940751e0 msgr2=0x7fdc940755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 --2- 172.21.15.40:0/2346117459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc940751e0 0x7fdc940755f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009ca0 tx=0x7fdc8402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 -- 172.21.15.40:0/2346117459 shutdown_connections 2024-07-26T12:20:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 --2- 172.21.15.40:0/2346117459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc9410fb10 0x7fdc94111f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 --2- 172.21.15.40:0/2346117459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc94075b30 0x7fdc9410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 --2- 172.21.15.40:0/2346117459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc940751e0 0x7fdc940755f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 -- 172.21.15.40:0/2346117459 >> 172.21.15.40:0/2346117459 conn(0x7fdc940ff040 msgr2=0x7fdc94101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 -- 172.21.15.40:0/2346117459 shutdown_connections 2024-07-26T12:20:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.491+0000 7fdc98a00640 1 -- 172.21.15.40:0/2346117459 wait complete. 2024-07-26T12:20:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.492+0000 7fdc98a00640 1 Processor -- start 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.492+0000 7fdc98a00640 1 -- start start 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc98a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc940751e0 0x7fdc9419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc98a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc94075b30 0x7fdc9419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc98a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 0x7fdc941a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc98a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdc941155c0 con 0x7fdc9410fb10 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc98a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94115440 con 0x7fdc94075b30 2024-07-26T12:20:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc98a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94115740 con 0x7fdc940751e0 2024-07-26T12:20:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc92800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 0x7fdc941a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc92800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 0x7fdc941a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37334/0 (socket says 172.21.15.40:37334) 2024-07-26T12:20:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc92800640 1 -- 172.21.15.40:0/669212906 learned_addr learned my addr 172.21.15.40:0/669212906 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc89400640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc94075b30 0x7fdc9419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.493+0000 7fdc91e00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc940751e0 0x7fdc9419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc92800640 1 -- 172.21.15.40:0/669212906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc940751e0 msgr2=0x7fdc9419bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc92800640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc940751e0 0x7fdc9419bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc92800640 1 -- 172.21.15.40:0/669212906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc94075b30 msgr2=0x7fdc9419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc92800640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc94075b30 0x7fdc9419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc92800640 1 -- 172.21.15.40:0/669212906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc941a1f60 con 0x7fdc9410fb10 2024-07-26T12:20:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc89400640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc94075b30 0x7fdc9419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.494+0000 7fdc92800640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 0x7fdc941a1830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00d750 tx=0x7fdc8c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.495+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c017070 con 0x7fdc9410fb10 2024-07-26T12:20:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.495+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc941a2250 con 0x7fdc9410fb10 2024-07-26T12:20:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.495+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc8c0054b0 con 0x7fdc9410fb10 2024-07-26T12:20:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.495+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c004b90 con 0x7fdc9410fb10 2024-07-26T12:20:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.495+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc941a89b0 con 0x7fdc9410fb10 2024-07-26T12:20:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.496+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc940766f0 con 0x7fdc9410fb10 2024-07-26T12:20:39.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.499+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdc8c004d30 con 0x7fdc9410fb10 2024-07-26T12:20:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.500+0000 7fdc8b400640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdc780b3bd0 0x7fdc780b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.501+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdc8c0e3b30 con 0x7fdc9410fb10 2024-07-26T12:20:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.501+0000 7fdc91e00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdc780b3bd0 0x7fdc780b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.502+0000 7fdc91e00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdc780b3bd0 0x7fdc780b60e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000f80 tx=0x7fdc840093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:39.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.504+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdc8c0ab140 con 0x7fdc9410fb10 2024-07-26T12:20:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.525+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f20c419aec0 con 0x7f20c41024f0 2024-07-26T12:20:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.526+0000 7f20c2000640 1 -- 172.21.15.40:0/1823588811 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20b80aaa80 con 0x7f20c41024f0 2024-07-26T12:20:39.528 INFO:teuthology.orchestra.run.smithi040.stdout:55834574963 2024-07-26T12:20:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20ac0b3c80 msgr2=0x7f20ac0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20ac0b3c80 0x7f20ac0b6190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20b0005e10 tx=0x7f20b0005da0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 msgr2=0x7f20c4199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 0x7f20c4199d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20b800d770 tx=0x7f20b800dc30 comp rx=0 tx=0).stop 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 shutdown_connections 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20c4108730 0x7f20c419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20ac0b3c80 0x7f20ac0b6190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c4107de0 0x7f20c419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 --2- 172.21.15.40:0/1823588811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c41024f0 0x7f20c4199d90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 >> 172.21.15.40:0/1823588811 conn(0x7f20c4079150 msgr2=0x7f20c4103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:39.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.529+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 shutdown_connections 2024-07-26T12:20:39.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.530+0000 7f20cc600640 1 -- 172.21.15.40:0/1823588811 wait complete. 2024-07-26T12:20:39.569 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790031 got 158913790037 for osd.5 2024-07-26T12:20:39.570 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:39.654 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:39 smithi040 ceph-mon[32397]: pgmap v452: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-07-26T12:20:39.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:39 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2398456398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-26T12:20:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.735+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fdc9419d120 con 0x7fdc9410fb10 2024-07-26T12:20:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.736+0000 7fdc8b400640 1 -- 172.21.15.40:0/669212906 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdc8c0aaa40 con 0x7fdc9410fb10 2024-07-26T12:20:39.739 INFO:teuthology.orchestra.run.smithi040.stdout:261993005115 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.739+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdc780b3bd0 msgr2=0x7fdc780b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.739+0000 7fdc98a00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdc780b3bd0 0x7fdc780b60e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000f80 tx=0x7fdc840093f0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.739+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 msgr2=0x7fdc941a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.739+0000 7fdc98a00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 0x7fdc941a1830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00d750 tx=0x7fdc8c00dc10 comp rx=0 tx=0).stop 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 shutdown_connections 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc9410fb10 0x7fdc941a1830 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc94075b30 0x7fdc9419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdc780b3bd0 0x7fdc780b60e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 --2- 172.21.15.40:0/669212906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc940751e0 0x7fdc9419bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 >> 172.21.15.40:0/669212906 conn(0x7fdc940ff040 msgr2=0x7fdc94109690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 shutdown_connections 2024-07-26T12:20:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:39.740+0000 7fdc98a00640 1 -- 172.21.15.40:0/669212906 wait complete. 2024-07-26T12:20:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:39 smithi146 ceph-mon[35807]: pgmap v452: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-07-26T12:20:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:39 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2398456398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-26T12:20:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:39 smithi076 ceph-mon[35401]: pgmap v452: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-07-26T12:20:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:39 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2398456398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-07-26T12:20:40.605 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:40 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1823588811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-26T12:20:40.605 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:40 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/669212906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-26T12:20:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:40 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1823588811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-26T12:20:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:40 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/669212906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-26T12:20:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:40 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1823588811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-07-26T12:20:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:40 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/669212906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-07-26T12:20:41.154 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411429 got 77309411434 for osd.2 2024-07-26T12:20:41.154 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:41.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005108 got 261993005115 for osd.9 2024-07-26T12:20:41.476 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:41.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:41 smithi040 ceph-mon[32397]: pgmap v453: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:41.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:41 smithi146 ceph-mon[35807]: pgmap v453: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:41 smithi076 ceph-mon[35401]: pgmap v453: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-07-26T12:20:42.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 -- 172.21.15.40:0/2031070087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 msgr2=0x7f710c10ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:42.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 --2- 172.21.15.40:0/2031070087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c10ed60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7104009ca0 tx=0x7f710402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 -- 172.21.15.40:0/2031070087 shutdown_connections 2024-07-26T12:20:42.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 --2- 172.21.15.40:0/2031070087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c10ed60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 --2- 172.21.15.40:0/2031070087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710c107be0 0x7f710c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 --2- 172.21.15.40:0/2031070087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f710c1022a0 0x7f710c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 -- 172.21.15.40:0/2031070087 >> 172.21.15.40:0/2031070087 conn(0x7f710c0fdcf0 msgr2=0x7f710c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:42.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 -- 172.21.15.40:0/2031070087 shutdown_connections 2024-07-26T12:20:42.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.135+0000 7f7111c00640 1 -- 172.21.15.40:0/2031070087 wait complete. 2024-07-26T12:20:42.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.136+0000 7f7111c00640 1 Processor -- start 2024-07-26T12:20:42.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.136+0000 7f7111c00640 1 -- start start 2024-07-26T12:20:42.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.137+0000 7f7111c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f710c1022a0 0x7f710c19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:42.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.137+0000 7f7111c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710c107be0 0x7f710c19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:42.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.137+0000 7f7111c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:42.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.137+0000 7f7111c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f710c112100 con 0x7f710c108530 2024-07-26T12:20:42.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.137+0000 7f7111c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f710c111f80 con 0x7f710c1022a0 2024-07-26T12:20:42.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.137+0000 7f7111c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f710c112280 con 0x7f710c107be0 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c1a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37352/0 (socket says 172.21.15.40:37352) 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f710be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f710c1022a0 0x7f710c19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 -- 172.21.15.40:0/4109879593 learned_addr learned my addr 172.21.15.40:0/4109879593 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f710b400640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710c107be0 0x7f710c19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 -- 172.21.15.40:0/4109879593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710c107be0 msgr2=0x7f710c19c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710c107be0 0x7f710c19c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 -- 172.21.15.40:0/4109879593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f710c1022a0 msgr2=0x7f710c19bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f710c1022a0 0x7f710c19bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.138+0000 7f7111200640 1 -- 172.21.15.40:0/4109879593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c1a1d10 con 0x7f710c108530 2024-07-26T12:20:42.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.139+0000 7f7111200640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c1a15e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7104005cc0 tx=0x7f7104032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.139+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104032e00 con 0x7f710c108530 2024-07-26T12:20:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.139+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71040044d0 con 0x7f710c108530 2024-07-26T12:20:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.139+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104030b70 con 0x7f710c108530 2024-07-26T12:20:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.139+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c1a1fa0 con 0x7f710c108530 2024-07-26T12:20:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.139+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c1a8760 con 0x7f710c108530 2024-07-26T12:20:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.141+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c1026b0 con 0x7f710c108530 2024-07-26T12:20:42.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.145+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7104030d10 con 0x7f710c108530 2024-07-26T12:20:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.146+0000 7f7108c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70f00b3bd0 0x7f70f00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.146+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f71041051c0 con 0x7f710c108530 2024-07-26T12:20:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.147+0000 7f710be00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70f00b3bd0 0x7f70f00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.147+0000 7f710be00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70f00b3bd0 0x7f70f00b60e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00bbe0 tx=0x7f70fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:42.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.149+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f71040cc810 con 0x7f710c108530 2024-07-26T12:20:42.205 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574958 got 55834574963 for osd.1 2024-07-26T12:20:42.205 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.357+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f710c19ced0 con 0x7f710c108530 2024-07-26T12:20:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.358+0000 7f7108c00640 1 -- 172.21.15.40:0/4109879593 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f710c19ced0 con 0x7f710c108530 2024-07-26T12:20:42.360 INFO:teuthology.orchestra.run.smithi040.stdout:210453397577 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.360+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70f00b3bd0 msgr2=0x7f70f00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.360+0000 7f7111c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70f00b3bd0 0x7f70f00b60e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00bbe0 tx=0x7f70fc00b390 comp rx=0 tx=0).stop 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 msgr2=0x7f710c1a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c1a15e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7104005cc0 tx=0x7f7104032a10 comp rx=0 tx=0).stop 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 shutdown_connections 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f710c108530 0x7f710c1a15e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70f00b3bd0 0x7f70f00b60e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f710c107be0 0x7f710c19c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 --2- 172.21.15.40:0/4109879593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f710c1022a0 0x7f710c19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:42.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 >> 172.21.15.40:0/4109879593 conn(0x7f710c0fdcf0 msgr2=0x7f710c1071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:42.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 shutdown_connections 2024-07-26T12:20:42.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:42.361+0000 7f7111c00640 1 -- 172.21.15.40:0/4109879593 wait complete. 2024-07-26T12:20:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:42 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4109879593' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-26T12:20:42.621 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:42.751 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:42 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4109879593' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-26T12:20:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:42 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4109879593' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-07-26T12:20:43.351 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593799 got 184683593805 for osd.6 2024-07-26T12:20:43.351 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:43.567 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:43 smithi040 ceph-mon[32397]: pgmap v454: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-07-26T12:20:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:43 smithi146 ceph-mon[35807]: pgmap v454: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-07-26T12:20:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:43 smithi076 ceph-mon[35401]: pgmap v454: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-07-26T12:20:43.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 -- 172.21.15.40:0/3492942898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410b860 msgr2=0x7f8b04112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:43.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 --2- 172.21.15.40:0/3492942898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410b860 0x7f8b04112090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009ca0 tx=0x7f8afc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:43.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 -- 172.21.15.40:0/3492942898 shutdown_connections 2024-07-26T12:20:43.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 --2- 172.21.15.40:0/3492942898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410b860 0x7f8b04112090 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:43.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 --2- 172.21.15.40:0/3492942898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b0410af10 0x7f8b0410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:43.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 --2- 172.21.15.40:0/3492942898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b041055d0 0x7f8b041059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 -- 172.21.15.40:0/3492942898 >> 172.21.15.40:0/3492942898 conn(0x7f8b04101040 msgr2=0x7f8b04103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 -- 172.21.15.40:0/3492942898 shutdown_connections 2024-07-26T12:20:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.981+0000 7f8b09400640 1 -- 172.21.15.40:0/3492942898 wait complete. 2024-07-26T12:20:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.982+0000 7f8b09400640 1 Processor -- start 2024-07-26T12:20:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.982+0000 7f8b09400640 1 -- start start 2024-07-26T12:20:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b09400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 0x7f8b0419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b09400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b0410af10 0x7f8b0419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b09400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b0410b860 0x7f8b041a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b09400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04115410 con 0x7f8b041055d0 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b09400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04115290 con 0x7f8b0410af10 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b09400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04115590 con 0x7f8b0410b860 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b03e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 0x7f8b0419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b03e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 0x7f8b0419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42974/0 (socket says 172.21.15.40:42974) 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b03e00640 1 -- 172.21.15.40:0/1160681711 learned_addr learned my addr 172.21.15.40:0/1160681711 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8afb400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b0410af10 0x7f8b0419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:43.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.983+0000 7f8b08a00640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b0410b860 0x7f8b041a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:43.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b03e00640 1 -- 172.21.15.40:0/1160681711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b0410b860 msgr2=0x7f8b041a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:43.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b03e00640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b0410b860 0x7f8b041a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:43.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b03e00640 1 -- 172.21.15.40:0/1160681711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b0410af10 msgr2=0x7f8b0419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:43.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b03e00640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b0410af10 0x7f8b0419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:43.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b03e00640 1 -- 172.21.15.40:0/1160681711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b041a1d50 con 0x7f8b041055d0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b03e00640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 0x7f8b0419bde0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8af400d950 tx=0x7f8af400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4017070 con 0x7f8b041055d0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b041a2040 con 0x7f8b041055d0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8af4009c30 con 0x7f8b041055d0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.984+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af400f620 con 0x7f8b041055d0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.985+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b041a87a0 con 0x7f8b041055d0 2024-07-26T12:20:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.986+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b041059e0 con 0x7f8b041055d0 2024-07-26T12:20:43.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.988+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8af4005030 con 0x7f8b041055d0 2024-07-26T12:20:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.990+0000 7f8b01600640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ae80b3bd0 0x7f8ae80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.990+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8af40e38f0 con 0x7f8b041055d0 2024-07-26T12:20:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.990+0000 7f8afb400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ae80b3bd0 0x7f8ae80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:43.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.991+0000 7f8afb400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ae80b3bd0 0x7f8ae80b60e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8aec005fd0 tx=0x7f8aec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:43.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:43.992+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8af40aaf00 con 0x7f8b041055d0 2024-07-26T12:20:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.205+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f8b0419cf10 con 0x7f8b041055d0 2024-07-26T12:20:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.206+0000 7f8b01600640 1 -- 172.21.15.40:0/1160681711 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8af4009de0 con 0x7f8b041055d0 2024-07-26T12:20:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:236223201345 2024-07-26T12:20:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.209+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ae80b3bd0 msgr2=0x7f8ae80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.209+0000 7f8b09400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ae80b3bd0 0x7f8ae80b60e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8aec005fd0 tx=0x7f8aec005850 comp rx=0 tx=0).stop 2024-07-26T12:20:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.209+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 msgr2=0x7f8b0419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.209+0000 7f8b09400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 0x7f8b0419bde0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8af400d950 tx=0x7f8af400de10 comp rx=0 tx=0).stop 2024-07-26T12:20:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 shutdown_connections 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ae80b3bd0 0x7f8ae80b60e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b0410b860 0x7f8b041a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b0410af10 0x7f8b0419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 --2- 172.21.15.40:0/1160681711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b041055d0 0x7f8b0419bde0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 >> 172.21.15.40:0/1160681711 conn(0x7f8b04101040 msgr2=0x7f8b04103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 shutdown_connections 2024-07-26T12:20:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:44.210+0000 7f8b09400640 1 -- 172.21.15.40:0/1160681711 wait complete. 2024-07-26T12:20:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1160681711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-26T12:20:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1160681711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-26T12:20:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1160681711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-07-26T12:20:45.401 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397571 got 210453397577 for osd.7 2024-07-26T12:20:45.401 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:45 smithi040 ceph-mon[32397]: pgmap v455: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:20:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:45 smithi146 ceph-mon[35807]: pgmap v455: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:20:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:45 smithi076 ceph-mon[35401]: pgmap v455: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:20:46.019 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201338 got 236223201345 for osd.8 2024-07-26T12:20:46.019 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 -- 172.21.15.40:0/3775109169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 msgr2=0x7ff40c103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 --2- 172.21.15.40:0/3775109169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c103a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009ca0 tx=0x7ff3fc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 -- 172.21.15.40:0/3775109169 shutdown_connections 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 --2- 172.21.15.40:0/3775109169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40c109830 0x7ff40c110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 --2- 172.21.15.40:0/3775109169 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff40c108ee0 0x7ff40c1092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 --2- 172.21.15.40:0/3775109169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c103a00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 -- 172.21.15.40:0/3775109169 >> 172.21.15.40:0/3775109169 conn(0x7ff40c07b340 msgr2=0x7ff40c07b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 -- 172.21.15.40:0/3775109169 shutdown_connections 2024-07-26T12:20:47.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.117+0000 7ff411200640 1 -- 172.21.15.40:0/3775109169 wait complete. 2024-07-26T12:20:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.118+0000 7ff411200640 1 Processor -- start 2024-07-26T12:20:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 -- start start 2024-07-26T12:20:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40c108ee0 0x7ff40c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff40c109830 0x7ff40c1a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c1133e0 con 0x7ff40c1035f0 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c113260 con 0x7ff40c109830 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff411200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c113560 con 0x7ff40c108ee0 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff409e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff409e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c19bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42990/0 (socket says 172.21.15.40:42990) 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.119+0000 7ff409e00640 1 -- 172.21.15.40:0/4072499330 learned_addr learned my addr 172.21.15.40:0/4072499330 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff401400640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40c108ee0 0x7ff40c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff40a800640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff40c109830 0x7ff40c1a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff409e00640 1 -- 172.21.15.40:0/4072499330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40c108ee0 msgr2=0x7ff40c19c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff409e00640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40c108ee0 0x7ff40c19c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff409e00640 1 -- 172.21.15.40:0/4072499330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff40c109830 msgr2=0x7ff40c1a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff409e00640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff40c109830 0x7ff40c1a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff409e00640 1 -- 172.21.15.40:0/4072499330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c1a1f60 con 0x7ff40c1035f0 2024-07-26T12:20:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.120+0000 7ff409e00640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c19bff0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009dc0 tx=0x7ff3fc003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.121+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc032dd0 con 0x7ff40c1035f0 2024-07-26T12:20:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.121+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c1a21f0 con 0x7ff40c1035f0 2024-07-26T12:20:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.121+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3fc0044d0 con 0x7ff40c1035f0 2024-07-26T12:20:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.121+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc030c50 con 0x7ff40c1035f0 2024-07-26T12:20:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.121+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c1a89b0 con 0x7ff40c1035f0 2024-07-26T12:20:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.122+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c103a00 con 0x7ff40c1035f0 2024-07-26T12:20:47.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.125+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff3fc004680 con 0x7ff40c1035f0 2024-07-26T12:20:47.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.127+0000 7ff403400640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3f00b3bd0 0x7ff3f00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:47.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.127+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff3fc105230 con 0x7ff40c1035f0 2024-07-26T12:20:47.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.127+0000 7ff401400640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3f00b3bd0 0x7ff3f00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:47.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.128+0000 7ff401400640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3f00b3bd0 0x7ff3f00b60e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff40c07bd70 tx=0x7ff3f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.129+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff3fc0cc880 con 0x7ff40c1035f0 2024-07-26T12:20:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.348+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff40c1a8c70 con 0x7ff40c1035f0 2024-07-26T12:20:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.349+0000 7ff403400640 1 -- 172.21.15.40:0/4072499330 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff3fc0cc180 con 0x7ff40c1035f0 2024-07-26T12:20:47.351 INFO:teuthology.orchestra.run.smithi040.stdout:107374182500 2024-07-26T12:20:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3f00b3bd0 msgr2=0x7ff3f00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3f00b3bd0 0x7ff3f00b60e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff40c07bd70 tx=0x7ff3f4005f90 comp rx=0 tx=0).stop 2024-07-26T12:20:47.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 msgr2=0x7ff40c19bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:47.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c19bff0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009dc0 tx=0x7ff3fc003f80 comp rx=0 tx=0).stop 2024-07-26T12:20:47.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 shutdown_connections 2024-07-26T12:20:47.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff40c109830 0x7ff40c1a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3f00b3bd0 0x7ff3f00b60e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40c108ee0 0x7ff40c19c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 --2- 172.21.15.40:0/4072499330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40c1035f0 0x7ff40c19bff0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 >> 172.21.15.40:0/4072499330 conn(0x7ff40c07b340 msgr2=0x7ff40c106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 shutdown_connections 2024-07-26T12:20:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:47.352+0000 7ff411200640 1 -- 172.21.15.40:0/4072499330 wait complete. 2024-07-26T12:20:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:47 smithi040 ceph-mon[32397]: pgmap v456: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:47 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4072499330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-26T12:20:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:47 smithi146 ceph-mon[35807]: pgmap v456: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:47 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4072499330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-26T12:20:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:47 smithi076 ceph-mon[35401]: pgmap v456: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:47 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4072499330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-07-26T12:20:48.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182495 got 107374182500 for osd.3 2024-07-26T12:20:48.263 DEBUG:teuthology.parallel:result is None 2024-07-26T12:20:48.263 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-26T12:20:48.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:20:48.752 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:49 smithi146 ceph-mon[35807]: pgmap v457: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:20:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:20:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.821 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:49 smithi040 ceph-mon[32397]: pgmap v457: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:49.822 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.822 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.822 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:20:49.822 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:20:49.822 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:49 smithi076 ceph-mon[35401]: pgmap v457: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:20:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:20:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.924+0000 7f0a07000640 1 -- 172.21.15.40:0/1465652380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00101e10 msgr2=0x7f0a00102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.924+0000 7f0a07000640 1 --2- 172.21.15.40:0/1465652380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00101e10 0x7f0a00102220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009ca0 tx=0x7f09f402a950 comp rx=0 tx=0).stop 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 -- 172.21.15.40:0/1465652380 shutdown_connections 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 --2- 172.21.15.40:0/1465652380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a0010f9c0 0x7f0a00111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 --2- 172.21.15.40:0/1465652380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a00102760 0x7f0a0010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 --2- 172.21.15.40:0/1465652380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00101e10 0x7f0a00102220 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:50.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 -- 172.21.15.40:0/1465652380 >> 172.21.15.40:0/1465652380 conn(0x7f0a000fdcf0 msgr2=0x7f0a00100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:50.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 -- 172.21.15.40:0/1465652380 shutdown_connections 2024-07-26T12:20:50.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.925+0000 7f0a07000640 1 -- 172.21.15.40:0/1465652380 wait complete. 2024-07-26T12:20:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.926+0000 7f0a07000640 1 Processor -- start 2024-07-26T12:20:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.926+0000 7f0a07000640 1 -- start start 2024-07-26T12:20:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.926+0000 7f0a07000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a00101e10 0x7f0a0019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a07000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 0x7f0a0019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a07000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a0010f9c0 0x7f0a001a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a07000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0a00115390 con 0x7f0a00102760 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a07000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0a00115210 con 0x7f0a0010f9c0 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a07000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a00115510 con 0x7f0a00101e10 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 0x7f0a0019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 0x7f0a0019c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43008/0 (socket says 172.21.15.40:43008) 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 -- 172.21.15.40:0/2753472061 learned_addr learned my addr 172.21.15.40:0/2753472061 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05c00640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a00101e10 0x7f0a0019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a06600640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a0010f9c0 0x7f0a001a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 -- 172.21.15.40:0/2753472061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a00101e10 msgr2=0x7f0a0019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a00101e10 0x7f0a0019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:50.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 -- 172.21.15.40:0/2753472061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a0010f9c0 msgr2=0x7f0a001a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:50.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a0010f9c0 0x7f0a001a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:50.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05200640 1 -- 172.21.15.40:0/2753472061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a001a1d70 con 0x7f0a00102760 2024-07-26T12:20:50.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.927+0000 7f0a05c00640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a00101e10 0x7f0a0019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:20:50.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.928+0000 7f0a05200640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 0x7f0a0019c3a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00d950 tx=0x7f09ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:50.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.928+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec017030 con 0x7f0a00102760 2024-07-26T12:20:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.928+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09ec004020 con 0x7f0a00102760 2024-07-26T12:20:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.928+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0055d0 con 0x7f0a00102760 2024-07-26T12:20:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.928+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a001a2060 con 0x7f0a00102760 2024-07-26T12:20:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.928+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a001a87c0 con 0x7f0a00102760 2024-07-26T12:20:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.930+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a00102220 con 0x7f0a00102760 2024-07-26T12:20:50.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.932+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f09ec009a30 con 0x7f0a00102760 2024-07-26T12:20:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.934+0000 7f09fe000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09e80b3c50 0x7f09e80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.934+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f09ec0e3d70 con 0x7f0a00102760 2024-07-26T12:20:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.934+0000 7f0a05c00640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09e80b3c50 0x7f09e80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.935+0000 7f0a05c00640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09e80b3c50 0x7f09e80b6160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09f40094e0 tx=0x7f09f4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:50.936+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f09ec0ab400 con 0x7f0a00102760 2024-07-26T12:20:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.125+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a00063230 con 0x7f09e80b3c50 2024-07-26T12:20:51.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.140+0000 7f09fe000640 1 -- 172.21.15.40:0/2753472061 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258867 (secure 0 0 0) 0x7f0a00063230 con 0x7f09e80b3c50 2024-07-26T12:20:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:20:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.146+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09e80b3c50 msgr2=0x7f09e80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09e80b3c50 0x7f09e80b6160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09f40094e0 tx=0x7f09f4000f40 comp rx=0 tx=0).stop 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 msgr2=0x7f0a0019c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 0x7f0a0019c3a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00d950 tx=0x7f09ec00de10 comp rx=0 tx=0).stop 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 shutdown_connections 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a0010f9c0 0x7f0a001a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a00102760 0x7f0a0019c3a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09e80b3c50 0x7f09e80b6160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 --2- 172.21.15.40:0/2753472061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a00101e10 0x7f0a0019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 >> 172.21.15.40:0/2753472061 conn(0x7f0a000fdcf0 msgr2=0x7f0a00111b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 shutdown_connections 2024-07-26T12:20:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:51.147+0000 7f0a07000640 1 -- 172.21.15.40:0/2753472061 wait complete. 2024-07-26T12:20:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:51 smithi146 ceph-mon[35807]: pgmap v458: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:20:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:51 smithi076 ceph-mon[35401]: pgmap v458: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:20:51.861 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:51 smithi040 ceph-mon[32397]: pgmap v458: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:20:51.922 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2024-07-26T12:20:49.914091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662529,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1256,"num_read_kb":727,"num_write":380,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":813,"ondisk_log_size":813,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386904,"kb_used_data":12792,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554920,"statfs":{"total":1151940427776,"available":1151544238080,"internally_reserved":0,"allocated":13099008,"data_stored":7201335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005400"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836266+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:20:27.836266+0000","last_peered":"2024-07-26T12:20:27.836266+0000","last_clean":"2024-07-26T12:20:27.836266+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:20:27.836266+0000","last_undegraded":"2024-07-26T12:20:27.836266+0000","last_fullsized":"2024-07-26T12:20:27.836266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836969+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:20:27.836969+0000","last_peered":"2024-07-26T12:20:27.836969+0000","last_clean":"2024-07-26T12:20:27.836969+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:20:27.836969+0000","last_undegraded":"2024-07-26T12:20:27.836969+0000","last_fullsized":"2024-07-26T12:20:27.836969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836334+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:20:27.836334+0000","last_peered":"2024-07-26T12:20:27.836334+0000","last_clean":"2024-07-26T12:20:27.836334+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:20:27.836334+0000","last_undegraded":"2024-07-26T12:20:27.836334+0000","last_fullsized":"2024-07-26T12:20:27.836334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831166+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:20:27.831166+0000","last_peered":"2024-07-26T12:20:27.831166+0000","last_clean":"2024-07-26T12:20:27.831166+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:20:27.831166+0000","last_undegraded":"2024-07-26T12:20:27.831166+0000","last_fullsized":"2024-07-26T12:20:27.831166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.819065+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:20:27.819065+0000","last_peered":"2024-07-26T12:20:27.819065+0000","last_clean":"2024-07-26T12:20:27.819065+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:20:27.819065+0000","last_undegraded":"2024-07-26T12:20:27.819065+0000","last_fullsized":"2024-07-26T12:20:27.819065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837015+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:20:27.837015+0000","last_peered":"2024-07-26T12:20:27.837015+0000","last_clean":"2024-07-26T12:20:27.837015+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:20:27.837015+0000","last_undegraded":"2024-07-26T12:20:27.837015+0000","last_fullsized":"2024-07-26T12:20:27.837015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835667+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:20:27.835667+0000","last_peered":"2024-07-26T12:20:27.835667+0000","last_clean":"2024-07-26T12:20:27.835667+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:20:27.835667+0000","last_undegraded":"2024-07-26T12:20:27.835667+0000","last_fullsized":"2024-07-26T12:20:27.835667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826017+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:20:27.826017+0000","last_peered":"2024-07-26T12:20:27.826017+0000","last_clean":"2024-07-26T12:20:27.826017+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:20:27.826017+0000","last_undegraded":"2024-07-26T12:20:27.826017+0000","last_fullsized":"2024-07-26T12:20:27.826017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841163+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:20:27.841163+0000","last_peered":"2024-07-26T12:20:27.841163+0000","last_clean":"2024-07-26T12:20:27.841163+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:20:27.841163+0000","last_undegraded":"2024-07-26T12:20:27.841163+0000","last_fullsized":"2024-07-26T12:20:27.841163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.828658+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:20:27.828658+0000","last_peered":"2024-07-26T12:20:27.828658+0000","last_clean":"2024-07-26T12:20:27.828658+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:20:27.828658+0000","last_undegraded":"2024-07-26T12:20:27.828658+0000","last_fullsized":"2024-07-26T12:20:27.828658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839430+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:20:27.839430+0000","last_peered":"2024-07-26T12:20:27.839430+0000","last_clean":"2024-07-26T12:20:27.839430+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:20:27.839430+0000","last_undegraded":"2024-07-26T12:20:27.839430+0000","last_fullsized":"2024-07-26T12:20:27.839430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823672+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:20:27.823672+0000","last_peered":"2024-07-26T12:20:27.823672+0000","last_clean":"2024-07-26T12:20:27.823672+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:20:27.823672+0000","last_undegraded":"2024-07-26T12:20:27.823672+0000","last_fullsized":"2024-07-26T12:20:27.823672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832737+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:20:27.832737+0000","last_peered":"2024-07-26T12:20:27.832737+0000","last_clean":"2024-07-26T12:20:27.832737+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:20:27.832737+0000","last_undegraded":"2024-07-26T12:20:27.832737+0000","last_fullsized":"2024-07-26T12:20:27.832737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.825739+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:20:27.825739+0000","last_peered":"2024-07-26T12:20:27.825739+0000","last_clean":"2024-07-26T12:20:27.825739+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:20:27.825739+0000","last_undegraded":"2024-07-26T12:20:27.825739+0000","last_fullsized":"2024-07-26T12:20:27.825739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822062+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:20:27.822062+0000","last_peered":"2024-07-26T12:20:27.822062+0000","last_clean":"2024-07-26T12:20:27.822062+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:20:27.822062+0000","last_undegraded":"2024-07-26T12:20:27.822062+0000","last_fullsized":"2024-07-26T12:20:27.822062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840929+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:20:27.840929+0000","last_peered":"2024-07-26T12:20:27.840929+0000","last_clean":"2024-07-26T12:20:27.840929+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:20:27.840929+0000","last_undegraded":"2024-07-26T12:20:27.840929+0000","last_fullsized":"2024-07-26T12:20:27.840929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836395+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:20:27.836395+0000","last_peered":"2024-07-26T12:20:27.836395+0000","last_clean":"2024-07-26T12:20:27.836395+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:20:27.836395+0000","last_undegraded":"2024-07-26T12:20:27.836395+0000","last_fullsized":"2024-07-26T12:20:27.836395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837187+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:20:27.837187+0000","last_peered":"2024-07-26T12:20:27.837187+0000","last_clean":"2024-07-26T12:20:27.837187+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:20:27.837187+0000","last_undegraded":"2024-07-26T12:20:27.837187+0000","last_fullsized":"2024-07-26T12:20:27.837187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824397+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:20:27.824397+0000","last_peered":"2024-07-26T12:20:27.824397+0000","last_clean":"2024-07-26T12:20:27.824397+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:20:27.824397+0000","last_undegraded":"2024-07-26T12:20:27.824397+0000","last_fullsized":"2024-07-26T12:20:27.824397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.821591+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:20:27.821591+0000","last_peered":"2024-07-26T12:20:27.821591+0000","last_clean":"2024-07-26T12:20:27.821591+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:20:27.821591+0000","last_undegraded":"2024-07-26T12:20:27.821591+0000","last_fullsized":"2024-07-26T12:20:27.821591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839046+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:20:27.839046+0000","last_peered":"2024-07-26T12:20:27.839046+0000","last_clean":"2024-07-26T12:20:27.839046+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:20:27.839046+0000","last_undegraded":"2024-07-26T12:20:27.839046+0000","last_fullsized":"2024-07-26T12:20:27.839046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840534+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:20:27.840534+0000","last_peered":"2024-07-26T12:20:27.840534+0000","last_clean":"2024-07-26T12:20:27.840534+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:20:27.840534+0000","last_undegraded":"2024-07-26T12:20:27.840534+0000","last_fullsized":"2024-07-26T12:20:27.840534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831640+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:20:27.831640+0000","last_peered":"2024-07-26T12:20:27.831640+0000","last_clean":"2024-07-26T12:20:27.831640+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:20:27.831640+0000","last_undegraded":"2024-07-26T12:20:27.831640+0000","last_fullsized":"2024-07-26T12:20:27.831640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832251+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:20:27.832251+0000","last_peered":"2024-07-26T12:20:27.832251+0000","last_clean":"2024-07-26T12:20:27.832251+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:20:27.832251+0000","last_undegraded":"2024-07-26T12:20:27.832251+0000","last_fullsized":"2024-07-26T12:20:27.832251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822925+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:20:27.822925+0000","last_peered":"2024-07-26T12:20:27.822925+0000","last_clean":"2024-07-26T12:20:27.822925+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:20:27.822925+0000","last_undegraded":"2024-07-26T12:20:27.822925+0000","last_fullsized":"2024-07-26T12:20:27.822925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835480+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:20:27.835480+0000","last_peered":"2024-07-26T12:20:27.835480+0000","last_clean":"2024-07-26T12:20:27.835480+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:20:27.835480+0000","last_undegraded":"2024-07-26T12:20:27.835480+0000","last_fullsized":"2024-07-26T12:20:27.835480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823737+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:20:27.823737+0000","last_peered":"2024-07-26T12:20:27.823737+0000","last_clean":"2024-07-26T12:20:27.823737+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:20:27.823737+0000","last_undegraded":"2024-07-26T12:20:27.823737+0000","last_fullsized":"2024-07-26T12:20:27.823737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830232+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:20:27.830232+0000","last_peered":"2024-07-26T12:20:27.830232+0000","last_clean":"2024-07-26T12:20:27.830232+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:20:27.830232+0000","last_undegraded":"2024-07-26T12:20:27.830232+0000","last_fullsized":"2024-07-26T12:20:27.830232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832159+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:20:27.832159+0000","last_peered":"2024-07-26T12:20:27.832159+0000","last_clean":"2024-07-26T12:20:27.832159+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:20:27.832159+0000","last_undegraded":"2024-07-26T12:20:27.832159+0000","last_fullsized":"2024-07-26T12:20:27.832159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824066+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:20:27.824066+0000","last_peered":"2024-07-26T12:20:27.824066+0000","last_clean":"2024-07-26T12:20:27.824066+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:20:27.824066+0000","last_undegraded":"2024-07-26T12:20:27.824066+0000","last_fullsized":"2024-07-26T12:20:27.824066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826459+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:20:27.826459+0000","last_peered":"2024-07-26T12:20:27.826459+0000","last_clean":"2024-07-26T12:20:27.826459+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:20:27.826459+0000","last_undegraded":"2024-07-26T12:20:27.826459+0000","last_fullsized":"2024-07-26T12:20:27.826459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823399+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:20:27.823399+0000","last_peered":"2024-07-26T12:20:27.823399+0000","last_clean":"2024-07-26T12:20:27.823399+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:20:27.823399+0000","last_undegraded":"2024-07-26T12:20:27.823399+0000","last_fullsized":"2024-07-26T12:20:27.823399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826697+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:20:27.826697+0000","last_peered":"2024-07-26T12:20:27.826697+0000","last_clean":"2024-07-26T12:20:27.826697+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:20:27.826697+0000","last_undegraded":"2024-07-26T12:20:27.826697+0000","last_fullsized":"2024-07-26T12:20:27.826697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:46.463362+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:20:46.463362+0000","last_peered":"2024-07-26T12:20:46.463362+0000","last_clean":"2024-07-26T12:20:46.463362+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:20:46.463362+0000","last_undegraded":"2024-07-26T12:20:46.463362+0000","last_fullsized":"2024-07-26T12:20:46.463362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827403+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:20:27.827403+0000","last_peered":"2024-07-26T12:20:27.827403+0000","last_clean":"2024-07-26T12:20:27.827403+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:20:27.827403+0000","last_undegraded":"2024-07-26T12:20:27.827403+0000","last_fullsized":"2024-07-26T12:20:27.827403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088167+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088167+0000","last_peered":"2024-07-26T12:18:59.088167+0000","last_clean":"2024-07-26T12:18:59.088167+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088167+0000","last_undegraded":"2024-07-26T12:18:59.088167+0000","last_fullsized":"2024-07-26T12:18:59.088167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084501+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084501+0000","last_peered":"2024-07-26T12:18:59.084501+0000","last_clean":"2024-07-26T12:18:59.084501+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084501+0000","last_undegraded":"2024-07-26T12:18:59.084501+0000","last_fullsized":"2024-07-26T12:18:59.084501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826479+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:20:27.826479+0000","last_peered":"2024-07-26T12:20:27.826479+0000","last_clean":"2024-07-26T12:20:27.826479+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:20:27.826479+0000","last_undegraded":"2024-07-26T12:20:27.826479+0000","last_fullsized":"2024-07-26T12:20:27.826479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117807+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117807+0000","last_peered":"2024-07-26T12:18:59.117807+0000","last_clean":"2024-07-26T12:18:59.117807+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117807+0000","last_undegraded":"2024-07-26T12:18:59.117807+0000","last_fullsized":"2024-07-26T12:18:59.117807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838492+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:20:27.838492+0000","last_peered":"2024-07-26T12:20:27.838492+0000","last_clean":"2024-07-26T12:20:27.838492+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:20:27.838492+0000","last_undegraded":"2024-07-26T12:20:27.838492+0000","last_fullsized":"2024-07-26T12:20:27.838492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:48.462275+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:20:48.462275+0000","last_peered":"2024-07-26T12:20:48.462275+0000","last_clean":"2024-07-26T12:20:48.462275+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:20:48.462275+0000","last_undegraded":"2024-07-26T12:20:48.462275+0000","last_fullsized":"2024-07-26T12:20:48.462275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839450+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:20:27.839450+0000","last_peered":"2024-07-26T12:20:27.839450+0000","last_clean":"2024-07-26T12:20:27.839450+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:20:27.839450+0000","last_undegraded":"2024-07-26T12:20:27.839450+0000","last_fullsized":"2024-07-26T12:20:27.839450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096778+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096778+0000","last_peered":"2024-07-26T12:18:59.096778+0000","last_clean":"2024-07-26T12:18:59.096778+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096778+0000","last_undegraded":"2024-07-26T12:18:59.096778+0000","last_fullsized":"2024-07-26T12:18:59.096778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830250+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:20:27.830250+0000","last_peered":"2024-07-26T12:20:27.830250+0000","last_clean":"2024-07-26T12:20:27.830250+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:20:27.830250+0000","last_undegraded":"2024-07-26T12:20:27.830250+0000","last_fullsized":"2024-07-26T12:20:27.830250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118510+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118510+0000","last_peered":"2024-07-26T12:18:59.118510+0000","last_clean":"2024-07-26T12:18:59.118510+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118510+0000","last_undegraded":"2024-07-26T12:18:59.118510+0000","last_fullsized":"2024-07-26T12:18:59.118510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837812+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:20:27.837812+0000","last_peered":"2024-07-26T12:20:27.837812+0000","last_clean":"2024-07-26T12:20:27.837812+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:20:27.837812+0000","last_undegraded":"2024-07-26T12:20:27.837812+0000","last_fullsized":"2024-07-26T12:20:27.837812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:48.482486+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:20:48.482486+0000","last_peered":"2024-07-26T12:20:48.482486+0000","last_clean":"2024-07-26T12:20:48.482486+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:20:48.482486+0000","last_undegraded":"2024-07-26T12:20:48.482486+0000","last_fullsized":"2024-07-26T12:20:48.482486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64973,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":176,"num_write":39,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827748+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:20:27.827748+0000","last_peered":"2024-07-26T12:20:27.827748+0000","last_clean":"2024-07-26T12:20:27.827748+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:20:27.827748+0000","last_undegraded":"2024-07-26T12:20:27.827748+0000","last_fullsized":"2024-07-26T12:20:27.827748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094059+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.094059+0000","last_peered":"2024-07-26T12:18:59.094059+0000","last_clean":"2024-07-26T12:18:59.094059+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.094059+0000","last_undegraded":"2024-07-26T12:18:59.094059+0000","last_fullsized":"2024-07-26T12:18:59.094059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827494+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:20:27.827494+0000","last_peered":"2024-07-26T12:20:27.827494+0000","last_clean":"2024-07-26T12:20:27.827494+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:20:27.827494+0000","last_undegraded":"2024-07-26T12:20:27.827494+0000","last_fullsized":"2024-07-26T12:20:27.827494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117333+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117333+0000","last_peered":"2024-07-26T12:18:59.117333+0000","last_clean":"2024-07-26T12:18:59.117333+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117333+0000","last_undegraded":"2024-07-26T12:18:59.117333+0000","last_fullsized":"2024-07-26T12:18:59.117333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841780+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:20:27.841780+0000","last_peered":"2024-07-26T12:20:27.841780+0000","last_clean":"2024-07-26T12:20:27.841780+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:20:27.841780+0000","last_undegraded":"2024-07-26T12:20:27.841780+0000","last_fullsized":"2024-07-26T12:20:27.841780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":152,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:48.441499+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:20:48.441499+0000","last_peered":"2024-07-26T12:20:48.441499+0000","last_clean":"2024-07-26T12:20:48.441499+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:20:48.441499+0000","last_undegraded":"2024-07-26T12:20:48.441499+0000","last_fullsized":"2024-07-26T12:20:48.441499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838601+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:20:27.838601+0000","last_peered":"2024-07-26T12:20:27.838601+0000","last_clean":"2024-07-26T12:20:27.838601+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:20:27.838601+0000","last_undegraded":"2024-07-26T12:20:27.838601+0000","last_fullsized":"2024-07-26T12:20:27.838601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096135+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.096135+0000","last_peered":"2024-07-26T12:18:59.096135+0000","last_clean":"2024-07-26T12:18:59.096135+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.096135+0000","last_undegraded":"2024-07-26T12:18:59.096135+0000","last_fullsized":"2024-07-26T12:18:59.096135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834433+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:20:27.834433+0000","last_peered":"2024-07-26T12:20:27.834433+0000","last_clean":"2024-07-26T12:20:27.834433+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:20:27.834433+0000","last_undegraded":"2024-07-26T12:20:27.834433+0000","last_fullsized":"2024-07-26T12:20:27.834433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.104420+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:18:59.104420+0000","last_peered":"2024-07-26T12:18:59.104420+0000","last_clean":"2024-07-26T12:18:59.104420+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:18:59.104420+0000","last_undegraded":"2024-07-26T12:18:59.104420+0000","last_fullsized":"2024-07-26T12:18:59.104420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822644+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:20:27.822644+0000","last_peered":"2024-07-26T12:20:27.822644+0000","last_clean":"2024-07-26T12:20:27.822644+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:20:27.822644+0000","last_undegraded":"2024-07-26T12:20:27.822644+0000","last_fullsized":"2024-07-26T12:20:27.822644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.121398+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.121398+0000","last_peered":"2024-07-26T12:18:59.121398+0000","last_clean":"2024-07-26T12:18:59.121398+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.121398+0000","last_undegraded":"2024-07-26T12:18:59.121398+0000","last_fullsized":"2024-07-26T12:18:59.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837997+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:20:27.837997+0000","last_peered":"2024-07-26T12:20:27.837997+0000","last_clean":"2024-07-26T12:20:27.837997+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:20:27.837997+0000","last_undegraded":"2024-07-26T12:20:27.837997+0000","last_fullsized":"2024-07-26T12:20:27.837997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118876+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118876+0000","last_peered":"2024-07-26T12:18:59.118876+0000","last_clean":"2024-07-26T12:18:59.118876+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118876+0000","last_undegraded":"2024-07-26T12:18:59.118876+0000","last_fullsized":"2024-07-26T12:18:59.118876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.833208+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:20:27.833208+0000","last_peered":"2024-07-26T12:20:27.833208+0000","last_clean":"2024-07-26T12:20:27.833208+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:20:27.833208+0000","last_undegraded":"2024-07-26T12:20:27.833208+0000","last_fullsized":"2024-07-26T12:20:27.833208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":152,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:47.460908+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:20:47.460908+0000","last_peered":"2024-07-26T12:20:47.460908+0000","last_clean":"2024-07-26T12:20:47.460908+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:20:47.460908+0000","last_undegraded":"2024-07-26T12:20:47.460908+0000","last_fullsized":"2024-07-26T12:20:47.460908+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840206+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:20:27.840206+0000","last_peered":"2024-07-26T12:20:27.840206+0000","last_clean":"2024-07-26T12:20:27.840206+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:20:27.840206+0000","last_undegraded":"2024-07-26T12:20:27.840206+0000","last_fullsized":"2024-07-26T12:20:27.840206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096638+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.096638+0000","last_peered":"2024-07-26T12:18:59.096638+0000","last_clean":"2024-07-26T12:18:59.096638+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.096638+0000","last_undegraded":"2024-07-26T12:18:59.096638+0000","last_fullsized":"2024-07-26T12:18:59.096638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.106205+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:18:59.106205+0000","last_peered":"2024-07-26T12:18:59.106205+0000","last_clean":"2024-07-26T12:18:59.106205+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:18:59.106205+0000","last_undegraded":"2024-07-26T12:18:59.106205+0000","last_fullsized":"2024-07-26T12:18:59.106205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834859+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:20:27.834859+0000","last_peered":"2024-07-26T12:20:27.834859+0000","last_clean":"2024-07-26T12:20:27.834859+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:20:27.834859+0000","last_undegraded":"2024-07-26T12:20:27.834859+0000","last_fullsized":"2024-07-26T12:20:27.834859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096453+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:18:59.096453+0000","last_peered":"2024-07-26T12:18:59.096453+0000","last_clean":"2024-07-26T12:18:59.096453+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:18:59.096453+0000","last_undegraded":"2024-07-26T12:18:59.096453+0000","last_fullsized":"2024-07-26T12:18:59.096453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822472+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:20:27.822472+0000","last_peered":"2024-07-26T12:20:27.822472+0000","last_clean":"2024-07-26T12:20:27.822472+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:20:27.822472+0000","last_undegraded":"2024-07-26T12:20:27.822472+0000","last_fullsized":"2024-07-26T12:20:27.822472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:46.435763+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:20:46.435763+0000","last_peered":"2024-07-26T12:20:46.435763+0000","last_clean":"2024-07-26T12:20:46.435763+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:20:46.435763+0000","last_undegraded":"2024-07-26T12:20:46.435763+0000","last_fullsized":"2024-07-26T12:20:46.435763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827288+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:20:27.827288+0000","last_peered":"2024-07-26T12:20:27.827288+0000","last_clean":"2024-07-26T12:20:27.827288+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:20:27.827288+0000","last_undegraded":"2024-07-26T12:20:27.827288+0000","last_fullsized":"2024-07-26T12:20:27.827288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:46.437794+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:20:46.437794+0000","last_peered":"2024-07-26T12:20:46.437794+0000","last_clean":"2024-07-26T12:20:46.437794+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:20:46.437794+0000","last_undegraded":"2024-07-26T12:20:46.437794+0000","last_fullsized":"2024-07-26T12:20:46.437794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836459+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:20:27.836459+0000","last_peered":"2024-07-26T12:20:27.836459+0000","last_clean":"2024-07-26T12:20:27.836459+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:20:27.836459+0000","last_undegraded":"2024-07-26T12:20:27.836459+0000","last_fullsized":"2024-07-26T12:20:27.836459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092627+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:18:59.092627+0000","last_peered":"2024-07-26T12:18:59.092627+0000","last_clean":"2024-07-26T12:18:59.092627+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:18:59.092627+0000","last_undegraded":"2024-07-26T12:18:59.092627+0000","last_fullsized":"2024-07-26T12:18:59.092627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826332+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:20:27.826332+0000","last_peered":"2024-07-26T12:20:27.826332+0000","last_clean":"2024-07-26T12:20:27.826332+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:20:27.826332+0000","last_undegraded":"2024-07-26T12:20:27.826332+0000","last_fullsized":"2024-07-26T12:20:27.826332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096975+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:18:59.096975+0000","last_peered":"2024-07-26T12:18:59.096975+0000","last_clean":"2024-07-26T12:18:59.096975+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:18:59.096975+0000","last_undegraded":"2024-07-26T12:18:59.096975+0000","last_fullsized":"2024-07-26T12:18:59.096975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827657+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:20:27.827657+0000","last_peered":"2024-07-26T12:20:27.827657+0000","last_clean":"2024-07-26T12:20:27.827657+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:20:27.827657+0000","last_undegraded":"2024-07-26T12:20:27.827657+0000","last_fullsized":"2024-07-26T12:20:27.827657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:28.611805+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:20:28.611805+0000","last_peered":"2024-07-26T12:20:28.611805+0000","last_clean":"2024-07-26T12:20:28.611805+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:20:28.611805+0000","last_undegraded":"2024-07-26T12:20:28.611805+0000","last_fullsized":"2024-07-26T12:20:28.611805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835465+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:20:27.835465+0000","last_peered":"2024-07-26T12:20:27.835465+0000","last_clean":"2024-07-26T12:20:27.835465+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:20:27.835465+0000","last_undegraded":"2024-07-26T12:20:27.835465+0000","last_fullsized":"2024-07-26T12:20:27.835465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107188+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107188+0000","last_peered":"2024-07-26T12:18:59.107188+0000","last_clean":"2024-07-26T12:18:59.107188+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107188+0000","last_undegraded":"2024-07-26T12:18:59.107188+0000","last_fullsized":"2024-07-26T12:18:59.107188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831555+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:20:27.831555+0000","last_peered":"2024-07-26T12:20:27.831555+0000","last_clean":"2024-07-26T12:20:27.831555+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:20:27.831555+0000","last_undegraded":"2024-07-26T12:20:27.831555+0000","last_fullsized":"2024-07-26T12:20:27.831555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094126+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:18:59.094126+0000","last_peered":"2024-07-26T12:18:59.094126+0000","last_clean":"2024-07-26T12:18:59.094126+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:18:59.094126+0000","last_undegraded":"2024-07-26T12:18:59.094126+0000","last_fullsized":"2024-07-26T12:18:59.094126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.809284+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:20:27.809284+0000","last_peered":"2024-07-26T12:20:27.809284+0000","last_clean":"2024-07-26T12:20:27.809284+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:20:27.809284+0000","last_undegraded":"2024-07-26T12:20:27.809284+0000","last_fullsized":"2024-07-26T12:20:27.809284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095568+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:18:59.095568+0000","last_peered":"2024-07-26T12:18:59.095568+0000","last_clean":"2024-07-26T12:18:59.095568+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:18:59.095568+0000","last_undegraded":"2024-07-26T12:18:59.095568+0000","last_fullsized":"2024-07-26T12:18:59.095568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826443+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:20:27.826443+0000","last_peered":"2024-07-26T12:20:27.826443+0000","last_clean":"2024-07-26T12:20:27.826443+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:20:27.826443+0000","last_undegraded":"2024-07-26T12:20:27.826443+0000","last_fullsized":"2024-07-26T12:20:27.826443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096064+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:18:59.096064+0000","last_peered":"2024-07-26T12:18:59.096064+0000","last_clean":"2024-07-26T12:18:59.096064+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:18:59.096064+0000","last_undegraded":"2024-07-26T12:18:59.096064+0000","last_fullsized":"2024-07-26T12:18:59.096064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831171+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:20:27.831171+0000","last_peered":"2024-07-26T12:20:27.831171+0000","last_clean":"2024-07-26T12:20:27.831171+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:20:27.831171+0000","last_undegraded":"2024-07-26T12:20:27.831171+0000","last_fullsized":"2024-07-26T12:20:27.831171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.120325+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:18:59.120325+0000","last_peered":"2024-07-26T12:18:59.120325+0000","last_clean":"2024-07-26T12:18:59.120325+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:18:59.120325+0000","last_undegraded":"2024-07-26T12:18:59.120325+0000","last_fullsized":"2024-07-26T12:18:59.120325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840809+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:20:27.840809+0000","last_peered":"2024-07-26T12:20:27.840809+0000","last_clean":"2024-07-26T12:20:27.840809+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:20:27.840809+0000","last_undegraded":"2024-07-26T12:20:27.840809+0000","last_fullsized":"2024-07-26T12:20:27.840809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838959+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:20:27.838959+0000","last_peered":"2024-07-26T12:20:27.838959+0000","last_clean":"2024-07-26T12:20:27.838959+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:20:27.838959+0000","last_undegraded":"2024-07-26T12:20:27.838959+0000","last_fullsized":"2024-07-26T12:20:27.838959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098071+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.098071+0000","last_peered":"2024-07-26T12:18:59.098071+0000","last_clean":"2024-07-26T12:18:59.098071+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.098071+0000","last_undegraded":"2024-07-26T12:18:59.098071+0000","last_fullsized":"2024-07-26T12:18:59.098071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837504+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:20:27.837504+0000","last_peered":"2024-07-26T12:20:27.837504+0000","last_clean":"2024-07-26T12:20:27.837504+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:20:27.837504+0000","last_undegraded":"2024-07-26T12:20:27.837504+0000","last_fullsized":"2024-07-26T12:20:27.837504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096568+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096568+0000","last_peered":"2024-07-26T12:18:59.096568+0000","last_clean":"2024-07-26T12:18:59.096568+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096568+0000","last_undegraded":"2024-07-26T12:18:59.096568+0000","last_fullsized":"2024-07-26T12:18:59.096568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839888+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:20:27.839888+0000","last_peered":"2024-07-26T12:20:27.839888+0000","last_clean":"2024-07-26T12:20:27.839888+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:20:27.839888+0000","last_undegraded":"2024-07-26T12:20:27.839888+0000","last_fullsized":"2024-07-26T12:20:27.839888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097680+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:18:59.097680+0000","last_peered":"2024-07-26T12:18:59.097680+0000","last_clean":"2024-07-26T12:18:59.097680+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:18:59.097680+0000","last_undegraded":"2024-07-26T12:18:59.097680+0000","last_fullsized":"2024-07-26T12:18:59.097680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824424+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:20:27.824424+0000","last_peered":"2024-07-26T12:20:27.824424+0000","last_clean":"2024-07-26T12:20:27.824424+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:20:27.824424+0000","last_undegraded":"2024-07-26T12:20:27.824424+0000","last_fullsized":"2024-07-26T12:20:27.824424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":177,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:45.433035+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:20:45.433035+0000","last_peered":"2024-07-26T12:20:45.433035+0000","last_clean":"2024-07-26T12:20:45.433035+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:20:45.433035+0000","last_undegraded":"2024-07-26T12:20:45.433035+0000","last_fullsized":"2024-07-26T12:20:45.433035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71927,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1180,"num_read_kb":663,"num_write":255,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645360,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":436343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841590,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1091673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005117,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201346,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1027966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593808,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986273,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":500152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182501,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411437,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":436983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":501204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":436657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:20:51.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:20:52.413 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:52.821 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:52 smithi040 ceph-mon[32397]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:20:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:52 smithi076 ceph-mon[35401]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:20:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:52 smithi146 ceph-mon[35807]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:20:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:53 smithi040 ceph-mon[32397]: pgmap v459: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:53 smithi076 ceph-mon[35401]: pgmap v459: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:53 smithi146 ceph-mon[35807]: pgmap v459: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:20:54.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 -- 172.21.15.40:0/1603385154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0108d00 msgr2=0x7f44b0109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:54.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 --2- 172.21.15.40:0/1603385154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0108d00 0x7f44b0109110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4498009900 tx=0x7f449802a410 comp rx=0 tx=0).stop 2024-07-26T12:20:54.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 -- 172.21.15.40:0/1603385154 shutdown_connections 2024-07-26T12:20:54.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 --2- 172.21.15.40:0/1603385154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44b0109650 0x7f44b010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 --2- 172.21.15.40:0/1603385154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0108d00 0x7f44b0109110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 --2- 172.21.15.40:0/1603385154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 0x7f44b01037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 -- 172.21.15.40:0/1603385154 >> 172.21.15.40:0/1603385154 conn(0x7f44b00fee10 msgr2=0x7f44b0101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 -- 172.21.15.40:0/1603385154 shutdown_connections 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.801+0000 7f44afe00640 1 -- 172.21.15.40:0/1603385154 wait complete. 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.802+0000 7f44afe00640 1 Processor -- start 2024-07-26T12:20:54.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 -- start start 2024-07-26T12:20:54.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 0x7f44b0199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:54.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44b0108d00 0x7f44b019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 0x7f44b019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0113170 con 0x7f44b0109650 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0112ff0 con 0x7f44b0108d00 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.803+0000 7f44afe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01132f0 con 0x7f44b01033c0 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 0x7f44b019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 0x7f44b019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37322/0 (socket says 172.21.15.40:37322) 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 -- 172.21.15.40:0/156338717 learned_addr learned my addr 172.21.15.40:0/156338717 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44aea00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 0x7f44b0199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:54.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44a7e00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44b0108d00 0x7f44b019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:54.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 -- 172.21.15.40:0/156338717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 msgr2=0x7f44b0199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:54.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 0x7f44b0199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:54.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 -- 172.21.15.40:0/156338717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44b0108d00 msgr2=0x7f44b019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:54.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44b0108d00 0x7f44b019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:54.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44af400640 1 -- 172.21.15.40:0/156338717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b019fbb0 con 0x7f44b0109650 2024-07-26T12:20:54.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.804+0000 7f44aea00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 0x7f44b0199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.805+0000 7f44af400640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 0x7f44b019f480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f44a800eb10 tx=0x7f44a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.805+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8004b20 con 0x7f44b0109650 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.805+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44a8004cc0 con 0x7f44b0109650 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.805+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b019fea0 con 0x7f44b0109650 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.805+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8010690 con 0x7f44b0109650 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.805+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b01a6600 con 0x7f44b0109650 2024-07-26T12:20:54.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.807+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b01037d0 con 0x7f44b0109650 2024-07-26T12:20:54.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.809+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f44a8005020 con 0x7f44b0109650 2024-07-26T12:20:54.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.811+0000 7f44b4a00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44940b3c50 0x7f44940b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.811+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f44a80e4220 con 0x7f44b0109650 2024-07-26T12:20:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.811+0000 7f44aea00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44940b3c50 0x7f44940b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:54.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.812+0000 7f44aea00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44940b3c50 0x7f44940b6160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005d00 tx=0x7f44a0005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:54.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:54.815+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f44a80ab830 con 0x7f44b0109650 2024-07-26T12:20:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.016+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44b0063230 con 0x7f44940b3c50 2024-07-26T12:20:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.025+0000 7f44b4a00640 1 -- 172.21.15.40:0/156338717 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258867 (secure 0 0 0) 0x7f44b0063230 con 0x7f44940b3c50 2024-07-26T12:20:55.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:20:55.032 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:20:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44940b3c50 msgr2=0x7f44940b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44940b3c50 0x7f44940b6160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005d00 tx=0x7f44a0005c70 comp rx=0 tx=0).stop 2024-07-26T12:20:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 msgr2=0x7f44b019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 0x7f44b019f480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f44a800eb10 tx=0x7f44a800c2d0 comp rx=0 tx=0).stop 2024-07-26T12:20:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 shutdown_connections 2024-07-26T12:20:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b0109650 0x7f44b019f480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:55.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f44b0108d00 0x7f44b019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:55.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44940b3c50 0x7f44940b6160 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:55.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 --2- 172.21.15.40:0/156338717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b01033c0 0x7f44b0199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:55.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.030+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 >> 172.21.15.40:0/156338717 conn(0x7f44b00fee10 msgr2=0x7f44b0101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:55.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.031+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 shutdown_connections 2024-07-26T12:20:55.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:55.031+0000 7f44afe00640 1 -- 172.21.15.40:0/156338717 wait complete. 2024-07-26T12:20:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:55 smithi040 ceph-mon[32397]: pgmap v460: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:20:55.890 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-07-26T12:20:53.915948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662529,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1281,"num_read_kb":737,"num_write":380,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":813,"ondisk_log_size":813,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386904,"kb_used_data":12792,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554920,"statfs":{"total":1151940427776,"available":1151544238080,"internally_reserved":0,"allocated":13099008,"data_stored":7201335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005106"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836266+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:20:27.836266+0000","last_peered":"2024-07-26T12:20:27.836266+0000","last_clean":"2024-07-26T12:20:27.836266+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:20:27.836266+0000","last_undegraded":"2024-07-26T12:20:27.836266+0000","last_fullsized":"2024-07-26T12:20:27.836266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836969+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:20:27.836969+0000","last_peered":"2024-07-26T12:20:27.836969+0000","last_clean":"2024-07-26T12:20:27.836969+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:20:27.836969+0000","last_undegraded":"2024-07-26T12:20:27.836969+0000","last_fullsized":"2024-07-26T12:20:27.836969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836334+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:20:27.836334+0000","last_peered":"2024-07-26T12:20:27.836334+0000","last_clean":"2024-07-26T12:20:27.836334+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:20:27.836334+0000","last_undegraded":"2024-07-26T12:20:27.836334+0000","last_fullsized":"2024-07-26T12:20:27.836334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831166+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:20:27.831166+0000","last_peered":"2024-07-26T12:20:27.831166+0000","last_clean":"2024-07-26T12:20:27.831166+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:20:27.831166+0000","last_undegraded":"2024-07-26T12:20:27.831166+0000","last_fullsized":"2024-07-26T12:20:27.831166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.819065+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:20:27.819065+0000","last_peered":"2024-07-26T12:20:27.819065+0000","last_clean":"2024-07-26T12:20:27.819065+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:20:27.819065+0000","last_undegraded":"2024-07-26T12:20:27.819065+0000","last_fullsized":"2024-07-26T12:20:27.819065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837015+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:20:27.837015+0000","last_peered":"2024-07-26T12:20:27.837015+0000","last_clean":"2024-07-26T12:20:27.837015+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:20:27.837015+0000","last_undegraded":"2024-07-26T12:20:27.837015+0000","last_fullsized":"2024-07-26T12:20:27.837015+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835667+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:20:27.835667+0000","last_peered":"2024-07-26T12:20:27.835667+0000","last_clean":"2024-07-26T12:20:27.835667+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:20:27.835667+0000","last_undegraded":"2024-07-26T12:20:27.835667+0000","last_fullsized":"2024-07-26T12:20:27.835667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826017+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:20:27.826017+0000","last_peered":"2024-07-26T12:20:27.826017+0000","last_clean":"2024-07-26T12:20:27.826017+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:20:27.826017+0000","last_undegraded":"2024-07-26T12:20:27.826017+0000","last_fullsized":"2024-07-26T12:20:27.826017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841163+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:20:27.841163+0000","last_peered":"2024-07-26T12:20:27.841163+0000","last_clean":"2024-07-26T12:20:27.841163+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:20:27.841163+0000","last_undegraded":"2024-07-26T12:20:27.841163+0000","last_fullsized":"2024-07-26T12:20:27.841163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.828658+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:20:27.828658+0000","last_peered":"2024-07-26T12:20:27.828658+0000","last_clean":"2024-07-26T12:20:27.828658+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:20:27.828658+0000","last_undegraded":"2024-07-26T12:20:27.828658+0000","last_fullsized":"2024-07-26T12:20:27.828658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839430+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:20:27.839430+0000","last_peered":"2024-07-26T12:20:27.839430+0000","last_clean":"2024-07-26T12:20:27.839430+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:20:27.839430+0000","last_undegraded":"2024-07-26T12:20:27.839430+0000","last_fullsized":"2024-07-26T12:20:27.839430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823672+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:20:27.823672+0000","last_peered":"2024-07-26T12:20:27.823672+0000","last_clean":"2024-07-26T12:20:27.823672+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:20:27.823672+0000","last_undegraded":"2024-07-26T12:20:27.823672+0000","last_fullsized":"2024-07-26T12:20:27.823672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832737+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:20:27.832737+0000","last_peered":"2024-07-26T12:20:27.832737+0000","last_clean":"2024-07-26T12:20:27.832737+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:20:27.832737+0000","last_undegraded":"2024-07-26T12:20:27.832737+0000","last_fullsized":"2024-07-26T12:20:27.832737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831001+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:20:27.831001+0000","last_peered":"2024-07-26T12:20:27.831001+0000","last_clean":"2024-07-26T12:20:27.831001+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:20:27.831001+0000","last_undegraded":"2024-07-26T12:20:27.831001+0000","last_fullsized":"2024-07-26T12:20:27.831001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822868+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:20:27.822868+0000","last_peered":"2024-07-26T12:20:27.822868+0000","last_clean":"2024-07-26T12:20:27.822868+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:20:27.822868+0000","last_undegraded":"2024-07-26T12:20:27.822868+0000","last_fullsized":"2024-07-26T12:20:27.822868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841034+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:20:27.841034+0000","last_peered":"2024-07-26T12:20:27.841034+0000","last_clean":"2024-07-26T12:20:27.841034+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:20:27.841034+0000","last_undegraded":"2024-07-26T12:20:27.841034+0000","last_fullsized":"2024-07-26T12:20:27.841034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836586+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:20:27.836586+0000","last_peered":"2024-07-26T12:20:27.836586+0000","last_clean":"2024-07-26T12:20:27.836586+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:20:27.836586+0000","last_undegraded":"2024-07-26T12:20:27.836586+0000","last_fullsized":"2024-07-26T12:20:27.836586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837413+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:20:27.837413+0000","last_peered":"2024-07-26T12:20:27.837413+0000","last_clean":"2024-07-26T12:20:27.837413+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:20:27.837413+0000","last_undegraded":"2024-07-26T12:20:27.837413+0000","last_fullsized":"2024-07-26T12:20:27.837413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824397+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:20:27.824397+0000","last_peered":"2024-07-26T12:20:27.824397+0000","last_clean":"2024-07-26T12:20:27.824397+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:20:27.824397+0000","last_undegraded":"2024-07-26T12:20:27.824397+0000","last_fullsized":"2024-07-26T12:20:27.824397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.821591+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:20:27.821591+0000","last_peered":"2024-07-26T12:20:27.821591+0000","last_clean":"2024-07-26T12:20:27.821591+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:20:27.821591+0000","last_undegraded":"2024-07-26T12:20:27.821591+0000","last_fullsized":"2024-07-26T12:20:27.821591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839046+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:20:27.839046+0000","last_peered":"2024-07-26T12:20:27.839046+0000","last_clean":"2024-07-26T12:20:27.839046+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:20:27.839046+0000","last_undegraded":"2024-07-26T12:20:27.839046+0000","last_fullsized":"2024-07-26T12:20:27.839046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840534+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:20:27.840534+0000","last_peered":"2024-07-26T12:20:27.840534+0000","last_clean":"2024-07-26T12:20:27.840534+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:20:27.840534+0000","last_undegraded":"2024-07-26T12:20:27.840534+0000","last_fullsized":"2024-07-26T12:20:27.840534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831640+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:20:27.831640+0000","last_peered":"2024-07-26T12:20:27.831640+0000","last_clean":"2024-07-26T12:20:27.831640+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:20:27.831640+0000","last_undegraded":"2024-07-26T12:20:27.831640+0000","last_fullsized":"2024-07-26T12:20:27.831640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832251+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:20:27.832251+0000","last_peered":"2024-07-26T12:20:27.832251+0000","last_clean":"2024-07-26T12:20:27.832251+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:20:27.832251+0000","last_undegraded":"2024-07-26T12:20:27.832251+0000","last_fullsized":"2024-07-26T12:20:27.832251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822925+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:20:27.822925+0000","last_peered":"2024-07-26T12:20:27.822925+0000","last_clean":"2024-07-26T12:20:27.822925+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:20:27.822925+0000","last_undegraded":"2024-07-26T12:20:27.822925+0000","last_fullsized":"2024-07-26T12:20:27.822925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835480+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:20:27.835480+0000","last_peered":"2024-07-26T12:20:27.835480+0000","last_clean":"2024-07-26T12:20:27.835480+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:20:27.835480+0000","last_undegraded":"2024-07-26T12:20:27.835480+0000","last_fullsized":"2024-07-26T12:20:27.835480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823737+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:20:27.823737+0000","last_peered":"2024-07-26T12:20:27.823737+0000","last_clean":"2024-07-26T12:20:27.823737+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:20:27.823737+0000","last_undegraded":"2024-07-26T12:20:27.823737+0000","last_fullsized":"2024-07-26T12:20:27.823737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830232+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:20:27.830232+0000","last_peered":"2024-07-26T12:20:27.830232+0000","last_clean":"2024-07-26T12:20:27.830232+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:20:27.830232+0000","last_undegraded":"2024-07-26T12:20:27.830232+0000","last_fullsized":"2024-07-26T12:20:27.830232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832159+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:20:27.832159+0000","last_peered":"2024-07-26T12:20:27.832159+0000","last_clean":"2024-07-26T12:20:27.832159+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:20:27.832159+0000","last_undegraded":"2024-07-26T12:20:27.832159+0000","last_fullsized":"2024-07-26T12:20:27.832159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824066+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:20:27.824066+0000","last_peered":"2024-07-26T12:20:27.824066+0000","last_clean":"2024-07-26T12:20:27.824066+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:20:27.824066+0000","last_undegraded":"2024-07-26T12:20:27.824066+0000","last_fullsized":"2024-07-26T12:20:27.824066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826459+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:20:27.826459+0000","last_peered":"2024-07-26T12:20:27.826459+0000","last_clean":"2024-07-26T12:20:27.826459+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:20:27.826459+0000","last_undegraded":"2024-07-26T12:20:27.826459+0000","last_fullsized":"2024-07-26T12:20:27.826459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823399+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:20:27.823399+0000","last_peered":"2024-07-26T12:20:27.823399+0000","last_clean":"2024-07-26T12:20:27.823399+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:20:27.823399+0000","last_undegraded":"2024-07-26T12:20:27.823399+0000","last_fullsized":"2024-07-26T12:20:27.823399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826697+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:20:27.826697+0000","last_peered":"2024-07-26T12:20:27.826697+0000","last_clean":"2024-07-26T12:20:27.826697+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:20:27.826697+0000","last_undegraded":"2024-07-26T12:20:27.826697+0000","last_fullsized":"2024-07-26T12:20:27.826697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":159,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:51.480300+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:20:51.480300+0000","last_peered":"2024-07-26T12:20:51.480300+0000","last_clean":"2024-07-26T12:20:51.480300+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:20:51.480300+0000","last_undegraded":"2024-07-26T12:20:51.480300+0000","last_fullsized":"2024-07-26T12:20:51.480300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827403+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:20:27.827403+0000","last_peered":"2024-07-26T12:20:27.827403+0000","last_clean":"2024-07-26T12:20:27.827403+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:20:27.827403+0000","last_undegraded":"2024-07-26T12:20:27.827403+0000","last_fullsized":"2024-07-26T12:20:27.827403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088167+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088167+0000","last_peered":"2024-07-26T12:18:59.088167+0000","last_clean":"2024-07-26T12:18:59.088167+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088167+0000","last_undegraded":"2024-07-26T12:18:59.088167+0000","last_fullsized":"2024-07-26T12:18:59.088167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084679+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084679+0000","last_peered":"2024-07-26T12:18:59.084679+0000","last_clean":"2024-07-26T12:18:59.084679+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084679+0000","last_undegraded":"2024-07-26T12:18:59.084679+0000","last_fullsized":"2024-07-26T12:18:59.084679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826479+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:20:27.826479+0000","last_peered":"2024-07-26T12:20:27.826479+0000","last_clean":"2024-07-26T12:20:27.826479+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:20:27.826479+0000","last_undegraded":"2024-07-26T12:20:27.826479+0000","last_fullsized":"2024-07-26T12:20:27.826479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117922+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117922+0000","last_peered":"2024-07-26T12:18:59.117922+0000","last_clean":"2024-07-26T12:18:59.117922+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117922+0000","last_undegraded":"2024-07-26T12:18:59.117922+0000","last_fullsized":"2024-07-26T12:18:59.117922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838492+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:20:27.838492+0000","last_peered":"2024-07-26T12:20:27.838492+0000","last_clean":"2024-07-26T12:20:27.838492+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:20:27.838492+0000","last_undegraded":"2024-07-26T12:20:27.838492+0000","last_fullsized":"2024-07-26T12:20:27.838492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:48.462275+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:20:48.462275+0000","last_peered":"2024-07-26T12:20:48.462275+0000","last_clean":"2024-07-26T12:20:48.462275+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:20:48.462275+0000","last_undegraded":"2024-07-26T12:20:48.462275+0000","last_fullsized":"2024-07-26T12:20:48.462275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":234,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839450+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:20:27.839450+0000","last_peered":"2024-07-26T12:20:27.839450+0000","last_clean":"2024-07-26T12:20:27.839450+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:20:27.839450+0000","last_undegraded":"2024-07-26T12:20:27.839450+0000","last_fullsized":"2024-07-26T12:20:27.839450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096936+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096936+0000","last_peered":"2024-07-26T12:18:59.096936+0000","last_clean":"2024-07-26T12:18:59.096936+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096936+0000","last_undegraded":"2024-07-26T12:18:59.096936+0000","last_fullsized":"2024-07-26T12:18:59.096936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830250+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:20:27.830250+0000","last_peered":"2024-07-26T12:20:27.830250+0000","last_clean":"2024-07-26T12:20:27.830250+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:20:27.830250+0000","last_undegraded":"2024-07-26T12:20:27.830250+0000","last_fullsized":"2024-07-26T12:20:27.830250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118636+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118636+0000","last_peered":"2024-07-26T12:18:59.118636+0000","last_clean":"2024-07-26T12:18:59.118636+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118636+0000","last_undegraded":"2024-07-26T12:18:59.118636+0000","last_fullsized":"2024-07-26T12:18:59.118636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839729+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:20:27.839729+0000","last_peered":"2024-07-26T12:20:27.839729+0000","last_clean":"2024-07-26T12:20:27.839729+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:20:27.839729+0000","last_undegraded":"2024-07-26T12:20:27.839729+0000","last_fullsized":"2024-07-26T12:20:27.839729+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:48.482486+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:20:48.482486+0000","last_peered":"2024-07-26T12:20:48.482486+0000","last_clean":"2024-07-26T12:20:48.482486+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:20:48.482486+0000","last_undegraded":"2024-07-26T12:20:48.482486+0000","last_fullsized":"2024-07-26T12:20:48.482486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64973,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":176,"num_write":39,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827748+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:20:27.827748+0000","last_peered":"2024-07-26T12:20:27.827748+0000","last_clean":"2024-07-26T12:20:27.827748+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:20:27.827748+0000","last_undegraded":"2024-07-26T12:20:27.827748+0000","last_fullsized":"2024-07-26T12:20:27.827748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094059+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.094059+0000","last_peered":"2024-07-26T12:18:59.094059+0000","last_clean":"2024-07-26T12:18:59.094059+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.094059+0000","last_undegraded":"2024-07-26T12:18:59.094059+0000","last_fullsized":"2024-07-26T12:18:59.094059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827622+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:20:27.827622+0000","last_peered":"2024-07-26T12:20:27.827622+0000","last_clean":"2024-07-26T12:20:27.827622+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:20:27.827622+0000","last_undegraded":"2024-07-26T12:20:27.827622+0000","last_fullsized":"2024-07-26T12:20:27.827622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117333+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117333+0000","last_peered":"2024-07-26T12:18:59.117333+0000","last_clean":"2024-07-26T12:18:59.117333+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117333+0000","last_undegraded":"2024-07-26T12:18:59.117333+0000","last_fullsized":"2024-07-26T12:18:59.117333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.843505+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:20:27.843505+0000","last_peered":"2024-07-26T12:20:27.843505+0000","last_clean":"2024-07-26T12:20:27.843505+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:20:27.843505+0000","last_undegraded":"2024-07-26T12:20:27.843505+0000","last_fullsized":"2024-07-26T12:20:27.843505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":152,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:48.441499+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:20:48.441499+0000","last_peered":"2024-07-26T12:20:48.441499+0000","last_clean":"2024-07-26T12:20:48.441499+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:20:48.441499+0000","last_undegraded":"2024-07-26T12:20:48.441499+0000","last_fullsized":"2024-07-26T12:20:48.441499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838824+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:20:27.838824+0000","last_peered":"2024-07-26T12:20:27.838824+0000","last_clean":"2024-07-26T12:20:27.838824+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:20:27.838824+0000","last_undegraded":"2024-07-26T12:20:27.838824+0000","last_fullsized":"2024-07-26T12:20:27.838824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096135+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.096135+0000","last_peered":"2024-07-26T12:18:59.096135+0000","last_clean":"2024-07-26T12:18:59.096135+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.096135+0000","last_undegraded":"2024-07-26T12:18:59.096135+0000","last_fullsized":"2024-07-26T12:18:59.096135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834733+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:20:27.834733+0000","last_peered":"2024-07-26T12:20:27.834733+0000","last_clean":"2024-07-26T12:20:27.834733+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:20:27.834733+0000","last_undegraded":"2024-07-26T12:20:27.834733+0000","last_fullsized":"2024-07-26T12:20:27.834733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.104420+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:18:59.104420+0000","last_peered":"2024-07-26T12:18:59.104420+0000","last_clean":"2024-07-26T12:18:59.104420+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:18:59.104420+0000","last_undegraded":"2024-07-26T12:18:59.104420+0000","last_fullsized":"2024-07-26T12:18:59.104420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822644+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:20:27.822644+0000","last_peered":"2024-07-26T12:20:27.822644+0000","last_clean":"2024-07-26T12:20:27.822644+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:20:27.822644+0000","last_undegraded":"2024-07-26T12:20:27.822644+0000","last_fullsized":"2024-07-26T12:20:27.822644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.121398+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.121398+0000","last_peered":"2024-07-26T12:18:59.121398+0000","last_clean":"2024-07-26T12:18:59.121398+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.121398+0000","last_undegraded":"2024-07-26T12:18:59.121398+0000","last_fullsized":"2024-07-26T12:18:59.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837997+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:20:27.837997+0000","last_peered":"2024-07-26T12:20:27.837997+0000","last_clean":"2024-07-26T12:20:27.837997+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:20:27.837997+0000","last_undegraded":"2024-07-26T12:20:27.837997+0000","last_fullsized":"2024-07-26T12:20:27.837997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118876+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118876+0000","last_peered":"2024-07-26T12:18:59.118876+0000","last_clean":"2024-07-26T12:18:59.118876+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118876+0000","last_undegraded":"2024-07-26T12:18:59.118876+0000","last_fullsized":"2024-07-26T12:18:59.118876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.833208+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:20:27.833208+0000","last_peered":"2024-07-26T12:20:27.833208+0000","last_clean":"2024-07-26T12:20:27.833208+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:20:27.833208+0000","last_undegraded":"2024-07-26T12:20:27.833208+0000","last_fullsized":"2024-07-26T12:20:27.833208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":157,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:52.475913+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:20:52.475913+0000","last_peered":"2024-07-26T12:20:52.475913+0000","last_clean":"2024-07-26T12:20:52.475913+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:20:52.475913+0000","last_undegraded":"2024-07-26T12:20:52.475913+0000","last_fullsized":"2024-07-26T12:20:52.475913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840206+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:20:27.840206+0000","last_peered":"2024-07-26T12:20:27.840206+0000","last_clean":"2024-07-26T12:20:27.840206+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:20:27.840206+0000","last_undegraded":"2024-07-26T12:20:27.840206+0000","last_fullsized":"2024-07-26T12:20:27.840206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099348+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.099348+0000","last_peered":"2024-07-26T12:18:59.099348+0000","last_clean":"2024-07-26T12:18:59.099348+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.099348+0000","last_undegraded":"2024-07-26T12:18:59.099348+0000","last_fullsized":"2024-07-26T12:18:59.099348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.106205+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:18:59.106205+0000","last_peered":"2024-07-26T12:18:59.106205+0000","last_clean":"2024-07-26T12:18:59.106205+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:18:59.106205+0000","last_undegraded":"2024-07-26T12:18:59.106205+0000","last_fullsized":"2024-07-26T12:18:59.106205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834859+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:20:27.834859+0000","last_peered":"2024-07-26T12:20:27.834859+0000","last_clean":"2024-07-26T12:20:27.834859+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:20:27.834859+0000","last_undegraded":"2024-07-26T12:20:27.834859+0000","last_fullsized":"2024-07-26T12:20:27.834859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096453+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:18:59.096453+0000","last_peered":"2024-07-26T12:18:59.096453+0000","last_clean":"2024-07-26T12:18:59.096453+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:18:59.096453+0000","last_undegraded":"2024-07-26T12:18:59.096453+0000","last_fullsized":"2024-07-26T12:18:59.096453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822472+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:20:27.822472+0000","last_peered":"2024-07-26T12:20:27.822472+0000","last_clean":"2024-07-26T12:20:27.822472+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:20:27.822472+0000","last_undegraded":"2024-07-26T12:20:27.822472+0000","last_fullsized":"2024-07-26T12:20:27.822472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:51.448630+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:20:51.448630+0000","last_peered":"2024-07-26T12:20:51.448630+0000","last_clean":"2024-07-26T12:20:51.448630+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:20:51.448630+0000","last_undegraded":"2024-07-26T12:20:51.448630+0000","last_fullsized":"2024-07-26T12:20:51.448630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827288+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:20:27.827288+0000","last_peered":"2024-07-26T12:20:27.827288+0000","last_clean":"2024-07-26T12:20:27.827288+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:20:27.827288+0000","last_undegraded":"2024-07-26T12:20:27.827288+0000","last_fullsized":"2024-07-26T12:20:27.827288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:51.451070+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:20:51.451070+0000","last_peered":"2024-07-26T12:20:51.451070+0000","last_clean":"2024-07-26T12:20:51.451070+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:20:51.451070+0000","last_undegraded":"2024-07-26T12:20:51.451070+0000","last_fullsized":"2024-07-26T12:20:51.451070+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836459+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:20:27.836459+0000","last_peered":"2024-07-26T12:20:27.836459+0000","last_clean":"2024-07-26T12:20:27.836459+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:20:27.836459+0000","last_undegraded":"2024-07-26T12:20:27.836459+0000","last_fullsized":"2024-07-26T12:20:27.836459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.092627+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:18:59.092627+0000","last_peered":"2024-07-26T12:18:59.092627+0000","last_clean":"2024-07-26T12:18:59.092627+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:18:59.092627+0000","last_undegraded":"2024-07-26T12:18:59.092627+0000","last_fullsized":"2024-07-26T12:18:59.092627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826332+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:20:27.826332+0000","last_peered":"2024-07-26T12:20:27.826332+0000","last_clean":"2024-07-26T12:20:27.826332+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:20:27.826332+0000","last_undegraded":"2024-07-26T12:20:27.826332+0000","last_fullsized":"2024-07-26T12:20:27.826332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096975+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:18:59.096975+0000","last_peered":"2024-07-26T12:18:59.096975+0000","last_clean":"2024-07-26T12:18:59.096975+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:18:59.096975+0000","last_undegraded":"2024-07-26T12:18:59.096975+0000","last_fullsized":"2024-07-26T12:18:59.096975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827657+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:20:27.827657+0000","last_peered":"2024-07-26T12:20:27.827657+0000","last_clean":"2024-07-26T12:20:27.827657+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:20:27.827657+0000","last_undegraded":"2024-07-26T12:20:27.827657+0000","last_fullsized":"2024-07-26T12:20:27.827657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:28.611805+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:20:28.611805+0000","last_peered":"2024-07-26T12:20:28.611805+0000","last_clean":"2024-07-26T12:20:28.611805+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:20:28.611805+0000","last_undegraded":"2024-07-26T12:20:28.611805+0000","last_fullsized":"2024-07-26T12:20:28.611805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835465+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:20:27.835465+0000","last_peered":"2024-07-26T12:20:27.835465+0000","last_clean":"2024-07-26T12:20:27.835465+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:20:27.835465+0000","last_undegraded":"2024-07-26T12:20:27.835465+0000","last_fullsized":"2024-07-26T12:20:27.835465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107188+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107188+0000","last_peered":"2024-07-26T12:18:59.107188+0000","last_clean":"2024-07-26T12:18:59.107188+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107188+0000","last_undegraded":"2024-07-26T12:18:59.107188+0000","last_fullsized":"2024-07-26T12:18:59.107188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831555+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:20:27.831555+0000","last_peered":"2024-07-26T12:20:27.831555+0000","last_clean":"2024-07-26T12:20:27.831555+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:20:27.831555+0000","last_undegraded":"2024-07-26T12:20:27.831555+0000","last_fullsized":"2024-07-26T12:20:27.831555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094126+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:18:59.094126+0000","last_peered":"2024-07-26T12:18:59.094126+0000","last_clean":"2024-07-26T12:18:59.094126+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:18:59.094126+0000","last_undegraded":"2024-07-26T12:18:59.094126+0000","last_fullsized":"2024-07-26T12:18:59.094126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.809284+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:20:27.809284+0000","last_peered":"2024-07-26T12:20:27.809284+0000","last_clean":"2024-07-26T12:20:27.809284+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:20:27.809284+0000","last_undegraded":"2024-07-26T12:20:27.809284+0000","last_fullsized":"2024-07-26T12:20:27.809284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095568+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:18:59.095568+0000","last_peered":"2024-07-26T12:18:59.095568+0000","last_clean":"2024-07-26T12:18:59.095568+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:18:59.095568+0000","last_undegraded":"2024-07-26T12:18:59.095568+0000","last_fullsized":"2024-07-26T12:18:59.095568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826443+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:20:27.826443+0000","last_peered":"2024-07-26T12:20:27.826443+0000","last_clean":"2024-07-26T12:20:27.826443+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:20:27.826443+0000","last_undegraded":"2024-07-26T12:20:27.826443+0000","last_fullsized":"2024-07-26T12:20:27.826443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096064+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:18:59.096064+0000","last_peered":"2024-07-26T12:18:59.096064+0000","last_clean":"2024-07-26T12:18:59.096064+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:18:59.096064+0000","last_undegraded":"2024-07-26T12:18:59.096064+0000","last_fullsized":"2024-07-26T12:18:59.096064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831171+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:20:27.831171+0000","last_peered":"2024-07-26T12:20:27.831171+0000","last_clean":"2024-07-26T12:20:27.831171+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:20:27.831171+0000","last_undegraded":"2024-07-26T12:20:27.831171+0000","last_fullsized":"2024-07-26T12:20:27.831171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.120325+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:18:59.120325+0000","last_peered":"2024-07-26T12:18:59.120325+0000","last_clean":"2024-07-26T12:18:59.120325+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:18:59.120325+0000","last_undegraded":"2024-07-26T12:18:59.120325+0000","last_fullsized":"2024-07-26T12:18:59.120325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840809+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:20:27.840809+0000","last_peered":"2024-07-26T12:20:27.840809+0000","last_clean":"2024-07-26T12:20:27.840809+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:20:27.840809+0000","last_undegraded":"2024-07-26T12:20:27.840809+0000","last_fullsized":"2024-07-26T12:20:27.840809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838959+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:20:27.838959+0000","last_peered":"2024-07-26T12:20:27.838959+0000","last_clean":"2024-07-26T12:20:27.838959+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:20:27.838959+0000","last_undegraded":"2024-07-26T12:20:27.838959+0000","last_fullsized":"2024-07-26T12:20:27.838959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.098071+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.098071+0000","last_peered":"2024-07-26T12:18:59.098071+0000","last_clean":"2024-07-26T12:18:59.098071+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.098071+0000","last_undegraded":"2024-07-26T12:18:59.098071+0000","last_fullsized":"2024-07-26T12:18:59.098071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837504+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:20:27.837504+0000","last_peered":"2024-07-26T12:20:27.837504+0000","last_clean":"2024-07-26T12:20:27.837504+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:20:27.837504+0000","last_undegraded":"2024-07-26T12:20:27.837504+0000","last_fullsized":"2024-07-26T12:20:27.837504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096568+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096568+0000","last_peered":"2024-07-26T12:18:59.096568+0000","last_clean":"2024-07-26T12:18:59.096568+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096568+0000","last_undegraded":"2024-07-26T12:18:59.096568+0000","last_fullsized":"2024-07-26T12:18:59.096568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839888+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:20:27.839888+0000","last_peered":"2024-07-26T12:20:27.839888+0000","last_clean":"2024-07-26T12:20:27.839888+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:20:27.839888+0000","last_undegraded":"2024-07-26T12:20:27.839888+0000","last_fullsized":"2024-07-26T12:20:27.839888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.097680+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:18:59.097680+0000","last_peered":"2024-07-26T12:18:59.097680+0000","last_clean":"2024-07-26T12:18:59.097680+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:18:59.097680+0000","last_undegraded":"2024-07-26T12:18:59.097680+0000","last_fullsized":"2024-07-26T12:18:59.097680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824424+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:20:27.824424+0000","last_peered":"2024-07-26T12:20:27.824424+0000","last_clean":"2024-07-26T12:20:27.824424+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:20:27.824424+0000","last_undegraded":"2024-07-26T12:20:27.824424+0000","last_fullsized":"2024-07-26T12:20:27.824424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":182,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:50.446493+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:20:50.446493+0000","last_peered":"2024-07-26T12:20:50.446493+0000","last_clean":"2024-07-26T12:20:50.446493+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:20:50.446493+0000","last_undegraded":"2024-07-26T12:20:50.446493+0000","last_fullsized":"2024-07-26T12:20:50.446493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71927,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1205,"num_read_kb":673,"num_write":255,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":436343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841590,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1091673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201347,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397580,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1027966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593809,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986273,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":500152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182502,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":436983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":501204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":436657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:20:55.894 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-26T12:20:55.894 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-07-26T12:20:55.894 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-07-26T12:20:55.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph health --format=json 2024-07-26T12:20:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:55 smithi146 ceph-mon[35807]: pgmap v460: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:20:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:55 smithi076 ceph-mon[35401]: pgmap v460: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:20:56.426 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:20:56.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:56 smithi040 ceph-mon[32397]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:20:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:56 smithi146 ceph-mon[35807]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:20:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:56 smithi076 ceph-mon[35401]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:20:57.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:57 smithi040 ceph-mon[32397]: pgmap v461: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:57 smithi146 ceph-mon[35807]: pgmap v461: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:57 smithi076 ceph-mon[35401]: pgmap v461: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:20:58.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 -- 172.21.15.40:0/4043597975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 msgr2=0x7fd4b0112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:58.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 --2- 172.21.15.40:0/4043597975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b0112090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009ca0 tx=0x7fd4a802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:20:58.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 -- 172.21.15.40:0/4043597975 shutdown_connections 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 --2- 172.21.15.40:0/4043597975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b0112090 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 --2- 172.21.15.40:0/4043597975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 0x7fd4b010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 --2- 172.21.15.40:0/4043597975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 0x7fd4b01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 -- 172.21.15.40:0/4043597975 >> 172.21.15.40:0/4043597975 conn(0x7fd4b0101040 msgr2=0x7fd4b0103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 -- 172.21.15.40:0/4043597975 shutdown_connections 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.811+0000 7fd4af200640 1 -- 172.21.15.40:0/4043597975 wait complete. 2024-07-26T12:20:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 Processor -- start 2024-07-26T12:20:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 -- start start 2024-07-26T12:20:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 0x7fd4b019be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 0x7fd4b019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0115430 con 0x7fd4b010b860 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01152b0 con 0x7fd4b010af10 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.813+0000 7fd4af200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01155b0 con 0x7fd4b01055d0 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b01a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37338/0 (socket says 172.21.15.40:37338) 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 -- 172.21.15.40:0/367231934 learned_addr learned my addr 172.21.15.40:0/367231934 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ade00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 0x7fd4b019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4a7e00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 0x7fd4b019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:58.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 -- 172.21.15.40:0/367231934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 msgr2=0x7fd4b019be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:58.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 0x7fd4b019be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:58.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 -- 172.21.15.40:0/367231934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 msgr2=0x7fd4b019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:58.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 0x7fd4b019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:58.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ae800640 1 -- 172.21.15.40:0/367231934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b01a1df0 con 0x7fd4b010b860 2024-07-26T12:20:58.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4ade00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 0x7fd4b019be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.814+0000 7fd4a7e00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 0x7fd4b019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.815+0000 7fd4ae800640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b01a16c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8005cc0 tx=0x7fd4a8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.815+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8032c10 con 0x7fd4b010b860 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.815+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a8032db0 con 0x7fd4b010b860 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.815+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b01a2080 con 0x7fd4b010b860 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.815+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8030a60 con 0x7fd4b010b860 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.815+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b01a8840 con 0x7fd4b010b860 2024-07-26T12:20:58.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.817+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b01059e0 con 0x7fd4b010b860 2024-07-26T12:20:58.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.819+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd4a8030c00 con 0x7fd4b010b860 2024-07-26T12:20:58.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.821+0000 7fd4a6a00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4940b3c50 0x7fd4940b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:20:58.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.821+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4a8104ff0 con 0x7fd4b010b860 2024-07-26T12:20:58.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.821+0000 7fd4ade00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4940b3c50 0x7fd4940b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:20:58.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.822+0000 7fd4ade00640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4940b3c50 0x7fd4940b6160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009c20 tx=0x7fd4a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:20:58.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:58.826+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd4a80cc600 con 0x7fd4b010b860 2024-07-26T12:20:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.067+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4b010d6b0 con 0x7fd4b010b860 2024-07-26T12:20:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.068+0000 7fd4a6a00640 1 -- 172.21.15.40:0/367231934 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd4a80cbf00 con 0x7fd4b010b860 2024-07-26T12:20:59.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:20:59.071 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-07-26T12:20:59.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4940b3c50 msgr2=0x7fd4940b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:59.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4940b3c50 0x7fd4940b6160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009c20 tx=0x7fd4a0005f90 comp rx=0 tx=0).stop 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 msgr2=0x7fd4b01a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b01a16c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8005cc0 tx=0x7fd4a8003f90 comp rx=0 tx=0).stop 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 shutdown_connections 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b010b860 0x7fd4b01a16c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4b010af10 0x7fd4b019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4940b3c50 0x7fd4940b6160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 --2- 172.21.15.40:0/367231934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b01055d0 0x7fd4b019be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.071+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 >> 172.21.15.40:0/367231934 conn(0x7fd4b0101040 msgr2=0x7fd4b0103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:20:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.072+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 shutdown_connections 2024-07-26T12:20:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:20:59.072+0000 7fd4af200640 1 -- 172.21.15.40:0/367231934 wait complete. 2024-07-26T12:20:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:59 smithi040 ceph-mon[32397]: pgmap v462: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:20:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:20:59 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/367231934' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-26T12:20:59.959 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-07-26T12:20:59.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:21:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:59 smithi146 ceph-mon[35807]: pgmap v462: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:20:59 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/367231934' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-26T12:21:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:59 smithi076 ceph-mon[35401]: pgmap v462: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:20:59 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/367231934' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-07-26T12:21:00.457 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:00.859 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:00 smithi040 ceph-mon[32397]: pgmap v463: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:00 smithi146 ceph-mon[35807]: pgmap v463: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:00 smithi076 ceph-mon[35401]: pgmap v463: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:02.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 -- 172.21.15.40:0/1468048530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984077cc0 msgr2=0x7f4984113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 --2- 172.21.15.40:0/1468048530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984077cc0 0x7f4984113c30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f496c009900 tx=0x7f496c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 -- 172.21.15.40:0/1468048530 shutdown_connections 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 --2- 172.21.15.40:0/1468048530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4984114170 0x7f4984116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 --2- 172.21.15.40:0/1468048530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984077cc0 0x7f4984113c30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 --2- 172.21.15.40:0/1468048530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 0x7f4984077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 -- 172.21.15.40:0/1468048530 >> 172.21.15.40:0/1468048530 conn(0x7f4984101240 msgr2=0x7f4984103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.709+0000 7f498b000640 1 -- 172.21.15.40:0/1468048530 shutdown_connections 2024-07-26T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.710+0000 7f498b000640 1 -- 172.21.15.40:0/1468048530 wait complete. 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 Processor -- start 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 -- start start 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 0x7f49841a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4984077cc0 0x7f49841a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 0x7f49841a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4984119a10 con 0x7f4984114170 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4984119890 con 0x7f4984077cc0 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.711+0000 7f498b000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4984119b90 con 0x7f4984077370 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 0x7f49841a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 0x7f49841a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37356/0 (socket says 172.21.15.40:37356) 2024-07-26T12:21:02.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 -- 172.21.15.40:0/4193051345 learned_addr learned my addr 172.21.15.40:0/4193051345 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:02.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4983400640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4984077cc0 0x7f49841a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:02.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4983e00640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 0x7f49841a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 -- 172.21.15.40:0/4193051345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 msgr2=0x7f49841a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 0x7f49841a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 -- 172.21.15.40:0/4193051345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4984077cc0 msgr2=0x7f49841a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4984077cc0 0x7f49841a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4989000640 1 -- 172.21.15.40:0/4193051345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49841a6370 con 0x7f4984114170 2024-07-26T12:21:02.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.712+0000 7f4983e00640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 0x7f49841a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.713+0000 7f4989000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 0x7f49841a5d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f497c00c970 tx=0x7f497c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.713+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c007bb0 con 0x7f4984114170 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.713+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f497c007d50 con 0x7f4984114170 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.713+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49841a6660 con 0x7f4984114170 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.713+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c018660 con 0x7f4984114170 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.713+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49841ace80 con 0x7f4984114170 2024-07-26T12:21:02.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.714+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4984077780 con 0x7f4984114170 2024-07-26T12:21:02.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.717+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f497c00f970 con 0x7f4984114170 2024-07-26T12:21:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.719+0000 7f4980c00640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49680b3c80 0x7f49680b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.719+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f497c0e3d70 con 0x7f4984114170 2024-07-26T12:21:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.719+0000 7f4983e00640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49680b3c80 0x7f49680b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.720+0000 7f4983e00640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49680b3c80 0x7f49680b6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4974009fa0 tx=0x7f4974009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.721+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f497c055600 con 0x7f4984114170 2024-07-26T12:21:02.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.967+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49841a15f0 con 0x7f4984114170 2024-07-26T12:21:02.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.969+0000 7f4980c00640 1 -- 172.21.15.40:0/4193051345 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f497c014030 con 0x7f4984114170 2024-07-26T12:21:02.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:02.971 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:21:02.972 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"btime":"2024-07-26T12:18:56:044354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:18:55.823664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:21:02.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.972+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49680b3c80 msgr2=0x7f49680b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:02.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.972+0000 7f498b000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49680b3c80 0x7f49680b6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4974009fa0 tx=0x7f4974009570 comp rx=0 tx=0).stop 2024-07-26T12:21:02.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.972+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 msgr2=0x7f49841a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:02.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.972+0000 7f498b000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 0x7f49841a5d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f497c00c970 tx=0x7f497c00ce30 comp rx=0 tx=0).stop 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 shutdown_connections 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4984114170 0x7f49841a5d00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4984077cc0 0x7f49841a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49680b3c80 0x7f49680b6190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 --2- 172.21.15.40:0/4193051345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4984077370 0x7f49841a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 >> 172.21.15.40:0/4193051345 conn(0x7f4984101240 msgr2=0x7f49841162a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 shutdown_connections 2024-07-26T12:21:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:02.973+0000 7f498b000640 1 -- 172.21.15.40:0/4193051345 wait complete. 2024-07-26T12:21:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:02 smithi040 ceph-mon[32397]: pgmap v464: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:02 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4193051345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:02 smithi146 ceph-mon[35807]: pgmap v464: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:02 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4193051345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:02 smithi076 ceph-mon[35401]: pgmap v464: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:02 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4193051345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:03.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:21:04.331 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:04 smithi040 ceph-mon[32397]: pgmap v465: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:04 smithi146 ceph-mon[35807]: pgmap v465: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:04 smithi076 ceph-mon[35401]: pgmap v465: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:06.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.500+0000 7f597b000640 1 -- 172.21.15.40:0/160469364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974075800 msgr2=0x7f5974075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:06.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.500+0000 7f597b000640 1 --2- 172.21.15.40:0/160469364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974075800 0x7f5974075c10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5960009900 tx=0x7f596002a410 comp rx=0 tx=0).stop 2024-07-26T12:21:06.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 -- 172.21.15.40:0/160469364 shutdown_connections 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 --2- 172.21.15.40:0/160469364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 0x7f5974116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 --2- 172.21.15.40:0/160469364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974075800 0x7f5974075c10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 --2- 172.21.15.40:0/160469364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974076db0 0x7f59740751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 -- 172.21.15.40:0/160469364 >> 172.21.15.40:0/160469364 conn(0x7f59740fee70 msgr2=0x7f59741012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 -- 172.21.15.40:0/160469364 shutdown_connections 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.501+0000 7f597b000640 1 -- 172.21.15.40:0/160469364 wait complete. 2024-07-26T12:21:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.503+0000 7f597b000640 1 Processor -- start 2024-07-26T12:21:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.503+0000 7f597b000640 1 -- start start 2024-07-26T12:21:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.503+0000 7f597b000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974075800 0x7f59741a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f597b000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 0x7f59741a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f597b000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 0x7f59741a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f597b000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f59741197a0 con 0x7f5974076db0 2024-07-26T12:21:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f597b000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5974119620 con 0x7f5974113cb0 2024-07-26T12:21:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f597b000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5974119920 con 0x7f5974075800 2024-07-26T12:21:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f5979200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 0x7f59741a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f5979200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 0x7f59741a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35726/0 (socket says 172.21.15.40:35726) 2024-07-26T12:21:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f5979200640 1 -- 172.21.15.40:0/3623243363 learned_addr learned my addr 172.21.15.40:0/3623243363 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f5979c00640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974075800 0x7f59741a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.504+0000 7f597a600640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 0x7f59741a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5979200640 1 -- 172.21.15.40:0/3623243363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974075800 msgr2=0x7f59741a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5979200640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974075800 0x7f59741a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5979200640 1 -- 172.21.15.40:0/3623243363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 msgr2=0x7f59741a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5979200640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 0x7f59741a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5979200640 1 -- 172.21.15.40:0/3623243363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59741a61c0 con 0x7f5974076db0 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f597a600640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 0x7f59741a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5979200640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 0x7f59741a07f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5960005940 tx=0x7f59600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596003f030 con 0x7f5974076db0 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59741a6450 con 0x7f5974076db0 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.505+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5960003c90 con 0x7f5974076db0 2024-07-26T12:21:06.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.506+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960035070 con 0x7f5974076db0 2024-07-26T12:21:06.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.506+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741acc10 con 0x7f5974076db0 2024-07-26T12:21:06.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.507+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5974075c10 con 0x7f5974076db0 2024-07-26T12:21:06.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.509+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5960042030 con 0x7f5974076db0 2024-07-26T12:21:06.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.511+0000 7f5972000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f595c0b3c50 0x7f595c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:06.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.511+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5960104120 con 0x7f5974076db0 2024-07-26T12:21:06.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.511+0000 7f5979c00640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f595c0b3c50 0x7f595c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:06.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.512+0000 7f5979c00640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f595c0b3c50 0x7f595c0b6160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5968005fd0 tx=0x7f596800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:06.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.515+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f59600cb730 con 0x7f5974076db0 2024-07-26T12:21:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.758+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59741129e0 con 0x7f5974076db0 2024-07-26T12:21:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.759+0000 7f5972000640 1 -- 172.21.15.40:0/3623243363 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f59600cb030 con 0x7f5974076db0 2024-07-26T12:21:06.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:06.761 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"btime":"2024-07-26T12:18:56:044354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:18:55.823664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:21:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:21:06.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f595c0b3c50 msgr2=0x7f595c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:06.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f595c0b3c50 0x7f595c0b6160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5968005fd0 tx=0x7f596800b390 comp rx=0 tx=0).stop 2024-07-26T12:21:06.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 msgr2=0x7f59741a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:06.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 0x7f59741a07f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5960005940 tx=0x7f59600042f0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 shutdown_connections 2024-07-26T12:21:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5974113cb0 0x7f59741a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5974076db0 0x7f59741a07f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f595c0b3c50 0x7f595c0b6160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 --2- 172.21.15.40:0/3623243363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974075800 0x7f59741a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 >> 172.21.15.40:0/3623243363 conn(0x7f59740fee70 msgr2=0x7f597410fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.763+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 shutdown_connections 2024-07-26T12:21:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:06.765+0000 7f597b000640 1 -- 172.21.15.40:0/3623243363 wait complete. 2024-07-26T12:21:07.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:06 smithi040 ceph-mon[32397]: pgmap v466: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:07.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:06 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3623243363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:06 smithi146 ceph-mon[35807]: pgmap v466: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:06 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3623243363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:06 smithi076 ceph-mon[35401]: pgmap v466: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:06 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3623243363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:07.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:21:08.001 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:08 smithi146 ceph-mon[35807]: pgmap v467: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:08 smithi076 ceph-mon[35401]: pgmap v467: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:09.367 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:08 smithi040 ceph-mon[32397]: pgmap v467: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.235+0000 7feff7e00640 1 -- 172.21.15.40:0/1993440231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81099f0 msgr2=0x7feff8109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.235+0000 7feff7e00640 1 --2- 172.21.15.40:0/1993440231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81099f0 0x7feff8109e00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009900 tx=0x7fefe802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 -- 172.21.15.40:0/1993440231 shutdown_connections 2024-07-26T12:21:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 --2- 172.21.15.40:0/1993440231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feff810fc80 0x7feff81164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 --2- 172.21.15.40:0/1993440231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feff810f330 0x7feff810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 --2- 172.21.15.40:0/1993440231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81099f0 0x7feff8109e00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 -- 172.21.15.40:0/1993440231 >> 172.21.15.40:0/1993440231 conn(0x7feff8078ff0 msgr2=0x7feff8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 -- 172.21.15.40:0/1993440231 shutdown_connections 2024-07-26T12:21:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.236+0000 7feff7e00640 1 -- 172.21.15.40:0/1993440231 wait complete. 2024-07-26T12:21:10.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.237+0000 7feff7e00640 1 Processor -- start 2024-07-26T12:21:10.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.237+0000 7feff7e00640 1 -- start start 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feff810f330 0x7feff81a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feff810fc80 0x7feff81a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 0x7feff81a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feff81198a0 con 0x7feff81a5bf0 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feff8119720 con 0x7feff810f330 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feff8119a20 con 0x7feff810fc80 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 0x7feff81a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 0x7feff81a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35750/0 (socket says 172.21.15.40:35750) 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff7400640 1 -- 172.21.15.40:0/1620234531 learned_addr learned my addr 172.21.15.40:0/1620234531 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7feff6a00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feff810f330 0x7feff81a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.238+0000 7fefefe00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feff810fc80 0x7feff81a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7400640 1 -- 172.21.15.40:0/1620234531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feff810fc80 msgr2=0x7feff81a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7400640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feff810fc80 0x7feff81a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7400640 1 -- 172.21.15.40:0/1620234531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feff810f330 msgr2=0x7feff81a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7400640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feff810f330 0x7feff81a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7400640 1 -- 172.21.15.40:0/1620234531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81a67d0 con 0x7feff81a5bf0 2024-07-26T12:21:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7400640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 0x7feff81a6000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feff000b970 tx=0x7feff000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0019070 con 0x7feff81a5bf0 2024-07-26T12:21:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feff0014440 con 0x7feff81a5bf0 2024-07-26T12:21:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff81acd70 con 0x7feff81a5bf0 2024-07-26T12:21:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.239+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff00075d0 con 0x7feff81a5bf0 2024-07-26T12:21:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.240+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff81ad1f0 con 0x7feff81a5bf0 2024-07-26T12:21:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.241+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff8109e00 con 0x7feff81a5bf0 2024-07-26T12:21:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.243+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7feff001c070 con 0x7feff81a5bf0 2024-07-26T12:21:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.245+0000 7fefef400640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fefdc0b3bd0 0x7fefdc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.245+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feff00e31e0 con 0x7feff81a5bf0 2024-07-26T12:21:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.245+0000 7feff6a00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fefdc0b3bd0 0x7fefdc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.246+0000 7feff6a00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fefdc0b3bd0 0x7fefdc0b60e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009230 tx=0x7fefe8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:10.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.249+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7feff00aa1a0 con 0x7feff81a5bf0 2024-07-26T12:21:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.452+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feff802e0f0 con 0x7feff81a5bf0 2024-07-26T12:21:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.458+0000 7fefef400640 1 -- 172.21.15.40:0/1620234531 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7feff00ae6f0 con 0x7feff81a5bf0 2024-07-26T12:21:10.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:10.460 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:59.075766+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:21:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fefdc0b3bd0 msgr2=0x7fefdc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fefdc0b3bd0 0x7fefdc0b60e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009230 tx=0x7fefe8005d50 comp rx=0 tx=0).stop 2024-07-26T12:21:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 msgr2=0x7feff81a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 0x7feff81a6000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feff000b970 tx=0x7feff000be30 comp rx=0 tx=0).stop 2024-07-26T12:21:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 shutdown_connections 2024-07-26T12:21:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff81a5bf0 0x7feff81a6000 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fefdc0b3bd0 0x7fefdc0b60e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feff810fc80 0x7feff81a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 --2- 172.21.15.40:0/1620234531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feff810f330 0x7feff81a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.461+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 >> 172.21.15.40:0/1620234531 conn(0x7feff8078ff0 msgr2=0x7feff80799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.462+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 shutdown_connections 2024-07-26T12:21:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:10.462+0000 7feff7e00640 1 -- 172.21.15.40:0/1620234531 wait complete. 2024-07-26T12:21:11.116 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:11 smithi040 ceph-mon[32397]: pgmap v468: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:11.116 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:11 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1620234531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:21:11.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:21:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:11 smithi146 ceph-mon[35807]: pgmap v468: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:11 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1620234531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:21:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:11 smithi076 ceph-mon[35401]: pgmap v468: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:11 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1620234531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:21:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:13 smithi146 ceph-mon[35807]: pgmap v469: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:13.325 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:13 smithi040 ceph-mon[32397]: pgmap v469: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:13 smithi076 ceph-mon[35401]: pgmap v469: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 -- 172.21.15.40:0/4256292512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d00108d20 msgr2=0x7f6d00109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 --2- 172.21.15.40:0/4256292512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d00108d20 0x7f6d00109130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009ca0 tx=0x7f6cec02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 -- 172.21.15.40:0/4256292512 shutdown_connections 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 --2- 172.21.15.40:0/4256292512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d00109670 0x7f6d0010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 --2- 172.21.15.40:0/4256292512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d00108d20 0x7f6d00109130 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 --2- 172.21.15.40:0/4256292512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d001033e0 0x7f6d001037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 -- 172.21.15.40:0/4256292512 >> 172.21.15.40:0/4256292512 conn(0x7f6d000fee70 msgr2=0x7f6d001012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 -- 172.21.15.40:0/4256292512 shutdown_connections 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.844+0000 7f6d05400640 1 -- 172.21.15.40:0/4256292512 wait complete. 2024-07-26T12:21:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.846+0000 7f6d05400640 1 Processor -- start 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.846+0000 7f6d05400640 1 -- start start 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6d05400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 0x7f6d0019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6d05400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d00108d20 0x7f6d0019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6d05400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d00109670 0x7f6d001a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6d05400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00113200 con 0x7f6d001033e0 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6d05400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00113080 con 0x7f6d00108d20 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6d05400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00113380 con 0x7f6d00109670 2024-07-26T12:21:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 0x7f6d0019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 0x7f6d0019bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36588/0 (socket says 172.21.15.40:36588) 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6cffe00640 1 -- 172.21.15.40:0/3958102849 learned_addr learned my addr 172.21.15.40:0/3958102849 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.847+0000 7f6cff400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d00108d20 0x7f6d0019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6d04a00640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d00109670 0x7f6d001a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cffe00640 1 -- 172.21.15.40:0/3958102849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d00109670 msgr2=0x7f6d001a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cffe00640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d00109670 0x7f6d001a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cffe00640 1 -- 172.21.15.40:0/3958102849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d00108d20 msgr2=0x7f6d0019c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cffe00640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d00108d20 0x7f6d0019c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cffe00640 1 -- 172.21.15.40:0/3958102849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d001a1ec0 con 0x7f6d001033e0 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cffe00640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 0x7f6d0019bf50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000d770 tx=0x7f6cf000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0017070 con 0x7f6d001033e0 2024-07-26T12:21:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf00054b0 con 0x7f6d001033e0 2024-07-26T12:21:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d001a21b0 con 0x7f6d001033e0 2024-07-26T12:21:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.848+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0004c60 con 0x7f6d001033e0 2024-07-26T12:21:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.849+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d001a8910 con 0x7f6d001033e0 2024-07-26T12:21:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.850+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d001037f0 con 0x7f6d001033e0 2024-07-26T12:21:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.852+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6cf0004e00 con 0x7f6d001033e0 2024-07-26T12:21:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.854+0000 7f6cfcc00640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6ce40b3bd0 0x7f6ce40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:13.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.854+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6cf00e3b50 con 0x7f6d001033e0 2024-07-26T12:21:13.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.854+0000 7f6cff400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6ce40b3bd0 0x7f6ce40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.855+0000 7f6cff400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6ce40b3bd0 0x7f6ce40b60e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6cec006010 tx=0x7f6cec000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:13.856+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6cf00ab160 con 0x7f6d001033e0 2024-07-26T12:21:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.103+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d001a8bf0 con 0x7f6d001033e0 2024-07-26T12:21:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.105+0000 7f6cfcc00640 1 -- 172.21.15.40:0/3958102849 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f6cf00aaa60 con 0x7f6d001033e0 2024-07-26T12:21:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:14.106 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"btime":"2024-07-26T12:18:56:044354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:18:55.823664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:21:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.107+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6ce40b3bd0 msgr2=0x7f6ce40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.107+0000 7f6d05400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6ce40b3bd0 0x7f6ce40b60e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6cec006010 tx=0x7f6cec000f40 comp rx=0 tx=0).stop 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 msgr2=0x7f6d0019bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 0x7f6d0019bf50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000d770 tx=0x7f6cf000dc30 comp rx=0 tx=0).stop 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 shutdown_connections 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6ce40b3bd0 0x7f6ce40b60e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d00109670 0x7f6d001a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d00108d20 0x7f6d0019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 --2- 172.21.15.40:0/3958102849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d001033e0 0x7f6d0019bf50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 >> 172.21.15.40:0/3958102849 conn(0x7f6d000fee70 msgr2=0x7f6d00108450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 shutdown_connections 2024-07-26T12:21:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:14.108+0000 7f6d05400640 1 -- 172.21.15.40:0/3958102849 wait complete. 2024-07-26T12:21:14.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-26T12:18:32.339754+0000', 'modified': '2024-07-26T12:18:55.823664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34631, 'mds_1': 34592, 'mds_2': 34547, 'mds_3': 24610, 'mds_4': 24592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14673': {'gid': 14673, 'name': 'e', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.76:6835/3482143239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6834', 'nonce': 3482143239}, {'type': 'v1', 'addr': '172.21.15.76:6835', 'nonce': 3482143239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14715': {'gid': 14715, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.40:6839/694136309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6838', 'nonce': 694136309}, {'type': 'v1', 'addr': '172.21.15.40:6839', 'nonce': 694136309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14727': {'gid': 14727, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.40:6841/3170726419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6840', 'nonce': 3170726419}, {'type': 'v1', 'addr': '172.21.15.40:6841', 'nonce': 3170726419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24547': {'gid': 24547, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/1448706156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1448706156}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1448706156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24586': {'gid': 24586, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/1374524390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 1374524390}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 1374524390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24592': {'gid': 24592, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.146:6837/3076436166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 3076436166}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 3076436166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'i', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.146:6839/4061759756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 4061759756}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 4061759756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34547': {'gid': 34547, 'name': 'k', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.76:6833/2744171288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6832', 'nonce': 2744171288}, {'type': 'v1', 'addr': '172.21.15.76:6833', 'nonce': 2744171288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34592': {'gid': 34592, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.76:6837/3327676602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6836', 'nonce': 3327676602}, {'type': 'v1', 'addr': '172.21.15.76:6837', 'nonce': 3327676602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34631': {'gid': 34631, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.76:6839/3866154018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6838', 'nonce': 3866154018}, {'type': 'v1', 'addr': '172.21.15.76:6839', 'nonce': 3866154018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34631, 'qdb_cluster': [24592, 24610, 34547, 34592, 34631]} 2024-07-26T12:21:14.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-07-26T12:21:14.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.c status 2024-07-26T12:21:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:15 smithi040 ceph-mon[32397]: pgmap v470: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:15 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3958102849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:15 smithi146 ceph-mon[35807]: pgmap v470: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:15 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3958102849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:15 smithi076 ceph-mon[35401]: pgmap v470: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:15 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3958102849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:21:15.382 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:17.219 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:17 smithi040 ceph-mon[32397]: pgmap v471: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:17 smithi146 ceph-mon[35807]: pgmap v471: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:17 smithi076 ceph-mon[35401]: pgmap v471: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:17.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.427+0000 7f5b87800640 1 -- 172.21.15.40:0/3462613828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b801057e0 msgr2=0x7f5b80105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.427+0000 7f5b87800640 1 --2- 172.21.15.40:0/3462613828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b801057e0 0x7f5b80105bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009900 tx=0x7f5b7402a400 comp rx=0 tx=0).stop 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 -- 172.21.15.40:0/3462613828 shutdown_connections 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 --2- 172.21.15.40:0/3462613828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b8010ba70 0x7f5b801122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 --2- 172.21.15.40:0/3462613828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8010b120 0x7f5b8010b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 --2- 172.21.15.40:0/3462613828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b801057e0 0x7f5b80105bf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 -- 172.21.15.40:0/3462613828 >> 172.21.15.40:0/3462613828 conn(0x7f5b801011f0 msgr2=0x7f5b80103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 -- 172.21.15.40:0/3462613828 shutdown_connections 2024-07-26T12:21:17.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.428+0000 7f5b87800640 1 -- 172.21.15.40:0/3462613828 wait complete. 2024-07-26T12:21:17.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.429+0000 7f5b87800640 1 Processor -- start 2024-07-26T12:21:17.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.429+0000 7f5b87800640 1 -- start start 2024-07-26T12:21:17.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.429+0000 7f5b87800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b801057e0 0x7f5b8019c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b87800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 0x7f5b8019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b87800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b8010ba70 0x7f5b801a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b87800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5b80115640 con 0x7f5b8010b120 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b87800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801154c0 con 0x7f5b8010ba70 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b87800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801157c0 con 0x7f5b801057e0 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 0x7f5b8019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 0x7f5b8019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36606/0 (socket says 172.21.15.40:36606) 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 -- 172.21.15.40:0/3980747731 learned_addr learned my addr 172.21.15.40:0/3980747731 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b84e00640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b801057e0 0x7f5b8019c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b85800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b8010ba70 0x7f5b801a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 -- 172.21.15.40:0/3980747731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b801057e0 msgr2=0x7f5b8019c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b801057e0 0x7f5b8019c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 -- 172.21.15.40:0/3980747731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b8010ba70 msgr2=0x7f5b801a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b8010ba70 0x7f5b801a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.430+0000 7f5b7fe00640 1 -- 172.21.15.40:0/3980747731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b801a1f40 con 0x7f5b8010b120 2024-07-26T12:21:17.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.431+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 0x7f5b8019c630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c8c0 tx=0x7f5b6c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.431+0000 7f5b7d600640 1 -- 172.21.15.40:0/3980747731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c007bb0 con 0x7f5b8010b120 2024-07-26T12:21:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.431+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b801a2230 con 0x7f5b8010b120 2024-07-26T12:21:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.431+0000 7f5b7d600640 1 -- 172.21.15.40:0/3980747731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b6c007d50 con 0x7f5b8010b120 2024-07-26T12:21:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.431+0000 7f5b7d600640 1 -- 172.21.15.40:0/3980747731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c018660 con 0x7f5b8010b120 2024-07-26T12:21:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.431+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b801a8a50 con 0x7f5b8010b120 2024-07-26T12:21:17.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.435+0000 7f5b8e3f5740 1 Processor -- start 2024-07-26T12:21:17.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.435+0000 7f5b8e3f5740 1 -- start start 2024-07-26T12:21:17.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b7d600640 1 -- 172.21.15.40:0/3980747731 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5b6c00fa00 con 0x7f5b8010b120 2024-07-26T12:21:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb07987550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07987a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07987fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bb078fd950 con 0x55bb075b90a0 2024-07-26T12:21:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bb078ece50 con 0x55bb075c1280 2024-07-26T12:21:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bb078f0e90 con 0x55bb075e1f60 2024-07-26T12:21:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b84e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07987a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b84e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07987a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36622/0 (socket says 172.21.15.40:36622) 2024-07-26T12:21:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.436+0000 7f5b84e00640 1 -- 172.21.15.40:0/3665482056 learned_addr learned my addr 172.21.15.40:0/3665482056 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b85800640 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb07987550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07987fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b84e00640 1 -- 172.21.15.40:0/3665482056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 msgr2=0x55bb07987550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b84e00640 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb07987550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b84e00640 1 -- 172.21.15.40:0/3665482056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 msgr2=0x55bb07987fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b84e00640 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07987fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b84e00640 1 -- 172.21.15.40:0/3665482056 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb078940f0 con 0x55bb075b90a0 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b85800640 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb07987550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.437+0000 7f5b84e00640 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07987a90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402a920 tx=0x7f5b74031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa7fa5c09aed2f5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.438+0000 7f5b72000640 1 -- 172.21.15.40:0/3665482056 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74035030 con 0x55bb075b90a0 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.438+0000 7f5b72000640 1 -- 172.21.15.40:0/3665482056 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b740044c0 con 0x55bb075b90a0 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.438+0000 7f5b72000640 1 -- 172.21.15.40:0/3665482056 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003ae0 con 0x55bb075b90a0 2024-07-26T12:21:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.438+0000 7f5b7d600640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5b680b3c00 0x7f5b680b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.438+0000 7f5b7d600640 1 -- 172.21.15.40:0/3980747731 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5b6c0e3d80 con 0x7f5b8010b120 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.438+0000 7f5b85800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5b680b3c00 0x7f5b680b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3665482056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 msgr2=0x55bb07987a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07987a90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402a920 tx=0x7f5b74031dc0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3665482056 shutdown_connections 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07987fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07987a90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3665482056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb07987550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3665482056 >> 172.21.15.40:0/3665482056 conn(0x55bb075d6350 msgr2=0x55bb07985440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3665482056 shutdown_connections 2024-07-26T12:21:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3665482056 wait complete. 2024-07-26T12:21:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.439+0000 7f5b85800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5b680b3c00 0x7f5b680b6110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009fd0 tx=0x7f5b7800e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.440+0000 7f5b8e3f5740 1 -- start start 2024-07-26T12:21:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.440+0000 7f5b8e3f5740 1 Processor -- start 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07992d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07993300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb0799eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bb077505f0 con 0x55bb075b90a0 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bb07889520 con 0x55bb075c1280 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bb07995cd0 con 0x55bb075e1f60 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b8e3f5740 10 client.0 _ll_register_callbacks cb 0x55bb07898ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b84e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07992d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b84e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07992d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36632/0 (socket says 172.21.15.40:36632) 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b84e00640 1 -- 172.21.15.40:0/1839811447 learned_addr learned my addr 172.21.15.40:0/1839811447 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.441+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07993300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b85800640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb0799eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b84e00640 1 -- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 msgr2=0x55bb0799eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b84e00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb0799eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b84e00640 1 -- 172.21.15.40:0/1839811447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 msgr2=0x55bb07993300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b84e00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07993300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b84e00640 1 -- 172.21.15.40:0/1839811447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb0764d540 con 0x55bb075b90a0 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07993300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b85800640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb0799eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b84e00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07992d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b74005940 tx=0x7f5b74031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8517cecba7b63d63 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b66a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b66a00640 1 -- 172.21.15.40:0/1839811447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74035070 con 0x55bb075b90a0 2024-07-26T12:21:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b66a00640 1 -- 172.21.15.40:0/1839811447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5b740317a0 con 0x55bb075b90a0 2024-07-26T12:21:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.442+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb078ff8a0 con 0x55bb075b90a0 2024-07-26T12:21:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.443+0000 7f5b66a00640 1 -- 172.21.15.40:0/1839811447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b7403c650 con 0x55bb075b90a0 2024-07-26T12:21:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.443+0000 7f5b8e3f5740 10 client.15090 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.443+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb079a1b60 con 0x55bb075b90a0 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.443+0000 7f5b66a00640 1 -- 172.21.15.40:0/1839811447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bb078ff8a0 con 0x55bb075b90a0 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.443+0000 7f5b66a00640 1 -- 172.21.15.40:0/1839811447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b7404e8e0 con 0x55bb075b90a0 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.443+0000 7f5b8e3f5740 10 client.15090 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.444+0000 7f5b8e3f5740 10 client.15090 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.444+0000 7f5b8e3f5740 20 client.15090 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.444+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb075a08e0 0x55bb079a5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.444+0000 7f5b8e3f5740 4 client.15090 mds_command: new command op to 24592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.444+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 --> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb078fb340 con 0x55bb075a08e0 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.444+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb075a08e0 0x55bb079a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.445+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb075a08e0 0x55bb079a5210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2fcec0071e07cb5c server_cookie=9b32b83dd0f366a9 in_seq=0 out_seq=0 2024-07-26T12:21:17.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.445+0000 7f5b66a00640 10 client.15090 ms_handle_connect on v2:172.21.15.146:6836/3076436166 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.447+0000 7f5b66a00640 1 -- 172.21.15.40:0/1839811447 <== mds.4 v2:172.21.15.146:6836/3076436166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb078fb340 con 0x55bb075a08e0 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.447+0000 7f5b66a00640 10 client.15090 handle_command_reply: tid=0 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.447+0000 7f5b8e3f5740 1 client.15090 shutdown 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 msgr2=0x55bb07992d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07992d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b74005940 tx=0x7f5b74031630 comp rx=0 tx=0).stop 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 shutdown_connections 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb075a08e0 0x55bb079a5210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075e1f60 0x55bb0799eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075c1280 0x55bb07993300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/1839811447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075b90a0 0x55bb07992d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 >> 172.21.15.40:0/1839811447 conn(0x55bb075d6350 msgr2=0x55bb0798a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b66a00640 0 client.15090 ms_handle_reset on v2:172.21.15.146:6836/3076436166 2024-07-26T12:21:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 shutdown_connections 2024-07-26T12:21:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/1839811447 wait complete. 2024-07-26T12:21:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.448+0000 7f5b8e3f5740 20 client.15090 trim_cache size 0 max 16384 2024-07-26T12:21:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.468+0000 7f5b8e3f5740 1 Processor -- start 2024-07-26T12:21:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.468+0000 7f5b8e3f5740 1 -- start start 2024-07-26T12:21:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075b90a0 0x55bb079a5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075c1280 0x55bb079a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 0x55bb079852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bb079a3550 con 0x55bb075e1f60 2024-07-26T12:21:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bb079a3c20 con 0x55bb075b90a0 2024-07-26T12:21:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bb079a42f0 con 0x55bb075c1280 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b85800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 0x55bb079852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b85800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 0x55bb079852b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36634/0 (socket says 172.21.15.40:36634) 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.469+0000 7f5b85800640 1 -- 172.21.15.40:0/3982434271 learned_addr learned my addr 172.21.15.40:0/3982434271 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b84e00640 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075b90a0 0x55bb079a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075c1280 0x55bb079a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b85800640 1 -- 172.21.15.40:0/3982434271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075c1280 msgr2=0x55bb079a36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b85800640 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075c1280 0x55bb079a36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b85800640 1 -- 172.21.15.40:0/3982434271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075b90a0 msgr2=0x55bb079a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b85800640 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075b90a0 0x55bb079a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b85800640 1 -- 172.21.15.40:0/3982434271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb07989de0 con 0x55bb075e1f60 2024-07-26T12:21:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.470+0000 7f5b85800640 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 0x55bb079852b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b78017800 tx=0x7f5b7800c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bd7445434543c6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.471+0000 7f5b71600640 1 -- 172.21.15.40:0/3982434271 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78027070 con 0x55bb075e1f60 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.471+0000 7f5b71600640 1 -- 172.21.15.40:0/3982434271 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b78022440 con 0x55bb075e1f60 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.471+0000 7f5b71600640 1 -- 172.21.15.40:0/3982434271 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780075d0 con 0x55bb075e1f60 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3982434271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 msgr2=0x55bb079852b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 0x55bb079852b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b78017800 tx=0x7f5b7800c050 comp rx=0 tx=0).stop 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3982434271 shutdown_connections 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075e1f60 0x55bb079852b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075c1280 0x55bb079a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/3982434271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075b90a0 0x55bb079a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3982434271 >> 172.21.15.40:0/3982434271 conn(0x55bb075d6350 msgr2=0x55bb07988580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3982434271 shutdown_connections 2024-07-26T12:21:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/3982434271 wait complete. 2024-07-26T12:21:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.472+0000 7f5b8e3f5740 1 -- start start 2024-07-26T12:21:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 Processor -- start 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075b90a0 0x55bb079a6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 0x55bb079a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075e1f60 0x55bb079a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bb079a5090 con 0x55bb075c1280 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bb079a49c0 con 0x55bb075e1f60 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bb079a5760 con 0x55bb075b90a0 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.473+0000 7f5b8e3f5740 10 client.0 _ll_register_callbacks cb 0x7f5b74031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 0x55bb079a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 0x55bb079a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36646/0 (socket says 172.21.15.40:36646) 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 -- 172.21.15.40:0/317481259 learned_addr learned my addr 172.21.15.40:0/317481259 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b85800640 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075e1f60 0x55bb079a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 -- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075b90a0 msgr2=0x55bb079a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075b90a0 0x55bb079a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 -- 172.21.15.40:0/317481259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075e1f60 msgr2=0x55bb079a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075e1f60 0x55bb079a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 -- 172.21.15.40:0/317481259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb07a0c4a0 con 0x55bb075c1280 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b7fe00640 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 0x55bb079a6950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0aac60 tx=0x7f5b6c0aa8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b49fa71fe9f7bb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.474+0000 7f5b66a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b66a00640 1 -- 172.21.15.40:0/317481259 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0af2d0 con 0x55bb075c1280 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b66a00640 1 -- 172.21.15.40:0/317481259 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5b6c0a72c0 con 0x55bb075c1280 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b78022440 con 0x55bb075c1280 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b66a00640 1 -- 172.21.15.40:0/317481259 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b6c0b3d80 con 0x55bb075c1280 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b8e3f5740 10 client.15096 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb07a0d750 con 0x55bb075c1280 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.475+0000 7f5b66a00640 1 -- 172.21.15.40:0/317481259 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b78022440 con 0x55bb075c1280 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b66a00640 1 -- 172.21.15.40:0/317481259 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b6c0a6640 con 0x55bb075c1280 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b8e3f5740 10 client.15096 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b8e3f5740 10 client.15096 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b8e3f5740 20 client.15096 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb07575c90 0x55bb07a10fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b8e3f5740 4 client.15096 mds_command: new command op to 24592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:21:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.476+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 --> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] -- command(tid 0: {"prefix": "status"}) -- 0x55bb078f8a80 con 0x55bb07575c90 2024-07-26T12:21:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.477+0000 7f5b84e00640 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb07575c90 0x55bb07a10fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.478+0000 7f5b84e00640 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb07575c90 0x55bb07a10fe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6aab3852f35276a7 server_cookie=1de16fcd7f60da34 in_seq=0 out_seq=0 2024-07-26T12:21:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.478+0000 7f5b66a00640 10 client.15096 ms_handle_connect on v2:172.21.15.146:6836/3076436166 2024-07-26T12:21:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.478+0000 7f5b66a00640 1 -- 172.21.15.40:0/317481259 <== mds.4 v2:172.21.15.146:6836/3076436166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bb078f8a80 con 0x55bb07575c90 2024-07-26T12:21:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.478+0000 7f5b66a00640 10 client.15096 handle_command_reply: tid=0 2024-07-26T12:21:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.478+0000 7f5b8e3f5740 1 client.15096 shutdown 2024-07-26T12:21:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 msgr2=0x55bb079a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 0x55bb079a6950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0aac60 tx=0x7f5b6c0aa8a0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 shutdown_connections 2024-07-26T12:21:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55bb07575c90 0x55bb07a10fe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb075e1f60 0x55bb079a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bb075c1280 0x55bb079a6950 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 --2- 172.21.15.40:0/317481259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bb075b90a0 0x55bb079a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 >> 172.21.15.40:0/317481259 conn(0x55bb075d6350 msgr2=0x55bb0798a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b66a00640 0 client.15096 ms_handle_reset on v2:172.21.15.146:6836/3076436166 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 shutdown_connections 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 1 -- 172.21.15.40:0/317481259 wait complete. 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.479+0000 7f5b8e3f5740 20 client.15096 trim_cache size 0 max 16384 2024-07-26T12:21:17.481 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 4, 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24592, 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 146.44671114900001, 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 206.003843437 2024-07-26T12:21:17.482 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:21:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5b680b3c00 msgr2=0x7f5b680b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5b680b3c00 0x7f5b680b6110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009fd0 tx=0x7f5b7800e040 comp rx=0 tx=0).stop 2024-07-26T12:21:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 msgr2=0x7f5b8019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 0x7f5b8019c630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c8c0 tx=0x7f5b6c00cd80 comp rx=0 tx=0).stop 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 shutdown_connections 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b8010ba70 0x7f5b801a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b8010b120 0x7f5b8019c630 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5b680b3c00 0x7f5b680b6110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 --2- 172.21.15.40:0/3980747731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b801057e0 0x7f5b8019c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 >> 172.21.15.40:0/3980747731 conn(0x7f5b801011f0 msgr2=0x7f5b80103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.480+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 shutdown_connections 2024-07-26T12:21:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:17.481+0000 7f5b87800640 1 -- 172.21.15.40:0/3980747731 wait complete. 2024-07-26T12:21:18.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.i status 2024-07-26T12:21:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:19 smithi040 ceph-mon[32397]: pgmap v472: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:19 smithi146 ceph-mon[35807]: pgmap v472: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:19 smithi076 ceph-mon[35401]: pgmap v472: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.987+0000 7f42d4600640 1 -- 172.21.15.40:0/3183693408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 msgr2=0x7f42cc10b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.987+0000 7f42d4600640 1 --2- 172.21.15.40:0/3183693408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc10b530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009900 tx=0x7f42b802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 -- 172.21.15.40:0/3183693408 shutdown_connections 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 --2- 172.21.15.40:0/3183693408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42cc10ba70 0x7f42cc1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 --2- 172.21.15.40:0/3183693408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc10b530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 --2- 172.21.15.40:0/3183693408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc1057e0 0x7f42cc105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 -- 172.21.15.40:0/3183693408 >> 172.21.15.40:0/3183693408 conn(0x7f42cc1011f0 msgr2=0x7f42cc103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 -- 172.21.15.40:0/3183693408 shutdown_connections 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.988+0000 7f42d4600640 1 -- 172.21.15.40:0/3183693408 wait complete. 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.989+0000 7f42d4600640 1 Processor -- start 2024-07-26T12:21:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.989+0000 7f42d4600640 1 -- start start 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d4600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc1057e0 0x7f42cc19c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d4600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d4600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42cc10ba70 0x7f42cc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d4600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1155b0 con 0x7f42cc10b120 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d4600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc115430 con 0x7f42cc1057e0 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d4600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc115730 con 0x7f42cc10ba70 2024-07-26T12:21:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36660/0 (socket says 172.21.15.40:36660) 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.990+0000 7f42d1200640 1 -- 172.21.15.40:0/643433537 learned_addr learned my addr 172.21.15.40:0/643433537 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1c00640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc1057e0 0x7f42cc19c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d2600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42cc10ba70 0x7f42cc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1200640 1 -- 172.21.15.40:0/643433537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42cc10ba70 msgr2=0x7f42cc1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1200640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42cc10ba70 0x7f42cc1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1200640 1 -- 172.21.15.40:0/643433537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc1057e0 msgr2=0x7f42cc19c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1200640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc1057e0 0x7f42cc19c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1200640 1 -- 172.21.15.40:0/643433537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc1a1ed0 con 0x7f42cc10b120 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.991+0000 7f42d1200640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc19c5c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005940 tx=0x7f42b80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.992+0000 7f42ca000640 1 -- 172.21.15.40:0/643433537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b803f030 con 0x7f42cc10b120 2024-07-26T12:21:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.992+0000 7f42ca000640 1 -- 172.21.15.40:0/643433537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b8003a80 con 0x7f42cc10b120 2024-07-26T12:21:20.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.992+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc1a2160 con 0x7f42cc10b120 2024-07-26T12:21:20.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.992+0000 7f42ca000640 1 -- 172.21.15.40:0/643433537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8035070 con 0x7f42cc10b120 2024-07-26T12:21:20.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.992+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc1a2690 con 0x7f42cc10b120 2024-07-26T12:21:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 Processor -- start 2024-07-26T12:21:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 -- start start 2024-07-26T12:21:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa4956570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4956ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4956ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55eaa48cc970 con 0x55eaa4590280 2024-07-26T12:21:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55eaa48bbe70 con 0x55eaa45b0f60 2024-07-26T12:21:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.995+0000 7f42db206740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eaa48bfeb0 con 0x55eaa45880a0 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.996+0000 7f42d2600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa4956570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.996+0000 7f42d2600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa4956570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:56442/0 (socket says 172.21.15.40:56442) 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.996+0000 7f42d2600640 1 -- 172.21.15.40:0/444634626 learned_addr learned my addr 172.21.15.40:0/444634626 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.996+0000 7f42d1c00640 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4956ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42ca000640 1 -- 172.21.15.40:0/643433537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f42b8042030 con 0x7f42cc10b120 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d2600640 1 -- 172.21.15.40:0/444634626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 msgr2=0x55eaa4956ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d2600640 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4956ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d2600640 1 -- 172.21.15.40:0/444634626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 msgr2=0x55eaa4956ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d1200640 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4956ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:20.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d2600640 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4956ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:20.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d2600640 1 -- 172.21.15.40:0/444634626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaa4863110 con 0x55eaa45b0f60 2024-07-26T12:21:20.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.997+0000 7f42d1200640 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4956ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:20.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.998+0000 7f42d2600640 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa4956570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42c400bc70 tx=0x7f42c400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8681599d15419d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:21.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.998+0000 7f42bea00640 1 -- 172.21.15.40:0/444634626 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4015070 con 0x55eaa45b0f60 2024-07-26T12:21:21.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.998+0000 7f42bea00640 1 -- 172.21.15.40:0/444634626 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c40118d0 con 0x55eaa45b0f60 2024-07-26T12:21:21.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.998+0000 7f42bea00640 1 -- 172.21.15.40:0/444634626 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4010750 con 0x55eaa45b0f60 2024-07-26T12:21:21.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.999+0000 7f42ca000640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42b40b3c80 0x7f42b40b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.999+0000 7f42db206740 1 -- 172.21.15.40:0/444634626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 msgr2=0x55eaa4956570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.999+0000 7f42db206740 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa4956570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42c400bc70 tx=0x7f42c400f730 comp rx=0 tx=0).stop 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.999+0000 7f42d1c00640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42b40b3c80 0x7f42b40b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:20.999+0000 7f42ca000640 1 -- 172.21.15.40:0/643433537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42b8104160 con 0x7f42cc10b120 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 -- 172.21.15.40:0/444634626 shutdown_connections 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4956ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4956ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 --2- 172.21.15.40:0/444634626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa4956570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 -- 172.21.15.40:0/444634626 >> 172.21.15.40:0/444634626 conn(0x55eaa45a5350 msgr2=0x55eaa4954460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:21.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 -- 172.21.15.40:0/444634626 shutdown_connections 2024-07-26T12:21:21.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42db206740 1 -- 172.21.15.40:0/444634626 wait complete. 2024-07-26T12:21:21.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.000+0000 7f42d1c00640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42b40b3c80 0x7f42b40b6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55eaa49551f0 tx=0x7f42c0007700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:21.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 -- start start 2024-07-26T12:21:21.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 Processor -- start 2024-07-26T12:21:21.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4961e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4962420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa496e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55eaa471f5f0 con 0x55eaa4590280 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4858540 con 0x55eaa45b0f60 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4964d50 con 0x55eaa45880a0 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.001+0000 7f42db206740 10 client.0 _ll_register_callbacks cb 0x55eaa4867f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4962420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4962420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36682/0 (socket says 172.21.15.40:36682) 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 -- 172.21.15.40:0/176507648 learned_addr learned my addr 172.21.15.40:0/176507648 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1c00640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4961e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d2600640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa496e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 -- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 msgr2=0x55eaa4961e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4961e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 -- 172.21.15.40:0/176507648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 msgr2=0x55eaa496e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa496e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.002+0000 7f42d1200640 1 -- 172.21.15.40:0/176507648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaa461c540 con 0x55eaa4590280 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42d1200640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4962420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b80caf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a6b00de4498913 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42b3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42b3400640 1 -- 172.21.15.40:0/176507648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8049040 con 0x55eaa4590280 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42b3400640 1 -- 172.21.15.40:0/176507648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42b80d3c90 con 0x55eaa4590280 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c40118d0 con 0x55eaa4590280 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42b3400640 1 -- 172.21.15.40:0/176507648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42b80cb770 con 0x55eaa4590280 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42db206740 10 client.15105 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:21.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eaa4970c10 con 0x55eaa4590280 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.003+0000 7f42b3400640 1 -- 172.21.15.40:0/176507648 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c40118d0 con 0x55eaa4590280 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42b3400640 1 -- 172.21.15.40:0/176507648 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42b80e5bb0 con 0x55eaa4590280 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42db206740 10 client.15105 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42db206740 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42db206740 20 client.15105 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42db206740 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa456f8e0 0x55eaa4974710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42db206740 4 client.15105 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:21:21.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 --> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaa48ce8c0 con 0x55eaa456f8e0 2024-07-26T12:21:21.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.004+0000 7f42d1c00640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa456f8e0 0x55eaa4974710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.005+0000 7f42d1c00640 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa456f8e0 0x55eaa4974710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=596914811ddf943f server_cookie=4f5be4faf6bf838 in_seq=0 out_seq=0 2024-07-26T12:21:21.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.006+0000 7f42b3400640 10 client.15105 ms_handle_connect on v2:172.21.15.146:6838/4061759756 2024-07-26T12:21:21.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42b3400640 1 -- 172.21.15.40:0/176507648 <== mds.3 v2:172.21.15.146:6838/4061759756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eaa48ce8c0 con 0x55eaa456f8e0 2024-07-26T12:21:21.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42b3400640 10 client.15105 handle_command_reply: tid=0 2024-07-26T12:21:21.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 client.15105 shutdown 2024-07-26T12:21:21.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 msgr2=0x55eaa4962420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:21.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4962420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b80caf00 comp rx=0 tx=0).stop 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 shutdown_connections 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa456f8e0 0x55eaa4974710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa496e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa4590280 0x55eaa4962420 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 --2- 172.21.15.40:0/176507648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa4961e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 >> 172.21.15.40:0/176507648 conn(0x55eaa45a5350 msgr2=0x55eaa4959700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.008+0000 7f42b3400640 0 client.15105 ms_handle_reset on v2:172.21.15.146:6838/4061759756 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.009+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 shutdown_connections 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.009+0000 7f42db206740 1 -- 172.21.15.40:0/176507648 wait complete. 2024-07-26T12:21:21.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.009+0000 7f42db206740 20 client.15105 trim_cache size 0 max 16384 2024-07-26T12:21:21.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.028+0000 7f42db206740 1 Processor -- start 2024-07-26T12:21:21.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.028+0000 7f42db206740 1 -- start start 2024-07-26T12:21:21.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42db206740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa495c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42db206740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa4590280 0x55eaa4961330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42db206740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 0x55eaa496e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42db206740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4972a50 con 0x55eaa45b0f60 2024-07-26T12:21:21.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42db206740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4973120 con 0x55eaa4590280 2024-07-26T12:21:21.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42db206740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eaa49737f0 con 0x55eaa45880a0 2024-07-26T12:21:21.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42d2600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 0x55eaa496e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42d2600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 0x55eaa496e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36688/0 (socket says 172.21.15.40:36688) 2024-07-26T12:21:21.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42d2600640 1 -- 172.21.15.40:0/3657799409 learned_addr learned my addr 172.21.15.40:0/3657799409 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:21.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.029+0000 7f42d1200640 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa4590280 0x55eaa4961330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d1c00640 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa495c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d2600640 1 -- 172.21.15.40:0/3657799409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 msgr2=0x55eaa495c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d2600640 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa495c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d2600640 1 -- 172.21.15.40:0/3657799409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa4590280 msgr2=0x55eaa4961330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d2600640 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa4590280 0x55eaa4961330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d2600640 1 -- 172.21.15.40:0/3657799409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaa495d6d0 con 0x55eaa45b0f60 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.030+0000 7f42d2600640 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 0x55eaa496e040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f42c400bef0 tx=0x7f42c400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f2affb3e34e857 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.031+0000 7f42be000640 1 -- 172.21.15.40:0/3657799409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4029070 con 0x55eaa45b0f60 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.031+0000 7f42be000640 1 -- 172.21.15.40:0/3657799409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c4004640 con 0x55eaa45b0f60 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.031+0000 7f42be000640 1 -- 172.21.15.40:0/3657799409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4015050 con 0x55eaa45b0f60 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.031+0000 7f42db206740 1 -- 172.21.15.40:0/3657799409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 msgr2=0x55eaa496e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.031+0000 7f42db206740 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 0x55eaa496e040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f42c400bef0 tx=0x7f42c400bf20 comp rx=0 tx=0).stop 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 -- 172.21.15.40:0/3657799409 shutdown_connections 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45b0f60 0x55eaa496e040 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa4590280 0x55eaa4961330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 --2- 172.21.15.40:0/3657799409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa45880a0 0x55eaa495c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 -- 172.21.15.40:0/3657799409 >> 172.21.15.40:0/3657799409 conn(0x55eaa45a5350 msgr2=0x55eaa49606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 -- 172.21.15.40:0/3657799409 shutdown_connections 2024-07-26T12:21:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 -- 172.21.15.40:0/3657799409 wait complete. 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.032+0000 7f42db206740 1 -- start start 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 Processor -- start 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 0x55eaa4975c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa4590280 0x55eaa4976250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa497b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4974590 con 0x55eaa45880a0 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4973ec0 con 0x55eaa45b0f60 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eaa4974c60 con 0x55eaa4590280 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.033+0000 7f42db206740 10 client.0 _ll_register_callbacks cb 0x7f42b8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 0x55eaa4975c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 0x55eaa4975c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36690/0 (socket says 172.21.15.40:36690) 2024-07-26T12:21:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 -- 172.21.15.40:0/3592761335 learned_addr learned my addr 172.21.15.40:0/3592761335 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d2600640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa497b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1200640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa4590280 0x55eaa4976250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 -- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa4590280 msgr2=0x55eaa4976250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa4590280 0x55eaa4976250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 -- 172.21.15.40:0/3592761335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 msgr2=0x55eaa497b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa497b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 -- 172.21.15.40:0/3592761335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaa497b900 con 0x55eaa45880a0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42d1c00640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 0x55eaa4975c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f42c0000f80 tx=0x7f42c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4638c7f65abdfdbc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.034+0000 7f42b3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42b3400640 1 -- 172.21.15.40:0/3592761335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00278f0 con 0x55eaa45880a0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c4004640 con 0x55eaa45880a0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42b3400640 1 -- 172.21.15.40:0/3592761335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42c0027a90 con 0x55eaa45880a0 2024-07-26T12:21:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42b3400640 1 -- 172.21.15.40:0/3592761335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42c0027c90 con 0x55eaa45880a0 2024-07-26T12:21:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42db206740 10 client.15111 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eaa497cd50 con 0x55eaa45880a0 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.035+0000 7f42b3400640 1 -- 172.21.15.40:0/3592761335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c4004640 con 0x55eaa45880a0 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42b3400640 1 -- 172.21.15.40:0/3592761335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42c0018040 con 0x55eaa45880a0 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42db206740 10 client.15111 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42db206740 10 client.15111 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42db206740 20 client.15111 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42db206740 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa4544c90 0x55eaa49e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42db206740 4 client.15111 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.036+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 --> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] -- command(tid 0: {"prefix": "status"}) -- 0x55eaa48ca360 con 0x55eaa4544c90 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.037+0000 7f42d1200640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa4544c90 0x55eaa49e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.037+0000 7f42d1200640 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa4544c90 0x55eaa49e9010 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77cb8034c36ff172 server_cookie=df1b7e8d8fb8b464 in_seq=0 out_seq=0 2024-07-26T12:21:21.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.037+0000 7f42b3400640 10 client.15111 ms_handle_connect on v2:172.21.15.146:6838/4061759756 2024-07-26T12:21:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.038+0000 7f42b3400640 1 -- 172.21.15.40:0/3592761335 <== mds.3 v2:172.21.15.146:6838/4061759756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55eaa48ca360 con 0x55eaa4544c90 2024-07-26T12:21:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.038+0000 7f42b3400640 10 client.15111 handle_command_reply: tid=0 2024-07-26T12:21:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.038+0000 7f42db206740 1 client.15111 shutdown 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.038+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 msgr2=0x55eaa4975c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.038+0000 7f42db206740 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 0x55eaa4975c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f42c0000f80 tx=0x7f42c0004a40 comp rx=0 tx=0).stop 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 shutdown_connections 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55eaa4544c90 0x55eaa49e9010 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55eaa45b0f60 0x55eaa497b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eaa4590280 0x55eaa4976250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 --2- 172.21.15.40:0/3592761335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eaa45880a0 0x55eaa4975c90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 >> 172.21.15.40:0/3592761335 conn(0x55eaa45a5350 msgr2=0x55eaa4960290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42b3400640 0 client.15111 ms_handle_reset on v2:172.21.15.146:6838/4061759756 2024-07-26T12:21:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 shutdown_connections 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 1 -- 172.21.15.40:0/3592761335 wait complete. 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.039+0000 7f42db206740 20 client.15111 trim_cache size 0 max 16384 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 3, 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24610, 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:21:21.042 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 151.022050213, 2024-07-26T12:21:21.043 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:21:21.043 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:21:21.043 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:21:21.043 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 202.036817859 2024-07-26T12:21:21.043 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:21:21.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42b40b3c80 msgr2=0x7f42b40b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42b40b3c80 0x7f42b40b6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55eaa49551f0 tx=0x7f42c0007700 comp rx=0 tx=0).stop 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 msgr2=0x7f42cc19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc19c5c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005940 tx=0x7f42b80040e0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 shutdown_connections 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42b40b3c80 0x7f42b40b6190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42cc10ba70 0x7f42cc1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42cc10b120 0x7f42cc19c5c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 --2- 172.21.15.40:0/643433537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc1057e0 0x7f42cc19c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 >> 172.21.15.40:0/643433537 conn(0x7f42cc1011f0 msgr2=0x7f42cc1098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 shutdown_connections 2024-07-26T12:21:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:21.040+0000 7f42d4600640 1 -- 172.21.15.40:0/643433537 wait complete. 2024-07-26T12:21:21.064 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:21 smithi040 ceph-mon[32397]: pgmap v473: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:21 smithi146 ceph-mon[35807]: pgmap v473: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:21 smithi076 ceph-mon[35401]: pgmap v473: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:21.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.k status 2024-07-26T12:21:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:23 smithi146 ceph-mon[35807]: pgmap v474: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:23 smithi076 ceph-mon[35401]: pgmap v474: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:23.467 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:23 smithi040 ceph-mon[32397]: pgmap v474: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 -- 172.21.15.40:0/3164088489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c1033c0 msgr2=0x7ff26c1037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 --2- 172.21.15.40:0/3164088489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c1033c0 0x7ff26c1037d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff260009900 tx=0x7ff26002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 -- 172.21.15.40:0/3164088489 shutdown_connections 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 --2- 172.21.15.40:0/3164088489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff26c109650 0x7ff26c10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 --2- 172.21.15.40:0/3164088489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff26c108d00 0x7ff26c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 --2- 172.21.15.40:0/3164088489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c1033c0 0x7ff26c1037d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 -- 172.21.15.40:0/3164088489 >> 172.21.15.40:0/3164088489 conn(0x7ff26c0fee10 msgr2=0x7ff26c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 -- 172.21.15.40:0/3164088489 shutdown_connections 2024-07-26T12:21:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.370+0000 7ff272600640 1 -- 172.21.15.40:0/3164088489 wait complete. 2024-07-26T12:21:24.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.371+0000 7ff272600640 1 Processor -- start 2024-07-26T12:21:24.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 -- start start 2024-07-26T12:21:24.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff26c1033c0 0x7ff26c199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 0x7ff26c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff26c109650 0x7ff26c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c113220 con 0x7ff26c108d00 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c1130a0 con 0x7ff26c1033c0 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff272600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c1133a0 con 0x7ff26c109650 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff26be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 0x7ff26c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff26be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 0x7ff26c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55372/0 (socket says 172.21.15.40:55372) 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.372+0000 7ff26be00640 1 -- 172.21.15.40:0/1445750857 learned_addr learned my addr 172.21.15.40:0/1445750857 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff271200640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff26c1033c0 0x7ff26c199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff271c00640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff26c109650 0x7ff26c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff26be00640 1 -- 172.21.15.40:0/1445750857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff26c109650 msgr2=0x7ff26c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff26be00640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff26c109650 0x7ff26c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff26be00640 1 -- 172.21.15.40:0/1445750857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff26c1033c0 msgr2=0x7ff26c199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff26be00640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff26c1033c0 0x7ff26c199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff26be00640 1 -- 172.21.15.40:0/1445750857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c19fc00 con 0x7ff26c108d00 2024-07-26T12:21:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.373+0000 7ff26be00640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 0x7ff26c19a230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00d750 tx=0x7ff25c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.374+0000 7ff269600640 1 -- 172.21.15.40:0/1445750857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c017070 con 0x7ff26c108d00 2024-07-26T12:21:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.374+0000 7ff269600640 1 -- 172.21.15.40:0/1445750857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff25c0054b0 con 0x7ff26c108d00 2024-07-26T12:21:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.374+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c19fef0 con 0x7ff26c108d00 2024-07-26T12:21:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.374+0000 7ff269600640 1 -- 172.21.15.40:0/1445750857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c004bc0 con 0x7ff26c108d00 2024-07-26T12:21:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.374+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c1a6650 con 0x7ff26c108d00 2024-07-26T12:21:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 Processor -- start 2024-07-26T12:21:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 -- start start 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff269600640 1 -- 172.21.15.40:0/1445750857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff25c009c30 con 0x7ff26c108d00 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbdef60 0x55802df84760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 0x55802df84ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55802defa950 con 0x55802dbb60a0 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55802dee9e50 con 0x55802dbdef60 2024-07-26T12:21:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.378+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55802deede90 con 0x55802dbbe280 2024-07-26T12:21:24.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 0x55802df84ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 0x55802df84ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55386/0 (socket says 172.21.15.40:55386) 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 -- 172.21.15.40:0/315719487 learned_addr learned my addr 172.21.15.40:0/315719487 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271c00640 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbdef60 0x55802df84760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff26be00640 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 -- 172.21.15.40:0/315719487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 msgr2=0x55802df851e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df851e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 -- 172.21.15.40:0/315719487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbdef60 msgr2=0x55802df84760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbdef60 0x55802df84760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.379+0000 7ff271200640 1 -- 172.21.15.40:0/315719487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802de910f0 con 0x55802dbb60a0 2024-07-26T12:21:24.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.380+0000 7ff271200640 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 0x55802df84ca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff26002a9e0 tx=0x7ff260004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f371fb17b62fec server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:24.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.380+0000 7ff25a000640 1 -- 172.21.15.40:0/315719487 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260035030 con 0x55802dbb60a0 2024-07-26T12:21:24.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.380+0000 7ff25a000640 1 -- 172.21.15.40:0/315719487 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2600054d0 con 0x55802dbb60a0 2024-07-26T12:21:24.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.380+0000 7ff269600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff2540b3bd0 0x7ff2540b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.380+0000 7ff25a000640 1 -- 172.21.15.40:0/315719487 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600035f0 con 0x55802dbb60a0 2024-07-26T12:21:24.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.381+0000 7ff269600640 1 -- 172.21.15.40:0/1445750857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff25c0e36c0 con 0x7ff26c108d00 2024-07-26T12:21:24.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.381+0000 7ff271c00640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff2540b3bd0 0x7ff2540b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.381+0000 7ff27a7dd740 1 -- 172.21.15.40:0/315719487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 msgr2=0x55802df84ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.381+0000 7ff271c00640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff2540b3bd0 0x7ff2540b60e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff264005fd0 tx=0x7ff264009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.381+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 0x55802df84ca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff26002a9e0 tx=0x7ff260004200 comp rx=0 tx=0).stop 2024-07-26T12:21:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.382+0000 7ff27a7dd740 1 -- 172.21.15.40:0/315719487 shutdown_connections 2024-07-26T12:21:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.382+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df851e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.382+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbb60a0 0x55802df84ca0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.382+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/315719487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbdef60 0x55802df84760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.382+0000 7ff27a7dd740 1 -- 172.21.15.40:0/315719487 >> 172.21.15.40:0/315719487 conn(0x55802dbd3350 msgr2=0x55802df82650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:24.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.382+0000 7ff27a7dd740 1 -- 172.21.15.40:0/315719487 shutdown_connections 2024-07-26T12:21:24.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.383+0000 7ff27a7dd740 1 -- 172.21.15.40:0/315719487 wait complete. 2024-07-26T12:21:24.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.383+0000 7ff27a7dd740 1 -- start start 2024-07-26T12:21:24.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.383+0000 7ff27a7dd740 1 Processor -- start 2024-07-26T12:21:24.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802df943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df94960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 0x55802dfa0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55802dd4d5f0 con 0x55802dbdef60 2024-07-26T12:21:24.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55802de86520 con 0x55802dbb60a0 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55802df97240 con 0x55802dbbe280 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff27a7dd740 10 client.0 _ll_register_callbacks cb 0x55802de95ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.384+0000 7ff271c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 0x55802dfa0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 0x55802dfa0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55402/0 (socket says 172.21.15.40:55402) 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 -- 172.21.15.40:0/2023531511 learned_addr learned my addr 172.21.15.40:0/2023531511 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271200640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802df943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff26be00640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df94960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 -- 172.21.15.40:0/2023531511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 msgr2=0x55802df94960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df94960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 -- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 msgr2=0x55802df943c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802df943c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff271c00640 1 -- 172.21.15.40:0/2023531511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802dc4a540 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.385+0000 7ff26be00640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df94960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff271c00640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 0x55802dfa0600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff264012900 tx=0x7ff264004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743f583a84772fe5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff24ea00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff24ea00640 1 -- 172.21.15.40:0/2023531511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26400ece0 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff24ea00640 1 -- 172.21.15.40:0/2023531511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff26401f420 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2600054d0 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff24ea00640 1 -- 172.21.15.40:0/2023531511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff264009670 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff27a7dd740 10 client.15123 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.386+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55802dfa3200 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff24ea00640 1 -- 172.21.15.40:0/2023531511 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2600054d0 con 0x55802dbdef60 2024-07-26T12:21:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff24ea00640 1 -- 172.21.15.40:0/2023531511 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff26400f040 con 0x55802dbdef60 2024-07-26T12:21:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff27a7dd740 10 client.15123 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff27a7dd740 10 client.15123 resolve_mds: resolved name 'k' to daemon mds.k 2024-07-26T12:21:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff27a7dd740 20 client.15123 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db9d8e0 0x55802dfa6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff27a7dd740 4 client.15123 mds_command: new command op to 34547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:21:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.387+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 --> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55802defc8a0 con 0x55802db9d8e0 2024-07-26T12:21:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.388+0000 7ff271200640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db9d8e0 0x55802dfa6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.389+0000 7ff271200640 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db9d8e0 0x55802dfa6cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94b2ceb0fb76b63c server_cookie=f8ca1c93d70fd01d in_seq=0 out_seq=0 2024-07-26T12:21:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.389+0000 7ff24ea00640 10 client.15123 ms_handle_connect on v2:172.21.15.76:6832/2744171288 2024-07-26T12:21:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff24ea00640 1 -- 172.21.15.40:0/2023531511 <== mds.2 v2:172.21.15.76:6832/2744171288 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55802defc8a0 con 0x55802db9d8e0 2024-07-26T12:21:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff24ea00640 10 client.15123 handle_command_reply: tid=0 2024-07-26T12:21:24.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 client.15123 shutdown 2024-07-26T12:21:24.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 msgr2=0x55802dfa0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 0x55802dfa0600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff264012900 tx=0x7ff264004a40 comp rx=0 tx=0).stop 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 shutdown_connections 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db9d8e0 0x55802dfa6cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbdef60 0x55802dfa0600 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbbe280 0x55802df94960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/2023531511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802df943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 >> 172.21.15.40:0/2023531511 conn(0x55802dbd3350 msgr2=0x55802df86150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff24ea00640 0 client.15123 ms_handle_reset on v2:172.21.15.76:6832/2744171288 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 shutdown_connections 2024-07-26T12:21:24.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.392+0000 7ff27a7dd740 1 -- 172.21.15.40:0/2023531511 wait complete. 2024-07-26T12:21:24.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.393+0000 7ff27a7dd740 20 client.15123 trim_cache size 0 max 16384 2024-07-26T12:21:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.412+0000 7ff27a7dd740 1 Processor -- start 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 -- start start 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfa6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802df8a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfa0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55802dfa5030 con 0x55802dbbe280 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55802dfa5700 con 0x55802dbb60a0 2024-07-26T12:21:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.413+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55802dfa5dd0 con 0x55802dbdef60 2024-07-26T12:21:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802df8a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802df8a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55416/0 (socket says 172.21.15.40:55416) 2024-07-26T12:21:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 -- 172.21.15.40:0/3163675464 learned_addr learned my addr 172.21.15.40:0/3163675464 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff271200640 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfa6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff271c00640 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfa0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 -- 172.21.15.40:0/3163675464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 msgr2=0x55802dfa0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfa0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 -- 172.21.15.40:0/3163675464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 msgr2=0x55802dfa6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfa6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.414+0000 7ff26be00640 1 -- 172.21.15.40:0/3163675464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802df7d7d0 con 0x55802dbbe280 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.415+0000 7ff26be00640 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802df8a210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0e1130 tx=0x7ff25c0b3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd001fa6523ebc66 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.415+0000 7ff259600640 1 -- 172.21.15.40:0/3163675464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c020070 con 0x55802dbbe280 2024-07-26T12:21:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.415+0000 7ff259600640 1 -- 172.21.15.40:0/3163675464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff25c0aa120 con 0x55802dbbe280 2024-07-26T12:21:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.415+0000 7ff259600640 1 -- 172.21.15.40:0/3163675464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b36c0 con 0x55802dbbe280 2024-07-26T12:21:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.416+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3163675464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 msgr2=0x55802df8a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802df8a210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0e1130 tx=0x7ff25c0b3040 comp rx=0 tx=0).stop 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3163675464 shutdown_connections 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfa0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802df8a210 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3163675464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfa6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3163675464 >> 172.21.15.40:0/3163675464 conn(0x55802dbd3350 msgr2=0x55802df89830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3163675464 shutdown_connections 2024-07-26T12:21:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.417+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3163675464 wait complete. 2024-07-26T12:21:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.418+0000 7ff27a7dd740 1 -- start start 2024-07-26T12:21:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.418+0000 7ff27a7dd740 1 Processor -- start 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfaf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802dfaf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55802dfa6b70 con 0x55802dbbe280 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55802dfa64a0 con 0x55802dbb60a0 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55802dfa7240 con 0x55802dbdef60 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff27a7dd740 10 client.0 _ll_register_callbacks cb 0x7ff2640125b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff26be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802dfaf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff26be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802dfaf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55432/0 (socket says 172.21.15.40:55432) 2024-07-26T12:21:24.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff26be00640 1 -- 172.21.15.40:0/3833324032 learned_addr learned my addr 172.21.15.40:0/3833324032 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:24.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.419+0000 7ff271200640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfaf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff271c00640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff26be00640 1 -- 172.21.15.40:0/3833324032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 msgr2=0x55802dfae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff26be00640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff26be00640 1 -- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 msgr2=0x55802dfaf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff26be00640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfaf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff26be00640 1 -- 172.21.15.40:0/3833324032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802dfae860 con 0x55802dbbe280 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff271200640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfaf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:24.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff26be00640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802dfaf820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0e3040 tx=0x7ff25c0cd2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab83010f1d6bb874 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.420+0000 7ff24ea00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff24ea00640 1 -- 172.21.15.40:0/3833324032 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0c4060 con 0x55802dbbe280 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff24ea00640 1 -- 172.21.15.40:0/3833324032 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff25c0e5b50 con 0x55802dbbe280 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff25c0aa120 con 0x55802dbbe280 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff24ea00640 1 -- 172.21.15.40:0/3833324032 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff25c020040 con 0x55802dbbe280 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff27a7dd740 10 client.15129 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55802e00eaa0 con 0x55802dbbe280 2024-07-26T12:21:24.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.421+0000 7ff24ea00640 1 -- 172.21.15.40:0/3833324032 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff25c0aa120 con 0x55802dbbe280 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff24ea00640 1 -- 172.21.15.40:0/3833324032 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff25c0cbc30 con 0x55802dbbe280 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff27a7dd740 10 client.15129 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff27a7dd740 10 client.15129 resolve_mds: resolved name 'k' to daemon mds.k 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff27a7dd740 20 client.15129 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db72c90 0x55802e011d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff27a7dd740 4 client.15129 mds_command: new command op to 34547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.422+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 --> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] -- command(tid 0: {"prefix": "status"}) -- 0x55802def8340 con 0x55802db72c90 2024-07-26T12:21:24.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.423+0000 7ff271200640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db72c90 0x55802e011d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:24.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.424+0000 7ff271200640 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db72c90 0x55802e011d60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a68145c14812a4c5 server_cookie=ac4076774743e146 in_seq=0 out_seq=0 2024-07-26T12:21:24.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.424+0000 7ff24ea00640 10 client.15129 ms_handle_connect on v2:172.21.15.76:6832/2744171288 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.424+0000 7ff24ea00640 1 -- 172.21.15.40:0/3833324032 <== mds.2 v2:172.21.15.76:6832/2744171288 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55802def8340 con 0x55802db72c90 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.424+0000 7ff24ea00640 10 client.15129 handle_command_reply: tid=0 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.424+0000 7ff27a7dd740 1 client.15129 shutdown 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 msgr2=0x55802dfaf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802dfaf820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0e3040 tx=0x7ff25c0cd2e0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 shutdown_connections 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55802db72c90 0x55802e011d60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55802dbdef60 0x55802dfae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55802dbbe280 0x55802dfaf820 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 --2- 172.21.15.40:0/3833324032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55802dbb60a0 0x55802dfaf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 >> 172.21.15.40:0/3833324032 conn(0x55802dbd3350 msgr2=0x55802df81fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:24.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff24ea00640 0 client.15129 ms_handle_reset on v2:172.21.15.76:6832/2744171288 2024-07-26T12:21:24.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 shutdown_connections 2024-07-26T12:21:24.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.425+0000 7ff27a7dd740 1 -- 172.21.15.40:0/3833324032 wait complete. 2024-07-26T12:21:24.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.426+0000 7ff27a7dd740 20 client.15129 trim_cache size 0 max 16384 2024-07-26T12:21:24.427 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 2, 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34547, 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 155.42304237600001, 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 232.70562698699999 2024-07-26T12:21:24.428 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.426+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff2540b3bd0 msgr2=0x7ff2540b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.426+0000 7ff272600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff2540b3bd0 0x7ff2540b60e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff264005fd0 tx=0x7ff264009580 comp rx=0 tx=0).stop 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.426+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 msgr2=0x7ff26c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.426+0000 7ff272600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 0x7ff26c19a230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00d750 tx=0x7ff25c00dc10 comp rx=0 tx=0).stop 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 shutdown_connections 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff2540b3bd0 0x7ff2540b60e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff26c109650 0x7ff26c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26c108d00 0x7ff26c19a230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 --2- 172.21.15.40:0/1445750857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff26c1033c0 0x7ff26c199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:24.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 >> 172.21.15.40:0/1445750857 conn(0x7ff26c0fee10 msgr2=0x7ff26c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:24.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 shutdown_connections 2024-07-26T12:21:24.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:24.427+0000 7ff272600640 1 -- 172.21.15.40:0/1445750857 wait complete. 2024-07-26T12:21:25.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.h status 2024-07-26T12:21:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:25 smithi146 ceph-mon[35807]: pgmap v475: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:21:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:25 smithi076 ceph-mon[35401]: pgmap v475: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:21:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:25 smithi040 ceph-mon[32397]: pgmap v475: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:21:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:27.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:27 smithi146 ceph-mon[35807]: pgmap v476: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:21:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:27 smithi076 ceph-mon[35401]: pgmap v476: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:21:27.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:27 smithi040 ceph-mon[32397]: pgmap v476: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:21:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 -- 172.21.15.40:0/2582267266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410b860 msgr2=0x7fdfc4112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 --2- 172.21.15.40:0/2582267266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410b860 0x7fdfc4112090 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009ca0 tx=0x7fdfbc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 -- 172.21.15.40:0/2582267266 shutdown_connections 2024-07-26T12:21:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 --2- 172.21.15.40:0/2582267266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410b860 0x7fdfc4112090 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 --2- 172.21.15.40:0/2582267266 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc410af10 0x7fdfc410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 --2- 172.21.15.40:0/2582267266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc41055d0 0x7fdfc41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 -- 172.21.15.40:0/2582267266 >> 172.21.15.40:0/2582267266 conn(0x7fdfc4101040 msgr2=0x7fdfc4103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 -- 172.21.15.40:0/2582267266 shutdown_connections 2024-07-26T12:21:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.737+0000 7fdfca000640 1 -- 172.21.15.40:0/2582267266 wait complete. 2024-07-26T12:21:27.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.738+0000 7fdfca000640 1 Processor -- start 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.738+0000 7fdfca000640 1 -- start start 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfca000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc41055d0 0x7fdfc419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfca000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 0x7fdfc419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfca000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc410b860 0x7fdfc41a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfca000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4115430 con 0x7fdfc410af10 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfca000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc41152b0 con 0x7fdfc41055d0 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfca000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc41155b0 con 0x7fdfc410b860 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 0x7fdfc419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 0x7fdfc419c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55452/0 (socket says 172.21.15.40:55452) 2024-07-26T12:21:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfc3e00640 1 -- 172.21.15.40:0/2690370967 learned_addr learned my addr 172.21.15.40:0/2690370967 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc41055d0 0x7fdfc419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.739+0000 7fdfc9600640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc410b860 0x7fdfc41a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc3e00640 1 -- 172.21.15.40:0/2690370967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc410b860 msgr2=0x7fdfc41a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc410b860 0x7fdfc41a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc3e00640 1 -- 172.21.15.40:0/2690370967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc41055d0 msgr2=0x7fdfc419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc41055d0 0x7fdfc419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc3e00640 1 -- 172.21.15.40:0/2690370967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc41a1d10 con 0x7fdfc410af10 2024-07-26T12:21:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc9600640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc410b860 0x7fdfc41a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 0x7fdfc419c400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c8c0 tx=0x7fdfb000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc1600640 1 -- 172.21.15.40:0/2690370967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0007bb0 con 0x7fdfc410af10 2024-07-26T12:21:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc1600640 1 -- 172.21.15.40:0/2690370967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfb0007d50 con 0x7fdfc410af10 2024-07-26T12:21:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc41a2000 con 0x7fdfc410af10 2024-07-26T12:21:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.740+0000 7fdfc1600640 1 -- 172.21.15.40:0/2690370967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00186a0 con 0x7fdfc410af10 2024-07-26T12:21:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.741+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a8820 con 0x7fdfc410af10 2024-07-26T12:21:27.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.744+0000 7fdfd22a7740 1 Processor -- start 2024-07-26T12:21:27.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.744+0000 7fdfd22a7740 1 -- start start 2024-07-26T12:21:27.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfc1600640 1 -- 172.21.15.40:0/2690370967 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdfb000fa00 con 0x7fdfc410af10 2024-07-26T12:21:27.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7ee7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7ee7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7ee81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559ac7e5d950 con 0x559ac7b190a0 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559ac7e4ce50 con 0x559ac7b21280 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559ac7e50e90 con 0x559ac7b41f60 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfc8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7ee7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfc8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7ee7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55454/0 (socket says 172.21.15.40:55454) 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.745+0000 7fdfc8c00640 1 -- 172.21.15.40:0/175410084 learned_addr learned my addr 172.21.15.40:0/175410084 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc9600640 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7ee7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7ee81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc8c00640 1 -- 172.21.15.40:0/175410084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 msgr2=0x559ac7ee7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7ee7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc8c00640 1 -- 172.21.15.40:0/175410084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 msgr2=0x559ac7ee81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7ee81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc8c00640 1 -- 172.21.15.40:0/175410084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ac7df40f0 con 0x559ac7b190a0 2024-07-26T12:21:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7ee81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.746+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7ee7ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bcf0 tx=0x7fdfb800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f408ebd09b43a839 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.747+0000 7fdfb5c00640 1 -- 172.21.15.40:0/175410084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8015070 con 0x559ac7b190a0 2024-07-26T12:21:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.747+0000 7fdfb5c00640 1 -- 172.21.15.40:0/175410084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfb80118d0 con 0x559ac7b190a0 2024-07-26T12:21:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.747+0000 7fdfb5c00640 1 -- 172.21.15.40:0/175410084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8010750 con 0x559ac7b190a0 2024-07-26T12:21:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.747+0000 7fdfc1600640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfac0b3c80 0x7fdfac0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.747+0000 7fdfc1600640 1 -- 172.21.15.40:0/2690370967 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdfb00e3ca0 con 0x7fdfc410af10 2024-07-26T12:21:27.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.747+0000 7fdfc9600640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfac0b3c80 0x7fdfac0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 -- 172.21.15.40:0/175410084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 msgr2=0x559ac7ee7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7ee7ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bcf0 tx=0x7fdfb800f730 comp rx=0 tx=0).stop 2024-07-26T12:21:27.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 -- 172.21.15.40:0/175410084 shutdown_connections 2024-07-26T12:21:27.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7ee81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7ee7ca0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/175410084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7ee7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 -- 172.21.15.40:0/175410084 >> 172.21.15.40:0/175410084 conn(0x559ac7b36350 msgr2=0x559ac7ee5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 -- 172.21.15.40:0/175410084 shutdown_connections 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfc9600640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfac0b3c80 0x7fdfac0b6190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0094e0 tx=0x7fdfbc009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.748+0000 7fdfd22a7740 1 -- 172.21.15.40:0/175410084 wait complete. 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.749+0000 7fdfd22a7740 1 -- start start 2024-07-26T12:21:27.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.749+0000 7fdfd22a7740 1 Processor -- start 2024-07-26T12:21:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b190a0 0x559ac7ef2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 0x559ac7ef35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b41f60 0x559ac7eff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559ac7cb05f0 con 0x559ac7b21280 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559ac7de9520 con 0x559ac7b41f60 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559ac7ef5f40 con 0x559ac7b190a0 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfd22a7740 10 client.0 _ll_register_callbacks cb 0x559ac7df8ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 0x559ac7ef35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 0x559ac7ef35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55462/0 (socket says 172.21.15.40:55462) 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfc3e00640 1 -- 172.21.15.40:0/1081141861 learned_addr learned my addr 172.21.15.40:0/1081141861 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b190a0 0x559ac7ef2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.750+0000 7fdfc9600640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b41f60 0x559ac7eff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc3e00640 1 -- 172.21.15.40:0/1081141861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b190a0 msgr2=0x559ac7ef2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b190a0 0x559ac7ef2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc3e00640 1 -- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b41f60 msgr2=0x559ac7eff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b41f60 0x559ac7eff260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc3e00640 1 -- 172.21.15.40:0/1081141861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ac7bad540 con 0x559ac7b21280 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b190a0 0x559ac7ef2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc9600640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b41f60 0x559ac7eff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 0x559ac7ef35a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00e1760 tx=0x7fdfb00aa450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a39bed18182417 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfaa000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfaa000640 1 -- 172.21.15.40:0/1081141861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00aabb0 con 0x559ac7b21280 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfaa000640 1 -- 172.21.15.40:0/1081141861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdfb00922f0 con 0x559ac7b21280 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.751+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfb80118d0 con 0x559ac7b21280 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfaa000640 1 -- 172.21.15.40:0/1081141861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdfb00af1b0 con 0x559ac7b21280 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 10 client.15141 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ac7f01e30 con 0x559ac7b21280 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfaa000640 1 -- 172.21.15.40:0/1081141861 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfb80118d0 con 0x559ac7b21280 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfaa000640 1 -- 172.21.15.40:0/1081141861 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdfb00b38d0 con 0x559ac7b21280 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 10 client.15141 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 10 client.15141 resolve_mds: resolved name 'h' to daemon mds.h 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 20 client.15141 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7b008e0 0x559ac7f05850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 4 client.15141 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.752+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ac7e5f8a0 con 0x559ac7b008e0 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.753+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7b008e0 0x559ac7f05850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.754+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7b008e0 0x559ac7f05850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8628f8b9bf5a154 server_cookie=fdd19d20a2032508 in_seq=0 out_seq=0 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.754+0000 7fdfaa000640 10 client.15141 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T12:21:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.756+0000 7fdfaa000640 1 -- 172.21.15.40:0/1081141861 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ac7e5f8a0 con 0x559ac7b008e0 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.756+0000 7fdfaa000640 10 client.15141 handle_command_reply: tid=0 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.756+0000 7fdfd22a7740 1 client.15141 shutdown 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 msgr2=0x559ac7ef35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 0x559ac7ef35a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00e1760 tx=0x7fdfb00aa450 comp rx=0 tx=0).stop 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 shutdown_connections 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7b008e0 0x559ac7f05850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b41f60 0x559ac7eff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b21280 0x559ac7ef35a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/1081141861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b190a0 0x559ac7ef2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 >> 172.21.15.40:0/1081141861 conn(0x559ac7b36350 msgr2=0x559ac7eea8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfaa000640 0 client.15141 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T12:21:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 shutdown_connections 2024-07-26T12:21:27.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 1 -- 172.21.15.40:0/1081141861 wait complete. 2024-07-26T12:21:27.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.757+0000 7fdfd22a7740 20 client.15141 trim_cache size 0 max 16384 2024-07-26T12:21:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.778+0000 7fdfd22a7740 1 Processor -- start 2024-07-26T12:21:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.778+0000 7fdfd22a7740 1 -- start start 2024-07-26T12:21:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7eed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7eff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7eff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559ac7f03b90 con 0x559ac7b190a0 2024-07-26T12:21:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559ac7f04260 con 0x559ac7b21280 2024-07-26T12:21:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559ac7f04930 con 0x559ac7b41f60 2024-07-26T12:21:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfc8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7eed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfc8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7eed880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55476/0 (socket says 172.21.15.40:55476) 2024-07-26T12:21:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.779+0000 7fdfc8c00640 1 -- 172.21.15.40:0/4193234261 learned_addr learned my addr 172.21.15.40:0/4193234261 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc8c00640 1 -- 172.21.15.40:0/4193234261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 msgr2=0x559ac7eff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc9600640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7eff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7eff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc8c00640 1 -- 172.21.15.40:0/4193234261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 msgr2=0x559ac7eff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7eff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7eff1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc8c00640 1 -- 172.21.15.40:0/4193234261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ac7ee07d0 con 0x559ac7b190a0 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc9600640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7eff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7eff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.780+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7eed880 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bcf0 tx=0x7fdfb800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e789a47adcf7fa8b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfb5200640 1 -- 172.21.15.40:0/4193234261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8015050 con 0x559ac7b190a0 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfb5200640 1 -- 172.21.15.40:0/4193234261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfb802a070 con 0x559ac7b190a0 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfb5200640 1 -- 172.21.15.40:0/4193234261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8025400 con 0x559ac7b190a0 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 -- 172.21.15.40:0/4193234261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 msgr2=0x559ac7eed880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7eed880 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bcf0 tx=0x7fdfb800bc50 comp rx=0 tx=0).stop 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 -- 172.21.15.40:0/4193234261 shutdown_connections 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b41f60 0x559ac7eff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b21280 0x559ac7eff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/4193234261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b190a0 0x559ac7eed880 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.781+0000 7fdfd22a7740 1 -- 172.21.15.40:0/4193234261 >> 172.21.15.40:0/4193234261 conn(0x559ac7b36350 msgr2=0x559ac7ef2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:27.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.782+0000 7fdfd22a7740 1 -- 172.21.15.40:0/4193234261 shutdown_connections 2024-07-26T12:21:27.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.782+0000 7fdfd22a7740 1 -- 172.21.15.40:0/4193234261 wait complete. 2024-07-26T12:21:27.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.782+0000 7fdfd22a7740 1 -- start start 2024-07-26T12:21:27.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.782+0000 7fdfd22a7740 1 Processor -- start 2024-07-26T12:21:27.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b190a0 0x559ac7f06c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b21280 0x559ac7f07190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 0x559ac7f0dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559ac7f056d0 con 0x559ac7b41f60 2024-07-26T12:21:27.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559ac7f05000 con 0x559ac7b190a0 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559ac7f05da0 con 0x559ac7b21280 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfd22a7740 10 client.0 _ll_register_callbacks cb 0x7fdfb00aa570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfc9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 0x559ac7f0dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfc9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 0x559ac7f0dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55482/0 (socket says 172.21.15.40:55482) 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.783+0000 7fdfc9600640 1 -- 172.21.15.40:0/699345863 learned_addr learned my addr 172.21.15.40:0/699345863 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b190a0 0x559ac7f06c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc3e00640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b21280 0x559ac7f07190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc9600640 1 -- 172.21.15.40:0/699345863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b21280 msgr2=0x559ac7f07190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc9600640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b21280 0x559ac7f07190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc9600640 1 -- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b190a0 msgr2=0x559ac7f06c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:27.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc9600640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b190a0 0x559ac7f06c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc9600640 1 -- 172.21.15.40:0/699345863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ac7f0e020 con 0x559ac7b41f60 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b190a0 0x559ac7f06c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfc9600640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 0x559ac7f0dab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0096c0 tx=0x7fdfbc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b424181c8add9c9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.784+0000 7fdfaa000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfaa000640 1 -- 172.21.15.40:0/699345863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc004720 con 0x559ac7b41f60 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfaa000640 1 -- 172.21.15.40:0/699345863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdfbc0305c0 con 0x559ac7b41f60 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfb802a070 con 0x559ac7b41f60 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfaa000640 1 -- 172.21.15.40:0/699345863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdfbc0307c0 con 0x559ac7b41f60 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfd22a7740 10 client.15147 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ac7f75af0 con 0x559ac7b41f60 2024-07-26T12:21:27.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.785+0000 7fdfaa000640 1 -- 172.21.15.40:0/699345863 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfb802a070 con 0x559ac7b41f60 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfaa000640 1 -- 172.21.15.40:0/699345863 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdfbc043040 con 0x559ac7b41f60 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfd22a7740 10 client.15147 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfd22a7740 10 client.15147 resolve_mds: resolved name 'h' to daemon mds.h 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfd22a7740 20 client.15147 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7ad5c90 0x559ac7f794f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfd22a7740 4 client.15147 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "status"}) -- 0x559ac7e5b340 con 0x559ac7ad5c90 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.786+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7ad5c90 0x559ac7f794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.787+0000 7fdfc8c00640 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7ad5c90 0x559ac7f794f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a5eb53bf62070e server_cookie=429301ecf87c2065 in_seq=0 out_seq=0 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.787+0000 7fdfaa000640 10 client.15147 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T12:21:27.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfaa000640 1 -- 172.21.15.40:0/699345863 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559ac7e5b340 con 0x559ac7ad5c90 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfaa000640 10 client.15147 handle_command_reply: tid=0 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 client.15147 shutdown 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 msgr2=0x559ac7f0dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 0x559ac7f0dab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0096c0 tx=0x7fdfbc0095c0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 shutdown_connections 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x559ac7ad5c90 0x559ac7f794f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559ac7b41f60 0x559ac7f0dab0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559ac7b21280 0x559ac7f07190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfaa000640 0 client.15147 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 --2- 172.21.15.40:0/699345863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ac7b190a0 0x559ac7f06c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 >> 172.21.15.40:0/699345863 conn(0x559ac7b36350 msgr2=0x559ac7ef2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:27.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.788+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 shutdown_connections 2024-07-26T12:21:27.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.789+0000 7fdfd22a7740 1 -- 172.21.15.40:0/699345863 wait complete. 2024-07-26T12:21:27.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.789+0000 7fdfd22a7740 20 client.15147 trim_cache size 0 max 16384 2024-07-26T12:21:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:21:27.796 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:21:27.797 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2024-07-26T12:21:27.797 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34592, 2024-07-26T12:21:27.797 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:21:27.797 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 159.802759063, 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 212.612792584 2024-07-26T12:21:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfac0b3c80 msgr2=0x7fdfac0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfac0b3c80 0x7fdfac0b6190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0094e0 tx=0x7fdfbc009890 comp rx=0 tx=0).stop 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 msgr2=0x7fdfc419c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 0x7fdfc419c400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c8c0 tx=0x7fdfb000cd80 comp rx=0 tx=0).stop 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 shutdown_connections 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfac0b3c80 0x7fdfac0b6190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfc410b860 0x7fdfc41a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfc410af10 0x7fdfc419c400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 --2- 172.21.15.40:0/2690370967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc41055d0 0x7fdfc419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 >> 172.21.15.40:0/2690370967 conn(0x7fdfc4101040 msgr2=0x7fdfc4103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 shutdown_connections 2024-07-26T12:21:27.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:27.790+0000 7fdfca000640 1 -- 172.21.15.40:0/2690370967 wait complete. 2024-07-26T12:21:28.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.b status 2024-07-26T12:21:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:29 smithi146 ceph-mon[35807]: pgmap v477: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:21:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:29 smithi076 ceph-mon[35401]: pgmap v477: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:21:29.363 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:29 smithi040 ceph-mon[32397]: pgmap v477: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:21:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 -- 172.21.15.40:0/695843500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114076db0 msgr2=0x7fa1140751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 --2- 172.21.15.40:0/695843500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114076db0 0x7fa1140751e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa104009ca0 tx=0x7fa10402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.220 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:31 smithi040 ceph-mon[32397]: pgmap v478: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 -- 172.21.15.40:0/695843500 shutdown_connections 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 --2- 172.21.15.40:0/695843500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114113cb0 0x7fa114116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 --2- 172.21.15.40:0/695843500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114075800 0x7fa114075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 --2- 172.21.15.40:0/695843500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114076db0 0x7fa1140751e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 -- 172.21.15.40:0/695843500 >> 172.21.15.40:0/695843500 conn(0x7fa1140fee70 msgr2=0x7fa1141012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 -- 172.21.15.40:0/695843500 shutdown_connections 2024-07-26T12:21:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.218+0000 7fa11a800640 1 -- 172.21.15.40:0/695843500 wait complete. 2024-07-26T12:21:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 Processor -- start 2024-07-26T12:21:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 -- start start 2024-07-26T12:21:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114075800 0x7fa1141a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114076db0 0x7fa1141a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 0x7fa1141a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141197f0 con 0x7fa114113cb0 2024-07-26T12:21:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa114119670 con 0x7fa114075800 2024-07-26T12:21:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.220+0000 7fa11a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa114119970 con 0x7fa114076db0 2024-07-26T12:21:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa118a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114076db0 0x7fa1141a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa119400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114075800 0x7fa1141a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa119e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 0x7fa1141a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa118a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114076db0 0x7fa1141a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41968/0 (socket says 172.21.15.40:41968) 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa119400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114075800 0x7fa1141a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:54306/0 (socket says 172.21.15.40:54306) 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa119e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 0x7fa1141a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55502/0 (socket says 172.21.15.40:55502) 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.221+0000 7fa118a00640 1 -- 172.21.15.40:0/985193308 learned_addr learned my addr 172.21.15.40:0/985193308 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa119e00640 1 -- 172.21.15.40:0/985193308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114076db0 msgr2=0x7fa1141a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa119e00640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114076db0 0x7fa1141a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa119e00640 1 -- 172.21.15.40:0/985193308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114075800 msgr2=0x7fa1141a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa119e00640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114075800 0x7fa1141a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa119e00640 1 -- 172.21.15.40:0/985193308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141a6130 con 0x7fa114113cb0 2024-07-26T12:21:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa119e00640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 0x7fa1141a5ac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00c970 tx=0x7fa10c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa112000640 1 -- 172.21.15.40:0/985193308 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c007bb0 con 0x7fa114113cb0 2024-07-26T12:21:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa112000640 1 -- 172.21.15.40:0/985193308 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa10c007d50 con 0x7fa114113cb0 2024-07-26T12:21:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa112000640 1 -- 172.21.15.40:0/985193308 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c018660 con 0x7fa114113cb0 2024-07-26T12:21:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.222+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1141a6420 con 0x7fa114113cb0 2024-07-26T12:21:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.223+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141acc40 con 0x7fa114113cb0 2024-07-26T12:21:31.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.227+0000 7fa122a45740 1 Processor -- start 2024-07-26T12:21:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.228+0000 7fa112000640 1 -- 172.21.15.40:0/985193308 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa10c00f450 con 0x7fa114113cb0 2024-07-26T12:21:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.228+0000 7fa122a45740 1 -- start start 2024-07-26T12:21:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa122a45740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 0x5601f253d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa122a45740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f216f0a0 0x5601f253dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa122a45740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f253e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa122a45740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5601f24b3950 con 0x5601f2197f60 2024-07-26T12:21:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa122a45740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5601f24a2e50 con 0x5601f2177280 2024-07-26T12:21:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa122a45740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5601f24a6e90 con 0x5601f216f0a0 2024-07-26T12:21:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa118a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 0x5601f253d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa118a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 0x5601f253d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55506/0 (socket says 172.21.15.40:55506) 2024-07-26T12:21:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa118a00640 1 -- 172.21.15.40:0/2138144709 learned_addr learned my addr 172.21.15.40:0/2138144709 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.229+0000 7fa119400640 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f216f0a0 0x5601f253dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f253e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa112000640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa0f80b3c80 0x7fa0f80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 -- 172.21.15.40:0/2138144709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f216f0a0 msgr2=0x5601f253dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f216f0a0 0x5601f253dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 -- 172.21.15.40:0/2138144709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 msgr2=0x5601f253e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f253e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 -- 172.21.15.40:0/2138144709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f244a0f0 con 0x5601f2197f60 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa112000640 1 -- 172.21.15.40:0/985193308 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa10c0e3ac0 con 0x7fa114113cb0 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa118a00640 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 0x5601f253d760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa100012650 tx=0x7fa10000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0195d45c22638a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.230+0000 7fa119e00640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa0f80b3c80 0x7fa0f80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.231+0000 7fa10a600640 1 -- 172.21.15.40:0/2138144709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100005020 con 0x5601f2197f60 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.231+0000 7fa10a600640 1 -- 172.21.15.40:0/2138144709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa100005650 con 0x5601f2197f60 2024-07-26T12:21:31.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.231+0000 7fa10a600640 1 -- 172.21.15.40:0/2138144709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10000e510 con 0x5601f2197f60 2024-07-26T12:21:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 -- 172.21.15.40:0/2138144709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 msgr2=0x5601f253d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 0x5601f253d760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa100012650 tx=0x7fa10000b8c0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa119e00640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa0f80b3c80 0x7fa0f80b6190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0aa6d0 tx=0x7fa10c00ff50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 -- 172.21.15.40:0/2138144709 shutdown_connections 2024-07-26T12:21:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f253e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f216f0a0 0x5601f253dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 --2- 172.21.15.40:0/2138144709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2197f60 0x5601f253d760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 -- 172.21.15.40:0/2138144709 >> 172.21.15.40:0/2138144709 conn(0x5601f218c350 msgr2=0x5601f253b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 -- 172.21.15.40:0/2138144709 shutdown_connections 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.232+0000 7fa122a45740 1 -- 172.21.15.40:0/2138144709 wait complete. 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.233+0000 7fa122a45740 1 -- start start 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.233+0000 7fa122a45740 1 Processor -- start 2024-07-26T12:21:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f25491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f2549730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f2555230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5601f23065f0 con 0x5601f2177280 2024-07-26T12:21:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5601f243f520 con 0x5601f216f0a0 2024-07-26T12:21:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5601f254bf40 con 0x5601f2197f60 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa122a45740 10 client.0 _ll_register_callbacks cb 0x5601f244eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa119400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f2549730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa119400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f2549730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55514/0 (socket says 172.21.15.40:55514) 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa119400640 1 -- 172.21.15.40:0/2550131126 learned_addr learned my addr 172.21.15.40:0/2550131126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa118a00640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f25491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.234+0000 7fa118a00640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f2555230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa119400640 1 -- 172.21.15.40:0/2550131126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 msgr2=0x5601f2555230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa119400640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f2555230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa119400640 1 -- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 msgr2=0x5601f25491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa119400640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f25491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa119400640 1 -- 172.21.15.40:0/2550131126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f2203540 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa119400640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f2549730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa104009ca0 tx=0x7fa104031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d427ac81a0d8e21 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa0fea00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa0fea00640 1 -- 172.21.15.40:0/2550131126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104003970 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa0fea00640 1 -- 172.21.15.40:0/2550131126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa104003b10 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.235+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa100005650 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa0fea00640 1 -- 172.21.15.40:0/2550131126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa104003d10 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa122a45740 10 client.15159 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601f2557e80 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa0fea00640 1 -- 172.21.15.40:0/2550131126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa100005650 con 0x5601f2177280 2024-07-26T12:21:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa0fea00640 1 -- 172.21.15.40:0/2550131126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa10404e020 con 0x5601f2177280 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa122a45740 10 client.15159 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa122a45740 10 client.15159 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa122a45740 20 client.15159 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.236+0000 7fa122a45740 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f21568e0 0x5601f255b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.237+0000 7fa122a45740 4 client.15159 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.237+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601f24b58a0 con 0x5601f21568e0 2024-07-26T12:21:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.237+0000 7fa118a00640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f21568e0 0x5601f255b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.238+0000 7fa118a00640 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f21568e0 0x5601f255b940 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1088107767c23ba7 server_cookie=db0b32440bf8c4d4 in_seq=0 out_seq=0 2024-07-26T12:21:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.238+0000 7fa0fea00640 10 client.15159 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:21:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa0fea00640 1 -- 172.21.15.40:0/2550131126 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601f24b58a0 con 0x5601f21568e0 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa0fea00640 10 client.15159 handle_command_reply: tid=0 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 client.15159 shutdown 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 msgr2=0x5601f2549730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f2549730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa104009ca0 tx=0x7fa104031bb0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 shutdown_connections 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f2555230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f21568e0 0x5601f255b940 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f2549730 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 --2- 172.21.15.40:0/2550131126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f25491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 >> 172.21.15.40:0/2550131126 conn(0x5601f218c350 msgr2=0x5601f2540940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa0fea00640 0 client.15159 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:21:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 shutdown_connections 2024-07-26T12:21:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 1 -- 172.21.15.40:0/2550131126 wait complete. 2024-07-26T12:21:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.241+0000 7fa122a45740 20 client.15159 trim_cache size 0 max 16384 2024-07-26T12:21:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.261+0000 7fa122a45740 1 Processor -- start 2024-07-26T12:21:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.261+0000 7fa122a45740 1 -- start start 2024-07-26T12:21:31.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa122a45740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 0x5601f255b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa122a45740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f2543880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa122a45740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f25498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa122a45740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5601f2559c80 con 0x5601f216f0a0 2024-07-26T12:21:31.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa122a45740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5601f255a350 con 0x5601f2177280 2024-07-26T12:21:31.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa122a45740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5601f255aa20 con 0x5601f2197f60 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 0x5601f255b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 0x5601f255b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55526/0 (socket says 172.21.15.40:55526) 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 -- 172.21.15.40:0/3672480607 learned_addr learned my addr 172.21.15.40:0/3672480607 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa119400640 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f2543880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 -- 172.21.15.40:0/3672480607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 msgr2=0x5601f25498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f25498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 -- 172.21.15.40:0/3672480607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 msgr2=0x5601f2543880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f2543880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.262+0000 7fa118a00640 1 -- 172.21.15.40:0/3672480607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f25367d0 con 0x5601f216f0a0 2024-07-26T12:21:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.263+0000 7fa118a00640 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 0x5601f255b270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa100012650 tx=0x7fa10000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46258ed5fef41a69 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.263+0000 7fa109c00640 1 -- 172.21.15.40:0/3672480607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10000b410 con 0x5601f216f0a0 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.263+0000 7fa109c00640 1 -- 172.21.15.40:0/3672480607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa100031020 con 0x5601f216f0a0 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.263+0000 7fa109c00640 1 -- 172.21.15.40:0/3672480607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10000ea20 con 0x5601f216f0a0 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 -- 172.21.15.40:0/3672480607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 msgr2=0x5601f255b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 0x5601f255b270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa100012650 tx=0x7fa10000b810 comp rx=0 tx=0).stop 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 -- 172.21.15.40:0/3672480607 shutdown_connections 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f25498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f2177280 0x5601f2543880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 --2- 172.21.15.40:0/3672480607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f216f0a0 0x5601f255b270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 -- 172.21.15.40:0/3672480607 >> 172.21.15.40:0/3672480607 conn(0x5601f218c350 msgr2=0x5601f25491d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 -- 172.21.15.40:0/3672480607 shutdown_connections 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.264+0000 7fa122a45740 1 -- 172.21.15.40:0/3672480607 wait complete. 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 -- start start 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 Processor -- start 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f2563ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f25640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f255cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5601f255b7c0 con 0x5601f2177280 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5601f255b0f0 con 0x5601f216f0a0 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5601f255be90 con 0x5601f2197f60 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.265+0000 7fa122a45740 10 client.0 _ll_register_callbacks cb 0x7fa1040317f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f25640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f25640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55534/0 (socket says 172.21.15.40:55534) 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 -- 172.21.15.40:0/2234306915 learned_addr learned my addr 172.21.15.40:0/2234306915 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa118a00640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f2563ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa118a00640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f255cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 -- 172.21.15.40:0/2234306915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 msgr2=0x5601f255cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f255cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 -- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 msgr2=0x5601f2563ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:21:31.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f2563ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa119400640 1 -- 172.21.15.40:0/2234306915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f255d080 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.266+0000 7fa118a00640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f2563ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa119400640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f25640e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa104009bf0 tx=0x7fa104003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172bc3ed97e98492 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa0fea00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa0fea00640 1 -- 172.21.15.40:0/2234306915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104030940 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa100031020 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa0fea00640 1 -- 172.21.15.40:0/2234306915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa104003eb0 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa0fea00640 1 -- 172.21.15.40:0/2234306915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa1040040b0 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa122a45740 10 client.15165 fetch_fsmap learned FSMap version 28 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.267+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601f25c32f0 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa0fea00640 1 -- 172.21.15.40:0/2234306915 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa100031020 con 0x5601f2177280 2024-07-26T12:21:31.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa0fea00640 1 -- 172.21.15.40:0/2234306915 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa104058030 con 0x5601f2177280 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa122a45740 10 client.15165 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa122a45740 10 client.15165 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa122a45740 20 client.15165 populate_metadata read hostname 'smithi040' 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa122a45740 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f212bc90 0x5601f25c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa122a45740 4 client.15165 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.268+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "status"}) -- 0x5601f24b1340 con 0x5601f212bc90 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.269+0000 7fa118a00640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f212bc90 0x5601f25c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.270+0000 7fa118a00640 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f212bc90 0x5601f25c6bf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e62481cf367143 server_cookie=f54dbf13b144458a in_seq=0 out_seq=0 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.270+0000 7fa0fea00640 10 client.15165 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.270+0000 7fa0fea00640 1 -- 172.21.15.40:0/2234306915 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5601f24b1340 con 0x5601f212bc90 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.270+0000 7fa0fea00640 10 client.15165 handle_command_reply: tid=0 2024-07-26T12:21:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.270+0000 7fa122a45740 1 client.15165 shutdown 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.270+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 msgr2=0x5601f25640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f25640e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa104009bf0 tx=0x7fa104003ca0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 shutdown_connections 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601f2197f60 0x5601f255cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5601f212bc90 0x5601f25c6bf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5601f2177280 0x5601f25640e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 --2- 172.21.15.40:0/2234306915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5601f216f0a0 0x5601f2563ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 >> 172.21.15.40:0/2234306915 conn(0x5601f218c350 msgr2=0x5601f253e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa0fea00640 0 client.15165 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 shutdown_connections 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 1 -- 172.21.15.40:0/2234306915 wait complete. 2024-07-26T12:21:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.271+0000 7fa122a45740 20 client.15165 trim_cache size 0 max 16384 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34631, 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 178.69097375999999, 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:21:31.277 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:21:31.278 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 199.944225235 2024-07-26T12:21:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:21:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa0f80b3c80 msgr2=0x7fa0f80b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa0f80b3c80 0x7fa0f80b6190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0aa6d0 tx=0x7fa10c00ff50 comp rx=0 tx=0).stop 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 msgr2=0x7fa1141a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 0x7fa1141a5ac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00c970 tx=0x7fa10c00ce30 comp rx=0 tx=0).stop 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 shutdown_connections 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa114113cb0 0x7fa1141a5ac0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa0f80b3c80 0x7fa0f80b6190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa114076db0 0x7fa1141a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 --2- 172.21.15.40:0/985193308 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa114075800 0x7fa1141a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 >> 172.21.15.40:0/985193308 conn(0x7fa1140fee70 msgr2=0x7fa11410fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 shutdown_connections 2024-07-26T12:21:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:31.272+0000 7fa11a800640 1 -- 172.21.15.40:0/985193308 wait complete. 2024-07-26T12:21:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:31 smithi146 ceph-mon[35807]: pgmap v478: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-07-26T12:21:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:31 smithi076 ceph-mon[35401]: pgmap v478: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-07-26T12:21:32.111 INFO:tasks.cephadm:Setup complete, yielding 2024-07-26T12:21:32.112 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-07-26T12:21:32.123 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-07-26T12:21:32.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph orch status' 2024-07-26T12:21:32.621 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:33 smithi076 ceph-mon[35401]: pgmap v479: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:21:33.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:33 smithi040 ceph-mon[32397]: pgmap v479: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:21:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:33 smithi146 ceph-mon[35807]: pgmap v479: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:21:34.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 -- 172.21.15.40:0/4160385783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 msgr2=0x7f107810b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:34.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 --2- 172.21.15.40:0/4160385783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107810b3b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1070009ca0 tx=0x7f107002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 -- 172.21.15.40:0/4160385783 shutdown_connections 2024-07-26T12:21:34.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 --2- 172.21.15.40:0/4160385783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107810b3b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 --2- 172.21.15.40:0/4160385783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078106300 0x7f1078108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 --2- 172.21.15.40:0/4160385783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 0x7f1078105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 -- 172.21.15.40:0/4160385783 >> 172.21.15.40:0/4160385783 conn(0x7f10780fd9e0 msgr2=0x7f10780ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 -- 172.21.15.40:0/4160385783 shutdown_connections 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.732+0000 7f107f400640 1 -- 172.21.15.40:0/4160385783 wait complete. 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.733+0000 7f107f400640 1 Processor -- start 2024-07-26T12:21:34.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 -- start start 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 0x7f107819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078106300 0x7f107819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f107810ecc0 con 0x7f1078108ea0 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f107810eb40 con 0x7f107806b3b0 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107f400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f107810ee40 con 0x7f1078106300 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:34.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55094/0 (socket says 172.21.15.40:55094) 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.734+0000 7f107d400640 1 -- 172.21.15.40:0/2044590680 learned_addr learned my addr 172.21.15.40:0/2044590680 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107ca00640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 0x7f107819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f1077e00640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078106300 0x7f107819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107d400640 1 -- 172.21.15.40:0/2044590680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078106300 msgr2=0x7f107819c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107d400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078106300 0x7f107819c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107d400640 1 -- 172.21.15.40:0/2044590680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 msgr2=0x7f107819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107d400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 0x7f107819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107d400640 1 -- 172.21.15.40:0/2044590680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107819d410 con 0x7f1078108ea0 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107ca00640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 0x7f107819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:34.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.735+0000 7f107d400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107819cc80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1070003ba0 tx=0x7f1070003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:34.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.736+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070004040 con 0x7f1078108ea0 2024-07-26T12:21:34.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.736+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1070004670 con 0x7f1078108ea0 2024-07-26T12:21:34.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.736+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107819d6a0 con 0x7f1078108ea0 2024-07-26T12:21:34.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.736+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107003b410 con 0x7f1078108ea0 2024-07-26T12:21:34.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.736+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10781a3cc0 con 0x7f1078108ea0 2024-07-26T12:21:34.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.737+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10781a3fe0 con 0x7f1078108ea0 2024-07-26T12:21:34.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.740+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f10700305c0 con 0x7f1078108ea0 2024-07-26T12:21:34.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.741+0000 7f1075600640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10600b3c50 0x7f10600b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:34.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.741+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1070105530 con 0x7f1078108ea0 2024-07-26T12:21:34.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.741+0000 7f107ca00640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10600b3c50 0x7f10600b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:34.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.742+0000 7f107ca00640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10600b3c50 0x7f10600b6160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f106c00baa0 tx=0x7f106c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:34.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.743+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f10700393b0 con 0x7f1078108ea0 2024-07-26T12:21:34.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.962+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f107810ad20 con 0x7f10600b3c50 2024-07-26T12:21:34.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.964+0000 7f1075600640 1 -- 172.21.15.40:0/2044590680 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f107810ad20 con 0x7f10600b3c50 2024-07-26T12:21:34.967 INFO:teuthology.orchestra.run.smithi040.stdout:Backend: cephadm 2024-07-26T12:21:34.967 INFO:teuthology.orchestra.run.smithi040.stdout:Available: Yes 2024-07-26T12:21:34.967 INFO:teuthology.orchestra.run.smithi040.stdout:Paused: No 2024-07-26T12:21:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.967+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10600b3c50 msgr2=0x7f10600b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.967+0000 7f107f400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10600b3c50 0x7f10600b6160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f106c00baa0 tx=0x7f106c005d90 comp rx=0 tx=0).stop 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.967+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 msgr2=0x7f107819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.967+0000 7f107f400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107819cc80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1070003ba0 tx=0x7f1070003bd0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 shutdown_connections 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078108ea0 0x7f107819cc80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f10600b3c50 0x7f10600b6160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078106300 0x7f107819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 --2- 172.21.15.40:0/2044590680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f107806b3b0 0x7f107819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 >> 172.21.15.40:0/2044590680 conn(0x7f10780fd9e0 msgr2=0x7f10780ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 shutdown_connections 2024-07-26T12:21:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:34.968+0000 7f107f400640 1 -- 172.21.15.40:0/2044590680 wait complete. 2024-07-26T12:21:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:35 smithi040 ceph-mon[32397]: pgmap v480: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:21:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:35 smithi076 ceph-mon[35401]: pgmap v480: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:21:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:35 smithi146 ceph-mon[35807]: pgmap v480: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:21:35.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph orch ps' 2024-07-26T12:21:36.278 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:36.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:36 smithi040 ceph-mon[32397]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:36 smithi146 ceph-mon[35807]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:36 smithi076 ceph-mon[35401]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:37.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:37 smithi040 ceph-mon[32397]: pgmap v481: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:37 smithi146 ceph-mon[35807]: pgmap v481: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:37 smithi076 ceph-mon[35401]: pgmap v481: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 -- 172.21.15.40:0/616233916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb234106de0 msgr2=0x7fb23410d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 --2- 172.21.15.40:0/616233916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb234106de0 0x7fb23410d780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009ca0 tx=0x7fb22c02a950 comp rx=0 tx=0).stop 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 -- 172.21.15.40:0/616233916 shutdown_connections 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 --2- 172.21.15.40:0/616233916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb234106de0 0x7fb23410d780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 --2- 172.21.15.40:0/616233916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb234106440 0x7fb234106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 --2- 172.21.15.40:0/616233916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2341053b0 0x7fb234105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 -- 172.21.15.40:0/616233916 >> 172.21.15.40:0/616233916 conn(0x7fb234100d20 msgr2=0x7fb2341031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 -- 172.21.15.40:0/616233916 shutdown_connections 2024-07-26T12:21:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.364+0000 7fb23c000640 1 -- 172.21.15.40:0/616233916 wait complete. 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 Processor -- start 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 -- start start 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 0x7fb23419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb234106440 0x7fb23419c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234106de0 0x7fb23419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb234110f10 con 0x7fb2341053b0 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb234110d90 con 0x7fb234106440 2024-07-26T12:21:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.366+0000 7fb23c000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb234111090 con 0x7fb234106de0 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 0x7fb23419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 0x7fb23419bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55110/0 (socket says 172.21.15.40:55110) 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 -- 172.21.15.40:0/4061067070 learned_addr learned my addr 172.21.15.40:0/4061067070 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb23a000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234106de0 0x7fb23419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb238c00640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb234106440 0x7fb23419c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 -- 172.21.15.40:0/4061067070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234106de0 msgr2=0x7fb23419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234106de0 0x7fb23419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 -- 172.21.15.40:0/4061067070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb234106440 msgr2=0x7fb23419c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb234106440 0x7fb23419c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.367+0000 7fb239600640 1 -- 172.21.15.40:0/4061067070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23419d510 con 0x7fb2341053b0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.368+0000 7fb239600640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 0x7fb23419bae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb22800d770 tx=0x7fb22800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.368+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228017070 con 0x7fb2341053b0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.368+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2280054b0 con 0x7fb2341053b0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.368+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23419d800 con 0x7fb2341053b0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.368+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228004c60 con 0x7fb2341053b0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.368+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2341a3f00 con 0x7fb2341053b0 2024-07-26T12:21:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.369+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23410c590 con 0x7fb2341053b0 2024-07-26T12:21:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.372+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb228004e00 con 0x7fb2341053b0 2024-07-26T12:21:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.373+0000 7fb232000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb21c0b3bd0 0x7fb21c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.373+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb2280e3790 con 0x7fb2341053b0 2024-07-26T12:21:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.374+0000 7fb238c00640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb21c0b3bd0 0x7fb21c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.375+0000 7fb238c00640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb21c0b3bd0 0x7fb21c0b60e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb220009b60 tx=0x7fb220005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.378+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb2280aada0 con 0x7fb2341053b0 2024-07-26T12:21:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.592+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb23402e440 con 0x7fb21c0b3bd0 2024-07-26T12:21:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.618+0000 7fb232000640 1 -- 172.21.15.40:0/4061067070 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fb23402e440 con 0x7fb21c0b3bd0 2024-07-26T12:21:38.620 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-07-26T12:21:38.620 INFO:teuthology.orchestra.run.smithi040.stdout:mds.a smithi040 running (3m) 50s ago 3m 86.5M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa daee5aef891f 2024-07-26T12:21:38.620 INFO:teuthology.orchestra.run.smithi040.stdout:mds.b smithi076 running (3m) 67s ago 3m 94.2M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 4122e0e03ee9 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.c smithi146 running (3m) 67s ago 3m 86.2M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa abe1a5739341 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.d smithi040 running (3m) 50s ago 3m 81.2M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 75981f61bc60 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.e smithi076 running (3m) 67s ago 3m 85.9M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa ea4d351352af 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.f smithi146 running (3m) 67s ago 3m 87.4M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa f8dfca4499a6 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.g smithi040 running (3m) 50s ago 3m 86.5M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa d6c15625d5ca 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.h smithi076 running (3m) 67s ago 3m 86.8M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa e0ccfa0f1f52 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.i smithi146 running (3m) 67s ago 3m 86.2M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa fe7d41be65c4 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.j smithi040 running (4m) 50s ago 4m 81.2M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa afa428a98542 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.k smithi076 running (4m) 67s ago 4m 86.6M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 17f99fe3e70d 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mds.l smithi146 running (4m) 67s ago 4m 86.1M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 7c88f1fb029a 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi040 *:9283,8765 running (14m) 50s ago 14m 591M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa a0805b95d766 2024-07-26T12:21:38.621 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi076 *:8443,8765 running (12m) 67s ago 12m 523M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 4d9eeb41d3d6 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.z smithi146 *:8443,8765 running (12m) 67s ago 12m 523M - 19.0.0-5320-ge8f88bb1 ae51f432d4fa 4267c5929640 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (14m) 50s ago 14m 119M 2048M 19.0.0-5320-ge8f88bb1 ae51f432d4fa de6095242ad6 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi076 running (12m) 67s ago 12m 110M 2048M 19.0.0-5320-ge8f88bb1 ae51f432d4fa bb21128930b7 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi146 running (12m) 67s ago 12m 111M 2048M 19.0.0-5320-ge8f88bb1 ae51f432d4fa ada68cf50194 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (10m) 50s ago 10m 116M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 11b43460ca96 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi076 running (10m) 67s ago 10m 124M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 6abd961076fa 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi146 running (9m) 67s ago 9m 117M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 97fd1952010d 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (9m) 50s ago 9m 115M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 460fd1716d28 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi076 running (8m) 67s ago 8m 119M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 1d2e8c5548f0 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi146 running (8m) 67s ago 8m 122M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa a0be15dfcb34 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi040 running (7m) 50s ago 7m 113M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa b2fa59f7c0e7 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi076 running (6m) 67s ago 6m 121M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 41eb684dd649 2024-07-26T12:21:38.622 INFO:teuthology.orchestra.run.smithi040.stdout:osd.8 smithi146 running (6m) 67s ago 6m 114M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa d496414fcf56 2024-07-26T12:21:38.623 INFO:teuthology.orchestra.run.smithi040.stdout:osd.9 smithi040 running (5m) 50s ago 5m 119M 4273M 19.0.0-5320-ge8f88bb1 ae51f432d4fa 61d53c7ac7e0 2024-07-26T12:21:38.623 INFO:teuthology.orchestra.run.smithi040.stdout:osd.10 smithi076 running (5m) 67s ago 5m 115M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa da64f5381feb 2024-07-26T12:21:38.623 INFO:teuthology.orchestra.run.smithi040.stdout:osd.11 smithi146 running (4m) 67s ago 4m 118M 4272M 19.0.0-5320-ge8f88bb1 ae51f432d4fa ee732fa1bf52 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.621+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb21c0b3bd0 msgr2=0x7fb21c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.621+0000 7fb23c000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb21c0b3bd0 0x7fb21c0b60e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb220009b60 tx=0x7fb220005f90 comp rx=0 tx=0).stop 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.621+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 msgr2=0x7fb23419bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.621+0000 7fb23c000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 0x7fb23419bae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb22800d770 tx=0x7fb22800dc30 comp rx=0 tx=0).stop 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 shutdown_connections 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb21c0b3bd0 0x7fb21c0b60e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234106de0 0x7fb23419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb234106440 0x7fb23419c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 --2- 172.21.15.40:0/4061067070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2341053b0 0x7fb23419bae0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 >> 172.21.15.40:0/4061067070 conn(0x7fb234100d20 msgr2=0x7fb234109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 shutdown_connections 2024-07-26T12:21:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:38.622+0000 7fb23c000640 1 -- 172.21.15.40:0/4061067070 wait complete. 2024-07-26T12:21:39.333 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:39 smithi040 ceph-mon[32397]: pgmap v482: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:39.333 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:39 smithi040 ceph-mon[32397]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:39.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph orch ls' 2024-07-26T12:21:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:39 smithi146 ceph-mon[35807]: pgmap v482: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:39 smithi146 ceph-mon[35807]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:39 smithi076 ceph-mon[35401]: pgmap v482: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:39 smithi076 ceph-mon[35401]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:41.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:41 smithi146 ceph-mon[35807]: pgmap v483: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:41 smithi040 ceph-mon[32397]: pgmap v483: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:41 smithi076 ceph-mon[35401]: pgmap v483: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 -- 172.21.15.40:0/2719034613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 msgr2=0x7fdffc106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 --2- 172.21.15.40:0/2719034613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc106660 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009900 tx=0x7fdfe802a490 comp rx=0 tx=0).stop 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 -- 172.21.15.40:0/2719034613 shutdown_connections 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 --2- 172.21.15.40:0/2719034613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdffc106bf0 0x7fdffc10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 --2- 172.21.15.40:0/2719034613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc106660 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 --2- 172.21.15.40:0/2719034613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdffc1051c0 0x7fdffc105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.051+0000 7fe000a00640 1 -- 172.21.15.40:0/2719034613 >> 172.21.15.40:0/2719034613 conn(0x7fdffc100b10 msgr2=0x7fdffc102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.052+0000 7fe000a00640 1 -- 172.21.15.40:0/2719034613 shutdown_connections 2024-07-26T12:21:42.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.052+0000 7fe000a00640 1 -- 172.21.15.40:0/2719034613 wait complete. 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 Processor -- start 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 -- start start 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdffc1051c0 0x7fdffc19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc19c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdffc106bf0 0x7fdffc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc110d60 con 0x7fdffc106250 2024-07-26T12:21:42.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc110be0 con 0x7fdffc1051c0 2024-07-26T12:21:42.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.053+0000 7fe000a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc110ee0 con 0x7fdffc106bf0 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdff9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc19c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdff9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc19c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55116/0 (socket says 172.21.15.40:55116) 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdff9e00640 1 -- 172.21.15.40:0/1129737958 learned_addr learned my addr 172.21.15.40:0/1129737958 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdffa800640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdffc1051c0 0x7fdffc19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdffb200640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdffc106bf0 0x7fdffc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdff9e00640 1 -- 172.21.15.40:0/1129737958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdffc106bf0 msgr2=0x7fdffc19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.054+0000 7fdff9e00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdffc106bf0 0x7fdffc19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff9e00640 1 -- 172.21.15.40:0/1129737958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdffc1051c0 msgr2=0x7fdffc19b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff9e00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdffc1051c0 0x7fdffc19b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff9e00640 1 -- 172.21.15.40:0/1129737958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc19d360 con 0x7fdffc106250 2024-07-26T12:21:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff9e00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc19c030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80057c0 tx=0x7fdfe8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:42.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe803f070 con 0x7fdffc106250 2024-07-26T12:21:42.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfe8031da0 con 0x7fdffc106250 2024-07-26T12:21:42.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8035030 con 0x7fdffc106250 2024-07-26T12:21:42.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.055+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc19d5f0 con 0x7fdffc106250 2024-07-26T12:21:42.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.056+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc1a3c90 con 0x7fdffc106250 2024-07-26T12:21:42.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.057+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc10c3a0 con 0x7fdffc106250 2024-07-26T12:21:42.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.060+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdfe8042070 con 0x7fdffc106250 2024-07-26T12:21:42.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.062+0000 7fdff3400640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfe00b3c50 0x7fdfe00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:42.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.062+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdfe8104c00 con 0x7fdffc106250 2024-07-26T12:21:42.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.062+0000 7fdffa800640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfe00b3c50 0x7fdfe00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:42.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.063+0000 7fdffa800640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfe00b3c50 0x7fdfe00b6160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00abe0 tx=0x7fdfec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:42.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.063+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdfe80cc210 con 0x7fdffc106250 2024-07-26T12:21:42.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.279+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fdffc063230 con 0x7fdfe00b3c50 2024-07-26T12:21:42.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.294+0000 7fdff3400640 1 -- 172.21.15.40:0/1129737958 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fdffc063230 con 0x7fdfe00b3c50 2024-07-26T12:21:42.296 INFO:teuthology.orchestra.run.smithi040.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-07-26T12:21:42.297 INFO:teuthology.orchestra.run.smithi040.stdout:mds.all 12/12 71s ago 4m smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi076=b;smithi076=e;smithi076=h;smithi076=k;smithi146=c;smithi146=f;smithi146=i;smithi146=l;count:12 2024-07-26T12:21:42.297 INFO:teuthology.orchestra.run.smithi040.stdout:mgr 3/3 71s ago 12m smithi040=x;smithi076=y;smithi146=z;count:3 2024-07-26T12:21:42.297 INFO:teuthology.orchestra.run.smithi040.stdout:mon 3/3 71s ago 12m smithi040:172.21.15.40=a;smithi076:172.21.15.76=b;smithi146:172.21.15.146=c;count:3 2024-07-26T12:21:42.297 INFO:teuthology.orchestra.run.smithi040.stdout:osd 12 71s ago - 2024-07-26T12:21:42.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfe00b3c50 msgr2=0x7fdfe00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:42.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfe00b3c50 0x7fdfe00b6160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00abe0 tx=0x7fdfec00a2d0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 msgr2=0x7fdffc19c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:42.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc19c030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80057c0 tx=0x7fdfe8003cd0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 shutdown_connections 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdfe00b3c50 0x7fdfe00b6160 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdffc106bf0 0x7fdffc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdffc106250 0x7fdffc19c030 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 --2- 172.21.15.40:0/1129737958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdffc1051c0 0x7fdffc19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.297+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 >> 172.21.15.40:0/1129737958 conn(0x7fdffc100b10 msgr2=0x7fdffc109570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.298+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 shutdown_connections 2024-07-26T12:21:42.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:42.298+0000 7fe000a00640 1 -- 172.21.15.40:0/1129737958 wait complete. 2024-07-26T12:21:43.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph orch host ls' 2024-07-26T12:21:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:43 smithi040 ceph-mon[32397]: pgmap v484: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:43 smithi040 ceph-mon[32397]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:43 smithi146 ceph-mon[35807]: pgmap v484: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:43 smithi146 ceph-mon[35807]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:43 smithi076 ceph-mon[35401]: pgmap v484: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:43 smithi076 ceph-mon[35401]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:43.639 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:45 smithi040 ceph-mon[32397]: pgmap v485: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:45 smithi146 ceph-mon[35807]: pgmap v485: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:45 smithi076 ceph-mon[35401]: pgmap v485: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:45.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 -- 172.21.15.40:0/2790173791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc010a660 msgr2=0x7f5dc010aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2790173791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc010a660 0x7f5dc010aa70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009900 tx=0x7f5dac02a480 comp rx=0 tx=0).stop 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 -- 172.21.15.40:0/2790173791 shutdown_connections 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2790173791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 0x7f5dc01119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2790173791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc010a660 0x7f5dc010aa70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2790173791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc01095d0 0x7f5dc0109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 -- 172.21.15.40:0/2790173791 >> 172.21.15.40:0/2790173791 conn(0x7f5dc0078970 msgr2=0x7f5dc007ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.808+0000 7f5dbf200640 1 -- 172.21.15.40:0/2790173791 shutdown_connections 2024-07-26T12:21:45.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.809+0000 7f5dbf200640 1 -- 172.21.15.40:0/2790173791 wait complete. 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 Processor -- start 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 -- start start 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 0x7f5dc019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc010a660 0x7f5dc01a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 0x7f5dc01a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc01150c0 con 0x7f5dc01095d0 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc0114f40 con 0x7f5dc010b000 2024-07-26T12:21:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.810+0000 7f5dbf200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc0115240 con 0x7f5dc010a660 2024-07-26T12:21:45.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 0x7f5dc019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 0x7f5dc019fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47450/0 (socket says 172.21.15.40:47450) 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 -- 172.21.15.40:0/2280362074 learned_addr learned my addr 172.21.15.40:0/2280362074 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbd400640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc010a660 0x7f5dc01a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbe800640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 0x7f5dc01a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 -- 172.21.15.40:0/2280362074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc010a660 msgr2=0x7f5dc01a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc010a660 0x7f5dc01a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 -- 172.21.15.40:0/2280362074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 msgr2=0x7f5dc01a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 0x7f5dc01a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbde00640 1 -- 172.21.15.40:0/2280362074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc01a1800 con 0x7f5dc01095d0 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.811+0000 7f5dbe800640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 0x7f5dc01a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.812+0000 7f5dbde00640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 0x7f5dc019fdd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d950 tx=0x7f5db000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.812+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0017070 con 0x7f5dc01095d0 2024-07-26T12:21:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.812+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5db0009c30 con 0x7f5dc01095d0 2024-07-26T12:21:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.812+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db000f620 con 0x7f5dc01095d0 2024-07-26T12:21:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.812+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc01a1af0 con 0x7f5dc01095d0 2024-07-26T12:21:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.812+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc01a81f0 con 0x7f5dc01095d0 2024-07-26T12:21:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.813+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc0109a40 con 0x7f5dc01095d0 2024-07-26T12:21:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.816+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5db0010460 con 0x7f5dc01095d0 2024-07-26T12:21:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.819+0000 7f5db6a00640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5da40b3c50 0x7f5da40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.819+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5db00e38a0 con 0x7f5dc01095d0 2024-07-26T12:21:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.819+0000 7f5dbd400640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5da40b3c50 0x7f5da40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.820+0000 7f5dbd400640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5da40b3c50 0x7f5da40b6160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5dac000c00 tx=0x7f5dac005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:45.821+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5db00aaf30 con 0x7f5dc01095d0 2024-07-26T12:21:46.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.028+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5dc0063230 con 0x7f5da40b3c50 2024-07-26T12:21:46.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.030+0000 7f5db6a00640 1 -- 172.21.15.40:0/2280362074 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5dc0063230 con 0x7f5da40b3c50 2024-07-26T12:21:46.032 INFO:teuthology.orchestra.run.smithi040.stdout:HOST ADDR LABELS STATUS 2024-07-26T12:21:46.032 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040 172.21.15.40 2024-07-26T12:21:46.032 INFO:teuthology.orchestra.run.smithi040.stdout:smithi076 172.21.15.76 2024-07-26T12:21:46.032 INFO:teuthology.orchestra.run.smithi040.stdout:smithi146 172.21.15.146 2024-07-26T12:21:46.032 INFO:teuthology.orchestra.run.smithi040.stdout:3 hosts in cluster 2024-07-26T12:21:46.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5da40b3c50 msgr2=0x7f5da40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:46.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5da40b3c50 0x7f5da40b6160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5dac000c00 tx=0x7f5dac005720 comp rx=0 tx=0).stop 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 msgr2=0x7f5dc019fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 0x7f5dc019fdd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d950 tx=0x7f5db000de10 comp rx=0 tx=0).stop 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 shutdown_connections 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc010b000 0x7f5dc01a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5da40b3c50 0x7f5da40b6160 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc010a660 0x7f5dc01a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 --2- 172.21.15.40:0/2280362074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dc01095d0 0x7f5dc019fdd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.033+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 >> 172.21.15.40:0/2280362074 conn(0x7f5dc0078970 msgr2=0x7f5dc010d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.034+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 shutdown_connections 2024-07-26T12:21:46.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:46.034+0000 7f5dbf200640 1 -- 172.21.15.40:0/2280362074 wait complete. 2024-07-26T12:21:46.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph orch device ls' 2024-07-26T12:21:47.277 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:47.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:47 smithi076 ceph-mon[35401]: pgmap v486: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:47.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:47 smithi076 ceph-mon[35401]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:47.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:47 smithi040 ceph-mon[32397]: pgmap v486: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:47.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:47 smithi040 ceph-mon[32397]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:47 smithi146 ceph-mon[35807]: pgmap v486: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:47 smithi146 ceph-mon[35807]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:49.226 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:49 smithi040 ceph-mon[32397]: pgmap v487: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:49.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 -- 172.21.15.40:0/437731951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 msgr2=0x7f395c10b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 --2- 172.21.15.40:0/437731951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c10b370 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3954009900 tx=0x7f395402a480 comp rx=0 tx=0).stop 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 -- 172.21.15.40:0/437731951 shutdown_connections 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 --2- 172.21.15.40:0/437731951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c10b370 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 --2- 172.21.15.40:0/437731951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f395c104030 0x7f395c104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 --2- 172.21.15.40:0/437731951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f395c102fa0 0x7f395c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 -- 172.21.15.40:0/437731951 >> 172.21.15.40:0/437731951 conn(0x7f395c0fe8f0 msgr2=0x7f395c100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 -- 172.21.15.40:0/437731951 shutdown_connections 2024-07-26T12:21:49.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.541+0000 7f3961c00640 1 -- 172.21.15.40:0/437731951 wait complete. 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.542+0000 7f3961c00640 1 Processor -- start 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 -- start start 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f395c102fa0 0x7f395c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f395c104030 0x7f395c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f395c10eb00 con 0x7f395c1049d0 2024-07-26T12:21:49.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f395c10e980 con 0x7f395c104030 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f395c10ec80 con 0x7f395c102fa0 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c19cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47474/0 (socket says 172.21.15.40:47474) 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.543+0000 7f3961200640 1 -- 172.21.15.40:0/2394036631 learned_addr learned my addr 172.21.15.40:0/2394036631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f395be00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f395c102fa0 0x7f395c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f3953400640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f395c104030 0x7f395c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f3961200640 1 -- 172.21.15.40:0/2394036631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f395c102fa0 msgr2=0x7f395c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f3961200640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f395c102fa0 0x7f395c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f3961200640 1 -- 172.21.15.40:0/2394036631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f395c104030 msgr2=0x7f395c19bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f3961200640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f395c104030 0x7f395c19bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.544+0000 7f3961200640 1 -- 172.21.15.40:0/2394036631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c19d290 con 0x7f395c1049d0 2024-07-26T12:21:49.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.545+0000 7f3961200640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c19cb00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f395402aa70 tx=0x7f3954003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:49.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.545+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395403f070 con 0x7f395c1049d0 2024-07-26T12:21:49.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.545+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3954031b90 con 0x7f395c1049d0 2024-07-26T12:21:49.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.545+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c19d520 con 0x7f395c1049d0 2024-07-26T12:21:49.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.545+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954035030 con 0x7f395c1049d0 2024-07-26T12:21:49.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.545+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c1a3b40 con 0x7f395c1049d0 2024-07-26T12:21:49.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.547+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c1a3d70 con 0x7f395c1049d0 2024-07-26T12:21:49.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.549+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3954042070 con 0x7f395c1049d0 2024-07-26T12:21:49.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.551+0000 7f3959600640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39400b3c50 0x7f39400b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:49.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.551+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f39541048c0 con 0x7f395c1049d0 2024-07-26T12:21:49.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.551+0000 7f395be00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39400b3c50 0x7f39400b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:49.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.552+0000 7f395be00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39400b3c50 0x7f39400b6160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f394c005c40 tx=0x7f394c00a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.558+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f39540cbed0 con 0x7f395c1049d0 2024-07-26T12:21:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:49 smithi146 ceph-mon[35807]: pgmap v487: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:49 smithi076 ceph-mon[35401]: pgmap v487: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:49.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.772+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f395c076740 con 0x7f39400b3c50 2024-07-26T12:21:49.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.775+0000 7f3959600640 1 -- 172.21.15.40:0/2394036631 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f395c076740 con 0x7f39400b3c50 2024-07-26T12:21:49.777 INFO:teuthology.orchestra.run.smithi040.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-07-26T12:21:49.778 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009J400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-07-26T12:21:49.778 INFO:teuthology.orchestra.run.smithi040.stdout:smithi076 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400U4400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-07-26T12:21:49.778 INFO:teuthology.orchestra.run.smithi040.stdout:smithi146 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GB400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-07-26T12:21:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39400b3c50 msgr2=0x7f39400b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39400b3c50 0x7f39400b6160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f394c005c40 tx=0x7f394c00a590 comp rx=0 tx=0).stop 2024-07-26T12:21:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 msgr2=0x7f395c19cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c19cb00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f395402aa70 tx=0x7f3954003c00 comp rx=0 tx=0).stop 2024-07-26T12:21:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 shutdown_connections 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f395c1049d0 0x7f395c19cb00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f395c104030 0x7f395c19bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39400b3c50 0x7f39400b6160 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 --2- 172.21.15.40:0/2394036631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f395c102fa0 0x7f395c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.778+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 >> 172.21.15.40:0/2394036631 conn(0x7f395c0fe8f0 msgr2=0x7f395c075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.779+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 shutdown_connections 2024-07-26T12:21:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:49.779+0000 7f3961c00640 1 -- 172.21.15.40:0/2394036631 wait complete. 2024-07-26T12:21:50.463 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:21:50.539 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-07-26T12:21:50.549 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-07-26T12:21:50.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph fs dump' 2024-07-26T12:21:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:21:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:21:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:51 smithi040 ceph-mon[32397]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:51 smithi040 ceph-mon[32397]: pgmap v488: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:21:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:21:51.462 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:21:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:51 smithi146 ceph-mon[35807]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:51 smithi146 ceph-mon[35807]: pgmap v488: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:21:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:21:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:21:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:51 smithi076 ceph-mon[35401]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-07-26T12:21:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:51 smithi076 ceph-mon[35401]: pgmap v488: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:21:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:21:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:21:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 -- 172.21.15.40:0/2832727008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a0106c10 msgr2=0x7f95a010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2832727008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a0106c10 0x7f95a010d5b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9598009ca0 tx=0x7f959802a950 comp rx=0 tx=0).stop 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 -- 172.21.15.40:0/2832727008 shutdown_connections 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2832727008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a0106c10 0x7f95a010d5b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2832727008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106270 0x7f95a0106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2832727008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95a01051e0 0x7f95a0105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.130+0000 7f95a5c00640 1 -- 172.21.15.40:0/2832727008 >> 172.21.15.40:0/2832727008 conn(0x7f95a0100b50 msgr2=0x7f95a0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.131+0000 7f95a5c00640 1 -- 172.21.15.40:0/2832727008 shutdown_connections 2024-07-26T12:21:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.131+0000 7f95a5c00640 1 -- 172.21.15.40:0/2832727008 wait complete. 2024-07-26T12:21:53.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 Processor -- start 2024-07-26T12:21:53.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 -- start start 2024-07-26T12:21:53.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 0x7f95a019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:53.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95a0106270 0x7f95a019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106c10 0x7f95a019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0110cf0 con 0x7f95a01051e0 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0110b70 con 0x7f95a0106270 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.132+0000 7f95a5c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0110e70 con 0x7f95a0106c10 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 0x7f95a019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 0x7f95a019b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48192/0 (socket says 172.21.15.40:48192) 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 -- 172.21.15.40:0/2292068155 learned_addr learned my addr 172.21.15.40:0/2292068155 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959f400640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95a0106270 0x7f95a019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f95a5200640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106c10 0x7f95a019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 -- 172.21.15.40:0/2292068155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106c10 msgr2=0x7f95a019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106c10 0x7f95a019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 -- 172.21.15.40:0/2292068155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95a0106270 msgr2=0x7f95a019bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95a0106270 0x7f95a019bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f959fe00640 1 -- 172.21.15.40:0/2292068155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a019d330 con 0x7f95a01051e0 2024-07-26T12:21:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.133+0000 7f95a5200640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106c10 0x7f95a019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:21:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.134+0000 7f959fe00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 0x7f95a019b900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f959000d950 tx=0x7f959000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.134+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590017070 con 0x7f95a01051e0 2024-07-26T12:21:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.134+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9590009c30 con 0x7f95a01051e0 2024-07-26T12:21:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.134+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a019d620 con 0x7f95a01051e0 2024-07-26T12:21:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.134+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959000f620 con 0x7f95a01051e0 2024-07-26T12:21:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.134+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a3d20 con 0x7f95a01051e0 2024-07-26T12:21:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.135+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0105650 con 0x7f95a01051e0 2024-07-26T12:21:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.138+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9590010460 con 0x7f95a01051e0 2024-07-26T12:21:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.139+0000 7f959cc00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95840b3bd0 0x7f95840b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.140+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f95900e3920 con 0x7f95a01051e0 2024-07-26T12:21:53.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.140+0000 7f959f400640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95840b3bd0 0x7f95840b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:53.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.141+0000 7f959f400640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95840b3bd0 0x7f95840b60e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f958c005fd0 tx=0x7f958c005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:53.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.142+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f95900aaf30 con 0x7f95a01051e0 2024-07-26T12:21:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:53 smithi040 ceph-mon[32397]: pgmap v489: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.388+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f95a002e0c0 con 0x7f95a01051e0 2024-07-26T12:21:53.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.389+0000 7f959cc00640 1 -- 172.21.15.40:0/2292068155 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3130 (secure 0 0 0) 0x7f95900b3020 con 0x7f95a01051e0 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:e28 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:btime 2024-07-26T12:18:56:044354+0000 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:legacy client fscid: 1 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:Filesystem 'cephfs' (1) 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:fs_name cephfs 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 28 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-07-26T12:21:53.393 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-07-26T12:18:32.339754+0000 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:modified 2024-07-26T12:18:55.823664+0000 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:tableserver 0 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:root 0 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:session_timeout 300 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:session_autoclose 300 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:max_file_size 1099511627776 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:max_xattr_size 65536 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:required_client_features {} 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:last_failure 0 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:last_failure_osd_epoch 0 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-07-26T12:21:53.394 INFO:teuthology.orchestra.run.smithi040.stdout:max_mds 5 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:in 0,1,2,3,4 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:up {0=34631,1=34592,2=34547,3=24610,4=24592} 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:failed 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:damaged 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:stopped 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:data_pools [3] 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:metadata_pool 2 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:inline_data disabled 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:balancer 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:bal_rank_mask -1 2024-07-26T12:21:53.395 INFO:teuthology.orchestra.run.smithi040.stdout:standby_count_wanted 0 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:qdb_cluster leader: 34631 members: 24592,24610,34547,34592,34631 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b{0:34631} state up:active seq 7 addr [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.f{0:24586} state up:standby-replay seq 1 addr [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.h{1:34592} state up:active seq 15 addr [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.l{1:24547} state up:standby-replay seq 1 addr [v2:172.21.15.146:6832/1448706156,v1:172.21.15.146:6833/1448706156] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.k{2:34547} state up:active seq 21 addr [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a{2:14727} state up:standby-replay seq 1 addr [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.i{3:24610} state up:active seq 14 addr [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.g{3:14715} state up:standby-replay seq 1 addr [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c{4:24592} state up:active seq 16 addr [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.e{4:14673} state up:standby-replay seq 1 addr [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:Standby daemons: 2024-07-26T12:21:53.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:21:53.397 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.j{-1:14655} state up:standby seq 1 addr [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.397 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d{-1:14661} state up:standby seq 1 addr [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] compat {c=[1],r=[1],i=[1fff]}] 2024-07-26T12:21:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.393+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95840b3bd0 msgr2=0x7f95840b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.393+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95840b3bd0 0x7f95840b60e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f958c005fd0 tx=0x7f958c005e20 comp rx=0 tx=0).stop 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.393+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 msgr2=0x7f95a019b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.393+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 0x7f95a019b900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f959000d950 tx=0x7f959000de10 comp rx=0 tx=0).stop 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 shutdown_connections 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95840b3bd0 0x7f95840b60e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95a0106c10 0x7f95a019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95a0106270 0x7f95a019bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 --2- 172.21.15.40:0/2292068155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a01051e0 0x7f95a019b900 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 >> 172.21.15.40:0/2292068155 conn(0x7f95a0100b50 msgr2=0x7f95a0109590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 shutdown_connections 2024-07-26T12:21:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:53.394+0000 7f95a5c00640 1 -- 172.21.15.40:0/2292068155 wait complete. 2024-07-26T12:21:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:53 smithi146 ceph-mon[35807]: pgmap v489: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:53 smithi076 ceph-mon[35401]: pgmap v489: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:21:54.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- bash -c 'ceph osd dump' 2024-07-26T12:21:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:54 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2292068155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-26T12:21:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:54 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2292068155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-26T12:21:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:54 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2292068155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-07-26T12:21:54.798 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:55 smithi040 ceph-mon[32397]: pgmap v490: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:55 smithi146 ceph-mon[35807]: pgmap v490: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:55 smithi076 ceph-mon[35401]: pgmap v490: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:21:56.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 -- 172.21.15.40:0/1717170378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106c00 msgr2=0x7fcf8010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:56.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/1717170378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106c00 0x7fcf8010d5a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ca0 tx=0x7fcf7802a950 comp rx=0 tx=0).stop 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 -- 172.21.15.40:0/1717170378 shutdown_connections 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/1717170378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106c00 0x7fcf8010d5a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/1717170378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80106260 0x7fcf80106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/1717170378 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf801051d0 0x7fcf80105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 -- 172.21.15.40:0/1717170378 >> 172.21.15.40:0/1717170378 conn(0x7fcf80100b60 msgr2=0x7fcf80102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 -- 172.21.15.40:0/1717170378 shutdown_connections 2024-07-26T12:21:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.851+0000 7fcf7fe00640 1 -- 172.21.15.40:0/1717170378 wait complete. 2024-07-26T12:21:56.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 Processor -- start 2024-07-26T12:21:56.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 -- start start 2024-07-26T12:21:56.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf801051d0 0x7fcf8019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 0x7fcf8019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80106c00 0x7fcf8019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80110d30 con 0x7fcf80106260 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80110bb0 con 0x7fcf80106c00 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.853+0000 7fcf7fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80110eb0 con 0x7fcf801051d0 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 0x7fcf8019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 0x7fcf8019bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48206/0 (socket says 172.21.15.40:48206) 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 -- 172.21.15.40:0/4160637706 learned_addr learned my addr 172.21.15.40:0/4160637706 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf7ea00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf801051d0 0x7fcf8019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf7f400640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80106c00 0x7fcf8019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 -- 172.21.15.40:0/4160637706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf801051d0 msgr2=0x7fcf8019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf801051d0 0x7fcf8019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 -- 172.21.15.40:0/4160637706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80106c00 msgr2=0x7fcf8019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80106c00 0x7fcf8019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf77e00640 1 -- 172.21.15.40:0/4160637706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8019d330 con 0x7fcf80106260 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf7ea00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf801051d0 0x7fcf8019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.854+0000 7fcf7f400640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80106c00 0x7fcf8019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.855+0000 7fcf77e00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 0x7fcf8019bf70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800d770 tx=0x7fcf6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.855+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68017070 con 0x7fcf80106260 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.855+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf680054b0 con 0x7fcf80106260 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.855+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8019d620 con 0x7fcf80106260 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.855+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68004c60 con 0x7fcf80106260 2024-07-26T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.855+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf801a3d20 con 0x7fcf80106260 2024-07-26T12:21:56.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.856+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8010c3b0 con 0x7fcf80106260 2024-07-26T12:21:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.859+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcf68004e00 con 0x7fcf80106260 2024-07-26T12:21:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.861+0000 7fcf77400640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c50 0x7fcf640b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:21:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.861+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf680e3b00 con 0x7fcf80106260 2024-07-26T12:21:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.861+0000 7fcf7ea00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c50 0x7fcf640b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:21:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.862+0000 7fcf7ea00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c50 0x7fcf640b6160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf700058c0 tx=0x7fcf70005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:21:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:56.862+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcf680ab190 con 0x7fcf80106260 2024-07-26T12:21:57.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.069+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fcf8002e0c0 con 0x7fcf80106260 2024-07-26T12:21:57.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.072+0000 7fcf77400640 1 -- 172.21.15.40:0/4160637706 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5293 (secure 0 0 0) 0x7fcf680a6030 con 0x7fcf80106260 2024-07-26T12:21:57.075 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 82 2024-07-26T12:21:57.075 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 2024-07-26T12:21:57.075 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-07-26T12:07:00.241568+0000 2024-07-26T12:21:57.075 INFO:teuthology.orchestra.run.smithi040.stdout:modified 2024-07-26T12:18:59.075766+0000 2024-07-26T12:21:57.075 INFO:teuthology.orchestra.run.smithi040.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:crush_version 26 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:full_ratio 0.95 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:backfillfull_ratio 0.9 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:nearfull_ratio 0.85 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:require_min_compat_client luminous 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:min_compat_client luminous 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:require_osd_release squid 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:stretch_mode_enabled false 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-07-26T12:21:57.076 INFO:teuthology.orchestra.run.smithi040.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:max_osd 12 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6802/336845656,v1:172.21.15.40:6803/336845656] [v2:172.21.15.40:6804/336845656,v1:172.21.15.40:6805/336845656] exists,up 14d626d5-0f5f-47dc-b24b-2ff59d022831 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6800/1858622261,v1:172.21.15.76:6801/1858622261] [v2:172.21.15.76:6802/1858622261,v1:172.21.15.76:6803/1858622261] exists,up 9ed50fe4-e7fc-48ce-823b-7d210178101e 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/2643488432,v1:172.21.15.146:6801/2643488432] [v2:172.21.15.146:6802/2643488432,v1:172.21.15.146:6803/2643488432] exists,up 5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 up in weight 1 up_from 25 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6810/2975278630,v1:172.21.15.40:6811/2975278630] [v2:172.21.15.40:6812/2975278630,v1:172.21.15.40:6813/2975278630] exists,up 9c225bd9-ee30-4bd3-b280-3237a9e899d5 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 up in weight 1 up_from 31 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6808/3287530832,v1:172.21.15.76:6809/3287530832] [v2:172.21.15.76:6810/3287530832,v1:172.21.15.76:6811/3287530832] exists,up fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 up in weight 1 up_from 37 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6808/371932906,v1:172.21.15.146:6809/371932906] [v2:172.21.15.146:6810/371932906,v1:172.21.15.146:6811/371932906] exists,up 80c9a4cc-0633-4e04-ace3-ed165c2d9bbf 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6818/692210835,v1:172.21.15.40:6819/692210835] [v2:172.21.15.40:6820/692210835,v1:172.21.15.40:6821/692210835] exists,up c801bf68-146c-40f3-98f0-adda7821387a 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 up in weight 1 up_from 49 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6816/2514797564,v1:172.21.15.76:6817/2514797564] [v2:172.21.15.76:6818/2514797564,v1:172.21.15.76:6819/2514797564] exists,up 283de83d-e151-4f9f-b313-0a2e51d169e8 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.8 up in weight 1 up_from 55 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6816/1134579636,v1:172.21.15.146:6817/1134579636] [v2:172.21.15.146:6818/1134579636,v1:172.21.15.146:6819/1134579636] exists,up f180ffe2-9657-4515-8808-52eee7840f25 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.9 up in weight 1 up_from 61 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6826/2884827145,v1:172.21.15.40:6827/2884827145] [v2:172.21.15.40:6828/2884827145,v1:172.21.15.40:6829/2884827145] exists,up 4acc2a16-b98d-4c67-83bd-c74f1f1cede0 2024-07-26T12:21:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:osd.10 up in weight 1 up_from 66 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6824/2195493855,v1:172.21.15.76:6825/2195493855] [v2:172.21.15.76:6826/2195493855,v1:172.21.15.76:6827/2195493855] exists,up 910c7cc4-df9b-40ed-8b38-4b7205cdeda2 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:osd.11 up in weight 1 up_from 72 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6824/2525193294,v1:172.21.15.146:6825/2525193294] [v2:172.21.15.146:6826/2525193294,v1:172.21.15.146:6827/2525193294] exists,up 722e9e08-a8ec-4d70-84c2-8bb189f05095 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.b [8,11] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.e [2,4] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.14 [2,4] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.1f [7,11] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.3 [4,9] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.14 [4,6] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.29 [3,9] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.37 [5,8] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.3c [4,9] 2024-07-26T12:21:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6800/3749083887 expires 2024-07-27T12:07:57.642554+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/1334877414 expires 2024-07-27T12:07:57.642554+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/1764700986 expires 2024-07-27T12:07:57.642554+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/18542135 expires 2024-07-27T12:07:57.642554+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/2030256837 expires 2024-07-27T12:07:27.399390+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6801/3749083887 expires 2024-07-27T12:07:57.642554+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6800/2685729470 expires 2024-07-27T12:07:27.399390+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/1883279801 expires 2024-07-27T12:07:27.399390+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6801/2685729470 expires 2024-07-27T12:07:27.399390+0000 2024-07-26T12:21:57.079 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/3266304279 expires 2024-07-27T12:07:27.399390+0000 2024-07-26T12:21:57.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.075+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c50 msgr2=0x7fcf640b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:57.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.075+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c50 0x7fcf640b6160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf700058c0 tx=0x7fcf70005850 comp rx=0 tx=0).stop 2024-07-26T12:21:57.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.075+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 msgr2=0x7fcf8019bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:21:57.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.075+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 0x7fcf8019bf70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800d770 tx=0x7fcf6800dc30 comp rx=0 tx=0).stop 2024-07-26T12:21:57.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.075+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 shutdown_connections 2024-07-26T12:21:57.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.075+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80106c00 0x7fcf8019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:57.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.076+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80106260 0x7fcf8019bf70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:57.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.076+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c50 0x7fcf640b6160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:57.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.076+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4160637706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf801051d0 0x7fcf8019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:21:57.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.076+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 >> 172.21.15.40:0/4160637706 conn(0x7fcf80100b60 msgr2=0x7fcf80109580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:21:57.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.076+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 shutdown_connections 2024-07-26T12:21:57.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:21:57.076+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4160637706 wait complete. 2024-07-26T12:21:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:57 smithi040 ceph-mon[32397]: pgmap v491: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:57 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4160637706' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-26T12:21:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:57 smithi146 ceph-mon[35807]: pgmap v491: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:57 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4160637706' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-26T12:21:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:57 smithi076 ceph-mon[35401]: pgmap v491: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:21:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:57 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4160637706' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-07-26T12:21:57.886 INFO:teuthology.run_tasks:Running task fs.ready... 2024-07-26T12:21:57.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:21:58.376 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:21:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:21:59 smithi040 ceph-mon[32397]: pgmap v492: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:21:59 smithi146 ceph-mon[35807]: pgmap v492: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:21:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:21:59 smithi076 ceph-mon[35401]: pgmap v492: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:00.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 -- 172.21.15.40:0/3919425757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 msgr2=0x7f3ab4112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/3919425757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab4112270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009ca0 tx=0x7f3aac02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 -- 172.21.15.40:0/3919425757 shutdown_connections 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/3919425757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab4112270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/3919425757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab410b0f0 0x7f3ab410b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/3919425757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab41057b0 0x7f3ab4105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 -- 172.21.15.40:0/3919425757 >> 172.21.15.40:0/3919425757 conn(0x7f3ab4101240 msgr2=0x7f3ab4103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.470+0000 7f3ab9a00640 1 -- 172.21.15.40:0/3919425757 shutdown_connections 2024-07-26T12:22:00.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.471+0000 7f3ab9a00640 1 -- 172.21.15.40:0/3919425757 wait complete. 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 Processor -- start 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 -- start start 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab41057b0 0x7f3ab419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab410b0f0 0x7f3ab419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab41a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab41155f0 con 0x7f3ab410ba40 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab4115470 con 0x7f3ab410b0f0 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.472+0000 7f3ab9a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab4115770 con 0x7f3ab41057b0 2024-07-26T12:22:00.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab41a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab41a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48220/0 (socket says 172.21.15.40:48220) 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 -- 172.21.15.40:0/1343977877 learned_addr learned my addr 172.21.15.40:0/1343977877 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab2000640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab410b0f0 0x7f3ab419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab2a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab41057b0 0x7f3ab419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 -- 172.21.15.40:0/1343977877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab41057b0 msgr2=0x7f3ab419c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab41057b0 0x7f3ab419c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 -- 172.21.15.40:0/1343977877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab410b0f0 msgr2=0x7f3ab419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab410b0f0 0x7f3ab419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab3400640 1 -- 172.21.15.40:0/1343977877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab41a1fb0 con 0x7f3ab410ba40 2024-07-26T12:22:00.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.473+0000 7f3ab2000640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab410b0f0 0x7f3ab419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:00.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.474+0000 7f3ab3400640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab41a1880 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3aac005cc0 tx=0x7f3aac032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:00.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.474+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac032e00 con 0x7f3ab410ba40 2024-07-26T12:22:00.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.474+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3aac0044d0 con 0x7f3ab410ba40 2024-07-26T12:22:00.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.474+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac030b70 con 0x7f3ab410ba40 2024-07-26T12:22:00.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.474+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab41a2240 con 0x7f3ab410ba40 2024-07-26T12:22:00.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.474+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab41a8a00 con 0x7f3ab410ba40 2024-07-26T12:22:00.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.475+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab4106a30 con 0x7f3ab410ba40 2024-07-26T12:22:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.478+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3aac030d10 con 0x7f3ab410ba40 2024-07-26T12:22:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.480+0000 7f3aab400640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a980b3c50 0x7f3a980b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.480+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3aac105310 con 0x7f3ab410ba40 2024-07-26T12:22:00.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.480+0000 7f3ab2a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a980b3c50 0x7f3a980b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:00.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.481+0000 7f3ab2a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a980b3c50 0x7f3a980b6160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4005fd0 tx=0x7f3aa4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:00.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.482+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3aac0cc920 con 0x7f3ab410ba40 2024-07-26T12:22:00.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.723+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ab4105bc0 con 0x7f3ab410ba40 2024-07-26T12:22:00.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.725+0000 7f3aab400640 1 -- 172.21.15.40:0/1343977877 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f3ab4105bc0 con 0x7f3ab410ba40 2024-07-26T12:22:00.727 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:00.727 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"btime":"2024-07-26T12:18:56:044354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:18:55.823664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:22:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:22:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.727+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a980b3c50 msgr2=0x7f3a980b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.727+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a980b3c50 0x7f3a980b6160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4005fd0 tx=0x7f3aa4005850 comp rx=0 tx=0).stop 2024-07-26T12:22:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.727+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 msgr2=0x7f3ab41a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.727+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab41a1880 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3aac005cc0 tx=0x7f3aac032a10 comp rx=0 tx=0).stop 2024-07-26T12:22:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 shutdown_connections 2024-07-26T12:22:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ab410ba40 0x7f3ab41a1880 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ab410b0f0 0x7f3ab419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a980b3c50 0x7f3a980b6160 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 --2- 172.21.15.40:0/1343977877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab41057b0 0x7f3ab419c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 >> 172.21.15.40:0/1343977877 conn(0x7f3ab4101240 msgr2=0x7f3ab410a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 shutdown_connections 2024-07-26T12:22:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:00.728+0000 7f3ab9a00640 1 -- 172.21.15.40:0/1343977877 wait complete. 2024-07-26T12:22:01.450 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:01 smithi040 ceph-mon[32397]: pgmap v493: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:01.450 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:01 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1343977877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:01.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:22:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:01 smithi146 ceph-mon[35807]: pgmap v493: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:01 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1343977877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:01 smithi076 ceph-mon[35401]: pgmap v493: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:01 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1343977877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:03 smithi040 ceph-mon[32397]: pgmap v494: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:03 smithi146 ceph-mon[35807]: pgmap v494: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:03 smithi076 ceph-mon[35401]: pgmap v494: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 -- 172.21.15.40:0/2482483461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f1010ba70 msgr2=0x7f8f101122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 --2- 172.21.15.40:0/2482483461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f1010ba70 0x7f8f101122a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009ca0 tx=0x7f8f0802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 -- 172.21.15.40:0/2482483461 shutdown_connections 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 --2- 172.21.15.40:0/2482483461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f1010ba70 0x7f8f101122a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 --2- 172.21.15.40:0/2482483461 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f1010b120 0x7f8f1010b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 --2- 172.21.15.40:0/2482483461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f101057e0 0x7f8f10105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 -- 172.21.15.40:0/2482483461 >> 172.21.15.40:0/2482483461 conn(0x7f8f101011f0 msgr2=0x7f8f10103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 -- 172.21.15.40:0/2482483461 shutdown_connections 2024-07-26T12:22:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.103+0000 7f8f16000640 1 -- 172.21.15.40:0/2482483461 wait complete. 2024-07-26T12:22:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.105+0000 7f8f16000640 1 Processor -- start 2024-07-26T12:22:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.105+0000 7f8f16000640 1 -- start start 2024-07-26T12:22:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f16000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 0x7f8f1019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f16000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f1010b120 0x7f8f1019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f16000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f1010ba70 0x7f8f101a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f16000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10115690 con 0x7f8f101057e0 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f16000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10115510 con 0x7f8f1010ba70 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f16000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10115810 con 0x7f8f1010b120 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f0f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 0x7f8f1019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f0f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 0x7f8f1019c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57054/0 (socket says 172.21.15.40:57054) 2024-07-26T12:22:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f0f400640 1 -- 172.21.15.40:0/2417916780 learned_addr learned my addr 172.21.15.40:0/2417916780 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f0fe00640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f1010ba70 0x7f8f101a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.106+0000 7f8f0ea00640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f1010b120 0x7f8f1019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0f400640 1 -- 172.21.15.40:0/2417916780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f1010b120 msgr2=0x7f8f1019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0f400640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f1010b120 0x7f8f1019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0f400640 1 -- 172.21.15.40:0/2417916780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f1010ba70 msgr2=0x7f8f101a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0f400640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f1010ba70 0x7f8f101a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0f400640 1 -- 172.21.15.40:0/2417916780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f101a1f70 con 0x7f8f101057e0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0ea00640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f1010b120 0x7f8f1019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.107+0000 7f8f0f400640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 0x7f8f1019c000 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b4a0 tx=0x7f8f0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.108+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00014070 con 0x7f8f101057e0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.108+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f00010aa0 con 0x7f8f101057e0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.108+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00017b70 con 0x7f8f101057e0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.108+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f101a2260 con 0x7f8f101057e0 2024-07-26T12:22:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.108+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f101a89c0 con 0x7f8f101057e0 2024-07-26T12:22:04.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.109+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f10105bf0 con 0x7f8f101057e0 2024-07-26T12:22:04.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.112+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8f00017070 con 0x7f8f101057e0 2024-07-26T12:22:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.114+0000 7f8f07e00640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ef40b3bd0 0x7f8ef40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.114+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8f000e3480 con 0x7f8f101057e0 2024-07-26T12:22:04.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.114+0000 7f8f0ea00640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ef40b3bd0 0x7f8ef40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:04.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.115+0000 7f8f0ea00640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ef40b3bd0 0x7f8ef40b60e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f10103a90 tx=0x7f8efc005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.116+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8f000aaa90 con 0x7f8f101057e0 2024-07-26T12:22:04.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.366+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f1019d130 con 0x7f8f101057e0 2024-07-26T12:22:04.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.368+0000 7f8f07e00640 1 -- 172.21.15.40:0/2417916780 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f8f1019d130 con 0x7f8f101057e0 2024-07-26T12:22:04.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:04.371 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"btime":"2024-07-26T12:18:56:044354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:18:55.823664+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:22:04.371 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 28 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ef40b3bd0 msgr2=0x7f8ef40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ef40b3bd0 0x7f8ef40b60e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f10103a90 tx=0x7f8efc005ec0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 msgr2=0x7f8f1019c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 0x7f8f1019c000 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b4a0 tx=0x7f8f0000b960 comp rx=0 tx=0).stop 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 shutdown_connections 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f1010ba70 0x7f8f101a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8ef40b3bd0 0x7f8ef40b60e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f1010b120 0x7f8f1019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 --2- 172.21.15.40:0/2417916780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f101057e0 0x7f8f1019c000 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 >> 172.21.15.40:0/2417916780 conn(0x7f8f101011f0 msgr2=0x7f8f10104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 shutdown_connections 2024-07-26T12:22:04.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:04.371+0000 7f8f16000640 1 -- 172.21.15.40:0/2417916780 wait complete. 2024-07-26T12:22:05.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:22:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:05 smithi040 ceph-mon[32397]: pgmap v495: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:05 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2417916780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:05 smithi146 ceph-mon[35807]: pgmap v495: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:05 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2417916780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:05 smithi076 ceph-mon[35401]: pgmap v495: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:05 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2417916780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:07.318 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:07 smithi040 ceph-mon[32397]: pgmap v496: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:07 smithi146 ceph-mon[35807]: pgmap v496: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:07 smithi076 ceph-mon[35401]: pgmap v496: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:07.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 -- 172.21.15.40:0/1147117600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 msgr2=0x7f87241164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:07.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 --2- 172.21.15.40:0/1147117600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241164b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ca0 tx=0x7f871c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 -- 172.21.15.40:0/1147117600 shutdown_connections 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 --2- 172.21.15.40:0/1147117600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241164b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 --2- 172.21.15.40:0/1147117600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f872410f330 0x7f872410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 --2- 172.21.15.40:0/1147117600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87241099f0 0x7f8724109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 -- 172.21.15.40:0/1147117600 >> 172.21.15.40:0/1147117600 conn(0x7f8724078ff0 msgr2=0x7f8724107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 -- 172.21.15.40:0/1147117600 shutdown_connections 2024-07-26T12:22:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.870+0000 7f8723e00640 1 -- 172.21.15.40:0/1147117600 wait complete. 2024-07-26T12:22:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.871+0000 7f8723e00640 1 Processor -- start 2024-07-26T12:22:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.871+0000 7f8723e00640 1 -- start start 2024-07-26T12:22:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87241099f0 0x7f87241a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872410f330 0x7f87241a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8724119840 con 0x7f872410fc80 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f87241196c0 con 0x7f87241099f0 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87241199c0 con 0x7f872410f330 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57082/0 (socket says 172.21.15.40:57082) 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8723400640 1 -- 172.21.15.40:0/4221022224 learned_addr learned my addr 172.21.15.40:0/4221022224 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f8722a00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87241099f0 0x7f87241a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.872+0000 7f871a000640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872410f330 0x7f87241a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723400640 1 -- 172.21.15.40:0/4221022224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872410f330 msgr2=0x7f87241a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723400640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872410f330 0x7f87241a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723400640 1 -- 172.21.15.40:0/4221022224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87241099f0 msgr2=0x7f87241a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723400640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87241099f0 0x7f87241a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723400640 1 -- 172.21.15.40:0/4221022224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87241a6120 con 0x7f872410fc80 2024-07-26T12:22:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723400640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241a59f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f871c031040 tx=0x7f871c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004040 con 0x7f872410fc80 2024-07-26T12:22:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f871c004670 con 0x7f872410fc80 2024-07-26T12:22:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87241a63b0 con 0x7f872410fc80 2024-07-26T12:22:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.873+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c030bb0 con 0x7f872410fc80 2024-07-26T12:22:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.874+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87241acb70 con 0x7f872410fc80 2024-07-26T12:22:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.875+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8724109e00 con 0x7f872410fc80 2024-07-26T12:22:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.877+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f871c0041e0 con 0x7f872410fc80 2024-07-26T12:22:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.879+0000 7f871be00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87080b3bd0 0x7f87080b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.879+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f871c105100 con 0x7f872410fc80 2024-07-26T12:22:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.879+0000 7f8722a00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87080b3bd0 0x7f87080b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.880+0000 7f8722a00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87080b3bd0 0x7f87080b60e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8714005fd0 tx=0x7f8714005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:07.883+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f871c0cc750 con 0x7f872410fc80 2024-07-26T12:22:08.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.087+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8724111ad0 con 0x7f872410fc80 2024-07-26T12:22:08.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.089+0000 7f871be00640 1 -- 172.21.15.40:0/4221022224 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7f871c0cc050 con 0x7f872410fc80 2024-07-26T12:22:08.092 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:08.092 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:59.075766+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.092+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87080b3bd0 msgr2=0x7f87080b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87080b3bd0 0x7f87080b60e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8714005fd0 tx=0x7f8714005850 comp rx=0 tx=0).stop 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 msgr2=0x7f87241a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241a59f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f871c031040 tx=0x7f871c032bc0 comp rx=0 tx=0).stop 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 shutdown_connections 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f872410fc80 0x7f87241a59f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87080b3bd0 0x7f87080b60e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872410f330 0x7f87241a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 --2- 172.21.15.40:0/4221022224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87241099f0 0x7f87241a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:08.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 >> 172.21.15.40:0/4221022224 conn(0x7f8724078ff0 msgr2=0x7f8724079670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:08.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 shutdown_connections 2024-07-26T12:22:08.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:08.093+0000 7f8723e00640 1 -- 172.21.15.40:0/4221022224 wait complete. 2024-07-26T12:22:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:08 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4221022224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:22:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:08 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4221022224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:22:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4221022224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:22:08.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-26T12:18:32.339754+0000', 'modified': '2024-07-26T12:18:55.823664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34631, 'mds_1': 34592, 'mds_2': 34547, 'mds_3': 24610, 'mds_4': 24592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14673': {'gid': 14673, 'name': 'e', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.76:6835/3482143239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6834', 'nonce': 3482143239}, {'type': 'v1', 'addr': '172.21.15.76:6835', 'nonce': 3482143239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14715': {'gid': 14715, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.40:6839/694136309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6838', 'nonce': 694136309}, {'type': 'v1', 'addr': '172.21.15.40:6839', 'nonce': 694136309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14727': {'gid': 14727, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.40:6841/3170726419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6840', 'nonce': 3170726419}, {'type': 'v1', 'addr': '172.21.15.40:6841', 'nonce': 3170726419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24547': {'gid': 24547, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/1448706156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1448706156}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1448706156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24586': {'gid': 24586, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/1374524390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 1374524390}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 1374524390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24592': {'gid': 24592, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.146:6837/3076436166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 3076436166}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 3076436166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'i', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.146:6839/4061759756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 4061759756}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 4061759756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34547': {'gid': 34547, 'name': 'k', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.76:6833/2744171288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6832', 'nonce': 2744171288}, {'type': 'v1', 'addr': '172.21.15.76:6833', 'nonce': 2744171288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34592': {'gid': 34592, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.76:6837/3327676602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6836', 'nonce': 3327676602}, {'type': 'v1', 'addr': '172.21.15.76:6837', 'nonce': 3327676602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34631': {'gid': 34631, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.76:6839/3866154018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6838', 'nonce': 3866154018}, {'type': 'v1', 'addr': '172.21.15.76:6839', 'nonce': 3866154018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34631, 'qdb_cluster': [24592, 24610, 34547, 34592, 34631]} 2024-07-26T12:22:08.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-07-26T12:22:08.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.c status 2024-07-26T12:22:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:09 smithi040 ceph-mon[32397]: pgmap v497: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:09 smithi146 ceph-mon[35807]: pgmap v497: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:09 smithi076 ceph-mon[35401]: pgmap v497: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:11.411 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:11 smithi040 ceph-mon[32397]: pgmap v498: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:11 smithi146 ceph-mon[35807]: pgmap v498: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:11 smithi076 ceph-mon[35401]: pgmap v498: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:11.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 -- 172.21.15.40:0/3403998909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c102960 msgr2=0x7f9a3c106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 --2- 172.21.15.40:0/3403998909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c102960 0x7f9a3c106e90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009cd0 tx=0x7f9a2402a8f0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 -- 172.21.15.40:0/3403998909 shutdown_connections 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 --2- 172.21.15.40:0/3403998909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a3c107450 0x7f9a3c107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 --2- 172.21.15.40:0/3403998909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c102960 0x7f9a3c106e90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 --2- 172.21.15.40:0/3403998909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c102010 0x7f9a3c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.622+0000 7f9a3b200640 1 -- 172.21.15.40:0/3403998909 >> 172.21.15.40:0/3403998909 conn(0x7f9a3c0fdd40 msgr2=0x7f9a3c100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.623+0000 7f9a3b200640 1 -- 172.21.15.40:0/3403998909 shutdown_connections 2024-07-26T12:22:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.623+0000 7f9a3b200640 1 -- 172.21.15.40:0/3403998909 wait complete. 2024-07-26T12:22:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.624+0000 7f9a3b200640 1 Processor -- start 2024-07-26T12:22:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.624+0000 7f9a3b200640 1 -- start start 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c102010 0x7f9a3c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a3c102960 0x7f9a3c1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 0x7f9a3c1a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c1197a0 con 0x7f9a3c107450 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c119620 con 0x7f9a3c102960 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c119920 con 0x7f9a3c102010 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 0x7f9a3c1a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 0x7f9a3c1a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57112/0 (socket says 172.21.15.40:57112) 2024-07-26T12:22:11.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.625+0000 7f9a3a800640 1 -- 172.21.15.40:0/2260026309 learned_addr learned my addr 172.21.15.40:0/2260026309 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a39400640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a3c102960 0x7f9a3c1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c102010 0x7f9a3c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a3a800640 1 -- 172.21.15.40:0/2260026309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c102010 msgr2=0x7f9a3c1a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c102010 0x7f9a3c1a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a3a800640 1 -- 172.21.15.40:0/2260026309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a3c102960 msgr2=0x7f9a3c1a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a3c102960 0x7f9a3c1a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.626+0000 7f9a3a800640 1 -- 172.21.15.40:0/2260026309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c1a62e0 con 0x7f9a3c107450 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.627+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 0x7f9a3c1a5bb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400d750 tx=0x7f9a3400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.627+0000 7f9a32a00640 1 -- 172.21.15.40:0/2260026309 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34017070 con 0x7f9a3c107450 2024-07-26T12:22:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.627+0000 7f9a32a00640 1 -- 172.21.15.40:0/2260026309 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a340054b0 con 0x7f9a3c107450 2024-07-26T12:22:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.627+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c1a65d0 con 0x7f9a3c107450 2024-07-26T12:22:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.627+0000 7f9a32a00640 1 -- 172.21.15.40:0/2260026309 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34004b90 con 0x7f9a3c107450 2024-07-26T12:22:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.627+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c1acd30 con 0x7f9a3c107450 2024-07-26T12:22:11.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.631+0000 7f9a47dfe740 1 Processor -- start 2024-07-26T12:22:11.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.631+0000 7f9a32a00640 1 -- 172.21.15.40:0/2260026309 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9a34004d30 con 0x7f9a3c107450 2024-07-26T12:22:11.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.631+0000 7f9a47dfe740 1 -- start start 2024-07-26T12:22:11.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.631+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccb8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.631+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccb8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccb9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f0ccc2e970 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f0ccc1de70 con 0x55f0cc912f60 2024-07-26T12:22:11.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0ccc21eb0 con 0x55f0cc8f2280 2024-07-26T12:22:11.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a39e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccb8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a39e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccb8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57126/0 (socket says 172.21.15.40:57126) 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a39e00640 1 -- 172.21.15.40:0/2991472727 learned_addr learned my addr 172.21.15.40:0/2991472727 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a39400640 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccb8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.632+0000 7f9a39400640 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccb9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a39e00640 1 -- 172.21.15.40:0/2991472727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 msgr2=0x55f0cccb9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccb9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a39e00640 1 -- 172.21.15.40:0/2991472727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 msgr2=0x55f0cccb8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccb8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a39e00640 1 -- 172.21.15.40:0/2991472727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0ccbc5110 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccb8cc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b760 tx=0x7f9a2c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2f864c2378823 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a32a00640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a1c0b3bd0 0x7f9a1c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a2b400640 1 -- 172.21.15.40:0/2991472727 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c003dd0 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a32a00640 1 -- 172.21.15.40:0/2260026309 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a340e3590 con 0x7f9a3c107450 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a2b400640 1 -- 172.21.15.40:0/2991472727 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a2c015070 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.633+0000 7f9a2b400640 1 -- 172.21.15.40:0/2991472727 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c004c90 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.634+0000 7f9a39400640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a1c0b3bd0 0x7f9a1c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2991472727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 msgr2=0x55f0cccb8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccb8cc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b760 tx=0x7f9a2c00bc20 comp rx=0 tx=0).stop 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a39400640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a1c0b3bd0 0x7f9a1c0b60e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009ca0 tx=0x7f9a24005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2991472727 shutdown_connections 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccb9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccb8cc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2991472727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccb8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2991472727 >> 172.21.15.40:0/2991472727 conn(0x55f0cc907350 msgr2=0x55f0cccb6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:11.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2991472727 shutdown_connections 2024-07-26T12:22:11.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.635+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2991472727 wait complete. 2024-07-26T12:22:11.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.636+0000 7f9a47dfe740 1 -- start start 2024-07-26T12:22:11.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.636+0000 7f9a47dfe740 1 Processor -- start 2024-07-26T12:22:11.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.636+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccc4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.636+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 0x55f0cccc4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.636+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccd02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f0cca815f0 con 0x55f0cc8f2280 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f0ccbba540 con 0x55f0cc912f60 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccc6f60 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a47dfe740 10 client.0 _ll_register_callbacks cb 0x55f0ccbc9f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 0x55f0cccc4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 0x55f0cccc4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57128/0 (socket says 172.21.15.40:57128) 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 -- 172.21.15.40:0/2601201922 learned_addr learned my addr 172.21.15.40:0/2601201922 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccc4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 -- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8ea0a0 msgr2=0x55f0cccc4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccc4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 -- 172.21.15.40:0/2601201922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 msgr2=0x55f0cccd02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccd02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccd02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39400640 1 -- 172.21.15.40:0/2601201922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0cc97e540 con 0x55f0cc8f2280 2024-07-26T12:22:11.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.637+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccc4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:11.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.638+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccd02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:22:11.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.638+0000 7f9a39400640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 0x55f0cccc4790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9a24035000 tx=0x7f9a2402a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2c77c0842638ac server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.638+0000 7f9a23e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.638+0000 7f9a23e00640 1 -- 172.21.15.40:0/2601201922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24004250 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.638+0000 7f9a23e00640 1 -- 172.21.15.40:0/2601201922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a240043f0 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.638+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a2c015070 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a23e00640 1 -- 172.21.15.40:0/2601201922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a240045f0 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 10 client.15237 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f0cccd2eb0 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a23e00640 1 -- 172.21.15.40:0/2601201922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a2c015070 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a23e00640 1 -- 172.21.15.40:0/2601201922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a24055b20 con 0x55f0cc8f2280 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 10 client.15237 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:11.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 10 client.15237 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 20 client.15237 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8d18e0 0x55f0cccd69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.639+0000 7f9a47dfe740 4 client.15237 mds_command: new command op to 24592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.640+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 --> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0ccc308c0 con 0x55f0cc8d18e0 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.640+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8d18e0 0x55f0cccd69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.641+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8d18e0 0x55f0cccd69b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5506569bd2283ae8 server_cookie=4e0c221dc4f84bae in_seq=0 out_seq=0 2024-07-26T12:22:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.641+0000 7f9a23e00640 10 client.15237 ms_handle_connect on v2:172.21.15.146:6836/3076436166 2024-07-26T12:22:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.643+0000 7f9a23e00640 1 -- 172.21.15.40:0/2601201922 <== mds.4 v2:172.21.15.146:6836/3076436166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0ccc308c0 con 0x55f0cc8d18e0 2024-07-26T12:22:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.643+0000 7f9a23e00640 10 client.15237 handle_command_reply: tid=0 2024-07-26T12:22:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.643+0000 7f9a47dfe740 1 client.15237 shutdown 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 msgr2=0x55f0cccc4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 0x55f0cccc4790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9a24035000 tx=0x7f9a2402a8f0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 shutdown_connections 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8d18e0 0x55f0cccd69b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc912f60 0x55f0cccd02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8f2280 0x55f0cccc4790 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2601201922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccc4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a23e00640 0 client.15237 ms_handle_reset on v2:172.21.15.146:6836/3076436166 2024-07-26T12:22:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 >> 172.21.15.40:0/2601201922 conn(0x55f0cc907350 msgr2=0x55f0cccbb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 shutdown_connections 2024-07-26T12:22:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2601201922 wait complete. 2024-07-26T12:22:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.644+0000 7f9a47dfe740 20 client.15237 trim_cache size 0 max 16384 2024-07-26T12:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.664+0000 7f9a47dfe740 1 Processor -- start 2024-07-26T12:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.664+0000 7f9a47dfe740 1 -- start start 2024-07-26T12:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.664+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.664+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8f2280 0x55f0cccc3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc912f60 0x55f0cccd0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccd4cf0 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccd53c0 con 0x55f0cc8f2280 2024-07-26T12:22:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccd5a90 con 0x55f0cc912f60 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a39e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a39e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57138/0 (socket says 172.21.15.40:57138) 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a39e00640 1 -- 172.21.15.40:0/1693667059 learned_addr learned my addr 172.21.15.40:0/1693667059 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a39400640 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8f2280 0x55f0cccc3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.665+0000 7f9a3a800640 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc912f60 0x55f0cccd0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39e00640 1 -- 172.21.15.40:0/1693667059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc912f60 msgr2=0x55f0cccd0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39e00640 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc912f60 0x55f0cccd0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39e00640 1 -- 172.21.15.40:0/1693667059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8f2280 msgr2=0x55f0cccc3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39e00640 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8f2280 0x55f0cccc3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39e00640 1 -- 172.21.15.40:0/1693667059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0cccbf8e0 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39400640 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8f2280 0x55f0cccc3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a39e00640 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd5c10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b760 tx=0x7f9a2c0048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50827fb00d4cd08 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.666+0000 7f9a2aa00640 1 -- 172.21.15.40:0/1693667059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c011440 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.667+0000 7f9a2aa00640 1 -- 172.21.15.40:0/1693667059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a2c015050 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.667+0000 7f9a2aa00640 1 -- 172.21.15.40:0/1693667059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c011e60 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.667+0000 7f9a47dfe740 1 -- 172.21.15.40:0/1693667059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 msgr2=0x55f0cccd5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.667+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd5c10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b760 tx=0x7f9a2c0048d0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 -- 172.21.15.40:0/1693667059 shutdown_connections 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc912f60 0x55f0cccd0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8f2280 0x55f0cccc3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/1693667059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd5c10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 -- 172.21.15.40:0/1693667059 >> 172.21.15.40:0/1693667059 conn(0x55f0cc907350 msgr2=0x55f0cccc28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 -- 172.21.15.40:0/1693667059 shutdown_connections 2024-07-26T12:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 -- 172.21.15.40:0/1693667059 wait complete. 2024-07-26T12:22:11.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.668+0000 7f9a47dfe740 1 -- start start 2024-07-26T12:22:11.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 Processor -- start 2024-07-26T12:22:11.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccda240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 0x55f0cccda780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccd6830 con 0x55f0cc912f60 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccd6160 con 0x55f0cc8ea0a0 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0cccd6f00 con 0x55f0cc8f2280 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a47dfe740 10 client.0 _ll_register_callbacks cb 0x7f9a24030c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.669+0000 7f9a3a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 0x55f0cccda780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 0x55f0cccda780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57144/0 (socket says 172.21.15.40:57144) 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 -- 172.21.15.40:0/2685978347 learned_addr learned my addr 172.21.15.40:0/2685978347 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a39400640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccda240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 -- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 msgr2=0x55f0cccda240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccda240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 -- 172.21.15.40:0/2685978347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8ea0a0 msgr2=0x55f0cccd9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:11.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 -- 172.21.15.40:0/2685978347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0ccd3de40 con 0x55f0cc912f60 2024-07-26T12:22:11.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a3a800640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 0x55f0cccda780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a340aa4e0 tx=0x7f9a340a9d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e61b1ab06289fb7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:11.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.670+0000 7f9a23e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.671+0000 7f9a23e00640 1 -- 172.21.15.40:0/2685978347 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a340c4060 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.671+0000 7f9a23e00640 1 -- 172.21.15.40:0/2685978347 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a34005020 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.671+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a2c015050 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.671+0000 7f9a23e00640 1 -- 172.21.15.40:0/2685978347 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a340cb050 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.671+0000 7f9a47dfe740 10 client.15243 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.671+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f0ccd3f0a0 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a23e00640 1 -- 172.21.15.40:0/2685978347 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a2c015050 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a23e00640 1 -- 172.21.15.40:0/2685978347 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a340a9840 con 0x55f0cc912f60 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a47dfe740 10 client.15243 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:11.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a47dfe740 10 client.15243 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-26T12:22:11.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a47dfe740 20 client.15243 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:11.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8a6c90 0x55f0ccd42930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:11.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a47dfe740 4 client.15243 mds_command: new command op to 24592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:22:11.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.672+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 --> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] -- command(tid 0: {"prefix": "status"}) -- 0x55f0ccc2c360 con 0x55f0cc8a6c90 2024-07-26T12:22:11.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.673+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8a6c90 0x55f0ccd42930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.674+0000 7f9a39e00640 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8a6c90 0x55f0ccd42930 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b04b78f494b8d633 server_cookie=3eb3af0712823249 in_seq=0 out_seq=0 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.674+0000 7f9a23e00640 10 client.15243 ms_handle_connect on v2:172.21.15.146:6836/3076436166 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.674+0000 7f9a23e00640 1 -- 172.21.15.40:0/2685978347 <== mds.4 v2:172.21.15.146:6836/3076436166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f0ccc2c360 con 0x55f0cc8a6c90 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.674+0000 7f9a23e00640 10 client.15243 handle_command_reply: tid=0 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.674+0000 7f9a47dfe740 1 client.15243 shutdown 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.674+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 msgr2=0x55f0cccda780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 0x55f0cccda780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a340aa4e0 tx=0x7f9a340a9d80 comp rx=0 tx=0).stop 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 shutdown_connections 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x55f0cc8a6c90 0x55f0ccd42930 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0cc912f60 0x55f0cccda780 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0cc8f2280 0x55f0cccda240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 --2- 172.21.15.40:0/2685978347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0cc8ea0a0 0x55f0cccd9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 >> 172.21.15.40:0/2685978347 conn(0x55f0cc907350 msgr2=0x55f0cccb97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a23e00640 0 client.15243 ms_handle_reset on v2:172.21.15.146:6836/3076436166 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 shutdown_connections 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 1 -- 172.21.15.40:0/2685978347 wait complete. 2024-07-26T12:22:11.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.675+0000 7f9a47dfe740 20 client.15243 trim_cache size 0 max 16384 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 4, 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24592, 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 200.643745946, 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:22:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:22:11.680 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 260.20087812399998 2024-07-26T12:22:11.680 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:22:11.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a1c0b3bd0 msgr2=0x7f9a1c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a1c0b3bd0 0x7f9a1c0b60e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009ca0 tx=0x7f9a24005fd0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 msgr2=0x7f9a3c1a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:11.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 0x7f9a3c1a5bb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400d750 tx=0x7f9a3400dc10 comp rx=0 tx=0).stop 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 shutdown_connections 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a3c107450 0x7f9a3c1a5bb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a3c102960 0x7f9a3c1a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a1c0b3bd0 0x7f9a1c0b60e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 --2- 172.21.15.40:0/2260026309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c102010 0x7f9a3c1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.676+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 >> 172.21.15.40:0/2260026309 conn(0x7f9a3c0fdd40 msgr2=0x7f9a3c104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.677+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 shutdown_connections 2024-07-26T12:22:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:11.677+0000 7f9a3b200640 1 -- 172.21.15.40:0/2260026309 wait complete. 2024-07-26T12:22:12.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.i status 2024-07-26T12:22:13.132 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:13 smithi146 ceph-mon[35807]: pgmap v499: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:13 smithi076 ceph-mon[35401]: pgmap v499: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:13.650 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:13 smithi040 ceph-mon[32397]: pgmap v499: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 -- 172.21.15.40:0/1025624894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 msgr2=0x7f48ac10fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 --2- 172.21.15.40:0/1025624894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac10fec0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009ca0 tx=0x7f48a402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 -- 172.21.15.40:0/1025624894 shutdown_connections 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 --2- 172.21.15.40:0/1025624894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac10fec0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 --2- 172.21.15.40:0/1025624894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48ac108d40 0x7f48ac109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 --2- 172.21.15.40:0/1025624894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ac103400 0x7f48ac103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 -- 172.21.15.40:0/1025624894 >> 172.21.15.40:0/1025624894 conn(0x7f48ac0fee90 msgr2=0x7f48ac1012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.368+0000 7f48b2c00640 1 -- 172.21.15.40:0/1025624894 shutdown_connections 2024-07-26T12:22:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.369+0000 7f48b2c00640 1 -- 172.21.15.40:0/1025624894 wait complete. 2024-07-26T12:22:15.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.370+0000 7f48b2c00640 1 Processor -- start 2024-07-26T12:22:15.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.370+0000 7f48b2c00640 1 -- start start 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ac103400 0x7f48ac199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48ac108d40 0x7f48ac19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac113240 con 0x7f48ac109690 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1130c0 con 0x7f48ac108d40 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1133c0 con 0x7f48ac103400 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac19f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56648/0 (socket says 172.21.15.40:56648) 2024-07-26T12:22:15.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.371+0000 7f48b2200640 1 -- 172.21.15.40:0/2561689329 learned_addr learned my addr 172.21.15.40:0/2561689329 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:15.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b1800640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ac103400 0x7f48ac199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b0e00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48ac108d40 0x7f48ac19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b2200640 1 -- 172.21.15.40:0/2561689329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ac103400 msgr2=0x7f48ac199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b2200640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ac103400 0x7f48ac199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b2200640 1 -- 172.21.15.40:0/2561689329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48ac108d40 msgr2=0x7f48ac19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b2200640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48ac108d40 0x7f48ac19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b2200640 1 -- 172.21.15.40:0/2561689329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac19fba0 con 0x7f48ac109690 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.372+0000 7f48b2200640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac19f470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f48a4031040 tx=0x7f48a4003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.373+0000 7f48aa000640 1 -- 172.21.15.40:0/2561689329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4032c90 con 0x7f48ac109690 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.373+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac19fe30 con 0x7f48ac109690 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.373+0000 7f48aa000640 1 -- 172.21.15.40:0/2561689329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48a4032e30 con 0x7f48ac109690 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.373+0000 7f48aa000640 1 -- 172.21.15.40:0/2561689329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4030af0 con 0x7f48ac109690 2024-07-26T12:22:15.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.373+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1a65f0 con 0x7f48ac109690 2024-07-26T12:22:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 Processor -- start 2024-07-26T12:22:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48aa000640 1 -- 172.21.15.40:0/2561689329 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f48a4030c90 con 0x7f48ac109690 2024-07-26T12:22:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 -- start start 2024-07-26T12:22:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 0x55a0280d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d060a0 0x55a0280d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d0e280 0x55a0280d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a02804a950 con 0x55a027d2ef60 2024-07-26T12:22:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a028039e50 con 0x55a027d060a0 2024-07-26T12:22:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.377+0000 7f48bae30740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a02803de90 con 0x55a027d0e280 2024-07-26T12:22:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 0x55a0280d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 0x55a0280d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56664/0 (socket says 172.21.15.40:56664) 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 -- 172.21.15.40:0/2306636106 learned_addr learned my addr 172.21.15.40:0/2306636106 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b1800640 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d060a0 0x55a0280d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d0e280 0x55a0280d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 -- 172.21.15.40:0/2306636106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d0e280 msgr2=0x55a0280d51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d0e280 0x55a0280d51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 -- 172.21.15.40:0/2306636106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d060a0 msgr2=0x55a0280d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d060a0 0x55a0280d4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.378+0000 7f48b0e00640 1 -- 172.21.15.40:0/2306636106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a027fe10f0 con 0x55a027d2ef60 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f48b0e00640 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 0x55a0280d4760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f489c013450 tx=0x7f489c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79e1d9b5cde9f85 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f48aa000640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f48940b3c50 0x7f48940b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f489aa00640 1 -- 172.21.15.40:0/2306636106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c004050 con 0x55a027d2ef60 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f489aa00640 1 -- 172.21.15.40:0/2306636106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f489c0035f0 con 0x55a027d2ef60 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f489aa00640 1 -- 172.21.15.40:0/2306636106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c0106d0 con 0x55a027d2ef60 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f48aa000640 1 -- 172.21.15.40:0/2561689329 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f48a4104ff0 con 0x7f48ac109690 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.379+0000 7f48b1800640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f48940b3c50 0x7f48940b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 -- 172.21.15.40:0/2306636106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 msgr2=0x55a0280d4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 0x55a0280d4760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f489c013450 tx=0x7f489c009710 comp rx=0 tx=0).stop 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48b1800640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f48940b3c50 0x7f48940b6160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55a0280d33e0 tx=0x7f48a000b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 -- 172.21.15.40:0/2306636106 shutdown_connections 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d0e280 0x55a0280d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d060a0 0x55a0280d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 --2- 172.21.15.40:0/2306636106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d2ef60 0x55a0280d4760 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 -- 172.21.15.40:0/2306636106 >> 172.21.15.40:0/2306636106 conn(0x55a027d23350 msgr2=0x55a0280d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 -- 172.21.15.40:0/2306636106 shutdown_connections 2024-07-26T12:22:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.380+0000 7f48bae30740 1 -- 172.21.15.40:0/2306636106 wait complete. 2024-07-26T12:22:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.381+0000 7f48bae30740 1 -- start start 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.381+0000 7f48bae30740 1 Processor -- start 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 0x55a0280e0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d0e280 0x55a0280e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d2ef60 0x55a0280ec290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a027e9d5f0 con 0x55a027d060a0 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a027fd6520 con 0x55a027d0e280 2024-07-26T12:22:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a0280e2f40 con 0x55a027d2ef60 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48bae30740 10 client.0 _ll_register_callbacks cb 0x55a027fe5ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48b1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 0x55a0280e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48b1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 0x55a0280e0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56666/0 (socket says 172.21.15.40:56666) 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.382+0000 7f48b1800640 1 -- 172.21.15.40:0/3231476696 learned_addr learned my addr 172.21.15.40:0/3231476696 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b0e00640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d0e280 0x55a0280e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b2200640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d2ef60 0x55a0280ec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b1800640 1 -- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d2ef60 msgr2=0x55a0280ec290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b1800640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d2ef60 0x55a0280ec290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b1800640 1 -- 172.21.15.40:0/3231476696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d0e280 msgr2=0x55a0280e05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b1800640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d0e280 0x55a0280e05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b1800640 1 -- 172.21.15.40:0/3231476696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a027d9a540 con 0x55a027d060a0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f48b1800640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 0x55a0280e0010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48a0013fd0 tx=0x7f48a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ce7cfde5a82971 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.383+0000 7f488f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f488f400640 1 -- 172.21.15.40:0/3231476696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0029680 con 0x55a027d060a0 2024-07-26T12:22:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f488f400640 1 -- 172.21.15.40:0/3231476696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f48a0029820 con 0x55a027d060a0 2024-07-26T12:22:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489c0035f0 con 0x55a027d060a0 2024-07-26T12:22:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f488f400640 1 -- 172.21.15.40:0/3231476696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48a0029a20 con 0x55a027d060a0 2024-07-26T12:22:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f48bae30740 10 client.15255 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0280eeea0 con 0x55a027d060a0 2024-07-26T12:22:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.384+0000 7f488f400640 1 -- 172.21.15.40:0/3231476696 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f489c0035f0 con 0x55a027d060a0 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f488f400640 1 -- 172.21.15.40:0/3231476696 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48a001ec30 con 0x55a027d060a0 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f48bae30740 10 client.15255 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f48bae30740 10 client.15255 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f48bae30740 20 client.15255 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f48bae30740 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027ced8e0 0x55a0280f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f48bae30740 4 client.15255 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.385+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 --> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a02804c8a0 con 0x55a027ced8e0 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.386+0000 7f48b0e00640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027ced8e0 0x55a0280f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.387+0000 7f48b0e00640 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027ced8e0 0x55a0280f2930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1dad6618cf5eae52 server_cookie=9b02d41bc15e0ea4 in_seq=0 out_seq=0 2024-07-26T12:22:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.387+0000 7f488f400640 10 client.15255 ms_handle_connect on v2:172.21.15.146:6838/4061759756 2024-07-26T12:22:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f488f400640 1 -- 172.21.15.40:0/3231476696 <== mds.3 v2:172.21.15.146:6838/4061759756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a02804c8a0 con 0x55a027ced8e0 2024-07-26T12:22:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f488f400640 10 client.15255 handle_command_reply: tid=0 2024-07-26T12:22:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 client.15255 shutdown 2024-07-26T12:22:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 msgr2=0x55a0280e0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 0x55a0280e0010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48a0013fd0 tx=0x7f48a00046c0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 shutdown_connections 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027ced8e0 0x55a0280f2930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d2ef60 0x55a0280ec290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d0e280 0x55a0280e05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 --2- 172.21.15.40:0/3231476696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d060a0 0x55a0280e0010 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 >> 172.21.15.40:0/3231476696 conn(0x55a027d23350 msgr2=0x55a0280d7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f488f400640 0 client.15255 ms_handle_reset on v2:172.21.15.146:6838/4061759756 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.389+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 shutdown_connections 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.390+0000 7f48bae30740 1 -- 172.21.15.40:0/3231476696 wait complete. 2024-07-26T12:22:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.390+0000 7f48bae30740 20 client.15255 trim_cache size 0 max 16384 2024-07-26T12:22:15.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 Processor -- start 2024-07-26T12:22:15.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 -- start start 2024-07-26T12:22:15.412 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:15 smithi040 ceph-mon[32397]: pgmap v500: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280ec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280ec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a0280f0c70 con 0x55a027d0e280 2024-07-26T12:22:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a0280f1340 con 0x55a027d2ef60 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.410+0000 7f48bae30740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a0280f1a10 con 0x55a027d060a0 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280ec740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56674/0 (socket says 172.21.15.40:56674) 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 -- 172.21.15.40:0/492384874 learned_addr learned my addr 172.21.15.40:0/492384874 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b1800640 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b2200640 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 -- 172.21.15.40:0/492384874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 msgr2=0x55a0280ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280ec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 -- 172.21.15.40:0/492384874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 msgr2=0x55a0280de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.411+0000 7f48b0e00640 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.412+0000 7f48b0e00640 1 -- 172.21.15.40:0/492384874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0280cd7d0 con 0x55a027d0e280 2024-07-26T12:22:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.412+0000 7f48b2200640 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.412+0000 7f48b0e00640 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280ec740 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f489c009550 tx=0x7f489c009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8200156da26a01 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.412+0000 7f489a000640 1 -- 172.21.15.40:0/492384874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c0050e0 con 0x55a027d0e280 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.412+0000 7f489a000640 1 -- 172.21.15.40:0/492384874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f489c028030 con 0x55a027d0e280 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.412+0000 7f489a000640 1 -- 172.21.15.40:0/492384874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c003ca0 con 0x55a027d0e280 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.413+0000 7f48bae30740 1 -- 172.21.15.40:0/492384874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 msgr2=0x55a0280ec740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.413+0000 7f48bae30740 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280ec740 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f489c009550 tx=0x7f489c009e70 comp rx=0 tx=0).stop 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 -- 172.21.15.40:0/492384874 shutdown_connections 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280ec740 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 --2- 172.21.15.40:0/492384874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 -- 172.21.15.40:0/492384874 >> 172.21.15.40:0/492384874 conn(0x55a027d23350 msgr2=0x55a0280dfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:15.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 -- 172.21.15.40:0/492384874 shutdown_connections 2024-07-26T12:22:15.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 -- 172.21.15.40:0/492384874 wait complete. 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.414+0000 7f48bae30740 1 -- start start 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 Processor -- start 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280f5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280f5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a0280f27b0 con 0x55a027d0e280 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a0280f20e0 con 0x55a027d2ef60 2024-07-26T12:22:15.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a0280f2e80 con 0x55a027d060a0 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.415+0000 7f48bae30740 10 client.0 _ll_register_callbacks cb 0x7f48a001d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56678/0 (socket says 172.21.15.40:56678) 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 -- 172.21.15.40:0/3927959993 learned_addr learned my addr 172.21.15.40:0/3927959993 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b1800640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b2200640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 -- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 msgr2=0x55a0280f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 -- 172.21.15.40:0/3927959993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 msgr2=0x55a0280f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b0e00640 1 -- 172.21.15.40:0/3927959993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0280f9830 con 0x55a027d0e280 2024-07-26T12:22:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.416+0000 7f48b2200640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f48b0e00640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280f5710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f489c009930 tx=0x7f489c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1545171400c83f40 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f488f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f488f400640 1 -- 172.21.15.40:0/3927959993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c030070 con 0x55a027d0e280 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f488f400640 1 -- 172.21.15.40:0/3927959993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f489c0052c0 con 0x55a027d0e280 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489c028030 con 0x55a027d0e280 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f488f400640 1 -- 172.21.15.40:0/3927959993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f489c03c050 con 0x55a027d0e280 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f48bae30740 10 client.15261 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.417+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0280fabf0 con 0x55a027d0e280 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f488f400640 1 -- 172.21.15.40:0/3927959993 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f489c028030 con 0x55a027d0e280 2024-07-26T12:22:15.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f488f400640 1 -- 172.21.15.40:0/3927959993 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f489c02c410 con 0x55a027d0e280 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f48bae30740 10 client.15261 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f48bae30740 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f48bae30740 20 client.15261 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f48bae30740 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027cc2c90 0x55a028166920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f48bae30740 4 client.15261 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.418+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 --> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] -- command(tid 0: {"prefix": "status"}) -- 0x55a028048340 con 0x55a027cc2c90 2024-07-26T12:22:15.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.419+0000 7f48b1800640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027cc2c90 0x55a028166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.420+0000 7f488f400640 10 client.15261 ms_handle_connect on v2:172.21.15.146:6838/4061759756 2024-07-26T12:22:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.420+0000 7f48b1800640 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027cc2c90 0x55a028166920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77277a06a4dc9d7e server_cookie=f39007229b4c8371 in_seq=0 out_seq=0 2024-07-26T12:22:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f488f400640 1 -- 172.21.15.40:0/3927959993 <== mds.3 v2:172.21.15.146:6838/4061759756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a028048340 con 0x55a027cc2c90 2024-07-26T12:22:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f488f400640 10 client.15261 handle_command_reply: tid=0 2024-07-26T12:22:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 client.15261 shutdown 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 msgr2=0x55a0280f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280f5710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f489c009930 tx=0x7f489c005880 comp rx=0 tx=0).stop 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 shutdown_connections 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x55a027cc2c90 0x55a028166920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a027d2ef60 0x55a0280f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f488f400640 0 client.15261 ms_handle_reset on v2:172.21.15.146:6838/4061759756 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a027d0e280 0x55a0280f5710 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 --2- 172.21.15.40:0/3927959993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a027d060a0 0x55a0280f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.421+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 >> 172.21.15.40:0/3927959993 conn(0x55a027d23350 msgr2=0x55a0280d7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.422+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 shutdown_connections 2024-07-26T12:22:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.422+0000 7f48bae30740 1 -- 172.21.15.40:0/3927959993 wait complete. 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.422+0000 7f48bae30740 20 client.15261 trim_cache size 0 max 16384 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 3, 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24610, 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:22:15.425 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 205.40567828600001, 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 256.42044479899999 2024-07-26T12:22:15.426 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f48940b3c50 msgr2=0x7f48940b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f48940b3c50 0x7f48940b6160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55a0280d33e0 tx=0x7f48a000b4d0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 msgr2=0x7f48ac19f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac19f470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f48a4031040 tx=0x7f48a4003f80 comp rx=0 tx=0).stop 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 shutdown_connections 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac109690 0x7f48ac19f470 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48ac108d40 0x7f48ac19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f48940b3c50 0x7f48940b6160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 --2- 172.21.15.40:0/2561689329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ac103400 0x7f48ac199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 >> 172.21.15.40:0/2561689329 conn(0x7f48ac0fee90 msgr2=0x7f48ac1083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 shutdown_connections 2024-07-26T12:22:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:15.423+0000 7f48b2c00640 1 -- 172.21.15.40:0/2561689329 wait complete. 2024-07-26T12:22:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:15 smithi146 ceph-mon[35807]: pgmap v500: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:15.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:15 smithi076 ceph-mon[35401]: pgmap v500: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:16.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.k status 2024-07-26T12:22:16.772 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:17 smithi040 ceph-mon[32397]: pgmap v501: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:17 smithi146 ceph-mon[35807]: pgmap v501: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:17 smithi076 ceph-mon[35401]: pgmap v501: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:18.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 -- 172.21.15.40:0/473680684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 msgr2=0x7f57fc10fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 --2- 172.21.15.40:0/473680684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc10fb30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009900 tx=0x7f57f402a410 comp rx=0 tx=0).stop 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 -- 172.21.15.40:0/473680684 shutdown_connections 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 --2- 172.21.15.40:0/473680684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc10fb30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 --2- 172.21.15.40:0/473680684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 0x7f57fc10d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 --2- 172.21.15.40:0/473680684 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f57fc1040e0 0x7f57fc1044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 -- 172.21.15.40:0/473680684 >> 172.21.15.40:0/473680684 conn(0x7f57fc0fdcf0 msgr2=0x7f57fc100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 -- 172.21.15.40:0/473680684 shutdown_connections 2024-07-26T12:22:18.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.919+0000 7f5802400640 1 -- 172.21.15.40:0/473680684 wait complete. 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.920+0000 7f5802400640 1 Processor -- start 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 -- start start 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f57fc1040e0 0x7f57fc19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 0x7f57fc19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1131b0 con 0x7f57fc10d690 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc113030 con 0x7f57fc1040e0 2024-07-26T12:22:18.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5802400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc113330 con 0x7f57fc104b10 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5801a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5801a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc1a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56696/0 (socket says 172.21.15.40:56696) 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.921+0000 7f5801a00640 1 -- 172.21.15.40:0/705170607 learned_addr learned my addr 172.21.15.40:0/705170607 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f57fbe00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 0x7f57fc19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801000640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f57fc1040e0 0x7f57fc19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801a00640 1 -- 172.21.15.40:0/705170607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 msgr2=0x7f57fc19c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801a00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 0x7f57fc19c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801a00640 1 -- 172.21.15.40:0/705170607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f57fc1040e0 msgr2=0x7f57fc19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801a00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f57fc1040e0 0x7f57fc19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801a00640 1 -- 172.21.15.40:0/705170607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc1a1cd0 con 0x7f57fc10d690 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f57fbe00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 0x7f57fc19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:18.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.922+0000 7f5801a00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc1a15a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f57f4004770 tx=0x7f57f4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:18.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.923+0000 7f57f9600640 1 -- 172.21.15.40:0/705170607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f403f070 con 0x7f57fc10d690 2024-07-26T12:22:18.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.923+0000 7f57f9600640 1 -- 172.21.15.40:0/705170607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f403bd00 con 0x7f57fc10d690 2024-07-26T12:22:18.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.923+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc1a1f60 con 0x7f57fc10d690 2024-07-26T12:22:18.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.923+0000 7f57f9600640 1 -- 172.21.15.40:0/705170607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4035030 con 0x7f57fc10d690 2024-07-26T12:22:18.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.923+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc1a8720 con 0x7f57fc10d690 2024-07-26T12:22:18.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.926+0000 7f580a835740 1 Processor -- start 2024-07-26T12:22:18.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.927+0000 7f57f9600640 1 -- 172.21.15.40:0/705170607 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f57f4042070 con 0x7f57fc10d690 2024-07-26T12:22:18.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.927+0000 7f580a835740 1 -- start start 2024-07-26T12:22:18.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f580a835740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c1a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f580a835740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c1acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f580a835740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c1b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f580a835740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561b44b90970 con 0x561b4484c0a0 2024-07-26T12:22:18.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f580a835740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b44b7fe70 con 0x561b44874f60 2024-07-26T12:22:18.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f580a835740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b44b83eb0 con 0x561b44854280 2024-07-26T12:22:18.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f5801000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c1acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f5801000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c1acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56710/0 (socket says 172.21.15.40:56710) 2024-07-26T12:22:18.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f5801000640 1 -- 172.21.15.40:0/545187993 learned_addr learned my addr 172.21.15.40:0/545187993 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:18.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.928+0000 7f57fbe00640 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c1a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f57fbe00640 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c1b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f5801000640 1 -- 172.21.15.40:0/545187993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 msgr2=0x561b44c1b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f5801000640 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c1b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f5801000640 1 -- 172.21.15.40:0/545187993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 msgr2=0x561b44c1a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f5801000640 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c1a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f5801000640 1 -- 172.21.15.40:0/545187993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b44b27110 con 0x561b4484c0a0 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f57fbe00640 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c1b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f57f9600640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57e00b3bd0 0x7f57e00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f5801000640 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c1acc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009f60 tx=0x7f57ec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea0caac42335a08 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.929+0000 7f57f9600640 1 -- 172.21.15.40:0/705170607 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57f41044c0 con 0x7f57fc10d690 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.930+0000 7f57fbe00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57e00b3bd0 0x7f57e00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.930+0000 7f57f2000640 1 -- 172.21.15.40:0/545187993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec016070 con 0x561b4484c0a0 2024-07-26T12:22:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.930+0000 7f57f2000640 1 -- 172.21.15.40:0/545187993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec01baf0 con 0x561b4484c0a0 2024-07-26T12:22:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.930+0000 7f57f2000640 1 -- 172.21.15.40:0/545187993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec012b90 con 0x561b4484c0a0 2024-07-26T12:22:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 -- 172.21.15.40:0/545187993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 msgr2=0x561b44c1acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c1acc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009f60 tx=0x7f57ec009f90 comp rx=0 tx=0).stop 2024-07-26T12:22:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f57fbe00640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57e00b3bd0 0x7f57e00b60e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f57e40058c0 tx=0x7f57e400c510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 -- 172.21.15.40:0/545187993 shutdown_connections 2024-07-26T12:22:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c1b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c1acc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 --2- 172.21.15.40:0/545187993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c1a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 -- 172.21.15.40:0/545187993 >> 172.21.15.40:0/545187993 conn(0x561b44869350 msgr2=0x561b44c18670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 -- 172.21.15.40:0/545187993 shutdown_connections 2024-07-26T12:22:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.931+0000 7f580a835740 1 -- 172.21.15.40:0/545187993 wait complete. 2024-07-26T12:22:18.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.932+0000 7f580a835740 1 -- start start 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.932+0000 7f580a835740 1 Processor -- start 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4484c0a0 0x561b44c26280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 0x561b44c32280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561b449e35f0 con 0x561b44874f60 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b44b1c540 con 0x561b4484c0a0 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b44c28f60 con 0x561b44854280 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f580a835740 10 client.0 _ll_register_callbacks cb 0x561b44b2bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f5801a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 0x561b44c32280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f5801a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 0x561b44c32280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56718/0 (socket says 172.21.15.40:56718) 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f5801a00640 1 -- 172.21.15.40:0/1136349590 learned_addr learned my addr 172.21.15.40:0/1136349590 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:18.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f5801000640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4484c0a0 0x561b44c26280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.933+0000 7f57fbe00640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f5801a00640 1 -- 172.21.15.40:0/1136349590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 msgr2=0x561b44c267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f5801a00640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f5801a00640 1 -- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4484c0a0 msgr2=0x561b44c26280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f5801a00640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4484c0a0 0x561b44c26280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f5801a00640 1 -- 172.21.15.40:0/1136349590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b448e0540 con 0x561b44874f60 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f5801a00640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 0x561b44c32280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f57f402a9d0 tx=0x7f57f4005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3860a301c1c3e7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f57eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f57eaa00640 1 -- 172.21.15.40:0/1136349590 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4049040 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f57eaa00640 1 -- 172.21.15.40:0/1136349590 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57f4104110 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec01baf0 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.934+0000 7f57eaa00640 1 -- 172.21.15.40:0/1136349590 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57f40cb3d0 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 10 client.15273 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b44c34e20 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f57eaa00640 1 -- 172.21.15.40:0/1136349590 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec01baf0 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f57eaa00640 1 -- 172.21.15.40:0/1136349590 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57f4031bd0 con 0x561b44874f60 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 10 client.15273 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 10 client.15273 resolve_mds: resolved name 'k' to daemon mds.k 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 20 client.15273 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b448338e0 0x561b44c38990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 4 client.15273 mds_command: new command op to 34547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:22:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.935+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 --> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b44b928c0 con 0x561b448338e0 2024-07-26T12:22:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.936+0000 7f5801000640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b448338e0 0x561b44c38990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.937+0000 7f5801000640 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b448338e0 0x561b44c38990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=763d3ce383ddc5ca server_cookie=665397e15ae3bb3e in_seq=0 out_seq=0 2024-07-26T12:22:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.937+0000 7f57eaa00640 10 client.15273 ms_handle_connect on v2:172.21.15.76:6832/2744171288 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.939+0000 7f57eaa00640 1 -- 172.21.15.40:0/1136349590 <== mds.2 v2:172.21.15.76:6832/2744171288 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b44b928c0 con 0x561b448338e0 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.939+0000 7f57eaa00640 10 client.15273 handle_command_reply: tid=0 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 client.15273 shutdown 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 msgr2=0x561b44c32280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 0x561b44c32280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f57f402a9d0 tx=0x7f57f4005de0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 shutdown_connections 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b448338e0 0x561b44c38990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44874f60 0x561b44c32280 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 --2- 172.21.15.40:0/1136349590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4484c0a0 0x561b44c26280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 >> 172.21.15.40:0/1136349590 conn(0x561b44869350 msgr2=0x561b44c1d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f57eaa00640 0 client.15273 ms_handle_reset on v2:172.21.15.76:6832/2744171288 2024-07-26T12:22:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 shutdown_connections 2024-07-26T12:22:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.940+0000 7f580a835740 1 -- 172.21.15.40:0/1136349590 wait complete. 2024-07-26T12:22:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.941+0000 7f580a835740 20 client.15273 trim_cache size 0 max 16384 2024-07-26T12:22:18.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 Processor -- start 2024-07-26T12:22:18.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 -- start start 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4484c0a0 0x561b44c208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 0x561b44c321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c32730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561b44c36cd0 con 0x561b44854280 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b44c373a0 con 0x561b44874f60 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.961+0000 7f580a835740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b44c37a70 con 0x561b4484c0a0 2024-07-26T12:22:18.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 0x561b44c321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 0x561b44c321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56722/0 (socket says 172.21.15.40:56722) 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 -- 172.21.15.40:0/596347646 learned_addr learned my addr 172.21.15.40:0/596347646 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f5801000640 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4484c0a0 0x561b44c208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f5801a00640 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c32730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 -- 172.21.15.40:0/596347646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4484c0a0 msgr2=0x561b44c208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4484c0a0 0x561b44c208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 -- 172.21.15.40:0/596347646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 msgr2=0x561b44c32730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c32730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.962+0000 7f57fbe00640 1 -- 172.21.15.40:0/596347646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b44c137f0 con 0x561b44854280 2024-07-26T12:22:18.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.963+0000 7f57fbe00640 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 0x561b44c321f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f57e40115f0 tx=0x7f57e4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47aefb03c308a9a3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:18.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.963+0000 7f57f1600640 1 -- 172.21.15.40:0/596347646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e401f6d0 con 0x561b44854280 2024-07-26T12:22:18.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.963+0000 7f57f1600640 1 -- 172.21.15.40:0/596347646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57e401fd00 con 0x561b44854280 2024-07-26T12:22:18.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.963+0000 7f57f1600640 1 -- 172.21.15.40:0/596347646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4020c70 con 0x561b44854280 2024-07-26T12:22:18.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 -- 172.21.15.40:0/596347646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 msgr2=0x561b44c321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 0x561b44c321f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f57e40115f0 tx=0x7f57e4014040 comp rx=0 tx=0).stop 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 -- 172.21.15.40:0/596347646 shutdown_connections 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c32730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b44854280 0x561b44c321f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 --2- 172.21.15.40:0/596347646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4484c0a0 0x561b44c208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 -- 172.21.15.40:0/596347646 >> 172.21.15.40:0/596347646 conn(0x561b44869350 msgr2=0x561b44c24900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.964+0000 7f580a835740 1 -- 172.21.15.40:0/596347646 shutdown_connections 2024-07-26T12:22:18.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.965+0000 7f580a835740 1 -- 172.21.15.40:0/596347646 wait complete. 2024-07-26T12:22:18.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.965+0000 7f580a835740 1 -- start start 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.965+0000 7f580a835740 1 Processor -- start 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c3b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c3c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561b44c38810 con 0x561b4484c0a0 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b44c38140 con 0x561b44874f60 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b44c38ee0 con 0x561b44854280 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f580a835740 10 client.0 _ll_register_callbacks cb 0x7f57f40cad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f5801000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f5801000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56738/0 (socket says 172.21.15.40:56738) 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.966+0000 7f5801000640 1 -- 172.21.15.40:0/1374446220 learned_addr learned my addr 172.21.15.40:0/1374446220 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801a00640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c3c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f57fbe00640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c3b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801000640 1 -- 172.21.15.40:0/1374446220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 msgr2=0x561b44c3b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801000640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c3b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801000640 1 -- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 msgr2=0x561b44c3c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801000640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c3c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801000640 1 -- 172.21.15.40:0/1374446220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b44c9fc20 con 0x561b4484c0a0 2024-07-26T12:22:18.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f5801000640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c414c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009f60 tx=0x7f57ec01cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d8f3067712e85d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.967+0000 7f57eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f57eaa00640 1 -- 172.21.15.40:0/1374446220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec016040 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f57eaa00640 1 -- 172.21.15.40:0/1374446220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57ec003b70 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e401fd00 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f57eaa00640 1 -- 172.21.15.40:0/1374446220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57ec003d70 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f580a835740 10 client.15279 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b44ca0cf0 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.968+0000 7f57eaa00640 1 -- 172.21.15.40:0/1374446220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57e401fd00 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f57eaa00640 1 -- 172.21.15.40:0/1374446220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57ec00f040 con 0x561b4484c0a0 2024-07-26T12:22:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f580a835740 10 client.15279 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f580a835740 10 client.15279 resolve_mds: resolved name 'k' to daemon mds.k 2024-07-26T12:22:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f580a835740 20 client.15279 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f580a835740 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b44808c90 0x561b44ca41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f580a835740 4 client.15279 mds_command: new command op to 34547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:22:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.969+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 --> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] -- command(tid 0: {"prefix": "status"}) -- 0x561b44b8e360 con 0x561b44808c90 2024-07-26T12:22:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.970+0000 7f57fbe00640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b44808c90 0x561b44ca41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.970+0000 7f57fbe00640 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b44808c90 0x561b44ca41b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b1312e2f62ef239 server_cookie=17daa172c5d0de5d in_seq=0 out_seq=0 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.971+0000 7f57eaa00640 10 client.15279 ms_handle_connect on v2:172.21.15.76:6832/2744171288 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.971+0000 7f57eaa00640 1 -- 172.21.15.40:0/1374446220 <== mds.2 v2:172.21.15.76:6832/2744171288 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561b44b8e360 con 0x561b44808c90 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.971+0000 7f57eaa00640 10 client.15279 handle_command_reply: tid=0 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.971+0000 7f580a835740 1 client.15279 shutdown 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.971+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 msgr2=0x561b44c414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.971+0000 7f580a835740 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c414c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009f60 tx=0x7f57ec01cdc0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 shutdown_connections 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x561b44808c90 0x561b44ca41b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b44874f60 0x561b44c3c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b44854280 0x561b44c3b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 --2- 172.21.15.40:0/1374446220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b4484c0a0 0x561b44c414c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 >> 172.21.15.40:0/1374446220 conn(0x561b44869350 msgr2=0x561b44c1b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f57eaa00640 0 client.15279 ms_handle_reset on v2:172.21.15.76:6832/2744171288 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 shutdown_connections 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 1 -- 172.21.15.40:0/1374446220 wait complete. 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.972+0000 7f580a835740 20 client.15279 trim_cache size 0 max 16384 2024-07-26T12:22:18.975 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 2, 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34547, 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 209.97086392400001, 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 287.253454589 2024-07-26T12:22:18.976 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57e00b3bd0 msgr2=0x7f57e00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57e00b3bd0 0x7f57e00b60e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f57e40058c0 tx=0x7f57e400c510 comp rx=0 tx=0).stop 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 msgr2=0x7f57fc1a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc1a15a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f57f4004770 tx=0x7f57f4003cd0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 shutdown_connections 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57fc10d690 0x7f57fc1a15a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57e00b3bd0 0x7f57e00b60e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57fc104b10 0x7f57fc19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 --2- 172.21.15.40:0/705170607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f57fc1040e0 0x7f57fc19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:18.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 >> 172.21.15.40:0/705170607 conn(0x7f57fc0fdcf0 msgr2=0x7f57fc101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:18.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 shutdown_connections 2024-07-26T12:22:18.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:18.973+0000 7f5802400640 1 -- 172.21.15.40:0/705170607 wait complete. 2024-07-26T12:22:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:19 smithi146 ceph-mon[35807]: pgmap v502: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:19 smithi076 ceph-mon[35401]: pgmap v502: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:19 smithi040 ceph-mon[32397]: pgmap v502: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:19.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.h status 2024-07-26T12:22:20.399 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:21 smithi146 ceph-mon[35807]: pgmap v503: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:21.581 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:21 smithi040 ceph-mon[32397]: pgmap v503: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:21 smithi076 ceph-mon[35401]: pgmap v503: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.692+0000 7fe53ce00640 1 -- 172.21.15.40:0/2924048002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538108f00 msgr2=0x7fe538109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.692+0000 7fe53ce00640 1 --2- 172.21.15.40:0/2924048002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538108f00 0x7fe538109310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe520009900 tx=0x7fe52002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 -- 172.21.15.40:0/2924048002 shutdown_connections 2024-07-26T12:22:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 --2- 172.21.15.40:0/2924048002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe538109850 0x7fe538110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 --2- 172.21.15.40:0/2924048002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538108f00 0x7fe538109310 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 --2- 172.21.15.40:0/2924048002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5381035c0 0x7fe5381039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 -- 172.21.15.40:0/2924048002 >> 172.21.15.40:0/2924048002 conn(0x7fe5380ff010 msgr2=0x7fe538101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 -- 172.21.15.40:0/2924048002 shutdown_connections 2024-07-26T12:22:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.693+0000 7fe53ce00640 1 -- 172.21.15.40:0/2924048002 wait complete. 2024-07-26T12:22:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.694+0000 7fe53ce00640 1 Processor -- start 2024-07-26T12:22:22.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 -- start start 2024-07-26T12:22:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5381035c0 0x7fe538199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe538108f00 0x7fe53819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 0x7fe53819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe538113390 con 0x7fe538109850 2024-07-26T12:22:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe538113210 con 0x7fe538108f00 2024-07-26T12:22:22.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.695+0000 7fe53ce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe538113510 con 0x7fe5381035c0 2024-07-26T12:22:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 0x7fe53819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 0x7fe53819f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56764/0 (socket says 172.21.15.40:56764) 2024-07-26T12:22:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 -- 172.21.15.40:0/233860855 learned_addr learned my addr 172.21.15.40:0/233860855 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe535e00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5381035c0 0x7fe538199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe52d400640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe538108f00 0x7fe53819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 -- 172.21.15.40:0/233860855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5381035c0 msgr2=0x7fe538199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5381035c0 0x7fe538199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 -- 172.21.15.40:0/233860855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe538108f00 msgr2=0x7fe53819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe538108f00 0x7fe53819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe536800640 1 -- 172.21.15.40:0/233860855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53819fcf0 con 0x7fe538109850 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.696+0000 7fe52d400640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe538108f00 0x7fe53819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.697+0000 7fe536800640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 0x7fe53819f680 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe53000cad0 tx=0x7fe53000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.697+0000 7fe52f400640 1 -- 172.21.15.40:0/233860855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ad60 con 0x7fe538109850 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.697+0000 7fe52f400640 1 -- 172.21.15.40:0/233860855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe530005020 con 0x7fe538109850 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.697+0000 7fe52f400640 1 -- 172.21.15.40:0/233860855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000f6b0 con 0x7fe538109850 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.697+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53819ffe0 con 0x7fe538109850 2024-07-26T12:22:22.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.697+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5381a6800 con 0x7fe538109850 2024-07-26T12:22:22.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.701+0000 7fe52f400640 1 -- 172.21.15.40:0/233860855 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe5300051d0 con 0x7fe538109850 2024-07-26T12:22:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.702+0000 7fe543a5d740 1 Processor -- start 2024-07-26T12:22:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.702+0000 7fe543a5d740 1 -- start start 2024-07-26T12:22:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe52f400640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5180b3c80 0x7fe5180b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace772550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace772a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace772fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe543a5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555ace6e8950 con 0x555ace3ccf60 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe543a5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555ace6d7e50 con 0x555ace3ac280 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe543a5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555ace6dbe90 con 0x555ace3a40a0 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe52f400640 1 -- 172.21.15.40:0/233860855 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5300e3ed0 con 0x7fe538109850 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe535e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace772550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe535e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace772550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56776/0 (socket says 172.21.15.40:56776) 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.703+0000 7fe535e00640 1 -- 172.21.15.40:0/341438479 learned_addr learned my addr 172.21.15.40:0/341438479 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe536800640 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace772fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe52d400640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5180b3c80 0x7fe5180b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe535e00640 1 -- 172.21.15.40:0/341438479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 msgr2=0x555ace772a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe535e00640 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace772a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe535e00640 1 -- 172.21.15.40:0/341438479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 msgr2=0x555ace772fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe535e00640 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace772fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe535e00640 1 -- 172.21.15.40:0/341438479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ace67f0f0 con 0x555ace3ccf60 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.704+0000 7fe535e00640 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace772550 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe52800ad00 tx=0x7fe52800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5445be770ca15070 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.705+0000 7fe527400640 1 -- 172.21.15.40:0/341438479 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52801d070 con 0x555ace3ccf60 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.705+0000 7fe52d400640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5180b3c80 0x7fe5180b6190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe5200057c0 tx=0x7fe520005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.705+0000 7fe527400640 1 -- 172.21.15.40:0/341438479 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe528018ad0 con 0x555ace3ccf60 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.705+0000 7fe527400640 1 -- 172.21.15.40:0/341438479 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5280109f0 con 0x555ace3ccf60 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 -- 172.21.15.40:0/341438479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 msgr2=0x555ace772550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace772550 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe52800ad00 tx=0x7fe52800f790 comp rx=0 tx=0).stop 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 -- 172.21.15.40:0/341438479 shutdown_connections 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace772fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace772a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 --2- 172.21.15.40:0/341438479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace772550 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 -- 172.21.15.40:0/341438479 >> 172.21.15.40:0/341438479 conn(0x555ace3c1350 msgr2=0x555ace770440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 -- 172.21.15.40:0/341438479 shutdown_connections 2024-07-26T12:22:22.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.706+0000 7fe543a5d740 1 -- 172.21.15.40:0/341438479 wait complete. 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.707+0000 7fe543a5d740 1 -- start start 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.707+0000 7fe543a5d740 1 Processor -- start 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.707+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace782480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace7829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace78e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe543a5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555ace53b5f0 con 0x555ace3a40a0 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe543a5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555ace674520 con 0x555ace3ccf60 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe543a5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555ace785090 con 0x555ace3ac280 2024-07-26T12:22:22.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe543a5d740 10 client.0 _ll_register_callbacks cb 0x555ace683ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace782480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace782480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56782/0 (socket says 172.21.15.40:56782) 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 -- 172.21.15.40:0/764724465 learned_addr learned my addr 172.21.15.40:0/764724465 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe52d400640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace7829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe536800640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace78e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 -- 172.21.15.40:0/764724465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 msgr2=0x555ace7829c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace7829c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 -- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 msgr2=0x555ace78e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace78e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.708+0000 7fe535e00640 1 -- 172.21.15.40:0/764724465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ace438540 con 0x555ace3a40a0 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.709+0000 7fe535e00640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace782480 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe528010690 tx=0x7fe528018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9257e45dc7467ed4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:22.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.709+0000 7fe51fe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:22.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.709+0000 7fe51fe00640 1 -- 172.21.15.40:0/764724465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528026020 con 0x555ace3a40a0 2024-07-26T12:22:22.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.709+0000 7fe51fe00640 1 -- 172.21.15.40:0/764724465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe528005240 con 0x555ace3a40a0 2024-07-26T12:22:22.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.709+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe528018ad0 con 0x555ace3a40a0 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe51fe00640 1 -- 172.21.15.40:0/764724465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe52801d070 con 0x555ace3a40a0 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 10 client.15291 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555ace791010 con 0x555ace3a40a0 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe51fe00640 1 -- 172.21.15.40:0/764724465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe528018ad0 con 0x555ace3a40a0 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe51fe00640 1 -- 172.21.15.40:0/764724465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe5280046c0 con 0x555ace3a40a0 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 10 client.15291 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2024-07-26T12:22:22.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 20 client.15291 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:22.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace38b8e0 0x555ace794700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 4 client.15291 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:22:22.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.710+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ace6ea8a0 con 0x555ace38b8e0 2024-07-26T12:22:22.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.711+0000 7fe52d400640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace38b8e0 0x555ace794700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.712+0000 7fe52d400640 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace38b8e0 0x555ace794700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf4820b5d39c8c4 server_cookie=6810011ac5329425 in_seq=0 out_seq=0 2024-07-26T12:22:22.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.712+0000 7fe51fe00640 10 client.15291 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T12:22:22.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.714+0000 7fe51fe00640 1 -- 172.21.15.40:0/764724465 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ace6ea8a0 con 0x555ace38b8e0 2024-07-26T12:22:22.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.714+0000 7fe51fe00640 10 client.15291 handle_command_reply: tid=0 2024-07-26T12:22:22.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.714+0000 7fe543a5d740 1 client.15291 shutdown 2024-07-26T12:22:22.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.714+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 msgr2=0x555ace782480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.714+0000 7fe543a5d740 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace782480 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe528010690 tx=0x7fe528018670 comp rx=0 tx=0).stop 2024-07-26T12:22:22.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 shutdown_connections 2024-07-26T12:22:22.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace38b8e0 0x555ace794700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace78e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace7829c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe51fe00640 0 client.15291 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T12:22:22.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 --2- 172.21.15.40:0/764724465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace782480 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 >> 172.21.15.40:0/764724465 conn(0x555ace3c1350 msgr2=0x555ace76e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:22.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 shutdown_connections 2024-07-26T12:22:22.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.715+0000 7fe543a5d740 1 -- 172.21.15.40:0/764724465 wait complete. 2024-07-26T12:22:22.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.716+0000 7fe543a5d740 20 client.15291 trim_cache size 0 max 16384 2024-07-26T12:22:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 Processor -- start 2024-07-26T12:22:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 -- start start 2024-07-26T12:22:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace794700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace781770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace77d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555ace792a40 con 0x555ace3a40a0 2024-07-26T12:22:22.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555ace793110 con 0x555ace3ccf60 2024-07-26T12:22:22.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.736+0000 7fe543a5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555ace7937e0 con 0x555ace3ac280 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace794700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace794700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56788/0 (socket says 172.21.15.40:56788) 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 -- 172.21.15.40:0/3172933203 learned_addr learned my addr 172.21.15.40:0/3172933203 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe52d400640 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace781770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 -- 172.21.15.40:0/3172933203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 msgr2=0x555ace781770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace781770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 -- 172.21.15.40:0/3172933203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 msgr2=0x555ace77d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace77d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 -- 172.21.15.40:0/3172933203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ace775380 con 0x555ace3a40a0 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe52d400640 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace781770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:22:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.737+0000 7fe535e00640 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace794700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe52801a000 tx=0x7fe52800ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5179835fbb5b73ec server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:22.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.738+0000 7fe526a00640 1 -- 172.21.15.40:0/3172933203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52803b070 con 0x555ace3a40a0 2024-07-26T12:22:22.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.738+0000 7fe526a00640 1 -- 172.21.15.40:0/3172933203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe52801e040 con 0x555ace3a40a0 2024-07-26T12:22:22.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.738+0000 7fe526a00640 1 -- 172.21.15.40:0/3172933203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528026040 con 0x555ace3a40a0 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 -- 172.21.15.40:0/3172933203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 msgr2=0x555ace794700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace794700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe52801a000 tx=0x7fe52800ac00 comp rx=0 tx=0).stop 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 -- 172.21.15.40:0/3172933203 shutdown_connections 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ccf60 0x555ace77d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3ac280 0x555ace781770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 --2- 172.21.15.40:0/3172933203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3a40a0 0x555ace794700 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 -- 172.21.15.40:0/3172933203 >> 172.21.15.40:0/3172933203 conn(0x555ace3c1350 msgr2=0x555ace774840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 -- 172.21.15.40:0/3172933203 shutdown_connections 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.739+0000 7fe543a5d740 1 -- 172.21.15.40:0/3172933203 wait complete. 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 -- start start 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 Processor -- start 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace79a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace79add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace795f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555ace794580 con 0x555ace3ccf60 2024-07-26T12:22:22.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555ace793eb0 con 0x555ace3ac280 2024-07-26T12:22:22.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555ace794c50 con 0x555ace3a40a0 2024-07-26T12:22:22.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.740+0000 7fe543a5d740 10 client.0 _ll_register_callbacks cb 0x7fe528010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace795f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace795f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56802/0 (socket says 172.21.15.40:56802) 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 -- 172.21.15.40:0/2338330322 learned_addr learned my addr 172.21.15.40:0/2338330322 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe535e00640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace79a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe52d400640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace79add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 -- 172.21.15.40:0/2338330322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 msgr2=0x555ace79a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace79a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 -- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 msgr2=0x555ace79add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace79add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 -- 172.21.15.40:0/2338330322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ace773340 con 0x555ace3ccf60 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe535e00640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace79a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe536800640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace795f10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5300aad70 tx=0x7fe5300aa8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a962a18f6f31dceb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.741+0000 7fe51fe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe51fe00640 1 -- 172.21.15.40:0/2338330322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5300ae070 con 0x555ace3ccf60 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe51fe00640 1 -- 172.21.15.40:0/2338330322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5300a7070 con 0x555ace3ccf60 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe52801e040 con 0x555ace3ccf60 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe51fe00640 1 -- 172.21.15.40:0/2338330322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe53001d040 con 0x555ace3ccf60 2024-07-26T12:22:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe543a5d740 10 client.15297 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555ace797b00 con 0x555ace3ccf60 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe51fe00640 1 -- 172.21.15.40:0/2338330322 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe52801e040 con 0x555ace3ccf60 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.742+0000 7fe51fe00640 1 -- 172.21.15.40:0/2338330322 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe53001d1e0 con 0x555ace3ccf60 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe543a5d740 10 client.15297 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe543a5d740 10 client.15297 resolve_mds: resolved name 'h' to daemon mds.h 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe543a5d740 20 client.15297 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe543a5d740 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace360c90 0x555ace800970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe543a5d740 4 client.15297 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "status"}) -- 0x555ace6e6340 con 0x555ace360c90 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.743+0000 7fe535e00640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace360c90 0x555ace800970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.744+0000 7fe535e00640 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace360c90 0x555ace800970 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55c9f8e0a6be30fd server_cookie=b0acc1cd791ef051 in_seq=0 out_seq=0 2024-07-26T12:22:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.744+0000 7fe51fe00640 10 client.15297 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe51fe00640 1 -- 172.21.15.40:0/2338330322 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555ace6e6340 con 0x555ace360c90 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe51fe00640 10 client.15297 handle_command_reply: tid=0 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 client.15297 shutdown 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 msgr2=0x555ace795f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace795f10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5300aad70 tx=0x7fe5300aa8f0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 shutdown_connections 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x555ace360c90 0x555ace800970 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555ace3ccf60 0x555ace795f10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe51fe00640 0 client.15297 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555ace3ac280 0x555ace79add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 --2- 172.21.15.40:0/2338330322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ace3a40a0 0x555ace79a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.745+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 >> 172.21.15.40:0/2338330322 conn(0x555ace3c1350 msgr2=0x555ace774840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.746+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 shutdown_connections 2024-07-26T12:22:22.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.746+0000 7fe543a5d740 1 -- 172.21.15.40:0/2338330322 wait complete. 2024-07-26T12:22:22.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.746+0000 7fe543a5d740 20 client.15297 trim_cache size 0 max 16384 2024-07-26T12:22:22.754 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:22:22.754 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:22:22.754 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2024-07-26T12:22:22.754 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34592, 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 214.759691546, 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 267.56972458500002 2024-07-26T12:22:22.755 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5180b3c80 msgr2=0x7fe5180b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5180b3c80 0x7fe5180b6190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe5200057c0 tx=0x7fe520005a40 comp rx=0 tx=0).stop 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 msgr2=0x7fe53819f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 0x7fe53819f680 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe53000cad0 tx=0x7fe53000ced0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 shutdown_connections 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe538109850 0x7fe53819f680 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe538108f00 0x7fe53819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5180b3c80 0x7fe5180b6190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 --2- 172.21.15.40:0/233860855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5381035c0 0x7fe538199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 >> 172.21.15.40:0/233860855 conn(0x7fe5380ff010 msgr2=0x7fe538101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 shutdown_connections 2024-07-26T12:22:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:22.747+0000 7fe53ce00640 1 -- 172.21.15.40:0/233860855 wait complete. 2024-07-26T12:22:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:23 smithi040 ceph-mon[32397]: pgmap v504: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:23.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.b status 2024-07-26T12:22:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:23 smithi146 ceph-mon[35807]: pgmap v504: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:23 smithi076 ceph-mon[35401]: pgmap v504: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:23.958 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:25 smithi040 ceph-mon[32397]: pgmap v505: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:25 smithi146 ceph-mon[35807]: pgmap v505: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:25 smithi076 ceph-mon[35401]: pgmap v505: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.052+0000 7f0a7fe00640 1 -- 172.21.15.40:0/3320737304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 msgr2=0x7f0a80104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.052+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/3320737304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80104610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009900 tx=0x7f0a7002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 -- 172.21.15.40:0/3320737304 shutdown_connections 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/3320737304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a8010d660 0x7f0a8010fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/3320737304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a80104b50 0x7f0a8010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/3320737304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80104610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 -- 172.21.15.40:0/3320737304 >> 172.21.15.40:0/3320737304 conn(0x7f0a800fdd00 msgr2=0x7f0a80100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 -- 172.21.15.40:0/3320737304 shutdown_connections 2024-07-26T12:22:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.053+0000 7f0a7fe00640 1 -- 172.21.15.40:0/3320737304 wait complete. 2024-07-26T12:22:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.054+0000 7f0a7fe00640 1 Processor -- start 2024-07-26T12:22:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 -- start start 2024-07-26T12:22:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a80104b50 0x7f0a8019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a8010d660 0x7f0a8019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0a801131f0 con 0x7f0a80104200 2024-07-26T12:22:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0a80113070 con 0x7f0a80104b50 2024-07-26T12:22:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a80113370 con 0x7f0a8010d660 2024-07-26T12:22:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60588/0 (socket says 172.21.15.40:60588) 2024-07-26T12:22:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.055+0000 7f0a7ea00640 1 -- 172.21.15.40:0/637528125 learned_addr learned my addr 172.21.15.40:0/637528125 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7e000640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a80104b50 0x7f0a8019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7f400640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a8010d660 0x7f0a8019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7ea00640 1 -- 172.21.15.40:0/637528125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a8010d660 msgr2=0x7f0a8019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a8010d660 0x7f0a8019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7ea00640 1 -- 172.21.15.40:0/637528125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a80104b50 msgr2=0x7f0a8019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a80104b50 0x7f0a8019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7ea00640 1 -- 172.21.15.40:0/637528125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8019fb10 con 0x7f0a80104200 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.056+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80199c60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0a7002a910 tx=0x7f0a70003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.057+0000 7f0a84a00640 1 -- 172.21.15.40:0/637528125 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7003f070 con 0x7f0a80104200 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.057+0000 7f0a84a00640 1 -- 172.21.15.40:0/637528125 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a70003e40 con 0x7f0a80104200 2024-07-26T12:22:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.057+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8019fda0 con 0x7f0a80104200 2024-07-26T12:22:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.057+0000 7f0a84a00640 1 -- 172.21.15.40:0/637528125 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70035030 con 0x7f0a80104200 2024-07-26T12:22:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.057+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a801a02d0 con 0x7f0a80104200 2024-07-26T12:22:26.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 Processor -- start 2024-07-26T12:22:26.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 -- start start 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760de6c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de6ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de6d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55760dde2970 con 0x55760daa6280 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55760ddd1e70 con 0x55760da9e0a0 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55760ddd5eb0 con 0x55760dac6f60 2024-07-26T12:22:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.061+0000 7f0a84a00640 1 -- 172.21.15.40:0/637528125 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0a70042070 con 0x7f0a80104200 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de6d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de6d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60590/0 (socket says 172.21.15.40:60590) 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 -- 172.21.15.40:0/1004334555 learned_addr learned my addr 172.21.15.40:0/1004334555 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7f400640 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760de6c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de6ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 -- 172.21.15.40:0/1004334555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 msgr2=0x55760de6c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760de6c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 -- 172.21.15.40:0/1004334555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 msgr2=0x55760de6ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de6ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.062+0000 7f0a7e000640 1 -- 172.21.15.40:0/1004334555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760dd79110 con 0x55760daa6280 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.063+0000 7f0a7e000640 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de6d200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bc20 tx=0x7f0a6c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3e011e9a819abf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.063+0000 7f0a6be00640 1 -- 172.21.15.40:0/1004334555 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c015070 con 0x55760daa6280 2024-07-26T12:22:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.063+0000 7f0a6be00640 1 -- 172.21.15.40:0/1004334555 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a6c01a8f0 con 0x55760daa6280 2024-07-26T12:22:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.063+0000 7f0a6be00640 1 -- 172.21.15.40:0/1004334555 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011800 con 0x55760daa6280 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.064+0000 7f0a84a00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0a640b3c80 0x7f0a640b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.064+0000 7f0a7f400640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0a640b3c80 0x7f0a640b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.064+0000 7f0a84a00640 1 -- 172.21.15.40:0/637528125 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a70104400 con 0x7f0a80104200 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.064+0000 7f0a8cc22740 1 -- 172.21.15.40:0/1004334555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 msgr2=0x55760de6d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.064+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de6d200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bc20 tx=0x7f0a6c00f730 comp rx=0 tx=0).stop 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 -- 172.21.15.40:0/1004334555 shutdown_connections 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de6d200 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de6ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/1004334555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760de6c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 -- 172.21.15.40:0/1004334555 >> 172.21.15.40:0/1004334555 conn(0x55760dabb350 msgr2=0x55760de6a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a7f400640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0a640b3c80 0x7f0a640b6190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0a78007ed0 tx=0x7f0a78007680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:26.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 -- 172.21.15.40:0/1004334555 shutdown_connections 2024-07-26T12:22:26.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.065+0000 7f0a8cc22740 1 -- 172.21.15.40:0/1004334555 wait complete. 2024-07-26T12:22:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.066+0000 7f0a8cc22740 1 -- start start 2024-07-26T12:22:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.066+0000 7f0a8cc22740 1 Processor -- start 2024-07-26T12:22:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de77f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de78490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de842b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55760dc355f0 con 0x55760daa6280 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55760dd6e540 con 0x55760dac6f60 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55760de7af60 con 0x55760da9e0a0 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a8cc22740 10 client.0 _ll_register_callbacks cb 0x55760dd7df10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de78490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de78490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60598/0 (socket says 172.21.15.40:60598) 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7e000640 1 -- 172.21.15.40:0/2624079900 learned_addr learned my addr 172.21.15.40:0/2624079900 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de77f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7f400640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7e000640 1 -- 172.21.15.40:0/2624079900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 msgr2=0x55760de77f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7e000640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de77f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.067+0000 7f0a7e000640 1 -- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 msgr2=0x55760de842b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a7e000640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de842b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a7e000640 1 -- 172.21.15.40:0/2624079900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55760db32540 con 0x55760daa6280 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a7e000640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de78490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c011480 tx=0x7f0a6c00b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8435246fe903e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a68c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a68c00640 1 -- 172.21.15.40:0/2624079900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c028060 con 0x55760daa6280 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a68c00640 1 -- 172.21.15.40:0/2624079900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a6c01aaa0 con 0x55760daa6280 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.068+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a6c01a8f0 con 0x55760daa6280 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a68c00640 1 -- 172.21.15.40:0/2624079900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a6c015070 con 0x55760daa6280 2024-07-26T12:22:26.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a8cc22740 10 client.15309 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55760de86df0 con 0x55760daa6280 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a68c00640 1 -- 172.21.15.40:0/2624079900 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a6c01a8f0 con 0x55760daa6280 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a68c00640 1 -- 172.21.15.40:0/2624079900 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0a6c02d070 con 0x55760daa6280 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a8cc22740 10 client.15309 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.069+0000 7f0a8cc22740 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.070+0000 7f0a8cc22740 20 client.15309 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.070+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da858e0 0x55760de8a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.070+0000 7f0a8cc22740 4 client.15309 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:22:26.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.070+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55760dde48c0 con 0x55760da858e0 2024-07-26T12:22:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.070+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da858e0 0x55760de8a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.071+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da858e0 0x55760de8a450 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3ed450b0d0ec2b server_cookie=fe0ee5930fcc2aa in_seq=0 out_seq=0 2024-07-26T12:22:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.071+0000 7f0a68c00640 10 client.15309 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:22:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a68c00640 1 -- 172.21.15.40:0/2624079900 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55760dde48c0 con 0x55760da858e0 2024-07-26T12:22:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a68c00640 10 client.15309 handle_command_reply: tid=0 2024-07-26T12:22:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 client.15309 shutdown 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 msgr2=0x55760de78490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de78490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c011480 tx=0x7f0a6c00b970 comp rx=0 tx=0).stop 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 shutdown_connections 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de842b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da858e0 0x55760de8a450 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.073+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de78490 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.074+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2624079900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de77f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.074+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 >> 172.21.15.40:0/2624079900 conn(0x55760dabb350 msgr2=0x55760de6f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.074+0000 7f0a68c00640 0 client.15309 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:22:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.074+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 shutdown_connections 2024-07-26T12:22:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.074+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2624079900 wait complete. 2024-07-26T12:22:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.074+0000 7f0a8cc22740 20 client.15309 trim_cache size 0 max 16384 2024-07-26T12:22:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 Processor -- start 2024-07-26T12:22:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 -- start start 2024-07-26T12:22:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de72870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55760de88790 con 0x55760daa6280 2024-07-26T12:22:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55760de88e60 con 0x55760dac6f60 2024-07-26T12:22:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.094+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55760de89530 con 0x55760da9e0a0 2024-07-26T12:22:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de896b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60614/0 (socket says 172.21.15.40:60614) 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 -- 172.21.15.40:0/2133207240 learned_addr learned my addr 172.21.15.40:0/2133207240 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de72870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7f400640 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 -- 172.21.15.40:0/2133207240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 msgr2=0x55760de72870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de72870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 -- 172.21.15.40:0/2133207240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 msgr2=0x55760de84220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de84220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.095+0000 7f0a7e000640 1 -- 172.21.15.40:0/2133207240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760de657f0 con 0x55760daa6280 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.096+0000 7f0a7e000640 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de896b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00f770 tx=0x7f0a6c004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cc92fbbe5ce9f9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.096+0000 7f0a6b400640 1 -- 172.21.15.40:0/2133207240 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c033020 con 0x55760daa6280 2024-07-26T12:22:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.096+0000 7f0a6b400640 1 -- 172.21.15.40:0/2133207240 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a6c00b3a0 con 0x55760daa6280 2024-07-26T12:22:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.096+0000 7f0a6b400640 1 -- 172.21.15.40:0/2133207240 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c028070 con 0x55760daa6280 2024-07-26T12:22:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2133207240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 msgr2=0x55760de896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de896b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00f770 tx=0x7f0a6c004f80 comp rx=0 tx=0).stop 2024-07-26T12:22:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2133207240 shutdown_connections 2024-07-26T12:22:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760dac6f60 0x55760de84220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de896b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/2133207240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760da9e0a0 0x55760de72870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2133207240 >> 172.21.15.40:0/2133207240 conn(0x55760dabb350 msgr2=0x55760de767d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2133207240 shutdown_connections 2024-07-26T12:22:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.097+0000 7f0a8cc22740 1 -- 172.21.15.40:0/2133207240 wait complete. 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.098+0000 7f0a8cc22740 1 -- start start 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.098+0000 7f0a8cc22740 1 Processor -- start 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de8fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760def5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55760de8a2d0 con 0x55760daa6280 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55760de89c00 con 0x55760da9e0a0 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55760de8a9a0 con 0x55760dac6f60 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a8cc22740 10 client.0 _ll_register_callbacks cb 0x7f0a6c00b830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:22:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de900c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60630/0 (socket says 172.21.15.40:60630) 2024-07-26T12:22:26.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.099+0000 7f0a7e000640 1 -- 172.21.15.40:0/763098956 learned_addr learned my addr 172.21.15.40:0/763098956 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7f400640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760def5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de8fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7e000640 1 -- 172.21.15.40:0/763098956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 msgr2=0x55760def5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7e000640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760def5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7e000640 1 -- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 msgr2=0x55760de8fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7e000640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de8fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7e000640 1 -- 172.21.15.40:0/763098956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55760def5c50 con 0x55760daa6280 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a7e000640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de900c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c004940 tx=0x7f0a6c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b0982cf8ebacf1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.100+0000 7f0a68c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:22:26.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a68c00640 1 -- 172.21.15.40:0/763098956 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c033030 con 0x55760daa6280 2024-07-26T12:22:26.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a68c00640 1 -- 172.21.15.40:0/763098956 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a6c005240 con 0x55760daa6280 2024-07-26T12:22:26.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a6c00b3a0 con 0x55760daa6280 2024-07-26T12:22:26.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a68c00640 1 -- 172.21.15.40:0/763098956 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a6c028040 con 0x55760daa6280 2024-07-26T12:22:26.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a8cc22740 10 client.15315 fetch_fsmap learned FSMap version 28 2024-07-26T12:22:26.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55760def6de0 con 0x55760daa6280 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.101+0000 7f0a68c00640 1 -- 172.21.15.40:0/763098956 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a6c00b3a0 con 0x55760daa6280 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a68c00640 1 -- 172.21.15.40:0/763098956 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0a6c02d070 con 0x55760daa6280 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a8cc22740 10 client.15315 fetch_fsmap finished waiting for FSMap version 28 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a8cc22740 10 client.15315 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a8cc22740 20 client.15315 populate_metadata read hostname 'smithi040' 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da5ac90 0x55760defa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a8cc22740 4 client.15315 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.102+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "status"}) -- 0x55760dde0360 con 0x55760da5ac90 2024-07-26T12:22:26.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.103+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da5ac90 0x55760defa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:26.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.103+0000 7f0a7ea00640 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da5ac90 0x55760defa350 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49eec9a7103811b5 server_cookie=13c827a62425bded in_seq=0 out_seq=0 2024-07-26T12:22:26.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.103+0000 7f0a68c00640 10 client.15315 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:22:26.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a68c00640 1 -- 172.21.15.40:0/763098956 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55760dde0360 con 0x55760da5ac90 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a68c00640 10 client.15315 handle_command_reply: tid=0 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a8cc22740 1 client.15315 shutdown 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 msgr2=0x55760de900c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de900c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c004940 tx=0x7f0a6c01baf0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 shutdown_connections 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760dac6f60 0x55760def5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.104+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55760da5ac90 0x55760defa350 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55760daa6280 0x55760de900c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a8cc22740 1 --2- 172.21.15.40:0/763098956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55760da9e0a0 0x55760de8fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 >> 172.21.15.40:0/763098956 conn(0x55760dabb350 msgr2=0x55760de69e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a68c00640 0 client.15315 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 shutdown_connections 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a8cc22740 1 -- 172.21.15.40:0/763098956 wait complete. 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.105+0000 7f0a8cc22740 20 client.15315 trim_cache size 0 max 16384 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-07-26T12:22:26.107 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34631, 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 233.523817347, 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 28, 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 80, 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 254.77706344500001 2024-07-26T12:22:26.108 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.106+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0a640b3c80 msgr2=0x7f0a640b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.106+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0a640b3c80 0x7f0a640b6190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0a78007ed0 tx=0x7f0a78007680 comp rx=0 tx=0).stop 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.106+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 msgr2=0x7f0a80199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.106+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80199c60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0a7002a910 tx=0x7f0a70003c20 comp rx=0 tx=0).stop 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 shutdown_connections 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0a640b3c80 0x7f0a640b6190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a8010d660 0x7f0a8019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0a80104b50 0x7f0a8019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 --2- 172.21.15.40:0/637528125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80104200 0x7f0a80199c60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 >> 172.21.15.40:0/637528125 conn(0x7f0a800fdd00 msgr2=0x7f0a800fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 shutdown_connections 2024-07-26T12:22:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:26.107+0000 7f0a7fe00640 1 -- 172.21.15.40:0/637528125 wait complete. 2024-07-26T12:22:27.000 INFO:teuthology.run_tasks:Running task sequential... 2024-07-26T12:22:27.011 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-07-26T12:22:27.011 INFO:teuthology.task.sequential:In sequential, running task print... 2024-07-26T12:22:27.011 INFO:teuthology.task.print:Enabling mgr modules 2024-07-26T12:22:27.011 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-07-26T12:22:27.109 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-07-26T12:22:27.109 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-07-26T12:22:27.109 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-07-26T12:22:27.110 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-26T12:22:27.110 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:27.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:27.110 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-07-26T12:22:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:27.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-07-26T12:22:27.270 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-07-26T12:22:27.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T12:22:27.274 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-07-26T12:22:27.274 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-07-26T12:22:27.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs ls 2024-07-26T12:22:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:27 smithi146 ceph-mon[35807]: pgmap v506: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:27 smithi076 ceph-mon[35401]: pgmap v506: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:27 smithi040 ceph-mon[32397]: pgmap v506: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:29 smithi146 ceph-mon[35807]: pgmap v507: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:29 smithi076 ceph-mon[35401]: pgmap v507: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:29.592 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:29 smithi040 ceph-mon[32397]: pgmap v507: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:29.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 -- 172.21.15.40:0/386860230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10b120 msgr2=0x7fb67c10b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:29.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 --2- 172.21.15.40:0/386860230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10b120 0x7fb67c10b530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb668009900 tx=0x7fb66802a400 comp rx=0 tx=0).stop 2024-07-26T12:22:29.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 -- 172.21.15.40:0/386860230 shutdown_connections 2024-07-26T12:22:29.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 --2- 172.21.15.40:0/386860230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb67c10ba70 0x7fb67c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:29.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 --2- 172.21.15.40:0/386860230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10b120 0x7fb67c10b530 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:29.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 --2- 172.21.15.40:0/386860230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67c1057e0 0x7fb67c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:29.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 -- 172.21.15.40:0/386860230 >> 172.21.15.40:0/386860230 conn(0x7fb67c101210 msgr2=0x7fb67c103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:29.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 -- 172.21.15.40:0/386860230 shutdown_connections 2024-07-26T12:22:29.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.963+0000 7fb684600640 1 -- 172.21.15.40:0/386860230 wait complete. 2024-07-26T12:22:29.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 Processor -- start 2024-07-26T12:22:29.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 -- start start 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67c1057e0 0x7fb67c19c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb67c10b120 0x7fb67c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 0x7fb67c1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c1155e0 con 0x7fb67c10ba70 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c115460 con 0x7fb67c10b120 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.965+0000 7fb684600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c115760 con 0x7fb67c1057e0 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 0x7fb67c1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 0x7fb67c1a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60660/0 (socket says 172.21.15.40:60660) 2024-07-26T12:22:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 -- 172.21.15.40:0/2100216114 learned_addr learned my addr 172.21.15.40:0/2100216114 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb681200640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb67c10b120 0x7fb67c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb681c00640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67c1057e0 0x7fb67c19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 -- 172.21.15.40:0/2100216114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67c1057e0 msgr2=0x7fb67c19c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67c1057e0 0x7fb67c19c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 -- 172.21.15.40:0/2100216114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb67c10b120 msgr2=0x7fb67c19c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb67c10b120 0x7fb67c19c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.966+0000 7fb682600640 1 -- 172.21.15.40:0/2100216114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c1a1f00 con 0x7fb67c10ba70 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.967+0000 7fb682600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 0x7fb67c1a1890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb67400cce0 tx=0x7fb67400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.967+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67400f450 con 0x7fb67c10ba70 2024-07-26T12:22:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.967+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c1a21f0 con 0x7fb67c10ba70 2024-07-26T12:22:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.967+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb67400fa80 con 0x7fb67c10ba70 2024-07-26T12:22:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.967+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674018ad0 con 0x7fb67c10ba70 2024-07-26T12:22:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.967+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c1a8a10 con 0x7fb67c10ba70 2024-07-26T12:22:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.968+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c105bf0 con 0x7fb67c10ba70 2024-07-26T12:22:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.971+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb67400f5f0 con 0x7fb67c10ba70 2024-07-26T12:22:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.973+0000 7fb67a000640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6640b3c00 0x7fb6640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.973+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb6740e44a0 con 0x7fb67c10ba70 2024-07-26T12:22:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.973+0000 7fb681c00640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6640b3c00 0x7fb6640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.974+0000 7fb681c00640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6640b3c00 0x7fb6640b6110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb670005e10 tx=0x7fb670005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:29.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:29.975+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb674014030 con 0x7fb67c10ba70 2024-07-26T12:22:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.216+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb67c10d8b0 con 0x7fb67c10ba70 2024-07-26T12:22:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.217+0000 7fb67a000640 1 -- 172.21.15.40:0/2100216114 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fb67c10d8b0 con 0x7fb67c10ba70 2024-07-26T12:22:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-26T12:22:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6640b3c00 msgr2=0x7fb6640b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6640b3c00 0x7fb6640b6110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb670005e10 tx=0x7fb670005da0 comp rx=0 tx=0).stop 2024-07-26T12:22:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 msgr2=0x7fb67c1a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 0x7fb67c1a1890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb67400cce0 tx=0x7fb67400a620 comp rx=0 tx=0).stop 2024-07-26T12:22:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 shutdown_connections 2024-07-26T12:22:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c10ba70 0x7fb67c1a1890 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb67c10b120 0x7fb67c19c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb6640b3c00 0x7fb6640b6110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 --2- 172.21.15.40:0/2100216114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67c1057e0 0x7fb67c19c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 >> 172.21.15.40:0/2100216114 conn(0x7fb67c101210 msgr2=0x7fb67c10a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.220+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 shutdown_connections 2024-07-26T12:22:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:30.221+0000 7fb684600640 1 -- 172.21.15.40:0/2100216114 wait complete. 2024-07-26T12:22:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:30 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2100216114' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T12:22:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:30 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2100216114' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T12:22:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:30 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2100216114' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-26T12:22:30.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-26T12:22:30.982 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-26T12:22:30.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:30.982 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-07-26T12:22:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-26T12:22:31.041 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-26T12:22:31.041 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T12:22:31.042 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 41608sec preferred_lft 41608sec 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-07-26T12:22:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-07-26T12:22:31.044 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-26T12:22:31.044 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T12:22:31.045 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-07-26T12:22:31.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-07-26T12:22:31.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-07-26T12:22:31.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-07-26T12:22:31.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-26T12:22:31.045 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-07-26T12:22:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T12:22:31.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:31 smithi040 ceph-mon[32397]: pgmap v508: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:31.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T12:22:31.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:31.556 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-26T12:22:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:31 smithi146 ceph-mon[35807]: pgmap v508: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:31 smithi076 ceph-mon[35401]: pgmap v508: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:22:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-07-26T12:22:31.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:31.641 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-07-26T12:22:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-07-26T12:22:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-26T12:22:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-07-26T12:22:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-07-26T12:22:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-26T12:22:31.699 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T12:22:31.699 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-07-26T12:22:31.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-07-26T12:22:31.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-07-26T12:22:31.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-07-26T12:22:31.699 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-07-26T12:22:31.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T12:22:32.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T12:22:32.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:32.496 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-07-26T12:22:32.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:32.552 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-07-26T12:22:32.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T12:22:32.607 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-07-26T12:22:32.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:32.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-07-26T12:22:32.607 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-07-26T12:22:32.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T12:22:32.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T12:22:32.796 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-07-26T12:22:32.796 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T12:22:32.796 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-07-26T12:22:32.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-07-26T12:22:32.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-26T12:22:32.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-07-26T12:22:32.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-07-26T12:22:32.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-07-26T12:22:32.797 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-07-26T12:22:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T12:22:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T12:22:33.102 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-26T12:22:33.102 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-07-26T12:22:33.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-07-26T12:22:33.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-07-26T12:22:33.102 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-07-26T12:22:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-26T12:22:33.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T12:22:33.311 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-07-26T12:22:33.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-26T12:22:33.311 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:33.353 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-26T12:22:33.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-26T12:22:33.353 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:33.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-07-26T12:22:33.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:33 smithi040 ceph-mon[32397]: pgmap v509: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:33.519 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-07-26T12:22:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-07-26T12:22:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-26T12:22:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/92222a7cc00cac285bf94c71aaf1388be8d1331b95f9e9f112d43288b488121f/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/61f72f747b4310e18502d66b22dd93c7511727caa89974bd5422db668a0f246d/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/0 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/29c2f5b821e95411cf3f7dc2d62a41c3eb0a67dbda49f8fad06cd49f7f23b6e1/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/2a22a4c1d80052cb9f0e17c8c8a43fd49b64c31bb150f267da3ab2095e01384a/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/4eba02675a78d9c18ac707cf444dc0cff149b7651671c1fc44e99811d6621be1/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/852bef71264993b98e28c94502fb5cb6a2742e7d25c70dcd558fdad6cae529e2/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/b78e78c8e360e65dc309497a45133c3c41f67d1e76efa91d4e4398ed2e662b87/merged 2024-07-26T12:22:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/fbe4255355c55a8451c501871102c62f766328ff5c851d6904b3bfd4aa3cfd85/merged 2024-07-26T12:22:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/0c616ed58b59bc5aa1dcbaec2454673d85b0947dd83d7af020b509cfb85c653f/merged 2024-07-26T12:22:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/d26ca88ee54e49c7b07d9095a97eb7cf8536b32dda0b18bd194d1f9616150f09/merged 2024-07-26T12:22:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-07-26T12:22:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:33.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:33.569 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-07-26T12:22:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:33 smithi076 ceph-mon[35401]: pgmap v509: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:33.659 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-07-26T12:22:33.660 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/f8ec22a5-1dd9-4bc7-896e-f9394f2e691f --client_fs=cephfs) 2024-07-26T12:22:33.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-07-26T12:22:33.728 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-07-26T12:22:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-07-26T12:22:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-26T12:22:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/92222a7cc00cac285bf94c71aaf1388be8d1331b95f9e9f112d43288b488121f/merged 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/61f72f747b4310e18502d66b22dd93c7511727caa89974bd5422db668a0f246d/merged 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/0 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/29c2f5b821e95411cf3f7dc2d62a41c3eb0a67dbda49f8fad06cd49f7f23b6e1/merged 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/2a22a4c1d80052cb9f0e17c8c8a43fd49b64c31bb150f267da3ab2095e01384a/merged 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/4eba02675a78d9c18ac707cf444dc0cff149b7651671c1fc44e99811d6621be1/merged 2024-07-26T12:22:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/852bef71264993b98e28c94502fb5cb6a2742e7d25c70dcd558fdad6cae529e2/merged 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/b78e78c8e360e65dc309497a45133c3c41f67d1e76efa91d4e4398ed2e662b87/merged 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/fbe4255355c55a8451c501871102c62f766328ff5c851d6904b3bfd4aa3cfd85/merged 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/0c616ed58b59bc5aa1dcbaec2454673d85b0947dd83d7af020b509cfb85c653f/merged 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/d26ca88ee54e49c7b07d9095a97eb7cf8536b32dda0b18bd194d1f9616150f09/merged 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:33.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:33.775 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-07-26T12:22:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:33 smithi146 ceph-mon[35807]: pgmap v509: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:33.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2024-07-26T12:22:33.935+0000 7ff8d9688480 -1 init, newargv = 0x7ff8c4004f20 newargc=15 2024-07-26T12:22:33.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[89449]: starting ceph client 2024-07-26T12:22:33.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[89449]: starting fuse 2024-07-26T12:22:34.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-07-26T12:22:35.067 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-07-26T12:22:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-26T12:22:35.127 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/92222a7cc00cac285bf94c71aaf1388be8d1331b95f9e9f112d43288b488121f/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/61f72f747b4310e18502d66b22dd93c7511727caa89974bd5422db668a0f246d/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/0 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/29c2f5b821e95411cf3f7dc2d62a41c3eb0a67dbda49f8fad06cd49f7f23b6e1/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/2a22a4c1d80052cb9f0e17c8c8a43fd49b64c31bb150f267da3ab2095e01384a/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/4eba02675a78d9c18ac707cf444dc0cff149b7651671c1fc44e99811d6621be1/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/852bef71264993b98e28c94502fb5cb6a2742e7d25c70dcd558fdad6cae529e2/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/b78e78c8e360e65dc309497a45133c3c41f67d1e76efa91d4e4398ed2e662b87/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/fbe4255355c55a8451c501871102c62f766328ff5c851d6904b3bfd4aa3cfd85/merged 2024-07-26T12:22:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/0c616ed58b59bc5aa1dcbaec2454673d85b0947dd83d7af020b509cfb85c653f/merged 2024-07-26T12:22:35.129 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/d26ca88ee54e49c7b07d9095a97eb7cf8536b32dda0b18bd194d1f9616150f09/merged 2024-07-26T12:22:35.129 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-07-26T12:22:35.129 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:35.129 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-26T12:22:35.129 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:35.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:35.130 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-07-26T12:22:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:119 2024-07-26T12:22:35.183 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-07-26T12:22:35.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-07-26T12:22:35.184 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-07-26T12:22:35.185 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-07-26T12:22:35.361 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.89449.asok 2024-07-26T12:22:35.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-26T12:22:35.380 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89449.asok 2024-07-26T12:22:35.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:35.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89449.asok status 2024-07-26T12:22:35.691 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:22:35.691 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-07-26T12:22:35.691 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528", 2024-07-26T12:22:35.691 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev)", 2024-07-26T12:22:35.691 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "89449", 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/volumes/qa/sv_0/f8ec22a5-1dd9-4bc7-896e-f9394f2e691f" 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 15327, 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 15327 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-07-26T12:22:35.692 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 242569578 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 242569578 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.15327 192.168.0.1:0/242569578", 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/242569578", 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 5, 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 28, 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 82, 2024-07-26T12:22:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-07-26T12:22:35.694 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-07-26T12:22:35.694 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-07-26T12:22:35.694 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:22:35.710 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:35 smithi040 ceph-mon[32397]: pgmap v510: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:35.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:35.715 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-07-26T12:22:35.715 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:35.773 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-07-26T12:22:35.773 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:35.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T12:22:35.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-26T12:22:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:35 smithi146 ceph-mon[35807]: pgmap v510: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:35 smithi076 ceph-mon[35401]: pgmap v510: 97 pgs: 97 active+clean; 647 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:35.859 INFO:teuthology.run_tasks:Running task exec... 2024-07-26T12:22:35.873 INFO:teuthology.task.exec:Executing custom commands... 2024-07-26T12:22:35.873 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-07-26T12:22:35.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-07-26T12:22:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 -- 172.21.15.40:0/3235753217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104180 msgr2=0x7f2058104590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 --2- 172.21.15.40:0/3235753217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104180 0x7f2058104590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2044009900 tx=0x7f204402a410 comp rx=0 tx=0).stop 2024-07-26T12:22:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 -- 172.21.15.40:0/3235753217 shutdown_connections 2024-07-26T12:22:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 --2- 172.21.15.40:0/3235753217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104b20 0x7f205810b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 --2- 172.21.15.40:0/3235753217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104180 0x7f2058104590 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 --2- 172.21.15.40:0/3235753217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2058103100 0x7f2058103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 -- 172.21.15.40:0/3235753217 >> 172.21.15.40:0/3235753217 conn(0x7f20580fea60 msgr2=0x7f2058100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 -- 172.21.15.40:0/3235753217 shutdown_connections 2024-07-26T12:22:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.150+0000 7f205ec00640 1 -- 172.21.15.40:0/3235753217 wait complete. 2024-07-26T12:22:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.152+0000 7f205ec00640 1 Processor -- start 2024-07-26T12:22:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.152+0000 7f205ec00640 1 -- start start 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.152+0000 7f205ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2058103100 0x7f205819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.152+0000 7f205ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104180 0x7f205819c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.152+0000 7f205ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 0x7f205819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.152+0000 7f205ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f205810ec80 con 0x7f2058104b20 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f205810eb00 con 0x7f2058104180 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f205810ee00 con 0x7f2058103100 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 0x7f205819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:36.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 0x7f205819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38354/0 (socket says 172.21.15.40:38354) 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 -- 172.21.15.40:0/3786532780 learned_addr learned my addr 172.21.15.40:0/3786532780 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f2057400640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104180 0x7f205819c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f2057e00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2058103100 0x7f205819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 -- 172.21.15.40:0/3786532780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2058103100 msgr2=0x7f205819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2058103100 0x7f205819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 -- 172.21.15.40:0/3786532780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104180 msgr2=0x7f205819c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104180 0x7f205819c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f205cc00640 1 -- 172.21.15.40:0/3786532780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205819d500 con 0x7f2058104b20 2024-07-26T12:22:36.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.153+0000 7f2057400640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104180 0x7f205819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:36.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.154+0000 7f205cc00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 0x7f205819cce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f205000eb10 tx=0x7f205000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:36.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.154+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050004b20 con 0x7f2058104b20 2024-07-26T12:22:36.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.154+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2050004cc0 con 0x7f2058104b20 2024-07-26T12:22:36.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.154+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205819d7f0 con 0x7f2058104b20 2024-07-26T12:22:36.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.154+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050010690 con 0x7f2058104b20 2024-07-26T12:22:36.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.154+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20581a3ee0 con 0x7f2058104b20 2024-07-26T12:22:36.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.155+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20581a40b0 con 0x7f2058104b20 2024-07-26T12:22:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.158+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2050005000 con 0x7f2058104b20 2024-07-26T12:22:36.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.159+0000 7f2054c00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f203c0b3c50 0x7f203c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:36.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.160+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f20500e44c0 con 0x7f2058104b20 2024-07-26T12:22:36.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.160+0000 7f2057e00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f203c0b3c50 0x7f203c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:36.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.161+0000 7f2057e00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f203c0b3c50 0x7f203c0b6160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2048009b60 tx=0x7f2048005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:36.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.162+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2050055600 con 0x7f2058104b20 2024-07-26T12:22:36.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:36.423+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f20581a4280 con 0x7f2058104b20 2024-07-26T12:22:37.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.354+0000 7f2054c00640 1 -- 172.21.15.40:0/3786532780 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f20500abad0 con 0x7f2058104b20 2024-07-26T12:22:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.358+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f203c0b3c50 msgr2=0x7f203c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.358+0000 7f205ec00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f203c0b3c50 0x7f203c0b6160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2048009b60 tx=0x7f2048005f90 comp rx=0 tx=0).stop 2024-07-26T12:22:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.358+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 msgr2=0x7f205819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.358+0000 7f205ec00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 0x7f205819cce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f205000eb10 tx=0x7f205000c2d0 comp rx=0 tx=0).stop 2024-07-26T12:22:37.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 shutdown_connections 2024-07-26T12:22:37.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2058104b20 0x7f205819cce0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:37.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2058104180 0x7f205819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:37.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f203c0b3c50 0x7f203c0b6160 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 --2- 172.21.15.40:0/3786532780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2058103100 0x7f205819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 >> 172.21.15.40:0/3786532780 conn(0x7f20580fea60 msgr2=0x7f2058075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 shutdown_connections 2024-07-26T12:22:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:37.359+0000 7f205ec00640 1 -- 172.21.15.40:0/3786532780 wait complete. 2024-07-26T12:22:37.392 INFO:teuthology.run_tasks:Running task check-counter... 2024-07-26T12:22:37.403 INFO:teuthology.run_tasks:Running task quiescer... 2024-07-26T12:22:37.424 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-07-26T12:22:37.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:22:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:37 smithi040 ceph-mon[32397]: pgmap v511: 97 pgs: 97 active+clean; 648 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-07-26T12:22:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:37 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3786532780' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-07-26T12:22:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:37 smithi146 ceph-mon[35807]: pgmap v511: 97 pgs: 97 active+clean; 648 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-07-26T12:22:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:37 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3786532780' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-07-26T12:22:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:37 smithi076 ceph-mon[35401]: pgmap v511: 97 pgs: 97 active+clean; 648 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-07-26T12:22:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:37 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3786532780' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-07-26T12:22:37.916 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:38 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3786532780' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-07-26T12:22:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:38 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:22:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:38 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3786532780' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-07-26T12:22:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:38 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:22:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:38 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3786532780' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-07-26T12:22:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:38 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:22:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:39 smithi040 ceph-mon[32397]: pgmap v512: 97 pgs: 97 active+clean; 648 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T12:22:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:39 smithi146 ceph-mon[35807]: pgmap v512: 97 pgs: 97 active+clean; 648 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T12:22:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:39 smithi076 ceph-mon[35401]: pgmap v512: 97 pgs: 97 active+clean; 648 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T12:22:40.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 -- 172.21.15.40:0/4228886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104240 msgr2=0x7f90a0104650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:40.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 --2- 172.21.15.40:0/4228886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104240 0x7f90a0104650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9090009ca0 tx=0x7f909002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 -- 172.21.15.40:0/4228886471 shutdown_connections 2024-07-26T12:22:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 --2- 172.21.15.40:0/4228886471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90a010d6a0 0x7f90a010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 --2- 172.21.15.40:0/4228886471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90a0104b90 0x7f90a010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 --2- 172.21.15.40:0/4228886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104240 0x7f90a0104650 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 -- 172.21.15.40:0/4228886471 >> 172.21.15.40:0/4228886471 conn(0x7f90a00fdd80 msgr2=0x7f90a01001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 -- 172.21.15.40:0/4228886471 shutdown_connections 2024-07-26T12:22:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.332+0000 7f90a5000640 1 -- 172.21.15.40:0/4228886471 wait complete. 2024-07-26T12:22:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 Processor -- start 2024-07-26T12:22:40.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 -- start start 2024-07-26T12:22:40.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90a0104240 0x7f90a0101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 0x7f90a01024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90a010d6a0 0x7f90a0102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90a0113230 con 0x7f90a0104b90 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f90a01130b0 con 0x7f90a010d6a0 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.334+0000 7f90a5000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90a01133b0 con 0x7f90a0104240 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 0x7f90a01024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 0x7f90a01024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38370/0 (socket says 172.21.15.40:38370) 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 -- 172.21.15.40:0/195765947 learned_addr learned my addr 172.21.15.40:0/195765947 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909f400640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90a0104240 0x7f90a0101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909fe00640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90a010d6a0 0x7f90a0102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 -- 172.21.15.40:0/195765947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90a0104240 msgr2=0x7f90a0101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90a0104240 0x7f90a0101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 -- 172.21.15.40:0/195765947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90a010d6a0 msgr2=0x7f90a0102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90a010d6a0 0x7f90a0102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.335+0000 7f909ea00640 1 -- 172.21.15.40:0/195765947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a01a7ed0 con 0x7f90a0104b90 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.336+0000 7f909ea00640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 0x7f90a01024c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f908800c8c0 tx=0x7f908800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.336+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088007bb0 con 0x7f90a0104b90 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.336+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a01a81c0 con 0x7f90a0104b90 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.336+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9088007d50 con 0x7f90a0104b90 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.336+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088005260 con 0x7f90a0104b90 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.336+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a01a8700 con 0x7f90a0104b90 2024-07-26T12:22:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.338+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a0104650 con 0x7f90a0104b90 2024-07-26T12:22:40.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.341+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f90880054c0 con 0x7f90a0104b90 2024-07-26T12:22:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.343+0000 7f9097e00640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f90840b3bd0 0x7f90840b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.343+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f90880e3ee0 con 0x7f90a0104b90 2024-07-26T12:22:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.343+0000 7f909f400640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f90840b3bd0 0x7f90840b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.344+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9088014030 con 0x7f90a0104b90 2024-07-26T12:22:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.344+0000 7f909f400640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f90840b3bd0 0x7f90840b60e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9090006010 tx=0x7f9090000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:40.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.546+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90a0107910 con 0x7f90840b3bd0 2024-07-26T12:22:40.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.561+0000 7f9097e00640 1 -- 172.21.15.40:0/195765947 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259013 (secure 0 0 0) 0x7f90a0107910 con 0x7f90840b3bd0 2024-07-26T12:22:40.566 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:40.567 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:22:40.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.566+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f90840b3bd0 msgr2=0x7f90840b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.566+0000 7f90a5000640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f90840b3bd0 0x7f90840b60e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9090006010 tx=0x7f9090000f40 comp rx=0 tx=0).stop 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.566+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 msgr2=0x7f90a01024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.566+0000 7f90a5000640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 0x7f90a01024c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f908800c8c0 tx=0x7f908800cd80 comp rx=0 tx=0).stop 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 shutdown_connections 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90a010d6a0 0x7f90a0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a0104b90 0x7f90a01024c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f90840b3bd0 0x7f90840b60e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 --2- 172.21.15.40:0/195765947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90a0104240 0x7f90a0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 >> 172.21.15.40:0/195765947 conn(0x7f90a00fdd80 msgr2=0x7f90a0107200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 shutdown_connections 2024-07-26T12:22:40.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:40.567+0000 7f90a5000640 1 -- 172.21.15.40:0/195765947 wait complete. 2024-07-26T12:22:41.444 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":513,"stamp":"2024-07-26T12:22:39.966718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":669308,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2359,"num_read_kb":1286,"num_write":397,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":827,"ondisk_log_size":827,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386912,"kb_used_data":12800,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554912,"statfs":{"total":1151940427776,"available":1151544229888,"internally_reserved":0,"allocated":13107200,"data_stored":7217358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6779,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":75,"num_write":17,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004864"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836266+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:20:27.836266+0000","last_peered":"2024-07-26T12:20:27.836266+0000","last_clean":"2024-07-26T12:20:27.836266+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:20:27.836266+0000","last_undegraded":"2024-07-26T12:20:27.836266+0000","last_fullsized":"2024-07-26T12:20:27.836266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836969+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:20:27.836969+0000","last_peered":"2024-07-26T12:20:27.836969+0000","last_clean":"2024-07-26T12:20:27.836969+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:20:27.836969+0000","last_undegraded":"2024-07-26T12:20:27.836969+0000","last_fullsized":"2024-07-26T12:20:27.836969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836334+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:20:27.836334+0000","last_peered":"2024-07-26T12:20:27.836334+0000","last_clean":"2024-07-26T12:20:27.836334+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:20:27.836334+0000","last_undegraded":"2024-07-26T12:20:27.836334+0000","last_fullsized":"2024-07-26T12:20:27.836334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831376+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:20:27.831376+0000","last_peered":"2024-07-26T12:20:27.831376+0000","last_clean":"2024-07-26T12:20:27.831376+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:20:27.831376+0000","last_undegraded":"2024-07-26T12:20:27.831376+0000","last_fullsized":"2024-07-26T12:20:27.831376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823673+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:20:27.823673+0000","last_peered":"2024-07-26T12:20:27.823673+0000","last_clean":"2024-07-26T12:20:27.823673+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:20:27.823673+0000","last_undegraded":"2024-07-26T12:20:27.823673+0000","last_fullsized":"2024-07-26T12:20:27.823673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837159+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:20:27.837159+0000","last_peered":"2024-07-26T12:20:27.837159+0000","last_clean":"2024-07-26T12:20:27.837159+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:20:27.837159+0000","last_undegraded":"2024-07-26T12:20:27.837159+0000","last_fullsized":"2024-07-26T12:20:27.837159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835809+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:20:27.835809+0000","last_peered":"2024-07-26T12:20:27.835809+0000","last_clean":"2024-07-26T12:20:27.835809+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:20:27.835809+0000","last_undegraded":"2024-07-26T12:20:27.835809+0000","last_fullsized":"2024-07-26T12:20:27.835809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831130+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:20:27.831130+0000","last_peered":"2024-07-26T12:20:27.831130+0000","last_clean":"2024-07-26T12:20:27.831130+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:20:27.831130+0000","last_undegraded":"2024-07-26T12:20:27.831130+0000","last_fullsized":"2024-07-26T12:20:27.831130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841319+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:20:27.841319+0000","last_peered":"2024-07-26T12:20:27.841319+0000","last_clean":"2024-07-26T12:20:27.841319+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:20:27.841319+0000","last_undegraded":"2024-07-26T12:20:27.841319+0000","last_fullsized":"2024-07-26T12:20:27.841319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.829801+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:20:27.829801+0000","last_peered":"2024-07-26T12:20:27.829801+0000","last_clean":"2024-07-26T12:20:27.829801+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:20:27.829801+0000","last_undegraded":"2024-07-26T12:20:27.829801+0000","last_fullsized":"2024-07-26T12:20:27.829801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840330+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:20:27.840330+0000","last_peered":"2024-07-26T12:20:27.840330+0000","last_clean":"2024-07-26T12:20:27.840330+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:20:27.840330+0000","last_undegraded":"2024-07-26T12:20:27.840330+0000","last_fullsized":"2024-07-26T12:20:27.840330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823915+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:20:27.823915+0000","last_peered":"2024-07-26T12:20:27.823915+0000","last_clean":"2024-07-26T12:20:27.823915+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:20:27.823915+0000","last_undegraded":"2024-07-26T12:20:27.823915+0000","last_fullsized":"2024-07-26T12:20:27.823915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837715+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:20:27.837715+0000","last_peered":"2024-07-26T12:20:27.837715+0000","last_clean":"2024-07-26T12:20:27.837715+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:20:27.837715+0000","last_undegraded":"2024-07-26T12:20:27.837715+0000","last_fullsized":"2024-07-26T12:20:27.837715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831001+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:20:27.831001+0000","last_peered":"2024-07-26T12:20:27.831001+0000","last_clean":"2024-07-26T12:20:27.831001+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:20:27.831001+0000","last_undegraded":"2024-07-26T12:20:27.831001+0000","last_fullsized":"2024-07-26T12:20:27.831001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822868+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:20:27.822868+0000","last_peered":"2024-07-26T12:20:27.822868+0000","last_clean":"2024-07-26T12:20:27.822868+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:20:27.822868+0000","last_undegraded":"2024-07-26T12:20:27.822868+0000","last_fullsized":"2024-07-26T12:20:27.822868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841034+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:20:27.841034+0000","last_peered":"2024-07-26T12:20:27.841034+0000","last_clean":"2024-07-26T12:20:27.841034+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:20:27.841034+0000","last_undegraded":"2024-07-26T12:20:27.841034+0000","last_fullsized":"2024-07-26T12:20:27.841034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836586+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:20:27.836586+0000","last_peered":"2024-07-26T12:20:27.836586+0000","last_clean":"2024-07-26T12:20:27.836586+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:20:27.836586+0000","last_undegraded":"2024-07-26T12:20:27.836586+0000","last_fullsized":"2024-07-26T12:20:27.836586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837413+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:20:27.837413+0000","last_peered":"2024-07-26T12:20:27.837413+0000","last_clean":"2024-07-26T12:20:27.837413+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:20:27.837413+0000","last_undegraded":"2024-07-26T12:20:27.837413+0000","last_fullsized":"2024-07-26T12:20:27.837413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824397+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:20:27.824397+0000","last_peered":"2024-07-26T12:20:27.824397+0000","last_clean":"2024-07-26T12:20:27.824397+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:20:27.824397+0000","last_undegraded":"2024-07-26T12:20:27.824397+0000","last_fullsized":"2024-07-26T12:20:27.824397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.821591+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:20:27.821591+0000","last_peered":"2024-07-26T12:20:27.821591+0000","last_clean":"2024-07-26T12:20:27.821591+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:20:27.821591+0000","last_undegraded":"2024-07-26T12:20:27.821591+0000","last_fullsized":"2024-07-26T12:20:27.821591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839046+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:20:27.839046+0000","last_peered":"2024-07-26T12:20:27.839046+0000","last_clean":"2024-07-26T12:20:27.839046+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:20:27.839046+0000","last_undegraded":"2024-07-26T12:20:27.839046+0000","last_fullsized":"2024-07-26T12:20:27.839046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840534+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:20:27.840534+0000","last_peered":"2024-07-26T12:20:27.840534+0000","last_clean":"2024-07-26T12:20:27.840534+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:20:27.840534+0000","last_undegraded":"2024-07-26T12:20:27.840534+0000","last_fullsized":"2024-07-26T12:20:27.840534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832429+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:20:27.832429+0000","last_peered":"2024-07-26T12:20:27.832429+0000","last_clean":"2024-07-26T12:20:27.832429+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:20:27.832429+0000","last_undegraded":"2024-07-26T12:20:27.832429+0000","last_fullsized":"2024-07-26T12:20:27.832429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832251+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:20:27.832251+0000","last_peered":"2024-07-26T12:20:27.832251+0000","last_clean":"2024-07-26T12:20:27.832251+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:20:27.832251+0000","last_undegraded":"2024-07-26T12:20:27.832251+0000","last_fullsized":"2024-07-26T12:20:27.832251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822925+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:20:27.822925+0000","last_peered":"2024-07-26T12:20:27.822925+0000","last_clean":"2024-07-26T12:20:27.822925+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:20:27.822925+0000","last_undegraded":"2024-07-26T12:20:27.822925+0000","last_fullsized":"2024-07-26T12:20:27.822925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835480+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:20:27.835480+0000","last_peered":"2024-07-26T12:20:27.835480+0000","last_clean":"2024-07-26T12:20:27.835480+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:20:27.835480+0000","last_undegraded":"2024-07-26T12:20:27.835480+0000","last_fullsized":"2024-07-26T12:20:27.835480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823737+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:20:27.823737+0000","last_peered":"2024-07-26T12:20:27.823737+0000","last_clean":"2024-07-26T12:20:27.823737+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:20:27.823737+0000","last_undegraded":"2024-07-26T12:20:27.823737+0000","last_fullsized":"2024-07-26T12:20:27.823737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830232+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:20:27.830232+0000","last_peered":"2024-07-26T12:20:27.830232+0000","last_clean":"2024-07-26T12:20:27.830232+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:20:27.830232+0000","last_undegraded":"2024-07-26T12:20:27.830232+0000","last_fullsized":"2024-07-26T12:20:27.830232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832159+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:20:27.832159+0000","last_peered":"2024-07-26T12:20:27.832159+0000","last_clean":"2024-07-26T12:20:27.832159+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:20:27.832159+0000","last_undegraded":"2024-07-26T12:20:27.832159+0000","last_fullsized":"2024-07-26T12:20:27.832159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.628489+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:20:33.628489+0000","last_peered":"2024-07-26T12:20:33.628489+0000","last_clean":"2024-07-26T12:20:33.628489+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:20:33.628489+0000","last_undegraded":"2024-07-26T12:20:33.628489+0000","last_fullsized":"2024-07-26T12:20:33.628489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.628409+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:20:33.628409+0000","last_peered":"2024-07-26T12:20:33.628409+0000","last_clean":"2024-07-26T12:20:33.628409+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:20:33.628409+0000","last_undegraded":"2024-07-26T12:20:33.628409+0000","last_fullsized":"2024-07-26T12:20:33.628409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823399+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:20:27.823399+0000","last_peered":"2024-07-26T12:20:27.823399+0000","last_clean":"2024-07-26T12:20:27.823399+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:20:27.823399+0000","last_undegraded":"2024-07-26T12:20:27.823399+0000","last_fullsized":"2024-07-26T12:20:27.823399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826868+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:20:27.826868+0000","last_peered":"2024-07-26T12:20:27.826868+0000","last_clean":"2024-07-26T12:20:27.826868+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:20:27.826868+0000","last_undegraded":"2024-07-26T12:20:27.826868+0000","last_fullsized":"2024-07-26T12:20:27.826868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":267,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:36.844582+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:22:36.844582+0000","last_peered":"2024-07-26T12:22:36.844582+0000","last_clean":"2024-07-26T12:22:36.844582+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:22:36.844582+0000","last_undegraded":"2024-07-26T12:22:36.844582+0000","last_fullsized":"2024-07-26T12:22:36.844582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827551+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:20:27.827551+0000","last_peered":"2024-07-26T12:20:27.827551+0000","last_clean":"2024-07-26T12:20:27.827551+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:20:27.827551+0000","last_undegraded":"2024-07-26T12:20:27.827551+0000","last_fullsized":"2024-07-26T12:20:27.827551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088332+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088332+0000","last_peered":"2024-07-26T12:18:59.088332+0000","last_clean":"2024-07-26T12:18:59.088332+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088332+0000","last_undegraded":"2024-07-26T12:18:59.088332+0000","last_fullsized":"2024-07-26T12:18:59.088332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084679+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084679+0000","last_peered":"2024-07-26T12:18:59.084679+0000","last_clean":"2024-07-26T12:18:59.084679+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084679+0000","last_undegraded":"2024-07-26T12:18:59.084679+0000","last_fullsized":"2024-07-26T12:18:59.084679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826687+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:20:27.826687+0000","last_peered":"2024-07-26T12:20:27.826687+0000","last_clean":"2024-07-26T12:20:27.826687+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:20:27.826687+0000","last_undegraded":"2024-07-26T12:20:27.826687+0000","last_fullsized":"2024-07-26T12:20:27.826687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117922+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117922+0000","last_peered":"2024-07-26T12:18:59.117922+0000","last_clean":"2024-07-26T12:18:59.117922+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117922+0000","last_undegraded":"2024-07-26T12:18:59.117922+0000","last_fullsized":"2024-07-26T12:18:59.117922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838871+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:20:27.838871+0000","last_peered":"2024-07-26T12:20:27.838871+0000","last_clean":"2024-07-26T12:20:27.838871+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:20:27.838871+0000","last_undegraded":"2024-07-26T12:20:27.838871+0000","last_fullsized":"2024-07-26T12:20:27.838871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":489,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:38.829185+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:22:38.829185+0000","last_peered":"2024-07-26T12:22:38.829185+0000","last_clean":"2024-07-26T12:22:38.829185+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:22:38.829185+0000","last_undegraded":"2024-07-26T12:22:38.829185+0000","last_fullsized":"2024-07-26T12:22:38.829185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839581+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:20:27.839581+0000","last_peered":"2024-07-26T12:20:27.839581+0000","last_clean":"2024-07-26T12:20:27.839581+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:20:27.839581+0000","last_undegraded":"2024-07-26T12:20:27.839581+0000","last_fullsized":"2024-07-26T12:20:27.839581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096936+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096936+0000","last_peered":"2024-07-26T12:18:59.096936+0000","last_clean":"2024-07-26T12:18:59.096936+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096936+0000","last_undegraded":"2024-07-26T12:18:59.096936+0000","last_fullsized":"2024-07-26T12:18:59.096936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830415+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:20:27.830415+0000","last_peered":"2024-07-26T12:20:27.830415+0000","last_clean":"2024-07-26T12:20:27.830415+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:20:27.830415+0000","last_undegraded":"2024-07-26T12:20:27.830415+0000","last_fullsized":"2024-07-26T12:20:27.830415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118636+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118636+0000","last_peered":"2024-07-26T12:18:59.118636+0000","last_clean":"2024-07-26T12:18:59.118636+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118636+0000","last_undegraded":"2024-07-26T12:18:59.118636+0000","last_fullsized":"2024-07-26T12:18:59.118636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839729+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:20:27.839729+0000","last_peered":"2024-07-26T12:20:27.839729+0000","last_clean":"2024-07-26T12:20:27.839729+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:20:27.839729+0000","last_undegraded":"2024-07-26T12:20:27.839729+0000","last_fullsized":"2024-07-26T12:20:27.839729+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:38.840588+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:22:38.840588+0000","last_peered":"2024-07-26T12:22:38.840588+0000","last_clean":"2024-07-26T12:22:38.840588+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:22:38.840588+0000","last_undegraded":"2024-07-26T12:22:38.840588+0000","last_fullsized":"2024-07-26T12:22:38.840588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69780,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":292,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.828023+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:20:27.828023+0000","last_peered":"2024-07-26T12:20:27.828023+0000","last_clean":"2024-07-26T12:20:27.828023+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:20:27.828023+0000","last_undegraded":"2024-07-26T12:20:27.828023+0000","last_fullsized":"2024-07-26T12:20:27.828023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094059+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.094059+0000","last_peered":"2024-07-26T12:18:59.094059+0000","last_clean":"2024-07-26T12:18:59.094059+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.094059+0000","last_undegraded":"2024-07-26T12:18:59.094059+0000","last_fullsized":"2024-07-26T12:18:59.094059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827622+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:20:27.827622+0000","last_peered":"2024-07-26T12:20:27.827622+0000","last_clean":"2024-07-26T12:20:27.827622+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:20:27.827622+0000","last_undegraded":"2024-07-26T12:20:27.827622+0000","last_fullsized":"2024-07-26T12:20:27.827622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117333+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117333+0000","last_peered":"2024-07-26T12:18:59.117333+0000","last_clean":"2024-07-26T12:18:59.117333+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117333+0000","last_undegraded":"2024-07-26T12:18:59.117333+0000","last_fullsized":"2024-07-26T12:18:59.117333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.843505+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:20:27.843505+0000","last_peered":"2024-07-26T12:20:27.843505+0000","last_clean":"2024-07-26T12:20:27.843505+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:20:27.843505+0000","last_undegraded":"2024-07-26T12:20:27.843505+0000","last_fullsized":"2024-07-26T12:20:27.843505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":264,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:37.786209+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:22:37.786209+0000","last_peered":"2024-07-26T12:22:37.786209+0000","last_clean":"2024-07-26T12:22:37.786209+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:22:37.786209+0000","last_undegraded":"2024-07-26T12:22:37.786209+0000","last_fullsized":"2024-07-26T12:22:37.786209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":231,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838824+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:20:27.838824+0000","last_peered":"2024-07-26T12:20:27.838824+0000","last_clean":"2024-07-26T12:20:27.838824+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:20:27.838824+0000","last_undegraded":"2024-07-26T12:20:27.838824+0000","last_fullsized":"2024-07-26T12:20:27.838824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096135+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.096135+0000","last_peered":"2024-07-26T12:18:59.096135+0000","last_clean":"2024-07-26T12:18:59.096135+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.096135+0000","last_undegraded":"2024-07-26T12:18:59.096135+0000","last_fullsized":"2024-07-26T12:18:59.096135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834733+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:20:27.834733+0000","last_peered":"2024-07-26T12:20:27.834733+0000","last_clean":"2024-07-26T12:20:27.834733+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:20:27.834733+0000","last_undegraded":"2024-07-26T12:20:27.834733+0000","last_fullsized":"2024-07-26T12:20:27.834733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:41.412571+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:20:41.412571+0000","last_peered":"2024-07-26T12:20:41.412571+0000","last_clean":"2024-07-26T12:20:41.412571+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:20:41.412571+0000","last_undegraded":"2024-07-26T12:20:41.412571+0000","last_fullsized":"2024-07-26T12:20:41.412571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822644+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:20:27.822644+0000","last_peered":"2024-07-26T12:20:27.822644+0000","last_clean":"2024-07-26T12:20:27.822644+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:20:27.822644+0000","last_undegraded":"2024-07-26T12:20:27.822644+0000","last_fullsized":"2024-07-26T12:20:27.822644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.121398+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.121398+0000","last_peered":"2024-07-26T12:18:59.121398+0000","last_clean":"2024-07-26T12:18:59.121398+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.121398+0000","last_undegraded":"2024-07-26T12:18:59.121398+0000","last_fullsized":"2024-07-26T12:18:59.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837997+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:20:27.837997+0000","last_peered":"2024-07-26T12:20:27.837997+0000","last_clean":"2024-07-26T12:20:27.837997+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:20:27.837997+0000","last_undegraded":"2024-07-26T12:20:27.837997+0000","last_fullsized":"2024-07-26T12:20:27.837997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118876+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118876+0000","last_peered":"2024-07-26T12:18:59.118876+0000","last_clean":"2024-07-26T12:18:59.118876+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118876+0000","last_undegraded":"2024-07-26T12:18:59.118876+0000","last_fullsized":"2024-07-26T12:18:59.118876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.833208+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:20:27.833208+0000","last_peered":"2024-07-26T12:20:27.833208+0000","last_clean":"2024-07-26T12:20:27.833208+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:20:27.833208+0000","last_undegraded":"2024-07-26T12:20:27.833208+0000","last_fullsized":"2024-07-26T12:20:27.833208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":263,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:36.824631+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:22:36.824631+0000","last_peered":"2024-07-26T12:22:36.824631+0000","last_clean":"2024-07-26T12:22:36.824631+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:22:36.824631+0000","last_undegraded":"2024-07-26T12:22:36.824631+0000","last_fullsized":"2024-07-26T12:22:36.824631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840206+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:20:27.840206+0000","last_peered":"2024-07-26T12:20:27.840206+0000","last_clean":"2024-07-26T12:20:27.840206+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:20:27.840206+0000","last_undegraded":"2024-07-26T12:20:27.840206+0000","last_fullsized":"2024-07-26T12:20:27.840206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099348+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.099348+0000","last_peered":"2024-07-26T12:18:59.099348+0000","last_clean":"2024-07-26T12:18:59.099348+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.099348+0000","last_undegraded":"2024-07-26T12:18:59.099348+0000","last_fullsized":"2024-07-26T12:18:59.099348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.025497+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:20:34.025497+0000","last_peered":"2024-07-26T12:20:34.025497+0000","last_clean":"2024-07-26T12:20:34.025497+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:20:34.025497+0000","last_undegraded":"2024-07-26T12:20:34.025497+0000","last_fullsized":"2024-07-26T12:20:34.025497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834859+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:20:27.834859+0000","last_peered":"2024-07-26T12:20:27.834859+0000","last_clean":"2024-07-26T12:20:27.834859+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:20:27.834859+0000","last_undegraded":"2024-07-26T12:20:27.834859+0000","last_fullsized":"2024-07-26T12:20:27.834859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.472148+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:20:27.472148+0000","last_peered":"2024-07-26T12:20:27.472148+0000","last_clean":"2024-07-26T12:20:27.472148+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:20:27.472148+0000","last_undegraded":"2024-07-26T12:20:27.472148+0000","last_fullsized":"2024-07-26T12:20:27.472148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822472+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:20:27.822472+0000","last_peered":"2024-07-26T12:20:27.822472+0000","last_clean":"2024-07-26T12:20:27.822472+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:20:27.822472+0000","last_undegraded":"2024-07-26T12:20:27.822472+0000","last_fullsized":"2024-07-26T12:20:27.822472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":261,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:36.781787+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:22:36.781787+0000","last_peered":"2024-07-26T12:22:36.781787+0000","last_clean":"2024-07-26T12:22:36.781787+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:22:36.781787+0000","last_undegraded":"2024-07-26T12:22:36.781787+0000","last_fullsized":"2024-07-26T12:22:36.781787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.164654+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:20:33.164654+0000","last_peered":"2024-07-26T12:20:33.164654+0000","last_clean":"2024-07-26T12:20:33.164654+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:20:33.164654+0000","last_undegraded":"2024-07-26T12:20:33.164654+0000","last_fullsized":"2024-07-26T12:20:33.164654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":261,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:36.782812+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:22:36.782812+0000","last_peered":"2024-07-26T12:22:36.782812+0000","last_clean":"2024-07-26T12:22:36.782812+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:22:36.782812+0000","last_undegraded":"2024-07-26T12:22:36.782812+0000","last_fullsized":"2024-07-26T12:22:36.782812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.057249+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:20:34.057249+0000","last_peered":"2024-07-26T12:20:34.057249+0000","last_clean":"2024-07-26T12:20:34.057249+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:20:34.057249+0000","last_undegraded":"2024-07-26T12:20:34.057249+0000","last_fullsized":"2024-07-26T12:20:34.057249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:32.296022+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:20:32.296022+0000","last_peered":"2024-07-26T12:20:32.296022+0000","last_clean":"2024-07-26T12:20:32.296022+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:20:32.296022+0000","last_undegraded":"2024-07-26T12:20:32.296022+0000","last_fullsized":"2024-07-26T12:20:32.296022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.057293+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:20:34.057293+0000","last_peered":"2024-07-26T12:20:34.057293+0000","last_clean":"2024-07-26T12:20:34.057293+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:20:34.057293+0000","last_undegraded":"2024-07-26T12:20:34.057293+0000","last_fullsized":"2024-07-26T12:20:34.057293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:31.410465+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:20:31.410465+0000","last_peered":"2024-07-26T12:20:31.410465+0000","last_clean":"2024-07-26T12:20:31.410465+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:20:31.410465+0000","last_undegraded":"2024-07-26T12:20:31.410465+0000","last_fullsized":"2024-07-26T12:20:31.410465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827657+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:20:27.827657+0000","last_peered":"2024-07-26T12:20:27.827657+0000","last_clean":"2024-07-26T12:20:27.827657+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:20:27.827657+0000","last_undegraded":"2024-07-26T12:20:27.827657+0000","last_fullsized":"2024-07-26T12:20:27.827657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.297167+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:20:37.297167+0000","last_peered":"2024-07-26T12:20:37.297167+0000","last_clean":"2024-07-26T12:20:37.297167+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:20:37.297167+0000","last_undegraded":"2024-07-26T12:20:37.297167+0000","last_fullsized":"2024-07-26T12:20:37.297167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835465+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:20:27.835465+0000","last_peered":"2024-07-26T12:20:27.835465+0000","last_clean":"2024-07-26T12:20:27.835465+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:20:27.835465+0000","last_undegraded":"2024-07-26T12:20:27.835465+0000","last_fullsized":"2024-07-26T12:20:27.835465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107188+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107188+0000","last_peered":"2024-07-26T12:18:59.107188+0000","last_clean":"2024-07-26T12:18:59.107188+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107188+0000","last_undegraded":"2024-07-26T12:18:59.107188+0000","last_fullsized":"2024-07-26T12:18:59.107188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831555+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:20:27.831555+0000","last_peered":"2024-07-26T12:20:27.831555+0000","last_clean":"2024-07-26T12:20:27.831555+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:20:27.831555+0000","last_undegraded":"2024-07-26T12:20:27.831555+0000","last_fullsized":"2024-07-26T12:20:27.831555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094126+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:18:59.094126+0000","last_peered":"2024-07-26T12:18:59.094126+0000","last_clean":"2024-07-26T12:18:59.094126+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:18:59.094126+0000","last_undegraded":"2024-07-26T12:18:59.094126+0000","last_fullsized":"2024-07-26T12:18:59.094126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.809284+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:20:27.809284+0000","last_peered":"2024-07-26T12:20:27.809284+0000","last_clean":"2024-07-26T12:20:27.809284+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:20:27.809284+0000","last_undegraded":"2024-07-26T12:20:27.809284+0000","last_fullsized":"2024-07-26T12:20:27.809284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095568+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:18:59.095568+0000","last_peered":"2024-07-26T12:18:59.095568+0000","last_clean":"2024-07-26T12:18:59.095568+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:18:59.095568+0000","last_undegraded":"2024-07-26T12:18:59.095568+0000","last_fullsized":"2024-07-26T12:18:59.095568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826443+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:20:27.826443+0000","last_peered":"2024-07-26T12:20:27.826443+0000","last_clean":"2024-07-26T12:20:27.826443+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:20:27.826443+0000","last_undegraded":"2024-07-26T12:20:27.826443+0000","last_fullsized":"2024-07-26T12:20:27.826443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:38.629627+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:20:38.629627+0000","last_peered":"2024-07-26T12:20:38.629627+0000","last_clean":"2024-07-26T12:20:38.629627+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:20:38.629627+0000","last_undegraded":"2024-07-26T12:20:38.629627+0000","last_fullsized":"2024-07-26T12:20:38.629627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831171+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:20:27.831171+0000","last_peered":"2024-07-26T12:20:27.831171+0000","last_clean":"2024-07-26T12:20:27.831171+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:20:27.831171+0000","last_undegraded":"2024-07-26T12:20:27.831171+0000","last_fullsized":"2024-07-26T12:20:27.831171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:02.028040+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:19:02.028040+0000","last_peered":"2024-07-26T12:19:02.028040+0000","last_clean":"2024-07-26T12:19:02.028040+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:19:02.028040+0000","last_undegraded":"2024-07-26T12:19:02.028040+0000","last_fullsized":"2024-07-26T12:19:02.028040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840809+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:20:27.840809+0000","last_peered":"2024-07-26T12:20:27.840809+0000","last_clean":"2024-07-26T12:20:27.840809+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:20:27.840809+0000","last_undegraded":"2024-07-26T12:20:27.840809+0000","last_fullsized":"2024-07-26T12:20:27.840809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839095+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:20:27.839095+0000","last_peered":"2024-07-26T12:20:27.839095+0000","last_clean":"2024-07-26T12:20:27.839095+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:20:27.839095+0000","last_undegraded":"2024-07-26T12:20:27.839095+0000","last_fullsized":"2024-07-26T12:20:27.839095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099091+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.099091+0000","last_peered":"2024-07-26T12:18:59.099091+0000","last_clean":"2024-07-26T12:18:59.099091+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.099091+0000","last_undegraded":"2024-07-26T12:18:59.099091+0000","last_fullsized":"2024-07-26T12:18:59.099091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837671+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:20:27.837671+0000","last_peered":"2024-07-26T12:20:27.837671+0000","last_clean":"2024-07-26T12:20:27.837671+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:20:27.837671+0000","last_undegraded":"2024-07-26T12:20:27.837671+0000","last_fullsized":"2024-07-26T12:20:27.837671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096752+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096752+0000","last_peered":"2024-07-26T12:18:59.096752+0000","last_clean":"2024-07-26T12:18:59.096752+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096752+0000","last_undegraded":"2024-07-26T12:18:59.096752+0000","last_fullsized":"2024-07-26T12:18:59.096752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839888+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:20:27.839888+0000","last_peered":"2024-07-26T12:20:27.839888+0000","last_clean":"2024-07-26T12:20:27.839888+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:20:27.839888+0000","last_undegraded":"2024-07-26T12:20:27.839888+0000","last_fullsized":"2024-07-26T12:20:27.839888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.517486+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:20:27.517486+0000","last_peered":"2024-07-26T12:20:27.517486+0000","last_clean":"2024-07-26T12:20:27.517486+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:20:27.517486+0000","last_undegraded":"2024-07-26T12:20:27.517486+0000","last_fullsized":"2024-07-26T12:20:27.517486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:32.518603+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:20:32.518603+0000","last_peered":"2024-07-26T12:20:32.518603+0000","last_clean":"2024-07-26T12:20:32.518603+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:20:32.518603+0000","last_undegraded":"2024-07-26T12:20:32.518603+0000","last_fullsized":"2024-07-26T12:20:32.518603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":289,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:36.781226+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:22:36.781226+0000","last_peered":"2024-07-26T12:22:36.781226+0000","last_clean":"2024-07-26T12:22:36.781226+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:22:36.781226+0000","last_undegraded":"2024-07-26T12:22:36.781226+0000","last_fullsized":"2024-07-26T12:22:36.781226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":218,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78706,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2283,"num_read_kb":1222,"num_write":272,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":231804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645382,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":436836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841612,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1096973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005139,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201368,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397601,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1029445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593830,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790062,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986295,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":505452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182523,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":437969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":502190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738512,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":437150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":72009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:22:41.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:22:41.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:41 smithi040 ceph-mon[32397]: pgmap v513: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-07-26T12:22:41.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:41 smithi040 ceph-mon[32397]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:41 smithi146 ceph-mon[35807]: pgmap v513: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-07-26T12:22:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:41 smithi146 ceph-mon[35807]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:41 smithi076 ceph-mon[35401]: pgmap v513: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-07-26T12:22:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:41 smithi076 ceph-mon[35401]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:41.926 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:43 smithi040 ceph-mon[32397]: pgmap v514: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-07-26T12:22:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:43 smithi146 ceph-mon[35807]: pgmap v514: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-07-26T12:22:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:43 smithi076 ceph-mon[35401]: pgmap v514: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-07-26T12:22:44.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 -- 172.21.15.40:0/2759824767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077cc0 msgr2=0x7f9634113c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:44.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 --2- 172.21.15.40:0/2759824767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077cc0 0x7f9634113c60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f961c009900 tx=0x7f961c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 -- 172.21.15.40:0/2759824767 shutdown_connections 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 --2- 172.21.15.40:0/2759824767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96341141a0 0x7f96341165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 --2- 172.21.15.40:0/2759824767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077cc0 0x7f9634113c60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 --2- 172.21.15.40:0/2759824767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9634077370 0x7f9634077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 -- 172.21.15.40:0/2759824767 >> 172.21.15.40:0/2759824767 conn(0x7f96341011f0 msgr2=0x7f9634103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 -- 172.21.15.40:0/2759824767 shutdown_connections 2024-07-26T12:22:44.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.117+0000 7f9639a00640 1 -- 172.21.15.40:0/2759824767 wait complete. 2024-07-26T12:22:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.118+0000 7f9639a00640 1 Processor -- start 2024-07-26T12:22:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 -- start start 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 0x7f96341a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9634077cc0 0x7f96341a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96341141a0 0x7f96341a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f96341199b0 con 0x7f9634077370 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9634119830 con 0x7f9634077cc0 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.119+0000 7f9639a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9634119b30 con 0x7f96341141a0 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 0x7f96341a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 0x7f96341a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48706/0 (socket says 172.21.15.40:48706) 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 -- 172.21.15.40:0/1631350700 learned_addr learned my addr 172.21.15.40:0/1631350700 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f962a000640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9634077cc0 0x7f96341a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9633400640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96341141a0 0x7f96341a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 -- 172.21.15.40:0/1631350700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96341141a0 msgr2=0x7f96341a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96341141a0 0x7f96341a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 -- 172.21.15.40:0/1631350700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9634077cc0 msgr2=0x7f96341a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9634077cc0 0x7f96341a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.120+0000 7f9632a00640 1 -- 172.21.15.40:0/1631350700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96341a6450 con 0x7f9634077370 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.121+0000 7f9632a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 0x7f96341a04e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f962400c970 tx=0x7f962400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.121+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624007bb0 con 0x7f9634077370 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.121+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96341a6740 con 0x7f9634077370 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.121+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9624007d50 con 0x7f9634077370 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.121+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624004e40 con 0x7f9634077370 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.121+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96341acea0 con 0x7f9634077370 2024-07-26T12:22:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.122+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9634078880 con 0x7f9634077370 2024-07-26T12:22:44.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.125+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9624005000 con 0x7f9634077370 2024-07-26T12:22:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.126+0000 7f962be00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f96180b3bd0 0x7f96180b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.127+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f96240e3e30 con 0x7f9634077370 2024-07-26T12:22:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.127+0000 7f962a000640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f96180b3bd0 0x7f96180b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.128+0000 7f962a000640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f96180b3bd0 0x7f96180b60e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f961c0057c0 tx=0x7f961c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.131+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9624014030 con 0x7f9634077370 2024-07-26T12:22:44.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.361+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9634063230 con 0x7f96180b3bd0 2024-07-26T12:22:44.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.375+0000 7f962be00640 1 -- 172.21.15.40:0/1631350700 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258925 (secure 0 0 0) 0x7f9634063230 con 0x7f96180b3bd0 2024-07-26T12:22:44.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:22:44.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f96180b3bd0 msgr2=0x7f96180b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f96180b3bd0 0x7f96180b60e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f961c0057c0 tx=0x7f961c000bc0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 msgr2=0x7f96341a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 0x7f96341a04e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f962400c970 tx=0x7f962400ce30 comp rx=0 tx=0).stop 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 shutdown_connections 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f96180b3bd0 0x7f96180b60e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96341141a0 0x7f96341a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9634077cc0 0x7f96341a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 --2- 172.21.15.40:0/1631350700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9634077370 0x7f96341a04e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 >> 172.21.15.40:0/1631350700 conn(0x7f96341011f0 msgr2=0x7f9634103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 shutdown_connections 2024-07-26T12:22:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:44.382+0000 7f9639a00640 1 -- 172.21.15.40:0/1631350700 wait complete. 2024-07-26T12:22:45.211 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2024-07-26T12:22:43.968086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":669308,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2384,"num_read_kb":1296,"num_write":397,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":827,"ondisk_log_size":827,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386916,"kb_used_data":12804,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554908,"statfs":{"total":1151940427776,"available":1151544225792,"internally_reserved":0,"allocated":13111296,"data_stored":7221672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6779,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":70,"num_write":17,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004395"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.047750+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:20:37.047750+0000","last_peered":"2024-07-26T12:20:37.047750+0000","last_clean":"2024-07-26T12:20:37.047750+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:20:37.047750+0000","last_undegraded":"2024-07-26T12:20:37.047750+0000","last_fullsized":"2024-07-26T12:20:37.047750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414871+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:20:35.414871+0000","last_peered":"2024-07-26T12:20:35.414871+0000","last_clean":"2024-07-26T12:20:35.414871+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:20:35.414871+0000","last_undegraded":"2024-07-26T12:20:35.414871+0000","last_fullsized":"2024-07-26T12:20:35.414871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414844+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:20:35.414844+0000","last_peered":"2024-07-26T12:20:35.414844+0000","last_clean":"2024-07-26T12:20:35.414844+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:20:35.414844+0000","last_undegraded":"2024-07-26T12:20:35.414844+0000","last_fullsized":"2024-07-26T12:20:35.414844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831376+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:20:27.831376+0000","last_peered":"2024-07-26T12:20:27.831376+0000","last_clean":"2024-07-26T12:20:27.831376+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:20:27.831376+0000","last_undegraded":"2024-07-26T12:20:27.831376+0000","last_fullsized":"2024-07-26T12:20:27.831376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823673+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:20:27.823673+0000","last_peered":"2024-07-26T12:20:27.823673+0000","last_clean":"2024-07-26T12:20:27.823673+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:20:27.823673+0000","last_undegraded":"2024-07-26T12:20:27.823673+0000","last_fullsized":"2024-07-26T12:20:27.823673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837159+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:20:27.837159+0000","last_peered":"2024-07-26T12:20:27.837159+0000","last_clean":"2024-07-26T12:20:27.837159+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:20:27.837159+0000","last_undegraded":"2024-07-26T12:20:27.837159+0000","last_fullsized":"2024-07-26T12:20:27.837159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835809+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:20:27.835809+0000","last_peered":"2024-07-26T12:20:27.835809+0000","last_clean":"2024-07-26T12:20:27.835809+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:20:27.835809+0000","last_undegraded":"2024-07-26T12:20:27.835809+0000","last_fullsized":"2024-07-26T12:20:27.835809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831130+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:20:27.831130+0000","last_peered":"2024-07-26T12:20:27.831130+0000","last_clean":"2024-07-26T12:20:27.831130+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:20:27.831130+0000","last_undegraded":"2024-07-26T12:20:27.831130+0000","last_fullsized":"2024-07-26T12:20:27.831130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841319+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:20:27.841319+0000","last_peered":"2024-07-26T12:20:27.841319+0000","last_clean":"2024-07-26T12:20:27.841319+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:20:27.841319+0000","last_undegraded":"2024-07-26T12:20:27.841319+0000","last_fullsized":"2024-07-26T12:20:27.841319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.829801+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:20:27.829801+0000","last_peered":"2024-07-26T12:20:27.829801+0000","last_clean":"2024-07-26T12:20:27.829801+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:20:27.829801+0000","last_undegraded":"2024-07-26T12:20:27.829801+0000","last_fullsized":"2024-07-26T12:20:27.829801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840330+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:20:27.840330+0000","last_peered":"2024-07-26T12:20:27.840330+0000","last_clean":"2024-07-26T12:20:27.840330+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:20:27.840330+0000","last_undegraded":"2024-07-26T12:20:27.840330+0000","last_fullsized":"2024-07-26T12:20:27.840330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823915+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:20:27.823915+0000","last_peered":"2024-07-26T12:20:27.823915+0000","last_clean":"2024-07-26T12:20:27.823915+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:20:27.823915+0000","last_undegraded":"2024-07-26T12:20:27.823915+0000","last_fullsized":"2024-07-26T12:20:27.823915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837715+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:20:27.837715+0000","last_peered":"2024-07-26T12:20:27.837715+0000","last_clean":"2024-07-26T12:20:27.837715+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:20:27.837715+0000","last_undegraded":"2024-07-26T12:20:27.837715+0000","last_fullsized":"2024-07-26T12:20:27.837715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831001+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:20:27.831001+0000","last_peered":"2024-07-26T12:20:27.831001+0000","last_clean":"2024-07-26T12:20:27.831001+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:20:27.831001+0000","last_undegraded":"2024-07-26T12:20:27.831001+0000","last_fullsized":"2024-07-26T12:20:27.831001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822868+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:20:27.822868+0000","last_peered":"2024-07-26T12:20:27.822868+0000","last_clean":"2024-07-26T12:20:27.822868+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:20:27.822868+0000","last_undegraded":"2024-07-26T12:20:27.822868+0000","last_fullsized":"2024-07-26T12:20:27.822868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841034+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:20:27.841034+0000","last_peered":"2024-07-26T12:20:27.841034+0000","last_clean":"2024-07-26T12:20:27.841034+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:20:27.841034+0000","last_undegraded":"2024-07-26T12:20:27.841034+0000","last_fullsized":"2024-07-26T12:20:27.841034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836586+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:20:27.836586+0000","last_peered":"2024-07-26T12:20:27.836586+0000","last_clean":"2024-07-26T12:20:27.836586+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:20:27.836586+0000","last_undegraded":"2024-07-26T12:20:27.836586+0000","last_fullsized":"2024-07-26T12:20:27.836586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837413+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:20:27.837413+0000","last_peered":"2024-07-26T12:20:27.837413+0000","last_clean":"2024-07-26T12:20:27.837413+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:20:27.837413+0000","last_undegraded":"2024-07-26T12:20:27.837413+0000","last_fullsized":"2024-07-26T12:20:27.837413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824397+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:20:27.824397+0000","last_peered":"2024-07-26T12:20:27.824397+0000","last_clean":"2024-07-26T12:20:27.824397+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:20:27.824397+0000","last_undegraded":"2024-07-26T12:20:27.824397+0000","last_fullsized":"2024-07-26T12:20:27.824397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.821591+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:20:27.821591+0000","last_peered":"2024-07-26T12:20:27.821591+0000","last_clean":"2024-07-26T12:20:27.821591+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:20:27.821591+0000","last_undegraded":"2024-07-26T12:20:27.821591+0000","last_fullsized":"2024-07-26T12:20:27.821591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839046+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:20:27.839046+0000","last_peered":"2024-07-26T12:20:27.839046+0000","last_clean":"2024-07-26T12:20:27.839046+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:20:27.839046+0000","last_undegraded":"2024-07-26T12:20:27.839046+0000","last_fullsized":"2024-07-26T12:20:27.839046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840534+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:20:27.840534+0000","last_peered":"2024-07-26T12:20:27.840534+0000","last_clean":"2024-07-26T12:20:27.840534+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:20:27.840534+0000","last_undegraded":"2024-07-26T12:20:27.840534+0000","last_fullsized":"2024-07-26T12:20:27.840534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832429+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:20:27.832429+0000","last_peered":"2024-07-26T12:20:27.832429+0000","last_clean":"2024-07-26T12:20:27.832429+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:20:27.832429+0000","last_undegraded":"2024-07-26T12:20:27.832429+0000","last_fullsized":"2024-07-26T12:20:27.832429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832251+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:20:27.832251+0000","last_peered":"2024-07-26T12:20:27.832251+0000","last_clean":"2024-07-26T12:20:27.832251+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:20:27.832251+0000","last_undegraded":"2024-07-26T12:20:27.832251+0000","last_fullsized":"2024-07-26T12:20:27.832251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822925+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:20:27.822925+0000","last_peered":"2024-07-26T12:20:27.822925+0000","last_clean":"2024-07-26T12:20:27.822925+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:20:27.822925+0000","last_undegraded":"2024-07-26T12:20:27.822925+0000","last_fullsized":"2024-07-26T12:20:27.822925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835480+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:20:27.835480+0000","last_peered":"2024-07-26T12:20:27.835480+0000","last_clean":"2024-07-26T12:20:27.835480+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:20:27.835480+0000","last_undegraded":"2024-07-26T12:20:27.835480+0000","last_fullsized":"2024-07-26T12:20:27.835480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823737+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:20:27.823737+0000","last_peered":"2024-07-26T12:20:27.823737+0000","last_clean":"2024-07-26T12:20:27.823737+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:20:27.823737+0000","last_undegraded":"2024-07-26T12:20:27.823737+0000","last_fullsized":"2024-07-26T12:20:27.823737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830232+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:20:27.830232+0000","last_peered":"2024-07-26T12:20:27.830232+0000","last_clean":"2024-07-26T12:20:27.830232+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:20:27.830232+0000","last_undegraded":"2024-07-26T12:20:27.830232+0000","last_fullsized":"2024-07-26T12:20:27.830232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414797+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:20:35.414797+0000","last_peered":"2024-07-26T12:20:35.414797+0000","last_clean":"2024-07-26T12:20:35.414797+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:20:35.414797+0000","last_undegraded":"2024-07-26T12:20:35.414797+0000","last_fullsized":"2024-07-26T12:20:35.414797+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.628489+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:20:33.628489+0000","last_peered":"2024-07-26T12:20:33.628489+0000","last_clean":"2024-07-26T12:20:33.628489+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:20:33.628489+0000","last_undegraded":"2024-07-26T12:20:33.628489+0000","last_fullsized":"2024-07-26T12:20:33.628489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.628409+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:20:33.628409+0000","last_peered":"2024-07-26T12:20:33.628409+0000","last_clean":"2024-07-26T12:20:33.628409+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:20:33.628409+0000","last_undegraded":"2024-07-26T12:20:33.628409+0000","last_fullsized":"2024-07-26T12:20:33.628409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.047680+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:20:37.047680+0000","last_peered":"2024-07-26T12:20:37.047680+0000","last_clean":"2024-07-26T12:20:37.047680+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:20:37.047680+0000","last_undegraded":"2024-07-26T12:20:37.047680+0000","last_fullsized":"2024-07-26T12:20:37.047680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826868+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:20:27.826868+0000","last_peered":"2024-07-26T12:20:27.826868+0000","last_clean":"2024-07-26T12:20:27.826868+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:20:27.826868+0000","last_undegraded":"2024-07-26T12:20:27.826868+0000","last_fullsized":"2024-07-26T12:20:27.826868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":272,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:41.860890+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:22:41.860890+0000","last_peered":"2024-07-26T12:22:41.860890+0000","last_clean":"2024-07-26T12:22:41.860890+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:22:41.860890+0000","last_undegraded":"2024-07-26T12:22:41.860890+0000","last_fullsized":"2024-07-26T12:22:41.860890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827551+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:20:27.827551+0000","last_peered":"2024-07-26T12:20:27.827551+0000","last_clean":"2024-07-26T12:20:27.827551+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:20:27.827551+0000","last_undegraded":"2024-07-26T12:20:27.827551+0000","last_fullsized":"2024-07-26T12:20:27.827551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088332+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088332+0000","last_peered":"2024-07-26T12:18:59.088332+0000","last_clean":"2024-07-26T12:18:59.088332+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088332+0000","last_undegraded":"2024-07-26T12:18:59.088332+0000","last_fullsized":"2024-07-26T12:18:59.088332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084679+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084679+0000","last_peered":"2024-07-26T12:18:59.084679+0000","last_clean":"2024-07-26T12:18:59.084679+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084679+0000","last_undegraded":"2024-07-26T12:18:59.084679+0000","last_fullsized":"2024-07-26T12:18:59.084679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826687+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:20:27.826687+0000","last_peered":"2024-07-26T12:20:27.826687+0000","last_clean":"2024-07-26T12:20:27.826687+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:20:27.826687+0000","last_undegraded":"2024-07-26T12:20:27.826687+0000","last_fullsized":"2024-07-26T12:20:27.826687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117922+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117922+0000","last_peered":"2024-07-26T12:18:59.117922+0000","last_clean":"2024-07-26T12:18:59.117922+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117922+0000","last_undegraded":"2024-07-26T12:18:59.117922+0000","last_fullsized":"2024-07-26T12:18:59.117922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838871+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:20:27.838871+0000","last_peered":"2024-07-26T12:20:27.838871+0000","last_clean":"2024-07-26T12:20:27.838871+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:20:27.838871+0000","last_undegraded":"2024-07-26T12:20:27.838871+0000","last_fullsized":"2024-07-26T12:20:27.838871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":489,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:38.829185+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:22:38.829185+0000","last_peered":"2024-07-26T12:22:38.829185+0000","last_clean":"2024-07-26T12:22:38.829185+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:22:38.829185+0000","last_undegraded":"2024-07-26T12:22:38.829185+0000","last_fullsized":"2024-07-26T12:22:38.829185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839581+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:20:27.839581+0000","last_peered":"2024-07-26T12:20:27.839581+0000","last_clean":"2024-07-26T12:20:27.839581+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:20:27.839581+0000","last_undegraded":"2024-07-26T12:20:27.839581+0000","last_fullsized":"2024-07-26T12:20:27.839581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096936+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096936+0000","last_peered":"2024-07-26T12:18:59.096936+0000","last_clean":"2024-07-26T12:18:59.096936+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096936+0000","last_undegraded":"2024-07-26T12:18:59.096936+0000","last_fullsized":"2024-07-26T12:18:59.096936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830415+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:20:27.830415+0000","last_peered":"2024-07-26T12:20:27.830415+0000","last_clean":"2024-07-26T12:20:27.830415+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:20:27.830415+0000","last_undegraded":"2024-07-26T12:20:27.830415+0000","last_fullsized":"2024-07-26T12:20:27.830415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118636+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118636+0000","last_peered":"2024-07-26T12:18:59.118636+0000","last_clean":"2024-07-26T12:18:59.118636+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118636+0000","last_undegraded":"2024-07-26T12:18:59.118636+0000","last_fullsized":"2024-07-26T12:18:59.118636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839729+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:20:27.839729+0000","last_peered":"2024-07-26T12:20:27.839729+0000","last_clean":"2024-07-26T12:20:27.839729+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:20:27.839729+0000","last_undegraded":"2024-07-26T12:20:27.839729+0000","last_fullsized":"2024-07-26T12:20:27.839729+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:38.840588+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:22:38.840588+0000","last_peered":"2024-07-26T12:22:38.840588+0000","last_clean":"2024-07-26T12:22:38.840588+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:22:38.840588+0000","last_undegraded":"2024-07-26T12:22:38.840588+0000","last_fullsized":"2024-07-26T12:22:38.840588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69780,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":292,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.828023+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:20:27.828023+0000","last_peered":"2024-07-26T12:20:27.828023+0000","last_clean":"2024-07-26T12:20:27.828023+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:20:27.828023+0000","last_undegraded":"2024-07-26T12:20:27.828023+0000","last_fullsized":"2024-07-26T12:20:27.828023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094059+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.094059+0000","last_peered":"2024-07-26T12:18:59.094059+0000","last_clean":"2024-07-26T12:18:59.094059+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.094059+0000","last_undegraded":"2024-07-26T12:18:59.094059+0000","last_fullsized":"2024-07-26T12:18:59.094059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827622+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:20:27.827622+0000","last_peered":"2024-07-26T12:20:27.827622+0000","last_clean":"2024-07-26T12:20:27.827622+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:20:27.827622+0000","last_undegraded":"2024-07-26T12:20:27.827622+0000","last_fullsized":"2024-07-26T12:20:27.827622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117333+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117333+0000","last_peered":"2024-07-26T12:18:59.117333+0000","last_clean":"2024-07-26T12:18:59.117333+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117333+0000","last_undegraded":"2024-07-26T12:18:59.117333+0000","last_fullsized":"2024-07-26T12:18:59.117333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.843505+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:20:27.843505+0000","last_peered":"2024-07-26T12:20:27.843505+0000","last_clean":"2024-07-26T12:20:27.843505+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:20:27.843505+0000","last_undegraded":"2024-07-26T12:20:27.843505+0000","last_fullsized":"2024-07-26T12:20:27.843505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":264,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:37.786209+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:22:37.786209+0000","last_peered":"2024-07-26T12:22:37.786209+0000","last_clean":"2024-07-26T12:22:37.786209+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:22:37.786209+0000","last_undegraded":"2024-07-26T12:22:37.786209+0000","last_fullsized":"2024-07-26T12:22:37.786209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":231,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838824+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:20:27.838824+0000","last_peered":"2024-07-26T12:20:27.838824+0000","last_clean":"2024-07-26T12:20:27.838824+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:20:27.838824+0000","last_undegraded":"2024-07-26T12:20:27.838824+0000","last_fullsized":"2024-07-26T12:20:27.838824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096135+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.096135+0000","last_peered":"2024-07-26T12:18:59.096135+0000","last_clean":"2024-07-26T12:18:59.096135+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.096135+0000","last_undegraded":"2024-07-26T12:18:59.096135+0000","last_fullsized":"2024-07-26T12:18:59.096135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834733+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:20:27.834733+0000","last_peered":"2024-07-26T12:20:27.834733+0000","last_clean":"2024-07-26T12:20:27.834733+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:20:27.834733+0000","last_undegraded":"2024-07-26T12:20:27.834733+0000","last_fullsized":"2024-07-26T12:20:27.834733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:41.412571+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:20:41.412571+0000","last_peered":"2024-07-26T12:20:41.412571+0000","last_clean":"2024-07-26T12:20:41.412571+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:20:41.412571+0000","last_undegraded":"2024-07-26T12:20:41.412571+0000","last_fullsized":"2024-07-26T12:20:41.412571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822644+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:20:27.822644+0000","last_peered":"2024-07-26T12:20:27.822644+0000","last_clean":"2024-07-26T12:20:27.822644+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:20:27.822644+0000","last_undegraded":"2024-07-26T12:20:27.822644+0000","last_fullsized":"2024-07-26T12:20:27.822644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.121398+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.121398+0000","last_peered":"2024-07-26T12:18:59.121398+0000","last_clean":"2024-07-26T12:18:59.121398+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.121398+0000","last_undegraded":"2024-07-26T12:18:59.121398+0000","last_fullsized":"2024-07-26T12:18:59.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837997+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:20:27.837997+0000","last_peered":"2024-07-26T12:20:27.837997+0000","last_clean":"2024-07-26T12:20:27.837997+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:20:27.837997+0000","last_undegraded":"2024-07-26T12:20:27.837997+0000","last_fullsized":"2024-07-26T12:20:27.837997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118876+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118876+0000","last_peered":"2024-07-26T12:18:59.118876+0000","last_clean":"2024-07-26T12:18:59.118876+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118876+0000","last_undegraded":"2024-07-26T12:18:59.118876+0000","last_fullsized":"2024-07-26T12:18:59.118876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.833208+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:20:27.833208+0000","last_peered":"2024-07-26T12:20:27.833208+0000","last_clean":"2024-07-26T12:20:27.833208+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:20:27.833208+0000","last_undegraded":"2024-07-26T12:20:27.833208+0000","last_fullsized":"2024-07-26T12:20:27.833208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":268,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:41.841005+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:22:41.841005+0000","last_peered":"2024-07-26T12:22:41.841005+0000","last_clean":"2024-07-26T12:22:41.841005+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:22:41.841005+0000","last_undegraded":"2024-07-26T12:22:41.841005+0000","last_fullsized":"2024-07-26T12:22:41.841005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840206+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:20:27.840206+0000","last_peered":"2024-07-26T12:20:27.840206+0000","last_clean":"2024-07-26T12:20:27.840206+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:20:27.840206+0000","last_undegraded":"2024-07-26T12:20:27.840206+0000","last_fullsized":"2024-07-26T12:20:27.840206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099348+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.099348+0000","last_peered":"2024-07-26T12:18:59.099348+0000","last_clean":"2024-07-26T12:18:59.099348+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.099348+0000","last_undegraded":"2024-07-26T12:18:59.099348+0000","last_fullsized":"2024-07-26T12:18:59.099348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.025497+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:20:34.025497+0000","last_peered":"2024-07-26T12:20:34.025497+0000","last_clean":"2024-07-26T12:20:34.025497+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:20:34.025497+0000","last_undegraded":"2024-07-26T12:20:34.025497+0000","last_fullsized":"2024-07-26T12:20:34.025497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.519755+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:20:37.519755+0000","last_peered":"2024-07-26T12:20:37.519755+0000","last_clean":"2024-07-26T12:20:37.519755+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:20:37.519755+0000","last_undegraded":"2024-07-26T12:20:37.519755+0000","last_fullsized":"2024-07-26T12:20:37.519755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.472148+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:20:27.472148+0000","last_peered":"2024-07-26T12:20:27.472148+0000","last_clean":"2024-07-26T12:20:27.472148+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:20:27.472148+0000","last_undegraded":"2024-07-26T12:20:27.472148+0000","last_fullsized":"2024-07-26T12:20:27.472148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.530717+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:20:37.530717+0000","last_peered":"2024-07-26T12:20:37.530717+0000","last_clean":"2024-07-26T12:20:37.530717+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:20:37.530717+0000","last_undegraded":"2024-07-26T12:20:37.530717+0000","last_fullsized":"2024-07-26T12:20:37.530717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:40.794447+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:22:40.794447+0000","last_peered":"2024-07-26T12:22:40.794447+0000","last_clean":"2024-07-26T12:22:40.794447+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:22:40.794447+0000","last_undegraded":"2024-07-26T12:22:40.794447+0000","last_fullsized":"2024-07-26T12:22:40.794447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":231,"num_read_kb":231,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.164654+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:20:33.164654+0000","last_peered":"2024-07-26T12:20:33.164654+0000","last_clean":"2024-07-26T12:20:33.164654+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:20:33.164654+0000","last_undegraded":"2024-07-26T12:20:33.164654+0000","last_fullsized":"2024-07-26T12:20:33.164654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:40.796964+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:22:40.796964+0000","last_peered":"2024-07-26T12:22:40.796964+0000","last_clean":"2024-07-26T12:22:40.796964+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:22:40.796964+0000","last_undegraded":"2024-07-26T12:22:40.796964+0000","last_fullsized":"2024-07-26T12:22:40.796964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.057249+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:20:34.057249+0000","last_peered":"2024-07-26T12:20:34.057249+0000","last_clean":"2024-07-26T12:20:34.057249+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:20:34.057249+0000","last_undegraded":"2024-07-26T12:20:34.057249+0000","last_fullsized":"2024-07-26T12:20:34.057249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:32.296022+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:20:32.296022+0000","last_peered":"2024-07-26T12:20:32.296022+0000","last_clean":"2024-07-26T12:20:32.296022+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:20:32.296022+0000","last_undegraded":"2024-07-26T12:20:32.296022+0000","last_fullsized":"2024-07-26T12:20:32.296022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.057293+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:20:34.057293+0000","last_peered":"2024-07-26T12:20:34.057293+0000","last_clean":"2024-07-26T12:20:34.057293+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:20:34.057293+0000","last_undegraded":"2024-07-26T12:20:34.057293+0000","last_fullsized":"2024-07-26T12:20:34.057293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:31.410465+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:20:31.410465+0000","last_peered":"2024-07-26T12:20:31.410465+0000","last_clean":"2024-07-26T12:20:31.410465+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:20:31.410465+0000","last_undegraded":"2024-07-26T12:20:31.410465+0000","last_fullsized":"2024-07-26T12:20:31.410465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.530894+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:20:37.530894+0000","last_peered":"2024-07-26T12:20:37.530894+0000","last_clean":"2024-07-26T12:20:37.530894+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:20:37.530894+0000","last_undegraded":"2024-07-26T12:20:37.530894+0000","last_fullsized":"2024-07-26T12:20:37.530894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.297167+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:20:37.297167+0000","last_peered":"2024-07-26T12:20:37.297167+0000","last_clean":"2024-07-26T12:20:37.297167+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:20:37.297167+0000","last_undegraded":"2024-07-26T12:20:37.297167+0000","last_fullsized":"2024-07-26T12:20:37.297167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835465+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:20:27.835465+0000","last_peered":"2024-07-26T12:20:27.835465+0000","last_clean":"2024-07-26T12:20:27.835465+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:20:27.835465+0000","last_undegraded":"2024-07-26T12:20:27.835465+0000","last_fullsized":"2024-07-26T12:20:27.835465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107188+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107188+0000","last_peered":"2024-07-26T12:18:59.107188+0000","last_clean":"2024-07-26T12:18:59.107188+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107188+0000","last_undegraded":"2024-07-26T12:18:59.107188+0000","last_fullsized":"2024-07-26T12:18:59.107188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831555+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:20:27.831555+0000","last_peered":"2024-07-26T12:20:27.831555+0000","last_clean":"2024-07-26T12:20:27.831555+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:20:27.831555+0000","last_undegraded":"2024-07-26T12:20:27.831555+0000","last_fullsized":"2024-07-26T12:20:27.831555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094126+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:18:59.094126+0000","last_peered":"2024-07-26T12:18:59.094126+0000","last_clean":"2024-07-26T12:18:59.094126+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:18:59.094126+0000","last_undegraded":"2024-07-26T12:18:59.094126+0000","last_fullsized":"2024-07-26T12:18:59.094126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.809284+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:20:27.809284+0000","last_peered":"2024-07-26T12:20:27.809284+0000","last_clean":"2024-07-26T12:20:27.809284+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:20:27.809284+0000","last_undegraded":"2024-07-26T12:20:27.809284+0000","last_fullsized":"2024-07-26T12:20:27.809284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.095568+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:18:59.095568+0000","last_peered":"2024-07-26T12:18:59.095568+0000","last_clean":"2024-07-26T12:18:59.095568+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:18:59.095568+0000","last_undegraded":"2024-07-26T12:18:59.095568+0000","last_fullsized":"2024-07-26T12:18:59.095568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826443+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:20:27.826443+0000","last_peered":"2024-07-26T12:20:27.826443+0000","last_clean":"2024-07-26T12:20:27.826443+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:20:27.826443+0000","last_undegraded":"2024-07-26T12:20:27.826443+0000","last_fullsized":"2024-07-26T12:20:27.826443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:38.629627+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:20:38.629627+0000","last_peered":"2024-07-26T12:20:38.629627+0000","last_clean":"2024-07-26T12:20:38.629627+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:20:38.629627+0000","last_undegraded":"2024-07-26T12:20:38.629627+0000","last_fullsized":"2024-07-26T12:20:38.629627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831171+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:20:27.831171+0000","last_peered":"2024-07-26T12:20:27.831171+0000","last_clean":"2024-07-26T12:20:27.831171+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:20:27.831171+0000","last_undegraded":"2024-07-26T12:20:27.831171+0000","last_fullsized":"2024-07-26T12:20:27.831171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:02.028040+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:19:02.028040+0000","last_peered":"2024-07-26T12:19:02.028040+0000","last_clean":"2024-07-26T12:19:02.028040+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:19:02.028040+0000","last_undegraded":"2024-07-26T12:19:02.028040+0000","last_fullsized":"2024-07-26T12:19:02.028040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840809+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:20:27.840809+0000","last_peered":"2024-07-26T12:20:27.840809+0000","last_clean":"2024-07-26T12:20:27.840809+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:20:27.840809+0000","last_undegraded":"2024-07-26T12:20:27.840809+0000","last_fullsized":"2024-07-26T12:20:27.840809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839095+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:20:27.839095+0000","last_peered":"2024-07-26T12:20:27.839095+0000","last_clean":"2024-07-26T12:20:27.839095+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:20:27.839095+0000","last_undegraded":"2024-07-26T12:20:27.839095+0000","last_fullsized":"2024-07-26T12:20:27.839095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099091+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.099091+0000","last_peered":"2024-07-26T12:18:59.099091+0000","last_clean":"2024-07-26T12:18:59.099091+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.099091+0000","last_undegraded":"2024-07-26T12:18:59.099091+0000","last_fullsized":"2024-07-26T12:18:59.099091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837671+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:20:27.837671+0000","last_peered":"2024-07-26T12:20:27.837671+0000","last_clean":"2024-07-26T12:20:27.837671+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:20:27.837671+0000","last_undegraded":"2024-07-26T12:20:27.837671+0000","last_fullsized":"2024-07-26T12:20:27.837671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096752+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096752+0000","last_peered":"2024-07-26T12:18:59.096752+0000","last_clean":"2024-07-26T12:18:59.096752+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096752+0000","last_undegraded":"2024-07-26T12:18:59.096752+0000","last_fullsized":"2024-07-26T12:18:59.096752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414943+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:20:35.414943+0000","last_peered":"2024-07-26T12:20:35.414943+0000","last_clean":"2024-07-26T12:20:35.414943+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:20:35.414943+0000","last_undegraded":"2024-07-26T12:20:35.414943+0000","last_fullsized":"2024-07-26T12:20:35.414943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.517486+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:20:27.517486+0000","last_peered":"2024-07-26T12:20:27.517486+0000","last_clean":"2024-07-26T12:20:27.517486+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:20:27.517486+0000","last_undegraded":"2024-07-26T12:20:27.517486+0000","last_fullsized":"2024-07-26T12:20:27.517486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:32.518603+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:20:32.518603+0000","last_peered":"2024-07-26T12:20:32.518603+0000","last_clean":"2024-07-26T12:20:32.518603+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:20:32.518603+0000","last_undegraded":"2024-07-26T12:20:32.518603+0000","last_fullsized":"2024-07-26T12:20:32.518603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:40.795475+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:22:40.795475+0000","last_peered":"2024-07-26T12:22:40.795475+0000","last_clean":"2024-07-26T12:22:40.795475+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:22:40.795475+0000","last_undegraded":"2024-07-26T12:22:40.795475+0000","last_fullsized":"2024-07-26T12:22:40.795475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":223,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78706,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2308,"num_read_kb":1232,"num_write":272,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":236118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645383,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":436836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841612,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1096973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005140,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201369,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397602,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1029445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593831,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790063,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986295,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":505452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182524,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":437969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":506504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738513,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":437150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":72009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:22:45.215 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-07-26T12:22:45.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph pg dump --format=json 2024-07-26T12:22:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:45 smithi040 ceph-mon[32397]: pgmap v515: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-07-26T12:22:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:45 smithi040 ceph-mon[32397]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:45.739 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:45 smithi146 ceph-mon[35807]: pgmap v515: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-07-26T12:22:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:45 smithi146 ceph-mon[35807]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:45 smithi076 ceph-mon[35401]: pgmap v515: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-07-26T12:22:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:45 smithi076 ceph-mon[35401]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:47.585 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:47 smithi040 ceph-mon[32397]: pgmap v516: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-07-26T12:22:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:47 smithi146 ceph-mon[35807]: pgmap v516: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-07-26T12:22:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:47 smithi076 ceph-mon[35401]: pgmap v516: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 -- 172.21.15.40:0/3523799344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 msgr2=0x7f3560109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 --2- 172.21.15.40:0/3523799344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f3560109110 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3548009900 tx=0x7f354802a410 comp rx=0 tx=0).stop 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 -- 172.21.15.40:0/3523799344 shutdown_connections 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 --2- 172.21.15.40:0/3523799344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 0x7f356010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 --2- 172.21.15.40:0/3523799344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f3560109110 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 --2- 172.21.15.40:0/3523799344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35601033c0 0x7f35601037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.145+0000 7f3565600640 1 -- 172.21.15.40:0/3523799344 >> 172.21.15.40:0/3523799344 conn(0x7f35600fee10 msgr2=0x7f3560101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.146+0000 7f3565600640 1 -- 172.21.15.40:0/3523799344 shutdown_connections 2024-07-26T12:22:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.146+0000 7f3565600640 1 -- 172.21.15.40:0/3523799344 wait complete. 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 Processor -- start 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 -- start start 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35601033c0 0x7f3560199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f356019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 0x7f356019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3560113190 con 0x7f3560108d00 2024-07-26T12:22:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3560113010 con 0x7f35601033c0 2024-07-26T12:22:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.147+0000 7f3565600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3560113310 con 0x7f3560109650 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f356019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f356019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48714/0 (socket says 172.21.15.40:48714) 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 -- 172.21.15.40:0/3364302026 learned_addr learned my addr 172.21.15.40:0/3364302026 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3564c00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 0x7f356019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f355fe00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35601033c0 0x7f3560199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 -- 172.21.15.40:0/3364302026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 msgr2=0x7f356019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 0x7f356019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 -- 172.21.15.40:0/3364302026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35601033c0 msgr2=0x7f3560199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35601033c0 0x7f3560199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.148+0000 7f3557e00640 1 -- 172.21.15.40:0/3364302026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356019fb90 con 0x7f3560108d00 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f3564c00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 0x7f356019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f3557e00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f356019a1c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3548005940 tx=0x7f35480040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354803f030 con 0x7f3560108d00 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356019fe20 con 0x7f3560108d00 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3548003a80 con 0x7f3560108d00 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35601a65e0 con 0x7f3560108d00 2024-07-26T12:22:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.149+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548049060 con 0x7f3560108d00 2024-07-26T12:22:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.151+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35601037d0 con 0x7f3560108d00 2024-07-26T12:22:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.153+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3548042030 con 0x7f3560108d00 2024-07-26T12:22:48.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.155+0000 7f355d600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35440b3bd0 0x7f35440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:48.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.155+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3548104710 con 0x7f3560108d00 2024-07-26T12:22:48.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.155+0000 7f355fe00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35440b3bd0 0x7f35440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:48.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.156+0000 7f355fe00640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35440b3bd0 0x7f35440b60e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3550005fd0 tx=0x7f3550005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:48.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.157+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f35480cbd20 con 0x7f3560108d00 2024-07-26T12:22:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.358+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 --> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f356010b490 con 0x7f35440b3bd0 2024-07-26T12:22:48.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.364+0000 7f355d600640 1 -- 172.21.15.40:0/3364302026 <== mgr.14150 v2:172.21.15.40:6800/4031368209 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258877 (secure 0 0 0) 0x7f356010b490 con 0x7f35440b3bd0 2024-07-26T12:22:48.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:48.372 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.371+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35440b3bd0 msgr2=0x7f35440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.371+0000 7f3565600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35440b3bd0 0x7f35440b60e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3550005fd0 tx=0x7f3550005850 comp rx=0 tx=0).stop 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.371+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 msgr2=0x7f356019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.371+0000 7f3565600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f356019a1c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3548005940 tx=0x7f35480040e0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.371+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 shutdown_connections 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.371+0000 7f3565600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35440b3bd0 0x7f35440b60e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.372+0000 7f3565600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3560109650 0x7f356019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.372+0000 7f3565600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3560108d00 0x7f356019a1c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.372+0000 7f3565600640 1 --2- 172.21.15.40:0/3364302026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35601033c0 0x7f3560199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.372+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 >> 172.21.15.40:0/3364302026 conn(0x7f35600fee10 msgr2=0x7f3560101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.372+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 shutdown_connections 2024-07-26T12:22:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:48.372+0000 7f3565600640 1 -- 172.21.15.40:0/3364302026 wait complete. 2024-07-26T12:22:49.131 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2024-07-26T12:22:47.970413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":669308,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2424,"num_read_kb":1321,"num_write":397,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2954124,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":827,"ondisk_log_size":827,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386916,"kb_used_data":12804,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554908,"statfs":{"total":1151940427776,"available":1151544225792,"internally_reserved":0,"allocated":13111296,"data_stored":7221672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":382973244},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004974"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.047750+0000","last_change":"2024-07-26T12:18:29.578403+0000","last_active":"2024-07-26T12:20:37.047750+0000","last_peered":"2024-07-26T12:20:37.047750+0000","last_clean":"2024-07-26T12:20:37.047750+0000","last_became_active":"2024-07-26T12:18:29.577935+0000","last_became_peered":"2024-07-26T12:18:29.577935+0000","last_unstale":"2024-07-26T12:20:37.047750+0000","last_undegraded":"2024-07-26T12:20:37.047750+0000","last_fullsized":"2024-07-26T12:20:37.047750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:23:49.013351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414871+0000","last_change":"2024-07-26T12:18:29.574718+0000","last_active":"2024-07-26T12:20:35.414871+0000","last_peered":"2024-07-26T12:20:35.414871+0000","last_clean":"2024-07-26T12:20:35.414871+0000","last_became_active":"2024-07-26T12:18:29.573390+0000","last_became_peered":"2024-07-26T12:18:29.573390+0000","last_unstale":"2024-07-26T12:20:35.414871+0000","last_undegraded":"2024-07-26T12:20:35.414871+0000","last_fullsized":"2024-07-26T12:20:35.414871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:54:50.529469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414844+0000","last_change":"2024-07-26T12:18:29.562066+0000","last_active":"2024-07-26T12:20:35.414844+0000","last_peered":"2024-07-26T12:20:35.414844+0000","last_clean":"2024-07-26T12:20:35.414844+0000","last_became_active":"2024-07-26T12:18:29.561725+0000","last_became_peered":"2024-07-26T12:18:29.561725+0000","last_unstale":"2024-07-26T12:20:35.414844+0000","last_undegraded":"2024-07-26T12:20:35.414844+0000","last_fullsized":"2024-07-26T12:20:35.414844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:03.548224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831376+0000","last_change":"2024-07-26T12:18:59.104267+0000","last_active":"2024-07-26T12:20:27.831376+0000","last_peered":"2024-07-26T12:20:27.831376+0000","last_clean":"2024-07-26T12:20:27.831376+0000","last_became_active":"2024-07-26T12:18:59.102840+0000","last_became_peered":"2024-07-26T12:18:59.102840+0000","last_unstale":"2024-07-26T12:20:27.831376+0000","last_undegraded":"2024-07-26T12:20:27.831376+0000","last_fullsized":"2024-07-26T12:20:27.831376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:12:54.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823673+0000","last_change":"2024-07-26T12:18:29.570074+0000","last_active":"2024-07-26T12:20:27.823673+0000","last_peered":"2024-07-26T12:20:27.823673+0000","last_clean":"2024-07-26T12:20:27.823673+0000","last_became_active":"2024-07-26T12:18:29.569636+0000","last_became_peered":"2024-07-26T12:18:29.569636+0000","last_unstale":"2024-07-26T12:20:27.823673+0000","last_undegraded":"2024-07-26T12:20:27.823673+0000","last_fullsized":"2024-07-26T12:20:27.823673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:17:49.850877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837159+0000","last_change":"2024-07-26T12:18:29.570876+0000","last_active":"2024-07-26T12:20:27.837159+0000","last_peered":"2024-07-26T12:20:27.837159+0000","last_clean":"2024-07-26T12:20:27.837159+0000","last_became_active":"2024-07-26T12:18:29.566781+0000","last_became_peered":"2024-07-26T12:18:29.566781+0000","last_unstale":"2024-07-26T12:20:27.837159+0000","last_undegraded":"2024-07-26T12:20:27.837159+0000","last_fullsized":"2024-07-26T12:20:27.837159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:43:38.169183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835809+0000","last_change":"2024-07-26T12:18:29.554658+0000","last_active":"2024-07-26T12:20:27.835809+0000","last_peered":"2024-07-26T12:20:27.835809+0000","last_clean":"2024-07-26T12:20:27.835809+0000","last_became_active":"2024-07-26T12:18:29.551545+0000","last_became_peered":"2024-07-26T12:18:29.551545+0000","last_unstale":"2024-07-26T12:20:27.835809+0000","last_undegraded":"2024-07-26T12:20:27.835809+0000","last_fullsized":"2024-07-26T12:20:27.835809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:11:14.317528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831130+0000","last_change":"2024-07-26T12:18:29.570815+0000","last_active":"2024-07-26T12:20:27.831130+0000","last_peered":"2024-07-26T12:20:27.831130+0000","last_clean":"2024-07-26T12:20:27.831130+0000","last_became_active":"2024-07-26T12:18:29.570378+0000","last_became_peered":"2024-07-26T12:18:29.570378+0000","last_unstale":"2024-07-26T12:20:27.831130+0000","last_undegraded":"2024-07-26T12:20:27.831130+0000","last_fullsized":"2024-07-26T12:20:27.831130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:34:31.593994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841319+0000","last_change":"2024-07-26T12:18:59.111037+0000","last_active":"2024-07-26T12:20:27.841319+0000","last_peered":"2024-07-26T12:20:27.841319+0000","last_clean":"2024-07-26T12:20:27.841319+0000","last_became_active":"2024-07-26T12:18:59.110221+0000","last_became_peered":"2024-07-26T12:18:59.110221+0000","last_unstale":"2024-07-26T12:20:27.841319+0000","last_undegraded":"2024-07-26T12:20:27.841319+0000","last_fullsized":"2024-07-26T12:20:27.841319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:47:21.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.829801+0000","last_change":"2024-07-26T12:18:29.576150+0000","last_active":"2024-07-26T12:20:27.829801+0000","last_peered":"2024-07-26T12:20:27.829801+0000","last_clean":"2024-07-26T12:20:27.829801+0000","last_became_active":"2024-07-26T12:18:29.572534+0000","last_became_peered":"2024-07-26T12:18:29.572534+0000","last_unstale":"2024-07-26T12:20:27.829801+0000","last_undegraded":"2024-07-26T12:20:27.829801+0000","last_fullsized":"2024-07-26T12:20:27.829801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:20:45.206087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840330+0000","last_change":"2024-07-26T12:18:29.563844+0000","last_active":"2024-07-26T12:20:27.840330+0000","last_peered":"2024-07-26T12:20:27.840330+0000","last_clean":"2024-07-26T12:20:27.840330+0000","last_became_active":"2024-07-26T12:18:29.563457+0000","last_became_peered":"2024-07-26T12:18:29.563457+0000","last_unstale":"2024-07-26T12:20:27.840330+0000","last_undegraded":"2024-07-26T12:20:27.840330+0000","last_fullsized":"2024-07-26T12:20:27.840330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:51:50.687279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823915+0000","last_change":"2024-07-26T12:18:29.574330+0000","last_active":"2024-07-26T12:20:27.823915+0000","last_peered":"2024-07-26T12:20:27.823915+0000","last_clean":"2024-07-26T12:20:27.823915+0000","last_became_active":"2024-07-26T12:18:29.568145+0000","last_became_peered":"2024-07-26T12:18:29.568145+0000","last_unstale":"2024-07-26T12:20:27.823915+0000","last_undegraded":"2024-07-26T12:20:27.823915+0000","last_fullsized":"2024-07-26T12:20:27.823915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:56:43.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837715+0000","last_change":"2024-07-26T12:18:29.557913+0000","last_active":"2024-07-26T12:20:27.837715+0000","last_peered":"2024-07-26T12:20:27.837715+0000","last_clean":"2024-07-26T12:20:27.837715+0000","last_became_active":"2024-07-26T12:18:29.555721+0000","last_became_peered":"2024-07-26T12:18:29.555721+0000","last_unstale":"2024-07-26T12:20:27.837715+0000","last_undegraded":"2024-07-26T12:20:27.837715+0000","last_fullsized":"2024-07-26T12:20:27.837715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:58:51.723309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831001+0000","last_change":"2024-07-26T12:18:29.570371+0000","last_active":"2024-07-26T12:20:27.831001+0000","last_peered":"2024-07-26T12:20:27.831001+0000","last_clean":"2024-07-26T12:20:27.831001+0000","last_became_active":"2024-07-26T12:18:29.569804+0000","last_became_peered":"2024-07-26T12:18:29.569804+0000","last_unstale":"2024-07-26T12:20:27.831001+0000","last_undegraded":"2024-07-26T12:20:27.831001+0000","last_fullsized":"2024-07-26T12:20:27.831001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:38:30.748941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822868+0000","last_change":"2024-07-26T12:18:29.559424+0000","last_active":"2024-07-26T12:20:27.822868+0000","last_peered":"2024-07-26T12:20:27.822868+0000","last_clean":"2024-07-26T12:20:27.822868+0000","last_became_active":"2024-07-26T12:18:29.557896+0000","last_became_peered":"2024-07-26T12:18:29.557896+0000","last_unstale":"2024-07-26T12:20:27.822868+0000","last_undegraded":"2024-07-26T12:20:27.822868+0000","last_fullsized":"2024-07-26T12:20:27.822868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:27:30.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.841034+0000","last_change":"2024-07-26T12:18:29.557093+0000","last_active":"2024-07-26T12:20:27.841034+0000","last_peered":"2024-07-26T12:20:27.841034+0000","last_clean":"2024-07-26T12:20:27.841034+0000","last_became_active":"2024-07-26T12:18:29.556729+0000","last_became_peered":"2024-07-26T12:18:29.556729+0000","last_unstale":"2024-07-26T12:20:27.841034+0000","last_undegraded":"2024-07-26T12:20:27.841034+0000","last_fullsized":"2024-07-26T12:20:27.841034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:50:09.881799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.836586+0000","last_change":"2024-07-26T12:18:29.575937+0000","last_active":"2024-07-26T12:20:27.836586+0000","last_peered":"2024-07-26T12:20:27.836586+0000","last_clean":"2024-07-26T12:20:27.836586+0000","last_became_active":"2024-07-26T12:18:29.575431+0000","last_became_peered":"2024-07-26T12:18:29.575431+0000","last_unstale":"2024-07-26T12:20:27.836586+0000","last_undegraded":"2024-07-26T12:20:27.836586+0000","last_fullsized":"2024-07-26T12:20:27.836586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:11.138453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837413+0000","last_change":"2024-07-26T12:18:29.569036+0000","last_active":"2024-07-26T12:20:27.837413+0000","last_peered":"2024-07-26T12:20:27.837413+0000","last_clean":"2024-07-26T12:20:27.837413+0000","last_became_active":"2024-07-26T12:18:29.567844+0000","last_became_peered":"2024-07-26T12:18:29.567844+0000","last_unstale":"2024-07-26T12:20:27.837413+0000","last_undegraded":"2024-07-26T12:20:27.837413+0000","last_fullsized":"2024-07-26T12:20:27.837413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:49:32.573111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.824397+0000","last_change":"2024-07-26T12:18:29.569846+0000","last_active":"2024-07-26T12:20:27.824397+0000","last_peered":"2024-07-26T12:20:27.824397+0000","last_clean":"2024-07-26T12:20:27.824397+0000","last_became_active":"2024-07-26T12:18:29.569416+0000","last_became_peered":"2024-07-26T12:18:29.569416+0000","last_unstale":"2024-07-26T12:20:27.824397+0000","last_undegraded":"2024-07-26T12:20:27.824397+0000","last_fullsized":"2024-07-26T12:20:27.824397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:44:11.089392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.821591+0000","last_change":"2024-07-26T12:18:29.571351+0000","last_active":"2024-07-26T12:20:27.821591+0000","last_peered":"2024-07-26T12:20:27.821591+0000","last_clean":"2024-07-26T12:20:27.821591+0000","last_became_active":"2024-07-26T12:18:29.570971+0000","last_became_peered":"2024-07-26T12:18:29.570971+0000","last_unstale":"2024-07-26T12:20:27.821591+0000","last_undegraded":"2024-07-26T12:20:27.821591+0000","last_fullsized":"2024-07-26T12:20:27.821591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:16:37.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839046+0000","last_change":"2024-07-26T12:18:29.558935+0000","last_active":"2024-07-26T12:20:27.839046+0000","last_peered":"2024-07-26T12:20:27.839046+0000","last_clean":"2024-07-26T12:20:27.839046+0000","last_became_active":"2024-07-26T12:18:29.558533+0000","last_became_peered":"2024-07-26T12:18:29.558533+0000","last_unstale":"2024-07-26T12:20:27.839046+0000","last_undegraded":"2024-07-26T12:20:27.839046+0000","last_fullsized":"2024-07-26T12:20:27.839046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:44.645730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840534+0000","last_change":"2024-07-26T12:18:29.560428+0000","last_active":"2024-07-26T12:20:27.840534+0000","last_peered":"2024-07-26T12:20:27.840534+0000","last_clean":"2024-07-26T12:20:27.840534+0000","last_became_active":"2024-07-26T12:18:29.558774+0000","last_became_peered":"2024-07-26T12:18:29.558774+0000","last_unstale":"2024-07-26T12:20:27.840534+0000","last_undegraded":"2024-07-26T12:20:27.840534+0000","last_fullsized":"2024-07-26T12:20:27.840534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:54:33.256693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832429+0000","last_change":"2024-07-26T12:18:59.102611+0000","last_active":"2024-07-26T12:20:27.832429+0000","last_peered":"2024-07-26T12:20:27.832429+0000","last_clean":"2024-07-26T12:20:27.832429+0000","last_became_active":"2024-07-26T12:18:59.101552+0000","last_became_peered":"2024-07-26T12:18:59.101552+0000","last_unstale":"2024-07-26T12:20:27.832429+0000","last_undegraded":"2024-07-26T12:20:27.832429+0000","last_fullsized":"2024-07-26T12:20:27.832429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:34.607632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.832251+0000","last_change":"2024-07-26T12:18:29.552866+0000","last_active":"2024-07-26T12:20:27.832251+0000","last_peered":"2024-07-26T12:20:27.832251+0000","last_clean":"2024-07-26T12:20:27.832251+0000","last_became_active":"2024-07-26T12:18:29.552506+0000","last_became_peered":"2024-07-26T12:18:29.552506+0000","last_unstale":"2024-07-26T12:20:27.832251+0000","last_undegraded":"2024-07-26T12:20:27.832251+0000","last_fullsized":"2024-07-26T12:20:27.832251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:37:41.631223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822925+0000","last_change":"2024-07-26T12:18:29.566187+0000","last_active":"2024-07-26T12:20:27.822925+0000","last_peered":"2024-07-26T12:20:27.822925+0000","last_clean":"2024-07-26T12:20:27.822925+0000","last_became_active":"2024-07-26T12:18:29.565246+0000","last_became_peered":"2024-07-26T12:18:29.565246+0000","last_unstale":"2024-07-26T12:20:27.822925+0000","last_undegraded":"2024-07-26T12:20:27.822925+0000","last_fullsized":"2024-07-26T12:20:27.822925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:36:11.264230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835480+0000","last_change":"2024-07-26T12:18:29.570645+0000","last_active":"2024-07-26T12:20:27.835480+0000","last_peered":"2024-07-26T12:20:27.835480+0000","last_clean":"2024-07-26T12:20:27.835480+0000","last_became_active":"2024-07-26T12:18:29.570236+0000","last_became_peered":"2024-07-26T12:18:29.570236+0000","last_unstale":"2024-07-26T12:20:27.835480+0000","last_undegraded":"2024-07-26T12:20:27.835480+0000","last_fullsized":"2024-07-26T12:20:27.835480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:52:41.969538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.823737+0000","last_change":"2024-07-26T12:18:29.575932+0000","last_active":"2024-07-26T12:20:27.823737+0000","last_peered":"2024-07-26T12:20:27.823737+0000","last_clean":"2024-07-26T12:20:27.823737+0000","last_became_active":"2024-07-26T12:18:29.573815+0000","last_became_peered":"2024-07-26T12:18:29.573815+0000","last_unstale":"2024-07-26T12:20:27.823737+0000","last_undegraded":"2024-07-26T12:20:27.823737+0000","last_fullsized":"2024-07-26T12:20:27.823737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:37:38.660065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830232+0000","last_change":"2024-07-26T12:18:29.555954+0000","last_active":"2024-07-26T12:20:27.830232+0000","last_peered":"2024-07-26T12:20:27.830232+0000","last_clean":"2024-07-26T12:20:27.830232+0000","last_became_active":"2024-07-26T12:18:29.551987+0000","last_became_peered":"2024-07-26T12:18:29.551987+0000","last_unstale":"2024-07-26T12:20:27.830232+0000","last_undegraded":"2024-07-26T12:20:27.830232+0000","last_fullsized":"2024-07-26T12:20:27.830232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:37:01.757627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414797+0000","last_change":"2024-07-26T12:18:29.564736+0000","last_active":"2024-07-26T12:20:35.414797+0000","last_peered":"2024-07-26T12:20:35.414797+0000","last_clean":"2024-07-26T12:20:35.414797+0000","last_became_active":"2024-07-26T12:18:29.564256+0000","last_became_peered":"2024-07-26T12:18:29.564256+0000","last_unstale":"2024-07-26T12:20:35.414797+0000","last_undegraded":"2024-07-26T12:20:35.414797+0000","last_fullsized":"2024-07-26T12:20:35.414797+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:20.915176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.628489+0000","last_change":"2024-07-26T12:18:29.560204+0000","last_active":"2024-07-26T12:20:33.628489+0000","last_peered":"2024-07-26T12:20:33.628489+0000","last_clean":"2024-07-26T12:20:33.628489+0000","last_became_active":"2024-07-26T12:18:29.559761+0000","last_became_peered":"2024-07-26T12:18:29.559761+0000","last_unstale":"2024-07-26T12:20:33.628489+0000","last_undegraded":"2024-07-26T12:20:33.628489+0000","last_fullsized":"2024-07-26T12:20:33.628489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:18:00.373669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.628409+0000","last_change":"2024-07-26T12:18:29.571386+0000","last_active":"2024-07-26T12:20:33.628409+0000","last_peered":"2024-07-26T12:20:33.628409+0000","last_clean":"2024-07-26T12:20:33.628409+0000","last_became_active":"2024-07-26T12:18:29.570868+0000","last_became_peered":"2024-07-26T12:18:29.570868+0000","last_unstale":"2024-07-26T12:20:33.628409+0000","last_undegraded":"2024-07-26T12:20:33.628409+0000","last_fullsized":"2024-07-26T12:20:33.628409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:31:36.358344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.047680+0000","last_change":"2024-07-26T12:18:29.568490+0000","last_active":"2024-07-26T12:20:37.047680+0000","last_peered":"2024-07-26T12:20:37.047680+0000","last_clean":"2024-07-26T12:20:37.047680+0000","last_became_active":"2024-07-26T12:18:29.566893+0000","last_became_peered":"2024-07-26T12:18:29.566893+0000","last_unstale":"2024-07-26T12:20:37.047680+0000","last_undegraded":"2024-07-26T12:20:37.047680+0000","last_fullsized":"2024-07-26T12:20:37.047680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:02:08.427164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826868+0000","last_change":"2024-07-26T12:18:29.566498+0000","last_active":"2024-07-26T12:20:27.826868+0000","last_peered":"2024-07-26T12:20:27.826868+0000","last_clean":"2024-07-26T12:20:27.826868+0000","last_became_active":"2024-07-26T12:18:29.565391+0000","last_became_peered":"2024-07-26T12:18:29.565391+0000","last_unstale":"2024-07-26T12:20:27.826868+0000","last_undegraded":"2024-07-26T12:20:27.826868+0000","last_fullsized":"2024-07-26T12:20:27.826868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:40:44.007419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":272,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:41.860890+0000","last_change":"2024-07-26T12:18:25.509689+0000","last_active":"2024-07-26T12:22:41.860890+0000","last_peered":"2024-07-26T12:22:41.860890+0000","last_clean":"2024-07-26T12:22:41.860890+0000","last_became_active":"2024-07-26T12:18:25.508827+0000","last_became_peered":"2024-07-26T12:18:25.508827+0000","last_unstale":"2024-07-26T12:22:41.860890+0000","last_undegraded":"2024-07-26T12:22:41.860890+0000","last_fullsized":"2024-07-26T12:22:41.860890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:19:51.053883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827551+0000","last_change":"2024-07-26T12:18:29.556597+0000","last_active":"2024-07-26T12:20:27.827551+0000","last_peered":"2024-07-26T12:20:27.827551+0000","last_clean":"2024-07-26T12:20:27.827551+0000","last_became_active":"2024-07-26T12:18:29.552132+0000","last_became_peered":"2024-07-26T12:18:29.552132+0000","last_unstale":"2024-07-26T12:20:27.827551+0000","last_undegraded":"2024-07-26T12:20:27.827551+0000","last_fullsized":"2024-07-26T12:20:27.827551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:34:46.646452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.088332+0000","last_change":"2024-07-26T12:18:25.507880+0000","last_active":"2024-07-26T12:18:59.088332+0000","last_peered":"2024-07-26T12:18:59.088332+0000","last_clean":"2024-07-26T12:18:59.088332+0000","last_became_active":"2024-07-26T12:18:25.505111+0000","last_became_peered":"2024-07-26T12:18:25.505111+0000","last_unstale":"2024-07-26T12:18:59.088332+0000","last_undegraded":"2024-07-26T12:18:59.088332+0000","last_fullsized":"2024-07-26T12:18:59.088332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:26:59.894495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.084679+0000","last_change":"2024-07-26T12:18:25.502803+0000","last_active":"2024-07-26T12:18:59.084679+0000","last_peered":"2024-07-26T12:18:59.084679+0000","last_clean":"2024-07-26T12:18:59.084679+0000","last_became_active":"2024-07-26T12:18:25.502054+0000","last_became_peered":"2024-07-26T12:18:25.502054+0000","last_unstale":"2024-07-26T12:18:59.084679+0000","last_undegraded":"2024-07-26T12:18:59.084679+0000","last_fullsized":"2024-07-26T12:18:59.084679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:24:55.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826687+0000","last_change":"2024-07-26T12:18:29.551669+0000","last_active":"2024-07-26T12:20:27.826687+0000","last_peered":"2024-07-26T12:20:27.826687+0000","last_clean":"2024-07-26T12:20:27.826687+0000","last_became_active":"2024-07-26T12:18:29.551260+0000","last_became_peered":"2024-07-26T12:18:29.551260+0000","last_unstale":"2024-07-26T12:20:27.826687+0000","last_undegraded":"2024-07-26T12:20:27.826687+0000","last_fullsized":"2024-07-26T12:20:27.826687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:35.100793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117922+0000","last_change":"2024-07-26T12:18:25.512740+0000","last_active":"2024-07-26T12:18:59.117922+0000","last_peered":"2024-07-26T12:18:59.117922+0000","last_clean":"2024-07-26T12:18:59.117922+0000","last_became_active":"2024-07-26T12:18:25.511204+0000","last_became_peered":"2024-07-26T12:18:25.511204+0000","last_unstale":"2024-07-26T12:18:59.117922+0000","last_undegraded":"2024-07-26T12:18:59.117922+0000","last_fullsized":"2024-07-26T12:18:59.117922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:30:50.938605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838871+0000","last_change":"2024-07-26T12:18:29.567778+0000","last_active":"2024-07-26T12:20:27.838871+0000","last_peered":"2024-07-26T12:20:27.838871+0000","last_clean":"2024-07-26T12:20:27.838871+0000","last_became_active":"2024-07-26T12:18:29.566396+0000","last_became_peered":"2024-07-26T12:18:29.566396+0000","last_unstale":"2024-07-26T12:20:27.838871+0000","last_undegraded":"2024-07-26T12:20:27.838871+0000","last_fullsized":"2024-07-26T12:20:27.838871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:01:37.555351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":499,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:43.846710+0000","last_change":"2024-07-26T12:18:25.510022+0000","last_active":"2024-07-26T12:22:43.846710+0000","last_peered":"2024-07-26T12:22:43.846710+0000","last_clean":"2024-07-26T12:22:43.846710+0000","last_became_active":"2024-07-26T12:18:25.508283+0000","last_became_peered":"2024-07-26T12:18:25.508283+0000","last_unstale":"2024-07-26T12:22:43.846710+0000","last_undegraded":"2024-07-26T12:22:43.846710+0000","last_fullsized":"2024-07-26T12:22:43.846710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:49:03.571553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":464,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839581+0000","last_change":"2024-07-26T12:18:29.576700+0000","last_active":"2024-07-26T12:20:27.839581+0000","last_peered":"2024-07-26T12:20:27.839581+0000","last_clean":"2024-07-26T12:20:27.839581+0000","last_became_active":"2024-07-26T12:18:29.575904+0000","last_became_peered":"2024-07-26T12:18:29.575904+0000","last_unstale":"2024-07-26T12:20:27.839581+0000","last_undegraded":"2024-07-26T12:20:27.839581+0000","last_fullsized":"2024-07-26T12:20:27.839581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:58:17.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096936+0000","last_change":"2024-07-26T12:18:25.513024+0000","last_active":"2024-07-26T12:18:59.096936+0000","last_peered":"2024-07-26T12:18:59.096936+0000","last_clean":"2024-07-26T12:18:59.096936+0000","last_became_active":"2024-07-26T12:18:25.511124+0000","last_became_peered":"2024-07-26T12:18:25.511124+0000","last_unstale":"2024-07-26T12:18:59.096936+0000","last_undegraded":"2024-07-26T12:18:59.096936+0000","last_fullsized":"2024-07-26T12:18:59.096936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:56:25.381356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.830415+0000","last_change":"2024-07-26T12:18:29.565250+0000","last_active":"2024-07-26T12:20:27.830415+0000","last_peered":"2024-07-26T12:20:27.830415+0000","last_clean":"2024-07-26T12:20:27.830415+0000","last_became_active":"2024-07-26T12:18:29.563617+0000","last_became_peered":"2024-07-26T12:18:29.563617+0000","last_unstale":"2024-07-26T12:20:27.830415+0000","last_undegraded":"2024-07-26T12:20:27.830415+0000","last_fullsized":"2024-07-26T12:20:27.830415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:55:38.377352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118636+0000","last_change":"2024-07-26T12:18:25.520768+0000","last_active":"2024-07-26T12:18:59.118636+0000","last_peered":"2024-07-26T12:18:59.118636+0000","last_clean":"2024-07-26T12:18:59.118636+0000","last_became_active":"2024-07-26T12:18:25.520355+0000","last_became_peered":"2024-07-26T12:18:25.520355+0000","last_unstale":"2024-07-26T12:18:59.118636+0000","last_undegraded":"2024-07-26T12:18:59.118636+0000","last_fullsized":"2024-07-26T12:18:59.118636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:59:23.442787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839729+0000","last_change":"2024-07-26T12:18:59.106504+0000","last_active":"2024-07-26T12:20:27.839729+0000","last_peered":"2024-07-26T12:20:27.839729+0000","last_clean":"2024-07-26T12:20:27.839729+0000","last_became_active":"2024-07-26T12:18:59.104976+0000","last_became_peered":"2024-07-26T12:18:59.104976+0000","last_unstale":"2024-07-26T12:20:27.839729+0000","last_undegraded":"2024-07-26T12:20:27.839729+0000","last_fullsized":"2024-07-26T12:20:27.839729+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:33:14.204514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":563,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:43.857274+0000","last_change":"2024-07-26T12:18:59.137025+0000","last_active":"2024-07-26T12:22:43.857274+0000","last_peered":"2024-07-26T12:22:43.857274+0000","last_clean":"2024-07-26T12:22:43.857274+0000","last_became_active":"2024-07-26T12:18:59.109141+0000","last_became_peered":"2024-07-26T12:18:59.109141+0000","last_unstale":"2024-07-26T12:22:43.857274+0000","last_undegraded":"2024-07-26T12:22:43.857274+0000","last_fullsized":"2024-07-26T12:22:43.857274+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:45:54.020284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69780,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":460,"num_read_kb":297,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.828023+0000","last_change":"2024-07-26T12:18:29.577964+0000","last_active":"2024-07-26T12:20:27.828023+0000","last_peered":"2024-07-26T12:20:27.828023+0000","last_clean":"2024-07-26T12:20:27.828023+0000","last_became_active":"2024-07-26T12:18:29.577564+0000","last_became_peered":"2024-07-26T12:18:29.577564+0000","last_unstale":"2024-07-26T12:20:27.828023+0000","last_undegraded":"2024-07-26T12:20:27.828023+0000","last_fullsized":"2024-07-26T12:20:27.828023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:36:32.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.094059+0000","last_change":"2024-07-26T12:18:25.510746+0000","last_active":"2024-07-26T12:18:59.094059+0000","last_peered":"2024-07-26T12:18:59.094059+0000","last_clean":"2024-07-26T12:18:59.094059+0000","last_became_active":"2024-07-26T12:18:25.509269+0000","last_became_peered":"2024-07-26T12:18:25.509269+0000","last_unstale":"2024-07-26T12:18:59.094059+0000","last_undegraded":"2024-07-26T12:18:59.094059+0000","last_fullsized":"2024-07-26T12:18:59.094059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:50:43.938625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.827622+0000","last_change":"2024-07-26T12:18:29.558974+0000","last_active":"2024-07-26T12:20:27.827622+0000","last_peered":"2024-07-26T12:20:27.827622+0000","last_clean":"2024-07-26T12:20:27.827622+0000","last_became_active":"2024-07-26T12:18:29.558563+0000","last_became_peered":"2024-07-26T12:18:29.558563+0000","last_unstale":"2024-07-26T12:20:27.827622+0000","last_undegraded":"2024-07-26T12:20:27.827622+0000","last_fullsized":"2024-07-26T12:20:27.827622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:25:54.758743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.117333+0000","last_change":"2024-07-26T12:18:25.513201+0000","last_active":"2024-07-26T12:18:59.117333+0000","last_peered":"2024-07-26T12:18:59.117333+0000","last_clean":"2024-07-26T12:18:59.117333+0000","last_became_active":"2024-07-26T12:18:25.511078+0000","last_became_peered":"2024-07-26T12:18:25.511078+0000","last_unstale":"2024-07-26T12:18:59.117333+0000","last_undegraded":"2024-07-26T12:18:59.117333+0000","last_fullsized":"2024-07-26T12:18:59.117333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:47.198950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.843505+0000","last_change":"2024-07-26T12:18:29.567424+0000","last_active":"2024-07-26T12:20:27.843505+0000","last_peered":"2024-07-26T12:20:27.843505+0000","last_clean":"2024-07-26T12:20:27.843505+0000","last_became_active":"2024-07-26T12:18:29.566972+0000","last_became_peered":"2024-07-26T12:18:29.566972+0000","last_unstale":"2024-07-26T12:20:27.843505+0000","last_undegraded":"2024-07-26T12:20:27.843505+0000","last_fullsized":"2024-07-26T12:20:27.843505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T12:47:43.651781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":269,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:42.802258+0000","last_change":"2024-07-26T12:18:25.512653+0000","last_active":"2024-07-26T12:22:42.802258+0000","last_peered":"2024-07-26T12:22:42.802258+0000","last_clean":"2024-07-26T12:22:42.802258+0000","last_became_active":"2024-07-26T12:18:25.511735+0000","last_became_peered":"2024-07-26T12:18:25.511735+0000","last_unstale":"2024-07-26T12:22:42.802258+0000","last_undegraded":"2024-07-26T12:22:42.802258+0000","last_fullsized":"2024-07-26T12:22:42.802258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:56:39.436156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.838824+0000","last_change":"2024-07-26T12:18:29.571552+0000","last_active":"2024-07-26T12:20:27.838824+0000","last_peered":"2024-07-26T12:20:27.838824+0000","last_clean":"2024-07-26T12:20:27.838824+0000","last_became_active":"2024-07-26T12:18:29.569949+0000","last_became_peered":"2024-07-26T12:18:29.569949+0000","last_unstale":"2024-07-26T12:20:27.838824+0000","last_undegraded":"2024-07-26T12:20:27.838824+0000","last_fullsized":"2024-07-26T12:20:27.838824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:30:46.817779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096135+0000","last_change":"2024-07-26T12:18:25.518382+0000","last_active":"2024-07-26T12:18:59.096135+0000","last_peered":"2024-07-26T12:18:59.096135+0000","last_clean":"2024-07-26T12:18:59.096135+0000","last_became_active":"2024-07-26T12:18:25.517686+0000","last_became_peered":"2024-07-26T12:18:25.517686+0000","last_unstale":"2024-07-26T12:18:59.096135+0000","last_undegraded":"2024-07-26T12:18:59.096135+0000","last_fullsized":"2024-07-26T12:18:59.096135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:01:28.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.834733+0000","last_change":"2024-07-26T12:18:29.562783+0000","last_active":"2024-07-26T12:20:27.834733+0000","last_peered":"2024-07-26T12:20:27.834733+0000","last_clean":"2024-07-26T12:20:27.834733+0000","last_became_active":"2024-07-26T12:18:29.557316+0000","last_became_peered":"2024-07-26T12:18:29.557316+0000","last_unstale":"2024-07-26T12:20:27.834733+0000","last_undegraded":"2024-07-26T12:20:27.834733+0000","last_fullsized":"2024-07-26T12:20:27.834733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:42:07.510778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:41.412571+0000","last_change":"2024-07-26T12:18:25.506297+0000","last_active":"2024-07-26T12:20:41.412571+0000","last_peered":"2024-07-26T12:20:41.412571+0000","last_clean":"2024-07-26T12:20:41.412571+0000","last_became_active":"2024-07-26T12:18:25.505577+0000","last_became_peered":"2024-07-26T12:18:25.505577+0000","last_unstale":"2024-07-26T12:20:41.412571+0000","last_undegraded":"2024-07-26T12:20:41.412571+0000","last_fullsized":"2024-07-26T12:20:41.412571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:43.243976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.822644+0000","last_change":"2024-07-26T12:18:29.572530+0000","last_active":"2024-07-26T12:20:27.822644+0000","last_peered":"2024-07-26T12:20:27.822644+0000","last_clean":"2024-07-26T12:20:27.822644+0000","last_became_active":"2024-07-26T12:18:29.566834+0000","last_became_peered":"2024-07-26T12:18:29.566834+0000","last_unstale":"2024-07-26T12:20:27.822644+0000","last_undegraded":"2024-07-26T12:20:27.822644+0000","last_fullsized":"2024-07-26T12:20:27.822644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:05:50.303229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.121398+0000","last_change":"2024-07-26T12:18:59.119766+0000","last_active":"2024-07-26T12:18:59.121398+0000","last_peered":"2024-07-26T12:18:59.121398+0000","last_clean":"2024-07-26T12:18:59.121398+0000","last_became_active":"2024-07-26T12:18:59.107895+0000","last_became_peered":"2024-07-26T12:18:59.107895+0000","last_unstale":"2024-07-26T12:18:59.121398+0000","last_undegraded":"2024-07-26T12:18:59.121398+0000","last_fullsized":"2024-07-26T12:18:59.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:37:19.792065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837997+0000","last_change":"2024-07-26T12:18:29.564607+0000","last_active":"2024-07-26T12:20:27.837997+0000","last_peered":"2024-07-26T12:20:27.837997+0000","last_clean":"2024-07-26T12:20:27.837997+0000","last_became_active":"2024-07-26T12:18:29.564086+0000","last_became_peered":"2024-07-26T12:18:29.564086+0000","last_unstale":"2024-07-26T12:20:27.837997+0000","last_undegraded":"2024-07-26T12:20:27.837997+0000","last_fullsized":"2024-07-26T12:20:27.837997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:56:51.460600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.118876+0000","last_change":"2024-07-26T12:18:25.510617+0000","last_active":"2024-07-26T12:18:59.118876+0000","last_peered":"2024-07-26T12:18:59.118876+0000","last_clean":"2024-07-26T12:18:59.118876+0000","last_became_active":"2024-07-26T12:18:25.510141+0000","last_became_peered":"2024-07-26T12:18:25.510141+0000","last_unstale":"2024-07-26T12:18:59.118876+0000","last_undegraded":"2024-07-26T12:18:59.118876+0000","last_fullsized":"2024-07-26T12:18:59.118876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:25:23.316223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.833208+0000","last_change":"2024-07-26T12:18:29.569004+0000","last_active":"2024-07-26T12:20:27.833208+0000","last_peered":"2024-07-26T12:20:27.833208+0000","last_clean":"2024-07-26T12:20:27.833208+0000","last_became_active":"2024-07-26T12:18:29.568422+0000","last_became_peered":"2024-07-26T12:18:29.568422+0000","last_unstale":"2024-07-26T12:20:27.833208+0000","last_undegraded":"2024-07-26T12:20:27.833208+0000","last_fullsized":"2024-07-26T12:20:27.833208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:06:49.613678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":268,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:41.841005+0000","last_change":"2024-07-26T12:18:25.518609+0000","last_active":"2024-07-26T12:22:41.841005+0000","last_peered":"2024-07-26T12:22:41.841005+0000","last_clean":"2024-07-26T12:22:41.841005+0000","last_became_active":"2024-07-26T12:18:25.518138+0000","last_became_peered":"2024-07-26T12:18:25.518138+0000","last_unstale":"2024-07-26T12:22:41.841005+0000","last_undegraded":"2024-07-26T12:22:41.841005+0000","last_fullsized":"2024-07-26T12:22:41.841005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:44:31.679912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840206+0000","last_change":"2024-07-26T12:18:29.569946+0000","last_active":"2024-07-26T12:20:27.840206+0000","last_peered":"2024-07-26T12:20:27.840206+0000","last_clean":"2024-07-26T12:20:27.840206+0000","last_became_active":"2024-07-26T12:18:29.567813+0000","last_became_peered":"2024-07-26T12:18:29.567813+0000","last_unstale":"2024-07-26T12:20:27.840206+0000","last_undegraded":"2024-07-26T12:20:27.840206+0000","last_fullsized":"2024-07-26T12:20:27.840206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:27:39.458566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099348+0000","last_change":"2024-07-26T12:16:36.571640+0000","last_active":"2024-07-26T12:18:59.099348+0000","last_peered":"2024-07-26T12:18:59.099348+0000","last_clean":"2024-07-26T12:18:59.099348+0000","last_became_active":"2024-07-26T12:16:36.553257+0000","last_became_peered":"2024-07-26T12:16:36.553257+0000","last_unstale":"2024-07-26T12:18:59.099348+0000","last_undegraded":"2024-07-26T12:18:59.099348+0000","last_fullsized":"2024-07-26T12:18:59.099348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:11:58.551504+0000","last_clean_scrub_stamp":"2024-07-26T12:11:58.551504+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:46:11.750243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.025497+0000","last_change":"2024-07-26T12:18:25.509520+0000","last_active":"2024-07-26T12:20:34.025497+0000","last_peered":"2024-07-26T12:20:34.025497+0000","last_clean":"2024-07-26T12:20:34.025497+0000","last_became_active":"2024-07-26T12:18:25.509103+0000","last_became_peered":"2024-07-26T12:18:25.509103+0000","last_unstale":"2024-07-26T12:20:34.025497+0000","last_undegraded":"2024-07-26T12:20:34.025497+0000","last_fullsized":"2024-07-26T12:20:34.025497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:02:35.747631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.519755+0000","last_change":"2024-07-26T12:18:29.560341+0000","last_active":"2024-07-26T12:20:37.519755+0000","last_peered":"2024-07-26T12:20:37.519755+0000","last_clean":"2024-07-26T12:20:37.519755+0000","last_became_active":"2024-07-26T12:18:29.559917+0000","last_became_peered":"2024-07-26T12:18:29.559917+0000","last_unstale":"2024-07-26T12:20:37.519755+0000","last_undegraded":"2024-07-26T12:20:37.519755+0000","last_fullsized":"2024-07-26T12:20:37.519755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:53:49.499435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.472148+0000","last_change":"2024-07-26T12:18:25.513448+0000","last_active":"2024-07-26T12:20:27.472148+0000","last_peered":"2024-07-26T12:20:27.472148+0000","last_clean":"2024-07-26T12:20:27.472148+0000","last_became_active":"2024-07-26T12:18:25.507908+0000","last_became_peered":"2024-07-26T12:18:25.507908+0000","last_unstale":"2024-07-26T12:20:27.472148+0000","last_undegraded":"2024-07-26T12:20:27.472148+0000","last_fullsized":"2024-07-26T12:20:27.472148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:36:57.399661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.530717+0000","last_change":"2024-07-26T12:18:29.560839+0000","last_active":"2024-07-26T12:20:37.530717+0000","last_peered":"2024-07-26T12:20:37.530717+0000","last_clean":"2024-07-26T12:20:37.530717+0000","last_became_active":"2024-07-26T12:18:29.560471+0000","last_became_peered":"2024-07-26T12:18:29.560471+0000","last_unstale":"2024-07-26T12:20:37.530717+0000","last_undegraded":"2024-07-26T12:20:37.530717+0000","last_fullsized":"2024-07-26T12:20:37.530717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T00:13:59.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:45.809652+0000","last_change":"2024-07-26T12:18:25.519104+0000","last_active":"2024-07-26T12:22:45.809652+0000","last_peered":"2024-07-26T12:22:45.809652+0000","last_clean":"2024-07-26T12:22:45.809652+0000","last_became_active":"2024-07-26T12:18:25.517813+0000","last_became_peered":"2024-07-26T12:18:25.517813+0000","last_unstale":"2024-07-26T12:22:45.809652+0000","last_undegraded":"2024-07-26T12:22:45.809652+0000","last_fullsized":"2024-07-26T12:22:45.809652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:50:41.436451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:33.164654+0000","last_change":"2024-07-26T12:18:29.561321+0000","last_active":"2024-07-26T12:20:33.164654+0000","last_peered":"2024-07-26T12:20:33.164654+0000","last_clean":"2024-07-26T12:20:33.164654+0000","last_became_active":"2024-07-26T12:18:29.559720+0000","last_became_peered":"2024-07-26T12:18:29.559720+0000","last_unstale":"2024-07-26T12:20:33.164654+0000","last_undegraded":"2024-07-26T12:20:33.164654+0000","last_fullsized":"2024-07-26T12:20:33.164654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:38:58.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":271,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:45.812915+0000","last_change":"2024-07-26T12:18:25.512608+0000","last_active":"2024-07-26T12:22:45.812915+0000","last_peered":"2024-07-26T12:22:45.812915+0000","last_clean":"2024-07-26T12:22:45.812915+0000","last_became_active":"2024-07-26T12:18:25.511553+0000","last_became_peered":"2024-07-26T12:18:25.511553+0000","last_unstale":"2024-07-26T12:22:45.812915+0000","last_undegraded":"2024-07-26T12:22:45.812915+0000","last_fullsized":"2024-07-26T12:22:45.812915+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:16.555073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.057249+0000","last_change":"2024-07-26T12:18:59.484811+0000","last_active":"2024-07-26T12:20:34.057249+0000","last_peered":"2024-07-26T12:20:34.057249+0000","last_clean":"2024-07-26T12:20:34.057249+0000","last_became_active":"2024-07-26T12:18:59.483489+0000","last_became_peered":"2024-07-26T12:18:59.483489+0000","last_unstale":"2024-07-26T12:20:34.057249+0000","last_undegraded":"2024-07-26T12:20:34.057249+0000","last_fullsized":"2024-07-26T12:20:34.057249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:57:47.710719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:32.296022+0000","last_change":"2024-07-26T12:18:25.522860+0000","last_active":"2024-07-26T12:20:32.296022+0000","last_peered":"2024-07-26T12:20:32.296022+0000","last_clean":"2024-07-26T12:20:32.296022+0000","last_became_active":"2024-07-26T12:18:25.522437+0000","last_became_peered":"2024-07-26T12:18:25.522437+0000","last_unstale":"2024-07-26T12:20:32.296022+0000","last_undegraded":"2024-07-26T12:20:32.296022+0000","last_fullsized":"2024-07-26T12:20:32.296022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:40:27.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:34.057293+0000","last_change":"2024-07-26T12:18:29.570473+0000","last_active":"2024-07-26T12:20:34.057293+0000","last_peered":"2024-07-26T12:20:34.057293+0000","last_clean":"2024-07-26T12:20:34.057293+0000","last_became_active":"2024-07-26T12:18:29.559870+0000","last_became_peered":"2024-07-26T12:18:29.559870+0000","last_unstale":"2024-07-26T12:20:34.057293+0000","last_undegraded":"2024-07-26T12:20:34.057293+0000","last_fullsized":"2024-07-26T12:20:34.057293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T21:18:43.433313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:31.410465+0000","last_change":"2024-07-26T12:18:25.521273+0000","last_active":"2024-07-26T12:20:31.410465+0000","last_peered":"2024-07-26T12:20:31.410465+0000","last_clean":"2024-07-26T12:20:31.410465+0000","last_became_active":"2024-07-26T12:18:25.520841+0000","last_became_peered":"2024-07-26T12:18:25.520841+0000","last_unstale":"2024-07-26T12:20:31.410465+0000","last_undegraded":"2024-07-26T12:20:31.410465+0000","last_fullsized":"2024-07-26T12:20:31.410465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T13:27:22.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.530894+0000","last_change":"2024-07-26T12:18:29.557341+0000","last_active":"2024-07-26T12:20:37.530894+0000","last_peered":"2024-07-26T12:20:37.530894+0000","last_clean":"2024-07-26T12:20:37.530894+0000","last_became_active":"2024-07-26T12:18:29.556877+0000","last_became_peered":"2024-07-26T12:18:29.556877+0000","last_unstale":"2024-07-26T12:20:37.530894+0000","last_undegraded":"2024-07-26T12:20:37.530894+0000","last_fullsized":"2024-07-26T12:20:37.530894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:44:24.301490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:34.635954+0000","last_change":"2024-07-26T12:18:25.502550+0000","last_active":"2024-07-26T12:22:34.635954+0000","last_peered":"2024-07-26T12:22:34.635954+0000","last_clean":"2024-07-26T12:22:34.635954+0000","last_became_active":"2024-07-26T12:18:25.502137+0000","last_became_peered":"2024-07-26T12:18:25.502137+0000","last_unstale":"2024-07-26T12:22:34.635954+0000","last_undegraded":"2024-07-26T12:22:34.635954+0000","last_fullsized":"2024-07-26T12:22:34.635954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:34:24.832404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.835465+0000","last_change":"2024-07-26T12:18:29.568531+0000","last_active":"2024-07-26T12:20:27.835465+0000","last_peered":"2024-07-26T12:20:27.835465+0000","last_clean":"2024-07-26T12:20:27.835465+0000","last_became_active":"2024-07-26T12:18:29.568098+0000","last_became_peered":"2024-07-26T12:18:29.568098+0000","last_unstale":"2024-07-26T12:20:27.835465+0000","last_undegraded":"2024-07-26T12:20:27.835465+0000","last_fullsized":"2024-07-26T12:20:27.835465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:26:29.478083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.107188+0000","last_change":"2024-07-26T12:18:25.506816+0000","last_active":"2024-07-26T12:18:59.107188+0000","last_peered":"2024-07-26T12:18:59.107188+0000","last_clean":"2024-07-26T12:18:59.107188+0000","last_became_active":"2024-07-26T12:18:25.505548+0000","last_became_peered":"2024-07-26T12:18:25.505548+0000","last_unstale":"2024-07-26T12:18:59.107188+0000","last_undegraded":"2024-07-26T12:18:59.107188+0000","last_fullsized":"2024-07-26T12:18:59.107188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:21:33.285244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831555+0000","last_change":"2024-07-26T12:18:29.567105+0000","last_active":"2024-07-26T12:20:27.831555+0000","last_peered":"2024-07-26T12:20:27.831555+0000","last_clean":"2024-07-26T12:20:27.831555+0000","last_became_active":"2024-07-26T12:18:29.564870+0000","last_became_peered":"2024-07-26T12:18:29.564870+0000","last_unstale":"2024-07-26T12:20:27.831555+0000","last_undegraded":"2024-07-26T12:20:27.831555+0000","last_fullsized":"2024-07-26T12:20:27.831555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T23:49:29.740616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.566132+0000","last_change":"2024-07-26T12:18:25.517971+0000","last_active":"2024-07-26T12:20:35.566132+0000","last_peered":"2024-07-26T12:20:35.566132+0000","last_clean":"2024-07-26T12:20:35.566132+0000","last_became_active":"2024-07-26T12:18:25.517360+0000","last_became_peered":"2024-07-26T12:18:25.517360+0000","last_unstale":"2024-07-26T12:20:35.566132+0000","last_undegraded":"2024-07-26T12:20:35.566132+0000","last_fullsized":"2024-07-26T12:20:35.566132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:43:12.382795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.809284+0000","last_change":"2024-07-26T12:18:29.573032+0000","last_active":"2024-07-26T12:20:27.809284+0000","last_peered":"2024-07-26T12:20:27.809284+0000","last_clean":"2024-07-26T12:20:27.809284+0000","last_became_active":"2024-07-26T12:18:29.568078+0000","last_became_peered":"2024-07-26T12:18:29.568078+0000","last_unstale":"2024-07-26T12:20:27.809284+0000","last_undegraded":"2024-07-26T12:20:27.809284+0000","last_fullsized":"2024-07-26T12:20:27.809284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:32:18.648061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:37.519677+0000","last_change":"2024-07-26T12:18:25.505576+0000","last_active":"2024-07-26T12:20:37.519677+0000","last_peered":"2024-07-26T12:20:37.519677+0000","last_clean":"2024-07-26T12:20:37.519677+0000","last_became_active":"2024-07-26T12:18:25.503037+0000","last_became_peered":"2024-07-26T12:18:25.503037+0000","last_unstale":"2024-07-26T12:20:37.519677+0000","last_undegraded":"2024-07-26T12:20:37.519677+0000","last_fullsized":"2024-07-26T12:20:37.519677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:18:18.450759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.826443+0000","last_change":"2024-07-26T12:18:29.573832+0000","last_active":"2024-07-26T12:20:27.826443+0000","last_peered":"2024-07-26T12:20:27.826443+0000","last_clean":"2024-07-26T12:20:27.826443+0000","last_became_active":"2024-07-26T12:18:29.573038+0000","last_became_peered":"2024-07-26T12:18:29.573038+0000","last_unstale":"2024-07-26T12:20:27.826443+0000","last_undegraded":"2024-07-26T12:20:27.826443+0000","last_fullsized":"2024-07-26T12:20:27.826443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T19:17:14.489542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:38.629627+0000","last_change":"2024-07-26T12:18:25.506536+0000","last_active":"2024-07-26T12:20:38.629627+0000","last_peered":"2024-07-26T12:20:38.629627+0000","last_clean":"2024-07-26T12:20:38.629627+0000","last_became_active":"2024-07-26T12:18:25.505886+0000","last_became_peered":"2024-07-26T12:18:25.505886+0000","last_unstale":"2024-07-26T12:20:38.629627+0000","last_undegraded":"2024-07-26T12:20:38.629627+0000","last_fullsized":"2024-07-26T12:20:38.629627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:19:01.832513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.831171+0000","last_change":"2024-07-26T12:18:29.565749+0000","last_active":"2024-07-26T12:20:27.831171+0000","last_peered":"2024-07-26T12:20:27.831171+0000","last_clean":"2024-07-26T12:20:27.831171+0000","last_became_active":"2024-07-26T12:18:29.565379+0000","last_became_peered":"2024-07-26T12:18:29.565379+0000","last_unstale":"2024-07-26T12:20:27.831171+0000","last_undegraded":"2024-07-26T12:20:27.831171+0000","last_fullsized":"2024-07-26T12:20:27.831171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:37:31.210265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:19:02.028040+0000","last_change":"2024-07-26T12:18:59.119123+0000","last_active":"2024-07-26T12:19:02.028040+0000","last_peered":"2024-07-26T12:19:02.028040+0000","last_clean":"2024-07-26T12:19:02.028040+0000","last_became_active":"2024-07-26T12:18:59.104257+0000","last_became_peered":"2024-07-26T12:18:59.104257+0000","last_unstale":"2024-07-26T12:19:02.028040+0000","last_undegraded":"2024-07-26T12:19:02.028040+0000","last_fullsized":"2024-07-26T12:19:02.028040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:32:14.828507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.840809+0000","last_change":"2024-07-26T12:18:29.573914+0000","last_active":"2024-07-26T12:20:27.840809+0000","last_peered":"2024-07-26T12:20:27.840809+0000","last_clean":"2024-07-26T12:20:27.840809+0000","last_became_active":"2024-07-26T12:18:29.573459+0000","last_became_peered":"2024-07-26T12:18:29.573459+0000","last_unstale":"2024-07-26T12:20:27.840809+0000","last_undegraded":"2024-07-26T12:20:27.840809+0000","last_fullsized":"2024-07-26T12:20:27.840809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:03:13.551382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.839095+0000","last_change":"2024-07-26T12:18:29.561628+0000","last_active":"2024-07-26T12:20:27.839095+0000","last_peered":"2024-07-26T12:20:27.839095+0000","last_clean":"2024-07-26T12:20:27.839095+0000","last_became_active":"2024-07-26T12:18:29.561233+0000","last_became_peered":"2024-07-26T12:18:29.561233+0000","last_unstale":"2024-07-26T12:20:27.839095+0000","last_undegraded":"2024-07-26T12:20:27.839095+0000","last_fullsized":"2024-07-26T12:20:27.839095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T14:38:47.227550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.099091+0000","last_change":"2024-07-26T12:18:25.514088+0000","last_active":"2024-07-26T12:18:59.099091+0000","last_peered":"2024-07-26T12:18:59.099091+0000","last_clean":"2024-07-26T12:18:59.099091+0000","last_became_active":"2024-07-26T12:18:25.513334+0000","last_became_peered":"2024-07-26T12:18:25.513334+0000","last_unstale":"2024-07-26T12:18:59.099091+0000","last_undegraded":"2024-07-26T12:18:59.099091+0000","last_fullsized":"2024-07-26T12:18:59.099091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T18:46:24.512640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.837671+0000","last_change":"2024-07-26T12:18:29.571517+0000","last_active":"2024-07-26T12:20:27.837671+0000","last_peered":"2024-07-26T12:20:27.837671+0000","last_clean":"2024-07-26T12:20:27.837671+0000","last_became_active":"2024-07-26T12:18:29.565274+0000","last_became_peered":"2024-07-26T12:18:29.565274+0000","last_unstale":"2024-07-26T12:20:27.837671+0000","last_undegraded":"2024-07-26T12:20:27.837671+0000","last_fullsized":"2024-07-26T12:20:27.837671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:10:26.309185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:18:59.096752+0000","last_change":"2024-07-26T12:18:25.512150+0000","last_active":"2024-07-26T12:18:59.096752+0000","last_peered":"2024-07-26T12:18:59.096752+0000","last_clean":"2024-07-26T12:18:59.096752+0000","last_became_active":"2024-07-26T12:18:25.511605+0000","last_became_peered":"2024-07-26T12:18:25.511605+0000","last_unstale":"2024-07-26T12:18:59.096752+0000","last_undegraded":"2024-07-26T12:18:59.096752+0000","last_fullsized":"2024-07-26T12:18:59.096752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T22:05:37.013476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:35.414943+0000","last_change":"2024-07-26T12:18:29.558450+0000","last_active":"2024-07-26T12:20:35.414943+0000","last_peered":"2024-07-26T12:20:35.414943+0000","last_clean":"2024-07-26T12:20:35.414943+0000","last_became_active":"2024-07-26T12:18:29.557997+0000","last_became_peered":"2024-07-26T12:18:29.557997+0000","last_unstale":"2024-07-26T12:20:35.414943+0000","last_undegraded":"2024-07-26T12:20:35.414943+0000","last_fullsized":"2024-07-26T12:20:35.414943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T16:22:51.089944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:27.517486+0000","last_change":"2024-07-26T12:18:25.519652+0000","last_active":"2024-07-26T12:20:27.517486+0000","last_peered":"2024-07-26T12:20:27.517486+0000","last_clean":"2024-07-26T12:20:27.517486+0000","last_became_active":"2024-07-26T12:18:25.519044+0000","last_became_peered":"2024-07-26T12:18:25.519044+0000","last_unstale":"2024-07-26T12:20:27.517486+0000","last_undegraded":"2024-07-26T12:20:27.517486+0000","last_fullsized":"2024-07-26T12:20:27.517486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T15:02:33.065933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:20:32.518603+0000","last_change":"2024-07-26T12:18:29.561642+0000","last_active":"2024-07-26T12:20:32.518603+0000","last_peered":"2024-07-26T12:20:32.518603+0000","last_clean":"2024-07-26T12:20:32.518603+0000","last_became_active":"2024-07-26T12:18:29.561295+0000","last_became_peered":"2024-07-26T12:18:29.561295+0000","last_unstale":"2024-07-26T12:20:32.518603+0000","last_undegraded":"2024-07-26T12:20:32.518603+0000","last_fullsized":"2024-07-26T12:20:32.518603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:28.496183+0000","last_clean_scrub_stamp":"2024-07-26T12:18:28.496183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T20:14:22.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":299,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-07-26T12:22:45.811463+0000","last_change":"2024-07-26T12:18:59.138844+0000","last_active":"2024-07-26T12:22:45.811463+0000","last_peered":"2024-07-26T12:22:45.811463+0000","last_clean":"2024-07-26T12:22:45.811463+0000","last_became_active":"2024-07-26T12:18:59.109509+0000","last_became_peered":"2024-07-26T12:18:59.109509+0000","last_unstale":"2024-07-26T12:22:45.811463+0000","last_undegraded":"2024-07-26T12:22:45.811463+0000","last_fullsized":"2024-07-26T12:22:45.811463+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-26T12:18:24.450811+0000","last_clean_scrub_stamp":"2024-07-26T12:18:24.450811+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-27T17:23:51.985186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78706,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2348,"num_read_kb":1257,"num_write":272,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2284,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":236118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":436836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841613,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1096973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005141,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":929792,"data_stored":435601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201370,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397603,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1515520,"data_stored":1029445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593832,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790063,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1536000,"data_stored":1028809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986296,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":505452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182525,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":435143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":437969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":506504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738514,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":437150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":72009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-26T12:22:49.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:22:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:49 smithi040 ceph-mon[32397]: pgmap v517: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-07-26T12:22:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:49 smithi040 ceph-mon[32397]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:49 smithi146 ceph-mon[35807]: pgmap v517: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-07-26T12:22:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:49 smithi146 ceph-mon[35807]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:49 smithi076 ceph-mon[35401]: pgmap v517: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-07-26T12:22:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:49 smithi076 ceph-mon[35401]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-07-26T12:22:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:51 smithi040 ceph-mon[32397]: pgmap v518: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T12:22:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:22:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:51 smithi146 ceph-mon[35807]: pgmap v518: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T12:22:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:22:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:51 smithi076 ceph-mon[35401]: pgmap v518: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T12:22:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.933+0000 7fb211e00640 1 -- 172.21.15.40:0/924966150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c104af0 msgr2=0x7fb20c10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.933+0000 7fb211e00640 1 --2- 172.21.15.40:0/924966150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c104af0 0x7fb20c10d130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009900 tx=0x7fb1f802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 -- 172.21.15.40:0/924966150 shutdown_connections 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 --2- 172.21.15.40:0/924966150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb20c10d670 0x7fb20c10fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 --2- 172.21.15.40:0/924966150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c104af0 0x7fb20c10d130 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 --2- 172.21.15.40:0/924966150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb20c1040c0 0x7fb20c1044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 -- 172.21.15.40:0/924966150 >> 172.21.15.40:0/924966150 conn(0x7fb20c0fdcf0 msgr2=0x7fb20c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 -- 172.21.15.40:0/924966150 shutdown_connections 2024-07-26T12:22:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.934+0000 7fb211e00640 1 -- 172.21.15.40:0/924966150 wait complete. 2024-07-26T12:22:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.935+0000 7fb211e00640 1 Processor -- start 2024-07-26T12:22:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.935+0000 7fb211e00640 1 -- start start 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.935+0000 7fb211e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 0x7fb20c199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb211e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb20c104af0 0x7fb20c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb211e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb20c10d670 0x7fb20c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb211e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1131a0 con 0x7fb20c1040c0 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb211e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c113020 con 0x7fb20c104af0 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb211e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c113320 con 0x7fb20c10d670 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb210a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 0x7fb20c199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb210a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 0x7fb20c199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48724/0 (socket says 172.21.15.40:48724) 2024-07-26T12:22:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb210a00640 1 -- 172.21.15.40:0/1375173347 learned_addr learned my addr 172.21.15.40:0/1375173347 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:51.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb20be00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb20c104af0 0x7fb20c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:51.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.936+0000 7fb211400640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb20c10d670 0x7fb20c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:51.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb210a00640 1 -- 172.21.15.40:0/1375173347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb20c10d670 msgr2=0x7fb20c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:51.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb210a00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb20c10d670 0x7fb20c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb210a00640 1 -- 172.21.15.40:0/1375173347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb20c104af0 msgr2=0x7fb20c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb210a00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb20c104af0 0x7fb20c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb210a00640 1 -- 172.21.15.40:0/1375173347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c19fb40 con 0x7fb20c1040c0 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb210a00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 0x7fb20c199bd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb20000d950 tx=0x7fb20000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200017070 con 0x7fb20c1040c0 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.937+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb200009c30 con 0x7fb20c1040c0 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.938+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c19fe30 con 0x7fb20c1040c0 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.938+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20000f620 con 0x7fb20c1040c0 2024-07-26T12:22:51.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.938+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c1a6590 con 0x7fb20c1040c0 2024-07-26T12:22:51.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.939+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c06aef0 con 0x7fb20c1040c0 2024-07-26T12:22:51.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.942+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb200005030 con 0x7fb20c1040c0 2024-07-26T12:22:51.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.943+0000 7fb209600640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1f40b3bd0 0x7fb1f40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:51.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.943+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb2000e3790 con 0x7fb20c1040c0 2024-07-26T12:22:51.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.944+0000 7fb20be00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1f40b3bd0 0x7fb1f40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:51.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.944+0000 7fb20be00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1f40b3bd0 0x7fb1f40b60e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80057c0 tx=0x7fb1f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:51.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:51.949+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb200009de0 con 0x7fb20c1040c0 2024-07-26T12:22:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.220+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb20c1044d0 con 0x7fb20c1040c0 2024-07-26T12:22:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.221+0000 7fb209600640 1 -- 172.21.15.40:0/1375173347 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7fb2000aa750 con 0x7fb20c1040c0 2024-07-26T12:22:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:52.224 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"btime":"2024-07-26T12:22:37:338561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:22:36.424751+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:22:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 29 2024-07-26T12:22:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1f40b3bd0 msgr2=0x7fb1f40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1f40b3bd0 0x7fb1f40b60e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80057c0 tx=0x7fb1f8000bc0 comp rx=0 tx=0).stop 2024-07-26T12:22:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 msgr2=0x7fb20c199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 0x7fb20c199bd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb20000d950 tx=0x7fb20000de10 comp rx=0 tx=0).stop 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 shutdown_connections 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1f40b3bd0 0x7fb1f40b60e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb20c10d670 0x7fb20c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb20c104af0 0x7fb20c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 --2- 172.21.15.40:0/1375173347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb20c1040c0 0x7fb20c199bd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.225+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 >> 172.21.15.40:0/1375173347 conn(0x7fb20c0fdcf0 msgr2=0x7fb20c107220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.226+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 shutdown_connections 2024-07-26T12:22:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:52.226+0000 7fb211e00640 1 -- 172.21.15.40:0/1375173347 wait complete. 2024-07-26T12:22:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1375173347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:22:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:22:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:22:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1375173347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:22:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:22:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:22:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1375173347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:22:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:22:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:22:53.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:22:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:53 smithi040 ceph-mon[32397]: pgmap v519: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:53 smithi146 ceph-mon[35807]: pgmap v519: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:53 smithi076 ceph-mon[35401]: pgmap v519: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:22:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:55 smithi040 ceph-mon[32397]: pgmap v520: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.756+0000 7f15ebe00640 1 -- 172.21.15.40:0/2461968335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec113cb0 msgr2=0x7f15ec116180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.756+0000 7f15ebe00640 1 --2- 172.21.15.40:0/2461968335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec113cb0 0x7f15ec116180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009900 tx=0x7f15e402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:22:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 -- 172.21.15.40:0/2461968335 shutdown_connections 2024-07-26T12:22:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 --2- 172.21.15.40:0/2461968335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec113cb0 0x7f15ec116180 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 --2- 172.21.15.40:0/2461968335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15ec075800 0x7f15ec075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 --2- 172.21.15.40:0/2461968335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ec076db0 0x7f15ec0751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 -- 172.21.15.40:0/2461968335 >> 172.21.15.40:0/2461968335 conn(0x7f15ec0fee70 msgr2=0x7f15ec1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 -- 172.21.15.40:0/2461968335 shutdown_connections 2024-07-26T12:22:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.757+0000 7f15ebe00640 1 -- 172.21.15.40:0/2461968335 wait complete. 2024-07-26T12:22:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.758+0000 7f15ebe00640 1 Processor -- start 2024-07-26T12:22:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.758+0000 7f15ebe00640 1 -- start start 2024-07-26T12:22:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ebe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ec075800 0x7f15ec1a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 0x7f15ec1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15ec113cb0 0x7f15ec1a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ebe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec1197f0 con 0x7f15ec076db0 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ebe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec119670 con 0x7f15ec075800 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ebe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec119970 con 0x7f15ec113cb0 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ea000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 0x7f15ec1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ea000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 0x7f15ec1a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36864/0 (socket says 172.21.15.40:36864) 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15ea000640 1 -- 172.21.15.40:0/1433584215 learned_addr learned my addr 172.21.15.40:0/1433584215 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15eaa00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ec075800 0x7f15ec1a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.759+0000 7f15eb400640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15ec113cb0 0x7f15ec1a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ea000640 1 -- 172.21.15.40:0/1433584215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15ec113cb0 msgr2=0x7f15ec1a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ea000640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15ec113cb0 0x7f15ec1a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ea000640 1 -- 172.21.15.40:0/1433584215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ec075800 msgr2=0x7f15ec1a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ea000640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ec075800 0x7f15ec1a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ea000640 1 -- 172.21.15.40:0/1433584215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ec1a6190 con 0x7f15ec076db0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ea000640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 0x7f15ec1a07c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f15d400ea50 tx=0x7f15d400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400cdc0 con 0x7f15ec076db0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d4005020 con 0x7f15ec076db0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.760+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ec1a6480 con 0x7f15ec076db0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.761+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d40116d0 con 0x7f15ec076db0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.761+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ec1acbe0 con 0x7f15ec076db0 2024-07-26T12:22:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.762+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ec075c10 con 0x7f15ec076db0 2024-07-26T12:22:55.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.766+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f15d4004a40 con 0x7f15ec076db0 2024-07-26T12:22:55.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.767+0000 7f15e3400640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15cc0b3bd0 0x7f15cc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.768+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15d40e41a0 con 0x7f15ec076db0 2024-07-26T12:22:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.768+0000 7f15eaa00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15cc0b3bd0 0x7f15cc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.768+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f15d4016030 con 0x7f15ec076db0 2024-07-26T12:22:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:55.769+0000 7f15eaa00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15cc0b3bd0 0x7f15cc0b60e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15dc005d00 tx=0x7f15dc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:55 smithi146 ceph-mon[35807]: pgmap v520: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:55 smithi076 ceph-mon[35401]: pgmap v520: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:22:56.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.011+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15ec1a1350 con 0x7f15ec076db0 2024-07-26T12:22:56.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.012+0000 7f15e3400640 1 -- 172.21.15.40:0/1433584215 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7f15ec1a1350 con 0x7f15ec076db0 2024-07-26T12:22:56.015 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:56.015 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"btime":"2024-07-26T12:22:37:338561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:22:36.424751+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:22:56.015 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 29 2024-07-26T12:22:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.015+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15cc0b3bd0 msgr2=0x7f15cc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.015+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15cc0b3bd0 0x7f15cc0b60e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15dc005d00 tx=0x7f15dc00b410 comp rx=0 tx=0).stop 2024-07-26T12:22:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.015+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 msgr2=0x7f15ec1a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.015+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 0x7f15ec1a07c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f15d400ea50 tx=0x7f15d400ef10 comp rx=0 tx=0).stop 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 shutdown_connections 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15cc0b3bd0 0x7f15cc0b60e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15ec113cb0 0x7f15ec1a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15ec076db0 0x7f15ec1a07c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1433584215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ec075800 0x7f15ec1a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 >> 172.21.15.40:0/1433584215 conn(0x7f15ec0fee70 msgr2=0x7f15ec10fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 shutdown_connections 2024-07-26T12:22:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:56.016+0000 7f15ebe00640 1 -- 172.21.15.40:0/1433584215 wait complete. 2024-07-26T12:22:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:56 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1433584215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:56 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1433584215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:56 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1433584215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:22:56.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd dump --format=json 2024-07-26T12:22:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:22:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:57 smithi040 ceph-mon[32397]: pgmap v521: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:57 smithi146 ceph-mon[35807]: pgmap v521: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:57 smithi076 ceph-mon[35401]: pgmap v521: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 -- 172.21.15.40:0/3640622481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 msgr2=0x7fceec0755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 --2- 172.21.15.40:0/3640622481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec0755f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009ca0 tx=0x7fcedc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 -- 172.21.15.40:0/3640622481 shutdown_connections 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 --2- 172.21.15.40:0/3640622481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fceec10f920 0x7fceec111d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 --2- 172.21.15.40:0/3640622481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceec075b30 0x7fceec10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 --2- 172.21.15.40:0/3640622481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec0755f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.648+0000 7fceebe00640 1 -- 172.21.15.40:0/3640622481 >> 172.21.15.40:0/3640622481 conn(0x7fceec0fee10 msgr2=0x7fceec101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.649+0000 7fceebe00640 1 -- 172.21.15.40:0/3640622481 shutdown_connections 2024-07-26T12:22:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.649+0000 7fceebe00640 1 -- 172.21.15.40:0/3640622481 wait complete. 2024-07-26T12:22:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.650+0000 7fceebe00640 1 Processor -- start 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.650+0000 7fceebe00640 1 -- start start 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.650+0000 7fceebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceec075b30 0x7fceec19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceebe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fceec10f920 0x7fceec1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceebe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fceec1153d0 con 0x7fceec0751e0 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceebe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fceec115250 con 0x7fceec10f920 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceebe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fceec115550 con 0x7fceec075b30 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36874/0 (socket says 172.21.15.40:36874) 2024-07-26T12:22:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 -- 172.21.15.40:0/138954690 learned_addr learned my addr 172.21.15.40:0/138954690 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeb400640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fceec10f920 0x7fceec1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fcee2000640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceec075b30 0x7fceec19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 -- 172.21.15.40:0/138954690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceec075b30 msgr2=0x7fceec19c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceec075b30 0x7fceec19c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 -- 172.21.15.40:0/138954690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fceec10f920 msgr2=0x7fceec1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.651+0000 7fceeaa00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fceec10f920 0x7fceec1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.652+0000 7fceeaa00640 1 -- 172.21.15.40:0/138954690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec1a1d70 con 0x7fceec0751e0 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.652+0000 7fceeaa00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec19bec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcedc031040 tx=0x7fcedc032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.652+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc004040 con 0x7fceec0751e0 2024-07-26T12:22:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.652+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec1a2000 con 0x7fceec0751e0 2024-07-26T12:22:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.652+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcedc004670 con 0x7fceec0751e0 2024-07-26T12:22:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.652+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec1a8880 con 0x7fceec0751e0 2024-07-26T12:22:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.653+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc030cf0 con 0x7fceec0751e0 2024-07-26T12:22:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.654+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceec0755f0 con 0x7fceec0751e0 2024-07-26T12:22:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.656+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcedc0305c0 con 0x7fceec0751e0 2024-07-26T12:22:59.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.658+0000 7fcee3e00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fced00b3c00 0x7fced00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:22:59.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.658+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcedc105520 con 0x7fceec0751e0 2024-07-26T12:22:59.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.658+0000 7fcee2000640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fced00b3c00 0x7fced00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:22:59.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.659+0000 7fcee2000640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fced00b3c00 0x7fced00b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fced4005fd0 tx=0x7fced4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:22:59.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.660+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcedc082600 con 0x7fceec0751e0 2024-07-26T12:22:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:22:59 smithi040 ceph-mon[32397]: pgmap v522: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:22:59 smithi146 ceph-mon[35807]: pgmap v522: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:22:59 smithi076 ceph-mon[35401]: pgmap v522: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:22:59.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.864+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fceec19cff0 con 0x7fceec0751e0 2024-07-26T12:22:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.868+0000 7fcee3e00640 1 -- 172.21.15.40:0/138954690 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7fcedc0ccb30 con 0x7fceec0751e0 2024-07-26T12:22:59.870 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:22:59.870 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T12:18:59.075766+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T12:22:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fced00b3c00 msgr2=0x7fced00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fced00b3c00 0x7fced00b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fced4005fd0 tx=0x7fced4005850 comp rx=0 tx=0).stop 2024-07-26T12:22:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 msgr2=0x7fceec19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:22:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec19bec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcedc031040 tx=0x7fcedc032bc0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 shutdown_connections 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fceec10f920 0x7fceec1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fced00b3c00 0x7fced00b6110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fceec075b30 0x7fceec19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 --2- 172.21.15.40:0/138954690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec0751e0 0x7fceec19bec0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 >> 172.21.15.40:0/138954690 conn(0x7fceec0fee10 msgr2=0x7fceec109520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.871+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 shutdown_connections 2024-07-26T12:22:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:22:59.872+0000 7fceebe00640 1 -- 172.21.15.40:0/138954690 wait complete. 2024-07-26T12:23:00.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:00 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/138954690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:23:00.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-07-26T12:23:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:00 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/138954690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:23:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:00 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/138954690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T12:23:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:01 smithi040 ceph-mon[32397]: pgmap v523: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:01 smithi146 ceph-mon[35807]: pgmap v523: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:01 smithi076 ceph-mon[35401]: pgmap v523: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:03 smithi146 ceph-mon[35807]: pgmap v524: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:03 smithi076 ceph-mon[35401]: pgmap v524: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:03.836 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:03 smithi040 ceph-mon[32397]: pgmap v524: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:04.300 INFO:teuthology.orchestra.run.smithi040.stdout:{"run_dir":"/var/run/ceph"} 2024-07-26T12:23:04.300 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-07-26T12:23:04.301 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5532 2024-07-26T12:23:04.301 DEBUG:tasks.quiescer:Yielding 2024-07-26T12:23:04.301 INFO:teuthology.run_tasks:Running task workunit... 2024-07-26T12:23:04.316 INFO:tasks.workunit:Pulling workunits from ref e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:23:04.316 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-07-26T12:23:04.316 INFO:tasks.workunit:timeout=3h 2024-07-26T12:23:04.316 INFO:tasks.workunit:cleanup=True 2024-07-26T12:23:04.317 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.0 2024-07-26T12:23:04.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:23:04.372 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-07-26T12:23:04.372 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-07-26T12:23:04.372 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 77h/119d Inode: 1 Links: 2 2024-07-26T12:23:04.372 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-26T12:23:04.373 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:fusefs_t:s0 2024-07-26T12:23:04.373 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-07-26 12:19:03.900527493 +0000 2024-07-26T12:23:04.373 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-07-26 12:19:03.900527493 +0000 2024-07-26T12:23:04.373 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-07-26 12:22:35.852097545 +0000 2024-07-26T12:23:04.373 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-07-26T12:23:04.373 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-07-26T12:23:04.373 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-07-26T12:23:04.511 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 2024-07-26T12:23:04.563 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-07-26T12:23:04.809 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:05 smithi040 ceph-mon[32397]: pgmap v525: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:05 smithi146 ceph-mon[35807]: pgmap v525: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:05 smithi076 ceph-mon[35401]: pgmap v525: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:07.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 -- 172.21.15.40:0/3865056157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f884810ba70 msgr2=0x7f88481122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 --2- 172.21.15.40:0/3865056157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f884810ba70 0x7f88481122a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8840009900 tx=0x7f884002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 -- 172.21.15.40:0/3865056157 shutdown_connections 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 --2- 172.21.15.40:0/3865056157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f884810ba70 0x7f88481122a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 --2- 172.21.15.40:0/3865056157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f884810b120 0x7f884810b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 --2- 172.21.15.40:0/3865056157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88481057e0 0x7f8848105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 -- 172.21.15.40:0/3865056157 >> 172.21.15.40:0/3865056157 conn(0x7f88481011f0 msgr2=0x7f8848103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 -- 172.21.15.40:0/3865056157 shutdown_connections 2024-07-26T12:23:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.131+0000 7f8850200640 1 -- 172.21.15.40:0/3865056157 wait complete. 2024-07-26T12:23:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.132+0000 7f8850200640 1 Processor -- start 2024-07-26T12:23:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 -- start start 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 0x7f884819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f884810b120 0x7f884819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884810ba70 0x7f88481a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8848115640 con 0x7f88481057e0 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88481154c0 con 0x7f884810ba70 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.133+0000 7f8850200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88481157c0 con 0x7f884810b120 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 0x7f884819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 0x7f884819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53942/0 (socket says 172.21.15.40:53942) 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 -- 172.21.15.40:0/597537323 learned_addr learned my addr 172.21.15.40:0/597537323 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884ce00640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f884810b120 0x7f884819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:07.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884e200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884810ba70 0x7f88481a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:07.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 -- 172.21.15.40:0/597537323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f884810b120 msgr2=0x7f884819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:07.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f884810b120 0x7f884819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 -- 172.21.15.40:0/597537323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884810ba70 msgr2=0x7f88481a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884810ba70 0x7f88481a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.134+0000 7f884d800640 1 -- 172.21.15.40:0/597537323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88481a1f60 con 0x7f88481057e0 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.135+0000 7f884d800640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 0x7f884819bff0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f883c00eab0 tx=0x7f883c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.135+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c00ce40 con 0x7f88481057e0 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.135+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f883c011900 con 0x7f88481057e0 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.135+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88481a2250 con 0x7f88481057e0 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.135+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c010990 con 0x7f88481057e0 2024-07-26T12:23:07.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.135+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88481a89b0 con 0x7f88481057e0 2024-07-26T12:23:07.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.137+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8848105bf0 con 0x7f88481057e0 2024-07-26T12:23:07.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.139+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f883c011470 con 0x7f88481057e0 2024-07-26T12:23:07.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.140+0000 7f8846000640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f88300b3bd0 0x7f88300b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:07.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.141+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f883c0e4310 con 0x7f88481057e0 2024-07-26T12:23:07.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.141+0000 7f884ce00640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f88300b3bd0 0x7f88300b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:07.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.142+0000 7f884ce00640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f88300b3bd0 0x7f88300b60e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8834005fd0 tx=0x7f8834005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:07.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.145+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f883c016030 con 0x7f88481057e0 2024-07-26T12:23:07.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.392+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f884802e0c0 con 0x7f88481057e0 2024-07-26T12:23:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.394+0000 7f8846000640 1 -- 172.21.15.40:0/597537323 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7f883c0ab920 con 0x7f88481057e0 2024-07-26T12:23:07.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:23:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 29 2024-07-26T12:23:07.397 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"btime":"2024-07-26T12:22:37:338561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:22:36.424751+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:23:07.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.396+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f88300b3bd0 msgr2=0x7f88300b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:07.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.396+0000 7f8850200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f88300b3bd0 0x7f88300b60e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8834005fd0 tx=0x7f8834005850 comp rx=0 tx=0).stop 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.396+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 msgr2=0x7f884819bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.396+0000 7f8850200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 0x7f884819bff0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f883c00eab0 tx=0x7f883c00ef70 comp rx=0 tx=0).stop 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.396+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 shutdown_connections 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884810ba70 0x7f88481a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f88300b3bd0 0x7f88300b60e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f884810b120 0x7f884819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 --2- 172.21.15.40:0/597537323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88481057e0 0x7f884819bff0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 >> 172.21.15.40:0/597537323 conn(0x7f88481011f0 msgr2=0x7f8848104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 shutdown_connections 2024-07-26T12:23:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:07.397+0000 7f8850200640 1 -- 172.21.15.40:0/597537323 wait complete. 2024-07-26T12:23:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:07 smithi040 ceph-mon[32397]: pgmap v526: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/597537323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:23:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:07 smithi146 ceph-mon[35807]: pgmap v526: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/597537323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:23:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:07 smithi076 ceph-mon[35401]: pgmap v526: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:07 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/597537323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:23:08.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-07-26T12:18:32.339754+0000', 'modified': '2024-07-26T12:22:36.424751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34631, 'mds_1': 34592, 'mds_2': 34547, 'mds_3': 24610, 'mds_4': 24592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14673': {'gid': 14673, 'name': 'e', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.76:6835/3482143239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6834', 'nonce': 3482143239}, {'type': 'v1', 'addr': '172.21.15.76:6835', 'nonce': 3482143239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14715': {'gid': 14715, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.40:6839/694136309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6838', 'nonce': 694136309}, {'type': 'v1', 'addr': '172.21.15.40:6839', 'nonce': 694136309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14727': {'gid': 14727, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.40:6841/3170726419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6840', 'nonce': 3170726419}, {'type': 'v1', 'addr': '172.21.15.40:6841', 'nonce': 3170726419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24547': {'gid': 24547, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/1448706156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1448706156}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1448706156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24586': {'gid': 24586, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/1374524390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 1374524390}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 1374524390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24592': {'gid': 24592, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.146:6837/3076436166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 3076436166}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 3076436166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'i', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.146:6839/4061759756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 4061759756}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 4061759756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34547': {'gid': 34547, 'name': 'k', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.76:6833/2744171288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6832', 'nonce': 2744171288}, {'type': 'v1', 'addr': '172.21.15.76:6833', 'nonce': 2744171288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34592': {'gid': 34592, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.76:6837/3327676602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6836', 'nonce': 3327676602}, {'type': 'v1', 'addr': '172.21.15.76:6837', 'nonce': 3327676602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34631': {'gid': 34631, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.76:6839/3866154018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6838', 'nonce': 3866154018}, {'type': 'v1', 'addr': '172.21.15.76:6839', 'nonce': 3866154018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34631, 'qdb_cluster': [34631, 34592, 34547, 24610, 24592]} 2024-07-26T12:23:08.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-07-26T12:23:08.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.c status 2024-07-26T12:23:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:09 smithi146 ceph-mon[35807]: pgmap v527: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:23:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:09 smithi076 ceph-mon[35401]: pgmap v527: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:23:09.860 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:09 smithi040 ceph-mon[32397]: pgmap v527: 97 pgs: 97 active+clean; 654 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:23:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 -- 172.21.15.40:0/1188491363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b81099f0 msgr2=0x7f69b8109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 --2- 172.21.15.40:0/1188491363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b81099f0 0x7f69b8109e00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009900 tx=0x7f69a802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 -- 172.21.15.40:0/1188491363 shutdown_connections 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 --2- 172.21.15.40:0/1188491363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b810fc80 0x7f69b81164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 --2- 172.21.15.40:0/1188491363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69b810f330 0x7f69b810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 --2- 172.21.15.40:0/1188491363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b81099f0 0x7f69b8109e00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 -- 172.21.15.40:0/1188491363 >> 172.21.15.40:0/1188491363 conn(0x7f69b8078ff0 msgr2=0x7f69b8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 -- 172.21.15.40:0/1188491363 shutdown_connections 2024-07-26T12:23:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.967+0000 7f69bdc00640 1 -- 172.21.15.40:0/1188491363 wait complete. 2024-07-26T12:23:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.969+0000 7f69bdc00640 1 Processor -- start 2024-07-26T12:23:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.969+0000 7f69bdc00640 1 -- start start 2024-07-26T12:23:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.969+0000 7f69bdc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69b81099f0 0x7f69b81a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.969+0000 7f69bdc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b810f330 0x7f69b81a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bdc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 0x7f69b81a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bdc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69b8119840 con 0x7f69b810fc80 2024-07-26T12:23:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bdc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81196c0 con 0x7f69b81099f0 2024-07-26T12:23:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bdc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81199c0 con 0x7f69b810f330 2024-07-26T12:23:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 0x7f69b81a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 0x7f69b81a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53974/0 (socket says 172.21.15.40:53974) 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69bd200640 1 -- 172.21.15.40:0/4292418719 learned_addr learned my addr 172.21.15.40:0/4292418719 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69b7e00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69b81099f0 0x7f69b81a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.970+0000 7f69af400640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b810f330 0x7f69b81a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bd200640 1 -- 172.21.15.40:0/4292418719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b810f330 msgr2=0x7f69b81a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bd200640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b810f330 0x7f69b81a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bd200640 1 -- 172.21.15.40:0/4292418719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69b81099f0 msgr2=0x7f69b81a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bd200640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69b81099f0 0x7f69b81a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bd200640 1 -- 172.21.15.40:0/4292418719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b81a61c0 con 0x7f69b810fc80 2024-07-26T12:23:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bd200640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 0x7f69b81a5a90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f69b000eaa0 tx=0x7f69b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69b5600640 1 -- 172.21.15.40:0/4292418719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b000cdb0 con 0x7f69b810fc80 2024-07-26T12:23:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69b5600640 1 -- 172.21.15.40:0/4292418719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b0005020 con 0x7f69b810fc80 2024-07-26T12:23:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b81a64b0 con 0x7f69b810fc80 2024-07-26T12:23:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.971+0000 7f69b5600640 1 -- 172.21.15.40:0/4292418719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00116d0 con 0x7f69b810fc80 2024-07-26T12:23:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.972+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b81acc10 con 0x7f69b810fc80 2024-07-26T12:23:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.975+0000 7f69c5e26740 1 Processor -- start 2024-07-26T12:23:10.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.975+0000 7f69b5600640 1 -- 172.21.15.40:0/4292418719 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69b00051d0 con 0x7f69b810fc80 2024-07-26T12:23:10.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 -- start start 2024-07-26T12:23:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 0x555fb2a6eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a6f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555fb29e4950 con 0x555fb26a00a0 2024-07-26T12:23:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555fb29d3e50 con 0x555fb26a8280 2024-07-26T12:23:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69c5e26740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555fb29d7e90 con 0x555fb26c8f60 2024-07-26T12:23:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.976+0000 7f69b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 0x555fb2a6eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 0x555fb2a6eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53982/0 (socket says 172.21.15.40:53982) 2024-07-26T12:23:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 -- 172.21.15.40:0/3070229729 learned_addr learned my addr 172.21.15.40:0/3070229729 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69af400640 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69af400640 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a6f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 -- 172.21.15.40:0/3070229729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 msgr2=0x555fb2a6e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 -- 172.21.15.40:0/3070229729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 msgr2=0x555fb2a6f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a6f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b7e00640 1 -- 172.21.15.40:0/3070229729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb297b0f0 con 0x555fb26a00a0 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.977+0000 7f69b5600640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f699c0b3bd0 0x7f699c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.978+0000 7f69b7e00640 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 0x555fb2a6eca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009900 tx=0x7f69a80040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a461257b3a61b1b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.978+0000 7f69b5600640 1 -- 172.21.15.40:0/4292418719 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f69b00e3d00 con 0x7f69b810fc80 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.978+0000 7f69af400640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f699c0b3bd0 0x7f699c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.978+0000 7f69ad600640 1 -- 172.21.15.40:0/3070229729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8040070 con 0x555fb26a00a0 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.978+0000 7f69ad600640 1 -- 172.21.15.40:0/3070229729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69a80054b0 con 0x555fb26a00a0 2024-07-26T12:23:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.978+0000 7f69ad600640 1 -- 172.21.15.40:0/3070229729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8035040 con 0x555fb26a00a0 2024-07-26T12:23:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 -- 172.21.15.40:0/3070229729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 msgr2=0x555fb2a6eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69af400640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f699c0b3bd0 0x7f699c0b60e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009730 tx=0x7f69a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 0x555fb2a6eca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009900 tx=0x7f69a80040f0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 -- 172.21.15.40:0/3070229729 shutdown_connections 2024-07-26T12:23:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a6f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a00a0 0x555fb2a6eca0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 --2- 172.21.15.40:0/3070229729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.979+0000 7f69c5e26740 1 -- 172.21.15.40:0/3070229729 >> 172.21.15.40:0/3070229729 conn(0x555fb26bd350 msgr2=0x555fb2a6c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.980+0000 7f69c5e26740 1 -- 172.21.15.40:0/3070229729 shutdown_connections 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.980+0000 7f69c5e26740 1 -- 172.21.15.40:0/3070229729 wait complete. 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.980+0000 7f69c5e26740 1 -- start start 2024-07-26T12:23:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.980+0000 7f69c5e26740 1 Processor -- start 2024-07-26T12:23:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26a00a0 0x555fb2a79f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a7a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 0x555fb2a86200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555fb28375f0 con 0x555fb26c8f60 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555fb2970520 con 0x555fb26a8280 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a7cee0 con 0x555fb26a00a0 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69c5e26740 10 client.0 _ll_register_callbacks cb 0x555fb297fef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69bd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 0x555fb2a86200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69bd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 0x555fb2a86200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53996/0 (socket says 172.21.15.40:53996) 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.981+0000 7f69bd200640 1 -- 172.21.15.40:0/557776061 learned_addr learned my addr 172.21.15.40:0/557776061 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69b7e00640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26a00a0 0x555fb2a79f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69af400640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a7a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69bd200640 1 -- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26a00a0 msgr2=0x555fb2a79f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69bd200640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26a00a0 0x555fb2a79f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69bd200640 1 -- 172.21.15.40:0/557776061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 msgr2=0x555fb2a7a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69bd200640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a7a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69bd200640 1 -- 172.21.15.40:0/557776061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb2734540 con 0x555fb26c8f60 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69b7e00640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26a00a0 0x555fb2a79f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69bd200640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 0x555fb2a86200 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f69b000cfd0 tx=0x7f69b00aa890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aca47c4e13443bb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.982+0000 7f69a6000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.983+0000 7f69a6000640 1 -- 172.21.15.40:0/557776061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b001f040 con 0x555fb26c8f60 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.983+0000 7f69a6000640 1 -- 172.21.15.40:0/557776061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f69b00a9f20 con 0x555fb26c8f60 2024-07-26T12:23:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.983+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a80054b0 con 0x555fb26c8f60 2024-07-26T12:23:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.983+0000 7f69a6000640 1 -- 172.21.15.40:0/557776061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69b00b3cc0 con 0x555fb26c8f60 2024-07-26T12:23:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.983+0000 7f69c5e26740 10 client.15387 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.983+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555fb2a88dd0 con 0x555fb26c8f60 2024-07-26T12:23:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69a6000640 1 -- 172.21.15.40:0/557776061 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69a80054b0 con 0x555fb26c8f60 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69a6000640 1 -- 172.21.15.40:0/557776061 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f69b000f040 con 0x555fb26c8f60 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69c5e26740 10 client.15387 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69c5e26740 10 client.15387 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69c5e26740 20 client.15387 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69c5e26740 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb26878e0 0x555fb2a8c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69c5e26740 4 client.15387 mds_command: new command op to 24592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.984+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 --> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fb29e68a0 con 0x555fb26878e0 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.985+0000 7f69b7e00640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb26878e0 0x555fb2a8c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.986+0000 7f69b7e00640 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb26878e0 0x555fb2a8c860 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=24cfdfc5839968a6 server_cookie=8b27944c7a565de5 in_seq=0 out_seq=0 2024-07-26T12:23:10.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.986+0000 7f69a6000640 10 client.15387 ms_handle_connect on v2:172.21.15.146:6836/3076436166 2024-07-26T12:23:10.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.988+0000 7f69a6000640 1 -- 172.21.15.40:0/557776061 <== mds.4 v2:172.21.15.146:6836/3076436166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555fb29e68a0 con 0x555fb26878e0 2024-07-26T12:23:10.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.988+0000 7f69a6000640 10 client.15387 handle_command_reply: tid=0 2024-07-26T12:23:10.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.988+0000 7f69c5e26740 1 client.15387 shutdown 2024-07-26T12:23:10.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 msgr2=0x555fb2a86200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:10.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 0x555fb2a86200 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f69b000cfd0 tx=0x7f69b00aa890 comp rx=0 tx=0).stop 2024-07-26T12:23:10.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 shutdown_connections 2024-07-26T12:23:10.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb26878e0 0x555fb2a8c860 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26c8f60 0x555fb2a86200 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a8280 0x555fb2a7a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 --2- 172.21.15.40:0/557776061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26a00a0 0x555fb2a79f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 >> 172.21.15.40:0/557776061 conn(0x555fb26bd350 msgr2=0x555fb2a718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69a6000640 0 client.15387 ms_handle_reset on v2:172.21.15.146:6836/3076436166 2024-07-26T12:23:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 shutdown_connections 2024-07-26T12:23:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 1 -- 172.21.15.40:0/557776061 wait complete. 2024-07-26T12:23:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:10.989+0000 7f69c5e26740 20 client.15387 trim_cache size 0 max 16384 2024-07-26T12:23:11.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.009+0000 7f69c5e26740 1 Processor -- start 2024-07-26T12:23:11.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.009+0000 7f69c5e26740 1 -- start start 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a74880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69c5e26740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a8aba0 con 0x555fb26a8280 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69c5e26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a8b270 con 0x555fb26a00a0 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69c5e26740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a8b940 con 0x555fb26c8f60 2024-07-26T12:23:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69af400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a74880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69af400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a74880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54008/0 (socket says 172.21.15.40:54008) 2024-07-26T12:23:11.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69af400640 1 -- 172.21.15.40:0/2185634869 learned_addr learned my addr 172.21.15.40:0/2185634869 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:11.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.010+0000 7f69b7e00640 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69bd200640 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69af400640 1 -- 172.21.15.40:0/2185634869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 msgr2=0x555fb2a6c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69af400640 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69af400640 1 -- 172.21.15.40:0/2185634869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 msgr2=0x555fb2a8bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69af400640 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69af400640 1 -- 172.21.15.40:0/2185634869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb2a78ee0 con 0x555fb26a8280 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.011+0000 7f69b7e00640 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.012+0000 7f69af400640 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a74880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f69a0004200 tx=0x7f69a0013050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c35002e266bf2a8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.012+0000 7f69acc00640 1 -- 172.21.15.40:0/2185634869 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a002e070 con 0x555fb26a8280 2024-07-26T12:23:11.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.012+0000 7f69acc00640 1 -- 172.21.15.40:0/2185634869 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69a0003df0 con 0x555fb26a8280 2024-07-26T12:23:11.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.012+0000 7f69acc00640 1 -- 172.21.15.40:0/2185634869 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0029760 con 0x555fb26a8280 2024-07-26T12:23:11.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 -- 172.21.15.40:0/2185634869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 msgr2=0x555fb2a74880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a74880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f69a0004200 tx=0x7f69a0013050 comp rx=0 tx=0).stop 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 -- 172.21.15.40:0/2185634869 shutdown_connections 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2a6c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a74880 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 --2- 172.21.15.40:0/2185634869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 -- 172.21.15.40:0/2185634869 >> 172.21.15.40:0/2185634869 conn(0x555fb26bd350 msgr2=0x555fb2a6be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 -- 172.21.15.40:0/2185634869 shutdown_connections 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.013+0000 7f69c5e26740 1 -- 172.21.15.40:0/2185634869 wait complete. 2024-07-26T12:23:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.014+0000 7f69c5e26740 1 -- start start 2024-07-26T12:23:11.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.014+0000 7f69c5e26740 1 Processor -- start 2024-07-26T12:23:11.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a8e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2af3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a8c6e0 con 0x555fb26a8280 2024-07-26T12:23:11.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a8c010 con 0x555fb26a00a0 2024-07-26T12:23:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555fb2a8cdb0 con 0x555fb26c8f60 2024-07-26T12:23:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.015+0000 7f69c5e26740 10 client.0 _ll_register_callbacks cb 0x7f69b00aa4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a8e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a8e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54016/0 (socket says 172.21.15.40:54016) 2024-07-26T12:23:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 -- 172.21.15.40:0/1745839209 learned_addr learned my addr 172.21.15.40:0/1745839209 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69b7e00640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 -- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 msgr2=0x555fb2af3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69bd200640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2af3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2af3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 -- 172.21.15.40:0/1745839209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 msgr2=0x555fb2a8e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69af400640 1 -- 172.21.15.40:0/1745839209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb2af4030 con 0x555fb26a8280 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.016+0000 7f69bd200640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2af3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69af400640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a8e7b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f69a001eb00 tx=0x7f69a001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756e67d4f10dc345 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69a6000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69a6000640 1 -- 172.21.15.40:0/1745839209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0036020 con 0x555fb26a8280 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69a6000640 1 -- 172.21.15.40:0/1745839209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f69a0005260 con 0x555fb26a8280 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a0003df0 con 0x555fb26a8280 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69a6000640 1 -- 172.21.15.40:0/1745839209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69a002e070 con 0x555fb26a8280 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69c5e26740 10 client.15393 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.017+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555fb2af5280 con 0x555fb26a8280 2024-07-26T12:23:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69a6000640 1 -- 172.21.15.40:0/1745839209 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69a0003df0 con 0x555fb26a8280 2024-07-26T12:23:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69a6000640 1 -- 172.21.15.40:0/1745839209 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f69a0028070 con 0x555fb26a8280 2024-07-26T12:23:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69c5e26740 10 client.15393 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69c5e26740 10 client.15393 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69c5e26740 20 client.15393 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69c5e26740 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb265cc90 0x555fb2af8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69c5e26740 4 client.15393 mds_command: new command op to 24592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.018+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 --> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] -- command(tid 0: {"prefix": "status"}) -- 0x555fb29e2340 con 0x555fb265cc90 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.019+0000 7f69b7e00640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb265cc90 0x555fb2af8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.020+0000 7f69b7e00640 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb265cc90 0x555fb2af8760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89ac0a8e55240fce server_cookie=3a87d58a6d8a58df in_seq=0 out_seq=0 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.020+0000 7f69a6000640 10 client.15393 ms_handle_connect on v2:172.21.15.146:6836/3076436166 2024-07-26T12:23:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69a6000640 1 -- 172.21.15.40:0/1745839209 <== mds.4 v2:172.21.15.146:6836/3076436166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555fb29e2340 con 0x555fb265cc90 2024-07-26T12:23:11.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69a6000640 10 client.15393 handle_command_reply: tid=0 2024-07-26T12:23:11.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 client.15393 shutdown 2024-07-26T12:23:11.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 msgr2=0x555fb2a8e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a8e7b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f69a001eb00 tx=0x7f69a001eb30 comp rx=0 tx=0).stop 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 shutdown_connections 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:6836/3076436166,v1:172.21.15.146:6837/3076436166] conn(0x555fb265cc90 0x555fb2af8760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555fb26c8f60 0x555fb2af3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555fb26a8280 0x555fb2a8e7b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 --2- 172.21.15.40:0/1745839209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555fb26a00a0 0x555fb2a8e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 >> 172.21.15.40:0/1745839209 conn(0x555fb26bd350 msgr2=0x555fb2a6ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69a6000640 0 client.15393 ms_handle_reset on v2:172.21.15.146:6836/3076436166 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.021+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 shutdown_connections 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.022+0000 7f69c5e26740 1 -- 172.21.15.40:0/1745839209 wait complete. 2024-07-26T12:23:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.022+0000 7f69c5e26740 20 client.15393 trim_cache size 0 max 16384 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 4, 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24592, 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 259.99028828100001, 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 29, 2024-07-26T12:23:11.025 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:23:11.026 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 82, 2024-07-26T12:23:11.026 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 319.54742109900002 2024-07-26T12:23:11.026 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:23:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.022+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f699c0b3bd0 msgr2=0x7f699c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.022+0000 7f69bdc00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f699c0b3bd0 0x7f699c0b60e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009730 tx=0x7f69a0005f90 comp rx=0 tx=0).stop 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.022+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 msgr2=0x7f69b81a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.022+0000 7f69bdc00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 0x7f69b81a5a90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f69b000eaa0 tx=0x7f69b000ef60 comp rx=0 tx=0).stop 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 shutdown_connections 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b810fc80 0x7f69b81a5a90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f699c0b3bd0 0x7f699c0b60e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b810f330 0x7f69b81a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 --2- 172.21.15.40:0/4292418719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69b81099f0 0x7f69b81a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 >> 172.21.15.40:0/4292418719 conn(0x7f69b8078ff0 msgr2=0x7f69b80797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 shutdown_connections 2024-07-26T12:23:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:11.023+0000 7f69bdc00640 1 -- 172.21.15.40:0/4292418719 wait complete. 2024-07-26T12:23:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:11 smithi040 ceph-mon[32397]: pgmap v528: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T12:23:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:11 smithi146 ceph-mon[35807]: pgmap v528: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T12:23:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:11 smithi076 ceph-mon[35401]: pgmap v528: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T12:23:11.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.i status 2024-07-26T12:23:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:13 smithi146 ceph-mon[35807]: pgmap v529: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-07-26T12:23:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:13 smithi076 ceph-mon[35401]: pgmap v529: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-07-26T12:23:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:13 smithi040 ceph-mon[32397]: pgmap v529: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-07-26T12:23:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 -- 172.21.15.40:0/1733226370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968108d20 msgr2=0x7fe968109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 --2- 172.21.15.40:0/1733226370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968108d20 0x7fe968109130 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe954009900 tx=0x7fe95402a410 comp rx=0 tx=0).stop 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 -- 172.21.15.40:0/1733226370 shutdown_connections 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 --2- 172.21.15.40:0/1733226370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968109670 0x7fe96810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 --2- 172.21.15.40:0/1733226370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968108d20 0x7fe968109130 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 --2- 172.21.15.40:0/1733226370 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe9681033e0 0x7fe9681037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 -- 172.21.15.40:0/1733226370 >> 172.21.15.40:0/1733226370 conn(0x7fe9680fee30 msgr2=0x7fe968101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 -- 172.21.15.40:0/1733226370 shutdown_connections 2024-07-26T12:23:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.612+0000 7fe96ec00640 1 -- 172.21.15.40:0/1733226370 wait complete. 2024-07-26T12:23:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.614+0000 7fe96ec00640 1 Processor -- start 2024-07-26T12:23:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.614+0000 7fe96ec00640 1 -- start start 2024-07-26T12:23:14.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.615+0000 7fe96ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe9681033e0 0x7fe968199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.615+0000 7fe96ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968108d20 0x7fe96819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.615+0000 7fe96ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 0x7fe96819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.615+0000 7fe96ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681131b0 con 0x7fe968109670 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.615+0000 7fe96ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe968113030 con 0x7fe9681033e0 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.615+0000 7fe96ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe968113330 con 0x7fe968108d20 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 0x7fe96819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 0x7fe96819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54048/0 (socket says 172.21.15.40:54048) 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 -- 172.21.15.40:0/2640475526 learned_addr learned my addr 172.21.15.40:0/2640475526 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96d800640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe9681033e0 0x7fe968199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96ce00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968108d20 0x7fe96819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 -- 172.21.15.40:0/2640475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968108d20 msgr2=0x7fe96819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968108d20 0x7fe96819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 -- 172.21.15.40:0/2640475526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe9681033e0 msgr2=0x7fe968199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe9681033e0 0x7fe968199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96e200640 1 -- 172.21.15.40:0/2640475526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96819fb90 con 0x7fe968109670 2024-07-26T12:23:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.616+0000 7fe96ce00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968108d20 0x7fe96819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.617+0000 7fe96e200640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 0x7fe96819f460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe96000eaa0 tx=0x7fe96000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.617+0000 7fe966000640 1 -- 172.21.15.40:0/2640475526 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96000cdb0 con 0x7fe968109670 2024-07-26T12:23:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.617+0000 7fe966000640 1 -- 172.21.15.40:0/2640475526 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe960005020 con 0x7fe968109670 2024-07-26T12:23:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.617+0000 7fe966000640 1 -- 172.21.15.40:0/2640475526 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9600116d0 con 0x7fe968109670 2024-07-26T12:23:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.617+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96819fe80 con 0x7fe968109670 2024-07-26T12:23:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.617+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9681a65e0 con 0x7fe968109670 2024-07-26T12:23:14.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.621+0000 7fe97701c740 1 Processor -- start 2024-07-26T12:23:14.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.621+0000 7fe966000640 1 -- 172.21.15.40:0/2640475526 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe9600051d0 con 0x7fe968109670 2024-07-26T12:23:14.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 -- start start 2024-07-26T12:23:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 0x56087cacab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c6f80a0 0x56087cacb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c700280 0x56087cacb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56087ca3c970 con 0x56087c720f60 2024-07-26T12:23:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56087ca2be70 con 0x56087c6f80a0 2024-07-26T12:23:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.622+0000 7fe97701c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56087ca2feb0 con 0x56087c700280 2024-07-26T12:23:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 0x56087cacab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 0x56087cacab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54052/0 (socket says 172.21.15.40:54052) 2024-07-26T12:23:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 -- 172.21.15.40:0/1452794346 learned_addr learned my addr 172.21.15.40:0/1452794346 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96d800640 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c6f80a0 0x56087cacb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c700280 0x56087cacb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 -- 172.21.15.40:0/1452794346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c700280 msgr2=0x56087cacb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c700280 0x56087cacb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 -- 172.21.15.40:0/1452794346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c6f80a0 msgr2=0x56087cacb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c6f80a0 0x56087cacb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96ce00640 1 -- 172.21.15.40:0/1452794346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56087c9d3110 con 0x56087c720f60 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.623+0000 7fe96d800640 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c6f80a0 0x56087cacb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe966000640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe94c0b3bd0 0x7fe94c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe96ce00640 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 0x56087cacab90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe954005f70 tx=0x7fe954009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502944de4a2d1ca4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe966000640 1 -- 172.21.15.40:0/2640475526 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe9600e3df0 con 0x7fe968109670 2024-07-26T12:23:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe96d800640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe94c0b3bd0 0x7fe94c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe95ea00640 1 -- 172.21.15.40:0/1452794346 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954043020 con 0x56087c720f60 2024-07-26T12:23:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe95ea00640 1 -- 172.21.15.40:0/1452794346 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9540044c0 con 0x56087c720f60 2024-07-26T12:23:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.624+0000 7fe95ea00640 1 -- 172.21.15.40:0/1452794346 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954035050 con 0x56087c720f60 2024-07-26T12:23:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 -- 172.21.15.40:0/1452794346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 msgr2=0x56087cacab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe96d800640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe94c0b3bd0 0x7fe94c0b60e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56087cac9810 tx=0x7fe95800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 0x56087cacab90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe954005f70 tx=0x7fe954009560 comp rx=0 tx=0).stop 2024-07-26T12:23:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 -- 172.21.15.40:0/1452794346 shutdown_connections 2024-07-26T12:23:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c700280 0x56087cacb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c6f80a0 0x56087cacb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 --2- 172.21.15.40:0/1452794346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c720f60 0x56087cacab90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 -- 172.21.15.40:0/1452794346 >> 172.21.15.40:0/1452794346 conn(0x56087c715350 msgr2=0x56087cac8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:14.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 -- 172.21.15.40:0/1452794346 shutdown_connections 2024-07-26T12:23:14.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 -- 172.21.15.40:0/1452794346 wait complete. 2024-07-26T12:23:14.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.626+0000 7fe97701c740 1 -- start start 2024-07-26T12:23:14.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 Processor -- start 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cad66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cad6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087cae2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56087c88f5f0 con 0x56087c700280 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56087c9c8540 con 0x56087c720f60 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.627+0000 7fe97701c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56087cad9310 con 0x56087c6f80a0 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe97701c740 10 client.0 _ll_register_callbacks cb 0x56087c9d7f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe96d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cad66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe96e200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087cae2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe96d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cad66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:47614/0 (socket says 172.21.15.40:47614) 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe96e200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087cae2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:54258/0 (socket says 172.21.15.40:54258) 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe96d800640 1 -- 172.21.15.40:0/3257879698 learned_addr learned my addr 172.21.15.40:0/3257879698 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.628+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cad6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96ce00640 1 -- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 msgr2=0x56087cad66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cad66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96ce00640 1 -- 172.21.15.40:0/3257879698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 msgr2=0x56087cae2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087cae2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96ce00640 1 -- 172.21.15.40:0/3257879698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56087c78c540 con 0x56087c700280 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96e200640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087cae2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cad6c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe954006010 tx=0x7fe9540054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9be597b78ff28b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.629+0000 7fe953400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe953400640 1 -- 172.21.15.40:0/3257879698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954043030 con 0x56087c700280 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56087ca3e8c0 con 0x56087c700280 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe953400640 1 -- 172.21.15.40:0/3257879698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe9540035f0 con 0x56087c700280 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe953400640 1 -- 172.21.15.40:0/3257879698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe954035040 con 0x56087c700280 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe97701c740 10 client.15405 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56087cae5280 con 0x56087c700280 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.630+0000 7fe953400640 1 -- 172.21.15.40:0/3257879698 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56087ca3e8c0 con 0x56087c700280 2024-07-26T12:23:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe953400640 1 -- 172.21.15.40:0/3257879698 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe95403a770 con 0x56087c700280 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe97701c740 10 client.15405 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe97701c740 10 client.15405 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe97701c740 20 client.15405 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe97701c740 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6df8e0 0x56087cae87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe97701c740 4 client.15405 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.631+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 --> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56087ca3a360 con 0x56087c6df8e0 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.632+0000 7fe96d800640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6df8e0 0x56087cae87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.633+0000 7fe96d800640 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6df8e0 0x56087cae87b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=217a9270e65e8ba8 server_cookie=aee233d9cdee4b98 in_seq=0 out_seq=0 2024-07-26T12:23:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.633+0000 7fe953400640 10 client.15405 ms_handle_connect on v2:172.21.15.146:6838/4061759756 2024-07-26T12:23:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe953400640 1 -- 172.21.15.40:0/3257879698 <== mds.3 v2:172.21.15.146:6838/4061759756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56087ca3a360 con 0x56087c6df8e0 2024-07-26T12:23:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe953400640 10 client.15405 handle_command_reply: tid=0 2024-07-26T12:23:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 client.15405 shutdown 2024-07-26T12:23:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 msgr2=0x56087cad6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cad6c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe954006010 tx=0x7fe9540054a0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 shutdown_connections 2024-07-26T12:23:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6df8e0 0x56087cae87b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087cae2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cad6c20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 --2- 172.21.15.40:0/3257879698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cad66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe953400640 0 client.15405 ms_handle_reset on v2:172.21.15.146:6838/4061759756 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 >> 172.21.15.40:0/3257879698 conn(0x56087c715350 msgr2=0x56087cacdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 shutdown_connections 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.635+0000 7fe97701c740 1 -- 172.21.15.40:0/3257879698 wait complete. 2024-07-26T12:23:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.636+0000 7fe97701c740 20 client.15405 trim_cache size 0 max 16384 2024-07-26T12:23:14.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 Processor -- start 2024-07-26T12:23:14.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 -- start start 2024-07-26T12:23:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 0x56087cae87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c700280 0x56087cad1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c720f60 0x56087cad0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56087cae6af0 con 0x56087c6f80a0 2024-07-26T12:23:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56087cae71c0 con 0x56087c700280 2024-07-26T12:23:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.656+0000 7fe97701c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56087cae7890 con 0x56087c720f60 2024-07-26T12:23:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 0x56087cae87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 0x56087cae87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54070/0 (socket says 172.21.15.40:54070) 2024-07-26T12:23:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 -- 172.21.15.40:0/1316690058 learned_addr learned my addr 172.21.15.40:0/1316690058 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96e200640 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c720f60 0x56087cad0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96ce00640 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c700280 0x56087cad1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 -- 172.21.15.40:0/1316690058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c720f60 msgr2=0x56087cad0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c720f60 0x56087cad0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 -- 172.21.15.40:0/1316690058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c700280 msgr2=0x56087cad1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c700280 0x56087cad1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.657+0000 7fe96d800640 1 -- 172.21.15.40:0/1316690058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56087cabf7f0 con 0x56087c6f80a0 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.658+0000 7fe96d800640 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 0x56087cae87b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x56087cad7600 tx=0x7fe958015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a874aaa7650fc4e7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.658+0000 7fe95e000640 1 -- 172.21.15.40:0/1316690058 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9580285b0 con 0x56087c6f80a0 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.658+0000 7fe95e000640 1 -- 172.21.15.40:0/1316690058 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe958012e20 con 0x56087c6f80a0 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.659+0000 7fe95e000640 1 -- 172.21.15.40:0/1316690058 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe958027a90 con 0x56087c6f80a0 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.659+0000 7fe97701c740 1 -- 172.21.15.40:0/1316690058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 msgr2=0x56087cae87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.659+0000 7fe97701c740 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 0x56087cae87b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x56087cad7600 tx=0x7fe958015000 comp rx=0 tx=0).stop 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 -- 172.21.15.40:0/1316690058 shutdown_connections 2024-07-26T12:23:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c720f60 0x56087cad0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c700280 0x56087cad1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 --2- 172.21.15.40:0/1316690058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c6f80a0 0x56087cae87b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 -- 172.21.15.40:0/1316690058 >> 172.21.15.40:0/1316690058 conn(0x56087c715350 msgr2=0x56087cac2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:14.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 -- 172.21.15.40:0/1316690058 shutdown_connections 2024-07-26T12:23:14.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.660+0000 7fe97701c740 1 -- 172.21.15.40:0/1316690058 wait complete. 2024-07-26T12:23:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 -- start start 2024-07-26T12:23:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 Processor -- start 2024-07-26T12:23:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cac4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cac5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087caea940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56087cae8630 con 0x56087c700280 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56087cae7f60 con 0x56087c720f60 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56087cae8d00 con 0x56087c6f80a0 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.661+0000 7fe97701c740 10 client.0 _ll_register_callbacks cb 0x7fe954004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cac5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cac5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54080/0 (socket says 172.21.15.40:54080) 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 -- 172.21.15.40:0/3750301531 learned_addr learned my addr 172.21.15.40:0/3750301531 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96d800640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cac4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96e200640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087caea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 -- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 msgr2=0x56087cac4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cac4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 -- 172.21.15.40:0/3750301531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 msgr2=0x56087caea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087caea940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96ce00640 1 -- 172.21.15.40:0/3750301531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56087caeafb0 con 0x56087c700280 2024-07-26T12:23:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.662+0000 7fe96e200640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087caea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.663+0000 7fe96ce00640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cac5140 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe95403d010 tx=0x7fe95403a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdd93c2b0ac4d43 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.663+0000 7fe953400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.663+0000 7fe953400640 1 -- 172.21.15.40:0/3750301531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954043040 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.663+0000 7fe953400640 1 -- 172.21.15.40:0/3750301531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe9540035f0 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.663+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe958012e20 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe953400640 1 -- 172.21.15.40:0/3750301531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9540037f0 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 10 client.15411 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56087caf0370 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe953400640 1 -- 172.21.15.40:0/3750301531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe958012e20 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe953400640 1 -- 172.21.15.40:0/3750301531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe95403d950 con 0x56087c700280 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 10 client.15411 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 10 client.15411 resolve_mds: resolved name 'i' to daemon mds.i 2024-07-26T12:23:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 20 client.15411 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:14.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6b4c90 0x56087cb58510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:14.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 4 client.15411 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:23:14.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.664+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 --> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] -- command(tid 0: {"prefix": "status"}) -- 0x56087ca37aa0 con 0x56087c6b4c90 2024-07-26T12:23:14.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.665+0000 7fe96d800640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6b4c90 0x56087cb58510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:14.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.666+0000 7fe96d800640 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6b4c90 0x56087cb58510 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=699455626c93ca84 server_cookie=449c21993a544e33 in_seq=0 out_seq=0 2024-07-26T12:23:14.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.666+0000 7fe953400640 10 client.15411 ms_handle_connect on v2:172.21.15.146:6838/4061759756 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe953400640 1 -- 172.21.15.40:0/3750301531 <== mds.3 v2:172.21.15.146:6838/4061759756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56087ca37aa0 con 0x56087c6b4c90 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe953400640 10 client.15411 handle_command_reply: tid=0 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 client.15411 shutdown 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 msgr2=0x56087cac5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cac5140 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe95403d010 tx=0x7fe95403a480 comp rx=0 tx=0).stop 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 shutdown_connections 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:6838/4061759756,v1:172.21.15.146:6839/4061759756] conn(0x56087c6b4c90 0x56087cb58510 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56087c720f60 0x56087caea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56087c700280 0x56087cac5140 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 --2- 172.21.15.40:0/3750301531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56087c6f80a0 0x56087cac4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 >> 172.21.15.40:0/3750301531 conn(0x56087c715350 msgr2=0x56087cad8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe953400640 0 client.15411 ms_handle_reset on v2:172.21.15.146:6838/4061759756 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 shutdown_connections 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 1 -- 172.21.15.40:0/3750301531 wait complete. 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.667+0000 7fe97701c740 20 client.15411 trim_cache size 0 max 16384 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:23:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 3, 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24610, 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 264.65157805799998, 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 29, 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 82, 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 315.66634785100001 2024-07-26T12:23:14.672 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:23:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe94c0b3bd0 msgr2=0x7fe94c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe94c0b3bd0 0x7fe94c0b60e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56087cac9810 tx=0x7fe95800b390 comp rx=0 tx=0).stop 2024-07-26T12:23:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 msgr2=0x7fe96819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 0x7fe96819f460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe96000eaa0 tx=0x7fe96000ef60 comp rx=0 tx=0).stop 2024-07-26T12:23:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 shutdown_connections 2024-07-26T12:23:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe968109670 0x7fe96819f460 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe94c0b3bd0 0x7fe94c0b60e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe968108d20 0x7fe96819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 --2- 172.21.15.40:0/2640475526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe9681033e0 0x7fe968199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.668+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 >> 172.21.15.40:0/2640475526 conn(0x7fe9680fee30 msgr2=0x7fe968101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.669+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 shutdown_connections 2024-07-26T12:23:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:14.669+0000 7fe96ec00640 1 -- 172.21.15.40:0/2640475526 wait complete. 2024-07-26T12:23:15.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.k status 2024-07-26T12:23:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:15 smithi146 ceph-mon[35807]: pgmap v530: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-07-26T12:23:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:15 smithi076 ceph-mon[35401]: pgmap v530: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-07-26T12:23:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:15 smithi040 ceph-mon[32397]: pgmap v530: 97 pgs: 97 active+clean; 659 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-07-26T12:23:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:17 smithi146 ceph-mon[35807]: pgmap v531: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:23:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:17 smithi076 ceph-mon[35401]: pgmap v531: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:23:17.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:17 smithi040 ceph-mon[32397]: pgmap v531: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:23:18.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.277+0000 7fa851c00640 1 -- 172.21.15.40:0/1447795629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 msgr2=0x7fa84c077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.277+0000 7fa851c00640 1 --2- 172.21.15.40:0/1447795629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c077780 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009900 tx=0x7fa83c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 -- 172.21.15.40:0/1447795629 shutdown_connections 2024-07-26T12:23:18.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 --2- 172.21.15.40:0/1447795629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa84c113fb0 0x7fa84c1163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 --2- 172.21.15.40:0/1447795629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84c077cc0 0x7fa84c113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 --2- 172.21.15.40:0/1447795629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c077780 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 -- 172.21.15.40:0/1447795629 >> 172.21.15.40:0/1447795629 conn(0x7fa84c101060 msgr2=0x7fa84c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:18.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 -- 172.21.15.40:0/1447795629 shutdown_connections 2024-07-26T12:23:18.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.278+0000 7fa851c00640 1 -- 172.21.15.40:0/1447795629 wait complete. 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.279+0000 7fa851c00640 1 Processor -- start 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.279+0000 7fa851c00640 1 -- start start 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa84c077cc0 0x7fa84c1a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84c113fb0 0x7fa84c1a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c119830 con 0x7fa84c077370 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1196b0 con 0x7fa84c077cc0 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1199b0 con 0x7fa84c113fb0 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa84be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa84be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c1a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54100/0 (socket says 172.21.15.40:54100) 2024-07-26T12:23:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa84be00640 1 -- 172.21.15.40:0/3127358600 learned_addr learned my addr 172.21.15.40:0/3127358600 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa84b400640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa84c077cc0 0x7fa84c1a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.280+0000 7fa851200640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84c113fb0 0x7fa84c1a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa84be00640 1 -- 172.21.15.40:0/3127358600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84c113fb0 msgr2=0x7fa84c1a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa84be00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84c113fb0 0x7fa84c1a5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa84be00640 1 -- 172.21.15.40:0/3127358600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa84c077cc0 msgr2=0x7fa84c1a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa84be00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa84c077cc0 0x7fa84c1a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa84be00640 1 -- 172.21.15.40:0/3127358600 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c1a6110 con 0x7fa84c077370 2024-07-26T12:23:18.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa84be00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c1a0260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa83c02a910 tx=0x7fa83c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:18.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa848c00640 1 -- 172.21.15.40:0/3127358600 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c03f070 con 0x7fa84c077370 2024-07-26T12:23:18.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa848c00640 1 -- 172.21.15.40:0/3127358600 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa83c003e40 con 0x7fa84c077370 2024-07-26T12:23:18.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c1a63a0 con 0x7fa84c077370 2024-07-26T12:23:18.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.281+0000 7fa848c00640 1 -- 172.21.15.40:0/3127358600 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c035030 con 0x7fa84c077370 2024-07-26T12:23:18.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.282+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c1a6880 con 0x7fa84c077370 2024-07-26T12:23:18.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.285+0000 7fa859e71740 1 Processor -- start 2024-07-26T12:23:18.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.285+0000 7fa859e71740 1 -- start start 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa848c00640 1 -- 172.21.15.40:0/3127358600 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa83c042070 con 0x7fa84c077370 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa859e71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbe3f60 0x55c60cf89780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa859e71740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 0x55c60cf89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa859e71740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf8a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa859e71740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c60ceff970 con 0x55c60cbbb0a0 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa859e71740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c60ceeee70 con 0x55c60cbc3280 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa859e71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c60cef2eb0 con 0x55c60cbe3f60 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa84be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 0x55c60cf89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa84be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 0x55c60cf89cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54106/0 (socket says 172.21.15.40:54106) 2024-07-26T12:23:18.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa84be00640 1 -- 172.21.15.40:0/1893342307 learned_addr learned my addr 172.21.15.40:0/1893342307 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:18.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.286+0000 7fa851200640 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbe3f60 0x55c60cf89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84b400640 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf8a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84be00640 1 -- 172.21.15.40:0/1893342307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbe3f60 msgr2=0x55c60cf89780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84be00640 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbe3f60 0x55c60cf89780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84be00640 1 -- 172.21.15.40:0/1893342307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 msgr2=0x55c60cf8a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84be00640 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf8a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84be00640 1 -- 172.21.15.40:0/1893342307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c60ce96110 con 0x55c60cbbb0a0 2024-07-26T12:23:18.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.287+0000 7fa84be00640 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 0x55c60cf89cc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa83c10a600 tx=0x7fa83c10a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f9e5a80ec31ddf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:18.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.288+0000 7fa848c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa8300b3c00 0x7fa8300b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.288+0000 7fa841600640 1 -- 172.21.15.40:0/1893342307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c104d20 con 0x55c60cbbb0a0 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.288+0000 7fa841600640 1 -- 172.21.15.40:0/1893342307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa83c111030 con 0x55c60cbbb0a0 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.288+0000 7fa841600640 1 -- 172.21.15.40:0/1893342307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0ff4b0 con 0x55c60cbbb0a0 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.288+0000 7fa848c00640 1 -- 172.21.15.40:0/3127358600 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa83c104520 con 0x7fa84c077370 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.288+0000 7fa851200640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa8300b3c00 0x7fa8300b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 -- 172.21.15.40:0/1893342307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 msgr2=0x55c60cf89cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 0x55c60cf89cc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa83c10a600 tx=0x7fa83c10a6f0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa851200640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa8300b3c00 0x7fa8300b6110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa844007ed0 tx=0x7fa844007680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 -- 172.21.15.40:0/1893342307 shutdown_connections 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf8a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbbb0a0 0x55c60cf89cc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 --2- 172.21.15.40:0/1893342307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbe3f60 0x55c60cf89780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 -- 172.21.15.40:0/1893342307 >> 172.21.15.40:0/1893342307 conn(0x55c60cbd8350 msgr2=0x55c60cf87670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 -- 172.21.15.40:0/1893342307 shutdown_connections 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.289+0000 7fa859e71740 1 -- 172.21.15.40:0/1893342307 wait complete. 2024-07-26T12:23:18.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.290+0000 7fa859e71740 1 -- start start 2024-07-26T12:23:18.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.290+0000 7fa859e71740 1 Processor -- start 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cf94f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf954c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c60cd525f0 con 0x55c60cbe3f60 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c60ce8b540 con 0x55c60cbc3280 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c60cf97d20 con 0x55c60cbbb0a0 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa859e71740 10 client.0 _ll_register_callbacks cb 0x55c60ce9af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa851200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa851200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54108/0 (socket says 172.21.15.40:54108) 2024-07-26T12:23:18.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.291+0000 7fa851200640 1 -- 172.21.15.40:0/2365185967 learned_addr learned my addr 172.21.15.40:0/2365185967 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa84be00640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cf94f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa84b400640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa851200640 1 -- 172.21.15.40:0/2365185967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 msgr2=0x55c60cf94f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa851200640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cf94f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa851200640 1 -- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 msgr2=0x55c60cf954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa851200640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa851200640 1 -- 172.21.15.40:0/2365185967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c60cc4f540 con 0x55c60cbe3f60 2024-07-26T12:23:18.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa84b400640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:18.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa851200640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa0f80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa84400edc0 tx=0x7fa844004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e12b6a1a4dec5dd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:18.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.292+0000 7fa83a000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.293+0000 7fa83a000640 1 -- 172.21.15.40:0/2365185967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84401ccb0 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.293+0000 7fa83a000640 1 -- 172.21.15.40:0/2365185967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa84401d410 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.293+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83c111030 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.293+0000 7fa83a000640 1 -- 172.21.15.40:0/2365185967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa84401ce50 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.293+0000 7fa859e71740 10 client.15423 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.293+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c60cfa3b30 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa83a000640 1 -- 172.21.15.40:0/2365185967 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa83c111030 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa83a000640 1 -- 172.21.15.40:0/2365185967 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa8440287b0 con 0x55c60cbe3f60 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa859e71740 10 client.15423 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa859e71740 10 client.15423 resolve_mds: resolved name 'k' to daemon mds.k 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa859e71740 20 client.15423 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:18.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa859e71740 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cba28e0 0x55c60cfa7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa859e71740 4 client.15423 mds_command: new command op to 34547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:23:18.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.294+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 --> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c60cf018c0 con 0x55c60cba28e0 2024-07-26T12:23:18.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.295+0000 7fa84be00640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cba28e0 0x55c60cfa7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.296+0000 7fa84be00640 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cba28e0 0x55c60cfa7600 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b12b5360624b9af server_cookie=17e114ef14c6f5f in_seq=0 out_seq=0 2024-07-26T12:23:18.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.296+0000 7fa83a000640 10 client.15423 ms_handle_connect on v2:172.21.15.76:6832/2744171288 2024-07-26T12:23:18.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa83a000640 1 -- 172.21.15.40:0/2365185967 <== mds.2 v2:172.21.15.76:6832/2744171288 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c60cf018c0 con 0x55c60cba28e0 2024-07-26T12:23:18.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa83a000640 10 client.15423 handle_command_reply: tid=0 2024-07-26T12:23:18.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 client.15423 shutdown 2024-07-26T12:23:18.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 msgr2=0x55c60cfa0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa0f80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa84400edc0 tx=0x7fa844004a40 comp rx=0 tx=0).stop 2024-07-26T12:23:18.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 shutdown_connections 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cba28e0 0x55c60cfa7600 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa0f80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cf954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 --2- 172.21.15.40:0/2365185967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cf94f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 >> 172.21.15.40:0/2365185967 conn(0x55c60cbd8350 msgr2=0x55c60cf8c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa83a000640 0 client.15423 ms_handle_reset on v2:172.21.15.76:6832/2744171288 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 shutdown_connections 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.298+0000 7fa859e71740 1 -- 172.21.15.40:0/2365185967 wait complete. 2024-07-26T12:23:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.299+0000 7fa859e71740 20 client.15423 trim_cache size 0 max 16384 2024-07-26T12:23:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.318+0000 7fa859e71740 1 Processor -- start 2024-07-26T12:23:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.318+0000 7fa859e71740 1 -- start start 2024-07-26T12:23:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa859e71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfa7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa859e71740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cfa0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa859e71740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa859e71740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c60cfa5940 con 0x55c60cbe3f60 2024-07-26T12:23:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa859e71740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c60cfa6010 con 0x55c60cbc3280 2024-07-26T12:23:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa859e71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c60cfa66e0 con 0x55c60cbbb0a0 2024-07-26T12:23:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa851200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa851200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54112/0 (socket says 172.21.15.40:54112) 2024-07-26T12:23:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.319+0000 7fa851200640 1 -- 172.21.15.40:0/145452761 learned_addr learned my addr 172.21.15.40:0/145452761 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa84be00640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfa7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa851200640 1 -- 172.21.15.40:0/145452761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 msgr2=0x55c60cfa7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa851200640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfa7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa851200640 1 -- 172.21.15.40:0/145452761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 msgr2=0x55c60cfa0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa84b400640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cfa0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa851200640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cfa0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa851200640 1 -- 172.21.15.40:0/145452761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c60cf97a90 con 0x55c60cbe3f60 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa84be00640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfa7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa84b400640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cfa0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.320+0000 7fa851200640 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa12b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa84400efd0 tx=0x7fa844007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691330ff31a05abc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.321+0000 7fa840c00640 1 -- 172.21.15.40:0/145452761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844004ab0 con 0x55c60cbe3f60 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.321+0000 7fa840c00640 1 -- 172.21.15.40:0/145452761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa844028910 con 0x55c60cbe3f60 2024-07-26T12:23:18.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.321+0000 7fa840c00640 1 -- 172.21.15.40:0/145452761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844005690 con 0x55c60cbe3f60 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.321+0000 7fa859e71740 1 -- 172.21.15.40:0/145452761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 msgr2=0x55c60cfa12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.321+0000 7fa859e71740 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa12b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa84400efd0 tx=0x7fa844007c50 comp rx=0 tx=0).stop 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 -- 172.21.15.40:0/145452761 shutdown_connections 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbe3f60 0x55c60cfa12b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbc3280 0x55c60cfa0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 --2- 172.21.15.40:0/145452761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfa7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 -- 172.21.15.40:0/145452761 >> 172.21.15.40:0/145452761 conn(0x55c60cbd8350 msgr2=0x55c60cf90140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 -- 172.21.15.40:0/145452761 shutdown_connections 2024-07-26T12:23:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 -- 172.21.15.40:0/145452761 wait complete. 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 -- start start 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.322+0000 7fa859e71740 1 Processor -- start 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfafd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 0x55c60cfad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbe3f60 0x55c60cfadeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c60cfa7480 con 0x55c60cbc3280 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c60cfa6db0 con 0x55c60cbe3f60 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c60cfa7b50 con 0x55c60cbbb0a0 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa859e71740 10 client.0 _ll_register_callbacks cb 0x7fa84400ea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa84b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 0x55c60cfad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa84b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 0x55c60cfad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54120/0 (socket says 172.21.15.40:54120) 2024-07-26T12:23:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.323+0000 7fa84b400640 1 -- 172.21.15.40:0/696364820 learned_addr learned my addr 172.21.15.40:0/696364820 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:18.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84be00640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfafd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa851200640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbe3f60 0x55c60cfadeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84b400640 1 -- 172.21.15.40:0/696364820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 msgr2=0x55c60cfafd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84b400640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfafd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84b400640 1 -- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbe3f60 msgr2=0x55c60cfadeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84b400640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbe3f60 0x55c60cfadeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84b400640 1 -- 172.21.15.40:0/696364820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c60cf827f0 con 0x55c60cbc3280 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84be00640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfafd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa851200640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbe3f60 0x55c60cfadeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa84b400640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 0x55c60cfad970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa84c06b360 tx=0x7fa8340127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897644eec17850fc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.324+0000 7fa83a000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa83a000640 1 -- 172.21.15.40:0/696364820 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834005020 con 0x55c60cbc3280 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa83a000640 1 -- 172.21.15.40:0/696364820 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa8340051c0 con 0x55c60cbc3280 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa844028910 con 0x55c60cbc3280 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa83a000640 1 -- 172.21.15.40:0/696364820 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa8340053c0 con 0x55c60cbc3280 2024-07-26T12:23:18.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa859e71740 10 client.15429 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c60d00f2c0 con 0x55c60cbc3280 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.325+0000 7fa83a000640 1 -- 172.21.15.40:0/696364820 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa844028910 con 0x55c60cbc3280 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa83a000640 1 -- 172.21.15.40:0/696364820 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa834010810 con 0x55c60cbc3280 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa859e71740 10 client.15429 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa859e71740 10 client.15429 resolve_mds: resolved name 'k' to daemon mds.k 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa859e71740 20 client.15429 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa859e71740 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cb77c90 0x55c60d012c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa859e71740 4 client.15429 mds_command: new command op to 34547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.326+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 --> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] -- command(tid 0: {"prefix": "status"}) -- 0x55c60cefd360 con 0x55c60cb77c90 2024-07-26T12:23:18.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.327+0000 7fa84be00640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cb77c90 0x55c60d012c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:18.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.327+0000 7fa84be00640 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cb77c90 0x55c60d012c60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0e8c0201d9a9b7e server_cookie=b817712d35b3c9ad in_seq=0 out_seq=0 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.327+0000 7fa83a000640 10 client.15429 ms_handle_connect on v2:172.21.15.76:6832/2744171288 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa83a000640 1 -- 172.21.15.40:0/696364820 <== mds.2 v2:172.21.15.76:6832/2744171288 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c60cefd360 con 0x55c60cb77c90 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa83a000640 10 client.15429 handle_command_reply: tid=0 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 client.15429 shutdown 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 msgr2=0x55c60cfad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 0x55c60cfad970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa84c06b360 tx=0x7fa8340127c0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 shutdown_connections 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:6832/2744171288,v1:172.21.15.76:6833/2744171288] conn(0x55c60cb77c90 0x55c60d012c60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c60cbe3f60 0x55c60cfadeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c60cbc3280 0x55c60cfad970 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 --2- 172.21.15.40:0/696364820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c60cbbb0a0 0x55c60cfafd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 >> 172.21.15.40:0/696364820 conn(0x55c60cbd8350 msgr2=0x55c60cf86f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.328+0000 7fa83a000640 0 client.15429 ms_handle_reset on v2:172.21.15.76:6832/2744171288 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 shutdown_connections 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa859e71740 1 -- 172.21.15.40:0/696364820 wait complete. 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa859e71740 20 client.15429 trim_cache size 0 max 16384 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 2, 2024-07-26T12:23:18.333 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34547, 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 269.32777932099998, 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 29, 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 82, 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 346.61036501000001 2024-07-26T12:23:18.334 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa8300b3c00 msgr2=0x7fa8300b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa851c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa8300b3c00 0x7fa8300b6110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa844007ed0 tx=0x7fa844007680 comp rx=0 tx=0).stop 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 msgr2=0x7fa84c1a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.329+0000 7fa851c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c1a0260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa83c02a910 tx=0x7fa83c003c20 comp rx=0 tx=0).stop 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 shutdown_connections 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa8300b3c00 0x7fa8300b6110 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84c113fb0 0x7fa84c1a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa84c077cc0 0x7fa84c1a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 --2- 172.21.15.40:0/3127358600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa84c077370 0x7fa84c1a0260 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:18.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 >> 172.21.15.40:0/3127358600 conn(0x7fa84c101060 msgr2=0x7fa84c1160b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:18.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 shutdown_connections 2024-07-26T12:23:18.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:18.330+0000 7fa851c00640 1 -- 172.21.15.40:0/3127358600 wait complete. 2024-07-26T12:23:19.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.h status 2024-07-26T12:23:19.655 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:19.802 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:19 smithi040 ceph-mon[32397]: pgmap v532: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T12:23:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:19 smithi146 ceph-mon[35807]: pgmap v532: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T12:23:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:19 smithi076 ceph-mon[35401]: pgmap v532: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-07-26T12:23:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:21 smithi040 ceph-mon[32397]: pgmap v533: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:23:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:21 smithi146 ceph-mon[35807]: pgmap v533: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:23:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:21 smithi076 ceph-mon[35401]: pgmap v533: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 -- 172.21.15.40:0/1696377692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 msgr2=0x7f9e441037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 --2- 172.21.15.40:0/1696377692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e441037f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009900 tx=0x7f9e3802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 -- 172.21.15.40:0/1696377692 shutdown_connections 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 --2- 172.21.15.40:0/1696377692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 0x7f9e4410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 --2- 172.21.15.40:0/1696377692 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e44108d20 0x7f9e44109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 --2- 172.21.15.40:0/1696377692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e441037f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 -- 172.21.15.40:0/1696377692 >> 172.21.15.40:0/1696377692 conn(0x7f9e440fee30 msgr2=0x7f9e44101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 -- 172.21.15.40:0/1696377692 shutdown_connections 2024-07-26T12:23:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.970+0000 7f9e4a000640 1 -- 172.21.15.40:0/1696377692 wait complete. 2024-07-26T12:23:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 Processor -- start 2024-07-26T12:23:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 -- start start 2024-07-26T12:23:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e44199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e44108d20 0x7f9e4419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 0x7f9e4419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9e441131d0 con 0x7f9e441033e0 2024-07-26T12:23:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44113050 con 0x7f9e44108d20 2024-07-26T12:23:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.972+0000 7f9e4a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44113350 con 0x7f9e44109670 2024-07-26T12:23:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.973+0000 7f9e48c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e44199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.973+0000 7f9e48c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e44199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54144/0 (socket says 172.21.15.40:54144) 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.973+0000 7f9e48c00640 1 -- 172.21.15.40:0/2708644489 learned_addr learned my addr 172.21.15.40:0/2708644489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.973+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e44108d20 0x7f9e4419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.973+0000 7f9e49600640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 0x7f9e4419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e48c00640 1 -- 172.21.15.40:0/2708644489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 msgr2=0x7f9e4419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 0x7f9e4419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e48c00640 1 -- 172.21.15.40:0/2708644489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e44108d20 msgr2=0x7f9e4419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e44108d20 0x7f9e4419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e48c00640 1 -- 172.21.15.40:0/2708644489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4419fbb0 con 0x7f9e441033e0 2024-07-26T12:23:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e49600640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 0x7f9e4419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.974+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e44199c40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009a20 tx=0x7f9e38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.975+0000 7f9e41600640 1 -- 172.21.15.40:0/2708644489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3803f030 con 0x7f9e441033e0 2024-07-26T12:23:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.975+0000 7f9e41600640 1 -- 172.21.15.40:0/2708644489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e380035f0 con 0x7f9e441033e0 2024-07-26T12:23:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.975+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4419fe40 con 0x7f9e441033e0 2024-07-26T12:23:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.975+0000 7f9e41600640 1 -- 172.21.15.40:0/2708644489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38035070 con 0x7f9e441033e0 2024-07-26T12:23:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.975+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e441a6600 con 0x7f9e441033e0 2024-07-26T12:23:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 Processor -- start 2024-07-26T12:23:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 -- start start 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e41600640 1 -- 172.21.15.40:0/2708644489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9e38032470 con 0x7f9e441033e0 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41aaf60 0x5629d4550760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d41820a0 0x5629d4550ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 0x5629d45511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5629d44c6950 con 0x5629d418a280 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5629d44b5e50 con 0x5629d41aaf60 2024-07-26T12:23:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.979+0000 7f9e522cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5629d44b9e90 con 0x5629d41820a0 2024-07-26T12:23:21.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 0x5629d45511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 0x5629d45511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54148/0 (socket says 172.21.15.40:54148) 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 -- 172.21.15.40:0/2764718743 learned_addr learned my addr 172.21.15.40:0/2764718743 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e49600640 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41aaf60 0x5629d4550760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d41820a0 0x5629d4550ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 -- 172.21.15.40:0/2764718743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d41820a0 msgr2=0x5629d4550ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d41820a0 0x5629d4550ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 -- 172.21.15.40:0/2764718743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41aaf60 msgr2=0x5629d4550760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41aaf60 0x5629d4550760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.980+0000 7f9e43e00640 1 -- 172.21.15.40:0/2764718743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629d445d0f0 con 0x5629d418a280 2024-07-26T12:23:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.981+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 0x5629d45511e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000aba0 tx=0x7f9e3000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51259196ae5d72d6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.981+0000 7f9e35c00640 1 -- 172.21.15.40:0/2764718743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30004220 con 0x5629d418a280 2024-07-26T12:23:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.981+0000 7f9e35c00640 1 -- 172.21.15.40:0/2764718743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e300043c0 con 0x5629d418a280 2024-07-26T12:23:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.981+0000 7f9e35c00640 1 -- 172.21.15.40:0/2764718743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30018730 con 0x5629d418a280 2024-07-26T12:23:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.981+0000 7f9e41600640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e2c0b3c50 0x7f9e2c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e41600640 1 -- 172.21.15.40:0/2708644489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9e38104790 con 0x7f9e441033e0 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e49600640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e2c0b3c50 0x7f9e2c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 -- 172.21.15.40:0/2764718743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 msgr2=0x5629d45511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 0x5629d45511e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000aba0 tx=0x7f9e3000f790 comp rx=0 tx=0).stop 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 -- 172.21.15.40:0/2764718743 shutdown_connections 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d418a280 0x5629d45511e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d41820a0 0x5629d4550ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2764718743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41aaf60 0x5629d4550760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.982+0000 7f9e522cf740 1 -- 172.21.15.40:0/2764718743 >> 172.21.15.40:0/2764718743 conn(0x5629d419f350 msgr2=0x5629d454e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.983+0000 7f9e49600640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e2c0b3c50 0x7f9e2c0b6160 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00aee0 tx=0x7f9e3c00a4b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.983+0000 7f9e522cf740 1 -- 172.21.15.40:0/2764718743 shutdown_connections 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.983+0000 7f9e522cf740 1 -- 172.21.15.40:0/2764718743 wait complete. 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.983+0000 7f9e522cf740 1 -- start start 2024-07-26T12:23:21.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 Processor -- start 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4560610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4560b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 0x5629d456c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5629d43195f0 con 0x5629d41aaf60 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5629d4452520 con 0x5629d41820a0 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5629d4563270 con 0x5629d418a280 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e522cf740 10 client.0 _ll_register_callbacks cb 0x5629d4461ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.984+0000 7f9e49600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 0x5629d456c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 0x5629d456c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54160/0 (socket says 172.21.15.40:54160) 2024-07-26T12:23:21.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 -- 172.21.15.40:0/3523797566 learned_addr learned my addr 172.21.15.40:0/3523797566 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e43e00640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4560b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e48c00640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4560610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 -- 172.21.15.40:0/3523797566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 msgr2=0x5629d4560b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4560b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 -- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 msgr2=0x5629d4560610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4560610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 -- 172.21.15.40:0/3523797566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629d4216540 con 0x5629d41aaf60 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e49600640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 0x5629d456c600 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00a7f0 tx=0x7f9e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956791f72fa43cd7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.985+0000 7f9e2a000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.986+0000 7f9e2a000640 1 -- 172.21.15.40:0/3523797566 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c01e620 con 0x5629d41aaf60 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.986+0000 7f9e2a000640 1 -- 172.21.15.40:0/3523797566 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9e3c01e7c0 con 0x5629d41aaf60 2024-07-26T12:23:21.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.986+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e300043c0 con 0x5629d41aaf60 2024-07-26T12:23:21.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e2a000640 1 -- 172.21.15.40:0/3523797566 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e3c01e9c0 con 0x5629d41aaf60 2024-07-26T12:23:21.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 10 client.15441 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:21.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5629d456f260 con 0x5629d41aaf60 2024-07-26T12:23:21.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e2a000640 1 -- 172.21.15.40:0/3523797566 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e300043c0 con 0x5629d41aaf60 2024-07-26T12:23:21.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e2a000640 1 -- 172.21.15.40:0/3523797566 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9e3c031b80 con 0x5629d41aaf60 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 10 client.15441 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 10 client.15441 resolve_mds: resolved name 'h' to daemon mds.h 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 20 client.15441 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41698e0 0x5629d4572d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 4 client.15441 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.987+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629d44c88a0 con 0x5629d41698e0 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.988+0000 7f9e48c00640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41698e0 0x5629d4572d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.989+0000 7f9e48c00640 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41698e0 0x5629d4572d00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9618e72b218038ef server_cookie=7f9c1321c0e9b8f8 in_seq=0 out_seq=0 2024-07-26T12:23:21.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.989+0000 7f9e2a000640 10 client.15441 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T12:23:21.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e2a000640 1 -- 172.21.15.40:0/3523797566 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629d44c88a0 con 0x5629d41698e0 2024-07-26T12:23:21.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e2a000640 10 client.15441 handle_command_reply: tid=0 2024-07-26T12:23:21.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 client.15441 shutdown 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 msgr2=0x5629d456c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 0x5629d456c600 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00a7f0 tx=0x7f9e3c004a40 comp rx=0 tx=0).stop 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 shutdown_connections 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41698e0 0x5629d4572d00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41aaf60 0x5629d456c600 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e2a000640 0 client.15441 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4560b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 --2- 172.21.15.40:0/3523797566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4560610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.991+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 >> 172.21.15.40:0/3523797566 conn(0x5629d419f350 msgr2=0x5629d45538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.992+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 shutdown_connections 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.992+0000 7f9e522cf740 1 -- 172.21.15.40:0/3523797566 wait complete. 2024-07-26T12:23:21.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:21.992+0000 7f9e522cf740 20 client.15441 trim_cache size 0 max 16384 2024-07-26T12:23:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.025+0000 7f9e522cf740 1 Processor -- start 2024-07-26T12:23:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.025+0000 7f9e522cf740 1 -- start start 2024-07-26T12:23:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.026+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41698e0 0x5629d455f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.026+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 0x5629d456c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.026+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d456cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.026+0000 7f9e522cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5629d4571040 con 0x5629d41820a0 2024-07-26T12:23:22.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.026+0000 7f9e522cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5629d4571710 con 0x5629d41698e0 2024-07-26T12:23:22.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.026+0000 7f9e522cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5629d4571de0 con 0x5629d418a280 2024-07-26T12:23:22.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 0x5629d456c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 0x5629d456c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54172/0 (socket says 172.21.15.40:54172) 2024-07-26T12:23:22.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 -- 172.21.15.40:0/301163106 learned_addr learned my addr 172.21.15.40:0/301163106 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:22.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e49600640 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d456cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e48c00640 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41698e0 0x5629d455f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 -- 172.21.15.40:0/301163106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 msgr2=0x5629d456cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:22.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d456cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 -- 172.21.15.40:0/301163106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41698e0 msgr2=0x5629d455f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:22.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41698e0 0x5629d455f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.027+0000 7f9e43e00640 1 -- 172.21.15.40:0/301163106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629d455bca0 con 0x5629d41820a0 2024-07-26T12:23:22.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.028+0000 7f9e49600640 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d456cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:22.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.028+0000 7f9e43e00640 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 0x5629d456c570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000aba0 tx=0x7f9e3000aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cad2c6ec7cdbf48 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.028+0000 7f9e35200640 1 -- 172.21.15.40:0/301163106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30026030 con 0x5629d41820a0 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.029+0000 7f9e35200640 1 -- 172.21.15.40:0/301163106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e3000a770 con 0x5629d41820a0 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.029+0000 7f9e35200640 1 -- 172.21.15.40:0/301163106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30004660 con 0x5629d41820a0 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 -- 172.21.15.40:0/301163106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 msgr2=0x5629d456c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 0x5629d456c570 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000aba0 tx=0x7f9e3000aab0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 -- 172.21.15.40:0/301163106 shutdown_connections 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d456cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41820a0 0x5629d456c570 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 --2- 172.21.15.40:0/301163106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41698e0 0x5629d455f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 -- 172.21.15.40:0/301163106 >> 172.21.15.40:0/301163106 conn(0x5629d419f350 msgr2=0x5629d455ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:22.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 -- 172.21.15.40:0/301163106 shutdown_connections 2024-07-26T12:23:22.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.030+0000 7f9e522cf740 1 -- 172.21.15.40:0/301163106 wait complete. 2024-07-26T12:23:22.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.031+0000 7f9e522cf740 1 -- start start 2024-07-26T12:23:22.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.031+0000 7f9e522cf740 1 Processor -- start 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 0x5629d455a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4556a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4556fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5629d4572b80 con 0x5629d41698e0 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5629d45724b0 con 0x5629d41820a0 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5629d4573250 con 0x5629d418a280 2024-07-26T12:23:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e522cf740 10 client.0 _ll_register_callbacks cb 0x7f9e3c011ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e48c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 0x5629d455a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e48c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 0x5629d455a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54176/0 (socket says 172.21.15.40:54176) 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.032+0000 7f9e48c00640 1 -- 172.21.15.40:0/2595781635 learned_addr learned my addr 172.21.15.40:0/2595781635 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4556a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e49600640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4556fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e48c00640 1 -- 172.21.15.40:0/2595781635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 msgr2=0x5629d4556fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4556fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e48c00640 1 -- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 msgr2=0x5629d4556a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4556a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e48c00640 1 -- 172.21.15.40:0/2595781635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629d4557540 con 0x5629d41698e0 2024-07-26T12:23:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e49600640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4556fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e48c00640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 0x5629d455a4d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9e380cb3a0 tx=0x7f9e3802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910f70ad5521bafe server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.033+0000 7f9e2a000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.034+0000 7f9e2a000640 1 -- 172.21.15.40:0/2595781635 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38049040 con 0x5629d41698e0 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.034+0000 7f9e2a000640 1 -- 172.21.15.40:0/2595781635 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9e38003aa0 con 0x5629d41698e0 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.034+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5629d44c4340 con 0x5629d41698e0 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.034+0000 7f9e2a000640 1 -- 172.21.15.40:0/2595781635 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9e380d4090 con 0x5629d41698e0 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.034+0000 7f9e522cf740 10 client.15447 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.034+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5629d457abf0 con 0x5629d41698e0 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e2a000640 1 -- 172.21.15.40:0/2595781635 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5629d44c4340 con 0x5629d41698e0 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e2a000640 1 -- 172.21.15.40:0/2595781635 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9e380c7930 con 0x5629d41698e0 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e522cf740 10 client.15447 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e522cf740 10 client.15447 resolve_mds: resolved name 'h' to daemon mds.h 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e522cf740 20 client.15447 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41aaf60 0x5629d45e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e522cf740 4 client.15447 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.035+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "status"}) -- 0x5629d44c1a80 con 0x5629d41aaf60 2024-07-26T12:23:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.036+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41aaf60 0x5629d45e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.037+0000 7f9e43e00640 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41aaf60 0x5629d45e2e90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8710384c5781c1c server_cookie=47ac6bbf72fb73f9 in_seq=0 out_seq=0 2024-07-26T12:23:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.037+0000 7f9e2a000640 10 client.15447 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T12:23:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.037+0000 7f9e2a000640 1 -- 172.21.15.40:0/2595781635 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5629d44c1a80 con 0x5629d41aaf60 2024-07-26T12:23:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.037+0000 7f9e2a000640 10 client.15447 handle_command_reply: tid=0 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.037+0000 7f9e522cf740 1 client.15447 shutdown 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 msgr2=0x5629d455a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 0x5629d455a4d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9e380cb3a0 tx=0x7f9e3802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 shutdown_connections 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x5629d41aaf60 0x5629d45e2e90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5629d418a280 0x5629d4556fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629d41820a0 0x5629d4556a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 --2- 172.21.15.40:0/2595781635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629d41698e0 0x5629d455a4d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 >> 172.21.15.40:0/2595781635 conn(0x5629d419f350 msgr2=0x5629d454de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e2a000640 0 client.15447 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 shutdown_connections 2024-07-26T12:23:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 1 -- 172.21.15.40:0/2595781635 wait complete. 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.038+0000 7f9e522cf740 20 client.15447 trim_cache size 0 max 16384 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34592, 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 274.05224094800002, 2024-07-26T12:23:22.042 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 29, 2024-07-26T12:23:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:23:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 82, 2024-07-26T12:23:22.043 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 326.86227411700003 2024-07-26T12:23:22.043 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:23:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e2c0b3c50 msgr2=0x7f9e2c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e2c0b3c50 0x7f9e2c0b6160 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00aee0 tx=0x7f9e3c00a4b0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 msgr2=0x7f9e44199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e44199c40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009a20 tx=0x7f9e38004270 comp rx=0 tx=0).stop 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 shutdown_connections 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9e2c0b3c50 0x7f9e2c0b6160 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e44109670 0x7f9e4419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9e44108d20 0x7f9e4419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 --2- 172.21.15.40:0/2708644489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e441033e0 0x7f9e44199c40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.039+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 >> 172.21.15.40:0/2708644489 conn(0x7f9e440fee30 msgr2=0x7f9e44101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.040+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 shutdown_connections 2024-07-26T12:23:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:22.040+0000 7f9e4a000640 1 -- 172.21.15.40:0/2708644489 wait complete. 2024-07-26T12:23:22.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph tell mds.b status 2024-07-26T12:23:23.440 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:23.799 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:23 smithi040 ceph-mon[32397]: pgmap v534: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-07-26T12:23:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:23 smithi146 ceph-mon[35807]: pgmap v534: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-07-26T12:23:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:23 smithi076 ceph-mon[35401]: pgmap v534: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-07-26T12:23:25.813 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:25 smithi040 ceph-mon[32397]: pgmap v535: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-07-26T12:23:25.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 -- 172.21.15.40:0/3173024891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd98104b10 msgr2=0x7fcd9810d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3173024891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd98104b10 0x7fcd9810d150 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009900 tx=0x7fcd8402a410 comp rx=0 tx=0).stop 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 -- 172.21.15.40:0/3173024891 shutdown_connections 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3173024891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd9810d690 0x7fcd9810fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3173024891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd98104b10 0x7fcd9810d150 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3173024891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd981040e0 0x7fcd981044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 -- 172.21.15.40:0/3173024891 >> 172.21.15.40:0/3173024891 conn(0x7fcd980fdcf0 msgr2=0x7fcd98100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 -- 172.21.15.40:0/3173024891 shutdown_connections 2024-07-26T12:23:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.811+0000 7fcd9d400640 1 -- 172.21.15.40:0/3173024891 wait complete. 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.812+0000 7fcd9d400640 1 Processor -- start 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 -- start start 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd981040e0 0x7fcd98199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd98104b10 0x7fcd9819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 0x7fcd9819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98113130 con 0x7fcd9810d690 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98112fb0 con 0x7fcd981040e0 2024-07-26T12:23:25.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.813+0000 7fcd9d400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd981132b0 con 0x7fcd98104b10 2024-07-26T12:23:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 0x7fcd9819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 0x7fcd9819f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49396/0 (socket says 172.21.15.40:49396) 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 -- 172.21.15.40:0/3405274584 learned_addr learned my addr 172.21.15.40:0/3405274584 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd97e00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd981040e0 0x7fcd98199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 -- 172.21.15.40:0/3405274584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd98104b10 msgr2=0x7fcd9819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd98104b10 0x7fcd9819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 -- 172.21.15.40:0/3405274584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd981040e0 msgr2=0x7fcd98199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd981040e0 0x7fcd98199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.814+0000 7fcd9ca00640 1 -- 172.21.15.40:0/3405274584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9819fb50 con 0x7fcd9810d690 2024-07-26T12:23:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.815+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 0x7fcd9819f420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000eaa0 tx=0x7fcd9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.815+0000 7fcd94c00640 1 -- 172.21.15.40:0/3405274584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000cdb0 con 0x7fcd9810d690 2024-07-26T12:23:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.815+0000 7fcd94c00640 1 -- 172.21.15.40:0/3405274584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd90005020 con 0x7fcd9810d690 2024-07-26T12:23:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.815+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9819fe40 con 0x7fcd9810d690 2024-07-26T12:23:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.815+0000 7fcd94c00640 1 -- 172.21.15.40:0/3405274584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd900116d0 con 0x7fcd9810d690 2024-07-26T12:23:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.815+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd98101ed0 con 0x7fcd9810d690 2024-07-26T12:23:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:25 smithi146 ceph-mon[35807]: pgmap v535: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-07-26T12:23:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.819+0000 7fcda563e740 1 Processor -- start 2024-07-26T12:23:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.820+0000 7fcd94c00640 1 -- 172.21.15.40:0/3405274584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcd900051d0 con 0x7fcd9810d690 2024-07-26T12:23:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.820+0000 7fcda563e740 1 -- start start 2024-07-26T12:23:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcda563e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 0x556b205ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcda563e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcda563e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcda563e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556b20544950 con 0x556b20228f60 2024-07-26T12:23:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcda563e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b20533e50 con 0x556b202000a0 2024-07-26T12:23:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcda563e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556b20537e90 con 0x556b20208280 2024-07-26T12:23:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcd97400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 0x556b205ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcd97400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 0x556b205ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49398/0 (socket says 172.21.15.40:49398) 2024-07-26T12:23:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcd97400640 1 -- 172.21.15.40:0/1980561716 learned_addr learned my addr 172.21.15.40:0/1980561716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.821+0000 7fcd97e00640 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97400640 1 -- 172.21.15.40:0/1980561716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 msgr2=0x556b205cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97400640 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97400640 1 -- 172.21.15.40:0/1980561716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 msgr2=0x556b205ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97400640 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97400640 1 -- 172.21.15.40:0/1980561716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b204db0f0 con 0x556b20228f60 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97e00640 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd94c00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd7c0b3c50 0x7fcd7c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd94c00640 1 -- 172.21.15.40:0/3405274584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd900e3e70 con 0x7fcd9810d690 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.822+0000 7fcd97e00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd7c0b3c50 0x7fcd7c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.823+0000 7fcd97400640 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 0x556b205ce760 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd8402a930 tx=0x7fcd84032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea3ccb62d1bf7ee server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.823+0000 7fcd8d200640 1 -- 172.21.15.40:0/1980561716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84040070 con 0x556b20228f60 2024-07-26T12:23:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.823+0000 7fcd8d200640 1 -- 172.21.15.40:0/1980561716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd84004040 con 0x556b20228f60 2024-07-26T12:23:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.823+0000 7fcd8d200640 1 -- 172.21.15.40:0/1980561716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84035040 con 0x556b20228f60 2024-07-26T12:23:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 -- 172.21.15.40:0/1980561716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 msgr2=0x556b205ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 0x556b205ce760 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd8402a930 tx=0x7fcd84032ba0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcd97e00640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd7c0b3c50 0x7fcd7c0b6160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556b205cd3e0 tx=0x7fcd8800b6f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 -- 172.21.15.40:0/1980561716 shutdown_connections 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 --2- 172.21.15.40:0/1980561716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b20228f60 0x556b205ce760 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.824+0000 7fcda563e740 1 -- 172.21.15.40:0/1980561716 >> 172.21.15.40:0/1980561716 conn(0x556b2021d350 msgr2=0x556b205cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.825+0000 7fcda563e740 1 -- 172.21.15.40:0/1980561716 shutdown_connections 2024-07-26T12:23:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.825+0000 7fcda563e740 1 -- 172.21.15.40:0/1980561716 wait complete. 2024-07-26T12:23:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.825+0000 7fcda563e740 1 -- start start 2024-07-26T12:23:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.825+0000 7fcda563e740 1 Processor -- start 2024-07-26T12:23:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 0x556b205da260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20228f60 0x556b205e6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556b203975f0 con 0x556b202000a0 2024-07-26T12:23:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b204d0520 con 0x556b20228f60 2024-07-26T12:23:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556b205dcee0 con 0x556b20208280 2024-07-26T12:23:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcda563e740 10 client.0 _ll_register_callbacks cb 0x556b204dfef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcd97e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 0x556b205da260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcd97e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 0x556b205da260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49412/0 (socket says 172.21.15.40:49412) 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.826+0000 7fcd97e00640 1 -- 172.21.15.40:0/2076301842 learned_addr learned my addr 172.21.15.40:0/2076301842 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97400640 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97e00640 1 -- 172.21.15.40:0/2076301842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 msgr2=0x556b205da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97e00640 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205da7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97e00640 1 -- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20228f60 msgr2=0x556b205e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97e00640 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20228f60 0x556b205e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97e00640 1 -- 172.21.15.40:0/2076301842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b20294540 con 0x556b202000a0 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd97e00640 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 0x556b205da260 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd88012680 tx=0x7fcd880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebf4d57a7e3865a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.827+0000 7fcd81600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcd81600640 1 -- 172.21.15.40:0/2076301842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801f8f0 con 0x556b202000a0 2024-07-26T12:23:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd84004040 con 0x556b202000a0 2024-07-26T12:23:25.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcd81600640 1 -- 172.21.15.40:0/2076301842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd8801fa90 con 0x556b202000a0 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcd81600640 1 -- 172.21.15.40:0/2076301842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd8801fc90 con 0x556b202000a0 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcda563e740 10 client.15459 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b205e8f00 con 0x556b202000a0 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.828+0000 7fcd81600640 1 -- 172.21.15.40:0/2076301842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd84004040 con 0x556b202000a0 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcd81600640 1 -- 172.21.15.40:0/2076301842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcd88032400 con 0x556b202000a0 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcda563e740 10 client.15459 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcda563e740 10 client.15459 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T12:23:25.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcda563e740 20 client.15459 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:25.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcda563e740 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b201e78e0 0x556b205ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcda563e740 4 client.15459 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:23:25.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.829+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b205468a0 con 0x556b201e78e0 2024-07-26T12:23:25.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.830+0000 7fcd97400640 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b201e78e0 0x556b205ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.831+0000 7fcd97400640 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b201e78e0 0x556b205ec9e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5caa5e3ff7b0bb1 server_cookie=e922093dce94e58c in_seq=0 out_seq=0 2024-07-26T12:23:25.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.831+0000 7fcd81600640 10 client.15459 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:25.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:25 smithi076 ceph-mon[35401]: pgmap v535: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-07-26T12:23:25.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcd81600640 1 -- 172.21.15.40:0/2076301842 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b205468a0 con 0x556b201e78e0 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcd81600640 10 client.15459 handle_command_reply: tid=0 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 client.15459 shutdown 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 msgr2=0x556b205da260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 0x556b205da260 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd88012680 tx=0x7fcd880046c0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 shutdown_connections 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20228f60 0x556b205e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b201e78e0 0x556b205ec9e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 --2- 172.21.15.40:0/2076301842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b202000a0 0x556b205da260 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 >> 172.21.15.40:0/2076301842 conn(0x556b2021d350 msgr2=0x556b205d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.833+0000 7fcd81600640 0 client.15459 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.834+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 shutdown_connections 2024-07-26T12:23:25.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.834+0000 7fcda563e740 1 -- 172.21.15.40:0/2076301842 wait complete. 2024-07-26T12:23:25.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.834+0000 7fcda563e740 20 client.15459 trim_cache size 0 max 16384 2024-07-26T12:23:25.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.855+0000 7fcda563e740 1 Processor -- start 2024-07-26T12:23:25.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.855+0000 7fcda563e740 1 -- start start 2024-07-26T12:23:25.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcda563e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205d4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcda563e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205d9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcda563e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205e6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcda563e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556b205ead20 con 0x556b2021d350 2024-07-26T12:23:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcda563e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b205eb3f0 con 0x556b202000a0 2024-07-26T12:23:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcda563e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556b205ebac0 con 0x556b20208280 2024-07-26T12:23:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcd97e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205d4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcd97e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205d4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49420/0 (socket says 172.21.15.40:49420) 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcd97e00640 1 -- 172.21.15.40:0/3741985436 learned_addr learned my addr 172.21.15.40:0/3741985436 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcd97400640 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205d9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.856+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97e00640 1 -- 172.21.15.40:0/3741985436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 msgr2=0x556b205e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97e00640 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205e6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97e00640 1 -- 172.21.15.40:0/3741985436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 msgr2=0x556b205d9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97e00640 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205d9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97e00640 1 -- 172.21.15.40:0/3741985436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b205c77d0 con 0x556b2021d350 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97400640 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205d9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd97e00640 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205d4880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcd88005780 tx=0x7fcd88032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5208868a18b9b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.857+0000 7fcd83e00640 1 -- 172.21.15.40:0/3741985436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8803f020 con 0x556b2021d350 2024-07-26T12:23:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcd83e00640 1 -- 172.21.15.40:0/3741985436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd88032600 con 0x556b2021d350 2024-07-26T12:23:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcd83e00640 1 -- 172.21.15.40:0/3741985436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88037040 con 0x556b2021d350 2024-07-26T12:23:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcda563e740 1 -- 172.21.15.40:0/3741985436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 msgr2=0x556b205d4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcda563e740 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205d4880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcd88005780 tx=0x7fcd88032b90 comp rx=0 tx=0).stop 2024-07-26T12:23:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcda563e740 1 -- 172.21.15.40:0/3741985436 shutdown_connections 2024-07-26T12:23:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcda563e740 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b20208280 0x556b205e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcda563e740 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b202000a0 0x556b205d9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.858+0000 7fcda563e740 1 --2- 172.21.15.40:0/3741985436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205d4880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.859+0000 7fcda563e740 1 -- 172.21.15.40:0/3741985436 >> 172.21.15.40:0/3741985436 conn(0x556b205da920 msgr2=0x556b205d5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.859+0000 7fcda563e740 1 -- 172.21.15.40:0/3741985436 shutdown_connections 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.859+0000 7fcda563e740 1 -- 172.21.15.40:0/3741985436 wait complete. 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.859+0000 7fcda563e740 1 -- start start 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 Processor -- start 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b202000a0 0x556b205f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20208280 0x556b205f5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205ee420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556b205ec860 con 0x556b2021d350 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b205ec190 con 0x556b20208280 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556b205ecf30 con 0x556b202000a0 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.860+0000 7fcda563e740 10 client.0 _ll_register_callbacks cb 0x7fcd8800bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205ee420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49436/0 (socket says 172.21.15.40:49436) 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 -- 172.21.15.40:0/1516646045 learned_addr learned my addr 172.21.15.40:0/1516646045 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd97e00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b202000a0 0x556b205f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd97400640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20208280 0x556b205f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 -- 172.21.15.40:0/1516646045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b202000a0 msgr2=0x556b205f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b202000a0 0x556b205f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 -- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20208280 msgr2=0x556b205f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20208280 0x556b205f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd9ca00640 1 -- 172.21.15.40:0/1516646045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b205d15c0 con 0x556b2021d350 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.861+0000 7fcd97e00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b202000a0 0x556b205f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcd9ca00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205ee420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcd900e1930 tx=0x7fcd900ab540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491e3d1c1c044fb1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcd81600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcd81600640 1 -- 172.21.15.40:0/1516646045 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9001f040 con 0x556b2021d350 2024-07-26T12:23:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcd81600640 1 -- 172.21.15.40:0/1516646045 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd900a9fe0 con 0x556b2021d350 2024-07-26T12:23:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd88032600 con 0x556b2021d350 2024-07-26T12:23:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcd81600640 1 -- 172.21.15.40:0/1516646045 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd900b3e30 con 0x556b2021d350 2024-07-26T12:23:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcda563e740 10 client.15465 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b205f4440 con 0x556b2021d350 2024-07-26T12:23:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.862+0000 7fcd81600640 1 -- 172.21.15.40:0/1516646045 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd88032600 con 0x556b2021d350 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcd81600640 1 -- 172.21.15.40:0/1516646045 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcd9000f040 con 0x556b2021d350 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcda563e740 10 client.15465 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcda563e740 10 client.15465 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcda563e740 20 client.15465 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcda563e740 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b20228f60 0x556b20658e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcda563e740 4 client.15465 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.863+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "status"}) -- 0x556b20542340 con 0x556b20228f60 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.864+0000 7fcd97e00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b20228f60 0x556b20658e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.865+0000 7fcd97e00640 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b20228f60 0x556b20658e60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9840e2dd370c0d8 server_cookie=a121b271d2105bc7 in_seq=0 out_seq=0 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.865+0000 7fcd81600640 10 client.15465 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.865+0000 7fcd81600640 1 -- 172.21.15.40:0/1516646045 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556b20542340 con 0x556b20228f60 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.865+0000 7fcd81600640 10 client.15465 handle_command_reply: tid=0 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.865+0000 7fcda563e740 1 client.15465 shutdown 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 msgr2=0x556b205ee420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205ee420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcd900e1930 tx=0x7fcd900ab540 comp rx=0 tx=0).stop 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 shutdown_connections 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556b20228f60 0x556b20658e60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556b2021d350 0x556b205ee420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b20208280 0x556b205f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 --2- 172.21.15.40:0/1516646045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556b202000a0 0x556b205f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 >> 172.21.15.40:0/1516646045 conn(0x556b205da920 msgr2=0x556b205cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcd81600640 0 client.15465 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 shutdown_connections 2024-07-26T12:23:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 1 -- 172.21.15.40:0/1516646045 wait complete. 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.866+0000 7fcda563e740 20 client.15465 trim_cache size 0 max 16384 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "5cbb9f42-4b47-11ef-bcb7-c7b262605968", 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 34631, 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-07-26T12:23:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 293.28622810000002, 2024-07-26T12:23:25.873 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 29, 2024-07-26T12:23:25.873 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 82, 2024-07-26T12:23:25.873 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 82, 2024-07-26T12:23:25.873 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 314.539473977 2024-07-26T12:23:25.873 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:23:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd7c0b3c50 msgr2=0x7fcd7c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd7c0b3c50 0x7fcd7c0b6160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556b205cd3e0 tx=0x7fcd8800b6f0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 msgr2=0x7fcd9819f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 0x7fcd9819f420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000eaa0 tx=0x7fcd9000ef60 comp rx=0 tx=0).stop 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 shutdown_connections 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd9810d690 0x7fcd9819f420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd7c0b3c50 0x7fcd7c0b6160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd98104b10 0x7fcd9819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 --2- 172.21.15.40:0/3405274584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd981040e0 0x7fcd98199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.867+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 >> 172.21.15.40:0/3405274584 conn(0x7fcd980fdcf0 msgr2=0x7fcd980fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.868+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 shutdown_connections 2024-07-26T12:23:25.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:25.868+0000 7fcd9d400640 1 -- 172.21.15.40:0/3405274584 wait complete. 2024-07-26T12:23:26.801 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-07-26T12:23:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:27 smithi146 ceph-mon[35807]: pgmap v536: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-07-26T12:23:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:27 smithi076 ceph-mon[35401]: pgmap v536: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-07-26T12:23:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:27 smithi040 ceph-mon[32397]: pgmap v536: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-07-26T12:23:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:29 smithi146 ceph-mon[35807]: pgmap v537: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:29 smithi076 ceph-mon[35401]: pgmap v537: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:29 smithi040 ceph-mon[32397]: pgmap v537: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:31 smithi076 ceph-mon[35401]: pgmap v538: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:31 smithi040 ceph-mon[32397]: pgmap v538: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:31 smithi146 ceph-mon[35807]: pgmap v538: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:33 smithi076 ceph-mon[35401]: pgmap v539: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:33.948 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:33 smithi040 ceph-mon[32397]: pgmap v539: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:33 smithi146 ceph-mon[35807]: pgmap v539: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:35.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:35 smithi040 ceph-mon[32397]: pgmap v540: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:35 smithi146 ceph-mon[35807]: pgmap v540: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:35 smithi076 ceph-mon[35401]: pgmap v540: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:37 smithi040 ceph-mon[32397]: pgmap v541: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:37 smithi146 ceph-mon[35807]: pgmap v541: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:37 smithi076 ceph-mon[35401]: pgmap v541: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:39 smithi040 ceph-mon[32397]: pgmap v542: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:39 smithi146 ceph-mon[35807]: pgmap v542: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:39 smithi076 ceph-mon[35401]: pgmap v542: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:41.802 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:23:41.803 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.55 2024-07-26T12:23:41.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:23:41.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:41 smithi146 ceph-mon[35807]: pgmap v543: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:41.888 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:41 smithi040 ceph-mon[32397]: pgmap v543: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:41 smithi076 ceph-mon[35401]: pgmap v543: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:42.460 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:43.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:43 smithi040 ceph-mon[32397]: pgmap v544: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:43 smithi146 ceph-mon[35807]: pgmap v544: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:43 smithi076 ceph-mon[35401]: pgmap v544: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:44.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.803+0000 7fef45400640 1 -- 172.21.15.40:0/2766728587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075180 msgr2=0x7fef40075590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:44.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.803+0000 7fef45400640 1 --2- 172.21.15.40:0/2766728587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075180 0x7fef40075590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef30009900 tx=0x7fef3002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:23:44.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.804+0000 7fef45400640 1 -- 172.21.15.40:0/2766728587 shutdown_connections 2024-07-26T12:23:44.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.804+0000 7fef45400640 1 --2- 172.21.15.40:0/2766728587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef4010f9a0 0x7fef40111dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.804+0000 7fef45400640 1 --2- 172.21.15.40:0/2766728587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef40075ad0 0x7fef4010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.804+0000 7fef45400640 1 --2- 172.21.15.40:0/2766728587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075180 0x7fef40075590 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.804+0000 7fef45400640 1 -- 172.21.15.40:0/2766728587 >> 172.21.15.40:0/2766728587 conn(0x7fef400fee30 msgr2=0x7fef40101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.805+0000 7fef45400640 1 -- 172.21.15.40:0/2766728587 shutdown_connections 2024-07-26T12:23:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.805+0000 7fef45400640 1 -- 172.21.15.40:0/2766728587 wait complete. 2024-07-26T12:23:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.806+0000 7fef45400640 1 Processor -- start 2024-07-26T12:23:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 -- start start 2024-07-26T12:23:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 0x7fef4019be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075ad0 0x7fef4019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef4010f9a0 0x7fef401a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fef40115400 con 0x7fef40075ad0 2024-07-26T12:23:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fef40115280 con 0x7fef40075180 2024-07-26T12:23:44.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.807+0000 7fef45400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fef40115580 con 0x7fef4010f9a0 2024-07-26T12:23:44.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.808+0000 7fef3fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 0x7fef4019be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:44.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.808+0000 7fef3fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 0x7fef4019be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:59632/0 (socket says 172.21.15.40:59632) 2024-07-26T12:23:44.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.808+0000 7fef3fe00640 1 -- 172.21.15.40:0/1825985597 learned_addr learned my addr 172.21.15.40:0/1825985597 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:44.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.808+0000 7fef44a00640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef4010f9a0 0x7fef401a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.809+0000 7fef3fe00640 1 -- 172.21.15.40:0/1825985597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef4010f9a0 msgr2=0x7fef401a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.809+0000 7fef3fe00640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef4010f9a0 0x7fef401a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.809+0000 7fef3fe00640 1 -- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075ad0 msgr2=0x7fef4019c3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-26T12:23:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.809+0000 7fef3f400640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075ad0 0x7fef4019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.809+0000 7fef3fe00640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075ad0 0x7fef4019c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.809+0000 7fef3fe00640 1 -- 172.21.15.40:0/1825985597 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef401a1da0 con 0x7fef40075180 2024-07-26T12:23:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.810+0000 7fef3f400640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075ad0 0x7fef4019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:23:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.810+0000 7fef3fe00640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 0x7fef4019be30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef3002a910 tx=0x7fef30003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.811+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3003f070 con 0x7fef40075180 2024-07-26T12:23:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.811+0000 7fef45400640 1 -- 172.21.15.40:0/1825985597 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef401a2030 con 0x7fef40075180 2024-07-26T12:23:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.811+0000 7fef45400640 1 -- 172.21.15.40:0/1825985597 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef401a87f0 con 0x7fef40075180 2024-07-26T12:23:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.811+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef3003baf0 con 0x7fef40075180 2024-07-26T12:23:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.811+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30035030 con 0x7fef40075180 2024-07-26T12:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.813+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef200052c0 con 0x7fef40075180 2024-07-26T12:23:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.820+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fef30042070 con 0x7fef40075180 2024-07-26T12:23:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.822+0000 7fef3cc00640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fef240b3c50 0x7fef240b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.822+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fef30104560 con 0x7fef40075180 2024-07-26T12:23:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.823+0000 7fef3f400640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fef240b3c50 0x7fef240b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.824+0000 7fef3f400640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fef240b3c50 0x7fef240b6160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef40111ef0 tx=0x7fef2c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:44.831+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fef300cbb70 con 0x7fef40075180 2024-07-26T12:23:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.194+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef200055b0 con 0x7fef40075180 2024-07-26T12:23:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.196+0000 7fef3cc00640 1 -- 172.21.15.40:0/1825985597 <== mon.2 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7fef300cb470 con 0x7fef40075180 2024-07-26T12:23:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:23:45.197 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"btime":"2024-07-26T12:22:37:338561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:22:36.424751+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:23:45.198 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 29 2024-07-26T12:23:45.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.200+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fef240b3c50 msgr2=0x7fef240b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:45.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.200+0000 7fef36000640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fef240b3c50 0x7fef240b6160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef40111ef0 tx=0x7fef2c005e50 comp rx=0 tx=0).stop 2024-07-26T12:23:45.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.200+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 msgr2=0x7fef4019be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:45.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.200+0000 7fef36000640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 0x7fef4019be30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef3002a910 tx=0x7fef30003b90 comp rx=0 tx=0).stop 2024-07-26T12:23:45.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 shutdown_connections 2024-07-26T12:23:45.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fef240b3c50 0x7fef240b6160 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:45.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef4010f9a0 0x7fef401a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:45.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40075ad0 0x7fef4019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:45.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 --2- 172.21.15.40:0/1825985597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef40075180 0x7fef4019be30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:45.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 >> 172.21.15.40:0/1825985597 conn(0x7fef400fee30 msgr2=0x7fef401019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:45.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 shutdown_connections 2024-07-26T12:23:45.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:45.201+0000 7fef36000640 1 -- 172.21.15.40:0/1825985597 wait complete. 2024-07-26T12:23:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:45 smithi040 ceph-mon[32397]: pgmap v545: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:45 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1825985597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:23:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:45 smithi146 ceph-mon[35807]: pgmap v545: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:45 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1825985597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:23:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:45 smithi076 ceph-mon[35401]: pgmap v545: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:23:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:45 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1825985597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:23:46.087 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0' 2024-07-26T12:23:46.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0 2024-07-26T12:23:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:23:47.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:47 smithi076 ceph-mon[35401]: pgmap v546: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:47 smithi040 ceph-mon[32397]: pgmap v546: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:47 smithi146 ceph-mon[35807]: pgmap v546: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:23:48.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.998+0000 7f2841800640 1 -- 172.21.15.40:0/3941286818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 msgr2=0x7f283c107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:48.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.998+0000 7f2841800640 1 --2- 172.21.15.40:0/3941286818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c107930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2834009cd0 tx=0x7f283402a8e0 comp rx=0 tx=0).stop 2024-07-26T12:23:48.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 -- 172.21.15.40:0/3941286818 shutdown_connections 2024-07-26T12:23:48.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 --2- 172.21.15.40:0/3941286818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c107930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:48.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 --2- 172.21.15.40:0/3941286818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f283c102960 0x7f283c106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 --2- 172.21.15.40:0/3941286818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102010 0x7f283c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 -- 172.21.15.40:0/3941286818 >> 172.21.15.40:0/3941286818 conn(0x7f283c0fdd60 msgr2=0x7f283c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:49.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 -- 172.21.15.40:0/3941286818 shutdown_connections 2024-07-26T12:23:49.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:48.999+0000 7f2841800640 1 -- 172.21.15.40:0/3941286818 wait complete. 2024-07-26T12:23:49.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.000+0000 7f2841800640 1 Processor -- start 2024-07-26T12:23:49.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 -- start start 2024-07-26T12:23:49.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f283c102010 0x7f283c1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102960 0x7f283c1a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c1a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1197c0 con 0x7f283c107450 2024-07-26T12:23:49.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f283c119640 con 0x7f283c102010 2024-07-26T12:23:49.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.001+0000 7f2841800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f283c119940 con 0x7f283c102960 2024-07-26T12:23:49.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.002+0000 7f2840e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c1a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.002+0000 7f2840e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c1a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53274/0 (socket says 172.21.15.40:53274) 2024-07-26T12:23:49.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.002+0000 7f2840e00640 1 -- 172.21.15.40:0/3005301958 learned_addr learned my addr 172.21.15.40:0/3005301958 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.002+0000 7f283be00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f283c102010 0x7f283c1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.002+0000 7f283b400640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102960 0x7f283c1a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.002+0000 7f2840e00640 1 -- 172.21.15.40:0/3005301958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102960 msgr2=0x7f283c1a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.003+0000 7f2840e00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102960 0x7f283c1a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.003+0000 7f2840e00640 1 -- 172.21.15.40:0/3005301958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f283c102010 msgr2=0x7f283c1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.003+0000 7f2840e00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f283c102010 0x7f283c1a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.003+0000 7f2840e00640 1 -- 172.21.15.40:0/3005301958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c1a61a0 con 0x7f283c107450 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.003+0000 7f283b400640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102960 0x7f283c1a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:23:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.003+0000 7f2840e00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c1a5a70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2834005cc0 tx=0x7f2834003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:49.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.004+0000 7f2838c00640 1 -- 172.21.15.40:0/3005301958 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834004240 con 0x7f283c107450 2024-07-26T12:23:49.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.004+0000 7f2838c00640 1 -- 172.21.15.40:0/3005301958 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2834003e10 con 0x7f283c107450 2024-07-26T12:23:49.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.004+0000 7f2838c00640 1 -- 172.21.15.40:0/3005301958 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834030da0 con 0x7f283c107450 2024-07-26T12:23:49.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.005+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c1a6430 con 0x7f283c107450 2024-07-26T12:23:49.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.005+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c1acbf0 con 0x7f283c107450 2024-07-26T12:23:49.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.009+0000 7f2849bcf740 1 Processor -- start 2024-07-26T12:23:49.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2838c00640 1 -- 172.21.15.40:0/3005301958 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f28340305a0 con 0x7f283c107450 2024-07-26T12:23:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 -- start start 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e60b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e60b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e243b70 0x56350e60bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56350e57f970 con 0x56350e243b70 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56350e56ee70 con 0x56350e23b990 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.011+0000 7f2849bcf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56350e572eb0 con 0x56350e264850 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.012+0000 7f283b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e243b70 0x56350e60bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.012+0000 7f283b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e243b70 0x56350e60bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53290/0 (socket says 172.21.15.40:53290) 2024-07-26T12:23:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.012+0000 7f283b400640 1 -- 172.21.15.40:0/3664009865 learned_addr learned my addr 172.21.15.40:0/3664009865 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.012+0000 7f283b400640 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e60b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.012+0000 7f283be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e60b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.013+0000 7f283b400640 1 -- 172.21.15.40:0/3664009865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 msgr2=0x56350e60b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.013+0000 7f283b400640 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e60b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.013+0000 7f283b400640 1 -- 172.21.15.40:0/3664009865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e243b70 msgr2=0x56350e60bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.013+0000 7f283b400640 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e243b70 0x56350e60bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.013+0000 7f283b400640 1 -- 172.21.15.40:0/3664009865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350e4f78e0 con 0x56350e264850 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.014+0000 7f2838c00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28200b3d10 0x7f28200b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.014+0000 7f283b400640 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e60b060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f282800cf60 tx=0x7f2828005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0c3c3dee5d4d008 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.015+0000 7f2838c00640 1 -- 172.21.15.40:0/3005301958 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f283402e030 con 0x7f283c107450 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.015+0000 7f2831600640 1 -- 172.21.15.40:0/3664009865 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282801a070 con 0x56350e264850 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.015+0000 7f283be00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28200b3d10 0x7f28200b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.015+0000 7f2831600640 1 -- 172.21.15.40:0/3664009865 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2828011860 con 0x56350e264850 2024-07-26T12:23:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.015+0000 7f2831600640 1 -- 172.21.15.40:0/3664009865 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828003850 con 0x56350e264850 2024-07-26T12:23:49.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 -- 172.21.15.40:0/3664009865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 msgr2=0x56350e60b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e60b060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f282800cf60 tx=0x7f2828005850 comp rx=0 tx=0).stop 2024-07-26T12:23:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f283be00640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28200b3d10 0x7f28200b6220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x56350e609ce0 tx=0x7f282c00b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 -- 172.21.15.40:0/3664009865 shutdown_connections 2024-07-26T12:23:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e243b70 0x56350e60bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e60b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 --2- 172.21.15.40:0/3664009865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e60b060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.016+0000 7f2849bcf740 1 -- 172.21.15.40:0/3664009865 >> 172.21.15.40:0/3664009865 conn(0x56350e258c40 msgr2=0x56350e608f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:49.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.017+0000 7f2849bcf740 1 -- 172.21.15.40:0/3664009865 shutdown_connections 2024-07-26T12:23:49.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.017+0000 7f2849bcf740 1 -- 172.21.15.40:0/3664009865 wait complete. 2024-07-26T12:23:49.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.018+0000 7f2849bcf740 1 -- start start 2024-07-26T12:23:49.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.018+0000 7f2849bcf740 1 Processor -- start 2024-07-26T12:23:49.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e23b990 0x56350e616bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6170f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e622b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56350e3d27b0 con 0x56350e264850 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56350e50b420 con 0x56350e243b70 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56350e619840 con 0x56350e23b990 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2849bcf740 10 client.0 _ll_register_callbacks cb 0x56350e27c0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2840e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e622b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2840e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e622b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53296/0 (socket says 172.21.15.40:53296) 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f2840e00640 1 -- 172.21.15.40:0/1077696065 learned_addr learned my addr 172.21.15.40:0/1077696065 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:49.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.019+0000 7f283be00640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e23b990 0x56350e616bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f283b400640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6170f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2840e00640 1 -- 172.21.15.40:0/1077696065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e23b990 msgr2=0x56350e616bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2840e00640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e23b990 0x56350e616bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2840e00640 1 -- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 msgr2=0x56350e6170f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2840e00640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6170f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2840e00640 1 -- 172.21.15.40:0/1077696065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350e503c50 con 0x56350e264850 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2840e00640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e622b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2834031dd0 tx=0x7f28340cb310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35ee552c8ca361d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.020+0000 7f2826000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.021+0000 7f2826000640 1 -- 172.21.15.40:0/1077696065 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28340cbba0 con 0x56350e264850 2024-07-26T12:23:49.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.021+0000 7f2826000640 1 -- 172.21.15.40:0/1077696065 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28340cae00 con 0x56350e264850 2024-07-26T12:23:49.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.021+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2828011860 con 0x56350e264850 2024-07-26T12:23:49.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.021+0000 7f2826000640 1 -- 172.21.15.40:0/1077696065 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28340d01a0 con 0x56350e264850 2024-07-26T12:23:49.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.022+0000 7f2849bcf740 10 client.15480 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:49.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.022+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56350e2deba0 con 0x56350e264850 2024-07-26T12:23:49.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.022+0000 7f2826000640 1 -- 172.21.15.40:0/1077696065 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2828011860 con 0x56350e264850 2024-07-26T12:23:49.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.022+0000 7f2826000640 1 -- 172.21.15.40:0/1077696065 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2834030070 con 0x56350e264850 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.022+0000 7f2849bcf740 10 client.15480 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.022+0000 7f2849bcf740 10 client.15480 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.023+0000 7f2849bcf740 20 client.15480 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.023+0000 7f2849bcf740 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e2231d0 0x56350e628ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.023+0000 7f2849bcf740 4 client.15480 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.023+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56350e5818c0 con 0x56350e2231d0 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.023+0000 7f283be00640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e2231d0 0x56350e628ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.024+0000 7f283be00640 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e2231d0 0x56350e628ad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de53e857343ca00 server_cookie=d536352f5ee6196c in_seq=0 out_seq=0 2024-07-26T12:23:49.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.024+0000 7f2826000640 10 client.15480 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:49.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.026+0000 7f2826000640 1 -- 172.21.15.40:0/1077696065 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56350e5818c0 con 0x56350e2231d0 2024-07-26T12:23:49.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.026+0000 7f2826000640 10 client.15480 handle_command_reply: tid=0 2024-07-26T12:23:49.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.026+0000 7f2849bcf740 1 client.15480 shutdown 2024-07-26T12:23:49.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 msgr2=0x56350e622b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e622b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2834031dd0 tx=0x7f28340cb310 comp rx=0 tx=0).stop 2024-07-26T12:23:49.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 shutdown_connections 2024-07-26T12:23:49.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e2231d0 0x56350e628ad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e622b60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6170f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 --2- 172.21.15.40:0/1077696065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e23b990 0x56350e616bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2826000640 0 client.15480 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:49.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.027+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 >> 172.21.15.40:0/1077696065 conn(0x56350e258c40 msgr2=0x56350e60e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:49.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.028+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 shutdown_connections 2024-07-26T12:23:49.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.028+0000 7f2849bcf740 1 -- 172.21.15.40:0/1077696065 wait complete. 2024-07-26T12:23:49.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.028+0000 7f2849bcf740 20 client.15480 trim_cache size 0 max 16384 2024-07-26T12:23:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.063+0000 7f2849bcf740 1 Processor -- start 2024-07-26T12:23:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 -- start start 2024-07-26T12:23:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 0x56350e607f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6185e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e622950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1b5090 con 0x56350e23b990 2024-07-26T12:23:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1b6bd0 con 0x56350e243b70 2024-07-26T12:23:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.064+0000 7f2849bcf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1b5760 con 0x56350e264850 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.065+0000 7f283be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 0x56350e607f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.065+0000 7f283be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 0x56350e607f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53306/0 (socket says 172.21.15.40:53306) 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.065+0000 7f283be00640 1 -- 172.21.15.40:0/2385824118 learned_addr learned my addr 172.21.15.40:0/2385824118 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.065+0000 7f2840e00640 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e622950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.066+0000 7f283be00640 1 -- 172.21.15.40:0/2385824118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 msgr2=0x56350e622950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.066+0000 7f283be00640 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e622950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.066+0000 7f283be00640 1 -- 172.21.15.40:0/2385824118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 msgr2=0x56350e6185e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T12:23:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.066+0000 7f283be00640 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6185e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.066+0000 7f283be00640 1 -- 172.21.15.40:0/2385824118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350e60d350 con 0x56350e23b990 2024-07-26T12:23:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.067+0000 7f283be00640 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 0x56350e607f50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f282c00bb00 tx=0x7f282c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9a57695f58f20c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.067+0000 7f2830c00640 1 -- 172.21.15.40:0/2385824118 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c01ec30 con 0x56350e23b990 2024-07-26T12:23:49.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.067+0000 7f2830c00640 1 -- 172.21.15.40:0/2385824118 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f282c01edd0 con 0x56350e23b990 2024-07-26T12:23:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.067+0000 7f2830c00640 1 -- 172.21.15.40:0/2385824118 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c031620 con 0x56350e23b990 2024-07-26T12:23:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 -- 172.21.15.40:0/2385824118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 msgr2=0x56350e607f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 0x56350e607f50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f282c00bb00 tx=0x7f282c015000 comp rx=0 tx=0).stop 2024-07-26T12:23:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 -- 172.21.15.40:0/2385824118 shutdown_connections 2024-07-26T12:23:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e264850 0x56350e622950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e243b70 0x56350e6185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 --2- 172.21.15.40:0/2385824118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e23b990 0x56350e607f50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.069+0000 7f2849bcf740 1 -- 172.21.15.40:0/2385824118 >> 172.21.15.40:0/2385824118 conn(0x56350e258c40 msgr2=0x56350e617ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.070+0000 7f2849bcf740 1 -- 172.21.15.40:0/2385824118 shutdown_connections 2024-07-26T12:23:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.070+0000 7f2849bcf740 1 -- 172.21.15.40:0/2385824118 wait complete. 2024-07-26T12:23:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.070+0000 7f2849bcf740 1 -- start start 2024-07-26T12:23:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.071+0000 7f2849bcf740 1 Processor -- start 2024-07-26T12:23:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e61a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e243b70 0x56350e61ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e61b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1b6500 con 0x56350e264850 2024-07-26T12:23:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1b5e30 con 0x56350e23b990 2024-07-26T12:23:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f283c1b3050 con 0x56350e243b70 2024-07-26T12:23:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.072+0000 7f2849bcf740 10 client.0 _ll_register_callbacks cb 0x7f2834009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:23:49.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.073+0000 7f283be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e61a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.073+0000 7f283be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e61a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:59680/0 (socket says 172.21.15.40:59680) 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.073+0000 7f283be00640 1 -- 172.21.15.40:0/199358905 learned_addr learned my addr 172.21.15.40:0/199358905 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.073+0000 7f283b400640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e243b70 0x56350e61ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.073+0000 7f2840e00640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e61b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f283b400640 1 -- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 msgr2=0x56350e61a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f283b400640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e61a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f283b400640 1 -- 172.21.15.40:0/199358905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 msgr2=0x56350e61b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f283b400640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e61b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f283b400640 1 -- 172.21.15.40:0/199358905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350e690260 con 0x56350e243b70 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f2840e00640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e61b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f283b400640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e243b70 0x56350e61ae00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f28280117b0 tx=0x7f282800c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14aea36958560e5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.074+0000 7f2826000640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.075+0000 7f2826000640 1 -- 172.21.15.40:0/199358905 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828023070 con 0x56350e243b70 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.075+0000 7f2826000640 1 -- 172.21.15.40:0/199358905 <== mon.1 v2:172.21.15.146:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28280050c0 con 0x56350e243b70 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.075+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f282c01edd0 con 0x56350e243b70 2024-07-26T12:23:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.076+0000 7f2826000640 1 -- 172.21.15.40:0/199358905 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f282802f050 con 0x56350e243b70 2024-07-26T12:23:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.076+0000 7f2849bcf740 10 client.25222 fetch_fsmap learned FSMap version 29 2024-07-26T12:23:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.076+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56350e6913f0 con 0x56350e243b70 2024-07-26T12:23:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.077+0000 7f2826000640 1 -- 172.21.15.40:0/199358905 <== mon.1 v2:172.21.15.146:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f282c01edd0 con 0x56350e243b70 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2826000640 1 -- 172.21.15.40:0/199358905 <== mon.1 v2:172.21.15.146:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2828004680 con 0x56350e243b70 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2849bcf740 10 client.25222 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2849bcf740 10 client.25222 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2849bcf740 20 client.25222 populate_metadata read hostname 'smithi040' 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2849bcf740 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e1f8580 0x56350e693840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2849bcf740 4 client.25222 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}] 2024-07-26T12:23:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.078+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}) -- 0x56350e57d360 con 0x56350e1f8580 2024-07-26T12:23:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.079+0000 7f283be00640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e1f8580 0x56350e693840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:23:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.081+0000 7f2826000640 10 client.25222 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.081+0000 7f283be00640 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e1f8580 0x56350e693840 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5803570a2682e96a server_cookie=80547acf5345bc03 in_seq=0 out_seq=0 2024-07-26T12:23:49.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.108+0000 7f2826000640 1 -- 172.21.15.40:0/199358905 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56350e57d360 con 0x56350e1f8580 2024-07-26T12:23:49.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.108+0000 7f2826000640 10 client.25222 handle_command_reply: tid=0 2024-07-26T12:23:49.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.108+0000 7f2849bcf740 1 client.25222 shutdown 2024-07-26T12:23:49.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e243b70 msgr2=0x56350e61ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e243b70 0x56350e61ae00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f28280117b0 tx=0x7f282800c440 comp rx=0 tx=0).stop 2024-07-26T12:23:49.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 shutdown_connections 2024-07-26T12:23:49.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56350e1f8580 0x56350e693840 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56350e264850 0x56350e61b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56350e243b70 0x56350e61ae00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 --2- 172.21.15.40:0/199358905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56350e23b990 0x56350e61a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 >> 172.21.15.40:0/199358905 conn(0x56350e258c40 msgr2=0x56350e607d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2826000640 0 client.25222 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.109+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 shutdown_connections 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.110+0000 7f2849bcf740 1 -- 172.21.15.40:0/199358905 wait complete. 2024-07-26T12:23:49.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.110+0000 7f2849bcf740 20 client.25222 trim_cache size 0 max 16384 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 29, 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 2, 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "93e4d180": { 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 2, 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:23:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.6, 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:23:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:23:49.114 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:23:49.114 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:23:49.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28200b3d10 msgr2=0x7f28200b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28200b3d10 0x7f28200b6220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x56350e609ce0 tx=0x7f282c00b4d0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 msgr2=0x7f283c1a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c1a5a70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2834005cc0 tx=0x7f2834003c20 comp rx=0 tx=0).stop 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 shutdown_connections 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f283c107450 0x7f283c1a5a70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28200b3d10 0x7f28200b6220 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c102960 0x7f283c1a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 --2- 172.21.15.40:0/3005301958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f283c102010 0x7f283c1a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 >> 172.21.15.40:0/3005301958 conn(0x7f283c0fdd60 msgr2=0x7f283c104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.111+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 shutdown_connections 2024-07-26T12:23:49.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:23:49.112+0000 7f2841800640 1 -- 172.21.15.40:0/3005301958 wait complete. 2024-07-26T12:23:49.937 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:49 smithi040 ceph-mon[32397]: pgmap v547: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:50.002 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '93e4d180', quiesce took 8.2 seconds. Will release after: 14.350000000000001 2024-07-26T12:23:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:49 smithi146 ceph-mon[35807]: pgmap v547: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:49 smithi076 ceph-mon[35401]: pgmap v547: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:23:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:51 smithi040 ceph-mon[32397]: pgmap v548: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:51 smithi146 ceph-mon[35807]: pgmap v548: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:51 smithi076 ceph-mon[35401]: pgmap v548: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:23:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:23:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:23:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:23:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:53 smithi040 ceph-mon[32397]: pgmap v549: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:23:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:23:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:23:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:53 smithi146 ceph-mon[35807]: pgmap v549: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:23:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:23:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:23:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:53 smithi076 ceph-mon[35401]: pgmap v549: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:23:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:23:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:23:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:23:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:54 smithi040 ceph-mon[32397]: pgmap v550: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:23:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:54 smithi146 ceph-mon[35807]: pgmap v550: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:23:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:54 smithi076 ceph-mon[35401]: pgmap v550: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:23:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:57 smithi146 ceph-mon[35807]: pgmap v551: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:23:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:57 smithi076 ceph-mon[35401]: pgmap v551: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:23:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:57 smithi040 ceph-mon[32397]: pgmap v551: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:23:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:23:59 smithi146 ceph-mon[35807]: pgmap v552: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-07-26T12:23:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:23:59 smithi076 ceph-mon[35401]: pgmap v552: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-07-26T12:23:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:23:59 smithi040 ceph-mon[32397]: pgmap v552: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-07-26T12:24:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:01 smithi146 ceph-mon[35807]: pgmap v553: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-07-26T12:24:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:01 smithi076 ceph-mon[35401]: pgmap v553: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-07-26T12:24:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:01 smithi040 ceph-mon[32397]: pgmap v553: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-07-26T12:24:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:03 smithi076 ceph-mon[35401]: pgmap v554: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-07-26T12:24:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:03 smithi040 ceph-mon[32397]: pgmap v554: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-07-26T12:24:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:03 smithi146 ceph-mon[35807]: pgmap v554: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-07-26T12:24:04.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:24:04.835 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:24:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:05 smithi076 ceph-mon[35401]: pgmap v555: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:24:05.335 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:05 smithi040 ceph-mon[32397]: pgmap v555: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:24:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:05 smithi146 ceph-mon[35807]: pgmap v555: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T12:24:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.185+0000 7f1c8da00640 1 -- 172.21.15.40:0/1787181253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88107dd0 msgr2=0x7f1c881081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.185+0000 7f1c8da00640 1 --2- 172.21.15.40:0/1787181253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88107dd0 0x7f1c881081e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009900 tx=0x7f1c7402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.185+0000 7f1c8da00640 1 -- 172.21.15.40:0/1787181253 shutdown_connections 2024-07-26T12:24:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.185+0000 7f1c8da00640 1 --2- 172.21.15.40:0/1787181253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88108720 0x7f1c8810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.185+0000 7f1c8da00640 1 --2- 172.21.15.40:0/1787181253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88107dd0 0x7f1c881081e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.185+0000 7f1c8da00640 1 --2- 172.21.15.40:0/1787181253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c88102490 0x7f1c881028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.186+0000 7f1c8da00640 1 -- 172.21.15.40:0/1787181253 >> 172.21.15.40:0/1787181253 conn(0x7f1c88079160 msgr2=0x7f1c88079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.186+0000 7f1c8da00640 1 -- 172.21.15.40:0/1787181253 shutdown_connections 2024-07-26T12:24:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.186+0000 7f1c8da00640 1 -- 172.21.15.40:0/1787181253 wait complete. 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.187+0000 7f1c8da00640 1 Processor -- start 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.187+0000 7f1c8da00640 1 -- start start 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c8da00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c88102490 0x7f1c8819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c8da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88107dd0 0x7f1c8819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c8da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 0x7f1c881a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c8da00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c88112250 con 0x7f1c88108720 2024-07-26T12:24:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c8da00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c881120d0 con 0x7f1c88102490 2024-07-26T12:24:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c8da00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c881123d0 con 0x7f1c88107dd0 2024-07-26T12:24:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c87400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 0x7f1c881a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c87400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 0x7f1c881a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48664/0 (socket says 172.21.15.40:48664) 2024-07-26T12:24:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c87400640 1 -- 172.21.15.40:0/4113534320 learned_addr learned my addr 172.21.15.40:0/4113534320 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c86a00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c88102490 0x7f1c8819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.188+0000 7f1c86000640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88107dd0 0x7f1c8819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c87400640 1 -- 172.21.15.40:0/4113534320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88107dd0 msgr2=0x7f1c8819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c87400640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88107dd0 0x7f1c8819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c87400640 1 -- 172.21.15.40:0/4113534320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c88102490 msgr2=0x7f1c8819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c87400640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c88102490 0x7f1c8819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c87400640 1 -- 172.21.15.40:0/4113534320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c881a2070 con 0x7f1c88108720 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c86000640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88107dd0 0x7f1c8819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.189+0000 7f1c87400640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 0x7f1c881a1940 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000eaa0 tx=0x7f1c8000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.190+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000cdb0 con 0x7f1c88108720 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.190+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c80005020 con 0x7f1c88108720 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.190+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c800116d0 con 0x7f1c88108720 2024-07-26T12:24:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.190+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c881a2360 con 0x7f1c88108720 2024-07-26T12:24:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.190+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c881a8ac0 con 0x7f1c88108720 2024-07-26T12:24:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.191+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c88103710 con 0x7f1c88108720 2024-07-26T12:24:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.194+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1c800051d0 con 0x7f1c88108720 2024-07-26T12:24:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.196+0000 7f1c7f400640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c6c0b3bd0 0x7f1c6c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.197+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1c800e4170 con 0x7f1c88108720 2024-07-26T12:24:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.197+0000 7f1c86a00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c6c0b3bd0 0x7f1c6c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.198+0000 7f1c86a00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c6c0b3bd0 0x7f1c6c0b60e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c78005d00 tx=0x7f1c7800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.199+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1c80016030 con 0x7f1c88108720 2024-07-26T12:24:07.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.442+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c881a8c90 con 0x7f1c88108720 2024-07-26T12:24:07.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:07 smithi040 ceph-mon[32397]: pgmap v556: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-07-26T12:24:07.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.444+0000 7f1c7f400640 1 -- 172.21.15.40:0/4113534320 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7f1c800ab780 con 0x7f1c88108720 2024-07-26T12:24:07.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:24:07.446 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"btime":"2024-07-26T12:22:37:338561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:22:36.424751+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:24:07.446 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 29 2024-07-26T12:24:07.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.446+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c6c0b3bd0 msgr2=0x7f1c6c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:07.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.446+0000 7f1c8da00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c6c0b3bd0 0x7f1c6c0b60e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c78005d00 tx=0x7f1c7800b410 comp rx=0 tx=0).stop 2024-07-26T12:24:07.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.446+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 msgr2=0x7f1c881a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:07.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.446+0000 7f1c8da00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 0x7f1c881a1940 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000eaa0 tx=0x7f1c8000ef60 comp rx=0 tx=0).stop 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.446+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 shutdown_connections 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c88108720 0x7f1c881a1940 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c6c0b3bd0 0x7f1c6c0b60e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c88107dd0 0x7f1c8819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 --2- 172.21.15.40:0/4113534320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c88102490 0x7f1c8819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 >> 172.21.15.40:0/4113534320 conn(0x7f1c88079160 msgr2=0x7f1c8806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 shutdown_connections 2024-07-26T12:24:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:07.447+0000 7f1c8da00640 1 -- 172.21.15.40:0/4113534320 wait complete. 2024-07-26T12:24:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:07 smithi146 ceph-mon[35807]: pgmap v556: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-07-26T12:24:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:07 smithi076 ceph-mon[35401]: pgmap v556: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-07-26T12:24:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:08 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4113534320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:08 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4113534320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:08 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4113534320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:09 smithi040 ceph-mon[32397]: pgmap v557: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:24:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:09 smithi146 ceph-mon[35807]: pgmap v557: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:24:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:09 smithi076 ceph-mon[35401]: pgmap v557: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:24:11.076 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 93e4d180 --release --await' 2024-07-26T12:24:11.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 93e4d180 --release --await 2024-07-26T12:24:11.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:11 smithi146 ceph-mon[35807]: pgmap v558: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-07-26T12:24:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:11 smithi040 ceph-mon[32397]: pgmap v558: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-07-26T12:24:11.536 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:24:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:11 smithi076 ceph-mon[35401]: pgmap v558: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-07-26T12:24:12.726 INFO:tasks.workunit.client.0.smithi040.stderr:Updating files: 57% (7253/12697) Updating files: 58% (7365/12697) Updating files: 59% (7492/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 93% (11908/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-07-26T12:24:13.447 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:13 smithi040 ceph-mon[32397]: pgmap v559: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:24:13.523 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to 'e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528'. 2024-07-26T12:24:13.523 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-07-26T12:24:13.524 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.525 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-07-26T12:24:13.525 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.525 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-07-26T12:24:13.525 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-07-26T12:24:13.525 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at e8f88bb1fe0 Merge PR #54435 into wip-vshankar-testing-20240725.121331-debug 2024-07-26T12:24:13.532 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-07-26T12:24:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:13 smithi146 ceph-mon[35807]: pgmap v559: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:24:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:13 smithi076 ceph-mon[35401]: pgmap v559: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:24:13.626 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-07-26T12:24:13.634 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-07-26T12:24:13.634 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.828+0000 7f3f4a000640 1 -- 172.21.15.40:0/766242901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 msgr2=0x7f3f441046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.828+0000 7f3f4a000640 1 --2- 172.21.15.40:0/766242901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f441046c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009900 tx=0x7f3f3402a410 comp rx=0 tx=0).stop 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.828+0000 7f3f4a000640 1 -- 172.21.15.40:0/766242901 shutdown_connections 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.828+0000 7f3f4a000640 1 --2- 172.21.15.40:0/766242901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4410d860 0x7f3f4410fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.829+0000 7f3f4a000640 1 --2- 172.21.15.40:0/766242901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f44104ce0 0x7f3f4410d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.829+0000 7f3f4a000640 1 --2- 172.21.15.40:0/766242901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f441046c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.829+0000 7f3f4a000640 1 -- 172.21.15.40:0/766242901 >> 172.21.15.40:0/766242901 conn(0x7f3f44079160 msgr2=0x7f3f44079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.829+0000 7f3f4a000640 1 -- 172.21.15.40:0/766242901 shutdown_connections 2024-07-26T12:24:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.829+0000 7f3f4a000640 1 -- 172.21.15.40:0/766242901 wait complete. 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 Processor -- start 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 -- start start 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f4419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f44104ce0 0x7f3f4419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4410d860 0x7f3f441a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3f44113360 con 0x7f3f441042b0 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441131e0 con 0x7f3f4410d860 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.830+0000 7f3f4a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441134e0 con 0x7f3f44104ce0 2024-07-26T12:24:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f4419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f4419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56486/0 (socket says 172.21.15.40:56486) 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 -- 172.21.15.40:0/1719113689 learned_addr learned my addr 172.21.15.40:0/1719113689 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f42a00640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f44104ce0 0x7f3f4419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43e00640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4410d860 0x7f3f441a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 -- 172.21.15.40:0/1719113689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f44104ce0 msgr2=0x7f3f4419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f44104ce0 0x7f3f4419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 -- 172.21.15.40:0/1719113689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4410d860 msgr2=0x7f3f441a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4410d860 0x7f3f441a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.831+0000 7f3f43400640 1 -- 172.21.15.40:0/1719113689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f441a1fe0 con 0x7f3f441042b0 2024-07-26T12:24:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.832+0000 7f3f43400640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f4419c070 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3f34005940 tx=0x7f3f340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.832+0000 7f3f3be00640 1 -- 172.21.15.40:0/1719113689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3403f030 con 0x7f3f441042b0 2024-07-26T12:24:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.832+0000 7f3f3be00640 1 -- 172.21.15.40:0/1719113689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f34003c90 con 0x7f3f441042b0 2024-07-26T12:24:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.832+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f441a2270 con 0x7f3f441042b0 2024-07-26T12:24:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.832+0000 7f3f3be00640 1 -- 172.21.15.40:0/1719113689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34035070 con 0x7f3f441042b0 2024-07-26T12:24:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.832+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f441a8a30 con 0x7f3f441042b0 2024-07-26T12:24:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.835+0000 7f3f50bbb740 1 Processor -- start 2024-07-26T12:24:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 -- start start 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 0x55caf70c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f3be00640 1 -- 172.21.15.40:0/1719113689 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f34042030 con 0x7f3f441042b0 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55caf703df30 con 0x55caf6d01840 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55caf702d430 con 0x55caf6d22520 2024-07-26T12:24:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55caf7031470 con 0x55caf6cf9660 2024-07-26T12:24:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.836+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 0x55caf70c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 0x55caf70c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56500/0 (socket says 172.21.15.40:56500) 2024-07-26T12:24:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 -- 172.21.15.40:0/779009924 learned_addr learned my addr 172.21.15.40:0/779009924 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f43e00640 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f43400640 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 -- 172.21.15.40:0/779009924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 msgr2=0x55caf70c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 -- 172.21.15.40:0/779009924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 msgr2=0x55caf70c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.837+0000 7f3f42a00640 1 -- 172.21.15.40:0/779009924 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caf6d8db00 con 0x55caf6d01840 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.838+0000 7f3f42a00640 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 0x55caf70c7a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000bc50 tx=0x7f3f3000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2e644c58be6d9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.838+0000 7f3f2fe00640 1 -- 172.21.15.40:0/779009924 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30015070 con 0x55caf6d01840 2024-07-26T12:24:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.838+0000 7f3f2fe00640 1 -- 172.21.15.40:0/779009924 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f3001a8f0 con 0x55caf6d01840 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.838+0000 7f3f2fe00640 1 -- 172.21.15.40:0/779009924 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f300117c0 con 0x55caf6d01840 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.838+0000 7f3f3be00640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f280b3c50 0x7f3f280b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f3be00640 1 -- 172.21.15.40:0/1719113689 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3f34104140 con 0x7f3f441042b0 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f43e00640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f280b3c50 0x7f3f280b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 -- 172.21.15.40:0/779009924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 msgr2=0x55caf70c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 0x55caf70c7a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000bc50 tx=0x7f3f3000f730 comp rx=0 tx=0).stop 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 -- 172.21.15.40:0/779009924 shutdown_connections 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d01840 0x55caf70c7a40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/779009924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 -- 172.21.15.40:0/779009924 >> 172.21.15.40:0/779009924 conn(0x55caf6d16910 msgr2=0x55caf70c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.839+0000 7f3f50bbb740 1 -- 172.21.15.40:0/779009924 shutdown_connections 2024-07-26T12:24:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.840+0000 7f3f43e00640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f280b3c50 0x7f3f280b6160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0092f0 tx=0x7f3f3c009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.840+0000 7f3f50bbb740 1 -- 172.21.15.40:0/779009924 wait complete. 2024-07-26T12:24:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.840+0000 7f3f50bbb740 1 -- start start 2024-07-26T12:24:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.840+0000 7f3f50bbb740 1 Processor -- start 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 0x55caf70d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55caf6e90bb0 con 0x55caf6d22520 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55caf6fc9910 con 0x55caf6d01840 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55caf70d57a0 con 0x55caf6cf9660 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f50bbb740 10 client.0 _ll_register_callbacks cb 0x55caf6d39d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 0x55caf70d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 0x55caf70d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56514/0 (socket says 172.21.15.40:56514) 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.841+0000 7f3f43e00640 1 -- 172.21.15.40:0/2803518006 learned_addr learned my addr 172.21.15.40:0/2803518006 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f42a00640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43400640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43e00640 1 -- 172.21.15.40:0/2803518006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 msgr2=0x55caf70d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43e00640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70d2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43e00640 1 -- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 msgr2=0x55caf70d2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43e00640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70d2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43e00640 1 -- 172.21.15.40:0/2803518006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caf6e04960 con 0x55caf6d22520 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f43e00640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 0x55caf70d30c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c012870 tx=0x7f3f3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a632c17c03c1831 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.842+0000 7f3f2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f2cc00640 1 -- 172.21.15.40:0/2803518006 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00ead0 con 0x55caf6d22520 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f3001a8f0 con 0x55caf6d22520 2024-07-26T12:24:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f2cc00640 1 -- 172.21.15.40:0/2803518006 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3f3c00ec70 con 0x55caf6d22520 2024-07-26T12:24:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f2cc00640 1 -- 172.21.15.40:0/2803518006 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f3c01f420 con 0x55caf6d22520 2024-07-26T12:24:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f50bbb740 10 client.15504 fetch_fsmap learned FSMap version 29 2024-07-26T12:24:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55caf70e1500 con 0x55caf6d22520 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f2cc00640 1 -- 172.21.15.40:0/2803518006 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f3001a8f0 con 0x55caf6d22520 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.843+0000 7f3f2cc00640 1 -- 172.21.15.40:0/2803518006 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3f3c00f040 con 0x55caf6d22520 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f50bbb740 10 client.15504 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f50bbb740 10 client.15504 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f50bbb740 20 client.15504 populate_metadata read hostname 'smithi040' 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf6ce0ea0 0x55caf70e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f50bbb740 4 client.15504 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55caf703fe80 con 0x55caf6ce0ea0 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.844+0000 7f3f43400640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf6ce0ea0 0x55caf70e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.845+0000 7f3f43400640 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf6ce0ea0 0x55caf70e4a70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9ecf1c93e68514 server_cookie=67928c9c6e526d39 in_seq=0 out_seq=0 2024-07-26T12:24:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.845+0000 7f3f2cc00640 10 client.15504 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.847+0000 7f3f2cc00640 1 -- 172.21.15.40:0/2803518006 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55caf703fe80 con 0x55caf6ce0ea0 2024-07-26T12:24:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.847+0000 7f3f2cc00640 10 client.15504 handle_command_reply: tid=0 2024-07-26T12:24:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 client.15504 shutdown 2024-07-26T12:24:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 msgr2=0x55caf70d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 0x55caf70d30c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c012870 tx=0x7f3f3c004a40 comp rx=0 tx=0).stop 2024-07-26T12:24:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 shutdown_connections 2024-07-26T12:24:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf6ce0ea0 0x55caf70e4a70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6d22520 0x55caf70d30c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70d2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/2803518006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6cf9660 0x55caf70d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f2cc00640 0 client.15504 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 >> 172.21.15.40:0/2803518006 conn(0x55caf6d16910 msgr2=0x55caf70ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 shutdown_connections 2024-07-26T12:24:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 1 -- 172.21.15.40:0/2803518006 wait complete. 2024-07-26T12:24:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.848+0000 7f3f50bbb740 20 client.15504 trim_cache size 0 max 16384 2024-07-26T12:24:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.869+0000 7f3f50bbb740 1 Processor -- start 2024-07-26T12:24:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.869+0000 7f3f50bbb740 1 -- start start 2024-07-26T12:24:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.869+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 0x55caf70cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.869+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d01840 0x55caf70d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.869+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441b0f30 con 0x55caf6cf9660 2024-07-26T12:24:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441b2a70 con 0x55caf6d22520 2024-07-26T12:24:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441b1600 con 0x55caf6d01840 2024-07-26T12:24:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f43400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 0x55caf70cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f43400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 0x55caf70cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56518/0 (socket says 172.21.15.40:56518) 2024-07-26T12:24:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f43400640 1 -- 172.21.15.40:0/3633534714 learned_addr learned my addr 172.21.15.40:0/3633534714 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f42a00640 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d01840 0x55caf70d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.870+0000 7f3f43e00640 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f43400640 1 -- 172.21.15.40:0/3633534714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d01840 msgr2=0x55caf70d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f43400640 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d01840 0x55caf70d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f43400640 1 -- 172.21.15.40:0/3633534714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 msgr2=0x55caf70cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f43400640 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f43400640 1 -- 172.21.15.40:0/3633534714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caf70c9e20 con 0x55caf6cf9660 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f43400640 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 0x55caf70cde00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3f34005f70 tx=0x7f3f3402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bed09fdbec3c35 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f2f400640 1 -- 172.21.15.40:0/3633534714 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34049040 con 0x55caf6cf9660 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f2f400640 1 -- 172.21.15.40:0/3633534714 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f340cab60 con 0x55caf6cf9660 2024-07-26T12:24:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.871+0000 7f3f2f400640 1 -- 172.21.15.40:0/3633534714 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34101d10 con 0x55caf6cf9660 2024-07-26T12:24:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 -- 172.21.15.40:0/3633534714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 msgr2=0x55caf70cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 0x55caf70cde00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3f34005f70 tx=0x7f3f3402a410 comp rx=0 tx=0).stop 2024-07-26T12:24:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 -- 172.21.15.40:0/3633534714 shutdown_connections 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d22520 0x55caf70cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d01840 0x55caf70d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/3633534714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cf9660 0x55caf70cde00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 -- 172.21.15.40:0/3633534714 >> 172.21.15.40:0/3633534714 conn(0x55caf6d16910 msgr2=0x55caf70d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.872+0000 7f3f50bbb740 1 -- 172.21.15.40:0/3633534714 shutdown_connections 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.873+0000 7f3f50bbb740 1 -- 172.21.15.40:0/3633534714 wait complete. 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.873+0000 7f3f50bbb740 1 -- start start 2024-07-26T12:24:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.873+0000 7f3f50bbb740 1 Processor -- start 2024-07-26T12:24:13.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70daa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d22520 0x55caf70dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 0x55caf70d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441b23a0 con 0x55caf6cb6250 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441b1cd0 con 0x55caf6d01840 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f441aeef0 con 0x55caf6d22520 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f50bbb740 10 client.0 _ll_register_callbacks cb 0x7f3f3c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 0x55caf70d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 0x55caf70d5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56534/0 (socket says 172.21.15.40:56534) 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.874+0000 7f3f43e00640 1 -- 172.21.15.40:0/4254183931 learned_addr learned my addr 172.21.15.40:0/4254183931 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43400640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70daa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f42a00640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d22520 0x55caf70dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43e00640 1 -- 172.21.15.40:0/4254183931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d22520 msgr2=0x55caf70dafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43e00640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d22520 0x55caf70dafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43e00640 1 -- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 msgr2=0x55caf70daa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43e00640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70daa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43e00640 1 -- 172.21.15.40:0/4254183931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caf70d5f50 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f43e00640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 0x55caf70d5a10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c027650 tx=0x7f3f3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3969a04b258fb684 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.875+0000 7f3f2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f2cc00640 1 -- 172.21.15.40:0/4254183931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c01f5c0 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f2cc00640 1 -- 172.21.15.40:0/4254183931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3f3c01f760 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f340cab60 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f2cc00640 1 -- 172.21.15.40:0/4254183931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f3c01f960 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f50bbb740 10 client.15510 fetch_fsmap learned FSMap version 29 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55caf714d980 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.876+0000 7f3f2cc00640 1 -- 172.21.15.40:0/4254183931 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f340cab60 con 0x55caf6cb6250 2024-07-26T12:24:13.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f2cc00640 1 -- 172.21.15.40:0/4254183931 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3f3c03d920 con 0x55caf6cb6250 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f50bbb740 10 client.15510 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f50bbb740 10 client.15510 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f50bbb740 20 client.15510 populate_metadata read hostname 'smithi040' 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf714e120 0x55caf7150540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f50bbb740 4 client.15510 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "93e4d180", "release": true, "await": true}] 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "93e4d180", "release": true, "await": true}) -- 0x55caf703b920 con 0x55caf714e120 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.877+0000 7f3f43400640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf714e120 0x55caf7150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:13.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.878+0000 7f3f43400640 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf714e120 0x55caf7150540 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb9394b8bddf97a server_cookie=ae743b87e8128d73 in_seq=0 out_seq=0 2024-07-26T12:24:13.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.878+0000 7f3f2cc00640 10 client.15510 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:13.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f2cc00640 1 -- 172.21.15.40:0/4254183931 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55caf703b920 con 0x55caf714e120 2024-07-26T12:24:13.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f2cc00640 10 client.15510 handle_command_reply: tid=0 2024-07-26T12:24:13.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 client.15510 shutdown 2024-07-26T12:24:13.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 msgr2=0x55caf70d5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 0x55caf70d5a10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c027650 tx=0x7f3f3c004ab0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 shutdown_connections 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55caf714e120 0x55caf7150540 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55caf6cb6250 0x55caf70d5a10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55caf6d22520 0x55caf70dafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 --2- 172.21.15.40:0/4254183931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55caf6d01840 0x55caf70daa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f2cc00640 0 client.15510 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.886+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 >> 172.21.15.40:0/4254183931 conn(0x55caf6d16910 msgr2=0x55caf70dd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.887+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 shutdown_connections 2024-07-26T12:24:13.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.887+0000 7f3f50bbb740 1 -- 172.21.15.40:0/4254183931 wait complete. 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.887+0000 7f3f50bbb740 20 client.15510 trim_cache size 0 max 16384 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 29, 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 4, 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:24:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "93e4d180": { 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 4, 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.6, 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:24:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:24:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:13.892 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f280b3c50 msgr2=0x7f3f280b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f280b3c50 0x7f3f280b6160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0092f0 tx=0x7f3f3c009280 comp rx=0 tx=0).stop 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 msgr2=0x7f3f4419c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f4419c070 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3f34005940 tx=0x7f3f340042f0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 shutdown_connections 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4410d860 0x7f3f441a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f280b3c50 0x7f3f280b6160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f44104ce0 0x7f3f4419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 --2- 172.21.15.40:0/1719113689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f441042b0 0x7f3f4419c070 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 >> 172.21.15.40:0/1719113689 conn(0x7f3f44079160 msgr2=0x7f3f440ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 shutdown_connections 2024-07-26T12:24:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:13.888+0000 7f3f4a000640 1 -- 172.21.15.40:0/1719113689 wait complete. 2024-07-26T12:24:14.913 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '93e4d180', total seconds elapsed: 33.1 2024-07-26T12:24:14.913 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.55 2024-07-26T12:24:14.914 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:24:15.205 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-07-26T12:24:15.324 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-07-26T12:24:15.416 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-07-26T12:24:15.420 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-07-26T12:24:15.420 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-07-26T12:24:15.424 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:24:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:15 smithi040 ceph-mon[32397]: pgmap v560: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:24:15.501 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-07-26T12:24:15.509 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T12:24:15.509 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-07-26T12:24:15.554 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-07-26T12:24:15.556 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-07-26T12:24:15.557 DEBUG:teuthology.orchestra.run.smithi040:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-07-26T12:24:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:15 smithi146 ceph-mon[35807]: pgmap v560: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:24:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:15 smithi076 ceph-mon[35401]: pgmap v560: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-07-26T12:24:15.719 INFO:tasks.workunit.client.0.smithi040.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-07-26T12:24:15.722 INFO:tasks.workunit.client.0.smithi040.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-07-26T12:24:15.723 INFO:tasks.workunit.client.0.smithi040.stderr:+ trap -- retry EXIT 2024-07-26T12:24:15.723 INFO:tasks.workunit.client.0.smithi040.stderr:+ rm -rf ffsb 2024-07-26T12:24:15.728 INFO:tasks.workunit.client.0.smithi040.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-07-26T12:24:15.749 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into 'ffsb'... 2024-07-26T12:24:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:17 smithi040 ceph-mon[32397]: pgmap v561: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:24:17.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:17 smithi076 ceph-mon[35401]: pgmap v561: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:24:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:17 smithi146 ceph-mon[35807]: pgmap v561: 97 pgs: 97 active+clean; 664 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:24:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 -- 172.21.15.40:0/76469974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 msgr2=0x7f0e3810ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/76469974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3810ed60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009ca0 tx=0x7f0e3002a8b0 comp rx=0 tx=0).stop 2024-07-26T12:24:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 -- 172.21.15.40:0/76469974 shutdown_connections 2024-07-26T12:24:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/76469974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3810ed60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/76469974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e38107be0 0x7f0e38107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/76469974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e381022a0 0x7f0e381026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 -- 172.21.15.40:0/76469974 >> 172.21.15.40:0/76469974 conn(0x7f0e380fdcf0 msgr2=0x7f0e38100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 -- 172.21.15.40:0/76469974 shutdown_connections 2024-07-26T12:24:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.862+0000 7f0e3ce00640 1 -- 172.21.15.40:0/76469974 wait complete. 2024-07-26T12:24:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 Processor -- start 2024-07-26T12:24:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 -- start start 2024-07-26T12:24:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e381022a0 0x7f0e38199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e38107be0 0x7f0e3819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3819f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381131c0 con 0x7f0e38108530 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38113040 con 0x7f0e38107be0 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.864+0000 7f0e3ce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38113340 con 0x7f0e381022a0 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.865+0000 7f0e37400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e381022a0 0x7f0e38199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.865+0000 7f0e37e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3819f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.865+0000 7f0e36a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e38107be0 0x7f0e3819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.865+0000 7f0e37400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e381022a0 0x7f0e38199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:37410/0 (socket says 172.21.15.40:37410) 2024-07-26T12:24:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.865+0000 7f0e37400640 1 -- 172.21.15.40:0/4290791032 learned_addr learned my addr 172.21.15.40:0/4290791032 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e37e00640 1 -- 172.21.15.40:0/4290791032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e381022a0 msgr2=0x7f0e38199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e37e00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e381022a0 0x7f0e38199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e37e00640 1 -- 172.21.15.40:0/4290791032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e38107be0 msgr2=0x7f0e3819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e37e00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e38107be0 0x7f0e3819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e37e00640 1 -- 172.21.15.40:0/4290791032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3819f9e0 con 0x7f0e38108530 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e37e00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3819f370 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009ca0 tx=0x7f0e30003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.866+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30004240 con 0x7f0e38108530 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.867+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e30040070 con 0x7f0e38108530 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.867+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3819fc70 con 0x7f0e38108530 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.867+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30045c50 con 0x7f0e38108530 2024-07-26T12:24:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.867+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e381a01b0 con 0x7f0e38108530 2024-07-26T12:24:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.869+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e381026b0 con 0x7f0e38108530 2024-07-26T12:24:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.871+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0e30045470 con 0x7f0e38108530 2024-07-26T12:24:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.873+0000 7f0e2fe00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0e1c0b3c00 0x7f0e1c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.873+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0e30104e20 con 0x7f0e38108530 2024-07-26T12:24:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.873+0000 7f0e37400640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0e1c0b3c00 0x7f0e1c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.874+0000 7f0e37400640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0e1c0b3c00 0x7f0e1c0b6110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800ac90 tx=0x7f0e2800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:17.879+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0e300cc430 con 0x7f0e38108530 2024-07-26T12:24:18.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.168+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e38109d90 con 0x7f0e38108530 2024-07-26T12:24:18.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.170+0000 7f0e2fe00640 1 -- 172.21.15.40:0/4290791032 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7f0e300cbd30 con 0x7f0e38108530 2024-07-26T12:24:18.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:24:18.172 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"btime":"2024-07-26T12:22:37:338561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:22:36.424751+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:24:18.173 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 29 2024-07-26T12:24:18.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.173+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0e1c0b3c00 msgr2=0x7f0e1c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:18.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.173+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0e1c0b3c00 0x7f0e1c0b6110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800ac90 tx=0x7f0e2800a380 comp rx=0 tx=0).stop 2024-07-26T12:24:18.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.173+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 msgr2=0x7f0e3819f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:18.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.173+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3819f370 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009ca0 tx=0x7f0e30003ba0 comp rx=0 tx=0).stop 2024-07-26T12:24:18.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.173+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 shutdown_connections 2024-07-26T12:24:18.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e38108530 0x7f0e3819f370 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:18.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e38107be0 0x7f0e3819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:18.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0e1c0b3c00 0x7f0e1c0b6110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:18.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 --2- 172.21.15.40:0/4290791032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e381022a0 0x7f0e38199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:18.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 >> 172.21.15.40:0/4290791032 conn(0x7f0e380fdcf0 msgr2=0x7f0e38100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:18.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 shutdown_connections 2024-07-26T12:24:18.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:18.174+0000 7f0e3ce00640 1 -- 172.21.15.40:0/4290791032 wait complete. 2024-07-26T12:24:19.129 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0' 2024-07-26T12:24:19.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 142.55 --await-for 45.0 2024-07-26T12:24:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:19 smithi040 ceph-mon[32397]: pgmap v562: 97 pgs: 97 active+clean; 687 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-07-26T12:24:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:19 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4290791032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:19 smithi146 ceph-mon[35807]: pgmap v562: 97 pgs: 97 active+clean; 687 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-07-26T12:24:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:19 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4290791032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:19 smithi076 ceph-mon[35401]: pgmap v562: 97 pgs: 97 active+clean; 687 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-07-26T12:24:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:19 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4290791032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:19.643 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:24:21.422 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:21 smithi040 ceph-mon[32397]: pgmap v563: 97 pgs: 97 active+clean; 1005 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-07-26T12:24:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:21 smithi146 ceph-mon[35807]: pgmap v563: 97 pgs: 97 active+clean; 1005 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-07-26T12:24:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:21 smithi076 ceph-mon[35401]: pgmap v563: 97 pgs: 97 active+clean; 1005 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-07-26T12:24:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 -- 172.21.15.40:0/1709599521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 msgr2=0x7f68c4116190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 --2- 172.21.15.40:0/1709599521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c4116190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009ca0 tx=0x7f68bc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 -- 172.21.15.40:0/1709599521 shutdown_connections 2024-07-26T12:24:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 --2- 172.21.15.40:0/1709599521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c4116190 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 --2- 172.21.15.40:0/1709599521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4075800 0x7f68c4075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 --2- 172.21.15.40:0/1709599521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c4076db0 0x7f68c40751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 -- 172.21.15.40:0/1709599521 >> 172.21.15.40:0/1709599521 conn(0x7f68c40fee60 msgr2=0x7f68c41012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 -- 172.21.15.40:0/1709599521 shutdown_connections 2024-07-26T12:24:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.070+0000 7f68c9a00640 1 -- 172.21.15.40:0/1709599521 wait complete. 2024-07-26T12:24:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.071+0000 7f68c9a00640 1 Processor -- start 2024-07-26T12:24:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 -- start start 2024-07-26T12:24:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c4075800 0x7f68c41a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4076db0 0x7f68c41a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c41a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4119800 con 0x7f68c4113cc0 2024-07-26T12:24:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4119680 con 0x7f68c4076db0 2024-07-26T12:24:22.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.072+0000 7f68c9a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4119980 con 0x7f68c4075800 2024-07-26T12:24:22.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.073+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c4075800 0x7f68c41a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.073+0000 7f68c9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c41a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.073+0000 7f68c9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c41a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56572/0 (socket says 172.21.15.40:56572) 2024-07-26T12:24:22.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.073+0000 7f68c9000640 1 -- 172.21.15.40:0/3436923503 learned_addr learned my addr 172.21.15.40:0/3436923503 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:22.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.073+0000 7f68c3400640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4076db0 0x7f68c41a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c9000640 1 -- 172.21.15.40:0/3436923503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c4075800 msgr2=0x7f68c41a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c9000640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c4075800 0x7f68c41a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c9000640 1 -- 172.21.15.40:0/3436923503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4076db0 msgr2=0x7f68c41a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c9000640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4076db0 0x7f68c41a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c9000640 1 -- 172.21.15.40:0/3436923503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41a6120 con 0x7f68c4113cc0 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c3400640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4076db0 0x7f68c41a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.074+0000 7f68c9000640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c41a59f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f68bc005cc0 tx=0x7f68bc032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.075+0000 7f68c0c00640 1 -- 172.21.15.40:0/3436923503 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc032e00 con 0x7f68c4113cc0 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.075+0000 7f68c0c00640 1 -- 172.21.15.40:0/3436923503 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68bc0044d0 con 0x7f68c4113cc0 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.075+0000 7f68c0c00640 1 -- 172.21.15.40:0/3436923503 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc030b70 con 0x7f68c4113cc0 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.075+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41a63b0 con 0x7f68c4113cc0 2024-07-26T12:24:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.075+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41acb70 con 0x7f68c4113cc0 2024-07-26T12:24:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.080+0000 7f68d1dea740 1 Processor -- start 2024-07-26T12:24:22.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.081+0000 7f68c0c00640 1 -- 172.21.15.40:0/3436923503 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f68bc04e440 con 0x7f68c4113cc0 2024-07-26T12:24:22.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.081+0000 7f68d1dea740 1 -- start start 2024-07-26T12:24:22.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07100060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a071005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a07100ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68d1dea740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560a07074970 con 0x560a06d30990 2024-07-26T12:24:22.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68d1dea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560a07063e70 con 0x560a06d38b70 2024-07-26T12:24:22.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68d1dea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560a07067eb0 con 0x560a06d59850 2024-07-26T12:24:22.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a071005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a071005a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56574/0 (socket says 172.21.15.40:56574) 2024-07-26T12:24:22.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.082+0000 7f68c3e00640 1 -- 172.21.15.40:0/3084738802 learned_addr learned my addr 172.21.15.40:0/3084738802 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:22.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3400640 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3400640 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a07100ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3e00640 1 -- 172.21.15.40:0/3084738802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 msgr2=0x560a07100060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3e00640 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07100060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3e00640 1 -- 172.21.15.40:0/3084738802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 msgr2=0x560a07100ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3e00640 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a07100ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3e00640 1 -- 172.21.15.40:0/3084738802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a06fec8e0 con 0x560a06d30990 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.083+0000 7f68c3400640 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a07100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68c3e00640 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a071005a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f68b400bcb0 tx=0x7f68b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541a718c57c114fb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68c0c00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f68a80b3c40 0x7f68a80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68c0c00640 1 -- 172.21.15.40:0/3436923503 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f68bc104fe0 con 0x7f68c4113cc0 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68b9600640 1 -- 172.21.15.40:0/3084738802 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4015070 con 0x560a06d30990 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68b9600640 1 -- 172.21.15.40:0/3084738802 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68b401a8f0 con 0x560a06d30990 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68b9600640 1 -- 172.21.15.40:0/3084738802 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4011900 con 0x560a06d30990 2024-07-26T12:24:22.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.084+0000 7f68c3400640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f68a80b3c40 0x7f68a80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 -- 172.21.15.40:0/3084738802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 msgr2=0x560a071005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68c3400640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f68a80b3c40 0x7f68a80b6150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68b00058c0 tx=0x7f68b0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:22.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a071005a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f68b400bcb0 tx=0x7f68b400f730 comp rx=0 tx=0).stop 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 -- 172.21.15.40:0/3084738802 shutdown_connections 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a07100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a071005a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 --2- 172.21.15.40:0/3084738802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 -- 172.21.15.40:0/3084738802 >> 172.21.15.40:0/3084738802 conn(0x560a06d4dc40 msgr2=0x560a070fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 -- 172.21.15.40:0/3084738802 shutdown_connections 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.086+0000 7f68d1dea740 1 -- 172.21.15.40:0/3084738802 wait complete. 2024-07-26T12:24:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.087+0000 7f68d1dea740 1 -- start start 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.087+0000 7f68d1dea740 1 Processor -- start 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a0710c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a07117bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560a06ec77b0 con 0x560a06d30990 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560a07000420 con 0x560a06d59850 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560a0710e840 con 0x560a06d38b70 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68d1dea740 10 client.0 _ll_register_callbacks cb 0x560a06d710a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:24:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56576/0 (socket says 172.21.15.40:56576) 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68c3e00640 1 -- 172.21.15.40:0/1753801766 learned_addr learned my addr 172.21.15.40:0/1753801766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68c3400640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a0710c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.088+0000 7f68c9000640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a07117bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c3e00640 1 -- 172.21.15.40:0/1753801766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 msgr2=0x560a0710c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c3e00640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a0710c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c3e00640 1 -- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 msgr2=0x560a07117bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c3e00640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a07117bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c3e00640 1 -- 172.21.15.40:0/1753801766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a06ff8c50 con 0x560a06d30990 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c9000640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a07117bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68c3e00640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710bb80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1d5a24bb9f164a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.089+0000 7f68ae000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.090+0000 7f68ae000640 1 -- 172.21.15.40:0/1753801766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4015070 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.090+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b401a8f0 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.090+0000 7f68ae000640 1 -- 172.21.15.40:0/1753801766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f68b401aaa0 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.090+0000 7f68ae000640 1 -- 172.21.15.40:0/1753801766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68b401a730 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.090+0000 7f68d1dea740 10 client.15528 fetch_fsmap learned FSMap version 29 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.090+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560a06dd3ba0 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68ae000640 1 -- 172.21.15.40:0/1753801766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68b401a8f0 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68ae000640 1 -- 172.21.15.40:0/1753801766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f68b40048c0 con 0x560a06d30990 2024-07-26T12:24:22.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68d1dea740 10 client.15528 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68d1dea740 10 client.15528 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68d1dea740 20 client.15528 populate_metadata read hostname 'smithi040' 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68d1dea740 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06d181d0 0x560a0711d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68d1dea740 4 client.15528 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.091+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a070768c0 con 0x560a06d181d0 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.092+0000 7f68c3400640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06d181d0 0x560a0711d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.093+0000 7f68c3400640 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06d181d0 0x560a0711d9e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb6397f8a1e2f5 server_cookie=cd6e0c10b1ff517a in_seq=0 out_seq=0 2024-07-26T12:24:22.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.093+0000 7f68ae000640 10 client.15528 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:22.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.099+0000 7f68ae000640 1 -- 172.21.15.40:0/1753801766 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a070768c0 con 0x560a06d181d0 2024-07-26T12:24:22.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.099+0000 7f68ae000640 10 client.15528 handle_command_reply: tid=0 2024-07-26T12:24:22.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.099+0000 7f68d1dea740 1 client.15528 shutdown 2024-07-26T12:24:22.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 msgr2=0x560a0710bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710bb80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b400b9f0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 shutdown_connections 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a07117bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a0710c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06d181d0 0x560a0711d9e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 --2- 172.21.15.40:0/1753801766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710bb80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 >> 172.21.15.40:0/1753801766 conn(0x560a06d4dc40 msgr2=0x560a071031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68ae000640 0 client.15528 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 shutdown_connections 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 1 -- 172.21.15.40:0/1753801766 wait complete. 2024-07-26T12:24:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.100+0000 7f68d1dea740 20 client.15528 trim_cache size 0 max 16384 2024-07-26T12:24:22.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 Processor -- start 2024-07-26T12:24:22.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 -- start start 2024-07-26T12:24:22.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a070fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a070fde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a071017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f68a400e4c0 con 0x560a06d30990 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68a4010000 con 0x560a06d59850 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.124+0000 7f68d1dea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68a400eb90 con 0x560a06d38b70 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a070fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a070fcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56584/0 (socket says 172.21.15.40:56584) 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c3e00640 1 -- 172.21.15.40:0/4146826010 learned_addr learned my addr 172.21.15.40:0/4146826010 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:22.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c3400640 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a070fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c9000640 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a071017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c3e00640 1 -- 172.21.15.40:0/4146826010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 msgr2=0x560a070fde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.125+0000 7f68c3e00640 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a070fde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68c3e00640 1 -- 172.21.15.40:0/4146826010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 msgr2=0x560a071017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68c3e00640 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a071017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68c3e00640 1 -- 172.21.15.40:0/4146826010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a07102350 con 0x560a06d30990 2024-07-26T12:24:22.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68c3e00640 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a070fcf50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f68b4005f30 tx=0x7f68b4005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a5e201fc9e03d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68b8c00640 1 -- 172.21.15.40:0/4146826010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4015070 con 0x560a06d30990 2024-07-26T12:24:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68b8c00640 1 -- 172.21.15.40:0/4146826010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68b400bda0 con 0x560a06d30990 2024-07-26T12:24:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.126+0000 7f68b8c00640 1 -- 172.21.15.40:0/4146826010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b401a8d0 con 0x560a06d30990 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 -- 172.21.15.40:0/4146826010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 msgr2=0x560a070fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a070fcf50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f68b4005f30 tx=0x7f68b4005f60 comp rx=0 tx=0).stop 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 -- 172.21.15.40:0/4146826010 shutdown_connections 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d59850 0x560a071017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d38b70 0x560a070fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 --2- 172.21.15.40:0/4146826010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a070fcf50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 -- 172.21.15.40:0/4146826010 >> 172.21.15.40:0/4146826010 conn(0x560a06d4dc40 msgr2=0x560a07101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 -- 172.21.15.40:0/4146826010 shutdown_connections 2024-07-26T12:24:22.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.128+0000 7f68d1dea740 1 -- 172.21.15.40:0/4146826010 wait complete. 2024-07-26T12:24:22.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.129+0000 7f68d1dea740 1 -- start start 2024-07-26T12:24:22.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.129+0000 7f68d1dea740 1 Processor -- start 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a0710f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07184030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f68a400f930 con 0x560a06d30990 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68a400f260 con 0x560a06d38b70 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68a400c480 con 0x560a06d59850 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68d1dea740 10 client.0 _ll_register_callbacks cb 0x7f68b000cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56598/0 (socket says 172.21.15.40:56598) 2024-07-26T12:24:22.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68c3e00640 1 -- 172.21.15.40:0/752419843 learned_addr learned my addr 172.21.15.40:0/752419843 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:22.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.130+0000 7f68c3400640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a0710f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c3e00640 1 -- 172.21.15.40:0/752419843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 msgr2=0x560a07184030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c9000640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07184030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c3e00640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07184030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c3e00640 1 -- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 msgr2=0x560a0710f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c3e00640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a0710f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c3e00640 1 -- 172.21.15.40:0/752419843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a07184670 con 0x560a06d30990 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c9000640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07184030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68c3e00640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710f2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68b400ba30 tx=0x7f68b40042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958277c1fb0148fb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68ae000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.131+0000 7f68ae000640 1 -- 172.21.15.40:0/752419843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b403d060 con 0x560a06d30990 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.132+0000 7f68ae000640 1 -- 172.21.15.40:0/752419843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f68b4020030 con 0x560a06d30990 2024-07-26T12:24:22.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.132+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b400bda0 con 0x560a06d30990 2024-07-26T12:24:22.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.132+0000 7f68ae000640 1 -- 172.21.15.40:0/752419843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68b4015040 con 0x560a06d30990 2024-07-26T12:24:22.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.132+0000 7f68d1dea740 10 client.15534 fetch_fsmap learned FSMap version 29 2024-07-26T12:24:22.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.132+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560a071858d0 con 0x560a06d30990 2024-07-26T12:24:22.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.132+0000 7f68ae000640 1 -- 172.21.15.40:0/752419843 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68b400bda0 con 0x560a06d30990 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68ae000640 1 -- 172.21.15.40:0/752419843 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f68b4042070 con 0x560a06d30990 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68d1dea740 10 client.15534 fetch_fsmap finished waiting for FSMap version 29 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68d1dea740 10 client.15534 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68d1dea740 20 client.15534 populate_metadata read hostname 'smithi040' 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68d1dea740 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06ced580 0x560a07187fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68d1dea740 4 client.15534 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}] 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.133+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.55, "await_for": 45.0}) -- 0x560a07072360 con 0x560a06ced580 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.134+0000 7f68c3400640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06ced580 0x560a07187fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.135+0000 7f68c3400640 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06ced580 0x560a07187fc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce10774afdd1408a server_cookie=a0fe8203461bd032 in_seq=0 out_seq=0 2024-07-26T12:24:22.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.135+0000 7f68ae000640 10 client.15534 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:22.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.434+0000 7f68ae000640 1 -- 172.21.15.40:0/752419843 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x560a07072360 con 0x560a06ced580 2024-07-26T12:24:22.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.434+0000 7f68ae000640 10 client.15534 handle_command_reply: tid=0 2024-07-26T12:24:22.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.434+0000 7f68d1dea740 1 client.15534 shutdown 2024-07-26T12:24:22.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.435+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 msgr2=0x560a0710f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.435+0000 7f68d1dea740 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710f2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68b400ba30 tx=0x7f68b40042a0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 shutdown_connections 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560a06d59850 0x560a07184030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560a06d38b70 0x560a0710f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560a06ced580 0x560a07187fc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 --2- 172.21.15.40:0/752419843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560a06d30990 0x560a0710f2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68ae000640 0 client.15534 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:22.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 >> 172.21.15.40:0/752419843 conn(0x560a06d4dc40 msgr2=0x560a070fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:22.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 shutdown_connections 2024-07-26T12:24:22.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.436+0000 7f68d1dea740 1 -- 172.21.15.40:0/752419843 wait complete. 2024-07-26T12:24:22.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.437+0000 7f68d1dea740 20 client.15534 trim_cache size 0 max 16384 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 29, 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 6, 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "e67c4b6": { 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 6, 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:24:22.440 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.6, 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:22.441 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.438+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f68a80b3c40 msgr2=0x7f68a80b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.438+0000 7f68c9a00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f68a80b3c40 0x7f68a80b6150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68b00058c0 tx=0x7f68b0005850 comp rx=0 tx=0).stop 2024-07-26T12:24:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.438+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 msgr2=0x7f68c41a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.438+0000 7f68c9a00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c41a59f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f68bc005cc0 tx=0x7f68bc032a10 comp rx=0 tx=0).stop 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 shutdown_connections 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4113cc0 0x7f68c41a59f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4076db0 0x7f68c41a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f68a80b3c40 0x7f68a80b6150 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 --2- 172.21.15.40:0/3436923503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c4075800 0x7f68c41a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 >> 172.21.15.40:0/3436923503 conn(0x7f68c40fee60 msgr2=0x7f68c410fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 shutdown_connections 2024-07-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:22.439+0000 7f68c9a00640 1 -- 172.21.15.40:0/3436923503 wait complete. 2024-07-26T12:24:23.347 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e67c4b6', quiesce took 8.4 seconds. Will release after: 14.15 2024-07-26T12:24:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:23 smithi040 ceph-mon[32397]: pgmap v564: 97 pgs: 97 active+clean; 1.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-07-26T12:24:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:23 smithi146 ceph-mon[35807]: pgmap v564: 97 pgs: 97 active+clean; 1.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-07-26T12:24:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:23 smithi076 ceph-mon[35401]: pgmap v564: 97 pgs: 97 active+clean; 1.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-07-26T12:24:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:25 smithi040 ceph-mon[32397]: pgmap v565: 97 pgs: 97 active+clean; 1.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 79 KiB/s wr, 24 op/s 2024-07-26T12:24:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:25 smithi146 ceph-mon[35807]: pgmap v565: 97 pgs: 97 active+clean; 1.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 79 KiB/s wr, 24 op/s 2024-07-26T12:24:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:25 smithi076 ceph-mon[35401]: pgmap v565: 97 pgs: 97 active+clean; 1.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 79 KiB/s wr, 24 op/s 2024-07-26T12:24:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:27 smithi040 ceph-mon[32397]: pgmap v566: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 210 KiB/s wr, 42 op/s 2024-07-26T12:24:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:27 smithi146 ceph-mon[35807]: pgmap v566: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 210 KiB/s wr, 42 op/s 2024-07-26T12:24:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:27 smithi076 ceph-mon[35401]: pgmap v566: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 210 KiB/s wr, 42 op/s 2024-07-26T12:24:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:28 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:24:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:28 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:24:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:28 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:24:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:29 smithi040 ceph-mon[32397]: pgmap v567: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 212 KiB/s wr, 42 op/s 2024-07-26T12:24:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:29 smithi146 ceph-mon[35807]: pgmap v567: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 212 KiB/s wr, 42 op/s 2024-07-26T12:24:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:29 smithi076 ceph-mon[35401]: pgmap v567: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 212 KiB/s wr, 42 op/s 2024-07-26T12:24:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:31 smithi040 ceph-mon[32397]: pgmap v568: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 211 KiB/s wr, 43 op/s 2024-07-26T12:24:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:31 smithi146 ceph-mon[35807]: pgmap v568: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 211 KiB/s wr, 43 op/s 2024-07-26T12:24:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:31 smithi076 ceph-mon[35401]: pgmap v568: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 211 KiB/s wr, 43 op/s 2024-07-26T12:24:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:33 smithi040 ceph-mon[32397]: pgmap v569: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 183 KiB/s wr, 37 op/s 2024-07-26T12:24:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:33 smithi146 ceph-mon[35807]: pgmap v569: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 183 KiB/s wr, 37 op/s 2024-07-26T12:24:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:33 smithi076 ceph-mon[35401]: pgmap v569: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 183 KiB/s wr, 37 op/s 2024-07-26T12:24:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:35 smithi040 ceph-mon[32397]: pgmap v570: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 177 KiB/s wr, 37 op/s 2024-07-26T12:24:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:35 smithi146 ceph-mon[35807]: pgmap v570: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 177 KiB/s wr, 37 op/s 2024-07-26T12:24:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:35 smithi076 ceph-mon[35401]: pgmap v570: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 177 KiB/s wr, 37 op/s 2024-07-26T12:24:37.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:37 smithi040 ceph-mon[32397]: pgmap v571: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 136 KiB/s wr, 30 op/s 2024-07-26T12:24:37.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:24:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:37 smithi146 ceph-mon[35807]: pgmap v571: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 136 KiB/s wr, 30 op/s 2024-07-26T12:24:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:37 smithi076 ceph-mon[35401]: pgmap v571: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 136 KiB/s wr, 30 op/s 2024-07-26T12:24:37.988 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:24:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:39 smithi040 ceph-mon[32397]: pgmap v572: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-07-26T12:24:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:39 smithi146 ceph-mon[35807]: pgmap v572: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-07-26T12:24:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:39 smithi076 ceph-mon[35401]: pgmap v572: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 -- 172.21.15.40:0/1751803074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08181055d0 msgr2=0x7f08181059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 --2- 172.21.15.40:0/1751803074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08181055d0 0x7f08181059e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0808009ca0 tx=0x7f080802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 -- 172.21.15.40:0/1751803074 shutdown_connections 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 --2- 172.21.15.40:0/1751803074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f081810b860 0x7f0818112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 --2- 172.21.15.40:0/1751803074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 0x7f081810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 --2- 172.21.15.40:0/1751803074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08181055d0 0x7f08181059e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 -- 172.21.15.40:0/1751803074 >> 172.21.15.40:0/1751803074 conn(0x7f0818101040 msgr2=0x7f0818103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:40.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 -- 172.21.15.40:0/1751803074 shutdown_connections 2024-07-26T12:24:40.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.378+0000 7f081dc00640 1 -- 172.21.15.40:0/1751803074 wait complete. 2024-07-26T12:24:40.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.380+0000 7f081dc00640 1 Processor -- start 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.380+0000 7f081dc00640 1 -- start start 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081dc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08181055d0 0x7f081819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 0x7f081819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 0x7f08181a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081dc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0818115430 con 0x7f081810b860 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081dc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f08181152b0 con 0x7f08181055d0 2024-07-26T12:24:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08181155b0 con 0x7f081810af10 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 0x7f08181a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 0x7f08181a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48192/0 (socket says 172.21.15.40:48192) 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f081d200640 1 -- 172.21.15.40:0/1327977488 learned_addr learned my addr 172.21.15.40:0/1327977488 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.381+0000 7f0817e00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08181055d0 0x7f081819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f080f400640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 0x7f081819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f081d200640 1 -- 172.21.15.40:0/1327977488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 msgr2=0x7f081819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f081d200640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 0x7f081819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f081d200640 1 -- 172.21.15.40:0/1327977488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08181055d0 msgr2=0x7f081819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:40.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f081d200640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08181055d0 0x7f081819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f081d200640 1 -- 172.21.15.40:0/1327977488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08181a1e10 con 0x7f081810b860 2024-07-26T12:24:40.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f080f400640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 0x7f081819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:24:40.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f0817e00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08181055d0 0x7f081819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.382+0000 7f081d200640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 0x7f08181a16e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f081000d750 tx=0x7f081000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.383+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810017070 con 0x7f081810b860 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.383+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08100054b0 con 0x7f081810b860 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.383+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08181a2100 con 0x7f081810b860 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.383+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810004b90 con 0x7f081810b860 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.383+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08181a8860 con 0x7f081810b860 2024-07-26T12:24:40.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.384+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08181059e0 con 0x7f081810b860 2024-07-26T12:24:40.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.387+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0810004d30 con 0x7f081810b860 2024-07-26T12:24:40.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.391+0000 7f0815600640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f07fc0b3c50 0x7f07fc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.391+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08100e3ab0 con 0x7f081810b860 2024-07-26T12:24:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.391+0000 7f0817e00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f07fc0b3c50 0x7f07fc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.392+0000 7f0817e00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f07fc0b3c50 0x7f07fc0b6160 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0808000f80 tx=0x7f08080314f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:40.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.394+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f08100ab140 con 0x7f081810b860 2024-07-26T12:24:40.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.635+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f081819cfd0 con 0x7f081810b860 2024-07-26T12:24:40.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.637+0000 7f0815600640 1 -- 172.21.15.40:0/1327977488 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11976 (secure 0 0 0) 0x7f081819cfd0 con 0x7f081810b860 2024-07-26T12:24:40.640 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:24:40.640 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"btime":"2024-07-26T12:24:27:155680+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:24:26.360132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T12:24:40.640 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2024-07-26T12:24:40.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.640+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f07fc0b3c50 msgr2=0x7f07fc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:40.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.640+0000 7f081dc00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f07fc0b3c50 0x7f07fc0b6160 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0808000f80 tx=0x7f08080314f0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.640+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 msgr2=0x7f08181a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:40.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.640+0000 7f081dc00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 0x7f08181a16e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f081000d750 tx=0x7f081000dc10 comp rx=0 tx=0).stop 2024-07-26T12:24:40.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 shutdown_connections 2024-07-26T12:24:40.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f081810b860 0x7f08181a16e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f07fc0b3c50 0x7f07fc0b6160 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081810af10 0x7f081819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 --2- 172.21.15.40:0/1327977488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08181055d0 0x7f081819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:40.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 >> 172.21.15.40:0/1327977488 conn(0x7f0818101040 msgr2=0x7f0818103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:40.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 shutdown_connections 2024-07-26T12:24:40.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:40.641+0000 7f081dc00640 1 -- 172.21.15.40:0/1327977488 wait complete. 2024-07-26T12:24:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:41 smithi040 ceph-mon[32397]: pgmap v573: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-07-26T12:24:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:41 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1327977488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:41 smithi146 ceph-mon[35807]: pgmap v573: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-07-26T12:24:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:41 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1327977488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:41 smithi076 ceph-mon[35401]: pgmap v573: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-07-26T12:24:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:41 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1327977488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:24:41.593 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id e67c4b6 --release --await' 2024-07-26T12:24:41.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id e67c4b6 --release --await 2024-07-26T12:24:42.091 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:24:43.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:43 smithi040 ceph-mon[32397]: pgmap v574: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-07-26T12:24:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:43 smithi146 ceph-mon[35807]: pgmap v574: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-07-26T12:24:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:43 smithi076 ceph-mon[35401]: pgmap v574: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-07-26T12:24:44.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 -- 172.21.15.40:0/381440725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc1055d0 msgr2=0x7f84dc1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 --2- 172.21.15.40:0/381440725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc1055d0 0x7f84dc1059e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009900 tx=0x7f84cc02a410 comp rx=0 tx=0).stop 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 -- 172.21.15.40:0/381440725 shutdown_connections 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 --2- 172.21.15.40:0/381440725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc10b860 0x7f84dc112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 --2- 172.21.15.40:0/381440725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f84dc10af10 0x7f84dc10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 --2- 172.21.15.40:0/381440725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc1055d0 0x7f84dc1059e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.371+0000 7f84e1800640 1 -- 172.21.15.40:0/381440725 >> 172.21.15.40:0/381440725 conn(0x7f84dc101040 msgr2=0x7f84dc103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.372+0000 7f84e1800640 1 -- 172.21.15.40:0/381440725 shutdown_connections 2024-07-26T12:24:44.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.372+0000 7f84e1800640 1 -- 172.21.15.40:0/381440725 wait complete. 2024-07-26T12:24:44.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.373+0000 7f84e1800640 1 Processor -- start 2024-07-26T12:24:44.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.373+0000 7f84e1800640 1 -- start start 2024-07-26T12:24:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc1055d0 0x7f84dc19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e1800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f84dc10af10 0x7f84dc19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 0x7f84dc1a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e1800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1153e0 con 0x7f84dc10b860 2024-07-26T12:24:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e1800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc115260 con 0x7f84dc10af10 2024-07-26T12:24:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e1800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc115560 con 0x7f84dc1055d0 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 0x7f84dc1a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 0x7f84dc1a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60284/0 (socket says 172.21.15.40:60284) 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.374+0000 7f84e0e00640 1 -- 172.21.15.40:0/4224256207 learned_addr learned my addr 172.21.15.40:0/4224256207 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84db400640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f84dc10af10 0x7f84dc19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84dbe00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc1055d0 0x7f84dc19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84e0e00640 1 -- 172.21.15.40:0/4224256207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc1055d0 msgr2=0x7f84dc19be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84e0e00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc1055d0 0x7f84dc19be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84e0e00640 1 -- 172.21.15.40:0/4224256207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f84dc10af10 msgr2=0x7f84dc19c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84e0e00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f84dc10af10 0x7f84dc19c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84e0e00640 1 -- 172.21.15.40:0/4224256207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc1a1de0 con 0x7f84dc10b860 2024-07-26T12:24:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.375+0000 7f84dbe00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc1055d0 0x7f84dc19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:24:44.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.376+0000 7f84e0e00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 0x7f84dc1a16b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f84d400eaa0 tx=0x7f84d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:44.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.376+0000 7f84d8c00640 1 -- 172.21.15.40:0/4224256207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d400cdb0 con 0x7f84dc10b860 2024-07-26T12:24:44.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.376+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc1a20d0 con 0x7f84dc10b860 2024-07-26T12:24:44.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.376+0000 7f84d8c00640 1 -- 172.21.15.40:0/4224256207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84d4005020 con 0x7f84dc10b860 2024-07-26T12:24:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.376+0000 7f84d8c00640 1 -- 172.21.15.40:0/4224256207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40116d0 con 0x7f84dc10b860 2024-07-26T12:24:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.376+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc1a8830 con 0x7f84dc10b860 2024-07-26T12:24:44.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.380+0000 7f84e9a5c740 1 Processor -- start 2024-07-26T12:24:44.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.381+0000 7f84d8c00640 1 -- 172.21.15.40:0/4224256207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f84d4004a40 con 0x7f84dc10b860 2024-07-26T12:24:44.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 -- start start 2024-07-26T12:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda10180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda106c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda10c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5643ed986f30 con 0x5643ed66b520 2024-07-26T12:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5643ed976430 con 0x5643ed64a840 2024-07-26T12:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5643ed97a470 con 0x5643ed642660 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda10180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.382+0000 7f84db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda10180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60290/0 (socket says 172.21.15.40:60290) 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 -- 172.21.15.40:0/1685079367 learned_addr learned my addr 172.21.15.40:0/1685079367 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84dbe00640 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 -- 172.21.15.40:0/1685079367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 msgr2=0x5643eda106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 -- 172.21.15.40:0/1685079367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 msgr2=0x5643eda10c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda10c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 -- 172.21.15.40:0/1685079367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ed6d6b00 con 0x5643ed66b520 2024-07-26T12:24:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.383+0000 7f84db400640 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda10180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f84c800bcd0 tx=0x7f84c80127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca2b7b5ab0db93c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.384+0000 7f84d8c00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84c00b3c50 0x7f84c00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.384+0000 7f84d1600640 1 -- 172.21.15.40:0/1685079367 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80120d0 con 0x5643ed66b520 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.384+0000 7f84d1600640 1 -- 172.21.15.40:0/1685079367 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c8016070 con 0x5643ed66b520 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.384+0000 7f84d1600640 1 -- 172.21.15.40:0/1685079367 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8004a00 con 0x5643ed66b520 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.384+0000 7f84d8c00640 1 -- 172.21.15.40:0/4224256207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f84d40e3d20 con 0x7f84dc10b860 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.384+0000 7f84dbe00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84c00b3c50 0x7f84c00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 -- 172.21.15.40:0/1685079367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 msgr2=0x5643eda10180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda10180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f84c800bcd0 tx=0x7f84c80127c0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 -- 172.21.15.40:0/1685079367 shutdown_connections 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda10c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/1685079367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda10180 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84dbe00640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84c00b3c50 0x7f84c00b6160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f84cc000c00 tx=0x7f84cc0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 -- 172.21.15.40:0/1685079367 >> 172.21.15.40:0/1685079367 conn(0x5643ed65f910 msgr2=0x5643eda0e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 -- 172.21.15.40:0/1685079367 shutdown_connections 2024-07-26T12:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.385+0000 7f84e9a5c740 1 -- 172.21.15.40:0/1685079367 wait complete. 2024-07-26T12:24:44.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.386+0000 7f84e9a5c740 1 -- start start 2024-07-26T12:24:44.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.386+0000 7f84e9a5c740 1 Processor -- start 2024-07-26T12:24:44.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda1b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda1bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda27cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5643ed7d9bb0 con 0x5643ed66b520 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5643ed912910 con 0x5643ed64a840 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5643eda1e960 con 0x5643ed642660 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e9a5c740 10 client.0 _ll_register_callbacks cb 0x5643ed682d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda27cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda27cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60294/0 (socket says 172.21.15.40:60294) 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84e0e00640 1 -- 172.21.15.40:0/961564006 learned_addr learned my addr 172.21.15.40:0/961564006 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84db400640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda1bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.387+0000 7f84dbe00640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda1b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e0e00640 1 -- 172.21.15.40:0/961564006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 msgr2=0x5643eda1b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e0e00640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda1b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e0e00640 1 -- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 msgr2=0x5643eda1bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e0e00640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda1bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e0e00640 1 -- 172.21.15.40:0/961564006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643ed74d960 con 0x5643ed66b520 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e0e00640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda27cb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f84d40aabc0 tx=0x7f84d40aa740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736dfa57a4e6e270 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84c6000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84c6000640 1 -- 172.21.15.40:0/961564006 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d401f040 con 0x5643ed66b520 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84c6000640 1 -- 172.21.15.40:0/961564006 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f84d40c5490 con 0x5643ed66b520 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.388+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c8016070 con 0x5643ed66b520 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84c6000640 1 -- 172.21.15.40:0/961564006 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f84d40ca050 con 0x5643ed66b520 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 10 client.15552 fetch_fsmap learned FSMap version 30 2024-07-26T12:24:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5643eda2a730 con 0x5643ed66b520 2024-07-26T12:24:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84c6000640 1 -- 172.21.15.40:0/961564006 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c8016070 con 0x5643ed66b520 2024-07-26T12:24:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84c6000640 1 -- 172.21.15.40:0/961564006 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f84d400f040 con 0x5643ed66b520 2024-07-26T12:24:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 10 client.15552 fetch_fsmap finished waiting for FSMap version 30 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 10 client.15552 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 20 client.15552 populate_metadata read hostname 'smithi040' 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed629ea0 0x5643eda2dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 4 client.15552 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.389+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643ed988e80 con 0x5643ed629ea0 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.390+0000 7f84dbe00640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed629ea0 0x5643eda2dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.392+0000 7f84dbe00640 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed629ea0 0x5643eda2dc20 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773a4bb7cb9acdbb server_cookie=c3bfd2b3be481baa in_seq=0 out_seq=0 2024-07-26T12:24:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.392+0000 7f84c6000640 10 client.15552 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84c6000640 1 -- 172.21.15.40:0/961564006 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643ed988e80 con 0x5643ed629ea0 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84c6000640 10 client.15552 handle_command_reply: tid=0 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 client.15552 shutdown 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 msgr2=0x5643eda27cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda27cb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f84d40aabc0 tx=0x7f84d40aa740 comp rx=0 tx=0).stop 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 shutdown_connections 2024-07-26T12:24:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed629ea0 0x5643eda2dc20 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed66b520 0x5643eda27cb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed64a840 0x5643eda1bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/961564006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed642660 0x5643eda1b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 >> 172.21.15.40:0/961564006 conn(0x5643ed65f910 msgr2=0x5643eda13310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84c6000640 0 client.15552 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.394+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 shutdown_connections 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.395+0000 7f84e9a5c740 1 -- 172.21.15.40:0/961564006 wait complete. 2024-07-26T12:24:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.395+0000 7f84e9a5c740 20 client.15552 trim_cache size 0 max 16384 2024-07-26T12:24:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.414+0000 7f84e9a5c740 1 Processor -- start 2024-07-26T12:24:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.414+0000 7f84e9a5c740 1 -- start start 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.414+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed642660 0x5643eda13990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 0x5643eda27aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed66b520 0x5643eda27fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1b0d30 con 0x5643ed64a840 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1b28a0 con 0x5643ed642660 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1b1400 con 0x5643ed66b520 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 0x5643eda27aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 0x5643eda27aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60306/0 (socket says 172.21.15.40:60306) 2024-07-26T12:24:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84db400640 1 -- 172.21.15.40:0/66883241 learned_addr learned my addr 172.21.15.40:0/66883241 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84dbe00640 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed642660 0x5643eda13990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.415+0000 7f84e0e00640 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed66b520 0x5643eda27fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84db400640 1 -- 172.21.15.40:0/66883241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed66b520 msgr2=0x5643eda27fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84db400640 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed66b520 0x5643eda27fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84db400640 1 -- 172.21.15.40:0/66883241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed642660 msgr2=0x5643eda13990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84db400640 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed642660 0x5643eda13990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84db400640 1 -- 172.21.15.40:0/66883241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643eda12470 con 0x5643ed64a840 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84db400640 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 0x5643eda27aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84c800bca0 tx=0x7f84c800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db956cf0effb709 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.416+0000 7f84d0c00640 1 -- 172.21.15.40:0/66883241 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80120d0 con 0x5643ed64a840 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.417+0000 7f84d0c00640 1 -- 172.21.15.40:0/66883241 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c8016030 con 0x5643ed64a840 2024-07-26T12:24:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.417+0000 7f84d0c00640 1 -- 172.21.15.40:0/66883241 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8003ce0 con 0x5643ed64a840 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.417+0000 7f84e9a5c740 1 -- 172.21.15.40:0/66883241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 msgr2=0x5643eda27aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.417+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 0x5643eda27aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84c800bca0 tx=0x7f84c800be70 comp rx=0 tx=0).stop 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 -- 172.21.15.40:0/66883241 shutdown_connections 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed66b520 0x5643eda27fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed64a840 0x5643eda27aa0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/66883241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed642660 0x5643eda13990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 -- 172.21.15.40:0/66883241 >> 172.21.15.40:0/66883241 conn(0x5643ed65f910 msgr2=0x5643eda13280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 -- 172.21.15.40:0/66883241 shutdown_connections 2024-07-26T12:24:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.418+0000 7f84e9a5c740 1 -- 172.21.15.40:0/66883241 wait complete. 2024-07-26T12:24:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 -- start start 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 Processor -- start 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 0x5643eda23c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed64a840 0x5643eda24160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed66b520 0x5643eda1ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1b21a0 con 0x5643ed642660 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1b1ad0 con 0x5643ed66b520 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.419+0000 7f84e9a5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1aecf0 con 0x5643ed64a840 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84e9a5c740 10 client.0 _ll_register_callbacks cb 0x7f84d4005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:24:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 0x5643eda23c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 0x5643eda23c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60312/0 (socket says 172.21.15.40:60312) 2024-07-26T12:24:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 -- 172.21.15.40:0/91018676 learned_addr learned my addr 172.21.15.40:0/91018676 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:24:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84e0e00640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed66b520 0x5643eda1ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84db400640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed64a840 0x5643eda24160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 -- 172.21.15.40:0/91018676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed64a840 msgr2=0x5643eda24160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed64a840 0x5643eda24160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 -- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed66b520 msgr2=0x5643eda1ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed66b520 0x5643eda1ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.420+0000 7f84dbe00640 1 -- 172.21.15.40:0/91018676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643eda1f110 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.421+0000 7f84dbe00640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 0x5643eda23c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84cc005940 tx=0x7f84cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e45b4044b45adb0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.421+0000 7f84c6000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.421+0000 7f84c6000640 1 -- 172.21.15.40:0/91018676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc035050 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.421+0000 7f84c6000640 1 -- 172.21.15.40:0/91018676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f84cc005040 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.421+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c8016030 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84c6000640 1 -- 172.21.15.40:0/91018676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f84cc05e050 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 10 client.15558 fetch_fsmap learned FSMap version 30 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5643eda9f2b0 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84c6000640 1 -- 172.21.15.40:0/91018676 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c8016030 con 0x5643ed642660 2024-07-26T12:24:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84c6000640 1 -- 172.21.15.40:0/91018676 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f84cc004c70 con 0x5643ed642660 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 10 client.15558 fetch_fsmap finished waiting for FSMap version 30 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 10 client.15558 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 20 client.15558 populate_metadata read hostname 'smithi040' 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed5ff250 0x5643edaa1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 4 client.15558 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e67c4b6", "release": true, "await": true}] 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.422+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e67c4b6", "release": true, "await": true}) -- 0x5643ed984920 con 0x5643ed5ff250 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.423+0000 7f84db400640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed5ff250 0x5643edaa1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:24:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.424+0000 7f84db400640 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed5ff250 0x5643edaa1a80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9aaf41f26597b3f server_cookie=34f9d703a93fab26 in_seq=0 out_seq=0 2024-07-26T12:24:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.424+0000 7f84c6000640 10 client.15558 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84c6000640 1 -- 172.21.15.40:0/91018676 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5643ed984920 con 0x5643ed5ff250 2024-07-26T12:24:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84c6000640 10 client.15558 handle_command_reply: tid=0 2024-07-26T12:24:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 client.15558 shutdown 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 msgr2=0x5643eda23c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 0x5643eda23c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84cc005940 tx=0x7f84cc009260 comp rx=0 tx=0).stop 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 shutdown_connections 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5643ed66b520 0x5643eda1ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5643ed64a840 0x5643eda24160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.504+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5643ed5ff250 0x5643edaa1a80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.505+0000 7f84e9a5c740 1 --2- 172.21.15.40:0/91018676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5643ed642660 0x5643eda23c20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.505+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 >> 172.21.15.40:0/91018676 conn(0x5643ed65f910 msgr2=0x5643eda13c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:44.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.505+0000 7f84c6000640 0 client.15558 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:24:44.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.505+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 shutdown_connections 2024-07-26T12:24:44.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.505+0000 7f84e9a5c740 1 -- 172.21.15.40:0/91018676 wait complete. 2024-07-26T12:24:44.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.505+0000 7f84e9a5c740 20 client.15558 trim_cache size 0 max 16384 2024-07-26T12:24:44.508 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 30, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 8, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "e67c4b6": { 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 8, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:24:44.509 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.6, 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:24:44.510 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:24:44.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.506+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84c00b3c50 msgr2=0x7f84c00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.506+0000 7f84e1800640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84c00b3c50 0x7f84c00b6160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f84cc000c00 tx=0x7f84cc0058b0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 msgr2=0x7f84dc1a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:24:44.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 0x7f84dc1a16b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f84d400eaa0 tx=0x7f84d400ef60 comp rx=0 tx=0).stop 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 shutdown_connections 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc10b860 0x7f84dc1a16b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f84dc10af10 0x7f84dc19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84c00b3c50 0x7f84c00b6160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 --2- 172.21.15.40:0/4224256207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84dc1055d0 0x7f84dc19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.507+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 >> 172.21.15.40:0/4224256207 conn(0x7f84dc101040 msgr2=0x7f84dc103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.508+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 shutdown_connections 2024-07-26T12:24:44.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:24:44.508+0000 7f84e1800640 1 -- 172.21.15.40:0/4224256207 wait complete. 2024-07-26T12:24:44.870 INFO:tasks.workunit.client.0.smithi040.stderr:Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-07-26T12:24:45.422 INFO:tasks.workunit.client.0.smithi040.stderr:+ trap - EXIT 2024-07-26T12:24:45.422 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd ffsb 2024-07-26T12:24:45.427 INFO:tasks.workunit.client.0.smithi040.stderr:+ ./configure 2024-07-26T12:24:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:45 smithi146 ceph-mon[35807]: pgmap v575: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-07-26T12:24:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:45 smithi076 ceph-mon[35401]: pgmap v575: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-07-26T12:24:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:45 smithi040 ceph-mon[32397]: pgmap v575: 97 pgs: 97 active+clean; 3.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-07-26T12:24:46.454 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-07-26T12:24:46.987 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e67c4b6', total seconds elapsed: 32.1 2024-07-26T12:24:47.497 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether build environment is sane... yes 2024-07-26T12:24:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:47 smithi146 ceph-mon[35807]: pgmap v576: 97 pgs: 97 active+clean; 3.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2024-07-26T12:24:47.573 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-07-26T12:24:47.576 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gawk... gawk 2024-07-26T12:24:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:47 smithi076 ceph-mon[35401]: pgmap v576: 97 pgs: 97 active+clean; 3.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2024-07-26T12:24:47.660 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether make sets $(MAKE)... yes 2024-07-26T12:24:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:47 smithi040 ceph-mon[32397]: pgmap v576: 97 pgs: 97 active+clean; 3.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2024-07-26T12:24:47.854 INFO:tasks.workunit.client.0.smithi040.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-07-26T12:24:47.855 INFO:tasks.workunit.client.0.smithi040.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-07-26T12:24:47.923 INFO:tasks.workunit.client.0.smithi040.stdout:checking for style of include used by make... GNU 2024-07-26T12:24:47.942 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... gcc 2024-07-26T12:24:48.304 INFO:tasks.workunit.client.0.smithi040.stdout:checking for C compiler default output file name... a.out 2024-07-26T12:24:48.321 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether the C compiler works... yes 2024-07-26T12:24:48.346 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are cross compiling... no 2024-07-26T12:24:48.567 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of executables... 2024-07-26T12:24:48.761 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of object files... o 2024-07-26T12:24:48.951 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2024-07-26T12:24:49.135 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... yes 2024-07-26T12:24:49.379 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2024-07-26T12:24:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:49 smithi146 ceph-mon[35807]: pgmap v577: 97 pgs: 97 active+clean; 3.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-07-26T12:24:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:49 smithi076 ceph-mon[35401]: pgmap v577: 97 pgs: 97 active+clean; 3.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-07-26T12:24:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:49 smithi040 ceph-mon[32397]: pgmap v577: 97 pgs: 97 active+clean; 3.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-07-26T12:24:50.083 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... gcc3 2024-07-26T12:24:50.330 INFO:tasks.workunit.client.0.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2024-07-26T12:24:50.563 INFO:tasks.workunit.client.0.smithi040.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-07-26T12:24:50.570 INFO:tasks.workunit.client.0.smithi040.stdout:checking for egrep... /usr/bin/grep -E 2024-07-26T12:24:50.619 INFO:tasks.workunit.client.0.smithi040.stdout:checking for AIX... no 2024-07-26T12:24:50.707 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... (cached) gcc 2024-07-26T12:24:50.771 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-07-26T12:24:50.777 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2024-07-26T12:24:50.782 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-07-26T12:24:50.782 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... (cached) gcc3 2024-07-26T12:24:51.122 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lm... yes 2024-07-26T12:24:51.446 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lpthread... yes 2024-07-26T12:24:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:51 smithi146 ceph-mon[35807]: pgmap v578: 97 pgs: 97 active+clean; 3.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-07-26T12:24:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:51 smithi076 ceph-mon[35401]: pgmap v578: 97 pgs: 97 active+clean; 3.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-07-26T12:24:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:51 smithi040 ceph-mon[32397]: pgmap v578: 97 pgs: 97 active+clean; 3.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-07-26T12:24:52.226 INFO:tasks.workunit.client.0.smithi040.stdout:checking for ANSI C header files... yes 2024-07-26T12:24:52.488 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-07-26T12:24:52.694 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/types.h... yes 2024-07-26T12:24:52.938 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/stat.h... yes 2024-07-26T12:24:53.196 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdlib.h... yes 2024-07-26T12:24:53.451 INFO:tasks.workunit.client.0.smithi040.stdout:checking for string.h... yes 2024-07-26T12:24:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:53 smithi146 ceph-mon[35807]: pgmap v579: 97 pgs: 97 active+clean; 3.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-07-26T12:24:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:53 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:24:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:53 smithi076 ceph-mon[35401]: pgmap v579: 97 pgs: 97 active+clean; 3.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-07-26T12:24:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:53 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:24:53.719 INFO:tasks.workunit.client.0.smithi040.stdout:checking for memory.h... yes 2024-07-26T12:24:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:53 smithi040 ceph-mon[32397]: pgmap v579: 97 pgs: 97 active+clean; 3.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-07-26T12:24:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:53 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:24:53.989 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strings.h... yes 2024-07-26T12:24:54.160 INFO:tasks.workunit.client.0.smithi040.stdout:checking for inttypes.h... yes 2024-07-26T12:24:54.382 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... yes 2024-07-26T12:24:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:24:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:24:54.585 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... yes 2024-07-26T12:24:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:24:54.834 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h usability... yes 2024-07-26T12:24:54.934 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h presence... yes 2024-07-26T12:24:54.938 INFO:tasks.workunit.client.0.smithi040.stdout:checking for pthread.h... yes 2024-07-26T12:24:55.168 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h usability... yes 2024-07-26T12:24:55.288 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h presence... yes 2024-07-26T12:24:55.292 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fcntl.h... yes 2024-07-26T12:24:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:55 smithi146 ceph-mon[35807]: pgmap v580: 97 pgs: 97 active+clean; 3.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 94 KiB/s wr, 38 op/s 2024-07-26T12:24:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:24:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:24:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:24:55.578 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h usability... yes 2024-07-26T12:24:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:55 smithi076 ceph-mon[35401]: pgmap v580: 97 pgs: 97 active+clean; 3.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 94 KiB/s wr, 38 op/s 2024-07-26T12:24:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:24:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:24:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:24:55.684 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h presence... yes 2024-07-26T12:24:55.688 INFO:tasks.workunit.client.0.smithi040.stdout:checking for limits.h... yes 2024-07-26T12:24:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:55 smithi040 ceph-mon[32397]: pgmap v580: 97 pgs: 97 active+clean; 3.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 94 KiB/s wr, 38 op/s 2024-07-26T12:24:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:24:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:24:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:24:55.782 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... (cached) yes 2024-07-26T12:24:56.038 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h usability... yes 2024-07-26T12:24:56.157 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h presence... yes 2024-07-26T12:24:56.163 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/time.h... yes 2024-07-26T12:24:56.253 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... (cached) yes 2024-07-26T12:24:56.571 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h usability... yes 2024-07-26T12:24:56.673 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h presence... yes 2024-07-26T12:24:56.678 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/vfs.h... yes 2024-07-26T12:24:56.937 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h usability... no 2024-07-26T12:24:57.067 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h presence... no 2024-07-26T12:24:57.071 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/limits.h... no 2024-07-26T12:24:57.269 INFO:tasks.workunit.client.0.smithi040.stdout:checking for an ANSI C-conforming const... yes 2024-07-26T12:24:57.446 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-07-26T12:24:57.460 INFO:tasks.workunit.client.0.smithi040.stdout:checking for function prototypes... yes 2024-07-26T12:24:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:57 smithi146 ceph-mon[35807]: pgmap v581: 97 pgs: 97 active+clean; 5.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 231 KiB/s wr, 54 op/s 2024-07-26T12:24:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:57 smithi076 ceph-mon[35401]: pgmap v581: 97 pgs: 97 active+clean; 5.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 231 KiB/s wr, 54 op/s 2024-07-26T12:24:57.709 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether setvbuf arguments are reversed... no 2024-07-26T12:24:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:57 smithi040 ceph-mon[32397]: pgmap v581: 97 pgs: 97 active+clean; 5.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 231 KiB/s wr, 54 op/s 2024-07-26T12:24:58.086 INFO:tasks.workunit.client.0.smithi040.stdout:checking for system... yes 2024-07-26T12:24:58.452 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gettimeofday... yes 2024-07-26T12:24:58.817 INFO:tasks.workunit.client.0.smithi040.stdout:checking for mkdir... yes 2024-07-26T12:24:59.209 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strerror... yes 2024-07-26T12:24:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:24:59 smithi146 ceph-mon[35807]: pgmap v582: 97 pgs: 97 active+clean; 5.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 236 KiB/s wr, 63 op/s 2024-07-26T12:24:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:24:59 smithi076 ceph-mon[35401]: pgmap v582: 97 pgs: 97 active+clean; 5.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 236 KiB/s wr, 63 op/s 2024-07-26T12:24:59.584 INFO:tasks.workunit.client.0.smithi040.stdout:checking for open64... yes 2024-07-26T12:24:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:24:59 smithi040 ceph-mon[32397]: pgmap v582: 97 pgs: 97 active+clean; 5.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 236 KiB/s wr, 63 op/s 2024-07-26T12:24:59.976 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stat64... yes 2024-07-26T12:25:00.362 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fseeko64... yes 2024-07-26T12:25:00.716 INFO:tasks.workunit.client.0.smithi040.stdout:checking for lrand48_r... yes 2024-07-26T12:25:01.080 INFO:tasks.workunit.client.0.smithi040.stdout:checking for srand48_r... yes 2024-07-26T12:25:01.174 INFO:tasks.workunit.client.0.smithi040.stdout:configure: creating ./config.status 2024-07-26T12:25:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:01 smithi146 ceph-mon[35807]: pgmap v583: 97 pgs: 97 active+clean; 6.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 305 KiB/s wr, 70 op/s 2024-07-26T12:25:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:01 smithi076 ceph-mon[35401]: pgmap v583: 97 pgs: 97 active+clean; 6.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 305 KiB/s wr, 70 op/s 2024-07-26T12:25:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:01 smithi040 ceph-mon[32397]: pgmap v583: 97 pgs: 97 active+clean; 6.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 305 KiB/s wr, 70 op/s 2024-07-26T12:25:01.760 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating Makefile 2024-07-26T12:25:01.844 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating config.h 2024-07-26T12:25:01.970 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing depfiles commands 2024-07-26T12:25:02.276 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing default commands 2024-07-26T12:25:02.543 INFO:tasks.workunit.client.0.smithi040.stderr:+ make 2024-07-26T12:25:02.695 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-07-26T12:25:02.741 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-07-26T12:25:02.745 INFO:tasks.workunit.client.0.smithi040.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-07-26T12:25:02.745 INFO:tasks.workunit.client.0.smithi040.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-07-26T12:25:02.745 INFO:tasks.workunit.client.0.smithi040.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-07-26T12:25:02.746 INFO:tasks.workunit.client.0.smithi040.stderr: any GNU archive site. 2024-07-26T12:25:02.769 INFO:tasks.workunit.client.0.smithi040.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-07-26T12:25:02.795 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-07-26T12:25:02.799 INFO:tasks.workunit.client.0.smithi040.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-07-26T12:25:02.799 INFO:tasks.workunit.client.0.smithi040.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-07-26T12:25:02.800 INFO:tasks.workunit.client.0.smithi040.stderr: You might want to install the `Automake' and `Perl' packages. 2024-07-26T12:25:02.800 INFO:tasks.workunit.client.0.smithi040.stderr: Grab them from any GNU archive site. 2024-07-26T12:25:03.569 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:03 smithi040 ceph-mon[32397]: pgmap v584: 97 pgs: 97 active+clean; 6.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 264 KiB/s wr, 67 op/s 2024-07-26T12:25:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:03 smithi146 ceph-mon[35807]: pgmap v584: 97 pgs: 97 active+clean; 6.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 264 KiB/s wr, 67 op/s 2024-07-26T12:25:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:03 smithi076 ceph-mon[35401]: pgmap v584: 97 pgs: 97 active+clean; 6.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 264 KiB/s wr, 67 op/s 2024-07-26T12:25:03.934 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-07-26T12:25:04.591 INFO:tasks.workunit.client.0.smithi040.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-07-26T12:25:04.591 INFO:tasks.workunit.client.0.smithi040.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-07-26T12:25:04.591 INFO:tasks.workunit.client.0.smithi040.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-07-26T12:25:04.591 INFO:tasks.workunit.client.0.smithi040.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-07-26T12:25:04.941 INFO:tasks.workunit.client.0.smithi040.stdout:/bin/sh ./config.status --recheck 2024-07-26T12:25:05.216 INFO:tasks.workunit.client.0.smithi040.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-07-26T12:25:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:05 smithi076 ceph-mon[35401]: pgmap v585: 97 pgs: 97 active+clean; 6.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 337 KiB/s wr, 87 op/s 2024-07-26T12:25:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:05 smithi040 ceph-mon[32397]: pgmap v585: 97 pgs: 97 active+clean; 6.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 337 KiB/s wr, 87 op/s 2024-07-26T12:25:05.819 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-07-26T12:25:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:05 smithi146 ceph-mon[35807]: pgmap v585: 97 pgs: 97 active+clean; 6.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 337 KiB/s wr, 87 op/s 2024-07-26T12:25:06.866 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether build environment is sane... yes 2024-07-26T12:25:06.916 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-07-26T12:25:06.919 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gawk... gawk 2024-07-26T12:25:07.006 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether make sets $(MAKE)... yes 2024-07-26T12:25:07.180 INFO:tasks.workunit.client.0.smithi040.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-07-26T12:25:07.180 INFO:tasks.workunit.client.0.smithi040.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-07-26T12:25:07.255 INFO:tasks.workunit.client.0.smithi040.stdout:checking for style of include used by make... GNU 2024-07-26T12:25:07.283 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... gcc 2024-07-26T12:25:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:07 smithi076 ceph-mon[35401]: pgmap v586: 97 pgs: 97 active+clean; 7.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 325 KiB/s wr, 73 op/s 2024-07-26T12:25:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:07 smithi040 ceph-mon[32397]: pgmap v586: 97 pgs: 97 active+clean; 7.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 325 KiB/s wr, 73 op/s 2024-07-26T12:25:07.745 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether the C compiler works... yes 2024-07-26T12:25:07.747 INFO:tasks.workunit.client.0.smithi040.stdout:checking for C compiler default output file name... a.out 2024-07-26T12:25:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:07 smithi146 ceph-mon[35807]: pgmap v586: 97 pgs: 97 active+clean; 7.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 325 KiB/s wr, 73 op/s 2024-07-26T12:25:08.003 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of executables... 2024-07-26T12:25:08.229 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are cross compiling... no 2024-07-26T12:25:08.427 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of object files... o 2024-07-26T12:25:08.570 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2024-07-26T12:25:08.693 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... yes 2024-07-26T12:25:08.849 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2024-07-26T12:25:09.486 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... gcc3 2024-07-26T12:25:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:09 smithi040 ceph-mon[32397]: pgmap v587: 97 pgs: 97 active+clean; 7.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 209 KiB/s wr, 62 op/s 2024-07-26T12:25:09.746 INFO:tasks.workunit.client.0.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2024-07-26T12:25:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:09 smithi146 ceph-mon[35807]: pgmap v587: 97 pgs: 97 active+clean; 7.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 209 KiB/s wr, 62 op/s 2024-07-26T12:25:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:09 smithi076 ceph-mon[35401]: pgmap v587: 97 pgs: 97 active+clean; 7.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 209 KiB/s wr, 62 op/s 2024-07-26T12:25:10.029 INFO:tasks.workunit.client.0.smithi040.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-07-26T12:25:10.143 INFO:tasks.workunit.client.0.smithi040.stdout:checking for egrep... /usr/bin/grep -E 2024-07-26T12:25:10.689 INFO:tasks.workunit.client.0.smithi040.stdout:checking for ANSI C header files... yes 2024-07-26T12:25:10.876 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/types.h... yes 2024-07-26T12:25:11.073 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/stat.h... yes 2024-07-26T12:25:11.283 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdlib.h... yes 2024-07-26T12:25:11.520 INFO:tasks.workunit.client.0.smithi040.stdout:checking for string.h... yes 2024-07-26T12:25:11.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:11 smithi146 ceph-mon[35807]: pgmap v588: 97 pgs: 97 active+clean; 7.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 232 KiB/s wr, 58 op/s 2024-07-26T12:25:11.725 INFO:tasks.workunit.client.0.smithi040.stdout:checking for memory.h... yes 2024-07-26T12:25:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:11 smithi040 ceph-mon[32397]: pgmap v588: 97 pgs: 97 active+clean; 7.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 232 KiB/s wr, 58 op/s 2024-07-26T12:25:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:11 smithi076 ceph-mon[35401]: pgmap v588: 97 pgs: 97 active+clean; 7.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 232 KiB/s wr, 58 op/s 2024-07-26T12:25:11.937 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strings.h... yes 2024-07-26T12:25:12.154 INFO:tasks.workunit.client.0.smithi040.stdout:checking for inttypes.h... yes 2024-07-26T12:25:12.369 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... yes 2024-07-26T12:25:12.573 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... yes 2024-07-26T12:25:12.811 INFO:tasks.workunit.client.0.smithi040.stdout:checking minix/config.h usability... no 2024-07-26T12:25:12.981 INFO:tasks.workunit.client.0.smithi040.stdout:checking minix/config.h presence... no 2024-07-26T12:25:12.983 INFO:tasks.workunit.client.0.smithi040.stdout:checking for minix/config.h... no 2024-07-26T12:25:13.139 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-07-26T12:25:13.166 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... (cached) gcc 2024-07-26T12:25:13.386 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-07-26T12:25:13.388 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2024-07-26T12:25:13.390 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-07-26T12:25:13.392 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... (cached) gcc3 2024-07-26T12:25:13.636 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lm... yes 2024-07-26T12:25:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:13 smithi040 ceph-mon[32397]: pgmap v589: 97 pgs: 97 active+clean; 7.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 161 KiB/s wr, 52 op/s 2024-07-26T12:25:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:13 smithi146 ceph-mon[35807]: pgmap v589: 97 pgs: 97 active+clean; 7.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 161 KiB/s wr, 52 op/s 2024-07-26T12:25:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:13 smithi076 ceph-mon[35401]: pgmap v589: 97 pgs: 97 active+clean; 7.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 161 KiB/s wr, 52 op/s 2024-07-26T12:25:13.894 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lpthread... yes 2024-07-26T12:25:13.907 INFO:tasks.workunit.client.0.smithi040.stdout:checking for ANSI C header files... (cached) yes 2024-07-26T12:25:14.071 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-07-26T12:25:14.271 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h usability... yes 2024-07-26T12:25:14.366 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h presence... yes 2024-07-26T12:25:14.368 INFO:tasks.workunit.client.0.smithi040.stdout:checking for pthread.h... yes 2024-07-26T12:25:14.591 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h usability... yes 2024-07-26T12:25:14.680 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h presence... yes 2024-07-26T12:25:14.681 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fcntl.h... yes 2024-07-26T12:25:14.922 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h usability... yes 2024-07-26T12:25:15.011 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h presence... yes 2024-07-26T12:25:15.013 INFO:tasks.workunit.client.0.smithi040.stdout:checking for limits.h... yes 2024-07-26T12:25:15.089 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... (cached) yes 2024-07-26T12:25:15.306 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h usability... yes 2024-07-26T12:25:15.386 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h presence... yes 2024-07-26T12:25:15.387 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/time.h... yes 2024-07-26T12:25:15.454 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... (cached) yes 2024-07-26T12:25:15.636 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h usability... yes 2024-07-26T12:25:15.726 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h presence... yes 2024-07-26T12:25:15.727 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/vfs.h... yes 2024-07-26T12:25:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:15 smithi040 ceph-mon[32397]: pgmap v590: 97 pgs: 97 active+clean; 8.3 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 241 KiB/s wr, 67 op/s 2024-07-26T12:25:15.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:15 smithi146 ceph-mon[35807]: pgmap v590: 97 pgs: 97 active+clean; 8.3 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 241 KiB/s wr, 67 op/s 2024-07-26T12:25:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:15 smithi076 ceph-mon[35401]: pgmap v590: 97 pgs: 97 active+clean; 8.3 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 241 KiB/s wr, 67 op/s 2024-07-26T12:25:15.995 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h usability... no 2024-07-26T12:25:16.174 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h presence... no 2024-07-26T12:25:16.177 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/limits.h... no 2024-07-26T12:25:16.315 INFO:tasks.workunit.client.0.smithi040.stdout:checking for an ANSI C-conforming const... yes 2024-07-26T12:25:16.456 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-07-26T12:25:16.776 INFO:tasks.workunit.client.0.smithi040.stdout:checking for system... yes 2024-07-26T12:25:17.133 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gettimeofday... yes 2024-07-26T12:25:17.461 INFO:tasks.workunit.client.0.smithi040.stdout:checking for mkdir... yes 2024-07-26T12:25:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:17 smithi040 ceph-mon[32397]: pgmap v591: 97 pgs: 97 active+clean; 8.3 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 170 KiB/s wr, 51 op/s 2024-07-26T12:25:17.818 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strerror... yes 2024-07-26T12:25:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:17 smithi146 ceph-mon[35807]: pgmap v591: 97 pgs: 97 active+clean; 8.3 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 170 KiB/s wr, 51 op/s 2024-07-26T12:25:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:17 smithi076 ceph-mon[35401]: pgmap v591: 97 pgs: 97 active+clean; 8.3 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 170 KiB/s wr, 51 op/s 2024-07-26T12:25:18.161 INFO:tasks.workunit.client.0.smithi040.stdout:checking for open64... yes 2024-07-26T12:25:18.473 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stat64... yes 2024-07-26T12:25:18.788 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fseeko64... yes 2024-07-26T12:25:19.127 INFO:tasks.workunit.client.0.smithi040.stdout:checking for lrand48_r... yes 2024-07-26T12:25:19.462 INFO:tasks.workunit.client.0.smithi040.stdout:checking for srand48_r... yes 2024-07-26T12:25:19.555 INFO:tasks.workunit.client.0.smithi040.stdout:configure: creating ./config.status 2024-07-26T12:25:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:19 smithi146 ceph-mon[35807]: pgmap v592: 97 pgs: 97 active+clean; 8.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 163 KiB/s wr, 62 op/s 2024-07-26T12:25:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:19 smithi076 ceph-mon[35401]: pgmap v592: 97 pgs: 97 active+clean; 8.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 163 KiB/s wr, 62 op/s 2024-07-26T12:25:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:19 smithi040 ceph-mon[32397]: pgmap v592: 97 pgs: 97 active+clean; 8.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 163 KiB/s wr, 62 op/s 2024-07-26T12:25:19.997 INFO:tasks.workunit.client.0.smithi040.stdout: /bin/sh ./config.status 2024-07-26T12:25:20.310 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating Makefile 2024-07-26T12:25:20.382 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating config.h 2024-07-26T12:25:20.483 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing depfiles commands 2024-07-26T12:25:20.651 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing default commands 2024-07-26T12:25:20.910 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-07-26T12:25:21.420 INFO:tasks.workunit.client.0.smithi040.stdout:rm -f stamp-h1 2024-07-26T12:25:21.436 INFO:tasks.workunit.client.0.smithi040.stdout:touch config.h.in 2024-07-26T12:25:21.446 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh ./config.status config.h 2024-07-26T12:25:21.720 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating config.h 2024-07-26T12:25:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:21 smithi146 ceph-mon[35807]: pgmap v593: 97 pgs: 97 active+clean; 9.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 212 KiB/s wr, 66 op/s 2024-07-26T12:25:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:21 smithi076 ceph-mon[35401]: pgmap v593: 97 pgs: 97 active+clean; 9.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 212 KiB/s wr, 66 op/s 2024-07-26T12:25:21.889 INFO:tasks.workunit.client.0.smithi040.stdout:make all-am 2024-07-26T12:25:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:21 smithi040 ceph-mon[32397]: pgmap v593: 97 pgs: 97 active+clean; 9.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 212 KiB/s wr, 66 op/s 2024-07-26T12:25:22.057 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-07-26T12:25:22.057 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-07-26T12:25:22.542 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-07-26T12:25:22.594 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-07-26T12:25:23.227 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-07-26T12:25:23.282 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-07-26T12:25:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:23 smithi146 ceph-mon[35807]: pgmap v594: 97 pgs: 97 active+clean; 9.0 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 189 KiB/s wr, 65 op/s 2024-07-26T12:25:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:23 smithi076 ceph-mon[35401]: pgmap v594: 97 pgs: 97 active+clean; 9.0 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 189 KiB/s wr, 65 op/s 2024-07-26T12:25:23.962 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-07-26T12:25:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:23 smithi040 ceph-mon[32397]: pgmap v594: 97 pgs: 97 active+clean; 9.0 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 189 KiB/s wr, 65 op/s 2024-07-26T12:25:24.018 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-07-26T12:25:24.653 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-07-26T12:25:24.706 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-07-26T12:25:25.329 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-07-26T12:25:25.381 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-07-26T12:25:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:25 smithi146 ceph-mon[35807]: pgmap v595: 97 pgs: 97 active+clean; 9.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 243 KiB/s wr, 80 op/s 2024-07-26T12:25:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:25 smithi076 ceph-mon[35401]: pgmap v595: 97 pgs: 97 active+clean; 9.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 243 KiB/s wr, 80 op/s 2024-07-26T12:25:25.942 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-07-26T12:25:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:25 smithi040 ceph-mon[32397]: pgmap v595: 97 pgs: 97 active+clean; 9.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 243 KiB/s wr, 80 op/s 2024-07-26T12:25:25.996 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-07-26T12:25:26.381 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-07-26T12:25:26.437 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-07-26T12:25:26.864 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-07-26T12:25:26.916 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-07-26T12:25:27.512 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-07-26T12:25:27.571 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-07-26T12:25:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:27 smithi146 ceph-mon[35807]: pgmap v596: 97 pgs: 97 active+clean; 9.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 174 KiB/s wr, 65 op/s 2024-07-26T12:25:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:27 smithi076 ceph-mon[35401]: pgmap v596: 97 pgs: 97 active+clean; 9.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 174 KiB/s wr, 65 op/s 2024-07-26T12:25:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:27 smithi040 ceph-mon[32397]: pgmap v596: 97 pgs: 97 active+clean; 9.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 174 KiB/s wr, 65 op/s 2024-07-26T12:25:28.196 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-07-26T12:25:28.246 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-07-26T12:25:28.995 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-07-26T12:25:29.049 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-07-26T12:25:29.573 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-07-26T12:25:29.629 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-07-26T12:25:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:29 smithi146 ceph-mon[35807]: pgmap v597: 97 pgs: 97 active+clean; 9.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 178 KiB/s wr, 63 op/s 2024-07-26T12:25:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:29 smithi076 ceph-mon[35401]: pgmap v597: 97 pgs: 97 active+clean; 9.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 178 KiB/s wr, 63 op/s 2024-07-26T12:25:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:29 smithi040 ceph-mon[32397]: pgmap v597: 97 pgs: 97 active+clean; 9.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 178 KiB/s wr, 63 op/s 2024-07-26T12:25:30.165 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-07-26T12:25:30.222 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-07-26T12:25:30.928 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-07-26T12:25:30.985 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-07-26T12:25:31.394 INFO:tasks.workunit.client.0.smithi040.stderr:In file included from parser.h:22, 2024-07-26T12:25:31.394 INFO:tasks.workunit.client.0.smithi040.stderr: from parser.c:25: 2024-07-26T12:25:31.394 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘init_filesys’: 2024-07-26T12:25:31.401 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.401 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.401 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.401 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.401 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.401 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.402 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.402 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.402 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.402 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.402 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-07-26T12:25:31.402 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.403 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.403 INFO:tasks.workunit.client.0.smithi040.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-07-26T12:25:31.403 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.405 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.405 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.406 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.406 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.406 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.409 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.409 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.409 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.410 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.410 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.410 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-07-26T12:25:31.410 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.410 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.411 INFO:tasks.workunit.client.0.smithi040.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-07-26T12:25:31.411 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.411 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.411 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.412 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.412 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.412 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.412 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.412 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.413 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.413 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.413 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.413 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-07-26T12:25:31.413 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.413 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.414 INFO:tasks.workunit.client.0.smithi040.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-07-26T12:25:31.414 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.414 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.414 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.414 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.414 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.415 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.415 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.415 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.415 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.415 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.415 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘init_tg_stats’: 2024-07-26T12:25:31.416 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.417 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: 971 | list_for_each_entry(tmp_list, 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.418 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr: 971 | list_for_each_entry(tmp_list, 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.419 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.420 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: 980 | list_for_each_entry(tmp_list, 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-07-26T12:25:31.421 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr: 980 | list_for_each_entry(tmp_list, 2024-07-26T12:25:31.422 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.503 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘get_optstr’: 2024-07-26T12:25:31.503 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-07-26T12:25:31.503 INFO:tasks.workunit.client.0.smithi040.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-07-26T12:25:31.503 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.503 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:200:14: note: source object declared here 2024-07-26T12:25:31.504 INFO:tasks.workunit.client.0.smithi040.stderr: 200 | char temp[BUFSIZE]; 2024-07-26T12:25:31.504 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~ 2024-07-26T12:25:31.511 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘size64_convert’: 2024-07-26T12:25:31.511 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-07-26T12:25:31.512 INFO:tasks.workunit.client.0.smithi040.stderr: 119 | memcpy(unit, "\0", 3); 2024-07-26T12:25:31.512 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-07-26T12:25:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:31 smithi146 ceph-mon[35807]: pgmap v598: 97 pgs: 97 active+clean; 10 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 186 KiB/s wr, 55 op/s 2024-07-26T12:25:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:31 smithi076 ceph-mon[35401]: pgmap v598: 97 pgs: 97 active+clean; 10 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 186 KiB/s wr, 55 op/s 2024-07-26T12:25:31.968 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-07-26T12:25:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:31 smithi040 ceph-mon[32397]: pgmap v598: 97 pgs: 97 active+clean; 10 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 186 KiB/s wr, 55 op/s 2024-07-26T12:25:32.022 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-07-26T12:25:32.559 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-07-26T12:25:32.611 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-07-26T12:25:33.153 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-07-26T12:25:33.206 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-07-26T12:25:33.479 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-07-26T12:25:33.536 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-07-26T12:25:33.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:33 smithi040 ceph-mon[32397]: pgmap v599: 97 pgs: 97 active+clean; 10 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 127 KiB/s wr, 46 op/s 2024-07-26T12:25:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:33 smithi146 ceph-mon[35807]: pgmap v599: 97 pgs: 97 active+clean; 10 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 127 KiB/s wr, 46 op/s 2024-07-26T12:25:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:33 smithi076 ceph-mon[35401]: pgmap v599: 97 pgs: 97 active+clean; 10 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 127 KiB/s wr, 46 op/s 2024-07-26T12:25:34.194 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-07-26T12:25:34.199 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd .. 2024-07-26T12:25:34.208 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir tmp 2024-07-26T12:25:34.223 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd tmp 2024-07-26T12:25:34.228 INFO:tasks.workunit.client.0.smithi040.stderr:+ for f in $mydir/*.ffsb 2024-07-26T12:25:34.229 INFO:tasks.workunit.client.0.smithi040.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-07-26T12:25:34.236 INFO:tasks.workunit.client.0.smithi040.stdout:FFSB version 6.0-RC2 started 2024-07-26T12:25:34.236 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.244 INFO:tasks.workunit.client.0.smithi040.stdout:benchmark time = 300 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout:ThreadGroup 0 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout:================ 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: num_threads = 32 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: read_random = off 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: read_size = 0 (0B) 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: read_blocksize = 0 (0B) 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: read_skip = off 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: read_skipsize = 0 (0B) 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: write_random = on 2024-07-26T12:25:34.245 INFO:tasks.workunit.client.0.smithi040.stdout: write_size = 5242880 (5MB) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: fsync_file = 0 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: write_blocksize = 4096 (4KB) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: wait time = 0 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: op weights 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: read = 0 (0.00%) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: readall = 0 (0.00%) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: write = 1 (100.00%) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: create = 0 (0.00%) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: append = 0 (0.00%) 2024-07-26T12:25:34.246 INFO:tasks.workunit.client.0.smithi040.stdout: delete = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: metaop = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: createdir = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: stat = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: writeall = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: writeall_fsync = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: open_close = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: write_fsync = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: create_fsync = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: append_fsync = 0 (0.00%) 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout:FileSystem . 2024-07-26T12:25:34.247 INFO:tasks.workunit.client.0.smithi040.stdout:========== 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: num_dirs = 0 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: starting files = 128 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: min file size = 104857600 (100MB) 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: max file size = 104857600 (100MB) 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: directio = off 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: alignedio = on 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: bufferedio = off 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.248 INFO:tasks.workunit.client.0.smithi040.stdout: aging is off 2024-07-26T12:25:34.249 INFO:tasks.workunit.client.0.smithi040.stdout: current utilization = 0.00% 2024-07-26T12:25:34.249 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T12:25:34.249 INFO:tasks.workunit.client.0.smithi040.stdout:checking existing fs: . 2024-07-26T12:25:34.249 INFO:tasks.workunit.client.0.smithi040.stdout:recreating new fileset 2024-07-26T12:25:34.249 INFO:tasks.workunit.client.0.smithi040.stderr:opendir: No such file or directory 2024-07-26T12:25:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:35 smithi146 ceph-mon[35807]: pgmap v600: 97 pgs: 97 active+clean; 10 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 150 KiB/s wr, 51 op/s 2024-07-26T12:25:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:35 smithi076 ceph-mon[35401]: pgmap v600: 97 pgs: 97 active+clean; 10 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 150 KiB/s wr, 51 op/s 2024-07-26T12:25:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:35 smithi040 ceph-mon[32397]: pgmap v600: 97 pgs: 97 active+clean; 10 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 150 KiB/s wr, 51 op/s 2024-07-26T12:25:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:37 smithi146 ceph-mon[35807]: pgmap v601: 97 pgs: 97 active+clean; 11 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-07-26T12:25:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:37 smithi076 ceph-mon[35401]: pgmap v601: 97 pgs: 97 active+clean; 11 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-07-26T12:25:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:37 smithi040 ceph-mon[32397]: pgmap v601: 97 pgs: 97 active+clean; 11 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-07-26T12:25:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:39 smithi146 ceph-mon[35807]: pgmap v602: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 465 KiB/s wr, 35 op/s 2024-07-26T12:25:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:39 smithi076 ceph-mon[35401]: pgmap v602: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 465 KiB/s wr, 35 op/s 2024-07-26T12:25:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:39 smithi040 ceph-mon[32397]: pgmap v602: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 465 KiB/s wr, 35 op/s 2024-07-26T12:25:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:41 smithi146 ceph-mon[35807]: pgmap v603: 97 pgs: 97 active+clean; 19 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 802 KiB/s wr, 34 op/s 2024-07-26T12:25:41.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:41 smithi076 ceph-mon[35401]: pgmap v603: 97 pgs: 97 active+clean; 19 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 802 KiB/s wr, 34 op/s 2024-07-26T12:25:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:41 smithi040 ceph-mon[32397]: pgmap v603: 97 pgs: 97 active+clean; 19 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 802 KiB/s wr, 34 op/s 2024-07-26T12:25:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:43 smithi146 ceph-mon[35807]: pgmap v604: 97 pgs: 97 active+clean; 27 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-07-26T12:25:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:43 smithi076 ceph-mon[35401]: pgmap v604: 97 pgs: 97 active+clean; 27 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-07-26T12:25:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:43 smithi040 ceph-mon[32397]: pgmap v604: 97 pgs: 97 active+clean; 27 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-07-26T12:25:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:45 smithi076 ceph-mon[35401]: pgmap v605: 97 pgs: 97 active+clean; 39 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 30 op/s 2024-07-26T12:25:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:45 smithi040 ceph-mon[32397]: pgmap v605: 97 pgs: 97 active+clean; 39 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 30 op/s 2024-07-26T12:25:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:45 smithi146 ceph-mon[35807]: pgmap v605: 97 pgs: 97 active+clean; 39 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 30 op/s 2024-07-26T12:25:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:47 smithi076 ceph-mon[35401]: pgmap v606: 97 pgs: 97 active+clean; 47 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-07-26T12:25:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:47 smithi040 ceph-mon[32397]: pgmap v606: 97 pgs: 97 active+clean; 47 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-07-26T12:25:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:47 smithi146 ceph-mon[35807]: pgmap v606: 97 pgs: 97 active+clean; 47 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.1 MiB/s wr, 20 op/s 2024-07-26T12:25:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:49 smithi040 ceph-mon[32397]: pgmap v607: 97 pgs: 97 active+clean; 67 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-07-26T12:25:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:49 smithi146 ceph-mon[35807]: pgmap v607: 97 pgs: 97 active+clean; 67 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-07-26T12:25:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:49 smithi076 ceph-mon[35401]: pgmap v607: 97 pgs: 97 active+clean; 67 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-07-26T12:25:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:51 smithi040 ceph-mon[32397]: pgmap v608: 97 pgs: 97 active+clean; 71 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-07-26T12:25:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:51 smithi146 ceph-mon[35807]: pgmap v608: 97 pgs: 97 active+clean; 71 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-07-26T12:25:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:51 smithi076 ceph-mon[35401]: pgmap v608: 97 pgs: 97 active+clean; 71 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-07-26T12:25:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:53 smithi040 ceph-mon[32397]: pgmap v609: 97 pgs: 97 active+clean; 75 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:25:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:53 smithi146 ceph-mon[35807]: pgmap v609: 97 pgs: 97 active+clean; 75 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:25:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:53 smithi076 ceph-mon[35401]: pgmap v609: 97 pgs: 97 active+clean; 75 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:25:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:55 smithi040 ceph-mon[32397]: pgmap v610: 97 pgs: 97 active+clean; 87 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:25:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:25:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:55 smithi146 ceph-mon[35807]: pgmap v610: 97 pgs: 97 active+clean; 87 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:25:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:25:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:55 smithi076 ceph-mon[35401]: pgmap v610: 97 pgs: 97 active+clean; 87 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:25:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:25:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:25:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:25:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:25:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:25:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:25:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:25:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:25:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:25:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:25:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:57 smithi040 ceph-mon[32397]: pgmap v611: 97 pgs: 97 active+clean; 95 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:25:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:57 smithi146 ceph-mon[35807]: pgmap v611: 97 pgs: 97 active+clean; 95 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:25:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:57 smithi076 ceph-mon[35401]: pgmap v611: 97 pgs: 97 active+clean; 95 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:25:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:25:59 smithi040 ceph-mon[32397]: pgmap v612: 97 pgs: 97 active+clean; 107 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:26:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:25:59 smithi146 ceph-mon[35807]: pgmap v612: 97 pgs: 97 active+clean; 107 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:26:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:25:59 smithi076 ceph-mon[35401]: pgmap v612: 97 pgs: 97 active+clean; 107 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:26:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:01 smithi040 ceph-mon[32397]: pgmap v613: 97 pgs: 97 active+clean; 107 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:26:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:01 smithi146 ceph-mon[35807]: pgmap v613: 97 pgs: 97 active+clean; 107 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:26:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:01 smithi076 ceph-mon[35401]: pgmap v613: 97 pgs: 97 active+clean; 107 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:26:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:03 smithi040 ceph-mon[32397]: pgmap v614: 97 pgs: 97 active+clean; 119 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:26:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:03 smithi146 ceph-mon[35807]: pgmap v614: 97 pgs: 97 active+clean; 119 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:26:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:03 smithi076 ceph-mon[35401]: pgmap v614: 97 pgs: 97 active+clean; 119 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:26:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:05 smithi040 ceph-mon[32397]: pgmap v615: 97 pgs: 97 active+clean; 139 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:26:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:05 smithi146 ceph-mon[35807]: pgmap v615: 97 pgs: 97 active+clean; 139 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:26:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:05 smithi076 ceph-mon[35401]: pgmap v615: 97 pgs: 97 active+clean; 139 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:26:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:07 smithi040 ceph-mon[32397]: pgmap v616: 97 pgs: 97 active+clean; 139 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:26:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:07 smithi146 ceph-mon[35807]: pgmap v616: 97 pgs: 97 active+clean; 139 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:26:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:07 smithi076 ceph-mon[35401]: pgmap v616: 97 pgs: 97 active+clean; 139 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:26:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:09 smithi040 ceph-mon[32397]: pgmap v617: 97 pgs: 97 active+clean; 159 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:26:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:09 smithi146 ceph-mon[35807]: pgmap v617: 97 pgs: 97 active+clean; 159 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:26:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:09 smithi076 ceph-mon[35401]: pgmap v617: 97 pgs: 97 active+clean; 159 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:26:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.1 2024-07-26T12:26:10.747 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:26:11.258 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:26:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:11 smithi040 ceph-mon[32397]: pgmap v618: 97 pgs: 97 active+clean; 167 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:26:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:11 smithi146 ceph-mon[35807]: pgmap v618: 97 pgs: 97 active+clean; 167 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:26:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:11 smithi076 ceph-mon[35401]: pgmap v618: 97 pgs: 97 active+clean; 167 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:26:13.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 -- 172.21.15.40:0/4243115191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6581057e0 msgr2=0x7fc658105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:13.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 --2- 172.21.15.40:0/4243115191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6581057e0 0x7fc658105bf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009900 tx=0x7fc64c02a410 comp rx=0 tx=0).stop 2024-07-26T12:26:13.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 -- 172.21.15.40:0/4243115191 shutdown_connections 2024-07-26T12:26:13.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 --2- 172.21.15.40:0/4243115191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc65810ba70 0x7fc6581122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:13.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 --2- 172.21.15.40:0/4243115191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc65810b120 0x7fc65810b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:13.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 --2- 172.21.15.40:0/4243115191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6581057e0 0x7fc658105bf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:13.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.767+0000 7fc65fa00640 1 -- 172.21.15.40:0/4243115191 >> 172.21.15.40:0/4243115191 conn(0x7fc6581011f0 msgr2=0x7fc658103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:13.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.768+0000 7fc65fa00640 1 -- 172.21.15.40:0/4243115191 shutdown_connections 2024-07-26T12:26:13.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.768+0000 7fc65fa00640 1 -- 172.21.15.40:0/4243115191 wait complete. 2024-07-26T12:26:13.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.769+0000 7fc65fa00640 1 Processor -- start 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.769+0000 7fc65fa00640 1 -- start start 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65fa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6581057e0 0x7fc65819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65fa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc65810b120 0x7fc65819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65fa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 0x7fc6581a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65fa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc658115620 con 0x7fc65810ba70 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65fa00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc6581154a0 con 0x7fc65810b120 2024-07-26T12:26:13.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65fa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6581157a0 con 0x7fc6581057e0 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 0x7fc6581a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 0x7fc6581a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37874/0 (socket says 172.21.15.40:37874) 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65da00640 1 -- 172.21.15.40:0/3277645314 learned_addr learned my addr 172.21.15.40:0/3277645314 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc65d000640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6581057e0 0x7fc65819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.770+0000 7fc657e00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc65810b120 0x7fc65819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.771+0000 7fc65da00640 1 -- 172.21.15.40:0/3277645314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6581057e0 msgr2=0x7fc65819c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.771+0000 7fc65da00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6581057e0 0x7fc65819c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.771+0000 7fc65da00640 1 -- 172.21.15.40:0/3277645314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc65810b120 msgr2=0x7fc65819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:13.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.771+0000 7fc65da00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc65810b120 0x7fc65819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:13.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.771+0000 7fc65da00640 1 -- 172.21.15.40:0/3277645314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6581a1fa0 con 0x7fc65810ba70 2024-07-26T12:26:13.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.772+0000 7fc65da00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 0x7fc6581a1870 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc65000eaa0 tx=0x7fc65000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:13.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.772+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65000cdb0 con 0x7fc65810ba70 2024-07-26T12:26:13.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.772+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc650005020 con 0x7fc65810ba70 2024-07-26T12:26:13.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.772+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500116d0 con 0x7fc65810ba70 2024-07-26T12:26:13.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.772+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6581a2290 con 0x7fc65810ba70 2024-07-26T12:26:13.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.773+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6581a89f0 con 0x7fc65810ba70 2024-07-26T12:26:13.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.774+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc658105bf0 con 0x7fc65810ba70 2024-07-26T12:26:13.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.779+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc6500051d0 con 0x7fc65810ba70 2024-07-26T12:26:13.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.781+0000 7fc655600640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc6400b3c50 0x7fc6400b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:13.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.781+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc6500e3cc0 con 0x7fc65810ba70 2024-07-26T12:26:13.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.781+0000 7fc65d000640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc6400b3c50 0x7fc6400b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:13.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.782+0000 7fc65d000640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc6400b3c50 0x7fc6400b6160 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc64c006010 tx=0x7fc64c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:13.787+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc6500ea080 con 0x7fc65810ba70 2024-07-26T12:26:13.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:13 smithi040 ceph-mon[32397]: pgmap v619: 97 pgs: 97 active+clean; 175 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T12:26:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:13 smithi146 ceph-mon[35807]: pgmap v619: 97 pgs: 97 active+clean; 175 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T12:26:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:13 smithi076 ceph-mon[35401]: pgmap v619: 97 pgs: 97 active+clean; 175 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T12:26:14.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.092+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc65819d160 con 0x7fc65810ba70 2024-07-26T12:26:14.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.094+0000 7fc655600640 1 -- 172.21.15.40:0/3277645314 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11982 (secure 0 0 0) 0x7fc650016030 con 0x7fc65810ba70 2024-07-26T12:26:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:26:14.096 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"btime":"2024-07-26T12:24:52:262062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:24:51.352416+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:26:14.096 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 31 2024-07-26T12:26:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.096+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc6400b3c50 msgr2=0x7fc6400b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.096+0000 7fc65fa00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc6400b3c50 0x7fc6400b6160 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc64c006010 tx=0x7fc64c000bc0 comp rx=0 tx=0).stop 2024-07-26T12:26:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.096+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 msgr2=0x7fc6581a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.096+0000 7fc65fa00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 0x7fc6581a1870 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc65000eaa0 tx=0x7fc65000ef60 comp rx=0 tx=0).stop 2024-07-26T12:26:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 shutdown_connections 2024-07-26T12:26:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65810ba70 0x7fc6581a1870 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc65810b120 0x7fc65819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc6400b3c50 0x7fc6400b6160 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 --2- 172.21.15.40:0/3277645314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6581057e0 0x7fc65819c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 >> 172.21.15.40:0/3277645314 conn(0x7fc6581011f0 msgr2=0x7fc6581098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 shutdown_connections 2024-07-26T12:26:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:14.097+0000 7fc65fa00640 1 -- 172.21.15.40:0/3277645314 wait complete. 2024-07-26T12:26:14.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:14 smithi040 ceph-mon[32397]: pgmap v620: 97 pgs: 97 active+clean; 187 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:26:14.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:14 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3277645314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:26:14.980 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 151.1 --await-for 45.0' 2024-07-26T12:26:14.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 151.1 --await-for 45.0 2024-07-26T12:26:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:14 smithi146 ceph-mon[35807]: pgmap v620: 97 pgs: 97 active+clean; 187 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:26:15.324 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:14 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3277645314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:26:15.325 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:14 smithi076 ceph-mon[35401]: pgmap v620: 97 pgs: 97 active+clean; 187 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:26:15.326 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:14 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3277645314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:26:15.522 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:26:17.422 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:17 smithi040 ceph-mon[32397]: pgmap v621: 97 pgs: 97 active+clean; 195 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:26:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:17 smithi146 ceph-mon[35807]: pgmap v621: 97 pgs: 97 active+clean; 195 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:26:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:17 smithi076 ceph-mon[35401]: pgmap v621: 97 pgs: 97 active+clean; 195 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:26:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 -- 172.21.15.40:0/2431450953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724101620 msgr2=0x7f9724101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 --2- 172.21.15.40:0/2431450953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724101620 0x7f9724101a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9710009900 tx=0x7f971002a410 comp rx=0 tx=0).stop 2024-07-26T12:26:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 -- 172.21.15.40:0/2431450953 shutdown_connections 2024-07-26T12:26:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 --2- 172.21.15.40:0/2431450953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9724102110 0x7f9724111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 --2- 172.21.15.40:0/2431450953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724101620 0x7f9724101a30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 --2- 172.21.15.40:0/2431450953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9724103f10 0x7f9724104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 -- 172.21.15.40:0/2431450953 >> 172.21.15.40:0/2431450953 conn(0x7f9724079610 msgr2=0x7f9724079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 -- 172.21.15.40:0/2431450953 shutdown_connections 2024-07-26T12:26:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.036+0000 7f9723200640 1 -- 172.21.15.40:0/2431450953 wait complete. 2024-07-26T12:26:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.037+0000 7f9723200640 1 Processor -- start 2024-07-26T12:26:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 -- start start 2024-07-26T12:26:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9724101620 0x7f972419be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9724102110 0x7f972419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 0x7f97241a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f97241153f0 con 0x7f9724103f10 2024-07-26T12:26:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9724115270 con 0x7f9724101620 2024-07-26T12:26:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.038+0000 7f9723200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9724115570 con 0x7f9724102110 2024-07-26T12:26:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.039+0000 7f9722800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 0x7f97241a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.039+0000 7f9722800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 0x7f97241a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37890/0 (socket says 172.21.15.40:37890) 2024-07-26T12:26:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.039+0000 7f9722800640 1 -- 172.21.15.40:0/3121900783 learned_addr learned my addr 172.21.15.40:0/3121900783 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.039+0000 7f9721400640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9724102110 0x7f972419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.039+0000 7f9721e00640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9724101620 0x7f972419be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f9722800640 1 -- 172.21.15.40:0/3121900783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9724102110 msgr2=0x7f972419c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f9722800640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9724102110 0x7f972419c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f9722800640 1 -- 172.21.15.40:0/3121900783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9724101620 msgr2=0x7f972419be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f9722800640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9724101620 0x7f972419be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f9722800640 1 -- 172.21.15.40:0/3121900783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97241a1df0 con 0x7f9724103f10 2024-07-26T12:26:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f9722800640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 0x7f97241a16c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f971c00eaa0 tx=0x7f971c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.040+0000 7f971aa00640 1 -- 172.21.15.40:0/3121900783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c00cdb0 con 0x7f9724103f10 2024-07-26T12:26:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.041+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97241a20e0 con 0x7f9724103f10 2024-07-26T12:26:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.041+0000 7f971aa00640 1 -- 172.21.15.40:0/3121900783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f971c005020 con 0x7f9724103f10 2024-07-26T12:26:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.041+0000 7f971aa00640 1 -- 172.21.15.40:0/3121900783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0116d0 con 0x7f9724103f10 2024-07-26T12:26:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.041+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97241a8840 con 0x7f9724103f10 2024-07-26T12:26:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.044+0000 7f972fe7c740 1 Processor -- start 2024-07-26T12:26:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.045+0000 7f971aa00640 1 -- 172.21.15.40:0/3121900783 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f971c0051d0 con 0x7f9724103f10 2024-07-26T12:26:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 -- start start 2024-07-26T12:26:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55955027acf0 con 0x55954ff0a840 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559550225b40 con 0x55954fee9b60 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.046+0000 7f972fe7c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559550215040 con 0x55954fee1980 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37900/0 (socket says 172.21.15.40:37900) 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 -- 172.21.15.40:0/2203753148 learned_addr learned my addr 172.21.15.40:0/2203753148 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721e00640 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 -- 172.21.15.40:0/2203753148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 msgr2=0x5595502b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 -- 172.21.15.40:0/2203753148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 msgr2=0x5595502b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.047+0000 7f9721400640 1 -- 172.21.15.40:0/2203753148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55955019caf0 con 0x55954ff0a840 2024-07-26T12:26:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f9721400640 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502b0390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9710005ab0 tx=0x7f9710005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4876d00bc176a6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f971aa00640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f97080b3bc0 0x7f97080b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f971aa00640 1 -- 172.21.15.40:0/3121900783 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f971c0e3d00 con 0x7f9724103f10 2024-07-26T12:26:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f970f400640 1 -- 172.21.15.40:0/2203753148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710035070 con 0x55954ff0a840 2024-07-26T12:26:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f9721e00640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f97080b3bc0 0x7f97080b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f970f400640 1 -- 172.21.15.40:0/2203753148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9710003d80 con 0x55954ff0a840 2024-07-26T12:26:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.048+0000 7f970f400640 1 -- 172.21.15.40:0/2203753148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971003bce0 con 0x55954ff0a840 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.049+0000 7f972fe7c740 1 -- 172.21.15.40:0/2203753148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 msgr2=0x5595502b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.049+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502b0390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9710005ab0 tx=0x7f9710005ed0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.049+0000 7f9721e00640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f97080b3bc0 0x7f97080b60d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5595502af010 tx=0x7f971400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 -- 172.21.15.40:0/2203753148 shutdown_connections 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2203753148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502b0390 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 -- 172.21.15.40:0/2203753148 >> 172.21.15.40:0/2203753148 conn(0x55954fefe990 msgr2=0x5595502ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 -- 172.21.15.40:0/2203753148 shutdown_connections 2024-07-26T12:26:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.050+0000 7f972fe7c740 1 -- 172.21.15.40:0/2203753148 wait complete. 2024-07-26T12:26:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.051+0000 7f972fe7c740 1 -- start start 2024-07-26T12:26:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.051+0000 7f972fe7c740 1 Processor -- start 2024-07-26T12:26:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.051+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.051+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f972fe7c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5595501b1500 con 0x55954ff0a840 2024-07-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f972fe7c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559550219080 con 0x55954fee9b60 2024-07-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f972fe7c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5595500787a0 con 0x55954fee1980 2024-07-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f972fe7c740 10 client.0 _ll_register_callbacks cb 0x55955020dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37902/0 (socket says 172.21.15.40:37902) 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 -- 172.21.15.40:0/3982259820 learned_addr learned my addr 172.21.15.40:0/3982259820 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9721e00640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9721400640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 -- 172.21.15.40:0/3982259820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 msgr2=0x5595502bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 -- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 msgr2=0x5595502bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.052+0000 7f9722800640 1 -- 172.21.15.40:0/3982259820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55954ff84b90 con 0x55954ff0a840 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.053+0000 7f9721e00640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.053+0000 7f9722800640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502c7cb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f971c0a6d40 tx=0x7f971c0aa910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea32ce23b22effe server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.053+0000 7f9703e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.053+0000 7f9703e00640 1 -- 172.21.15.40:0/3982259820 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c01f040 con 0x55954ff0a840 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.053+0000 7f9703e00640 1 -- 172.21.15.40:0/3982259820 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f971c0a9f20 con 0x55954ff0a840 2024-07-26T12:26:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.053+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9710003d80 con 0x55954ff0a840 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f9703e00640 1 -- 172.21.15.40:0/3982259820 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f971c0b3cc0 con 0x55954ff0a840 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 10 client.15576 fetch_fsmap learned FSMap version 31 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5595502ca9b0 con 0x55954ff0a840 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f9703e00640 1 -- 172.21.15.40:0/3982259820 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9710003d80 con 0x55954ff0a840 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f9703e00640 1 -- 172.21.15.40:0/3982259820 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f971c00f040 con 0x55954ff0a840 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 10 client.15576 fetch_fsmap finished waiting for FSMap version 31 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 10 client.15576 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 20 client.15576 populate_metadata read hostname 'smithi040' 2024-07-26T12:26:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fec91c0 0x5595502cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 4 client.15576 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:26:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.054+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559550227a90 con 0x55954fec91c0 2024-07-26T12:26:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.055+0000 7f9721e00640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fec91c0 0x5595502cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.056+0000 7f9721e00640 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fec91c0 0x5595502cdfa0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=978e6b313007b7d0 server_cookie=107d2ece532385c2 in_seq=0 out_seq=0 2024-07-26T12:26:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.056+0000 7f9703e00640 10 client.15576 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.058+0000 7f9703e00640 1 -- 172.21.15.40:0/3982259820 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559550227a90 con 0x55954fec91c0 2024-07-26T12:26:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.058+0000 7f9703e00640 10 client.15576 handle_command_reply: tid=0 2024-07-26T12:26:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.058+0000 7f972fe7c740 1 client.15576 shutdown 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 msgr2=0x5595502c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502c7cb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f971c0a6d40 tx=0x7f971c0aa910 comp rx=0 tx=0).stop 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 shutdown_connections 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fec91c0 0x5595502cdfa0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x5595502c7cb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 --2- 172.21.15.40:0/3982259820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 >> 172.21.15.40:0/3982259820 conn(0x55954fefe990 msgr2=0x5595502b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f9703e00640 0 client.15576 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 shutdown_connections 2024-07-26T12:26:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 1 -- 172.21.15.40:0/3982259820 wait complete. 2024-07-26T12:26:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.059+0000 7f972fe7c740 20 client.15576 trim_cache size 0 max 16384 2024-07-26T12:26:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.083+0000 7f972fe7c740 1 Processor -- start 2024-07-26T12:26:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.083+0000 7f972fe7c740 1 -- start start 2024-07-26T12:26:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee1980 0x5595502bb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 0x5595502b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954ff0a840 0x5595502b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f972fe7c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f97241b0d30 con 0x55954fee9b60 2024-07-26T12:26:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f972fe7c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f97241b2930 con 0x55954fee1980 2024-07-26T12:26:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f972fe7c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97241b1400 con 0x55954ff0a840 2024-07-26T12:26:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f9721400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 0x5595502b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f9721400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 0x5595502b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37914/0 (socket says 172.21.15.40:37914) 2024-07-26T12:26:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.084+0000 7f9721400640 1 -- 172.21.15.40:0/2337791631 learned_addr learned my addr 172.21.15.40:0/2337791631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9722800640 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954ff0a840 0x5595502b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9721e00640 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee1980 0x5595502bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9721400640 1 -- 172.21.15.40:0/2337791631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954ff0a840 msgr2=0x5595502b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9721400640 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954ff0a840 0x5595502b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9721400640 1 -- 172.21.15.40:0/2337791631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee1980 msgr2=0x5595502bb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9721400640 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee1980 0x5595502bb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.085+0000 7f9721400640 1 -- 172.21.15.40:0/2337791631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595502b7620 con 0x55954fee9b60 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.086+0000 7f9721400640 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 0x5595502b54a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f97100057c0 tx=0x7f9710000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7135a3d62c599a3a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.086+0000 7f970ea00640 1 -- 172.21.15.40:0/2337791631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710035070 con 0x55954fee9b60 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.086+0000 7f970ea00640 1 -- 172.21.15.40:0/2337791631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9710003d80 con 0x55954fee9b60 2024-07-26T12:26:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.086+0000 7f970ea00640 1 -- 172.21.15.40:0/2337791631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971003bc60 con 0x55954fee9b60 2024-07-26T12:26:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 -- 172.21.15.40:0/2337791631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 msgr2=0x5595502b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 0x5595502b54a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f97100057c0 tx=0x7f9710000bc0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 -- 172.21.15.40:0/2337791631 shutdown_connections 2024-07-26T12:26:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954ff0a840 0x5595502b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954fee9b60 0x5595502b54a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 --2- 172.21.15.40:0/2337791631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee1980 0x5595502bb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 -- 172.21.15.40:0/2337791631 >> 172.21.15.40:0/2337791631 conn(0x55954fefe990 msgr2=0x5595502bbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 -- 172.21.15.40:0/2337791631 shutdown_connections 2024-07-26T12:26:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.087+0000 7f972fe7c740 1 -- 172.21.15.40:0/2337791631 wait complete. 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.088+0000 7f972fe7c740 1 -- start start 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.088+0000 7f972fe7c740 1 Processor -- start 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x55955033cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f97241b21a0 con 0x55954ff0a840 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f97241b1ad0 con 0x55954fee9b60 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97241aecf0 con 0x55954fee1980 2024-07-26T12:26:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f972fe7c740 10 client.0 _ll_register_callbacks cb 0x7f971c0a6b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:26:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.089+0000 7f9722800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x55955033cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x55955033cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37916/0 (socket says 172.21.15.40:37916) 2024-07-26T12:26:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 -- 172.21.15.40:0/595647495 learned_addr learned my addr 172.21.15.40:0/595647495 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9721400640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9721e00640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 -- 172.21.15.40:0/595647495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 msgr2=0x5595502bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 -- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 msgr2=0x5595502bf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.090+0000 7f9722800640 1 -- 172.21.15.40:0/595647495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55955033d470 con 0x55954ff0a840 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f9722800640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x55955033cf30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f971c009270 tx=0x7f971c0a6840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3461e0093e65d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f9703e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f9703e00640 1 -- 172.21.15.40:0/595647495 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c089060 con 0x55954ff0a840 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f9703e00640 1 -- 172.21.15.40:0/595647495 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f971c0922c0 con 0x55954ff0a840 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9710003d80 con 0x55954ff0a840 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f9703e00640 1 -- 172.21.15.40:0/595647495 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f971c01f040 con 0x55954ff0a840 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f972fe7c740 10 client.15582 fetch_fsmap learned FSMap version 31 2024-07-26T12:26:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.091+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55955033e700 con 0x55954ff0a840 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f9703e00640 1 -- 172.21.15.40:0/595647495 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9710003d80 con 0x55954ff0a840 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f9703e00640 1 -- 172.21.15.40:0/595647495 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f971c08e070 con 0x55954ff0a840 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f972fe7c740 10 client.15582 fetch_fsmap finished waiting for FSMap version 31 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f972fe7c740 10 client.15582 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f972fe7c740 20 client.15582 populate_metadata read hostname 'smithi040' 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f972fe7c740 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fe9e570 0x559550341020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f972fe7c740 4 client.15582 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.1, "await_for": 45.0}] 2024-07-26T12:26:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.092+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.1, "await_for": 45.0}) -- 0x559550223530 con 0x55954fe9e570 2024-07-26T12:26:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.093+0000 7f9721e00640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fe9e570 0x559550341020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.094+0000 7f9721e00640 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fe9e570 0x559550341020 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879d7f304b9eaa86 server_cookie=566fa6891e7f9ddc in_seq=0 out_seq=0 2024-07-26T12:26:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.094+0000 7f9703e00640 10 client.15582 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.350+0000 7f9703e00640 1 -- 172.21.15.40:0/595647495 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559550223530 con 0x55954fe9e570 2024-07-26T12:26:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.350+0000 7f9703e00640 10 client.15582 handle_command_reply: tid=0 2024-07-26T12:26:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.350+0000 7f972fe7c740 1 client.15582 shutdown 2024-07-26T12:26:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.350+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 msgr2=0x55955033cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.350+0000 7f972fe7c740 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x55955033cf30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f971c009270 tx=0x7f971c0a6840 comp rx=0 tx=0).stop 2024-07-26T12:26:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 shutdown_connections 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55954fe9e570 0x559550341020 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55954ff0a840 0x55955033cf30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55954fee9b60 0x5595502bf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 --2- 172.21.15.40:0/595647495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55954fee1980 0x5595502bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 >> 172.21.15.40:0/595647495 conn(0x55954fefe990 msgr2=0x5595502ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f9703e00640 0 client.15582 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.351+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 shutdown_connections 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.352+0000 7f972fe7c740 1 -- 172.21.15.40:0/595647495 wait complete. 2024-07-26T12:26:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.352+0000 7f972fe7c740 20 client.15582 trim_cache size 0 max 16384 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 31, 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 10, 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "1a303451": { 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 10, 2024-07-26T12:26:18.355 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 151.1, 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:26:18.356 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:18.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:18.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:18.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:18.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:18.357 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:26:18.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.353+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f97080b3bc0 msgr2=0x7f97080b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.353+0000 7f9723200640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f97080b3bc0 0x7f97080b60d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5595502af010 tx=0x7f971400b390 comp rx=0 tx=0).stop 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.353+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 msgr2=0x7f97241a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.353+0000 7f9723200640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 0x7f97241a16c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f971c00eaa0 tx=0x7f971c00ef60 comp rx=0 tx=0).stop 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 shutdown_connections 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9724103f10 0x7f97241a16c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f97080b3bc0 0x7f97080b60d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9724102110 0x7f972419c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 --2- 172.21.15.40:0/3121900783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9724101620 0x7f972419be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 >> 172.21.15.40:0/3121900783 conn(0x7f9724079610 msgr2=0x7f97240ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 shutdown_connections 2024-07-26T12:26:18.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:18.354+0000 7f9723200640 1 -- 172.21.15.40:0/3121900783 wait complete. 2024-07-26T12:26:19.266 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1a303451', quiesce took 8.5 seconds. Will release after: 22.6 2024-07-26T12:26:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:19 smithi040 ceph-mon[32397]: pgmap v622: 97 pgs: 97 active+clean; 223 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.0 MiB/s wr, 11 op/s 2024-07-26T12:26:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:19 smithi146 ceph-mon[35807]: pgmap v622: 97 pgs: 97 active+clean; 223 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.0 MiB/s wr, 11 op/s 2024-07-26T12:26:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:19 smithi076 ceph-mon[35401]: pgmap v622: 97 pgs: 97 active+clean; 223 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.0 MiB/s wr, 11 op/s 2024-07-26T12:26:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:21 smithi040 ceph-mon[32397]: pgmap v623: 97 pgs: 97 active+clean; 227 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:26:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:21 smithi146 ceph-mon[35807]: pgmap v623: 97 pgs: 97 active+clean; 227 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:26:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:21 smithi076 ceph-mon[35401]: pgmap v623: 97 pgs: 97 active+clean; 227 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:26:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:23 smithi040 ceph-mon[32397]: pgmap v624: 97 pgs: 97 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:26:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:23 smithi146 ceph-mon[35807]: pgmap v624: 97 pgs: 97 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:26:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:23 smithi076 ceph-mon[35401]: pgmap v624: 97 pgs: 97 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:26:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:25 smithi040 ceph-mon[32397]: pgmap v625: 97 pgs: 97 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:26:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:25 smithi146 ceph-mon[35807]: pgmap v625: 97 pgs: 97 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:26:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:25 smithi076 ceph-mon[35401]: pgmap v625: 97 pgs: 97 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:26:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:27 smithi040 ceph-mon[32397]: pgmap v626: 97 pgs: 97 active+clean; 235 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:26:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:27 smithi146 ceph-mon[35807]: pgmap v626: 97 pgs: 97 active+clean; 235 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:26:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:27 smithi076 ceph-mon[35401]: pgmap v626: 97 pgs: 97 active+clean; 235 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:26:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:29 smithi040 ceph-mon[32397]: pgmap v627: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:26:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:29 smithi146 ceph-mon[35807]: pgmap v627: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:26:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:29 smithi076 ceph-mon[35401]: pgmap v627: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:26:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:31 smithi040 ceph-mon[32397]: pgmap v628: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-07-26T12:26:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:31 smithi146 ceph-mon[35807]: pgmap v628: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-07-26T12:26:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:31 smithi076 ceph-mon[35401]: pgmap v628: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-07-26T12:26:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:33 smithi040 ceph-mon[32397]: pgmap v629: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 879 KiB/s wr, 9 op/s 2024-07-26T12:26:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:33 smithi146 ceph-mon[35807]: pgmap v629: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 879 KiB/s wr, 9 op/s 2024-07-26T12:26:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:33 smithi076 ceph-mon[35401]: pgmap v629: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 879 KiB/s wr, 9 op/s 2024-07-26T12:26:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:35 smithi040 ceph-mon[32397]: pgmap v630: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 537 KiB/s wr, 11 op/s 2024-07-26T12:26:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:35 smithi146 ceph-mon[35807]: pgmap v630: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 537 KiB/s wr, 11 op/s 2024-07-26T12:26:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:35 smithi076 ceph-mon[35401]: pgmap v630: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 537 KiB/s wr, 11 op/s 2024-07-26T12:26:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:37 smithi040 ceph-mon[32397]: pgmap v631: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 536 KiB/s wr, 10 op/s 2024-07-26T12:26:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:37 smithi146 ceph-mon[35807]: pgmap v631: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 536 KiB/s wr, 10 op/s 2024-07-26T12:26:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:37 smithi076 ceph-mon[35401]: pgmap v631: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 536 KiB/s wr, 10 op/s 2024-07-26T12:26:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:39 smithi040 ceph-mon[32397]: pgmap v632: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 195 KiB/s wr, 9 op/s 2024-07-26T12:26:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:39 smithi146 ceph-mon[35807]: pgmap v632: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 195 KiB/s wr, 9 op/s 2024-07-26T12:26:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:39 smithi076 ceph-mon[35401]: pgmap v632: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 195 KiB/s wr, 9 op/s 2024-07-26T12:26:41.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:41 smithi040 ceph-mon[32397]: pgmap v633: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T12:26:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:41 smithi146 ceph-mon[35807]: pgmap v633: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T12:26:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:41 smithi076 ceph-mon[35401]: pgmap v633: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T12:26:41.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:26:42.367 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:26:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:43 smithi040 ceph-mon[32397]: pgmap v634: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:26:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:43 smithi146 ceph-mon[35807]: pgmap v634: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:26:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:43 smithi076 ceph-mon[35401]: pgmap v634: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:26:44.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.683+0000 7fb244600640 1 -- 172.21.15.40:0/2050165850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c108720 msgr2=0x7fb23c10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:44.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.683+0000 7fb244600640 1 --2- 172.21.15.40:0/2050165850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c108720 0x7fb23c10ef50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb234009ca0 tx=0x7fb23402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 -- 172.21.15.40:0/2050165850 shutdown_connections 2024-07-26T12:26:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 --2- 172.21.15.40:0/2050165850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c108720 0x7fb23c10ef50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 --2- 172.21.15.40:0/2050165850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23c107dd0 0x7fb23c1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 --2- 172.21.15.40:0/2050165850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb23c102490 0x7fb23c1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 -- 172.21.15.40:0/2050165850 >> 172.21.15.40:0/2050165850 conn(0x7fb23c079160 msgr2=0x7fb23c079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 -- 172.21.15.40:0/2050165850 shutdown_connections 2024-07-26T12:26:44.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.684+0000 7fb244600640 1 -- 172.21.15.40:0/2050165850 wait complete. 2024-07-26T12:26:44.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.685+0000 7fb244600640 1 Processor -- start 2024-07-26T12:26:44.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.685+0000 7fb244600640 1 -- start start 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb244600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 0x7fb23c0ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb244600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb23c107dd0 0x7fb23c0ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb244600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23c108720 0x7fb23c0ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb244600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c112280 con 0x7fb23c102490 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb244600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c112100 con 0x7fb23c107dd0 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb244600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c112400 con 0x7fb23c108720 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb241c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 0x7fb23c0ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb241c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 0x7fb23c0ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35612/0 (socket says 172.21.15.40:35612) 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb241c00640 1 -- 172.21.15.40:0/2381284989 learned_addr learned my addr 172.21.15.40:0/2381284989 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.686+0000 7fb241200640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb23c107dd0 0x7fb23c0ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:44.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb242600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23c108720 0x7fb23c0ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb241c00640 1 -- 172.21.15.40:0/2381284989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23c108720 msgr2=0x7fb23c0ffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb241c00640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23c108720 0x7fb23c0ffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb241c00640 1 -- 172.21.15.40:0/2381284989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb23c107dd0 msgr2=0x7fb23c0ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb241c00640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb23c107dd0 0x7fb23c0ff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb241c00640 1 -- 172.21.15.40:0/2381284989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c1a8080 con 0x7fb23c102490 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.687+0000 7fb241c00640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 0x7fb23c0ff0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb23000d950 tx=0x7fb23000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.688+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230017070 con 0x7fb23c102490 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.688+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb230009c30 con 0x7fb23c102490 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.688+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c1a8370 con 0x7fb23c102490 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.688+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23000f620 con 0x7fb23c102490 2024-07-26T12:26:44.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.688+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c1a8900 con 0x7fb23c102490 2024-07-26T12:26:44.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.689+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c1028a0 con 0x7fb23c102490 2024-07-26T12:26:44.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.692+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb230010460 con 0x7fb23c102490 2024-07-26T12:26:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.693+0000 7fb23a000640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2240b3c50 0x7fb2240b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.693+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb2300e37f0 con 0x7fb23c102490 2024-07-26T12:26:44.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.694+0000 7fb241200640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2240b3c50 0x7fb2240b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:44.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.694+0000 7fb241200640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2240b3c50 0x7fb2240b6160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb23c069e80 tx=0x7fb22800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:44.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.699+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb2300aae80 con 0x7fb23c102490 2024-07-26T12:26:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.944+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb23c1003a0 con 0x7fb23c102490 2024-07-26T12:26:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.946+0000 7fb23a000640 1 -- 172.21.15.40:0/2381284989 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11982 (secure 0 0 0) 0x7fb2300bfe20 con 0x7fb23c102490 2024-07-26T12:26:44.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:26:44.947 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"btime":"2024-07-26T12:24:52:262062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:24:51.352416+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:26:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 31 2024-07-26T12:26:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2240b3c50 msgr2=0x7fb2240b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2240b3c50 0x7fb2240b6160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb23c069e80 tx=0x7fb22800b390 comp rx=0 tx=0).stop 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 msgr2=0x7fb23c0ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 0x7fb23c0ff0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb23000d950 tx=0x7fb23000de10 comp rx=0 tx=0).stop 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 shutdown_connections 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2240b3c50 0x7fb2240b6160 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23c108720 0x7fb23c0ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb23c107dd0 0x7fb23c0ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 --2- 172.21.15.40:0/2381284989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c102490 0x7fb23c0ff0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.949+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 >> 172.21.15.40:0/2381284989 conn(0x7fb23c079160 msgr2=0x7fb23c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.950+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 shutdown_connections 2024-07-26T12:26:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:44.950+0000 7fb244600640 1 -- 172.21.15.40:0/2381284989 wait complete. 2024-07-26T12:26:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:45 smithi146 ceph-mon[35807]: pgmap v635: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:26:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:45 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2381284989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:26:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:45 smithi076 ceph-mon[35401]: pgmap v635: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:26:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:45 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2381284989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:26:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:45 smithi040 ceph-mon[32397]: pgmap v635: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:26:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:45 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2381284989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:26:45.845 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 1a303451 --release --await' 2024-07-26T12:26:45.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 1a303451 --release --await 2024-07-26T12:26:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:26:47.551 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:47 smithi040 ceph-mon[32397]: pgmap v636: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:26:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:47 smithi146 ceph-mon[35807]: pgmap v636: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:26:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:47 smithi076 ceph-mon[35401]: pgmap v636: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:26:48.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.722+0000 7fdf29200640 1 -- 172.21.15.40:0/3936978016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf241099f0 msgr2=0x7fdf24109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.722+0000 7fdf29200640 1 --2- 172.21.15.40:0/3936978016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf241099f0 0x7fdf24109e00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009900 tx=0x7fdf1402a410 comp rx=0 tx=0).stop 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 -- 172.21.15.40:0/3936978016 shutdown_connections 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 --2- 172.21.15.40:0/3936978016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2410fc80 0x7fdf241164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 --2- 172.21.15.40:0/3936978016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2410f330 0x7fdf2410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 --2- 172.21.15.40:0/3936978016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf241099f0 0x7fdf24109e00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 -- 172.21.15.40:0/3936978016 >> 172.21.15.40:0/3936978016 conn(0x7fdf24078ff0 msgr2=0x7fdf24107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 -- 172.21.15.40:0/3936978016 shutdown_connections 2024-07-26T12:26:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.723+0000 7fdf29200640 1 -- 172.21.15.40:0/3936978016 wait complete. 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.724+0000 7fdf29200640 1 Processor -- start 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.724+0000 7fdf29200640 1 -- start start 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.725+0000 7fdf29200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf241099f0 0x7fdf241a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.725+0000 7fdf29200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2410f330 0x7fdf241a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.725+0000 7fdf29200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 0x7fdf241a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.725+0000 7fdf29200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf24119840 con 0x7fdf2410fc80 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.725+0000 7fdf29200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241196c0 con 0x7fdf2410f330 2024-07-26T12:26:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.725+0000 7fdf29200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241199c0 con 0x7fdf241099f0 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 0x7fdf241a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 0x7fdf241a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35626/0 (socket says 172.21.15.40:35626) 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 -- 172.21.15.40:0/2645745796 learned_addr learned my addr 172.21.15.40:0/2645745796 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23400640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf241099f0 0x7fdf241a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2410f330 0x7fdf241a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 -- 172.21.15.40:0/2645745796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf241099f0 msgr2=0x7fdf241a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf241099f0 0x7fdf241a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 -- 172.21.15.40:0/2645745796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2410f330 msgr2=0x7fdf241a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2410f330 0x7fdf241a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.726+0000 7fdf23e00640 1 -- 172.21.15.40:0/2645745796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf241a61c0 con 0x7fdf2410fc80 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.727+0000 7fdf23e00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 0x7fdf241a5a90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00eb10 tx=0x7fdf1c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.727+0000 7fdf20c00640 1 -- 172.21.15.40:0/2645745796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c004b20 con 0x7fdf2410fc80 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.727+0000 7fdf20c00640 1 -- 172.21.15.40:0/2645745796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf1c004cc0 con 0x7fdf2410fc80 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.727+0000 7fdf20c00640 1 -- 172.21.15.40:0/2645745796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c010690 con 0x7fdf2410fc80 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.727+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf241a64b0 con 0x7fdf2410fc80 2024-07-26T12:26:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.727+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf241acc10 con 0x7fdf2410fc80 2024-07-26T12:26:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.731+0000 7fdf31491740 1 Processor -- start 2024-07-26T12:26:48.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.732+0000 7fdf20c00640 1 -- 172.21.15.40:0/2645745796 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdf1c005020 con 0x7fdf2410fc80 2024-07-26T12:26:48.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.732+0000 7fdf31491740 1 -- start start 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf31491740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77d0a520 0x559b780af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf31491740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf31491740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf31491740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559b78025f50 con 0x559b77ce1660 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf31491740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559b78015450 con 0x559b77d0a520 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf31491740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559b78019490 con 0x559b77ce9840 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf23400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf23400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35630/0 (socket says 172.21.15.40:35630) 2024-07-26T12:26:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.733+0000 7fdf23400640 1 -- 172.21.15.40:0/3714120614 learned_addr learned my addr 172.21.15.40:0/3714120614 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77d0a520 0x559b780af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf23400640 1 -- 172.21.15.40:0/3714120614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 msgr2=0x559b780afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf23400640 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf23400640 1 -- 172.21.15.40:0/3714120614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77d0a520 msgr2=0x559b780af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf23400640 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77d0a520 0x559b780af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf23400640 1 -- 172.21.15.40:0/3714120614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b77d75b00 con 0x559b77ce1660 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf20c00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf080b3c50 0x7fdf080b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.734+0000 7fdf23400640 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780af6e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009900 tx=0x7fdf14004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67d07235ace5534 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.735+0000 7fdf20c00640 1 -- 172.21.15.40:0/2645745796 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf1c0e4160 con 0x7fdf2410fc80 2024-07-26T12:26:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.735+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf080b3c50 0x7fdf080b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.735+0000 7fdf18c00640 1 -- 172.21.15.40:0/3714120614 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14040070 con 0x559b77ce1660 2024-07-26T12:26:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.735+0000 7fdf18c00640 1 -- 172.21.15.40:0/3714120614 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf140054b0 con 0x559b77ce1660 2024-07-26T12:26:48.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.735+0000 7fdf18c00640 1 -- 172.21.15.40:0/3714120614 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14035040 con 0x559b77ce1660 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 -- 172.21.15.40:0/3714120614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 msgr2=0x559b780af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf080b3c50 0x7fdf080b6160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf2410fb50 tx=0x7fdf0c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780af6e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009900 tx=0x7fdf14004040 comp rx=0 tx=0).stop 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 -- 172.21.15.40:0/3714120614 shutdown_connections 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780af6e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 --2- 172.21.15.40:0/3714120614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77d0a520 0x559b780af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 -- 172.21.15.40:0/3714120614 >> 172.21.15.40:0/3714120614 conn(0x559b77cfe910 msgr2=0x559b780ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.736+0000 7fdf31491740 1 -- 172.21.15.40:0/3714120614 shutdown_connections 2024-07-26T12:26:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.737+0000 7fdf31491740 1 -- 172.21.15.40:0/3714120614 wait complete. 2024-07-26T12:26:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.737+0000 7fdf31491740 1 -- start start 2024-07-26T12:26:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.737+0000 7fdf31491740 1 Processor -- start 2024-07-26T12:26:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780bad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559b77e78bb0 con 0x559b77d0a520 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559b77fb1930 con 0x559b77ce1660 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559b780bd920 con 0x559b77ce9840 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.738+0000 7fdf31491740 10 client.0 _ll_register_callbacks cb 0x559b77d21d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35646/0 (socket says 172.21.15.40:35646) 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 -- 172.21.15.40:0/4082422463 learned_addr learned my addr 172.21.15.40:0/4082422463 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23400640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 -- 172.21.15.40:0/4082422463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 msgr2=0x559b780bad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780bad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 -- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 msgr2=0x559b780ba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780ba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.739+0000 7fdf23e00640 1 -- 172.21.15.40:0/4082422463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b77dec960 con 0x559b77d0a520 2024-07-26T12:26:48.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf23e00640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780c6c40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005ba0 tx=0x7fdf1c0aa8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c62d54c07bffeb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:48.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf11600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf11600640 1 -- 172.21.15.40:0/4082422463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0c4070 con 0x559b77d0a520 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf140054b0 con 0x559b77d0a520 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf11600640 1 -- 172.21.15.40:0/4082422463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf1c0ab4e0 con 0x559b77d0a520 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf11600640 1 -- 172.21.15.40:0/4082422463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdf1c0ab070 con 0x559b77d0a520 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf31491740 10 client.15600 fetch_fsmap learned FSMap version 31 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.740+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559b780c9620 con 0x559b77d0a520 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf11600640 1 -- 172.21.15.40:0/4082422463 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf140054b0 con 0x559b77d0a520 2024-07-26T12:26:48.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf11600640 1 -- 172.21.15.40:0/4082422463 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fdf1c0c5bb0 con 0x559b77d0a520 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf31491740 10 client.15600 fetch_fsmap finished waiting for FSMap version 31 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf31491740 10 client.15600 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf31491740 20 client.15600 populate_metadata read hostname 'smithi040' 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf31491740 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77cc8ea0 0x559b780ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf31491740 4 client.15600 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.741+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b78027ea0 con 0x559b77cc8ea0 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.742+0000 7fdf23400640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77cc8ea0 0x559b780ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.743+0000 7fdf23400640 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77cc8ea0 0x559b780ccaf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402ba1ee607ae137 server_cookie=b736550ec33e0c75 in_seq=0 out_seq=0 2024-07-26T12:26:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.743+0000 7fdf11600640 10 client.15600 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:48.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf11600640 1 -- 172.21.15.40:0/4082422463 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b78027ea0 con 0x559b77cc8ea0 2024-07-26T12:26:48.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf11600640 10 client.15600 handle_command_reply: tid=0 2024-07-26T12:26:48.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 client.15600 shutdown 2024-07-26T12:26:48.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 msgr2=0x559b780c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780c6c40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005ba0 tx=0x7fdf1c0aa8a0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 shutdown_connections 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77cc8ea0 0x559b780ccaf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780c6c40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780bad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 --2- 172.21.15.40:0/4082422463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 >> 172.21.15.40:0/4082422463 conn(0x559b77cfe910 msgr2=0x559b780b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf11600640 0 client.15600 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.745+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 shutdown_connections 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.746+0000 7fdf31491740 1 -- 172.21.15.40:0/4082422463 wait complete. 2024-07-26T12:26:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.746+0000 7fdf31491740 20 client.15600 trim_cache size 0 max 16384 2024-07-26T12:26:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 Processor -- start 2024-07-26T12:26:48.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 -- start start 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241b51a0 con 0x559b77d0a520 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241b6da0 con 0x559b77ce1660 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.765+0000 7fdf31491740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241b5870 con 0x559b77ce9840 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.766+0000 7fdf23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.766+0000 7fdf23400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.766+0000 7fdf23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35662/0 (socket says 172.21.15.40:35662) 2024-07-26T12:26:48.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.766+0000 7fdf23e00640 1 -- 172.21.15.40:0/2485231895 learned_addr learned my addr 172.21.15.40:0/2485231895 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:48.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.766+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf23e00640 1 -- 172.21.15.40:0/2485231895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 msgr2=0x559b780b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf23e00640 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf23e00640 1 -- 172.21.15.40:0/2485231895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 msgr2=0x559b780c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf23e00640 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf23e00640 1 -- 172.21.15.40:0/2485231895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b780bb750 con 0x559b77d0a520 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf23e00640 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780b5c60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0049d0 tx=0x7fdf1c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27447e24e65a1146 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.767+0000 7fdf13e00640 1 -- 172.21.15.40:0/2485231895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c08c070 con 0x559b77d0a520 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.768+0000 7fdf13e00640 1 -- 172.21.15.40:0/2485231895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf1c0af670 con 0x559b77d0a520 2024-07-26T12:26:48.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.768+0000 7fdf13e00640 1 -- 172.21.15.40:0/2485231895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0c4070 con 0x559b77d0a520 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 -- 172.21.15.40:0/2485231895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 msgr2=0x559b780b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780b5c60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0049d0 tx=0x7fdf1c00cee0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 -- 172.21.15.40:0/2485231895 shutdown_connections 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77d0a520 0x559b780b5c60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77ce9840 0x559b780b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 --2- 172.21.15.40:0/2485231895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce1660 0x559b780c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 -- 172.21.15.40:0/2485231895 >> 172.21.15.40:0/2485231895 conn(0x559b77cfe910 msgr2=0x559b780b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 -- 172.21.15.40:0/2485231895 shutdown_connections 2024-07-26T12:26:48.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.769+0000 7fdf31491740 1 -- 172.21.15.40:0/2485231895 wait complete. 2024-07-26T12:26:48.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.770+0000 7fdf31491740 1 -- start start 2024-07-26T12:26:48.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.770+0000 7fdf31491740 1 Processor -- start 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce9840 0x559b780bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77d0a520 0x559b7812e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241b6610 con 0x559b77ce1660 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241b5f40 con 0x559b77ce9840 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf241b3160 con 0x559b77d0a520 2024-07-26T12:26:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.771+0000 7fdf31491740 10 client.0 _ll_register_callbacks cb 0x7fdf1c005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35666/0 (socket says 172.21.15.40:35666) 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 -- 172.21.15.40:0/991301500 learned_addr learned my addr 172.21.15.40:0/991301500 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce9840 0x559b780bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23e00640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77d0a520 0x559b7812e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 -- 172.21.15.40:0/991301500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77d0a520 msgr2=0x559b7812e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77d0a520 0x559b7812e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 -- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce9840 msgr2=0x559b780bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce9840 0x559b780bfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23400640 1 -- 172.21.15.40:0/991301500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b7812e990 con 0x559b77ce1660 2024-07-26T12:26:48.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf23e00640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77d0a520 0x559b7812e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:26:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.772+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce9840 0x559b780bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:26:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.773+0000 7fdf23400640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780bf4c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdf1402a450 tx=0x7fdf14004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908dad1fc88dcb12 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:26:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.773+0000 7fdf11600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:26:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.773+0000 7fdf11600640 1 -- 172.21.15.40:0/991301500 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14035040 con 0x559b77ce1660 2024-07-26T12:26:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.773+0000 7fdf11600640 1 -- 172.21.15.40:0/991301500 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf14005000 con 0x559b77ce1660 2024-07-26T12:26:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.773+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf1c0af670 con 0x559b77ce1660 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.773+0000 7fdf11600640 1 -- 172.21.15.40:0/991301500 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdf14040040 con 0x559b77ce1660 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 10 client.15606 fetch_fsmap learned FSMap version 31 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559b78135e50 con 0x559b77ce1660 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf11600640 1 -- 172.21.15.40:0/991301500 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf1c0af670 con 0x559b77ce1660 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf11600640 1 -- 172.21.15.40:0/991301500 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fdf14056070 con 0x559b77ce1660 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 10 client.15606 fetch_fsmap finished waiting for FSMap version 31 2024-07-26T12:26:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 10 client.15606 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 20 client.15606 populate_metadata read hostname 'smithi040' 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77c9e250 0x559b78138260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 4 client.15606 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1a303451", "release": true, "await": true}] 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.774+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1a303451", "release": true, "await": true}) -- 0x559b78023940 con 0x559b77c9e250 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.775+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77c9e250 0x559b78138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.776+0000 7fdf1aa00640 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77c9e250 0x559b78138260 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6fb131bdf736f2 server_cookie=c93b87f921cd17e1 in_seq=0 out_seq=0 2024-07-26T12:26:48.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.776+0000 7fdf11600640 10 client.15606 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:48.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.828+0000 7fdf11600640 1 -- 172.21.15.40:0/991301500 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559b78023940 con 0x559b77c9e250 2024-07-26T12:26:48.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.828+0000 7fdf11600640 10 client.15606 handle_command_reply: tid=0 2024-07-26T12:26:48.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.828+0000 7fdf31491740 1 client.15606 shutdown 2024-07-26T12:26:48.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 msgr2=0x559b780bf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780bf4c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdf1402a450 tx=0x7fdf14004d60 comp rx=0 tx=0).stop 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 shutdown_connections 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559b77d0a520 0x559b7812e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559b77ce9840 0x559b780bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559b77c9e250 0x559b78138260 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 --2- 172.21.15.40:0/991301500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559b77ce1660 0x559b780bf4c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 >> 172.21.15.40:0/991301500 conn(0x559b77cfe910 msgr2=0x559b780b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.829+0000 7fdf11600640 0 client.15606 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.830+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 shutdown_connections 2024-07-26T12:26:48.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.830+0000 7fdf31491740 1 -- 172.21.15.40:0/991301500 wait complete. 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.830+0000 7fdf31491740 20 client.15606 trim_cache size 0 max 16384 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 31, 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 12, 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: "1a303451": { 2024-07-26T12:26:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 12, 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 151.1, 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:26:48.834 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.831+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf080b3c50 msgr2=0x7fdf080b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.831+0000 7fdf29200640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf080b3c50 0x7fdf080b6160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf2410fb50 tx=0x7fdf0c004730 comp rx=0 tx=0).stop 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.831+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 msgr2=0x7fdf241a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.831+0000 7fdf29200640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 0x7fdf241a5a90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00eb10 tx=0x7fdf1c00c2d0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 shutdown_connections 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2410fc80 0x7fdf241a5a90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2410f330 0x7fdf241a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf080b3c50 0x7fdf080b6160 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 --2- 172.21.15.40:0/2645745796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf241099f0 0x7fdf241a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 >> 172.21.15.40:0/2645745796 conn(0x7fdf24078ff0 msgr2=0x7fdf240797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 shutdown_connections 2024-07-26T12:26:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:26:48.832+0000 7fdf29200640 1 -- 172.21.15.40:0/2645745796 wait complete. 2024-07-26T12:26:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:49 smithi146 ceph-mon[35807]: pgmap v637: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:26:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:49 smithi076 ceph-mon[35401]: pgmap v637: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:26:49.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:49 smithi040 ceph-mon[32397]: pgmap v637: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:26:49.825 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1a303451', total seconds elapsed: 39.1 2024-07-26T12:26:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:51 smithi146 ceph-mon[35807]: pgmap v638: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:26:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:51 smithi076 ceph-mon[35401]: pgmap v638: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:26:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:51 smithi040 ceph-mon[32397]: pgmap v638: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:26:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:53 smithi146 ceph-mon[35807]: pgmap v639: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:26:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:53 smithi076 ceph-mon[35401]: pgmap v639: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:26:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:53 smithi040 ceph-mon[32397]: pgmap v639: 97 pgs: 97 active+clean; 237 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:26:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:55 smithi146 ceph-mon[35807]: pgmap v640: 97 pgs: 97 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 488 KiB/s wr, 10 op/s 2024-07-26T12:26:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:55 smithi076 ceph-mon[35401]: pgmap v640: 97 pgs: 97 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 488 KiB/s wr, 10 op/s 2024-07-26T12:26:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:55 smithi040 ceph-mon[32397]: pgmap v640: 97 pgs: 97 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 488 KiB/s wr, 10 op/s 2024-07-26T12:26:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:57 smithi146 ceph-mon[35807]: pgmap v641: 97 pgs: 97 active+clean; 251 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-07-26T12:26:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:57 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:26:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:57 smithi076 ceph-mon[35401]: pgmap v641: 97 pgs: 97 active+clean; 251 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-07-26T12:26:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:57 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:26:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:57 smithi040 ceph-mon[32397]: pgmap v641: 97 pgs: 97 active+clean; 251 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-07-26T12:26:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:26:58.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:26:58.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:26:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:26:58.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:26:58.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:26:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:26:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:59 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:26:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:59 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:26:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:59 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:26:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:59 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:26:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:26:59 smithi146 ceph-mon[35807]: pgmap v642: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T12:26:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:59 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:26:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:59 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:26:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:59 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:26:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:59 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:26:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:26:59 smithi076 ceph-mon[35401]: pgmap v642: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T12:26:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:59 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:26:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:59 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:26:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:59 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:26:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:59 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:26:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:26:59 smithi040 ceph-mon[32397]: pgmap v642: 97 pgs: 97 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T12:27:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:01 smithi146 ceph-mon[35807]: pgmap v643: 97 pgs: 97 active+clean; 271 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:27:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:01 smithi076 ceph-mon[35401]: pgmap v643: 97 pgs: 97 active+clean; 271 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:27:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:01 smithi040 ceph-mon[32397]: pgmap v643: 97 pgs: 97 active+clean; 271 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:27:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:03 smithi146 ceph-mon[35807]: pgmap v644: 97 pgs: 97 active+clean; 275 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T12:27:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:03 smithi076 ceph-mon[35401]: pgmap v644: 97 pgs: 97 active+clean; 275 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T12:27:03.965 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:03 smithi040 ceph-mon[32397]: pgmap v644: 97 pgs: 97 active+clean; 275 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T12:27:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:05 smithi040 ceph-mon[32397]: pgmap v645: 97 pgs: 97 active+clean; 295 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-07-26T12:27:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:05 smithi146 ceph-mon[35807]: pgmap v645: 97 pgs: 97 active+clean; 295 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-07-26T12:27:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:05 smithi076 ceph-mon[35401]: pgmap v645: 97 pgs: 97 active+clean; 295 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-07-26T12:27:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:07 smithi146 ceph-mon[35807]: pgmap v646: 97 pgs: 97 active+clean; 299 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:07 smithi076 ceph-mon[35401]: pgmap v646: 97 pgs: 97 active+clean; 299 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:07 smithi040 ceph-mon[32397]: pgmap v646: 97 pgs: 97 active+clean; 299 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:09 smithi146 ceph-mon[35807]: pgmap v647: 97 pgs: 97 active+clean; 307 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:09 smithi076 ceph-mon[35401]: pgmap v647: 97 pgs: 97 active+clean; 307 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:09 smithi040 ceph-mon[32397]: pgmap v647: 97 pgs: 97 active+clean; 307 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:11 smithi146 ceph-mon[35807]: pgmap v648: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:27:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:11 smithi076 ceph-mon[35401]: pgmap v648: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:27:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:11 smithi040 ceph-mon[32397]: pgmap v648: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:27:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:13 smithi146 ceph-mon[35807]: pgmap v649: 97 pgs: 97 active+clean; 327 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:27:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:13 smithi076 ceph-mon[35401]: pgmap v649: 97 pgs: 97 active+clean; 327 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:27:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:13 smithi040 ceph-mon[32397]: pgmap v649: 97 pgs: 97 active+clean; 327 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:27:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:15 smithi040 ceph-mon[32397]: pgmap v650: 97 pgs: 97 active+clean; 339 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:15 smithi076 ceph-mon[35401]: pgmap v650: 97 pgs: 97 active+clean; 339 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:15 smithi146 ceph-mon[35807]: pgmap v650: 97 pgs: 97 active+clean; 339 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:17 smithi040 ceph-mon[32397]: pgmap v651: 97 pgs: 97 active+clean; 343 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:27:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:17 smithi146 ceph-mon[35807]: pgmap v651: 97 pgs: 97 active+clean; 343 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:27:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:17 smithi076 ceph-mon[35401]: pgmap v651: 97 pgs: 97 active+clean; 343 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:27:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:19 smithi040 ceph-mon[32397]: pgmap v652: 97 pgs: 97 active+clean; 351 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:27:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:19 smithi146 ceph-mon[35807]: pgmap v652: 97 pgs: 97 active+clean; 351 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:27:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:19 smithi076 ceph-mon[35401]: pgmap v652: 97 pgs: 97 active+clean; 351 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:27:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:21 smithi040 ceph-mon[32397]: pgmap v653: 97 pgs: 97 active+clean; 359 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:27:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:21 smithi146 ceph-mon[35807]: pgmap v653: 97 pgs: 97 active+clean; 359 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:27:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:21 smithi076 ceph-mon[35401]: pgmap v653: 97 pgs: 97 active+clean; 359 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:27:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:23 smithi040 ceph-mon[32397]: pgmap v654: 97 pgs: 97 active+clean; 359 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:27:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:23 smithi146 ceph-mon[35807]: pgmap v654: 97 pgs: 97 active+clean; 359 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:27:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:23 smithi076 ceph-mon[35401]: pgmap v654: 97 pgs: 97 active+clean; 359 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:27:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:25 smithi040 ceph-mon[32397]: pgmap v655: 97 pgs: 97 active+clean; 379 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:25 smithi146 ceph-mon[35807]: pgmap v655: 97 pgs: 97 active+clean; 379 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:25 smithi076 ceph-mon[35401]: pgmap v655: 97 pgs: 97 active+clean; 379 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:27 smithi040 ceph-mon[32397]: pgmap v656: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:27:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:27 smithi146 ceph-mon[35807]: pgmap v656: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:27:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:27 smithi076 ceph-mon[35401]: pgmap v656: 97 pgs: 97 active+clean; 387 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:27:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:29 smithi040 ceph-mon[32397]: pgmap v657: 97 pgs: 97 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:27:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:29 smithi146 ceph-mon[35807]: pgmap v657: 97 pgs: 97 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:27:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:29 smithi076 ceph-mon[35401]: pgmap v657: 97 pgs: 97 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:27:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:31 smithi040 ceph-mon[32397]: pgmap v658: 97 pgs: 97 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:31 smithi146 ceph-mon[35807]: pgmap v658: 97 pgs: 97 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:31 smithi076 ceph-mon[35401]: pgmap v658: 97 pgs: 97 active+clean; 403 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:33 smithi040 ceph-mon[32397]: pgmap v659: 97 pgs: 97 active+clean; 407 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:27:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:33 smithi146 ceph-mon[35807]: pgmap v659: 97 pgs: 97 active+clean; 407 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:27:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:33 smithi076 ceph-mon[35401]: pgmap v659: 97 pgs: 97 active+clean; 407 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:27:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:35 smithi040 ceph-mon[32397]: pgmap v660: 97 pgs: 97 active+clean; 427 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:27:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:35 smithi146 ceph-mon[35807]: pgmap v660: 97 pgs: 97 active+clean; 427 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:27:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:35 smithi076 ceph-mon[35401]: pgmap v660: 97 pgs: 97 active+clean; 427 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:27:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:37 smithi040 ceph-mon[32397]: pgmap v661: 97 pgs: 97 active+clean; 431 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:27:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:37 smithi146 ceph-mon[35807]: pgmap v661: 97 pgs: 97 active+clean; 431 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:27:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:37 smithi076 ceph-mon[35401]: pgmap v661: 97 pgs: 97 active+clean; 431 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:27:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:39 smithi040 ceph-mon[32397]: pgmap v662: 97 pgs: 97 active+clean; 443 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:39 smithi146 ceph-mon[35807]: pgmap v662: 97 pgs: 97 active+clean; 443 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:39 smithi076 ceph-mon[35401]: pgmap v662: 97 pgs: 97 active+clean; 443 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:27:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:41 smithi040 ceph-mon[32397]: pgmap v663: 97 pgs: 97 active+clean; 451 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:27:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:41 smithi146 ceph-mon[35807]: pgmap v663: 97 pgs: 97 active+clean; 451 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:27:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:41 smithi076 ceph-mon[35401]: pgmap v663: 97 pgs: 97 active+clean; 451 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:27:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:42 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:42 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:42 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:43 smithi040 ceph-mon[32397]: pgmap v664: 97 pgs: 97 active+clean; 459 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:27:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:43 smithi146 ceph-mon[35807]: pgmap v664: 97 pgs: 97 active+clean; 459 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:27:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:43 smithi076 ceph-mon[35401]: pgmap v664: 97 pgs: 97 active+clean; 459 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:27:45.964 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:45 smithi040 ceph-mon[32397]: pgmap v665: 97 pgs: 97 active+clean; 471 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:45 smithi146 ceph-mon[35807]: pgmap v665: 97 pgs: 97 active+clean; 471 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:45 smithi076 ceph-mon[35401]: pgmap v665: 97 pgs: 97 active+clean; 471 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:47.583 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-26T12:27:47.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:27:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:47 smithi040 ceph-mon[32397]: pgmap v666: 97 pgs: 97 active+clean; 471 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:27:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:47 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:47 smithi146 ceph-mon[35807]: pgmap v666: 97 pgs: 97 active+clean; 471 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:27:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:47 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:47 smithi076 ceph-mon[35401]: pgmap v666: 97 pgs: 97 active+clean; 471 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:27:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:47 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:27:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:48 smithi040 ceph-mon[32397]: pgmap v667: 97 pgs: 97 active+clean; 495 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:27:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:48 smithi146 ceph-mon[35807]: pgmap v667: 97 pgs: 97 active+clean; 495 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:27:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:48 smithi076 ceph-mon[35401]: pgmap v667: 97 pgs: 97 active+clean; 495 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:27:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 -- 172.21.15.40:0/295180814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 msgr2=0x7f53d4109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 --2- 172.21.15.40:0/295180814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4109130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009900 tx=0x7f53c002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 -- 172.21.15.40:0/295180814 shutdown_connections 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 --2- 172.21.15.40:0/295180814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4109670 0x7f53d410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 --2- 172.21.15.40:0/295180814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4109130 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 --2- 172.21.15.40:0/295180814 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53d41033e0 0x7f53d41037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 -- 172.21.15.40:0/295180814 >> 172.21.15.40:0/295180814 conn(0x7f53d40fee70 msgr2=0x7f53d41012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 -- 172.21.15.40:0/295180814 shutdown_connections 2024-07-26T12:27:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.643+0000 7f53d9a00640 1 -- 172.21.15.40:0/295180814 wait complete. 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.644+0000 7f53d9a00640 1 Processor -- start 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.644+0000 7f53d9a00640 1 -- start start 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d9a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53d41033e0 0x7f53d4075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d9a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4109670 0x7f53d4075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d9a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41131e0 con 0x7f53d4108d20 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d9a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4113060 con 0x7f53d41033e0 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d9a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4113360 con 0x7f53d4109670 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46484/0 (socket says 172.21.15.40:46484) 2024-07-26T12:27:50.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.645+0000 7f53d3400640 1 -- 172.21.15.40:0/671425483 learned_addr learned my addr 172.21.15.40:0/671425483 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d9000640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4109670 0x7f53d4075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3e00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53d41033e0 0x7f53d4075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3400640 1 -- 172.21.15.40:0/671425483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4109670 msgr2=0x7f53d4075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3400640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4109670 0x7f53d4075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3400640 1 -- 172.21.15.40:0/671425483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53d41033e0 msgr2=0x7f53d4075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3400640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53d41033e0 0x7f53d4075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3400640 1 -- 172.21.15.40:0/671425483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41a7f30 con 0x7f53d4108d20 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.646+0000 7f53d3400640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4075680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f53c002a910 tx=0x7f53c0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.647+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c003f070 con 0x7f53d4108d20 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.647+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41a81c0 con 0x7f53d4108d20 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.647+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53c0003e10 con 0x7f53d4108d20 2024-07-26T12:27:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.647+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0035030 con 0x7f53d4108d20 2024-07-26T12:27:50.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.647+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d41a86a0 con 0x7f53d4108d20 2024-07-26T12:27:50.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.649+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d41037f0 con 0x7f53d4108d20 2024-07-26T12:27:50.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.651+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f53c0042070 con 0x7f53d4108d20 2024-07-26T12:27:50.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.653+0000 7f53d0c00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53b80b3bd0 0x7f53b80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:50.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.653+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f53c01044a0 con 0x7f53d4108d20 2024-07-26T12:27:50.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.653+0000 7f53d3e00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53b80b3bd0 0x7f53b80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:50.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.654+0000 7f53d3e00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53b80b3bd0 0x7f53b80b60e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f53c4005fd0 tx=0x7f53c4005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:50.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.658+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f53c00cbab0 con 0x7f53d4108d20 2024-07-26T12:27:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.941+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53d410b4b0 con 0x7f53d4108d20 2024-07-26T12:27:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.943+0000 7f53d0c00640 1 -- 172.21.15.40:0/671425483 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11978 (secure 0 0 0) 0x7f53d410b4b0 con 0x7f53d4108d20 2024-07-26T12:27:50.944 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:27:50.945 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":33,"btime":"2024-07-26T12:27:46:695225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:46.354170+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:27:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 33 2024-07-26T12:27:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53b80b3bd0 msgr2=0x7f53b80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53b80b3bd0 0x7f53b80b60e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f53c4005fd0 tx=0x7f53c4005c70 comp rx=0 tx=0).stop 2024-07-26T12:27:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 msgr2=0x7f53d4075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4075680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f53c002a910 tx=0x7f53c0003c20 comp rx=0 tx=0).stop 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 shutdown_connections 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53b80b3bd0 0x7f53b80b60e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4109670 0x7f53d4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53d4108d20 0x7f53d4075680 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.946+0000 7f53d9a00640 1 --2- 172.21.15.40:0/671425483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53d41033e0 0x7f53d4075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.947+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 >> 172.21.15.40:0/671425483 conn(0x7f53d40fee70 msgr2=0x7f53d4101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.947+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 shutdown_connections 2024-07-26T12:27:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:50.947+0000 7f53d9a00640 1 -- 172.21.15.40:0/671425483 wait complete. 2024-07-26T12:27:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:51 smithi040 ceph-mon[32397]: pgmap v668: 97 pgs: 97 active+clean; 495 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/671425483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:27:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:51 smithi146 ceph-mon[35807]: pgmap v668: 97 pgs: 97 active+clean; 495 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/671425483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:27:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:51 smithi076 ceph-mon[35401]: pgmap v668: 97 pgs: 97 active+clean; 495 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:27:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/671425483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:27:51.858 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-26T12:27:51.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-26T12:27:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:27:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:53 smithi040 ceph-mon[32397]: pgmap v669: 97 pgs: 97 active+clean; 511 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:27:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:53 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:53 smithi146 ceph-mon[35807]: pgmap v669: 97 pgs: 97 active+clean; 511 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:27:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:53 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:53 smithi076 ceph-mon[35401]: pgmap v669: 97 pgs: 97 active+clean; 511 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:27:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:53 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.932+0000 7f716d800640 1 -- 172.21.15.40:0/798064705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168108560 msgr2=0x7f716810ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.932+0000 7f716d800640 1 --2- 172.21.15.40:0/798064705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168108560 0x7f716810ed90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7160009ca0 tx=0x7f716002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 -- 172.21.15.40:0/798064705 shutdown_connections 2024-07-26T12:27:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 --2- 172.21.15.40:0/798064705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168108560 0x7f716810ed90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 --2- 172.21.15.40:0/798064705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168107c10 0x7f7168108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 --2- 172.21.15.40:0/798064705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71681022d0 0x7f71681026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 -- 172.21.15.40:0/798064705 >> 172.21.15.40:0/798064705 conn(0x7f71680fdd60 msgr2=0x7f71681001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 -- 172.21.15.40:0/798064705 shutdown_connections 2024-07-26T12:27:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.933+0000 7f716d800640 1 -- 172.21.15.40:0/798064705 wait complete. 2024-07-26T12:27:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.934+0000 7f716d800640 1 Processor -- start 2024-07-26T12:27:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.934+0000 7f716d800640 1 -- start start 2024-07-26T12:27:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f716d800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71681022d0 0x7f716819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f716d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 0x7f716819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f716d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168108560 0x7f71681a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f716d800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7168111010 con 0x7f7168107c10 2024-07-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f716d800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7168110e90 con 0x7f71681022d0 2024-07-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f716d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7168111190 con 0x7f7168108560 2024-07-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.935+0000 7f7167400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 0x7f716819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 0x7f716819c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33006/0 (socket says 172.21.15.40:33006) 2024-07-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 -- 172.21.15.40:0/2094944677 learned_addr learned my addr 172.21.15.40:0/2094944677 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167e00640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71681022d0 0x7f716819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f716ce00640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168108560 0x7f71681a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 -- 172.21.15.40:0/2094944677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168108560 msgr2=0x7f71681a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168108560 0x7f71681a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 -- 172.21.15.40:0/2094944677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71681022d0 msgr2=0x7f716819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71681022d0 0x7f716819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.936+0000 7f7167400640 1 -- 172.21.15.40:0/2094944677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71681a1d60 con 0x7f7168107c10 2024-07-26T12:27:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.937+0000 7f7167400640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 0x7f716819c390 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f715400d750 tx=0x7f715400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.937+0000 7f7164c00640 1 -- 172.21.15.40:0/2094944677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154017070 con 0x7f7168107c10 2024-07-26T12:27:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.937+0000 7f7164c00640 1 -- 172.21.15.40:0/2094944677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71540054b0 con 0x7f7168107c10 2024-07-26T12:27:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.937+0000 7f7164c00640 1 -- 172.21.15.40:0/2094944677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154004bc0 con 0x7f7168107c10 2024-07-26T12:27:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.937+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71681a2050 con 0x7f7168107c10 2024-07-26T12:27:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.937+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681a87b0 con 0x7f7168107c10 2024-07-26T12:27:54.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.941+0000 7f7175ab7740 1 Processor -- start 2024-07-26T12:27:54.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 -- start start 2024-07-26T12:27:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272a8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562827272cf0 con 0x562826ed9980 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56282721db40 con 0x562826ee1b60 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.942+0000 7f7175ab7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56282720d040 con 0x562826f02840 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33014/0 (socket says 172.21.15.40:33014) 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 -- 172.21.15.40:0/1988325537 learned_addr learned my addr 172.21.15.40:0/1988325537 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7164c00640 1 -- 172.21.15.40:0/2094944677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7154009c30 con 0x7f7168107c10 2024-07-26T12:27:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f716ce00640 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 -- 172.21.15.40:0/1988325537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 msgr2=0x5628272a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 -- 172.21.15.40:0/1988325537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 msgr2=0x5628272a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.943+0000 7f7167e00640 1 -- 172.21.15.40:0/1988325537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562827194af0 con 0x562826ed9980 2024-07-26T12:27:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.944+0000 7f7167e00640 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272a88d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f715800bc30 tx=0x7f715800a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17f4b38d24d6145 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.944+0000 7f715d600640 1 -- 172.21.15.40:0/1988325537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71580155f0 con 0x562826ed9980 2024-07-26T12:27:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.945+0000 7f715d600640 1 -- 172.21.15.40:0/1988325537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f715801a070 con 0x562826ed9980 2024-07-26T12:27:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.945+0000 7f715d600640 1 -- 172.21.15.40:0/1988325537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158014820 con 0x562826ed9980 2024-07-26T12:27:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7164c00640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f714c0b3cc0 0x7f714c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 -- 172.21.15.40:0/1988325537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 msgr2=0x5628272a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:54.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272a88d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f715800bc30 tx=0x7f715800a680 comp rx=0 tx=0).stop 2024-07-26T12:27:54.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7164c00640 1 -- 172.21.15.40:0/2094944677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f71540e3680 con 0x7f7168107c10 2024-07-26T12:27:54.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f716ce00640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f714c0b3cc0 0x7f714c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 -- 172.21.15.40:0/1988325537 shutdown_connections 2024-07-26T12:27:54.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272a88d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1988325537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.946+0000 7f7175ab7740 1 -- 172.21.15.40:0/1988325537 >> 172.21.15.40:0/1988325537 conn(0x562826ef6990 msgr2=0x5628272a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:54.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.947+0000 7f7175ab7740 1 -- 172.21.15.40:0/1988325537 shutdown_connections 2024-07-26T12:27:54.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.947+0000 7f7175ab7740 1 -- 172.21.15.40:0/1988325537 wait complete. 2024-07-26T12:27:54.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.948+0000 7f716ce00640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f714c0b3cc0 0x7f714c0b61d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7160006010 tx=0x7f7160009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:54.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.948+0000 7f7175ab7740 1 -- start start 2024-07-26T12:27:54.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 Processor -- start 2024-07-26T12:27:54.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272bcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272bd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5628271a9500 con 0x562826ed9980 2024-07-26T12:27:54.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562827211080 con 0x562826ee1b60 2024-07-26T12:27:54.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5628270707a0 con 0x562826f02840 2024-07-26T12:27:54.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.949+0000 7f7175ab7740 10 client.0 _ll_register_callbacks cb 0x562827205bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:27:54.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272bcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272bcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33024/0 (socket says 172.21.15.40:33024) 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167e00640 1 -- 172.21.15.40:0/1459038251 learned_addr learned my addr 172.21.15.40:0/1459038251 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f716ce00640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167400640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272bd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167e00640 1 -- 172.21.15.40:0/1459038251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 msgr2=0x5628272c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167e00640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.950+0000 7f7167e00640 1 -- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 msgr2=0x5628272bd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.951+0000 7f7167e00640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272bd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.951+0000 7f7167e00640 1 -- 172.21.15.40:0/1459038251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562826f7cb90 con 0x562826ed9980 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.951+0000 7f7167e00640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272bcbf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f715800b710 tx=0x7f7158004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e598047f28543c7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.951+0000 7f7152000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.952+0000 7f7152000640 1 -- 172.21.15.40:0/1459038251 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158022070 con 0x562826ed9980 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.952+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f715801a070 con 0x562826ed9980 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.952+0000 7f7152000640 1 -- 172.21.15.40:0/1459038251 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7158014560 con 0x562826ed9980 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.952+0000 7f7152000640 1 -- 172.21.15.40:0/1459038251 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f71580055d0 con 0x562826ed9980 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.952+0000 7f7175ab7740 10 client.15624 fetch_fsmap learned FSMap version 34 2024-07-26T12:27:54.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.952+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5628272cb140 con 0x562826ed9980 2024-07-26T12:27:54.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7152000640 1 -- 172.21.15.40:0/1459038251 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f715801a070 con 0x562826ed9980 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7152000640 1 -- 172.21.15.40:0/1459038251 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 34) ==== 8366+0+0 (secure 0 0 0) 0x7f7158027460 con 0x562826ed9980 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7175ab7740 10 client.15624 fetch_fsmap finished waiting for FSMap version 34 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7175ab7740 10 client.15624 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7175ab7740 20 client.15624 populate_metadata read hostname 'smithi040' 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826ec11c0 0x5628272ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7175ab7740 4 client.15624 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.953+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56282721fa90 con 0x562826ec11c0 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.954+0000 7f7167400640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826ec11c0 0x5628272ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.955+0000 7f7167400640 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826ec11c0 0x5628272ce5b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e69d02f701fe3ac server_cookie=61745724343a489d in_seq=0 out_seq=0 2024-07-26T12:27:54.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.955+0000 7f7152000640 10 client.15624 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:27:54.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.957+0000 7f7152000640 1 -- 172.21.15.40:0/1459038251 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56282721fa90 con 0x562826ec11c0 2024-07-26T12:27:54.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.957+0000 7f7152000640 10 client.15624 handle_command_reply: tid=0 2024-07-26T12:27:54.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.957+0000 7f7175ab7740 1 client.15624 shutdown 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 msgr2=0x5628272bcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272bcbf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f715800b710 tx=0x7f7158004970 comp rx=0 tx=0).stop 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 shutdown_connections 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826f02840 0x5628272c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272bd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826ec11c0 0x5628272ce5b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1459038251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272bcbf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7152000640 0 client.15624 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:27:54.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 >> 172.21.15.40:0/1459038251 conn(0x562826ef6990 msgr2=0x5628272ab520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 shutdown_connections 2024-07-26T12:27:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 1 -- 172.21.15.40:0/1459038251 wait complete. 2024-07-26T12:27:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.958+0000 7f7175ab7740 20 client.15624 trim_cache size 0 max 16384 2024-07-26T12:27:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 Processor -- start 2024-07-26T12:27:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 -- start start 2024-07-26T12:27:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ed9980 0x5628272a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 0x5628272ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71681ac9d0 con 0x562826f02840 2024-07-26T12:27:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f71681ae540 con 0x562826ee1b60 2024-07-26T12:27:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.982+0000 7f7175ab7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f71681ad0a0 con 0x562826ed9980 2024-07-26T12:27:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.983+0000 7f716ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 0x5628272ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.983+0000 7f716ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 0x5628272ba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33028/0 (socket says 172.21.15.40:33028) 2024-07-26T12:27:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.983+0000 7f716ce00640 1 -- 172.21.15.40:0/3119210355 learned_addr learned my addr 172.21.15.40:0/3119210355 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:27:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.983+0000 7f7167e00640 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ed9980 0x5628272a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.983+0000 7f7167400640 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f716ce00640 1 -- 172.21.15.40:0/3119210355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ed9980 msgr2=0x5628272a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f716ce00640 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ed9980 0x5628272a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f716ce00640 1 -- 172.21.15.40:0/3119210355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 msgr2=0x5628272b9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f716ce00640 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272b9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f716ce00640 1 -- 172.21.15.40:0/3119210355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628272bb950 con 0x562826f02840 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f716ce00640 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 0x5628272ba120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71600318f0 tx=0x7f7160040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aef10037e4ec591 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f715cc00640 1 -- 172.21.15.40:0/3119210355 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160031980 con 0x562826f02840 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.984+0000 7f715cc00640 1 -- 172.21.15.40:0/3119210355 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7160036040 con 0x562826f02840 2024-07-26T12:27:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.985+0000 7f715cc00640 1 -- 172.21.15.40:0/3119210355 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160030820 con 0x562826f02840 2024-07-26T12:27:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 -- 172.21.15.40:0/3119210355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 msgr2=0x5628272ba120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 0x5628272ba120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71600318f0 tx=0x7f7160040000 comp rx=0 tx=0).stop 2024-07-26T12:27:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 -- 172.21.15.40:0/3119210355 shutdown_connections 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826f02840 0x5628272ba120 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826ee1b60 0x5628272b9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 --2- 172.21.15.40:0/3119210355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ed9980 0x5628272a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 -- 172.21.15.40:0/3119210355 >> 172.21.15.40:0/3119210355 conn(0x562826ef6990 msgr2=0x5628272b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 -- 172.21.15.40:0/3119210355 shutdown_connections 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 -- 172.21.15.40:0/3119210355 wait complete. 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.986+0000 7f7175ab7740 1 -- start start 2024-07-26T12:27:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 Processor -- start 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272c8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ee1b60 0x5628272c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826f02840 0x56282732f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71681ade40 con 0x562826ed9980 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f71681ad770 con 0x562826f02840 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f71681aa9b0 con 0x562826ee1b60 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.987+0000 7f7175ab7740 10 client.0 _ll_register_callbacks cb 0x7f715800ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33042/0 (socket says 172.21.15.40:33042) 2024-07-26T12:27:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 -- 172.21.15.40:0/1562950948 learned_addr learned my addr 172.21.15.40:0/1562950948 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167400640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ee1b60 0x5628272c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f716ce00640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826f02840 0x56282732f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 -- 172.21.15.40:0/1562950948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ee1b60 msgr2=0x5628272c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ee1b60 0x5628272c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 -- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826f02840 msgr2=0x56282732f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826f02840 0x56282732f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.988+0000 7f7167e00640 1 -- 172.21.15.40:0/1562950948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282732f830 con 0x562826ed9980 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7167e00640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272c8650 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f715800ab80 tx=0x7f7158004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b833d25dc57565 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7152000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7152000640 1 -- 172.21.15.40:0/1562950948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158022040 con 0x562826ed9980 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7152000640 1 -- 172.21.15.40:0/1562950948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7158004030 con 0x562826ed9980 2024-07-26T12:27:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7160036040 con 0x562826ed9980 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7152000640 1 -- 172.21.15.40:0/1562950948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f715800b800 con 0x562826ed9980 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7175ab7740 10 client.15630 fetch_fsmap learned FSMap version 34 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.989+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562827336c00 con 0x562826ed9980 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7152000640 1 -- 172.21.15.40:0/1562950948 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7160036040 con 0x562826ed9980 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7152000640 1 -- 172.21.15.40:0/1562950948 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 34) ==== 8366+0+0 (secure 0 0 0) 0x7f715803a020 con 0x562826ed9980 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7175ab7740 10 client.15630 fetch_fsmap finished waiting for FSMap version 34 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7175ab7740 10 client.15630 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:27:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7175ab7740 20 client.15630 populate_metadata read hostname 'smithi040' 2024-07-26T12:27:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826e96570 0x5628273393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:27:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7175ab7740 4 client.15630 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-26T12:27:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.990+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x56282721b530 con 0x562826e96570 2024-07-26T12:27:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.991+0000 7f7167400640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826e96570 0x5628273393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:27:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.992+0000 7f7167400640 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826e96570 0x5628273393a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dca018abb2f55dc server_cookie=cc5456e7b8dcf77f in_seq=0 out_seq=0 2024-07-26T12:27:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:54.992+0000 7f7152000640 10 client.15630 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:27:55.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.259+0000 7f7152000640 1 -- 172.21.15.40:0/1562950948 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56282721b530 con 0x562826e96570 2024-07-26T12:27:55.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.259+0000 7f7152000640 10 client.15630 handle_command_reply: tid=0 2024-07-26T12:27:55.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.259+0000 7f7175ab7740 1 client.15630 shutdown 2024-07-26T12:27:55.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 msgr2=0x5628272c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:55.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272c8650 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f715800ab80 tx=0x7f7158004fa0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 shutdown_connections 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562826f02840 0x56282732f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562826ee1b60 0x5628272c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562826e96570 0x5628273393a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 --2- 172.21.15.40:0/1562950948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562826ed9980 0x5628272c8650 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7152000640 0 client.15630 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:27:55.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.260+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 >> 172.21.15.40:0/1562950948 conn(0x562826ef6990 msgr2=0x5628272b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:55.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.261+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 shutdown_connections 2024-07-26T12:27:55.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.261+0000 7f7175ab7740 1 -- 172.21.15.40:0/1562950948 wait complete. 2024-07-26T12:27:55.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.261+0000 7f7175ab7740 20 client.15630 trim_cache size 0 max 16384 2024-07-26T12:27:55.263 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:27:55.263 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 34, 2024-07-26T12:27:55.263 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 14, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "999fac39": { 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 14, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T12:27:55.264 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:27:55.265 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.263+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f714c0b3cc0 msgr2=0x7f714c0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.263+0000 7f716d800640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f714c0b3cc0 0x7f714c0b61d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7160006010 tx=0x7f7160009410 comp rx=0 tx=0).stop 2024-07-26T12:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.263+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 msgr2=0x7f716819c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.263+0000 7f716d800640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 0x7f716819c390 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f715400d750 tx=0x7f715400dc10 comp rx=0 tx=0).stop 2024-07-26T12:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.263+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 shutdown_connections 2024-07-26T12:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.263+0000 7f716d800640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f714c0b3cc0 0x7f714c0b61d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.264+0000 7f716d800640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7168108560 0x7f71681a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.264+0000 7f716d800640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7168107c10 0x7f716819c390 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.264+0000 7f716d800640 1 --2- 172.21.15.40:0/2094944677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f71681022d0 0x7f716819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:27:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.264+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 >> 172.21.15.40:0/2094944677 conn(0x7f71680fdd60 msgr2=0x7f7168100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:27:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.264+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 shutdown_connections 2024-07-26T12:27:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:27:55.264+0000 7f716d800640 1 -- 172.21.15.40:0/2094944677 wait complete. 2024-07-26T12:27:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:55 smithi040 ceph-mon[32397]: pgmap v670: 97 pgs: 97 active+clean; 523 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:55 smithi146 ceph-mon[35807]: pgmap v670: 97 pgs: 97 active+clean; 523 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:55 smithi076 ceph-mon[35401]: pgmap v670: 97 pgs: 97 active+clean; 523 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:27:56.320 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '999fac39', quiesce took 8.7 seconds. Will release after: 1.3000000000000007 2024-07-26T12:27:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:57 smithi040 ceph-mon[32397]: pgmap v671: 97 pgs: 97 active+clean; 531 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:27:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:57 smithi146 ceph-mon[35807]: pgmap v671: 97 pgs: 97 active+clean; 531 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:27:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:57 smithi076 ceph-mon[35401]: pgmap v671: 97 pgs: 97 active+clean; 531 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:27:57.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:27:58.566 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:58 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:58 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:58 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T12:27:59.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:59 smithi040 ceph-mon[32397]: pgmap v672: 97 pgs: 97 active+clean; 539 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:27:59.555 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:27:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:27:59.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:59 smithi146 ceph-mon[35807]: pgmap v672: 97 pgs: 97 active+clean; 539 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:27:59.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:27:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:27:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:59 smithi076 ceph-mon[35401]: pgmap v672: 97 pgs: 97 active+clean; 539 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:27:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:27:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:28:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 -- 172.21.15.40:0/2583017725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 msgr2=0x7ff8c80751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2583017725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c80751e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009900 tx=0x7ff8bc02a410 comp rx=0 tx=0).stop 2024-07-26T12:28:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 -- 172.21.15.40:0/2583017725 shutdown_connections 2024-07-26T12:28:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2583017725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c8113cb0 0x7ff8c8116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2583017725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 0x7ff8c8075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2583017725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c80751e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 -- 172.21.15.40:0/2583017725 >> 172.21.15.40:0/2583017725 conn(0x7ff8c80fee70 msgr2=0x7ff8c81012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:00.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 -- 172.21.15.40:0/2583017725 shutdown_connections 2024-07-26T12:28:00.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.433+0000 7ff8cec00640 1 -- 172.21.15.40:0/2583017725 wait complete. 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.434+0000 7ff8cec00640 1 Processor -- start 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.434+0000 7ff8cec00640 1 -- start start 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 0x7ff8c81a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c81a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c8113cb0 0x7ff8c81a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c81197a0 con 0x7ff8c8076db0 2024-07-26T12:28:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8119620 con 0x7ff8c8075800 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8119920 con 0x7ff8c8113cb0 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c81a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c81a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33058/0 (socket says 172.21.15.40:33058) 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cce00640 1 -- 172.21.15.40:0/2195690776 learned_addr learned my addr 172.21.15.40:0/2195690776 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.435+0000 7ff8cd800640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 0x7ff8c81a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8ce200640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c8113cb0 0x7ff8c81a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cce00640 1 -- 172.21.15.40:0/2195690776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c8113cb0 msgr2=0x7ff8c81a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cce00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c8113cb0 0x7ff8c81a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cce00640 1 -- 172.21.15.40:0/2195690776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 msgr2=0x7ff8c81a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cce00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 0x7ff8c81a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cce00640 1 -- 172.21.15.40:0/2195690776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81a6280 con 0x7ff8c8076db0 2024-07-26T12:28:00.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cd800640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 0x7ff8c81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:28:00.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.436+0000 7ff8cce00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c81a08b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4005fd0 tx=0x7ff8b400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:00.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.437+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4017070 con 0x7ff8c8076db0 2024-07-26T12:28:00.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.437+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8b4009c30 con 0x7ff8c8076db0 2024-07-26T12:28:00.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.437+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c81a6570 con 0x7ff8c8076db0 2024-07-26T12:28:00.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.437+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4003c70 con 0x7ff8c8076db0 2024-07-26T12:28:00.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.437+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c81accd0 con 0x7ff8c8076db0 2024-07-26T12:28:00.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.438+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c8075c10 con 0x7ff8c8076db0 2024-07-26T12:28:00.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.442+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff8b4003e10 con 0x7ff8c8076db0 2024-07-26T12:28:00.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.443+0000 7ff8c6000640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff8b00b3bd0 0x7ff8b00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:00.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.443+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff8b40e4100 con 0x7ff8c8076db0 2024-07-26T12:28:00.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.443+0000 7ff8cd800640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff8b00b3bd0 0x7ff8b00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:00.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.444+0000 7ff8cd800640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff8b00b3bd0 0x7ff8b00b60e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc000c00 tx=0x7ff8bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:00.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.444+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff8b4020030 con 0x7ff8c8076db0 2024-07-26T12:28:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:28:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:28:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:28:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:28:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:28:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:28:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:28:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:28:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:28:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:28:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:28:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:28:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.694+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8c81a1440 con 0x7ff8c8076db0 2024-07-26T12:28:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.696+0000 7ff8c6000640 1 -- 172.21.15.40:0/2195690776 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ff8b40ab710 con 0x7ff8c8076db0 2024-07-26T12:28:00.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:28:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:28:00.698 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff8b00b3bd0 msgr2=0x7ff8b00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff8b00b3bd0 0x7ff8b00b60e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc000c00 tx=0x7ff8bc005a20 comp rx=0 tx=0).stop 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 msgr2=0x7ff8c81a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c81a08b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4005fd0 tx=0x7ff8b400dde0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 shutdown_connections 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff8b00b3bd0 0x7ff8b00b60e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c8113cb0 0x7ff8c81a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8c8076db0 0x7ff8c81a08b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 --2- 172.21.15.40:0/2195690776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8c8075800 0x7ff8c81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 >> 172.21.15.40:0/2195690776 conn(0x7ff8c80fee70 msgr2=0x7ff8c810fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.699+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 shutdown_connections 2024-07-26T12:28:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:00.700+0000 7ff8cec00640 1 -- 172.21.15.40:0/2195690776 wait complete. 2024-07-26T12:28:01.583 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 999fac39 --release --await' 2024-07-26T12:28:01.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 999fac39 --release --await 2024-07-26T12:28:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:01 smithi040 ceph-mon[32397]: pgmap v673: 97 pgs: 97 active+clean; 539 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T12:28:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:01 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2195690776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:01.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:01 smithi146 ceph-mon[35807]: pgmap v673: 97 pgs: 97 active+clean; 539 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T12:28:01.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:01 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2195690776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:01 smithi076 ceph-mon[35401]: pgmap v673: 97 pgs: 97 active+clean; 539 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T12:28:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:01 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2195690776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:03 smithi040 ceph-mon[32397]: pgmap v674: 97 pgs: 97 active+clean; 543 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:28:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:03 smithi146 ceph-mon[35807]: pgmap v674: 97 pgs: 97 active+clean; 543 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:28:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:03 smithi076 ceph-mon[35401]: pgmap v674: 97 pgs: 97 active+clean; 543 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:28:05.544 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:05 smithi040 ceph-mon[32397]: pgmap v675: 97 pgs: 97 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T12:28:05.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.659+0000 7faa51400640 1 -- 172.21.15.40:0/3887061434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c10d840 msgr2=0x7faa4c10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.659+0000 7faa51400640 1 --2- 172.21.15.40:0/3887061434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c10d840 0x7faa4c10fd30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faa44009ca0 tx=0x7faa4402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 -- 172.21.15.40:0/3887061434 shutdown_connections 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 --2- 172.21.15.40:0/3887061434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c10d840 0x7faa4c10fd30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 --2- 172.21.15.40:0/3887061434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c104d30 0x7faa4c10d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 --2- 172.21.15.40:0/3887061434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c1043e0 0x7faa4c1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 -- 172.21.15.40:0/3887061434 >> 172.21.15.40:0/3887061434 conn(0x7faa4c079160 msgr2=0x7faa4c079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 -- 172.21.15.40:0/3887061434 shutdown_connections 2024-07-26T12:28:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.660+0000 7faa51400640 1 -- 172.21.15.40:0/3887061434 wait complete. 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.661+0000 7faa51400640 1 Processor -- start 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 -- start start 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c1043e0 0x7faa4c199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 0x7faa4c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c10d840 0x7faa4c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1133a0 con 0x7faa4c104d30 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c113220 con 0x7faa4c1043e0 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa51400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c113520 con 0x7faa4c10d840 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa49e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 0x7faa4c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa49e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 0x7faa4c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49404/0 (socket says 172.21.15.40:49404) 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.662+0000 7faa49e00640 1 -- 172.21.15.40:0/3114620284 learned_addr learned my addr 172.21.15.40:0/3114620284 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa4a800640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c1043e0 0x7faa4c199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa4b200640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c10d840 0x7faa4c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa49e00640 1 -- 172.21.15.40:0/3114620284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c10d840 msgr2=0x7faa4c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa49e00640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c10d840 0x7faa4c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa49e00640 1 -- 172.21.15.40:0/3114620284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c1043e0 msgr2=0x7faa4c199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa49e00640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c1043e0 0x7faa4c199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa49e00640 1 -- 172.21.15.40:0/3114620284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c19fd40 con 0x7faa4c104d30 2024-07-26T12:28:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.663+0000 7faa4a800640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c1043e0 0x7faa4c199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:28:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.664+0000 7faa49e00640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 0x7faa4c19a430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d740 tx=0x7faa3800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.664+0000 7faa43400640 1 -- 172.21.15.40:0/3114620284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38017070 con 0x7faa4c104d30 2024-07-26T12:28:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.664+0000 7faa43400640 1 -- 172.21.15.40:0/3114620284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa3800de50 con 0x7faa4c104d30 2024-07-26T12:28:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.664+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c1a0030 con 0x7faa4c104d30 2024-07-26T12:28:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.664+0000 7faa43400640 1 -- 172.21.15.40:0/3114620284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3800f620 con 0x7faa4c104d30 2024-07-26T12:28:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.664+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c1a6850 con 0x7faa4c104d30 2024-07-26T12:28:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 Processor -- start 2024-07-26T12:28:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 -- start start 2024-07-26T12:28:05.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802acefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802acf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802acfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560802a45f50 con 0x56080272a520 2024-07-26T12:28:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560802a35450 con 0x560802701660 2024-07-26T12:28:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.668+0000 7faa57fdf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560802a39490 con 0x560802709840 2024-07-26T12:28:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802acefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802acefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49412/0 (socket says 172.21.15.40:49412) 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 -- 172.21.15.40:0/531962167 learned_addr learned my addr 172.21.15.40:0/531962167 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4a800640 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802acf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 -- 172.21.15.40:0/531962167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 msgr2=0x560802acfa60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802acfa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 -- 172.21.15.40:0/531962167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 msgr2=0x560802acf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802acf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4b200640 1 -- 172.21.15.40:0/531962167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560802795b00 con 0x56080272a520 2024-07-26T12:28:05.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.669+0000 7faa4a800640 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802acf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:28:05.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.670+0000 7faa4b200640 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802acefe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faa44035000 tx=0x7faa44031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05215d3d8e83b46 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:05.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.670+0000 7faa37400640 1 -- 172.21.15.40:0/531962167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44031b80 con 0x56080272a520 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.670+0000 7faa37400640 1 -- 172.21.15.40:0/531962167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa44036040 con 0x56080272a520 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.670+0000 7faa37400640 1 -- 172.21.15.40:0/531962167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44004540 con 0x56080272a520 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.670+0000 7faa43400640 1 -- 172.21.15.40:0/3114620284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faa3801a070 con 0x7faa4c104d30 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 -- 172.21.15.40:0/531962167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 msgr2=0x560802acefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802acefe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7faa44035000 tx=0x7faa44031580 comp rx=0 tx=0).stop 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 -- 172.21.15.40:0/531962167 shutdown_connections 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802acfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802acf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 --2- 172.21.15.40:0/531962167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802acefe0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.671+0000 7faa57fdf740 1 -- 172.21.15.40:0/531962167 >> 172.21.15.40:0/531962167 conn(0x56080271e910 msgr2=0x560802acced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.672+0000 7faa57fdf740 1 -- 172.21.15.40:0/531962167 shutdown_connections 2024-07-26T12:28:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.672+0000 7faa57fdf740 1 -- 172.21.15.40:0/531962167 wait complete. 2024-07-26T12:28:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.672+0000 7faa57fdf740 1 -- start start 2024-07-26T12:28:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.673+0000 7faa43400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa300b3ba0 0x7faa300b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.673+0000 7faa57fdf740 1 Processor -- start 2024-07-26T12:28:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.673+0000 7faa43400640 1 -- 172.21.15.40:0/3114620284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa380e35b0 con 0x7faa4c104d30 2024-07-26T12:28:05.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.673+0000 7faa4b200640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa300b3ba0 0x7faa300b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802ada780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802adb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560802898bb0 con 0x56080272a520 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5608029d1930 con 0x560802701660 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560802add760 con 0x560802709840 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa57fdf740 10 client.0 _ll_register_callbacks cb 0x560802741d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.674+0000 7faa4b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802adb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802adb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49428/0 (socket says 172.21.15.40:49428) 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 -- 172.21.15.40:0/2175677020 learned_addr learned my addr 172.21.15.40:0/2175677020 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4a800640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802ada780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa49e00640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa300b3ba0 0x7faa300b60b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faa440099a0 tx=0x7faa4403e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 -- 172.21.15.40:0/2175677020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 msgr2=0x560802adacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 -- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 msgr2=0x560802ada780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802ada780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.675+0000 7faa4b200640 1 -- 172.21.15.40:0/2175677020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56080280c960 con 0x56080272a520 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa4b200640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802adb200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faa44045000 tx=0x7faa44005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee21dffa2b813ed server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa2be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:28:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa2be00640 1 -- 172.21.15.40:0/2175677020 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4404a040 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa2be00640 1 -- 172.21.15.40:0/2175677020 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa44003d70 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa44036040 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa2be00640 1 -- 172.21.15.40:0/2175677020 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7faa44004280 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa57fdf740 10 client.15648 fetch_fsmap learned FSMap version 35 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.676+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560802af1d80 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa2be00640 1 -- 172.21.15.40:0/2175677020 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa44036040 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa2be00640 1 -- 172.21.15.40:0/2175677020 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7faa4404d030 con 0x56080272a520 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa57fdf740 10 client.15648 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa57fdf740 10 client.15648 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa57fdf740 20 client.15648 populate_metadata read hostname 'smithi040' 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa57fdf740 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5608026e8ea0 0x560802af50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa57fdf740 4 client.15648 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:28:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.677+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560802a47ea0 con 0x5608026e8ea0 2024-07-26T12:28:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.678+0000 7faa4a800640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5608026e8ea0 0x560802af50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.679+0000 7faa4a800640 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5608026e8ea0 0x560802af50e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8680816aa3613dcb server_cookie=b588a2a964bfd13 in_seq=0 out_seq=0 2024-07-26T12:28:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.679+0000 7faa2be00640 10 client.15648 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:05.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa2be00640 1 -- 172.21.15.40:0/2175677020 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560802a47ea0 con 0x5608026e8ea0 2024-07-26T12:28:05.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa2be00640 10 client.15648 handle_command_reply: tid=0 2024-07-26T12:28:05.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 client.15648 shutdown 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 msgr2=0x560802adb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802adb200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faa44045000 tx=0x7faa44005fd0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 shutdown_connections 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5608026e8ea0 0x560802af50e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56080272a520 0x560802adb200 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 --2- 172.21.15.40:0/2175677020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560802701660 0x560802ada780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 >> 172.21.15.40:0/2175677020 conn(0x56080271e910 msgr2=0x560802ad21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.681+0000 7faa2be00640 0 client.15648 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:05.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.682+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 shutdown_connections 2024-07-26T12:28:05.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.682+0000 7faa57fdf740 1 -- 172.21.15.40:0/2175677020 wait complete. 2024-07-26T12:28:05.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.682+0000 7faa57fdf740 20 client.15648 trim_cache size 0 max 16384 2024-07-26T12:28:05.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 Processor -- start 2024-07-26T12:28:05.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 -- start start 2024-07-26T12:28:05.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 0x560802ad6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802adb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1acbf0 con 0x560802701660 2024-07-26T12:28:05.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1ae730 con 0x56080272a520 2024-07-26T12:28:05.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.701+0000 7faa57fdf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1ad2c0 con 0x560802709840 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 0x560802ad6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 0x560802ad6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49430/0 (socket says 172.21.15.40:49430) 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4a800640 1 -- 172.21.15.40:0/382722621 learned_addr learned my addr 172.21.15.40:0/382722621 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4b200640 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802adb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa49e00640 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4a800640 1 -- 172.21.15.40:0/382722621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 msgr2=0x560802adac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4a800640 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.702+0000 7faa4a800640 1 -- 172.21.15.40:0/382722621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 msgr2=0x560802adb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.703+0000 7faa4a800640 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802adb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.703+0000 7faa4a800640 1 -- 172.21.15.40:0/382722621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560802acda90 con 0x560802701660 2024-07-26T12:28:05.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.703+0000 7faa4a800640 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 0x560802ad6270 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x560802acdc60 tx=0x7faa3c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a41a2408d3c361 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:05.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.703+0000 7faa36a00640 1 -- 172.21.15.40:0/382722621 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004020 con 0x560802701660 2024-07-26T12:28:05.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.703+0000 7faa36a00640 1 -- 172.21.15.40:0/382722621 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa3c0041c0 con 0x560802701660 2024-07-26T12:28:05.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.703+0000 7faa36a00640 1 -- 172.21.15.40:0/382722621 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c01a330 con 0x560802701660 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.704+0000 7faa57fdf740 1 -- 172.21.15.40:0/382722621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 msgr2=0x560802ad6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.704+0000 7faa57fdf740 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 0x560802ad6270 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x560802acdc60 tx=0x7faa3c005f60 comp rx=0 tx=0).stop 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.704+0000 7faa57fdf740 1 -- 172.21.15.40:0/382722621 shutdown_connections 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802adb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560802709840 0x560802adac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 --2- 172.21.15.40:0/382722621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802701660 0x560802ad6270 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 -- 172.21.15.40:0/382722621 >> 172.21.15.40:0/382722621 conn(0x56080271e910 msgr2=0x560802ada530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 -- 172.21.15.40:0/382722621 shutdown_connections 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 -- 172.21.15.40:0/382722621 wait complete. 2024-07-26T12:28:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 -- start start 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.705+0000 7faa57fdf740 1 Processor -- start 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 0x560802af00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802aed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5608026be250 0x560802aedc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1ae060 con 0x560802709840 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1ad990 con 0x56080272a520 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c1aabb0 con 0x5608026be250 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa57fdf740 10 client.0 _ll_register_callbacks cb 0x7faa44031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa4a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 0x560802af00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa4a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 0x560802af00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49432/0 (socket says 172.21.15.40:49432) 2024-07-26T12:28:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.706+0000 7faa4a800640 1 -- 172.21.15.40:0/1232668455 learned_addr learned my addr 172.21.15.40:0/1232668455 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa4a800640 1 -- 172.21.15.40:0/1232668455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5608026be250 msgr2=0x560802aedc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T12:28:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa4a800640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5608026be250 0x560802aedc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa4a800640 1 -- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 msgr2=0x560802aed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa49e00640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802aed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa4a800640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802aed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa4a800640 1 -- 172.21.15.40:0/1232668455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560802b5c630 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa49e00640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802aed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa4a800640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 0x560802af00a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7faa3c013040 tx=0x7faa3c004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a259025479f37d0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.707+0000 7faa2be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa2be00640 1 -- 172.21.15.40:0/1232668455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c003e80 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa2be00640 1 -- 172.21.15.40:0/1232668455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa3c0035f0 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3c0041c0 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa2be00640 1 -- 172.21.15.40:0/1232668455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7faa3c0037f0 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa57fdf740 10 client.15654 fetch_fsmap learned FSMap version 35 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560802b5d790 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.708+0000 7faa2be00640 1 -- 172.21.15.40:0/1232668455 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa3c0041c0 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa2be00640 1 -- 172.21.15.40:0/1232668455 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7faa3c01ab10 con 0x560802709840 2024-07-26T12:28:05.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa57fdf740 10 client.15654 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa57fdf740 10 client.15654 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa57fdf740 20 client.15654 populate_metadata read hostname 'smithi040' 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa57fdf740 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560802b5df50 0x560802b60370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa57fdf740 4 client.15654 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "999fac39", "release": true, "await": true}] 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.709+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "999fac39", "release": true, "await": true}) -- 0x560802a43940 con 0x560802b5df50 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.710+0000 7faa49e00640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560802b5df50 0x560802b60370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.711+0000 7faa49e00640 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560802b5df50 0x560802b60370 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7757d1c16fba6918 server_cookie=c831b1f4cc70ec03 in_seq=0 out_seq=0 2024-07-26T12:28:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.711+0000 7faa2be00640 10 client.15654 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:05.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.778+0000 7faa2be00640 1 -- 172.21.15.40:0/1232668455 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560802a43940 con 0x560802b5df50 2024-07-26T12:28:05.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.778+0000 7faa2be00640 10 client.15654 handle_command_reply: tid=0 2024-07-26T12:28:05.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 client.15654 shutdown 2024-07-26T12:28:05.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 msgr2=0x560802af00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 0x560802af00a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7faa3c013040 tx=0x7faa3c004400 comp rx=0 tx=0).stop 2024-07-26T12:28:05.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 shutdown_connections 2024-07-26T12:28:05.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5608026be250 0x560802aedc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56080272a520 0x560802aed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560802b5df50 0x560802b60370 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 --2- 172.21.15.40:0/1232668455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560802709840 0x560802af00a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 >> 172.21.15.40:0/1232668455 conn(0x56080271e910 msgr2=0x560802adaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:05.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.779+0000 7faa2be00640 0 client.15654 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:05.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.780+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 shutdown_connections 2024-07-26T12:28:05.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.780+0000 7faa57fdf740 1 -- 172.21.15.40:0/1232668455 wait complete. 2024-07-26T12:28:05.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.781+0000 7faa57fdf740 20 client.15654 trim_cache size 0 max 16384 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 16, 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "999fac39": { 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 16, 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:28:05.783 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:05.784 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:05.785 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:05.785 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:05.785 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:05.785 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:28:05.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.782+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa300b3ba0 msgr2=0x7faa300b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.782+0000 7faa51400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa300b3ba0 0x7faa300b60b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faa440099a0 tx=0x7faa4403e040 comp rx=0 tx=0).stop 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.782+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 msgr2=0x7faa4c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.782+0000 7faa51400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 0x7faa4c19a430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d740 tx=0x7faa3800dc00 comp rx=0 tx=0).stop 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 shutdown_connections 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa300b3ba0 0x7faa300b60b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c10d840 0x7faa4c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa4c104d30 0x7faa4c19a430 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 --2- 172.21.15.40:0/3114620284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa4c1043e0 0x7faa4c199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 >> 172.21.15.40:0/3114620284 conn(0x7faa4c079160 msgr2=0x7faa4c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 shutdown_connections 2024-07-26T12:28:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:05.783+0000 7faa51400640 1 -- 172.21.15.40:0/3114620284 wait complete. 2024-07-26T12:28:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:05 smithi146 ceph-mon[35807]: pgmap v675: 97 pgs: 97 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T12:28:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:05 smithi076 ceph-mon[35401]: pgmap v675: 97 pgs: 97 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T12:28:06.753 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '999fac39', total seconds elapsed: 19.2 2024-07-26T12:28:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:07 smithi146 ceph-mon[35807]: pgmap v676: 97 pgs: 97 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T12:28:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:07 smithi076 ceph-mon[35401]: pgmap v676: 97 pgs: 97 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T12:28:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:07 smithi040 ceph-mon[32397]: pgmap v676: 97 pgs: 97 active+clean; 547 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T12:28:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:09 smithi146 ceph-mon[35807]: pgmap v677: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T12:28:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:09 smithi076 ceph-mon[35401]: pgmap v677: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T12:28:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:09 smithi040 ceph-mon[32397]: pgmap v677: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T12:28:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:11 smithi146 ceph-mon[35807]: pgmap v678: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T12:28:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:11 smithi076 ceph-mon[35401]: pgmap v678: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T12:28:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:11 smithi040 ceph-mon[32397]: pgmap v678: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T12:28:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:13 smithi146 ceph-mon[35807]: pgmap v679: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T12:28:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:13 smithi076 ceph-mon[35401]: pgmap v679: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T12:28:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:13 smithi040 ceph-mon[32397]: pgmap v679: 97 pgs: 97 active+clean; 551 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T12:28:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:15 smithi146 ceph-mon[35807]: pgmap v680: 97 pgs: 97 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T12:28:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:15 smithi076 ceph-mon[35401]: pgmap v680: 97 pgs: 97 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T12:28:15.856 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:15 smithi040 ceph-mon[32397]: pgmap v680: 97 pgs: 97 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T12:28:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:17 smithi146 ceph-mon[35807]: pgmap v681: 97 pgs: 97 active+clean; 583 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:28:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:17 smithi076 ceph-mon[35401]: pgmap v681: 97 pgs: 97 active+clean; 583 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:28:17.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:17 smithi040 ceph-mon[32397]: pgmap v681: 97 pgs: 97 active+clean; 583 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:28:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:19 smithi146 ceph-mon[35807]: pgmap v682: 97 pgs: 97 active+clean; 587 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 MiB/s wr, 10 op/s 2024-07-26T12:28:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:19 smithi076 ceph-mon[35401]: pgmap v682: 97 pgs: 97 active+clean; 587 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 MiB/s wr, 10 op/s 2024-07-26T12:28:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:19 smithi040 ceph-mon[32397]: pgmap v682: 97 pgs: 97 active+clean; 587 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 MiB/s wr, 10 op/s 2024-07-26T12:28:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:21 smithi146 ceph-mon[35807]: pgmap v683: 97 pgs: 97 active+clean; 587 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:28:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:21 smithi076 ceph-mon[35401]: pgmap v683: 97 pgs: 97 active+clean; 587 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:28:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:21 smithi040 ceph-mon[32397]: pgmap v683: 97 pgs: 97 active+clean; 587 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:28:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:23 smithi146 ceph-mon[35807]: pgmap v684: 97 pgs: 97 active+clean; 611 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:28:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:23 smithi076 ceph-mon[35401]: pgmap v684: 97 pgs: 97 active+clean; 611 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:28:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:23 smithi040 ceph-mon[32397]: pgmap v684: 97 pgs: 97 active+clean; 611 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:28:25.325 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:28:25.325 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.95 2024-07-26T12:28:25.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:28:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:25 smithi040 ceph-mon[32397]: pgmap v685: 97 pgs: 97 active+clean; 615 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:28:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:25 smithi146 ceph-mon[35807]: pgmap v685: 97 pgs: 97 active+clean; 615 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:28:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:25 smithi076 ceph-mon[35401]: pgmap v685: 97 pgs: 97 active+clean; 615 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:28:25.851 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:27 smithi146 ceph-mon[35807]: pgmap v686: 97 pgs: 97 active+clean; 623 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:28:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:27 smithi076 ceph-mon[35401]: pgmap v686: 97 pgs: 97 active+clean; 623 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:28:27.871 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:27 smithi040 ceph-mon[32397]: pgmap v686: 97 pgs: 97 active+clean; 623 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 -- 172.21.15.40:0/3948663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077cc0 msgr2=0x7f536c113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 --2- 172.21.15.40:0/3948663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077cc0 0x7f536c113c30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5358009900 tx=0x7f535802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 -- 172.21.15.40:0/3948663215 shutdown_connections 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 --2- 172.21.15.40:0/3948663215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c114170 0x7f536c116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 --2- 172.21.15.40:0/3948663215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077cc0 0x7f536c113c30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 --2- 172.21.15.40:0/3948663215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f536c077370 0x7f536c077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.212+0000 7f5374000640 1 -- 172.21.15.40:0/3948663215 >> 172.21.15.40:0/3948663215 conn(0x7f536c101240 msgr2=0x7f536c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.213+0000 7f5374000640 1 -- 172.21.15.40:0/3948663215 shutdown_connections 2024-07-26T12:28:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.213+0000 7f5374000640 1 -- 172.21.15.40:0/3948663215 wait complete. 2024-07-26T12:28:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.214+0000 7f5374000640 1 Processor -- start 2024-07-26T12:28:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.214+0000 7f5374000640 1 -- start start 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5374000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 0x7f536c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5374000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f536c077cc0 0x7f536c1a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5374000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c114170 0x7f536c1a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5374000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1199d0 con 0x7f536c077370 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5374000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f536c119850 con 0x7f536c077cc0 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5374000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f536c119b50 con 0x7f536c114170 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5371600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 0x7f536c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5371600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 0x7f536c1a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47672/0 (socket says 172.21.15.40:47672) 2024-07-26T12:28:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5371600640 1 -- 172.21.15.40:0/791992119 learned_addr learned my addr 172.21.15.40:0/791992119 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.215+0000 7f5370c00640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f536c077cc0 0x7f536c1a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.216+0000 7f5372000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c114170 0x7f536c1a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.216+0000 7f5371600640 1 -- 172.21.15.40:0/791992119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c114170 msgr2=0x7f536c1a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.216+0000 7f5371600640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c114170 0x7f536c1a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.216+0000 7f5371600640 1 -- 172.21.15.40:0/791992119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f536c077cc0 msgr2=0x7f536c1a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.216+0000 7f5371600640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f536c077cc0 0x7f536c1a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.216+0000 7f5371600640 1 -- 172.21.15.40:0/791992119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c1a63b0 con 0x7f536c077370 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.217+0000 7f5371600640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 0x7f536c1a0440 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f536000db80 tx=0x7f536000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.217+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360017070 con 0x7f536c077370 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.217+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5360004020 con 0x7f536c077370 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.217+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536c1a66a0 con 0x7f536c077370 2024-07-26T12:28:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.217+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536000be60 con 0x7f536c077370 2024-07-26T12:28:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.217+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f536c1ace00 con 0x7f536c077370 2024-07-26T12:28:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.219+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536c077780 con 0x7f536c077370 2024-07-26T12:28:28.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.223+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5360003b70 con 0x7f536c077370 2024-07-26T12:28:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.225+0000 7f536a000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53540b3c50 0x7f53540b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.225+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f53600e4000 con 0x7f536c077370 2024-07-26T12:28:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.225+0000 7f5370c00640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53540b3c50 0x7f53540b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.226+0000 7f5370c00640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53540b3c50 0x7f53540b6160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f535802a910 tx=0x7f5358005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.228+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f53600ab6d0 con 0x7f536c077370 2024-07-26T12:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.506+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f536c02e0c0 con 0x7f536c077370 2024-07-26T12:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.508+0000 7f536a000640 1 -- 172.21.15.40:0/791992119 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f53600aafd0 con 0x7f536c077370 2024-07-26T12:28:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:28:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.511+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53540b3c50 msgr2=0x7f53540b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.511+0000 7f5374000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53540b3c50 0x7f53540b6160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f535802a910 tx=0x7f5358005a40 comp rx=0 tx=0).stop 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.511+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 msgr2=0x7f536c1a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.511+0000 7f5374000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 0x7f536c1a0440 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f536000db80 tx=0x7f536000b630 comp rx=0 tx=0).stop 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 shutdown_connections 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53540b3c50 0x7f53540b6160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c114170 0x7f536c1a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f536c077cc0 0x7f536c1a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 --2- 172.21.15.40:0/791992119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f536c077370 0x7f536c1a0440 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 >> 172.21.15.40:0/791992119 conn(0x7f536c101240 msgr2=0x7f536c116260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:28.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 shutdown_connections 2024-07-26T12:28:28.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:28.512+0000 7f5374000640 1 -- 172.21.15.40:0/791992119 wait complete. 2024-07-26T12:28:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:28 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/791992119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:28.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:28 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/791992119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:28 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/791992119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:29.505 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0' 2024-07-26T12:28:29.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0 2024-07-26T12:28:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:29 smithi076 ceph-mon[35401]: pgmap v687: 97 pgs: 97 active+clean; 643 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:29 smithi040 ceph-mon[32397]: pgmap v687: 97 pgs: 97 active+clean; 643 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:30.029 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:29 smithi146 ceph-mon[35807]: pgmap v687: 97 pgs: 97 active+clean; 643 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:31.845 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:31 smithi040 ceph-mon[32397]: pgmap v688: 97 pgs: 97 active+clean; 647 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:28:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:31 smithi146 ceph-mon[35807]: pgmap v688: 97 pgs: 97 active+clean; 647 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:28:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:31 smithi076 ceph-mon[35401]: pgmap v688: 97 pgs: 97 active+clean; 647 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:28:32.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 -- 172.21.15.40:0/1625697723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c102960 msgr2=0x7fcc3c106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1625697723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c102960 0x7fcc3c106e90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009930 tx=0x7fcc2802a420 comp rx=0 tx=0).stop 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 -- 172.21.15.40:0/1625697723 shutdown_connections 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1625697723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c107450 0x7fcc3c107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1625697723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c102960 0x7fcc3c106e90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1625697723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc3c102010 0x7fcc3c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 -- 172.21.15.40:0/1625697723 >> 172.21.15.40:0/1625697723 conn(0x7fcc3c0fdd60 msgr2=0x7fcc3c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 -- 172.21.15.40:0/1625697723 shutdown_connections 2024-07-26T12:28:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.251+0000 7fcc40c00640 1 -- 172.21.15.40:0/1625697723 wait complete. 2024-07-26T12:28:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.253+0000 7fcc40c00640 1 Processor -- start 2024-07-26T12:28:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.253+0000 7fcc40c00640 1 -- start start 2024-07-26T12:28:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc40c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 0x7fcc3c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc40c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c107450 0x7fcc3c1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc40c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc3c1a5b90 0x7fcc3c1a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc40c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1197a0 con 0x7fcc3c107450 2024-07-26T12:28:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc40c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c119620 con 0x7fcc3c102010 2024-07-26T12:28:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc40c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c119920 con 0x7fcc3c1a5b90 2024-07-26T12:28:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 0x7fcc3c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 0x7fcc3c1a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:42910/0 (socket says 172.21.15.40:42910) 2024-07-26T12:28:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc3b400640 1 -- 172.21.15.40:0/1052072912 learned_addr learned my addr 172.21.15.40:0/1052072912 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.254+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c107450 0x7fcc3c1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.255+0000 7fcc3be00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc3c1a5b90 0x7fcc3c1a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.255+0000 7fcc3b400640 1 -- 172.21.15.40:0/1052072912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc3c1a5b90 msgr2=0x7fcc3c1a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.255+0000 7fcc3b400640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc3c1a5b90 0x7fcc3c1a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.255+0000 7fcc3b400640 1 -- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c107450 msgr2=0x7fcc3c1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.255+0000 7fcc3b400640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c107450 0x7fcc3c1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.255+0000 7fcc3b400640 1 -- 172.21.15.40:0/1052072912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3c1a66e0 con 0x7fcc3c102010 2024-07-26T12:28:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.256+0000 7fcc3b400640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 0x7fcc3c1a0410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c920 tx=0x7fcc2c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.256+0000 7fcc33e00640 1 -- 172.21.15.40:0/1052072912 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c007c70 con 0x7fcc3c102010 2024-07-26T12:28:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.256+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3c1a69d0 con 0x7fcc3c102010 2024-07-26T12:28:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.257+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c1ad0a0 con 0x7fcc3c102010 2024-07-26T12:28:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.257+0000 7fcc33e00640 1 -- 172.21.15.40:0/1052072912 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc2c007e10 con 0x7fcc3c102010 2024-07-26T12:28:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.257+0000 7fcc33e00640 1 -- 172.21.15.40:0/1052072912 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c004e20 con 0x7fcc3c102010 2024-07-26T12:28:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.260+0000 7fcc48dbf740 1 Processor -- start 2024-07-26T12:28:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 -- start start 2024-07-26T12:28:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a732480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a7329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a732f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b17a6a68a0 con 0x55b17a362990 2024-07-26T12:28:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b17a695da0 con 0x55b17a38b850 2024-07-26T12:28:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.261+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b17a699de0 con 0x55b17a36ab70 2024-07-26T12:28:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.262+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a732480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.262+0000 7fcc3aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a732f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.262+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a732480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:42912/0 (socket says 172.21.15.40:42912) 2024-07-26T12:28:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.262+0000 7fcc3be00640 1 -- 172.21.15.40:0/1240236627 learned_addr learned my addr 172.21.15.40:0/1240236627 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.263+0000 7fcc3aa00640 1 -- 172.21.15.40:0/1240236627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 msgr2=0x55b17a732480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.263+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a732480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.263+0000 7fcc3aa00640 1 -- 172.21.15.40:0/1240236627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 msgr2=0x55b17a7329c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T12:28:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.263+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a7329c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.263+0000 7fcc3aa00640 1 -- 172.21.15.40:0/1240236627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17a62ab70 con 0x55b17a36ab70 2024-07-26T12:28:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.263+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a732f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c06b690 tx=0x7fcc28031cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a69b242d8d9379 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:32.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.264+0000 7fcc27e00640 1 -- 172.21.15.40:0/1240236627 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28040070 con 0x55b17a36ab70 2024-07-26T12:28:32.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.264+0000 7fcc27e00640 1 -- 172.21.15.40:0/1240236627 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc280044c0 con 0x55b17a36ab70 2024-07-26T12:28:32.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.264+0000 7fcc27e00640 1 -- 172.21.15.40:0/1240236627 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035040 con 0x55b17a36ab70 2024-07-26T12:28:32.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.264+0000 7fcc33e00640 1 -- 172.21.15.40:0/1052072912 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcc2c004fc0 con 0x7fcc3c102010 2024-07-26T12:28:32.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1240236627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 msgr2=0x55b17a732f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a732f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c06b690 tx=0x7fcc28031cb0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1240236627 shutdown_connections 2024-07-26T12:28:32.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a732f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a7329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1240236627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a732480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1240236627 >> 172.21.15.40:0/1240236627 conn(0x55b17a37fc40 msgr2=0x55b17a730370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.265+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1240236627 shutdown_connections 2024-07-26T12:28:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.266+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1240236627 wait complete. 2024-07-26T12:28:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.266+0000 7fcc33e00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcc200b3b50 0x7fcc200b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.266+0000 7fcc48dbf740 1 -- start start 2024-07-26T12:28:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.266+0000 7fcc33e00640 1 -- 172.21.15.40:0/1052072912 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc2c0e3ce0 con 0x7fcc3c102010 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.266+0000 7fcc3be00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcc200b3b50 0x7fcc200b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 Processor -- start 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a73e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a749ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b17a4f97b0 con 0x55b17a362990 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b17a632380 con 0x55b17a38b850 2024-07-26T12:28:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.267+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b17a740c00 con 0x55b17a36ab70 2024-07-26T12:28:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3be00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcc200b3b50 0x7fcc200b6060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc34009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc48dbf740 10 client.0 _ll_register_callbacks cb 0x55b17a641830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a73e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a73e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47684/0 (socket says 172.21.15.40:47684) 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 -- 172.21.15.40:0/1832187933 learned_addr learned my addr 172.21.15.40:0/1832187933 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3be00640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a749ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 -- 172.21.15.40:0/1832187933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 msgr2=0x55b17a73e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 -- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 msgr2=0x55b17a749ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a749ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.268+0000 7fcc3b400640 1 -- 172.21.15.40:0/1832187933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17a405ba0 con 0x55b17a362990 2024-07-26T12:28:32.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.269+0000 7fcc3b400640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a73e0c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0a6c70 tx=0x7fcc2c0aa7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5a086c10580cad server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.269+0000 7fcc24c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.269+0000 7fcc24c00640 1 -- 172.21.15.40:0/1832187933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0af1f0 con 0x55b17a362990 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.269+0000 7fcc24c00640 1 -- 172.21.15.40:0/1832187933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc2c0b3810 con 0x55b17a362990 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.269+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b17a6a87f0 con 0x55b17a362990 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.270+0000 7fcc24c00640 1 -- 172.21.15.40:0/1832187933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcc2c0b3ca0 con 0x55b17a362990 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.270+0000 7fcc48dbf740 10 client.15669 fetch_fsmap learned FSMap version 35 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.270+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b17a74cc10 con 0x55b17a362990 2024-07-26T12:28:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.270+0000 7fcc24c00640 1 -- 172.21.15.40:0/1832187933 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b17a6a87f0 con 0x55b17a362990 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.270+0000 7fcc24c00640 1 -- 172.21.15.40:0/1832187933 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fcc2c090ce0 con 0x55b17a362990 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc48dbf740 10 client.15669 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc48dbf740 10 client.15669 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc48dbf740 20 client.15669 populate_metadata read hostname 'smithi040' 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a34a1d0 0x55b17a7500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc48dbf740 4 client.15669 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b17a6a4290 con 0x55b17a34a1d0 2024-07-26T12:28:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.271+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a34a1d0 0x55b17a7500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.272+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a34a1d0 0x55b17a7500e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1036126e5b3cd09 server_cookie=f6528954f026005f in_seq=0 out_seq=0 2024-07-26T12:28:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.272+0000 7fcc24c00640 10 client.15669 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:32.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.274+0000 7fcc24c00640 1 -- 172.21.15.40:0/1832187933 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b17a6a4290 con 0x55b17a34a1d0 2024-07-26T12:28:32.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.274+0000 7fcc24c00640 10 client.15669 handle_command_reply: tid=0 2024-07-26T12:28:32.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.274+0000 7fcc48dbf740 1 client.15669 shutdown 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 msgr2=0x55b17a73e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a73e0c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0a6c70 tx=0x7fcc2c0aa7c0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 shutdown_connections 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a38b850 0x55b17a749ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a34a1d0 0x55b17a7500e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/1832187933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a362990 0x55b17a73e0c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc24c00640 0 client.15669 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 >> 172.21.15.40:0/1832187933 conn(0x55b17a37fc40 msgr2=0x55b17a735660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 shutdown_connections 2024-07-26T12:28:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 1 -- 172.21.15.40:0/1832187933 wait complete. 2024-07-26T12:28:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.275+0000 7fcc48dbf740 20 client.15669 trim_cache size 0 max 16384 2024-07-26T12:28:32.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.294+0000 7fcc48dbf740 1 Processor -- start 2024-07-26T12:28:32.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.294+0000 7fcc48dbf740 1 -- start start 2024-07-26T12:28:32.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.294+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a362990 0x55b17a72f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.294+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a749ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b56b0 con 0x55b17a38b850 2024-07-26T12:28:32.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b71f0 con 0x55b17a362990 2024-07-26T12:28:32.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b5d80 con 0x55b17a36ab70 2024-07-26T12:28:32.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a749ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a749ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47686/0 (socket says 172.21.15.40:47686) 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc3be00640 1 -- 172.21.15.40:0/2511484246 learned_addr learned my addr 172.21.15.40:0/2511484246 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.295+0000 7fcc3b400640 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a362990 0x55b17a72f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.296+0000 7fcc3be00640 1 -- 172.21.15.40:0/2511484246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 msgr2=0x55b17a73d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.296+0000 7fcc3be00640 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.296+0000 7fcc3be00640 1 -- 172.21.15.40:0/2511484246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a362990 msgr2=0x55b17a72f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.296+0000 7fcc3be00640 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a362990 0x55b17a72f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.296+0000 7fcc3be00640 1 -- 172.21.15.40:0/2511484246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17a7352e0 con 0x55b17a38b850 2024-07-26T12:28:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.296+0000 7fcc3be00640 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a749ce0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcc34011840 tx=0x7fcc34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97bbf3370a0716e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.297+0000 7fcc27400640 1 -- 172.21.15.40:0/2511484246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc340219b0 con 0x55b17a38b850 2024-07-26T12:28:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.297+0000 7fcc27400640 1 -- 172.21.15.40:0/2511484246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc3401d420 con 0x55b17a38b850 2024-07-26T12:28:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.297+0000 7fcc27400640 1 -- 172.21.15.40:0/2511484246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34029620 con 0x55b17a38b850 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 -- 172.21.15.40:0/2511484246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 msgr2=0x55b17a749ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a749ce0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcc34011840 tx=0x7fcc34016000 comp rx=0 tx=0).stop 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 -- 172.21.15.40:0/2511484246 shutdown_connections 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a749ce0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a36ab70 0x55b17a73d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/2511484246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a362990 0x55b17a72f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 -- 172.21.15.40:0/2511484246 >> 172.21.15.40:0/2511484246 conn(0x55b17a37fc40 msgr2=0x55b17a730300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 -- 172.21.15.40:0/2511484246 shutdown_connections 2024-07-26T12:28:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.298+0000 7fcc48dbf740 1 -- 172.21.15.40:0/2511484246 wait complete. 2024-07-26T12:28:32.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.299+0000 7fcc48dbf740 1 -- start start 2024-07-26T12:28:32.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.299+0000 7fcc48dbf740 1 Processor -- start 2024-07-26T12:28:32.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a362990 0x55b17a742000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a36ab70 0x55b17a742540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a7b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b6b20 con 0x55b17a38b850 2024-07-26T12:28:32.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b6450 con 0x55b17a36ab70 2024-07-26T12:28:32.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b3670 con 0x55b17a362990 2024-07-26T12:28:32.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc48dbf740 10 client.0 _ll_register_callbacks cb 0x7fcc2c0aa3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:28:32.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a7b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a7b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47694/0 (socket says 172.21.15.40:47694) 2024-07-26T12:28:32.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc3be00640 1 -- 172.21.15.40:0/757950397 learned_addr learned my addr 172.21.15.40:0/757950397 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:32.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc3b400640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a362990 0x55b17a742000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.300+0000 7fcc3aa00640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a36ab70 0x55b17a742540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc3be00640 1 -- 172.21.15.40:0/757950397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a362990 msgr2=0x55b17a742000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc3be00640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a362990 0x55b17a742000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc3be00640 1 -- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a36ab70 msgr2=0x55b17a742540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc3be00640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a36ab70 0x55b17a742540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc3be00640 1 -- 172.21.15.40:0/757950397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17a730ce0 con 0x55b17a38b850 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc3be00640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a7b78c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcc3401d9e0 tx=0x7fcc3401da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a5c8ea6bfbe53 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.301+0000 7fcc24c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:28:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.302+0000 7fcc24c00640 1 -- 172.21.15.40:0/757950397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34038020 con 0x55b17a38b850 2024-07-26T12:28:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.302+0000 7fcc24c00640 1 -- 172.21.15.40:0/757950397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc34004a40 con 0x55b17a38b850 2024-07-26T12:28:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.302+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc3401d420 con 0x55b17a38b850 2024-07-26T12:28:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.302+0000 7fcc24c00640 1 -- 172.21.15.40:0/757950397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcc34004c40 con 0x55b17a38b850 2024-07-26T12:28:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.302+0000 7fcc48dbf740 10 client.15675 fetch_fsmap learned FSMap version 35 2024-07-26T12:28:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.302+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b17a7b8c40 con 0x55b17a38b850 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc24c00640 1 -- 172.21.15.40:0/757950397 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc3401d420 con 0x55b17a38b850 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc24c00640 1 -- 172.21.15.40:0/757950397 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fcc34028070 con 0x55b17a38b850 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc48dbf740 10 client.15675 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc48dbf740 10 client.15675 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc48dbf740 20 client.15675 populate_metadata read hostname 'smithi040' 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a31f580 0x55b17a7bb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc48dbf740 4 client.15675 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}] 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.303+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}) -- 0x55b17a6a19d0 con 0x55b17a31f580 2024-07-26T12:28:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.304+0000 7fcc3b400640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a31f580 0x55b17a7bb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:32.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.305+0000 7fcc3b400640 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a31f580 0x55b17a7bb3b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4d1c6643d62c01 server_cookie=da101955c5a1c507 in_seq=0 out_seq=0 2024-07-26T12:28:32.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.305+0000 7fcc24c00640 10 client.15675 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:32.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.563+0000 7fcc24c00640 1 -- 172.21.15.40:0/757950397 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b17a6a19d0 con 0x55b17a31f580 2024-07-26T12:28:32.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.563+0000 7fcc24c00640 10 client.15675 handle_command_reply: tid=0 2024-07-26T12:28:32.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.563+0000 7fcc48dbf740 1 client.15675 shutdown 2024-07-26T12:28:32.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 msgr2=0x55b17a7b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a7b78c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcc3401d9e0 tx=0x7fcc3401da10 comp rx=0 tx=0).stop 2024-07-26T12:28:32.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 shutdown_connections 2024-07-26T12:28:32.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b17a31f580 0x55b17a7bb3b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b17a38b850 0x55b17a7b78c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b17a36ab70 0x55b17a742540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 --2- 172.21.15.40:0/757950397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b17a362990 0x55b17a742000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 >> 172.21.15.40:0/757950397 conn(0x55b17a37fc40 msgr2=0x55b17a72f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:32.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.564+0000 7fcc24c00640 0 client.15675 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:32.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.565+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 shutdown_connections 2024-07-26T12:28:32.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.565+0000 7fcc48dbf740 1 -- 172.21.15.40:0/757950397 wait complete. 2024-07-26T12:28:32.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.565+0000 7fcc48dbf740 20 client.15675 trim_cache size 0 max 16384 2024-07-26T12:28:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:28:32.568 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:28:32.568 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:28:32.568 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 18, 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "7725ded9": { 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 18, 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.9, 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:28:32.569 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.566+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcc200b3b50 msgr2=0x7fcc200b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.566+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcc200b3b50 0x7fcc200b6060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc34009600 comp rx=0 tx=0).stop 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.566+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 msgr2=0x7fcc3c1a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.566+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 0x7fcc3c1a0410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c920 tx=0x7fcc2c00cde0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 shutdown_connections 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcc200b3b50 0x7fcc200b6060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc3c1a5b90 0x7fcc3c1a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3c107450 0x7fcc3c1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 --2- 172.21.15.40:0/1052072912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc3c102010 0x7fcc3c1a0410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 >> 172.21.15.40:0/1052072912 conn(0x7fcc3c0fdd60 msgr2=0x7fcc3c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 shutdown_connections 2024-07-26T12:28:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:32.567+0000 7fcc40c00640 1 -- 172.21.15.40:0/1052072912 wait complete. 2024-07-26T12:28:33.416 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7725ded9', quiesce took 8.1 seconds. Will release after: 13.85 2024-07-26T12:28:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:33 smithi040 ceph-mon[32397]: pgmap v689: 97 pgs: 97 active+clean; 651 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:28:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:33 smithi146 ceph-mon[35807]: pgmap v689: 97 pgs: 97 active+clean; 651 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:28:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:33 smithi076 ceph-mon[35401]: pgmap v689: 97 pgs: 97 active+clean; 651 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:28:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:35 smithi040 ceph-mon[32397]: pgmap v690: 97 pgs: 97 active+clean; 675 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:28:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:35 smithi146 ceph-mon[35807]: pgmap v690: 97 pgs: 97 active+clean; 675 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:28:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:35 smithi076 ceph-mon[35401]: pgmap v690: 97 pgs: 97 active+clean; 675 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:28:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:37 smithi040 ceph-mon[32397]: pgmap v691: 97 pgs: 97 active+clean; 675 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:37 smithi146 ceph-mon[35807]: pgmap v691: 97 pgs: 97 active+clean; 675 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:37 smithi076 ceph-mon[35401]: pgmap v691: 97 pgs: 97 active+clean; 675 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:39 smithi040 ceph-mon[32397]: pgmap v692: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:39 smithi146 ceph-mon[35807]: pgmap v692: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:39 smithi076 ceph-mon[35401]: pgmap v692: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:28:41.872 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:41 smithi146 ceph-mon[35807]: pgmap v693: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:28:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:41 smithi040 ceph-mon[32397]: pgmap v693: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:28:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:41 smithi076 ceph-mon[35401]: pgmap v693: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:28:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:43 smithi040 ceph-mon[32397]: pgmap v694: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:28:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:43 smithi146 ceph-mon[35807]: pgmap v694: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:28:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:43 smithi076 ceph-mon[35401]: pgmap v694: 97 pgs: 97 active+clean; 683 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:28:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:45 smithi040 ceph-mon[32397]: pgmap v695: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:28:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:45 smithi146 ceph-mon[35807]: pgmap v695: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:28:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:45 smithi076 ceph-mon[35401]: pgmap v695: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:28:47.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:28:47.763 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:47.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:47 smithi040 ceph-mon[32397]: pgmap v696: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 772 KiB/s wr, 10 op/s 2024-07-26T12:28:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:47 smithi146 ceph-mon[35807]: pgmap v696: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 772 KiB/s wr, 10 op/s 2024-07-26T12:28:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:47 smithi076 ceph-mon[35401]: pgmap v696: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 772 KiB/s wr, 10 op/s 2024-07-26T12:28:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:49 smithi040 ceph-mon[32397]: pgmap v697: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 772 KiB/s wr, 10 op/s 2024-07-26T12:28:49.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 -- 172.21.15.40:0/2994640935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c80751e0 msgr2=0x7ff0c80755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:49.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2994640935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c80751e0 0x7ff0c80755f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009900 tx=0x7ff0bc02a410 comp rx=0 tx=0).stop 2024-07-26T12:28:49.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 -- 172.21.15.40:0/2994640935 shutdown_connections 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2994640935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c810f920 0x7ff0c8111d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2994640935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c8075b30 0x7ff0c810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2994640935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c80751e0 0x7ff0c80755f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 -- 172.21.15.40:0/2994640935 >> 172.21.15.40:0/2994640935 conn(0x7ff0c80fee10 msgr2=0x7ff0c8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 -- 172.21.15.40:0/2994640935 shutdown_connections 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.973+0000 7ff0ce800640 1 -- 172.21.15.40:0/2994640935 wait complete. 2024-07-26T12:28:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 Processor -- start 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 -- start start 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c80751e0 0x7ff0c819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8075b30 0x7ff0c819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 0x7ff0c81a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c8115360 con 0x7ff0c810f920 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c81151e0 con 0x7ff0c80751e0 2024-07-26T12:28:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.975+0000 7ff0ce800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c81154e0 con 0x7ff0c8075b30 2024-07-26T12:28:49.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 0x7ff0c81a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:49.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 0x7ff0c81a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33162/0 (socket says 172.21.15.40:33162) 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 -- 172.21.15.40:0/2125658467 learned_addr learned my addr 172.21.15.40:0/2125658467 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cca00640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8075b30 0x7ff0c819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cd400640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c80751e0 0x7ff0c819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 -- 172.21.15.40:0/2125658467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8075b30 msgr2=0x7ff0c819c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8075b30 0x7ff0c819c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 -- 172.21.15.40:0/2125658467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c80751e0 msgr2=0x7ff0c819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c80751e0 0x7ff0c819bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cde00640 1 -- 172.21.15.40:0/2125658467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c81a1d40 con 0x7ff0c810f920 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.976+0000 7ff0cd400640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c80751e0 0x7ff0c819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:28:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.977+0000 7ff0cde00640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 0x7ff0c81a1610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000eaa0 tx=0x7ff0c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:49.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.977+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000cdb0 con 0x7ff0c810f920 2024-07-26T12:28:49.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.977+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c0005020 con 0x7ff0c810f920 2024-07-26T12:28:49.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.977+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00116d0 con 0x7ff0c810f920 2024-07-26T12:28:49.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.977+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c81a2030 con 0x7ff0c810f920 2024-07-26T12:28:49.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.977+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c81a8790 con 0x7ff0c810f920 2024-07-26T12:28:49.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.979+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c80755f0 con 0x7ff0c810f920 2024-07-26T12:28:49.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.982+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff0c00051d0 con 0x7ff0c810f920 2024-07-26T12:28:49.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.983+0000 7ff0c6000640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0b00b3bd0 0x7ff0b00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:49.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.984+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff0c00e42e0 con 0x7ff0c810f920 2024-07-26T12:28:49.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.984+0000 7ff0cd400640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0b00b3bd0 0x7ff0b00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:49.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.985+0000 7ff0cd400640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0b00b3bd0 0x7ff0b00b60e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc000c00 tx=0x7ff0bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:49.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:49.985+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff0c0016030 con 0x7ff0c810f920 2024-07-26T12:28:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:49 smithi146 ceph-mon[35807]: pgmap v697: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 772 KiB/s wr, 10 op/s 2024-07-26T12:28:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:49 smithi076 ceph-mon[35401]: pgmap v697: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 772 KiB/s wr, 10 op/s 2024-07-26T12:28:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.227+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0c819cf00 con 0x7ff0c810f920 2024-07-26T12:28:50.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.228+0000 7ff0c6000640 1 -- 172.21.15.40:0/2125658467 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ff0c00ab8f0 con 0x7ff0c810f920 2024-07-26T12:28:50.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:28:50.231 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:28:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:28:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.231+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0b00b3bd0 msgr2=0x7ff0b00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:50.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.231+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0b00b3bd0 0x7ff0b00b60e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc000c00 tx=0x7ff0bc005a20 comp rx=0 tx=0).stop 2024-07-26T12:28:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 msgr2=0x7ff0c81a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 0x7ff0c81a1610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000eaa0 tx=0x7ff0c000ef60 comp rx=0 tx=0).stop 2024-07-26T12:28:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 shutdown_connections 2024-07-26T12:28:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0c810f920 0x7ff0c81a1610 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff0b00b3bd0 0x7ff0b00b60e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:50.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8075b30 0x7ff0c819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:50.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 --2- 172.21.15.40:0/2125658467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0c80751e0 0x7ff0c819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:50.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 >> 172.21.15.40:0/2125658467 conn(0x7ff0c80fee10 msgr2=0x7ff0c8109500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:50.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 shutdown_connections 2024-07-26T12:28:50.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:50.232+0000 7ff0ce800640 1 -- 172.21.15.40:0/2125658467 wait complete. 2024-07-26T12:28:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:50 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2125658467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:50 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2125658467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:50 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2125658467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:51.211 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 7725ded9 --release --await' 2024-07-26T12:28:51.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 7725ded9 --release --await 2024-07-26T12:28:51.707 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:51 smithi040 ceph-mon[32397]: pgmap v698: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 89 KiB/s wr, 11 op/s 2024-07-26T12:28:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:51 smithi146 ceph-mon[35807]: pgmap v698: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 89 KiB/s wr, 11 op/s 2024-07-26T12:28:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:51 smithi076 ceph-mon[35401]: pgmap v698: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 89 KiB/s wr, 11 op/s 2024-07-26T12:28:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:53 smithi040 ceph-mon[32397]: pgmap v699: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 89 KiB/s wr, 8 op/s 2024-07-26T12:28:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 -- 172.21.15.40:0/398337933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010f520 msgr2=0x7f680010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 --2- 172.21.15.40:0/398337933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010f520 0x7f680010f930 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009900 tx=0x7f67ec02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 -- 172.21.15.40:0/398337933 shutdown_connections 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 --2- 172.21.15.40:0/398337933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f680010fe70 0x7f68001166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 --2- 172.21.15.40:0/398337933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010f520 0x7f680010f930 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 --2- 172.21.15.40:0/398337933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6800109be0 0x7f6800109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 -- 172.21.15.40:0/398337933 >> 172.21.15.40:0/398337933 conn(0x7f6800077b10 msgr2=0x7f6800107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 -- 172.21.15.40:0/398337933 shutdown_connections 2024-07-26T12:28:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.005+0000 7f6807a00640 1 -- 172.21.15.40:0/398337933 wait complete. 2024-07-26T12:28:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.006+0000 7f6807a00640 1 Processor -- start 2024-07-26T12:28:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.006+0000 7f6807a00640 1 -- start start 2024-07-26T12:28:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6807a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800109be0 0x7f68001a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6807a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f680010f520 0x7f68001a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6807a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 0x7f68001a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6807a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6800119a50 con 0x7f680010fe70 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6807a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68001198d0 con 0x7f680010f520 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6807a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6800119bd0 con 0x7f6800109be0 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 0x7f68001a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 0x7f68001a5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41442/0 (socket says 172.21.15.40:41442) 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6805a00640 1 -- 172.21.15.40:0/1445979403 learned_addr learned my addr 172.21.15.40:0/1445979403 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f6805000640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800109be0 0x7f68001a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.007+0000 7f67ffe00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f680010f520 0x7f68001a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f6805a00640 1 -- 172.21.15.40:0/1445979403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800109be0 msgr2=0x7f68001a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f6805a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800109be0 0x7f68001a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f6805a00640 1 -- 172.21.15.40:0/1445979403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f680010f520 msgr2=0x7f68001a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f6805a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f680010f520 0x7f68001a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f6805a00640 1 -- 172.21.15.40:0/1445979403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68001a6410 con 0x7f680010fe70 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f67ffe00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f680010f520 0x7f68001a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.008+0000 7f6805a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 0x7f68001a5ce0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f67f800b970 tx=0x7f67f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.009+0000 7f67fd600640 1 -- 172.21.15.40:0/1445979403 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8019070 con 0x7f680010fe70 2024-07-26T12:28:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.009+0000 7f67fd600640 1 -- 172.21.15.40:0/1445979403 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f8014440 con 0x7f680010fe70 2024-07-26T12:28:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.009+0000 7f67fd600640 1 -- 172.21.15.40:0/1445979403 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80075d0 con 0x7f680010fe70 2024-07-26T12:28:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.009+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68001a6700 con 0x7f680010fe70 2024-07-26T12:28:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.009+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68001ace60 con 0x7f680010fe70 2024-07-26T12:28:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.013+0000 7f680e618740 1 Processor -- start 2024-07-26T12:28:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.013+0000 7f67fd600640 1 -- 172.21.15.40:0/1445979403 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f67f801c070 con 0x7f680010fe70 2024-07-26T12:28:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 -- start start 2024-07-26T12:28:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3ddb520 0x564ff417ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4180520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 0x564ff4180a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564ff40f6f50 con 0x564ff3dba840 2024-07-26T12:28:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564ff40e6450 con 0x564ff3ddb520 2024-07-26T12:28:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.014+0000 7f680e618740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564ff40ea490 con 0x564ff3db2660 2024-07-26T12:28:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 0x564ff4180a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 0x564ff4180a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41458/0 (socket says 172.21.15.40:41458) 2024-07-26T12:28:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 -- 172.21.15.40:0/651221075 learned_addr learned my addr 172.21.15.40:0/651221075 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3ddb520 0x564ff417ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f6805000640 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4180520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 -- 172.21.15.40:0/651221075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 msgr2=0x564ff4180520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4180520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 -- 172.21.15.40:0/651221075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3ddb520 msgr2=0x564ff417ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3ddb520 0x564ff417ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.015+0000 7f67ffe00640 1 -- 172.21.15.40:0/651221075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff3e46b00 con 0x564ff3dba840 2024-07-26T12:28:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f67ffe00640 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 0x564ff4180a60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f680006c450 tx=0x7f67ec005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171d7027bee73ced server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f67fd600640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67e80b3bd0 0x7f67e80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f67f2000640 1 -- 172.21.15.40:0/651221075 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec041070 con 0x564ff3dba840 2024-07-26T12:28:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f67fd600640 1 -- 172.21.15.40:0/1445979403 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f67f80e3270 con 0x7f680010fe70 2024-07-26T12:28:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f67f2000640 1 -- 172.21.15.40:0/651221075 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67ec045070 con 0x564ff3dba840 2024-07-26T12:28:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f67f2000640 1 -- 172.21.15.40:0/651221075 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec035050 con 0x564ff3dba840 2024-07-26T12:28:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.016+0000 7f6805000640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67e80b3bd0 0x7f67e80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.017+0000 7f680e618740 1 -- 172.21.15.40:0/651221075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 msgr2=0x564ff4180a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.017+0000 7f6805000640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67e80b3bd0 0x7f67e80b60e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67f4005fd0 tx=0x7f67f4005f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.017+0000 7f680e618740 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 0x564ff4180a60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f680006c450 tx=0x7f67ec005d50 comp rx=0 tx=0).stop 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 -- 172.21.15.40:0/651221075 shutdown_connections 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3dba840 0x564ff4180a60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4180520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 --2- 172.21.15.40:0/651221075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3ddb520 0x564ff417ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 -- 172.21.15.40:0/651221075 >> 172.21.15.40:0/651221075 conn(0x564ff3dcf910 msgr2=0x564ff417ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 -- 172.21.15.40:0/651221075 shutdown_connections 2024-07-26T12:28:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.018+0000 7f680e618740 1 -- 172.21.15.40:0/651221075 wait complete. 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.019+0000 7f680e618740 1 -- start start 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.019+0000 7f680e618740 1 Processor -- start 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff418b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff418bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff4197a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564ff3f49bb0 con 0x564ff3ddb520 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564ff4082930 con 0x564ff3dba840 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564ff418e760 con 0x564ff3db2660 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f680e618740 10 client.0 _ll_register_callbacks cb 0x564ff3df2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff4197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff4197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41466/0 (socket says 172.21.15.40:41466) 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 -- 172.21.15.40:0/1373353758 learned_addr learned my addr 172.21.15.40:0/1373353758 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f67ffe00640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff418bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805000640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff418b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 -- 172.21.15.40:0/1373353758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 msgr2=0x564ff418b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff418b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 -- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 msgr2=0x564ff418bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff418bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.020+0000 7f6805a00640 1 -- 172.21.15.40:0/1373353758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff3ebd960 con 0x564ff3ddb520 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f6805a00640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff4197a80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f67f80a6200 tx=0x7f67f80aa940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4a89650fdbbe20 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f67e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f67e6a00640 1 -- 172.21.15.40:0/1373353758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80b3230 con 0x564ff3ddb520 2024-07-26T12:28:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f67e6a00640 1 -- 172.21.15.40:0/1373353758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f67f80b2da0 con 0x564ff3ddb520 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67ec045070 con 0x564ff3ddb520 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f67e6a00640 1 -- 172.21.15.40:0/1373353758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f67f80b2fa0 con 0x564ff3ddb520 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f680e618740 10 client.15693 fetch_fsmap learned FSMap version 35 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.021+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564ff419a500 con 0x564ff3ddb520 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f67e6a00640 1 -- 172.21.15.40:0/1373353758 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67ec045070 con 0x564ff3ddb520 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f67e6a00640 1 -- 172.21.15.40:0/1373353758 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f67f80b1b90 con 0x564ff3ddb520 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f680e618740 10 client.15693 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f680e618740 10 client.15693 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:28:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f680e618740 20 client.15693 populate_metadata read hostname 'smithi040' 2024-07-26T12:28:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f680e618740 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d99ea0 0x564ff419da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f680e618740 4 client.15693 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:28:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.022+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ff40f8ea0 con 0x564ff3d99ea0 2024-07-26T12:28:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.023+0000 7f6805000640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d99ea0 0x564ff419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.024+0000 7f6805000640 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d99ea0 0x564ff419da70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2150286d25dc1bfa server_cookie=cd809e9db85bd54f in_seq=0 out_seq=0 2024-07-26T12:28:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.024+0000 7f67e6a00640 10 client.15693 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.026+0000 7f67e6a00640 1 -- 172.21.15.40:0/1373353758 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ff40f8ea0 con 0x564ff3d99ea0 2024-07-26T12:28:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.026+0000 7f67e6a00640 10 client.15693 handle_command_reply: tid=0 2024-07-26T12:28:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.026+0000 7f680e618740 1 client.15693 shutdown 2024-07-26T12:28:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.026+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 msgr2=0x564ff4197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.026+0000 7f680e618740 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff4197a80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f67f80a6200 tx=0x7f67f80aa940 comp rx=0 tx=0).stop 2024-07-26T12:28:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 shutdown_connections 2024-07-26T12:28:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d99ea0 0x564ff419da70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff4197a80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff418bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 --2- 172.21.15.40:0/1373353758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff418b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 >> 172.21.15.40:0/1373353758 conn(0x564ff3dcf910 msgr2=0x564ff4183170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f67e6a00640 0 client.15693 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 shutdown_connections 2024-07-26T12:28:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 1 -- 172.21.15.40:0/1373353758 wait complete. 2024-07-26T12:28:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.027+0000 7f680e618740 20 client.15693 trim_cache size 0 max 16384 2024-07-26T12:28:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 Processor -- start 2024-07-26T12:28:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 -- start start 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4197870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4197db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f68001b5440 con 0x564ff3ddb520 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68001b6f80 con 0x564ff3dba840 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.055+0000 7f680e618740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68001b5b10 con 0x564ff3db2660 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.056+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.056+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41478/0 (socket says 172.21.15.40:41478) 2024-07-26T12:28:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.056+0000 7f6805a00640 1 -- 172.21.15.40:0/1099753092 learned_addr learned my addr 172.21.15.40:0/1099753092 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.056+0000 7f6805000640 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.056+0000 7f67ffe00640 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f6805a00640 1 -- 172.21.15.40:0/1099753092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 msgr2=0x564ff4197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f6805a00640 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f6805a00640 1 -- 172.21.15.40:0/1099753092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 msgr2=0x564ff4197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f6805a00640 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f6805a00640 1 -- 172.21.15.40:0/1099753092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff41822d0 con 0x564ff3ddb520 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f67ffe00640 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f6805a00640 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418a620 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f67f80a9e80 tx=0x7f67f80a9fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9039b8653a39359 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.057+0000 7f67f1600640 1 -- 172.21.15.40:0/1099753092 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80b3230 con 0x564ff3ddb520 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.058+0000 7f67f1600640 1 -- 172.21.15.40:0/1099753092 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f8009040 con 0x564ff3ddb520 2024-07-26T12:28:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.058+0000 7f67f1600640 1 -- 172.21.15.40:0/1099753092 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80a93e0 con 0x564ff3ddb520 2024-07-26T12:28:54.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.058+0000 7f680e618740 1 -- 172.21.15.40:0/1099753092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 msgr2=0x564ff418a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.058+0000 7f680e618740 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418a620 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f67f80a9e80 tx=0x7f67f80a9fc0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 -- 172.21.15.40:0/1099753092 shutdown_connections 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418a620 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 --2- 172.21.15.40:0/1099753092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff4197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 -- 172.21.15.40:0/1099753092 >> 172.21.15.40:0/1099753092 conn(0x564ff3dcf910 msgr2=0x564ff4189f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 -- 172.21.15.40:0/1099753092 shutdown_connections 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 -- 172.21.15.40:0/1099753092 wait complete. 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 -- start start 2024-07-26T12:28:54.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.059+0000 7f680e618740 1 Processor -- start 2024-07-26T12:28:54.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff41939f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4193f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f68001b68b0 con 0x564ff3ddb520 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68001b61e0 con 0x564ff3dba840 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68001b3400 con 0x564ff3db2660 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f680e618740 10 client.0 _ll_register_callbacks cb 0x7f67f80a6040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f6805a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41490/0 (socket says 172.21.15.40:41490) 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.060+0000 7f6805a00640 1 -- 172.21.15.40:0/3993440838 learned_addr learned my addr 172.21.15.40:0/3993440838 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805000640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff41939f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f67ffe00640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4193f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805a00640 1 -- 172.21.15.40:0/3993440838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 msgr2=0x564ff41939f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805a00640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff41939f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805a00640 1 -- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 msgr2=0x564ff4193f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:28:54.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805a00640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4193f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805a00640 1 -- 172.21.15.40:0/3993440838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff418eee0 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f6805a00640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418e9a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f67f80aa110 tx=0x7f67f80b1d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98a2d4c17226b99 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.061+0000 7f67e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f67e6a00640 1 -- 172.21.15.40:0/3993440838 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80b3230 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f67e6a00640 1 -- 172.21.15.40:0/3993440838 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f67f80b2da0 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f8009040 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f67e6a00640 1 -- 172.21.15.40:0/3993440838 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f67f80b8050 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f680e618740 10 client.15699 fetch_fsmap learned FSMap version 35 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564ff4206940 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f67e6a00640 1 -- 172.21.15.40:0/3993440838 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f8009040 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.062+0000 7f67e6a00640 1 -- 172.21.15.40:0/3993440838 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f67f80a8e50 con 0x564ff3ddb520 2024-07-26T12:28:54.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f680e618740 10 client.15699 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f680e618740 10 client.15699 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f680e618740 20 client.15699 populate_metadata read hostname 'smithi040' 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f680e618740 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d6f250 0x564ff4208d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f680e618740 4 client.15699 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7725ded9", "release": true, "await": true}] 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7725ded9", "release": true, "await": true}) -- 0x564ff40f4940 con 0x564ff3d6f250 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.063+0000 7f6805000640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d6f250 0x564ff4208d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:54.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.064+0000 7f6805000640 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d6f250 0x564ff4208d90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f7724965060fa9 server_cookie=414d5e25778b6f46 in_seq=0 out_seq=0 2024-07-26T12:28:54.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.064+0000 7f67e6a00640 10 client.15699 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:53 smithi146 ceph-mon[35807]: pgmap v699: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 89 KiB/s wr, 8 op/s 2024-07-26T12:28:54.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:53 smithi076 ceph-mon[35401]: pgmap v699: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 89 KiB/s wr, 8 op/s 2024-07-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.120+0000 7f67e6a00640 1 -- 172.21.15.40:0/3993440838 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564ff40f4940 con 0x564ff3d6f250 2024-07-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.120+0000 7f67e6a00640 10 client.15699 handle_command_reply: tid=0 2024-07-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.120+0000 7f680e618740 1 client.15699 shutdown 2024-07-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 msgr2=0x564ff418e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418e9a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f67f80aa110 tx=0x7f67f80b1d30 comp rx=0 tx=0).stop 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 shutdown_connections 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564ff3d6f250 0x564ff4208d90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564ff3ddb520 0x564ff418e9a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564ff3dba840 0x564ff4193f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 --2- 172.21.15.40:0/3993440838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564ff3db2660 0x564ff41939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 >> 172.21.15.40:0/3993440838 conn(0x564ff3dcf910 msgr2=0x564ff418a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.121+0000 7f67e6a00640 0 client.15699 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.122+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 shutdown_connections 2024-07-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.122+0000 7f680e618740 1 -- 172.21.15.40:0/3993440838 wait complete. 2024-07-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.123+0000 7f680e618740 20 client.15699 trim_cache size 0 max 16384 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 20, 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "7725ded9": { 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 20, 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.9, 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.124+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67e80b3bd0 msgr2=0x7f67e80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.124+0000 7f6807a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67e80b3bd0 0x7f67e80b60e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67f4005fd0 tx=0x7f67f4005f20 comp rx=0 tx=0).stop 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.124+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 msgr2=0x7f68001a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.124+0000 7f6807a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 0x7f68001a5ce0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f67f800b970 tx=0x7f67f800be30 comp rx=0 tx=0).stop 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 shutdown_connections 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680010fe70 0x7f68001a5ce0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f680010f520 0x7f68001a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f67e80b3bd0 0x7f67e80b60e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 --2- 172.21.15.40:0/1445979403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800109be0 0x7f68001a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 >> 172.21.15.40:0/1445979403 conn(0x7f6800077b10 msgr2=0x7f680010db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 shutdown_connections 2024-07-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:54.125+0000 7f6807a00640 1 -- 172.21.15.40:0/1445979403 wait complete. 2024-07-26T12:28:54.988 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7725ded9', total seconds elapsed: 29.7 2024-07-26T12:28:54.988 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.95 2024-07-26T12:28:54.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:28:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:55 smithi040 ceph-mon[32397]: pgmap v700: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 89 KiB/s wr, 11 op/s 2024-07-26T12:28:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:55 smithi146 ceph-mon[35807]: pgmap v700: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 89 KiB/s wr, 11 op/s 2024-07-26T12:28:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:55 smithi076 ceph-mon[35401]: pgmap v700: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 89 KiB/s wr, 11 op/s 2024-07-26T12:28:57.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:57 smithi040 ceph-mon[32397]: pgmap v701: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:28:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.878+0000 7fa50be00640 1 -- 172.21.15.40:0/1650088251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10af00 msgr2=0x7fa50c10b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.878+0000 7fa50be00640 1 --2- 172.21.15.40:0/1650088251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10af00 0x7fa50c10b310 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009900 tx=0x7fa4f802a410 comp rx=0 tx=0).stop 2024-07-26T12:28:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 -- 172.21.15.40:0/1650088251 shutdown_connections 2024-07-26T12:28:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 --2- 172.21.15.40:0/1650088251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50c10b850 0x7fa50c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 --2- 172.21.15.40:0/1650088251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10af00 0x7fa50c10b310 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 --2- 172.21.15.40:0/1650088251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa50c1055c0 0x7fa50c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 -- 172.21.15.40:0/1650088251 >> 172.21.15.40:0/1650088251 conn(0x7fa50c101010 msgr2=0x7fa50c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 -- 172.21.15.40:0/1650088251 shutdown_connections 2024-07-26T12:28:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.879+0000 7fa50be00640 1 -- 172.21.15.40:0/1650088251 wait complete. 2024-07-26T12:28:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.880+0000 7fa50be00640 1 Processor -- start 2024-07-26T12:28:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.880+0000 7fa50be00640 1 -- start start 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50c1055c0 0x7fa50c19bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa50c10af00 0x7fa50c19c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 0x7fa50c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c1153c0 con 0x7fa50c10b850 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c115240 con 0x7fa50c10af00 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c115540 con 0x7fa50c1055c0 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.881+0000 7fa50b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 0x7fa50c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 0x7fa50c1a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41508/0 (socket says 172.21.15.40:41508) 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 -- 172.21.15.40:0/4093133054 learned_addr learned my addr 172.21.15.40:0/4093133054 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50aa00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50c1055c0 0x7fa50c19bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50a000640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa50c10af00 0x7fa50c19c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 -- 172.21.15.40:0/4093133054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50c1055c0 msgr2=0x7fa50c19bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50c1055c0 0x7fa50c19bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 -- 172.21.15.40:0/4093133054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa50c10af00 msgr2=0x7fa50c19c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa50c10af00 0x7fa50c19c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.882+0000 7fa50b400640 1 -- 172.21.15.40:0/4093133054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c1a1e20 con 0x7fa50c10b850 2024-07-26T12:28:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.883+0000 7fa50b400640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 0x7fa50c1a17b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa50400cce0 tx=0x7fa50400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.883+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50400f450 con 0x7fa50c10b850 2024-07-26T12:28:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.883+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50c1a2110 con 0x7fa50c10b850 2024-07-26T12:28:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.883+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa50400fa80 con 0x7fa50c10b850 2024-07-26T12:28:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.883+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504018ad0 con 0x7fa50c10b850 2024-07-26T12:28:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.884+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50c1a8930 con 0x7fa50c10b850 2024-07-26T12:28:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.885+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50c1059d0 con 0x7fa50c10b850 2024-07-26T12:28:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.888+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa50400f5f0 con 0x7fa50c10b850 2024-07-26T12:28:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.890+0000 7fa503400640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4f00b3c80 0x7fa4f00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:28:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.890+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa5040e4360 con 0x7fa50c10b850 2024-07-26T12:28:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.890+0000 7fa50aa00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4f00b3c80 0x7fa4f00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:28:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.891+0000 7fa50aa00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4f00b3c80 0x7fa4f00b6190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00bbe0 tx=0x7fa4fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:28:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:57.892+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa504014030 con 0x7fa50c10b850 2024-07-26T12:28:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:57 smithi146 ceph-mon[35807]: pgmap v701: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:28:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:57 smithi076 ceph-mon[35401]: pgmap v701: 97 pgs: 97 active+clean; 684 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:28:58.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.172+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa50c19d0a0 con 0x7fa50c10b850 2024-07-26T12:28:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.174+0000 7fa503400640 1 -- 172.21.15.40:0/4093133054 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fa5040aba80 con 0x7fa50c10b850 2024-07-26T12:28:58.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:28:58.177 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:28:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:28:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4f00b3c80 msgr2=0x7fa4f00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4f00b3c80 0x7fa4f00b6190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00bbe0 tx=0x7fa4fc00b390 comp rx=0 tx=0).stop 2024-07-26T12:28:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 msgr2=0x7fa50c1a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 0x7fa50c1a17b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa50400cce0 tx=0x7fa50400a620 comp rx=0 tx=0).stop 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 shutdown_connections 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50c10b850 0x7fa50c1a17b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa50c10af00 0x7fa50c19c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4f00b3c80 0x7fa4f00b6190 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 --2- 172.21.15.40:0/4093133054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50c1055c0 0x7fa50c19bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.177+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 >> 172.21.15.40:0/4093133054 conn(0x7fa50c101010 msgr2=0x7fa50c103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.178+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 shutdown_connections 2024-07-26T12:28:58.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:28:58.178+0000 7fa50be00640 1 -- 172.21.15.40:0/4093133054 wait complete. 2024-07-26T12:28:58.942 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:58 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4093133054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:59.005 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0' 2024-07-26T12:28:59.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0 2024-07-26T12:28:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:58 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4093133054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:58 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4093133054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:28:59.557 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:28:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:28:59 smithi040 ceph-mon[32397]: pgmap v702: 97 pgs: 97 active+clean; 695 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 935 KiB/s wr, 9 op/s 2024-07-26T12:29:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:28:59 smithi146 ceph-mon[35807]: pgmap v702: 97 pgs: 97 active+clean; 695 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 935 KiB/s wr, 9 op/s 2024-07-26T12:29:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:28:59 smithi076 ceph-mon[35401]: pgmap v702: 97 pgs: 97 active+clean; 695 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 935 KiB/s wr, 9 op/s 2024-07-26T12:29:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:29:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:29:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:29:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.729+0000 7fb5aca00640 1 -- 172.21.15.40:0/1849066182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a810af40 msgr2=0x7fb5a810b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.729+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1849066182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a810af40 0x7fb5a810b350 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb594009900 tx=0x7fb59402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.729+0000 7fb5aca00640 1 -- 172.21.15.40:0/1849066182 shutdown_connections 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.729+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1849066182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a81120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.730+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1849066182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a810af40 0x7fb5a810b350 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.730+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1849066182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5a8105600 0x7fb5a8105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.730+0000 7fb5aca00640 1 -- 172.21.15.40:0/1849066182 >> 172.21.15.40:0/1849066182 conn(0x7fb5a8101070 msgr2=0x7fb5a81034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.730+0000 7fb5aca00640 1 -- 172.21.15.40:0/1849066182 shutdown_connections 2024-07-26T12:29:01.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.730+0000 7fb5aca00640 1 -- 172.21.15.40:0/1849066182 wait complete. 2024-07-26T12:29:01.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.731+0000 7fb5aca00640 1 Processor -- start 2024-07-26T12:29:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:01 smithi040 ceph-mon[32397]: pgmap v703: 97 pgs: 97 active+clean; 695 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 935 KiB/s wr, 11 op/s 2024-07-26T12:29:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:29:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:29:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:01.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.731+0000 7fb5aca00640 1 -- start start 2024-07-26T12:29:01.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5aca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a8105600 0x7fb5a807b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5aca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5a810af40 0x7fb5a8077350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5aca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a8077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5aca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81153b0 con 0x7fb5a8105600 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5aca00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8115230 con 0x7fb5a810b890 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5aca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8115530 con 0x7fb5a810af40 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5a7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a8077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5a7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a8077a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:38486/0 (socket says 172.21.15.40:38486) 2024-07-26T12:29:01.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.732+0000 7fb5a7e00640 1 -- 172.21.15.40:0/1500745991 learned_addr learned my addr 172.21.15.40:0/1500745991 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:01.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5a810af40 0x7fb5a8077350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7400640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a8105600 0x7fb5a807b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7e00640 1 -- 172.21.15.40:0/1500745991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5a810af40 msgr2=0x7fb5a8077350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7e00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5a810af40 0x7fb5a8077350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7e00640 1 -- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a8105600 msgr2=0x7fb5a807b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7e00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a8105600 0x7fb5a807b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7e00640 1 -- 172.21.15.40:0/1500745991 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a81ac390 con 0x7fb5a810b890 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.733+0000 7fb5a7400640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a8105600 0x7fb5a807b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.734+0000 7fb5a7e00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a8077a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000eaa0 tx=0x7fb5a000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.734+0000 7fb59fe00640 1 -- 172.21.15.40:0/1500745991 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0004d20 con 0x7fb5a810b890 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.734+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a81ac560 con 0x7fb5a810b890 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.734+0000 7fb59fe00640 1 -- 172.21.15.40:0/1500745991 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a0005020 con 0x7fb5a810b890 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.734+0000 7fb59fe00640 1 -- 172.21.15.40:0/1500745991 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a00116d0 con 0x7fb5a810b890 2024-07-26T12:29:01.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.735+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81aca70 con 0x7fb5a810b890 2024-07-26T12:29:01.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.739+0000 7fb5b4cd7740 1 Processor -- start 2024-07-26T12:29:01.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.740+0000 7fb59fe00640 1 -- 172.21.15.40:0/1500745991 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb5a000caf0 con 0x7fb5a810b890 2024-07-26T12:29:01.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.740+0000 7fb5b4cd7740 1 -- start start 2024-07-26T12:29:01.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.740+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 0x56082a84f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a84f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a487b70 0x56082a84ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56082a7c38a0 con 0x56082a4a8850 2024-07-26T12:29:01.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56082a7b2da0 con 0x56082a47f990 2024-07-26T12:29:01.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56082a7b6de0 con 0x56082a487b70 2024-07-26T12:29:01.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5a6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 0x56082a84f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5a6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 0x56082a84f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41534/0 (socket says 172.21.15.40:41534) 2024-07-26T12:29:01.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5a6a00640 1 -- 172.21.15.40:0/276121485 learned_addr learned my addr 172.21.15.40:0/276121485 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:01.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.741+0000 7fb5a7400640 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a84f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb59fe00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb58c0b3cc0 0x7fb58c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a487b70 0x56082a84ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb59fe00640 1 -- 172.21.15.40:0/1500745991 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb5a00e3b60 con 0x7fb5a810b890 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a7e00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb58c0b3cc0 0x7fb58c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a6a00640 1 -- 172.21.15.40:0/276121485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a487b70 msgr2=0x56082a84ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a487b70 0x56082a84ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a6a00640 1 -- 172.21.15.40:0/276121485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 msgr2=0x56082a84f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a84f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.742+0000 7fb5a6a00640 1 -- 172.21.15.40:0/276121485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082a747b70 con 0x56082a4a8850 2024-07-26T12:29:01.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.743+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 0x56082a84f480 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb594005f70 tx=0x7fb594000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da1d618415a950 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:01.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.743+0000 7fb5a7e00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb58c0b3cc0 0x7fb58c0b61d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00a6af0 tx=0x7fb5a0022fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:01.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.744+0000 7fb593e00640 1 -- 172.21.15.40:0/276121485 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594035040 con 0x56082a4a8850 2024-07-26T12:29:01.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.744+0000 7fb593e00640 1 -- 172.21.15.40:0/276121485 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5940044c0 con 0x56082a4a8850 2024-07-26T12:29:01.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.744+0000 7fb593e00640 1 -- 172.21.15.40:0/276121485 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594003df0 con 0x56082a4a8850 2024-07-26T12:29:01.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/276121485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 msgr2=0x56082a84f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:01.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 0x56082a84f480 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb594005f70 tx=0x7fb594000bc0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/276121485 shutdown_connections 2024-07-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a487b70 0x56082a84ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a84f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/276121485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a4a8850 0x56082a84f480 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/276121485 >> 172.21.15.40:0/276121485 conn(0x56082a49cc40 msgr2=0x56082a84d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:01.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.745+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/276121485 shutdown_connections 2024-07-26T12:29:01.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.746+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/276121485 wait complete. 2024-07-26T12:29:01.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.746+0000 7fb5b4cd7740 1 -- start start 2024-07-26T12:29:01.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 Processor -- start 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a85afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a85b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a866f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56082a6167b0 con 0x56082a487b70 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56082a74f380 con 0x56082a47f990 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56082a85dc00 con 0x56082a4a8850 2024-07-26T12:29:01.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.747+0000 7fb5b4cd7740 10 client.0 _ll_register_callbacks cb 0x56082a75e830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:29:01.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.748+0000 7fb5a6a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a85afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.748+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a85b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.748+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a85b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41546/0 (socket says 172.21.15.40:41546) 2024-07-26T12:29:01.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.748+0000 7fb5a7400640 1 -- 172.21.15.40:0/2800997716 learned_addr learned my addr 172.21.15.40:0/2800997716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:01.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.748+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a866f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.749+0000 7fb5a7400640 1 -- 172.21.15.40:0/2800997716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 msgr2=0x56082a866f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.749+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a866f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.749+0000 7fb5a7400640 1 -- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 msgr2=0x56082a85afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.749+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a85afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.749+0000 7fb5a7400640 1 -- 172.21.15.40:0/2800997716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082a522ba0 con 0x56082a487b70 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.749+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a85b4e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb598012c20 tx=0x7fb5980107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67000a94cba59f2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.750+0000 7fb590c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.750+0000 7fb590c00640 1 -- 172.21.15.40:0/2800997716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59801f060 con 0x56082a487b70 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.750+0000 7fb590c00640 1 -- 172.21.15.40:0/2800997716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb59800e7c0 con 0x56082a487b70 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.750+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56082a7c57f0 con 0x56082a487b70 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.751+0000 7fb590c00640 1 -- 172.21.15.40:0/2800997716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb59800e9c0 con 0x56082a487b70 2024-07-26T12:29:01.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.751+0000 7fb5b4cd7740 10 client.15717 fetch_fsmap learned FSMap version 35 2024-07-26T12:29:01.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.751+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56082a869c40 con 0x56082a487b70 2024-07-26T12:29:01.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.751+0000 7fb590c00640 1 -- 172.21.15.40:0/2800997716 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56082a7c57f0 con 0x56082a487b70 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb590c00640 1 -- 172.21.15.40:0/2800997716 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb598024070 con 0x56082a487b70 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5b4cd7740 10 client.15717 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5b4cd7740 10 client.15717 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5b4cd7740 20 client.15717 populate_metadata read hostname 'smithi040' 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a4671d0 0x56082a86d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5b4cd7740 4 client.15717 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56082a7c1290 con 0x56082a4671d0 2024-07-26T12:29:01.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.752+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a4671d0 0x56082a86d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.753+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a4671d0 0x56082a86d1c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d3bfcb445a7d9ba server_cookie=f50fbe7065046b87 in_seq=0 out_seq=0 2024-07-26T12:29:01.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.753+0000 7fb590c00640 10 client.15717 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:01.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.754+0000 7fb590c00640 1 -- 172.21.15.40:0/2800997716 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56082a7c1290 con 0x56082a4671d0 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.754+0000 7fb590c00640 10 client.15717 handle_command_reply: tid=0 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.754+0000 7fb5b4cd7740 1 client.15717 shutdown 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.754+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 msgr2=0x56082a85b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.754+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a85b4e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb598012c20 tx=0x7fb5980107a0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 shutdown_connections 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a866f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a4671d0 0x56082a86d1c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a85b4e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2800997716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a47f990 0x56082a85afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 >> 172.21.15.40:0/2800997716 conn(0x56082a49cc40 msgr2=0x56082a852610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:01.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb590c00640 0 client.15717 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:01.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 shutdown_connections 2024-07-26T12:29:01.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.755+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2800997716 wait complete. 2024-07-26T12:29:01.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.756+0000 7fb5b4cd7740 20 client.15717 trim_cache size 0 max 16384 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.777+0000 7fb5b4cd7740 1 Processor -- start 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.777+0000 7fb5b4cd7740 1 -- start start 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.777+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a47f990 0x56082a852f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.777+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a84ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.777+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a4a8850 0x56082a866d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb58800e4d0 con 0x56082a487b70 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb588010010 con 0x56082a4a8850 2024-07-26T12:29:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb58800eba0 con 0x56082a47f990 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a84ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a84ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41560/0 (socket says 172.21.15.40:41560) 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 -- 172.21.15.40:0/856666041 learned_addr learned my addr 172.21.15.40:0/856666041 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a4a8850 0x56082a866d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a47f990 0x56082a852f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 -- 172.21.15.40:0/856666041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a47f990 msgr2=0x56082a852f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a47f990 0x56082a852f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 -- 172.21.15.40:0/856666041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a4a8850 msgr2=0x56082a866d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.778+0000 7fb5a7400640 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a4a8850 0x56082a866d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.779+0000 7fb5a7400640 1 -- 172.21.15.40:0/856666041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082a8592a0 con 0x56082a487b70 2024-07-26T12:29:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.779+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a4a8850 0x56082a866d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.779+0000 7fb5a7400640 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a84ccb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb598012bf0 tx=0x7fb598005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1201d3b224066ee server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.779+0000 7fb593400640 1 -- 172.21.15.40:0/856666041 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598033070 con 0x56082a487b70 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.779+0000 7fb593400640 1 -- 172.21.15.40:0/856666041 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb59800eb60 con 0x56082a487b70 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.779+0000 7fb593400640 1 -- 172.21.15.40:0/856666041 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59802a070 con 0x56082a487b70 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.780+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/856666041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 msgr2=0x56082a84ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.780+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a84ccb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb598012bf0 tx=0x7fb598005880 comp rx=0 tx=0).stop 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/856666041 shutdown_connections 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a4a8850 0x56082a866d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a487b70 0x56082a84ccb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/856666041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a47f990 0x56082a852f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/856666041 >> 172.21.15.40:0/856666041 conn(0x56082a49cc40 msgr2=0x56082a859620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/856666041 shutdown_connections 2024-07-26T12:29:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.781+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/856666041 wait complete. 2024-07-26T12:29:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.782+0000 7fb5b4cd7740 1 -- start start 2024-07-26T12:29:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.782+0000 7fb5b4cd7740 1 Processor -- start 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.782+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 0x56082a85ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a487b70 0x56082a85f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5b4cd7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a85f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb58800f940 con 0x56082a47f990 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb58800f270 con 0x56082a487b70 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5b4cd7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb58800c490 con 0x56082a4a8850 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5b4cd7740 10 client.0 _ll_register_callbacks cb 0x7fb598012830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5a6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 0x56082a85ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5a6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 0x56082a85ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41576/0 (socket says 172.21.15.40:41576) 2024-07-26T12:29:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5a6a00640 1 -- 172.21.15.40:0/2459560126 learned_addr learned my addr 172.21.15.40:0/2459560126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a487b70 0x56082a85f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.783+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a85f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a6a00640 1 -- 172.21.15.40:0/2459560126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 msgr2=0x56082a85f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a85f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a6a00640 1 -- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a487b70 msgr2=0x56082a85f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a487b70 0x56082a85f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a6a00640 1 -- 172.21.15.40:0/2459560126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082a8d4ad0 con 0x56082a47f990 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a487b70 0x56082a85f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb5a6a00640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 0x56082a85ef20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb594009900 tx=0x7fb598012590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae351acb08125f90 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.784+0000 7fb590c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.785+0000 7fb590c00640 1 -- 172.21.15.40:0/2459560126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594035040 con 0x56082a47f990 2024-07-26T12:29:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.785+0000 7fb590c00640 1 -- 172.21.15.40:0/2459560126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb594056040 con 0x56082a47f990 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.785+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb59800eb60 con 0x56082a47f990 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.785+0000 7fb590c00640 1 -- 172.21.15.40:0/2459560126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb59404a620 con 0x56082a47f990 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.785+0000 7fb5b4cd7740 10 client.15723 fetch_fsmap learned FSMap version 35 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.785+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56082a8d5d30 con 0x56082a47f990 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.786+0000 7fb590c00640 1 -- 172.21.15.40:0/2459560126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb59800eb60 con 0x56082a47f990 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb590c00640 1 -- 172.21.15.40:0/2459560126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb59404c6c0 con 0x56082a47f990 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb5b4cd7740 10 client.15723 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb5b4cd7740 10 client.15723 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb5b4cd7740 20 client.15723 populate_metadata read hostname 'smithi040' 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a43c580 0x56082a8d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb5b4cd7740 4 client.15723 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}] 2024-07-26T12:29:01.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.787+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}) -- 0x56082a7be9d0 con 0x56082a43c580 2024-07-26T12:29:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.788+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a43c580 0x56082a8d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.788+0000 7fb590c00640 10 client.15723 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:01.788+0000 7fb5a7400640 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a43c580 0x56082a8d7fc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa3bec07df308b7 server_cookie=24a9e77d8a9390b in_seq=0 out_seq=0 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb590c00640 1 -- 172.21.15.40:0/2459560126 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56082a7be9d0 con 0x56082a43c580 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb590c00640 10 client.15723 handle_command_reply: tid=0 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 client.15723 shutdown 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 msgr2=0x56082a85ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 0x56082a85ef20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb594009900 tx=0x7fb598012590 comp rx=0 tx=0).stop 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 shutdown_connections 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56082a4a8850 0x56082a85f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56082a487b70 0x56082a85f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56082a43c580 0x56082a8d7fc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 --2- 172.21.15.40:0/2459560126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56082a47f990 0x56082a85ef20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb590c00640 0 client.15723 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.035+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 >> 172.21.15.40:0/2459560126 conn(0x56082a49cc40 msgr2=0x56082a852580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.036+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 shutdown_connections 2024-07-26T12:29:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.036+0000 7fb5b4cd7740 1 -- 172.21.15.40:0/2459560126 wait complete. 2024-07-26T12:29:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.036+0000 7fb5b4cd7740 20 client.15723 trim_cache size 0 max 16384 2024-07-26T12:29:02.039 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 22, 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "95d00e2d": { 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 22, 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:29:02.040 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.9, 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:02.041 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb58c0b3cc0 msgr2=0x7fb58c0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb58c0b3cc0 0x7fb58c0b61d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00a6af0 tx=0x7fb5a0022fb0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 msgr2=0x7fb5a8077a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a8077a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000eaa0 tx=0x7fb5a000eea0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 shutdown_connections 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5a810b890 0x7fb5a8077a70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb58c0b3cc0 0x7fb58c0b61d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5a810af40 0x7fb5a8077350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 --2- 172.21.15.40:0/1500745991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5a8105600 0x7fb5a807b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 >> 172.21.15.40:0/1500745991 conn(0x7fb5a8101070 msgr2=0x7fb5a8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 shutdown_connections 2024-07-26T12:29:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:02.038+0000 7fb5aca00640 1 -- 172.21.15.40:0/1500745991 wait complete. 2024-07-26T12:29:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:01 smithi146 ceph-mon[35807]: pgmap v703: 97 pgs: 97 active+clean; 695 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 935 KiB/s wr, 11 op/s 2024-07-26T12:29:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:29:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:29:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:01 smithi076 ceph-mon[35401]: pgmap v703: 97 pgs: 97 active+clean; 695 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 935 KiB/s wr, 11 op/s 2024-07-26T12:29:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:29:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:29:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:29:02.812 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '95d00e2d', quiesce took 7.8 seconds. Will release after: 14.149999999999999 2024-07-26T12:29:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:03 smithi040 ceph-mon[32397]: pgmap v704: 97 pgs: 97 active+clean; 703 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-07-26T12:29:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:03 smithi146 ceph-mon[35807]: pgmap v704: 97 pgs: 97 active+clean; 703 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-07-26T12:29:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:03 smithi076 ceph-mon[35401]: pgmap v704: 97 pgs: 97 active+clean; 703 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 MiB/s wr, 8 op/s 2024-07-26T12:29:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:05 smithi040 ceph-mon[32397]: pgmap v705: 97 pgs: 97 active+clean; 731 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.9 MiB/s wr, 14 op/s 2024-07-26T12:29:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:05 smithi146 ceph-mon[35807]: pgmap v705: 97 pgs: 97 active+clean; 731 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.9 MiB/s wr, 14 op/s 2024-07-26T12:29:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:05 smithi076 ceph-mon[35401]: pgmap v705: 97 pgs: 97 active+clean; 731 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.9 MiB/s wr, 14 op/s 2024-07-26T12:29:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:07 smithi040 ceph-mon[32397]: pgmap v706: 97 pgs: 97 active+clean; 735 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T12:29:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:07 smithi146 ceph-mon[35807]: pgmap v706: 97 pgs: 97 active+clean; 735 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T12:29:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:07 smithi076 ceph-mon[35401]: pgmap v706: 97 pgs: 97 active+clean; 735 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T12:29:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:09 smithi040 ceph-mon[32397]: pgmap v707: 97 pgs: 97 active+clean; 739 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T12:29:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:09 smithi146 ceph-mon[35807]: pgmap v707: 97 pgs: 97 active+clean; 739 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T12:29:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:09 smithi076 ceph-mon[35401]: pgmap v707: 97 pgs: 97 active+clean; 739 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T12:29:11.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:11 smithi146 ceph-mon[35807]: pgmap v708: 97 pgs: 97 active+clean; 739 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:29:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:11 smithi040 ceph-mon[32397]: pgmap v708: 97 pgs: 97 active+clean; 739 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:29:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:11 smithi076 ceph-mon[35401]: pgmap v708: 97 pgs: 97 active+clean; 739 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:29:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:13 smithi040 ceph-mon[32397]: pgmap v709: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T12:29:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:13 smithi146 ceph-mon[35807]: pgmap v709: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T12:29:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:13 smithi076 ceph-mon[35401]: pgmap v709: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T12:29:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:15 smithi040 ceph-mon[32397]: pgmap v710: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 MiB/s wr, 14 op/s 2024-07-26T12:29:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:15 smithi146 ceph-mon[35807]: pgmap v710: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 MiB/s wr, 14 op/s 2024-07-26T12:29:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:15 smithi076 ceph-mon[35401]: pgmap v710: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 MiB/s wr, 14 op/s 2024-07-26T12:29:16.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:29:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:29:17.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:17 smithi076 ceph-mon[35401]: pgmap v711: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 851 KiB/s wr, 8 op/s 2024-07-26T12:29:17.966 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:17 smithi040 ceph-mon[32397]: pgmap v711: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 851 KiB/s wr, 8 op/s 2024-07-26T12:29:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:17 smithi146 ceph-mon[35807]: pgmap v711: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 851 KiB/s wr, 8 op/s 2024-07-26T12:29:19.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 -- 172.21.15.40:0/579419974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a200751e0 msgr2=0x7f9a200755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/579419974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a200751e0 0x7f9a200755f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009900 tx=0x7f9a1002a410 comp rx=0 tx=0).stop 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 -- 172.21.15.40:0/579419974 shutdown_connections 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/579419974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a2010f940 0x7f9a20111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/579419974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a20075b30 0x7f9a2010f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/579419974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a200751e0 0x7f9a200755f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 -- 172.21.15.40:0/579419974 >> 172.21.15.40:0/579419974 conn(0x7f9a200fee70 msgr2=0x7f9a201012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 -- 172.21.15.40:0/579419974 shutdown_connections 2024-07-26T12:29:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.681+0000 7f9a1fe00640 1 -- 172.21.15.40:0/579419974 wait complete. 2024-07-26T12:29:19.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 Processor -- start 2024-07-26T12:29:19.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 -- start start 2024-07-26T12:29:19.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a200751e0 0x7f9a2019bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 0x7f9a2019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a2010f940 0x7f9a201a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9a201153d0 con 0x7f9a20075b30 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20115250 con 0x7f9a2010f940 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.683+0000 7f9a1fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20115550 con 0x7f9a200751e0 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 0x7f9a2019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 0x7f9a2019c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42828/0 (socket says 172.21.15.40:42828) 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 -- 172.21.15.40:0/1351405305 learned_addr learned my addr 172.21.15.40:0/1351405305 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a1ea00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a200751e0 0x7f9a2019bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a1f400640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a2010f940 0x7f9a201a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 -- 172.21.15.40:0/1351405305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a200751e0 msgr2=0x7f9a2019bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a200751e0 0x7f9a2019bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 -- 172.21.15.40:0/1351405305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a2010f940 msgr2=0x7f9a201a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a2010f940 0x7f9a201a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a17e00640 1 -- 172.21.15.40:0/1351405305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a201a1d90 con 0x7f9a20075b30 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.684+0000 7f9a1ea00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a200751e0 0x7f9a2019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:29:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.685+0000 7f9a17e00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 0x7f9a2019c480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800d770 tx=0x7f9a0800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:19.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.685+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08017070 con 0x7f9a20075b30 2024-07-26T12:29:19.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.685+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a08009c30 con 0x7f9a20075b30 2024-07-26T12:29:19.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.685+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a201a2080 con 0x7f9a20075b30 2024-07-26T12:29:19.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.685+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08003c50 con 0x7f9a20075b30 2024-07-26T12:29:19.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.685+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201a88a0 con 0x7f9a20075b30 2024-07-26T12:29:19.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.687+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a200755f0 con 0x7f9a20075b30 2024-07-26T12:29:19.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.691+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9a08003df0 con 0x7f9a20075b30 2024-07-26T12:29:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.693+0000 7f9a17400640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a040b3c00 0x7f9a040b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:19.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.693+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a080e3a80 con 0x7f9a20075b30 2024-07-26T12:29:19.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.693+0000 7f9a1ea00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a040b3c00 0x7f9a040b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:19.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.694+0000 7f9a1ea00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a040b3c00 0x7f9a040b6110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a10006010 tx=0x7f9a10005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:19.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.695+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9a080ab090 con 0x7f9a20075b30 2024-07-26T12:29:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:19 smithi040 ceph-mon[32397]: pgmap v712: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 510 KiB/s wr, 10 op/s 2024-07-26T12:29:19.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.937+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a201a8a70 con 0x7f9a20075b30 2024-07-26T12:29:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.938+0000 7f9a17400640 1 -- 172.21.15.40:0/1351405305 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f9a080aa990 con 0x7f9a20075b30 2024-07-26T12:29:19.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:29:19.940 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:29:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a040b3c00 msgr2=0x7f9a040b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a040b3c00 0x7f9a040b6110 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a10006010 tx=0x7f9a10005a20 comp rx=0 tx=0).stop 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 msgr2=0x7f9a2019c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 0x7f9a2019c480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800d770 tx=0x7f9a0800dc30 comp rx=0 tx=0).stop 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 shutdown_connections 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a2010f940 0x7f9a201a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a20075b30 0x7f9a2019c480 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9a040b3c00 0x7f9a040b6110 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 --2- 172.21.15.40:0/1351405305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a200751e0 0x7f9a2019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 >> 172.21.15.40:0/1351405305 conn(0x7f9a200fee70 msgr2=0x7f9a201083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.942+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 shutdown_connections 2024-07-26T12:29:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:19.943+0000 7f9a1fe00640 1 -- 172.21.15.40:0/1351405305 wait complete. 2024-07-26T12:29:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:19 smithi146 ceph-mon[35807]: pgmap v712: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 510 KiB/s wr, 10 op/s 2024-07-26T12:29:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:19 smithi076 ceph-mon[35401]: pgmap v712: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 510 KiB/s wr, 10 op/s 2024-07-26T12:29:20.835 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 95d00e2d --release --await' 2024-07-26T12:29:20.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 95d00e2d --release --await 2024-07-26T12:29:20.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:20 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1351405305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:29:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:20 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1351405305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:29:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:20 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1351405305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:29:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:29:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:21 smithi040 ceph-mon[32397]: pgmap v713: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 169 KiB/s wr, 11 op/s 2024-07-26T12:29:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:21 smithi146 ceph-mon[35807]: pgmap v713: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 169 KiB/s wr, 11 op/s 2024-07-26T12:29:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:21 smithi076 ceph-mon[35401]: pgmap v713: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 169 KiB/s wr, 11 op/s 2024-07-26T12:29:23.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 -- 172.21.15.40:0/3811730574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 msgr2=0x7f7734109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 --2- 172.21.15.40:0/3811730574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f7734109e00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7724009900 tx=0x7f772402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 -- 172.21.15.40:0/3811730574 shutdown_connections 2024-07-26T12:29:23.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 --2- 172.21.15.40:0/3811730574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f773410fc80 0x7f77341164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 --2- 172.21.15.40:0/3811730574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 0x7f773410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 --2- 172.21.15.40:0/3811730574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f7734109e00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 -- 172.21.15.40:0/3811730574 >> 172.21.15.40:0/3811730574 conn(0x7f7734078ff0 msgr2=0x7f7734107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 -- 172.21.15.40:0/3811730574 shutdown_connections 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.650+0000 7f7738c00640 1 -- 172.21.15.40:0/3811730574 wait complete. 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.652+0000 7f7738c00640 1 Processor -- start 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.652+0000 7f7738c00640 1 -- start start 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.653+0000 7f7738c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f77341a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.653+0000 7f7738c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 0x7f77341a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.653+0000 7f7738c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f773410fc80 0x7f77341a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.653+0000 7f7738c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f77341197f0 con 0x7f77341099f0 2024-07-26T12:29:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.653+0000 7f7738c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7734119670 con 0x7f773410f330 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.653+0000 7f7738c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7734119970 con 0x7f773410fc80 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f77341a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f77341a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33552/0 (socket says 172.21.15.40:33552) 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 -- 172.21.15.40:0/2622320158 learned_addr learned my addr 172.21.15.40:0/2622320158 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7732a00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 0x7f77341a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733e00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f773410fc80 0x7f77341a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 -- 172.21.15.40:0/2622320158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f773410fc80 msgr2=0x7f77341a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f773410fc80 0x7f77341a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 -- 172.21.15.40:0/2622320158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 msgr2=0x7f77341a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 0x7f77341a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7733400640 1 -- 172.21.15.40:0/2622320158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77341a6190 con 0x7f77341099f0 2024-07-26T12:29:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.654+0000 7f7732a00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 0x7f77341a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:29:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.655+0000 7f7733400640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f77341a02e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7724009230 tx=0x7f7724004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.655+0000 7f772be00640 1 -- 172.21.15.40:0/2622320158 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772403f030 con 0x7f77341099f0 2024-07-26T12:29:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.655+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77341a6420 con 0x7f77341099f0 2024-07-26T12:29:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.655+0000 7f772be00640 1 -- 172.21.15.40:0/2622320158 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7724003a80 con 0x7f77341099f0 2024-07-26T12:29:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.655+0000 7f772be00640 1 -- 172.21.15.40:0/2622320158 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724035070 con 0x7f77341099f0 2024-07-26T12:29:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.655+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77341a6950 con 0x7f77341099f0 2024-07-26T12:29:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.659+0000 7f7740e5d740 1 Processor -- start 2024-07-26T12:29:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.659+0000 7f7740e5d740 1 -- start start 2024-07-26T12:29:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.659+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c457e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b0660 0x5581c457e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c457ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7740e5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5581c44f4f30 con 0x5581c41b0660 2024-07-26T12:29:23.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7740e5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5581c44e4430 con 0x5581c41b8840 2024-07-26T12:29:23.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7740e5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5581c44e8470 con 0x5581c41d9520 2024-07-26T12:29:23.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f772be00640 1 -- 172.21.15.40:0/2622320158 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7724042030 con 0x7f77341099f0 2024-07-26T12:29:23.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7732a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c457ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7733e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c457e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7733e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c457e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:36722/0 (socket says 172.21.15.40:36722) 2024-07-26T12:29:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.660+0000 7f7733e00640 1 -- 172.21.15.40:0/167746476 learned_addr learned my addr 172.21.15.40:0/167746476 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.661+0000 7f7733400640 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b0660 0x5581c457e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.661+0000 7f7732a00640 1 -- 172.21.15.40:0/167746476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 msgr2=0x5581c457e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.661+0000 7f7732a00640 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c457e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.661+0000 7f7732a00640 1 -- 172.21.15.40:0/167746476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b0660 msgr2=0x5581c457e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.661+0000 7f7732a00640 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b0660 0x5581c457e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.661+0000 7f7732a00640 1 -- 172.21.15.40:0/167746476 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581c4244b00 con 0x5581c41b8840 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.662+0000 7f7732a00640 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c457ec00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f773410ba80 tx=0x7f772000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442608b1a972a44f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.662+0000 7f772be00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f77180b3c00 0x7f77180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.662+0000 7f772be00640 1 -- 172.21.15.40:0/2622320158 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f77241043e0 con 0x7f77341099f0 2024-07-26T12:29:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.662+0000 7f7733e00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f77180b3c00 0x7f77180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.663+0000 7f7733e00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f77180b3c00 0x7f77180b6110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f772c007ef0 tx=0x7f772c0076c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.671+0000 7f771fe00640 1 -- 172.21.15.40:0/167746476 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720015070 con 0x5581c41b8840 2024-07-26T12:29:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.671+0000 7f771fe00640 1 -- 172.21.15.40:0/167746476 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f772001a8f0 con 0x5581c41b8840 2024-07-26T12:29:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.671+0000 7f771fe00640 1 -- 172.21.15.40:0/167746476 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200117f0 con 0x5581c41b8840 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 -- 172.21.15.40:0/167746476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 msgr2=0x5581c457ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c457ec00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f773410ba80 tx=0x7f772000f730 comp rx=0 tx=0).stop 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 -- 172.21.15.40:0/167746476 shutdown_connections 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c457ec00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b0660 0x5581c457e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 --2- 172.21.15.40:0/167746476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c457e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 -- 172.21.15.40:0/167746476 >> 172.21.15.40:0/167746476 conn(0x5581c41cd910 msgr2=0x5581c457c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 -- 172.21.15.40:0/167746476 shutdown_connections 2024-07-26T12:29:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.672+0000 7f7740e5d740 1 -- 172.21.15.40:0/167746476 wait complete. 2024-07-26T12:29:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.673+0000 7f7740e5d740 1 -- start start 2024-07-26T12:29:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.673+0000 7f7740e5d740 1 Processor -- start 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c45898a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c4589de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c4595c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5581c4347bb0 con 0x5581c41b8840 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5581c4480910 con 0x5581c41b0660 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5581c458c960 con 0x5581c41d9520 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7740e5d740 10 client.0 _ll_register_callbacks cb 0x5581c41f0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7732a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c4589de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7732a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c4589de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33576/0 (socket says 172.21.15.40:33576) 2024-07-26T12:29:23.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7732a00640 1 -- 172.21.15.40:0/621602226 learned_addr learned my addr 172.21.15.40:0/621602226 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:23.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.674+0000 7f7733400640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c45898a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7733e00640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c4595c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7732a00640 1 -- 172.21.15.40:0/621602226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 msgr2=0x5581c4595c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7732a00640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c4595c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7732a00640 1 -- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 msgr2=0x5581c45898a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7732a00640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c45898a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7732a00640 1 -- 172.21.15.40:0/621602226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581c42bb960 con 0x5581c41b8840 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7733400640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c45898a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f7732a00640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c4589de0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7720005890 tx=0x7f772000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6409f66e03fcf31 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.675+0000 7f771cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:29:23.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:23 smithi040 ceph-mon[32397]: pgmap v714: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 168 KiB/s wr, 8 op/s 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f771cc00640 1 -- 172.21.15.40:0/621602226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720015070 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f771cc00640 1 -- 172.21.15.40:0/621602226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f772001aaa0 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f772001a8f0 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f771cc00640 1 -- 172.21.15.40:0/621602226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f772001aca0 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f7740e5d740 10 client.15741 fetch_fsmap learned FSMap version 35 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5581c45986d0 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.676+0000 7f771cc00640 1 -- 172.21.15.40:0/621602226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f772001a8f0 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f771cc00640 1 -- 172.21.15.40:0/621602226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7720005420 con 0x5581c41b8840 2024-07-26T12:29:23.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f7740e5d740 10 client.15741 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f7740e5d740 10 client.15741 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f7740e5d740 20 client.15741 populate_metadata read hostname 'smithi040' 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f7740e5d740 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c4197ea0 0x5581c459ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f7740e5d740 4 client.15741 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.677+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581c44f6e80 con 0x5581c4197ea0 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.678+0000 7f7733400640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c4197ea0 0x5581c459ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.679+0000 7f7733400640 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c4197ea0 0x5581c459ba30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66796d9fc26956e server_cookie=1d3c3457c2308914 in_seq=0 out_seq=0 2024-07-26T12:29:23.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.679+0000 7f771cc00640 10 client.15741 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:23.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f771cc00640 1 -- 172.21.15.40:0/621602226 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581c44f6e80 con 0x5581c4197ea0 2024-07-26T12:29:23.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f771cc00640 10 client.15741 handle_command_reply: tid=0 2024-07-26T12:29:23.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 client.15741 shutdown 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 msgr2=0x5581c4589de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c4589de0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7720005890 tx=0x7f772000bf70 comp rx=0 tx=0).stop 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 shutdown_connections 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c4595c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c4197ea0 0x5581c459ba30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c4589de0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 --2- 172.21.15.40:0/621602226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c45898a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 >> 172.21.15.40:0/621602226 conn(0x5581c41cd910 msgr2=0x5581c4581310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:23.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.681+0000 7f771cc00640 0 client.15741 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:23.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.682+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 shutdown_connections 2024-07-26T12:29:23.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.682+0000 7f7740e5d740 1 -- 172.21.15.40:0/621602226 wait complete. 2024-07-26T12:29:23.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.682+0000 7f7740e5d740 20 client.15741 trim_cache size 0 max 16384 2024-07-26T12:29:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 Processor -- start 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 -- start start 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41b0660 0x5581c458b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c4595bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 0x5581c4586a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b5200 con 0x5581c41d9520 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b6d40 con 0x5581c41b8840 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.706+0000 7f7740e5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b58d0 con 0x5581c41b0660 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 0x5581c4586a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 0x5581c4586a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33580/0 (socket says 172.21.15.40:33580) 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 -- 172.21.15.40:0/1450421952 learned_addr learned my addr 172.21.15.40:0/1450421952 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:23.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733400640 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41b0660 0x5581c458b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7732a00640 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c4595bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 -- 172.21.15.40:0/1450421952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41b0660 msgr2=0x5581c458b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41b0660 0x5581c458b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 -- 172.21.15.40:0/1450421952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 msgr2=0x5581c4595bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c4595bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7733e00640 1 -- 172.21.15.40:0/1450421952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581c458a940 con 0x5581c41d9520 2024-07-26T12:29:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.707+0000 7f7732a00640 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c4595bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:29:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.708+0000 7f7733e00640 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 0x5581c4586a90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f772c003b00 tx=0x7f772c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31d19aaca8f0369 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.708+0000 7f771f400640 1 -- 172.21.15.40:0/1450421952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c028670 con 0x5581c41d9520 2024-07-26T12:29:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.708+0000 7f771f400640 1 -- 172.21.15.40:0/1450421952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f772c023070 con 0x5581c41d9520 2024-07-26T12:29:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.708+0000 7f771f400640 1 -- 172.21.15.40:0/1450421952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c01f980 con 0x5581c41d9520 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 -- 172.21.15.40:0/1450421952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 msgr2=0x5581c4586a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 0x5581c4586a90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f772c003b00 tx=0x7f772c014000 comp rx=0 tx=0).stop 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 -- 172.21.15.40:0/1450421952 shutdown_connections 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41d9520 0x5581c4586a90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b8840 0x5581c4595bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1450421952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41b0660 0x5581c458b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 -- 172.21.15.40:0/1450421952 >> 172.21.15.40:0/1450421952 conn(0x5581c41cd910 msgr2=0x5581c457f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 -- 172.21.15.40:0/1450421952 shutdown_connections 2024-07-26T12:29:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.709+0000 7f7740e5d740 1 -- 172.21.15.40:0/1450421952 wait complete. 2024-07-26T12:29:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.710+0000 7f7740e5d740 1 -- start start 2024-07-26T12:29:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.710+0000 7f7740e5d740 1 Processor -- start 2024-07-26T12:29:23.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.710+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c459ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.710+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c459cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.710+0000 7f7740e5d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c459d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7740e5d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b6670 con 0x5581c41b8840 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7740e5d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b5fa0 con 0x5581c41b0660 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7740e5d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b31c0 con 0x5581c41d9520 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7740e5d740 10 client.0 _ll_register_callbacks cb 0x7f7724107d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7732a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c459cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7733400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c459ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7732a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c459cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33590/0 (socket says 172.21.15.40:33590) 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7732a00640 1 -- 172.21.15.40:0/1201004113 learned_addr learned my addr 172.21.15.40:0/1201004113 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.711+0000 7f7733e00640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c459d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7732a00640 1 -- 172.21.15.40:0/1201004113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 msgr2=0x5581c459d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7732a00640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c459d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7732a00640 1 -- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 msgr2=0x5581c459ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7732a00640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c459ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7732a00640 1 -- 172.21.15.40:0/1201004113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581c46030b0 con 0x5581c41b8840 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7733e00640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c459d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7732a00640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c459cfb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f772000b370 tx=0x7f772001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1a62601dfa508d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f771cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f771cc00640 1 -- 172.21.15.40:0/1201004113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720032070 con 0x5581c41b8840 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f771cc00640 1 -- 172.21.15.40:0/1201004113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7720004240 con 0x5581c41b8840 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.712+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f772c023070 con 0x5581c41b8840 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f771cc00640 1 -- 172.21.15.40:0/1201004113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7720015040 con 0x5581c41b8840 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 10 client.15747 fetch_fsmap learned FSMap version 35 2024-07-26T12:29:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5581c46042e0 con 0x5581c41b8840 2024-07-26T12:29:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f771cc00640 1 -- 172.21.15.40:0/1201004113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f772c023070 con 0x5581c41b8840 2024-07-26T12:29:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f771cc00640 1 -- 172.21.15.40:0/1201004113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7720003aa0 con 0x5581c41b8840 2024-07-26T12:29:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 10 client.15747 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 10 client.15747 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 20 client.15747 populate_metadata read hostname 'smithi040' 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c416d250 0x5581c4606ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 4 client.15747 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "95d00e2d", "release": true, "await": true}] 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.713+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "95d00e2d", "release": true, "await": true}) -- 0x5581c44f2920 con 0x5581c416d250 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.714+0000 7f7733400640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c416d250 0x5581c4606ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.715+0000 7f7733400640 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c416d250 0x5581c4606ad0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501dc7aee5cb9e5d server_cookie=29efd918db6d3a8b in_seq=0 out_seq=0 2024-07-26T12:29:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.715+0000 7f771cc00640 10 client.15747 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.770+0000 7f771cc00640 1 -- 172.21.15.40:0/1201004113 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5581c44f2920 con 0x5581c416d250 2024-07-26T12:29:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.770+0000 7f771cc00640 10 client.15747 handle_command_reply: tid=0 2024-07-26T12:29:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.770+0000 7f7740e5d740 1 client.15747 shutdown 2024-07-26T12:29:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 msgr2=0x5581c459cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c459cfb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f772000b370 tx=0x7f772001ab60 comp rx=0 tx=0).stop 2024-07-26T12:29:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 shutdown_connections 2024-07-26T12:29:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c41d9520 0x5581c459d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c416d250 0x5581c4606ad0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c41b8840 0x5581c459cfb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 --2- 172.21.15.40:0/1201004113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c41b0660 0x5581c459ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 >> 172.21.15.40:0/1201004113 conn(0x5581c41cd910 msgr2=0x5581c457f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.771+0000 7f771cc00640 0 client.15747 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.772+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 shutdown_connections 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.772+0000 7f7740e5d740 1 -- 172.21.15.40:0/1201004113 wait complete. 2024-07-26T12:29:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.772+0000 7f7740e5d740 20 client.15747 trim_cache size 0 max 16384 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 24, 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "95d00e2d": { 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 24, 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:29:23.774 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.9, 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:29:23.776 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:29:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.773+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f77180b3c00 msgr2=0x7f77180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.773+0000 7f7738c00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f77180b3c00 0x7f77180b6110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f772c007ef0 tx=0x7f772c0076c0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.773+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 msgr2=0x7f77341a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.773+0000 7f7738c00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f77341a02e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7724009230 tx=0x7f7724004270 comp rx=0 tx=0).stop 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 shutdown_connections 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f77180b3c00 0x7f77180b6110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f773410fc80 0x7f77341a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f773410f330 0x7f77341a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 --2- 172.21.15.40:0/2622320158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77341099f0 0x7f77341a02e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 >> 172.21.15.40:0/2622320158 conn(0x7f7734078ff0 msgr2=0x7f77340799d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 shutdown_connections 2024-07-26T12:29:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:29:23.774+0000 7f7738c00640 1 -- 172.21.15.40:0/2622320158 wait complete. 2024-07-26T12:29:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:23 smithi146 ceph-mon[35807]: pgmap v714: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 168 KiB/s wr, 8 op/s 2024-07-26T12:29:24.148 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:23 smithi076 ceph-mon[35401]: pgmap v714: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 168 KiB/s wr, 8 op/s 2024-07-26T12:29:24.550 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '95d00e2d', total seconds elapsed: 29.6 2024-07-26T12:29:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:25 smithi040 ceph-mon[32397]: pgmap v715: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-07-26T12:29:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:25 smithi146 ceph-mon[35807]: pgmap v715: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-07-26T12:29:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:25 smithi076 ceph-mon[35401]: pgmap v715: 97 pgs: 97 active+clean; 741 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-07-26T12:29:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:27 smithi040 ceph-mon[32397]: pgmap v716: 97 pgs: 97 active+clean; 743 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-07-26T12:29:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:27 smithi146 ceph-mon[35807]: pgmap v716: 97 pgs: 97 active+clean; 743 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-07-26T12:29:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:27 smithi076 ceph-mon[35401]: pgmap v716: 97 pgs: 97 active+clean; 743 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-07-26T12:29:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:29 smithi040 ceph-mon[32397]: pgmap v717: 97 pgs: 97 active+clean; 747 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 514 KiB/s wr, 9 op/s 2024-07-26T12:29:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:29 smithi146 ceph-mon[35807]: pgmap v717: 97 pgs: 97 active+clean; 747 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 514 KiB/s wr, 9 op/s 2024-07-26T12:29:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:29 smithi076 ceph-mon[35401]: pgmap v717: 97 pgs: 97 active+clean; 747 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 514 KiB/s wr, 9 op/s 2024-07-26T12:29:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:31 smithi040 ceph-mon[32397]: pgmap v718: 97 pgs: 97 active+clean; 755 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T12:29:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:31 smithi146 ceph-mon[35807]: pgmap v718: 97 pgs: 97 active+clean; 755 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T12:29:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:31 smithi076 ceph-mon[35401]: pgmap v718: 97 pgs: 97 active+clean; 755 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T12:29:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:33 smithi040 ceph-mon[32397]: pgmap v719: 97 pgs: 97 active+clean; 759 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T12:29:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:33 smithi146 ceph-mon[35807]: pgmap v719: 97 pgs: 97 active+clean; 759 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T12:29:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:33 smithi076 ceph-mon[35401]: pgmap v719: 97 pgs: 97 active+clean; 759 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T12:29:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:35 smithi040 ceph-mon[32397]: pgmap v720: 97 pgs: 97 active+clean; 779 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T12:29:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:35 smithi146 ceph-mon[35807]: pgmap v720: 97 pgs: 97 active+clean; 779 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T12:29:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:35 smithi076 ceph-mon[35401]: pgmap v720: 97 pgs: 97 active+clean; 779 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T12:29:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:37 smithi040 ceph-mon[32397]: pgmap v721: 97 pgs: 97 active+clean; 787 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T12:29:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:37 smithi146 ceph-mon[35807]: pgmap v721: 97 pgs: 97 active+clean; 787 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T12:29:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:37 smithi076 ceph-mon[35401]: pgmap v721: 97 pgs: 97 active+clean; 787 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T12:29:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:39 smithi040 ceph-mon[32397]: pgmap v722: 97 pgs: 97 active+clean; 791 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:29:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:39 smithi146 ceph-mon[35807]: pgmap v722: 97 pgs: 97 active+clean; 791 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:29:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:39 smithi076 ceph-mon[35401]: pgmap v722: 97 pgs: 97 active+clean; 791 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:29:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:41 smithi040 ceph-mon[32397]: pgmap v723: 97 pgs: 97 active+clean; 799 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:29:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:41 smithi146 ceph-mon[35807]: pgmap v723: 97 pgs: 97 active+clean; 799 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:29:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:41 smithi076 ceph-mon[35401]: pgmap v723: 97 pgs: 97 active+clean; 799 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:29:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:42 smithi146 ceph-mon[35807]: pgmap v724: 97 pgs: 97 active+clean; 807 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:29:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:42 smithi076 ceph-mon[35401]: pgmap v724: 97 pgs: 97 active+clean; 807 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:29:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:42 smithi040 ceph-mon[32397]: pgmap v724: 97 pgs: 97 active+clean; 807 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:29:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:45 smithi146 ceph-mon[35807]: pgmap v725: 97 pgs: 97 active+clean; 815 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:29:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:45 smithi076 ceph-mon[35401]: pgmap v725: 97 pgs: 97 active+clean; 815 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:29:45.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:45 smithi040 ceph-mon[32397]: pgmap v725: 97 pgs: 97 active+clean; 815 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:29:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:47 smithi146 ceph-mon[35807]: pgmap v726: 97 pgs: 97 active+clean; 827 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:29:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:47 smithi076 ceph-mon[35401]: pgmap v726: 97 pgs: 97 active+clean; 827 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:29:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:47 smithi040 ceph-mon[32397]: pgmap v726: 97 pgs: 97 active+clean; 827 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:29:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:49 smithi146 ceph-mon[35807]: pgmap v727: 97 pgs: 97 active+clean; 839 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:29:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:49 smithi076 ceph-mon[35401]: pgmap v727: 97 pgs: 97 active+clean; 839 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:29:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:49 smithi040 ceph-mon[32397]: pgmap v727: 97 pgs: 97 active+clean; 839 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:29:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:51 smithi146 ceph-mon[35807]: pgmap v728: 97 pgs: 97 active+clean; 843 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:29:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:51 smithi076 ceph-mon[35401]: pgmap v728: 97 pgs: 97 active+clean; 843 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:29:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:51 smithi040 ceph-mon[32397]: pgmap v728: 97 pgs: 97 active+clean; 843 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:29:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:53 smithi146 ceph-mon[35807]: pgmap v729: 97 pgs: 97 active+clean; 851 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:29:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:53 smithi076 ceph-mon[35401]: pgmap v729: 97 pgs: 97 active+clean; 851 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:29:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:53 smithi040 ceph-mon[32397]: pgmap v729: 97 pgs: 97 active+clean; 851 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:29:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:55 smithi146 ceph-mon[35807]: pgmap v730: 97 pgs: 97 active+clean; 871 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:29:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:55 smithi076 ceph-mon[35401]: pgmap v730: 97 pgs: 97 active+clean; 871 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:29:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:55 smithi040 ceph-mon[32397]: pgmap v730: 97 pgs: 97 active+clean; 871 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:29:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:57 smithi146 ceph-mon[35807]: pgmap v731: 97 pgs: 97 active+clean; 875 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:29:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:57 smithi076 ceph-mon[35401]: pgmap v731: 97 pgs: 97 active+clean; 875 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:29:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:57 smithi040 ceph-mon[32397]: pgmap v731: 97 pgs: 97 active+clean; 875 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:29:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:29:59 smithi146 ceph-mon[35807]: pgmap v732: 97 pgs: 97 active+clean; 887 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:29:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:29:59 smithi076 ceph-mon[35401]: pgmap v732: 97 pgs: 97 active+clean; 887 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:29:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:29:59 smithi040 ceph-mon[32397]: pgmap v732: 97 pgs: 97 active+clean; 887 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:30:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T12:30:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:30:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:30:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:01 smithi146 ceph-mon[35807]: pgmap v733: 97 pgs: 97 active+clean; 895 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:30:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:01 smithi076 ceph-mon[35401]: pgmap v733: 97 pgs: 97 active+clean; 895 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:30:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:01 smithi040 ceph-mon[32397]: pgmap v733: 97 pgs: 97 active+clean; 895 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:30:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:30:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:30:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:30:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:03 smithi146 ceph-mon[35807]: pgmap v734: 97 pgs: 97 active+clean; 907 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:30:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:03 smithi076 ceph-mon[35401]: pgmap v734: 97 pgs: 97 active+clean; 907 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:30:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:03 smithi040 ceph-mon[32397]: pgmap v734: 97 pgs: 97 active+clean; 907 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:30:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:30:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:30:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:30:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:30:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:30:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:30:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:30:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:05 smithi040 ceph-mon[32397]: pgmap v735: 97 pgs: 97 active+clean; 919 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T12:30:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:05 smithi146 ceph-mon[35807]: pgmap v735: 97 pgs: 97 active+clean; 919 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T12:30:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:05 smithi076 ceph-mon[35401]: pgmap v735: 97 pgs: 97 active+clean; 919 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T12:30:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:07 smithi040 ceph-mon[32397]: pgmap v736: 97 pgs: 97 active+clean; 919 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:30:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:07 smithi146 ceph-mon[35807]: pgmap v736: 97 pgs: 97 active+clean; 919 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:30:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:07 smithi076 ceph-mon[35401]: pgmap v736: 97 pgs: 97 active+clean; 919 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:30:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:09 smithi040 ceph-mon[32397]: pgmap v737: 97 pgs: 97 active+clean; 935 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:30:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:09 smithi146 ceph-mon[35807]: pgmap v737: 97 pgs: 97 active+clean; 935 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:30:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:09 smithi076 ceph-mon[35401]: pgmap v737: 97 pgs: 97 active+clean; 935 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:30:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:11 smithi040 ceph-mon[32397]: pgmap v738: 97 pgs: 97 active+clean; 943 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:30:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:11 smithi146 ceph-mon[35807]: pgmap v738: 97 pgs: 97 active+clean; 943 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:30:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:11 smithi076 ceph-mon[35401]: pgmap v738: 97 pgs: 97 active+clean; 943 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:30:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:13 smithi146 ceph-mon[35807]: pgmap v739: 97 pgs: 97 active+clean; 959 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:13 smithi040 ceph-mon[32397]: pgmap v739: 97 pgs: 97 active+clean; 959 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:13 smithi076 ceph-mon[35401]: pgmap v739: 97 pgs: 97 active+clean; 959 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:15 smithi146 ceph-mon[35807]: pgmap v740: 97 pgs: 97 active+clean; 971 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:30:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:15 smithi076 ceph-mon[35401]: pgmap v740: 97 pgs: 97 active+clean; 971 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:30:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:15 smithi040 ceph-mon[32397]: pgmap v740: 97 pgs: 97 active+clean; 971 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:30:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:17 smithi040 ceph-mon[32397]: pgmap v741: 97 pgs: 97 active+clean; 971 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:30:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:17 smithi146 ceph-mon[35807]: pgmap v741: 97 pgs: 97 active+clean; 971 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:30:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:17 smithi076 ceph-mon[35401]: pgmap v741: 97 pgs: 97 active+clean; 971 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:30:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:19 smithi076 ceph-mon[35401]: pgmap v742: 97 pgs: 97 active+clean; 983 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:19 smithi040 ceph-mon[32397]: pgmap v742: 97 pgs: 97 active+clean; 983 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:19 smithi146 ceph-mon[35807]: pgmap v742: 97 pgs: 97 active+clean; 983 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:21 smithi040 ceph-mon[32397]: pgmap v743: 97 pgs: 97 active+clean; 983 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:30:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:21 smithi146 ceph-mon[35807]: pgmap v743: 97 pgs: 97 active+clean; 983 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:30:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:21 smithi076 ceph-mon[35401]: pgmap v743: 97 pgs: 97 active+clean; 983 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:30:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:23 smithi040 ceph-mon[32397]: pgmap v744: 97 pgs: 97 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:30:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:23 smithi146 ceph-mon[35807]: pgmap v744: 97 pgs: 97 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:30:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:23 smithi076 ceph-mon[35401]: pgmap v744: 97 pgs: 97 active+clean; 999 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:30:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:25 smithi040 ceph-mon[32397]: pgmap v745: 97 pgs: 97 active+clean; 1011 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:30:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:25 smithi146 ceph-mon[35807]: pgmap v745: 97 pgs: 97 active+clean; 1011 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:30:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:25 smithi076 ceph-mon[35401]: pgmap v745: 97 pgs: 97 active+clean; 1011 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:30:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:27 smithi040 ceph-mon[32397]: pgmap v746: 97 pgs: 97 active+clean; 1015 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:30:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:27 smithi146 ceph-mon[35807]: pgmap v746: 97 pgs: 97 active+clean; 1015 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:30:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:27 smithi076 ceph-mon[35401]: pgmap v746: 97 pgs: 97 active+clean; 1015 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:30:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:29 smithi040 ceph-mon[32397]: pgmap v747: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:30:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:29 smithi146 ceph-mon[35807]: pgmap v747: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:30:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:29 smithi076 ceph-mon[35401]: pgmap v747: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:30:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:31 smithi146 ceph-mon[35807]: pgmap v748: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:30:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:31 smithi076 ceph-mon[35401]: pgmap v748: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:30:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:31 smithi040 ceph-mon[32397]: pgmap v748: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:30:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:32 smithi146 ceph-mon[35807]: pgmap v749: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:30:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:32 smithi076 ceph-mon[35401]: pgmap v749: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:30:33.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:32 smithi040 ceph-mon[32397]: pgmap v749: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:30:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:35 smithi146 ceph-mon[35807]: pgmap v750: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T12:30:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:35 smithi076 ceph-mon[35401]: pgmap v750: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T12:30:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:35 smithi040 ceph-mon[32397]: pgmap v750: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T12:30:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:37 smithi146 ceph-mon[35807]: pgmap v751: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:30:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:37 smithi076 ceph-mon[35401]: pgmap v751: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:30:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:37 smithi040 ceph-mon[32397]: pgmap v751: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:30:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:39 smithi146 ceph-mon[35807]: pgmap v752: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:30:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:39 smithi076 ceph-mon[35401]: pgmap v752: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:30:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:39 smithi040 ceph-mon[32397]: pgmap v752: 97 pgs: 97 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:30:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:41 smithi146 ceph-mon[35807]: pgmap v753: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:30:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:41 smithi076 ceph-mon[35401]: pgmap v753: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:30:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:41 smithi040 ceph-mon[32397]: pgmap v753: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:30:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:43 smithi146 ceph-mon[35807]: pgmap v754: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:30:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:43 smithi076 ceph-mon[35401]: pgmap v754: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:30:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:43 smithi040 ceph-mon[32397]: pgmap v754: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:30:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:45 smithi146 ceph-mon[35807]: pgmap v755: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:30:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:45 smithi076 ceph-mon[35401]: pgmap v755: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:30:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:45 smithi040 ceph-mon[32397]: pgmap v755: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:30:46.080 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:30:46.081 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-07-26T12:30:46.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:30:46.617 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:30:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:47 smithi040 ceph-mon[32397]: pgmap v756: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:30:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:47 smithi146 ceph-mon[35807]: pgmap v756: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:30:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:47 smithi076 ceph-mon[35401]: pgmap v756: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:30:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 -- 172.21.15.40:0/2806410642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23901035c0 msgr2=0x7f23901039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 --2- 172.21.15.40:0/2806410642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23901035c0 0x7f23901039d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2380009900 tx=0x7f238002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 -- 172.21.15.40:0/2806410642 shutdown_connections 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 --2- 172.21.15.40:0/2806410642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2390109850 0x7f2390110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 --2- 172.21.15.40:0/2806410642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2390108f00 0x7f2390109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 --2- 172.21.15.40:0/2806410642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23901035c0 0x7f23901039d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 -- 172.21.15.40:0/2806410642 >> 172.21.15.40:0/2806410642 conn(0x7f23900ff010 msgr2=0x7f2390101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 -- 172.21.15.40:0/2806410642 shutdown_connections 2024-07-26T12:30:49.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.084+0000 7f2395e00640 1 -- 172.21.15.40:0/2806410642 wait complete. 2024-07-26T12:30:49.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.086+0000 7f2395e00640 1 Processor -- start 2024-07-26T12:30:49.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.086+0000 7f2395e00640 1 -- start start 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.086+0000 7f2395e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23901035c0 0x7f2390075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f2395e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 0x7f2390075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f2395e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2390109850 0x7f2390075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f2395e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2390113420 con 0x7f2390108f00 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f2395e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f23901132a0 con 0x7f2390109850 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f2395e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23901135a0 con 0x7f23901035c0 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f238e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 0x7f2390075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f238e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 0x7f2390075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54772/0 (socket says 172.21.15.40:54772) 2024-07-26T12:30:49.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f238e000640 1 -- 172.21.15.40:0/3825754016 learned_addr learned my addr 172.21.15.40:0/3825754016 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:30:49.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f238ea00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23901035c0 0x7f2390075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:49.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.087+0000 7f238f400640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2390109850 0x7f2390075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:49.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238e000640 1 -- 172.21.15.40:0/3825754016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23901035c0 msgr2=0x7f2390075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:49.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238e000640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23901035c0 0x7f2390075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238e000640 1 -- 172.21.15.40:0/3825754016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2390109850 msgr2=0x7f2390075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:49.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238e000640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2390109850 0x7f2390075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238e000640 1 -- 172.21.15.40:0/3825754016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23901a8000 con 0x7f2390108f00 2024-07-26T12:30:49.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238ea00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23901035c0 0x7f2390075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f238e000640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 0x7f2390075680 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c8c0 tx=0x7f237c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c007bb0 con 0x7f2390108f00 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f237c007d50 con 0x7f2390108f00 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.088+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c0186a0 con 0x7f2390108f00 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.089+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23901a82f0 con 0x7f2390108f00 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.089+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23901a8830 con 0x7f2390108f00 2024-07-26T12:30:49.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.090+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23901039d0 con 0x7f2390108f00 2024-07-26T12:30:49.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.094+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f237c00fa00 con 0x7f2390108f00 2024-07-26T12:30:49.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.096+0000 7f2394a00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23740b3bd0 0x7f23740b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:49.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.096+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f237c0e3dc0 con 0x7f2390108f00 2024-07-26T12:30:49.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.096+0000 7f238ea00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23740b3bd0 0x7f23740b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:49.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.097+0000 7f238ea00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23740b3bd0 0x7f23740b60e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2390076b90 tx=0x7f2380005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.102+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f237c014030 con 0x7f2390108f00 2024-07-26T12:30:49.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.369+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2390076440 con 0x7f2390108f00 2024-07-26T12:30:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.370+0000 7f2394a00640 1 -- 172.21.15.40:0/3825754016 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f237c0ab3d0 con 0x7f2390108f00 2024-07-26T12:30:49.372 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:30:49.372 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:30:49.372 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:30:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23740b3bd0 msgr2=0x7f23740b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23740b3bd0 0x7f23740b60e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2390076b90 tx=0x7f2380005a20 comp rx=0 tx=0).stop 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 msgr2=0x7f2390075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 0x7f2390075680 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c8c0 tx=0x7f237c00cd80 comp rx=0 tx=0).stop 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 shutdown_connections 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2390109850 0x7f2390075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390108f00 0x7f2390075680 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23740b3bd0 0x7f23740b60e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 --2- 172.21.15.40:0/3825754016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23901035c0 0x7f2390075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.373+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 >> 172.21.15.40:0/3825754016 conn(0x7f23900ff010 msgr2=0x7f2390101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.374+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 shutdown_connections 2024-07-26T12:30:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:49.374+0000 7f2395e00640 1 -- 172.21.15.40:0/3825754016 wait complete. 2024-07-26T12:30:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:49 smithi076 ceph-mon[35401]: pgmap v757: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:49 smithi040 ceph-mon[32397]: pgmap v757: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:49 smithi146 ceph-mon[35807]: pgmap v757: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:50.173 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-07-26T12:30:50.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-07-26T12:30:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:50 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3825754016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:30:50.720 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:30:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:50 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3825754016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:30:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:50 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3825754016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:30:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:51 smithi040 ceph-mon[32397]: pgmap v758: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:30:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:51 smithi146 ceph-mon[35807]: pgmap v758: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:30:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:51 smithi076 ceph-mon[35401]: pgmap v758: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 -- 172.21.15.40:0/39156923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 msgr2=0x7f0904110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 --2- 172.21.15.40:0/39156923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904110070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009ca0 tx=0x7f08fc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 -- 172.21.15.40:0/39156923 shutdown_connections 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 --2- 172.21.15.40:0/39156923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904110070 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 --2- 172.21.15.40:0/39156923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0904108ef0 0x7f0904109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 --2- 172.21.15.40:0/39156923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09041035b0 0x7f09041039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.177+0000 7f090b600640 1 -- 172.21.15.40:0/39156923 >> 172.21.15.40:0/39156923 conn(0x7f09040fefe0 msgr2=0x7f0904101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.178+0000 7f090b600640 1 -- 172.21.15.40:0/39156923 shutdown_connections 2024-07-26T12:30:53.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.178+0000 7f090b600640 1 -- 172.21.15.40:0/39156923 wait complete. 2024-07-26T12:30:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.179+0000 7f090b600640 1 Processor -- start 2024-07-26T12:30:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.179+0000 7f090b600640 1 -- start start 2024-07-26T12:30:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f090b600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09041035b0 0x7f0904075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f090b600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0904108ef0 0x7f0904075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f090b600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f090b600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0904113410 con 0x7f0904109840 2024-07-26T12:30:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f090b600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0904113290 con 0x7f09041035b0 2024-07-26T12:30:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f090b600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0904113590 con 0x7f0904108ef0 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f0909600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f0909600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904075bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53108/0 (socket says 172.21.15.40:53108) 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f0909600640 1 -- 172.21.15.40:0/3477062100 learned_addr learned my addr 172.21.15.40:0/3477062100 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.180+0000 7f0908c00640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09041035b0 0x7f0904075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0903e00640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0904108ef0 0x7f0904075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0909600640 1 -- 172.21.15.40:0/3477062100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0904108ef0 msgr2=0x7f0904075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0909600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0904108ef0 0x7f0904075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0909600640 1 -- 172.21.15.40:0/3477062100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09041035b0 msgr2=0x7f0904075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0909600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09041035b0 0x7f0904075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0909600640 1 -- 172.21.15.40:0/3477062100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09041a8100 con 0x7f0904109840 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.181+0000 7f0909600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904075bc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005cc0 tx=0x7f08fc032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.182+0000 7f0901600640 1 -- 172.21.15.40:0/3477062100 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc032e00 con 0x7f0904109840 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.182+0000 7f0901600640 1 -- 172.21.15.40:0/3477062100 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08fc0044d0 con 0x7f0904109840 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.182+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09041a8390 con 0x7f0904109840 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.182+0000 7f0901600640 1 -- 172.21.15.40:0/3477062100 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc030b70 con 0x7f0904109840 2024-07-26T12:30:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.182+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09041a88d0 con 0x7f0904109840 2024-07-26T12:30:53.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.186+0000 7f0912261740 1 Processor -- start 2024-07-26T12:30:53.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.186+0000 7f0901600640 1 -- 172.21.15.40:0/3477062100 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f08fc004680 con 0x7f0904109840 2024-07-26T12:30:53.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 -- start start 2024-07-26T12:30:53.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 0x5644881c01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df1980 0x5644881c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df9b60 0x5644881c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56448818ad10 con 0x564487e1a840 2024-07-26T12:30:53.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564488135b60 con 0x564487df1980 2024-07-26T12:30:53.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.187+0000 7f0912261740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564488125060 con 0x564487df9b60 2024-07-26T12:30:53.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 0x5644881c01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 0x5644881c01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53120/0 (socket says 172.21.15.40:53120) 2024-07-26T12:30:53.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 -- 172.21.15.40:0/2622224091 learned_addr learned my addr 172.21.15.40:0/2622224091 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:30:53.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0908c00640 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df1980 0x5644881c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df9b60 0x5644881c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 -- 172.21.15.40:0/2622224091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df9b60 msgr2=0x5644881c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df9b60 0x5644881c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 -- 172.21.15.40:0/2622224091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df1980 msgr2=0x5644881c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df1980 0x5644881c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.188+0000 7f0903e00640 1 -- 172.21.15.40:0/2622224091 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644880acb10 con 0x564487e1a840 2024-07-26T12:30:53.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.189+0000 7f0903e00640 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 0x5644881c01c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f08f00113b0 tx=0x7f08f000d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85b394f58b7484 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:53.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.189+0000 7f08f5c00640 1 -- 172.21.15.40:0/2622224091 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0019020 con 0x564487e1a840 2024-07-26T12:30:53.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.189+0000 7f08f5c00640 1 -- 172.21.15.40:0/2622224091 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f00035f0 con 0x564487e1a840 2024-07-26T12:30:53.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.189+0000 7f08f5c00640 1 -- 172.21.15.40:0/2622224091 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f00044c0 con 0x564487e1a840 2024-07-26T12:30:53.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.190+0000 7f0901600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f08ec0b3bd0 0x7f08ec0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.190+0000 7f0901600640 1 -- 172.21.15.40:0/3477062100 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08fc105140 con 0x7f0904109840 2024-07-26T12:30:53.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.190+0000 7f0908c00640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f08ec0b3bd0 0x7f08ec0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 -- 172.21.15.40:0/2622224091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 msgr2=0x5644881c01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 0x5644881c01c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f08f00113b0 tx=0x7f08f000d590 comp rx=0 tx=0).stop 2024-07-26T12:30:53.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 -- 172.21.15.40:0/2622224091 shutdown_connections 2024-07-26T12:30:53.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df9b60 0x5644881c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df1980 0x5644881c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 --2- 172.21.15.40:0/2622224091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487e1a840 0x5644881c01c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 -- 172.21.15.40:0/2622224091 >> 172.21.15.40:0/2622224091 conn(0x564487e0e990 msgr2=0x5644881be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:53.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 -- 172.21.15.40:0/2622224091 shutdown_connections 2024-07-26T12:30:53.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0912261740 1 -- 172.21.15.40:0/2622224091 wait complete. 2024-07-26T12:30:53.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.191+0000 7f0908c00640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f08ec0b3bd0 0x7f08ec0b60e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5644881bee40 tx=0x7f08f800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:53.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.192+0000 7f0912261740 1 -- start start 2024-07-26T12:30:53.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.192+0000 7f0912261740 1 Processor -- start 2024-07-26T12:30:53.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5644880c1520 con 0x564487df1980 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5644881290a0 con 0x564487df9b60 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564487f887a0 con 0x564487e1a840 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0912261740 10 client.0 _ll_register_callbacks cb 0x56448811dbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0908c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0908c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53126/0 (socket says 172.21.15.40:53126) 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.193+0000 7f0908c00640 1 -- 172.21.15.40:0/2961305452 learned_addr learned my addr 172.21.15.40:0/2961305452 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0903e00640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0909600640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0908c00640 1 -- 172.21.15.40:0/2961305452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 msgr2=0x5644881d7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0908c00640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0908c00640 1 -- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 msgr2=0x5644881cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0908c00640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.194+0000 7f0908c00640 1 -- 172.21.15.40:0/2961305452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564487e94b90 con 0x564487df1980 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.195+0000 7f0908c00640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cbd30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f08f8004650 tx=0x7f08f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac75756df517354 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.195+0000 7f08ea000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.195+0000 7f08ea000640 1 -- 172.21.15.40:0/2961305452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f802c060 con 0x564487df1980 2024-07-26T12:30:53.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.195+0000 7f08ea000640 1 -- 172.21.15.40:0/2961305452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08f8017030 con 0x564487df1980 2024-07-26T12:30:53.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.195+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f00035f0 con 0x564487df1980 2024-07-26T12:30:53.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f08ea000640 1 -- 172.21.15.40:0/2961305452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f08f8027410 con 0x564487df1980 2024-07-26T12:30:53.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f0912261740 10 client.15765 fetch_fsmap learned FSMap version 35 2024-07-26T12:30:53.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5644881da840 con 0x564487df1980 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f08ea000640 1 -- 172.21.15.40:0/2961305452 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f00035f0 con 0x564487df1980 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f08ea000640 1 -- 172.21.15.40:0/2961305452 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f08f8031070 con 0x564487df1980 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f0912261740 10 client.15765 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f0912261740 10 client.15765 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f0912261740 20 client.15765 populate_metadata read hostname 'smithi040' 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.196+0000 7f0912261740 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dd91c0 0x5644881ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.197+0000 7f0912261740 4 client.15765 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.197+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564488137ab0 con 0x564487dd91c0 2024-07-26T12:30:53.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.197+0000 7f0903e00640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dd91c0 0x5644881ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.198+0000 7f0903e00640 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dd91c0 0x5644881ddd90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7cf8bbe5684b0e5 server_cookie=4c4f8a7842dac38f in_seq=0 out_seq=0 2024-07-26T12:30:53.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.198+0000 7f08ea000640 10 client.15765 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:30:53.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.200+0000 7f08ea000640 1 -- 172.21.15.40:0/2961305452 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564488137ab0 con 0x564487dd91c0 2024-07-26T12:30:53.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.200+0000 7f08ea000640 10 client.15765 handle_command_reply: tid=0 2024-07-26T12:30:53.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.200+0000 7f0912261740 1 client.15765 shutdown 2024-07-26T12:30:53.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 msgr2=0x5644881cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cbd30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f08f8004650 tx=0x7f08f8004730 comp rx=0 tx=0).stop 2024-07-26T12:30:53.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 shutdown_connections 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dd91c0 0x5644881ddd90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 --2- 172.21.15.40:0/2961305452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cbd30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 >> 172.21.15.40:0/2961305452 conn(0x564487e0e990 msgr2=0x5644881c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f08ea000640 0 client.15765 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 shutdown_connections 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 1 -- 172.21.15.40:0/2961305452 wait complete. 2024-07-26T12:30:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.201+0000 7f0912261740 20 client.15765 trim_cache size 0 max 16384 2024-07-26T12:30:53.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 Processor -- start 2024-07-26T12:30:53.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 -- start start 2024-07-26T12:30:53.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df1980 0x5644881cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 0x5644881c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487e1a840 0x5644881d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09041b0fd0 con 0x564487df9b60 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f09041b2b10 con 0x564487e1a840 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.223+0000 7f0912261740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f09041b16a0 con 0x564487df1980 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 0x5644881c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 0x5644881c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53132/0 (socket says 172.21.15.40:53132) 2024-07-26T12:30:53.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 -- 172.21.15.40:0/2870957500 learned_addr learned my addr 172.21.15.40:0/2870957500 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:30:53.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0909600640 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487e1a840 0x5644881d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0908c00640 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df1980 0x5644881cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 -- 172.21.15.40:0/2870957500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df1980 msgr2=0x5644881cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df1980 0x5644881cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 -- 172.21.15.40:0/2870957500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487e1a840 msgr2=0x5644881d7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487e1a840 0x5644881d7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.224+0000 7f0903e00640 1 -- 172.21.15.40:0/2870957500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644881c39a0 con 0x564487df9b60 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.225+0000 7f0903e00640 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 0x5644881c6f10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f08f000d8c0 tx=0x7f08f000d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404c4fe1a2f3132 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.225+0000 7f08f5200640 1 -- 172.21.15.40:0/2870957500 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f002c070 con 0x564487df9b60 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.225+0000 7f08f5200640 1 -- 172.21.15.40:0/2870957500 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0005050 con 0x564487df9b60 2024-07-26T12:30:53.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.225+0000 7f08f5200640 1 -- 172.21.15.40:0/2870957500 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0019030 con 0x564487df9b60 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.226+0000 7f0912261740 1 -- 172.21.15.40:0/2870957500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 msgr2=0x5644881c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.226+0000 7f0912261740 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 0x5644881c6f10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f08f000d8c0 tx=0x7f08f000d810 comp rx=0 tx=0).stop 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.226+0000 7f0912261740 1 -- 172.21.15.40:0/2870957500 shutdown_connections 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487e1a840 0x5644881d7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df9b60 0x5644881c6f10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 --2- 172.21.15.40:0/2870957500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487df1980 0x5644881cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 -- 172.21.15.40:0/2870957500 >> 172.21.15.40:0/2870957500 conn(0x564487e0e990 msgr2=0x5644881ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:53.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 -- 172.21.15.40:0/2870957500 shutdown_connections 2024-07-26T12:30:53.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 -- 172.21.15.40:0/2870957500 wait complete. 2024-07-26T12:30:53.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 -- start start 2024-07-26T12:30:53.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.227+0000 7f0912261740 1 Processor -- start 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09041b2440 con 0x564487df1980 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f09041b1d70 con 0x564487df9b60 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f09041aef90 con 0x564487e1a840 2024-07-26T12:30:53.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0912261740 10 client.0 _ll_register_callbacks cb 0x7f08f8004470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0908c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0908c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53148/0 (socket says 172.21.15.40:53148) 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.228+0000 7f0908c00640 1 -- 172.21.15.40:0/1564405851 learned_addr learned my addr 172.21.15.40:0/1564405851 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0903e00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0909600640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0908c00640 1 -- 172.21.15.40:0/1564405851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 msgr2=0x5644881d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0908c00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0908c00640 1 -- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 msgr2=0x5644881cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0908c00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0908c00640 1 -- 172.21.15.40:0/1564405851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564488245520 con 0x564487df1980 2024-07-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0903e00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0909600640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f0908c00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cf8a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f08f8003a30 tx=0x7f08f8003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29d3bf237238211 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.229+0000 7f08ea000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:30:53.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.230+0000 7f08ea000640 1 -- 172.21.15.40:0/1564405851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8037070 con 0x564487df1980 2024-07-26T12:30:53.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.230+0000 7f08ea000640 1 -- 172.21.15.40:0/1564405851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08f8004bb0 con 0x564487df1980 2024-07-26T12:30:53.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.230+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f0005050 con 0x564487df1980 2024-07-26T12:30:53.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.230+0000 7f08ea000640 1 -- 172.21.15.40:0/1564405851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f08f802c020 con 0x564487df1980 2024-07-26T12:30:53.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.230+0000 7f0912261740 10 client.15771 fetch_fsmap learned FSMap version 35 2024-07-26T12:30:53.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.230+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5644882466e0 con 0x564487df1980 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f08ea000640 1 -- 172.21.15.40:0/1564405851 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f0005050 con 0x564487df1980 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f08ea000640 1 -- 172.21.15.40:0/1564405851 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f08f8031040 con 0x564487df1980 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f0912261740 10 client.15771 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f0912261740 10 client.15771 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f0912261740 20 client.15771 populate_metadata read hostname 'smithi040' 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f0912261740 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dae570 0x564488248f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f0912261740 4 client.15771 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-07-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.231+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x5644881c76e0 con 0x564487dae570 2024-07-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.232+0000 7f0903e00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dae570 0x564488248f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.233+0000 7f0903e00640 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dae570 0x564488248f40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15cd1b12425e977 server_cookie=175582098042ccd5 in_seq=0 out_seq=0 2024-07-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.233+0000 7f08ea000640 10 client.15771 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:30:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:53 smithi040 ceph-mon[32397]: pgmap v759: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:30:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.503+0000 7f08ea000640 1 -- 172.21.15.40:0/1564405851 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5644881c76e0 con 0x564487dae570 2024-07-26T12:30:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.503+0000 7f08ea000640 10 client.15771 handle_command_reply: tid=0 2024-07-26T12:30:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.503+0000 7f0912261740 1 client.15771 shutdown 2024-07-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 msgr2=0x5644881cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cf8a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f08f8003a30 tx=0x7f08f8003eb0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 shutdown_connections 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564487e1a840 0x5644881d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564487df9b60 0x5644881cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564487dae570 0x564488248f40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 --2- 172.21.15.40:0/1564405851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564487df1980 0x5644881cf8a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 >> 172.21.15.40:0/1564405851 conn(0x564487e0e990 msgr2=0x5644881ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f08ea000640 0 client.15771 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 shutdown_connections 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.504+0000 7f0912261740 1 -- 172.21.15.40:0/1564405851 wait complete. 2024-07-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.505+0000 7f0912261740 20 client.15771 trim_cache size 0 max 16384 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 26, 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "d15834a1": { 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 26, 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.2, 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.506+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f08ec0b3bd0 msgr2=0x7f08ec0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.506+0000 7f090b600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f08ec0b3bd0 0x7f08ec0b60e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5644881bee40 tx=0x7f08f800b390 comp rx=0 tx=0).stop 2024-07-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.506+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 msgr2=0x7f0904075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.506+0000 7f090b600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904075bc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005cc0 tx=0x7f08fc032a10 comp rx=0 tx=0).stop 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 shutdown_connections 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0904109840 0x7f0904075bc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f08ec0b3bd0 0x7f08ec0b60e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0904108ef0 0x7f0904075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 --2- 172.21.15.40:0/3477062100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09041035b0 0x7f0904075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 >> 172.21.15.40:0/3477062100 conn(0x7f09040fefe0 msgr2=0x7f0904106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 shutdown_connections 2024-07-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:30:53.507+0000 7f090b600640 1 -- 172.21.15.40:0/3477062100 wait complete. 2024-07-26T12:30:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:53 smithi146 ceph-mon[35807]: pgmap v759: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:30:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:53 smithi076 ceph-mon[35401]: pgmap v759: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:30:54.264 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd15834a1', quiesce took 8.2 seconds. Will release after: 14.0 2024-07-26T12:30:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:55 smithi040 ceph-mon[32397]: pgmap v760: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T12:30:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:55 smithi146 ceph-mon[35807]: pgmap v760: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T12:30:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:55 smithi076 ceph-mon[35401]: pgmap v760: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T12:30:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:57 smithi040 ceph-mon[32397]: pgmap v761: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:57 smithi146 ceph-mon[35807]: pgmap v761: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:57 smithi076 ceph-mon[35401]: pgmap v761: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:30:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:30:59 smithi040 ceph-mon[32397]: pgmap v762: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:30:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:30:59 smithi146 ceph-mon[35807]: pgmap v762: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:30:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:30:59 smithi076 ceph-mon[35401]: pgmap v762: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:31:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:01 smithi040 ceph-mon[32397]: pgmap v763: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T12:31:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:01 smithi146 ceph-mon[35807]: pgmap v763: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T12:31:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:01 smithi076 ceph-mon[35401]: pgmap v763: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T12:31:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:03 smithi040 ceph-mon[32397]: pgmap v764: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:31:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:03 smithi146 ceph-mon[35807]: pgmap v764: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:31:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:03 smithi076 ceph-mon[35401]: pgmap v764: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:31:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:31:05.056 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:31:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:31:05.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:05 smithi040 ceph-mon[32397]: pgmap v765: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-07-26T12:31:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:05 smithi146 ceph-mon[35807]: pgmap v765: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-07-26T12:31:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:05 smithi076 ceph-mon[35401]: pgmap v765: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.2 MiB/s wr, 14 op/s 2024-07-26T12:31:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: pgmap v766: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 918 KiB/s wr, 9 op/s 2024-07-26T12:31:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: pgmap v766: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 918 KiB/s wr, 9 op/s 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: pgmap v766: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 918 KiB/s wr, 9 op/s 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:08.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:31:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:31:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:31:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:31:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:31:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:31:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:31:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:31:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:31:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:09 smithi146 ceph-mon[35807]: pgmap v767: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 577 KiB/s wr, 10 op/s 2024-07-26T12:31:09.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:09 smithi040 ceph-mon[32397]: pgmap v767: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 577 KiB/s wr, 10 op/s 2024-07-26T12:31:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:09 smithi076 ceph-mon[35401]: pgmap v767: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 577 KiB/s wr, 10 op/s 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 -- 172.21.15.40:0/2837228520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010b860 msgr2=0x7fcf70112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 --2- 172.21.15.40:0/2837228520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010b860 0x7fcf70112090 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009ca0 tx=0x7fcf6802a8b0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 -- 172.21.15.40:0/2837228520 shutdown_connections 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 --2- 172.21.15.40:0/2837228520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010b860 0x7fcf70112090 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 --2- 172.21.15.40:0/2837228520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf7010af10 0x7fcf7010b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 --2- 172.21.15.40:0/2837228520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf701055d0 0x7fcf701059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.005+0000 7fcf6f200640 1 -- 172.21.15.40:0/2837228520 >> 172.21.15.40:0/2837228520 conn(0x7fcf70101040 msgr2=0x7fcf70103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.006+0000 7fcf6f200640 1 -- 172.21.15.40:0/2837228520 shutdown_connections 2024-07-26T12:31:11.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.006+0000 7fcf6f200640 1 -- 172.21.15.40:0/2837228520 wait complete. 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.007+0000 7fcf6f200640 1 Processor -- start 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.007+0000 7fcf6f200640 1 -- start start 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.007+0000 7fcf6f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf701055d0 0x7fcf7019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 0x7fcf7019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf7010b860 0x7fcf701a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70115410 con 0x7fcf7010af10 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70115290 con 0x7fcf701055d0 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70115590 con 0x7fcf7010b860 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 0x7fcf7019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:11.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 0x7fcf7019c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51050/0 (socket says 172.21.15.40:51050) 2024-07-26T12:31:11.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf67e00640 1 -- 172.21.15.40:0/104531314 learned_addr learned my addr 172.21.15.40:0/104531314 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:11.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6de00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf701055d0 0x7fcf7019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:11.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.008+0000 7fcf6e800640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf7010b860 0x7fcf701a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:11.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf67e00640 1 -- 172.21.15.40:0/104531314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf7010b860 msgr2=0x7fcf701a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf67e00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf7010b860 0x7fcf701a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf67e00640 1 -- 172.21.15.40:0/104531314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf701055d0 msgr2=0x7fcf7019bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf67e00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf701055d0 0x7fcf7019bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf67e00640 1 -- 172.21.15.40:0/104531314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf701a1c90 con 0x7fcf7010af10 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf6de00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf701055d0 0x7fcf7019bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf67e00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 0x7fcf7019c380 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c8c0 tx=0x7fcf5800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58007bb0 con 0x7fcf7010af10 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf58007d50 con 0x7fcf7010af10 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf701a1f80 con 0x7fcf7010af10 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.009+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58018660 con 0x7fcf7010af10 2024-07-26T12:31:11.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.010+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf701a87a0 con 0x7fcf7010af10 2024-07-26T12:31:11.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.011+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf701059e0 con 0x7fcf7010af10 2024-07-26T12:31:11.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.014+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcf5800fa00 con 0x7fcf7010af10 2024-07-26T12:31:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.018+0000 7fcf66a00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf540b3c80 0x7fcf540b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.018+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf580e3f10 con 0x7fcf7010af10 2024-07-26T12:31:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.018+0000 7fcf6de00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf540b3c80 0x7fcf540b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.019+0000 7fcf6de00640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf540b3c80 0x7fcf540b6190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000abe0 tx=0x7fcf6000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.019+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcf58014030 con 0x7fcf7010af10 2024-07-26T12:31:11.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.260+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf7019cf10 con 0x7fcf7010af10 2024-07-26T12:31:11.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.262+0000 7fcf66a00640 1 -- 172.21.15.40:0/104531314 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fcf580ab630 con 0x7fcf7010af10 2024-07-26T12:31:11.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:31:11.264 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:31:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:31:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.264+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf540b3c80 msgr2=0x7fcf540b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.264+0000 7fcf6f200640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf540b3c80 0x7fcf540b6190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000abe0 tx=0x7fcf6000a5c0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.264+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 msgr2=0x7fcf7019c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.264+0000 7fcf6f200640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 0x7fcf7019c380 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c8c0 tx=0x7fcf5800cd80 comp rx=0 tx=0).stop 2024-07-26T12:31:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 shutdown_connections 2024-07-26T12:31:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf540b3c80 0x7fcf540b6190 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf7010b860 0x7fcf701a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf7010af10 0x7fcf7019c380 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 --2- 172.21.15.40:0/104531314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf701055d0 0x7fcf7019bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 >> 172.21.15.40:0/104531314 conn(0x7fcf70101040 msgr2=0x7fcf7010a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 shutdown_connections 2024-07-26T12:31:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:11.265+0000 7fcf6f200640 1 -- 172.21.15.40:0/104531314 wait complete. 2024-07-26T12:31:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:11 smithi146 ceph-mon[35807]: pgmap v768: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 577 KiB/s wr, 11 op/s 2024-07-26T12:31:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:11 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/104531314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:11 smithi076 ceph-mon[35401]: pgmap v768: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 577 KiB/s wr, 11 op/s 2024-07-26T12:31:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:11 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/104531314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:11.974 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:11 smithi040 ceph-mon[32397]: pgmap v768: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 577 KiB/s wr, 11 op/s 2024-07-26T12:31:11.974 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:11 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/104531314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:12.033 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id d15834a1 --release --await' 2024-07-26T12:31:12.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id d15834a1 --release --await 2024-07-26T12:31:12.512 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:31:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:13 smithi146 ceph-mon[35807]: pgmap v769: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 576 KiB/s wr, 8 op/s 2024-07-26T12:31:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:13 smithi076 ceph-mon[35401]: pgmap v769: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 576 KiB/s wr, 8 op/s 2024-07-26T12:31:13.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:13 smithi040 ceph-mon[32397]: pgmap v769: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 576 KiB/s wr, 8 op/s 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 -- 172.21.15.40:0/2733019600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc0077370 msgr2=0x7ffbc0077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 --2- 172.21.15.40:0/2733019600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc0077370 0x7ffbc0077780 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009ca0 tx=0x7ffbb002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 -- 172.21.15.40:0/2733019600 shutdown_connections 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 --2- 172.21.15.40:0/2733019600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbc01141a0 0x7ffbc01165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 --2- 172.21.15.40:0/2733019600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc0077cc0 0x7ffbc0113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 --2- 172.21.15.40:0/2733019600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc0077370 0x7ffbc0077780 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.240+0000 7ffbc5200640 1 -- 172.21.15.40:0/2733019600 >> 172.21.15.40:0/2733019600 conn(0x7ffbc01011f0 msgr2=0x7ffbc0103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.241+0000 7ffbc5200640 1 -- 172.21.15.40:0/2733019600 shutdown_connections 2024-07-26T12:31:15.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.241+0000 7ffbc5200640 1 -- 172.21.15.40:0/2733019600 wait complete. 2024-07-26T12:31:15.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 Processor -- start 2024-07-26T12:31:15.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 -- start start 2024-07-26T12:31:15.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbc0077cc0 0x7ffbc01a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc01141a0 0x7ffbc01a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 0x7ffbc01a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0119a00 con 0x7ffbc01a5d50 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0119880 con 0x7ffbc0077cc0 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.242+0000 7ffbc5200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0119b80 con 0x7ffbc01141a0 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.243+0000 7ffbbe800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 0x7ffbc01a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.243+0000 7ffbbe800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 0x7ffbc01a6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49346/0 (socket says 172.21.15.40:49346) 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.243+0000 7ffbbe800640 1 -- 172.21.15.40:0/1486283990 learned_addr learned my addr 172.21.15.40:0/1486283990 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.243+0000 7ffbbde00640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbc0077cc0 0x7ffbc01a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.243+0000 7ffbb5400640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc01141a0 0x7ffbc01a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbbe800640 1 -- 172.21.15.40:0/1486283990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc01141a0 msgr2=0x7ffbc01a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbbe800640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc01141a0 0x7ffbc01a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbbe800640 1 -- 172.21.15.40:0/1486283990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbc0077cc0 msgr2=0x7ffbc01a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbbe800640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbc0077cc0 0x7ffbc01a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbbe800640 1 -- 172.21.15.40:0/1486283990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc01a68a0 con 0x7ffbc01a5d50 2024-07-26T12:31:15.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbb5400640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc01141a0 0x7ffbc01a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:15.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbbe800640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 0x7ffbc01a6160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c970 tx=0x7ffbb800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:15.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbb7400640 1 -- 172.21.15.40:0/1486283990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8007bb0 con 0x7ffbc01a5d50 2024-07-26T12:31:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbb7400640 1 -- 172.21.15.40:0/1486283990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbb8007d50 con 0x7ffbc01a5d50 2024-07-26T12:31:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbb7400640 1 -- 172.21.15.40:0/1486283990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004d50 con 0x7ffbc01a5d50 2024-07-26T12:31:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.244+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc01a6b90 con 0x7ffbc01a5d50 2024-07-26T12:31:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.245+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01ad190 con 0x7ffbc01a5d50 2024-07-26T12:31:15.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.248+0000 7ffbcbe72740 1 Processor -- start 2024-07-26T12:31:15.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.248+0000 7ffbb7400640 1 -- 172.21.15.40:0/1486283990 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffbb8004f70 con 0x7ffbc01a5d50 2024-07-26T12:31:15.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 -- start start 2024-07-26T12:31:15.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587034a1520 0x558703845fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x558703846500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703846a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5587037bcf30 con 0x558703480840 2024-07-26T12:31:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5587037ac430 con 0x5587034a1520 2024-07-26T12:31:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.249+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5587037b0470 con 0x558703478660 2024-07-26T12:31:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703846a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703846a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49362/0 (socket says 172.21.15.40:49362) 2024-07-26T12:31:15.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 -- 172.21.15.40:0/4068775145 learned_addr learned my addr 172.21.15.40:0/4068775145 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587034a1520 0x558703845fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbbde00640 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x558703846500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 -- 172.21.15.40:0/4068775145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 msgr2=0x558703846500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x558703846500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 -- 172.21.15.40:0/4068775145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587034a1520 msgr2=0x558703845fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587034a1520 0x558703845fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.250+0000 7ffbb5400640 1 -- 172.21.15.40:0/4068775145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55870350cb00 con 0x558703480840 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbb5400640 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703846a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffba8005e10 tx=0x7ffba800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16b188ff68a4156 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbb7400640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba40b3bd0 0x7ffba40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbaf400640 1 -- 172.21.15.40:0/4068775145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8004260 con 0x558703480840 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbb7400640 1 -- 172.21.15.40:0/1486283990 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffbb80e3910 con 0x7ffbc01a5d50 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbbde00640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba40b3bd0 0x7ffba40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbaf400640 1 -- 172.21.15.40:0/4068775145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffba8004400 con 0x558703480840 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.251+0000 7ffbaf400640 1 -- 172.21.15.40:0/4068775145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8003850 con 0x558703480840 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.252+0000 7ffbcbe72740 1 -- 172.21.15.40:0/4068775145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 msgr2=0x558703846a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.252+0000 7ffbbde00640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba40b3bd0 0x7ffba40b60e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006010 tx=0x7ffbb0031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.252+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703846a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffba8005e10 tx=0x7ffba800b4a0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 -- 172.21.15.40:0/4068775145 shutdown_connections 2024-07-26T12:31:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703846a40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x558703846500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/4068775145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587034a1520 0x558703845fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 -- 172.21.15.40:0/4068775145 >> 172.21.15.40:0/4068775145 conn(0x558703495910 msgr2=0x558703843eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 -- 172.21.15.40:0/4068775145 shutdown_connections 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.253+0000 7ffbcbe72740 1 -- 172.21.15.40:0/4068775145 wait complete. 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 -- start start 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 Processor -- start 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703851660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703851ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x55870385da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55870360fbb0 con 0x558703480840 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558703748910 con 0x558703478660 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.254+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5587038547a0 con 0x5587034a1520 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbcbe72740 10 client.0 _ll_register_callbacks cb 0x5587034b8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703851ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703851ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49368/0 (socket says 172.21.15.40:49368) 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 -- 172.21.15.40:0/616720546 learned_addr learned my addr 172.21.15.40:0/616720546 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbbe800640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x55870385da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703851660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 -- 172.21.15.40:0/616720546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 msgr2=0x55870385da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x55870385da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 -- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 msgr2=0x558703851660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703851660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbb5400640 1 -- 172.21.15.40:0/616720546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558703583960 con 0x558703480840 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.255+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703851660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.256+0000 7ffbb5400640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703851ba0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffba800ee10 tx=0x7ffba8013340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906ff089887443f2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.256+0000 7ffba3e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.256+0000 7ffba3e00640 1 -- 172.21.15.40:0/616720546 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8004260 con 0x558703480840 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.256+0000 7ffba3e00640 1 -- 172.21.15.40:0/616720546 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffba800eb60 con 0x558703480840 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.256+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba8004400 con 0x558703480840 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffba3e00640 1 -- 172.21.15.40:0/616720546 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffba8013630 con 0x558703480840 2024-07-26T12:31:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 10 client.15789 fetch_fsmap learned FSMap version 35 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558703860490 con 0x558703480840 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffba3e00640 1 -- 172.21.15.40:0/616720546 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffba8004400 con 0x558703480840 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffba3e00640 1 -- 172.21.15.40:0/616720546 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ffba8004a60 con 0x558703480840 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 10 client.15789 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 10 client.15789 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 20 client.15789 populate_metadata read hostname 'smithi040' 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55870345fea0 0x5587038638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 4 client.15789 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:31:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.257+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587037bee80 con 0x55870345fea0 2024-07-26T12:31:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.258+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55870345fea0 0x5587038638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.259+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55870345fea0 0x5587038638a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b206ed6103991c server_cookie=c1a18fbda544dc62 in_seq=0 out_seq=0 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.259+0000 7ffba3e00640 10 client.15789 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffba3e00640 1 -- 172.21.15.40:0/616720546 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587037bee80 con 0x55870345fea0 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffba3e00640 10 client.15789 handle_command_reply: tid=0 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 client.15789 shutdown 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 msgr2=0x558703851ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703851ba0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffba800ee10 tx=0x7ffba8013340 comp rx=0 tx=0).stop 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 shutdown_connections 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x55870385da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55870345fea0 0x5587038638a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703851ba0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616720546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703851660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 >> 172.21.15.40:0/616720546 conn(0x558703495910 msgr2=0x5587038491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.261+0000 7ffba3e00640 0 client.15789 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.262+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 shutdown_connections 2024-07-26T12:31:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.262+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616720546 wait complete. 2024-07-26T12:31:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.262+0000 7ffbcbe72740 20 client.15789 trim_cache size 0 max 16384 2024-07-26T12:31:15.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.281+0000 7ffbcbe72740 1 Processor -- start 2024-07-26T12:31:15.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.281+0000 7ffbcbe72740 1 -- start start 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.281+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x55870384ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.281+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703480840 0x558703847660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 0x55870384b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b5900 con 0x5587034a1520 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b7440 con 0x558703480840 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b5fd0 con 0x558703478660 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbbe800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 0x55870384b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbbe800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 0x55870384b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49370/0 (socket says 172.21.15.40:49370) 2024-07-26T12:31:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbbe800640 1 -- 172.21.15.40:0/3431272661 learned_addr learned my addr 172.21.15.40:0/3431272661 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbb5400640 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703480840 0x558703847660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.282+0000 7ffbbde00640 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x55870384ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbbe800640 1 -- 172.21.15.40:0/3431272661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 msgr2=0x55870384ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbbe800640 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x55870384ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbbe800640 1 -- 172.21.15.40:0/3431272661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703480840 msgr2=0x558703847660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbbe800640 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703480840 0x558703847660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbbe800640 1 -- 172.21.15.40:0/3431272661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558703847f00 con 0x5587034a1520 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbb5400640 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703480840 0x558703847660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.283+0000 7ffbbe800640 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 0x55870384b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80e13d0 tx=0x7ffbb8092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30357f5acfa3160e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.284+0000 7ffbaea00640 1 -- 172.21.15.40:0/3431272661 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80c4070 con 0x5587034a1520 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.284+0000 7ffbaea00640 1 -- 172.21.15.40:0/3431272661 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbb80b3220 con 0x5587034a1520 2024-07-26T12:31:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.284+0000 7ffbaea00640 1 -- 172.21.15.40:0/3431272661 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb801d070 con 0x5587034a1520 2024-07-26T12:31:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 -- 172.21.15.40:0/3431272661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 msgr2=0x55870384b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 0x55870384b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80e13d0 tx=0x7ffbb8092040 comp rx=0 tx=0).stop 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 -- 172.21.15.40:0/3431272661 shutdown_connections 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5587034a1520 0x55870384b0a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703480840 0x558703847660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/3431272661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558703478660 0x55870384ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 -- 172.21.15.40:0/3431272661 >> 172.21.15.40:0/3431272661 conn(0x558703495910 msgr2=0x5587038508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 -- 172.21.15.40:0/3431272661 shutdown_connections 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 -- 172.21.15.40:0/3431272661 wait complete. 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.285+0000 7ffbcbe72740 1 -- start start 2024-07-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 Processor -- start 2024-07-26T12:31:15.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703855ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703856010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x558703856570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b6d70 con 0x558703480840 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b66a0 con 0x558703478660 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b38c0 con 0x5587034a1520 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.286+0000 7ffbcbe72740 10 client.0 _ll_register_callbacks cb 0x7ffba800bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703856010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703856010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49378/0 (socket says 172.21.15.40:49378) 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 -- 172.21.15.40:0/616538389 learned_addr learned my addr 172.21.15.40:0/616538389 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbbe800640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x558703856570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703855ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 -- 172.21.15.40:0/616538389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 msgr2=0x558703856570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x558703856570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 -- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 msgr2=0x558703855ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703855ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbb5400640 1 -- 172.21.15.40:0/616538389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587038cb0a0 con 0x558703480840 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbbe800640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x558703856570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.287+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703855ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffbb5400640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703856010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffba8004e00 tx=0x7ffba8013900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06a775679db8b3f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffba3e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffba3e00640 1 -- 172.21.15.40:0/616538389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba803a060 con 0x558703480840 2024-07-26T12:31:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb80b3220 con 0x558703480840 2024-07-26T12:31:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffba3e00640 1 -- 172.21.15.40:0/616538389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffba800eb60 con 0x558703480840 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffba3e00640 1 -- 172.21.15.40:0/616538389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffba8003a70 con 0x558703480840 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffbcbe72740 10 client.15795 fetch_fsmap learned FSMap version 35 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.288+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5587038cc360 con 0x558703480840 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffba3e00640 1 -- 172.21.15.40:0/616538389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbb80b3220 con 0x558703480840 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffba3e00640 1 -- 172.21.15.40:0/616538389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ffba803f070 con 0x558703480840 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffbcbe72740 10 client.15795 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffbcbe72740 10 client.15795 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffbcbe72740 20 client.15795 populate_metadata read hostname 'smithi040' 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558703435250 0x5587038cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffbcbe72740 4 client.15795 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d15834a1", "release": true, "await": true}] 2024-07-26T12:31:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.289+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d15834a1", "release": true, "await": true}) -- 0x5587037ba920 con 0x558703435250 2024-07-26T12:31:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.290+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558703435250 0x5587038cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.291+0000 7ffbbde00640 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558703435250 0x5587038cea60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=893f2a1ffed2e593 server_cookie=74e21022f79c5341 in_seq=0 out_seq=0 2024-07-26T12:31:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.291+0000 7ffba3e00640 10 client.15795 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.350+0000 7ffba3e00640 1 -- 172.21.15.40:0/616538389 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5587037ba920 con 0x558703435250 2024-07-26T12:31:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.350+0000 7ffba3e00640 10 client.15795 handle_command_reply: tid=0 2024-07-26T12:31:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.350+0000 7ffbcbe72740 1 client.15795 shutdown 2024-07-26T12:31:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 msgr2=0x558703856010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703856010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffba8004e00 tx=0x7ffba8013900 comp rx=0 tx=0).stop 2024-07-26T12:31:15.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 shutdown_connections 2024-07-26T12:31:15.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587034a1520 0x558703856570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558703435250 0x5587038cea60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558703480840 0x558703856010 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 --2- 172.21.15.40:0/616538389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558703478660 0x558703855ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 >> 172.21.15.40:0/616538389 conn(0x558703495910 msgr2=0x55870385c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.351+0000 7ffba3e00640 0 client.15795 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.352+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 shutdown_connections 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.352+0000 7ffbcbe72740 1 -- 172.21.15.40:0/616538389 wait complete. 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.352+0000 7ffbcbe72740 20 client.15795 trim_cache size 0 max 16384 2024-07-26T12:31:15.355 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 28, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "d15834a1": { 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 28, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:31:15.356 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.2, 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:15.357 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:31:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.353+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba40b3bd0 msgr2=0x7ffba40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.353+0000 7ffbc5200640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba40b3bd0 0x7ffba40b60e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006010 tx=0x7ffbb0031000 comp rx=0 tx=0).stop 2024-07-26T12:31:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.353+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 msgr2=0x7ffbc01a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.353+0000 7ffbc5200640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 0x7ffbc01a6160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c970 tx=0x7ffbb800ce30 comp rx=0 tx=0).stop 2024-07-26T12:31:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 shutdown_connections 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc01a5d50 0x7ffbc01a6160 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba40b3bd0 0x7ffba40b60e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbc01141a0 0x7ffbc01a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 --2- 172.21.15.40:0/1486283990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbc0077cc0 0x7ffbc01a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 >> 172.21.15.40:0/1486283990 conn(0x7ffbc01011f0 msgr2=0x7ffbc0103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 shutdown_connections 2024-07-26T12:31:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:15.354+0000 7ffbc5200640 1 -- 172.21.15.40:0/1486283990 wait complete. 2024-07-26T12:31:15.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:15 smithi146 ceph-mon[35807]: pgmap v770: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 576 KiB/s wr, 12 op/s 2024-07-26T12:31:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:15 smithi076 ceph-mon[35401]: pgmap v770: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 576 KiB/s wr, 12 op/s 2024-07-26T12:31:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:15 smithi040 ceph-mon[32397]: pgmap v770: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 576 KiB/s wr, 12 op/s 2024-07-26T12:31:16.247 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd15834a1', total seconds elapsed: 30.2 2024-07-26T12:31:16.247 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-07-26T12:31:16.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:31:16.731 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:31:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:17 smithi146 ceph-mon[35807]: pgmap v771: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:31:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:17 smithi076 ceph-mon[35401]: pgmap v771: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:31:17.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:17 smithi040 ceph-mon[32397]: pgmap v771: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-07-26T12:31:19.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.065+0000 7fe196c00640 1 -- 172.21.15.40:0/137560924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 msgr2=0x7fe19010fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:19.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.065+0000 7fe196c00640 1 --2- 172.21.15.40:0/137560924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe19010fea0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe188009900 tx=0x7fe18802a410 comp rx=0 tx=0).stop 2024-07-26T12:31:19.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 -- 172.21.15.40:0/137560924 shutdown_connections 2024-07-26T12:31:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 --2- 172.21.15.40:0/137560924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe19010fea0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 --2- 172.21.15.40:0/137560924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 0x7fe190109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 --2- 172.21.15.40:0/137560924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1901033e0 0x7fe1901037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 -- 172.21.15.40:0/137560924 >> 172.21.15.40:0/137560924 conn(0x7fe1900fee70 msgr2=0x7fe1901012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 -- 172.21.15.40:0/137560924 shutdown_connections 2024-07-26T12:31:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.066+0000 7fe196c00640 1 -- 172.21.15.40:0/137560924 wait complete. 2024-07-26T12:31:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.067+0000 7fe196c00640 1 Processor -- start 2024-07-26T12:31:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.067+0000 7fe196c00640 1 -- start start 2024-07-26T12:31:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1901033e0 0x7fe19019be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 0x7fe19019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe1901a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1901131f0 con 0x7fe190109670 2024-07-26T12:31:19.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe190113070 con 0x7fe190108d20 2024-07-26T12:31:19.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe190113370 con 0x7fe1901033e0 2024-07-26T12:31:19.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe1901a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:19.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe1901a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49394/0 (socket says 172.21.15.40:49394) 2024-07-26T12:31:19.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.068+0000 7fe196200640 1 -- 172.21.15.40:0/3794248301 learned_addr learned my addr 172.21.15.40:0/3794248301 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe195800640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1901033e0 0x7fe19019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe194e00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 0x7fe19019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe196200640 1 -- 172.21.15.40:0/3794248301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1901033e0 msgr2=0x7fe19019be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe196200640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1901033e0 0x7fe19019be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe196200640 1 -- 172.21.15.40:0/3794248301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 msgr2=0x7fe19019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe196200640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 0x7fe19019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe196200640 1 -- 172.21.15.40:0/3794248301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901a1d30 con 0x7fe190109670 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe194e00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 0x7fe19019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.069+0000 7fe196200640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe1901a16c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe188005ab0 tx=0x7fe1880040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.070+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18803f030 con 0x7fe190109670 2024-07-26T12:31:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.070+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe188003a80 con 0x7fe190109670 2024-07-26T12:31:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.070+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188035070 con 0x7fe190109670 2024-07-26T12:31:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.070+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901a1fc0 con 0x7fe190109670 2024-07-26T12:31:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.070+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901a2450 con 0x7fe190109670 2024-07-26T12:31:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.071+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1901037f0 con 0x7fe190109670 2024-07-26T12:31:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.075+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe188042030 con 0x7fe190109670 2024-07-26T12:31:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.076+0000 7fe18e000640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1780b3c80 0x7fe1780b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.077+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe1881044d0 con 0x7fe190109670 2024-07-26T12:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.077+0000 7fe195800640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1780b3c80 0x7fe1780b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.078+0000 7fe195800640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1780b3c80 0x7fe1780b6190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe184005fd0 tx=0x7fe184009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:19.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.081+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe1880cbae0 con 0x7fe190109670 2024-07-26T12:31:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.330+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1901a8960 con 0x7fe190109670 2024-07-26T12:31:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.331+0000 7fe18e000640 1 -- 172.21.15.40:0/3794248301 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fe1880cb3e0 con 0x7fe190109670 2024-07-26T12:31:19.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:31:19.334 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:31:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.334+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1780b3c80 msgr2=0x7fe1780b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.334+0000 7fe196c00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1780b3c80 0x7fe1780b6190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe184005fd0 tx=0x7fe184009680 comp rx=0 tx=0).stop 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.334+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 msgr2=0x7fe1901a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.334+0000 7fe196c00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe1901a16c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe188005ab0 tx=0x7fe1880040e0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 shutdown_connections 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe190109670 0x7fe1901a16c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe190108d20 0x7fe19019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1780b3c80 0x7fe1780b6190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 --2- 172.21.15.40:0/3794248301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1901033e0 0x7fe19019be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 >> 172.21.15.40:0/3794248301 conn(0x7fe1900fee70 msgr2=0x7fe19010e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 shutdown_connections 2024-07-26T12:31:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:19.335+0000 7fe196c00640 1 -- 172.21.15.40:0/3794248301 wait complete. 2024-07-26T12:31:19.723 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:19 smithi040 ceph-mon[32397]: pgmap v772: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 447 KiB/s wr, 9 op/s 2024-07-26T12:31:19.723 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:19 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3794248301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:19 smithi076 ceph-mon[35401]: pgmap v772: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 447 KiB/s wr, 9 op/s 2024-07-26T12:31:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:19 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3794248301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:19 smithi146 ceph-mon[35807]: pgmap v772: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 447 KiB/s wr, 9 op/s 2024-07-26T12:31:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:19 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3794248301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:20.216 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-07-26T12:31:20.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-07-26T12:31:20.746 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:31:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:21 smithi076 ceph-mon[35401]: pgmap v773: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T12:31:21.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:21 smithi040 ceph-mon[32397]: pgmap v773: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T12:31:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:21 smithi146 ceph-mon[35807]: pgmap v773: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 -- 172.21.15.40:0/1684060906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 msgr2=0x7f174810ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 --2- 172.21.15.40:0/1684060906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174810ef70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1740009900 tx=0x7f174002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 -- 172.21.15.40:0/1684060906 shutdown_connections 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 --2- 172.21.15.40:0/1684060906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174810ef70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 --2- 172.21.15.40:0/1684060906 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1748107df0 0x7f1748108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 --2- 172.21.15.40:0/1684060906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17481024b0 0x7f17481028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.065+0000 7f1750200640 1 -- 172.21.15.40:0/1684060906 >> 172.21.15.40:0/1684060906 conn(0x7f1748079190 msgr2=0x7f17480795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.066+0000 7f1750200640 1 -- 172.21.15.40:0/1684060906 shutdown_connections 2024-07-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.066+0000 7f1750200640 1 -- 172.21.15.40:0/1684060906 wait complete. 2024-07-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.067+0000 7f1750200640 1 Processor -- start 2024-07-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 -- start start 2024-07-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17481024b0 0x7f1748199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1748107df0 0x7f174819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17481122c0 con 0x7f1748108740 2024-07-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1748112140 con 0x7f1748107df0 2024-07-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.068+0000 7f1750200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1748112440 con 0x7f17481024b0 2024-07-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.069+0000 7f174e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.069+0000 7f174d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17481024b0 0x7f1748199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.069+0000 7f174e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174819f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34192/0 (socket says 172.21.15.40:34192) 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.069+0000 7f174e200640 1 -- 172.21.15.40:0/1971682793 learned_addr learned my addr 172.21.15.40:0/1971682793 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.069+0000 7f174ce00640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1748107df0 0x7f174819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f174e200640 1 -- 172.21.15.40:0/1971682793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17481024b0 msgr2=0x7f1748199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f174e200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17481024b0 0x7f1748199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f174e200640 1 -- 172.21.15.40:0/1971682793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1748107df0 msgr2=0x7f174819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f174e200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1748107df0 0x7f174819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f174e200640 1 -- 172.21.15.40:0/1971682793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174819fe30 con 0x7f1748108740 2024-07-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f174e200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174819f700 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1740004770 tx=0x7f1740003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f1746000640 1 -- 172.21.15.40:0/1971682793 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174003f070 con 0x7f1748108740 2024-07-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f1746000640 1 -- 172.21.15.40:0/1971682793 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f174003bd00 con 0x7f1748108740 2024-07-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.070+0000 7f1746000640 1 -- 172.21.15.40:0/1971682793 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740035030 con 0x7f1748108740 2024-07-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.071+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17481a00c0 con 0x7f1748108740 2024-07-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.071+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17481a6880 con 0x7f1748108740 2024-07-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.074+0000 7f1757036740 1 Processor -- start 2024-07-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.075+0000 7f1746000640 1 -- 172.21.15.40:0/1971682793 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1740042070 con 0x7f1748108740 2024-07-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 -- start start 2024-07-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a4d840 0x55f840df75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a24980 0x55f840df7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840df8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f840dbdd10 con 0x55f840a2cb60 2024-07-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f840d68b60 con 0x55f840a24980 2024-07-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.076+0000 7f1757036740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f840d58060 con 0x55f840a4d840 2024-07-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840df8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840df8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34208/0 (socket says 172.21.15.40:34208) 2024-07-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 -- 172.21.15.40:0/1121988587 learned_addr learned my addr 172.21.15.40:0/1121988587 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a4d840 0x55f840df75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174d800640 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a24980 0x55f840df7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 -- 172.21.15.40:0/1121988587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a4d840 msgr2=0x55f840df75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a4d840 0x55f840df75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 -- 172.21.15.40:0/1121988587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a24980 msgr2=0x55f840df7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a24980 0x55f840df7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f174ce00640 1 -- 172.21.15.40:0/1121988587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f840cdfb10 con 0x55f840a2cb60 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.077+0000 7f1746000640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17300b3bd0 0x7f17300b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.078+0000 7f174ce00640 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840df8050 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1734012700 tx=0x7f173400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd48ae1088182554 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.078+0000 7f1746000640 1 -- 172.21.15.40:0/1971682793 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1740104300 con 0x7f1748108740 2024-07-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.078+0000 7f174d800640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17300b3bd0 0x7f17300b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.078+0000 7f173aa00640 1 -- 172.21.15.40:0/1121988587 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734012c80 con 0x55f840a2cb60 2024-07-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.078+0000 7f173aa00640 1 -- 172.21.15.40:0/1121988587 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17340044c0 con 0x55f840a2cb60 2024-07-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.078+0000 7f173aa00640 1 -- 172.21.15.40:0/1121988587 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340035f0 con 0x55f840a2cb60 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.079+0000 7f1757036740 1 -- 172.21.15.40:0/1121988587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 msgr2=0x55f840df8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.079+0000 7f174d800640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17300b3bd0 0x7f17300b60e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55f840df6250 tx=0x7f173c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.079+0000 7f1757036740 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840df8050 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1734012700 tx=0x7f173400b6e0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 -- 172.21.15.40:0/1121988587 shutdown_connections 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840df8050 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a24980 0x55f840df7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 --2- 172.21.15.40:0/1121988587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a4d840 0x55f840df75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 -- 172.21.15.40:0/1121988587 >> 172.21.15.40:0/1121988587 conn(0x55f840a41990 msgr2=0x55f840df54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 -- 172.21.15.40:0/1121988587 shutdown_connections 2024-07-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.080+0000 7f1757036740 1 -- 172.21.15.40:0/1121988587 wait complete. 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.081+0000 7f1757036740 1 -- start start 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.081+0000 7f1757036740 1 Processor -- start 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.081+0000 7f1757036740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a24980 0x55f840e03160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.081+0000 7f1757036740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840e036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f1757036740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e0ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f1757036740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f840cf4520 con 0x55f840a2cb60 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f1757036740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f840d5c0a0 con 0x55f840a4d840 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f1757036740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f840bbb7a0 con 0x55f840a24980 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f1757036740 10 client.0 _ll_register_callbacks cb 0x55f840d50bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f174ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840e036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f174ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840e036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34224/0 (socket says 172.21.15.40:34224) 2024-07-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f174ce00640 1 -- 172.21.15.40:0/431237396 learned_addr learned my addr 172.21.15.40:0/431237396 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f174d800640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a24980 0x55f840e03160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.082+0000 7f174e200640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e0ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174ce00640 1 -- 172.21.15.40:0/431237396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a24980 msgr2=0x55f840e03160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174ce00640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a24980 0x55f840e03160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174ce00640 1 -- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 msgr2=0x55f840e0ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174ce00640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e0ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174ce00640 1 -- 172.21.15.40:0/431237396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f840ac7b90 con 0x55f840a2cb60 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174e200640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e0ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f174ce00640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840e036a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1734005850 tx=0x7f1734005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07a3422ec0471dd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f172f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.083+0000 7f172f400640 1 -- 172.21.15.40:0/431237396 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734005240 con 0x55f840a2cb60 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.084+0000 7f172f400640 1 -- 172.21.15.40:0/431237396 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17340053e0 con 0x55f840a2cb60 2024-07-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.084+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f840d6aab0 con 0x55f840a2cb60 2024-07-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.084+0000 7f172f400640 1 -- 172.21.15.40:0/431237396 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f17340055e0 con 0x55f840a2cb60 2024-07-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.084+0000 7f1757036740 10 client.15813 fetch_fsmap learned FSMap version 35 2024-07-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.084+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f840e11c10 con 0x55f840a2cb60 2024-07-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.084+0000 7f172f400640 1 -- 172.21.15.40:0/431237396 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f840d6aab0 con 0x55f840a2cb60 2024-07-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f172f400640 1 -- 172.21.15.40:0/431237396 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f173401f940 con 0x55f840a2cb60 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f1757036740 10 client.15813 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f1757036740 10 client.15813 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f1757036740 20 client.15813 populate_metadata read hostname 'smithi040' 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f1757036740 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f840a0c1c0 0x55f840e14f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f1757036740 4 client.15813 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.085+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f840d66550 con 0x55f840a0c1c0 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.086+0000 7f174d800640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f840a0c1c0 0x55f840e14f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.087+0000 7f174d800640 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f840a0c1c0 0x55f840e14f70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b615fac7e59bc8 server_cookie=e998a6e8238cb8cf in_seq=0 out_seq=0 2024-07-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.087+0000 7f172f400640 10 client.15813 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f172f400640 1 -- 172.21.15.40:0/431237396 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f840d66550 con 0x55f840a0c1c0 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f172f400640 10 client.15813 handle_command_reply: tid=0 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 client.15813 shutdown 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 msgr2=0x55f840e036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840e036a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1734005850 tx=0x7f1734005880 comp rx=0 tx=0).stop 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 shutdown_connections 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e0ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f840a0c1c0 0x55f840e14f70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a2cb60 0x55f840e036a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 --2- 172.21.15.40:0/431237396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a24980 0x55f840e03160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.089+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 >> 172.21.15.40:0/431237396 conn(0x55f840a41990 msgr2=0x55f840dfa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.090+0000 7f172f400640 0 client.15813 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.090+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 shutdown_connections 2024-07-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.090+0000 7f1757036740 1 -- 172.21.15.40:0/431237396 wait complete. 2024-07-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.090+0000 7f1757036740 20 client.15813 trim_cache size 0 max 16384 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 Processor -- start 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 -- start start 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840df5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840df0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e04b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17481acb70 con 0x55f840a24980 2024-07-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.110+0000 7f1757036740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17481ae6b0 con 0x55f840a4d840 2024-07-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.111+0000 7f1757036740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17481ad240 con 0x55f840a2cb60 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.111+0000 7f174d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840df5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.111+0000 7f174d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840df5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34228/0 (socket says 172.21.15.40:34228) 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.111+0000 7f174d800640 1 -- 172.21.15.40:0/28980726 learned_addr learned my addr 172.21.15.40:0/28980726 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.111+0000 7f174e200640 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e04b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.111+0000 7f174ce00640 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840df0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174d800640 1 -- 172.21.15.40:0/28980726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 msgr2=0x55f840df0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174d800640 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840df0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174d800640 1 -- 172.21.15.40:0/28980726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 msgr2=0x55f840e04b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174d800640 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e04b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174d800640 1 -- 172.21.15.40:0/28980726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f840e05750 con 0x55f840a24980 2024-07-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174ce00640 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840df0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f174d800640 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840df5680 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f173c003bf0 tx=0x7f173c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3db620080a6b7d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.112+0000 7f173a000640 1 -- 172.21.15.40:0/28980726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c028600 con 0x55f840a24980 2024-07-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.113+0000 7f173a000640 1 -- 172.21.15.40:0/28980726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f173c028c30 con 0x55f840a24980 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.113+0000 7f173a000640 1 -- 172.21.15.40:0/28980726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c01caa0 con 0x55f840a24980 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.113+0000 7f1757036740 1 -- 172.21.15.40:0/28980726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 msgr2=0x55f840df5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.113+0000 7f1757036740 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840df5680 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f173c003bf0 tx=0x7f173c015000 comp rx=0 tx=0).stop 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 -- 172.21.15.40:0/28980726 shutdown_connections 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840df0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 --2- 172.21.15.40:0/28980726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840df5680 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 -- 172.21.15.40:0/28980726 >> 172.21.15.40:0/28980726 conn(0x55f840a41990 msgr2=0x55f840e04480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 -- 172.21.15.40:0/28980726 shutdown_connections 2024-07-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 -- 172.21.15.40:0/28980726 wait complete. 2024-07-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.114+0000 7f1757036740 1 -- start start 2024-07-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 Processor -- start 2024-07-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840e159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840e15fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17481adfe0 con 0x55f840a24980 2024-07-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17481ad910 con 0x55f840a4d840 2024-07-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.115+0000 7f1757036740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17481aab30 con 0x55f840a2cb60 2024-07-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f1757036740 10 client.0 _ll_register_callbacks cb 0x7f173400bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840e159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840e159d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34242/0 (socket says 172.21.15.40:34242) 2024-07-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174d800640 1 -- 172.21.15.40:0/2209007702 learned_addr learned my addr 172.21.15.40:0/2209007702 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174ce00640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840e15fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174e200640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174d800640 1 -- 172.21.15.40:0/2209007702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 msgr2=0x55f840e15fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174d800640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840e15fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.116+0000 7f174d800640 1 -- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 msgr2=0x55f840e744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f174d800640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f174d800640 1 -- 172.21.15.40:0/2209007702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f840e74b50 con 0x55f840a24980 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f174d800640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840e159d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f173c01c680 tx=0x7f173c028490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3685bca9323400b9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f172f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f172f400640 1 -- 172.21.15.40:0/2209007702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c03e060 con 0x55f840a24980 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f172f400640 1 -- 172.21.15.40:0/2209007702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f173c0287c0 con 0x55f840a24980 2024-07-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.117+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c028c30 con 0x55f840a24980 2024-07-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.118+0000 7f172f400640 1 -- 172.21.15.40:0/2209007702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f173c0289c0 con 0x55f840a24980 2024-07-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.118+0000 7f1757036740 10 client.15819 fetch_fsmap learned FSMap version 35 2024-07-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.118+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f840e7d010 con 0x55f840a24980 2024-07-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.118+0000 7f172f400640 1 -- 172.21.15.40:0/2209007702 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f173c028c30 con 0x55f840a24980 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f172f400640 1 -- 172.21.15.40:0/2209007702 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f173c043070 con 0x55f840a24980 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f1757036740 10 client.15819 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f1757036740 10 client.15819 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f1757036740 20 client.15819 populate_metadata read hostname 'smithi040' 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f1757036740 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f8409e1570 0x55f840e7f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f1757036740 4 client.15819 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x55f840d63c90 con 0x55f8409e1570 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.119+0000 7f174ce00640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f8409e1570 0x55f840e7f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.120+0000 7f174ce00640 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f8409e1570 0x55f840e7f7b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac97309bc1965dac server_cookie=640561da2aa285db in_seq=0 out_seq=0 2024-07-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.120+0000 7f172f400640 10 client.15819 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:23.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f172f400640 1 -- 172.21.15.40:0/2209007702 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f840d63c90 con 0x55f8409e1570 2024-07-26T12:31:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f172f400640 10 client.15819 handle_command_reply: tid=0 2024-07-26T12:31:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 client.15819 shutdown 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 msgr2=0x55f840e159d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840e159d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f173c01c680 tx=0x7f173c028490 comp rx=0 tx=0).stop 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 shutdown_connections 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f840a4d840 0x55f840e744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f840a2cb60 0x55f840e15fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f8409e1570 0x55f840e7f7b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 --2- 172.21.15.40:0/2209007702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f840a24980 0x55f840e159d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.362+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 >> 172.21.15.40:0/2209007702 conn(0x55f840a41990 msgr2=0x55f840defde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.363+0000 7f172f400640 0 client.15819 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.363+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 shutdown_connections 2024-07-26T12:31:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.363+0000 7f1757036740 1 -- 172.21.15.40:0/2209007702 wait complete. 2024-07-26T12:31:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.364+0000 7f1757036740 20 client.15819 trim_cache size 0 max 16384 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 30, 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "bd1a7a28": { 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 30, 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:31:23.367 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.2, 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:23.368 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:23.369 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:23.369 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:31:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.365+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17300b3bd0 msgr2=0x7f17300b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.365+0000 7f1750200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17300b3bd0 0x7f17300b60e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55f840df6250 tx=0x7f173c009680 comp rx=0 tx=0).stop 2024-07-26T12:31:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.365+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 msgr2=0x7f174819f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.365+0000 7f1750200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174819f700 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1740004770 tx=0x7f1740003cd0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 shutdown_connections 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1748108740 0x7f174819f700 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1748107df0 0x7f174819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17300b3bd0 0x7f17300b60e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 --2- 172.21.15.40:0/1971682793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17481024b0 0x7f1748199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 >> 172.21.15.40:0/1971682793 conn(0x7f1748079190 msgr2=0x7f17481015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 shutdown_connections 2024-07-26T12:31:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:23.366+0000 7f1750200640 1 -- 172.21.15.40:0/1971682793 wait complete. 2024-07-26T12:31:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:23 smithi040 ceph-mon[32397]: pgmap v774: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-07-26T12:31:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:23 smithi146 ceph-mon[35807]: pgmap v774: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-07-26T12:31:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:23 smithi076 ceph-mon[35401]: pgmap v774: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 MiB/s wr, 8 op/s 2024-07-26T12:31:24.232 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bd1a7a28', quiesce took 8.0 seconds. Will release after: 14.2 2024-07-26T12:31:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:25 smithi040 ceph-mon[32397]: pgmap v775: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.1 MiB/s wr, 14 op/s 2024-07-26T12:31:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:25 smithi146 ceph-mon[35807]: pgmap v775: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.1 MiB/s wr, 14 op/s 2024-07-26T12:31:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:25 smithi076 ceph-mon[35401]: pgmap v775: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.1 MiB/s wr, 14 op/s 2024-07-26T12:31:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:27 smithi040 ceph-mon[32397]: pgmap v776: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T12:31:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:27 smithi146 ceph-mon[35807]: pgmap v776: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T12:31:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:27 smithi076 ceph-mon[35401]: pgmap v776: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T12:31:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:29 smithi040 ceph-mon[32397]: pgmap v777: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T12:31:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:29 smithi146 ceph-mon[35807]: pgmap v777: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T12:31:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:29 smithi076 ceph-mon[35401]: pgmap v777: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T12:31:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:31 smithi040 ceph-mon[32397]: pgmap v778: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:31:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:31 smithi146 ceph-mon[35807]: pgmap v778: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:31:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:31 smithi076 ceph-mon[35401]: pgmap v778: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:31:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:33 smithi040 ceph-mon[32397]: pgmap v779: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:31:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:33 smithi146 ceph-mon[35807]: pgmap v779: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:31:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:33 smithi076 ceph-mon[35401]: pgmap v779: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:31:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:35 smithi040 ceph-mon[32397]: pgmap v780: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.8 MiB/s wr, 14 op/s 2024-07-26T12:31:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:35 smithi146 ceph-mon[35807]: pgmap v780: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.8 MiB/s wr, 14 op/s 2024-07-26T12:31:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:35 smithi076 ceph-mon[35401]: pgmap v780: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.8 MiB/s wr, 14 op/s 2024-07-26T12:31:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:37 smithi040 ceph-mon[32397]: pgmap v781: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:31:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:37 smithi146 ceph-mon[35807]: pgmap v781: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:31:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:37 smithi076 ceph-mon[35401]: pgmap v781: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:31:38.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:31:38.950 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:31:39.951 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:39 smithi040 ceph-mon[32397]: pgmap v782: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 819 KiB/s wr, 10 op/s 2024-07-26T12:31:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:39 smithi146 ceph-mon[35807]: pgmap v782: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 819 KiB/s wr, 10 op/s 2024-07-26T12:31:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:39 smithi076 ceph-mon[35401]: pgmap v782: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 819 KiB/s wr, 10 op/s 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 -- 172.21.15.40:0/584400519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc10f330 msgr2=0x7f95dc10f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 --2- 172.21.15.40:0/584400519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc10f330 0x7f95dc10f740 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009900 tx=0x7f95c402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 -- 172.21.15.40:0/584400519 shutdown_connections 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 --2- 172.21.15.40:0/584400519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc10fc80 0x7f95dc1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 --2- 172.21.15.40:0/584400519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc10f330 0x7f95dc10f740 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 --2- 172.21.15.40:0/584400519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95dc1099f0 0x7f95dc109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.120+0000 7f95e0a00640 1 -- 172.21.15.40:0/584400519 >> 172.21.15.40:0/584400519 conn(0x7f95dc078ff0 msgr2=0x7f95dc107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.121+0000 7f95e0a00640 1 -- 172.21.15.40:0/584400519 shutdown_connections 2024-07-26T12:31:41.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.121+0000 7f95e0a00640 1 -- 172.21.15.40:0/584400519 wait complete. 2024-07-26T12:31:41.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.122+0000 7f95e0a00640 1 Processor -- start 2024-07-26T12:31:41.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.122+0000 7f95e0a00640 1 -- start start 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95e0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 0x7f95dc1a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95e0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc10f330 0x7f95dc1a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95e0a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95dc10fc80 0x7f95dc1a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95e0a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc119860 con 0x7f95dc1099f0 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95e0a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc1196e0 con 0x7f95dc10fc80 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95e0a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc1199e0 con 0x7f95dc10f330 2024-07-26T12:31:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95da800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 0x7f95dc1a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95da800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 0x7f95dc1a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38996/0 (socket says 172.21.15.40:38996) 2024-07-26T12:31:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.123+0000 7f95da800640 1 -- 172.21.15.40:0/2444440048 learned_addr learned my addr 172.21.15.40:0/2444440048 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95d1e00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc10f330 0x7f95dc1a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95db200640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95dc10fc80 0x7f95dc1a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95da800640 1 -- 172.21.15.40:0/2444440048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc10f330 msgr2=0x7f95dc1a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95da800640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc10f330 0x7f95dc1a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95da800640 1 -- 172.21.15.40:0/2444440048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95dc10fc80 msgr2=0x7f95dc1a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95da800640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95dc10fc80 0x7f95dc1a5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95da800640 1 -- 172.21.15.40:0/2444440048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc1a61a0 con 0x7f95dc1099f0 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.124+0000 7f95da800640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 0x7f95dc1a02f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c920 tx=0x7f95cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.125+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc007c70 con 0x7f95dc1099f0 2024-07-26T12:31:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.125+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95cc007e10 con 0x7f95dc1099f0 2024-07-26T12:31:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.125+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc018710 con 0x7f95dc1099f0 2024-07-26T12:31:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.125+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc1a6490 con 0x7f95dc1099f0 2024-07-26T12:31:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.125+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc1accb0 con 0x7f95dc1099f0 2024-07-26T12:31:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.126+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95dc109e00 con 0x7f95dc1099f0 2024-07-26T12:31:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.130+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f95cc00f450 con 0x7f95dc1099f0 2024-07-26T12:31:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.132+0000 7f95d3e00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95c00b3c00 0x7f95c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.132+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f95cc0e4110 con 0x7f95dc1099f0 2024-07-26T12:31:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.132+0000 7f95d1e00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95c00b3c00 0x7f95c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:41.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.133+0000 7f95d1e00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95c00b3c00 0x7f95c00b6110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f95c402a910 tx=0x7f95c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:41.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.134+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f95cc014030 con 0x7f95dc1099f0 2024-07-26T12:31:41.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.379+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95dc1a1420 con 0x7f95dc1099f0 2024-07-26T12:31:41.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.381+0000 7f95d3e00640 1 -- 172.21.15.40:0/2444440048 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f95cc0ab7b0 con 0x7f95dc1099f0 2024-07-26T12:31:41.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:31:41.383 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:31:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:31:41.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95c00b3c00 msgr2=0x7f95c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:41.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95c00b3c00 0x7f95c00b6110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f95c402a910 tx=0x7f95c4000bc0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 msgr2=0x7f95dc1a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 0x7f95dc1a02f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c920 tx=0x7f95cc00cde0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 shutdown_connections 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95dc10fc80 0x7f95dc1a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f95c00b3c00 0x7f95c00b6110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc10f330 0x7f95dc1a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 --2- 172.21.15.40:0/2444440048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95dc1099f0 0x7f95dc1a02f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.384+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 >> 172.21.15.40:0/2444440048 conn(0x7f95dc078ff0 msgr2=0x7f95dc079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.385+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 shutdown_connections 2024-07-26T12:31:41.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:41.385+0000 7f95e0a00640 1 -- 172.21.15.40:0/2444440048 wait complete. 2024-07-26T12:31:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:41 smithi040 ceph-mon[32397]: pgmap v783: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 478 KiB/s wr, 12 op/s 2024-07-26T12:31:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:41 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2444440048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:41 smithi146 ceph-mon[35807]: pgmap v783: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 478 KiB/s wr, 12 op/s 2024-07-26T12:31:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:41 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2444440048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:41 smithi076 ceph-mon[35401]: pgmap v783: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 478 KiB/s wr, 12 op/s 2024-07-26T12:31:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:41 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2444440048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:31:42.118 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id bd1a7a28 --release --await' 2024-07-26T12:31:42.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id bd1a7a28 --release --await 2024-07-26T12:31:42.604 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:31:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:43 smithi040 ceph-mon[32397]: pgmap v784: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 136 KiB/s wr, 8 op/s 2024-07-26T12:31:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:43 smithi146 ceph-mon[35807]: pgmap v784: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 136 KiB/s wr, 8 op/s 2024-07-26T12:31:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:43 smithi076 ceph-mon[35401]: pgmap v784: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 136 KiB/s wr, 8 op/s 2024-07-26T12:31:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 -- 172.21.15.40:0/4087852184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104b80 msgr2=0x7fc01c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 --2- 172.21.15.40:0/4087852184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104b80 0x7fc01c10d0d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc004009900 tx=0x7fc00402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 -- 172.21.15.40:0/4087852184 shutdown_connections 2024-07-26T12:31:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 --2- 172.21.15.40:0/4087852184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc01c10d690 0x7fc01c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 --2- 172.21.15.40:0/4087852184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104b80 0x7fc01c10d0d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 --2- 172.21.15.40:0/4087852184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc01c104230 0x7fc01c104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.356+0000 7fc01b200640 1 -- 172.21.15.40:0/4087852184 >> 172.21.15.40:0/4087852184 conn(0x7fc01c0fdd30 msgr2=0x7fc01c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.357+0000 7fc01b200640 1 -- 172.21.15.40:0/4087852184 shutdown_connections 2024-07-26T12:31:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.357+0000 7fc01b200640 1 -- 172.21.15.40:0/4087852184 wait complete. 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.358+0000 7fc01b200640 1 Processor -- start 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.358+0000 7fc01b200640 1 -- start start 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc01b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 0x7fc01c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc01b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc01c104b80 0x7fc01c19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc01b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc01c10d690 0x7fc01c1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc01b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1131c0 con 0x7fc01c104230 2024-07-26T12:31:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc01b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c113040 con 0x7fc01c104b80 2024-07-26T12:31:45.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc01b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c113340 con 0x7fc01c10d690 2024-07-26T12:31:45.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc019e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 0x7fc01c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc019e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 0x7fc01c19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56014/0 (socket says 172.21.15.40:56014) 2024-07-26T12:31:45.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.359+0000 7fc019e00640 1 -- 172.21.15.40:0/3479649670 learned_addr learned my addr 172.21.15.40:0/3479649670 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc01a800640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc01c10d690 0x7fc01c1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc013e00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc01c104b80 0x7fc01c19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc019e00640 1 -- 172.21.15.40:0/3479649670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc01c10d690 msgr2=0x7fc01c1a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc019e00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc01c10d690 0x7fc01c1a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc019e00640 1 -- 172.21.15.40:0/3479649670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc01c104b80 msgr2=0x7fc01c19c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc019e00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc01c104b80 0x7fc01c19c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc019e00640 1 -- 172.21.15.40:0/3479649670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c1a1d00 con 0x7fc01c104230 2024-07-26T12:31:45.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.360+0000 7fc019e00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 0x7fc01c19be50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c920 tx=0x7fc00c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:45.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.361+0000 7fc012a00640 1 -- 172.21.15.40:0/3479649670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c007c70 con 0x7fc01c104230 2024-07-26T12:31:45.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.361+0000 7fc012a00640 1 -- 172.21.15.40:0/3479649670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc00c007e10 con 0x7fc01c104230 2024-07-26T12:31:45.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.361+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01c1a1ff0 con 0x7fc01c104230 2024-07-26T12:31:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.361+0000 7fc012a00640 1 -- 172.21.15.40:0/3479649670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c018710 con 0x7fc01c104230 2024-07-26T12:31:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.361+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01c1a8810 con 0x7fc01c104230 2024-07-26T12:31:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 Processor -- start 2024-07-26T12:31:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 -- start start 2024-07-26T12:31:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c6a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c6ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564e83be0f50 con 0x564e838c5520 2024-07-26T12:31:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564e83bd0450 con 0x564e838a4840 2024-07-26T12:31:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.365+0000 7fc02786a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564e83bd4490 con 0x564e8389c660 2024-07-26T12:31:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc012a00640 1 -- 172.21.15.40:0/3479649670 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc00c00f450 con 0x7fc01c104230 2024-07-26T12:31:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c6a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56028/0 (socket says 172.21.15.40:56028) 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 -- 172.21.15.40:0/2835702913 learned_addr learned my addr 172.21.15.40:0/2835702913 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc013e00640 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c6ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 -- 172.21.15.40:0/2835702913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 msgr2=0x564e83c6a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c6a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 -- 172.21.15.40:0/2835702913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 msgr2=0x564e83c6ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c6ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.366+0000 7fc01a800640 1 -- 172.21.15.40:0/2835702913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e83930b00 con 0x564e838c5520 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.367+0000 7fc01a800640 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c6a1a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc014008dc0 tx=0x7fc01400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e211beadedb7a0ad server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.367+0000 7fc00b000640 1 -- 172.21.15.40:0/2835702913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014014070 con 0x564e838c5520 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.367+0000 7fc00b000640 1 -- 172.21.15.40:0/2835702913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc014004020 con 0x564e838c5520 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.367+0000 7fc00b000640 1 -- 172.21.15.40:0/2835702913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014010690 con 0x564e838c5520 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.368+0000 7fc012a00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc0000b3c00 0x7fc0000b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.368+0000 7fc012a00640 1 -- 172.21.15.40:0/3479649670 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc00c0e3eb0 con 0x7fc01c104230 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.368+0000 7fc019e00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc0000b3c00 0x7fc0000b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.368+0000 7fc02786a740 1 -- 172.21.15.40:0/2835702913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 msgr2=0x564e83c6a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.368+0000 7fc02786a740 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c6a1a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc014008dc0 tx=0x7fc01400e720 comp rx=0 tx=0).stop 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 -- 172.21.15.40:0/2835702913 shutdown_connections 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c6ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c6a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 --2- 172.21.15.40:0/2835702913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c6a1a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 -- 172.21.15.40:0/2835702913 >> 172.21.15.40:0/2835702913 conn(0x564e838b9910 msgr2=0x564e83c68090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc019e00640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc0000b3c00 0x7fc0000b6110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00cfd0 tx=0x7fc00c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 -- 172.21.15.40:0/2835702913 shutdown_connections 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 -- 172.21.15.40:0/2835702913 wait complete. 2024-07-26T12:31:45.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.369+0000 7fc02786a740 1 -- start start 2024-07-26T12:31:45.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 Processor -- start 2024-07-26T12:31:45.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c75880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c75dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c81d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564e83a33bb0 con 0x564e838c5520 2024-07-26T12:31:45.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564e83b6c930 con 0x564e838a4840 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564e83c78980 con 0x564e8389c660 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.370+0000 7fc02786a740 10 client.0 _ll_register_callbacks cb 0x564e838dcd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c81d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c81d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56038/0 (socket says 172.21.15.40:56038) 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 -- 172.21.15.40:0/4160796864 learned_addr learned my addr 172.21.15.40:0/4160796864 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc013e00640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c75dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c75880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 -- 172.21.15.40:0/4160796864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 msgr2=0x564e83c75880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c75880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 -- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 msgr2=0x564e83c75dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c75dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.371+0000 7fc01a800640 1 -- 172.21.15.40:0/4160796864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e839a7960 con 0x564e838c5520 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.372+0000 7fc01a800640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c81d00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc014005b40 tx=0x7fc014005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fef3718a48caca server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.372+0000 7fbfff400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.372+0000 7fbfff400640 1 -- 172.21.15.40:0/4160796864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014014030 con 0x564e838c5520 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.372+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc014004020 con 0x564e838c5520 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.372+0000 7fbfff400640 1 -- 172.21.15.40:0/4160796864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc014010870 con 0x564e838c5520 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.372+0000 7fbfff400640 1 -- 172.21.15.40:0/4160796864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc014021040 con 0x564e838c5520 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 10 client.15837 fetch_fsmap learned FSMap version 35 2024-07-26T12:31:45.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564e83c846e0 con 0x564e838c5520 2024-07-26T12:31:45.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fbfff400640 1 -- 172.21.15.40:0/4160796864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc014004020 con 0x564e838c5520 2024-07-26T12:31:45.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fbfff400640 1 -- 172.21.15.40:0/4160796864 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc014018800 con 0x564e838c5520 2024-07-26T12:31:45.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 10 client.15837 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:31:45.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 10 client.15837 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:31:45.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 20 client.15837 populate_metadata read hostname 'smithi040' 2024-07-26T12:31:45.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83883ea0 0x564e83c87a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 4 client.15837 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:31:45.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.373+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e83be2ea0 con 0x564e83883ea0 2024-07-26T12:31:45.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.374+0000 7fc013e00640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83883ea0 0x564e83c87a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.375+0000 7fc013e00640 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83883ea0 0x564e83c87a40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ddbae708bc49ff2 server_cookie=16832a10a070f303 in_seq=0 out_seq=0 2024-07-26T12:31:45.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.375+0000 7fbfff400640 10 client.15837 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fbfff400640 1 -- 172.21.15.40:0/4160796864 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e83be2ea0 con 0x564e83883ea0 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fbfff400640 10 client.15837 handle_command_reply: tid=0 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fc02786a740 1 client.15837 shutdown 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 msgr2=0x564e83c81d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fc02786a740 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c81d00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc014005b40 tx=0x7fc014005a70 comp rx=0 tx=0).stop 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 shutdown_connections 2024-07-26T12:31:45.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.377+0000 7fc02786a740 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83883ea0 0x564e83c87a40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838c5520 0x564e83c81d00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e838a4840 0x564e83c75dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 1 --2- 172.21.15.40:0/4160796864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e8389c660 0x564e83c75880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 >> 172.21.15.40:0/4160796864 conn(0x564e838b9910 msgr2=0x564e83c6d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fbfff400640 0 client.15837 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 shutdown_connections 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 1 -- 172.21.15.40:0/4160796864 wait complete. 2024-07-26T12:31:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.378+0000 7fc02786a740 20 client.15837 trim_cache size 0 max 16384 2024-07-26T12:31:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.397+0000 7fc02786a740 1 Processor -- start 2024-07-26T12:31:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.397+0000 7fc02786a740 1 -- start start 2024-07-26T12:31:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc02786a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c77410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc02786a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c70fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc02786a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c6b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc02786a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b0d30 con 0x564e838a4840 2024-07-26T12:31:45.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc02786a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b2870 con 0x564e8389c660 2024-07-26T12:31:45.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc02786a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b1400 con 0x564e838c5520 2024-07-26T12:31:45.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc013e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c70fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc013e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c70fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56042/0 (socket says 172.21.15.40:56042) 2024-07-26T12:31:45.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc013e00640 1 -- 172.21.15.40:0/2074386035 learned_addr learned my addr 172.21.15.40:0/2074386035 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:45.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc01a800640 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c77410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.398+0000 7fc01a800640 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c6b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc013e00640 1 -- 172.21.15.40:0/2074386035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 msgr2=0x564e83c6b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc013e00640 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c6b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc013e00640 1 -- 172.21.15.40:0/2074386035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 msgr2=0x564e83c77410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc013e00640 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c77410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc013e00640 1 -- 172.21.15.40:0/2074386035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e83c76b40 con 0x564e838a4840 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc013e00640 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c70fe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc00402a910 tx=0x7fc004009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5f972687fc1d10 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.399+0000 7fc00a600640 1 -- 172.21.15.40:0/2074386035 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00404a070 con 0x564e838a4840 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc00a600640 1 -- 172.21.15.40:0/2074386035 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc004045340 con 0x564e838a4840 2024-07-26T12:31:45.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc00a600640 1 -- 172.21.15.40:0/2074386035 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004035040 con 0x564e838a4840 2024-07-26T12:31:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc02786a740 1 -- 172.21.15.40:0/2074386035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 msgr2=0x564e83c70fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc02786a740 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c70fe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc00402a910 tx=0x7fc004009660 comp rx=0 tx=0).stop 2024-07-26T12:31:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc02786a740 1 -- 172.21.15.40:0/2074386035 shutdown_connections 2024-07-26T12:31:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc02786a740 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c6b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.400+0000 7fc02786a740 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c70fe0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.401+0000 7fc02786a740 1 --2- 172.21.15.40:0/2074386035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c77410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.401+0000 7fc02786a740 1 -- 172.21.15.40:0/2074386035 >> 172.21.15.40:0/2074386035 conn(0x564e838b9910 msgr2=0x564e83c74990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.401+0000 7fc02786a740 1 -- 172.21.15.40:0/2074386035 shutdown_connections 2024-07-26T12:31:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.401+0000 7fc02786a740 1 -- 172.21.15.40:0/2074386035 wait complete. 2024-07-26T12:31:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.401+0000 7fc02786a740 1 -- start start 2024-07-26T12:31:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 Processor -- start 2024-07-26T12:31:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c7e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c7a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b21a0 con 0x564e838a4840 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b1ad0 con 0x564e8389c660 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1aecf0 con 0x564e838c5520 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.402+0000 7fc02786a740 10 client.0 _ll_register_callbacks cb 0x7fc014008c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c799f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56056/0 (socket says 172.21.15.40:56056) 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 -- 172.21.15.40:0/142241816 learned_addr learned my addr 172.21.15.40:0/142241816 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc01a800640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c7e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc01a800640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c7a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 -- 172.21.15.40:0/142241816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 msgr2=0x564e83c7a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c7a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 -- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 msgr2=0x564e83c7e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:31:45.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c7e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.403+0000 7fc013e00640 1 -- 172.21.15.40:0/142241816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e83cef010 con 0x564e838a4840 2024-07-26T12:31:45.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fc013e00640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c799f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc004009230 tx=0x7fc004004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84fc67e99a5ece8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:31:45.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fbfff400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fbfff400640 1 -- 172.21.15.40:0/142241816 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004035070 con 0x564e838a4840 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc004045340 con 0x564e838a4840 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fbfff400640 1 -- 172.21.15.40:0/142241816 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc004003ba0 con 0x564e838a4840 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fbfff400640 1 -- 172.21.15.40:0/142241816 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc00404a040 con 0x564e838a4840 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fc02786a740 10 client.15843 fetch_fsmap learned FSMap version 35 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.404+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564e83cf0180 con 0x564e838a4840 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fbfff400640 1 -- 172.21.15.40:0/142241816 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc004045340 con 0x564e838a4840 2024-07-26T12:31:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fbfff400640 1 -- 172.21.15.40:0/142241816 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc00404d070 con 0x564e838a4840 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fc02786a740 10 client.15843 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fc02786a740 10 client.15843 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fc02786a740 20 client.15843 populate_metadata read hostname 'smithi040' 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fc02786a740 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83859250 0x564e83cf2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fc02786a740 4 client.15843 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bd1a7a28", "release": true, "await": true}] 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.405+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bd1a7a28", "release": true, "await": true}) -- 0x564e83bde940 con 0x564e83859250 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.406+0000 7fc01a800640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83859250 0x564e83cf2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.407+0000 7fc01a800640 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83859250 0x564e83cf2890 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7503c2a33fb1ae09 server_cookie=b89bc1dd113ceb6f in_seq=0 out_seq=0 2024-07-26T12:31:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.407+0000 7fbfff400640 10 client.15843 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:45.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.470+0000 7fbfff400640 1 -- 172.21.15.40:0/142241816 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564e83bde940 con 0x564e83859250 2024-07-26T12:31:45.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.470+0000 7fbfff400640 10 client.15843 handle_command_reply: tid=0 2024-07-26T12:31:45.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.470+0000 7fc02786a740 1 client.15843 shutdown 2024-07-26T12:31:45.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 msgr2=0x564e83c799f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c799f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc004009230 tx=0x7fc004004280 comp rx=0 tx=0).stop 2024-07-26T12:31:45.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 shutdown_connections 2024-07-26T12:31:45.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564e838c5520 0x564e83c7a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564e83859250 0x564e83cf2890 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564e838a4840 0x564e83c799f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 --2- 172.21.15.40:0/142241816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e8389c660 0x564e83c7e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fbfff400640 0 client.15843 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:31:45.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 >> 172.21.15.40:0/142241816 conn(0x564e838b9910 msgr2=0x564e83c6ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:45.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.471+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 shutdown_connections 2024-07-26T12:31:45.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.472+0000 7fc02786a740 1 -- 172.21.15.40:0/142241816 wait complete. 2024-07-26T12:31:45.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.472+0000 7fc02786a740 20 client.15843 trim_cache size 0 max 16384 2024-07-26T12:31:45.475 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 32, 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "bd1a7a28": { 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 32, 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:31:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.2, 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:31:45.477 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.473+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc0000b3c00 msgr2=0x7fc0000b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.473+0000 7fc01b200640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc0000b3c00 0x7fc0000b6110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00cfd0 tx=0x7fc00c000bc0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.473+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 msgr2=0x7fc01c19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.473+0000 7fc01b200640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 0x7fc01c19be50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c920 tx=0x7fc00c00cde0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 shutdown_connections 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc0000b3c00 0x7fc0000b6110 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc01c10d690 0x7fc01c1a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc01c104b80 0x7fc01c19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 --2- 172.21.15.40:0/3479649670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc01c104230 0x7fc01c19be50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:31:45.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 >> 172.21.15.40:0/3479649670 conn(0x7fc01c0fdd30 msgr2=0x7fc01c0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:31:45.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 shutdown_connections 2024-07-26T12:31:45.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:31:45.474+0000 7fc01b200640 1 -- 172.21.15.40:0/3479649670 wait complete. 2024-07-26T12:31:45.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:45 smithi040 ceph-mon[32397]: pgmap v785: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 136 KiB/s wr, 12 op/s 2024-07-26T12:31:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:45 smithi146 ceph-mon[35807]: pgmap v785: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 136 KiB/s wr, 12 op/s 2024-07-26T12:31:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:45 smithi076 ceph-mon[35401]: pgmap v785: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 136 KiB/s wr, 12 op/s 2024-07-26T12:31:46.393 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bd1a7a28', total seconds elapsed: 30.1 2024-07-26T12:31:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:47 smithi040 ceph-mon[32397]: pgmap v786: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:31:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:47 smithi146 ceph-mon[35807]: pgmap v786: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:31:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:47 smithi076 ceph-mon[35401]: pgmap v786: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:31:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:49 smithi040 ceph-mon[32397]: pgmap v787: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 205 KiB/s wr, 9 op/s 2024-07-26T12:31:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:49 smithi146 ceph-mon[35807]: pgmap v787: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 205 KiB/s wr, 9 op/s 2024-07-26T12:31:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:49 smithi076 ceph-mon[35401]: pgmap v787: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 205 KiB/s wr, 9 op/s 2024-07-26T12:31:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:51 smithi040 ceph-mon[32397]: pgmap v788: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 205 KiB/s wr, 11 op/s 2024-07-26T12:31:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:51 smithi146 ceph-mon[35807]: pgmap v788: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 205 KiB/s wr, 11 op/s 2024-07-26T12:31:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:51 smithi076 ceph-mon[35401]: pgmap v788: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 205 KiB/s wr, 11 op/s 2024-07-26T12:31:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:53 smithi040 ceph-mon[32397]: pgmap v789: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 888 KiB/s wr, 8 op/s 2024-07-26T12:31:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:53 smithi146 ceph-mon[35807]: pgmap v789: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 888 KiB/s wr, 8 op/s 2024-07-26T12:31:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:53 smithi076 ceph-mon[35401]: pgmap v789: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 888 KiB/s wr, 8 op/s 2024-07-26T12:31:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:55 smithi040 ceph-mon[32397]: pgmap v790: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T12:31:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:55 smithi146 ceph-mon[35807]: pgmap v790: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T12:31:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:55 smithi076 ceph-mon[35401]: pgmap v790: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T12:31:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:57 smithi040 ceph-mon[32397]: pgmap v791: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 9 op/s 2024-07-26T12:31:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:57 smithi146 ceph-mon[35807]: pgmap v791: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 9 op/s 2024-07-26T12:31:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:57 smithi076 ceph-mon[35401]: pgmap v791: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 9 op/s 2024-07-26T12:31:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:31:59 smithi040 ceph-mon[32397]: pgmap v792: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 MiB/s wr, 10 op/s 2024-07-26T12:32:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:31:59 smithi146 ceph-mon[35807]: pgmap v792: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 MiB/s wr, 10 op/s 2024-07-26T12:32:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:31:59 smithi076 ceph-mon[35401]: pgmap v792: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 MiB/s wr, 10 op/s 2024-07-26T12:32:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:01 smithi040 ceph-mon[32397]: pgmap v793: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:32:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:01 smithi146 ceph-mon[35807]: pgmap v793: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:32:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:01 smithi076 ceph-mon[35401]: pgmap v793: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:32:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:03 smithi040 ceph-mon[32397]: pgmap v794: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:32:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:03 smithi146 ceph-mon[35807]: pgmap v794: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:32:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:03 smithi076 ceph-mon[35401]: pgmap v794: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:32:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:05 smithi040 ceph-mon[32397]: pgmap v795: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:05 smithi146 ceph-mon[35807]: pgmap v795: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:05 smithi076 ceph-mon[35401]: pgmap v795: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:07 smithi146 ceph-mon[35807]: pgmap v796: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:32:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:07 smithi076 ceph-mon[35401]: pgmap v796: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:32:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:07 smithi040 ceph-mon[32397]: pgmap v796: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:32:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:32:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:32:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:32:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:09 smithi146 ceph-mon[35807]: pgmap v797: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:32:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:32:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:32:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:09 smithi076 ceph-mon[35401]: pgmap v797: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:32:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:32:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:32:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:09 smithi040 ceph-mon[32397]: pgmap v797: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:32:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:32:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:32:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:11 smithi146 ceph-mon[35807]: pgmap v798: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:32:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:11 smithi076 ceph-mon[35401]: pgmap v798: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:32:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:11 smithi040 ceph-mon[32397]: pgmap v798: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:32:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:12 smithi146 ceph-mon[35807]: pgmap v799: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:12 smithi076 ceph-mon[35401]: pgmap v799: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:12 smithi040 ceph-mon[32397]: pgmap v799: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:15 smithi076 ceph-mon[35401]: pgmap v800: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:32:15.729 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:15 smithi040 ceph-mon[32397]: pgmap v800: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:32:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:15 smithi146 ceph-mon[35807]: pgmap v800: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:32:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:17 smithi040 ceph-mon[32397]: pgmap v801: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:17 smithi146 ceph-mon[35807]: pgmap v801: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:17 smithi076 ceph-mon[35401]: pgmap v801: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:19 smithi040 ceph-mon[32397]: pgmap v802: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:19 smithi146 ceph-mon[35807]: pgmap v802: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:19 smithi076 ceph-mon[35401]: pgmap v802: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:21 smithi040 ceph-mon[32397]: pgmap v803: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:21 smithi146 ceph-mon[35807]: pgmap v803: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:21 smithi076 ceph-mon[35401]: pgmap v803: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:23 smithi040 ceph-mon[32397]: pgmap v804: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:23 smithi146 ceph-mon[35807]: pgmap v804: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:23 smithi076 ceph-mon[35401]: pgmap v804: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:25 smithi040 ceph-mon[32397]: pgmap v805: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T12:32:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:25 smithi146 ceph-mon[35807]: pgmap v805: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T12:32:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:25 smithi076 ceph-mon[35401]: pgmap v805: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T12:32:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:27 smithi040 ceph-mon[32397]: pgmap v806: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:32:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:27 smithi146 ceph-mon[35807]: pgmap v806: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:32:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:27 smithi076 ceph-mon[35401]: pgmap v806: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:32:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:29 smithi040 ceph-mon[32397]: pgmap v807: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:32:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:29 smithi146 ceph-mon[35807]: pgmap v807: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:32:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:29 smithi076 ceph-mon[35401]: pgmap v807: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:32:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:31 smithi040 ceph-mon[32397]: pgmap v808: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:32:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:31 smithi146 ceph-mon[35807]: pgmap v808: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:32:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:31 smithi076 ceph-mon[35401]: pgmap v808: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:32:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:33 smithi040 ceph-mon[32397]: pgmap v809: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:33 smithi146 ceph-mon[35807]: pgmap v809: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:33 smithi076 ceph-mon[35401]: pgmap v809: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:35 smithi040 ceph-mon[32397]: pgmap v810: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:35 smithi146 ceph-mon[35807]: pgmap v810: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:35 smithi076 ceph-mon[35401]: pgmap v810: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:37 smithi040 ceph-mon[32397]: pgmap v811: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:32:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:37 smithi146 ceph-mon[35807]: pgmap v811: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:32:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:37 smithi076 ceph-mon[35401]: pgmap v811: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:32:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:39 smithi040 ceph-mon[32397]: pgmap v812: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:39 smithi146 ceph-mon[35807]: pgmap v812: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:39 smithi076 ceph-mon[35401]: pgmap v812: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:41 smithi040 ceph-mon[32397]: pgmap v813: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:32:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:41 smithi146 ceph-mon[35807]: pgmap v813: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:32:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:41 smithi076 ceph-mon[35401]: pgmap v813: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:32:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:43 smithi040 ceph-mon[32397]: pgmap v814: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:43 smithi146 ceph-mon[35807]: pgmap v814: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:43 smithi076 ceph-mon[35401]: pgmap v814: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:32:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:45 smithi040 ceph-mon[32397]: pgmap v815: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:32:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:45 smithi146 ceph-mon[35807]: pgmap v815: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:32:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:45 smithi076 ceph-mon[35401]: pgmap v815: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:32:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:47 smithi040 ceph-mon[32397]: pgmap v816: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:47 smithi146 ceph-mon[35807]: pgmap v816: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:47 smithi076 ceph-mon[35401]: pgmap v816: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:32:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:49 smithi040 ceph-mon[32397]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:32:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:49 smithi146 ceph-mon[35807]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:32:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:49 smithi076 ceph-mon[35401]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:32:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:51 smithi040 ceph-mon[32397]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:32:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:51 smithi146 ceph-mon[35807]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:32:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:51 smithi076 ceph-mon[35401]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:32:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:53 smithi040 ceph-mon[32397]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:53 smithi146 ceph-mon[35807]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:53 smithi076 ceph-mon[35401]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:55 smithi040 ceph-mon[32397]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:55 smithi146 ceph-mon[35807]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:55 smithi076 ceph-mon[35401]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:32:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:57 smithi040 ceph-mon[32397]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:57 smithi146 ceph-mon[35807]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:57 smithi076 ceph-mon[35401]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:32:59.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:32:59 smithi146 ceph-mon[35807]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:32:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:32:59 smithi076 ceph-mon[35401]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:32:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:32:59 smithi040 ceph-mon[32397]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:33:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:01 smithi146 ceph-mon[35807]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:33:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:01 smithi076 ceph-mon[35401]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:33:01.894 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:01 smithi040 ceph-mon[32397]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:33:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:03 smithi146 ceph-mon[35807]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:33:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:03 smithi076 ceph-mon[35401]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:33:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:03 smithi040 ceph-mon[32397]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:33:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:05 smithi146 ceph-mon[35807]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:33:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:05 smithi076 ceph-mon[35401]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:33:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:05 smithi040 ceph-mon[32397]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:33:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:07 smithi146 ceph-mon[35807]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:33:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:07 smithi076 ceph-mon[35401]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:33:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:07 smithi040 ceph-mon[32397]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:33:08.851 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.6 2024-07-26T12:33:08.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:33:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:33:09.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:09 smithi040 ceph-mon[32397]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:33:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:09 smithi146 ceph-mon[35807]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:33:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:09 smithi076 ceph-mon[35401]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:33:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:33:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:33:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:33:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 -- 172.21.15.40:0/2913071076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144109670 msgr2=0x7f014410fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 --2- 172.21.15.40:0/2913071076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144109670 0x7f014410fea0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ca0 tx=0x7f013c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:33:11.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:11 smithi040 ceph-mon[32397]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:33:11.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:33:11.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:33:11.793 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:33:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 -- 172.21.15.40:0/2913071076 shutdown_connections 2024-07-26T12:33:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 --2- 172.21.15.40:0/2913071076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144109670 0x7f014410fea0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 --2- 172.21.15.40:0/2913071076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0144108d20 0x7f0144109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 --2- 172.21.15.40:0/2913071076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01441033e0 0x7f01441037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 -- 172.21.15.40:0/2913071076 >> 172.21.15.40:0/2913071076 conn(0x7f01440fee30 msgr2=0x7f0144101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.790+0000 7f014ac00640 1 -- 172.21.15.40:0/2913071076 shutdown_connections 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.791+0000 7f014ac00640 1 -- 172.21.15.40:0/2913071076 wait complete. 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.792+0000 7f014ac00640 1 Processor -- start 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.792+0000 7f014ac00640 1 -- start start 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f014ac00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 0x7f0144075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f014ac00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144108d20 0x7f0144075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f014ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0144109670 0x7f0144075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f014ac00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0144113240 con 0x7f0144108d20 2024-07-26T12:33:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f014ac00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f01441130c0 con 0x7f01441033e0 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f014ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01441133c0 con 0x7f0144109670 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f0149800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 0x7f0144075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f0149800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 0x7f0144075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:52254/0 (socket says 172.21.15.40:52254) 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.793+0000 7f0149800640 1 -- 172.21.15.40:0/3010683829 learned_addr learned my addr 172.21.15.40:0/3010683829 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f014a200640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0144109670 0x7f0144075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f0148e00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144108d20 0x7f0144075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f0149800640 1 -- 172.21.15.40:0/3010683829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0144109670 msgr2=0x7f0144075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f0149800640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0144109670 0x7f0144075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f0149800640 1 -- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144108d20 msgr2=0x7f0144075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f0149800640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144108d20 0x7f0144075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.794+0000 7f0149800640 1 -- 172.21.15.40:0/3010683829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01441a7e90 con 0x7f01441033e0 2024-07-26T12:33:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.795+0000 7f0149800640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 0x7f0144075140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f013800d770 tx=0x7f013800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.795+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138017070 con 0x7f01441033e0 2024-07-26T12:33:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.795+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01441a8180 con 0x7f01441033e0 2024-07-26T12:33:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.796+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01441a86c0 con 0x7f01441033e0 2024-07-26T12:33:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.796+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01380054b0 con 0x7f01441033e0 2024-07-26T12:33:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.796+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138004c60 con 0x7f01441033e0 2024-07-26T12:33:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.797+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01240052c0 con 0x7f01441033e0 2024-07-26T12:33:11.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.802+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0138009c30 con 0x7f01441033e0 2024-07-26T12:33:11.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.804+0000 7f0142000640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f012c0b3c50 0x7f012c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:11.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.804+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f01380e3700 con 0x7f01441033e0 2024-07-26T12:33:11.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.804+0000 7f0148e00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f012c0b3c50 0x7f012c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:11.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.805+0000 7f0148e00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f012c0b3c50 0x7f012c0b6160 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0144106610 tx=0x7f013000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:11.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:11.815+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f01380aa740 con 0x7f01441033e0 2024-07-26T12:33:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:11 smithi146 ceph-mon[35807]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:33:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:33:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:33:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:33:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:11 smithi076 ceph-mon[35401]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:33:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:33:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:33:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:33:12.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.087+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01240055b0 con 0x7f01441033e0 2024-07-26T12:33:12.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.089+0000 7f0142000640 1 -- 172.21.15.40:0/3010683829 <== mon.2 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f01380aec90 con 0x7f01441033e0 2024-07-26T12:33:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:33:12.091 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:33:12.091 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:33:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f012c0b3c50 msgr2=0x7f012c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f012c0b3c50 0x7f012c0b6160 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0144106610 tx=0x7f013000b390 comp rx=0 tx=0).stop 2024-07-26T12:33:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 msgr2=0x7f0144075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 0x7f0144075140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f013800d770 tx=0x7f013800dc30 comp rx=0 tx=0).stop 2024-07-26T12:33:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 shutdown_connections 2024-07-26T12:33:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f012c0b3c50 0x7f012c0b6160 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:12.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0144109670 0x7f0144075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:12.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0144108d20 0x7f0144075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:12.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 --2- 172.21.15.40:0/3010683829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01441033e0 0x7f0144075140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:12.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 >> 172.21.15.40:0/3010683829 conn(0x7f01440fee30 msgr2=0x7f0144101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:12.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.093+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 shutdown_connections 2024-07-26T12:33:12.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:12.094+0000 7f014ac00640 1 -- 172.21.15.40:0/3010683829 wait complete. 2024-07-26T12:33:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:12 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3010683829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:33:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:12 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3010683829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:33:12.866 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:12 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3010683829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:33:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 152.6 --await-for 45.0' 2024-07-26T12:33:12.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 152.6 --await-for 45.0 2024-07-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:33:13.814 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:13 smithi040 ceph-mon[32397]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:33:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:13 smithi146 ceph-mon[35807]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:33:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:13 smithi076 ceph-mon[35401]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:33:15.707 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:15 smithi040 ceph-mon[32397]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T12:33:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:15 smithi146 ceph-mon[35807]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T12:33:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:15 smithi076 ceph-mon[35401]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T12:33:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 -- 172.21.15.40:0/920368272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e28104b20 msgr2=0x7f3e2810d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 --2- 172.21.15.40:0/920368272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e28104b20 0x7f3e2810d160 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009900 tx=0x7f3e1802a410 comp rx=0 tx=0).stop 2024-07-26T12:33:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 -- 172.21.15.40:0/920368272 shutdown_connections 2024-07-26T12:33:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 --2- 172.21.15.40:0/920368272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e2810d6a0 0x7f3e2810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 --2- 172.21.15.40:0/920368272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e28104b20 0x7f3e2810d160 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 --2- 172.21.15.40:0/920368272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e281040f0 0x7f3e28104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 -- 172.21.15.40:0/920368272 >> 172.21.15.40:0/920368272 conn(0x7f3e280fdd60 msgr2=0x7f3e281001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.940+0000 7f3e2f200640 1 -- 172.21.15.40:0/920368272 shutdown_connections 2024-07-26T12:33:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.941+0000 7f3e2f200640 1 -- 172.21.15.40:0/920368272 wait complete. 2024-07-26T12:33:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.942+0000 7f3e2f200640 1 Processor -- start 2024-07-26T12:33:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.942+0000 7f3e2f200640 1 -- start start 2024-07-26T12:33:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e281040f0 0x7f3e2819beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e28104b20 0x7f3e2819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 0x7f3e281a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28113160 con 0x7f3e2810d6a0 2024-07-26T12:33:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28112fe0 con 0x7f3e28104b20 2024-07-26T12:33:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281132e0 con 0x7f3e281040f0 2024-07-26T12:33:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 0x7f3e281a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 0x7f3e281a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44276/0 (socket says 172.21.15.40:44276) 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2e800640 1 -- 172.21.15.40:0/2414139853 learned_addr learned my addr 172.21.15.40:0/2414139853 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e28104b20 0x7f3e2819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.943+0000 7f3e2de00640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e281040f0 0x7f3e2819beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2e800640 1 -- 172.21.15.40:0/2414139853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e281040f0 msgr2=0x7f3e2819beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2e800640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e281040f0 0x7f3e2819beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2e800640 1 -- 172.21.15.40:0/2414139853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e28104b20 msgr2=0x7f3e2819c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2e800640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e28104b20 0x7f3e2819c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2e800640 1 -- 172.21.15.40:0/2414139853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e281a1e20 con 0x7f3e2810d6a0 2024-07-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e28104b20 0x7f3e2819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:33:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.944+0000 7f3e2e800640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 0x7f3e281a16f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400eaa0 tx=0x7f3e2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.945+0000 7f3e22a00640 1 -- 172.21.15.40:0/2414139853 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400cdb0 con 0x7f3e2810d6a0 2024-07-26T12:33:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.945+0000 7f3e22a00640 1 -- 172.21.15.40:0/2414139853 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e24005020 con 0x7f3e2810d6a0 2024-07-26T12:33:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.945+0000 7f3e22a00640 1 -- 172.21.15.40:0/2414139853 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e240116d0 con 0x7f3e2810d6a0 2024-07-26T12:33:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.945+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e281a2110 con 0x7f3e2810d6a0 2024-07-26T12:33:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.945+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e281a8870 con 0x7f3e2810d6a0 2024-07-26T12:33:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.949+0000 7f3e22a00640 1 -- 172.21.15.40:0/2414139853 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3e240051d0 con 0x7f3e2810d6a0 2024-07-26T12:33:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.950+0000 7f3e3761b740 1 Processor -- start 2024-07-26T12:33:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.950+0000 7f3e3761b740 1 -- start start 2024-07-26T12:33:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.950+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 0x555cc55f9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.950+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc522a980 0x555cc55f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.950+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc55f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e3761b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555cc55c3cf0 con 0x555cc5232b60 2024-07-26T12:33:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e3761b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555cc556eb40 con 0x555cc522a980 2024-07-26T12:33:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e3761b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555cc555e040 con 0x555cc5253840 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e2d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 0x555cc55f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e2d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 0x555cc55f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:46184/0 (socket says 172.21.15.40:46184) 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e2d400640 1 -- 172.21.15.40:0/2784822026 learned_addr learned my addr 172.21.15.40:0/2784822026 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e2de00640 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc522a980 0x555cc55f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.951+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc55f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e22a00640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e100b3c40 0x7f3e100b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e22a00640 1 -- 172.21.15.40:0/2414139853 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3e240e3cf0 con 0x7f3e2810d6a0 2024-07-26T12:33:15.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e2d400640 1 -- 172.21.15.40:0/2784822026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc522a980 msgr2=0x555cc55f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:15.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc522a980 0x555cc55f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e2d400640 1 -- 172.21.15.40:0/2784822026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 msgr2=0x555cc55f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:15.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc55f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.952+0000 7f3e2d400640 1 -- 172.21.15.40:0/2784822026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc54e5af0 con 0x555cc5253840 2024-07-26T12:33:15.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.953+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 0x555cc55f9390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005760 tx=0x7f3e180056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a66442296a7bc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:15.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.953+0000 7f3e2e800640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e100b3c40 0x7f3e100b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.953+0000 7f3e17000640 1 -- 172.21.15.40:0/2784822026 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18035040 con 0x555cc5253840 2024-07-26T12:33:15.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.953+0000 7f3e17000640 1 -- 172.21.15.40:0/2784822026 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e180044c0 con 0x555cc5253840 2024-07-26T12:33:15.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.953+0000 7f3e17000640 1 -- 172.21.15.40:0/2784822026 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18003c70 con 0x555cc5253840 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 -- 172.21.15.40:0/2784822026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 msgr2=0x555cc55f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 0x555cc55f9390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005760 tx=0x7f3e180056d0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e2e800640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e100b3c40 0x7f3e100b6150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e240a7eb0 tx=0x7f3e2400cf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 -- 172.21.15.40:0/2784822026 shutdown_connections 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc55f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc522a980 0x555cc55f98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2784822026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5253840 0x555cc55f9390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 -- 172.21.15.40:0/2784822026 >> 172.21.15.40:0/2784822026 conn(0x555cc5247990 msgr2=0x555cc55f7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 -- 172.21.15.40:0/2784822026 shutdown_connections 2024-07-26T12:33:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.955+0000 7f3e3761b740 1 -- 172.21.15.40:0/2784822026 wait complete. 2024-07-26T12:33:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.956+0000 7f3e3761b740 1 -- start start 2024-07-26T12:33:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.956+0000 7f3e3761b740 1 Processor -- start 2024-07-26T12:33:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5604e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5605370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555cc54fa500 con 0x555cc5232b60 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555cc5562080 con 0x555cc5253840 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555cc53c17a0 con 0x555cc522a980 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e3761b740 10 client.0 _ll_register_callbacks cb 0x555cc5556bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.959+0000 7f3e2d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5604e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.960+0000 7f3e2d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5604e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:46196/0 (socket says 172.21.15.40:46196) 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.960+0000 7f3e2d400640 1 -- 172.21.15.40:0/2748728953 learned_addr learned my addr 172.21.15.40:0/2748728953 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.960+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.960+0000 7f3e2de00640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5605370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e2d400640 1 -- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 msgr2=0x555cc5610ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:15.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e2d400640 1 -- 172.21.15.40:0/2748728953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 msgr2=0x555cc5605370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5605370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e2d400640 1 -- 172.21.15.40:0/2748728953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc52cdb90 con 0x555cc522a980 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5604e30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e18032bc0 tx=0x7f3e18003930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b5bf6d917eb719 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.961+0000 7f3e0b400640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.962+0000 7f3e0b400640 1 -- 172.21.15.40:0/2748728953 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1804d070 con 0x555cc522a980 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.962+0000 7f3e0b400640 1 -- 172.21.15.40:0/2748728953 <== mon.1 v2:172.21.15.146:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3e18004060 con 0x555cc522a980 2024-07-26T12:33:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.962+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555cc5570a90 con 0x555cc522a980 2024-07-26T12:33:15.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.963+0000 7f3e0b400640 1 -- 172.21.15.40:0/2748728953 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3e18035040 con 0x555cc522a980 2024-07-26T12:33:15.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.963+0000 7f3e3761b740 10 client.25543 fetch_fsmap learned FSMap version 35 2024-07-26T12:33:15.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.963+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555cc56138e0 con 0x555cc522a980 2024-07-26T12:33:15.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.963+0000 7f3e0b400640 1 -- 172.21.15.40:0/2748728953 <== mon.1 v2:172.21.15.146:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555cc5570a90 con 0x555cc522a980 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e0b400640 1 -- 172.21.15.40:0/2748728953 <== mon.1 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1803a040 con 0x555cc522a980 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e3761b740 10 client.25543 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e3761b740 10 client.25543 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e3761b740 20 client.25543 populate_metadata read hostname 'smithi040' 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc52121c0 0x555cc5616c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e3761b740 4 client.25543 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:33:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.964+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc556c530 con 0x555cc52121c0 2024-07-26T12:33:15.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.965+0000 7f3e2de00640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc52121c0 0x555cc5616c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.967+0000 7f3e2de00640 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc52121c0 0x555cc5616c40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c5103a0a4623ea server_cookie=659f3d195c4d24b5 in_seq=0 out_seq=0 2024-07-26T12:33:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.967+0000 7f3e0b400640 10 client.25543 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:15.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.970+0000 7f3e0b400640 1 -- 172.21.15.40:0/2748728953 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cc556c530 con 0x555cc52121c0 2024-07-26T12:33:15.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.970+0000 7f3e0b400640 10 client.25543 handle_command_reply: tid=0 2024-07-26T12:33:15.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.970+0000 7f3e3761b740 1 client.25543 shutdown 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 msgr2=0x555cc5604e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5604e30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e18032bc0 tx=0x7f3e18003930 comp rx=0 tx=0).stop 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 shutdown_connections 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc52121c0 0x555cc5616c40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5605370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2748728953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5604e30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 >> 172.21.15.40:0/2748728953 conn(0x555cc5247990 msgr2=0x555cc55fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.971+0000 7f3e0b400640 0 client.25543 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.972+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 shutdown_connections 2024-07-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.972+0000 7f3e3761b740 1 -- 172.21.15.40:0/2748728953 wait complete. 2024-07-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.972+0000 7f3e3761b740 20 client.25543 trim_cache size 0 max 16384 2024-07-26T12:33:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.996+0000 7f3e3761b740 1 Processor -- start 2024-07-26T12:33:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.996+0000 7f3e3761b740 1 -- start start 2024-07-26T12:33:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 0x555cc55ff4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5232b60 0x555cc5606b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e3761b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281b0d90 con 0x555cc522a980 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e3761b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281b28d0 con 0x555cc5253840 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e3761b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281b1460 con 0x555cc5232b60 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e2d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 0x555cc55ff4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e2d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 0x555cc55ff4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44296/0 (socket says 172.21.15.40:44296) 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.997+0000 7f3e2d400640 1 -- 172.21.15.40:0/2439455657 learned_addr learned my addr 172.21.15.40:0/2439455657 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2de00640 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5232b60 0x555cc5606b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2d400640 1 -- 172.21.15.40:0/2439455657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5232b60 msgr2=0x555cc5606b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5232b60 0x555cc5606b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2d400640 1 -- 172.21.15.40:0/2439455657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 msgr2=0x555cc5610c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2d400640 1 -- 172.21.15.40:0/2439455657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc55fbae0 con 0x555cc522a980 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.998+0000 7f3e2d400640 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 0x555cc55ff4b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3e1803dba0 tx=0x7f3e18032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdf8caedd9ce8ea server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.999+0000 7f3e16600640 1 -- 172.21.15.40:0/2439455657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1804d040 con 0x555cc522a980 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.999+0000 7f3e16600640 1 -- 172.21.15.40:0/2439455657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e18009780 con 0x555cc522a980 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:15.999+0000 7f3e16600640 1 -- 172.21.15.40:0/2439455657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e180319c0 con 0x555cc522a980 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 -- 172.21.15.40:0/2439455657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 msgr2=0x555cc55ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 0x555cc55ff4b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3e1803dba0 tx=0x7f3e18032cd0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 -- 172.21.15.40:0/2439455657 shutdown_connections 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5610c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc5232b60 0x555cc5606b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 --2- 172.21.15.40:0/2439455657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc522a980 0x555cc55ff4b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 -- 172.21.15.40:0/2439455657 >> 172.21.15.40:0/2439455657 conn(0x555cc5247990 msgr2=0x555cc55fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 -- 172.21.15.40:0/2439455657 shutdown_connections 2024-07-26T12:33:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.000+0000 7f3e3761b740 1 -- 172.21.15.40:0/2439455657 wait complete. 2024-07-26T12:33:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.001+0000 7f3e3761b740 1 -- start start 2024-07-26T12:33:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.001+0000 7f3e3761b740 1 Processor -- start 2024-07-26T12:33:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.001+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5676460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5676a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e3761b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5617460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e3761b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281b2200 con 0x555cc5232b60 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e3761b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281b1b30 con 0x555cc5253840 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e3761b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281aed50 con 0x555cc522a980 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e3761b740 10 client.0 _ll_register_callbacks cb 0x7f3e18032d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e2de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5676a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e2de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5676a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44312/0 (socket says 172.21.15.40:44312) 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e2de00640 1 -- 172.21.15.40:0/235164392 learned_addr learned my addr 172.21.15.40:0/235164392 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e2d400640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5676460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.002+0000 7f3e2d400640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5617460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:16.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e2de00640 1 -- 172.21.15.40:0/235164392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 msgr2=0x555cc5676460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:16.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e2de00640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5676460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e2de00640 1 -- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 msgr2=0x555cc5617460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:16.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e2de00640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5617460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e2de00640 1 -- 172.21.15.40:0/235164392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc5617bd0 con 0x555cc5232b60 2024-07-26T12:33:16.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e2de00640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5676a20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00b890 tx=0x7f3e1c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdcd52b6eed3c15 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e0b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e0b400640 1 -- 172.21.15.40:0/235164392 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c011640 con 0x555cc5232b60 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e0b400640 1 -- 172.21.15.40:0/235164392 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3e1c0117e0 con 0x555cc5232b60 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.003+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e18009780 con 0x555cc5232b60 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.004+0000 7f3e0b400640 1 -- 172.21.15.40:0/235164392 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0119e0 con 0x555cc5232b60 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.004+0000 7f3e3761b740 10 client.15867 fetch_fsmap learned FSMap version 35 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.004+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555cc567ed80 con 0x555cc5232b60 2024-07-26T12:33:16.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.004+0000 7f3e0b400640 1 -- 172.21.15.40:0/235164392 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e18009780 con 0x555cc5232b60 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.004+0000 7f3e0b400640 1 -- 172.21.15.40:0/235164392 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1c030c00 con 0x555cc5232b60 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e3761b740 10 client.15867 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e3761b740 10 client.15867 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e3761b740 20 client.15867 populate_metadata read hostname 'smithi040' 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e3761b740 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc51e7570 0x555cc56815e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e3761b740 4 client.15867 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.6, "await_for": 45.0}] 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.6, "await_for": 45.0}) -- 0x555cc5569c70 con 0x555cc51e7570 2024-07-26T12:33:16.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.005+0000 7f3e2d400640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc51e7570 0x555cc56815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:16.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.006+0000 7f3e2d400640 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc51e7570 0x555cc56815e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fbc8ee649a1f665 server_cookie=6c7b0704d0294df7 in_seq=0 out_seq=0 2024-07-26T12:33:16.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.006+0000 7f3e0b400640 10 client.15867 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.251+0000 7f3e0b400640 1 -- 172.21.15.40:0/235164392 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555cc5569c70 con 0x555cc51e7570 2024-07-26T12:33:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.251+0000 7f3e0b400640 10 client.15867 handle_command_reply: tid=0 2024-07-26T12:33:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 client.15867 shutdown 2024-07-26T12:33:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 msgr2=0x555cc5676a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5676a20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00b890 tx=0x7f3e1c0035f0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 shutdown_connections 2024-07-26T12:33:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555cc5253840 0x555cc5617460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555cc51e7570 0x555cc56815e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555cc5232b60 0x555cc5676a20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 --2- 172.21.15.40:0/235164392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555cc522a980 0x555cc5676460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 >> 172.21.15.40:0/235164392 conn(0x555cc5247990 msgr2=0x555cc55fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.252+0000 7f3e0b400640 0 client.15867 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.253+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 shutdown_connections 2024-07-26T12:33:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.253+0000 7f3e3761b740 1 -- 172.21.15.40:0/235164392 wait complete. 2024-07-26T12:33:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.253+0000 7f3e3761b740 20 client.15867 trim_cache size 0 max 16384 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 34, 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "140686f3": { 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 34, 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:33:16.256 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 152.6, 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:16.258 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e100b3c40 msgr2=0x7f3e100b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e100b3c40 0x7f3e100b6150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e240a7eb0 tx=0x7f3e2400cf90 comp rx=0 tx=0).stop 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 msgr2=0x7f3e281a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 0x7f3e281a16f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400eaa0 tx=0x7f3e2400ef60 comp rx=0 tx=0).stop 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 shutdown_connections 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e2810d6a0 0x7f3e281a16f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e28104b20 0x7f3e2819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e100b3c40 0x7f3e100b6150 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 --2- 172.21.15.40:0/2414139853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e281040f0 0x7f3e2819beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:16.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.255+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 >> 172.21.15.40:0/2414139853 conn(0x7f3e280fdd60 msgr2=0x7f3e28102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:16.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.256+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 shutdown_connections 2024-07-26T12:33:16.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:16.256+0000 7f3e2f200640 1 -- 172.21.15.40:0/2414139853 wait complete. 2024-07-26T12:33:16.965 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '140686f3', quiesce took 8.1 seconds. Will release after: 24.5 2024-07-26T12:33:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:17 smithi146 ceph-mon[35807]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:33:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:17 smithi076 ceph-mon[35401]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:33:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:17 smithi040 ceph-mon[32397]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:33:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:19 smithi076 ceph-mon[35401]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:33:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:19 smithi040 ceph-mon[32397]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:33:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:19 smithi146 ceph-mon[35807]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:33:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:21 smithi076 ceph-mon[35401]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:33:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:21 smithi040 ceph-mon[32397]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:33:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:21 smithi146 ceph-mon[35807]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:33:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:23 smithi040 ceph-mon[32397]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:33:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:23 smithi146 ceph-mon[35807]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:33:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:23 smithi076 ceph-mon[35401]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:33:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:25 smithi040 ceph-mon[32397]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:33:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:25 smithi146 ceph-mon[35807]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:33:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:25 smithi076 ceph-mon[35401]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:33:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:27 smithi040 ceph-mon[32397]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-07-26T12:33:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:27 smithi146 ceph-mon[35807]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-07-26T12:33:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:27 smithi076 ceph-mon[35401]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-07-26T12:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:29 smithi040 ceph-mon[32397]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T12:33:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:29 smithi146 ceph-mon[35807]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T12:33:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:29 smithi076 ceph-mon[35401]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T12:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:31 smithi040 ceph-mon[32397]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 755 KiB/s wr, 12 op/s 2024-07-26T12:33:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:31 smithi146 ceph-mon[35807]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 755 KiB/s wr, 12 op/s 2024-07-26T12:33:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:31 smithi076 ceph-mon[35401]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 755 KiB/s wr, 12 op/s 2024-07-26T12:33:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:33 smithi040 ceph-mon[32397]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 412 KiB/s wr, 9 op/s 2024-07-26T12:33:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:33 smithi146 ceph-mon[35807]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 412 KiB/s wr, 9 op/s 2024-07-26T12:33:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:33 smithi076 ceph-mon[35401]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 412 KiB/s wr, 9 op/s 2024-07-26T12:33:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:35 smithi040 ceph-mon[32397]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 413 KiB/s wr, 12 op/s 2024-07-26T12:33:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:35 smithi146 ceph-mon[35807]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 413 KiB/s wr, 12 op/s 2024-07-26T12:33:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:35 smithi076 ceph-mon[35401]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 413 KiB/s wr, 12 op/s 2024-07-26T12:33:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:37 smithi040 ceph-mon[32397]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 71 KiB/s wr, 8 op/s 2024-07-26T12:33:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:37 smithi146 ceph-mon[35807]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 71 KiB/s wr, 8 op/s 2024-07-26T12:33:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:37 smithi076 ceph-mon[35401]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 71 KiB/s wr, 8 op/s 2024-07-26T12:33:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:39 smithi146 ceph-mon[35807]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-07-26T12:33:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:39 smithi076 ceph-mon[35401]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-07-26T12:33:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:39 smithi040 ceph-mon[32397]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-07-26T12:33:41.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:33:41.971 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:33:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:41 smithi040 ceph-mon[32397]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T12:33:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:41 smithi146 ceph-mon[35807]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T12:33:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:41 smithi076 ceph-mon[35401]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T12:33:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:43 smithi146 ceph-mon[35807]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:33:44.074 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:43 smithi040 ceph-mon[32397]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:33:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:43 smithi076 ceph-mon[35401]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:33:44.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 -- 172.21.15.40:0/3250472647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73201099f0 msgr2=0x7f7320109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:44.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 --2- 172.21.15.40:0/3250472647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73201099f0 0x7f7320109e00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7310009900 tx=0x7f731002a410 comp rx=0 tx=0).stop 2024-07-26T12:33:44.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 -- 172.21.15.40:0/3250472647 shutdown_connections 2024-07-26T12:33:44.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 --2- 172.21.15.40:0/3250472647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010fc80 0x7f73201164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 --2- 172.21.15.40:0/3250472647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f732010f330 0x7f732010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 --2- 172.21.15.40:0/3250472647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73201099f0 0x7f7320109e00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 -- 172.21.15.40:0/3250472647 >> 172.21.15.40:0/3250472647 conn(0x7f7320078ff0 msgr2=0x7f7320107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:44.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 -- 172.21.15.40:0/3250472647 shutdown_connections 2024-07-26T12:33:44.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.282+0000 7f731f200640 1 -- 172.21.15.40:0/3250472647 wait complete. 2024-07-26T12:33:44.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.283+0000 7f731f200640 1 Processor -- start 2024-07-26T12:33:44.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.283+0000 7f731f200640 1 -- start start 2024-07-26T12:33:44.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73201099f0 0x7f73201a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:44.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010f330 0x7f73201a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:44.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 0x7f73201a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f73201197f0 con 0x7f732010fc80 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7320119670 con 0x7f73201099f0 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7320119970 con 0x7f732010f330 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 0x7f73201a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 0x7f73201a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54812/0 (socket says 172.21.15.40:54812) 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731e800640 1 -- 172.21.15.40:0/834292398 learned_addr learned my addr 172.21.15.40:0/834292398 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731de00640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73201099f0 0x7f73201a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:44.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.284+0000 7f731d400640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010f330 0x7f73201a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:44.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731e800640 1 -- 172.21.15.40:0/834292398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010f330 msgr2=0x7f73201a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:44.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731e800640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010f330 0x7f73201a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731e800640 1 -- 172.21.15.40:0/834292398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73201099f0 msgr2=0x7f73201a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731e800640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73201099f0 0x7f73201a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731e800640 1 -- 172.21.15.40:0/834292398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73201a61b0 con 0x7f732010fc80 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731de00640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73201099f0 0x7f73201a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731d400640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010f330 0x7f73201a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.285+0000 7f731e800640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 0x7f73201a5a80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f731800eaa0 tx=0x7f731800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.286+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731800cdb0 con 0x7f732010fc80 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.286+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7318005020 con 0x7f732010fc80 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.286+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73180116d0 con 0x7f732010fc80 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.286+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73201a64a0 con 0x7f732010fc80 2024-07-26T12:33:44.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.286+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73201acc00 con 0x7f732010fc80 2024-07-26T12:33:44.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.287+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7320109e00 con 0x7f732010fc80 2024-07-26T12:33:44.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.290+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f73180051d0 con 0x7f732010fc80 2024-07-26T12:33:44.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.291+0000 7f7316a00640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f73040b3c50 0x7f73040b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:44.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.291+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73180e41e0 con 0x7f732010fc80 2024-07-26T12:33:44.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.292+0000 7f731de00640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f73040b3c50 0x7f73040b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:44.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.293+0000 7f731de00640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f73040b3c50 0x7f73040b6160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7310000c00 tx=0x7f7310005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:44.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.294+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7318016030 con 0x7f732010fc80 2024-07-26T12:33:44.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.538+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73201a1370 con 0x7f732010fc80 2024-07-26T12:33:44.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.539+0000 7f7316a00640 1 -- 172.21.15.40:0/834292398 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f73201a1370 con 0x7f732010fc80 2024-07-26T12:33:44.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:33:44.542 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:33:44.542 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:33:44.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f73040b3c50 msgr2=0x7f73040b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f73040b3c50 0x7f73040b6160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7310000c00 tx=0x7f7310005a20 comp rx=0 tx=0).stop 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 msgr2=0x7f73201a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 0x7f73201a5a80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f731800eaa0 tx=0x7f731800ef60 comp rx=0 tx=0).stop 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 shutdown_connections 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f732010fc80 0x7f73201a5a80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f73040b3c50 0x7f73040b6160 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732010f330 0x7f73201a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 --2- 172.21.15.40:0/834292398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f73201099f0 0x7f73201a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.542+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 >> 172.21.15.40:0/834292398 conn(0x7f7320078ff0 msgr2=0x7f73200797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:44.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.543+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 shutdown_connections 2024-07-26T12:33:44.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:44.543+0000 7f731f200640 1 -- 172.21.15.40:0/834292398 wait complete. 2024-07-26T12:33:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/834292398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:33:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/834292398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:33:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/834292398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:33:45.316 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 140686f3 --release --await' 2024-07-26T12:33:45.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 140686f3 --release --await 2024-07-26T12:33:45.801 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:33:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:45 smithi146 ceph-mon[35807]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T12:33:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:45 smithi076 ceph-mon[35401]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T12:33:46.093 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:45 smithi040 ceph-mon[32397]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 -- 172.21.15.40:0/3493357595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127810f980 msgr2=0x7f1278111da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 --2- 172.21.15.40:0/3493357595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127810f980 0x7f1278111da0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1270009ca0 tx=0x7f127002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 -- 172.21.15.40:0/3493357595 shutdown_connections 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 --2- 172.21.15.40:0/3493357595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127810f980 0x7f1278111da0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 --2- 172.21.15.40:0/3493357595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 0x7f127810f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 --2- 172.21.15.40:0/3493357595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1278075180 0x7f1278075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.005+0000 7f1277e00640 1 -- 172.21.15.40:0/3493357595 >> 172.21.15.40:0/3493357595 conn(0x7f12780fee10 msgr2=0x7f1278101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.006+0000 7f1277e00640 1 -- 172.21.15.40:0/3493357595 shutdown_connections 2024-07-26T12:33:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.006+0000 7f1277e00640 1 -- 172.21.15.40:0/3493357595 wait complete. 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.007+0000 7f1277e00640 1 Processor -- start 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.007+0000 7f1277e00640 1 -- start start 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.007+0000 7f1277e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 0x7f127819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1277e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 0x7f127819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1277e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f127810f980 0x7f12781a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1277e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12781153f0 con 0x7f1278075180 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1277e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1278115270 con 0x7f127810f980 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1277e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1278115570 con 0x7f1278075ad0 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1276a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 0x7f127819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1276a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 0x7f127819bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54820/0 (socket says 172.21.15.40:54820) 2024-07-26T12:33:48.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1276a00640 1 -- 172.21.15.40:0/2196352316 learned_addr learned my addr 172.21.15.40:0/2196352316 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:48.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f1277400640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f127810f980 0x7f12781a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.008+0000 7f126e000640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 0x7f127819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1276a00640 1 -- 172.21.15.40:0/2196352316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 msgr2=0x7f127819c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1276a00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 0x7f127819c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1276a00640 1 -- 172.21.15.40:0/2196352316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f127810f980 msgr2=0x7f12781a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1276a00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f127810f980 0x7f12781a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1276a00640 1 -- 172.21.15.40:0/2196352316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12781a1d50 con 0x7f1278075180 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f126e000640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 0x7f127819c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1276a00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 0x7f127819bde0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f126800d950 tx=0x7f126800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f126fe00640 1 -- 172.21.15.40:0/2196352316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268017070 con 0x7f1278075180 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f126fe00640 1 -- 172.21.15.40:0/2196352316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1268009c30 con 0x7f1278075180 2024-07-26T12:33:48.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f126fe00640 1 -- 172.21.15.40:0/2196352316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126800f620 con 0x7f1278075180 2024-07-26T12:33:48.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.009+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12781a2040 con 0x7f1278075180 2024-07-26T12:33:48.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.010+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781a87a0 con 0x7f1278075180 2024-07-26T12:33:48.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.013+0000 7f12846c4740 1 Processor -- start 2024-07-26T12:33:48.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.013+0000 7f12846c4740 1 -- start start 2024-07-26T12:33:48.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.013+0000 7f126fe00640 1 -- 172.21.15.40:0/2196352316 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1268010460 con 0x7f1278075180 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f12846c4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d49180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f12846c4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f12846c4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d49c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f12846c4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564eb1cbff30 con 0x564eb19a4520 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f12846c4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564eb1caf430 con 0x564eb1983840 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f12846c4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564eb1cb3470 con 0x564eb197b660 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f1277400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d49180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f1277400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d49180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54836/0 (socket says 172.21.15.40:54836) 2024-07-26T12:33:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f1277400640 1 -- 172.21.15.40:0/2184076088 learned_addr learned my addr 172.21.15.40:0/2184076088 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:48.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f1276a00640 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.014+0000 7f126e000640 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d49c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f1277400640 1 -- 172.21.15.40:0/2184076088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 msgr2=0x564eb1d496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f1277400640 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f1277400640 1 -- 172.21.15.40:0/2184076088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 msgr2=0x564eb1d49c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f1277400640 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d49c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f1277400640 1 -- 172.21.15.40:0/2184076088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb1a0fb00 con 0x564eb19a4520 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f1277400640 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d49180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1270009ca0 tx=0x7f12700094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc419c4bfdf4e05 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.015+0000 7f126fe00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f125c0b3bd0 0x7f125c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.016+0000 7f126fe00640 1 -- 172.21.15.40:0/2196352316 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f12680e3850 con 0x7f1278075180 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.016+0000 7f1267e00640 1 -- 172.21.15.40:0/2184076088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270031980 con 0x564eb19a4520 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.016+0000 7f1267e00640 1 -- 172.21.15.40:0/2184076088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1270036030 con 0x564eb19a4520 2024-07-26T12:33:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.016+0000 7f1276a00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f125c0b3bd0 0x7f125c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.016+0000 7f1267e00640 1 -- 172.21.15.40:0/2184076088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270004550 con 0x564eb19a4520 2024-07-26T12:33:48.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 -- 172.21.15.40:0/2184076088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 msgr2=0x564eb1d49180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f1276a00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f125c0b3bd0 0x7f125c0b60e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f12680aa460 tx=0x7f12680e7040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d49180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1270009ca0 tx=0x7f12700094a0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 -- 172.21.15.40:0/2184076088 shutdown_connections 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d49c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 --2- 172.21.15.40:0/2184076088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d49180 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 -- 172.21.15.40:0/2184076088 >> 172.21.15.40:0/2184076088 conn(0x564eb1998910 msgr2=0x564eb1d47070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 -- 172.21.15.40:0/2184076088 shutdown_connections 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.017+0000 7f12846c4740 1 -- 172.21.15.40:0/2184076088 wait complete. 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.018+0000 7f12846c4740 1 -- start start 2024-07-26T12:33:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.018+0000 7f12846c4740 1 Processor -- start 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d54cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d55270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564eb1b12bb0 con 0x564eb1983840 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564eb1c4b910 con 0x564eb197b660 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564eb1d57780 con 0x564eb19a4520 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f12846c4740 10 client.0 _ll_register_callbacks cb 0x564eb19bbd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f126e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d54cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f126e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d54cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54840/0 (socket says 172.21.15.40:54840) 2024-07-26T12:33:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f126e000640 1 -- 172.21.15.40:0/1369078782 learned_addr learned my addr 172.21.15.40:0/1369078782 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f1277400640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.019+0000 7f1277400640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d55270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f126e000640 1 -- 172.21.15.40:0/1369078782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 msgr2=0x564eb1d55270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f126e000640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d55270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f126e000640 1 -- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 msgr2=0x564eb1d547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f126e000640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f126e000640 1 -- 172.21.15.40:0/1369078782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb1a86960 con 0x564eb1983840 2024-07-26T12:33:48.023 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:47 smithi040 ceph-mon[32397]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:33:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f126e000640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d54cf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f126000bf00 tx=0x7f12600117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89529a3af6fbfef server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f1264c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.020+0000 7f1264c00640 1 -- 172.21.15.40:0/1369078782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260012650 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.021+0000 7f1264c00640 1 -- 172.21.15.40:0/1369078782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f12600127f0 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.021+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1270036030 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.021+0000 7f1264c00640 1 -- 172.21.15.40:0/1369078782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f12600129f0 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.021+0000 7f12846c4740 10 client.15885 fetch_fsmap learned FSMap version 35 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.021+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564eb1d63480 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.021+0000 7f1264c00640 1 -- 172.21.15.40:0/1369078782 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1270036030 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f1264c00640 1 -- 172.21.15.40:0/1369078782 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f126001bca0 con 0x564eb1983840 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f12846c4740 10 client.15885 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:33:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f12846c4740 10 client.15885 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f12846c4740 20 client.15885 populate_metadata read hostname 'smithi040' 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f12846c4740 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1962ea0 0x564eb1d66a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f12846c4740 4 client.15885 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eb1cc1e80 con 0x564eb1962ea0 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.022+0000 7f1277400640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1962ea0 0x564eb1d66a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.023+0000 7f1277400640 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1962ea0 0x564eb1d66a30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f41298cc11b4699 server_cookie=85566efec5caa561 in_seq=0 out_seq=0 2024-07-26T12:33:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.023+0000 7f1264c00640 10 client.15885 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.025+0000 7f1264c00640 1 -- 172.21.15.40:0/1369078782 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564eb1cc1e80 con 0x564eb1962ea0 2024-07-26T12:33:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.025+0000 7f1264c00640 10 client.15885 handle_command_reply: tid=0 2024-07-26T12:33:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.025+0000 7f12846c4740 1 client.15885 shutdown 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 msgr2=0x564eb1d54cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d54cf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f126000bf00 tx=0x7f12600117b0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 shutdown_connections 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d55270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1962ea0 0x564eb1d66a30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d54cf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 --2- 172.21.15.40:0/1369078782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 >> 172.21.15.40:0/1369078782 conn(0x564eb1998910 msgr2=0x564eb1d4c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f1264c00640 0 client.15885 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 shutdown_connections 2024-07-26T12:33:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 1 -- 172.21.15.40:0/1369078782 wait complete. 2024-07-26T12:33:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.026+0000 7f12846c4740 20 client.15885 trim_cache size 0 max 16384 2024-07-26T12:33:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.045+0000 7f12846c4740 1 Processor -- start 2024-07-26T12:33:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.045+0000 7f12846c4740 1 -- start start 2024-07-26T12:33:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f12846c4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d4a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f12846c4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d4cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f12846c4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f12846c4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12781b0d90 con 0x564eb1983840 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f12846c4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f12781b28d0 con 0x564eb197b660 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f12846c4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12781b1460 con 0x564eb19a4520 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f126e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d4cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f126e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d4cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54848/0 (socket says 172.21.15.40:54848) 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.046+0000 7f126e000640 1 -- 172.21.15.40:0/3494901737 learned_addr learned my addr 172.21.15.40:0/3494901737 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f1277400640 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d4a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f1277400640 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f126e000640 1 -- 172.21.15.40:0/3494901737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 msgr2=0x564eb1d563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f126e000640 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f126e000640 1 -- 172.21.15.40:0/3494901737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 msgr2=0x564eb1d4a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f126e000640 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d4a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f126e000640 1 -- 172.21.15.40:0/3494901737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb1d57490 con 0x564eb1983840 2024-07-26T12:33:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f1277400640 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d4a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.047+0000 7f126e000640 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d4cc40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1260000c00 tx=0x7f126000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130cbdf286e254ca server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.048+0000 7f1267400640 1 -- 172.21.15.40:0/3494901737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126002b040 con 0x564eb1983840 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.048+0000 7f1267400640 1 -- 172.21.15.40:0/3494901737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1260012d90 con 0x564eb1983840 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.048+0000 7f1267400640 1 -- 172.21.15.40:0/3494901737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600054a0 con 0x564eb1983840 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.048+0000 7f12846c4740 1 -- 172.21.15.40:0/3494901737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 msgr2=0x564eb1d4cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.048+0000 7f12846c4740 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d4cc40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1260000c00 tx=0x7f126000bb20 comp rx=0 tx=0).stop 2024-07-26T12:33:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 -- 172.21.15.40:0/3494901737 shutdown_connections 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb19a4520 0x564eb1d563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb1983840 0x564eb1d4cc40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 --2- 172.21.15.40:0/3494901737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb197b660 0x564eb1d4a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 -- 172.21.15.40:0/3494901737 >> 172.21.15.40:0/3494901737 conn(0x564eb1998910 msgr2=0x564eb1d55cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 -- 172.21.15.40:0/3494901737 shutdown_connections 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 -- 172.21.15.40:0/3494901737 wait complete. 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.049+0000 7f12846c4740 1 -- start start 2024-07-26T12:33:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 Processor -- start 2024-07-26T12:33:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d5d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d58ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12781b2200 con 0x564eb19a4520 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f12781b1b30 con 0x564eb1983840 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12781aed50 con 0x564eb197b660 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f12846c4740 10 client.0 _ll_register_callbacks cb 0x7f126000b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.050+0000 7f1277400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d58ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d58ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54856/0 (socket says 172.21.15.40:54856) 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 -- 172.21.15.40:0/4157917303 learned_addr learned my addr 172.21.15.40:0/4157917303 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d5d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f126e000640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 -- 172.21.15.40:0/4157917303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 msgr2=0x564eb1d5d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d5d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 -- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 msgr2=0x564eb1d587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 -- 172.21.15.40:0/4157917303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb1dce1c0 con 0x564eb19a4520 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1277400640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d58ef0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1270009960 tx=0x7f12700094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410b057e710059bc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.051+0000 7f1264c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f1264c00640 1 -- 172.21.15.40:0/4157917303 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270031980 con 0x564eb19a4520 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f1264c00640 1 -- 172.21.15.40:0/4157917303 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1270031b20 con 0x564eb19a4520 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1260012d90 con 0x564eb19a4520 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f1264c00640 1 -- 172.21.15.40:0/4157917303 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1270031d20 con 0x564eb19a4520 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f12846c4740 10 client.15891 fetch_fsmap learned FSMap version 35 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564eb1dcf3e0 con 0x564eb19a4520 2024-07-26T12:33:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.052+0000 7f1264c00640 1 -- 172.21.15.40:0/4157917303 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1260012d90 con 0x564eb19a4520 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f1264c00640 1 -- 172.21.15.40:0/4157917303 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1270043070 con 0x564eb19a4520 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f12846c4740 10 client.15891 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f12846c4740 10 client.15891 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f12846c4740 20 client.15891 populate_metadata read hostname 'smithi040' 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f12846c4740 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1938250 0x564eb1dd1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f12846c4740 4 client.15891 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "140686f3", "release": true, "await": true}] 2024-07-26T12:33:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "140686f3", "release": true, "await": true}) -- 0x564eb1cbd920 con 0x564eb1938250 2024-07-26T12:33:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.053+0000 7f126e000640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1938250 0x564eb1dd1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:33:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.054+0000 7f126e000640 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1938250 0x564eb1dd1870 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c862b5f06fbde06 server_cookie=5807999255c9bcbe in_seq=0 out_seq=0 2024-07-26T12:33:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.054+0000 7f1264c00640 10 client.15891 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:47 smithi146 ceph-mon[35807]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:33:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:47 smithi076 ceph-mon[35401]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:33:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.115+0000 7f1264c00640 1 -- 172.21.15.40:0/4157917303 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564eb1cbd920 con 0x564eb1938250 2024-07-26T12:33:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.115+0000 7f1264c00640 10 client.15891 handle_command_reply: tid=0 2024-07-26T12:33:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.115+0000 7f12846c4740 1 client.15891 shutdown 2024-07-26T12:33:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.115+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 msgr2=0x564eb1d58ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.115+0000 7f12846c4740 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d58ef0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1270009960 tx=0x7f12700094a0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 shutdown_connections 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564eb1938250 0x564eb1dd1870 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564eb19a4520 0x564eb1d58ef0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564eb1983840 0x564eb1d587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 --2- 172.21.15.40:0/4157917303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eb197b660 0x564eb1d5d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 >> 172.21.15.40:0/4157917303 conn(0x564eb1998910 msgr2=0x564eb1d4ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f1264c00640 0 client.15891 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.116+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 shutdown_connections 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.117+0000 7f12846c4740 1 -- 172.21.15.40:0/4157917303 wait complete. 2024-07-26T12:33:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.117+0000 7f12846c4740 20 client.15891 trim_cache size 0 max 16384 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 36, 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "140686f3": { 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 36, 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:33:48.120 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 152.6, 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:33:48.121 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:33:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f125c0b3bd0 msgr2=0x7f125c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f125c0b3bd0 0x7f125c0b60e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f12680aa460 tx=0x7f12680e7040 comp rx=0 tx=0).stop 2024-07-26T12:33:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 msgr2=0x7f127819bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:33:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 0x7f127819bde0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f126800d950 tx=0x7f126800de10 comp rx=0 tx=0).stop 2024-07-26T12:33:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 shutdown_connections 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f127810f980 0x7f12781a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f125c0b3bd0 0x7f125c0b60e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1278075ad0 0x7f127819c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 --2- 172.21.15.40:0/2196352316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1278075180 0x7f127819bde0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.118+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 >> 172.21.15.40:0/2196352316 conn(0x7f12780fee10 msgr2=0x7f1278101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.119+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 shutdown_connections 2024-07-26T12:33:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:33:48.119+0000 7f1277e00640 1 -- 172.21.15.40:0/2196352316 wait complete. 2024-07-26T12:33:49.074 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '140686f3', total seconds elapsed: 40.2 2024-07-26T12:33:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:49 smithi146 ceph-mon[35807]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:33:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:49 smithi076 ceph-mon[35401]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:33:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:49 smithi040 ceph-mon[32397]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:33:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:50 smithi040 ceph-mon[32397]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:33:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:50 smithi146 ceph-mon[35807]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:33:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:50 smithi076 ceph-mon[35401]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:33:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:53 smithi040 ceph-mon[32397]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 271 KiB/s wr, 8 op/s 2024-07-26T12:33:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:53 smithi146 ceph-mon[35807]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 271 KiB/s wr, 8 op/s 2024-07-26T12:33:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:53 smithi076 ceph-mon[35401]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 271 KiB/s wr, 8 op/s 2024-07-26T12:33:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:55 smithi040 ceph-mon[32397]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 953 KiB/s wr, 12 op/s 2024-07-26T12:33:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:55 smithi146 ceph-mon[35807]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 953 KiB/s wr, 12 op/s 2024-07-26T12:33:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:55 smithi076 ceph-mon[35401]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 953 KiB/s wr, 12 op/s 2024-07-26T12:33:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:57 smithi040 ceph-mon[32397]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:33:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:57 smithi146 ceph-mon[35807]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:33:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:57 smithi076 ceph-mon[35401]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:33:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:33:59 smithi040 ceph-mon[32397]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T12:33:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:33:59 smithi146 ceph-mon[35807]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T12:33:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:33:59 smithi076 ceph-mon[35401]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T12:34:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:01 smithi040 ceph-mon[32397]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T12:34:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:01 smithi146 ceph-mon[35807]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T12:34:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:01 smithi076 ceph-mon[35401]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T12:34:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:03 smithi040 ceph-mon[32397]: pgmap v854: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:34:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:03 smithi146 ceph-mon[35807]: pgmap v854: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:34:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:03 smithi076 ceph-mon[35401]: pgmap v854: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:34:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:05 smithi040 ceph-mon[32397]: pgmap v855: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:34:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:05 smithi146 ceph-mon[35807]: pgmap v855: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:34:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:05 smithi076 ceph-mon[35401]: pgmap v855: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:34:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:07 smithi040 ceph-mon[32397]: pgmap v856: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:07 smithi146 ceph-mon[35807]: pgmap v856: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:07 smithi076 ceph-mon[35401]: pgmap v856: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:09 smithi040 ceph-mon[32397]: pgmap v857: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:09 smithi146 ceph-mon[35807]: pgmap v857: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:09 smithi076 ceph-mon[35401]: pgmap v857: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:11 smithi040 ceph-mon[32397]: pgmap v858: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:34:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:34:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:11 smithi146 ceph-mon[35807]: pgmap v858: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:34:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:34:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:11 smithi076 ceph-mon[35401]: pgmap v858: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:34:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:34:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:34:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:34:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:34:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:13 smithi040 ceph-mon[32397]: pgmap v859: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:34:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:13 smithi146 ceph-mon[35807]: pgmap v859: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:34:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:13 smithi076 ceph-mon[35401]: pgmap v859: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:34:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:15 smithi040 ceph-mon[32397]: pgmap v860: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:34:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:15 smithi146 ceph-mon[35807]: pgmap v860: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:34:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:15 smithi076 ceph-mon[35401]: pgmap v860: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:34:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:17 smithi040 ceph-mon[32397]: pgmap v861: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:34:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:17 smithi146 ceph-mon[35807]: pgmap v861: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:34:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:17 smithi076 ceph-mon[35401]: pgmap v861: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:34:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:19 smithi146 ceph-mon[35807]: pgmap v862: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:34:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:19 smithi076 ceph-mon[35401]: pgmap v862: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:34:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:19 smithi040 ceph-mon[32397]: pgmap v862: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:34:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:21 smithi146 ceph-mon[35807]: pgmap v863: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:34:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:21 smithi076 ceph-mon[35401]: pgmap v863: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:34:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:21 smithi040 ceph-mon[32397]: pgmap v863: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:34:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:23 smithi146 ceph-mon[35807]: pgmap v864: 97 pgs: 97 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T12:34:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:23 smithi076 ceph-mon[35401]: pgmap v864: 97 pgs: 97 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T12:34:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:23 smithi040 ceph-mon[32397]: pgmap v864: 97 pgs: 97 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T12:34:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:25 smithi146 ceph-mon[35807]: pgmap v865: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:34:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:25 smithi076 ceph-mon[35401]: pgmap v865: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:34:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:25 smithi040 ceph-mon[32397]: pgmap v865: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:34:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:27 smithi146 ceph-mon[35807]: pgmap v866: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:34:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:27 smithi076 ceph-mon[35401]: pgmap v866: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:34:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:27 smithi040 ceph-mon[32397]: pgmap v866: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:34:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:29 smithi146 ceph-mon[35807]: pgmap v867: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:29 smithi076 ceph-mon[35401]: pgmap v867: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:29 smithi040 ceph-mon[32397]: pgmap v867: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:31 smithi146 ceph-mon[35807]: pgmap v868: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:34:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:31 smithi076 ceph-mon[35401]: pgmap v868: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:34:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:31 smithi040 ceph-mon[32397]: pgmap v868: 97 pgs: 97 active+clean; 1.8 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:34:33.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:33 smithi040 ceph-mon[32397]: pgmap v869: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:34:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:33 smithi146 ceph-mon[35807]: pgmap v869: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:34:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:33 smithi076 ceph-mon[35401]: pgmap v869: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:34:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:35 smithi146 ceph-mon[35807]: pgmap v870: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-07-26T12:34:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:35 smithi076 ceph-mon[35401]: pgmap v870: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-07-26T12:34:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:35 smithi040 ceph-mon[32397]: pgmap v870: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-07-26T12:34:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:37 smithi146 ceph-mon[35807]: pgmap v871: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:34:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:37 smithi076 ceph-mon[35401]: pgmap v871: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:34:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:37 smithi040 ceph-mon[32397]: pgmap v871: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:34:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:39 smithi146 ceph-mon[35807]: pgmap v872: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:34:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:39 smithi076 ceph-mon[35401]: pgmap v872: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:34:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:39 smithi040 ceph-mon[32397]: pgmap v872: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:34:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:41 smithi146 ceph-mon[35807]: pgmap v873: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T12:34:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:41 smithi076 ceph-mon[35401]: pgmap v873: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T12:34:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:41 smithi040 ceph-mon[32397]: pgmap v873: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T12:34:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:43 smithi076 ceph-mon[35401]: pgmap v874: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:43 smithi040 ceph-mon[32397]: pgmap v874: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:43 smithi146 ceph-mon[35807]: pgmap v874: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:45 smithi076 ceph-mon[35401]: pgmap v875: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:34:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:45 smithi040 ceph-mon[32397]: pgmap v875: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:34:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:45 smithi146 ceph-mon[35807]: pgmap v875: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:34:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:47 smithi040 ceph-mon[32397]: pgmap v876: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:34:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:47 smithi146 ceph-mon[35807]: pgmap v876: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:34:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:47 smithi076 ceph-mon[35401]: pgmap v876: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:34:49.619 INFO:tasks.quiescer.fs.[cephfs]:Total duration (48.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:34:49.619 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.2 2024-07-26T12:34:49.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:34:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:49 smithi040 ceph-mon[32397]: pgmap v877: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:49 smithi146 ceph-mon[35807]: pgmap v877: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:49 smithi076 ceph-mon[35401]: pgmap v877: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:34:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:51 smithi040 ceph-mon[32397]: pgmap v878: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:34:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:51 smithi146 ceph-mon[35807]: pgmap v878: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:34:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:51 smithi076 ceph-mon[35401]: pgmap v878: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:34:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 -- 172.21.15.40:0/337555901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54981057b0 msgr2=0x7f5498105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 --2- 172.21.15.40:0/337555901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54981057b0 0x7f5498105bc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f548c009900 tx=0x7f548c02a410 comp rx=0 tx=0).stop 2024-07-26T12:34:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 -- 172.21.15.40:0/337555901 shutdown_connections 2024-07-26T12:34:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 --2- 172.21.15.40:0/337555901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f549810ba40 0x7f5498112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 --2- 172.21.15.40:0/337555901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549810b0f0 0x7f549810b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 --2- 172.21.15.40:0/337555901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54981057b0 0x7f5498105bc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 -- 172.21.15.40:0/337555901 >> 172.21.15.40:0/337555901 conn(0x7f5498101240 msgr2=0x7f5498103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 -- 172.21.15.40:0/337555901 shutdown_connections 2024-07-26T12:34:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.626+0000 7f54a0200640 1 -- 172.21.15.40:0/337555901 wait complete. 2024-07-26T12:34:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 Processor -- start 2024-07-26T12:34:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 -- start start 2024-07-26T12:34:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54981057b0 0x7f549819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 0x7f549819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549810ba40 0x7f54981a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5498115610 con 0x7f549810b0f0 2024-07-26T12:34:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5498115490 con 0x7f54981057b0 2024-07-26T12:34:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.628+0000 7f54a0200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5498115790 con 0x7f549810ba40 2024-07-26T12:34:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.629+0000 7f549ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 0x7f549819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.629+0000 7f549ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 0x7f549819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33364/0 (socket says 172.21.15.40:33364) 2024-07-26T12:34:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.629+0000 7f549ce00640 1 -- 172.21.15.40:0/3341298000 learned_addr learned my addr 172.21.15.40:0/3341298000 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:34:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.629+0000 7f549d800640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54981057b0 0x7f549819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.629+0000 7f549e200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549810ba40 0x7f54981a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.630+0000 7f549ce00640 1 -- 172.21.15.40:0/3341298000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549810ba40 msgr2=0x7f54981a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.630+0000 7f549ce00640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549810ba40 0x7f54981a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.630+0000 7f549ce00640 1 -- 172.21.15.40:0/3341298000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54981057b0 msgr2=0x7f549819c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.630+0000 7f549ce00640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54981057b0 0x7f549819c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.630+0000 7f549ce00640 1 -- 172.21.15.40:0/3341298000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54981a1fb0 con 0x7f549810b0f0 2024-07-26T12:34:52.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.630+0000 7f549ce00640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 0x7f549819c5e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f548400d750 tx=0x7f548400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:52.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.631+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484017070 con 0x7f549810b0f0 2024-07-26T12:34:52.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.631+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54840054b0 con 0x7f549810b0f0 2024-07-26T12:34:52.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.631+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484004bc0 con 0x7f549810b0f0 2024-07-26T12:34:52.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.631+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54981a22a0 con 0x7f549810b0f0 2024-07-26T12:34:52.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.631+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54981a8a00 con 0x7f549810b0f0 2024-07-26T12:34:52.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.632+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5498105bc0 con 0x7f549810b0f0 2024-07-26T12:34:52.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.637+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5484009c30 con 0x7f549810b0f0 2024-07-26T12:34:52.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.639+0000 7f5496000640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f54800b3bd0 0x7f54800b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:52.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.640+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f54840e3970 con 0x7f549810b0f0 2024-07-26T12:34:52.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.640+0000 7f549d800640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f54800b3bd0 0x7f54800b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:52.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.640+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f54840a6c00 con 0x7f549810b0f0 2024-07-26T12:34:52.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.641+0000 7f549d800640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f54800b3bd0 0x7f54800b60e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f548c006010 tx=0x7f548c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:52.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.912+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f549819d170 con 0x7f549810b0f0 2024-07-26T12:34:52.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.913+0000 7f5496000640 1 -- 172.21.15.40:0/3341298000 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f54840aa970 con 0x7f549810b0f0 2024-07-26T12:34:52.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:34:52.915 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:34:52.915 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:34:52.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.916+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f54800b3bd0 msgr2=0x7f54800b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:52.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.916+0000 7f54a0200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f54800b3bd0 0x7f54800b60e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f548c006010 tx=0x7f548c000bc0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.916+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 msgr2=0x7f549819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:52.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.916+0000 7f54a0200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 0x7f549819c5e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f548400d750 tx=0x7f548400dc10 comp rx=0 tx=0).stop 2024-07-26T12:34:52.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.917+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 shutdown_connections 2024-07-26T12:34:52.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.917+0000 7f54a0200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f54800b3bd0 0x7f54800b60e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.917+0000 7f54a0200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549810ba40 0x7f54981a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.917+0000 7f54a0200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549810b0f0 0x7f549819c5e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.917+0000 7f54a0200640 1 --2- 172.21.15.40:0/3341298000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54981057b0 0x7f549819c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:52.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.917+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 >> 172.21.15.40:0/3341298000 conn(0x7f5498101240 msgr2=0x7f5498103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:52.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.918+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 shutdown_connections 2024-07-26T12:34:52.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:52.918+0000 7f54a0200640 1 -- 172.21.15.40:0/3341298000 wait complete. 2024-07-26T12:34:53.742 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0' 2024-07-26T12:34:53.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0 2024-07-26T12:34:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:53 smithi040 ceph-mon[32397]: pgmap v879: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:53 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3341298000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:34:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:53 smithi146 ceph-mon[35807]: pgmap v879: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:53 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3341298000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:34:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:53 smithi076 ceph-mon[35401]: pgmap v879: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:34:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:53 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3341298000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:34:54.245 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:34:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:55 smithi040 ceph-mon[32397]: pgmap v880: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:34:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:55 smithi146 ceph-mon[35807]: pgmap v880: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:34:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:55 smithi076 ceph-mon[35401]: pgmap v880: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.636+0000 7f3cccc00640 1 -- 172.21.15.40:0/2977642732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 msgr2=0x7f3cc810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.636+0000 7f3cccc00640 1 --2- 172.21.15.40:0/2977642732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc810f760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009900 tx=0x7f3cb402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 -- 172.21.15.40:0/2977642732 shutdown_connections 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 --2- 172.21.15.40:0/2977642732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3cc810fca0 0x7f3cc81164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 --2- 172.21.15.40:0/2977642732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc810f760 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 --2- 172.21.15.40:0/2977642732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cc8109a60 0x7f3cc8109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 -- 172.21.15.40:0/2977642732 >> 172.21.15.40:0/2977642732 conn(0x7f3cc8079100 msgr2=0x7f3cc8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:56.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 -- 172.21.15.40:0/2977642732 shutdown_connections 2024-07-26T12:34:56.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.637+0000 7f3cccc00640 1 -- 172.21.15.40:0/2977642732 wait complete. 2024-07-26T12:34:56.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.638+0000 7f3cccc00640 1 Processor -- start 2024-07-26T12:34:56.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.638+0000 7f3cccc00640 1 -- start start 2024-07-26T12:34:56.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cccc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cc8109a60 0x7f3cc81a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cccc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc81a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cccc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3cc810fca0 0x7f3cc81a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cccc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8119810 con 0x7f3cc810f350 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cccc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8119690 con 0x7f3cc810fca0 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cccc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8119990 con 0x7f3cc8109a60 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cc6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc81a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cc6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc81a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53904/0 (socket says 172.21.15.40:53904) 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cc6a00640 1 -- 172.21.15.40:0/1713863980 learned_addr learned my addr 172.21.15.40:0/1713863980 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cc7400640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cc8109a60 0x7f3cc81a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.639+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3cc810fca0 0x7f3cc81a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cc6a00640 1 -- 172.21.15.40:0/1713863980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cc8109a60 msgr2=0x7f3cc81a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cc8109a60 0x7f3cc81a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cc6a00640 1 -- 172.21.15.40:0/1713863980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3cc810fca0 msgr2=0x7f3cc81a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3cc810fca0 0x7f3cc81a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cc6a00640 1 -- 172.21.15.40:0/1713863980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc81a60f0 con 0x7f3cc810f350 2024-07-26T12:34:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc81a07e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3cb402a910 tx=0x7f3cb4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.640+0000 7f3cbfe00640 1 -- 172.21.15.40:0/1713863980 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb403f070 con 0x7f3cc810f350 2024-07-26T12:34:56.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.641+0000 7f3cbfe00640 1 -- 172.21.15.40:0/1713863980 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cb4003e10 con 0x7f3cc810f350 2024-07-26T12:34:56.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.641+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc81a6380 con 0x7f3cc810f350 2024-07-26T12:34:56.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.641+0000 7f3cbfe00640 1 -- 172.21.15.40:0/1713863980 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4035030 con 0x7f3cc810f350 2024-07-26T12:34:56.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.641+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc81a6860 con 0x7f3cc810f350 2024-07-26T12:34:56.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.644+0000 7f3cd4e2d740 1 Processor -- start 2024-07-26T12:34:56.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 -- start start 2024-07-26T12:34:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f5e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f5e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f5ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55aec7f28d10 con 0x55aec7bb8840 2024-07-26T12:34:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55aec7ed3b60 con 0x55aec7b97b60 2024-07-26T12:34:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.645+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aec7ec3060 con 0x55aec7b8f980 2024-07-26T12:34:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.646+0000 7f3cc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f5e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.646+0000 7f3cc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f5e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53916/0 (socket says 172.21.15.40:53916) 2024-07-26T12:34:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.646+0000 7f3cc7e00640 1 -- 172.21.15.40:0/2562464769 learned_addr learned my addr 172.21.15.40:0/2562464769 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:34:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.646+0000 7f3cc7400640 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f5e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cc7e00640 1 -- 172.21.15.40:0/2562464769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 msgr2=0x55aec7f5e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f5e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cc7e00640 1 -- 172.21.15.40:0/2562464769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 msgr2=0x55aec7f5ee30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T12:34:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cbfe00640 1 -- 172.21.15.40:0/1713863980 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3cb4042070 con 0x7f3cc810f350 2024-07-26T12:34:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f5ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cc7e00640 1 -- 172.21.15.40:0/2562464769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec7e4ab10 con 0x55aec7bb8840 2024-07-26T12:34:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.647+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f5e3b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007e50 tx=0x7f3cc000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151bfffeee17d404 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.648+0000 7f3cb3e00640 1 -- 172.21.15.40:0/2562464769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0014070 con 0x55aec7bb8840 2024-07-26T12:34:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.648+0000 7f3cb3e00640 1 -- 172.21.15.40:0/2562464769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cc000ee90 con 0x55aec7bb8840 2024-07-26T12:34:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.648+0000 7f3cb3e00640 1 -- 172.21.15.40:0/2562464769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0005310 con 0x55aec7bb8840 2024-07-26T12:34:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cbfe00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cac0b3c70 0x7f3cac0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cbfe00640 1 -- 172.21.15.40:0/1713863980 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3cb41044b0 con 0x7f3cc810f350 2024-07-26T12:34:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/2562464769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 msgr2=0x55aec7f5e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f5e3b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007e50 tx=0x7f3cc000e720 comp rx=0 tx=0).stop 2024-07-26T12:34:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cc7400640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cac0b3c70 0x7f3cac0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/2562464769 shutdown_connections 2024-07-26T12:34:56.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f5ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f5e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.649+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/2562464769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f5e3b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.650+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/2562464769 >> 172.21.15.40:0/2562464769 conn(0x55aec7bac990 msgr2=0x55aec7f5c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:56.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.650+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/2562464769 shutdown_connections 2024-07-26T12:34:56.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.650+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/2562464769 wait complete. 2024-07-26T12:34:56.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.651+0000 7f3cc7400640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cac0b3c70 0x7f3cac0b6180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55aec7f5d030 tx=0x7f3cb800b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:56.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.651+0000 7f3cd4e2d740 1 -- start start 2024-07-26T12:34:56.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.651+0000 7f3cd4e2d740 1 Processor -- start 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 0x55aec7f69f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b97b60 0x55aec7f6a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f75d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55aec7e5f520 con 0x55aec7b8f980 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55aec7ec70a0 con 0x55aec7bb8840 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aec7d267a0 con 0x55aec7b97b60 2024-07-26T12:34:56.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.652+0000 7f3cd4e2d740 10 client.0 _ll_register_callbacks cb 0x55aec7ebbbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:34:56.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 0x55aec7f69f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 0x55aec7f69f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53932/0 (socket says 172.21.15.40:53932) 2024-07-26T12:34:56.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 -- 172.21.15.40:0/3994393590 learned_addr learned my addr 172.21.15.40:0/3994393590 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:34:56.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b97b60 0x55aec7f6a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f75d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 -- 172.21.15.40:0/3994393590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b97b60 msgr2=0x55aec7f6a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b97b60 0x55aec7f6a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 -- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 msgr2=0x55aec7f75d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f75d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7400640 1 -- 172.21.15.40:0/3994393590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec7c32b90 con 0x55aec7b8f980 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.653+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f75d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.654+0000 7f3cc7400640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 0x55aec7f69f70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80058c0 tx=0x7f3cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5d594b23ae317e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:56.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.654+0000 7f3cb0c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:34:56.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.654+0000 7f3cb0c00640 1 -- 172.21.15.40:0/3994393590 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb802a060 con 0x55aec7b8f980 2024-07-26T12:34:56.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.654+0000 7f3cb0c00640 1 -- 172.21.15.40:0/3994393590 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3cb80107a0 con 0x55aec7b8f980 2024-07-26T12:34:56.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.654+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cc000ee90 con 0x55aec7b8f980 2024-07-26T12:34:56.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.655+0000 7f3cb0c00640 1 -- 172.21.15.40:0/3994393590 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3cb80109a0 con 0x55aec7b8f980 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.655+0000 7f3cd4e2d740 10 client.15909 fetch_fsmap learned FSMap version 35 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.655+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55aec7f78a80 con 0x55aec7b8f980 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.655+0000 7f3cb0c00640 1 -- 172.21.15.40:0/3994393590 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cc000ee90 con 0x55aec7b8f980 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cb0c00640 1 -- 172.21.15.40:0/3994393590 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3cb802f070 con 0x55aec7b8f980 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cd4e2d740 10 client.15909 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cd4e2d740 10 client.15909 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cd4e2d740 20 client.15909 populate_metadata read hostname 'smithi040' 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b771c0 0x55aec7f7bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cd4e2d740 4 client.15909 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:34:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.656+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aec7ed5ab0 con 0x55aec7b771c0 2024-07-26T12:34:56.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.657+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b771c0 0x55aec7f7bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.657+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b771c0 0x55aec7f7bfb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a364bfa7c93d482 server_cookie=754c79ca0a6f52f4 in_seq=0 out_seq=0 2024-07-26T12:34:56.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.657+0000 7f3cb0c00640 10 client.15909 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:34:56.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.659+0000 7f3cb0c00640 1 -- 172.21.15.40:0/3994393590 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aec7ed5ab0 con 0x55aec7b771c0 2024-07-26T12:34:56.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.659+0000 7f3cb0c00640 10 client.15909 handle_command_reply: tid=0 2024-07-26T12:34:56.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 client.15909 shutdown 2024-07-26T12:34:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 msgr2=0x55aec7f69f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 0x55aec7f69f70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80058c0 tx=0x7f3cb80046c0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 shutdown_connections 2024-07-26T12:34:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f75d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b97b60 0x55aec7f6a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b771c0 0x55aec7f7bfb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3994393590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b8f980 0x55aec7f69f70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 >> 172.21.15.40:0/3994393590 conn(0x55aec7bac990 msgr2=0x55aec7f61590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cb0c00640 0 client.15909 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 shutdown_connections 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3994393590 wait complete. 2024-07-26T12:34:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.660+0000 7f3cd4e2d740 20 client.15909 trim_cache size 0 max 16384 2024-07-26T12:34:56.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.687+0000 7f3cd4e2d740 1 Processor -- start 2024-07-26T12:34:56.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.687+0000 7f3cd4e2d740 1 -- start start 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f81770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 0x55aec7f81cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f71c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b5180 con 0x55aec7b97b60 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b6cc0 con 0x55aec7bb8840 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b5850 con 0x55aec7b8f980 2024-07-26T12:34:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cc6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 0x55aec7f81cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cc6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 0x55aec7f81cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53934/0 (socket says 172.21.15.40:53934) 2024-07-26T12:34:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.688+0000 7f3cc6a00640 1 -- 172.21.15.40:0/3223121444 learned_addr learned my addr 172.21.15.40:0/3223121444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc7400640 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f81770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f71c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc6a00640 1 -- 172.21.15.40:0/3223121444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 msgr2=0x55aec7f81770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f81770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc6a00640 1 -- 172.21.15.40:0/3223121444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 msgr2=0x55aec7f71c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f71c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc6a00640 1 -- 172.21.15.40:0/3223121444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec7f61210 con 0x55aec7b97b60 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.689+0000 7f3cc7400640 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f81770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.690+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 0x55aec7f81cb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40cb0c0 tx=0x7f3cb40ee040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca42aac694ac50d6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.690+0000 7f3cb3400640 1 -- 172.21.15.40:0/3223121444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4049040 con 0x55aec7b97b60 2024-07-26T12:34:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.690+0000 7f3cb3400640 1 -- 172.21.15.40:0/3223121444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cb40cf9c0 con 0x55aec7b97b60 2024-07-26T12:34:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.690+0000 7f3cb3400640 1 -- 172.21.15.40:0/3223121444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb41040c0 con 0x55aec7b97b60 2024-07-26T12:34:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3223121444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 msgr2=0x55aec7f81cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 0x55aec7f81cb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40cb0c0 tx=0x7f3cb40ee040 comp rx=0 tx=0).stop 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3223121444 shutdown_connections 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7bb8840 0x55aec7f71c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7b97b60 0x55aec7f81cb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/3223121444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f81770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3223121444 >> 172.21.15.40:0/3223121444 conn(0x55aec7bac990 msgr2=0x55aec7f685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3223121444 shutdown_connections 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.691+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/3223121444 wait complete. 2024-07-26T12:34:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.692+0000 7f3cd4e2d740 1 -- start start 2024-07-26T12:34:56.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.692+0000 7f3cd4e2d740 1 Processor -- start 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f6e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f6e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b65f0 con 0x55aec7bb8840 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b5f20 con 0x55aec7b97b60 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b3140 con 0x55aec7b8f980 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cd4e2d740 10 client.0 _ll_register_callbacks cb 0x7f3cb800bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f6e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f6e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53940/0 (socket says 172.21.15.40:53940) 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.693+0000 7f3cc7e00640 1 -- 172.21.15.40:0/1264580618 learned_addr learned my addr 172.21.15.40:0/1264580618 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc6a00640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f6e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7400640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7e00640 1 -- 172.21.15.40:0/1264580618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 msgr2=0x55aec7f6dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f6dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7e00640 1 -- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 msgr2=0x55aec7f6e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:34:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f6e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7e00640 1 -- 172.21.15.40:0/1264580618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec7fe37f0 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cb0c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.694+0000 7f3cc7e00640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f6e6e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007e20 tx=0x7f3cc0007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7bd3fbf947967d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.695+0000 7f3cb0c00640 1 -- 172.21.15.40:0/1264580618 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0014040 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.695+0000 7f3cb0c00640 1 -- 172.21.15.40:0/1264580618 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3cc0010a50 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.695+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb40cf9c0 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.695+0000 7f3cb0c00640 1 -- 172.21.15.40:0/1264580618 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3cc0010c50 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.696+0000 7f3cd4e2d740 10 client.15915 fetch_fsmap learned FSMap version 35 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.696+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55aec7fe4a50 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.696+0000 7f3cb0c00640 1 -- 172.21.15.40:0/1264580618 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cb40cf9c0 con 0x55aec7bb8840 2024-07-26T12:34:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.696+0000 7f3cb0c00640 1 -- 172.21.15.40:0/1264580618 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3cc0023570 con 0x55aec7bb8840 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.697+0000 7f3cd4e2d740 10 client.15915 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.697+0000 7f3cd4e2d740 10 client.15915 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.697+0000 7f3cd4e2d740 20 client.15915 populate_metadata read hostname 'smithi040' 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.697+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b4c570 0x55aec7fe6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.697+0000 7f3cd4e2d740 4 client.15915 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}] 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.697+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}) -- 0x55aec7ed1550 con 0x55aec7b4c570 2024-07-26T12:34:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.698+0000 7f3cc7400640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b4c570 0x55aec7fe6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:34:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.698+0000 7f3cc7400640 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b4c570 0x55aec7fe6f60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62e95b150111c0c6 server_cookie=e979d1675361fe65 in_seq=0 out_seq=0 2024-07-26T12:34:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.698+0000 7f3cb0c00640 10 client.15915 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:34:56.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.948+0000 7f3cb0c00640 1 -- 172.21.15.40:0/1264580618 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55aec7ed1550 con 0x55aec7b4c570 2024-07-26T12:34:56.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.948+0000 7f3cb0c00640 10 client.15915 handle_command_reply: tid=0 2024-07-26T12:34:56.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.948+0000 7f3cd4e2d740 1 client.15915 shutdown 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.949+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 msgr2=0x55aec7f6e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.949+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f6e6e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007e20 tx=0x7f3cc0007b90 comp rx=0 tx=0).stop 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 shutdown_connections 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55aec7b4c570 0x55aec7fe6f60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aec7bb8840 0x55aec7f6e6e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55aec7b97b60 0x55aec7f6e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 --2- 172.21.15.40:0/1264580618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aec7b8f980 0x55aec7f6dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 >> 172.21.15.40:0/1264580618 conn(0x55aec7bac990 msgr2=0x55aec7f68fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:56.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cb0c00640 0 client.15915 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:34:56.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 shutdown_connections 2024-07-26T12:34:56.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.950+0000 7f3cd4e2d740 1 -- 172.21.15.40:0/1264580618 wait complete. 2024-07-26T12:34:56.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.951+0000 7f3cd4e2d740 20 client.15915 trim_cache size 0 max 16384 2024-07-26T12:34:56.953 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 38, 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "92241c": { 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 38, 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:34:56.954 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 144.2, 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:34:56.955 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:34:56.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.952+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cac0b3c70 msgr2=0x7f3cac0b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.952+0000 7f3cccc00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cac0b3c70 0x7f3cac0b6180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55aec7f5d030 tx=0x7f3cb800b4d0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.952+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 msgr2=0x7f3cc81a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:34:56.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.952+0000 7f3cccc00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc81a07e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3cb402a910 tx=0x7f3cb4003c20 comp rx=0 tx=0).stop 2024-07-26T12:34:56.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 shutdown_connections 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3cc810fca0 0x7f3cc81a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc810f350 0x7f3cc81a07e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cac0b3c70 0x7f3cac0b6180 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 --2- 172.21.15.40:0/1713863980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cc8109a60 0x7f3cc81a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 >> 172.21.15.40:0/1713863980 conn(0x7f3cc8079100 msgr2=0x7f3cc810dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 shutdown_connections 2024-07-26T12:34:56.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:34:56.953+0000 7f3cccc00640 1 -- 172.21.15.40:0/1713863980 wait complete. 2024-07-26T12:34:57.796 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '92241c', quiesce took 8.2 seconds. Will release after: 16.0 2024-07-26T12:34:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:57 smithi040 ceph-mon[32397]: pgmap v881: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:57 smithi146 ceph-mon[35807]: pgmap v881: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:34:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:57 smithi076 ceph-mon[35401]: pgmap v881: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:35:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:34:59 smithi146 ceph-mon[35807]: pgmap v882: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:35:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:34:59 smithi076 ceph-mon[35401]: pgmap v882: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:35:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:34:59 smithi040 ceph-mon[32397]: pgmap v882: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:35:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:00 smithi040 ceph-mon[32397]: pgmap v883: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:35:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:00 smithi146 ceph-mon[35807]: pgmap v883: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:35:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:00 smithi076 ceph-mon[35401]: pgmap v883: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:35:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:03 smithi146 ceph-mon[35807]: pgmap v884: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T12:35:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:03 smithi076 ceph-mon[35401]: pgmap v884: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T12:35:04.213 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:03 smithi040 ceph-mon[32397]: pgmap v884: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T12:35:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:05 smithi146 ceph-mon[35807]: pgmap v885: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:35:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:05 smithi076 ceph-mon[35401]: pgmap v885: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:35:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:05 smithi040 ceph-mon[32397]: pgmap v885: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:35:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:07 smithi146 ceph-mon[35807]: pgmap v886: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:35:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:07 smithi076 ceph-mon[35401]: pgmap v886: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:35:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:07 smithi040 ceph-mon[32397]: pgmap v886: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:35:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:09 smithi146 ceph-mon[35807]: pgmap v887: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:35:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:09 smithi076 ceph-mon[35401]: pgmap v887: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:35:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:09 smithi040 ceph-mon[32397]: pgmap v887: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:35:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:11 smithi146 ceph-mon[35807]: pgmap v888: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-07-26T12:35:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:11 smithi076 ceph-mon[35401]: pgmap v888: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-07-26T12:35:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:11 smithi040 ceph-mon[32397]: pgmap v888: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-07-26T12:35:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:35:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:35:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:35:13.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:35:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:13 smithi146 ceph-mon[35807]: pgmap v889: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T12:35:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:13 smithi076 ceph-mon[35401]: pgmap v889: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T12:35:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:13 smithi040 ceph-mon[32397]: pgmap v889: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T12:35:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:35:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:35:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:35:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:35:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:14 smithi146 ceph-mon[35807]: pgmap v890: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 338 KiB/s wr, 12 op/s 2024-07-26T12:35:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:35:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:35:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:35:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:14 smithi076 ceph-mon[35401]: pgmap v890: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 338 KiB/s wr, 12 op/s 2024-07-26T12:35:15.201 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:35:15.202 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:35:15.202 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:35:15.202 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:14 smithi040 ceph-mon[32397]: pgmap v890: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 338 KiB/s wr, 12 op/s 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 -- 172.21.15.40:0/2296969343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 msgr2=0x7f3768109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 --2- 172.21.15.40:0/2296969343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f3768109e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3758009900 tx=0x7f375802a410 comp rx=0 tx=0).stop 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 -- 172.21.15.40:0/2296969343 shutdown_connections 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 --2- 172.21.15.40:0/2296969343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 0x7f37681164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 --2- 172.21.15.40:0/2296969343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f376810f330 0x7f376810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 --2- 172.21.15.40:0/2296969343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f3768109e00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.461+0000 7f376dc00640 1 -- 172.21.15.40:0/2296969343 >> 172.21.15.40:0/2296969343 conn(0x7f3768078ff0 msgr2=0x7f3768107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.462+0000 7f376dc00640 1 -- 172.21.15.40:0/2296969343 shutdown_connections 2024-07-26T12:35:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.462+0000 7f376dc00640 1 -- 172.21.15.40:0/2296969343 wait complete. 2024-07-26T12:35:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.463+0000 7f376dc00640 1 Processor -- start 2024-07-26T12:35:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.463+0000 7f376dc00640 1 -- start start 2024-07-26T12:35:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.463+0000 7f376dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f37681a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.463+0000 7f376dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f376810f330 0x7f37681a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.463+0000 7f376dc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 0x7f37681a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f376dc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3768119840 con 0x7f37681099f0 2024-07-26T12:35:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f376dc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f37681196c0 con 0x7f376810fc80 2024-07-26T12:35:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f376dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f37681199c0 con 0x7f376810f330 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f3767e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f37681a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f3767e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f37681a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37058/0 (socket says 172.21.15.40:37058) 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f3767e00640 1 -- 172.21.15.40:0/382188202 learned_addr learned my addr 172.21.15.40:0/382188202 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f376d200640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 0x7f37681a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.464+0000 7f375fe00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f376810f330 0x7f37681a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3767e00640 1 -- 172.21.15.40:0/382188202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f376810f330 msgr2=0x7f37681a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3767e00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f376810f330 0x7f37681a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3767e00640 1 -- 172.21.15.40:0/382188202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 msgr2=0x7f37681a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3767e00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 0x7f37681a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3767e00640 1 -- 172.21.15.40:0/382188202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37681a6220 con 0x7f37681099f0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f376d200640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 0x7f37681a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3767e00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f37681a02b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f375802a930 tx=0x7f3758003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375803f070 con 0x7f37681099f0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f375803baf0 con 0x7f37681099f0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37681a64b0 con 0x7f37681099f0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.465+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758035030 con 0x7f37681099f0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.466+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37681acc70 con 0x7f37681099f0 2024-07-26T12:35:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.467+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3768109e00 con 0x7f37681099f0 2024-07-26T12:35:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.469+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3758042070 con 0x7f37681099f0 2024-07-26T12:35:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.471+0000 7f3765600640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f374c0b3c50 0x7f374c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.471+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f37581046a0 con 0x7f37681099f0 2024-07-26T12:35:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.471+0000 7f375fe00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f374c0b3c50 0x7f374c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.472+0000 7f375fe00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f374c0b3c50 0x7f374c0b6160 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f376810faf0 tx=0x7f3750005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.474+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f37580cbcb0 con 0x7f37681099f0 2024-07-26T12:35:16.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.714+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3768111ab0 con 0x7f37681099f0 2024-07-26T12:35:16.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.715+0000 7f3765600640 1 -- 172.21.15.40:0/382188202 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f37580cb5b0 con 0x7f37681099f0 2024-07-26T12:35:16.718 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:35:16.718 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:35:16.718 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:35:16.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.718+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f374c0b3c50 msgr2=0x7f374c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:16.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.718+0000 7f376dc00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f374c0b3c50 0x7f374c0b6160 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f376810faf0 tx=0x7f3750005f90 comp rx=0 tx=0).stop 2024-07-26T12:35:16.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.718+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 msgr2=0x7f37681a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:16.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.718+0000 7f376dc00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f37681a02b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f375802a930 tx=0x7f3758003b90 comp rx=0 tx=0).stop 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 shutdown_connections 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f376810fc80 0x7f37681a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f374c0b3c50 0x7f374c0b6160 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f376810f330 0x7f37681a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 --2- 172.21.15.40:0/382188202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37681099f0 0x7f37681a02b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 >> 172.21.15.40:0/382188202 conn(0x7f3768078ff0 msgr2=0x7f3768108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 shutdown_connections 2024-07-26T12:35:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:16.719+0000 7f376dc00640 1 -- 172.21.15.40:0/382188202 wait complete. 2024-07-26T12:35:17.471 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 92241c --release --await' 2024-07-26T12:35:17.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 92241c --release --await 2024-07-26T12:35:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:17 smithi040 ceph-mon[32397]: pgmap v891: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/382188202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:17.786 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:17 smithi076 ceph-mon[35401]: pgmap v891: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:35:17.787 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/382188202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:17 smithi146 ceph-mon[35807]: pgmap v891: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:35:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/382188202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:35:19.596 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:19 smithi040 ceph-mon[32397]: pgmap v892: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T12:35:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:19 smithi146 ceph-mon[35807]: pgmap v892: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T12:35:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:19 smithi076 ceph-mon[35401]: pgmap v892: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T12:35:20.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 -- 172.21.15.40:0/925222049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 msgr2=0x7ff03810b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 --2- 172.21.15.40:0/925222049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03810b530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff020009900 tx=0x7ff02002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 -- 172.21.15.40:0/925222049 shutdown_connections 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 --2- 172.21.15.40:0/925222049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff03810ba70 0x7ff0381122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 --2- 172.21.15.40:0/925222049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03810b530 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 --2- 172.21.15.40:0/925222049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0381057e0 0x7ff038105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.206+0000 7ff03ee00640 1 -- 172.21.15.40:0/925222049 >> 172.21.15.40:0/925222049 conn(0x7ff0381011f0 msgr2=0x7ff038103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.207+0000 7ff03ee00640 1 -- 172.21.15.40:0/925222049 shutdown_connections 2024-07-26T12:35:20.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.207+0000 7ff03ee00640 1 -- 172.21.15.40:0/925222049 wait complete. 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.208+0000 7ff03ee00640 1 Processor -- start 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.208+0000 7ff03ee00640 1 -- start start 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.208+0000 7ff03ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0381057e0 0x7ff03819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.208+0000 7ff03ee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.208+0000 7ff03ee00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff03810ba70 0x7ff0381a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff03ee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381155b0 con 0x7ff03810b120 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff03ee00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff038115430 con 0x7ff03810ba70 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff03ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff038115730 con 0x7ff0381057e0 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff037400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff037400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37070/0 (socket says 172.21.15.40:37070) 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff037400640 1 -- 172.21.15.40:0/1890946538 learned_addr learned my addr 172.21.15.40:0/1890946538 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff037e00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0381057e0 0x7ff03819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.209+0000 7ff03ce00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff03810ba70 0x7ff0381a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037400640 1 -- 172.21.15.40:0/1890946538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0381057e0 msgr2=0x7ff03819c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037400640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0381057e0 0x7ff03819c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037400640 1 -- 172.21.15.40:0/1890946538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff03810ba70 msgr2=0x7ff0381a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037400640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff03810ba70 0x7ff0381a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037400640 1 -- 172.21.15.40:0/1890946538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0381a1fb0 con 0x7ff03810b120 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037e00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0381057e0 0x7ff03819c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff03ce00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff03810ba70 0x7ff0381a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff037400640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03819c5e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff020005940 tx=0x7ff020005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.210+0000 7ff034c00640 1 -- 172.21.15.40:0/1890946538 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02003f030 con 0x7ff03810b120 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.211+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0381a2240 con 0x7ff03810b120 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.211+0000 7ff034c00640 1 -- 172.21.15.40:0/1890946538 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0200043d0 con 0x7ff03810b120 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.211+0000 7ff034c00640 1 -- 172.21.15.40:0/1890946538 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035070 con 0x7ff03810b120 2024-07-26T12:35:20.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.211+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0381a8a00 con 0x7ff03810b120 2024-07-26T12:35:20.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.214+0000 7ff045c0a740 1 Processor -- start 2024-07-26T12:35:20.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.214+0000 7ff045c0a740 1 -- start start 2024-07-26T12:35:20.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.214+0000 7ff034c00640 1 -- 172.21.15.40:0/1890946538 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff020042030 con 0x7ff03810b120 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f29520 0x55bbc72cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff045c0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bbc7244f30 con 0x55bbc6f08840 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff045c0a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bbc7234430 con 0x55bbc6f29520 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff045c0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bbc7238470 con 0x55bbc6f00660 2024-07-26T12:35:20.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff037400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff037400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37082/0 (socket says 172.21.15.40:37082) 2024-07-26T12:35:20.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff037400640 1 -- 172.21.15.40:0/3137354379 learned_addr learned my addr 172.21.15.40:0/3137354379 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:20.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff03ce00640 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f29520 0x55bbc72cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.215+0000 7ff037e00640 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.216+0000 7ff037400640 1 -- 172.21.15.40:0/3137354379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 msgr2=0x55bbc72ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.216+0000 7ff037400640 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.216+0000 7ff037400640 1 -- 172.21.15.40:0/3137354379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f29520 msgr2=0x55bbc72cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.216+0000 7ff037400640 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f29520 0x55bbc72cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.216+0000 7ff037400640 1 -- 172.21.15.40:0/3137354379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbc6f94b00 con 0x55bbc6f08840 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.216+0000 7ff037400640 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72cea40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff02010c190 tx=0x7ff02010c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539c689e34c0b5ae server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.217+0000 7ff02d600640 1 -- 172.21.15.40:0/3137354379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020116470 con 0x55bbc6f08840 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.217+0000 7ff02d600640 1 -- 172.21.15.40:0/3137354379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff020111070 con 0x55bbc6f08840 2024-07-26T12:35:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.217+0000 7ff02d600640 1 -- 172.21.15.40:0/3137354379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0201047c0 con 0x55bbc6f08840 2024-07-26T12:35:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.217+0000 7ff034c00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff01c0b3c50 0x7ff01c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.217+0000 7ff034c00640 1 -- 172.21.15.40:0/1890946538 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff020103fd0 con 0x7ff03810b120 2024-07-26T12:35:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.217+0000 7ff03ce00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff01c0b3c50 0x7ff01c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 -- 172.21.15.40:0/3137354379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 msgr2=0x55bbc72cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72cea40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff02010c190 tx=0x7ff02010c280 comp rx=0 tx=0).stop 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 -- 172.21.15.40:0/3137354379 shutdown_connections 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72cea40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 --2- 172.21.15.40:0/3137354379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f29520 0x55bbc72cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 -- 172.21.15.40:0/3137354379 >> 172.21.15.40:0/3137354379 conn(0x55bbc6f1d910 msgr2=0x55bbc72cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff03ce00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff01c0b3c50 0x7ff01c0b6160 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff030009d30 tx=0x7ff030005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 -- 172.21.15.40:0/3137354379 shutdown_connections 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.218+0000 7ff045c0a740 1 -- 172.21.15.40:0/3137354379 wait complete. 2024-07-26T12:35:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.219+0000 7ff045c0a740 1 -- start start 2024-07-26T12:35:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.219+0000 7ff045c0a740 1 Processor -- start 2024-07-26T12:35:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 0x55bbc72d9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72d9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72e5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bbc7097bb0 con 0x55bbc6f00660 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bbc71d0910 con 0x55bbc6f08840 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bbc72dc560 con 0x55bbc6f29520 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff045c0a740 10 client.0 _ll_register_callbacks cb 0x55bbc6f40d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff037e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 0x55bbc72d9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff037e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 0x55bbc72d9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37094/0 (socket says 172.21.15.40:37094) 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.220+0000 7ff037e00640 1 -- 172.21.15.40:0/2111455770 learned_addr learned my addr 172.21.15.40:0/2111455770 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037400640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72d9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff03ce00640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037e00640 1 -- 172.21.15.40:0/2111455770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 msgr2=0x55bbc72e5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037e00640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037e00640 1 -- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 msgr2=0x55bbc72d9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037e00640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72d9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037e00640 1 -- 172.21.15.40:0/2111455770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbc700b960 con 0x55bbc6f00660 2024-07-26T12:35:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff037e00640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 0x55bbc72d9680 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff028011b00 tx=0x7ff0280103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb6d55ff00d42b0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.221+0000 7ff026000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:35:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff026000640 1 -- 172.21.15.40:0/2111455770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028010e50 con 0x55bbc6f00660 2024-07-26T12:35:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff026000640 1 -- 172.21.15.40:0/2111455770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff028004b20 con 0x55bbc6f00660 2024-07-26T12:35:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff020111070 con 0x55bbc6f00660 2024-07-26T12:35:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff026000640 1 -- 172.21.15.40:0/2111455770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff028004d20 con 0x55bbc6f00660 2024-07-26T12:35:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff045c0a740 10 client.15933 fetch_fsmap learned FSMap version 35 2024-07-26T12:35:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bbc72e8290 con 0x55bbc6f00660 2024-07-26T12:35:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.222+0000 7ff026000640 1 -- 172.21.15.40:0/2111455770 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff020111070 con 0x55bbc6f00660 2024-07-26T12:35:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff026000640 1 -- 172.21.15.40:0/2111455770 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ff0280044a0 con 0x55bbc6f00660 2024-07-26T12:35:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff045c0a740 10 client.15933 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff045c0a740 10 client.15933 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff045c0a740 20 client.15933 populate_metadata read hostname 'smithi040' 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ee7ea0 0x55bbc72eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff045c0a740 4 client.15933 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbc7246e80 con 0x55bbc6ee7ea0 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.223+0000 7ff037400640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ee7ea0 0x55bbc72eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.224+0000 7ff037400640 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ee7ea0 0x55bbc72eb7e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efc94f0353a3699c server_cookie=95f14f77536d8464 in_seq=0 out_seq=0 2024-07-26T12:35:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.224+0000 7ff026000640 10 client.15933 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:20.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.226+0000 7ff026000640 1 -- 172.21.15.40:0/2111455770 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbc7246e80 con 0x55bbc6ee7ea0 2024-07-26T12:35:20.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.226+0000 7ff026000640 10 client.15933 handle_command_reply: tid=0 2024-07-26T12:35:20.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.226+0000 7ff045c0a740 1 client.15933 shutdown 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.226+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 msgr2=0x55bbc72d9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.226+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 0x55bbc72d9680 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff028011b00 tx=0x7ff0280103d0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.226+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 shutdown_connections 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72e5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72d9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ee7ea0 0x55bbc72eb7e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2111455770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f00660 0x55bbc72d9680 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 >> 172.21.15.40:0/2111455770 conn(0x55bbc6f1d910 msgr2=0x55bbc72d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff026000640 0 client.15933 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 shutdown_connections 2024-07-26T12:35:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 1 -- 172.21.15.40:0/2111455770 wait complete. 2024-07-26T12:35:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.227+0000 7ff045c0a740 20 client.15933 trim_cache size 0 max 16384 2024-07-26T12:35:20.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.246+0000 7ff045c0a740 1 Processor -- start 2024-07-26T12:35:20.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.246+0000 7ff045c0a740 1 -- start start 2024-07-26T12:35:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f00660 0x55bbc72e5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff045c0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381b1010 con 0x55bbc6f08840 2024-07-26T12:35:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff045c0a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381b2b50 con 0x55bbc6f00660 2024-07-26T12:35:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff045c0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381b16e0 con 0x55bbc6f29520 2024-07-26T12:35:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff037400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff037400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72e5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37098/0 (socket says 172.21.15.40:37098) 2024-07-26T12:35:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.247+0000 7ff037400640 1 -- 172.21.15.40:0/2318752841 learned_addr learned my addr 172.21.15.40:0/2318752841 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037e00640 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f00660 0x55bbc72e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff03ce00640 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037400640 1 -- 172.21.15.40:0/2318752841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 msgr2=0x55bbc72d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037400640 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72d45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037400640 1 -- 172.21.15.40:0/2318752841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f00660 msgr2=0x55bbc72e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037400640 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f00660 0x55bbc72e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037400640 1 -- 172.21.15.40:0/2318752841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbc72ccc40 con 0x55bbc6f08840 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037e00640 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f00660 0x55bbc72e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.248+0000 7ff037400640 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72e5b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b0fd0 tx=0x7ff0200b2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4a4994db23e723 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.249+0000 7ff02cc00640 1 -- 172.21.15.40:0/2318752841 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0200abe80 con 0x55bbc6f08840 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.249+0000 7ff02cc00640 1 -- 172.21.15.40:0/2318752841 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff020111040 con 0x55bbc6f08840 2024-07-26T12:35:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.249+0000 7ff02cc00640 1 -- 172.21.15.40:0/2318752841 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020049040 con 0x55bbc6f08840 2024-07-26T12:35:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 -- 172.21.15.40:0/2318752841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 msgr2=0x55bbc72e5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72e5b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b0fd0 tx=0x7ff0200b2040 comp rx=0 tx=0).stop 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 -- 172.21.15.40:0/2318752841 shutdown_connections 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f29520 0x55bbc72d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f08840 0x55bbc72e5b80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2318752841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f00660 0x55bbc72e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 -- 172.21.15.40:0/2318752841 >> 172.21.15.40:0/2318752841 conn(0x55bbc6f1d910 msgr2=0x55bbc72d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 -- 172.21.15.40:0/2318752841 shutdown_connections 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 -- 172.21.15.40:0/2318752841 wait complete. 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.250+0000 7ff045c0a740 1 -- start start 2024-07-26T12:35:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 Processor -- start 2024-07-26T12:35:20.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 0x55bbc7352fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381b2480 con 0x55bbc6f29520 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381b1db0 con 0x55bbc6f08840 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381aefd0 con 0x55bbc6f00660 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.251+0000 7ff045c0a740 10 client.0 _ll_register_callbacks cb 0x7ff028009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 0x55bbc7352fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 0x55bbc7352fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37104/0 (socket says 172.21.15.40:37104) 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 -- 172.21.15.40:0/2408981454 learned_addr learned my addr 172.21.15.40:0/2408981454 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff037e00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff037400640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 -- 172.21.15.40:0/2408981454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 msgr2=0x55bbc72ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ddef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 -- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 msgr2=0x55bbc72de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72de4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff03ce00640 1 -- 172.21.15.40:0/2408981454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbc7353620 con 0x55bbc6f29520 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.252+0000 7ff037e00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff03ce00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 0x55bbc7352fb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff030009830 tx=0x7ff030004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20266a08f3a8c8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff026000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff026000640 1 -- 172.21.15.40:0/2408981454 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03001de60 con 0x55bbc6f29520 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff026000640 1 -- 172.21.15.40:0/2408981454 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff030011b50 con 0x55bbc6f29520 2024-07-26T12:35:20.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff020111040 con 0x55bbc6f29520 2024-07-26T12:35:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff026000640 1 -- 172.21.15.40:0/2408981454 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff030011d90 con 0x55bbc6f29520 2024-07-26T12:35:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff045c0a740 10 client.15939 fetch_fsmap learned FSMap version 35 2024-07-26T12:35:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.253+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bbc7354970 con 0x55bbc6f29520 2024-07-26T12:35:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff026000640 1 -- 172.21.15.40:0/2408981454 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff020111040 con 0x55bbc6f29520 2024-07-26T12:35:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff026000640 1 -- 172.21.15.40:0/2408981454 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ff030028070 con 0x55bbc6f29520 2024-07-26T12:35:20.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff045c0a740 10 client.15939 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff045c0a740 10 client.15939 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff045c0a740 20 client.15939 populate_metadata read hostname 'smithi040' 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ebd250 0x55bbc73571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff045c0a740 4 client.15939 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "92241c", "release": true, "await": true}] 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.254+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "92241c", "release": true, "await": true}) -- 0x55bbc7242920 con 0x55bbc6ebd250 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.255+0000 7ff037e00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ebd250 0x55bbc73571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.256+0000 7ff037e00640 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ebd250 0x55bbc73571e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d674c8b9c362c3 server_cookie=1d2c28598769d5f2 in_seq=0 out_seq=0 2024-07-26T12:35:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.256+0000 7ff026000640 10 client.15939 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.325+0000 7ff026000640 1 -- 172.21.15.40:0/2408981454 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55bbc7242920 con 0x55bbc6ebd250 2024-07-26T12:35:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.325+0000 7ff026000640 10 client.15939 handle_command_reply: tid=0 2024-07-26T12:35:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.325+0000 7ff045c0a740 1 client.15939 shutdown 2024-07-26T12:35:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 msgr2=0x55bbc7352fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 0x55bbc7352fb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff030009830 tx=0x7ff030004730 comp rx=0 tx=0).stop 2024-07-26T12:35:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 shutdown_connections 2024-07-26T12:35:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bbc6ebd250 0x55bbc73571e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bbc6f29520 0x55bbc7352fb0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbc6f08840 0x55bbc72de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 --2- 172.21.15.40:0/2408981454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bbc6f00660 0x55bbc72ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 >> 172.21.15.40:0/2408981454 conn(0x55bbc6f1d910 msgr2=0x55bbc72e4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff026000640 0 client.15939 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.326+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 shutdown_connections 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.327+0000 7ff045c0a740 1 -- 172.21.15.40:0/2408981454 wait complete. 2024-07-26T12:35:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.327+0000 7ff045c0a740 20 client.15939 trim_cache size 0 max 16384 2024-07-26T12:35:20.330 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:35:20.330 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 40, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "92241c": { 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 40, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 144.2, 2024-07-26T12:35:20.331 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:20.332 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:35:20.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff01c0b3c50 msgr2=0x7ff01c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff01c0b3c50 0x7ff01c0b6160 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff030009d30 tx=0x7ff030005f90 comp rx=0 tx=0).stop 2024-07-26T12:35:20.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 msgr2=0x7ff03819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03819c5e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff020005940 tx=0x7ff020005e10 comp rx=0 tx=0).stop 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 shutdown_connections 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff03810ba70 0x7ff0381a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff03810b120 0x7ff03819c5e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff01c0b3c50 0x7ff01c0b6160 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 --2- 172.21.15.40:0/1890946538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0381057e0 0x7ff03819c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.329+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 >> 172.21.15.40:0/1890946538 conn(0x7ff0381011f0 msgr2=0x7ff0381098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.330+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 shutdown_connections 2024-07-26T12:35:20.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:20.330+0000 7ff03ee00640 1 -- 172.21.15.40:0/1890946538 wait complete. 2024-07-26T12:35:21.208 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '92241c', total seconds elapsed: 31.6 2024-07-26T12:35:21.208 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.2 2024-07-26T12:35:21.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:35:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:35:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:21 smithi040 ceph-mon[32397]: pgmap v893: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:35:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:21 smithi146 ceph-mon[35807]: pgmap v893: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:35:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:21 smithi076 ceph-mon[35401]: pgmap v893: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:35:23.624 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:23 smithi040 ceph-mon[32397]: pgmap v894: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T12:35:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:23 smithi146 ceph-mon[35807]: pgmap v894: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T12:35:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:23 smithi076 ceph-mon[35401]: pgmap v894: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.966+0000 7f8b0c600640 1 -- 172.21.15.40:0/1067581790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 msgr2=0x7f8b0410fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.966+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1067581790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b0410fd30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009ca0 tx=0x7f8afc02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 -- 172.21.15.40:0/1067581790 shutdown_connections 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1067581790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b0410fd30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1067581790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b04104ce0 0x7f8b0410d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1067581790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b041042b0 0x7f8b041046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 -- 172.21.15.40:0/1067581790 >> 172.21.15.40:0/1067581790 conn(0x7f8b04079160 msgr2=0x7f8b04079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 -- 172.21.15.40:0/1067581790 shutdown_connections 2024-07-26T12:35:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.967+0000 7f8b0c600640 1 -- 172.21.15.40:0/1067581790 wait complete. 2024-07-26T12:35:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.968+0000 7f8b0c600640 1 Processor -- start 2024-07-26T12:35:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.968+0000 7f8b0c600640 1 -- start start 2024-07-26T12:35:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.969+0000 7f8b0c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b041042b0 0x7f8b041021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.969+0000 7f8b0c600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b04104ce0 0x7f8b04102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.969+0000 7f8b0c600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b04102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.969+0000 7f8b0c600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04113380 con 0x7f8b0410d860 2024-07-26T12:35:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.969+0000 7f8b0c600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04113200 con 0x7f8b04104ce0 2024-07-26T12:35:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.969+0000 7f8b0c600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04113500 con 0x7f8b041042b0 2024-07-26T12:35:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b04102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b04102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50224/0 (socket says 172.21.15.40:50224) 2024-07-26T12:35:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 -- 172.21.15.40:0/1865880628 learned_addr learned my addr 172.21.15.40:0/1865880628 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b09c00640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b041042b0 0x7f8b041021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b09200640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b04104ce0 0x7f8b04102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 -- 172.21.15.40:0/1865880628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b041042b0 msgr2=0x7f8b041021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b041042b0 0x7f8b041021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 -- 172.21.15.40:0/1865880628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b04104ce0 msgr2=0x7f8b04102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b04104ce0 0x7f8b04102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.970+0000 7f8b0a600640 1 -- 172.21.15.40:0/1865880628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b041a8010 con 0x7f8b0410d860 2024-07-26T12:35:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.971+0000 7f8b0a600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b04102c40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8afc005cc0 tx=0x7f8afc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.971+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc032c10 con 0x7f8b0410d860 2024-07-26T12:35:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.971+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8afc032db0 con 0x7f8b0410d860 2024-07-26T12:35:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.971+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc030a60 con 0x7f8b0410d860 2024-07-26T12:35:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.971+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b041a82a0 con 0x7f8b0410d860 2024-07-26T12:35:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.972+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b041a8790 con 0x7f8b0410d860 2024-07-26T12:35:23.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.973+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b041046c0 con 0x7f8b0410d860 2024-07-26T12:35:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.976+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8afc030c00 con 0x7f8b0410d860 2024-07-26T12:35:23.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.978+0000 7f8b02000640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8aec0b3c50 0x7f8aec0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:23.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.979+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8afc105070 con 0x7f8b0410d860 2024-07-26T12:35:23.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.979+0000 7f8b09c00640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8aec0b3c50 0x7f8aec0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:23.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.980+0000 7f8b09c00640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8aec0b3c50 0x7f8aec0b6160 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b04103c10 tx=0x7f8af8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:23.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:23.983+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8afc0cc6c0 con 0x7f8b0410d860 2024-07-26T12:35:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.265+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b0402e0c0 con 0x7f8b0410d860 2024-07-26T12:35:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.267+0000 7f8b02000640 1 -- 172.21.15.40:0/1865880628 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f8afc0cbfc0 con 0x7f8b0410d860 2024-07-26T12:35:24.269 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:35:24.270 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:35:24.270 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:35:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.270+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8aec0b3c50 msgr2=0x7f8aec0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.270+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8aec0b3c50 0x7f8aec0b6160 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b04103c10 tx=0x7f8af8005f90 comp rx=0 tx=0).stop 2024-07-26T12:35:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.270+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 msgr2=0x7f8b04102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.270+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b04102c40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8afc005cc0 tx=0x7f8afc003f90 comp rx=0 tx=0).stop 2024-07-26T12:35:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 shutdown_connections 2024-07-26T12:35:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b0410d860 0x7f8b04102c40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b04104ce0 0x7f8b04102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8aec0b3c50 0x7f8aec0b6160 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 --2- 172.21.15.40:0/1865880628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b041042b0 0x7f8b041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 >> 172.21.15.40:0/1865880628 conn(0x7f8b04079160 msgr2=0x7f8b04100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 shutdown_connections 2024-07-26T12:35:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:24.271+0000 7f8b0c600640 1 -- 172.21.15.40:0/1865880628 wait complete. 2024-07-26T12:35:24.654 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:24 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1865880628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:24 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1865880628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:24 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1865880628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:25.104 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0' 2024-07-26T12:35:25.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0 2024-07-26T12:35:25.663 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:35:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:25 smithi040 ceph-mon[32397]: pgmap v895: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T12:35:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:25 smithi146 ceph-mon[35807]: pgmap v895: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T12:35:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:25 smithi076 ceph-mon[35401]: pgmap v895: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T12:35:27.721 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:27 smithi040 ceph-mon[32397]: pgmap v896: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:35:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:27 smithi146 ceph-mon[35807]: pgmap v896: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:35:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:27 smithi076 ceph-mon[35401]: pgmap v896: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:35:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 -- 172.21.15.40:0/3511434153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 msgr2=0x7feb48102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:27.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 --2- 172.21.15.40:0/3511434153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb48102420 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feb38009930 tx=0x7feb3802a420 comp rx=0 tx=0).stop 2024-07-26T12:35:27.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 -- 172.21.15.40:0/3511434153 shutdown_connections 2024-07-26T12:35:27.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 --2- 172.21.15.40:0/3511434153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb48107450 0x7feb48107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 --2- 172.21.15.40:0/3511434153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb48102960 0x7feb48106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 --2- 172.21.15.40:0/3511434153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb48102420 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 -- 172.21.15.40:0/3511434153 >> 172.21.15.40:0/3511434153 conn(0x7feb480fdd60 msgr2=0x7feb481001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:27.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 -- 172.21.15.40:0/3511434153 shutdown_connections 2024-07-26T12:35:27.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.953+0000 7feb47200640 1 -- 172.21.15.40:0/3511434153 wait complete. 2024-07-26T12:35:27.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.954+0000 7feb47200640 1 Processor -- start 2024-07-26T12:35:27.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.954+0000 7feb47200640 1 -- start start 2024-07-26T12:35:27.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb47200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb481a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb47200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb48102960 0x7feb481a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb47200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb48107450 0x7feb481a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb47200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feb481197a0 con 0x7feb48102010 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb47200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feb48119620 con 0x7feb48102960 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb47200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feb48119920 con 0x7feb48107450 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.955+0000 7feb45e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb481a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb481a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50236/0 (socket says 172.21.15.40:50236) 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 -- 172.21.15.40:0/2073898180 learned_addr learned my addr 172.21.15.40:0/2073898180 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45400640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb48102960 0x7feb481a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb46800640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb48107450 0x7feb481a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 -- 172.21.15.40:0/2073898180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb48107450 msgr2=0x7feb481a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb48107450 0x7feb481a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 -- 172.21.15.40:0/2073898180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb48102960 msgr2=0x7feb481a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb48102960 0x7feb481a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.956+0000 7feb45e00640 1 -- 172.21.15.40:0/2073898180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb481a6280 con 0x7feb48102010 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.957+0000 7feb45e00640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb481a0310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feb38005940 tx=0x7feb380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.957+0000 7feb3ea00640 1 -- 172.21.15.40:0/2073898180 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3803f030 con 0x7feb48102010 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.957+0000 7feb3ea00640 1 -- 172.21.15.40:0/2073898180 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb38003c90 con 0x7feb48102010 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.957+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb481a6510 con 0x7feb48102010 2024-07-26T12:35:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.957+0000 7feb3ea00640 1 -- 172.21.15.40:0/2073898180 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38035070 con 0x7feb48102010 2024-07-26T12:35:27.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.957+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb481accd0 con 0x7feb48102010 2024-07-26T12:35:27.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.961+0000 7feb53620740 1 Processor -- start 2024-07-26T12:35:27.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 -- start start 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a22390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a228d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55efc89eccf0 con 0x55efc8653980 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55efc8997b40 con 0x55efc865bb60 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb53620740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55efc8987040 con 0x55efc867c840 2024-07-26T12:35:27.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.962+0000 7feb3ea00640 1 -- 172.21.15.40:0/2073898180 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7feb38042030 con 0x7feb48102010 2024-07-26T12:35:27.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb46800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a22390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb45400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb46800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a22390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:49004/0 (socket says 172.21.15.40:49004) 2024-07-26T12:35:27.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb46800640 1 -- 172.21.15.40:0/2624355435 learned_addr learned my addr 172.21.15.40:0/2624355435 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:27.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb45e00640 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb45400640 1 -- 172.21.15.40:0/2624355435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 msgr2=0x55efc8a22390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.963+0000 7feb45400640 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a22390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.964+0000 7feb45400640 1 -- 172.21.15.40:0/2624355435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 msgr2=0x55efc8a228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.964+0000 7feb45400640 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.964+0000 7feb45400640 1 -- 172.21.15.40:0/2624355435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc890eaf0 con 0x55efc865bb60 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.964+0000 7feb46800640 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a22390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:35:27.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.964+0000 7feb45400640 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a22e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb4806a120 tx=0x7feb340107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f893340130800c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.965+0000 7feb33000640 1 -- 172.21.15.40:0/2624355435 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34004030 con 0x55efc865bb60 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.965+0000 7feb3ea00640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7feb2c0b3bc0 0x7feb2c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.965+0000 7feb3ea00640 1 -- 172.21.15.40:0/2073898180 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feb38104050 con 0x7feb48102010 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.965+0000 7feb33000640 1 -- 172.21.15.40:0/2624355435 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb340035f0 con 0x55efc865bb60 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.965+0000 7feb33000640 1 -- 172.21.15.40:0/2624355435 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb340116a0 con 0x55efc865bb60 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.965+0000 7feb46800640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7feb2c0b3bc0 0x7feb2c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 -- 172.21.15.40:0/2624355435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 msgr2=0x55efc8a22e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a22e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb4806a120 tx=0x7feb340107a0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb46800640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7feb2c0b3bc0 0x7feb2c0b60d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb40005f40 tx=0x7feb40009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 -- 172.21.15.40:0/2624355435 shutdown_connections 2024-07-26T12:35:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a22e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 --2- 172.21.15.40:0/2624355435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a22390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 -- 172.21.15.40:0/2624355435 >> 172.21.15.40:0/2624355435 conn(0x55efc8670990 msgr2=0x55efc8a20280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.966+0000 7feb53620740 1 -- 172.21.15.40:0/2624355435 shutdown_connections 2024-07-26T12:35:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.967+0000 7feb53620740 1 -- 172.21.15.40:0/2624355435 wait complete. 2024-07-26T12:35:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.967+0000 7feb53620740 1 -- start start 2024-07-26T12:35:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 Processor -- start 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a2dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a2e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a39ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55efc8923500 con 0x55efc8653980 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55efc898b080 con 0x55efc865bb60 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55efc87ea7a0 con 0x55efc867c840 2024-07-26T12:35:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb53620740 10 client.0 _ll_register_callbacks cb 0x55efc897fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.968+0000 7feb45e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a2dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a2dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50246/0 (socket says 172.21.15.40:50246) 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 -- 172.21.15.40:0/3759482833 learned_addr learned my addr 172.21.15.40:0/3759482833 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45400640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a2e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb46800640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a39ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 -- 172.21.15.40:0/3759482833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 msgr2=0x55efc8a39ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a39ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 -- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 msgr2=0x55efc8a2e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a2e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.969+0000 7feb45e00640 1 -- 172.21.15.40:0/3759482833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc86f6b90 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.970+0000 7feb45e00640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a2dc00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feb380c70d0 tx=0x7feb38031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92645a942b5e4c7c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.970+0000 7feb27400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.970+0000 7feb27400640 1 -- 172.21.15.40:0/3759482833 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38049040 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.970+0000 7feb27400640 1 -- 172.21.15.40:0/3759482833 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feb38106070 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.970+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb340035f0 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.971+0000 7feb27400640 1 -- 172.21.15.40:0/3759482833 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feb380c6f10 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.971+0000 7feb53620740 10 client.15957 fetch_fsmap learned FSMap version 35 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.971+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55efc8a3c8b0 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.971+0000 7feb27400640 1 -- 172.21.15.40:0/3759482833 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb340035f0 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.971+0000 7feb27400640 1 -- 172.21.15.40:0/3759482833 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7feb380d3bc0 con 0x55efc8653980 2024-07-26T12:35:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.972+0000 7feb53620740 10 client.15957 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.972+0000 7feb53620740 10 client.15957 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.972+0000 7feb53620740 20 client.15957 populate_metadata read hostname 'smithi040' 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.972+0000 7feb53620740 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc863b1c0 0x55efc8a3fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.972+0000 7feb53620740 4 client.15957 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.972+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efc8999a90 con 0x55efc863b1c0 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.973+0000 7feb45400640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc863b1c0 0x55efc8a3fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.974+0000 7feb45400640 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc863b1c0 0x55efc8a3fcf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caa2ee98733461ed server_cookie=53eba711589d9c3d in_seq=0 out_seq=0 2024-07-26T12:35:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.974+0000 7feb27400640 10 client.15957 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:27.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb27400640 1 -- 172.21.15.40:0/3759482833 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efc8999a90 con 0x55efc863b1c0 2024-07-26T12:35:27.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb27400640 10 client.15957 handle_command_reply: tid=0 2024-07-26T12:35:27.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 client.15957 shutdown 2024-07-26T12:35:27.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 msgr2=0x55efc8a2dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a2dc00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feb380c70d0 tx=0x7feb38031970 comp rx=0 tx=0).stop 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 shutdown_connections 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc867c840 0x55efc8a39ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc865bb60 0x55efc8a2e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc863b1c0 0x55efc8a3fcf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 --2- 172.21.15.40:0/3759482833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc8653980 0x55efc8a2dc00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.976+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 >> 172.21.15.40:0/3759482833 conn(0x55efc8670990 msgr2=0x55efc8a25520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.977+0000 7feb27400640 0 client.15957 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.977+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 shutdown_connections 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.977+0000 7feb53620740 1 -- 172.21.15.40:0/3759482833 wait complete. 2024-07-26T12:35:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:27.977+0000 7feb53620740 20 client.15957 trim_cache size 0 max 16384 2024-07-26T12:35:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 Processor -- start 2024-07-26T12:35:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 -- start start 2024-07-26T12:35:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a2f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a2d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a2d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feb481b52c0 con 0x55efc867c840 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feb481b6e00 con 0x55efc8653980 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.000+0000 7feb53620740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feb481b5990 con 0x55efc865bb60 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.001+0000 7feb46800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a2d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.001+0000 7feb46800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a2d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50250/0 (socket says 172.21.15.40:50250) 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.001+0000 7feb46800640 1 -- 172.21.15.40:0/56745208 learned_addr learned my addr 172.21.15.40:0/56745208 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.001+0000 7feb45e00640 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.001+0000 7feb45400640 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a2d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb46800640 1 -- 172.21.15.40:0/56745208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 msgr2=0x55efc8a2d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb46800640 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a2d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb46800640 1 -- 172.21.15.40:0/56745208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 msgr2=0x55efc8a2f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb46800640 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a2f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb46800640 1 -- 172.21.15.40:0/56745208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc8a2eec0 con 0x55efc867c840 2024-07-26T12:35:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb46800640 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a2d9d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7feb40003bb0 tx=0x7feb40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabfd36404a2033e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.002+0000 7feb32600640 1 -- 172.21.15.40:0/56745208 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40004b20 con 0x55efc867c840 2024-07-26T12:35:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.003+0000 7feb32600640 1 -- 172.21.15.40:0/56745208 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb40011dd0 con 0x55efc867c840 2024-07-26T12:35:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.003+0000 7feb32600640 1 -- 172.21.15.40:0/56745208 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40004700 con 0x55efc867c840 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 -- 172.21.15.40:0/56745208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 msgr2=0x55efc8a2d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a2d9d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7feb40003bb0 tx=0x7feb40016000 comp rx=0 tx=0).stop 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 -- 172.21.15.40:0/56745208 shutdown_connections 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a2d9d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a2d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 --2- 172.21.15.40:0/56745208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 -- 172.21.15.40:0/56745208 >> 172.21.15.40:0/56745208 conn(0x55efc8670990 msgr2=0x55efc8a2f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 -- 172.21.15.40:0/56745208 shutdown_connections 2024-07-26T12:35:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.004+0000 7feb53620740 1 -- 172.21.15.40:0/56745208 wait complete. 2024-07-26T12:35:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.005+0000 7feb53620740 1 -- start start 2024-07-26T12:35:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.005+0000 7feb53620740 1 Processor -- start 2024-07-26T12:35:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a36240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a31c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feb481b6730 con 0x55efc867c840 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feb481b6060 con 0x55efc8653980 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feb481b3280 con 0x55efc865bb60 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb53620740 10 client.0 _ll_register_callbacks cb 0x7feb381077c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb46800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a31c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb46800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a31c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50256/0 (socket says 172.21.15.40:50256) 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb46800640 1 -- 172.21.15.40:0/1876356458 learned_addr learned my addr 172.21.15.40:0/1876356458 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb45e00640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a36240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.006+0000 7feb45400640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb46800640 1 -- 172.21.15.40:0/1876356458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 msgr2=0x55efc8a316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb46800640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb46800640 1 -- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 msgr2=0x55efc8a36240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb46800640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a36240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb46800640 1 -- 172.21.15.40:0/1876356458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc8a32320 con 0x55efc867c840 2024-07-26T12:35:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb46800640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a31c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7feb40005f10 tx=0x7feb40004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b6d454bd819e12 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.007+0000 7feb27400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:35:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb27400640 1 -- 172.21.15.40:0/1876356458 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400041f0 con 0x55efc867c840 2024-07-26T12:35:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb40011dd0 con 0x55efc867c840 2024-07-26T12:35:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb27400640 1 -- 172.21.15.40:0/1876356458 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feb40025040 con 0x55efc867c840 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb27400640 1 -- 172.21.15.40:0/1876356458 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feb40004390 con 0x55efc867c840 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb53620740 10 client.15963 fetch_fsmap learned FSMap version 35 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55efc8aa82c0 con 0x55efc867c840 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.008+0000 7feb27400640 1 -- 172.21.15.40:0/1876356458 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb40011dd0 con 0x55efc867c840 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb27400640 1 -- 172.21.15.40:0/1876356458 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7feb4000f040 con 0x55efc867c840 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb53620740 10 client.15963 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb53620740 10 client.15963 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb53620740 20 client.15963 populate_metadata read hostname 'smithi040' 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb53620740 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc8610570 0x55efc8aaaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb53620740 4 client.15963 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}] 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.009+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}) -- 0x55efc8995530 con 0x55efc8610570 2024-07-26T12:35:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.010+0000 7feb45e00640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc8610570 0x55efc8aaaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.011+0000 7feb45e00640 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc8610570 0x55efc8aaaa80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42090064b1ced4e2 server_cookie=755b630eb01d0ff6 in_seq=0 out_seq=0 2024-07-26T12:35:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.011+0000 7feb27400640 10 client.15963 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.268+0000 7feb27400640 1 -- 172.21.15.40:0/1876356458 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55efc8995530 con 0x55efc8610570 2024-07-26T12:35:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.268+0000 7feb27400640 10 client.15963 handle_command_reply: tid=0 2024-07-26T12:35:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.268+0000 7feb53620740 1 client.15963 shutdown 2024-07-26T12:35:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.268+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 msgr2=0x55efc8a31c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.268+0000 7feb53620740 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a31c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7feb40005f10 tx=0x7feb40004ce0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 shutdown_connections 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efc8610570 0x55efc8aaaa80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efc867c840 0x55efc8a31c30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efc865bb60 0x55efc8a316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 --2- 172.21.15.40:0/1876356458 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efc8653980 0x55efc8a36240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 >> 172.21.15.40:0/1876356458 conn(0x55efc8670990 msgr2=0x55efc8a2fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb27400640 0 client.15963 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:28.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 shutdown_connections 2024-07-26T12:35:28.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 1 -- 172.21.15.40:0/1876356458 wait complete. 2024-07-26T12:35:28.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.269+0000 7feb53620740 20 client.15963 trim_cache size 0 max 16384 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 42, 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "1209e4eb": { 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 42, 2024-07-26T12:35:28.273 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 144.2, 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:28.274 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7feb2c0b3bc0 msgr2=0x7feb2c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7feb2c0b3bc0 0x7feb2c0b60d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb40005f40 tx=0x7feb40009600 comp rx=0 tx=0).stop 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 msgr2=0x7feb481a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:28.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb481a0310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feb38005940 tx=0x7feb380042f0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 shutdown_connections 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7feb2c0b3bc0 0x7feb2c0b60d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb48107450 0x7feb481a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb48102960 0x7feb481a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 --2- 172.21.15.40:0/2073898180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb48102010 0x7feb481a0310 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.271+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 >> 172.21.15.40:0/2073898180 conn(0x7feb480fdd60 msgr2=0x7feb48104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.272+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 shutdown_connections 2024-07-26T12:35:28.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:28.272+0000 7feb47200640 1 -- 172.21.15.40:0/2073898180 wait complete. 2024-07-26T12:35:29.095 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1209e4eb', quiesce took 7.9 seconds. Will release after: 16.299999999999997 2024-07-26T12:35:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:29 smithi040 ceph-mon[32397]: pgmap v897: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-07-26T12:35:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:29 smithi146 ceph-mon[35807]: pgmap v897: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-07-26T12:35:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:29 smithi076 ceph-mon[35401]: pgmap v897: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-07-26T12:35:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:31 smithi146 ceph-mon[35807]: pgmap v898: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-07-26T12:35:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:31 smithi076 ceph-mon[35401]: pgmap v898: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-07-26T12:35:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:31 smithi040 ceph-mon[32397]: pgmap v898: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-07-26T12:35:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:33 smithi040 ceph-mon[32397]: pgmap v899: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:35:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:33 smithi146 ceph-mon[35807]: pgmap v899: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:35:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:33 smithi076 ceph-mon[35401]: pgmap v899: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:35:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:35 smithi146 ceph-mon[35807]: pgmap v900: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T12:35:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:35 smithi076 ceph-mon[35401]: pgmap v900: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T12:35:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:35 smithi040 ceph-mon[32397]: pgmap v900: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T12:35:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:37 smithi146 ceph-mon[35807]: pgmap v901: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:35:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:37 smithi076 ceph-mon[35401]: pgmap v901: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:35:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:37 smithi040 ceph-mon[32397]: pgmap v901: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:35:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:39 smithi146 ceph-mon[35807]: pgmap v902: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:35:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:39 smithi076 ceph-mon[35401]: pgmap v902: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:35:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:39 smithi040 ceph-mon[32397]: pgmap v902: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:35:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:41 smithi146 ceph-mon[35807]: pgmap v903: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-07-26T12:35:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:41 smithi076 ceph-mon[35401]: pgmap v903: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-07-26T12:35:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:41 smithi040 ceph-mon[32397]: pgmap v903: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.8 MiB/s wr, 13 op/s 2024-07-26T12:35:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:43 smithi146 ceph-mon[35807]: pgmap v904: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:35:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:43 smithi076 ceph-mon[35401]: pgmap v904: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:35:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:43 smithi040 ceph-mon[32397]: pgmap v904: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:35:45.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:35:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:45 smithi040 ceph-mon[32397]: pgmap v905: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 462 KiB/s wr, 12 op/s 2024-07-26T12:35:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:45 smithi146 ceph-mon[35807]: pgmap v905: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 462 KiB/s wr, 12 op/s 2024-07-26T12:35:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:45 smithi076 ceph-mon[35401]: pgmap v905: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 462 KiB/s wr, 12 op/s 2024-07-26T12:35:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:35:47.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:47 smithi040 ceph-mon[32397]: pgmap v906: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 461 KiB/s wr, 8 op/s 2024-07-26T12:35:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:47 smithi146 ceph-mon[35807]: pgmap v906: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 461 KiB/s wr, 8 op/s 2024-07-26T12:35:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:47 smithi076 ceph-mon[35401]: pgmap v906: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 461 KiB/s wr, 8 op/s 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 -- 172.21.15.40:0/3862848739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64810f330 msgr2=0x7fe64810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 --2- 172.21.15.40:0/3862848739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64810f330 0x7fe64810f740 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe630009ca0 tx=0x7fe63002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 -- 172.21.15.40:0/3862848739 shutdown_connections 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 --2- 172.21.15.40:0/3862848739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810fc80 0x7fe6481164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 --2- 172.21.15.40:0/3862848739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64810f330 0x7fe64810f740 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 --2- 172.21.15.40:0/3862848739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6481099f0 0x7fe648109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 -- 172.21.15.40:0/3862848739 >> 172.21.15.40:0/3862848739 conn(0x7fe648078ff0 msgr2=0x7fe648107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 -- 172.21.15.40:0/3862848739 shutdown_connections 2024-07-26T12:35:47.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.996+0000 7fe64ca00640 1 -- 172.21.15.40:0/3862848739 wait complete. 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.997+0000 7fe64ca00640 1 Processor -- start 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.997+0000 7fe64ca00640 1 -- start start 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe64ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 0x7fe6481a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe64ca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810f330 0x7fe6481a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe64ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe64810fc80 0x7fe6481a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe64ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe648119840 con 0x7fe6481099f0 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe64ca00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481196c0 con 0x7fe64810f330 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe64ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481199c0 con 0x7fe64810fc80 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe646800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 0x7fe6481a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe646800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 0x7fe6481a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55278/0 (socket says 172.21.15.40:55278) 2024-07-26T12:35:48.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe646800640 1 -- 172.21.15.40:0/2100089201 learned_addr learned my addr 172.21.15.40:0/2100089201 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe63de00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810f330 0x7fe6481a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.998+0000 7fe647200640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe64810fc80 0x7fe6481a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe646800640 1 -- 172.21.15.40:0/2100089201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe64810fc80 msgr2=0x7fe6481a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe646800640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe64810fc80 0x7fe6481a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe646800640 1 -- 172.21.15.40:0/2100089201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810f330 msgr2=0x7fe6481a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe646800640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810f330 0x7fe6481a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe646800640 1 -- 172.21.15.40:0/2100089201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6481a6220 con 0x7fe6481099f0 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe647200640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe64810fc80 0x7fe6481a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:48.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe63de00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810f330 0x7fe6481a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:48.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:47.999+0000 7fe646800640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 0x7fe6481a02b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe63800d770 tx=0x7fe63800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:48.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.000+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638017070 con 0x7fe6481099f0 2024-07-26T12:35:48.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.000+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6481a6510 con 0x7fe6481099f0 2024-07-26T12:35:48.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.000+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6380054b0 con 0x7fe6481099f0 2024-07-26T12:35:48.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.000+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638004c60 con 0x7fe6481099f0 2024-07-26T12:35:48.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.000+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6481acc70 con 0x7fe6481099f0 2024-07-26T12:35:48.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.001+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe648109e00 con 0x7fe6481099f0 2024-07-26T12:35:48.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.004+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe638004e00 con 0x7fe6481099f0 2024-07-26T12:35:48.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.005+0000 7fe63fe00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe62c0b3bd0 0x7fe62c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:48.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.005+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6380e3b00 con 0x7fe6481099f0 2024-07-26T12:35:48.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.005+0000 7fe63de00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe62c0b3bd0 0x7fe62c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:48.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.006+0000 7fe63de00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe62c0b3bd0 0x7fe62c0b60e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe630006010 tx=0x7fe6300314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:48.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.007+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe6380ab110 con 0x7fe6481099f0 2024-07-26T12:35:48.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.256+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6481a13e0 con 0x7fe6481099f0 2024-07-26T12:35:48.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.257+0000 7fe63fe00640 1 -- 172.21.15.40:0/2100089201 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fe6481a13e0 con 0x7fe6481099f0 2024-07-26T12:35:48.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:35:48.260 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:35:48.260 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:35:48.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.260+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe62c0b3bd0 msgr2=0x7fe62c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:48.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.260+0000 7fe64ca00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe62c0b3bd0 0x7fe62c0b60e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe630006010 tx=0x7fe6300314d0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.260+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 msgr2=0x7fe6481a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:48.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.260+0000 7fe64ca00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 0x7fe6481a02b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe63800d770 tx=0x7fe63800dc30 comp rx=0 tx=0).stop 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 shutdown_connections 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe62c0b3bd0 0x7fe62c0b60e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe64810fc80 0x7fe6481a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe64810f330 0x7fe6481a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 --2- 172.21.15.40:0/2100089201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6481099f0 0x7fe6481a02b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 >> 172.21.15.40:0/2100089201 conn(0x7fe648078ff0 msgr2=0x7fe648108090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 shutdown_connections 2024-07-26T12:35:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:48.261+0000 7fe64ca00640 1 -- 172.21.15.40:0/2100089201 wait complete. 2024-07-26T12:35:48.808 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:48 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2100089201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:48 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2100089201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:48 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2100089201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:35:49.238 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 1209e4eb --release --await' 2024-07-26T12:35:49.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 1209e4eb --release --await 2024-07-26T12:35:49.715 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:35:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:49 smithi146 ceph-mon[35807]: pgmap v907: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 120 KiB/s wr, 10 op/s 2024-07-26T12:35:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:49 smithi076 ceph-mon[35401]: pgmap v907: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 120 KiB/s wr, 10 op/s 2024-07-26T12:35:49.871 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:49 smithi040 ceph-mon[32397]: pgmap v907: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 120 KiB/s wr, 10 op/s 2024-07-26T12:35:51.663 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:51 smithi040 ceph-mon[32397]: pgmap v908: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:35:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:51 smithi146 ceph-mon[35807]: pgmap v908: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:35:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:51 smithi076 ceph-mon[35401]: pgmap v908: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:35:51.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.884+0000 7f38b8a00640 1 -- 172.21.15.40:0/2832661067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 msgr2=0x7f38b4109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.884+0000 7f38b8a00640 1 --2- 172.21.15.40:0/2832661067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b4109e00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009900 tx=0x7f38a402a410 comp rx=0 tx=0).stop 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 -- 172.21.15.40:0/2832661067 shutdown_connections 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 --2- 172.21.15.40:0/2832661067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b410fc80 0x7f38b41164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 --2- 172.21.15.40:0/2832661067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38b410f330 0x7f38b410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 --2- 172.21.15.40:0/2832661067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b4109e00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 -- 172.21.15.40:0/2832661067 >> 172.21.15.40:0/2832661067 conn(0x7f38b4078ff0 msgr2=0x7f38b4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 -- 172.21.15.40:0/2832661067 shutdown_connections 2024-07-26T12:35:51.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.885+0000 7f38b8a00640 1 -- 172.21.15.40:0/2832661067 wait complete. 2024-07-26T12:35:51.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 Processor -- start 2024-07-26T12:35:51.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 -- start start 2024-07-26T12:35:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b41a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38b410f330 0x7f38b41a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b410fc80 0x7f38b41a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4119840 con 0x7f38b41099f0 2024-07-26T12:35:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41196c0 con 0x7f38b410f330 2024-07-26T12:35:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b8a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41199c0 con 0x7f38b410fc80 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.887+0000 7f38b2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b41a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b41a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55302/0 (socket says 172.21.15.40:55302) 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 -- 172.21.15.40:0/4151183898 learned_addr learned my addr 172.21.15.40:0/4151183898 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b1e00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38b410f330 0x7f38b41a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b3200640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b410fc80 0x7f38b41a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 -- 172.21.15.40:0/4151183898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b410fc80 msgr2=0x7f38b41a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b410fc80 0x7f38b41a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 -- 172.21.15.40:0/4151183898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38b410f330 msgr2=0x7f38b41a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38b410f330 0x7f38b41a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.888+0000 7f38b2800640 1 -- 172.21.15.40:0/4151183898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b41a61e0 con 0x7f38b41099f0 2024-07-26T12:35:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.889+0000 7f38b2800640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b41a0270 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f38a402a930 tx=0x7f38a4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.889+0000 7f38ab400640 1 -- 172.21.15.40:0/4151183898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a403f070 con 0x7f38b41099f0 2024-07-26T12:35:51.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.889+0000 7f38ab400640 1 -- 172.21.15.40:0/4151183898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38a4003e40 con 0x7f38b41099f0 2024-07-26T12:35:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.889+0000 7f38ab400640 1 -- 172.21.15.40:0/4151183898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4035030 con 0x7f38b41099f0 2024-07-26T12:35:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.889+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b41a6470 con 0x7f38b41099f0 2024-07-26T12:35:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.889+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b41acc30 con 0x7f38b41099f0 2024-07-26T12:35:51.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38ab400640 1 -- 172.21.15.40:0/4151183898 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f38a4042070 con 0x7f38b41099f0 2024-07-26T12:35:51.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 Processor -- start 2024-07-26T12:35:51.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 -- start start 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 0x55baad0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacce0840 0x55baad0a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55baad01cf30 con 0x55baacd01520 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55baad00c430 con 0x55baacce0840 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.894+0000 7f38c01f3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55baad010470 con 0x55baaccd8660 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 0x55baad0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 0x55baad0a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55314/0 (socket says 172.21.15.40:55314) 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b3200640 1 -- 172.21.15.40:0/1721388235 learned_addr learned my addr 172.21.15.40:0/1721388235 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b2800640 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b1e00640 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacce0840 0x55baad0a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b3200640 1 -- 172.21.15.40:0/1721388235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 msgr2=0x55baad0a66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.895+0000 7f38b3200640 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0a66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38b3200640 1 -- 172.21.15.40:0/1721388235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacce0840 msgr2=0x55baad0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38b3200640 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacce0840 0x55baad0a6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38b3200640 1 -- 172.21.15.40:0/1721388235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baacd6cb00 con 0x55baacd01520 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38b1e00640 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacce0840 0x55baad0a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38ab400640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38980b3c50 0x7f38980b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38b3200640 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 0x55baad0a6180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009ee0 tx=0x7f38ac010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a7b30f7d1d691e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38ab400640 1 -- 172.21.15.40:0/4151183898 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f38a4104470 con 0x7f38b41099f0 2024-07-26T12:35:51.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.896+0000 7f38b2800640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38980b3c50 0x7f38980b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.897+0000 7f389f400640 1 -- 172.21.15.40:0/1721388235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac016070 con 0x55baacd01520 2024-07-26T12:35:51.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.897+0000 7f389f400640 1 -- 172.21.15.40:0/1721388235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38ac004d20 con 0x55baacd01520 2024-07-26T12:35:51.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.897+0000 7f389f400640 1 -- 172.21.15.40:0/1721388235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac012650 con 0x55baacd01520 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 -- 172.21.15.40:0/1721388235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 msgr2=0x55baad0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 0x55baad0a6180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009ee0 tx=0x7f38ac010740 comp rx=0 tx=0).stop 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38b2800640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38980b3c50 0x7f38980b6160 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38a40c7400 tx=0x7f38a4005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 -- 172.21.15.40:0/1721388235 shutdown_connections 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacce0840 0x55baad0a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0a66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1721388235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacd01520 0x55baad0a6180 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 -- 172.21.15.40:0/1721388235 >> 172.21.15.40:0/1721388235 conn(0x55baaccf5910 msgr2=0x55baad0a4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 -- 172.21.15.40:0/1721388235 shutdown_connections 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.898+0000 7f38c01f3740 1 -- 172.21.15.40:0/1721388235 wait complete. 2024-07-26T12:35:51.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 -- start start 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 Processor -- start 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 0x55baad0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacce0840 0x55baad0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0bdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55baace6fbb0 con 0x55baaccd8660 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55baacfa8910 con 0x55baacd01520 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.899+0000 7f38c01f3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55baad0b49b0 con 0x55baacce0840 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38c01f3740 10 client.0 _ll_register_callbacks cb 0x55baacd18d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 0x55baad0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 0x55baad0b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55318/0 (socket says 172.21.15.40:55318) 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 -- 172.21.15.40:0/1327694717 learned_addr learned my addr 172.21.15.40:0/1327694717 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b1e00640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacce0840 0x55baad0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0bdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 -- 172.21.15.40:0/1327694717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacce0840 msgr2=0x55baad0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacce0840 0x55baad0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 -- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 msgr2=0x55baad0bdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0bdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.900+0000 7f38b3200640 1 -- 172.21.15.40:0/1327694717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baacde3960 con 0x55baaccd8660 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.901+0000 7f38b1e00640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacce0840 0x55baad0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.901+0000 7f38b3200640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 0x55baad0b1860 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38ac005a20 tx=0x7f38ac005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a751e1b54448c4e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.901+0000 7f3893e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.901+0000 7f3893e00640 1 -- 172.21.15.40:0/1327694717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac016070 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.901+0000 7f3893e00640 1 -- 172.21.15.40:0/1327694717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f38ac005390 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.901+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38ac004d20 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f3893e00640 1 -- 172.21.15.40:0/1327694717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f38ac005590 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 10 client.15981 fetch_fsmap learned FSMap version 35 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55baad0c06f0 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f3893e00640 1 -- 172.21.15.40:0/1327694717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38ac004d20 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f3893e00640 1 -- 172.21.15.40:0/1327694717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f38ac00f040 con 0x55baaccd8660 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 10 client.15981 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 10 client.15981 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 20 client.15981 populate_metadata read hostname 'smithi040' 2024-07-26T12:35:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baaccbfea0 0x55baad0c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 4 client.15981 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:35:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.902+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baad01ee80 con 0x55baaccbfea0 2024-07-26T12:35:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.903+0000 7f38b1e00640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baaccbfea0 0x55baad0c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.904+0000 7f38b1e00640 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baaccbfea0 0x55baad0c3a50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff80fe08dd4be1d2 server_cookie=db362d3d96d33f45 in_seq=0 out_seq=0 2024-07-26T12:35:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.904+0000 7f3893e00640 10 client.15981 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f3893e00640 1 -- 172.21.15.40:0/1327694717 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55baad01ee80 con 0x55baaccbfea0 2024-07-26T12:35:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f3893e00640 10 client.15981 handle_command_reply: tid=0 2024-07-26T12:35:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 client.15981 shutdown 2024-07-26T12:35:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 msgr2=0x55baad0b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 0x55baad0b1860 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38ac005a20 tx=0x7f38ac005920 comp rx=0 tx=0).stop 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 shutdown_connections 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0bdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacce0840 0x55baad0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baaccbfea0 0x55baad0c3a50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 --2- 172.21.15.40:0/1327694717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baaccd8660 0x55baad0b1860 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 >> 172.21.15.40:0/1327694717 conn(0x55baaccf5910 msgr2=0x55baad0a71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f3893e00640 0 client.15981 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 shutdown_connections 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 1 -- 172.21.15.40:0/1327694717 wait complete. 2024-07-26T12:35:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.907+0000 7f38c01f3740 20 client.15981 trim_cache size 0 max 16384 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 Processor -- start 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 -- start start 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0be000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b5270 con 0x55baacce0840 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b6db0 con 0x55baacd01520 2024-07-26T12:35:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.926+0000 7f38c01f3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b5940 con 0x55baaccd8660 2024-07-26T12:35:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.927+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.927+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0bdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55328/0 (socket says 172.21.15.40:55328) 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.927+0000 7f38b3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.927+0000 7f38b1e00640 1 -- 172.21.15.40:0/4041127274 learned_addr learned my addr 172.21.15.40:0/4041127274 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.927+0000 7f38b3200640 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f38b1e00640 1 -- 172.21.15.40:0/4041127274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 msgr2=0x55baad0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f38b1e00640 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f38b1e00640 1 -- 172.21.15.40:0/4041127274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 msgr2=0x55baad0be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f38b1e00640 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f38b1e00640 1 -- 172.21.15.40:0/4041127274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baad0b2b20 con 0x55baacce0840 2024-07-26T12:35:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f38b1e00640 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0bdac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f38a0005d80 tx=0x7f38a0005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ff66a64d6079b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.928+0000 7f389ea00640 1 -- 172.21.15.40:0/4041127274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0014c90 con 0x55baacce0840 2024-07-26T12:35:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.929+0000 7f389ea00640 1 -- 172.21.15.40:0/4041127274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38a0014e30 con 0x55baacce0840 2024-07-26T12:35:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.929+0000 7f389ea00640 1 -- 172.21.15.40:0/4041127274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00035f0 con 0x55baacce0840 2024-07-26T12:35:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.929+0000 7f38c01f3740 1 -- 172.21.15.40:0/4041127274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 msgr2=0x55baad0bdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.929+0000 7f38c01f3740 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0bdac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f38a0005d80 tx=0x7f38a0005c70 comp rx=0 tx=0).stop 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 -- 172.21.15.40:0/4041127274 shutdown_connections 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baacd01520 0x55baad0be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0bdac0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 --2- 172.21.15.40:0/4041127274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baaccd8660 0x55baad0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 -- 172.21.15.40:0/4041127274 >> 172.21.15.40:0/4041127274 conn(0x55baaccf5910 msgr2=0x55baad0a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 -- 172.21.15.40:0/4041127274 shutdown_connections 2024-07-26T12:35:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.930+0000 7f38c01f3740 1 -- 172.21.15.40:0/4041127274 wait complete. 2024-07-26T12:35:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.931+0000 7f38c01f3740 1 -- start start 2024-07-26T12:35:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.931+0000 7f38c01f3740 1 Processor -- start 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.931+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baaccd8660 0x55baad0b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38c01f3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacd01520 0x55baad125150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38c01f3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b66e0 con 0x55baacce0840 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38c01f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b6010 con 0x55baaccd8660 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38c01f3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b3230 con 0x55baacd01520 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38c01f3740 10 client.0 _ll_register_callbacks cb 0x7f38ac009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38b1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55332/0 (socket says 172.21.15.40:55332) 2024-07-26T12:35:51.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38b1e00640 1 -- 172.21.15.40:0/3463180464 learned_addr learned my addr 172.21.15.40:0/3463180464 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:35:51.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38b3200640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baaccd8660 0x55baad0b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.932+0000 7f38b3200640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacd01520 0x55baad125150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38b1e00640 1 -- 172.21.15.40:0/3463180464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacd01520 msgr2=0x55baad125150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38b1e00640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacd01520 0x55baad125150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38b1e00640 1 -- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baaccd8660 msgr2=0x55baad0b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:35:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38b1e00640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baaccd8660 0x55baad0b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38b1e00640 1 -- 172.21.15.40:0/3463180464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baad1257c0 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38b1e00640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0b6b90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0014d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90501547b20c1cbd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f3893e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f3893e00640 1 -- 172.21.15.40:0/3463180464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0014310 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f3893e00640 1 -- 172.21.15.40:0/3463180464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f38a0004030 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.933+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a0014e30 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f3893e00640 1 -- 172.21.15.40:0/3463180464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f38a0011b00 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 10 client.15987 fetch_fsmap learned FSMap version 35 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55baad12cbf0 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f3893e00640 1 -- 172.21.15.40:0/3463180464 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38a0014e30 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f3893e00640 1 -- 172.21.15.40:0/3463180464 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f38a002b020 con 0x55baacce0840 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 10 client.15987 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 10 client.15987 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:35:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 20 client.15987 populate_metadata read hostname 'smithi040' 2024-07-26T12:35:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baacc95250 0x55baad12f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:35:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 4 client.15987 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1209e4eb", "release": true, "await": true}] 2024-07-26T12:35:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.934+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1209e4eb", "release": true, "await": true}) -- 0x55baad01a920 con 0x55baacc95250 2024-07-26T12:35:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.935+0000 7f38b3200640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baacc95250 0x55baad12f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:35:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.936+0000 7f38b3200640 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baacc95250 0x55baad12f320 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d76e85ebd6ed0e server_cookie=17dd9336c8620d08 in_seq=0 out_seq=0 2024-07-26T12:35:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.936+0000 7f3893e00640 10 client.15987 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:51.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.991+0000 7f3893e00640 1 -- 172.21.15.40:0/3463180464 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55baad01a920 con 0x55baacc95250 2024-07-26T12:35:51.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.991+0000 7f3893e00640 10 client.15987 handle_command_reply: tid=0 2024-07-26T12:35:51.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.991+0000 7f38c01f3740 1 client.15987 shutdown 2024-07-26T12:35:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 msgr2=0x55baad0b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0b6b90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0014d10 comp rx=0 tx=0).stop 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 shutdown_connections 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baacd01520 0x55baad125150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55baacc95250 0x55baad12f320 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55baacce0840 0x55baad0b6b90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 --2- 172.21.15.40:0/3463180464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55baaccd8660 0x55baad0b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 >> 172.21.15.40:0/3463180464 conn(0x55baaccf5910 msgr2=0x55baad0b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f3893e00640 0 client.15987 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.992+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 shutdown_connections 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.993+0000 7f38c01f3740 1 -- 172.21.15.40:0/3463180464 wait complete. 2024-07-26T12:35:51.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.993+0000 7f38c01f3740 20 client.15987 trim_cache size 0 max 16384 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 44, 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "1209e4eb": { 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 44, 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:35:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 144.2, 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38980b3c50 msgr2=0x7f38980b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38980b3c50 0x7f38980b6160 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38a40c7400 tx=0x7f38a4005de0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 msgr2=0x7f38b41a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b41a0270 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f38a402a930 tx=0x7f38a4003c20 comp rx=0 tx=0).stop 2024-07-26T12:35:51.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 shutdown_connections 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38980b3c50 0x7f38980b6160 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b410fc80 0x7f38b41a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38b410f330 0x7f38b41a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 --2- 172.21.15.40:0/4151183898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38b41099f0 0x7f38b41a0270 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.994+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 >> 172.21.15.40:0/4151183898 conn(0x7f38b4078ff0 msgr2=0x7f38b4108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.995+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 shutdown_connections 2024-07-26T12:35:51.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:35:51.995+0000 7f38b8a00640 1 -- 172.21.15.40:0/4151183898 wait complete. 2024-07-26T12:35:52.904 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1209e4eb', total seconds elapsed: 31.7 2024-07-26T12:35:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:53 smithi146 ceph-mon[35807]: pgmap v909: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:35:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:53 smithi076 ceph-mon[35401]: pgmap v909: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:35:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:53 smithi040 ceph-mon[32397]: pgmap v909: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:35:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:55 smithi076 ceph-mon[35401]: pgmap v910: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-07-26T12:35:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:55 smithi040 ceph-mon[32397]: pgmap v910: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-07-26T12:35:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:55 smithi146 ceph-mon[35807]: pgmap v910: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-07-26T12:35:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:57 smithi040 ceph-mon[32397]: pgmap v911: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 KiB/s wr, 8 op/s 2024-07-26T12:35:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:57 smithi146 ceph-mon[35807]: pgmap v911: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 KiB/s wr, 8 op/s 2024-07-26T12:35:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:57 smithi076 ceph-mon[35401]: pgmap v911: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 KiB/s wr, 8 op/s 2024-07-26T12:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:35:59 smithi040 ceph-mon[32397]: pgmap v912: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 904 KiB/s wr, 10 op/s 2024-07-26T12:36:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:35:59 smithi146 ceph-mon[35807]: pgmap v912: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 904 KiB/s wr, 10 op/s 2024-07-26T12:36:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:35:59 smithi076 ceph-mon[35401]: pgmap v912: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 904 KiB/s wr, 10 op/s 2024-07-26T12:36:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:01 smithi040 ceph-mon[32397]: pgmap v913: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T12:36:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:01 smithi146 ceph-mon[35807]: pgmap v913: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T12:36:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:01 smithi076 ceph-mon[35401]: pgmap v913: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T12:36:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:03 smithi040 ceph-mon[32397]: pgmap v914: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-07-26T12:36:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:03 smithi146 ceph-mon[35807]: pgmap v914: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-07-26T12:36:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:03 smithi076 ceph-mon[35401]: pgmap v914: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-07-26T12:36:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:05 smithi040 ceph-mon[32397]: pgmap v915: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T12:36:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:05 smithi146 ceph-mon[35807]: pgmap v915: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T12:36:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:05 smithi076 ceph-mon[35401]: pgmap v915: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T12:36:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:07 smithi040 ceph-mon[32397]: pgmap v916: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.5 MiB/s wr, 9 op/s 2024-07-26T12:36:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:07 smithi146 ceph-mon[35807]: pgmap v916: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.5 MiB/s wr, 9 op/s 2024-07-26T12:36:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:07 smithi076 ceph-mon[35401]: pgmap v916: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.5 MiB/s wr, 9 op/s 2024-07-26T12:36:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:09 smithi040 ceph-mon[32397]: pgmap v917: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T12:36:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:09 smithi146 ceph-mon[35807]: pgmap v917: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T12:36:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:09 smithi076 ceph-mon[35401]: pgmap v917: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T12:36:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:11 smithi040 ceph-mon[32397]: pgmap v918: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:36:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:11 smithi146 ceph-mon[35807]: pgmap v918: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:36:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:11 smithi076 ceph-mon[35401]: pgmap v918: 97 pgs: 97 active+clean; 2.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:36:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:13 smithi040 ceph-mon[32397]: pgmap v919: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:36:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:13 smithi146 ceph-mon[35807]: pgmap v919: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:36:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:13 smithi076 ceph-mon[35401]: pgmap v919: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:36:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:36:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:36:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:15 smithi040 ceph-mon[32397]: pgmap v920: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:36:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:15 smithi146 ceph-mon[35807]: pgmap v920: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:36:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:36:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:36:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:36:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:15 smithi076 ceph-mon[35401]: pgmap v920: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:36:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:36:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:36:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:36:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:17 smithi040 ceph-mon[32397]: pgmap v921: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:36:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:17 smithi146 ceph-mon[35807]: pgmap v921: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:36:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:17 smithi076 ceph-mon[35401]: pgmap v921: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:36:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:19 smithi040 ceph-mon[32397]: pgmap v922: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:36:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:19 smithi146 ceph-mon[35807]: pgmap v922: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:36:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:19 smithi076 ceph-mon[35401]: pgmap v922: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:36:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:21 smithi040 ceph-mon[32397]: pgmap v923: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:21 smithi146 ceph-mon[35807]: pgmap v923: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:21 smithi076 ceph-mon[35401]: pgmap v923: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:23 smithi040 ceph-mon[32397]: pgmap v924: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:36:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:23 smithi146 ceph-mon[35807]: pgmap v924: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:36:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:23 smithi076 ceph-mon[35401]: pgmap v924: 97 pgs: 97 active+clean; 2.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:36:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:25 smithi040 ceph-mon[32397]: pgmap v925: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:36:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:25 smithi146 ceph-mon[35807]: pgmap v925: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:36:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:25 smithi076 ceph-mon[35401]: pgmap v925: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:36:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:27 smithi040 ceph-mon[32397]: pgmap v926: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:36:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:27 smithi146 ceph-mon[35807]: pgmap v926: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:36:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:27 smithi076 ceph-mon[35401]: pgmap v926: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:36:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:29 smithi040 ceph-mon[32397]: pgmap v927: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:36:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:29 smithi146 ceph-mon[35807]: pgmap v927: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:36:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:29 smithi076 ceph-mon[35401]: pgmap v927: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:36:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:31 smithi040 ceph-mon[32397]: pgmap v928: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:36:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:31 smithi146 ceph-mon[35807]: pgmap v928: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:36:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:31 smithi076 ceph-mon[35401]: pgmap v928: 97 pgs: 97 active+clean; 2.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:36:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:33 smithi040 ceph-mon[32397]: pgmap v929: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:36:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:33 smithi146 ceph-mon[35807]: pgmap v929: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:36:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:33 smithi076 ceph-mon[35401]: pgmap v929: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:36:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:35 smithi040 ceph-mon[32397]: pgmap v930: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:36:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:35 smithi146 ceph-mon[35807]: pgmap v930: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:36:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:35 smithi076 ceph-mon[35401]: pgmap v930: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:36:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:37 smithi040 ceph-mon[32397]: pgmap v931: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:36:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:37 smithi146 ceph-mon[35807]: pgmap v931: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:36:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:37 smithi076 ceph-mon[35401]: pgmap v931: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:36:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:39 smithi146 ceph-mon[35807]: pgmap v932: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:39 smithi076 ceph-mon[35401]: pgmap v932: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:39 smithi040 ceph-mon[32397]: pgmap v932: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:41 smithi146 ceph-mon[35807]: pgmap v933: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:36:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:41 smithi076 ceph-mon[35401]: pgmap v933: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:36:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:41 smithi040 ceph-mon[32397]: pgmap v933: 97 pgs: 97 active+clean; 2.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:36:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:43 smithi146 ceph-mon[35807]: pgmap v934: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:36:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:43 smithi076 ceph-mon[35401]: pgmap v934: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:36:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:43 smithi040 ceph-mon[32397]: pgmap v934: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:36:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:45 smithi146 ceph-mon[35807]: pgmap v935: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T12:36:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:45 smithi076 ceph-mon[35401]: pgmap v935: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T12:36:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:45 smithi040 ceph-mon[32397]: pgmap v935: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T12:36:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:47 smithi146 ceph-mon[35807]: pgmap v936: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:36:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:47 smithi076 ceph-mon[35401]: pgmap v936: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:36:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:47 smithi040 ceph-mon[32397]: pgmap v936: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:36:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:49 smithi146 ceph-mon[35807]: pgmap v937: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:36:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:49 smithi076 ceph-mon[35401]: pgmap v937: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:36:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:49 smithi040 ceph-mon[32397]: pgmap v937: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:36:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:51 smithi146 ceph-mon[35807]: pgmap v938: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:36:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:51 smithi076 ceph-mon[35401]: pgmap v938: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:36:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:51 smithi040 ceph-mon[32397]: pgmap v938: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:36:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:53 smithi146 ceph-mon[35807]: pgmap v939: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:36:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:53 smithi076 ceph-mon[35401]: pgmap v939: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:36:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:53 smithi040 ceph-mon[32397]: pgmap v939: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:36:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:55 smithi146 ceph-mon[35807]: pgmap v940: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:55 smithi076 ceph-mon[35401]: pgmap v940: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:55 smithi040 ceph-mon[32397]: pgmap v940: 97 pgs: 97 active+clean; 2.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:36:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:57 smithi146 ceph-mon[35807]: pgmap v941: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:36:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:57 smithi076 ceph-mon[35401]: pgmap v941: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:36:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:57 smithi040 ceph-mon[32397]: pgmap v941: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:37:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:36:59 smithi146 ceph-mon[35807]: pgmap v942: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:37:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:36:59 smithi076 ceph-mon[35401]: pgmap v942: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:37:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:36:59 smithi040 ceph-mon[32397]: pgmap v942: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:37:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:01 smithi146 ceph-mon[35807]: pgmap v943: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:37:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:01 smithi076 ceph-mon[35401]: pgmap v943: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:37:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:01 smithi040 ceph-mon[32397]: pgmap v943: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:37:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:03 smithi146 ceph-mon[35807]: pgmap v944: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:37:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:03 smithi076 ceph-mon[35401]: pgmap v944: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:37:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:03 smithi040 ceph-mon[32397]: pgmap v944: 97 pgs: 97 active+clean; 2.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:37:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:04 smithi040 ceph-mon[32397]: pgmap v945: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:37:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:04 smithi146 ceph-mon[35807]: pgmap v945: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:37:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:04 smithi076 ceph-mon[35401]: pgmap v945: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:37:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:07 smithi146 ceph-mon[35807]: pgmap v946: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:37:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:07 smithi076 ceph-mon[35401]: pgmap v946: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:37:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:07 smithi040 ceph-mon[32397]: pgmap v946: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:37:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:09 smithi146 ceph-mon[35807]: pgmap v947: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:37:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:09 smithi076 ceph-mon[35401]: pgmap v947: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:37:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:09 smithi040 ceph-mon[32397]: pgmap v947: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:37:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:11 smithi146 ceph-mon[35807]: pgmap v948: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:37:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:11 smithi076 ceph-mon[35401]: pgmap v948: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:37:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:11 smithi040 ceph-mon[32397]: pgmap v948: 97 pgs: 97 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:37:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:13 smithi146 ceph-mon[35807]: pgmap v949: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:13 smithi076 ceph-mon[35401]: pgmap v949: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:13 smithi040 ceph-mon[32397]: pgmap v949: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:15 smithi146 ceph-mon[35807]: pgmap v950: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:37:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:15 smithi076 ceph-mon[35401]: pgmap v950: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:37:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:15 smithi040 ceph-mon[32397]: pgmap v950: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:37:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:37:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:37:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:37:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: pgmap v951: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:37:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:37:17.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:37:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: pgmap v951: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:37:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:37:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:37:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: pgmap v951: 97 pgs: 97 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:37:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:37:17.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:37:17.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:37:17.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:37:17.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:37:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:19 smithi146 ceph-mon[35807]: pgmap v952: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:37:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:19 smithi076 ceph-mon[35401]: pgmap v952: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:37:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:19 smithi040 ceph-mon[32397]: pgmap v952: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:37:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:21 smithi146 ceph-mon[35807]: pgmap v953: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:37:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:21 smithi076 ceph-mon[35401]: pgmap v953: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:37:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:21 smithi040 ceph-mon[32397]: pgmap v953: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:37:22.790 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:37:22.791 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-07-26T12:37:22.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:37:23.331 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:37:23.744 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:23 smithi040 ceph-mon[32397]: pgmap v954: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:37:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:23 smithi146 ceph-mon[35807]: pgmap v954: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:37:23.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:23 smithi076 ceph-mon[35401]: pgmap v954: 97 pgs: 97 active+clean; 2.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:37:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:25 smithi146 ceph-mon[35807]: pgmap v955: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:37:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:25 smithi076 ceph-mon[35401]: pgmap v955: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 -- 172.21.15.40:0/3771748273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 msgr2=0x7fa4ec10fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 --2- 172.21.15.40:0/3771748273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec10fb30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009ca0 tx=0x7fa4e402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 -- 172.21.15.40:0/3771748273 shutdown_connections 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 --2- 172.21.15.40:0/3771748273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec10fb30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 --2- 172.21.15.40:0/3771748273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4ec104b10 0x7fa4ec10d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 --2- 172.21.15.40:0/3771748273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4ec1040e0 0x7fa4ec1044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:25.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 -- 172.21.15.40:0/3771748273 >> 172.21.15.40:0/3771748273 conn(0x7fa4ec0fdcf0 msgr2=0x7fa4ec100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:25.858 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:25 smithi040 ceph-mon[32397]: pgmap v955: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:37:25.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.856+0000 7fa4eb200640 1 -- 172.21.15.40:0/3771748273 shutdown_connections 2024-07-26T12:37:25.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.857+0000 7fa4eb200640 1 -- 172.21.15.40:0/3771748273 wait complete. 2024-07-26T12:37:25.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.858+0000 7fa4eb200640 1 Processor -- start 2024-07-26T12:37:25.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 -- start start 2024-07-26T12:37:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4ec1040e0 0x7fa4ec101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4ec104b10 0x7fa4ec102530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec102a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec1131a0 con 0x7fa4ec10d690 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec113020 con 0x7fa4ec104b10 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.859+0000 7fa4eb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec113320 con 0x7fa4ec1040e0 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec102a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec102a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46028/0 (socket says 172.21.15.40:46028) 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4ea800640 1 -- 172.21.15.40:0/4228481191 learned_addr learned my addr 172.21.15.40:0/4228481191 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4e9400640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4ec104b10 0x7fa4ec102530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4e9e00640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4ec1040e0 0x7fa4ec101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4ea800640 1 -- 172.21.15.40:0/4228481191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4ec1040e0 msgr2=0x7fa4ec101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4ea800640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4ec1040e0 0x7fa4ec101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.860+0000 7fa4ea800640 1 -- 172.21.15.40:0/4228481191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4ec104b10 msgr2=0x7fa4ec102530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.861+0000 7fa4ea800640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4ec104b10 0x7fa4ec102530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.861+0000 7fa4ea800640 1 -- 172.21.15.40:0/4228481191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec1a7e50 con 0x7fa4ec10d690 2024-07-26T12:37:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.861+0000 7fa4ea800640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec102a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4005cc0 tx=0x7fa4e4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.861+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4032e00 con 0x7fa4ec10d690 2024-07-26T12:37:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.861+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4e40044d0 con 0x7fa4ec10d690 2024-07-26T12:37:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.861+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec1a80e0 con 0x7fa4ec10d690 2024-07-26T12:37:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.862+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec1a8670 con 0x7fa4ec10d690 2024-07-26T12:37:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.862+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4030b70 con 0x7fa4ec10d690 2024-07-26T12:37:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.864+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc005290 con 0x7fa4ec10d690 2024-07-26T12:37:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.866+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa4e4004040 con 0x7fa4ec10d690 2024-07-26T12:37:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.868+0000 7fa4e2a00640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4d00b3c50 0x7fa4d00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.869+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa4e4105120 con 0x7fa4ec10d690 2024-07-26T12:37:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.869+0000 7fa4e9e00640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4d00b3c50 0x7fa4d00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.870+0000 7fa4e9e00640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4d00b3c50 0x7fa4d00b6160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc005fd0 tx=0x7fa4dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:25.874+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa4e40cc730 con 0x7fa4ec10d690 2024-07-26T12:37:26.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.176+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4cc005580 con 0x7fa4ec10d690 2024-07-26T12:37:26.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.178+0000 7fa4e2a00640 1 -- 172.21.15.40:0/4228481191 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fa4e40cc030 con 0x7fa4ec10d690 2024-07-26T12:37:26.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:37:26.180 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:37:26.180 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:37:26.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4d00b3c50 msgr2=0x7fa4d00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:26.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4d00b3c50 0x7fa4d00b6160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc005fd0 tx=0x7fa4dc005850 comp rx=0 tx=0).stop 2024-07-26T12:37:26.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 msgr2=0x7fa4ec102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:26.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec102a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4005cc0 tx=0x7fa4e4032a10 comp rx=0 tx=0).stop 2024-07-26T12:37:26.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 shutdown_connections 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec10d690 0x7fa4ec102a70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4ec104b10 0x7fa4ec102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4d00b3c50 0x7fa4d00b6160 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 --2- 172.21.15.40:0/4228481191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4ec1040e0 0x7fa4ec101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.182+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 >> 172.21.15.40:0/4228481191 conn(0x7fa4ec0fdcf0 msgr2=0x7fa4ec1071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.183+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 shutdown_connections 2024-07-26T12:37:26.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:26.183+0000 7fa4eb200640 1 -- 172.21.15.40:0/4228481191 wait complete. 2024-07-26T12:37:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4228481191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:26.964 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4228481191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:27.022 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-07-26T12:37:27.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-07-26T12:37:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4228481191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:37:27.713 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:27 smithi040 ceph-mon[32397]: pgmap v956: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:27 smithi076 ceph-mon[35401]: pgmap v956: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:27 smithi146 ceph-mon[35807]: pgmap v956: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.753+0000 7f1dab000640 1 -- 172.21.15.40:0/3026659958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da4109650 msgr2=0x7f1da410fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.753+0000 7f1dab000640 1 --2- 172.21.15.40:0/3026659958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da4109650 0x7f1da410fe80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009ca0 tx=0x7f1d9c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.755 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:29 smithi040 ceph-mon[32397]: pgmap v957: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:37:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 -- 172.21.15.40:0/3026659958 shutdown_connections 2024-07-26T12:37:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 --2- 172.21.15.40:0/3026659958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da4109650 0x7f1da410fe80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 --2- 172.21.15.40:0/3026659958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4108d00 0x7f1da4109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 --2- 172.21.15.40:0/3026659958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41033c0 0x7f1da41037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 -- 172.21.15.40:0/3026659958 >> 172.21.15.40:0/3026659958 conn(0x7f1da40fee10 msgr2=0x7f1da4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 -- 172.21.15.40:0/3026659958 shutdown_connections 2024-07-26T12:37:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.754+0000 7f1dab000640 1 -- 172.21.15.40:0/3026659958 wait complete. 2024-07-26T12:37:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 Processor -- start 2024-07-26T12:37:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 -- start start 2024-07-26T12:37:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 0x7f1da4075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da4108d00 0x7f1da4075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4109650 0x7f1da4075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4113240 con 0x7f1da41033c0 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41130c0 con 0x7f1da4109650 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.756+0000 7f1dab000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41133c0 con 0x7f1da4108d00 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1da9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 0x7f1da4075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1da9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 0x7f1da4075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46048/0 (socket says 172.21.15.40:46048) 2024-07-26T12:37:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1da9c00640 1 -- 172.21.15.40:0/4182620048 learned_addr learned my addr 172.21.15.40:0/4182620048 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1da9200640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da4108d00 0x7f1da4075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1daa600640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4109650 0x7f1da4075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1da9c00640 1 -- 172.21.15.40:0/4182620048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da4108d00 msgr2=0x7f1da4075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.757+0000 7f1da9c00640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da4108d00 0x7f1da4075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da9c00640 1 -- 172.21.15.40:0/4182620048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4109650 msgr2=0x7f1da4075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da9c00640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4109650 0x7f1da4075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da9c00640 1 -- 172.21.15.40:0/4182620048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da41a7eb0 con 0x7f1da41033c0 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1daa600640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4109650 0x7f1da4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da9200640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da4108d00 0x7f1da4075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da9c00640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 0x7f1da4075140 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e9f0 tx=0x7f1d9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da2000640 1 -- 172.21.15.40:0/4182620048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400cd80 con 0x7f1da41033c0 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.758+0000 7f1da2000640 1 -- 172.21.15.40:0/4182620048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d940054b0 con 0x7f1da41033c0 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.759+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da41a81a0 con 0x7f1da41033c0 2024-07-26T12:37:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.759+0000 7f1da2000640 1 -- 172.21.15.40:0/4182620048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94010430 con 0x7f1da41033c0 2024-07-26T12:37:29.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.759+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da41a8690 con 0x7f1da41033c0 2024-07-26T12:37:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.763+0000 7f1db3270740 1 Processor -- start 2024-07-26T12:37:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.763+0000 7f1db3270740 1 -- start start 2024-07-26T12:37:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1db3270740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1db3270740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1db3270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e00b70 0x564c631c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1db3270740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564c6313c970 con 0x564c62e21850 2024-07-26T12:37:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1db3270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564c6312be70 con 0x564c62e00b70 2024-07-26T12:37:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1db3270740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564c6312feb0 con 0x564c62df8990 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1da2000640 1 -- 172.21.15.40:0/4182620048 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1d940046c0 con 0x7f1da41033c0 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1daa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1daa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46054/0 (socket says 172.21.15.40:46054) 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.764+0000 7f1daa600640 1 -- 172.21.15.40:0/858276547 learned_addr learned my addr 172.21.15.40:0/858276547 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1da9200640 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e00b70 0x564c631c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1da9c00640 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1daa600640 1 -- 172.21.15.40:0/858276547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 msgr2=0x564c631c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1daa600640 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1daa600640 1 -- 172.21.15.40:0/858276547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e00b70 msgr2=0x564c631c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1daa600640 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e00b70 0x564c631c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1daa600640 1 -- 172.21.15.40:0/858276547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c630b48e0 con 0x564c62e21850 2024-07-26T12:37:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.765+0000 7f1da9c00640 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:37:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.766+0000 7f1daa600640 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631c8060 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0094b0 tx=0x7f1d9c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29a29ba43ede7ed server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.766+0000 7f1d92a00640 1 -- 172.21.15.40:0/858276547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c031980 con 0x564c62e21850 2024-07-26T12:37:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.766+0000 7f1d92a00640 1 -- 172.21.15.40:0/858276547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d9c036040 con 0x564c62e21850 2024-07-26T12:37:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.766+0000 7f1d92a00640 1 -- 172.21.15.40:0/858276547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c004400 con 0x564c62e21850 2024-07-26T12:37:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.766+0000 7f1da2000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d8c0b3bc0 0x7f1d8c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.767+0000 7f1da9c00640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d8c0b3bc0 0x7f1d8c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.767+0000 7f1da2000640 1 -- 172.21.15.40:0/4182620048 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d940e40e0 con 0x7f1da41033c0 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.767+0000 7f1db3270740 1 -- 172.21.15.40:0/858276547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 msgr2=0x564c631c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.767+0000 7f1db3270740 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631c8060 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0094b0 tx=0x7f1d9c009a20 comp rx=0 tx=0).stop 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 -- 172.21.15.40:0/858276547 shutdown_connections 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e00b70 0x564c631c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 --2- 172.21.15.40:0/858276547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631c8060 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 -- 172.21.15.40:0/858276547 >> 172.21.15.40:0/858276547 conn(0x564c62e15c40 msgr2=0x564c631c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1da9c00640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d8c0b3bc0 0x7f1d8c0b60d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1d940a70b0 tx=0x7f1d94009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 -- 172.21.15.40:0/858276547 shutdown_connections 2024-07-26T12:37:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.768+0000 7f1db3270740 1 -- 172.21.15.40:0/858276547 wait complete. 2024-07-26T12:37:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.769+0000 7f1db3270740 1 -- start start 2024-07-26T12:37:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.769+0000 7f1db3270740 1 Processor -- start 2024-07-26T12:37:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 0x564c631d40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 0x564c631dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564c62f8f7b0 con 0x564c62e00b70 2024-07-26T12:37:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564c630c8420 con 0x564c62e21850 2024-07-26T12:37:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564c631d67e0 con 0x564c62df8990 2024-07-26T12:37:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1db3270740 10 client.0 _ll_register_callbacks cb 0x564c62e390a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1da9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 0x564c631d40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1da9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 0x564c631d40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46064/0 (socket says 172.21.15.40:46064) 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.770+0000 7f1da9200640 1 -- 172.21.15.40:0/325290419 learned_addr learned my addr 172.21.15.40:0/325290419 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1daa600640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1da9200640 1 -- 172.21.15.40:0/325290419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 msgr2=0x564c631d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1da9200640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1da9200640 1 -- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 msgr2=0x564c631dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1da9200640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 0x564c631dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1da9200640 1 -- 172.21.15.40:0/325290419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c630c0c50 con 0x564c62e00b70 2024-07-26T12:37:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1daa600640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:37:29.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1da9200640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 0x564c631d40b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1d98013790 tx=0x7f1d98013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0f32f2cf797cd0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:29.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.771+0000 7f1d87400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:37:29.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.772+0000 7f1d87400640 1 -- 172.21.15.40:0/325290419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98020060 con 0x564c62e00b70 2024-07-26T12:37:29.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.772+0000 7f1d87400640 1 -- 172.21.15.40:0/325290419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d98011dd0 con 0x564c62e00b70 2024-07-26T12:37:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.772+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d9c036040 con 0x564c62e00b70 2024-07-26T12:37:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.772+0000 7f1d87400640 1 -- 172.21.15.40:0/325290419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1d9800f450 con 0x564c62e00b70 2024-07-26T12:37:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.772+0000 7f1db3270740 10 client.16005 fetch_fsmap learned FSMap version 35 2024-07-26T12:37:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.772+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564c62e9bba0 con 0x564c62e00b70 2024-07-26T12:37:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1d87400640 1 -- 172.21.15.40:0/325290419 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d9c036040 con 0x564c62e00b70 2024-07-26T12:37:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1d87400640 1 -- 172.21.15.40:0/325290419 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1d98025070 con 0x564c62e00b70 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1db3270740 10 client.16005 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1db3270740 10 client.16005 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1db3270740 20 client.16005 populate_metadata read hostname 'smithi040' 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1db3270740 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62de01d0 0x564c631e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1db3270740 4 client.16005 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.773+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c6313e8c0 con 0x564c62de01d0 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.774+0000 7f1daa600640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62de01d0 0x564c631e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.775+0000 7f1daa600640 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62de01d0 0x564c631e5ad0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc061691f789b00 server_cookie=3b17e9ec519e63c7 in_seq=0 out_seq=0 2024-07-26T12:37:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.775+0000 7f1d87400640 10 client.16005 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.777+0000 7f1d87400640 1 -- 172.21.15.40:0/325290419 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c6313e8c0 con 0x564c62de01d0 2024-07-26T12:37:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.777+0000 7f1d87400640 10 client.16005 handle_command_reply: tid=0 2024-07-26T12:37:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.777+0000 7f1db3270740 1 client.16005 shutdown 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.777+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 msgr2=0x564c631d40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.777+0000 7f1db3270740 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 0x564c631d40b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1d98013790 tx=0x7f1d98013c50 comp rx=0 tx=0).stop 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 shutdown_connections 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 0x564c631dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62de01d0 0x564c631e5ad0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e00b70 0x564c631d40b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 --2- 172.21.15.40:0/325290419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62df8990 0x564c631d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 >> 172.21.15.40:0/325290419 conn(0x564c62e15c40 msgr2=0x564c631cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1d87400640 0 client.16005 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 shutdown_connections 2024-07-26T12:37:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 1 -- 172.21.15.40:0/325290419 wait complete. 2024-07-26T12:37:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.778+0000 7f1db3270740 20 client.16005 trim_cache size 0 max 16384 2024-07-26T12:37:29.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.797+0000 7f1db3270740 1 Processor -- start 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.797+0000 7f1db3270740 1 -- start start 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1db3270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62df8990 0x564c631c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1db3270740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1db3270740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631df920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1db3270740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41b0da0 con 0x564c62e21850 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1db3270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41b28e0 con 0x564c62df8990 2024-07-26T12:37:29.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1db3270740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41b1470 con 0x564c62e00b70 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1daa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1daa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46072/0 (socket says 172.21.15.40:46072) 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.798+0000 7f1daa600640 1 -- 172.21.15.40:0/2838587758 learned_addr learned my addr 172.21.15.40:0/2838587758 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1da9200640 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1daa600640 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62df8990 0x564c631c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1daa600640 1 -- 172.21.15.40:0/2838587758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 msgr2=0x564c631c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1daa600640 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1daa600640 1 -- 172.21.15.40:0/2838587758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62df8990 msgr2=0x564c631c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1daa600640 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62df8990 0x564c631c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.799+0000 7f1daa600640 1 -- 172.21.15.40:0/2838587758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c62de0400 con 0x564c62e21850 2024-07-26T12:37:29.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.800+0000 7f1daa600640 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631df920 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c02aeb0 tx=0x7f1d9c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941ea4b4ff269ecc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:29.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.800+0000 7f1d92000640 1 -- 172.21.15.40:0/2838587758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c054070 con 0x564c62e21850 2024-07-26T12:37:29.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.800+0000 7f1d92000640 1 -- 172.21.15.40:0/2838587758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d9c055040 con 0x564c62e21850 2024-07-26T12:37:29.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.800+0000 7f1d92000640 1 -- 172.21.15.40:0/2838587758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c04a040 con 0x564c62e21850 2024-07-26T12:37:29.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 -- 172.21.15.40:0/2838587758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 msgr2=0x564c631df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:29.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631df920 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c02aeb0 tx=0x7f1d9c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 -- 172.21.15.40:0/2838587758 shutdown_connections 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62e21850 0x564c631df920 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 --2- 172.21.15.40:0/2838587758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62df8990 0x564c631c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.801+0000 7f1db3270740 1 -- 172.21.15.40:0/2838587758 >> 172.21.15.40:0/2838587758 conn(0x564c62e15c40 msgr2=0x564c631c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.802+0000 7f1db3270740 1 -- 172.21.15.40:0/2838587758 shutdown_connections 2024-07-26T12:37:29.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.802+0000 7f1db3270740 1 -- 172.21.15.40:0/2838587758 wait complete. 2024-07-26T12:37:29.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.802+0000 7f1db3270740 1 -- start start 2024-07-26T12:37:29.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.802+0000 7f1db3270740 1 Processor -- start 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 0x564c631dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631d78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 0x564c631d8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41b2210 con 0x564c62df8990 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41b1b40 con 0x564c62e21850 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41aed60 con 0x564c62e00b70 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1db3270740 10 client.0 _ll_register_callbacks cb 0x7f1d98009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1daa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 0x564c631dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1daa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 0x564c631dc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46076/0 (socket says 172.21.15.40:46076) 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.803+0000 7f1daa600640 1 -- 172.21.15.40:0/2471342366 learned_addr learned my addr 172.21.15.40:0/2471342366 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1da9200640 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631d78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1daa600640 1 -- 172.21.15.40:0/2471342366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 msgr2=0x564c631d78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1daa600640 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631d78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1daa600640 1 -- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 msgr2=0x564c631d8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1daa600640 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 0x564c631d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:29.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1daa600640 1 -- 172.21.15.40:0/2471342366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c6324d240 con 0x564c62df8990 2024-07-26T12:37:29.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1daa600640 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 0x564c631dc3c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c006010 tx=0x7f1d9c003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca0c9e32dcc42f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:29.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.804+0000 7f1d87400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:37:29.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.805+0000 7f1d87400640 1 -- 172.21.15.40:0/2471342366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c054070 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.805+0000 7f1d87400640 1 -- 172.21.15.40:0/2471342366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d9c003eb0 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.805+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d9c055040 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.805+0000 7f1d87400640 1 -- 172.21.15.40:0/2471342366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c0040b0 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.805+0000 7f1db3270740 10 client.16011 fetch_fsmap learned FSMap version 35 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.805+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564c6324e3b0 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1d87400640 1 -- 172.21.15.40:0/2471342366 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d9c055040 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1d87400640 1 -- 172.21.15.40:0/2471342366 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1d9c06e070 con 0x564c62df8990 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1db3270740 10 client.16011 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1db3270740 10 client.16011 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1db3270740 20 client.16011 populate_metadata read hostname 'smithi040' 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1db3270740 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62db5580 0x564c632507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1db3270740 4 client.16011 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-07-26T12:37:29.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.806+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x564c6313a360 con 0x564c62db5580 2024-07-26T12:37:29.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.807+0000 7f1da9200640 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62db5580 0x564c632507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:29.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.808+0000 7f1da9200640 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62db5580 0x564c632507a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c84cbc952e10ca server_cookie=964eb93c3b8de6b6 in_seq=0 out_seq=0 2024-07-26T12:37:29.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:29.808+0000 7f1d87400640 10 client.16011 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:29 smithi146 ceph-mon[35807]: pgmap v957: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:37:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:29 smithi076 ceph-mon[35401]: pgmap v957: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:37:30.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.114+0000 7f1d87400640 1 -- 172.21.15.40:0/2471342366 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564c6313a360 con 0x564c62db5580 2024-07-26T12:37:30.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.114+0000 7f1d87400640 10 client.16011 handle_command_reply: tid=0 2024-07-26T12:37:30.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.114+0000 7f1db3270740 1 client.16011 shutdown 2024-07-26T12:37:30.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.115+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 msgr2=0x564c631dc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:30.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.115+0000 7f1db3270740 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 0x564c631dc3c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c006010 tx=0x7f1d9c003a90 comp rx=0 tx=0).stop 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 shutdown_connections 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1db3270740 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564c62e21850 0x564c631d8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1db3270740 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564c62e00b70 0x564c631d78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1db3270740 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564c62db5580 0x564c632507a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1db3270740 1 --2- 172.21.15.40:0/2471342366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564c62df8990 0x564c631dc3c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 >> 172.21.15.40:0/2471342366 conn(0x564c62e15c40 msgr2=0x564c631c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:30.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.116+0000 7f1d87400640 0 client.16011 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:30.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.117+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 shutdown_connections 2024-07-26T12:37:30.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.117+0000 7f1db3270740 1 -- 172.21.15.40:0/2471342366 wait complete. 2024-07-26T12:37:30.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.117+0000 7f1db3270740 20 client.16011 trim_cache size 0 max 16384 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 46, 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "cde0eedf": { 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 46, 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:37:30.119 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 140.3, 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:37:30.120 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:30.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:30.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:30.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:30.121 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.118+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d8c0b3bc0 msgr2=0x7f1d8c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.118+0000 7f1dab000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d8c0b3bc0 0x7f1d8c0b60d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1d940a70b0 tx=0x7f1d94009720 comp rx=0 tx=0).stop 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 msgr2=0x7f1da4075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 0x7f1da4075140 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e9f0 tx=0x7f1d9400edf0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 shutdown_connections 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1da4109650 0x7f1da4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d8c0b3bc0 0x7f1d8c0b60d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da4108d00 0x7f1da4075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 --2- 172.21.15.40:0/4182620048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1da41033c0 0x7f1da4075140 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:30.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.119+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 >> 172.21.15.40:0/4182620048 conn(0x7f1da40fee10 msgr2=0x7f1da4101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:30.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.120+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 shutdown_connections 2024-07-26T12:37:30.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:30.120+0000 7f1dab000640 1 -- 172.21.15.40:0/4182620048 wait complete. 2024-07-26T12:37:31.079 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cde0eedf', quiesce took 8.3 seconds. Will release after: 12.05 2024-07-26T12:37:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:31 smithi040 ceph-mon[32397]: pgmap v958: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:37:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:31 smithi146 ceph-mon[35807]: pgmap v958: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:37:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:31 smithi076 ceph-mon[35401]: pgmap v958: 97 pgs: 97 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:37:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:33 smithi040 ceph-mon[32397]: pgmap v959: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:37:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:33 smithi146 ceph-mon[35807]: pgmap v959: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:37:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:33 smithi076 ceph-mon[35401]: pgmap v959: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:37:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:35 smithi040 ceph-mon[32397]: pgmap v960: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:37:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:35 smithi146 ceph-mon[35807]: pgmap v960: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:37:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:35 smithi076 ceph-mon[35401]: pgmap v960: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:37:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:37 smithi040 ceph-mon[32397]: pgmap v961: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:37 smithi146 ceph-mon[35807]: pgmap v961: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:37 smithi076 ceph-mon[35401]: pgmap v961: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:37:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:39 smithi040 ceph-mon[32397]: pgmap v962: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T12:37:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:39 smithi146 ceph-mon[35807]: pgmap v962: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T12:37:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:39 smithi076 ceph-mon[35401]: pgmap v962: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T12:37:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:41 smithi040 ceph-mon[32397]: pgmap v963: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:37:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:41 smithi146 ceph-mon[35807]: pgmap v963: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:37:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:41 smithi076 ceph-mon[35401]: pgmap v963: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:37:43.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:37:43.607 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:37:43.944 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:43 smithi040 ceph-mon[32397]: pgmap v964: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 9 op/s 2024-07-26T12:37:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:43 smithi146 ceph-mon[35807]: pgmap v964: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 9 op/s 2024-07-26T12:37:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:43 smithi076 ceph-mon[35401]: pgmap v964: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 9 op/s 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 -- 172.21.15.40:0/2362203953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc113f80 msgr2=0x7ffbbc1163a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/2362203953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc113f80 0x7ffbbc1163a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009ca0 tx=0x7ffbb402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 -- 172.21.15.40:0/2362203953 shutdown_connections 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/2362203953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc113f80 0x7ffbbc1163a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/2362203953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/2362203953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbbc077370 0x7ffbbc077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 -- 172.21.15.40:0/2362203953 >> 172.21.15.40:0/2362203953 conn(0x7ffbbc101010 msgr2=0x7ffbbc103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 -- 172.21.15.40:0/2362203953 shutdown_connections 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.661+0000 7ffbbbe00640 1 -- 172.21.15.40:0/2362203953 wait complete. 2024-07-26T12:37:45.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 Processor -- start 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 -- start start 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077370 0x7ffbbc1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc1a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbbc113f80 0x7ffbbc1a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc119800 con 0x7ffbbc077cc0 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc119680 con 0x7ffbbc113f80 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.663+0000 7ffbbbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc119980 con 0x7ffbbc077370 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc1a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc1a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54384/0 (socket says 172.21.15.40:54384) 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 -- 172.21.15.40:0/3252460553 learned_addr learned my addr 172.21.15.40:0/3252460553 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbbb400640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbbc113f80 0x7ffbbc1a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbbaa00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077370 0x7ffbbc1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 -- 172.21.15.40:0/3252460553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077370 msgr2=0x7ffbbc1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077370 0x7ffbbc1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 -- 172.21.15.40:0/3252460553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbbc113f80 msgr2=0x7ffbbc1a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbbc113f80 0x7ffbbc1a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 -- 172.21.15.40:0/3252460553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbbc1a61e0 con 0x7ffbbc077cc0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbbaa00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077370 0x7ffbbc1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.664+0000 7ffbb2000640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc1a0810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c970 tx=0x7ffba400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.665+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4004220 con 0x7ffbbc077cc0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.665+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbbc1a64d0 con 0x7ffbbc077cc0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.665+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffba4007e40 con 0x7ffbbc077cc0 2024-07-26T12:37:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.665+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba40047a0 con 0x7ffbbc077cc0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.665+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbbc1acc30 con 0x7ffbbc077cc0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.666+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbbc077780 con 0x7ffbbc077cc0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.670+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffba40079b0 con 0x7ffbbc077cc0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.672+0000 7ffbb3e00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba00b3bd0 0x7ffba00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.672+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffba40e3d50 con 0x7ffbbc077cc0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.672+0000 7ffbbaa00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba00b3bd0 0x7ffba00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.673+0000 7ffbbaa00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba00b3bd0 0x7ffba00b60e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0058c0 tx=0x7ffbac005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.674+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffba4014030 con 0x7ffbbc077cc0 2024-07-26T12:37:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:45 smithi040 ceph-mon[32397]: pgmap v965: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-07-26T12:37:45.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.921+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbbc1a13a0 con 0x7ffbbc077cc0 2024-07-26T12:37:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.922+0000 7ffbb3e00640 1 -- 172.21.15.40:0/3252460553 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ffba40ab360 con 0x7ffbbc077cc0 2024-07-26T12:37:45.924 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:37:45.924 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:37:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:37:45.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba00b3bd0 msgr2=0x7ffba00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:45.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba00b3bd0 0x7ffba00b60e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0058c0 tx=0x7ffbac005d30 comp rx=0 tx=0).stop 2024-07-26T12:37:45.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 msgr2=0x7ffbbc1a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:45.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc1a0810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c970 tx=0x7ffba400ce30 comp rx=0 tx=0).stop 2024-07-26T12:37:45.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 shutdown_connections 2024-07-26T12:37:45.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffbbc113f80 0x7ffbbc1a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbbc077cc0 0x7ffbbc1a0810 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffba00b3bd0 0x7ffba00b60e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 --2- 172.21.15.40:0/3252460553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbbc077370 0x7ffbbc1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 >> 172.21.15.40:0/3252460553 conn(0x7ffbbc101010 msgr2=0x7ffbbc116040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 shutdown_connections 2024-07-26T12:37:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:45.925+0000 7ffbbbe00640 1 -- 172.21.15.40:0/3252460553 wait complete. 2024-07-26T12:37:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:45 smithi146 ceph-mon[35807]: pgmap v965: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-07-26T12:37:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:45 smithi076 ceph-mon[35401]: pgmap v965: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-07-26T12:37:46.635 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id cde0eedf --release --await' 2024-07-26T12:37:46.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id cde0eedf --release --await 2024-07-26T12:37:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:46 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3252460553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:46 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3252460553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:46 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3252460553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:37:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:47 smithi040 ceph-mon[32397]: pgmap v966: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 498 KiB/s wr, 8 op/s 2024-07-26T12:37:47.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:47 smithi076 ceph-mon[35401]: pgmap v966: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 498 KiB/s wr, 8 op/s 2024-07-26T12:37:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:47 smithi146 ceph-mon[35807]: pgmap v966: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 498 KiB/s wr, 8 op/s 2024-07-26T12:37:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 -- 172.21.15.40:0/3381591035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410af10 msgr2=0x7fe16410b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 --2- 172.21.15.40:0/3381591035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410af10 0x7fe16410b320 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe150009900 tx=0x7fe15002a410 comp rx=0 tx=0).stop 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 -- 172.21.15.40:0/3381591035 shutdown_connections 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 --2- 172.21.15.40:0/3381591035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16410b860 0x7fe164112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 --2- 172.21.15.40:0/3381591035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410af10 0x7fe16410b320 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 --2- 172.21.15.40:0/3381591035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1641055d0 0x7fe1641059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 -- 172.21.15.40:0/3381591035 >> 172.21.15.40:0/3381591035 conn(0x7fe164101040 msgr2=0x7fe164103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 -- 172.21.15.40:0/3381591035 shutdown_connections 2024-07-26T12:37:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.376+0000 7fe163200640 1 -- 172.21.15.40:0/3381591035 wait complete. 2024-07-26T12:37:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.378+0000 7fe163200640 1 Processor -- start 2024-07-26T12:37:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.378+0000 7fe163200640 1 -- start start 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe163200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1641055d0 0x7fe16419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe163200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16410af10 0x7fe16419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe163200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 0x7fe1641a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe163200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe164115380 con 0x7fe16410b860 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe163200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe164115200 con 0x7fe1641055d0 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe163200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe164115500 con 0x7fe16410af10 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe161e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1641055d0 0x7fe16419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe162800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 0x7fe1641a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe162800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 0x7fe1641a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54410/0 (socket says 172.21.15.40:54410) 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe162800640 1 -- 172.21.15.40:0/46815664 learned_addr learned my addr 172.21.15.40:0/46815664 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.379+0000 7fe161400640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16410af10 0x7fe16419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.380+0000 7fe162800640 1 -- 172.21.15.40:0/46815664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16410af10 msgr2=0x7fe16419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.380+0000 7fe162800640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16410af10 0x7fe16419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.380+0000 7fe162800640 1 -- 172.21.15.40:0/46815664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1641055d0 msgr2=0x7fe16419be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.380+0000 7fe162800640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1641055d0 0x7fe16419be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.380+0000 7fe162800640 1 -- 172.21.15.40:0/46815664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1641a1de0 con 0x7fe16410b860 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.380+0000 7fe162800640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 0x7fe1641a16b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009fd0 tx=0x7fe15c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.381+0000 7fe15aa00640 1 -- 172.21.15.40:0/46815664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c017070 con 0x7fe16410b860 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.381+0000 7fe15aa00640 1 -- 172.21.15.40:0/46815664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe15c003e00 con 0x7fe16410b860 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.381+0000 7fe15aa00640 1 -- 172.21.15.40:0/46815664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c010460 con 0x7fe16410b860 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.381+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1641a20d0 con 0x7fe16410b860 2024-07-26T12:37:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.381+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1641a8830 con 0x7fe16410b860 2024-07-26T12:37:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.384+0000 7fe16f5d2740 1 Processor -- start 2024-07-26T12:37:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.385+0000 7fe15aa00640 1 -- 172.21.15.40:0/46815664 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe15c003970 con 0x7fe16410b860 2024-07-26T12:37:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.385+0000 7fe16f5d2740 1 -- start start 2024-07-26T12:37:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94e6660 0x5614a98b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94ee840 0x5614a98b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5614a982af30 con 0x5614a950f520 2024-07-26T12:37:49.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5614a981a430 con 0x5614a94ee840 2024-07-26T12:37:49.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5614a981e470 con 0x5614a94e6660 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe161400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe161400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54416/0 (socket says 172.21.15.40:54416) 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe161400640 1 -- 172.21.15.40:0/1419397447 learned_addr learned my addr 172.21.15.40:0/1419397447 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.386+0000 7fe161e00640 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94e6660 0x5614a98b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161400640 1 -- 172.21.15.40:0/1419397447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94e6660 msgr2=0x5614a98b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161400640 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94e6660 0x5614a98b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161400640 1 -- 172.21.15.40:0/1419397447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94ee840 msgr2=0x5614a98b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161400640 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94ee840 0x5614a98b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161400640 1 -- 172.21.15.40:0/1419397447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a957ab00 con 0x5614a950f520 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe15aa00640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1480b3c50 0x7fe1480b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161400640 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98b4180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe1500057c0 tx=0x7fe150009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd8d520a9bde0dc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:49.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe15aa00640 1 -- 172.21.15.40:0/46815664 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe15c0e3cb0 con 0x7fe16410b860 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.387+0000 7fe161e00640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1480b3c50 0x7fe1480b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.388+0000 7fe14f000640 1 -- 172.21.15.40:0/1419397447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150035040 con 0x5614a950f520 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.388+0000 7fe14f000640 1 -- 172.21.15.40:0/1419397447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe150004030 con 0x5614a950f520 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.388+0000 7fe14f000640 1 -- 172.21.15.40:0/1419397447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150003b10 con 0x5614a950f520 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1419397447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 msgr2=0x5614a98b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98b4180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe1500057c0 tx=0x7fe150009580 comp rx=0 tx=0).stop 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe161e00640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1480b3c50 0x7fe1480b6160 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5614a98b2e00 tx=0x7fe15400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1419397447 shutdown_connections 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94ee840 0x5614a98b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94e6660 0x5614a98b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1419397447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98b4180 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1419397447 >> 172.21.15.40:0/1419397447 conn(0x5614a9503910 msgr2=0x5614a98b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:49.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1419397447 shutdown_connections 2024-07-26T12:37:49.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.389+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1419397447 wait complete. 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.390+0000 7fe16f5d2740 1 -- start start 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.390+0000 7fe16f5d2740 1 Processor -- start 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98bf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a98cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5614a967dbb0 con 0x5614a94e6660 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5614a97b6910 con 0x5614a950f520 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5614a98c2900 con 0x5614a94ee840 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe16f5d2740 10 client.0 _ll_register_callbacks cb 0x5614a9526d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54430/0 (socket says 172.21.15.40:54430) 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 -- 172.21.15.40:0/1566826987 learned_addr learned my addr 172.21.15.40:0/1566826987 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161400640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe162800640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a98cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 -- 172.21.15.40:0/1566826987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 msgr2=0x5614a98bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 -- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 msgr2=0x5614a98cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a98cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe161e00640 1 -- 172.21.15.40:0/1566826987 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a95f1960 con 0x5614a94e6660 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.391+0000 7fe162800640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a98cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.392+0000 7fe161e00640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98bf800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe154003e90 tx=0x7fe1540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c93d54668e01f70 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.392+0000 7fe143400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:37:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.392+0000 7fe143400640 1 -- 172.21.15.40:0/1566826987 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15401b660 con 0x5614a94e6660 2024-07-26T12:37:49.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.392+0000 7fe143400640 1 -- 172.21.15.40:0/1566826987 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe15401b800 con 0x5614a94e6660 2024-07-26T12:37:49.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.392+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe150004030 con 0x5614a94e6660 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.392+0000 7fe143400640 1 -- 172.21.15.40:0/1566826987 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe15401ba00 con 0x5614a94e6660 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 10 client.16029 fetch_fsmap learned FSMap version 35 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5614a98ce670 con 0x5614a94e6660 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe143400640 1 -- 172.21.15.40:0/1566826987 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe150004030 con 0x5614a94e6660 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe143400640 1 -- 172.21.15.40:0/1566826987 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe154024070 con 0x5614a94e6660 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 10 client.16029 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 10 client.16029 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:37:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 20 client.16029 populate_metadata read hostname 'smithi040' 2024-07-26T12:37:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94cdea0 0x5614a98d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 4 client.16029 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:37:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.393+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614a982ce80 con 0x5614a94cdea0 2024-07-26T12:37:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.394+0000 7fe161400640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94cdea0 0x5614a98d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.395+0000 7fe161400640 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94cdea0 0x5614a98d1c50 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b101fe3bafaeb274 server_cookie=2b84c1b503804d42 in_seq=0 out_seq=0 2024-07-26T12:37:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.395+0000 7fe143400640 10 client.16029 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.397+0000 7fe143400640 1 -- 172.21.15.40:0/1566826987 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614a982ce80 con 0x5614a94cdea0 2024-07-26T12:37:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.397+0000 7fe143400640 10 client.16029 handle_command_reply: tid=0 2024-07-26T12:37:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.397+0000 7fe16f5d2740 1 client.16029 shutdown 2024-07-26T12:37:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.397+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 msgr2=0x5614a98bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.397+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98bf800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe154003e90 tx=0x7fe1540046c0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 shutdown_connections 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a98cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94cdea0 0x5614a98d1c50 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1566826987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98bf800 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 >> 172.21.15.40:0/1566826987 conn(0x5614a9503910 msgr2=0x5614a98b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe143400640 0 client.16029 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 shutdown_connections 2024-07-26T12:37:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1566826987 wait complete. 2024-07-26T12:37:49.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.398+0000 7fe16f5d2740 20 client.16029 trim_cache size 0 max 16384 2024-07-26T12:37:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.417+0000 7fe16f5d2740 1 Processor -- start 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.417+0000 7fe16f5d2740 1 -- start start 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94e6660 0x5614a98c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641b0d40 con 0x5614a950f520 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641b2880 con 0x5614a94e6660 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641b1410 con 0x5614a94ee840 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98d7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54434/0 (socket says 172.21.15.40:54434) 2024-07-26T12:37:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 -- 172.21.15.40:0/1950090073 learned_addr learned my addr 172.21.15.40:0/1950090073 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe161e00640 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94e6660 0x5614a98c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe161400640 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 -- 172.21.15.40:0/1950090073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 msgr2=0x5614a98cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 -- 172.21.15.40:0/1950090073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94e6660 msgr2=0x5614a98c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94e6660 0x5614a98c17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.418+0000 7fe162800640 1 -- 172.21.15.40:0/1950090073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a98b6fe0 con 0x5614a950f520 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.419+0000 7fe162800640 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98d7410 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0e1710 tx=0x7fe15c003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599deadab6d556d4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.419+0000 7fe14e600640 1 -- 172.21.15.40:0/1950090073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c020040 con 0x5614a950f520 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.419+0000 7fe14e600640 1 -- 172.21.15.40:0/1950090073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe15c0af1c0 con 0x5614a950f520 2024-07-26T12:37:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.419+0000 7fe14e600640 1 -- 172.21.15.40:0/1950090073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c0b3a40 con 0x5614a950f520 2024-07-26T12:37:49.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1950090073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 msgr2=0x5614a98d7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98d7410 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0e1710 tx=0x7fe15c003d20 comp rx=0 tx=0).stop 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1950090073 shutdown_connections 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a950f520 0x5614a98d7410 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/1950090073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a94e6660 0x5614a98c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1950090073 >> 172.21.15.40:0/1950090073 conn(0x5614a9503910 msgr2=0x5614a98bea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1950090073 shutdown_connections 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.420+0000 7fe16f5d2740 1 -- 172.21.15.40:0/1950090073 wait complete. 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.421+0000 7fe16f5d2740 1 -- start start 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.421+0000 7fe16f5d2740 1 Processor -- start 2024-07-26T12:37:49.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98c4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a9933420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641b21b0 con 0x5614a94e6660 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641b1ae0 con 0x5614a950f520 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aed00 con 0x5614a94ee840 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe16f5d2740 10 client.0 _ll_register_callbacks cb 0x7fe154004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe161e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe161e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54444/0 (socket says 172.21.15.40:54444) 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe161e00640 1 -- 172.21.15.40:0/3022132741 learned_addr learned my addr 172.21.15.40:0/3022132741 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe161400640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.422+0000 7fe162800640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a9933420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe161e00640 1 -- 172.21.15.40:0/3022132741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 msgr2=0x5614a98c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe161e00640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe161e00640 1 -- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 msgr2=0x5614a9933420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe161e00640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a9933420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe161e00640 1 -- 172.21.15.40:0/3022132741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a9933a90 con 0x5614a94e6660 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe161e00640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98c4420 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe1540043f0 tx=0x7fe154012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44659975c31d686 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe143400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe143400640 1 -- 172.21.15.40:0/3022132741 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154005240 con 0x5614a94e6660 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe143400640 1 -- 172.21.15.40:0/3022132741 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe1540053e0 con 0x5614a94e6660 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.423+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe15c0af1c0 con 0x5614a94e6660 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe143400640 1 -- 172.21.15.40:0/3022132741 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe1540055e0 con 0x5614a94e6660 2024-07-26T12:37:49.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 10 client.16035 fetch_fsmap learned FSMap version 35 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5614a993adf0 con 0x5614a94e6660 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe143400640 1 -- 172.21.15.40:0/3022132741 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe15c0af1c0 con 0x5614a94e6660 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe143400640 1 -- 172.21.15.40:0/3022132741 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe154024050 con 0x5614a94e6660 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 10 client.16035 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 10 client.16035 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 20 client.16035 populate_metadata read hostname 'smithi040' 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94a3250 0x5614a993d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 4 client.16035 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cde0eedf", "release": true, "await": true}] 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.424+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cde0eedf", "release": true, "await": true}) -- 0x5614a9828920 con 0x5614a94a3250 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.425+0000 7fe161400640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94a3250 0x5614a993d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.426+0000 7fe161400640 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94a3250 0x5614a993d580 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a72c5cd80a3906 server_cookie=afaa7f1a86560e8a in_seq=0 out_seq=0 2024-07-26T12:37:49.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.426+0000 7fe143400640 10 client.16035 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.499+0000 7fe143400640 1 -- 172.21.15.40:0/3022132741 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5614a9828920 con 0x5614a94a3250 2024-07-26T12:37:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.499+0000 7fe143400640 10 client.16035 handle_command_reply: tid=0 2024-07-26T12:37:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 client.16035 shutdown 2024-07-26T12:37:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 msgr2=0x5614a98c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98c4420 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe1540043f0 tx=0x7fe154012d50 comp rx=0 tx=0).stop 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 shutdown_connections 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5614a950f520 0x5614a9933420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614a94ee840 0x5614a98c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5614a94a3250 0x5614a993d580 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 --2- 172.21.15.40:0/3022132741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5614a94e6660 0x5614a98c4420 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 >> 172.21.15.40:0/3022132741 conn(0x5614a9503910 msgr2=0x5614a98b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.500+0000 7fe143400640 0 client.16035 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.501+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 shutdown_connections 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.501+0000 7fe16f5d2740 1 -- 172.21.15.40:0/3022132741 wait complete. 2024-07-26T12:37:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.501+0000 7fe16f5d2740 20 client.16035 trim_cache size 0 max 16384 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 48, 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout: "cde0eedf": { 2024-07-26T12:37:49.504 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 48, 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 140.3, 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:49.506 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:49.506 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:49.506 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:37:49.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1480b3c50 msgr2=0x7fe1480b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1480b3c50 0x7fe1480b6160 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5614a98b2e00 tx=0x7fe15400b390 comp rx=0 tx=0).stop 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 msgr2=0x7fe1641a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 0x7fe1641a16b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009fd0 tx=0x7fe15c00b260 comp rx=0 tx=0).stop 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 shutdown_connections 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16410b860 0x7fe1641a16b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe1480b3c50 0x7fe1480b6160 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe16410af10 0x7fe16419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 --2- 172.21.15.40:0/46815664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe1641055d0 0x7fe16419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.503+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 >> 172.21.15.40:0/46815664 conn(0x7fe164101040 msgr2=0x7fe164103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.504+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 shutdown_connections 2024-07-26T12:37:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:49.504+0000 7fe163200640 1 -- 172.21.15.40:0/46815664 wait complete. 2024-07-26T12:37:49.969 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:49 smithi040 ceph-mon[32397]: pgmap v967: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 498 KiB/s wr, 10 op/s 2024-07-26T12:37:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:49 smithi146 ceph-mon[35807]: pgmap v967: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 498 KiB/s wr, 10 op/s 2024-07-26T12:37:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:49 smithi076 ceph-mon[35401]: pgmap v967: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 498 KiB/s wr, 10 op/s 2024-07-26T12:37:50.424 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cde0eedf', total seconds elapsed: 27.6 2024-07-26T12:37:50.424 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-07-26T12:37:50.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:37:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:37:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:51 smithi040 ceph-mon[32397]: pgmap v968: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T12:37:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:51 smithi146 ceph-mon[35807]: pgmap v968: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T12:37:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:51 smithi076 ceph-mon[35401]: pgmap v968: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T12:37:53.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 -- 172.21.15.40:0/2745771642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 msgr2=0x7f220c111e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:53.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 --2- 172.21.15.40:0/2745771642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c111e40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2204009ca0 tx=0x7f220402a950 comp rx=0 tx=0).stop 2024-07-26T12:37:53.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 -- 172.21.15.40:0/2745771642 shutdown_connections 2024-07-26T12:37:53.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 --2- 172.21.15.40:0/2745771642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c111e40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 --2- 172.21.15.40:0/2745771642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f220c1027c0 0x7f220c10f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 --2- 172.21.15.40:0/2745771642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c101e70 0x7f220c102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 -- 172.21.15.40:0/2745771642 >> 172.21.15.40:0/2745771642 conn(0x7f220c0fdcf0 msgr2=0x7f220c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 -- 172.21.15.40:0/2745771642 shutdown_connections 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.086+0000 7f220b200640 1 -- 172.21.15.40:0/2745771642 wait complete. 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 Processor -- start 2024-07-26T12:37:53.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 -- start start 2024-07-26T12:37:53.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f220c101e70 0x7f220c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:53.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c1027c0 0x7f220c19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:53.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:53.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f220c115320 con 0x7f220c10fa20 2024-07-26T12:37:53.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f220c1151a0 con 0x7f220c101e70 2024-07-26T12:37:53.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.088+0000 7f220b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f220c1154a0 con 0x7f220c1027c0 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f220a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f220a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c1a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36736/0 (socket says 172.21.15.40:36736) 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f220a800640 1 -- 172.21.15.40:0/3541030710 learned_addr learned my addr 172.21.15.40:0/3541030710 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f2209e00640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f220c101e70 0x7f220c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f2209400640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c1027c0 0x7f220c19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f220a800640 1 -- 172.21.15.40:0/3541030710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c1027c0 msgr2=0x7f220c19c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.089+0000 7f220a800640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c1027c0 0x7f220c19c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f220a800640 1 -- 172.21.15.40:0/3541030710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f220c101e70 msgr2=0x7f220c19be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f220a800640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f220c101e70 0x7f220c19be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f220a800640 1 -- 172.21.15.40:0/3541030710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220c1a1dc0 con 0x7f220c10fa20 2024-07-26T12:37:53.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f2209400640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c1027c0 0x7f220c19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:37:53.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f220a800640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c1a1690 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f220402ae70 tx=0x7f2204003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:53.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204034040 con 0x7f220c10fa20 2024-07-26T12:37:53.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.090+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220c1a2050 con 0x7f220c10fa20 2024-07-26T12:37:53.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.091+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2204030850 con 0x7f220c10fa20 2024-07-26T12:37:53.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.091+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204004670 con 0x7f220c10fa20 2024-07-26T12:37:53.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.091+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220c1a8810 con 0x7f220c10fa20 2024-07-26T12:37:53.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.092+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220c102280 con 0x7f220c10fa20 2024-07-26T12:37:53.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.096+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2204037020 con 0x7f220c10fa20 2024-07-26T12:37:53.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.098+0000 7f2202a00640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21f00b3c50 0x7f21f00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:53.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.098+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2204104d10 con 0x7f220c10fa20 2024-07-26T12:37:53.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.098+0000 7f2209e00640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21f00b3c50 0x7f21f00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:53.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.099+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2204082600 con 0x7f220c10fa20 2024-07-26T12:37:53.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.099+0000 7f2209e00640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21f00b3c50 0x7f21f00b6160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00bbe0 tx=0x7f21fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.357+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f220c19cf80 con 0x7f220c10fa20 2024-07-26T12:37:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.358+0000 7f2202a00640 1 -- 172.21.15.40:0/3541030710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f22040cc3b0 con 0x7f220c10fa20 2024-07-26T12:37:53.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:37:53.361 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:37:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:37:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21f00b3c50 msgr2=0x7f21f00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21f00b3c50 0x7f21f00b6160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00bbe0 tx=0x7f21fc00b390 comp rx=0 tx=0).stop 2024-07-26T12:37:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 msgr2=0x7f220c1a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c1a1690 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f220402ae70 tx=0x7f2204003f10 comp rx=0 tx=0).stop 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 shutdown_connections 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220c10fa20 0x7f220c1a1690 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f21f00b3c50 0x7f21f00b6160 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f220c1027c0 0x7f220c19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 --2- 172.21.15.40:0/3541030710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f220c101e70 0x7f220c19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.362+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 >> 172.21.15.40:0/3541030710 conn(0x7f220c0fdcf0 msgr2=0x7f220c100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.363+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 shutdown_connections 2024-07-26T12:37:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:53.363+0000 7f220b200640 1 -- 172.21.15.40:0/3541030710 wait complete. 2024-07-26T12:37:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:53 smithi040 ceph-mon[32397]: pgmap v969: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:37:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:53 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3541030710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:53 smithi146 ceph-mon[35807]: pgmap v969: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:37:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:53 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3541030710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:53 smithi076 ceph-mon[35401]: pgmap v969: 97 pgs: 97 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:37:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:53 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3541030710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:37:54.185 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-07-26T12:37:54.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-07-26T12:37:54.713 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:37:55.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:55 smithi040 ceph-mon[32397]: pgmap v970: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-07-26T12:37:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:55 smithi146 ceph-mon[35807]: pgmap v970: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-07-26T12:37:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:55 smithi076 ceph-mon[35401]: pgmap v970: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-07-26T12:37:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 -- 172.21.15.40:0/3853269749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 msgr2=0x7f66dc109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 --2- 172.21.15.40:0/3853269749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc109e60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009900 tx=0x7f66d002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 -- 172.21.15.40:0/3853269749 shutdown_connections 2024-07-26T12:37:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 --2- 172.21.15.40:0/3853269749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10fc90 0x7f66dc1164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 --2- 172.21.15.40:0/3853269749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66dc10f340 0x7f66dc10f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 --2- 172.21.15.40:0/3853269749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc109e60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 -- 172.21.15.40:0/3853269749 >> 172.21.15.40:0/3853269749 conn(0x7f66dc079030 msgr2=0x7f66dc107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 -- 172.21.15.40:0/3853269749 shutdown_connections 2024-07-26T12:37:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.882+0000 7f66e3000640 1 -- 172.21.15.40:0/3853269749 wait complete. 2024-07-26T12:37:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.884+0000 7f66e3000640 1 Processor -- start 2024-07-26T12:37:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.884+0000 7f66e3000640 1 -- start start 2024-07-26T12:37:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.884+0000 7f66e3000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.884+0000 7f66e3000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10f340 0x7f66dc1a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e3000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66dc10fc90 0x7f66dc1a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e3000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc119800 con 0x7f66dc109a50 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e3000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc119680 con 0x7f66dc10f340 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e3000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc119980 con 0x7f66dc10fc90 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc1a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36756/0 (socket says 172.21.15.40:36756) 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e1c00640 1 -- 172.21.15.40:0/4146154948 learned_addr learned my addr 172.21.15.40:0/4146154948 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e1200640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10f340 0x7f66dc1a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.885+0000 7f66e2600640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66dc10fc90 0x7f66dc1a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1c00640 1 -- 172.21.15.40:0/4146154948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66dc10fc90 msgr2=0x7f66dc1a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:56.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1c00640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66dc10fc90 0x7f66dc1a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1c00640 1 -- 172.21.15.40:0/4146154948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10f340 msgr2=0x7f66dc1a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:56.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1c00640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10f340 0x7f66dc1a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1c00640 1 -- 172.21.15.40:0/4146154948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc1a6200 con 0x7f66dc109a50 2024-07-26T12:37:56.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1200640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10f340 0x7f66dc1a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:37:56.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e1c00640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc1a0290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009230 tx=0x7f66d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:56.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66da000640 1 -- 172.21.15.40:0/4146154948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d003f030 con 0x7f66dc109a50 2024-07-26T12:37:56.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc1a6490 con 0x7f66dc109a50 2024-07-26T12:37:56.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.886+0000 7f66da000640 1 -- 172.21.15.40:0/4146154948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66d0003a80 con 0x7f66dc109a50 2024-07-26T12:37:56.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.887+0000 7f66da000640 1 -- 172.21.15.40:0/4146154948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0035070 con 0x7f66dc109a50 2024-07-26T12:37:56.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.887+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc1acc50 con 0x7f66dc109a50 2024-07-26T12:37:56.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 Processor -- start 2024-07-26T12:37:56.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 -- start start 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66da000640 1 -- 172.21.15.40:0/4146154948 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f66d0042030 con 0x7f66dc109a50 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d808f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d808f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d808ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5648d80038a0 con 0x5648d7cbf990 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5648d7ff2da0 con 0x5648d7ce8850 2024-07-26T12:37:56.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.891+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5648d7ff6de0 con 0x5648d7cc7b70 2024-07-26T12:37:56.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d808f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d808f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36760/0 (socket says 172.21.15.40:36760) 2024-07-26T12:37:56.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 -- 172.21.15.40:0/3929906729 learned_addr learned my addr 172.21.15.40:0/3929906729 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:56.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e2600640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d808f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1200640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d808ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 -- 172.21.15.40:0/3929906729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 msgr2=0x5648d808ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d808ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 -- 172.21.15.40:0/3929906729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 msgr2=0x5648d808f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d808f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1c00640 1 -- 172.21.15.40:0/3929906729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d7f87b70 con 0x5648d7cbf990 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e2600640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d808f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:37:56.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.892+0000 7f66e1200640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d808ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.893+0000 7f66e1c00640 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d808f9c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66d010c570 tx=0x7f66d010c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4e3d62d80b2c25 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.893+0000 7f66cea00640 1 -- 172.21.15.40:0/3929906729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0106520 con 0x5648d7cbf990 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.893+0000 7f66cea00640 1 -- 172.21.15.40:0/3929906729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66d0104c60 con 0x5648d7cbf990 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.893+0000 7f66cea00640 1 -- 172.21.15.40:0/3929906729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0115a50 con 0x5648d7cbf990 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.894+0000 7f66da000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66c40b3c40 0x7f66c40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.894+0000 7f66da000640 1 -- 172.21.15.40:0/4146154948 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f66d01043e0 con 0x7f66dc109a50 2024-07-26T12:37:56.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.894+0000 7f66e2600640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66c40b3c40 0x7f66c40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 -- 172.21.15.40:0/3929906729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 msgr2=0x5648d808f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d808f9c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66d010c570 tx=0x7f66d010c660 comp rx=0 tx=0).stop 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 -- 172.21.15.40:0/3929906729 shutdown_connections 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d808ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d808f9c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/3929906729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d808f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 -- 172.21.15.40:0/3929906729 >> 172.21.15.40:0/3929906729 conn(0x5648d7cdcc40 msgr2=0x5648d808d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 -- 172.21.15.40:0/3929906729 shutdown_connections 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.895+0000 7f66eb3f8740 1 -- 172.21.15.40:0/3929906729 wait complete. 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.896+0000 7f66eb3f8740 1 -- start start 2024-07-26T12:37:56.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.896+0000 7f66e2600640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66c40b3c40 0x7f66c40b6150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f66d40092f0 tx=0x7f66d4009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:56.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.896+0000 7f66eb3f8740 1 Processor -- start 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d809af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d809b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d80a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5648d7e567b0 con 0x5648d7cbf990 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5648d7f8f380 con 0x5648d7ce8850 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5648d809da20 con 0x5648d7cc7b70 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66eb3f8740 10 client.0 _ll_register_callbacks cb 0x5648d7f9e830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d809af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d809af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36776/0 (socket says 172.21.15.40:36776) 2024-07-26T12:37:56.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66e1c00640 1 -- 172.21.15.40:0/1827112567 learned_addr learned my addr 172.21.15.40:0/1827112567 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.897+0000 7f66e1200640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d809b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e2600640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d80a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e1c00640 1 -- 172.21.15.40:0/1827112567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 msgr2=0x5648d809b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e1c00640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d809b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e1c00640 1 -- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 msgr2=0x5648d80a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e1c00640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d80a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e1c00640 1 -- 172.21.15.40:0/1827112567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648d7d62ba0 con 0x5648d7cbf990 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66e1c00640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d809af70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f66d0000c00 tx=0x7f66d003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9bbb9e34097b1d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.898+0000 7f66c3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66c3400640 1 -- 172.21.15.40:0/1827112567 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0049030 con 0x5648d7cbf990 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66c3400640 1 -- 172.21.15.40:0/1827112567 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f66d01153f0 con 0x5648d7cbf990 2024-07-26T12:37:56.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66d0104c60 con 0x5648d7cbf990 2024-07-26T12:37:56.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66c3400640 1 -- 172.21.15.40:0/1827112567 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f66d00c71b0 con 0x5648d7cbf990 2024-07-26T12:37:56.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66eb3f8740 10 client.16053 fetch_fsmap learned FSMap version 35 2024-07-26T12:37:56.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5648d80a98b0 con 0x5648d7cbf990 2024-07-26T12:37:56.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.899+0000 7f66c3400640 1 -- 172.21.15.40:0/1827112567 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66d0104c60 con 0x5648d7cbf990 2024-07-26T12:37:56.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66c3400640 1 -- 172.21.15.40:0/1827112567 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f66d00c7580 con 0x5648d7cbf990 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66eb3f8740 10 client.16053 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66eb3f8740 10 client.16053 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66eb3f8740 20 client.16053 populate_metadata read hostname 'smithi040' 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7ca71d0 0x5648d80aca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66eb3f8740 4 client.16053 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.900+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648d80057f0 con 0x5648d7ca71d0 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.901+0000 7f66e1200640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7ca71d0 0x5648d80aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.902+0000 7f66e1200640 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7ca71d0 0x5648d80aca40 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe275d051bfe8aed server_cookie=877b12ab242401f in_seq=0 out_seq=0 2024-07-26T12:37:56.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.902+0000 7f66c3400640 10 client.16053 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:56.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66c3400640 1 -- 172.21.15.40:0/1827112567 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648d80057f0 con 0x5648d7ca71d0 2024-07-26T12:37:56.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66c3400640 10 client.16053 handle_command_reply: tid=0 2024-07-26T12:37:56.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 client.16053 shutdown 2024-07-26T12:37:56.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 msgr2=0x5648d809af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:56.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d809af70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f66d0000c00 tx=0x7f66d003b460 comp rx=0 tx=0).stop 2024-07-26T12:37:56.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 shutdown_connections 2024-07-26T12:37:56.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d80a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cc7b70 0x5648d809b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7ca71d0 0x5648d80aca40 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1827112567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cbf990 0x5648d809af70 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66c3400640 0 client.16053 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:56.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.904+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 >> 172.21.15.40:0/1827112567 conn(0x5648d7cdcc40 msgr2=0x5648d8092610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:56.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.905+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 shutdown_connections 2024-07-26T12:37:56.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.905+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1827112567 wait complete. 2024-07-26T12:37:56.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.905+0000 7f66eb3f8740 20 client.16053 trim_cache size 0 max 16384 2024-07-26T12:37:56.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 Processor -- start 2024-07-26T12:37:56.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 -- start start 2024-07-26T12:37:56.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d808c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7cc7b70 0x5648d808ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 0x5648d80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc1b5250 con 0x5648d7ce8850 2024-07-26T12:37:56.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc1b6d90 con 0x5648d7cc7b70 2024-07-26T12:37:56.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.933+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc1b5920 con 0x5648d7cbf990 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.934+0000 7f66e2600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 0x5648d80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.934+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d808c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.934+0000 7f66e2600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 0x5648d80b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36788/0 (socket says 172.21.15.40:36788) 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.934+0000 7f66e2600640 1 -- 172.21.15.40:0/2831620430 learned_addr learned my addr 172.21.15.40:0/2831620430 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.934+0000 7f66e1200640 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7cc7b70 0x5648d808ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.935+0000 7f66e1c00640 1 -- 172.21.15.40:0/2831620430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7cc7b70 msgr2=0x5648d808ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.935+0000 7f66e1c00640 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7cc7b70 0x5648d808ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.935+0000 7f66e1c00640 1 -- 172.21.15.40:0/2831620430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 msgr2=0x5648d80b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.935+0000 7f66e1c00640 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 0x5648d80b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.935+0000 7f66e1c00640 1 -- 172.21.15.40:0/2831620430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d80acdb0 con 0x5648d7cbf990 2024-07-26T12:37:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.935+0000 7f66e2600640 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 0x5648d80b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:37:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.936+0000 7f66e1c00640 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d808c920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66d00c7370 tx=0x7f66d003b4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6ba9484cbf1c612 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.936+0000 7f66ce000640 1 -- 172.21.15.40:0/2831620430 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0049070 con 0x5648d7cbf990 2024-07-26T12:37:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.937+0000 7f66ce000640 1 -- 172.21.15.40:0/2831620430 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66d00cae00 con 0x5648d7cbf990 2024-07-26T12:37:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.937+0000 7f66ce000640 1 -- 172.21.15.40:0/2831620430 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d00caa60 con 0x5648d7cbf990 2024-07-26T12:37:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 -- 172.21.15.40:0/2831620430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 msgr2=0x5648d808c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d808c920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66d00c7370 tx=0x7f66d003b4d0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 -- 172.21.15.40:0/2831620430 shutdown_connections 2024-07-26T12:37:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7ce8850 0x5648d80b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7cc7b70 0x5648d808ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/2831620430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d808c920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 -- 172.21.15.40:0/2831620430 >> 172.21.15.40:0/2831620430 conn(0x5648d7cdcc40 msgr2=0x5648d80995f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 -- 172.21.15.40:0/2831620430 shutdown_connections 2024-07-26T12:37:56.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.938+0000 7f66eb3f8740 1 -- 172.21.15.40:0/2831620430 wait complete. 2024-07-26T12:37:56.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.939+0000 7f66eb3f8740 1 -- start start 2024-07-26T12:37:56.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.939+0000 7f66eb3f8740 1 Processor -- start 2024-07-26T12:37:56.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d80a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 0x5648d809e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d809ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc1b66c0 con 0x5648d7cc7b70 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc1b5ff0 con 0x5648d7ce8850 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc1b3210 con 0x5648d7cbf990 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66eb3f8740 10 client.0 _ll_register_callbacks cb 0x7f66d003ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66e1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 0x5648d809e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66e1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 0x5648d809e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36798/0 (socket says 172.21.15.40:36798) 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66e1200640 1 -- 172.21.15.40:0/1740657048 learned_addr learned my addr 172.21.15.40:0/1740657048 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.940+0000 7f66e1c00640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d80a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.941+0000 7f66e2600640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d809ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.941+0000 7f66e1200640 1 -- 172.21.15.40:0/1740657048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 msgr2=0x5648d80a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.941+0000 7f66e1200640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d80a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.941+0000 7f66e1200640 1 -- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 msgr2=0x5648d809ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:37:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.941+0000 7f66e1200640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d809ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.941+0000 7f66e1200640 1 -- 172.21.15.40:0/1740657048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648d809f3e0 con 0x5648d7cc7b70 2024-07-26T12:37:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.942+0000 7f66e1200640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 0x5648d809e730 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f66c80058c0 tx=0x7f66c80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30420e7e4083a0de server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:37:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.942+0000 7f66c3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:37:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.942+0000 7f66c3400640 1 -- 172.21.15.40:0/1740657048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c801e600 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.942+0000 7f66c3400640 1 -- 172.21.15.40:0/1740657048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f66c801e7a0 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.942+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66d00cae00 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66c3400640 1 -- 172.21.15.40:0/1740657048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f66c801e9a0 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66eb3f8740 10 client.16059 fetch_fsmap learned FSMap version 35 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5648d8114f80 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66c3400640 1 -- 172.21.15.40:0/1740657048 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66d00cae00 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66c3400640 1 -- 172.21.15.40:0/1740657048 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f66c802f050 con 0x5648d7cc7b70 2024-07-26T12:37:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66eb3f8740 10 client.16059 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:37:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66eb3f8740 10 client.16059 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:37:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66eb3f8740 20 client.16059 populate_metadata read hostname 'smithi040' 2024-07-26T12:37:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.943+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7c7c580 0x5648d8117790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:37:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.944+0000 7f66eb3f8740 4 client.16059 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-07-26T12:37:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.944+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5648d8001290 con 0x5648d7c7c580 2024-07-26T12:37:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.944+0000 7f66e1c00640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7c7c580 0x5648d8117790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:37:56.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.945+0000 7f66e1c00640 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7c7c580 0x5648d8117790 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83794e941448c52f server_cookie=a4a0fcdc77f0a34c in_seq=0 out_seq=0 2024-07-26T12:37:56.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:56.945+0000 7f66c3400640 10 client.16059 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.236+0000 7f66c3400640 1 -- 172.21.15.40:0/1740657048 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5648d8001290 con 0x5648d7c7c580 2024-07-26T12:37:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.236+0000 7f66c3400640 10 client.16059 handle_command_reply: tid=0 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.236+0000 7f66eb3f8740 1 client.16059 shutdown 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 msgr2=0x5648d809e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 0x5648d809e730 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f66c80058c0 tx=0x7f66c80035f0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 shutdown_connections 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5648d7ce8850 0x5648d809ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5648d7c7c580 0x5648d8117790 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5648d7cc7b70 0x5648d809e730 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 --2- 172.21.15.40:0/1740657048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5648d7cbf990 0x5648d80a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 >> 172.21.15.40:0/1740657048 conn(0x5648d7cdcc40 msgr2=0x5648d8099fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.237+0000 7f66c3400640 0 client.16059 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:37:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.238+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 shutdown_connections 2024-07-26T12:37:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.238+0000 7f66eb3f8740 1 -- 172.21.15.40:0/1740657048 wait complete. 2024-07-26T12:37:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.238+0000 7f66eb3f8740 20 client.16059 trim_cache size 0 max 16384 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 50, 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout: "7433b02": { 2024-07-26T12:37:57.241 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 50, 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 140.3, 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:37:57.242 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:37:57.243 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:57.243 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:57.243 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:57.243 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:57.243 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:37:57.243 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.239+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66c40b3c40 msgr2=0x7f66c40b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.239+0000 7f66e3000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66c40b3c40 0x7f66c40b6150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f66d40092f0 tx=0x7f66d4009280 comp rx=0 tx=0).stop 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.239+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 msgr2=0x7f66dc1a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.239+0000 7f66e3000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc1a0290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009230 tx=0x7f66d0004270 comp rx=0 tx=0).stop 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 shutdown_connections 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f66c40b3c40 0x7f66c40b6150 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66dc10fc90 0x7f66dc1a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66dc10f340 0x7f66dc1a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 --2- 172.21.15.40:0/4146154948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66dc109a50 0x7f66dc1a0290 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 >> 172.21.15.40:0/4146154948 conn(0x7f66dc079030 msgr2=0x7f66dc107fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 shutdown_connections 2024-07-26T12:37:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:37:57.240+0000 7f66e3000640 1 -- 172.21.15.40:0/4146154948 wait complete. 2024-07-26T12:37:57.958 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:57 smithi040 ceph-mon[32397]: pgmap v971: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-07-26T12:37:58.044 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7433b02', quiesce took 7.6 seconds. Will release after: 12.750000000000002 2024-07-26T12:37:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:57 smithi146 ceph-mon[35807]: pgmap v971: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-07-26T12:37:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:57 smithi076 ceph-mon[35401]: pgmap v971: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-07-26T12:37:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:37:59 smithi040 ceph-mon[32397]: pgmap v972: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:38:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:37:59 smithi146 ceph-mon[35807]: pgmap v972: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:38:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:37:59 smithi076 ceph-mon[35401]: pgmap v972: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:38:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:01 smithi040 ceph-mon[32397]: pgmap v973: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:38:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:01 smithi146 ceph-mon[35807]: pgmap v973: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:38:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:01 smithi076 ceph-mon[35401]: pgmap v973: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:38:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:03 smithi040 ceph-mon[32397]: pgmap v974: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:38:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:03 smithi146 ceph-mon[35807]: pgmap v974: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:38:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:03 smithi076 ceph-mon[35401]: pgmap v974: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:38:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:05 smithi040 ceph-mon[32397]: pgmap v975: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-07-26T12:38:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:05 smithi146 ceph-mon[35807]: pgmap v975: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-07-26T12:38:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:05 smithi076 ceph-mon[35401]: pgmap v975: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-07-26T12:38:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:07 smithi146 ceph-mon[35807]: pgmap v976: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.7 MiB/s wr, 10 op/s 2024-07-26T12:38:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:07 smithi076 ceph-mon[35401]: pgmap v976: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.7 MiB/s wr, 10 op/s 2024-07-26T12:38:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:07 smithi040 ceph-mon[32397]: pgmap v976: 97 pgs: 97 active+clean; 2.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.7 MiB/s wr, 10 op/s 2024-07-26T12:38:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:09 smithi146 ceph-mon[35807]: pgmap v977: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T12:38:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:09 smithi076 ceph-mon[35401]: pgmap v977: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T12:38:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:09 smithi040 ceph-mon[32397]: pgmap v977: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T12:38:10.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:38:11.305 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:38:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:11 smithi146 ceph-mon[35807]: pgmap v978: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 544 KiB/s wr, 11 op/s 2024-07-26T12:38:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:11 smithi076 ceph-mon[35401]: pgmap v978: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 544 KiB/s wr, 11 op/s 2024-07-26T12:38:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:11 smithi040 ceph-mon[32397]: pgmap v978: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 544 KiB/s wr, 11 op/s 2024-07-26T12:38:13.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.577+0000 7f5381a00640 1 -- 172.21.15.40:0/1729129737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c1141a0 msgr2=0x7f537c1165c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:13.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.577+0000 7f5381a00640 1 --2- 172.21.15.40:0/1729129737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c1141a0 0x7f537c1165c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5374009900 tx=0x7f537402a400 comp rx=0 tx=0).stop 2024-07-26T12:38:13.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 -- 172.21.15.40:0/1729129737 shutdown_connections 2024-07-26T12:38:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 --2- 172.21.15.40:0/1729129737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c1141a0 0x7f537c1165c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 --2- 172.21.15.40:0/1729129737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 0x7f537c113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 --2- 172.21.15.40:0/1729129737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f537c077370 0x7f537c077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 -- 172.21.15.40:0/1729129737 >> 172.21.15.40:0/1729129737 conn(0x7f537c1011f0 msgr2=0x7f537c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 -- 172.21.15.40:0/1729129737 shutdown_connections 2024-07-26T12:38:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.578+0000 7f5381a00640 1 -- 172.21.15.40:0/1729129737 wait complete. 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.579+0000 7f5381a00640 1 Processor -- start 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 -- start start 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 0x7f537c1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 0x7f537c1a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f537c1141a0 0x7f537c1a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f537c119a00 con 0x7f537c077370 2024-07-26T12:38:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f537c119880 con 0x7f537c077cc0 2024-07-26T12:38:13.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f5381a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f537c119b80 con 0x7f537c1141a0 2024-07-26T12:38:13.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.580+0000 7f537aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 0x7f537c1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:13.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 0x7f537c1a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59310/0 (socket says 172.21.15.40:59310) 2024-07-26T12:38:13.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 -- 172.21.15.40:0/1958756997 learned_addr learned my addr 172.21.15.40:0/1958756997 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:38:13.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537b400640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f537c1141a0 0x7f537c1a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:13.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537a000640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 0x7f537c1a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 -- 172.21.15.40:0/1958756997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f537c1141a0 msgr2=0x7f537c1a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f537c1141a0 0x7f537c1a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 -- 172.21.15.40:0/1958756997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 msgr2=0x7f537c1a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 0x7f537c1a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537aa00640 1 -- 172.21.15.40:0/1958756997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c1a61e0 con 0x7f537c077370 2024-07-26T12:38:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.581+0000 7f537a000640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 0x7f537c1a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:38:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.582+0000 7f537aa00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 0x7f537c1a0330 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f536c00cce0 tx=0x7f536c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.582+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c00f650 con 0x7f537c077370 2024-07-26T12:38:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.582+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f536c00fc80 con 0x7f537c077370 2024-07-26T12:38:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.582+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c018ae0 con 0x7f537c077370 2024-07-26T12:38:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.582+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c1a64d0 con 0x7f537c077370 2024-07-26T12:38:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.582+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c1accf0 con 0x7f537c077370 2024-07-26T12:38:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.583+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c077780 con 0x7f537c077370 2024-07-26T12:38:13.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.588+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f536c018c80 con 0x7f537c077370 2024-07-26T12:38:13.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.589+0000 7f5373400640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53600b3c80 0x7f53600b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.590+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f536c0e4390 con 0x7f537c077370 2024-07-26T12:38:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.590+0000 7f537a000640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53600b3c80 0x7f53600b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.591+0000 7f537a000640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53600b3c80 0x7f53600b6190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f537c079c80 tx=0x7f536800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.591+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f536c014030 con 0x7f537c077370 2024-07-26T12:38:13.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:13 smithi040 ceph-mon[32397]: pgmap v979: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 544 KiB/s wr, 9 op/s 2024-07-26T12:38:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.836+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f537c1a1460 con 0x7f537c077370 2024-07-26T12:38:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.837+0000 7f5373400640 1 -- 172.21.15.40:0/1958756997 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f536c0abab0 con 0x7f537c077370 2024-07-26T12:38:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:38:13.840 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:38:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:38:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53600b3c80 msgr2=0x7f53600b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53600b3c80 0x7f53600b6190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f537c079c80 tx=0x7f536800a5c0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 msgr2=0x7f537c1a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 0x7f537c1a0330 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f536c00cce0 tx=0x7f536c00a620 comp rx=0 tx=0).stop 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 shutdown_connections 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53600b3c80 0x7f53600b6190 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f537c1141a0 0x7f537c1a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f537c077cc0 0x7f537c1a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 --2- 172.21.15.40:0/1958756997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537c077370 0x7f537c1a0330 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 >> 172.21.15.40:0/1958756997 conn(0x7f537c1011f0 msgr2=0x7f537c103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 shutdown_connections 2024-07-26T12:38:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:13.841+0000 7f5381a00640 1 -- 172.21.15.40:0/1958756997 wait complete. 2024-07-26T12:38:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:13 smithi146 ceph-mon[35807]: pgmap v979: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 544 KiB/s wr, 9 op/s 2024-07-26T12:38:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:13 smithi076 ceph-mon[35401]: pgmap v979: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 544 KiB/s wr, 9 op/s 2024-07-26T12:38:14.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 7433b02 --release --await' 2024-07-26T12:38:14.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 7433b02 --release --await 2024-07-26T12:38:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:14 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1958756997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:38:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:14 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1958756997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:38:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:14 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1958756997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:38:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:38:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:15 smithi040 ceph-mon[32397]: pgmap v980: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 544 KiB/s wr, 12 op/s 2024-07-26T12:38:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:15 smithi146 ceph-mon[35807]: pgmap v980: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 544 KiB/s wr, 12 op/s 2024-07-26T12:38:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:15 smithi076 ceph-mon[35401]: pgmap v980: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 544 KiB/s wr, 12 op/s 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 -- 172.21.15.40:0/3269688575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 msgr2=0x7fbd0c1046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 --2- 172.21.15.40:0/3269688575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1046a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009900 tx=0x7fbcfc02a410 comp rx=0 tx=0).stop 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 -- 172.21.15.40:0/3269688575 shutdown_connections 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 --2- 172.21.15.40:0/3269688575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c10d840 0x7fbd0c10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 --2- 172.21.15.40:0/3269688575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd0c104cc0 0x7fbd0c10d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 --2- 172.21.15.40:0/3269688575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1046a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 -- 172.21.15.40:0/3269688575 >> 172.21.15.40:0/3269688575 conn(0x7fbd0c079160 msgr2=0x7fbd0c079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.448+0000 7fbd11400640 1 -- 172.21.15.40:0/3269688575 shutdown_connections 2024-07-26T12:38:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.449+0000 7fbd11400640 1 -- 172.21.15.40:0/3269688575 wait complete. 2024-07-26T12:38:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.450+0000 7fbd11400640 1 Processor -- start 2024-07-26T12:38:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.450+0000 7fbd11400640 1 -- start start 2024-07-26T12:38:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd11400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd11400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd0c104cc0 0x7fbd0c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd11400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c10d840 0x7fbd0c1ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd11400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c113390 con 0x7fbd0c104290 2024-07-26T12:38:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd11400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c113210 con 0x7fbd0c104cc0 2024-07-26T12:38:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd11400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c113510 con 0x7fbd0c10d840 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59332/0 (socket says 172.21.15.40:59332) 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd0a800640 1 -- 172.21.15.40:0/2363539647 learned_addr learned my addr 172.21.15.40:0/2363539647 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.451+0000 7fbd03e00640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd0c104cc0 0x7fbd0c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0b200640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c10d840 0x7fbd0c1ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0a800640 1 -- 172.21.15.40:0/2363539647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c10d840 msgr2=0x7fbd0c1ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0a800640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c10d840 0x7fbd0c1ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0a800640 1 -- 172.21.15.40:0/2363539647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd0c104cc0 msgr2=0x7fbd0c1a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0a800640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd0c104cc0 0x7fbd0c1a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0a800640 1 -- 172.21.15.40:0/2363539647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c1ac630 con 0x7fbd0c104290 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.452+0000 7fbd0a800640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1a1070 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc02a930 tx=0x7fbcfc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.453+0000 7fbd03400640 1 -- 172.21.15.40:0/2363539647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc03f070 con 0x7fbd0c104290 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.453+0000 7fbd03400640 1 -- 172.21.15.40:0/2363539647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcfc003e40 con 0x7fbd0c104290 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.453+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c1ac800 con 0x7fbd0c104290 2024-07-26T12:38:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.453+0000 7fbd03400640 1 -- 172.21.15.40:0/2363539647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc035030 con 0x7fbd0c104290 2024-07-26T12:38:17.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.453+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c1acc50 con 0x7fbd0c104290 2024-07-26T12:38:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.457+0000 7fbd03400640 1 -- 172.21.15.40:0/2363539647 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbcfc042070 con 0x7fbd0c104290 2024-07-26T12:38:17.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.458+0000 7fbd1803b740 1 Processor -- start 2024-07-26T12:38:17.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 -- start start 2024-07-26T12:38:17.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd03400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbcf00b3c50 0x7fbcf00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd03400640 1 -- 172.21.15.40:0/2363539647 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbcfc104400 con 0x7fbd0c104290 2024-07-26T12:38:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 0x562ae79b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae75f1840 0x562ae79b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562ae792df50 con 0x562ae7612520 2024-07-26T12:38:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562ae791d450 con 0x562ae75e9660 2024-07-26T12:38:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd1803b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562ae7921490 con 0x562ae75f1840 2024-07-26T12:38:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.459+0000 7fbd0b200640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbcf00b3c50 0x7fbcf00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 0x562ae79b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 0x562ae79b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59344/0 (socket says 172.21.15.40:59344) 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 -- 172.21.15.40:0/2456845053 learned_addr learned my addr 172.21.15.40:0/2456845053 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd03e00640 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 -- 172.21.15.40:0/2456845053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae75f1840 msgr2=0x562ae79b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae75f1840 0x562ae79b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 -- 172.21.15.40:0/2456845053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 msgr2=0x562ae79b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.460+0000 7fbd0a800640 1 -- 172.21.15.40:0/2456845053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae767db00 con 0x562ae7612520 2024-07-26T12:38:17.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.461+0000 7fbd0b200640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbcf00b3c50 0x7fbcf00b6160 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd04005fd0 tx=0x7fbd0400f730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.461+0000 7fbd0a800640 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 0x562ae79b6fe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0c7390 tx=0x7fbcfc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be847e6f5f026b58 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.461+0000 7fbcfb400640 1 -- 172.21.15.40:0/2456845053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc049070 con 0x562ae7612520 2024-07-26T12:38:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.461+0000 7fbcfb400640 1 -- 172.21.15.40:0/2456845053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcfc0cf910 con 0x562ae7612520 2024-07-26T12:38:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.461+0000 7fbcfb400640 1 -- 172.21.15.40:0/2456845053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0cb7d0 con 0x562ae7612520 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 -- 172.21.15.40:0/2456845053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 msgr2=0x562ae79b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 0x562ae79b6fe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0c7390 tx=0x7fbcfc009260 comp rx=0 tx=0).stop 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 -- 172.21.15.40:0/2456845053 shutdown_connections 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae75f1840 0x562ae79b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 --2- 172.21.15.40:0/2456845053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae7612520 0x562ae79b6fe0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.462+0000 7fbd1803b740 1 -- 172.21.15.40:0/2456845053 >> 172.21.15.40:0/2456845053 conn(0x562ae7606910 msgr2=0x562ae79b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.463+0000 7fbd1803b740 1 -- 172.21.15.40:0/2456845053 shutdown_connections 2024-07-26T12:38:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.463+0000 7fbd1803b740 1 -- 172.21.15.40:0/2456845053 wait complete. 2024-07-26T12:38:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.463+0000 7fbd1803b740 1 -- start start 2024-07-26T12:38:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.463+0000 7fbd1803b740 1 Processor -- start 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562ae7780bb0 con 0x562ae75f1840 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562ae78b9930 con 0x562ae75e9660 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562ae79c5580 con 0x562ae7612520 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd1803b740 10 client.0 _ll_register_callbacks cb 0x562ae7629d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.464+0000 7fbd03e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59352/0 (socket says 172.21.15.40:59352) 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 -- 172.21.15.40:0/739008922 learned_addr learned my addr 172.21.15.40:0/739008922 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:38:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd0a800640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd0b200640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 -- 172.21.15.40:0/739008922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 msgr2=0x562ae79ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 -- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 msgr2=0x562ae79c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.465+0000 7fbd03e00640 1 -- 172.21.15.40:0/739008922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae76f4960 con 0x562ae75f1840 2024-07-26T12:38:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.466+0000 7fbd03e00640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c2bf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ba20 tx=0x7fbcf400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2016e380ffe8f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.466+0000 7fbcefe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:38:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.466+0000 7fbcefe00640 1 -- 172.21.15.40:0/739008922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf401b640 con 0x562ae75f1840 2024-07-26T12:38:17.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.466+0000 7fbcefe00640 1 -- 172.21.15.40:0/739008922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbcf401b7e0 con 0x562ae75f1840 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.466+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcfc0cf910 con 0x562ae75f1840 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.466+0000 7fbcefe00640 1 -- 172.21.15.40:0/739008922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbcf4003e40 con 0x562ae75f1840 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbd1803b740 10 client.16077 fetch_fsmap learned FSMap version 35 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562ae79d11a0 con 0x562ae75f1840 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbcefe00640 1 -- 172.21.15.40:0/739008922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcfc0cf910 con 0x562ae75f1840 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbcefe00640 1 -- 172.21.15.40:0/739008922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fbcf4019020 con 0x562ae75f1840 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbd1803b740 10 client.16077 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbd1803b740 10 client.16077 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbd1803b740 20 client.16077 populate_metadata read hostname 'smithi040' 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.467+0000 7fbd1803b740 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75d0ea0 0x562ae79d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.468+0000 7fbd1803b740 4 client.16077 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:38:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.468+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ae792fea0 con 0x562ae75d0ea0 2024-07-26T12:38:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.468+0000 7fbd0a800640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75d0ea0 0x562ae79d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.469+0000 7fbd0a800640 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75d0ea0 0x562ae79d4700 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465247686e573ea server_cookie=f32dd7e6c0c134f in_seq=0 out_seq=0 2024-07-26T12:38:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.469+0000 7fbcefe00640 10 client.16077 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:38:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.471+0000 7fbcefe00640 1 -- 172.21.15.40:0/739008922 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ae792fea0 con 0x562ae75d0ea0 2024-07-26T12:38:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.471+0000 7fbcefe00640 10 client.16077 handle_command_reply: tid=0 2024-07-26T12:38:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.471+0000 7fbd1803b740 1 client.16077 shutdown 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.471+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 msgr2=0x562ae79c2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.471+0000 7fbd1803b740 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c2bf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ba20 tx=0x7fbcf400bee0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.471+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 shutdown_connections 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75d0ea0 0x562ae79d4700 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c2bf0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 --2- 172.21.15.40:0/739008922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbcefe00640 0 client.16077 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 >> 172.21.15.40:0/739008922 conn(0x562ae7606910 msgr2=0x562ae79b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 shutdown_connections 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 1 -- 172.21.15.40:0/739008922 wait complete. 2024-07-26T12:38:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.472+0000 7fbd1803b740 20 client.16077 trim_cache size 0 max 16384 2024-07-26T12:38:17.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 Processor -- start 2024-07-26T12:38:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 -- start start 2024-07-26T12:38:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 0x562ae79ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75f1840 0x562ae79cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b5380 con 0x562ae75e9660 2024-07-26T12:38:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b6ec0 con 0x562ae75f1840 2024-07-26T12:38:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.491+0000 7fbd1803b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b5a50 con 0x562ae7612520 2024-07-26T12:38:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.492+0000 7fbd0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 0x562ae79ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.492+0000 7fbd0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 0x562ae79ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59354/0 (socket says 172.21.15.40:59354) 2024-07-26T12:38:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.492+0000 7fbd0a800640 1 -- 172.21.15.40:0/4158485336 learned_addr learned my addr 172.21.15.40:0/4158485336 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:38:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.492+0000 7fbd0b200640 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.492+0000 7fbd03e00640 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75f1840 0x562ae79cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbd0a800640 1 -- 172.21.15.40:0/4158485336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 msgr2=0x562ae79bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbd0a800640 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbd0a800640 1 -- 172.21.15.40:0/4158485336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75f1840 msgr2=0x562ae79cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbd0a800640 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75f1840 0x562ae79cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbd0a800640 1 -- 172.21.15.40:0/4158485336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae79c3970 con 0x562ae75e9660 2024-07-26T12:38:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbd0a800640 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 0x562ae79ce590 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0c8580 tx=0x7fbcfc0cb490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58557d6b47e5a4c8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbcfaa00640 1 -- 172.21.15.40:0/4158485336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0aa070 con 0x562ae75e9660 2024-07-26T12:38:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbcfaa00640 1 -- 172.21.15.40:0/4158485336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcfc0e5e50 con 0x562ae75e9660 2024-07-26T12:38:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.493+0000 7fbcfaa00640 1 -- 172.21.15.40:0/4158485336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0e7e60 con 0x562ae75e9660 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 -- 172.21.15.40:0/4158485336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 msgr2=0x562ae79ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 0x562ae79ce590 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0c8580 tx=0x7fbcfc0cb490 comp rx=0 tx=0).stop 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 -- 172.21.15.40:0/4158485336 shutdown_connections 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae79bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75f1840 0x562ae79cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 --2- 172.21.15.40:0/4158485336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75e9660 0x562ae79ce590 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 -- 172.21.15.40:0/4158485336 >> 172.21.15.40:0/4158485336 conn(0x562ae7606910 msgr2=0x562ae79bce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 -- 172.21.15.40:0/4158485336 shutdown_connections 2024-07-26T12:38:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.495+0000 7fbd1803b740 1 -- 172.21.15.40:0/4158485336 wait complete. 2024-07-26T12:38:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.496+0000 7fbd1803b740 1 -- start start 2024-07-26T12:38:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.496+0000 7fbd1803b740 1 Processor -- start 2024-07-26T12:38:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae7a34ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b67f0 con 0x562ae75f1840 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b6120 con 0x562ae75e9660 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b3340 con 0x562ae7612520 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.497+0000 7fbd1803b740 10 client.0 _ll_register_callbacks cb 0x7fbcf4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59362/0 (socket says 172.21.15.40:59362) 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 -- 172.21.15.40:0/277411335 learned_addr learned my addr 172.21.15.40:0/277411335 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:38:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd0a800640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd0b200640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae7a34ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 -- 172.21.15.40:0/277411335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 msgr2=0x562ae7a34ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae7a34ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 -- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 msgr2=0x562ae79c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.498+0000 7fbd03e00640 1 -- 172.21.15.40:0/277411335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae7a35510 con 0x562ae75f1840 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.499+0000 7fbd03e00640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c9610 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4001eb0 tx=0x7fbcf4005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38ac17527421b2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:38:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.499+0000 7fbcefe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.499+0000 7fbcefe00640 1 -- 172.21.15.40:0/277411335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4034060 con 0x562ae75f1840 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.499+0000 7fbcefe00640 1 -- 172.21.15.40:0/277411335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbcf4005240 con 0x562ae75f1840 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.499+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcfc0e5e50 con 0x562ae75f1840 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.500+0000 7fbcefe00640 1 -- 172.21.15.40:0/277411335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbcf402b040 con 0x562ae75f1840 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.500+0000 7fbd1803b740 10 client.16083 fetch_fsmap learned FSMap version 35 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.500+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562ae7a3da10 con 0x562ae75f1840 2024-07-26T12:38:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.500+0000 7fbcefe00640 1 -- 172.21.15.40:0/277411335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcfc0e5e50 con 0x562ae75f1840 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbcefe00640 1 -- 172.21.15.40:0/277411335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fbcf4039070 con 0x562ae75f1840 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd1803b740 10 client.16083 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd1803b740 10 client.16083 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd1803b740 20 client.16083 populate_metadata read hostname 'smithi040' 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd1803b740 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75a6250 0x562ae7a40170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd1803b740 4 client.16083 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7433b02", "release": true, "await": true}] 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7433b02", "release": true, "await": true}) -- 0x562ae792b940 con 0x562ae75a6250 2024-07-26T12:38:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.501+0000 7fbd0a800640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75a6250 0x562ae7a40170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:38:17.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.502+0000 7fbd0a800640 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75a6250 0x562ae7a40170 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bae31b06bc7d31ea server_cookie=d03409fe502b851f in_seq=0 out_seq=0 2024-07-26T12:38:17.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.502+0000 7fbcefe00640 10 client.16083 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:38:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.547+0000 7fbcefe00640 1 -- 172.21.15.40:0/277411335 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562ae792b940 con 0x562ae75a6250 2024-07-26T12:38:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.547+0000 7fbcefe00640 10 client.16083 handle_command_reply: tid=0 2024-07-26T12:38:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.547+0000 7fbd1803b740 1 client.16083 shutdown 2024-07-26T12:38:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 msgr2=0x562ae79c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c9610 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4001eb0 tx=0x7fbcf4005e50 comp rx=0 tx=0).stop 2024-07-26T12:38:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 shutdown_connections 2024-07-26T12:38:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ae7612520 0x562ae7a34ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562ae75a6250 0x562ae7a40170 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562ae75f1840 0x562ae79c9610 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 --2- 172.21.15.40:0/277411335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ae75e9660 0x562ae79c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 >> 172.21.15.40:0/277411335 conn(0x562ae7606910 msgr2=0x562ae79bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbcefe00640 0 client.16083 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 shutdown_connections 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.548+0000 7fbd1803b740 1 -- 172.21.15.40:0/277411335 wait complete. 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.549+0000 7fbd1803b740 20 client.16083 trim_cache size 0 max 16384 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:38:17.551 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 52, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "7433b02": { 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 52, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:38:17.552 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 140.3, 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:38:17.553 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbcf00b3c50 msgr2=0x7fbcf00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbcf00b3c50 0x7fbcf00b6160 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd04005fd0 tx=0x7fbd0400f730 comp rx=0 tx=0).stop 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 msgr2=0x7fbd0c1a1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1a1070 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc02a930 tx=0x7fbcfc003c20 comp rx=0 tx=0).stop 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 shutdown_connections 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbcf00b3c50 0x7fbcf00b6160 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c10d840 0x7fbd0c1ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd0c104cc0 0x7fbd0c1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 --2- 172.21.15.40:0/2363539647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd0c104290 0x7fbd0c1a1070 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:38:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 >> 172.21.15.40:0/2363539647 conn(0x7fbd0c079160 msgr2=0x7fbd0c10b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:38:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 shutdown_connections 2024-07-26T12:38:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:38:17.550+0000 7fbd11400640 1 -- 172.21.15.40:0/2363539647 wait complete. 2024-07-26T12:38:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:17 smithi146 ceph-mon[35807]: pgmap v981: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 202 KiB/s wr, 8 op/s 2024-07-26T12:38:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:38:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:17 smithi076 ceph-mon[35401]: pgmap v981: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 202 KiB/s wr, 8 op/s 2024-07-26T12:38:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:38:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:17 smithi040 ceph-mon[32397]: pgmap v981: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 202 KiB/s wr, 8 op/s 2024-07-26T12:38:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:38:18.368 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7433b02', total seconds elapsed: 27.9 2024-07-26T12:38:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:38:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:38:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:38:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: pgmap v982: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 202 KiB/s wr, 10 op/s 2024-07-26T12:38:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:38:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:38:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:19 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: pgmap v982: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 202 KiB/s wr, 10 op/s 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:19 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:38:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:38:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: pgmap v982: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 202 KiB/s wr, 10 op/s 2024-07-26T12:38:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:20.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:38:20.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:38:20.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:19 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:38:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:21 smithi146 ceph-mon[35807]: pgmap v983: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:38:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:21 smithi076 ceph-mon[35401]: pgmap v983: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:38:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:21 smithi040 ceph-mon[32397]: pgmap v983: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:38:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:23 smithi146 ceph-mon[35807]: pgmap v984: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 821 KiB/s wr, 8 op/s 2024-07-26T12:38:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:23 smithi076 ceph-mon[35401]: pgmap v984: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 821 KiB/s wr, 8 op/s 2024-07-26T12:38:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:23 smithi040 ceph-mon[32397]: pgmap v984: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 821 KiB/s wr, 8 op/s 2024-07-26T12:38:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:25 smithi076 ceph-mon[35401]: pgmap v985: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:38:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:25 smithi040 ceph-mon[32397]: pgmap v985: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:38:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:25 smithi146 ceph-mon[35807]: pgmap v985: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:38:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:27 smithi076 ceph-mon[35401]: pgmap v986: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T12:38:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:27 smithi040 ceph-mon[32397]: pgmap v986: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T12:38:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:27 smithi146 ceph-mon[35807]: pgmap v986: 97 pgs: 97 active+clean; 2.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T12:38:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:29 smithi040 ceph-mon[32397]: pgmap v987: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T12:38:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:29 smithi146 ceph-mon[35807]: pgmap v987: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T12:38:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:29 smithi076 ceph-mon[35401]: pgmap v987: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T12:38:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:30 smithi040 ceph-mon[32397]: pgmap v988: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:38:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:30 smithi146 ceph-mon[35807]: pgmap v988: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:38:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:30 smithi076 ceph-mon[35401]: pgmap v988: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:38:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:33 smithi146 ceph-mon[35807]: pgmap v989: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.5 MiB/s wr, 10 op/s 2024-07-26T12:38:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:33 smithi076 ceph-mon[35401]: pgmap v989: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.5 MiB/s wr, 10 op/s 2024-07-26T12:38:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:33 smithi040 ceph-mon[32397]: pgmap v989: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.5 MiB/s wr, 10 op/s 2024-07-26T12:38:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:35 smithi146 ceph-mon[35807]: pgmap v990: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:38:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:35 smithi076 ceph-mon[35401]: pgmap v990: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:38:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:35 smithi040 ceph-mon[32397]: pgmap v990: 97 pgs: 97 active+clean; 2.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:38:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:37 smithi146 ceph-mon[35807]: pgmap v991: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:38:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:37 smithi076 ceph-mon[35401]: pgmap v991: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:38:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:37 smithi040 ceph-mon[32397]: pgmap v991: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:38:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:39 smithi146 ceph-mon[35807]: pgmap v992: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:38:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:39 smithi076 ceph-mon[35401]: pgmap v992: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:38:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:39 smithi040 ceph-mon[32397]: pgmap v992: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:38:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:41 smithi146 ceph-mon[35807]: pgmap v993: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:38:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:41 smithi076 ceph-mon[35401]: pgmap v993: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:38:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:41 smithi040 ceph-mon[32397]: pgmap v993: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:38:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:43 smithi146 ceph-mon[35807]: pgmap v994: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:38:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:43 smithi076 ceph-mon[35401]: pgmap v994: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:38:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:43 smithi040 ceph-mon[32397]: pgmap v994: 97 pgs: 97 active+clean; 2.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:38:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:45 smithi076 ceph-mon[35401]: pgmap v995: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:38:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:45 smithi040 ceph-mon[32397]: pgmap v995: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:38:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:45 smithi146 ceph-mon[35807]: pgmap v995: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:38:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:47 smithi076 ceph-mon[35401]: pgmap v996: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:38:47.973 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:47 smithi040 ceph-mon[32397]: pgmap v996: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:38:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:47 smithi146 ceph-mon[35807]: pgmap v996: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:38:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:49 smithi040 ceph-mon[32397]: pgmap v997: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:38:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:49 smithi146 ceph-mon[35807]: pgmap v997: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:38:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:49 smithi076 ceph-mon[35401]: pgmap v997: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:38:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:51 smithi040 ceph-mon[32397]: pgmap v998: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:38:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:51 smithi146 ceph-mon[35807]: pgmap v998: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:38:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:51 smithi076 ceph-mon[35401]: pgmap v998: 97 pgs: 97 active+clean; 2.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:38:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:53 smithi040 ceph-mon[32397]: pgmap v999: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:38:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:53 smithi146 ceph-mon[35807]: pgmap v999: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:38:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:53 smithi076 ceph-mon[35401]: pgmap v999: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:38:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:55 smithi040 ceph-mon[32397]: pgmap v1000: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:38:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:55 smithi146 ceph-mon[35807]: pgmap v1000: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:38:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:55 smithi076 ceph-mon[35401]: pgmap v1000: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:38:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:57 smithi040 ceph-mon[32397]: pgmap v1001: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:38:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:57 smithi146 ceph-mon[35807]: pgmap v1001: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:38:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:57 smithi076 ceph-mon[35401]: pgmap v1001: 97 pgs: 97 active+clean; 2.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:38:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:38:59 smithi040 ceph-mon[32397]: pgmap v1002: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:39:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:38:59 smithi146 ceph-mon[35807]: pgmap v1002: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:39:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:38:59 smithi076 ceph-mon[35401]: pgmap v1002: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:39:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:01 smithi040 ceph-mon[32397]: pgmap v1003: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:01 smithi146 ceph-mon[35807]: pgmap v1003: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:01 smithi076 ceph-mon[35401]: pgmap v1003: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:03 smithi040 ceph-mon[32397]: pgmap v1004: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:39:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:03 smithi146 ceph-mon[35807]: pgmap v1004: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:39:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:03 smithi076 ceph-mon[35401]: pgmap v1004: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:39:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:05 smithi040 ceph-mon[32397]: pgmap v1005: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:39:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:05 smithi146 ceph-mon[35807]: pgmap v1005: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:39:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:05 smithi076 ceph-mon[35401]: pgmap v1005: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:39:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:07 smithi040 ceph-mon[32397]: pgmap v1006: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:39:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:07 smithi146 ceph-mon[35807]: pgmap v1006: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:39:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:07 smithi076 ceph-mon[35401]: pgmap v1006: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:39:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:09 smithi040 ceph-mon[32397]: pgmap v1007: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:39:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:09 smithi146 ceph-mon[35807]: pgmap v1007: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:39:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:09 smithi076 ceph-mon[35401]: pgmap v1007: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:39:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:11 smithi040 ceph-mon[32397]: pgmap v1008: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:39:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:11 smithi146 ceph-mon[35807]: pgmap v1008: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:39:12.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:11 smithi076 ceph-mon[35401]: pgmap v1008: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:39:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:13 smithi040 ceph-mon[32397]: pgmap v1009: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:39:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:13 smithi146 ceph-mon[35807]: pgmap v1009: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:39:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:13 smithi076 ceph-mon[35401]: pgmap v1009: 97 pgs: 97 active+clean; 2.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:39:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:15 smithi040 ceph-mon[32397]: pgmap v1010: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:39:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:15 smithi146 ceph-mon[35807]: pgmap v1010: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:39:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:15 smithi076 ceph-mon[35401]: pgmap v1010: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:39:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:17 smithi040 ceph-mon[32397]: pgmap v1011: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:39:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:17 smithi146 ceph-mon[35807]: pgmap v1011: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:39:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:17 smithi076 ceph-mon[35401]: pgmap v1011: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:39:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:19 smithi040 ceph-mon[32397]: pgmap v1012: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:39:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:19 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:39:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:19 smithi146 ceph-mon[35807]: pgmap v1012: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:39:20.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:19 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:39:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:19 smithi076 ceph-mon[35401]: pgmap v1012: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:39:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:19 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: pgmap v1013: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: pgmap v1013: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: pgmap v1013: 97 pgs: 97 active+clean; 2.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:21.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:39:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:39:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:39:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:39:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:39:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:39:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:39:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:22 smithi040 ceph-mon[32397]: pgmap v1014: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:39:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:22 smithi146 ceph-mon[35807]: pgmap v1014: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:39:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:22 smithi076 ceph-mon[35401]: pgmap v1014: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:39:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:25 smithi146 ceph-mon[35807]: pgmap v1015: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:39:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:25 smithi076 ceph-mon[35401]: pgmap v1015: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:39:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:25 smithi040 ceph-mon[32397]: pgmap v1015: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:39:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:27 smithi146 ceph-mon[35807]: pgmap v1016: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:39:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:27 smithi076 ceph-mon[35401]: pgmap v1016: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:39:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:27 smithi040 ceph-mon[32397]: pgmap v1016: 97 pgs: 97 active+clean; 2.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:39:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:29 smithi076 ceph-mon[35401]: pgmap v1017: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:39:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:29 smithi040 ceph-mon[32397]: pgmap v1017: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:39:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:29 smithi146 ceph-mon[35807]: pgmap v1017: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:39:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:31 smithi040 ceph-mon[32397]: pgmap v1018: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:39:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:31 smithi146 ceph-mon[35807]: pgmap v1018: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:39:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:31 smithi076 ceph-mon[35401]: pgmap v1018: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:39:33.955 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.8 2024-07-26T12:39:33.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:39:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:33 smithi040 ceph-mon[32397]: pgmap v1019: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:39:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:33 smithi146 ceph-mon[35807]: pgmap v1019: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:39:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:33 smithi076 ceph-mon[35401]: pgmap v1019: 97 pgs: 97 active+clean; 2.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:39:34.455 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:39:35.963 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:35 smithi040 ceph-mon[32397]: pgmap v1020: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:39:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:35 smithi146 ceph-mon[35807]: pgmap v1020: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:39:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:35 smithi076 ceph-mon[35401]: pgmap v1020: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:39:37.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.056+0000 7f8f8e400640 1 -- 172.21.15.40:0/1304389885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88108d40 msgr2=0x7f8f88109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:37.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.056+0000 7f8f8e400640 1 --2- 172.21.15.40:0/1304389885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88108d40 0x7f8f88109150 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009900 tx=0x7f8f7402a3f0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 -- 172.21.15.40:0/1304389885 shutdown_connections 2024-07-26T12:39:37.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 --2- 172.21.15.40:0/1304389885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f88109690 0x7f8f8810fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 --2- 172.21.15.40:0/1304389885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88108d40 0x7f8f88109150 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 --2- 172.21.15.40:0/1304389885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88103400 0x7f8f88103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 -- 172.21.15.40:0/1304389885 >> 172.21.15.40:0/1304389885 conn(0x7f8f880fee90 msgr2=0x7f8f881012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:37.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 -- 172.21.15.40:0/1304389885 shutdown_connections 2024-07-26T12:39:37.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.057+0000 7f8f8e400640 1 -- 172.21.15.40:0/1304389885 wait complete. 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.058+0000 7f8f8e400640 1 Processor -- start 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.058+0000 7f8f8e400640 1 -- start start 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.059+0000 7f8f8e400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f88103400 0x7f8f8819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.059+0000 7f8f8e400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88108d40 0x7f8f8819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.059+0000 7f8f8e400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 0x7f8f881a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.059+0000 7f8f8e400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113200 con 0x7f8f88109690 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.059+0000 7f8f8e400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113080 con 0x7f8f88108d40 2024-07-26T12:39:37.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.059+0000 7f8f8e400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113380 con 0x7f8f88103400 2024-07-26T12:39:37.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 0x7f8f881a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:37.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 0x7f8f881a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52942/0 (socket says 172.21.15.40:52942) 2024-07-26T12:39:37.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 -- 172.21.15.40:0/2172628106 learned_addr learned my addr 172.21.15.40:0/2172628106 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:39:37.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8d000640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f88103400 0x7f8f8819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f87e00640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88108d40 0x7f8f8819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 -- 172.21.15.40:0/2172628106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f88103400 msgr2=0x7f8f8819bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f88103400 0x7f8f8819bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 -- 172.21.15.40:0/2172628106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88108d40 msgr2=0x7f8f8819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88108d40 0x7f8f8819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f8da00640 1 -- 172.21.15.40:0/2172628106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f881a1e40 con 0x7f8f88109690 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.060+0000 7f8f87e00640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88108d40 0x7f8f8819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:39:37.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.061+0000 7f8f8da00640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 0x7f8f881a1710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000cad0 tx=0x7f8f8000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.061+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000ae20 con 0x7f8f88109690 2024-07-26T12:39:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.061+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f80005020 con 0x7f8f88109690 2024-07-26T12:39:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.061+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000f6b0 con 0x7f8f88109690 2024-07-26T12:39:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.061+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f881a2130 con 0x7f8f88109690 2024-07-26T12:39:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.061+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f881a8890 con 0x7f8f88109690 2024-07-26T12:39:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.063+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88103810 con 0x7f8f88109690 2024-07-26T12:39:37.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.065+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8f800051d0 con 0x7f8f88109690 2024-07-26T12:39:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.068+0000 7f8f85600640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8f700b3c50 0x7f8f700b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.068+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8f800e3f50 con 0x7f8f88109690 2024-07-26T12:39:37.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.068+0000 7f8f8d000640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8f700b3c50 0x7f8f700b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:37.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.069+0000 7f8f8d000640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8f700b3c50 0x7f8f700b6160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00bbe0 tx=0x7f8f7c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.071+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f8f80014030 con 0x7f8f88109690 2024-07-26T12:39:37.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.358+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f8819d000 con 0x7f8f88109690 2024-07-26T12:39:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.360+0000 7f8f85600640 1 -- 172.21.15.40:0/2172628106 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f8f800ab560 con 0x7f8f88109690 2024-07-26T12:39:37.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:39:37.363 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:39:37.363 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:39:37.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.363+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8f700b3c50 msgr2=0x7f8f700b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:37.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.363+0000 7f8f8e400640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8f700b3c50 0x7f8f700b6160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00bbe0 tx=0x7f8f7c00b390 comp rx=0 tx=0).stop 2024-07-26T12:39:37.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.363+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 msgr2=0x7f8f881a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:37.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.363+0000 7f8f8e400640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 0x7f8f881a1710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000cad0 tx=0x7f8f8000cf90 comp rx=0 tx=0).stop 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 shutdown_connections 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f88109690 0x7f8f881a1710 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f88108d40 0x7f8f8819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f8f700b3c50 0x7f8f700b6160 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 --2- 172.21.15.40:0/2172628106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f88103400 0x7f8f8819bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 >> 172.21.15.40:0/2172628106 conn(0x7f8f880fee90 msgr2=0x7f8f88107420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 shutdown_connections 2024-07-26T12:39:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:37.364+0000 7f8f8e400640 1 -- 172.21.15.40:0/2172628106 wait complete. 2024-07-26T12:39:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:37 smithi040 ceph-mon[32397]: pgmap v1021: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:39:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:37 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2172628106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:39:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:37 smithi146 ceph-mon[35807]: pgmap v1021: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:39:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:37 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2172628106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:39:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:37 smithi076 ceph-mon[35401]: pgmap v1021: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T12:39:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:37 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2172628106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:39:38.175 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 148.8 --await-for 45.0' 2024-07-26T12:39:38.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 148.8 --await-for 45.0 2024-07-26T12:39:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:39:39.945 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:39 smithi040 ceph-mon[32397]: pgmap v1022: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:39:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:39 smithi146 ceph-mon[35807]: pgmap v1022: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:39:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:39 smithi076 ceph-mon[35401]: pgmap v1022: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:39:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 -- 172.21.15.40:0/3177128229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa01010b130 msgr2=0x7fa01010b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 --2- 172.21.15.40:0/3177128229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa01010b130 0x7fa01010b540 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009900 tx=0x7f9ff802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 -- 172.21.15.40:0/3177128229 shutdown_connections 2024-07-26T12:39:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 --2- 172.21.15.40:0/3177128229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01010ba80 0x7fa0101122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 --2- 172.21.15.40:0/3177128229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa01010b130 0x7fa01010b540 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 --2- 172.21.15.40:0/3177128229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa0101057f0 0x7fa010105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 -- 172.21.15.40:0/3177128229 >> 172.21.15.40:0/3177128229 conn(0x7fa010101200 msgr2=0x7fa010103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 -- 172.21.15.40:0/3177128229 shutdown_connections 2024-07-26T12:39:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.964+0000 7fa014e00640 1 -- 172.21.15.40:0/3177128229 wait complete. 2024-07-26T12:39:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.966+0000 7fa014e00640 1 Processor -- start 2024-07-26T12:39:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.966+0000 7fa014e00640 1 -- start start 2024-07-26T12:39:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.966+0000 7fa014e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 0x7fa01019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.966+0000 7fa014e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01010b130 0x7fa01019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa014e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa01010ba80 0x7fa0101a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa014e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101155f0 con 0x7fa0101057f0 2024-07-26T12:39:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa014e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa010115470 con 0x7fa01010ba80 2024-07-26T12:39:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa014e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa010115770 con 0x7fa01010b130 2024-07-26T12:39:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa00de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 0x7fa01019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa00de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 0x7fa01019c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52956/0 (socket says 172.21.15.40:52956) 2024-07-26T12:39:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa00de00640 1 -- 172.21.15.40:0/3171917491 learned_addr learned my addr 172.21.15.40:0/3171917491 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa00d400640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01010b130 0x7fa01019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.967+0000 7fa00e800640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa01010ba80 0x7fa0101a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.968+0000 7fa00de00640 1 -- 172.21.15.40:0/3171917491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01010b130 msgr2=0x7fa01019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.968+0000 7fa00de00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01010b130 0x7fa01019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.968+0000 7fa00de00640 1 -- 172.21.15.40:0/3171917491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa01010ba80 msgr2=0x7fa0101a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.968+0000 7fa00de00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa01010ba80 0x7fa0101a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.968+0000 7fa00de00640 1 -- 172.21.15.40:0/3171917491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0101a2070 con 0x7fa0101057f0 2024-07-26T12:39:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.968+0000 7fa00de00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 0x7fa01019c100 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa00000d950 tx=0x7fa00000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:40.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.969+0000 7fa006a00640 1 -- 172.21.15.40:0/3171917491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000017030 con 0x7fa0101057f0 2024-07-26T12:39:40.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.969+0000 7fa006a00640 1 -- 172.21.15.40:0/3171917491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa000004020 con 0x7fa0101057f0 2024-07-26T12:39:40.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.969+0000 7fa006a00640 1 -- 172.21.15.40:0/3171917491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0000055d0 con 0x7fa0101057f0 2024-07-26T12:39:40.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.969+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0101a2360 con 0x7fa0101057f0 2024-07-26T12:39:40.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.969+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0101a8ac0 con 0x7fa0101057f0 2024-07-26T12:39:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 Processor -- start 2024-07-26T12:39:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 -- start start 2024-07-26T12:39:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 0x562e536ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e5331f980 0x562e536ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53327b60 0x562e536eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562e536b8cf0 con 0x562e53348840 2024-07-26T12:39:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562e53663b40 con 0x562e53327b60 2024-07-26T12:39:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.973+0000 7fa01bab8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562e53653040 con 0x562e5331f980 2024-07-26T12:39:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 0x562e536ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 0x562e536ee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52964/0 (socket says 172.21.15.40:52964) 2024-07-26T12:39:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 -- 172.21.15.40:0/1444312897 learned_addr learned my addr 172.21.15.40:0/1444312897 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:39:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00d400640 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53327b60 0x562e536eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 -- 172.21.15.40:0/1444312897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e5331f980 msgr2=0x562e536ee6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T12:39:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e5331f980 0x562e536ee6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 -- 172.21.15.40:0/1444312897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53327b60 msgr2=0x562e536eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53327b60 0x562e536eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00e800640 1 -- 172.21.15.40:0/1444312897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e535daaf0 con 0x562e53348840 2024-07-26T12:39:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.974+0000 7fa00d400640 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53327b60 0x562e536eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:39:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.975+0000 7fa006a00640 1 -- 172.21.15.40:0/3171917491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa000009a30 con 0x7fa0101057f0 2024-07-26T12:39:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.975+0000 7fa00e800640 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 0x562e536ee1a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa008009f20 tx=0x7fa00800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61af794907fea1f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.975+0000 7f9fff400640 1 -- 172.21.15.40:0/1444312897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008015070 con 0x562e53348840 2024-07-26T12:39:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.975+0000 7f9fff400640 1 -- 172.21.15.40:0/1444312897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa00801aaf0 con 0x562e53348840 2024-07-26T12:39:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.975+0000 7f9fff400640 1 -- 172.21.15.40:0/1444312897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008011b10 con 0x562e53348840 2024-07-26T12:39:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.976+0000 7fa01bab8740 1 -- 172.21.15.40:0/1444312897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 msgr2=0x562e536ee1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.976+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 0x562e536ee1a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa008009f20 tx=0x7fa00800f7f0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa01bab8740 1 -- 172.21.15.40:0/1444312897 shutdown_connections 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53327b60 0x562e536eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e5331f980 0x562e536ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1444312897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53348840 0x562e536ee1a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa01bab8740 1 -- 172.21.15.40:0/1444312897 >> 172.21.15.40:0/1444312897 conn(0x562e5333c990 msgr2=0x562e536ec090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa006a00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9ff40b3bd0 0x7f9ff40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.977+0000 7fa006a00640 1 -- 172.21.15.40:0/3171917491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa0000e3650 con 0x7fa0101057f0 2024-07-26T12:39:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.978+0000 7fa01bab8740 1 -- 172.21.15.40:0/1444312897 shutdown_connections 2024-07-26T12:39:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.978+0000 7fa01bab8740 1 -- 172.21.15.40:0/1444312897 wait complete. 2024-07-26T12:39:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.978+0000 7fa00d400640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9ff40b3bd0 0x7f9ff40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.978+0000 7fa01bab8740 1 -- start start 2024-07-26T12:39:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.979+0000 7fa01bab8740 1 Processor -- start 2024-07-26T12:39:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.979+0000 7fa00d400640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9ff40b3bd0 0x7f9ff40b60e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9ff802a910 tx=0x7f9ff8005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.979+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e53702ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.979+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e537030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e537080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa01bab8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562e535ef500 con 0x562e53327b60 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa01bab8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562e53657080 con 0x562e5331f980 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa01bab8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562e534b67a0 con 0x562e53348840 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa01bab8740 10 client.0 _ll_register_callbacks cb 0x562e5364bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa00d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e537030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa00de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e53702ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa00d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e537030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52970/0 (socket says 172.21.15.40:52970) 2024-07-26T12:39:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa00d400640 1 -- 172.21.15.40:0/1189806892 learned_addr learned my addr 172.21.15.40:0/1189806892 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.980+0000 7fa00e800640 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e537080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.981+0000 7fa00d400640 1 -- 172.21.15.40:0/1189806892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 msgr2=0x562e537080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.981+0000 7fa00d400640 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e537080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.981+0000 7fa00d400640 1 -- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 msgr2=0x562e53702ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.981+0000 7fa00d400640 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e53702ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.981+0000 7fa00d400640 1 -- 172.21.15.40:0/1189806892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e533c2b90 con 0x562e53327b60 2024-07-26T12:39:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.982+0000 7fa00d400640 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e537030a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8033000 tx=0x7f9ff8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf46fcca3de3d57e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.982+0000 7f9ff3e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:39:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.982+0000 7f9ff3e00640 1 -- 172.21.15.40:0/1189806892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff804d070 con 0x562e53327b60 2024-07-26T12:39:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.982+0000 7f9ff3e00640 1 -- 172.21.15.40:0/1189806892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9ff8049860 con 0x562e53327b60 2024-07-26T12:39:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.982+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00801aaf0 con 0x562e53327b60 2024-07-26T12:39:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.983+0000 7f9ff3e00640 1 -- 172.21.15.40:0/1189806892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9ff8059050 con 0x562e53327b60 2024-07-26T12:39:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.983+0000 7fa01bab8740 10 client.16101 fetch_fsmap learned FSMap version 35 2024-07-26T12:39:40.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.983+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562e53710fd0 con 0x562e53327b60 2024-07-26T12:39:40.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.983+0000 7f9ff3e00640 1 -- 172.21.15.40:0/1189806892 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa00801aaf0 con 0x562e53327b60 2024-07-26T12:39:40.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7f9ff3e00640 1 -- 172.21.15.40:0/1189806892 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9ff803ca60 con 0x562e53327b60 2024-07-26T12:39:40.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7fa01bab8740 10 client.16101 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:39:40.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7fa01bab8740 10 client.16101 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:39:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7fa01bab8740 20 client.16101 populate_metadata read hostname 'smithi040' 2024-07-26T12:39:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e533071c0 0x562e53714410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7fa01bab8740 4 client.16101 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:39:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.984+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e53665a90 con 0x562e533071c0 2024-07-26T12:39:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.985+0000 7fa00de00640 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e533071c0 0x562e53714410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:40.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.986+0000 7f9ff3e00640 10 client.16101 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:39:40.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.986+0000 7fa00de00640 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e533071c0 0x562e53714410 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81053ffbfb448115 server_cookie=752d99ffb4fe4471 in_seq=0 out_seq=0 2024-07-26T12:39:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.987+0000 7f9ff3e00640 1 -- 172.21.15.40:0/1189806892 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e53665a90 con 0x562e533071c0 2024-07-26T12:39:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7f9ff3e00640 10 client.16101 handle_command_reply: tid=0 2024-07-26T12:39:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 client.16101 shutdown 2024-07-26T12:39:40.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 msgr2=0x562e537030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:40.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e537030a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8033000 tx=0x7f9ff8009260 comp rx=0 tx=0).stop 2024-07-26T12:39:40.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 shutdown_connections 2024-07-26T12:39:40.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e537080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e533071c0 0x562e53714410 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e537030a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 --2- 172.21.15.40:0/1189806892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e53702ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:40.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 >> 172.21.15.40:0/1189806892 conn(0x562e5333c990 msgr2=0x562e536f1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:40.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.988+0000 7f9ff3e00640 0 client.16101 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:39:40.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.989+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 shutdown_connections 2024-07-26T12:39:40.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.989+0000 7fa01bab8740 1 -- 172.21.15.40:0/1189806892 wait complete. 2024-07-26T12:39:40.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:40.989+0000 7fa01bab8740 20 client.16101 trim_cache size 0 max 16384 2024-07-26T12:39:41.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 Processor -- start 2024-07-26T12:39:41.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 -- start start 2024-07-26T12:39:41.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 0x562e536ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53327b60 0x562e53703de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53348840 0x562e53704320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101acd60 con 0x562e5331f980 2024-07-26T12:39:41.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101ae8a0 con 0x562e53348840 2024-07-26T12:39:41.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.015+0000 7fa01bab8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101ad430 con 0x562e53327b60 2024-07-26T12:39:41.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 0x562e536ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 0x562e536ebdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52980/0 (socket says 172.21.15.40:52980) 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 -- 172.21.15.40:0/957561179 learned_addr learned my addr 172.21.15.40:0/957561179 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00d400640 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53327b60 0x562e53703de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00e800640 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53348840 0x562e53704320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 -- 172.21.15.40:0/957561179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53327b60 msgr2=0x562e53703de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53327b60 0x562e53703de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 -- 172.21.15.40:0/957561179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53348840 msgr2=0x562e53704320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53348840 0x562e53704320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00de00640 1 -- 172.21.15.40:0/957561179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e53703b80 con 0x562e5331f980 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.016+0000 7fa00d400640 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53327b60 0x562e53703de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:39:41.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.017+0000 7fa00de00640 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 0x562e536ebdb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa0000aa4f0 tx=0x7fa0000044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d333fcf8a7c4bc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.017+0000 7f9ffea00640 1 -- 172.21.15.40:0/957561179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0000c4070 con 0x562e5331f980 2024-07-26T12:39:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.017+0000 7f9ffea00640 1 -- 172.21.15.40:0/957561179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0000aac60 con 0x562e5331f980 2024-07-26T12:39:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.017+0000 7f9ffea00640 1 -- 172.21.15.40:0/957561179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000009d20 con 0x562e5331f980 2024-07-26T12:39:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 -- 172.21.15.40:0/957561179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 msgr2=0x562e536ebdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 0x562e536ebdb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa0000aa4f0 tx=0x7fa0000044d0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 -- 172.21.15.40:0/957561179 shutdown_connections 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e53348840 0x562e53704320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53327b60 0x562e53703de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 --2- 172.21.15.40:0/957561179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e5331f980 0x562e536ebdb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.018+0000 7fa01bab8740 1 -- 172.21.15.40:0/957561179 >> 172.21.15.40:0/957561179 conn(0x562e5333c990 msgr2=0x562e536eb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.019+0000 7fa01bab8740 1 -- 172.21.15.40:0/957561179 shutdown_connections 2024-07-26T12:39:41.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.019+0000 7fa01bab8740 1 -- 172.21.15.40:0/957561179 wait complete. 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.019+0000 7fa01bab8740 1 -- start start 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 Processor -- start 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e536eb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e536ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e5370e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101ae1d0 con 0x562e53327b60 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101adb00 con 0x562e5331f980 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101aad20 con 0x562e53348840 2024-07-26T12:39:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.020+0000 7fa01bab8740 10 client.0 _ll_register_callbacks cb 0x7f9ff8005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:39:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.021+0000 7fa00d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e536ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.021+0000 7fa00d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e536ebd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52996/0 (socket says 172.21.15.40:52996) 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.021+0000 7fa00d400640 1 -- 172.21.15.40:0/4049463003 learned_addr learned my addr 172.21.15.40:0/4049463003 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.021+0000 7fa00e800640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e5370e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.021+0000 7fa00de00640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e536eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7fa00d400640 1 -- 172.21.15.40:0/4049463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 msgr2=0x562e5370e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7fa00d400640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e5370e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7fa00d400640 1 -- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 msgr2=0x562e536eb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7fa00d400640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e536eb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7fa00d400640 1 -- 172.21.15.40:0/4049463003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5370e720 con 0x562e53327b60 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7fa00d400640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e536ebd80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9ff803cfd0 tx=0x7f9ff8005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fa689f2bed46ae server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.022+0000 7f9ff3e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.023+0000 7f9ff3e00640 1 -- 172.21.15.40:0/4049463003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8061070 con 0x562e53327b60 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.023+0000 7f9ff3e00640 1 -- 172.21.15.40:0/4049463003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9ff8031c50 con 0x562e53327b60 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.023+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0000aac60 con 0x562e53327b60 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.023+0000 7f9ff3e00640 1 -- 172.21.15.40:0/4049463003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9ff806d050 con 0x562e53327b60 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.023+0000 7fa01bab8740 10 client.16107 fetch_fsmap learned FSMap version 35 2024-07-26T12:39:41.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.023+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562e53719a40 con 0x562e53327b60 2024-07-26T12:39:41.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7f9ff3e00640 1 -- 172.21.15.40:0/4049463003 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0000aac60 con 0x562e53327b60 2024-07-26T12:39:41.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7f9ff3e00640 1 -- 172.21.15.40:0/4049463003 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9ff8049660 con 0x562e53327b60 2024-07-26T12:39:41.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7fa01bab8740 10 client.16107 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:39:41.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7fa01bab8740 10 client.16107 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:39:41.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7fa01bab8740 20 client.16107 populate_metadata read hostname 'smithi040' 2024-07-26T12:39:41.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7fa01bab8740 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e532dc570 0x562e5377ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:39:41.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7fa01bab8740 4 client.16107 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.8, "await_for": 45.0}] 2024-07-26T12:39:41.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.024+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.8, "await_for": 45.0}) -- 0x562e53661530 con 0x562e532dc570 2024-07-26T12:39:41.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.025+0000 7fa00de00640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e532dc570 0x562e5377ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:39:41.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.026+0000 7fa00de00640 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e532dc570 0x562e5377ee40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd1375059cc0335 server_cookie=9775130a30984770 in_seq=0 out_seq=0 2024-07-26T12:39:41.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.026+0000 7f9ff3e00640 10 client.16107 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:39:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.257+0000 7f9ff3e00640 1 -- 172.21.15.40:0/4049463003 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562e53661530 con 0x562e532dc570 2024-07-26T12:39:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.257+0000 7f9ff3e00640 10 client.16107 handle_command_reply: tid=0 2024-07-26T12:39:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.258+0000 7fa01bab8740 1 client.16107 shutdown 2024-07-26T12:39:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.258+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 msgr2=0x562e536ebd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.258+0000 7fa01bab8740 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e536ebd80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9ff803cfd0 tx=0x7f9ff8005980 comp rx=0 tx=0).stop 2024-07-26T12:39:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.258+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 shutdown_connections 2024-07-26T12:39:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.258+0000 7fa01bab8740 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562e53348840 0x562e5370e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.258+0000 7fa01bab8740 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562e532dc570 0x562e5377ee40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.259+0000 7fa01bab8740 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562e53327b60 0x562e536ebd80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.259+0000 7fa01bab8740 1 --2- 172.21.15.40:0/4049463003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e5331f980 0x562e536eb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.259+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 >> 172.21.15.40:0/4049463003 conn(0x562e5333c990 msgr2=0x562e53708730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.259+0000 7f9ff3e00640 0 client.16107 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.259+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 shutdown_connections 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.259+0000 7fa01bab8740 1 -- 172.21.15.40:0/4049463003 wait complete. 2024-07-26T12:39:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.260+0000 7fa01bab8740 20 client.16107 trim_cache size 0 max 16384 2024-07-26T12:39:41.263 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:39:41.263 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:39:41.263 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:39:41.263 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 54, 2024-07-26T12:39:41.263 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "3f0d8266": { 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 54, 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.8, 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:39:41.264 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:39:41.265 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9ff40b3bd0 msgr2=0x7f9ff40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9ff40b3bd0 0x7f9ff40b60e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9ff802a910 tx=0x7f9ff8005a40 comp rx=0 tx=0).stop 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 msgr2=0x7fa01019c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 0x7fa01019c100 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa00000d950 tx=0x7fa00000de10 comp rx=0 tx=0).stop 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 shutdown_connections 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa01010ba80 0x7fa0101a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9ff40b3bd0 0x7f9ff40b60e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01010b130 0x7fa01019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 --2- 172.21.15.40:0/3171917491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0101057f0 0x7fa01019c100 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:39:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.261+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 >> 172.21.15.40:0/3171917491 conn(0x7fa010101200 msgr2=0x7fa0101097e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:39:41.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.262+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 shutdown_connections 2024-07-26T12:39:41.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:39:41.262+0000 7fa014e00640 1 -- 172.21.15.40:0/3171917491 wait complete. 2024-07-26T12:39:41.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:41 smithi146 ceph-mon[35807]: pgmap v1023: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:41.966 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:41 smithi040 ceph-mon[32397]: pgmap v1023: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:42.021 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3f0d8266', quiesce took 8.1 seconds. Will release after: 20.700000000000003 2024-07-26T12:39:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:41 smithi076 ceph-mon[35401]: pgmap v1023: 97 pgs: 97 active+clean; 2.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:39:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:43 smithi040 ceph-mon[32397]: pgmap v1024: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T12:39:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:43 smithi146 ceph-mon[35807]: pgmap v1024: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T12:39:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:43 smithi076 ceph-mon[35401]: pgmap v1024: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T12:39:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:45 smithi040 ceph-mon[32397]: pgmap v1025: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:39:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:45 smithi146 ceph-mon[35807]: pgmap v1025: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:39:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:45 smithi076 ceph-mon[35401]: pgmap v1025: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:39:47.887 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:47 smithi076 ceph-mon[35401]: pgmap v1026: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:39:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:47 smithi040 ceph-mon[32397]: pgmap v1026: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:39:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:47 smithi146 ceph-mon[35807]: pgmap v1026: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:39:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:49 smithi040 ceph-mon[32397]: pgmap v1027: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:39:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:49 smithi146 ceph-mon[35807]: pgmap v1027: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:39:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:49 smithi076 ceph-mon[35401]: pgmap v1027: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:39:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:51 smithi040 ceph-mon[32397]: pgmap v1028: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:39:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:51 smithi146 ceph-mon[35807]: pgmap v1028: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:39:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:51 smithi076 ceph-mon[35401]: pgmap v1028: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:39:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:53 smithi040 ceph-mon[32397]: pgmap v1029: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:39:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:53 smithi146 ceph-mon[35807]: pgmap v1029: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:39:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:53 smithi076 ceph-mon[35401]: pgmap v1029: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T12:39:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:55 smithi040 ceph-mon[32397]: pgmap v1030: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-07-26T12:39:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:55 smithi146 ceph-mon[35807]: pgmap v1030: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-07-26T12:39:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:55 smithi076 ceph-mon[35401]: pgmap v1030: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-07-26T12:39:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:57 smithi040 ceph-mon[32397]: pgmap v1031: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 721 KiB/s wr, 8 op/s 2024-07-26T12:39:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:57 smithi146 ceph-mon[35807]: pgmap v1031: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 721 KiB/s wr, 8 op/s 2024-07-26T12:39:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:57 smithi076 ceph-mon[35401]: pgmap v1031: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 721 KiB/s wr, 8 op/s 2024-07-26T12:39:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:39:59 smithi040 ceph-mon[32397]: pgmap v1032: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 380 KiB/s wr, 10 op/s 2024-07-26T12:40:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:39:59 smithi146 ceph-mon[35807]: pgmap v1032: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 380 KiB/s wr, 10 op/s 2024-07-26T12:40:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:39:59 smithi076 ceph-mon[35401]: pgmap v1032: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 380 KiB/s wr, 10 op/s 2024-07-26T12:40:00.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:40:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T12:40:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:40:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:01 smithi040 ceph-mon[32397]: pgmap v1033: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-07-26T12:40:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:01 smithi146 ceph-mon[35807]: pgmap v1033: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-07-26T12:40:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:01 smithi076 ceph-mon[35401]: pgmap v1033: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-07-26T12:40:02.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:40:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:40:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:03 smithi040 ceph-mon[32397]: pgmap v1034: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-07-26T12:40:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:03 smithi146 ceph-mon[35807]: pgmap v1034: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-07-26T12:40:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:03 smithi076 ceph-mon[35401]: pgmap v1034: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-07-26T12:40:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.512+0000 7f2811c00640 1 -- 172.21.15.40:0/205415408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 msgr2=0x7f280c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.512+0000 7f2811c00640 1 --2- 172.21.15.40:0/205415408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c1026b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009900 tx=0x7f27fc02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 -- 172.21.15.40:0/205415408 shutdown_connections 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 --2- 172.21.15.40:0/205415408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f280c108530 0x7f280c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 --2- 172.21.15.40:0/205415408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280c107be0 0x7f280c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 --2- 172.21.15.40:0/205415408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c1026b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 -- 172.21.15.40:0/205415408 >> 172.21.15.40:0/205415408 conn(0x7f280c0fdcf0 msgr2=0x7f280c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 -- 172.21.15.40:0/205415408 shutdown_connections 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.513+0000 7f2811c00640 1 -- 172.21.15.40:0/205415408 wait complete. 2024-07-26T12:40:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.515+0000 7f2811c00640 1 Processor -- start 2024-07-26T12:40:05.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.515+0000 7f2811c00640 1 -- start start 2024-07-26T12:40:05.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f2811c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c0fe220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:05.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f2811c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f280c107be0 0x7f280c0fe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:05.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f2811c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280c108530 0x7f280c0feca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:05.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f2811c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f280c1120e0 con 0x7f280c1022a0 2024-07-26T12:40:05.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f2811c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f280c111f60 con 0x7f280c107be0 2024-07-26T12:40:05.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f2811c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f280c112260 con 0x7f280c108530 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f280be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c0fe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f280be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c0fe220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57336/0 (socket says 172.21.15.40:57336) 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f280be00640 1 -- 172.21.15.40:0/4224507705 learned_addr learned my addr 172.21.15.40:0/4224507705 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.516+0000 7f280b400640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f280c107be0 0x7f280c0fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.517+0000 7f2811200640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280c108530 0x7f280c0feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.517+0000 7f280be00640 1 -- 172.21.15.40:0/4224507705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280c108530 msgr2=0x7f280c0feca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.517+0000 7f280be00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280c108530 0x7f280c0feca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.517+0000 7f280be00640 1 -- 172.21.15.40:0/4224507705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f280c107be0 msgr2=0x7f280c0fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:05.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.517+0000 7f280be00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f280c107be0 0x7f280c0fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.517+0000 7f280be00640 1 -- 172.21.15.40:0/4224507705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280c1a7df0 con 0x7f280c1022a0 2024-07-26T12:40:05.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.518+0000 7f280be00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c0fe220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f27fc02a910 tx=0x7f27fc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:05.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.518+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc03f070 con 0x7f280c1022a0 2024-07-26T12:40:05.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.518+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27fc003e40 con 0x7f280c1022a0 2024-07-26T12:40:05.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.518+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280c1a8080 con 0x7f280c1022a0 2024-07-26T12:40:05.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.518+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc035030 con 0x7f280c1022a0 2024-07-26T12:40:05.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.518+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280c1a85b0 con 0x7f280c1022a0 2024-07-26T12:40:05.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.520+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280c1026b0 con 0x7f280c1022a0 2024-07-26T12:40:05.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.522+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f27fc042070 con 0x7f280c1022a0 2024-07-26T12:40:05.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.525+0000 7f2808c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27f00b3c50 0x7f27f00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:05.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.525+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f27fc104740 con 0x7f280c1022a0 2024-07-26T12:40:05.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.525+0000 7f280b400640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27f00b3c50 0x7f27f00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:05.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.526+0000 7f280b400640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27f00b3c50 0x7f27f00b6160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f280c1042b0 tx=0x7f27f800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:05.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.528+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f27fc0cbd50 con 0x7f280c1022a0 2024-07-26T12:40:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.785+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f280c0ff520 con 0x7f280c1022a0 2024-07-26T12:40:05.787 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:05 smithi040 ceph-mon[32397]: pgmap v1035: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-07-26T12:40:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.788+0000 7f2808c00640 1 -- 172.21.15.40:0/4224507705 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f27fc0cb650 con 0x7f280c1022a0 2024-07-26T12:40:05.795 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:40:05.795 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.792+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27f00b3c50 msgr2=0x7f27f00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.792+0000 7f2811c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27f00b3c50 0x7f27f00b6160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f280c1042b0 tx=0x7f27f800a2d0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.792+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 msgr2=0x7f280c0fe220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.792+0000 7f2811c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c0fe220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f27fc02a910 tx=0x7f27fc003c20 comp rx=0 tx=0).stop 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.792+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 shutdown_connections 2024-07-26T12:40:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.792+0000 7f2811c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27f00b3c50 0x7f27f00b6160 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.793+0000 7f2811c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f280c108530 0x7f280c0feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.793+0000 7f2811c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f280c107be0 0x7f280c0fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.793+0000 7f2811c00640 1 --2- 172.21.15.40:0/4224507705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c1022a0 0x7f280c0fe220 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.793+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 >> 172.21.15.40:0/4224507705 conn(0x7f280c0fdcf0 msgr2=0x7f280c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.794+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 shutdown_connections 2024-07-26T12:40:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:05.794+0000 7f2811c00640 1 -- 172.21.15.40:0/4224507705 wait complete. 2024-07-26T12:40:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:05 smithi146 ceph-mon[35807]: pgmap v1035: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-07-26T12:40:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:05 smithi076 ceph-mon[35401]: pgmap v1035: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-07-26T12:40:06.505 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 3f0d8266 --release --await' 2024-07-26T12:40:06.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 3f0d8266 --release --await 2024-07-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:40:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:06 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4224507705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:40:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:06 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4224507705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:40:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:06 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4224507705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:40:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:07 smithi040 ceph-mon[32397]: pgmap v1036: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:40:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:07 smithi146 ceph-mon[35807]: pgmap v1036: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:40:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:07 smithi076 ceph-mon[35401]: pgmap v1036: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 -- 172.21.15.40:0/1869368123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 msgr2=0x7fbd9810b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1869368123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9810b310 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009900 tx=0x7fbd8802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 -- 172.21.15.40:0/1869368123 shutdown_connections 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1869368123 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd9810b850 0x7fbd98112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1869368123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9810b310 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1869368123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd981055c0 0x7fbd981059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 -- 172.21.15.40:0/1869368123 >> 172.21.15.40:0/1869368123 conn(0x7fbd98101010 msgr2=0x7fbd98103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.321+0000 7fbd9f200640 1 -- 172.21.15.40:0/1869368123 shutdown_connections 2024-07-26T12:40:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.322+0000 7fbd9f200640 1 -- 172.21.15.40:0/1869368123 wait complete. 2024-07-26T12:40:09.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.323+0000 7fbd9f200640 1 Processor -- start 2024-07-26T12:40:09.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.323+0000 7fbd9f200640 1 -- start start 2024-07-26T12:40:09.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd981055c0 0x7fbd9819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9810b850 0x7fbd981a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981153e0 con 0x7fbd9810af00 2024-07-26T12:40:09.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98115260 con 0x7fbd981055c0 2024-07-26T12:40:09.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98115560 con 0x7fbd9810b850 2024-07-26T12:40:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9819c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57360/0 (socket says 172.21.15.40:57360) 2024-07-26T12:40:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.324+0000 7fbd9d400640 1 -- 172.21.15.40:0/1317961270 learned_addr learned my addr 172.21.15.40:0/1317961270 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:40:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9de00640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd981055c0 0x7fbd9819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9810b850 0x7fbd981a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9d400640 1 -- 172.21.15.40:0/1317961270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9810b850 msgr2=0x7fbd981a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9810b850 0x7fbd981a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9d400640 1 -- 172.21.15.40:0/1317961270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd981055c0 msgr2=0x7fbd9819be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd981055c0 0x7fbd9819be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9d400640 1 -- 172.21.15.40:0/1317961270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd981a1e00 con 0x7fbd9810af00 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.325+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9819c430 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd8802a910 tx=0x7fbd88003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.326+0000 7fbd92a00640 1 -- 172.21.15.40:0/1317961270 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8803f070 con 0x7fbd9810af00 2024-07-26T12:40:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.326+0000 7fbd92a00640 1 -- 172.21.15.40:0/1317961270 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd88003e10 con 0x7fbd9810af00 2024-07-26T12:40:09.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.326+0000 7fbd92a00640 1 -- 172.21.15.40:0/1317961270 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88035030 con 0x7fbd9810af00 2024-07-26T12:40:09.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.326+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd981a2090 con 0x7fbd9810af00 2024-07-26T12:40:09.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.326+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd981a8850 con 0x7fbd9810af00 2024-07-26T12:40:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.329+0000 7fbda7440740 1 Processor -- start 2024-07-26T12:40:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 -- start start 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbd92a00640 1 -- 172.21.15.40:0/1317961270 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbd88042070 con 0x7fbd9810af00 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb20520 0x55e33cec51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cec56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cec5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e33ce3bf50 con 0x55e33caff840 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e33ce2b450 con 0x55e33caf7660 2024-07-26T12:40:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.330+0000 7fbda7440740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e33ce2f490 con 0x55e33cb20520 2024-07-26T12:40:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cec5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cec5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57364/0 (socket says 172.21.15.40:57364) 2024-07-26T12:40:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 -- 172.21.15.40:0/1549503914 learned_addr learned my addr 172.21.15.40:0/1549503914 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb20520 0x55e33cec51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9de00640 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cec56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 -- 172.21.15.40:0/1549503914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb20520 msgr2=0x55e33cec51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb20520 0x55e33cec51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 -- 172.21.15.40:0/1549503914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 msgr2=0x55e33cec56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cec56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.331+0000 7fbd9d400640 1 -- 172.21.15.40:0/1549503914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33cb8bb00 con 0x55e33caff840 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cec5c20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbd8810c590 tx=0x7fbd8810c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ff5cf6b463fd09 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd92a00640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbd800b3c50 0x7fbd800b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd92a00640 1 -- 172.21.15.40:0/1317961270 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbd88104410 con 0x7fbd9810af00 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbd800b3c50 0x7fbd800b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd87000640 1 -- 172.21.15.40:0/1549503914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd880c71e0 con 0x55e33caff840 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd87000640 1 -- 172.21.15.40:0/1549503914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd880cae30 con 0x55e33caff840 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.332+0000 7fbd87000640 1 -- 172.21.15.40:0/1549503914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd880caa90 con 0x55e33caff840 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 -- 172.21.15.40:0/1549503914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 msgr2=0x55e33cec5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cec5c20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbd8810c590 tx=0x7fbd8810c680 comp rx=0 tx=0).stop 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbd800b3c50 0x7fbd800b6160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd94005fd0 tx=0x7fbd94009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 -- 172.21.15.40:0/1549503914 shutdown_connections 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cec5c20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cec56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 --2- 172.21.15.40:0/1549503914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb20520 0x55e33cec51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.333+0000 7fbda7440740 1 -- 172.21.15.40:0/1549503914 >> 172.21.15.40:0/1549503914 conn(0x55e33cb14910 msgr2=0x55e33cec3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.334+0000 7fbda7440740 1 -- 172.21.15.40:0/1549503914 shutdown_connections 2024-07-26T12:40:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.334+0000 7fbda7440740 1 -- 172.21.15.40:0/1549503914 wait complete. 2024-07-26T12:40:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.334+0000 7fbda7440740 1 -- start start 2024-07-26T12:40:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.334+0000 7fbda7440740 1 Processor -- start 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caf7660 0x55e33ced08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caff840 0x55e33ced0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 0x55e33cedc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e33cc8ebb0 con 0x55e33cb20520 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e33cdc7930 con 0x55e33caff840 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e33ced3740 con 0x55e33caf7660 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbda7440740 10 client.0 _ll_register_callbacks cb 0x55e33cb37d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 0x55e33cedc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 0x55e33cedc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57378/0 (socket says 172.21.15.40:57378) 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.335+0000 7fbd9e800640 1 -- 172.21.15.40:0/3536482782 learned_addr learned my addr 172.21.15.40:0/3536482782 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:40:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9de00640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caf7660 0x55e33ced08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9d400640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caff840 0x55e33ced0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9e800640 1 -- 172.21.15.40:0/3536482782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caf7660 msgr2=0x55e33ced08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9e800640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caf7660 0x55e33ced08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9e800640 1 -- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caff840 msgr2=0x55e33ced0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9e800640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caff840 0x55e33ced0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9e800640 1 -- 172.21.15.40:0/3536482782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33cc02960 con 0x55e33cb20520 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.336+0000 7fbd9d400640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caff840 0x55e33ced0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbd9e800640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 0x55e33cedc9f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbd9401e970 tx=0x7fbd94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cbf67f0e19fbb5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbd7b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbd7b400640 1 -- 172.21.15.40:0/3536482782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94010d60 con 0x55e33cb20520 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbd7b400640 1 -- 172.21.15.40:0/3536482782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbd9401f420 con 0x55e33cb20520 2024-07-26T12:40:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd880cae30 con 0x55e33cb20520 2024-07-26T12:40:09.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbd7b400640 1 -- 172.21.15.40:0/3536482782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbd94004b20 con 0x55e33cb20520 2024-07-26T12:40:09.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbda7440740 10 client.16125 fetch_fsmap learned FSMap version 35 2024-07-26T12:40:09.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.337+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e33cedf480 con 0x55e33cb20520 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbd7b400640 1 -- 172.21.15.40:0/3536482782 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd880cae30 con 0x55e33cb20520 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbd7b400640 1 -- 172.21.15.40:0/3536482782 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fbd9400f040 con 0x55e33cb20520 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbda7440740 10 client.16125 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbda7440740 10 client.16125 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbda7440740 20 client.16125 populate_metadata read hostname 'smithi040' 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbda7440740 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cadeea0 0x55e33cee2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbda7440740 4 client.16125 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.338+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e33ce3dea0 con 0x55e33cadeea0 2024-07-26T12:40:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.339+0000 7fbd9de00640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cadeea0 0x55e33cee2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.340+0000 7fbd9de00640 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cadeea0 0x55e33cee2a50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b49726678c7eff5 server_cookie=871b53020963a30 in_seq=0 out_seq=0 2024-07-26T12:40:09.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.340+0000 7fbd7b400640 10 client.16125 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:40:09.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.342+0000 7fbd7b400640 1 -- 172.21.15.40:0/3536482782 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e33ce3dea0 con 0x55e33cadeea0 2024-07-26T12:40:09.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.342+0000 7fbd7b400640 10 client.16125 handle_command_reply: tid=0 2024-07-26T12:40:09.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 client.16125 shutdown 2024-07-26T12:40:09.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 msgr2=0x55e33cedc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 0x55e33cedc9f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbd9401e970 tx=0x7fbd94004a40 comp rx=0 tx=0).stop 2024-07-26T12:40:09.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 shutdown_connections 2024-07-26T12:40:09.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cadeea0 0x55e33cee2a50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbd7b400640 0 client.16125 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:40:09.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33cb20520 0x55e33cedc9f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caff840 0x55e33ced0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 --2- 172.21.15.40:0/3536482782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caf7660 0x55e33ced08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 >> 172.21.15.40:0/3536482782 conn(0x55e33cb14910 msgr2=0x55e33cec8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 shutdown_connections 2024-07-26T12:40:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 1 -- 172.21.15.40:0/3536482782 wait complete. 2024-07-26T12:40:09.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.343+0000 7fbda7440740 20 client.16125 trim_cache size 0 max 16384 2024-07-26T12:40:09.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.363+0000 7fbda7440740 1 Processor -- start 2024-07-26T12:40:09.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.363+0000 7fbda7440740 1 -- start start 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbda7440740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb14910 0x55e33cec68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbda7440740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cedc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbda7440740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cedcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbda7440740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981b0e00 con 0x55e33caff840 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbda7440740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981b2940 con 0x55e33caf7660 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbda7440740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981b14d0 con 0x55e33cb14910 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cedcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cedcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57390/0 (socket says 172.21.15.40:57390) 2024-07-26T12:40:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.364+0000 7fbd9e800640 1 -- 172.21.15.40:0/1949649229 learned_addr learned my addr 172.21.15.40:0/1949649229 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cedc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9de00640 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb14910 0x55e33cec68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9e800640 1 -- 172.21.15.40:0/1949649229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb14910 msgr2=0x55e33cec68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb14910 0x55e33cec68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9e800640 1 -- 172.21.15.40:0/1949649229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 msgr2=0x55e33cedc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cedc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9e800640 1 -- 172.21.15.40:0/1949649229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33cee2dc0 con 0x55e33caff840 2024-07-26T12:40:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.365+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cedcd60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbd9401e940 tx=0x7fbd9401e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff5e34e5065a519 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.366+0000 7fbd86600640 1 -- 172.21.15.40:0/1949649229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94010b60 con 0x55e33caff840 2024-07-26T12:40:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.366+0000 7fbd86600640 1 -- 172.21.15.40:0/1949649229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd94023070 con 0x55e33caff840 2024-07-26T12:40:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.366+0000 7fbd86600640 1 -- 172.21.15.40:0/1949649229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9401f680 con 0x55e33caff840 2024-07-26T12:40:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 -- 172.21.15.40:0/1949649229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 msgr2=0x55e33cedcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cedcd60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbd9401e940 tx=0x7fbd9401e420 comp rx=0 tx=0).stop 2024-07-26T12:40:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 -- 172.21.15.40:0/1949649229 shutdown_connections 2024-07-26T12:40:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caff840 0x55e33cedcd60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33caf7660 0x55e33cedc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 --2- 172.21.15.40:0/1949649229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33cb14910 0x55e33cec68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 -- 172.21.15.40:0/1949649229 >> 172.21.15.40:0/1949649229 conn(0x55e33cec3390 msgr2=0x55e33cec61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:09.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 -- 172.21.15.40:0/1949649229 shutdown_connections 2024-07-26T12:40:09.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.367+0000 7fbda7440740 1 -- 172.21.15.40:0/1949649229 wait complete. 2024-07-26T12:40:09.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.368+0000 7fbda7440740 1 -- start start 2024-07-26T12:40:09.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.368+0000 7fbda7440740 1 Processor -- start 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 0x55e33ced9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caff840 0x55e33ced3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33cb14910 0x55e33ced3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981b2270 con 0x55e33caf7660 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981b1ba0 con 0x55e33cb14910 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981aedc0 con 0x55e33caff840 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbda7440740 10 client.0 _ll_register_callbacks cb 0x7fbd9401e5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 0x55e33ced9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 0x55e33ced9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57396/0 (socket says 172.21.15.40:57396) 2024-07-26T12:40:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbd9de00640 1 -- 172.21.15.40:0/1710805885 learned_addr learned my addr 172.21.15.40:0/1710805885 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:40:09.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33cb14910 0x55e33ced3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.369+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caff840 0x55e33ced3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9de00640 1 -- 172.21.15.40:0/1710805885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caff840 msgr2=0x55e33ced3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9de00640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caff840 0x55e33ced3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9de00640 1 -- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33cb14910 msgr2=0x55e33ced3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9de00640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33cb14910 0x55e33ced3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9de00640 1 -- 172.21.15.40:0/1710805885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33ced4620 con 0x55e33caf7660 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9e800640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33cb14910 0x55e33ced3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd9de00640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 0x55e33ced9080 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55e33cee31a0 tx=0x7fbd8c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6227591681fb881 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd7b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.370+0000 7fbd7b400640 1 -- 172.21.15.40:0/1710805885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c02a060 con 0x55e33caf7660 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.371+0000 7fbd7b400640 1 -- 172.21.15.40:0/1710805885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbd8c01e6c0 con 0x55e33caf7660 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.371+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd94023070 con 0x55e33caf7660 2024-07-26T12:40:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.371+0000 7fbd7b400640 1 -- 172.21.15.40:0/1710805885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbd8c01e8c0 con 0x55e33caf7660 2024-07-26T12:40:09.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.371+0000 7fbda7440740 10 client.16131 fetch_fsmap learned FSMap version 35 2024-07-26T12:40:09.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.371+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e33cf4c1f0 con 0x55e33caf7660 2024-07-26T12:40:09.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.371+0000 7fbd7b400640 1 -- 172.21.15.40:0/1710805885 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd94023070 con 0x55e33caf7660 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbd7b400640 1 -- 172.21.15.40:0/1710805885 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fbd8c02f070 con 0x55e33caf7660 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbda7440740 10 client.16131 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbda7440740 10 client.16131 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbda7440740 20 client.16131 populate_metadata read hostname 'smithi040' 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbda7440740 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cb20520 0x55e33cf4e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbda7440740 4 client.16131 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f0d8266", "release": true, "await": true}] 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f0d8266", "release": true, "await": true}) -- 0x55e33ce39940 con 0x55e33cb20520 2024-07-26T12:40:09.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.372+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cb20520 0x55e33cf4e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:40:09.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.373+0000 7fbd9d400640 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cb20520 0x55e33cf4e9b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e913ffcea00b6 server_cookie=670bde025c0ae485 in_seq=0 out_seq=0 2024-07-26T12:40:09.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.373+0000 7fbd7b400640 10 client.16131 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:40:09.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.449+0000 7fbd7b400640 1 -- 172.21.15.40:0/1710805885 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e33ce39940 con 0x55e33cb20520 2024-07-26T12:40:09.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.449+0000 7fbd7b400640 10 client.16131 handle_command_reply: tid=0 2024-07-26T12:40:09.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.449+0000 7fbda7440740 1 client.16131 shutdown 2024-07-26T12:40:09.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.449+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 msgr2=0x55e33ced9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.449+0000 7fbda7440740 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 0x55e33ced9080 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55e33cee31a0 tx=0x7fbd8c012820 comp rx=0 tx=0).stop 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 shutdown_connections 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e33cb14910 0x55e33ced3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e33caff840 0x55e33ced3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e33cb20520 0x55e33cf4e9b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 --2- 172.21.15.40:0/1710805885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e33caf7660 0x55e33ced9080 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 >> 172.21.15.40:0/1710805885 conn(0x55e33cec3390 msgr2=0x55e33cec6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbd7b400640 0 client.16131 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:40:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 shutdown_connections 2024-07-26T12:40:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.450+0000 7fbda7440740 1 -- 172.21.15.40:0/1710805885 wait complete. 2024-07-26T12:40:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.451+0000 7fbda7440740 20 client.16131 trim_cache size 0 max 16384 2024-07-26T12:40:09.452 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:40:09.452 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:40:09.452 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 56, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "3f0d8266": { 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 56, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.8, 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:40:09.453 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:40:09.454 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbd800b3c50 msgr2=0x7fbd800b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbd800b3c50 0x7fbd800b6160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd94005fd0 tx=0x7fbd94009740 comp rx=0 tx=0).stop 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 msgr2=0x7fbd9819c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9819c430 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd8802a910 tx=0x7fbd88003c20 comp rx=0 tx=0).stop 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 shutdown_connections 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbd800b3c50 0x7fbd800b6160 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9810b850 0x7fbd981a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd9810af00 0x7fbd9819c430 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 --2- 172.21.15.40:0/1317961270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd981055c0 0x7fbd9819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:40:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.452+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 >> 172.21.15.40:0/1317961270 conn(0x7fbd98101010 msgr2=0x7fbd98103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:40:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.453+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 shutdown_connections 2024-07-26T12:40:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:40:09.453+0000 7fbd9f200640 1 -- 172.21.15.40:0/1317961270 wait complete. 2024-07-26T12:40:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:09 smithi146 ceph-mon[35807]: pgmap v1037: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:40:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:09 smithi076 ceph-mon[35401]: pgmap v1037: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:40:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:09 smithi040 ceph-mon[32397]: pgmap v1037: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:40:10.336 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3f0d8266', total seconds elapsed: 36.4 2024-07-26T12:40:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:11 smithi146 ceph-mon[35807]: pgmap v1038: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:40:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:11 smithi076 ceph-mon[35401]: pgmap v1038: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:40:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:11 smithi040 ceph-mon[32397]: pgmap v1038: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:40:14.002 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:13 smithi146 ceph-mon[35807]: pgmap v1039: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:40:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:13 smithi076 ceph-mon[35401]: pgmap v1039: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:40:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:13 smithi040 ceph-mon[32397]: pgmap v1039: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:40:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:15 smithi146 ceph-mon[35807]: pgmap v1040: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1024 KiB/s wr, 12 op/s 2024-07-26T12:40:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:15 smithi076 ceph-mon[35401]: pgmap v1040: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1024 KiB/s wr, 12 op/s 2024-07-26T12:40:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:15 smithi040 ceph-mon[32397]: pgmap v1040: 97 pgs: 97 active+clean; 2.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1024 KiB/s wr, 12 op/s 2024-07-26T12:40:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:17 smithi040 ceph-mon[32397]: pgmap v1041: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:40:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:17 smithi146 ceph-mon[35807]: pgmap v1041: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:40:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:17 smithi076 ceph-mon[35401]: pgmap v1041: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T12:40:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:19 smithi146 ceph-mon[35807]: pgmap v1042: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:40:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:19 smithi076 ceph-mon[35401]: pgmap v1042: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:40:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:19 smithi040 ceph-mon[32397]: pgmap v1042: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:40:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:21 smithi146 ceph-mon[35807]: pgmap v1043: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T12:40:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:40:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:21 smithi076 ceph-mon[35401]: pgmap v1043: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T12:40:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:40:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:21 smithi040 ceph-mon[32397]: pgmap v1043: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T12:40:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:40:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:23 smithi146 ceph-mon[35807]: pgmap v1044: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T12:40:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:23 smithi076 ceph-mon[35401]: pgmap v1044: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T12:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:23 smithi040 ceph-mon[32397]: pgmap v1044: 97 pgs: 97 active+clean; 2.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T12:40:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:40:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:40:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:40:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:40:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:40:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:40:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:40:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:25 smithi146 ceph-mon[35807]: pgmap v1045: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 MiB/s wr, 13 op/s 2024-07-26T12:40:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:25 smithi076 ceph-mon[35401]: pgmap v1045: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 MiB/s wr, 13 op/s 2024-07-26T12:40:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:25 smithi040 ceph-mon[32397]: pgmap v1045: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 MiB/s wr, 13 op/s 2024-07-26T12:40:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:27 smithi040 ceph-mon[32397]: pgmap v1046: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.6 MiB/s wr, 9 op/s 2024-07-26T12:40:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:27 smithi146 ceph-mon[35807]: pgmap v1046: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.6 MiB/s wr, 9 op/s 2024-07-26T12:40:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:27 smithi076 ceph-mon[35401]: pgmap v1046: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.6 MiB/s wr, 9 op/s 2024-07-26T12:40:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:29 smithi040 ceph-mon[32397]: pgmap v1047: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:40:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:29 smithi146 ceph-mon[35807]: pgmap v1047: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:40:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:29 smithi076 ceph-mon[35401]: pgmap v1047: 97 pgs: 97 active+clean; 2.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:40:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:31 smithi040 ceph-mon[32397]: pgmap v1048: 97 pgs: 97 active+clean; 2.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:40:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:31 smithi146 ceph-mon[35807]: pgmap v1048: 97 pgs: 97 active+clean; 2.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:40:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:31 smithi076 ceph-mon[35401]: pgmap v1048: 97 pgs: 97 active+clean; 2.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:40:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:33 smithi040 ceph-mon[32397]: pgmap v1049: 97 pgs: 97 active+clean; 2.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:40:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:33 smithi146 ceph-mon[35807]: pgmap v1049: 97 pgs: 97 active+clean; 2.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:40:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:33 smithi076 ceph-mon[35401]: pgmap v1049: 97 pgs: 97 active+clean; 2.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:40:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:35 smithi040 ceph-mon[32397]: pgmap v1050: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:40:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:35 smithi146 ceph-mon[35807]: pgmap v1050: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:40:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:35 smithi076 ceph-mon[35401]: pgmap v1050: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:40:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:37 smithi040 ceph-mon[32397]: pgmap v1051: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:40:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:37 smithi146 ceph-mon[35807]: pgmap v1051: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:40:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:37 smithi076 ceph-mon[35401]: pgmap v1051: 97 pgs: 97 active+clean; 3.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:40:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:39 smithi040 ceph-mon[32397]: pgmap v1052: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:40:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:39 smithi146 ceph-mon[35807]: pgmap v1052: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:40:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:39 smithi076 ceph-mon[35401]: pgmap v1052: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:40:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:41 smithi040 ceph-mon[32397]: pgmap v1053: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:40:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:41 smithi146 ceph-mon[35807]: pgmap v1053: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:40:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:41 smithi076 ceph-mon[35401]: pgmap v1053: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:40:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:43 smithi040 ceph-mon[32397]: pgmap v1054: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:40:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:43 smithi146 ceph-mon[35807]: pgmap v1054: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:40:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:43 smithi076 ceph-mon[35401]: pgmap v1054: 97 pgs: 97 active+clean; 3.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:40:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:45 smithi040 ceph-mon[32397]: pgmap v1055: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:40:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:45 smithi146 ceph-mon[35807]: pgmap v1055: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:40:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:45 smithi076 ceph-mon[35401]: pgmap v1055: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:40:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:47 smithi040 ceph-mon[32397]: pgmap v1056: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:40:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:47 smithi146 ceph-mon[35807]: pgmap v1056: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:40:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:47 smithi076 ceph-mon[35401]: pgmap v1056: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:40:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:49 smithi076 ceph-mon[35401]: pgmap v1057: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:40:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:49 smithi040 ceph-mon[32397]: pgmap v1057: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:40:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:49 smithi146 ceph-mon[35807]: pgmap v1057: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:40:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:51 smithi040 ceph-mon[32397]: pgmap v1058: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:40:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:51 smithi146 ceph-mon[35807]: pgmap v1058: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:40:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:51 smithi076 ceph-mon[35401]: pgmap v1058: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:40:53.956 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:53 smithi146 ceph-mon[35807]: pgmap v1059: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:40:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:53 smithi040 ceph-mon[32397]: pgmap v1059: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:40:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:53 smithi076 ceph-mon[35401]: pgmap v1059: 97 pgs: 97 active+clean; 3.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:40:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:55 smithi040 ceph-mon[32397]: pgmap v1060: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:40:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:55 smithi146 ceph-mon[35807]: pgmap v1060: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:40:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:55 smithi076 ceph-mon[35401]: pgmap v1060: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:40:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:57 smithi040 ceph-mon[32397]: pgmap v1061: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:40:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:57 smithi146 ceph-mon[35807]: pgmap v1061: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:40:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:57 smithi076 ceph-mon[35401]: pgmap v1061: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:40:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:40:59 smithi040 ceph-mon[32397]: pgmap v1062: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:41:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:40:59 smithi146 ceph-mon[35807]: pgmap v1062: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:41:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:40:59 smithi076 ceph-mon[35401]: pgmap v1062: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:41:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:01 smithi040 ceph-mon[32397]: pgmap v1063: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:41:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:01 smithi146 ceph-mon[35807]: pgmap v1063: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:41:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:01 smithi076 ceph-mon[35401]: pgmap v1063: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:41:03.823 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.8 2024-07-26T12:41:03.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:41:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:03 smithi040 ceph-mon[32397]: pgmap v1064: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:41:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:03 smithi146 ceph-mon[35807]: pgmap v1064: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:41:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:03 smithi076 ceph-mon[35401]: pgmap v1064: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:41:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:41:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:05 smithi040 ceph-mon[32397]: pgmap v1065: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:41:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:05 smithi146 ceph-mon[35807]: pgmap v1065: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:41:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:05 smithi076 ceph-mon[35401]: pgmap v1065: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:41:06.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 -- 172.21.15.40:0/952913543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10af30 msgr2=0x7fd34c10b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 --2- 172.21.15.40:0/952913543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10af30 0x7fd34c10b340 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd338009900 tx=0x7fd33802a410 comp rx=0 tx=0).stop 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 -- 172.21.15.40:0/952913543 shutdown_connections 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 --2- 172.21.15.40:0/952913543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34c10b880 0x7fd34c1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 --2- 172.21.15.40:0/952913543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10af30 0x7fd34c10b340 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 --2- 172.21.15.40:0/952913543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd34c1055f0 0x7fd34c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 -- 172.21.15.40:0/952913543 >> 172.21.15.40:0/952913543 conn(0x7fd34c101060 msgr2=0x7fd34c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 -- 172.21.15.40:0/952913543 shutdown_connections 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.809+0000 7fd34b200640 1 -- 172.21.15.40:0/952913543 wait complete. 2024-07-26T12:41:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.811+0000 7fd34b200640 1 Processor -- start 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.811+0000 7fd34b200640 1 -- start start 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34c1055f0 0x7fd34c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd34c10af30 0x7fd34c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 0x7fd34c1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c115410 con 0x7fd34c10b880 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c115290 con 0x7fd34c10af30 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c115590 con 0x7fd34c1055f0 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 0x7fd34c1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd349e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34c1055f0 0x7fd34c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 0x7fd34c1a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44584/0 (socket says 172.21.15.40:44584) 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd34a800640 1 -- 172.21.15.40:0/566903668 learned_addr learned my addr 172.21.15.40:0/566903668 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.812+0000 7fd349400640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd34c10af30 0x7fd34c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.813+0000 7fd34a800640 1 -- 172.21.15.40:0/566903668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34c1055f0 msgr2=0x7fd34c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.813+0000 7fd34a800640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34c1055f0 0x7fd34c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.813+0000 7fd34a800640 1 -- 172.21.15.40:0/566903668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd34c10af30 msgr2=0x7fd34c19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.813+0000 7fd34a800640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd34c10af30 0x7fd34c19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.813+0000 7fd34a800640 1 -- 172.21.15.40:0/566903668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c1a1dd0 con 0x7fd34c10b880 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.814+0000 7fd34a800640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 0x7fd34c1a16a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd34400eaa0 tx=0x7fd34400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.814+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34400cdb0 con 0x7fd34c10b880 2024-07-26T12:41:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.814+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd344005020 con 0x7fd34c10b880 2024-07-26T12:41:06.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.814+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440116d0 con 0x7fd34c10b880 2024-07-26T12:41:06.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.814+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c1a20c0 con 0x7fd34c10b880 2024-07-26T12:41:06.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.815+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c1a8820 con 0x7fd34c10b880 2024-07-26T12:41:06.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.816+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c105a00 con 0x7fd34c10b880 2024-07-26T12:41:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.821+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd344004a40 con 0x7fd34c10b880 2024-07-26T12:41:06.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.824+0000 7fd342a00640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3300b3c50 0x7fd3300b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:06.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.824+0000 7fd349e00640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3300b3c50 0x7fd3300b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:06.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.824+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3440e3fe0 con 0x7fd34c10b880 2024-07-26T12:41:06.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.825+0000 7fd349e00640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3300b3c50 0x7fd3300b6160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00bbe0 tx=0x7fd33c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:06.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:06.828+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd344016030 con 0x7fd34c10b880 2024-07-26T12:41:07.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.119+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd34c02e0c0 con 0x7fd34c10b880 2024-07-26T12:41:07.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.120+0000 7fd342a00640 1 -- 172.21.15.40:0/566903668 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fd3440aafe0 con 0x7fd34c10b880 2024-07-26T12:41:07.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:41:07.123 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:41:07.124 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:41:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.124+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3300b3c50 msgr2=0x7fd3300b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.124+0000 7fd34b200640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3300b3c50 0x7fd3300b6160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00bbe0 tx=0x7fd33c00b390 comp rx=0 tx=0).stop 2024-07-26T12:41:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.124+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 msgr2=0x7fd34c1a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.124+0000 7fd34b200640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 0x7fd34c1a16a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd34400eaa0 tx=0x7fd34400ef60 comp rx=0 tx=0).stop 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 shutdown_connections 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd34c10b880 0x7fd34c1a16a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd34c10af30 0x7fd34c19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3300b3c50 0x7fd3300b6160 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 --2- 172.21.15.40:0/566903668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34c1055f0 0x7fd34c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 >> 172.21.15.40:0/566903668 conn(0x7fd34c101060 msgr2=0x7fd34c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 shutdown_connections 2024-07-26T12:41:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:07.125+0000 7fd34b200640 1 -- 172.21.15.40:0/566903668 wait complete. 2024-07-26T12:41:07.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:07 smithi040 ceph-mon[32397]: pgmap v1066: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:41:07.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/566903668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:41:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:07 smithi146 ceph-mon[35807]: pgmap v1066: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:41:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/566903668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:41:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:07 smithi076 ceph-mon[35401]: pgmap v1066: 97 pgs: 97 active+clean; 3.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:41:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:07 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/566903668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:41:08.096 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 153.8 --await-for 45.0' 2024-07-26T12:41:08.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 153.8 --await-for 45.0 2024-07-26T12:41:08.592 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:41:09.887 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:09 smithi040 ceph-mon[32397]: pgmap v1067: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:41:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:09 smithi146 ceph-mon[35807]: pgmap v1067: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:41:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:09 smithi076 ceph-mon[35401]: pgmap v1067: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:41:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 -- 172.21.15.40:0/2944061247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f010d680 msgr2=0x7f20f010fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:10.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 --2- 172.21.15.40:0/2944061247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f010d680 0x7f20f010fb70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009ca0 tx=0x7f20e802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 -- 172.21.15.40:0/2944061247 shutdown_connections 2024-07-26T12:41:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 --2- 172.21.15.40:0/2944061247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f010d680 0x7f20f010fb70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 --2- 172.21.15.40:0/2944061247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f0104b70 0x7f20f010d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 --2- 172.21.15.40:0/2944061247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0104220 0x7f20f0104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 -- 172.21.15.40:0/2944061247 >> 172.21.15.40:0/2944061247 conn(0x7f20f00fdd60 msgr2=0x7f20f01001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:10.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 -- 172.21.15.40:0/2944061247 shutdown_connections 2024-07-26T12:41:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.945+0000 7f20efe00640 1 -- 172.21.15.40:0/2944061247 wait complete. 2024-07-26T12:41:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.947+0000 7f20efe00640 1 Processor -- start 2024-07-26T12:41:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.947+0000 7f20efe00640 1 -- start start 2024-07-26T12:41:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 0x7f20f019be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20efe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f0104b70 0x7f20f019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20efe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f010d680 0x7f20f01a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20efe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0113200 con 0x7f20f0104220 2024-07-26T12:41:10.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20efe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0113080 con 0x7f20f0104b70 2024-07-26T12:41:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20efe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0113380 con 0x7f20f010d680 2024-07-26T12:41:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20eea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 0x7f20f019be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20eea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 0x7f20f019be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44590/0 (socket says 172.21.15.40:44590) 2024-07-26T12:41:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20eea00640 1 -- 172.21.15.40:0/740683022 learned_addr learned my addr 172.21.15.40:0/740683022 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.948+0000 7f20ee000640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f0104b70 0x7f20f019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.949+0000 7f20ef400640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f010d680 0x7f20f01a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.949+0000 7f20eea00640 1 -- 172.21.15.40:0/740683022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f010d680 msgr2=0x7f20f01a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.949+0000 7f20eea00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f010d680 0x7f20f01a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.949+0000 7f20eea00640 1 -- 172.21.15.40:0/740683022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f0104b70 msgr2=0x7f20f019c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.949+0000 7f20eea00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f0104b70 0x7f20f019c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.949+0000 7f20eea00640 1 -- 172.21.15.40:0/740683022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f01a1da0 con 0x7f20f0104220 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.950+0000 7f20eea00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 0x7f20f019be30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f20e000d770 tx=0x7f20e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.950+0000 7f20f4a00640 1 -- 172.21.15.40:0/740683022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0017070 con 0x7f20f0104220 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.950+0000 7f20f4a00640 1 -- 172.21.15.40:0/740683022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e00054b0 con 0x7f20f0104220 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.950+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f01a2090 con 0x7f20f0104220 2024-07-26T12:41:10.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.950+0000 7f20f4a00640 1 -- 172.21.15.40:0/740683022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004c60 con 0x7f20f0104220 2024-07-26T12:41:10.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.950+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f01a87f0 con 0x7f20f0104220 2024-07-26T12:41:10.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.954+0000 7f20fca87740 1 Processor -- start 2024-07-26T12:41:10.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 -- start start 2024-07-26T12:41:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 0x5589154663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x5589154668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x558915466e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558915430d10 con 0x5589150c0840 2024-07-26T12:41:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5589153dbb60 con 0x55891509fb60 2024-07-26T12:41:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.955+0000 7f20fca87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5589153cb060 con 0x558915097980 2024-07-26T12:41:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.956+0000 7f20ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 0x5589154663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.956+0000 7f20f4a00640 1 -- 172.21.15.40:0/740683022 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f20e0010460 con 0x7f20f0104220 2024-07-26T12:41:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.956+0000 7f20ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 0x5589154663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44606/0 (socket says 172.21.15.40:44606) 2024-07-26T12:41:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.956+0000 7f20ef400640 1 -- 172.21.15.40:0/2832113361 learned_addr learned my addr 172.21.15.40:0/2832113361 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.956+0000 7f20ee000640 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x558915466e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.956+0000 7f20eea00640 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x5589154668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20ef400640 1 -- 172.21.15.40:0/2832113361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 msgr2=0x5589154668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20ef400640 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x5589154668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20ef400640 1 -- 172.21.15.40:0/2832113361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 msgr2=0x558915466e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20ef400640 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x558915466e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20ef400640 1 -- 172.21.15.40:0/2832113361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558915352b10 con 0x5589150c0840 2024-07-26T12:41:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20eea00640 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x5589154668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:41:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20ef400640 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 0x5589154663b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f20e8005e30 tx=0x7f20e8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2965575cd30043ff server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20dbe00640 1 -- 172.21.15.40:0/2832113361 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8031980 con 0x5589150c0840 2024-07-26T12:41:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20dbe00640 1 -- 172.21.15.40:0/2832113361 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e8036040 con 0x5589150c0840 2024-07-26T12:41:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.958+0000 7f20dbe00640 1 -- 172.21.15.40:0/2832113361 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e80043c0 con 0x5589150c0840 2024-07-26T12:41:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.959+0000 7f20f4a00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20d40b3cc0 0x7f20d40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.959+0000 7f20f4a00640 1 -- 172.21.15.40:0/740683022 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f20e00e3690 con 0x7f20f0104220 2024-07-26T12:41:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.959+0000 7f20fca87740 1 -- 172.21.15.40:0/2832113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 msgr2=0x5589154663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.959+0000 7f20fca87740 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 0x5589154663b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f20e8005e30 tx=0x7f20e8009a20 comp rx=0 tx=0).stop 2024-07-26T12:41:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.959+0000 7f20eea00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20d40b3cc0 0x7f20d40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 -- 172.21.15.40:0/2832113361 shutdown_connections 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x558915466e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x5589154668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 --2- 172.21.15.40:0/2832113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5589150c0840 0x5589154663b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 -- 172.21.15.40:0/2832113361 >> 172.21.15.40:0/2832113361 conn(0x5589150b4990 msgr2=0x5589154642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 -- 172.21.15.40:0/2832113361 shutdown_connections 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.960+0000 7f20fca87740 1 -- 172.21.15.40:0/2832113361 wait complete. 2024-07-26T12:41:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.961+0000 7f20eea00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20d40b3cc0 0x7f20d40b61d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f20e00aa530 tx=0x7f20e00b3040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.961+0000 7f20fca87740 1 -- start start 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.961+0000 7f20fca87740 1 Processor -- start 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x55891547ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x558915480180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558915367520 con 0x558915097980 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5589153cf0a0 con 0x55891509fb60 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55891522e7a0 con 0x5589150c0840 2024-07-26T12:41:10.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.962+0000 7f20fca87740 10 client.0 _ll_register_callbacks cb 0x5589153c3bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:41:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x55891547ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x55891547ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44614/0 (socket says 172.21.15.40:44614) 2024-07-26T12:41:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 -- 172.21.15.40:0/2260847047 learned_addr learned my addr 172.21.15.40:0/2260847047 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ee000640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x558915480180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 -- 172.21.15.40:0/2260847047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 msgr2=0x558915480180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:10.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x558915480180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 -- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 msgr2=0x55891547b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:10.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.963+0000 7f20ef400640 1 -- 172.21.15.40:0/2260847047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55891513ab90 con 0x558915097980 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.964+0000 7f20ef400640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x55891547ab80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f20e802a900 tx=0x7f20e8005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d342a44c2e35ac server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.964+0000 7f20d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.964+0000 7f20d8c00640 1 -- 172.21.15.40:0/2260847047 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8056060 con 0x558915097980 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.964+0000 7f20d8c00640 1 -- 172.21.15.40:0/2260847047 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f20e8031980 con 0x558915097980 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.965+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e8036040 con 0x558915097980 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.965+0000 7f20d8c00640 1 -- 172.21.15.40:0/2260847047 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f20e8031b80 con 0x558915097980 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.965+0000 7f20fca87740 10 client.16149 fetch_fsmap learned FSMap version 35 2024-07-26T12:41:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.965+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5589154890d0 con 0x558915097980 2024-07-26T12:41:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.966+0000 7f20d8c00640 1 -- 172.21.15.40:0/2260847047 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e8036040 con 0x558915097980 2024-07-26T12:41:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.966+0000 7f20d8c00640 1 -- 172.21.15.40:0/2260847047 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f20e80305c0 con 0x558915097980 2024-07-26T12:41:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.966+0000 7f20fca87740 10 client.16149 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:41:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.966+0000 7f20fca87740 10 client.16149 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:41:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.966+0000 7f20fca87740 20 client.16149 populate_metadata read hostname 'smithi040' 2024-07-26T12:41:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.966+0000 7f20fca87740 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55891507f1c0 0x55891548c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.967+0000 7f20fca87740 4 client.16149 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:41:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.967+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589153ddab0 con 0x55891507f1c0 2024-07-26T12:41:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.968+0000 7f20ee000640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55891507f1c0 0x55891548c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.969+0000 7f20ee000640 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55891507f1c0 0x55891548c430 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c344267e518d5d5 server_cookie=854e7c6e325e9614 in_seq=0 out_seq=0 2024-07-26T12:41:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.969+0000 7f20d8c00640 10 client.16149 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.972+0000 7f20d8c00640 1 -- 172.21.15.40:0/2260847047 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589153ddab0 con 0x55891507f1c0 2024-07-26T12:41:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.972+0000 7f20d8c00640 10 client.16149 handle_command_reply: tid=0 2024-07-26T12:41:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.972+0000 7f20fca87740 1 client.16149 shutdown 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.972+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 msgr2=0x55891547ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.972+0000 7f20fca87740 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x55891547ab80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f20e802a900 tx=0x7f20e8005bf0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 shutdown_connections 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x558915480180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55891507f1c0 0x55891548c430 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 --2- 172.21.15.40:0/2260847047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x55891547ab80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 >> 172.21.15.40:0/2260847047 conn(0x5589150b4990 msgr2=0x558915469590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20d8c00640 0 client.16149 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 shutdown_connections 2024-07-26T12:41:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 1 -- 172.21.15.40:0/2260847047 wait complete. 2024-07-26T12:41:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.973+0000 7f20fca87740 20 client.16149 trim_cache size 0 max 16384 2024-07-26T12:41:10.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 Processor -- start 2024-07-26T12:41:10.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 -- start start 2024-07-26T12:41:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x558915473eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x55891547bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01ac950 con 0x558915097980 2024-07-26T12:41:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01ae490 con 0x55891509fb60 2024-07-26T12:41:10.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.995+0000 7f20fca87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01ad020 con 0x5589150c0840 2024-07-26T12:41:10.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x558915473eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x558915473eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44620/0 (socket says 172.21.15.40:44620) 2024-07-26T12:41:10.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 -- 172.21.15.40:0/103174996 learned_addr learned my addr 172.21.15.40:0/103174996 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ee000640 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 -- 172.21.15.40:0/103174996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 msgr2=0x55891547bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x55891547bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 -- 172.21.15.40:0/103174996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 msgr2=0x55891547a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.996+0000 7f20ef400640 1 -- 172.21.15.40:0/103174996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55891547b5c0 con 0x558915097980 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.997+0000 7f20ef400640 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x558915473eb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009620 tx=0x7f20e8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90147c5fa1933170 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.997+0000 7f20db400640 1 -- 172.21.15.40:0/103174996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8060080 con 0x558915097980 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.997+0000 7f20db400640 1 -- 172.21.15.40:0/103174996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e8036040 con 0x558915097980 2024-07-26T12:41:10.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.997+0000 7f20db400640 1 -- 172.21.15.40:0/103174996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e80305c0 con 0x558915097980 2024-07-26T12:41:11.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 -- 172.21.15.40:0/103174996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 msgr2=0x558915473eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:11.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x558915473eb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009620 tx=0x7f20e8009800 comp rx=0 tx=0).stop 2024-07-26T12:41:11.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 -- 172.21.15.40:0/103174996 shutdown_connections 2024-07-26T12:41:11.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589150c0840 0x55891547bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55891509fb60 0x55891547a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 --2- 172.21.15.40:0/103174996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558915097980 0x558915473eb0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 -- 172.21.15.40:0/103174996 >> 172.21.15.40:0/103174996 conn(0x5589150b4990 msgr2=0x5589154694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.998+0000 7f20fca87740 1 -- 172.21.15.40:0/103174996 shutdown_connections 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.999+0000 7f20fca87740 1 -- 172.21.15.40:0/103174996 wait complete. 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:10.999+0000 7f20fca87740 1 -- start start 2024-07-26T12:41:11.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 Processor -- start 2024-07-26T12:41:11.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x558915486c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 0x5589154820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589150c0840 0x558915482610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01addc0 con 0x55891509fb60 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01ad6f0 con 0x5589150c0840 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01aa990 con 0x558915097980 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.000+0000 7f20fca87740 10 client.0 _ll_register_callbacks cb 0x7f20dc00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.001+0000 7f20ee000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 0x5589154820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.001+0000 7f20ee000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 0x5589154820d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44628/0 (socket says 172.21.15.40:44628) 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.001+0000 7f20ee000640 1 -- 172.21.15.40:0/1157489492 learned_addr learned my addr 172.21.15.40:0/1157489492 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.001+0000 7f20ef400640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x558915486c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:11.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.001+0000 7f20ef400640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589150c0840 0x558915482610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:11.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20ee000640 1 -- 172.21.15.40:0/1157489492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 msgr2=0x558915486c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:11.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20ee000640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x558915486c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20ee000640 1 -- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589150c0840 msgr2=0x558915482610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:11.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20ee000640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589150c0840 0x558915482610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20ee000640 1 -- 172.21.15.40:0/1157489492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558915482b80 con 0x55891509fb60 2024-07-26T12:41:11.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20ee000640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 0x5589154820d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00b890 tx=0x7f20dc0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8363cc760c7bce6d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:11.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.002+0000 7f20d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:41:11.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.003+0000 7f20d8c00640 1 -- 172.21.15.40:0/1157489492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc011640 con 0x55891509fb60 2024-07-26T12:41:11.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.003+0000 7f20d8c00640 1 -- 172.21.15.40:0/1157489492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f20dc0117e0 con 0x55891509fb60 2024-07-26T12:41:11.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.003+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e8036040 con 0x55891509fb60 2024-07-26T12:41:11.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.003+0000 7f20d8c00640 1 -- 172.21.15.40:0/1157489492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f20dc0119e0 con 0x55891509fb60 2024-07-26T12:41:11.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.003+0000 7f20fca87740 10 client.16155 fetch_fsmap learned FSMap version 35 2024-07-26T12:41:11.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.003+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5589154f46f0 con 0x55891509fb60 2024-07-26T12:41:11.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20d8c00640 1 -- 172.21.15.40:0/1157489492 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e8036040 con 0x55891509fb60 2024-07-26T12:41:11.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20d8c00640 1 -- 172.21.15.40:0/1157489492 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f20dc030b20 con 0x55891509fb60 2024-07-26T12:41:11.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20fca87740 10 client.16155 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:41:11.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20fca87740 10 client.16155 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:41:11.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20fca87740 20 client.16155 populate_metadata read hostname 'smithi040' 2024-07-26T12:41:11.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20fca87740 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558915054570 0x5589154f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:11.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20fca87740 4 client.16155 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.8, "await_for": 45.0}] 2024-07-26T12:41:11.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.004+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.8, "await_for": 45.0}) -- 0x558915480c30 con 0x558915054570 2024-07-26T12:41:11.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.005+0000 7f20ef400640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558915054570 0x5589154f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:11.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.006+0000 7f20ef400640 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558915054570 0x5589154f6f00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62ddce1c14985ac server_cookie=e0bcec672398c36f in_seq=0 out_seq=0 2024-07-26T12:41:11.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.006+0000 7f20d8c00640 10 client.16155 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20d8c00640 1 -- 172.21.15.40:0/1157489492 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558915480c30 con 0x558915054570 2024-07-26T12:41:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20d8c00640 10 client.16155 handle_command_reply: tid=0 2024-07-26T12:41:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 client.16155 shutdown 2024-07-26T12:41:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 msgr2=0x5589154820d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:11.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 0x5589154820d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00b890 tx=0x7f20dc0035f0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 shutdown_connections 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5589150c0840 0x558915482610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558915054570 0x5589154f6f00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55891509fb60 0x5589154820d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 --2- 172.21.15.40:0/1157489492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558915097980 0x558915486c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 >> 172.21.15.40:0/1157489492 conn(0x5589150b4990 msgr2=0x5589154694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:11.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.272+0000 7f20d8c00640 0 client.16155 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:11.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.273+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 shutdown_connections 2024-07-26T12:41:11.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.273+0000 7f20fca87740 1 -- 172.21.15.40:0/1157489492 wait complete. 2024-07-26T12:41:11.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.274+0000 7f20fca87740 20 client.16155 trim_cache size 0 max 16384 2024-07-26T12:41:11.276 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 58, 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "ec208ffd": { 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 58, 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:41:11.277 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 153.8, 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:11.278 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:11.279 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:41:11.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.275+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20d40b3cc0 msgr2=0x7f20d40b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:11.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.275+0000 7f20efe00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20d40b3cc0 0x7f20d40b61d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f20e00aa530 tx=0x7f20e00b3040 comp rx=0 tx=0).stop 2024-07-26T12:41:11.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.275+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 msgr2=0x7f20f019be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:11.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.275+0000 7f20efe00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 0x7f20f019be30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f20e000d770 tx=0x7f20e000dc30 comp rx=0 tx=0).stop 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 shutdown_connections 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f20d40b3cc0 0x7f20d40b61d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f010d680 0x7f20f01a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20f0104b70 0x7f20f019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 --2- 172.21.15.40:0/740683022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f0104220 0x7f20f019be30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 >> 172.21.15.40:0/740683022 conn(0x7f20f00fdd60 msgr2=0x7f20f0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 shutdown_connections 2024-07-26T12:41:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:11.276+0000 7f20efe00640 1 -- 172.21.15.40:0/740683022 wait complete. 2024-07-26T12:41:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:11 smithi146 ceph-mon[35807]: pgmap v1068: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:41:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:11 smithi076 ceph-mon[35401]: pgmap v1068: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:41:12.121 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:11 smithi040 ceph-mon[32397]: pgmap v1068: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:41:12.192 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ec208ffd', quiesce took 8.4 seconds. Will release after: 25.4 2024-07-26T12:41:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:13 smithi146 ceph-mon[35807]: pgmap v1069: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:41:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:13 smithi076 ceph-mon[35401]: pgmap v1069: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:41:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:13 smithi040 ceph-mon[32397]: pgmap v1069: 97 pgs: 97 active+clean; 3.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:41:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:15 smithi146 ceph-mon[35807]: pgmap v1070: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:41:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:15 smithi076 ceph-mon[35401]: pgmap v1070: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:41:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:15 smithi040 ceph-mon[32397]: pgmap v1070: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:41:18.025 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:17 smithi040 ceph-mon[32397]: pgmap v1071: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:41:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:17 smithi146 ceph-mon[35807]: pgmap v1071: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:41:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:17 smithi076 ceph-mon[35401]: pgmap v1071: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:41:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:19 smithi146 ceph-mon[35807]: pgmap v1072: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:41:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:19 smithi076 ceph-mon[35401]: pgmap v1072: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:41:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:19 smithi040 ceph-mon[32397]: pgmap v1072: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:41:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:21 smithi146 ceph-mon[35807]: pgmap v1073: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:41:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:21 smithi076 ceph-mon[35401]: pgmap v1073: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:41:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:21 smithi040 ceph-mon[32397]: pgmap v1073: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:41:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:23 smithi146 ceph-mon[35807]: pgmap v1074: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 MiB/s wr, 10 op/s 2024-07-26T12:41:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:41:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:23 smithi076 ceph-mon[35401]: pgmap v1074: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 MiB/s wr, 10 op/s 2024-07-26T12:41:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:41:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:23 smithi040 ceph-mon[32397]: pgmap v1074: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 MiB/s wr, 10 op/s 2024-07-26T12:41:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:41:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:25 smithi146 ceph-mon[35807]: pgmap v1075: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 MiB/s wr, 13 op/s 2024-07-26T12:41:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:25 smithi076 ceph-mon[35401]: pgmap v1075: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 MiB/s wr, 13 op/s 2024-07-26T12:41:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:25 smithi040 ceph-mon[32397]: pgmap v1075: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 MiB/s wr, 13 op/s 2024-07-26T12:41:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:26 smithi040 ceph-mon[32397]: pgmap v1076: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 414 KiB/s wr, 8 op/s 2024-07-26T12:41:27.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:26 smithi146 ceph-mon[35807]: pgmap v1076: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 414 KiB/s wr, 8 op/s 2024-07-26T12:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:27.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:26 smithi076 ceph-mon[35401]: pgmap v1076: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 414 KiB/s wr, 8 op/s 2024-07-26T12:41:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:41:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:41:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:41:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:41:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:41:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:41:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:41:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:29 smithi040 ceph-mon[32397]: pgmap v1077: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 415 KiB/s wr, 10 op/s 2024-07-26T12:41:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:29 smithi146 ceph-mon[35807]: pgmap v1077: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 415 KiB/s wr, 10 op/s 2024-07-26T12:41:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:29 smithi076 ceph-mon[35401]: pgmap v1077: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 415 KiB/s wr, 10 op/s 2024-07-26T12:41:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:31 smithi040 ceph-mon[32397]: pgmap v1078: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 342 KiB/s wr, 10 op/s 2024-07-26T12:41:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:31 smithi146 ceph-mon[35807]: pgmap v1078: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 342 KiB/s wr, 10 op/s 2024-07-26T12:41:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:31 smithi076 ceph-mon[35401]: pgmap v1078: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 342 KiB/s wr, 10 op/s 2024-07-26T12:41:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:33 smithi040 ceph-mon[32397]: pgmap v1079: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 852 B/s wr, 9 op/s 2024-07-26T12:41:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:33 smithi146 ceph-mon[35807]: pgmap v1079: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 852 B/s wr, 9 op/s 2024-07-26T12:41:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:33 smithi076 ceph-mon[35401]: pgmap v1079: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 852 B/s wr, 9 op/s 2024-07-26T12:41:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:35 smithi040 ceph-mon[32397]: pgmap v1080: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-07-26T12:41:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:35 smithi146 ceph-mon[35807]: pgmap v1080: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-07-26T12:41:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:35 smithi076 ceph-mon[35401]: pgmap v1080: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 852 B/s wr, 12 op/s 2024-07-26T12:41:37.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:41:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:37 smithi040 ceph-mon[32397]: pgmap v1081: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:41:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:37 smithi146 ceph-mon[35807]: pgmap v1081: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:41:38.072 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:41:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:37 smithi076 ceph-mon[35401]: pgmap v1081: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:41:39.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:39 smithi040 ceph-mon[32397]: pgmap v1082: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:41:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:39 smithi146 ceph-mon[35807]: pgmap v1082: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:41:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:39 smithi076 ceph-mon[35401]: pgmap v1082: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:41:40.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.231+0000 7faaaf000640 1 -- 172.21.15.40:0/725938693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810af10 msgr2=0x7faaa810b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:40.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.231+0000 7faaaf000640 1 --2- 172.21.15.40:0/725938693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810af10 0x7faaa810b320 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faa94009900 tx=0x7faa9402a410 comp rx=0 tx=0).stop 2024-07-26T12:41:40.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 -- 172.21.15.40:0/725938693 shutdown_connections 2024-07-26T12:41:40.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 --2- 172.21.15.40:0/725938693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faaa810b860 0x7faaa8112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 --2- 172.21.15.40:0/725938693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810af10 0x7faaa810b320 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 --2- 172.21.15.40:0/725938693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa81055d0 0x7faaa81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 -- 172.21.15.40:0/725938693 >> 172.21.15.40:0/725938693 conn(0x7faaa8101040 msgr2=0x7faaa8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:40.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 -- 172.21.15.40:0/725938693 shutdown_connections 2024-07-26T12:41:40.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.232+0000 7faaaf000640 1 -- 172.21.15.40:0/725938693 wait complete. 2024-07-26T12:41:40.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.233+0000 7faaaf000640 1 Processor -- start 2024-07-26T12:41:40.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.233+0000 7faaaf000640 1 -- start start 2024-07-26T12:41:40.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaaf000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa81055d0 0x7faaa819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:40.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaaf000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faaa810af10 0x7faaa819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaaf000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 0x7faaa81a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaaf000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81153d0 con 0x7faaa810b860 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaaf000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8115250 con 0x7faaa810af10 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaaf000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8115550 con 0x7faaa81055d0 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaae600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 0x7faaa81a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaae600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 0x7faaa81a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41854/0 (socket says 172.21.15.40:41854) 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaae600640 1 -- 172.21.15.40:0/3139735104 learned_addr learned my addr 172.21.15.40:0/3139735104 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaad200640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faaa810af10 0x7faaa819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.234+0000 7faaadc00640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa81055d0 0x7faaa819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaae600640 1 -- 172.21.15.40:0/3139735104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa81055d0 msgr2=0x7faaa819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:40.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaae600640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa81055d0 0x7faaa819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaae600640 1 -- 172.21.15.40:0/3139735104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faaa810af10 msgr2=0x7faaa819c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:40.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaae600640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faaa810af10 0x7faaa819c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaae600640 1 -- 172.21.15.40:0/3139735104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa81a1dd0 con 0x7faaa810b860 2024-07-26T12:41:40.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaae600640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 0x7faaa81a16a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faaa000d750 tx=0x7faaa000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:40.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0017070 con 0x7faaa810b860 2024-07-26T12:41:40.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa81a20c0 con 0x7faaa810b860 2024-07-26T12:41:40.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaa00054b0 con 0x7faaa810b860 2024-07-26T12:41:40.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.235+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0004b90 con 0x7faaa810b860 2024-07-26T12:41:40.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.236+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa81a8820 con 0x7faaa810b860 2024-07-26T12:41:40.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.237+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa81059e0 con 0x7faaa810b860 2024-07-26T12:41:40.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.240+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faaa0004d30 con 0x7faaa810b860 2024-07-26T12:41:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.243+0000 7faaa6000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa900b3bd0 0x7faa900b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.243+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faaa00e3aa0 con 0x7faaa810b860 2024-07-26T12:41:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.243+0000 7faaadc00640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa900b3bd0 0x7faa900b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.243+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7faaa00ab0b0 con 0x7faaa810b860 2024-07-26T12:41:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.244+0000 7faaadc00640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa900b3bd0 0x7faa900b60e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa9c005fd0 tx=0x7faa9c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:40.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.485+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa819cf90 con 0x7faaa810b860 2024-07-26T12:41:40.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.488+0000 7faaa6000640 1 -- 172.21.15.40:0/3139735104 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7faaa819cf90 con 0x7faaa810b860 2024-07-26T12:41:40.490 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:41:40.490 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:41:40.490 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa900b3bd0 msgr2=0x7faa900b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa900b3bd0 0x7faa900b60e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa9c005fd0 tx=0x7faa9c009520 comp rx=0 tx=0).stop 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 msgr2=0x7faaa81a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 0x7faaa81a16a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faaa000d750 tx=0x7faaa000dc10 comp rx=0 tx=0).stop 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 shutdown_connections 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaa810b860 0x7faaa81a16a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faaa810af10 0x7faaa819c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faa900b3bd0 0x7faa900b60e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 --2- 172.21.15.40:0/3139735104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa81055d0 0x7faaa819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 >> 172.21.15.40:0/3139735104 conn(0x7faaa8101040 msgr2=0x7faaa8103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 shutdown_connections 2024-07-26T12:41:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:40.491+0000 7faaaf000640 1 -- 172.21.15.40:0/3139735104 wait complete. 2024-07-26T12:41:40.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:40 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3139735104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:41:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:40 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3139735104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:41:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:40 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3139735104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:41:41.224 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id ec208ffd --release --await' 2024-07-26T12:41:41.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id ec208ffd --release --await 2024-07-26T12:41:41.722 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:41:41.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:41 smithi146 ceph-mon[35807]: pgmap v1083: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:41:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:41 smithi040 ceph-mon[32397]: pgmap v1083: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:41:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:41 smithi076 ceph-mon[35401]: pgmap v1083: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:41:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:43 smithi040 ceph-mon[32397]: pgmap v1084: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:41:44.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 -- 172.21.15.40:0/2217552086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 msgr2=0x7fd9ec1164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/2217552086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1164b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009ca0 tx=0x7fd9e402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 -- 172.21.15.40:0/2217552086 shutdown_connections 2024-07-26T12:41:44.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/2217552086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1164b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/2217552086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9ec10f330 0x7fd9ec10f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/2217552086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 0x7fd9ec109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 -- 172.21.15.40:0/2217552086 >> 172.21.15.40:0/2217552086 conn(0x7fd9ec078ff0 msgr2=0x7fd9ec107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:44.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 -- 172.21.15.40:0/2217552086 shutdown_connections 2024-07-26T12:41:44.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.026+0000 7fd9f2e00640 1 -- 172.21.15.40:0/2217552086 wait complete. 2024-07-26T12:41:44.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.027+0000 7fd9f2e00640 1 Processor -- start 2024-07-26T12:41:44.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 -- start start 2024-07-26T12:41:44.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 0x7fd9ec1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9ec10f330 0x7fd9ec1a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec119840 con 0x7fd9ec10fc80 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1196c0 con 0x7fd9ec1099f0 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.028+0000 7fd9f2e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1199c0 con 0x7fd9ec10f330 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36186/0 (socket says 172.21.15.40:36186) 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 -- 172.21.15.40:0/3305482932 learned_addr learned my addr 172.21.15.40:0/3305482932 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 0x7fd9ec1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9ec10f330 0x7fd9ec1a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 -- 172.21.15.40:0/3305482932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9ec10f330 msgr2=0x7fd9ec1a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9ec10f330 0x7fd9ec1a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 -- 172.21.15.40:0/3305482932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 msgr2=0x7fd9ec1a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 0x7fd9ec1a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f2400640 1 -- 172.21.15.40:0/3305482932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec1a6080 con 0x7fd9ec10fc80 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.029+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 0x7fd9ec1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.030+0000 7fd9f2400640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1a5a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4031040 tx=0x7fd9e4032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.030+0000 7fd9ea000640 1 -- 172.21.15.40:0/3305482932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4004040 con 0x7fd9ec10fc80 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.030+0000 7fd9ea000640 1 -- 172.21.15.40:0/3305482932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e4004670 con 0x7fd9ec10fc80 2024-07-26T12:41:44.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.030+0000 7fd9ea000640 1 -- 172.21.15.40:0/3305482932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4030bb0 con 0x7fd9ec10fc80 2024-07-26T12:41:44.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.030+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ec1a6310 con 0x7fd9ec10fc80 2024-07-26T12:41:44.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.030+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ec1a6850 con 0x7fd9ec10fc80 2024-07-26T12:41:44.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.035+0000 7fd9fb02f740 1 Processor -- start 2024-07-26T12:41:44.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.035+0000 7fd9ea000640 1 -- 172.21.15.40:0/3305482932 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd9e40041e0 con 0x7fd9ec10fc80 2024-07-26T12:41:44.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 -- start start 2024-07-26T12:41:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dc971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dc976e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8d1840 0x55751dc97c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55751dc0df50 con 0x55751d8c9660 2024-07-26T12:41:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55751dbfd450 con 0x55751d8d1840 2024-07-26T12:41:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55751dc01490 con 0x55751d8f2520 2024-07-26T12:41:44.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.036+0000 7fd9f1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dc976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dc976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36192/0 (socket says 172.21.15.40:36192) 2024-07-26T12:41:44.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3890553897 learned_addr learned my addr 172.21.15.40:0/3890553897 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:44.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dc971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8d1840 0x55751dc97c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3890553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 msgr2=0x55751dc971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dc971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3890553897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8d1840 msgr2=0x55751dc97c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8d1840 0x55751dc97c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3890553897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55751d95db00 con 0x55751d8c9660 2024-07-26T12:41:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8d1840 0x55751dc97c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9ea000640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd9d40b3c00 0x7fd9d40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.037+0000 7fd9ea000640 1 -- 172.21.15.40:0/3305482932 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd9e4105130 con 0x7fd9ec10fc80 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.038+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dc976e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0008c60 tx=0x7fd9e000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f247dbf4ce60b83 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.038+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd9d40b3c00 0x7fd9d40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.038+0000 7fd9dea00640 1 -- 172.21.15.40:0/3890553897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0014070 con 0x55751d8c9660 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.038+0000 7fd9dea00640 1 -- 172.21.15.40:0/3890553897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e00047a0 con 0x55751d8c9660 2024-07-26T12:41:44.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.038+0000 7fd9dea00640 1 -- 172.21.15.40:0/3890553897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0010630 con 0x55751d8c9660 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3890553897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 msgr2=0x55751dc976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dc976e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0008c60 tx=0x7fd9e000e720 comp rx=0 tx=0).stop 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd9d40b3c00 0x7fd9d40b6110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec07b290 tx=0x7fd9d80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3890553897 shutdown_connections 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8d1840 0x55751dc97c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dc976e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3890553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dc971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3890553897 >> 172.21.15.40:0/3890553897 conn(0x55751d8e6910 msgr2=0x55751dc95090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3890553897 shutdown_connections 2024-07-26T12:41:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.039+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3890553897 wait complete. 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.040+0000 7fd9fb02f740 1 -- start start 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.040+0000 7fd9fb02f740 1 Processor -- start 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcaec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55751da60bb0 con 0x55751d8c9660 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55751db99930 con 0x55751d8f2520 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55751dca5980 con 0x55751d8d1840 2024-07-26T12:41:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9fb02f740 10 client.0 _ll_register_callbacks cb 0x55751d909d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:41:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9f1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9f1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36196/0 (socket says 172.21.15.40:36196) 2024-07-26T12:41:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.041+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3324666702 learned_addr learned my addr 172.21.15.40:0/3324666702 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f2400640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcaec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3324666702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 msgr2=0x55751dca2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 msgr2=0x55751dcaec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcaec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1a00640 1 -- 172.21.15.40:0/3324666702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55751d9d4960 con 0x55751d8c9660 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f2400640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcaec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca27f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0005e10 tx=0x7fd9e00089a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726dad2cb35391fb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.042+0000 7fd9d3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9d3400640 1 -- 172.21.15.40:0/3324666702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0014030 con 0x55751d8c9660 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9d3400640 1 -- 172.21.15.40:0/3324666702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd9e0004320 con 0x55751d8c9660 2024-07-26T12:41:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e00047a0 con 0x55751d8c9660 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9d3400640 1 -- 172.21.15.40:0/3324666702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd9e0005000 con 0x55751d8c9660 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9fb02f740 10 client.16173 fetch_fsmap learned FSMap version 35 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55751dcb15a0 con 0x55751d8c9660 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.043+0000 7fd9d3400640 1 -- 172.21.15.40:0/3324666702 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e00047a0 con 0x55751d8c9660 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9d3400640 1 -- 172.21.15.40:0/3324666702 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd9e0003ce0 con 0x55751d8c9660 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9fb02f740 10 client.16173 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9fb02f740 10 client.16173 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9fb02f740 20 client.16173 populate_metadata read hostname 'smithi040' 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d8b0ea0 0x55751dcb4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9fb02f740 4 client.16173 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55751dc0fea0 con 0x55751d8b0ea0 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.044+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d8b0ea0 0x55751dcb4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.045+0000 7fd9f1000640 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d8b0ea0 0x55751dcb4900 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfcdb88ef6ebfc64 server_cookie=ca5cfcd99447c36f in_seq=0 out_seq=0 2024-07-26T12:41:44.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.045+0000 7fd9d3400640 10 client.16173 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.047+0000 7fd9d3400640 1 -- 172.21.15.40:0/3324666702 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55751dc0fea0 con 0x55751d8b0ea0 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.047+0000 7fd9d3400640 10 client.16173 handle_command_reply: tid=0 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.047+0000 7fd9fb02f740 1 client.16173 shutdown 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 msgr2=0x55751dca27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca27f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0005e10 tx=0x7fd9e00089a0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 shutdown_connections 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcaec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d8b0ea0 0x55751dcb4900 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/3324666702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca27f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 >> 172.21.15.40:0/3324666702 conn(0x55751d8e6910 msgr2=0x55751dc9a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:44.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9d3400640 0 client.16173 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:44.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 shutdown_connections 2024-07-26T12:41:44.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 1 -- 172.21.15.40:0/3324666702 wait complete. 2024-07-26T12:41:44.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.048+0000 7fd9fb02f740 20 client.16173 trim_cache size 0 max 16384 2024-07-26T12:41:44.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.067+0000 7fd9fb02f740 1 Processor -- start 2024-07-26T12:41:44.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 -- start start 2024-07-26T12:41:44.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcb9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1b5120 con 0x55751d8c9660 2024-07-26T12:41:44.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1b6c60 con 0x55751d8f2520 2024-07-26T12:41:44.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1b57f0 con 0x55751d8d1840 2024-07-26T12:41:44.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9f1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9f1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36200/0 (socket says 172.21.15.40:36200) 2024-07-26T12:41:44.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.068+0000 7fd9f1a00640 1 -- 172.21.15.40:0/2749483556 learned_addr learned my addr 172.21.15.40:0/2749483556 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:44.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1000640 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f2400640 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcb9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1a00640 1 -- 172.21.15.40:0/2749483556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 msgr2=0x55751dca4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1a00640 1 -- 172.21.15.40:0/2749483556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 msgr2=0x55751dcb9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcb9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1a00640 1 -- 172.21.15.40:0/2749483556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55751dc99490 con 0x55751d8c9660 2024-07-26T12:41:44.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.069+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca4420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0004d00 tx=0x7fd9e0008550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9751714f6a88d63d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:44.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.070+0000 7fd9de000640 1 -- 172.21.15.40:0/2749483556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0014040 con 0x55751d8c9660 2024-07-26T12:41:44.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.070+0000 7fd9de000640 1 -- 172.21.15.40:0/2749483556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e0004320 con 0x55751d8c9660 2024-07-26T12:41:44.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.070+0000 7fd9de000640 1 -- 172.21.15.40:0/2749483556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00054d0 con 0x55751d8c9660 2024-07-26T12:41:44.076 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:43 smithi146 ceph-mon[35807]: pgmap v1084: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 -- 172.21.15.40:0/2749483556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 msgr2=0x55751dca4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca4420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0004d00 tx=0x7fd9e0008550 comp rx=0 tx=0).stop 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 -- 172.21.15.40:0/2749483556 shutdown_connections 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8f2520 0x55751dcb9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8d1840 0x55751dca4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/2749483556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8c9660 0x55751dca4420 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 -- 172.21.15.40:0/2749483556 >> 172.21.15.40:0/2749483556 conn(0x55751d8e6910 msgr2=0x55751dca3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 -- 172.21.15.40:0/2749483556 shutdown_connections 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.071+0000 7fd9fb02f740 1 -- 172.21.15.40:0/2749483556 wait complete. 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.072+0000 7fd9fb02f740 1 -- start start 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.072+0000 7fd9fb02f740 1 Processor -- start 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8c9660 0x55751dcab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 0x55751dca6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dca6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1b6590 con 0x55751d8d1840 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1b5ec0 con 0x55751d8c9660 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec1b30e0 con 0x55751d8f2520 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9fb02f740 10 client.0 _ll_register_callbacks cb 0x7fd9e0008ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9f1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 0x55751dca6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9f1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 0x55751dca6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36206/0 (socket says 172.21.15.40:36206) 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9f1000640 1 -- 172.21.15.40:0/4009879935 learned_addr learned my addr 172.21.15.40:0/4009879935 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.073+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8c9660 0x55751dcab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f2400640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dca6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f1000640 1 -- 172.21.15.40:0/4009879935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 msgr2=0x55751dca6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f1000640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dca6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f1000640 1 -- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8c9660 msgr2=0x55751dcab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f1000640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8c9660 0x55751dcab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f1000640 1 -- 172.21.15.40:0/4009879935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55751dca75a0 con 0x55751d8d1840 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f2400640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dca6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9f1000640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 0x55751dca6840 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x55751dcb4f10 tx=0x7fd9d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ed065de0c7b261 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.074+0000 7fd9d3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.075+0000 7fd9d3400640 1 -- 172.21.15.40:0/4009879935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8029800 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.075+0000 7fd9d3400640 1 -- 172.21.15.40:0/4009879935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd9d80299a0 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.075+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e0004320 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.075+0000 7fd9d3400640 1 -- 172.21.15.40:0/4009879935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd9d8029ba0 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.075+0000 7fd9fb02f740 10 client.16179 fetch_fsmap learned FSMap version 35 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.075+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55751dd1d010 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9d3400640 1 -- 172.21.15.40:0/4009879935 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e0004320 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9d3400640 1 -- 172.21.15.40:0/4009879935 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd9d8020400 con 0x55751d8d1840 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9fb02f740 10 client.16179 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:41:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9fb02f740 10 client.16179 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9fb02f740 20 client.16179 populate_metadata read hostname 'smithi040' 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d886250 0x55751dd1f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9fb02f740 4 client.16179 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ec208ffd", "release": true, "await": true}] 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.076+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ec208ffd", "release": true, "await": true}) -- 0x55751dc0b940 con 0x55751d886250 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.077+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d886250 0x55751dd1f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.078+0000 7fd9f1a00640 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d886250 0x55751dd1f800 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d80b196c24a895 server_cookie=a861f6864d7a8ea4 in_seq=0 out_seq=0 2024-07-26T12:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.078+0000 7fd9d3400640 10 client.16179 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:44.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:43 smithi076 ceph-mon[35401]: pgmap v1084: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-07-26T12:41:44.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.142+0000 7fd9d3400640 1 -- 172.21.15.40:0/4009879935 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55751dc0b940 con 0x55751d886250 2024-07-26T12:41:44.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.142+0000 7fd9d3400640 10 client.16179 handle_command_reply: tid=0 2024-07-26T12:41:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.142+0000 7fd9fb02f740 1 client.16179 shutdown 2024-07-26T12:41:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 msgr2=0x55751dca6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 0x55751dca6840 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x55751dcb4f10 tx=0x7fd9d8004730 comp rx=0 tx=0).stop 2024-07-26T12:41:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 shutdown_connections 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55751d8f2520 0x55751dca6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55751d886250 0x55751dd1f800 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55751d8d1840 0x55751dca6840 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 --2- 172.21.15.40:0/4009879935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55751d8c9660 0x55751dcab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 >> 172.21.15.40:0/4009879935 conn(0x55751d8e6910 msgr2=0x55751dca45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9d3400640 0 client.16179 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 shutdown_connections 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.143+0000 7fd9fb02f740 1 -- 172.21.15.40:0/4009879935 wait complete. 2024-07-26T12:41:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.144+0000 7fd9fb02f740 20 client.16179 trim_cache size 0 max 16384 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 60, 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "ec208ffd": { 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 60, 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:41:44.147 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 153.8, 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:44.148 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:44.149 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:44.149 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:44.149 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:41:44.149 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd9d40b3c00 msgr2=0x7fd9d40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd9d40b3c00 0x7fd9d40b6110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec07b290 tx=0x7fd9d80046c0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 msgr2=0x7fd9ec1a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1a5a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4031040 tx=0x7fd9e4032bc0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 shutdown_connections 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ec10fc80 0x7fd9ec1a5a10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd9d40b3c00 0x7fd9d40b6110 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.145+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9ec10f330 0x7fd9ec1a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.146+0000 7fd9f2e00640 1 --2- 172.21.15.40:0/3305482932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd9ec1099f0 0x7fd9ec1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.146+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 >> 172.21.15.40:0/3305482932 conn(0x7fd9ec078ff0 msgr2=0x7fd9ec0796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:41:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.146+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 shutdown_connections 2024-07-26T12:41:44.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:41:44.146+0000 7fd9f2e00640 1 -- 172.21.15.40:0/3305482932 wait complete. 2024-07-26T12:41:44.992 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ec208ffd', total seconds elapsed: 41.2 2024-07-26T12:41:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:45 smithi040 ceph-mon[32397]: pgmap v1085: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-07-26T12:41:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:45 smithi146 ceph-mon[35807]: pgmap v1085: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-07-26T12:41:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:45 smithi076 ceph-mon[35401]: pgmap v1085: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-07-26T12:41:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:47 smithi040 ceph-mon[32397]: pgmap v1086: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:41:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:47 smithi146 ceph-mon[35807]: pgmap v1086: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:41:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:47 smithi076 ceph-mon[35401]: pgmap v1086: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:41:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:49 smithi040 ceph-mon[32397]: pgmap v1087: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 951 KiB/s wr, 10 op/s 2024-07-26T12:41:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:49 smithi146 ceph-mon[35807]: pgmap v1087: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 951 KiB/s wr, 10 op/s 2024-07-26T12:41:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:49 smithi076 ceph-mon[35401]: pgmap v1087: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 951 KiB/s wr, 10 op/s 2024-07-26T12:41:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:51 smithi040 ceph-mon[32397]: pgmap v1088: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T12:41:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:51 smithi146 ceph-mon[35807]: pgmap v1088: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T12:41:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:51 smithi076 ceph-mon[35401]: pgmap v1088: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T12:41:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:53 smithi040 ceph-mon[32397]: pgmap v1089: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-07-26T12:41:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:53 smithi146 ceph-mon[35807]: pgmap v1089: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-07-26T12:41:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:53 smithi076 ceph-mon[35401]: pgmap v1089: 97 pgs: 97 active+clean; 3.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-07-26T12:41:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:55 smithi146 ceph-mon[35807]: pgmap v1090: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T12:41:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:55 smithi076 ceph-mon[35401]: pgmap v1090: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T12:41:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:55 smithi040 ceph-mon[32397]: pgmap v1090: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T12:41:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:57 smithi146 ceph-mon[35807]: pgmap v1091: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:41:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:57 smithi076 ceph-mon[35401]: pgmap v1091: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:41:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:57 smithi040 ceph-mon[32397]: pgmap v1091: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:42:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:41:59 smithi146 ceph-mon[35807]: pgmap v1092: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T12:42:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:41:59 smithi076 ceph-mon[35401]: pgmap v1092: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T12:42:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:41:59 smithi040 ceph-mon[32397]: pgmap v1092: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T12:42:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:01 smithi146 ceph-mon[35807]: pgmap v1093: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:42:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:01 smithi076 ceph-mon[35401]: pgmap v1093: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:42:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:01 smithi040 ceph-mon[32397]: pgmap v1093: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:42:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:03 smithi146 ceph-mon[35807]: pgmap v1094: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:42:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:03 smithi076 ceph-mon[35401]: pgmap v1094: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:42:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:03 smithi040 ceph-mon[32397]: pgmap v1094: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:42:06.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:05 smithi040 ceph-mon[32397]: pgmap v1095: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:42:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:05 smithi146 ceph-mon[35807]: pgmap v1095: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:42:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:05 smithi076 ceph-mon[35401]: pgmap v1095: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:42:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:07 smithi146 ceph-mon[35807]: pgmap v1096: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:42:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:07 smithi076 ceph-mon[35401]: pgmap v1096: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:42:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:07 smithi040 ceph-mon[32397]: pgmap v1096: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:42:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:09 smithi146 ceph-mon[35807]: pgmap v1097: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:09 smithi076 ceph-mon[35401]: pgmap v1097: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:09 smithi040 ceph-mon[32397]: pgmap v1097: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:11 smithi146 ceph-mon[35807]: pgmap v1098: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:42:12.099 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:11 smithi076 ceph-mon[35401]: pgmap v1098: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:42:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:11 smithi040 ceph-mon[32397]: pgmap v1098: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:42:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:13 smithi146 ceph-mon[35807]: pgmap v1099: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:13 smithi076 ceph-mon[35401]: pgmap v1099: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:13 smithi040 ceph-mon[32397]: pgmap v1099: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:15 smithi146 ceph-mon[35807]: pgmap v1100: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:42:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:15 smithi076 ceph-mon[35401]: pgmap v1100: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:42:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:15 smithi040 ceph-mon[32397]: pgmap v1100: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T12:42:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:17 smithi146 ceph-mon[35807]: pgmap v1101: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:17 smithi076 ceph-mon[35401]: pgmap v1101: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:17 smithi040 ceph-mon[32397]: pgmap v1101: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:19 smithi146 ceph-mon[35807]: pgmap v1102: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:19 smithi076 ceph-mon[35401]: pgmap v1102: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:19 smithi040 ceph-mon[32397]: pgmap v1102: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:21 smithi076 ceph-mon[35401]: pgmap v1103: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:21 smithi040 ceph-mon[32397]: pgmap v1103: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:21 smithi146 ceph-mon[35807]: pgmap v1103: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:23 smithi076 ceph-mon[35401]: pgmap v1104: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:42:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:23 smithi040 ceph-mon[32397]: pgmap v1104: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:42:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:23 smithi146 ceph-mon[35807]: pgmap v1104: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:42:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:25 smithi040 ceph-mon[32397]: pgmap v1105: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:42:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:25 smithi146 ceph-mon[35807]: pgmap v1105: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:42:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:25 smithi076 ceph-mon[35401]: pgmap v1105: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:42:28.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:27 smithi040 ceph-mon[32397]: pgmap v1106: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:42:28.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:42:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:27 smithi146 ceph-mon[35807]: pgmap v1106: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:42:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:42:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:27 smithi076 ceph-mon[35401]: pgmap v1106: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:42:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:42:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:42:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:42:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:42:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:42:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:42:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:42:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:42:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:42:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:42:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:29 smithi040 ceph-mon[32397]: pgmap v1107: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:29 smithi146 ceph-mon[35807]: pgmap v1107: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:29 smithi076 ceph-mon[35401]: pgmap v1107: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:42:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:31 smithi040 ceph-mon[32397]: pgmap v1108: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:42:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:31 smithi146 ceph-mon[35807]: pgmap v1108: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:42:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:31 smithi076 ceph-mon[35401]: pgmap v1108: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:42:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:33 smithi040 ceph-mon[32397]: pgmap v1109: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:42:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:33 smithi146 ceph-mon[35807]: pgmap v1109: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:42:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:33 smithi076 ceph-mon[35401]: pgmap v1109: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:42:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:35 smithi040 ceph-mon[32397]: pgmap v1110: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:42:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:35 smithi146 ceph-mon[35807]: pgmap v1110: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:42:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:35 smithi076 ceph-mon[35401]: pgmap v1110: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-07-26T12:42:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:37 smithi040 ceph-mon[32397]: pgmap v1111: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:42:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:37 smithi146 ceph-mon[35807]: pgmap v1111: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:42:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:37 smithi076 ceph-mon[35401]: pgmap v1111: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:42:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:38 smithi040 ceph-mon[32397]: pgmap v1112: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:42:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:38 smithi146 ceph-mon[35807]: pgmap v1112: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:42:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:38 smithi076 ceph-mon[35401]: pgmap v1112: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:42:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:41 smithi040 ceph-mon[32397]: pgmap v1113: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:42:42.025 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:41 smithi146 ceph-mon[35807]: pgmap v1113: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:42:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:41 smithi076 ceph-mon[35401]: pgmap v1113: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:42:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:43 smithi040 ceph-mon[32397]: pgmap v1114: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:43 smithi146 ceph-mon[35807]: pgmap v1114: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:43 smithi076 ceph-mon[35401]: pgmap v1114: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:45 smithi040 ceph-mon[32397]: pgmap v1115: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:42:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:45 smithi146 ceph-mon[35807]: pgmap v1115: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:42:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:45 smithi076 ceph-mon[35401]: pgmap v1115: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:42:47.764 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:42:47.765 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.95 2024-07-26T12:42:47.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:42:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:47 smithi040 ceph-mon[32397]: pgmap v1116: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:42:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:47 smithi146 ceph-mon[35807]: pgmap v1116: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:42:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:47 smithi076 ceph-mon[35401]: pgmap v1116: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:42:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:42:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:49 smithi040 ceph-mon[32397]: pgmap v1117: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:42:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:49 smithi146 ceph-mon[35807]: pgmap v1117: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:42:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:49 smithi076 ceph-mon[35401]: pgmap v1117: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:42:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 -- 172.21.15.40:0/2343077664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660107dd0 msgr2=0x7f46601081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 --2- 172.21.15.40:0/2343077664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660107dd0 0x7f46601081e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f464c009900 tx=0x7f464c02a410 comp rx=0 tx=0).stop 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 -- 172.21.15.40:0/2343077664 shutdown_connections 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 --2- 172.21.15.40:0/2343077664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660108720 0x7f466010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 --2- 172.21.15.40:0/2343077664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660107dd0 0x7f46601081e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 --2- 172.21.15.40:0/2343077664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4660102490 0x7f46601028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.796+0000 7f4666400640 1 -- 172.21.15.40:0/2343077664 >> 172.21.15.40:0/2343077664 conn(0x7f4660079160 msgr2=0x7f4660079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.797+0000 7f4666400640 1 -- 172.21.15.40:0/2343077664 shutdown_connections 2024-07-26T12:42:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.797+0000 7f4666400640 1 -- 172.21.15.40:0/2343077664 wait complete. 2024-07-26T12:42:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.799+0000 7f4666400640 1 Processor -- start 2024-07-26T12:42:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.799+0000 7f4666400640 1 -- start start 2024-07-26T12:42:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.799+0000 7f4666400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4660102490 0x7f466010f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.799+0000 7f4666400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660107dd0 0x7f466010ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.799+0000 7f4666400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 0x7f4660110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.799+0000 7f4666400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4660113390 con 0x7f4660108720 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f4666400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4660113210 con 0x7f4660107dd0 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f4666400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4660113510 con 0x7f4660102490 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f465fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 0x7f4660110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f465fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 0x7f4660110460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53226/0 (socket says 172.21.15.40:53226) 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f465fe00640 1 -- 172.21.15.40:0/1457395333 learned_addr learned my addr 172.21.15.40:0/1457395333 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f465f400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4660102490 0x7f466010f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.800+0000 7f465ea00640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660107dd0 0x7f466010ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465fe00640 1 -- 172.21.15.40:0/1457395333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4660102490 msgr2=0x7f466010f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465fe00640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4660102490 0x7f466010f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465fe00640 1 -- 172.21.15.40:0/1457395333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660107dd0 msgr2=0x7f466010ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465fe00640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660107dd0 0x7f466010ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465fe00640 1 -- 172.21.15.40:0/1457395333 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601a80e0 con 0x7f4660108720 2024-07-26T12:42:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465ea00640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660107dd0 0x7f466010ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:42:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.801+0000 7f465fe00640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 0x7f4660110460 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f465800eaa0 tx=0x7f465800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.802+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465800cdb0 con 0x7f4660108720 2024-07-26T12:42:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.802+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46601a83d0 con 0x7f4660108720 2024-07-26T12:42:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.802+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4658005020 con 0x7f4660108720 2024-07-26T12:42:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.802+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580116d0 con 0x7f4660108720 2024-07-26T12:42:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.802+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46601a8890 con 0x7f4660108720 2024-07-26T12:42:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.803+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46601028a0 con 0x7f4660108720 2024-07-26T12:42:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.807+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f46580051d0 con 0x7f4660108720 2024-07-26T12:42:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.809+0000 7f4657e00640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46440b3bd0 0x7f46440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.809+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f46580e41b0 con 0x7f4660108720 2024-07-26T12:42:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.809+0000 7f465f400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46440b3bd0 0x7f46440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.810+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f4658016030 con 0x7f4660108720 2024-07-26T12:42:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:50.810+0000 7f465f400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46440b3bd0 0x7f46440b60e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4660111430 tx=0x7f465000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:51.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.090+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4660110ce0 con 0x7f4660108720 2024-07-26T12:42:51.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.092+0000 7f4657e00640 1 -- 172.21.15.40:0/1457395333 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f46580ab800 con 0x7f4660108720 2024-07-26T12:42:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:42:51.093 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:42:51.094 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:42:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46440b3bd0 msgr2=0x7f46440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46440b3bd0 0x7f46440b60e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4660111430 tx=0x7f465000b390 comp rx=0 tx=0).stop 2024-07-26T12:42:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 msgr2=0x7f4660110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:51.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 0x7f4660110460 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f465800eaa0 tx=0x7f465800ef60 comp rx=0 tx=0).stop 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 shutdown_connections 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4660108720 0x7f4660110460 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660107dd0 0x7f466010ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f46440b3bd0 0x7f46440b60e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 --2- 172.21.15.40:0/1457395333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4660102490 0x7f466010f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.096+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 >> 172.21.15.40:0/1457395333 conn(0x7f4660079160 msgr2=0x7f4660103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.097+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 shutdown_connections 2024-07-26T12:42:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:51.097+0000 7f4666400640 1 -- 172.21.15.40:0/1457395333 wait complete. 2024-07-26T12:42:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:51 smithi040 ceph-mon[32397]: pgmap v1118: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:42:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1457395333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:42:52.054 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0' 2024-07-26T12:42:52.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0 2024-07-26T12:42:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:51 smithi146 ceph-mon[35807]: pgmap v1118: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:42:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1457395333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:42:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:51 smithi076 ceph-mon[35401]: pgmap v1118: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:42:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1457395333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:42:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:42:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:53 smithi040 ceph-mon[32397]: pgmap v1119: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:53 smithi146 ceph-mon[35807]: pgmap v1119: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:53 smithi076 ceph-mon[35401]: pgmap v1119: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:42:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 -- 172.21.15.40:0/1598162845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010b880 msgr2=0x7fe6901120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 --2- 172.21.15.40:0/1598162845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010b880 0x7fe6901120b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe688009ca0 tx=0x7fe68802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:42:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 -- 172.21.15.40:0/1598162845 shutdown_connections 2024-07-26T12:42:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 --2- 172.21.15.40:0/1598162845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010b880 0x7fe6901120b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 --2- 172.21.15.40:0/1598162845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe69010af30 0x7fe69010b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 --2- 172.21.15.40:0/1598162845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6901055f0 0x7fe690105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 -- 172.21.15.40:0/1598162845 >> 172.21.15.40:0/1598162845 conn(0x7fe690101060 msgr2=0x7fe6901034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 -- 172.21.15.40:0/1598162845 shutdown_connections 2024-07-26T12:42:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.993+0000 7fe68fe00640 1 -- 172.21.15.40:0/1598162845 wait complete. 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.994+0000 7fe68fe00640 1 Processor -- start 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 -- start start 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6901055f0 0x7fe69019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 0x7fe69019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe69010b880 0x7fe6901a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe690115430 con 0x7fe69010af30 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901152b0 con 0x7fe6901055f0 2024-07-26T12:42:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.995+0000 7fe68fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901155b0 con 0x7fe69010b880 2024-07-26T12:42:54.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 0x7fe69019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:54.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 0x7fe69019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34228/0 (socket says 172.21.15.40:34228) 2024-07-26T12:42:54.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 -- 172.21.15.40:0/176686623 learned_addr learned my addr 172.21.15.40:0/176686623 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe68f400640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe69010b880 0x7fe6901a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe68ea00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6901055f0 0x7fe69019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 -- 172.21.15.40:0/176686623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe69010b880 msgr2=0x7fe6901a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe69010b880 0x7fe6901a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 -- 172.21.15.40:0/176686623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6901055f0 msgr2=0x7fe69019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6901055f0 0x7fe69019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.996+0000 7fe686000640 1 -- 172.21.15.40:0/176686623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a1d90 con 0x7fe69010af30 2024-07-26T12:42:54.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.997+0000 7fe686000640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 0x7fe69019c3c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe67800d740 tx=0x7fe67800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:54.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.997+0000 7fe687e00640 1 -- 172.21.15.40:0/176686623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678017070 con 0x7fe69010af30 2024-07-26T12:42:54.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.997+0000 7fe687e00640 1 -- 172.21.15.40:0/176686623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe67800de50 con 0x7fe69010af30 2024-07-26T12:42:54.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.997+0000 7fe687e00640 1 -- 172.21.15.40:0/176686623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67800f620 con 0x7fe69010af30 2024-07-26T12:42:54.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.997+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a2080 con 0x7fe69010af30 2024-07-26T12:42:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:54.998+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a87e0 con 0x7fe69010af30 2024-07-26T12:42:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.002+0000 7fe69c46e740 1 Processor -- start 2024-07-26T12:42:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.002+0000 7fe69c46e740 1 -- start start 2024-07-26T12:42:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f9870480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f98709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f9870f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe69c46e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c3f97e48a0 con 0x55c3f94a0990 2024-07-26T12:42:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe69c46e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c3f97d3da0 con 0x55c3f94a8b70 2024-07-26T12:42:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe69c46e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c3f97d7de0 con 0x55c3f94c9850 2024-07-26T12:42:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe687e00640 1 -- 172.21.15.40:0/176686623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe67801a070 con 0x7fe69010af30 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe68ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f98709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe68ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f98709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34230/0 (socket says 172.21.15.40:34230) 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.003+0000 7fe68ea00640 1 -- 172.21.15.40:0/3572287465 learned_addr learned my addr 172.21.15.40:0/3572287465 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68f400640 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f9870480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe686000640 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f9870f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68ea00640 1 -- 172.21.15.40:0/3572287465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 msgr2=0x55c3f9870480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68ea00640 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f9870480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68ea00640 1 -- 172.21.15.40:0/3572287465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 msgr2=0x55c3f9870f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68ea00640 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f9870f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68ea00640 1 -- 172.21.15.40:0/3572287465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f9768b70 con 0x55c3f94a0990 2024-07-26T12:42:55.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.004+0000 7fe68ea00640 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f98709c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe68000bd10 tx=0x7fe6800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4647ad80fee262 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:55.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.005+0000 7fe67fe00640 1 -- 172.21.15.40:0/3572287465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680004030 con 0x55c3f94a0990 2024-07-26T12:42:55.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.005+0000 7fe67fe00640 1 -- 172.21.15.40:0/3572287465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6800035f0 con 0x55c3f94a0990 2024-07-26T12:42:55.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.005+0000 7fe67fe00640 1 -- 172.21.15.40:0/3572287465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680011680 con 0x55c3f94a0990 2024-07-26T12:42:55.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.005+0000 7fe687e00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3c40 0x7fe6740b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.005+0000 7fe687e00640 1 -- 172.21.15.40:0/176686623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6780e3540 con 0x7fe69010af30 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.006+0000 7fe68f400640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3c40 0x7fe6740b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.006+0000 7fe69c46e740 1 -- 172.21.15.40:0/3572287465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 msgr2=0x55c3f98709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.006+0000 7fe69c46e740 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f98709c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe68000bd10 tx=0x7fe6800107a0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 -- 172.21.15.40:0/3572287465 shutdown_connections 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f9870f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f98709c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 --2- 172.21.15.40:0/3572287465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f9870480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 -- 172.21.15.40:0/3572287465 >> 172.21.15.40:0/3572287465 conn(0x55c3f94bdc40 msgr2=0x55c3f986e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 -- 172.21.15.40:0/3572287465 shutdown_connections 2024-07-26T12:42:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe69c46e740 1 -- 172.21.15.40:0/3572287465 wait complete. 2024-07-26T12:42:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.007+0000 7fe68f400640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3c40 0x7fe6740b6150 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe688006010 tx=0x7fe688005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.008+0000 7fe69c46e740 1 -- start start 2024-07-26T12:42:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.008+0000 7fe69c46e740 1 Processor -- start 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f987bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f987c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f9887f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c3f96377b0 con 0x55c3f94a0990 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c3f9770380 con 0x55c3f94c9850 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c3f987ec60 con 0x55c3f94a8b70 2024-07-26T12:42:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.009+0000 7fe69c46e740 10 client.0 _ll_register_callbacks cb 0x55c3f977f830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:42:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f987bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f987bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34238/0 (socket says 172.21.15.40:34238) 2024-07-26T12:42:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 -- 172.21.15.40:0/4122655162 learned_addr learned my addr 172.21.15.40:0/4122655162 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:42:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe686000640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f987c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68f400640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f9887f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 -- 172.21.15.40:0/4122655162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 msgr2=0x55c3f987c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f987c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 -- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 msgr2=0x55c3f9887f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f9887f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.010+0000 7fe68ea00640 1 -- 172.21.15.40:0/4122655162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f9543ba0 con 0x55c3f94a0990 2024-07-26T12:42:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.011+0000 7fe68ea00640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f987bd10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe680003e40 tx=0x7fe6800039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84df3859a25e6a35 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.011+0000 7fe67cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:42:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.011+0000 7fe67cc00640 1 -- 172.21.15.40:0/4122655162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680029060 con 0x55c3f94a0990 2024-07-26T12:42:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.011+0000 7fe67cc00640 1 -- 172.21.15.40:0/4122655162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe680004410 con 0x55c3f94a0990 2024-07-26T12:42:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.011+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6800035f0 con 0x55c3f94a0990 2024-07-26T12:42:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.012+0000 7fe67cc00640 1 -- 172.21.15.40:0/4122655162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe68000be70 con 0x55c3f94a0990 2024-07-26T12:42:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.012+0000 7fe69c46e740 10 client.16197 fetch_fsmap learned FSMap version 35 2024-07-26T12:42:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.012+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c3f988ab20 con 0x55c3f94a0990 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe67cc00640 1 -- 172.21.15.40:0/4122655162 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6800035f0 con 0x55c3f94a0990 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe67cc00640 1 -- 172.21.15.40:0/4122655162 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe68002e070 con 0x55c3f94a0990 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe69c46e740 10 client.16197 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe69c46e740 10 client.16197 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe69c46e740 20 client.16197 populate_metadata read hostname 'smithi040' 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe69c46e740 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f94881d0 0x55c3f988df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe69c46e740 4 client.16197 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:42:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.013+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3f97e67f0 con 0x55c3f94881d0 2024-07-26T12:42:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.014+0000 7fe686000640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f94881d0 0x55c3f988df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.015+0000 7fe686000640 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f94881d0 0x55c3f988df30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bcf49829c8aada4 server_cookie=88fcb518e9bc47e in_seq=0 out_seq=0 2024-07-26T12:42:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.015+0000 7fe67cc00640 10 client.16197 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:42:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe67cc00640 1 -- 172.21.15.40:0/4122655162 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3f97e67f0 con 0x55c3f94881d0 2024-07-26T12:42:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe67cc00640 10 client.16197 handle_command_reply: tid=0 2024-07-26T12:42:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 client.16197 shutdown 2024-07-26T12:42:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 msgr2=0x55c3f987bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f987bd10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe680003e40 tx=0x7fe6800039d0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 shutdown_connections 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f9887f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f987c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f94881d0 0x55c3f988df30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 --2- 172.21.15.40:0/4122655162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f94a0990 0x55c3f987bd10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 >> 172.21.15.40:0/4122655162 conn(0x55c3f94bdc40 msgr2=0x55c3f9873610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.017+0000 7fe67cc00640 0 client.16197 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.018+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 shutdown_connections 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.018+0000 7fe69c46e740 1 -- 172.21.15.40:0/4122655162 wait complete. 2024-07-26T12:42:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.018+0000 7fe69c46e740 20 client.16197 trim_cache size 0 max 16384 2024-07-26T12:42:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.040+0000 7fe69c46e740 1 Processor -- start 2024-07-26T12:42:55.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.040+0000 7fe69c46e740 1 -- start start 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.040+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f98765a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f986d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f9887ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe69c46e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901b0f00 con 0x55c3f945d580 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe69c46e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901b2a40 con 0x55c3f94c9850 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe69c46e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901b15d0 con 0x55c3f94a8b70 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe68f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f9887ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe68f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f9887ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34254/0 (socket says 172.21.15.40:34254) 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe68f400640 1 -- 172.21.15.40:0/2827000594 learned_addr learned my addr 172.21.15.40:0/2827000594 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:42:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe68ea00640 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f98765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.041+0000 7fe686000640 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f986d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe68f400640 1 -- 172.21.15.40:0/2827000594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 msgr2=0x55c3f98765a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe68f400640 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f98765a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe68f400640 1 -- 172.21.15.40:0/2827000594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 msgr2=0x55c3f986d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe68f400640 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f986d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe68f400640 1 -- 172.21.15.40:0/2827000594 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f9488400 con 0x55c3f945d580 2024-07-26T12:42:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe686000640 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f986d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:42:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.042+0000 7fe68f400640 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f9887ef0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe688009ca0 tx=0x7fe688041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98493f298082703 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.043+0000 7fe67f400640 1 -- 172.21.15.40:0/2827000594 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688031b00 con 0x55c3f945d580 2024-07-26T12:42:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.043+0000 7fe67f400640 1 -- 172.21.15.40:0/2827000594 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe688036050 con 0x55c3f945d580 2024-07-26T12:42:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.043+0000 7fe67f400640 1 -- 172.21.15.40:0/2827000594 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6880305c0 con 0x55c3f945d580 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 -- 172.21.15.40:0/2827000594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 msgr2=0x55c3f9887ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f9887ef0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe688009ca0 tx=0x7fe688041000 comp rx=0 tx=0).stop 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 -- 172.21.15.40:0/2827000594 shutdown_connections 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f9887ef0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94c9850 0x55c3f986d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 --2- 172.21.15.40:0/2827000594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94a8b70 0x55c3f98765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 -- 172.21.15.40:0/2827000594 >> 172.21.15.40:0/2827000594 conn(0x55c3f94bdc40 msgr2=0x55c3f986db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 -- 172.21.15.40:0/2827000594 shutdown_connections 2024-07-26T12:42:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.044+0000 7fe69c46e740 1 -- 172.21.15.40:0/2827000594 wait complete. 2024-07-26T12:42:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.045+0000 7fe69c46e740 1 -- start start 2024-07-26T12:42:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.045+0000 7fe69c46e740 1 Processor -- start 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f98f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f98f7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f988e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901b2370 con 0x55c3f945d580 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901b1ca0 con 0x55c3f94a8b70 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901aeec0 con 0x55c3f94c9850 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe69c46e740 10 client.0 _ll_register_callbacks cb 0x7fe68000b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe68ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f98f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe68ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f98f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34270/0 (socket says 172.21.15.40:34270) 2024-07-26T12:42:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe68ea00640 1 -- 172.21.15.40:0/255265156 learned_addr learned my addr 172.21.15.40:0/255265156 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe686000640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f98f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.046+0000 7fe68f400640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f988e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe68ea00640 1 -- 172.21.15.40:0/255265156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 msgr2=0x55c3f988e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe68ea00640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f988e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe68ea00640 1 -- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 msgr2=0x55c3f98f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe68ea00640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f98f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe68ea00640 1 -- 172.21.15.40:0/255265156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f988eca0 con 0x55c3f945d580 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe686000640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f98f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe68ea00640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f98f6f50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe68000baa0 tx=0x7fe6800048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4e3e03a45d6993 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.047+0000 7fe67cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.048+0000 7fe67cc00640 1 -- 172.21.15.40:0/255265156 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680034070 con 0x55c3f945d580 2024-07-26T12:42:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.048+0000 7fe67cc00640 1 -- 172.21.15.40:0/255265156 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6800117b0 con 0x55c3f945d580 2024-07-26T12:42:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.048+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe688036050 con 0x55c3f945d580 2024-07-26T12:42:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.048+0000 7fe67cc00640 1 -- 172.21.15.40:0/255265156 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe680029040 con 0x55c3f945d580 2024-07-26T12:42:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.048+0000 7fe69c46e740 10 client.16203 fetch_fsmap learned FSMap version 35 2024-07-26T12:42:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.048+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c3f98fe650 con 0x55c3f945d580 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe67cc00640 1 -- 172.21.15.40:0/255265156 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe688036050 con 0x55c3f945d580 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe67cc00640 1 -- 172.21.15.40:0/255265156 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe680042050 con 0x55c3f945d580 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe69c46e740 10 client.16203 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe69c46e740 10 client.16203 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe69c46e740 20 client.16203 populate_metadata read hostname 'smithi040' 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe69c46e740 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f98fed80 0x55c3f99011a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe69c46e740 4 client.16203 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}] 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.049+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}) -- 0x55c3f97e2290 con 0x55c3f98fed80 2024-07-26T12:42:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.050+0000 7fe686000640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f98fed80 0x55c3f99011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:42:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.051+0000 7fe686000640 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f98fed80 0x55c3f99011a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6430308f9ec926fe server_cookie=a11c25def9868043 in_seq=0 out_seq=0 2024-07-26T12:42:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.051+0000 7fe67cc00640 10 client.16203 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:42:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.294+0000 7fe67cc00640 1 -- 172.21.15.40:0/255265156 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c3f97e2290 con 0x55c3f98fed80 2024-07-26T12:42:55.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.294+0000 7fe67cc00640 10 client.16203 handle_command_reply: tid=0 2024-07-26T12:42:55.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.294+0000 7fe69c46e740 1 client.16203 shutdown 2024-07-26T12:42:55.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.294+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 msgr2=0x55c3f98f6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:55.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.294+0000 7fe69c46e740 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f98f6f50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe68000baa0 tx=0x7fe6800048d0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 shutdown_connections 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe69c46e740 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c3f94c9850 0x55c3f988e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe69c46e740 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c3f94a8b70 0x55c3f98f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe69c46e740 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c3f98fed80 0x55c3f99011a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe69c46e740 1 --2- 172.21.15.40:0/255265156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c3f945d580 0x55c3f98f6f50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 >> 172.21.15.40:0/255265156 conn(0x55c3f94bdc40 msgr2=0x55c3f98714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.295+0000 7fe67cc00640 0 client.16203 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:42:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.296+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 shutdown_connections 2024-07-26T12:42:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.296+0000 7fe69c46e740 1 -- 172.21.15.40:0/255265156 wait complete. 2024-07-26T12:42:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.296+0000 7fe69c46e740 20 client.16203 trim_cache size 0 max 16384 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 62, 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "a9b44208": { 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 62, 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:42:55.299 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.9, 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:42:55.300 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:42:55.301 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.297+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3c40 msgr2=0x7fe6740b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.297+0000 7fe68fe00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3c40 0x7fe6740b6150 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe688006010 tx=0x7fe688005c30 comp rx=0 tx=0).stop 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.297+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 msgr2=0x7fe69019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.297+0000 7fe68fe00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 0x7fe69019c3c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe67800d740 tx=0x7fe67800dc00 comp rx=0 tx=0).stop 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 shutdown_connections 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe6740b3c40 0x7fe6740b6150 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe69010b880 0x7fe6901a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69010af30 0x7fe69019c3c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 --2- 172.21.15.40:0/176686623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6901055f0 0x7fe69019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:42:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 >> 172.21.15.40:0/176686623 conn(0x7fe690101060 msgr2=0x7fe690103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:42:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.298+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 shutdown_connections 2024-07-26T12:42:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:42:55.299+0000 7fe68fe00640 1 -- 172.21.15.40:0/176686623 wait complete. 2024-07-26T12:42:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:55 smithi040 ceph-mon[32397]: pgmap v1120: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:42:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:55 smithi146 ceph-mon[35807]: pgmap v1120: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:42:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:55 smithi076 ceph-mon[35401]: pgmap v1120: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:42:56.213 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a9b44208', quiesce took 8.4 seconds. Will release after: 10.549999999999999 2024-07-26T12:42:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:57 smithi146 ceph-mon[35807]: pgmap v1121: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:57 smithi076 ceph-mon[35401]: pgmap v1121: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:42:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:57 smithi040 ceph-mon[32397]: pgmap v1121: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:43:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:42:59 smithi146 ceph-mon[35807]: pgmap v1122: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:43:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:42:59 smithi076 ceph-mon[35401]: pgmap v1122: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:43:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:42:59 smithi040 ceph-mon[32397]: pgmap v1122: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:43:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:01 smithi040 ceph-mon[32397]: pgmap v1123: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:43:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:01 smithi146 ceph-mon[35807]: pgmap v1123: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:43:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:01 smithi076 ceph-mon[35401]: pgmap v1123: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:43:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:03 smithi146 ceph-mon[35807]: pgmap v1124: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:43:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:03 smithi076 ceph-mon[35401]: pgmap v1124: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:43:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:03 smithi040 ceph-mon[32397]: pgmap v1124: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:43:06.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:05 smithi040 ceph-mon[32397]: pgmap v1125: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.6 MiB/s wr, 14 op/s 2024-07-26T12:43:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:05 smithi146 ceph-mon[35807]: pgmap v1125: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.6 MiB/s wr, 14 op/s 2024-07-26T12:43:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:05 smithi076 ceph-mon[35401]: pgmap v1125: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.6 MiB/s wr, 14 op/s 2024-07-26T12:43:06.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:43:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:43:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:07 smithi146 ceph-mon[35807]: pgmap v1126: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:43:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:07 smithi076 ceph-mon[35401]: pgmap v1126: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:43:08.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:07 smithi040 ceph-mon[32397]: pgmap v1126: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 -- 172.21.15.40:0/440505817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f010faf0 msgr2=0x7ff6f0111f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 --2- 172.21.15.40:0/440505817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f010faf0 0x7ff6f0111f30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009ca0 tx=0x7ff6e802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 -- 172.21.15.40:0/440505817 shutdown_connections 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 --2- 172.21.15.40:0/440505817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f010faf0 0x7ff6f0111f30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 --2- 172.21.15.40:0/440505817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f0075b30 0x7ff6f010f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 --2- 172.21.15.40:0/440505817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 0x7ff6f00755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.488+0000 7ff6f7800640 1 -- 172.21.15.40:0/440505817 >> 172.21.15.40:0/440505817 conn(0x7ff6f007b280 msgr2=0x7ff6f007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.489+0000 7ff6f7800640 1 -- 172.21.15.40:0/440505817 shutdown_connections 2024-07-26T12:43:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.489+0000 7ff6f7800640 1 -- 172.21.15.40:0/440505817 wait complete. 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.490+0000 7ff6f7800640 1 Processor -- start 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.490+0000 7ff6f7800640 1 -- start start 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.490+0000 7ff6f7800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 0x7ff6f019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.490+0000 7ff6f7800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 0x7ff6f019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.490+0000 7ff6f7800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f010faf0 0x7ff6f01a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.490+0000 7ff6f7800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0115580 con 0x7ff6f0075b30 2024-07-26T12:43:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6f7800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0115400 con 0x7ff6f00751e0 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6f7800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0115700 con 0x7ff6f010faf0 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 0x7ff6f019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 0x7ff6f019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39824/0 (socket says 172.21.15.40:39824) 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 -- 172.21.15.40:0/3711580268 learned_addr learned my addr 172.21.15.40:0/3711580268 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6f4e00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 0x7ff6f019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6f5800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f010faf0 0x7ff6f01a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 -- 172.21.15.40:0/3711580268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f010faf0 msgr2=0x7ff6f01a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f010faf0 0x7ff6f01a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 -- 172.21.15.40:0/3711580268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 msgr2=0x7ff6f019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 0x7ff6f019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6efe00640 1 -- 172.21.15.40:0/3711580268 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f01a1ec0 con 0x7ff6f0075b30 2024-07-26T12:43:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.491+0000 7ff6f4e00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 0x7ff6f019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:43:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.492+0000 7ff6efe00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 0x7ff6f019c4f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00d770 tx=0x7ff6dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.492+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc017070 con 0x7ff6f0075b30 2024-07-26T12:43:09.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.492+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6dc009c30 con 0x7ff6f0075b30 2024-07-26T12:43:09.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.492+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc003c50 con 0x7ff6f0075b30 2024-07-26T12:43:09.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.492+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f01a21b0 con 0x7ff6f0075b30 2024-07-26T12:43:09.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.493+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f01a8910 con 0x7ff6f0075b30 2024-07-26T12:43:09.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.494+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f00755f0 con 0x7ff6f0075b30 2024-07-26T12:43:09.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.496+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff6dc003df0 con 0x7ff6f0075b30 2024-07-26T12:43:09.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.498+0000 7ff6ed600640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff6d40b3c50 0x7ff6d40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:09.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.498+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff6dc0e3a60 con 0x7ff6f0075b30 2024-07-26T12:43:09.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.498+0000 7ff6f4e00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff6d40b3c50 0x7ff6d40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:09.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.499+0000 7ff6f4e00640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff6d40b3c50 0x7ff6d40b6160 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00058c0 tx=0x7ff6e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:09.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.500+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff6dc009de0 con 0x7ff6f0075b30 2024-07-26T12:43:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.746+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6f01a8c00 con 0x7ff6f0075b30 2024-07-26T12:43:09.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.748+0000 7ff6ed600640 1 -- 172.21.15.40:0/3711580268 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ff6dc0ab0f0 con 0x7ff6f0075b30 2024-07-26T12:43:09.750 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:43:09.750 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:43:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:43:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff6d40b3c50 msgr2=0x7ff6d40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff6d40b3c50 0x7ff6d40b6160 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00058c0 tx=0x7ff6e0005850 comp rx=0 tx=0).stop 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 msgr2=0x7ff6f019c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 0x7ff6f019c4f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00d770 tx=0x7ff6dc00dc30 comp rx=0 tx=0).stop 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 shutdown_connections 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff6d40b3c50 0x7ff6d40b6160 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f010faf0 0x7ff6f01a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f0075b30 0x7ff6f019c4f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.751+0000 7ff6f7800640 1 --2- 172.21.15.40:0/3711580268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6f00751e0 0x7ff6f019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.752+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 >> 172.21.15.40:0/3711580268 conn(0x7ff6f007b280 msgr2=0x7ff6f0101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.752+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 shutdown_connections 2024-07-26T12:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:09.752+0000 7ff6f7800640 1 -- 172.21.15.40:0/3711580268 wait complete. 2024-07-26T12:43:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:09 smithi146 ceph-mon[35807]: pgmap v1127: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-07-26T12:43:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:09 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3711580268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:09 smithi076 ceph-mon[35401]: pgmap v1127: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-07-26T12:43:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:09 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3711580268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:10.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:09 smithi040 ceph-mon[32397]: pgmap v1127: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-07-26T12:43:10.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:09 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3711580268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:10.569 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id a9b44208 --release --await' 2024-07-26T12:43:10.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id a9b44208 --release --await 2024-07-26T12:43:11.082 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:43:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:11 smithi040 ceph-mon[32397]: pgmap v1128: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 598 KiB/s wr, 10 op/s 2024-07-26T12:43:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:11 smithi146 ceph-mon[35807]: pgmap v1128: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 598 KiB/s wr, 10 op/s 2024-07-26T12:43:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:11 smithi076 ceph-mon[35401]: pgmap v1128: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 598 KiB/s wr, 10 op/s 2024-07-26T12:43:13.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 -- 172.21.15.40:0/4110895895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c10b100 msgr2=0x7fe06c10b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 --2- 172.21.15.40:0/4110895895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c10b100 0x7fe06c10b510 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe058009900 tx=0x7fe05802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 -- 172.21.15.40:0/4110895895 shutdown_connections 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 --2- 172.21.15.40:0/4110895895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe06c10ba50 0x7fe06c112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 --2- 172.21.15.40:0/4110895895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c10b100 0x7fe06c10b510 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 --2- 172.21.15.40:0/4110895895 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c1057c0 0x7fe06c105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 -- 172.21.15.40:0/4110895895 >> 172.21.15.40:0/4110895895 conn(0x7fe06c101290 msgr2=0x7fe06c1036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.303+0000 7fe073200640 1 -- 172.21.15.40:0/4110895895 shutdown_connections 2024-07-26T12:43:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.304+0000 7fe073200640 1 -- 172.21.15.40:0/4110895895 wait complete. 2024-07-26T12:43:13.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.305+0000 7fe073200640 1 Processor -- start 2024-07-26T12:43:13.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.305+0000 7fe073200640 1 -- start start 2024-07-26T12:43:13.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.305+0000 7fe073200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe06c1057c0 0x7fe06c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.305+0000 7fe073200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c10ba50 0x7fe06c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe073200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 0x7fe06c1a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe073200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c115590 con 0x7fe06c1a1960 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe073200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c115410 con 0x7fe06c10ba50 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe073200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c115710 con 0x7fe06c1057c0 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe071200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 0x7fe06c1a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe06be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe06c1057c0 0x7fe06c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe06b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c10ba50 0x7fe06c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe071200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 0x7fe06c1a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46036/0 (socket says 172.21.15.40:46036) 2024-07-26T12:43:13.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.306+0000 7fe071200640 1 -- 172.21.15.40:0/1970605411 learned_addr learned my addr 172.21.15.40:0/1970605411 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:13.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.307+0000 7fe071200640 1 -- 172.21.15.40:0/1970605411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe06c1057c0 msgr2=0x7fe06c19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.307+0000 7fe071200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe06c1057c0 0x7fe06c19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.307+0000 7fe071200640 1 -- 172.21.15.40:0/1970605411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c10ba50 msgr2=0x7fe06c19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.307+0000 7fe071200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c10ba50 0x7fe06c19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.307+0000 7fe071200640 1 -- 172.21.15.40:0/1970605411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c1a2540 con 0x7fe06c1a1960 2024-07-26T12:43:13.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.308+0000 7fe071200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 0x7fe06c1a1d70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe06400eaa0 tx=0x7fe06400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:13.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.308+0000 7fe068c00640 1 -- 172.21.15.40:0/1970605411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06400cdb0 con 0x7fe06c1a1960 2024-07-26T12:43:13.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.308+0000 7fe068c00640 1 -- 172.21.15.40:0/1970605411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe064005020 con 0x7fe06c1a1960 2024-07-26T12:43:13.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.308+0000 7fe068c00640 1 -- 172.21.15.40:0/1970605411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0640116d0 con 0x7fe06c1a1960 2024-07-26T12:43:13.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.308+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c1a8ae0 con 0x7fe06c1a1960 2024-07-26T12:43:13.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.308+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c1a8e80 con 0x7fe06c1a1960 2024-07-26T12:43:13.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.312+0000 7fe079e90740 1 Processor -- start 2024-07-26T12:43:13.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.312+0000 7fe068c00640 1 -- 172.21.15.40:0/1970605411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe0640051d0 con 0x7fe06c1a1960 2024-07-26T12:43:13.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 -- start start 2024-07-26T12:43:13.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adb8afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7bd660 0x5621adb8b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb8ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5621adb01f50 con 0x5621ad7c5840 2024-07-26T12:43:13.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5621adaf1450 con 0x5621ad7e6520 2024-07-26T12:43:13.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.313+0000 7fe079e90740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5621adaf5490 con 0x5621ad7bd660 2024-07-26T12:43:13.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb8ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb8ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46046/0 (socket says 172.21.15.40:46046) 2024-07-26T12:43:13.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 -- 172.21.15.40:0/880465141 learned_addr learned my addr 172.21.15.40:0/880465141 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:13.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06be00640 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7bd660 0x5621adb8b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adb8afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe068c00640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0500b3c50 0x7fe0500b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 -- 172.21.15.40:0/880465141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7bd660 msgr2=0x5621adb8b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7bd660 0x5621adb8b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 -- 172.21.15.40:0/880465141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 msgr2=0x5621adb8afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adb8afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.314+0000 7fe06b400640 1 -- 172.21.15.40:0/880465141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ad851b00 con 0x5621ad7c5840 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.315+0000 7fe068c00640 1 -- 172.21.15.40:0/1970605411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0640e3c00 con 0x7fe06c1a1960 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.315+0000 7fe071200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0500b3c50 0x7fe0500b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.315+0000 7fe06b400640 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb8ba60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe0580096c0 tx=0x7fe058000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc1424f72ce387b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:13.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.315+0000 7fe061600640 1 -- 172.21.15.40:0/880465141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058035070 con 0x5621ad7c5840 2024-07-26T12:43:13.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.315+0000 7fe061600640 1 -- 172.21.15.40:0/880465141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0580044c0 con 0x5621ad7c5840 2024-07-26T12:43:13.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.315+0000 7fe061600640 1 -- 172.21.15.40:0/880465141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058003bd0 con 0x5621ad7c5840 2024-07-26T12:43:13.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe079e90740 1 -- 172.21.15.40:0/880465141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 msgr2=0x5621adb8ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe079e90740 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb8ba60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe0580096c0 tx=0x7fe058000bc0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe071200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0500b3c50 0x7fe0500b6160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe0640aa900 tx=0x7fe06400cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:13.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe079e90740 1 -- 172.21.15.40:0/880465141 shutdown_connections 2024-07-26T12:43:13.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe079e90740 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb8ba60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe079e90740 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7bd660 0x5621adb8b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.316+0000 7fe079e90740 1 --2- 172.21.15.40:0/880465141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adb8afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.317+0000 7fe079e90740 1 -- 172.21.15.40:0/880465141 >> 172.21.15.40:0/880465141 conn(0x5621ad7da910 msgr2=0x5621adb88ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:13.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.317+0000 7fe079e90740 1 -- 172.21.15.40:0/880465141 shutdown_connections 2024-07-26T12:43:13.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.317+0000 7fe079e90740 1 -- 172.21.15.40:0/880465141 wait complete. 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.317+0000 7fe079e90740 1 -- start start 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.317+0000 7fe079e90740 1 Processor -- start 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb96be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7e6520 0x5621adba2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5621ad954bb0 con 0x5621ad7c5840 2024-07-26T12:43:13.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5621ada8d930 con 0x5621ad7bd660 2024-07-26T12:43:13.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5621adb99760 con 0x5621ad7e6520 2024-07-26T12:43:13.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe079e90740 10 client.0 _ll_register_callbacks cb 0x5621ad7fdd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:43:13.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe06be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb96be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe06be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb96be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46056/0 (socket says 172.21.15.40:46056) 2024-07-26T12:43:13.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.318+0000 7fe06be00640 1 -- 172.21.15.40:0/2127613288 learned_addr learned my addr 172.21.15.40:0/2127613288 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:13.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06b400640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06b400640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7e6520 0x5621adba2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06be00640 1 -- 172.21.15.40:0/2127613288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7e6520 msgr2=0x5621adba2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06be00640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7e6520 0x5621adba2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06be00640 1 -- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 msgr2=0x5621adb966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06be00640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06be00640 1 -- 172.21.15.40:0/2127613288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ad8c8960 con 0x5621ad7c5840 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06b400640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7e6520 0x5621adba2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe06be00640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb96be0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00bad0 tx=0x7fe05c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99f7c84a4d58d93 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.319+0000 7fe056000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe056000640 1 -- 172.21.15.40:0/2127613288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c005020 con 0x5621ad7c5840 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe056000640 1 -- 172.21.15.40:0/2127613288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe05c0051c0 con 0x5621ad7c5840 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5621adb03ea0 con 0x5621ad7c5840 2024-07-26T12:43:13.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe056000640 1 -- 172.21.15.40:0/2127613288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe05c0053c0 con 0x5621ad7c5840 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe079e90740 10 client.16221 fetch_fsmap learned FSMap version 35 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5621adba5500 con 0x5621ad7c5840 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.320+0000 7fe056000640 1 -- 172.21.15.40:0/2127613288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5621adb03ea0 con 0x5621ad7c5840 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe056000640 1 -- 172.21.15.40:0/2127613288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe05c01b600 con 0x5621ad7c5840 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe079e90740 10 client.16221 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe079e90740 10 client.16221 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe079e90740 20 client.16221 populate_metadata read hostname 'smithi040' 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe079e90740 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad7a4ea0 0x5621adba8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe079e90740 4 client.16221 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:43:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.321+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621adaff940 con 0x5621ad7a4ea0 2024-07-26T12:43:13.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.322+0000 7fe06b400640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad7a4ea0 0x5621adba8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.323+0000 7fe06b400640 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad7a4ea0 0x5621adba8a60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=695536830d887f28 server_cookie=af902e61076bcc50 in_seq=0 out_seq=0 2024-07-26T12:43:13.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.323+0000 7fe056000640 10 client.16221 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe056000640 1 -- 172.21.15.40:0/2127613288 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621adaff940 con 0x5621ad7a4ea0 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe056000640 10 client.16221 handle_command_reply: tid=0 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 client.16221 shutdown 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 msgr2=0x5621adb96be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb96be0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00bad0 tx=0x7fe05c00bed0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 shutdown_connections 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7e6520 0x5621adba2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad7a4ea0 0x5621adba8a60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7c5840 0x5621adb96be0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 --2- 172.21.15.40:0/2127613288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe056000640 0 client.16221 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.325+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 >> 172.21.15.40:0/2127613288 conn(0x5621ad7da910 msgr2=0x5621adb8e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.326+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 shutdown_connections 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.326+0000 7fe079e90740 1 -- 172.21.15.40:0/2127613288 wait complete. 2024-07-26T12:43:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.326+0000 7fe079e90740 20 client.16221 trim_cache size 0 max 16384 2024-07-26T12:43:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 Processor -- start 2024-07-26T12:43:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 -- start start 2024-07-26T12:43:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 0x5621adb8c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adba2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adba2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b1620 con 0x5621ad7bd660 2024-07-26T12:43:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b3160 con 0x5621ad7e6520 2024-07-26T12:43:13.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.345+0000 7fe079e90740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b1cf0 con 0x5621ad7c5840 2024-07-26T12:43:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.346+0000 7fe06b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 0x5621adb8c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.346+0000 7fe06b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 0x5621adb8c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46070/0 (socket says 172.21.15.40:46070) 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.346+0000 7fe06b400640 1 -- 172.21.15.40:0/3594920879 learned_addr learned my addr 172.21.15.40:0/3594920879 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.346+0000 7fe06be00640 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adba2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.346+0000 7fe06b400640 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adba2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06b400640 1 -- 172.21.15.40:0/3594920879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 msgr2=0x5621adba2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06b400640 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adba2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06b400640 1 -- 172.21.15.40:0/3594920879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 msgr2=0x5621adba2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06b400640 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adba2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06b400640 1 -- 172.21.15.40:0/3594920879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621adb97960 con 0x5621ad7bd660 2024-07-26T12:43:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06be00640 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adba2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:43:13.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.347+0000 7fe06b400640 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 0x5621adb8c720 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe0580057c0 tx=0x7fe058009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13318f40e8a20121 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:13.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.348+0000 7fe060c00640 1 -- 172.21.15.40:0/3594920879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058035040 con 0x5621ad7bd660 2024-07-26T12:43:13.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.348+0000 7fe060c00640 1 -- 172.21.15.40:0/3594920879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe05803d8e0 con 0x5621ad7bd660 2024-07-26T12:43:13.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.348+0000 7fe060c00640 1 -- 172.21.15.40:0/3594920879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05804b6a0 con 0x5621ad7bd660 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 -- 172.21.15.40:0/3594920879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 msgr2=0x5621adb8c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 0x5621adb8c720 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe0580057c0 tx=0x7fe058009260 comp rx=0 tx=0).stop 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 -- 172.21.15.40:0/3594920879 shutdown_connections 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7e6520 0x5621adba2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adba2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 --2- 172.21.15.40:0/3594920879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7bd660 0x5621adb8c720 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 -- 172.21.15.40:0/3594920879 >> 172.21.15.40:0/3594920879 conn(0x5621ad7da910 msgr2=0x5621adb8c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 -- 172.21.15.40:0/3594920879 shutdown_connections 2024-07-26T12:43:13.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.349+0000 7fe079e90740 1 -- 172.21.15.40:0/3594920879 wait complete. 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.350+0000 7fe079e90740 1 -- start start 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.350+0000 7fe079e90740 1 Processor -- start 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb9acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adb9b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 0x5621adc18a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b2a90 con 0x5621ad7e6520 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b23c0 con 0x5621ad7bd660 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1af5e0 con 0x5621ad7c5840 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe079e90740 10 client.0 _ll_register_callbacks cb 0x7fe05c0040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe06b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 0x5621adc18a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe06b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 0x5621adc18a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46082/0 (socket says 172.21.15.40:46082) 2024-07-26T12:43:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe06b400640 1 -- 172.21.15.40:0/4193524262 learned_addr learned my addr 172.21.15.40:0/4193524262 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe06b400640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb9acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.351+0000 7fe06be00640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adb9b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe06b400640 1 -- 172.21.15.40:0/4193524262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 msgr2=0x5621adb9b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe06b400640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adb9b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe06b400640 1 -- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 msgr2=0x5621adb9acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe06b400640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb9acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe06b400640 1 -- 172.21.15.40:0/4193524262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621adc18f80 con 0x5621ad7e6520 2024-07-26T12:43:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe06b400640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 0x5621adc18a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098d0 tx=0x7fe058005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7290a199217622 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe056000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe056000640 1 -- 172.21.15.40:0/4193524262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058060020 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe056000640 1 -- 172.21.15.40:0/4193524262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe05803d650 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.352+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe05803d8e0 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe056000640 1 -- 172.21.15.40:0/4193524262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe058035040 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe079e90740 10 client.16227 fetch_fsmap learned FSMap version 35 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5621adc1a150 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe056000640 1 -- 172.21.15.40:0/4193524262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe05803d8e0 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe056000640 1 -- 172.21.15.40:0/4193524262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe058049040 con 0x5621ad7e6520 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe079e90740 10 client.16227 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe079e90740 10 client.16227 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.353+0000 7fe079e90740 20 client.16227 populate_metadata read hostname 'smithi040' 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.354+0000 7fe079e90740 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad77a250 0x5621adc1c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.354+0000 7fe079e90740 4 client.16227 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a9b44208", "release": true, "await": true}] 2024-07-26T12:43:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.354+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a9b44208", "release": true, "await": true}) -- 0x5621adafd080 con 0x5621ad77a250 2024-07-26T12:43:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.354+0000 7fe06be00640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad77a250 0x5621adc1c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.355+0000 7fe06be00640 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad77a250 0x5621adc1c430 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70a23d9f94aaa24 server_cookie=bf3e3f99a28d01e0 in_seq=0 out_seq=0 2024-07-26T12:43:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.355+0000 7fe056000640 10 client.16227 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:13.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.415+0000 7fe056000640 1 -- 172.21.15.40:0/4193524262 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5621adafd080 con 0x5621ad77a250 2024-07-26T12:43:13.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.415+0000 7fe056000640 10 client.16227 handle_command_reply: tid=0 2024-07-26T12:43:13.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.415+0000 7fe079e90740 1 client.16227 shutdown 2024-07-26T12:43:13.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 msgr2=0x5621adc18a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 0x5621adc18a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098d0 tx=0x7fe058005c90 comp rx=0 tx=0).stop 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 shutdown_connections 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5621ad77a250 0x5621adc1c430 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5621ad7e6520 0x5621adc18a40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621ad7c5840 0x5621adb9b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 --2- 172.21.15.40:0/4193524262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621ad7bd660 0x5621adb9acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe056000640 0 client.16227 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:13.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.416+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 >> 172.21.15.40:0/4193524262 conn(0x5621ad7da910 msgr2=0x5621adb91070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:13.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.417+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 shutdown_connections 2024-07-26T12:43:13.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.417+0000 7fe079e90740 1 -- 172.21.15.40:0/4193524262 wait complete. 2024-07-26T12:43:13.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.417+0000 7fe079e90740 20 client.16227 trim_cache size 0 max 16384 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 64, 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "a9b44208": { 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 64, 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:43:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.9, 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:13.422 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:43:13.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0500b3c50 msgr2=0x7fe0500b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0500b3c50 0x7fe0500b6160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe0640aa900 tx=0x7fe06400cf50 comp rx=0 tx=0).stop 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 msgr2=0x7fe06c1a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 0x7fe06c1a1d70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe06400eaa0 tx=0x7fe06400ef60 comp rx=0 tx=0).stop 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 shutdown_connections 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe06c1a1960 0x7fe06c1a1d70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c10ba50 0x7fe06c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0500b3c50 0x7fe0500b6160 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 --2- 172.21.15.40:0/1970605411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe06c1057c0 0x7fe06c19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.419+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 >> 172.21.15.40:0/1970605411 conn(0x7fe06c101290 msgr2=0x7fe06c1036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.420+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 shutdown_connections 2024-07-26T12:43:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:13.420+0000 7fe073200640 1 -- 172.21.15.40:0/1970605411 wait complete. 2024-07-26T12:43:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:13 smithi146 ceph-mon[35807]: pgmap v1129: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 257 KiB/s wr, 8 op/s 2024-07-26T12:43:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:13 smithi076 ceph-mon[35401]: pgmap v1129: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 257 KiB/s wr, 8 op/s 2024-07-26T12:43:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:13 smithi040 ceph-mon[32397]: pgmap v1129: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 257 KiB/s wr, 8 op/s 2024-07-26T12:43:14.448 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a9b44208', total seconds elapsed: 26.7 2024-07-26T12:43:14.448 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.95 2024-07-26T12:43:14.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:43:14.958 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:43:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:15 smithi146 ceph-mon[35807]: pgmap v1130: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-07-26T12:43:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:15 smithi076 ceph-mon[35401]: pgmap v1130: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-07-26T12:43:16.158 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:15 smithi040 ceph-mon[32397]: pgmap v1130: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-07-26T12:43:17.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.323+0000 7f6e09800640 1 -- 172.21.15.40:0/350083079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04107de0 msgr2=0x7f6e041081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:17.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.323+0000 7f6e09800640 1 --2- 172.21.15.40:0/350083079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04107de0 0x7f6e041081f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009900 tx=0x7f6dec02a410 comp rx=0 tx=0).stop 2024-07-26T12:43:17.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 -- 172.21.15.40:0/350083079 shutdown_connections 2024-07-26T12:43:17.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 --2- 172.21.15.40:0/350083079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e04108730 0x7f6e0410ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 --2- 172.21.15.40:0/350083079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04107de0 0x7f6e041081f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 --2- 172.21.15.40:0/350083079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e041024f0 0x7f6e04102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 -- 172.21.15.40:0/350083079 >> 172.21.15.40:0/350083079 conn(0x7f6e04079150 msgr2=0x7f6e04079560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 -- 172.21.15.40:0/350083079 shutdown_connections 2024-07-26T12:43:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.324+0000 7f6e09800640 1 -- 172.21.15.40:0/350083079 wait complete. 2024-07-26T12:43:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.325+0000 7f6e09800640 1 Processor -- start 2024-07-26T12:43:17.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.325+0000 7f6e09800640 1 -- start start 2024-07-26T12:43:17.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.326+0000 7f6e09800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e041024f0 0x7f6e0410cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:17.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.326+0000 7f6e09800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e04107de0 0x7f6e04108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:17.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.326+0000 7f6e09800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 0x7f6e04109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.326+0000 7f6e09800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6e041122c0 con 0x7f6e04108730 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.326+0000 7f6e09800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04112140 con 0x7f6e041024f0 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.326+0000 7f6e09800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04112440 con 0x7f6e04107de0 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 0x7f6e04109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 0x7f6e04109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46094/0 (socket says 172.21.15.40:46094) 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 -- 172.21.15.40:0/1985987865 learned_addr learned my addr 172.21.15.40:0/1985987865 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6dfa000640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e04107de0 0x7f6e04108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e02a00640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e041024f0 0x7f6e0410cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 -- 172.21.15.40:0/1985987865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e04107de0 msgr2=0x7f6e04108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e04107de0 0x7f6e04108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 -- 172.21.15.40:0/1985987865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e041024f0 msgr2=0x7f6e0410cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e041024f0 0x7f6e0410cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.327+0000 7f6e03400640 1 -- 172.21.15.40:0/1985987865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e041ac580 con 0x7f6e04108730 2024-07-26T12:43:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.328+0000 7f6e03400640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 0x7f6e04109650 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d750 tx=0x7f6dfc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.328+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc017070 con 0x7f6e04108730 2024-07-26T12:43:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.328+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dfc0054b0 con 0x7f6e04108730 2024-07-26T12:43:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.328+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc004b90 con 0x7f6e04108730 2024-07-26T12:43:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.328+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e041ac7b0 con 0x7f6e04108730 2024-07-26T12:43:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.329+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e041acc70 con 0x7f6e04108730 2024-07-26T12:43:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.330+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e04102900 con 0x7f6e04108730 2024-07-26T12:43:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.333+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6dfc004d30 con 0x7f6e04108730 2024-07-26T12:43:17.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.336+0000 7f6dfbe00640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6de80b3bd0 0x7f6de80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.336+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6dfc0e3630 con 0x7f6e04108730 2024-07-26T12:43:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.336+0000 7f6e02a00640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6de80b3bd0 0x7f6de80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.337+0000 7f6e02a00640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6de80b3bd0 0x7f6de80b60e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e0410c9a0 tx=0x7f6df4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:17.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.340+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6dfc0aa5f0 con 0x7f6e04108730 2024-07-26T12:43:17.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.648+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e0410a230 con 0x7f6e04108730 2024-07-26T12:43:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.650+0000 7f6dfbe00640 1 -- 172.21.15.40:0/1985987865 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f6dfc0aeb40 con 0x7f6e04108730 2024-07-26T12:43:17.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:43:17.652 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:43:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:43:17.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.653+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6de80b3bd0 msgr2=0x7f6de80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:17.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.653+0000 7f6e09800640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6de80b3bd0 0x7f6de80b60e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e0410c9a0 tx=0x7f6df4009680 comp rx=0 tx=0).stop 2024-07-26T12:43:17.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.653+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 msgr2=0x7f6e04109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:17.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.653+0000 7f6e09800640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 0x7f6e04109650 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d750 tx=0x7f6dfc00dc10 comp rx=0 tx=0).stop 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.653+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 shutdown_connections 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e04108730 0x7f6e04109650 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6de80b3bd0 0x7f6de80b60e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e04107de0 0x7f6e04108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 --2- 172.21.15.40:0/1985987865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e041024f0 0x7f6e0410cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 >> 172.21.15.40:0/1985987865 conn(0x7f6e04079150 msgr2=0x7f6e04103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 shutdown_connections 2024-07-26T12:43:17.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:17.654+0000 7f6e09800640 1 -- 172.21.15.40:0/1985987865 wait complete. 2024-07-26T12:43:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:17 smithi040 ceph-mon[32397]: pgmap v1131: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:43:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1985987865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:17 smithi146 ceph-mon[35807]: pgmap v1131: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:43:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1985987865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:17 smithi076 ceph-mon[35401]: pgmap v1131: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:43:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1985987865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:18.586 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0' 2024-07-26T12:43:18.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 138.95 --await-for 45.0 2024-07-26T12:43:19.100 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:43:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:19 smithi040 ceph-mon[32397]: pgmap v1132: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 766 KiB/s wr, 11 op/s 2024-07-26T12:43:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:19 smithi146 ceph-mon[35807]: pgmap v1132: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 766 KiB/s wr, 11 op/s 2024-07-26T12:43:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:19 smithi076 ceph-mon[35401]: pgmap v1132: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 766 KiB/s wr, 11 op/s 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.313+0000 7f49e5a00640 1 -- 172.21.15.40:0/286226300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 msgr2=0x7f49e01120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.313+0000 7f49e5a00640 1 --2- 172.21.15.40:0/286226300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01120f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009ca0 tx=0x7f49d802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.313+0000 7f49e5a00640 1 -- 172.21.15.40:0/286226300 shutdown_connections 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.313+0000 7f49e5a00640 1 --2- 172.21.15.40:0/286226300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01120f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.313+0000 7f49e5a00640 1 --2- 172.21.15.40:0/286226300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 0x7f49e010b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.313+0000 7f49e5a00640 1 --2- 172.21.15.40:0/286226300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e0105630 0x7f49e0105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.314+0000 7f49e5a00640 1 -- 172.21.15.40:0/286226300 >> 172.21.15.40:0/286226300 conn(0x7f49e01010a0 msgr2=0x7f49e01034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.314+0000 7f49e5a00640 1 -- 172.21.15.40:0/286226300 shutdown_connections 2024-07-26T12:43:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.314+0000 7f49e5a00640 1 -- 172.21.15.40:0/286226300 wait complete. 2024-07-26T12:43:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.315+0000 7f49e5a00640 1 Processor -- start 2024-07-26T12:43:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.315+0000 7f49e5a00640 1 -- start start 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49e5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e0105630 0x7f49e019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49e5a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 0x7f49e019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49e5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49e5a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0115490 con 0x7f49e010b8c0 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49e5a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0115310 con 0x7f49e010af70 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49e5a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0115610 con 0x7f49e0105630 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49df400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49df400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46110/0 (socket says 172.21.15.40:46110) 2024-07-26T12:43:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.316+0000 7f49df400640 1 -- 172.21.15.40:0/1834306729 learned_addr learned my addr 172.21.15.40:0/1834306729 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49de000640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 0x7f49e019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49dea00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e0105630 0x7f49e019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49df400640 1 -- 172.21.15.40:0/1834306729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e0105630 msgr2=0x7f49e019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49df400640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e0105630 0x7f49e019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49df400640 1 -- 172.21.15.40:0/1834306729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 msgr2=0x7f49e019c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49df400640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 0x7f49e019c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49df400640 1 -- 172.21.15.40:0/1834306729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e01a1d70 con 0x7f49e010b8c0 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.317+0000 7f49de000640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 0x7f49e019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.318+0000 7f49df400640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01a1640 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f49d8031040 tx=0x7f49d8032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.318+0000 7f49d7400640 1 -- 172.21.15.40:0/1834306729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8004040 con 0x7f49e010b8c0 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.318+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e01a2000 con 0x7f49e010b8c0 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.318+0000 7f49d7400640 1 -- 172.21.15.40:0/1834306729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49d8004670 con 0x7f49e010b8c0 2024-07-26T12:43:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.318+0000 7f49d7400640 1 -- 172.21.15.40:0/1834306729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8030bb0 con 0x7f49e010b8c0 2024-07-26T12:43:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.318+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e01a87c0 con 0x7f49e010b8c0 2024-07-26T12:43:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.322+0000 7f49ec601740 1 Processor -- start 2024-07-26T12:43:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.323+0000 7f49d7400640 1 -- 172.21.15.40:0/1834306729 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f49d80041e0 con 0x7f49e010b8c0 2024-07-26T12:43:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.323+0000 7f49ec601740 1 -- start start 2024-07-26T12:43:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49ec601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672c9a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49ec601740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672c9a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49ec601740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672c9af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49ec601740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b672c0e8a0 con 0x55b6728d2b70 2024-07-26T12:43:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49ec601740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b672bfdda0 con 0x55b6728ca990 2024-07-26T12:43:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49ec601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b672c01de0 con 0x55b6728f3850 2024-07-26T12:43:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49de000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672c9af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49de000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672c9af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46124/0 (socket says 172.21.15.40:46124) 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49de000640 1 -- 172.21.15.40:0/3700873418 learned_addr learned my addr 172.21.15.40:0/3700873418 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49de000640 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672c9a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.324+0000 7f49dea00640 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672c9a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.325+0000 7f49de000640 1 -- 172.21.15.40:0/3700873418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 msgr2=0x55b672c9a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.325+0000 7f49de000640 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672c9a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.325+0000 7f49de000640 1 -- 172.21.15.40:0/3700873418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 msgr2=0x55b672c9a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.325+0000 7f49de000640 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672c9a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.325+0000 7f49de000640 1 -- 172.21.15.40:0/3700873418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b672b92b70 con 0x55b6728d2b70 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.325+0000 7f49d7400640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49c40b3bc0 0x7f49c40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.326+0000 7f49de000640 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672c9af00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0149f0 tx=0x7f49cc00c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661a19a25eaaffcd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.326+0000 7f49d7400640 1 -- 172.21.15.40:0/1834306729 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f49d8105070 con 0x7f49e010b8c0 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.326+0000 7f49dea00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49c40b3bc0 0x7f49c40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.326+0000 7f49cbe00640 1 -- 172.21.15.40:0/3700873418 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0142d0 con 0x55b6728d2b70 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.326+0000 7f49cbe00640 1 -- 172.21.15.40:0/3700873418 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49cc00f760 con 0x55b6728d2b70 2024-07-26T12:43:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.326+0000 7f49cbe00640 1 -- 172.21.15.40:0/3700873418 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0044c0 con 0x55b6728d2b70 2024-07-26T12:43:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.327+0000 7f49ec601740 1 -- 172.21.15.40:0/3700873418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 msgr2=0x55b672c9af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.327+0000 7f49ec601740 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672c9af00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0149f0 tx=0x7f49cc00c510 comp rx=0 tx=0).stop 2024-07-26T12:43:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.327+0000 7f49dea00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49c40b3bc0 0x7f49c40b60d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55b672c99100 tx=0x7f49d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 -- 172.21.15.40:0/3700873418 shutdown_connections 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672c9af00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672c9a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 --2- 172.21.15.40:0/3700873418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672c9a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 -- 172.21.15.40:0/3700873418 >> 172.21.15.40:0/3700873418 conn(0x55b6728e7c40 msgr2=0x55b672c98370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 -- 172.21.15.40:0/3700873418 shutdown_connections 2024-07-26T12:43:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.328+0000 7f49ec601740 1 -- 172.21.15.40:0/3700873418 wait complete. 2024-07-26T12:43:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.329+0000 7f49ec601740 1 -- start start 2024-07-26T12:43:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.329+0000 7f49ec601740 1 Processor -- start 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 0x55b672ca5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728d2b70 0x55b672ca6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728f3850 0x55b672cb1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b672a617b0 con 0x55b6728ca990 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b672b9a380 con 0x55b6728f3850 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b672ca8c00 con 0x55b6728d2b70 2024-07-26T12:43:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49ec601740 10 client.0 _ll_register_callbacks cb 0x55b672ba9830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:43:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.330+0000 7f49dea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 0x55b672ca5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 0x55b672ca5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46140/0 (socket says 172.21.15.40:46140) 2024-07-26T12:43:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 -- 172.21.15.40:0/689854923 learned_addr learned my addr 172.21.15.40:0/689854923 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49de000640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728d2b70 0x55b672ca6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49df400640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728f3850 0x55b672cb1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 -- 172.21.15.40:0/689854923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728d2b70 msgr2=0x55b672ca6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728d2b70 0x55b672ca6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 -- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728f3850 msgr2=0x55b672cb1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728f3850 0x55b672cb1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.331+0000 7f49dea00640 1 -- 172.21.15.40:0/689854923 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67296dba0 con 0x55b6728ca990 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.332+0000 7f49dea00640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 0x55b672ca5f10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f49d0003dd0 tx=0x7f49d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80d033c5c6daef8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.332+0000 7f49c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.332+0000 7f49c8c00640 1 -- 172.21.15.40:0/689854923 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d002c060 con 0x55b6728ca990 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.332+0000 7f49c8c00640 1 -- 172.21.15.40:0/689854923 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f49d0017030 con 0x55b6728ca990 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.332+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49cc00f760 con 0x55b6728ca990 2024-07-26T12:43:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.333+0000 7f49c8c00640 1 -- 172.21.15.40:0/689854923 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f49d0027410 con 0x55b6728ca990 2024-07-26T12:43:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.333+0000 7f49ec601740 10 client.16245 fetch_fsmap learned FSMap version 35 2024-07-26T12:43:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.333+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b672cb4b80 con 0x55b6728ca990 2024-07-26T12:43:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.333+0000 7f49c8c00640 1 -- 172.21.15.40:0/689854923 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49cc00f760 con 0x55b6728ca990 2024-07-26T12:43:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.333+0000 7f49c8c00640 1 -- 172.21.15.40:0/689854923 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f49d0031070 con 0x55b6728ca990 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.334+0000 7f49ec601740 10 client.16245 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.334+0000 7f49ec601740 10 client.16245 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.334+0000 7f49ec601740 20 client.16245 populate_metadata read hostname 'smithi040' 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.334+0000 7f49ec601740 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6728b21d0 0x55b672cb80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.334+0000 7f49ec601740 4 client.16245 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.334+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b672c107f0 con 0x55b6728b21d0 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.335+0000 7f49de000640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6728b21d0 0x55b672cb80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.336+0000 7f49de000640 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6728b21d0 0x55b672cb80b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c704ad9cec4e87e server_cookie=38f531e2ef685257 in_seq=0 out_seq=0 2024-07-26T12:43:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.336+0000 7f49c8c00640 10 client.16245 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49c8c00640 1 -- 172.21.15.40:0/689854923 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b672c107f0 con 0x55b6728b21d0 2024-07-26T12:43:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49c8c00640 10 client.16245 handle_command_reply: tid=0 2024-07-26T12:43:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 client.16245 shutdown 2024-07-26T12:43:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 msgr2=0x55b672ca5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 0x55b672ca5f10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f49d0003dd0 tx=0x7f49d0004730 comp rx=0 tx=0).stop 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 shutdown_connections 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728f3850 0x55b672cb1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728d2b70 0x55b672ca6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6728b21d0 0x55b672cb80b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.339+0000 7f49c8c00640 0 client.16245 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.338+0000 7f49ec601740 1 --2- 172.21.15.40:0/689854923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728ca990 0x55b672ca5f10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.339+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 >> 172.21.15.40:0/689854923 conn(0x55b6728e7c40 msgr2=0x55b672c9d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.339+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 shutdown_connections 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.339+0000 7f49ec601740 1 -- 172.21.15.40:0/689854923 wait complete. 2024-07-26T12:43:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.339+0000 7f49ec601740 20 client.16245 trim_cache size 0 max 16384 2024-07-26T12:43:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.358+0000 7f49ec601740 1 Processor -- start 2024-07-26T12:43:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.358+0000 7f49ec601740 1 -- start start 2024-07-26T12:43:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49ec601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728ca990 0x55b672c9be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49ec601740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728d2b70 0x55b672ca7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49ec601740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 0x55b672cb1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49ec601740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01b0d60 con 0x55b6728f3850 2024-07-26T12:43:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49ec601740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01b28a0 con 0x55b6728d2b70 2024-07-26T12:43:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49ec601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01b1430 con 0x55b6728ca990 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49df400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 0x55b672cb1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49df400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 0x55b672cb1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46154/0 (socket says 172.21.15.40:46154) 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.359+0000 7f49df400640 1 -- 172.21.15.40:0/1729135830 learned_addr learned my addr 172.21.15.40:0/1729135830 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49de000640 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728d2b70 0x55b672ca7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49dea00640 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728ca990 0x55b672c9be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49df400640 1 -- 172.21.15.40:0/1729135830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728ca990 msgr2=0x55b672c9be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49df400640 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728ca990 0x55b672c9be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49df400640 1 -- 172.21.15.40:0/1729135830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728d2b70 msgr2=0x55b672ca7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49df400640 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728d2b70 0x55b672ca7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49df400640 1 -- 172.21.15.40:0/1729135830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b672ca82f0 con 0x55b6728f3850 2024-07-26T12:43:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.360+0000 7f49df400640 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 0x55b672cb1d10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f49d8102b70 tx=0x7f49d80cb9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdb85132291469e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.361+0000 7f49cb400640 1 -- 172.21.15.40:0/1729135830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80e5020 con 0x55b6728f3850 2024-07-26T12:43:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.361+0000 7f49cb400640 1 -- 172.21.15.40:0/1729135830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49d8036040 con 0x55b6728f3850 2024-07-26T12:43:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.361+0000 7f49cb400640 1 -- 172.21.15.40:0/1729135830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80d05c0 con 0x55b6728f3850 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 -- 172.21.15.40:0/1729135830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 msgr2=0x55b672cb1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 0x55b672cb1d10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f49d8102b70 tx=0x7f49d80cb9d0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 -- 172.21.15.40:0/1729135830 shutdown_connections 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728f3850 0x55b672cb1d10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728d2b70 0x55b672ca7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 --2- 172.21.15.40:0/1729135830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728ca990 0x55b672c9be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 -- 172.21.15.40:0/1729135830 >> 172.21.15.40:0/1729135830 conn(0x55b6728e7c40 msgr2=0x55b672ca7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 -- 172.21.15.40:0/1729135830 shutdown_connections 2024-07-26T12:43:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.362+0000 7f49ec601740 1 -- 172.21.15.40:0/1729135830 wait complete. 2024-07-26T12:43:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.363+0000 7f49ec601740 1 -- start start 2024-07-26T12:43:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.363+0000 7f49ec601740 1 Processor -- start 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672ca9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672caa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672caa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01b21d0 con 0x55b6728d2b70 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01b1b00 con 0x55b6728ca990 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01aed20 con 0x55b6728f3850 2024-07-26T12:43:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49ec601740 10 client.0 _ll_register_callbacks cb 0x7f49d0003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:43:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49de000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672caa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49de000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672caa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46170/0 (socket says 172.21.15.40:46170) 2024-07-26T12:43:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49de000640 1 -- 172.21.15.40:0/3081457708 learned_addr learned my addr 172.21.15.40:0/3081457708 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.364+0000 7f49dea00640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672ca9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49df400640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672caa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49de000640 1 -- 172.21.15.40:0/3081457708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 msgr2=0x55b672caa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49de000640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672caa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49de000640 1 -- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 msgr2=0x55b672ca9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49de000640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672ca9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49de000640 1 -- 172.21.15.40:0/3081457708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b672d1f9a0 con 0x55b6728d2b70 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49de000640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672caa3e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c4b0 tx=0x7f49cc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe2c8db7c59c393 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.365+0000 7f49c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.366+0000 7f49c8c00640 1 -- 172.21.15.40:0/3081457708 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc004230 con 0x55b6728d2b70 2024-07-26T12:43:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.366+0000 7f49c8c00640 1 -- 172.21.15.40:0/3081457708 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f49cc0043d0 con 0x55b6728d2b70 2024-07-26T12:43:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.366+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d8036040 con 0x55b6728d2b70 2024-07-26T12:43:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.366+0000 7f49c8c00640 1 -- 172.21.15.40:0/3081457708 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f49cc00f730 con 0x55b6728d2b70 2024-07-26T12:43:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.366+0000 7f49ec601740 10 client.16251 fetch_fsmap learned FSMap version 35 2024-07-26T12:43:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.366+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b672d20c00 con 0x55b6728d2b70 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49c8c00640 1 -- 172.21.15.40:0/3081457708 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49d8036040 con 0x55b6728d2b70 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49c8c00640 1 -- 172.21.15.40:0/3081457708 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f49cc035030 con 0x55b6728d2b70 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49ec601740 10 client.16251 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49ec601740 10 client.16251 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49ec601740 20 client.16251 populate_metadata read hostname 'smithi040' 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49ec601740 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b672887580 0x55b672d230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49ec601740 4 client.16251 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}] 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.367+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.95, "await_for": 45.0}) -- 0x55b672c0c290 con 0x55b672887580 2024-07-26T12:43:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.368+0000 7f49dea00640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b672887580 0x55b672d230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.369+0000 7f49dea00640 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b672887580 0x55b672d230f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d409c36649f67b0 server_cookie=da621b1fd440a7bf in_seq=0 out_seq=0 2024-07-26T12:43:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.369+0000 7f49c8c00640 10 client.16251 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:21.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.638+0000 7f49c8c00640 1 -- 172.21.15.40:0/3081457708 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b672c0c290 con 0x55b672887580 2024-07-26T12:43:21.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.638+0000 7f49c8c00640 10 client.16251 handle_command_reply: tid=0 2024-07-26T12:43:21.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.638+0000 7f49ec601740 1 client.16251 shutdown 2024-07-26T12:43:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 msgr2=0x55b672caa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672caa3e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c4b0 tx=0x7f49cc005850 comp rx=0 tx=0).stop 2024-07-26T12:43:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 shutdown_connections 2024-07-26T12:43:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6728f3850 0x55b672caa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b672887580 0x55b672d230f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6728d2b70 0x55b672caa3e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 --2- 172.21.15.40:0/3081457708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6728ca990 0x55b672ca9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 >> 172.21.15.40:0/3081457708 conn(0x55b6728e7c40 msgr2=0x55b672c9bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.639+0000 7f49c8c00640 0 client.16251 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.640+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 shutdown_connections 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.640+0000 7f49ec601740 1 -- 172.21.15.40:0/3081457708 wait complete. 2024-07-26T12:43:21.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.640+0000 7f49ec601740 20 client.16251 trim_cache size 0 max 16384 2024-07-26T12:43:21.643 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:43:21.643 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:43:21.643 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:43:21.643 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 66, 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "6436de54": { 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 66, 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.9, 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:43:21.644 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:21.646 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:43:21.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.642+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49c40b3bc0 msgr2=0x7f49c40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.642+0000 7f49e5a00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49c40b3bc0 0x7f49c40b60d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55b672c99100 tx=0x7f49d000b390 comp rx=0 tx=0).stop 2024-07-26T12:43:21.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.642+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 msgr2=0x7f49e01a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.642+0000 7f49e5a00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01a1640 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f49d8031040 tx=0x7f49d8032bc0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 shutdown_connections 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49e010b8c0 0x7f49e01a1640 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f49e010af70 0x7f49e019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f49c40b3bc0 0x7f49c40b60d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 --2- 172.21.15.40:0/1834306729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e0105630 0x7f49e019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 >> 172.21.15.40:0/1834306729 conn(0x7f49e01010a0 msgr2=0x7f49e01034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 shutdown_connections 2024-07-26T12:43:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:21.643+0000 7f49e5a00640 1 -- 172.21.15.40:0/1834306729 wait complete. 2024-07-26T12:43:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:21 smithi040 ceph-mon[32397]: pgmap v1133: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 MiB/s wr, 10 op/s 2024-07-26T12:43:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:21 smithi146 ceph-mon[35807]: pgmap v1133: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 MiB/s wr, 10 op/s 2024-07-26T12:43:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:21 smithi076 ceph-mon[35401]: pgmap v1133: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 MiB/s wr, 10 op/s 2024-07-26T12:43:22.409 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6436de54', quiesce took 8.0 seconds. Will release after: 10.95 2024-07-26T12:43:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:23 smithi076 ceph-mon[35401]: pgmap v1134: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T12:43:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:23 smithi040 ceph-mon[32397]: pgmap v1134: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T12:43:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:23 smithi146 ceph-mon[35807]: pgmap v1134: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T12:43:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:25 smithi076 ceph-mon[35401]: pgmap v1135: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:43:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:25 smithi040 ceph-mon[32397]: pgmap v1135: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:43:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:25 smithi146 ceph-mon[35807]: pgmap v1135: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:43:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:27 smithi040 ceph-mon[32397]: pgmap v1136: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:43:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:27 smithi146 ceph-mon[35807]: pgmap v1136: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:43:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:27 smithi076 ceph-mon[35401]: pgmap v1136: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:43:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:29 smithi040 ceph-mon[32397]: pgmap v1137: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:43:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:43:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:29 smithi146 ceph-mon[35807]: pgmap v1137: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:43:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:43:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:29 smithi076 ceph-mon[35401]: pgmap v1137: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:43:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:43:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:43:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:43:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:43:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:43:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:43:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:43:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:43:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:43:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:43:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:31 smithi040 ceph-mon[32397]: pgmap v1138: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:43:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:31 smithi146 ceph-mon[35807]: pgmap v1138: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:43:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:31 smithi076 ceph-mon[35401]: pgmap v1138: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:43:33.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:43:33.846 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:43:34.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:33 smithi040 ceph-mon[32397]: pgmap v1139: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2024-07-26T12:43:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:33 smithi146 ceph-mon[35807]: pgmap v1139: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2024-07-26T12:43:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:33 smithi076 ceph-mon[35401]: pgmap v1139: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 -- 172.21.15.40:0/2270432299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09810b860 msgr2=0x7fe098112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 --2- 172.21.15.40:0/2270432299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09810b860 0x7fe098112090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe090009ca0 tx=0x7fe09002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 -- 172.21.15.40:0/2270432299 shutdown_connections 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 --2- 172.21.15.40:0/2270432299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09810b860 0x7fe098112090 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 --2- 172.21.15.40:0/2270432299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe09810af10 0x7fe09810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 --2- 172.21.15.40:0/2270432299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981055d0 0x7fe0981059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 -- 172.21.15.40:0/2270432299 >> 172.21.15.40:0/2270432299 conn(0x7fe098101040 msgr2=0x7fe098103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 -- 172.21.15.40:0/2270432299 shutdown_connections 2024-07-26T12:43:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.983+0000 7fe097200640 1 -- 172.21.15.40:0/2270432299 wait complete. 2024-07-26T12:43:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.985+0000 7fe097200640 1 Processor -- start 2024-07-26T12:43:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.985+0000 7fe097200640 1 -- start start 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe097200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 0x7fe09819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe097200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe09810af10 0x7fe09819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe097200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe09810b860 0x7fe0981a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe097200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe098115410 con 0x7fe0981055d0 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe097200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe098115290 con 0x7fe09810af10 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe097200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe098115590 con 0x7fe09810b860 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe095e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 0x7fe09819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe095e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 0x7fe09819bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51618/0 (socket says 172.21.15.40:51618) 2024-07-26T12:43:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe095e00640 1 -- 172.21.15.40:0/637146325 learned_addr learned my addr 172.21.15.40:0/637146325 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.986+0000 7fe095400640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe09810af10 0x7fe09819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe096800640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe09810b860 0x7fe0981a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe095e00640 1 -- 172.21.15.40:0/637146325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe09810b860 msgr2=0x7fe0981a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe095e00640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe09810b860 0x7fe0981a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe095e00640 1 -- 172.21.15.40:0/637146325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe09810af10 msgr2=0x7fe09819c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe095e00640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe09810af10 0x7fe09819c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe095e00640 1 -- 172.21.15.40:0/637146325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0981a1d30 con 0x7fe0981055d0 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe096800640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe09810b860 0x7fe0981a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe095e00640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 0x7fe09819bdc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe08800d950 tx=0x7fe08800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088017070 con 0x7fe0981055d0 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe088009c30 con 0x7fe0981055d0 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0981a2020 con 0x7fe0981055d0 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.987+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08800f620 con 0x7fe0981055d0 2024-07-26T12:43:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.988+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0981a8780 con 0x7fe0981055d0 2024-07-26T12:43:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.989+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0981059e0 con 0x7fe0981055d0 2024-07-26T12:43:35.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.992+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe088005030 con 0x7fe0981055d0 2024-07-26T12:43:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.993+0000 7fe08ea00640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe07c0b3bd0 0x7fe07c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.993+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0880e38b0 con 0x7fe0981055d0 2024-07-26T12:43:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.993+0000 7fe095400640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe07c0b3bd0 0x7fe07c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:35.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.994+0000 7fe095400640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe07c0b3bd0 0x7fe07c0b60e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe098109950 tx=0x7fe08400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:35.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:35.995+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe0880aaec0 con 0x7fe0981055d0 2024-07-26T12:43:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:35 smithi040 ceph-mon[32397]: pgmap v1140: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 931 KiB/s wr, 13 op/s 2024-07-26T12:43:36.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.238+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe09802e0c0 con 0x7fe0981055d0 2024-07-26T12:43:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.240+0000 7fe08ea00640 1 -- 172.21.15.40:0/637146325 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fe088009de0 con 0x7fe0981055d0 2024-07-26T12:43:36.242 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:43:36.242 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:43:36.242 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:43:36.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe07c0b3bd0 msgr2=0x7fe07c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:36.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe07c0b3bd0 0x7fe07c0b60e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe098109950 tx=0x7fe08400b590 comp rx=0 tx=0).stop 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 msgr2=0x7fe09819bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 0x7fe09819bdc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe08800d950 tx=0x7fe08800de10 comp rx=0 tx=0).stop 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 shutdown_connections 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe07c0b3bd0 0x7fe07c0b60e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe09810b860 0x7fe0981a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe09810af10 0x7fe09819c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 --2- 172.21.15.40:0/637146325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0981055d0 0x7fe09819bdc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.243+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 >> 172.21.15.40:0/637146325 conn(0x7fe098101040 msgr2=0x7fe098103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.244+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 shutdown_connections 2024-07-26T12:43:36.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:36.244+0000 7fe097200640 1 -- 172.21.15.40:0/637146325 wait complete. 2024-07-26T12:43:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:35 smithi146 ceph-mon[35807]: pgmap v1140: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 931 KiB/s wr, 13 op/s 2024-07-26T12:43:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:35 smithi076 ceph-mon[35401]: pgmap v1140: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 931 KiB/s wr, 13 op/s 2024-07-26T12:43:36.975 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:36 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/637146325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:37.221 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 6436de54 --release --await' 2024-07-26T12:43:37.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 6436de54 --release --await 2024-07-26T12:43:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:36 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/637146325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:36 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/637146325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:43:37.710 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:43:38.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:37 smithi040 ceph-mon[32397]: pgmap v1141: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 248 KiB/s wr, 8 op/s 2024-07-26T12:43:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:37 smithi146 ceph-mon[35807]: pgmap v1141: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 248 KiB/s wr, 8 op/s 2024-07-26T12:43:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:37 smithi076 ceph-mon[35401]: pgmap v1141: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 248 KiB/s wr, 8 op/s 2024-07-26T12:43:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 -- 172.21.15.40:0/4259371865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 msgr2=0x7f7540107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 --2- 172.21.15.40:0/4259371865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f7540107ff0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f752c009900 tx=0x7f752c02a410 comp rx=0 tx=0).stop 2024-07-26T12:43:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 -- 172.21.15.40:0/4259371865 shutdown_connections 2024-07-26T12:43:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 --2- 172.21.15.40:0/4259371865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7540108530 0x7f754010ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 --2- 172.21.15.40:0/4259371865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f7540107ff0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 --2- 172.21.15.40:0/4259371865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75401022a0 0x7f75401026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.765+0000 7f7544a00640 1 -- 172.21.15.40:0/4259371865 >> 172.21.15.40:0/4259371865 conn(0x7f75400fdcf0 msgr2=0x7f7540100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.766+0000 7f7544a00640 1 -- 172.21.15.40:0/4259371865 shutdown_connections 2024-07-26T12:43:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.766+0000 7f7544a00640 1 -- 172.21.15.40:0/4259371865 wait complete. 2024-07-26T12:43:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.767+0000 7f7544a00640 1 Processor -- start 2024-07-26T12:43:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.768+0000 7f7544a00640 1 -- start start 2024-07-26T12:43:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.768+0000 7f7544a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75401022a0 0x7f7540199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.768+0000 7f7544a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f754019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.768+0000 7f7544a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7540108530 0x7f754019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f7544a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75401131f0 con 0x7f7540107be0 2024-07-26T12:43:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f7544a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7540113070 con 0x7f7540108530 2024-07-26T12:43:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f7544a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7540113370 con 0x7f75401022a0 2024-07-26T12:43:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f754019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f754019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51636/0 (socket says 172.21.15.40:51636) 2024-07-26T12:43:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 -- 172.21.15.40:0/2817712052 learned_addr learned my addr 172.21.15.40:0/2817712052 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753f400640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75401022a0 0x7f7540199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753fe00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7540108530 0x7f754019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 -- 172.21.15.40:0/2817712052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75401022a0 msgr2=0x7f7540199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75401022a0 0x7f7540199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 -- 172.21.15.40:0/2817712052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7540108530 msgr2=0x7f754019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.769+0000 7f753ea00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7540108530 0x7f754019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.770+0000 7f753ea00640 1 -- 172.21.15.40:0/2817712052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754019fbd0 con 0x7f7540107be0 2024-07-26T12:43:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.770+0000 7f753ea00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f754019a200 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f752c02a930 tx=0x7f752c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.770+0000 7f7537e00640 1 -- 172.21.15.40:0/2817712052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c03f070 con 0x7f7540107be0 2024-07-26T12:43:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.770+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754019fe60 con 0x7f7540107be0 2024-07-26T12:43:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.770+0000 7f7537e00640 1 -- 172.21.15.40:0/2817712052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f752c03baf0 con 0x7f7540107be0 2024-07-26T12:43:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.770+0000 7f7537e00640 1 -- 172.21.15.40:0/2817712052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c035030 con 0x7f7540107be0 2024-07-26T12:43:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.771+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75401a6620 con 0x7f7540107be0 2024-07-26T12:43:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.774+0000 7f754cc5e740 1 Processor -- start 2024-07-26T12:43:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.774+0000 7f754cc5e740 1 -- start start 2024-07-26T12:43:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x561830474af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300aa840 0x561830475030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f754cc5e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5618303e6f50 con 0x5618300a2660 2024-07-26T12:43:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f754cc5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5618303d6450 con 0x5618300cb520 2024-07-26T12:43:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f754cc5e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5618303da490 con 0x5618300aa840 2024-07-26T12:43:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f7537e00640 1 -- 172.21.15.40:0/2817712052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f752c042070 con 0x7f7540107be0 2024-07-26T12:43:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f753f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x561830474af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f753f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x561830474af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51642/0 (socket says 172.21.15.40:51642) 2024-07-26T12:43:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f753f400640 1 -- 172.21.15.40:0/985760307 learned_addr learned my addr 172.21.15.40:0/985760307 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.775+0000 7f753fe00640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753ea00640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300aa840 0x561830475030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753f400640 1 -- 172.21.15.40:0/985760307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300aa840 msgr2=0x561830475030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753f400640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300aa840 0x561830475030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753f400640 1 -- 172.21.15.40:0/985760307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 msgr2=0x5618304745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753f400640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753f400640 1 -- 172.21.15.40:0/985760307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561830136b00 con 0x5618300a2660 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753ea00640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300aa840 0x561830475030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753fe00640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.776+0000 7f753f400640 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x561830474af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7530009c80 tx=0x7f75300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed700658f5b863 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.777+0000 7f752be00640 1 -- 172.21.15.40:0/985760307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530012450 con 0x5618300a2660 2024-07-26T12:43:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.777+0000 7f752be00640 1 -- 172.21.15.40:0/985760307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7530012a80 con 0x5618300a2660 2024-07-26T12:43:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.777+0000 7f752be00640 1 -- 172.21.15.40:0/985760307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753000fa60 con 0x5618300a2660 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 -- 172.21.15.40:0/985760307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 msgr2=0x561830474af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f7537e00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75240b3bd0 0x7f75240b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x561830474af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7530009c80 tx=0x7f75300117b0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 -- 172.21.15.40:0/985760307 shutdown_connections 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300aa840 0x561830475030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x561830474af0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 --2- 172.21.15.40:0/985760307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 -- 172.21.15.40:0/985760307 >> 172.21.15.40:0/985760307 conn(0x5618300bf910 msgr2=0x5618304724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f7537e00640 1 -- 172.21.15.40:0/2817712052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f752c1043e0 con 0x7f7540107be0 2024-07-26T12:43:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 -- 172.21.15.40:0/985760307 shutdown_connections 2024-07-26T12:43:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f753fe00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75240b3bd0 0x7f75240b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.778+0000 7f754cc5e740 1 -- 172.21.15.40:0/985760307 wait complete. 2024-07-26T12:43:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.779+0000 7f754cc5e740 1 -- start start 2024-07-26T12:43:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.779+0000 7f753fe00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75240b3bd0 0x7f75240b60e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7538005fd0 tx=0x7f75380098f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.779+0000 7f754cc5e740 1 Processor -- start 2024-07-26T12:43:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300a2660 0x56183047fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x5618304801e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x56183048c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561830239bb0 con 0x5618300aa840 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561830372930 con 0x5618300a2660 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561830482d90 con 0x5618300cb520 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f754cc5e740 10 client.0 _ll_register_callbacks cb 0x5618300e2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f753ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x5618304801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f753ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x5618304801e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51644/0 (socket says 172.21.15.40:51644) 2024-07-26T12:43:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f753ea00640 1 -- 172.21.15.40:0/3960341961 learned_addr learned my addr 172.21.15.40:0/3960341961 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.780+0000 7f753f400640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300a2660 0x56183047fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753fe00640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x56183048c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753ea00640 1 -- 172.21.15.40:0/3960341961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 msgr2=0x56183048c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753ea00640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x56183048c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753ea00640 1 -- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300a2660 msgr2=0x56183047fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753ea00640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300a2660 0x56183047fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753ea00640 1 -- 172.21.15.40:0/3960341961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618301ad960 con 0x5618300aa840 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753fe00640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x56183048c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f753ea00640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x5618304801e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f752c0cb280 tx=0x7f752c0cb1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8c7a702d45c5a4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f7528c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f7528c00640 1 -- 172.21.15.40:0/3960341961 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c049050 con 0x5618300aa840 2024-07-26T12:43:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f7528c00640 1 -- 172.21.15.40:0/3960341961 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f752c031400 con 0x5618300aa840 2024-07-26T12:43:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.781+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7530012a80 con 0x5618300aa840 2024-07-26T12:43:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f7528c00640 1 -- 172.21.15.40:0/3960341961 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f752c0cb9f0 con 0x5618300aa840 2024-07-26T12:43:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f754cc5e740 10 client.16269 fetch_fsmap learned FSMap version 35 2024-07-26T12:43:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56183048ea10 con 0x5618300aa840 2024-07-26T12:43:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f7528c00640 1 -- 172.21.15.40:0/3960341961 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7530012a80 con 0x5618300aa840 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f7528c00640 1 -- 172.21.15.40:0/3960341961 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f752c0cb550 con 0x5618300aa840 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f754cc5e740 10 client.16269 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f754cc5e740 10 client.16269 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.782+0000 7f754cc5e740 20 client.16269 populate_metadata read hostname 'smithi040' 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.783+0000 7f754cc5e740 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561830089ea0 0x561830491e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.783+0000 7f754cc5e740 4 client.16269 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.783+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618303e8ea0 con 0x561830089ea0 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.783+0000 7f753f400640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561830089ea0 0x561830491e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.784+0000 7f753f400640 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561830089ea0 0x561830491e50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89641aecf0b967fb server_cookie=f3dbd1db79f1c839 in_seq=0 out_seq=0 2024-07-26T12:43:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.784+0000 7f7528c00640 10 client.16269 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.786+0000 7f7528c00640 1 -- 172.21.15.40:0/3960341961 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618303e8ea0 con 0x561830089ea0 2024-07-26T12:43:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.786+0000 7f7528c00640 10 client.16269 handle_command_reply: tid=0 2024-07-26T12:43:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.786+0000 7f754cc5e740 1 client.16269 shutdown 2024-07-26T12:43:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.786+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 msgr2=0x5618304801e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.786+0000 7f754cc5e740 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x5618304801e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f752c0cb280 tx=0x7f752c0cb1f0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 shutdown_connections 2024-07-26T12:43:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x56183048c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561830089ea0 0x561830491e50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x5618304801e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 --2- 172.21.15.40:0/3960341961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300a2660 0x56183047fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f7528c00640 0 client.16269 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 >> 172.21.15.40:0/3960341961 conn(0x5618300bf910 msgr2=0x561830477790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 shutdown_connections 2024-07-26T12:43:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 1 -- 172.21.15.40:0/3960341961 wait complete. 2024-07-26T12:43:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.787+0000 7f754cc5e740 20 client.16269 trim_cache size 0 max 16384 2024-07-26T12:43:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.806+0000 7f754cc5e740 1 Processor -- start 2024-07-26T12:43:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.806+0000 7f754cc5e740 1 -- start start 2024-07-26T12:43:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300a2660 0x56183048be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x56183048c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304975e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f754cc5e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75401aca40 con 0x5618300aa840 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f754cc5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75401ae580 con 0x5618300cb520 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f754cc5e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75401ad110 con 0x5618300a2660 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f753ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x56183048c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f753ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x56183048c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51652/0 (socket says 172.21.15.40:51652) 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.807+0000 7f753ea00640 1 -- 172.21.15.40:0/905150247 learned_addr learned my addr 172.21.15.40:0/905150247 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753f400640 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300a2660 0x56183048be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753fe00640 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753ea00640 1 -- 172.21.15.40:0/905150247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300a2660 msgr2=0x56183048be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753ea00640 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300a2660 0x56183048be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753ea00640 1 -- 172.21.15.40:0/905150247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 msgr2=0x5618304975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753ea00640 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753ea00640 1 -- 172.21.15.40:0/905150247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561830472d90 con 0x5618300aa840 2024-07-26T12:43:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753fe00640 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:43:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f753ea00640 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x56183048c3b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f752c0c8560 tx=0x7f752c03bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f93a67bcee047f2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f752b400640 1 -- 172.21.15.40:0/905150247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c0ea070 con 0x5618300aa840 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.808+0000 7f752b400640 1 -- 172.21.15.40:0/905150247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f752c0e5e30 con 0x5618300aa840 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.809+0000 7f752b400640 1 -- 172.21.15.40:0/905150247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c049070 con 0x5618300aa840 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.809+0000 7f754cc5e740 1 -- 172.21.15.40:0/905150247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 msgr2=0x56183048c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.809+0000 7f754cc5e740 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x56183048c3b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f752c0c8560 tx=0x7f752c03bf50 comp rx=0 tx=0).stop 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 -- 172.21.15.40:0/905150247 shutdown_connections 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300cb520 0x5618304975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300aa840 0x56183048c3b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 --2- 172.21.15.40:0/905150247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300a2660 0x56183048be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 -- 172.21.15.40:0/905150247 >> 172.21.15.40:0/905150247 conn(0x5618300bf910 msgr2=0x5618304755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 -- 172.21.15.40:0/905150247 shutdown_connections 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 -- 172.21.15.40:0/905150247 wait complete. 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 -- start start 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.810+0000 7f754cc5e740 1 Processor -- start 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x56183046fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300aa840 0x56183046fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x5618304861c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75401adeb0 con 0x5618300a2660 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75401ad7e0 con 0x5618300aa840 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75401aaa00 con 0x5618300cb520 2024-07-26T12:43:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f754cc5e740 10 client.0 _ll_register_callbacks cb 0x7f752c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:43:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f753f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x56183046fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f753f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x56183046fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51654/0 (socket says 172.21.15.40:51654) 2024-07-26T12:43:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.811+0000 7f753f400640 1 -- 172.21.15.40:0/1043069273 learned_addr learned my addr 172.21.15.40:0/1043069273 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:43:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753fe00640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x5618304861c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753ea00640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300aa840 0x56183046fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753f400640 1 -- 172.21.15.40:0/1043069273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 msgr2=0x5618304861c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753f400640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x5618304861c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753f400640 1 -- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300aa840 msgr2=0x56183046fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753f400640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300aa840 0x56183046fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753f400640 1 -- 172.21.15.40:0/1043069273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561830486830 con 0x5618300a2660 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f753f400640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x56183046fa30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x561830473230 tx=0x7f75300098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2de1a483baa2ba8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.812+0000 7f7528c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f7528c00640 1 -- 172.21.15.40:0/1043069273 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530033060 con 0x5618300a2660 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f7528c00640 1 -- 172.21.15.40:0/1043069273 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f75300052c0 con 0x5618300a2660 2024-07-26T12:43:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f752c0e5e30 con 0x5618300a2660 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f7528c00640 1 -- 172.21.15.40:0/1043069273 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f75300054c0 con 0x5618300a2660 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f754cc5e740 10 client.16275 fetch_fsmap learned FSMap version 35 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561830487bd0 con 0x5618300a2660 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.813+0000 7f7528c00640 1 -- 172.21.15.40:0/1043069273 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f752c0e5e30 con 0x5618300a2660 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f7528c00640 1 -- 172.21.15.40:0/1043069273 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7530038070 con 0x5618300a2660 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f754cc5e740 10 client.16275 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:43:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f754cc5e740 10 client.16275 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f754cc5e740 20 client.16275 populate_metadata read hostname 'smithi040' 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f754cc5e740 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56183005f250 0x561830488220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f754cc5e740 4 client.16275 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6436de54", "release": true, "await": true}] 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.814+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6436de54", "release": true, "await": true}) -- 0x5618303e4940 con 0x56183005f250 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.815+0000 7f753ea00640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56183005f250 0x561830488220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.815+0000 7f753ea00640 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56183005f250 0x561830488220 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f521e29732c45dd server_cookie=671deb5a1e1893a in_seq=0 out_seq=0 2024-07-26T12:43:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.815+0000 7f7528c00640 10 client.16275 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.868+0000 7f7528c00640 1 -- 172.21.15.40:0/1043069273 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5618303e4940 con 0x56183005f250 2024-07-26T12:43:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.868+0000 7f7528c00640 10 client.16275 handle_command_reply: tid=0 2024-07-26T12:43:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.868+0000 7f754cc5e740 1 client.16275 shutdown 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.868+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 msgr2=0x56183046fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.868+0000 7f754cc5e740 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x56183046fa30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x561830473230 tx=0x7f75300098b0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 shutdown_connections 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618300cb520 0x5618304861c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618300aa840 0x56183046fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56183005f250 0x561830488220 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 --2- 172.21.15.40:0/1043069273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618300a2660 0x56183046fa30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 >> 172.21.15.40:0/1043069273 conn(0x5618300bf910 msgr2=0x5618304755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f7528c00640 0 client.16275 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 shutdown_connections 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 1 -- 172.21.15.40:0/1043069273 wait complete. 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.869+0000 7f754cc5e740 20 client.16275 trim_cache size 0 max 16384 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:43:39.872 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 68, 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "6436de54": { 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 68, 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.9, 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:43:39.873 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:43:39.874 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75240b3bd0 msgr2=0x7f75240b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75240b3bd0 0x7f75240b60e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7538005fd0 tx=0x7f75380098f0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 msgr2=0x7f754019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f754019a200 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f752c02a930 tx=0x7f752c003b90 comp rx=0 tx=0).stop 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 shutdown_connections 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7540108530 0x7f754019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7540107be0 0x7f754019a200 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75240b3bd0 0x7f75240b60e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 --2- 172.21.15.40:0/2817712052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75401022a0 0x7f7540199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:43:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 >> 172.21.15.40:0/2817712052 conn(0x7f75400fdcf0 msgr2=0x7f7540100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:43:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 shutdown_connections 2024-07-26T12:43:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:43:39.871+0000 7f7544a00640 1 -- 172.21.15.40:0/2817712052 wait complete. 2024-07-26T12:43:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:39 smithi040 ceph-mon[32397]: pgmap v1142: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 248 KiB/s wr, 11 op/s 2024-07-26T12:43:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:39 smithi146 ceph-mon[35807]: pgmap v1142: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 248 KiB/s wr, 11 op/s 2024-07-26T12:43:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:39 smithi076 ceph-mon[35401]: pgmap v1142: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 248 KiB/s wr, 11 op/s 2024-07-26T12:43:40.720 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6436de54', total seconds elapsed: 26.3 2024-07-26T12:43:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:41 smithi040 ceph-mon[32397]: pgmap v1143: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:43:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:41 smithi146 ceph-mon[35807]: pgmap v1143: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:43:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:41 smithi076 ceph-mon[35401]: pgmap v1143: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:43:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:43 smithi040 ceph-mon[32397]: pgmap v1144: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T12:43:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:43 smithi146 ceph-mon[35807]: pgmap v1144: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T12:43:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:43 smithi076 ceph-mon[35401]: pgmap v1144: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T12:43:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:45 smithi040 ceph-mon[32397]: pgmap v1145: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 436 KiB/s wr, 12 op/s 2024-07-26T12:43:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:45 smithi146 ceph-mon[35807]: pgmap v1145: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 436 KiB/s wr, 12 op/s 2024-07-26T12:43:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:45 smithi076 ceph-mon[35401]: pgmap v1145: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 436 KiB/s wr, 12 op/s 2024-07-26T12:43:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:46 smithi040 ceph-mon[32397]: pgmap v1146: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 436 KiB/s wr, 9 op/s 2024-07-26T12:43:47.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:46 smithi076 ceph-mon[35401]: pgmap v1146: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 436 KiB/s wr, 9 op/s 2024-07-26T12:43:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:46 smithi146 ceph-mon[35807]: pgmap v1146: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 436 KiB/s wr, 9 op/s 2024-07-26T12:43:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:49 smithi040 ceph-mon[32397]: pgmap v1147: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:43:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:49 smithi146 ceph-mon[35807]: pgmap v1147: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:43:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:49 smithi076 ceph-mon[35401]: pgmap v1147: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:43:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:51 smithi040 ceph-mon[32397]: pgmap v1148: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-07-26T12:43:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:51 smithi146 ceph-mon[35807]: pgmap v1148: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-07-26T12:43:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:51 smithi076 ceph-mon[35401]: pgmap v1148: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-07-26T12:43:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:53 smithi040 ceph-mon[32397]: pgmap v1149: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.8 MiB/s wr, 10 op/s 2024-07-26T12:43:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:53 smithi146 ceph-mon[35807]: pgmap v1149: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.8 MiB/s wr, 10 op/s 2024-07-26T12:43:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:53 smithi076 ceph-mon[35401]: pgmap v1149: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.8 MiB/s wr, 10 op/s 2024-07-26T12:43:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:55 smithi040 ceph-mon[32397]: pgmap v1150: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-07-26T12:43:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:55 smithi146 ceph-mon[35807]: pgmap v1150: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-07-26T12:43:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:55 smithi076 ceph-mon[35401]: pgmap v1150: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 MiB/s wr, 14 op/s 2024-07-26T12:43:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:57 smithi146 ceph-mon[35807]: pgmap v1151: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:43:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:57 smithi076 ceph-mon[35401]: pgmap v1151: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:43:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:57 smithi040 ceph-mon[32397]: pgmap v1151: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:44:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:43:59 smithi146 ceph-mon[35807]: pgmap v1152: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:44:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:43:59 smithi076 ceph-mon[35401]: pgmap v1152: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:44:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:43:59 smithi040 ceph-mon[32397]: pgmap v1152: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:44:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:01 smithi146 ceph-mon[35807]: pgmap v1153: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:44:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:01 smithi076 ceph-mon[35401]: pgmap v1153: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:44:02.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:01 smithi040 ceph-mon[32397]: pgmap v1153: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:44:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:03 smithi146 ceph-mon[35807]: pgmap v1154: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:03 smithi076 ceph-mon[35401]: pgmap v1154: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:03 smithi040 ceph-mon[32397]: pgmap v1154: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:06.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:05 smithi040 ceph-mon[32397]: pgmap v1155: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:44:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:05 smithi146 ceph-mon[35807]: pgmap v1155: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:44:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:05 smithi076 ceph-mon[35401]: pgmap v1155: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:44:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:07 smithi146 ceph-mon[35807]: pgmap v1156: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:07 smithi076 ceph-mon[35401]: pgmap v1156: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:07 smithi040 ceph-mon[32397]: pgmap v1156: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:09 smithi146 ceph-mon[35807]: pgmap v1157: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:44:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:09 smithi076 ceph-mon[35401]: pgmap v1157: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:44:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:09 smithi040 ceph-mon[32397]: pgmap v1157: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:44:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:11 smithi146 ceph-mon[35807]: pgmap v1158: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:44:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:11 smithi076 ceph-mon[35401]: pgmap v1158: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:44:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:11 smithi040 ceph-mon[32397]: pgmap v1158: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:44:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:13 smithi146 ceph-mon[35807]: pgmap v1159: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:44:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:13 smithi076 ceph-mon[35401]: pgmap v1159: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:44:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:13 smithi040 ceph-mon[32397]: pgmap v1159: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:44:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:15 smithi146 ceph-mon[35807]: pgmap v1160: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:44:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:15 smithi076 ceph-mon[35401]: pgmap v1160: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:44:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:15 smithi040 ceph-mon[32397]: pgmap v1160: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-07-26T12:44:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:17 smithi146 ceph-mon[35807]: pgmap v1161: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:44:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:17 smithi076 ceph-mon[35401]: pgmap v1161: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:44:18.206 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:17 smithi040 ceph-mon[32397]: pgmap v1161: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:44:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:19 smithi146 ceph-mon[35807]: pgmap v1162: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:19 smithi076 ceph-mon[35401]: pgmap v1162: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:19 smithi040 ceph-mon[32397]: pgmap v1162: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:22.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:21 smithi146 ceph-mon[35807]: pgmap v1163: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:44:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:21 smithi076 ceph-mon[35401]: pgmap v1163: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:44:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:21 smithi040 ceph-mon[32397]: pgmap v1163: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:44:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:23 smithi076 ceph-mon[35401]: pgmap v1164: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:23 smithi040 ceph-mon[32397]: pgmap v1164: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:24.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:23 smithi146 ceph-mon[35807]: pgmap v1164: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:44:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:25 smithi076 ceph-mon[35401]: pgmap v1165: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:44:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:25 smithi040 ceph-mon[32397]: pgmap v1165: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:44:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:25 smithi146 ceph-mon[35807]: pgmap v1165: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:44:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:27 smithi040 ceph-mon[32397]: pgmap v1166: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:44:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:27 smithi146 ceph-mon[35807]: pgmap v1166: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:44:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:27 smithi076 ceph-mon[35401]: pgmap v1166: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T12:44:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:29 smithi040 ceph-mon[32397]: pgmap v1167: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:29 smithi146 ceph-mon[35807]: pgmap v1167: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:29 smithi076 ceph-mon[35401]: pgmap v1167: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:44:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:44:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:44:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:31 smithi040 ceph-mon[32397]: pgmap v1168: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:44:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:44:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:44:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:44:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:31 smithi146 ceph-mon[35807]: pgmap v1168: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:44:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:44:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:44:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:44:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:31 smithi076 ceph-mon[35401]: pgmap v1168: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:44:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:44:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:44:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:44:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:33 smithi040 ceph-mon[32397]: pgmap v1169: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:44:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:33 smithi146 ceph-mon[35807]: pgmap v1169: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:44:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:33 smithi076 ceph-mon[35401]: pgmap v1169: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:44:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:35 smithi040 ceph-mon[32397]: pgmap v1170: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:44:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:35 smithi146 ceph-mon[35807]: pgmap v1170: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:44:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:35 smithi076 ceph-mon[35401]: pgmap v1170: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:44:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:37 smithi040 ceph-mon[32397]: pgmap v1171: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:44:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:37 smithi146 ceph-mon[35807]: pgmap v1171: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:44:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:37 smithi076 ceph-mon[35401]: pgmap v1171: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:44:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:39 smithi040 ceph-mon[32397]: pgmap v1172: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:44:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:39 smithi146 ceph-mon[35807]: pgmap v1172: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:44:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:39 smithi076 ceph-mon[35401]: pgmap v1172: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:44:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:41 smithi040 ceph-mon[32397]: pgmap v1173: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:44:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:41 smithi146 ceph-mon[35807]: pgmap v1173: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:44:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:41 smithi076 ceph-mon[35401]: pgmap v1173: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:44:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:43 smithi040 ceph-mon[32397]: pgmap v1174: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:44:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:43 smithi146 ceph-mon[35807]: pgmap v1174: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:44:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:43 smithi076 ceph-mon[35401]: pgmap v1174: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:44:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:45 smithi040 ceph-mon[32397]: pgmap v1175: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:45 smithi146 ceph-mon[35807]: pgmap v1175: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:45 smithi076 ceph-mon[35401]: pgmap v1175: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:44:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:47 smithi040 ceph-mon[32397]: pgmap v1176: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:44:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:47 smithi146 ceph-mon[35807]: pgmap v1176: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:44:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:47 smithi076 ceph-mon[35401]: pgmap v1176: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:44:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:48 smithi040 ceph-mon[32397]: pgmap v1177: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:44:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:48 smithi146 ceph-mon[35807]: pgmap v1177: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:44:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:48 smithi076 ceph-mon[35401]: pgmap v1177: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:44:51.107 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.5 2024-07-26T12:44:51.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:44:51.632 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:44:52.017 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:51 smithi040 ceph-mon[32397]: pgmap v1178: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:44:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:51 smithi146 ceph-mon[35807]: pgmap v1178: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:44:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:51 smithi076 ceph-mon[35401]: pgmap v1178: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:44:53.789 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:53 smithi040 ceph-mon[32397]: pgmap v1179: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:44:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:53 smithi146 ceph-mon[35807]: pgmap v1179: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:44:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:53 smithi076 ceph-mon[35401]: pgmap v1179: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.125+0000 7f7071c00640 1 -- 172.21.15.40:0/3919950846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 msgr2=0x7f706c10b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.125+0000 7f7071c00640 1 --2- 172.21.15.40:0/3919950846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c10b530 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7058009900 tx=0x7f705802a410 comp rx=0 tx=0).stop 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 -- 172.21.15.40:0/3919950846 shutdown_connections 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 --2- 172.21.15.40:0/3919950846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f706c10ba70 0x7f706c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 --2- 172.21.15.40:0/3919950846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c10b530 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 --2- 172.21.15.40:0/3919950846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c1057e0 0x7f706c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 -- 172.21.15.40:0/3919950846 >> 172.21.15.40:0/3919950846 conn(0x7f706c1011f0 msgr2=0x7f706c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 -- 172.21.15.40:0/3919950846 shutdown_connections 2024-07-26T12:44:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.126+0000 7f7071c00640 1 -- 172.21.15.40:0/3919950846 wait complete. 2024-07-26T12:44:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.127+0000 7f7071c00640 1 Processor -- start 2024-07-26T12:44:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.127+0000 7f7071c00640 1 -- start start 2024-07-26T12:44:54.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f7071c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f706c1057e0 0x7f706c19c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f7071c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f7071c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c10ba70 0x7f706c1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f7071c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f706c115600 con 0x7f706c10b120 2024-07-26T12:44:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f7071c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f706c115480 con 0x7f706c1057e0 2024-07-26T12:44:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f7071c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f706c115780 con 0x7f706c10ba70 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f706a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f706a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53600/0 (socket says 172.21.15.40:53600) 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f706a000640 1 -- 172.21.15.40:0/4060543526 learned_addr learned my addr 172.21.15.40:0/4060543526 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f706aa00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f706c1057e0 0x7f706c19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.128+0000 7f706b400640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c10ba70 0x7f706c1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706a000640 1 -- 172.21.15.40:0/4060543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c10ba70 msgr2=0x7f706c1a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706a000640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c10ba70 0x7f706c1a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706a000640 1 -- 172.21.15.40:0/4060543526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f706c1057e0 msgr2=0x7f706c19c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706a000640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f706c1057e0 0x7f706c19c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706a000640 1 -- 172.21.15.40:0/4060543526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c1a1fc0 con 0x7f706c10b120 2024-07-26T12:44:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706b400640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c10ba70 0x7f706c1a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:44:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.129+0000 7f706a000640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c19c5f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f705802a930 tx=0x7f7058003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.130+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705803f070 con 0x7f706c10b120 2024-07-26T12:44:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.130+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7058003e10 con 0x7f706c10b120 2024-07-26T12:44:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.130+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058035030 con 0x7f706c10b120 2024-07-26T12:44:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.130+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c1a2250 con 0x7f706c10b120 2024-07-26T12:44:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.130+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c1a8a10 con 0x7f706c10b120 2024-07-26T12:44:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.132+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c105bf0 con 0x7f706c10b120 2024-07-26T12:44:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.136+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7058042070 con 0x7f706c10b120 2024-07-26T12:44:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.138+0000 7f7063400640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70500b3c50 0x7f70500b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.138+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7058104750 con 0x7f706c10b120 2024-07-26T12:44:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.138+0000 7f706aa00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70500b3c50 0x7f70500b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.139+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f70580cbd60 con 0x7f706c10b120 2024-07-26T12:44:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.139+0000 7f706aa00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70500b3c50 0x7f70500b6160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f705c005fd0 tx=0x7f705c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:54.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.394+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f706c1a8c10 con 0x7f706c10b120 2024-07-26T12:44:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.395+0000 7f7063400640 1 -- 172.21.15.40:0/4060543526 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f70580cb660 con 0x7f706c10b120 2024-07-26T12:44:54.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:44:54.398 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:44:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:44:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.398+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70500b3c50 msgr2=0x7f70500b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.398+0000 7f7071c00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70500b3c50 0x7f70500b6160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f705c005fd0 tx=0x7f705c00b390 comp rx=0 tx=0).stop 2024-07-26T12:44:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.398+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 msgr2=0x7f706c19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.398+0000 7f7071c00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c19c5f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f705802a930 tx=0x7f7058003c20 comp rx=0 tx=0).stop 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 shutdown_connections 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70500b3c50 0x7f70500b6160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c10ba70 0x7f706c1a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f706c10b120 0x7f706c19c5f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 --2- 172.21.15.40:0/4060543526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f706c1057e0 0x7f706c19c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 >> 172.21.15.40:0/4060543526 conn(0x7f706c1011f0 msgr2=0x7f706c107870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 shutdown_connections 2024-07-26T12:44:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:54.399+0000 7f7071c00640 1 -- 172.21.15.40:0/4060543526 wait complete. 2024-07-26T12:44:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:54 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4060543526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:44:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:54 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4060543526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:44:55.126 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:54 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4060543526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:44:55.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 153.5 --await-for 45.0' 2024-07-26T12:44:55.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 153.5 --await-for 45.0 2024-07-26T12:44:55.720 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:44:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:55 smithi146 ceph-mon[35807]: pgmap v1180: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:44:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:55 smithi076 ceph-mon[35401]: pgmap v1180: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:44:56.102 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:55 smithi040 ceph-mon[32397]: pgmap v1180: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:44:57.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:57 smithi040 ceph-mon[32397]: pgmap v1181: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:44:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:57 smithi146 ceph-mon[35807]: pgmap v1181: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:44:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:57 smithi076 ceph-mon[35401]: pgmap v1181: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:44:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.255+0000 7f4511000640 1 -- 172.21.15.40:0/3284721428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c108d30 msgr2=0x7f450c109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.255+0000 7f4511000640 1 --2- 172.21.15.40:0/3284721428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c108d30 0x7f450c109140 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009900 tx=0x7f44f802a410 comp rx=0 tx=0).stop 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 -- 172.21.15.40:0/3284721428 shutdown_connections 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 --2- 172.21.15.40:0/3284721428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c109680 0x7f450c10feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 --2- 172.21.15.40:0/3284721428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c108d30 0x7f450c109140 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 --2- 172.21.15.40:0/3284721428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c1033f0 0x7f450c103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 -- 172.21.15.40:0/3284721428 >> 172.21.15.40:0/3284721428 conn(0x7f450c0fee60 msgr2=0x7f450c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 -- 172.21.15.40:0/3284721428 shutdown_connections 2024-07-26T12:44:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.256+0000 7f4511000640 1 -- 172.21.15.40:0/3284721428 wait complete. 2024-07-26T12:44:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.257+0000 7f4511000640 1 Processor -- start 2024-07-26T12:44:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.257+0000 7f4511000640 1 -- start start 2024-07-26T12:44:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f4511000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c1033f0 0x7f450c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f4511000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c108d30 0x7f450c19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f4511000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 0x7f450c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f4511000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f450c113210 con 0x7f450c109680 2024-07-26T12:44:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f4511000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f450c113090 con 0x7f450c108d30 2024-07-26T12:44:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f4511000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f450c113390 con 0x7f450c1033f0 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.258+0000 7f450be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 0x7f450c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 0x7f450c1a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53610/0 (socket says 172.21.15.40:53610) 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 -- 172.21.15.40:0/1937993080 learned_addr learned my addr 172.21.15.40:0/1937993080 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450b400640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c1033f0 0x7f450c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450aa00640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c108d30 0x7f450c19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 -- 172.21.15.40:0/1937993080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c1033f0 msgr2=0x7f450c19bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c1033f0 0x7f450c19bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 -- 172.21.15.40:0/1937993080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c108d30 msgr2=0x7f450c19c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c108d30 0x7f450c19c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450be00640 1 -- 172.21.15.40:0/1937993080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c1a1e10 con 0x7f450c109680 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.259+0000 7f450aa00640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c108d30 0x7f450c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.260+0000 7f450be00640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 0x7f450c1a16e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f450400eaa0 tx=0x7f450400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.260+0000 7f4503e00640 1 -- 172.21.15.40:0/1937993080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450400cdb0 con 0x7f450c109680 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.260+0000 7f4503e00640 1 -- 172.21.15.40:0/1937993080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4504005020 con 0x7f450c109680 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.260+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c1a2100 con 0x7f450c109680 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.260+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c1a8860 con 0x7f450c109680 2024-07-26T12:44:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.260+0000 7f4503e00640 1 -- 172.21.15.40:0/1937993080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45040116d0 con 0x7f450c109680 2024-07-26T12:44:58.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.264+0000 7f451928c740 1 Processor -- start 2024-07-26T12:44:58.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.265+0000 7f4503e00640 1 -- 172.21.15.40:0/1937993080 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4504004a40 con 0x7f450c109680 2024-07-26T12:44:58.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.265+0000 7f451928c740 1 -- start start 2024-07-26T12:44:58.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.266+0000 7f451928c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c3c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.266+0000 7f451928c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c3c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.266+0000 7f451928c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 0x562b36c3ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.266+0000 7f451928c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562b36c06d10 con 0x562b36875b60 2024-07-26T12:44:58.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.266+0000 7f451928c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b36bb1b60 con 0x562b36896840 2024-07-26T12:44:58.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.266+0000 7f451928c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b36ba1060 con 0x562b3686d980 2024-07-26T12:44:58.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 0x562b36c3ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 0x562b36c3ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53622/0 (socket says 172.21.15.40:53622) 2024-07-26T12:44:58.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c3c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 -- 172.21.15.40:0/2689623007 learned_addr learned my addr 172.21.15.40:0/2689623007 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:44:58.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c3c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 -- 172.21.15.40:0/2689623007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 msgr2=0x562b36c3c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c3c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 -- 172.21.15.40:0/2689623007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 msgr2=0x562b36c3c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c3c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.267+0000 7f450aa00640 1 -- 172.21.15.40:0/2689623007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b36b28b10 con 0x562b36875b60 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.268+0000 7f4503e00640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44f00b3c40 0x7f44f00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.268+0000 7f4503e00640 1 -- 172.21.15.40:0/1937993080 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f45040e3f40 con 0x7f450c109680 2024-07-26T12:44:58.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.268+0000 7f450aa00640 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 0x562b36c3ce30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f44f80096c0 tx=0x7f44f8009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3ca84ec9aa25f6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:58.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.268+0000 7f450b400640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44f00b3c40 0x7f44f00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.268+0000 7f4500c00640 1 -- 172.21.15.40:0/2689623007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8035040 con 0x562b36875b60 2024-07-26T12:44:58.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.268+0000 7f4500c00640 1 -- 172.21.15.40:0/2689623007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f80038c0 con 0x562b36875b60 2024-07-26T12:44:58.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.269+0000 7f4500c00640 1 -- 172.21.15.40:0/2689623007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8004920 con 0x562b36875b60 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 -- 172.21.15.40:0/2689623007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 msgr2=0x562b36c3ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f450b400640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44f00b3c40 0x7f44f00b6150 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x562b36c3b030 tx=0x7f44fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 0x562b36c3ce30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f44f80096c0 tx=0x7f44f8009560 comp rx=0 tx=0).stop 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 -- 172.21.15.40:0/2689623007 shutdown_connections 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36875b60 0x562b36c3ce30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c3c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 --2- 172.21.15.40:0/2689623007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c3c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 -- 172.21.15.40:0/2689623007 >> 172.21.15.40:0/2689623007 conn(0x562b3688a990 msgr2=0x562b36c3a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:58.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 -- 172.21.15.40:0/2689623007 shutdown_connections 2024-07-26T12:44:58.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.270+0000 7f451928c740 1 -- 172.21.15.40:0/2689623007 wait complete. 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.271+0000 7f451928c740 1 -- start start 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.271+0000 7f451928c740 1 Processor -- start 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c47f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36875b60 0x562b36c48440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562b36b3d520 con 0x562b36896840 2024-07-26T12:44:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b36ba50a0 con 0x562b36875b60 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b36a047a0 con 0x562b3686d980 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f451928c740 10 client.0 _ll_register_callbacks cb 0x562b36b99bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f450be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f450be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53624/0 (socket says 172.21.15.40:53624) 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f450be00640 1 -- 172.21.15.40:0/593131688 learned_addr learned my addr 172.21.15.40:0/593131688 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f450b400640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.272+0000 7f450aa00640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36875b60 0x562b36c48440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.273+0000 7f450be00640 1 -- 172.21.15.40:0/593131688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 msgr2=0x562b36c47f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.273+0000 7f450be00640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c47f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.273+0000 7f450be00640 1 -- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36875b60 msgr2=0x562b36c48440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.273+0000 7f450be00640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36875b60 0x562b36c48440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.273+0000 7f450be00640 1 -- 172.21.15.40:0/593131688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b36910b90 con 0x562b36896840 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f450be00640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53d30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f45040a80c0 tx=0x7f45040ab5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbb5dd2e52e8347 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f44f5600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f44f5600640 1 -- 172.21.15.40:0/593131688 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450401f040 con 0x562b36896840 2024-07-26T12:44:58.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f44f5600640 1 -- 172.21.15.40:0/593131688 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f45040b3a70 con 0x562b36896840 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f80038c0 con 0x562b36896840 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f44f5600640 1 -- 172.21.15.40:0/593131688 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f45040b3f00 con 0x562b36896840 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f451928c740 10 client.16293 fetch_fsmap learned FSMap version 35 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.274+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562b36c569e0 con 0x562b36896840 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f44f5600640 1 -- 172.21.15.40:0/593131688 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f80038c0 con 0x562b36896840 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f44f5600640 1 -- 172.21.15.40:0/593131688 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f450400f040 con 0x562b36896840 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f451928c740 10 client.16293 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f451928c740 10 client.16293 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f451928c740 20 client.16293 populate_metadata read hostname 'smithi040' 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f451928c740 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b368551c0 0x562b36c59ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f451928c740 4 client.16293 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:44:58.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.275+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b36bb3ab0 con 0x562b368551c0 2024-07-26T12:44:58.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.276+0000 7f450b400640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b368551c0 0x562b36c59ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.277+0000 7f450b400640 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b368551c0 0x562b36c59ed0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ba0f5d4fa53be9f server_cookie=f120b6c77100b5a4 in_seq=0 out_seq=0 2024-07-26T12:44:58.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.277+0000 7f44f5600640 10 client.16293 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f44f5600640 1 -- 172.21.15.40:0/593131688 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b36bb3ab0 con 0x562b368551c0 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f44f5600640 10 client.16293 handle_command_reply: tid=0 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 client.16293 shutdown 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 msgr2=0x562b36c53d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53d30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f45040a80c0 tx=0x7f45040ab5d0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 shutdown_connections 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b368551c0 0x562b36c59ed0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53d30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.279+0000 7f451928c740 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36875b60 0x562b36c48440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.280+0000 7f451928c740 1 --2- 172.21.15.40:0/593131688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b3686d980 0x562b36c47f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.280+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 >> 172.21.15.40:0/593131688 conn(0x562b3688a990 msgr2=0x562b36c3f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.280+0000 7f44f5600640 0 client.16293 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.280+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 shutdown_connections 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.280+0000 7f451928c740 1 -- 172.21.15.40:0/593131688 wait complete. 2024-07-26T12:44:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.280+0000 7f451928c740 20 client.16293 trim_cache size 0 max 16384 2024-07-26T12:44:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.301+0000 7f451928c740 1 Processor -- start 2024-07-26T12:44:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 -- start start 2024-07-26T12:44:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3686d980 0x562b36c424d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c49220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec00e480 con 0x562b36896840 2024-07-26T12:44:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec00ffc0 con 0x562b3686d980 2024-07-26T12:44:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.302+0000 7f451928c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec00eb50 con 0x562b36875b60 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53634/0 (socket says 172.21.15.40:53634) 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 -- 172.21.15.40:0/1512071758 learned_addr learned my addr 172.21.15.40:0/1512071758 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450b400640 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3686d980 0x562b36c424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450aa00640 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c49220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 -- 172.21.15.40:0/1512071758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 msgr2=0x562b36c49220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c49220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 -- 172.21.15.40:0/1512071758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3686d980 msgr2=0x562b36c424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3686d980 0x562b36c424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.303+0000 7f450be00640 1 -- 172.21.15.40:0/1512071758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b36c42a10 con 0x562b36896840 2024-07-26T12:44:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.304+0000 7f450be00640 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53b20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f45040aab50 tx=0x7f4504004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fe31823cd1d35f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.304+0000 7f44f7e00640 1 -- 172.21.15.40:0/1512071758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450401f040 con 0x562b36896840 2024-07-26T12:44:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.304+0000 7f44f7e00640 1 -- 172.21.15.40:0/1512071758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45040ad030 con 0x562b36896840 2024-07-26T12:44:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.304+0000 7f44f7e00640 1 -- 172.21.15.40:0/1512071758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45040b3a70 con 0x562b36896840 2024-07-26T12:44:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 -- 172.21.15.40:0/1512071758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 msgr2=0x562b36c53b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53b20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f45040aab50 tx=0x7f4504004f40 comp rx=0 tx=0).stop 2024-07-26T12:44:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 -- 172.21.15.40:0/1512071758 shutdown_connections 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b36896840 0x562b36c53b20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c49220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 --2- 172.21.15.40:0/1512071758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3686d980 0x562b36c424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 -- 172.21.15.40:0/1512071758 >> 172.21.15.40:0/1512071758 conn(0x562b3688a990 msgr2=0x562b36c3dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 -- 172.21.15.40:0/1512071758 shutdown_connections 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.305+0000 7f451928c740 1 -- 172.21.15.40:0/1512071758 wait complete. 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.306+0000 7f451928c740 1 -- start start 2024-07-26T12:44:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.306+0000 7f451928c740 1 Processor -- start 2024-07-26T12:44:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 0x562b36c502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c4b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c4bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec00f8f0 con 0x562b3686d980 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec00f220 con 0x562b36896840 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec00c440 con 0x562b36875b60 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f451928c740 10 client.0 _ll_register_callbacks cb 0x7f45040a6db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f450b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 0x562b36c502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f450b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 0x562b36c502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53638/0 (socket says 172.21.15.40:53638) 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f450b400640 1 -- 172.21.15.40:0/755846341 learned_addr learned my addr 172.21.15.40:0/755846341 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.307+0000 7f450aa00640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c4b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450b400640 1 -- 172.21.15.40:0/755846341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 msgr2=0x562b36c4b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450b400640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c4b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450be00640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c4bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450b400640 1 -- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 msgr2=0x562b36c4bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:44:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450b400640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c4bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450b400640 1 -- 172.21.15.40:0/755846341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b36c4c390 con 0x562b3686d980 2024-07-26T12:44:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450be00640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c4bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f450b400640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 0x562b36c502b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0043f0 tx=0x7f44fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc64a6d8b67cb849 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.308+0000 7f44f5600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.309+0000 7f44f5600640 1 -- 172.21.15.40:0/755846341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc02f070 con 0x562b3686d980 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.309+0000 7f44f5600640 1 -- 172.21.15.40:0/755846341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f44fc01eb90 con 0x562b3686d980 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.309+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45040ad030 con 0x562b3686d980 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.309+0000 7f44f5600640 1 -- 172.21.15.40:0/755846341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f44fc03b050 con 0x562b3686d980 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.309+0000 7f451928c740 10 client.16299 fetch_fsmap learned FSMap version 35 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.309+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562b36cc25a0 con 0x562b3686d980 2024-07-26T12:44:58.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f44f5600640 1 -- 172.21.15.40:0/755846341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45040ad030 con 0x562b3686d980 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f44f5600640 1 -- 172.21.15.40:0/755846341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f44fc01d410 con 0x562b3686d980 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f451928c740 10 client.16299 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f451928c740 10 client.16299 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f451928c740 20 client.16299 populate_metadata read hostname 'smithi040' 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f451928c740 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b3682a570 0x562b36cc4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f451928c740 4 client.16299 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.5, "await_for": 45.0}] 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.310+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.5, "await_for": 45.0}) -- 0x562b36baf550 con 0x562b3682a570 2024-07-26T12:44:58.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.311+0000 7f450aa00640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b3682a570 0x562b36cc4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:44:58.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.312+0000 7f450aa00640 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b3682a570 0x562b36cc4de0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f145822a4fd2db7 server_cookie=e24a3b3b65c80a4e in_seq=0 out_seq=0 2024-07-26T12:44:58.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.312+0000 7f44f5600640 10 client.16299 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:44:58.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.552+0000 7f44f5600640 1 -- 172.21.15.40:0/755846341 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562b36baf550 con 0x562b3682a570 2024-07-26T12:44:58.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.552+0000 7f44f5600640 10 client.16299 handle_command_reply: tid=0 2024-07-26T12:44:58.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.552+0000 7f451928c740 1 client.16299 shutdown 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 msgr2=0x562b36c502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 0x562b36c502b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0043f0 tx=0x7f44fc0046c0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 shutdown_connections 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b36896840 0x562b36c4bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b36875b60 0x562b36c4b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b3682a570 0x562b36cc4de0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 --2- 172.21.15.40:0/755846341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b3686d980 0x562b36c502b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 >> 172.21.15.40:0/755846341 conn(0x562b3688a990 msgr2=0x562b36c3dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.553+0000 7f44f5600640 0 client.16299 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.554+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 shutdown_connections 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.554+0000 7f451928c740 1 -- 172.21.15.40:0/755846341 wait complete. 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.554+0000 7f451928c740 20 client.16299 trim_cache size 0 max 16384 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 70, 2024-07-26T12:44:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "3647e802": { 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 70, 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 153.5, 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:44:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:44:58.559 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44f00b3c40 msgr2=0x7f44f00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44f00b3c40 0x7f44f00b6150 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x562b36c3b030 tx=0x7f44fc00b390 comp rx=0 tx=0).stop 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 msgr2=0x7f450c1a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 0x7f450c1a16e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f450400eaa0 tx=0x7f450400ef60 comp rx=0 tx=0).stop 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 shutdown_connections 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f450c109680 0x7f450c1a16e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f450c108d30 0x7f450c19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f44f00b3c40 0x7f44f00b6150 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 --2- 172.21.15.40:0/1937993080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f450c1033f0 0x7f450c19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:44:58.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.556+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 >> 172.21.15.40:0/1937993080 conn(0x7f450c0fee60 msgr2=0x7f450c108420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:44:58.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.557+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 shutdown_connections 2024-07-26T12:44:58.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:44:58.557+0000 7f4511000640 1 -- 172.21.15.40:0/1937993080 wait complete. 2024-07-26T12:44:59.454 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3647e802', quiesce took 8.3 seconds. Will release after: 25.2 2024-07-26T12:45:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:44:59 smithi146 ceph-mon[35807]: pgmap v1182: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 14 op/s 2024-07-26T12:45:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:44:59 smithi076 ceph-mon[35401]: pgmap v1182: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 14 op/s 2024-07-26T12:45:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:44:59 smithi040 ceph-mon[32397]: pgmap v1182: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 14 op/s 2024-07-26T12:45:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:01 smithi146 ceph-mon[35807]: pgmap v1183: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:45:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:01 smithi076 ceph-mon[35401]: pgmap v1183: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:45:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:01 smithi040 ceph-mon[32397]: pgmap v1183: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:45:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:03 smithi146 ceph-mon[35807]: pgmap v1184: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:45:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:03 smithi076 ceph-mon[35401]: pgmap v1184: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:45:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:03 smithi040 ceph-mon[32397]: pgmap v1184: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:45:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:05 smithi040 ceph-mon[32397]: pgmap v1185: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:45:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:05 smithi146 ceph-mon[35807]: pgmap v1185: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:45:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:05 smithi076 ceph-mon[35401]: pgmap v1185: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:45:08.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:07 smithi146 ceph-mon[35807]: pgmap v1186: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:45:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:07 smithi076 ceph-mon[35401]: pgmap v1186: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:45:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:07 smithi040 ceph-mon[32397]: pgmap v1186: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:45:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:09 smithi146 ceph-mon[35807]: pgmap v1187: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:45:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:09 smithi076 ceph-mon[35401]: pgmap v1187: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:45:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:09 smithi040 ceph-mon[32397]: pgmap v1187: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:45:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:11 smithi076 ceph-mon[35401]: pgmap v1188: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-07-26T12:45:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:11 smithi040 ceph-mon[32397]: pgmap v1188: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-07-26T12:45:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:11 smithi146 ceph-mon[35807]: pgmap v1188: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-07-26T12:45:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:13 smithi076 ceph-mon[35401]: pgmap v1189: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 704 KiB/s wr, 10 op/s 2024-07-26T12:45:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:13 smithi040 ceph-mon[32397]: pgmap v1189: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 704 KiB/s wr, 10 op/s 2024-07-26T12:45:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:13 smithi146 ceph-mon[35807]: pgmap v1189: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 704 KiB/s wr, 10 op/s 2024-07-26T12:45:16.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:15 smithi146 ceph-mon[35807]: pgmap v1190: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 704 KiB/s wr, 12 op/s 2024-07-26T12:45:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:15 smithi040 ceph-mon[32397]: pgmap v1190: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 704 KiB/s wr, 12 op/s 2024-07-26T12:45:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:15 smithi076 ceph-mon[35401]: pgmap v1190: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 704 KiB/s wr, 12 op/s 2024-07-26T12:45:18.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:17 smithi076 ceph-mon[35401]: pgmap v1191: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 362 KiB/s wr, 8 op/s 2024-07-26T12:45:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:17 smithi040 ceph-mon[32397]: pgmap v1191: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 362 KiB/s wr, 8 op/s 2024-07-26T12:45:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:17 smithi146 ceph-mon[35807]: pgmap v1191: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 362 KiB/s wr, 8 op/s 2024-07-26T12:45:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:19 smithi040 ceph-mon[32397]: pgmap v1192: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:45:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:19 smithi146 ceph-mon[35807]: pgmap v1192: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:45:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:19 smithi076 ceph-mon[35401]: pgmap v1192: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:45:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:21 smithi040 ceph-mon[32397]: pgmap v1193: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:45:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:21 smithi146 ceph-mon[35807]: pgmap v1193: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:45:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:21 smithi076 ceph-mon[35401]: pgmap v1193: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:45:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:23 smithi040 ceph-mon[32397]: pgmap v1194: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:45:24.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:23 smithi146 ceph-mon[35807]: pgmap v1194: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:45:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:23 smithi076 ceph-mon[35401]: pgmap v1194: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:45:24.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:45:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:45:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:25 smithi040 ceph-mon[32397]: pgmap v1195: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:45:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:25 smithi146 ceph-mon[35807]: pgmap v1195: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:45:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:25 smithi076 ceph-mon[35401]: pgmap v1195: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-07-26T12:45:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 -- 172.21.15.40:0/1366636086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 msgr2=0x7f1f68110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/1366636086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f68110060 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009ca0 tx=0x7f1f6002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 -- 172.21.15.40:0/1366636086 shutdown_connections 2024-07-26T12:45:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/1366636086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f68110060 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/1366636086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f68108ee0 0x7f1f681092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/1366636086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f681035a0 0x7f1f681039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.497+0000 7f1f6dc00640 1 -- 172.21.15.40:0/1366636086 >> 172.21.15.40:0/1366636086 conn(0x7f1f680ff010 msgr2=0x7f1f68101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.498+0000 7f1f6dc00640 1 -- 172.21.15.40:0/1366636086 shutdown_connections 2024-07-26T12:45:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.498+0000 7f1f6dc00640 1 -- 172.21.15.40:0/1366636086 wait complete. 2024-07-26T12:45:27.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.499+0000 7f1f6dc00640 1 Processor -- start 2024-07-26T12:45:27.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.499+0000 7f1f6dc00640 1 -- start start 2024-07-26T12:45:27.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.499+0000 7f1f6dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f681035a0 0x7f1f6819bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:27.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.499+0000 7f1f6dc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f68108ee0 0x7f1f6819c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:27.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.499+0000 7f1f6dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f681a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f6dc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1f681133e0 con 0x7f1f68109830 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f6dc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68113260 con 0x7f1f68108ee0 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f6dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68113560 con 0x7f1f681035a0 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f67400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f681a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f67400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f681a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36976/0 (socket says 172.21.15.40:36976) 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f67400640 1 -- 172.21.15.40:0/2855689013 learned_addr learned my addr 172.21.15.40:0/2855689013 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f66a00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f681035a0 0x7f1f6819bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.500+0000 7f1f66000640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f68108ee0 0x7f1f6819c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.501+0000 7f1f67400640 1 -- 172.21.15.40:0/2855689013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f681035a0 msgr2=0x7f1f6819bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.501+0000 7f1f67400640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f681035a0 0x7f1f6819bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.501+0000 7f1f67400640 1 -- 172.21.15.40:0/2855689013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f68108ee0 msgr2=0x7f1f6819c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.501+0000 7f1f67400640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f68108ee0 0x7f1f6819c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.501+0000 7f1f67400640 1 -- 172.21.15.40:0/2855689013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f681a1e80 con 0x7f1f68109830 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.501+0000 7f1f67400640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f681a1810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1f60005cc0 tx=0x7f1f60032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.502+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60004040 con 0x7f1f68109830 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.502+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f681a2110 con 0x7f1f68109830 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.502+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f60004670 con 0x7f1f68109830 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.502+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f681a8990 con 0x7f1f68109830 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.502+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60030ca0 con 0x7f1f68109830 2024-07-26T12:45:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.503+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f681039b0 con 0x7f1f68109830 2024-07-26T12:45:27.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.506+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1f600041e0 con 0x7f1f68109830 2024-07-26T12:45:27.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.507+0000 7f1f5f400640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f4c0b3c00 0x7f1f4c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:27.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.508+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f601054e0 con 0x7f1f68109830 2024-07-26T12:45:27.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.508+0000 7f1f66a00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f4c0b3c00 0x7f1f4c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:27.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.509+0000 7f1f66a00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f4c0b3c00 0x7f1f4c0b6110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800abe0 tx=0x7f1f5800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:27.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.514+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1f60082600 con 0x7f1f68109830 2024-07-26T12:45:27.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.755+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f681a8c50 con 0x7f1f68109830 2024-07-26T12:45:27.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.756+0000 7f1f5f400640 1 -- 172.21.15.40:0/2855689013 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f1f600ccaf0 con 0x7f1f68109830 2024-07-26T12:45:27.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:45:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:45:27.758 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:45:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.759+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f4c0b3c00 msgr2=0x7f1f4c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.759+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f4c0b3c00 0x7f1f4c0b6110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800abe0 tx=0x7f1f5800a2d0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.759+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 msgr2=0x7f1f681a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.759+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f681a1810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1f60005cc0 tx=0x7f1f60032c40 comp rx=0 tx=0).stop 2024-07-26T12:45:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.760+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 shutdown_connections 2024-07-26T12:45:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.760+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f68109830 0x7f1f681a1810 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.760+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f68108ee0 0x7f1f6819c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.760+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1f4c0b3c00 0x7f1f4c0b6110 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.760+0000 7f1f6dc00640 1 --2- 172.21.15.40:0/2855689013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f681035a0 0x7f1f6819bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.760+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 >> 172.21.15.40:0/2855689013 conn(0x7f1f680ff010 msgr2=0x7f1f68108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.761+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 shutdown_connections 2024-07-26T12:45:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:27.761+0000 7f1f6dc00640 1 -- 172.21.15.40:0/2855689013 wait complete. 2024-07-26T12:45:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:27 smithi040 ceph-mon[32397]: pgmap v1196: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:45:28.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:27 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2855689013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:45:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:27 smithi146 ceph-mon[35807]: pgmap v1196: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:45:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:27 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2855689013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:45:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:27 smithi076 ceph-mon[35401]: pgmap v1196: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:45:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:27 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2855689013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:45:28.579 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 3647e802 --release --await' 2024-07-26T12:45:28.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 3647e802 --release --await 2024-07-26T12:45:29.035 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:45:30.218 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:29 smithi040 ceph-mon[32397]: pgmap v1197: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:45:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:29 smithi146 ceph-mon[35807]: pgmap v1197: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:45:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:29 smithi076 ceph-mon[35401]: pgmap v1197: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 -- 172.21.15.40:0/2573331049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c102510 msgr2=0x7fc15c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 --2- 172.21.15.40:0/2573331049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c102510 0x7fc15c102920 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009900 tx=0x7fc14c02a410 comp rx=0 tx=0).stop 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 -- 172.21.15.40:0/2573331049 shutdown_connections 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 --2- 172.21.15.40:0/2573331049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc15c108750 0x7fc15c10ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 --2- 172.21.15.40:0/2573331049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc15c107e00 0x7fc15c108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 --2- 172.21.15.40:0/2573331049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c102510 0x7fc15c102920 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 -- 172.21.15.40:0/2573331049 >> 172.21.15.40:0/2573331049 conn(0x7fc15c079190 msgr2=0x7fc15c0795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 -- 172.21.15.40:0/2573331049 shutdown_connections 2024-07-26T12:45:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.109+0000 7fc162400640 1 -- 172.21.15.40:0/2573331049 wait complete. 2024-07-26T12:45:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.111+0000 7fc162400640 1 Processor -- start 2024-07-26T12:45:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.111+0000 7fc162400640 1 -- start start 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc162400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc15c102510 0x7fc15c103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc162400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 0x7fc15c1041f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc162400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc15c108750 0x7fc15c104730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc162400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1122b0 con 0x7fc15c107e00 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc162400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112130 con 0x7fc15c108750 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc162400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112430 con 0x7fc15c102510 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc15aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 0x7fc15c1041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc15aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 0x7fc15c1041f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36990/0 (socket says 172.21.15.40:36990) 2024-07-26T12:45:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc15aa00640 1 -- 172.21.15.40:0/225250819 learned_addr learned my addr 172.21.15.40:0/225250819 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:45:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.112+0000 7fc15b400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc15c102510 0x7fc15c103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15be00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc15c108750 0x7fc15c104730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15aa00640 1 -- 172.21.15.40:0/225250819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc15c102510 msgr2=0x7fc15c103cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15aa00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc15c102510 0x7fc15c103cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15aa00640 1 -- 172.21.15.40:0/225250819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc15c108750 msgr2=0x7fc15c104730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15aa00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc15c108750 0x7fc15c104730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15aa00640 1 -- 172.21.15.40:0/225250819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c1a8110 con 0x7fc15c107e00 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.113+0000 7fc15aa00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 0x7fc15c1041f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc14800c970 tx=0x7fc14800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.114+0000 7fc153e00640 1 -- 172.21.15.40:0/225250819 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148007bb0 con 0x7fc15c107e00 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.114+0000 7fc153e00640 1 -- 172.21.15.40:0/225250819 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc148007d50 con 0x7fc15c107e00 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.114+0000 7fc153e00640 1 -- 172.21.15.40:0/225250819 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148004e10 con 0x7fc15c107e00 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.114+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c1a8400 con 0x7fc15c107e00 2024-07-26T12:45:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.114+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c1a88f0 con 0x7fc15c107e00 2024-07-26T12:45:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 Processor -- start 2024-07-26T12:45:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 -- start start 2024-07-26T12:45:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769eaffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769eb0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aea840 0x562769eb0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562769e26f30 con 0x562769aea840 2024-07-26T12:45:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562769e16430 con 0x562769ae2660 2024-07-26T12:45:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.118+0000 7fc169208740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562769e1a470 con 0x562769b0b520 2024-07-26T12:45:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.119+0000 7fc153e00640 1 -- 172.21.15.40:0/225250819 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc148005000 con 0x7fc15c107e00 2024-07-26T12:45:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.119+0000 7fc15aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aea840 0x562769eb0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.119+0000 7fc15be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769eaffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.119+0000 7fc15b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769eb0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.119+0000 7fc15be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769eaffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:51176/0 (socket says 172.21.15.40:51176) 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.119+0000 7fc15be00640 1 -- 172.21.15.40:0/1093094615 learned_addr learned my addr 172.21.15.40:0/1093094615 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.120+0000 7fc15aa00640 1 -- 172.21.15.40:0/1093094615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 msgr2=0x562769eaffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.120+0000 7fc15aa00640 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769eaffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.120+0000 7fc15aa00640 1 -- 172.21.15.40:0/1093094615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 msgr2=0x562769eb0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.120+0000 7fc15aa00640 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769eb0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.120+0000 7fc15aa00640 1 -- 172.21.15.40:0/1093094615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769b76b00 con 0x562769aea840 2024-07-26T12:45:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.120+0000 7fc15aa00640 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aea840 0x562769eb0a40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc1480e1790 tx=0x7fc1480e7ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbbd3a455990d43 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.121+0000 7fc150c00640 1 -- 172.21.15.40:0/1093094615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1480f6470 con 0x562769aea840 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.121+0000 7fc150c00640 1 -- 172.21.15.40:0/1093094615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1480f1070 con 0x562769aea840 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.121+0000 7fc150c00640 1 -- 172.21.15.40:0/1093094615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1480ea7f0 con 0x562769aea840 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.121+0000 7fc153e00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc1400b3bd0 0x7fc1400b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.121+0000 7fc153e00640 1 -- 172.21.15.40:0/225250819 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc1480e3d30 con 0x7fc15c107e00 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.121+0000 7fc15be00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc1400b3bd0 0x7fc1400b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 -- 172.21.15.40:0/1093094615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aea840 msgr2=0x562769eb0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aea840 0x562769eb0a40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc1480e1790 tx=0x7fc1480e7ef0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 -- 172.21.15.40:0/1093094615 shutdown_connections 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aea840 0x562769eb0a40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769eb0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 --2- 172.21.15.40:0/1093094615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769eaffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 -- 172.21.15.40:0/1093094615 >> 172.21.15.40:0/1093094615 conn(0x562769aff910 msgr2=0x562769eadeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc15be00640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc1400b3bd0 0x7fc1400b60e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc154005c40 tx=0x7fc154009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 -- 172.21.15.40:0/1093094615 shutdown_connections 2024-07-26T12:45:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.122+0000 7fc169208740 1 -- 172.21.15.40:0/1093094615 wait complete. 2024-07-26T12:45:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.123+0000 7fc169208740 1 -- start start 2024-07-26T12:45:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.123+0000 7fc169208740 1 Processor -- start 2024-07-26T12:45:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ebb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ebbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769ec7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562769c79bb0 con 0x562769ae2660 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562769db2910 con 0x562769aea840 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562769ebe7a0 con 0x562769b0b520 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc169208740 10 client.0 _ll_register_callbacks cb 0x562769b22d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc15b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ebb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc15b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ebb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37000/0 (socket says 172.21.15.40:37000) 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.124+0000 7fc15b400640 1 -- 172.21.15.40:0/2005452542 learned_addr learned my addr 172.21.15.40:0/2005452542 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15aa00640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ebbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15be00640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769ec7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15b400640 1 -- 172.21.15.40:0/2005452542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 msgr2=0x562769ec7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15b400640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769ec7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15b400640 1 -- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 msgr2=0x562769ebbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15b400640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ebbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15b400640 1 -- 172.21.15.40:0/2005452542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562769bed960 con 0x562769ae2660 2024-07-26T12:45:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15be00640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769ec7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:45:31.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc15b400640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ebb6d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009900 tx=0x7fc14c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc81389ddd7a0de server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:31.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc145600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:45:31.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.125+0000 7fc145600640 1 -- 172.21.15.40:0/2005452542 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c035040 con 0x562769ae2660 2024-07-26T12:45:31.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.126+0000 7fc145600640 1 -- 172.21.15.40:0/2005452542 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc14c003960 con 0x562769ae2660 2024-07-26T12:45:31.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.126+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1480f1070 con 0x562769ae2660 2024-07-26T12:45:31.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.126+0000 7fc145600640 1 -- 172.21.15.40:0/2005452542 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc14c003b60 con 0x562769ae2660 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.126+0000 7fc169208740 10 client.16317 fetch_fsmap learned FSMap version 35 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.126+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562769eca510 con 0x562769ae2660 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.126+0000 7fc145600640 1 -- 172.21.15.40:0/2005452542 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1480f1070 con 0x562769ae2660 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc145600640 1 -- 172.21.15.40:0/2005452542 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc14c03d450 con 0x562769ae2660 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc169208740 10 client.16317 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc169208740 10 client.16317 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc169208740 20 client.16317 populate_metadata read hostname 'smithi040' 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc169208740 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769ac9ea0 0x562769ecda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc169208740 4 client.16317 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562769e28e80 con 0x562769ac9ea0 2024-07-26T12:45:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.127+0000 7fc15aa00640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769ac9ea0 0x562769ecda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.128+0000 7fc15aa00640 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769ac9ea0 0x562769ecda90 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b446984abc592cca server_cookie=26d373d0ed64188a in_seq=0 out_seq=0 2024-07-26T12:45:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.128+0000 7fc145600640 10 client.16317 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:45:31.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.130+0000 7fc145600640 1 -- 172.21.15.40:0/2005452542 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562769e28e80 con 0x562769ac9ea0 2024-07-26T12:45:31.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.130+0000 7fc145600640 10 client.16317 handle_command_reply: tid=0 2024-07-26T12:45:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 client.16317 shutdown 2024-07-26T12:45:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 msgr2=0x562769ebb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ebb6d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009900 tx=0x7fc14c0035f0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 shutdown_connections 2024-07-26T12:45:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769b0b520 0x562769ec7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ebbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769ac9ea0 0x562769ecda90 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 --2- 172.21.15.40:0/2005452542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ebb6d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 >> 172.21.15.40:0/2005452542 conn(0x562769aff910 msgr2=0x562769eb31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc145600640 0 client.16317 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.131+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 shutdown_connections 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.132+0000 7fc169208740 1 -- 172.21.15.40:0/2005452542 wait complete. 2024-07-26T12:45:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.132+0000 7fc169208740 20 client.16317 trim_cache size 0 max 16384 2024-07-26T12:45:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.151+0000 7fc169208740 1 Processor -- start 2024-07-26T12:45:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.151+0000 7fc169208740 1 -- start start 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc169208740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 0x562769eb1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc169208740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769ec7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc169208740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aea840 0x562769ec7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc169208740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1b1010 con 0x562769aff910 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc169208740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1b2b50 con 0x562769ae2660 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc169208740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1b16e0 con 0x562769aea840 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc15b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 0x562769eb1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc15b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 0x562769eb1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37008/0 (socket says 172.21.15.40:37008) 2024-07-26T12:45:31.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.152+0000 7fc15b400640 1 -- 172.21.15.40:0/1360533463 learned_addr learned my addr 172.21.15.40:0/1360533463 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:45:31.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15aa00640 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769ec7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15be00640 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aea840 0x562769ec7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15b400640 1 -- 172.21.15.40:0/1360533463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aea840 msgr2=0x562769ec7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15b400640 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aea840 0x562769ec7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15b400640 1 -- 172.21.15.40:0/1360533463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 msgr2=0x562769ec7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15b400640 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769ec7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15b400640 1 -- 172.21.15.40:0/1360533463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769eb1e40 con 0x562769aff910 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc15b400640 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 0x562769eb1660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc14c02a930 tx=0x7fc14c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3522184dce78493 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc147e00640 1 -- 172.21.15.40:0/1360533463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c035030 con 0x562769aff910 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc147e00640 1 -- 172.21.15.40:0/1360533463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc14c03da90 con 0x562769aff910 2024-07-26T12:45:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.153+0000 7fc147e00640 1 -- 172.21.15.40:0/1360533463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c046960 con 0x562769aff910 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 -- 172.21.15.40:0/1360533463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 msgr2=0x562769eb1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 0x562769eb1660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc14c02a930 tx=0x7fc14c02a410 comp rx=0 tx=0).stop 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 -- 172.21.15.40:0/1360533463 shutdown_connections 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aea840 0x562769ec7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769ae2660 0x562769ec7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 --2- 172.21.15.40:0/1360533463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769aff910 0x562769eb1660 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.154+0000 7fc169208740 1 -- 172.21.15.40:0/1360533463 >> 172.21.15.40:0/1360533463 conn(0x562769eae1b0 msgr2=0x562769ebd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.155+0000 7fc169208740 1 -- 172.21.15.40:0/1360533463 shutdown_connections 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.155+0000 7fc169208740 1 -- 172.21.15.40:0/1360533463 wait complete. 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.155+0000 7fc169208740 1 -- start start 2024-07-26T12:45:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.155+0000 7fc169208740 1 Processor -- start 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ec3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ec4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aff910 0x562769ebea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1b2480 con 0x562769ae2660 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1b1db0 con 0x562769aea840 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1aefd0 con 0x562769aff910 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc169208740 10 client.0 _ll_register_callbacks cb 0x7fc14c0042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc15b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ec3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc15b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ec3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37010/0 (socket says 172.21.15.40:37010) 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc15b400640 1 -- 172.21.15.40:0/2959236901 learned_addr learned my addr 172.21.15.40:0/2959236901 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:45:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.156+0000 7fc15aa00640 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ec4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc15b400640 1 -- 172.21.15.40:0/2959236901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aff910 msgr2=0x562769ebea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc15b400640 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aff910 0x562769ebea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc15b400640 1 -- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 msgr2=0x562769ec4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc15b400640 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ec4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc15b400640 1 -- 172.21.15.40:0/2959236901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562769ebf200 con 0x562769ae2660 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc15b400640 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ec3cb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc14c004650 tx=0x7fc14c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df42465f7330773 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc145600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc145600640 1 -- 172.21.15.40:0/2959236901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c035070 con 0x562769ae2660 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc145600640 1 -- 172.21.15.40:0/2959236901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc14c046680 con 0x562769ae2660 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.157+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc14c03da90 con 0x562769ae2660 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc145600640 1 -- 172.21.15.40:0/2959236901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc14c06a050 con 0x562769ae2660 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 10 client.16323 fetch_fsmap learned FSMap version 35 2024-07-26T12:45:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562769f36d60 con 0x562769ae2660 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc145600640 1 -- 172.21.15.40:0/2959236901 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc14c03da90 con 0x562769ae2660 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc145600640 1 -- 172.21.15.40:0/2959236901 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc14c051a40 con 0x562769ae2660 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 10 client.16323 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 10 client.16323 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 20 client.16323 populate_metadata read hostname 'smithi040' 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769b0b520 0x562769f39430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 4 client.16323 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3647e802", "release": true, "await": true}] 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.158+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3647e802", "release": true, "await": true}) -- 0x562769e24920 con 0x562769b0b520 2024-07-26T12:45:31.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.159+0000 7fc15aa00640 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769b0b520 0x562769f39430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:45:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.160+0000 7fc15aa00640 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769b0b520 0x562769f39430 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46dcd18efb120f9f server_cookie=e382929614c4dcdd in_seq=0 out_seq=0 2024-07-26T12:45:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.160+0000 7fc145600640 10 client.16323 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:45:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.220+0000 7fc145600640 1 -- 172.21.15.40:0/2959236901 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562769e24920 con 0x562769b0b520 2024-07-26T12:45:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.220+0000 7fc145600640 10 client.16323 handle_command_reply: tid=0 2024-07-26T12:45:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.220+0000 7fc169208740 1 client.16323 shutdown 2024-07-26T12:45:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 msgr2=0x562769ec3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ec3cb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc14c004650 tx=0x7fc14c0035f0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 shutdown_connections 2024-07-26T12:45:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562769aff910 0x562769ebea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562769aea840 0x562769ec4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562769b0b520 0x562769f39430 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 --2- 172.21.15.40:0/2959236901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562769ae2660 0x562769ec3cb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc145600640 0 client.16323 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:45:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.221+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 >> 172.21.15.40:0/2959236901 conn(0x562769eae1b0 msgr2=0x562769eac2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.222+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 shutdown_connections 2024-07-26T12:45:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.222+0000 7fc169208740 1 -- 172.21.15.40:0/2959236901 wait complete. 2024-07-26T12:45:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.222+0000 7fc169208740 20 client.16323 trim_cache size 0 max 16384 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 72, 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "3647e802": { 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 72, 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:45:31.224 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 153.5, 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:45:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:45:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:45:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.223+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc1400b3bd0 msgr2=0x7fc1400b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.223+0000 7fc162400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc1400b3bd0 0x7fc1400b60e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc154005c40 tx=0x7fc154009760 comp rx=0 tx=0).stop 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 msgr2=0x7fc15c1041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 0x7fc15c1041f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc14800c970 tx=0x7fc14800ce30 comp rx=0 tx=0).stop 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 shutdown_connections 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc15c108750 0x7fc15c104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c107e00 0x7fc15c1041f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc1400b3bd0 0x7fc1400b60e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 --2- 172.21.15.40:0/225250819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc15c102510 0x7fc15c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.224+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 >> 172.21.15.40:0/225250819 conn(0x7fc15c079190 msgr2=0x7fc15c1015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.225+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 shutdown_connections 2024-07-26T12:45:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:45:31.225+0000 7fc162400640 1 -- 172.21.15.40:0/225250819 wait complete. 2024-07-26T12:45:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:31 smithi040 ceph-mon[32397]: pgmap v1198: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:45:32.082 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3647e802', total seconds elapsed: 41.0 2024-07-26T12:45:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:31 smithi146 ceph-mon[35807]: pgmap v1198: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:45:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:31 smithi076 ceph-mon[35401]: pgmap v1198: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:45:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:45:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:45:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:45:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:33 smithi040 ceph-mon[32397]: pgmap v1199: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:45:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:45:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:45:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:45:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:33 smithi146 ceph-mon[35807]: pgmap v1199: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:45:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:45:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:45:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:45:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:33 smithi076 ceph-mon[35401]: pgmap v1199: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:45:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:45:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:45:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:45:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:35 smithi040 ceph-mon[32397]: pgmap v1200: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:45:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:35 smithi146 ceph-mon[35807]: pgmap v1200: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:45:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:35 smithi076 ceph-mon[35401]: pgmap v1200: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:45:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:36 smithi040 ceph-mon[32397]: pgmap v1201: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1002 KiB/s wr, 8 op/s 2024-07-26T12:45:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:36 smithi146 ceph-mon[35807]: pgmap v1201: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1002 KiB/s wr, 8 op/s 2024-07-26T12:45:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:36 smithi076 ceph-mon[35401]: pgmap v1201: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1002 KiB/s wr, 8 op/s 2024-07-26T12:45:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:39 smithi146 ceph-mon[35807]: pgmap v1202: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:45:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:39 smithi076 ceph-mon[35401]: pgmap v1202: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:45:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:39 smithi040 ceph-mon[32397]: pgmap v1202: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:45:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:41 smithi146 ceph-mon[35807]: pgmap v1203: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T12:45:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:41 smithi076 ceph-mon[35401]: pgmap v1203: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T12:45:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:41 smithi040 ceph-mon[32397]: pgmap v1203: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T12:45:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:43 smithi146 ceph-mon[35807]: pgmap v1204: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:45:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:43 smithi076 ceph-mon[35401]: pgmap v1204: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:45:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:43 smithi040 ceph-mon[32397]: pgmap v1204: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:45:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:45 smithi146 ceph-mon[35807]: pgmap v1205: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:45:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:45 smithi076 ceph-mon[35401]: pgmap v1205: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:45:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:45 smithi040 ceph-mon[32397]: pgmap v1205: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:45:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:47 smithi146 ceph-mon[35807]: pgmap v1206: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:45:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:47 smithi076 ceph-mon[35401]: pgmap v1206: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:45:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:47 smithi040 ceph-mon[32397]: pgmap v1206: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:45:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:49 smithi146 ceph-mon[35807]: pgmap v1207: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:45:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:49 smithi076 ceph-mon[35401]: pgmap v1207: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:45:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:49 smithi040 ceph-mon[32397]: pgmap v1207: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:45:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:51 smithi146 ceph-mon[35807]: pgmap v1208: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:45:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:51 smithi076 ceph-mon[35401]: pgmap v1208: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:45:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:51 smithi040 ceph-mon[32397]: pgmap v1208: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:45:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:53 smithi076 ceph-mon[35401]: pgmap v1209: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:45:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:53 smithi040 ceph-mon[32397]: pgmap v1209: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:45:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:53 smithi146 ceph-mon[35807]: pgmap v1209: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:45:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:55 smithi076 ceph-mon[35401]: pgmap v1210: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:45:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:55 smithi040 ceph-mon[32397]: pgmap v1210: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:45:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:55 smithi146 ceph-mon[35807]: pgmap v1210: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:45:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:57 smithi040 ceph-mon[32397]: pgmap v1211: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:45:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:57 smithi146 ceph-mon[35807]: pgmap v1211: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:45:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:57 smithi076 ceph-mon[35401]: pgmap v1211: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:46:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:45:59 smithi040 ceph-mon[32397]: pgmap v1212: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:46:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:45:59 smithi146 ceph-mon[35807]: pgmap v1212: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:46:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:45:59 smithi076 ceph-mon[35401]: pgmap v1212: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:46:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:01 smithi040 ceph-mon[32397]: pgmap v1213: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:46:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:01 smithi146 ceph-mon[35807]: pgmap v1213: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:46:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:01 smithi076 ceph-mon[35401]: pgmap v1213: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:46:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:03 smithi040 ceph-mon[32397]: pgmap v1214: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:46:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:03 smithi146 ceph-mon[35807]: pgmap v1214: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:46:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:03 smithi076 ceph-mon[35401]: pgmap v1214: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:46:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:05 smithi040 ceph-mon[32397]: pgmap v1215: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:46:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:05 smithi146 ceph-mon[35807]: pgmap v1215: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:46:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:05 smithi076 ceph-mon[35401]: pgmap v1215: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:46:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:07 smithi040 ceph-mon[32397]: pgmap v1216: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:46:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:07 smithi146 ceph-mon[35807]: pgmap v1216: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:46:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:07 smithi076 ceph-mon[35401]: pgmap v1216: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:46:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:09 smithi040 ceph-mon[32397]: pgmap v1217: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:46:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:09 smithi146 ceph-mon[35807]: pgmap v1217: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:46:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:09 smithi076 ceph-mon[35401]: pgmap v1217: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:46:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:11 smithi040 ceph-mon[32397]: pgmap v1218: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:46:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:11 smithi146 ceph-mon[35807]: pgmap v1218: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:46:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:11 smithi076 ceph-mon[35401]: pgmap v1218: 97 pgs: 97 active+clean; 4.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:46:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:13 smithi040 ceph-mon[32397]: pgmap v1219: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:13 smithi146 ceph-mon[35807]: pgmap v1219: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:13 smithi076 ceph-mon[35401]: pgmap v1219: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:15 smithi040 ceph-mon[32397]: pgmap v1220: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:46:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:15 smithi146 ceph-mon[35807]: pgmap v1220: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:46:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:15 smithi076 ceph-mon[35401]: pgmap v1220: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:46:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:17 smithi040 ceph-mon[32397]: pgmap v1221: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:46:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:17 smithi146 ceph-mon[35807]: pgmap v1221: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:46:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:17 smithi076 ceph-mon[35401]: pgmap v1221: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:46:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:19 smithi040 ceph-mon[32397]: pgmap v1222: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:46:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:19 smithi146 ceph-mon[35807]: pgmap v1222: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:46:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:19 smithi076 ceph-mon[35401]: pgmap v1222: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:46:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:21 smithi040 ceph-mon[32397]: pgmap v1223: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:46:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:21 smithi146 ceph-mon[35807]: pgmap v1223: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:46:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:21 smithi076 ceph-mon[35401]: pgmap v1223: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:46:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:23 smithi040 ceph-mon[32397]: pgmap v1224: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:46:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:23 smithi146 ceph-mon[35807]: pgmap v1224: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:46:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:23 smithi076 ceph-mon[35401]: pgmap v1224: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:46:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:25 smithi040 ceph-mon[32397]: pgmap v1225: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:46:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:25 smithi146 ceph-mon[35807]: pgmap v1225: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:46:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:25 smithi076 ceph-mon[35401]: pgmap v1225: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:46:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:27 smithi040 ceph-mon[32397]: pgmap v1226: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:46:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:27 smithi146 ceph-mon[35807]: pgmap v1226: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:46:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:27 smithi076 ceph-mon[35401]: pgmap v1226: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:46:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:28 smithi146 ceph-mon[35807]: pgmap v1227: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:46:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:28 smithi076 ceph-mon[35401]: pgmap v1227: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:46:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:28 smithi040 ceph-mon[32397]: pgmap v1227: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:46:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:31 smithi146 ceph-mon[35807]: pgmap v1228: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:31 smithi076 ceph-mon[35401]: pgmap v1228: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:31 smithi040 ceph-mon[32397]: pgmap v1228: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:33 smithi146 ceph-mon[35807]: pgmap v1229: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:46:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:46:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:33 smithi076 ceph-mon[35401]: pgmap v1229: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:46:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:46:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:33 smithi040 ceph-mon[32397]: pgmap v1229: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:46:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:46:34.298 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-07-26T12:46:34.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:46:34.851 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:46:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:35 smithi146 ceph-mon[35807]: pgmap v1230: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:46:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:35 smithi076 ceph-mon[35401]: pgmap v1230: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:46:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:35 smithi040 ceph-mon[32397]: pgmap v1230: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:46:37.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 -- 172.21.15.40:0/231205864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 msgr2=0x7fc43c111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 --2- 172.21.15.40:0/231205864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c111de0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc434009ca0 tx=0x7fc43402a950 comp rx=0 tx=0).stop 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 -- 172.21.15.40:0/231205864 shutdown_connections 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 --2- 172.21.15.40:0/231205864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c111de0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 --2- 172.21.15.40:0/231205864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc43c102760 0x7fc43c10f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 --2- 172.21.15.40:0/231205864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43c101e10 0x7fc43c102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 -- 172.21.15.40:0/231205864 >> 172.21.15.40:0/231205864 conn(0x7fc43c0fdcf0 msgr2=0x7fc43c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 -- 172.21.15.40:0/231205864 shutdown_connections 2024-07-26T12:46:37.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.766+0000 7fc441000640 1 -- 172.21.15.40:0/231205864 wait complete. 2024-07-26T12:46:37.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.768+0000 7fc441000640 1 Processor -- start 2024-07-26T12:46:37.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.768+0000 7fc441000640 1 -- start start 2024-07-26T12:46:37.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc441000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43c101e10 0x7fc43c107e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:37.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc441000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc43c102760 0x7fc43c104140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:37.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc441000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c104860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:37.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc441000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c115330 con 0x7fc43c10f9c0 2024-07-26T12:46:37.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc441000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1151b0 con 0x7fc43c102760 2024-07-26T12:46:37.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc441000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c1154b0 con 0x7fc43c101e10 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc43be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c104860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc43be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c104860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49098/0 (socket says 172.21.15.40:49098) 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc43be00640 1 -- 172.21.15.40:0/1776976369 learned_addr learned my addr 172.21.15.40:0/1776976369 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc43b400640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43c101e10 0x7fc43c107e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.769+0000 7fc43aa00640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc43c102760 0x7fc43c104140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.770+0000 7fc43be00640 1 -- 172.21.15.40:0/1776976369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43c101e10 msgr2=0x7fc43c107e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.770+0000 7fc43be00640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43c101e10 0x7fc43c107e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.770+0000 7fc43be00640 1 -- 172.21.15.40:0/1776976369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc43c102760 msgr2=0x7fc43c104140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.770+0000 7fc43be00640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc43c102760 0x7fc43c104140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:37.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.770+0000 7fc43be00640 1 -- 172.21.15.40:0/1776976369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c1ac2f0 con 0x7fc43c10f9c0 2024-07-26T12:46:37.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.771+0000 7fc43be00640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c104860 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc43402ae70 tx=0x7fc434003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:37.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.771+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434034040 con 0x7fc43c10f9c0 2024-07-26T12:46:37.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.771+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc434030850 con 0x7fc43c10f9c0 2024-07-26T12:46:37.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.771+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c1ac4c0 con 0x7fc43c10f9c0 2024-07-26T12:46:37.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.771+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434004670 con 0x7fc43c10f9c0 2024-07-26T12:46:37.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.771+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c1aca50 con 0x7fc43c10f9c0 2024-07-26T12:46:37.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.773+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c06af90 con 0x7fc43c10f9c0 2024-07-26T12:46:37.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.776+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc434037020 con 0x7fc43c10f9c0 2024-07-26T12:46:37.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.779+0000 7fc433e00640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4200b3c50 0x7fc4200b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.779+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc434104c00 con 0x7fc43c10f9c0 2024-07-26T12:46:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.779+0000 7fc43b400640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4200b3c50 0x7fc4200b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.780+0000 7fc43b400640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4200b3c50 0x7fc4200b6160 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc43c107bb0 tx=0x7fc42c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:37.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:37.781+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc4340cc370 con 0x7fc43c10f9c0 2024-07-26T12:46:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:37 smithi076 ceph-mon[35401]: pgmap v1231: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:46:38.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:37 smithi040 ceph-mon[32397]: pgmap v1231: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:46:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.093+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc43c10abb0 con 0x7fc43c10f9c0 2024-07-26T12:46:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.094+0000 7fc433e00640 1 -- 172.21.15.40:0/1776976369 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fc4340cbc70 con 0x7fc43c10f9c0 2024-07-26T12:46:38.095 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:46:38.095 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:46:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4200b3c50 msgr2=0x7fc4200b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4200b3c50 0x7fc4200b6160 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc43c107bb0 tx=0x7fc42c00b390 comp rx=0 tx=0).stop 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 msgr2=0x7fc43c104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c104860 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc43402ae70 tx=0x7fc434003f10 comp rx=0 tx=0).stop 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 shutdown_connections 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43c10f9c0 0x7fc43c104860 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc43c102760 0x7fc43c104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4200b3c50 0x7fc4200b6160 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 --2- 172.21.15.40:0/1776976369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43c101e10 0x7fc43c107e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.098+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 >> 172.21.15.40:0/1776976369 conn(0x7fc43c0fdcf0 msgr2=0x7fc43c100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.099+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 shutdown_connections 2024-07-26T12:46:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:38.099+0000 7fc441000640 1 -- 172.21.15.40:0/1776976369 wait complete. 2024-07-26T12:46:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:37 smithi146 ceph-mon[35807]: pgmap v1231: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:46:39.217 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:38 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1776976369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:46:39.277 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-07-26T12:46:39.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-07-26T12:46:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:38 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1776976369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:46:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:38 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1776976369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:46:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:46:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:39 smithi040 ceph-mon[32397]: pgmap v1232: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:46:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:39 smithi146 ceph-mon[35807]: pgmap v1232: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:46:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:39 smithi076 ceph-mon[35401]: pgmap v1232: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:46:42.143 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:41 smithi040 ceph-mon[32397]: pgmap v1233: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:46:42.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:41 smithi146 ceph-mon[35807]: pgmap v1233: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:46:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:41 smithi076 ceph-mon[35401]: pgmap v1233: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 -- 172.21.15.40:0/3389176242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 msgr2=0x7f5df41028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 --2- 172.21.15.40:0/3389176242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41028c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009900 tx=0x7f5de802a410 comp rx=0 tx=0).stop 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 -- 172.21.15.40:0/3389176242 shutdown_connections 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 --2- 172.21.15.40:0/3389176242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5df4108740 0x7f5df410ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 --2- 172.21.15.40:0/3389176242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5df4107df0 0x7f5df4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 --2- 172.21.15.40:0/3389176242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41028c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:42.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 -- 172.21.15.40:0/3389176242 >> 172.21.15.40:0/3389176242 conn(0x7f5df4079190 msgr2=0x7f5df40795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:42.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 -- 172.21.15.40:0/3389176242 shutdown_connections 2024-07-26T12:46:42.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.990+0000 7f5dfc800640 1 -- 172.21.15.40:0/3389176242 wait complete. 2024-07-26T12:46:42.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.991+0000 7f5dfc800640 1 Processor -- start 2024-07-26T12:46:42.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.991+0000 7f5dfc800640 1 -- start start 2024-07-26T12:46:42.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5dfc800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41056b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:42.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5dfc800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5df4107df0 0x7f5df4103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:42.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5dfc800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5df4108740 0x7f5df41041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:42.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5dfc800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41122c0 con 0x7f5df41024b0 2024-07-26T12:46:42.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5dfc800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5df4112140 con 0x7f5df4108740 2024-07-26T12:46:42.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5dfc800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5df4112440 con 0x7f5df4107df0 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5df9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.992+0000 7f5df9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42222/0 (socket says 172.21.15.40:42222) 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9e00640 1 -- 172.21.15.40:0/959947764 learned_addr learned my addr 172.21.15.40:0/959947764 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9400640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5df4107df0 0x7f5df4103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5dfa800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5df4108740 0x7f5df41041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9e00640 1 -- 172.21.15.40:0/959947764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5df4107df0 msgr2=0x7f5df4103ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9e00640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5df4107df0 0x7f5df4103ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:42.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9e00640 1 -- 172.21.15.40:0/959947764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5df4108740 msgr2=0x7f5df41041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:42.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9e00640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5df4108740 0x7f5df41041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:42.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.993+0000 7f5df9e00640 1 -- 172.21.15.40:0/959947764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4104a00 con 0x7f5df41024b0 2024-07-26T12:46:42.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.994+0000 7f5df9e00640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41056b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5de802a930 tx=0x7f5de8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:42.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.994+0000 7f5deea00640 1 -- 172.21.15.40:0/959947764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de803f070 con 0x7f5df41024b0 2024-07-26T12:46:42.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.994+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df41ac740 con 0x7f5df41024b0 2024-07-26T12:46:42.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.994+0000 7f5deea00640 1 -- 172.21.15.40:0/959947764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5de803baf0 con 0x7f5df41024b0 2024-07-26T12:46:42.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.994+0000 7f5deea00640 1 -- 172.21.15.40:0/959947764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8035030 con 0x7f5df41024b0 2024-07-26T12:46:42.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.994+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df41acc20 con 0x7f5df41024b0 2024-07-26T12:46:42.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.998+0000 7f5e03426740 1 Processor -- start 2024-07-26T12:46:42.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.998+0000 7f5e03426740 1 -- start start 2024-07-26T12:46:43.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5e03426740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b5691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5e03426740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b569700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5e03426740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b569c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5e03426740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55828b533d10 con 0x55828b19a980 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5e03426740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55828b4deb60 con 0x55828b1a2b60 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5e03426740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55828b4ce060 con 0x55828b1c3840 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5deea00640 1 -- 172.21.15.40:0/959947764 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5de8042070 con 0x7f5df41024b0 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b5691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5df9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b569700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b5691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:51408/0 (socket says 172.21.15.40:51408) 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:42.999+0000 7f5dfa800640 1 -- 172.21.15.40:0/3966928991 learned_addr learned my addr 172.21.15.40:0/3966928991 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:46:43.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.000+0000 7f5df9400640 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b569c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.000+0000 7f5dfa800640 1 -- 172.21.15.40:0/3966928991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 msgr2=0x55828b569c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.000+0000 7f5dfa800640 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b569c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.000+0000 7f5dfa800640 1 -- 172.21.15.40:0/3966928991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 msgr2=0x55828b569700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.000+0000 7f5dfa800640 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b569700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.000+0000 7f5dfa800640 1 -- 172.21.15.40:0/3966928991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828b455b10 con 0x55828b1c3840 2024-07-26T12:46:43.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.001+0000 7f5dfa800640 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b5691c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009f80 tx=0x7f5df0010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd171db91ce7a556 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:43.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.001+0000 7f5de3000640 1 -- 172.21.15.40:0/3966928991 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0003b70 con 0x55828b1c3840 2024-07-26T12:46:43.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.001+0000 7f5de3000640 1 -- 172.21.15.40:0/3966928991 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5df0003d10 con 0x55828b1c3840 2024-07-26T12:46:43.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.001+0000 7f5de3000640 1 -- 172.21.15.40:0/3966928991 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011a00 con 0x55828b1c3840 2024-07-26T12:46:43.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.001+0000 7f5deea00640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ddc0b3bd0 0x7f5ddc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.002+0000 7f5deea00640 1 -- 172.21.15.40:0/959947764 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5de81042d0 con 0x7f5df41024b0 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.002+0000 7f5df9e00640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ddc0b3bd0 0x7f5ddc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.002+0000 7f5e03426740 1 -- 172.21.15.40:0/3966928991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 msgr2=0x55828b5691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.002+0000 7f5e03426740 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b5691c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009f80 tx=0x7f5df0010860 comp rx=0 tx=0).stop 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 -- 172.21.15.40:0/3966928991 shutdown_connections 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b569c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5df9e00640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ddc0b3bd0 0x7f5ddc0b60e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5de80c7260 tx=0x7f5de8107d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b569700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 --2- 172.21.15.40:0/3966928991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b5691c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 -- 172.21.15.40:0/3966928991 >> 172.21.15.40:0/3966928991 conn(0x55828b1b7990 msgr2=0x55828b5670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 -- 172.21.15.40:0/3966928991 shutdown_connections 2024-07-26T12:46:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.003+0000 7f5e03426740 1 -- 172.21.15.40:0/3966928991 wait complete. 2024-07-26T12:46:43.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.004+0000 7f5e03426740 1 -- start start 2024-07-26T12:46:43.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.004+0000 7f5e03426740 1 Processor -- start 2024-07-26T12:46:43.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b574d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b575240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b580b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55828b46a520 con 0x55828b19a980 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55828b4d20a0 con 0x55828b1a2b60 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55828b3317a0 con 0x55828b1c3840 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5e03426740 10 client.0 _ll_register_callbacks cb 0x55828b4c6bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b574d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b574d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42228/0 (socket says 172.21.15.40:42228) 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5dfa800640 1 -- 172.21.15.40:0/485426748 learned_addr learned my addr 172.21.15.40:0/485426748 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.005+0000 7f5dfa800640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b580b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.006+0000 7f5df9400640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b575240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.006+0000 7f5dfa800640 1 -- 172.21.15.40:0/485426748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 msgr2=0x55828b580b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.006+0000 7f5dfa800640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b580b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.006+0000 7f5dfa800640 1 -- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 msgr2=0x55828b575240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.006+0000 7f5dfa800640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b575240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.006+0000 7f5dfa800640 1 -- 172.21.15.40:0/485426748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828b23db90 con 0x55828b19a980 2024-07-26T12:46:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5dfa800640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b574d00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009d90 tx=0x7f5df0011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dd852bef30756 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5dd7400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5dd7400640 1 -- 172.21.15.40:0/485426748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0026070 con 0x55828b19a980 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df0003d10 con 0x55828b19a980 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5dd7400640 1 -- 172.21.15.40:0/485426748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5df0003ec0 con 0x55828b19a980 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5dd7400640 1 -- 172.21.15.40:0/485426748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5df00040c0 con 0x55828b19a980 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5e03426740 10 client.16341 fetch_fsmap learned FSMap version 35 2024-07-26T12:46:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.007+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55828b5837c0 con 0x55828b19a980 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5dd7400640 1 -- 172.21.15.40:0/485426748 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5df0003d10 con 0x55828b19a980 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5dd7400640 1 -- 172.21.15.40:0/485426748 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f5df001b9c0 con 0x55828b19a980 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5e03426740 10 client.16341 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5e03426740 10 client.16341 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5e03426740 20 client.16341 populate_metadata read hostname 'smithi040' 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5e03426740 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b1821c0 0x55828b586b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5e03426740 4 client.16341 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.008+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55828b4e0ab0 con 0x55828b1821c0 2024-07-26T12:46:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.009+0000 7f5df9400640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b1821c0 0x55828b586b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.010+0000 7f5df9400640 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b1821c0 0x55828b586b80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b29f58112c3c0de server_cookie=dd3fa5a5862d05c6 in_seq=0 out_seq=0 2024-07-26T12:46:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.010+0000 7f5dd7400640 10 client.16341 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:46:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.012+0000 7f5dd7400640 1 -- 172.21.15.40:0/485426748 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55828b4e0ab0 con 0x55828b1821c0 2024-07-26T12:46:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.012+0000 7f5dd7400640 10 client.16341 handle_command_reply: tid=0 2024-07-26T12:46:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.012+0000 7f5e03426740 1 client.16341 shutdown 2024-07-26T12:46:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 msgr2=0x55828b574d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b574d00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009d90 tx=0x7f5df0011500 comp rx=0 tx=0).stop 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 shutdown_connections 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b580b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b575240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b1821c0 0x55828b586b80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 --2- 172.21.15.40:0/485426748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b574d00 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 >> 172.21.15.40:0/485426748 conn(0x55828b1b7990 msgr2=0x55828b56c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5dd7400640 0 client.16341 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:46:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 shutdown_connections 2024-07-26T12:46:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 1 -- 172.21.15.40:0/485426748 wait complete. 2024-07-26T12:46:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.013+0000 7f5e03426740 20 client.16341 trim_cache size 0 max 16384 2024-07-26T12:46:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 Processor -- start 2024-07-26T12:46:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 -- start start 2024-07-26T12:46:43.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 0x55828b566660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b566ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b1c3840 0x55828b58c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41b5330 con 0x55828b1c3840 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41b6e70 con 0x55828b1a2b60 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.034+0000 7f5e03426740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41b5a00 con 0x55828b19a980 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 0x55828b566660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 0x55828b566660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:51428/0 (socket says 172.21.15.40:51428) 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 -- 172.21.15.40:0/1221965183 learned_addr learned my addr 172.21.15.40:0/1221965183 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b1c3840 0x55828b58c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5df9400640 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b566ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 -- 172.21.15.40:0/1221965183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 msgr2=0x55828b566ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b566ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 -- 172.21.15.40:0/1221965183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b1c3840 msgr2=0x55828b58c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b1c3840 0x55828b58c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5dfa800640 1 -- 172.21.15.40:0/1221965183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828b5679a0 con 0x55828b19a980 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.035+0000 7f5df9400640 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b566ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.036+0000 7f5dfa800640 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 0x55828b566660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009690 tx=0x7f5df0010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=202a5d55fa025f81 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.036+0000 7f5de2600640 1 -- 172.21.15.40:0/1221965183 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0026070 con 0x55828b19a980 2024-07-26T12:46:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.036+0000 7f5de2600640 1 -- 172.21.15.40:0/1221965183 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5df0024050 con 0x55828b19a980 2024-07-26T12:46:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.036+0000 7f5de2600640 1 -- 172.21.15.40:0/1221965183 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df002f540 con 0x55828b19a980 2024-07-26T12:46:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 -- 172.21.15.40:0/1221965183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 msgr2=0x55828b566660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 0x55828b566660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009690 tx=0x7f5df0010860 comp rx=0 tx=0).stop 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 -- 172.21.15.40:0/1221965183 shutdown_connections 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b1c3840 0x55828b58c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b566ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 --2- 172.21.15.40:0/1221965183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b19a980 0x55828b566660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.037+0000 7f5e03426740 1 -- 172.21.15.40:0/1221965183 >> 172.21.15.40:0/1221965183 conn(0x55828b1b7990 msgr2=0x55828b573250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.038+0000 7f5e03426740 1 -- 172.21.15.40:0/1221965183 shutdown_connections 2024-07-26T12:46:43.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.038+0000 7f5e03426740 1 -- 172.21.15.40:0/1221965183 wait complete. 2024-07-26T12:46:43.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.039+0000 7f5e03426740 1 -- start start 2024-07-26T12:46:43.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.039+0000 7f5e03426740 1 Processor -- start 2024-07-26T12:46:43.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.039+0000 7f5e03426740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b57d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5e03426740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b578650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5e03426740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b578b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5e03426740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41b67a0 con 0x55828b19a980 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5e03426740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41b60d0 con 0x55828b1a2b60 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5e03426740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5df41b32f0 con 0x55828b1c3840 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5e03426740 10 client.0 _ll_register_callbacks cb 0x7f5de8107be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b57d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b57d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42258/0 (socket says 172.21.15.40:42258) 2024-07-26T12:46:43.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 -- 172.21.15.40:0/2496372650 learned_addr learned my addr 172.21.15.40:0/2496372650 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:46:43.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5df9400640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b578650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b578b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 -- 172.21.15.40:0/2496372650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 msgr2=0x55828b578b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b578b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 -- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 msgr2=0x55828b578650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:46:43.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b578650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.040+0000 7f5dfa800640 1 -- 172.21.15.40:0/2496372650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828b579320 con 0x55828b19a980 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.041+0000 7f5dfa800640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b57d1a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5df001beb0 tx=0x7f5df0009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a691f4f6d6f3fd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.041+0000 7f5dd7400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.041+0000 7f5dd7400640 1 -- 172.21.15.40:0/2496372650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0026070 con 0x55828b19a980 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.041+0000 7f5dd7400640 1 -- 172.21.15.40:0/2496372650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5df002f1c0 con 0x55828b19a980 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.041+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df0024050 con 0x55828b19a980 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5dd7400640 1 -- 172.21.15.40:0/2496372650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5df002f3c0 con 0x55828b19a980 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5e03426740 10 client.16347 fetch_fsmap learned FSMap version 35 2024-07-26T12:46:43.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55828b5ef0b0 con 0x55828b19a980 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5dd7400640 1 -- 172.21.15.40:0/2496372650 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5df0024050 con 0x55828b19a980 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5dd7400640 1 -- 172.21.15.40:0/2496372650 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f5df001b420 con 0x55828b19a980 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5e03426740 10 client.16347 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5e03426740 10 client.16347 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5e03426740 20 client.16347 populate_metadata read hostname 'smithi040' 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.042+0000 7f5e03426740 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b157570 0x55828b5f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.043+0000 7f5e03426740 4 client.16347 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-07-26T12:46:43.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.043+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x55828b4dc550 con 0x55828b157570 2024-07-26T12:46:43.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.043+0000 7f5df9400640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b157570 0x55828b5f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:46:43.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.044+0000 7f5df9400640 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b157570 0x55828b5f17c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37994e570567e67a server_cookie=cf4141a0cd75c09f in_seq=0 out_seq=0 2024-07-26T12:46:43.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.044+0000 7f5dd7400640 10 client.16347 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:46:43.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.302+0000 7f5dd7400640 1 -- 172.21.15.40:0/2496372650 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55828b4dc550 con 0x55828b157570 2024-07-26T12:46:43.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.302+0000 7f5dd7400640 10 client.16347 handle_command_reply: tid=0 2024-07-26T12:46:43.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.302+0000 7f5e03426740 1 client.16347 shutdown 2024-07-26T12:46:43.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 msgr2=0x55828b57d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b57d1a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5df001beb0 tx=0x7f5df0009520 comp rx=0 tx=0).stop 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 shutdown_connections 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55828b1c3840 0x55828b578b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828b1a2b60 0x55828b578650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55828b157570 0x55828b5f17c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 --2- 172.21.15.40:0/2496372650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55828b19a980 0x55828b57d1a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 >> 172.21.15.40:0/2496372650 conn(0x55828b1b7990 msgr2=0x55828b573c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.303+0000 7f5dd7400640 0 client.16347 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.304+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 shutdown_connections 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.304+0000 7f5e03426740 1 -- 172.21.15.40:0/2496372650 wait complete. 2024-07-26T12:46:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.304+0000 7f5e03426740 20 client.16347 trim_cache size 0 max 16384 2024-07-26T12:46:43.306 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 74, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "bf3d366d": { 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 74, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:46:43.307 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.0, 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:46:43.308 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.305+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ddc0b3bd0 msgr2=0x7f5ddc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.305+0000 7f5dfc800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ddc0b3bd0 0x7f5ddc0b60e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5de80c7260 tx=0x7f5de8107d10 comp rx=0 tx=0).stop 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.305+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 msgr2=0x7f5df41056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.305+0000 7f5dfc800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41056b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5de802a930 tx=0x7f5de8003b90 comp rx=0 tx=0).stop 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 shutdown_connections 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5df4108740 0x7f5df41041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ddc0b3bd0 0x7f5ddc0b60e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5df4107df0 0x7f5df4103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 --2- 172.21.15.40:0/959947764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df41024b0 0x7f5df41056b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:46:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 >> 172.21.15.40:0/959947764 conn(0x7f5df4079190 msgr2=0x7f5df4101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:46:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 shutdown_connections 2024-07-26T12:46:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:46:43.306+0000 7f5dfc800640 1 -- 172.21.15.40:0/959947764 wait complete. 2024-07-26T12:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:43.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:43 smithi040 ceph-mon[32397]: pgmap v1234: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:46:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:46:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:46:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:43 smithi146 ceph-mon[35807]: pgmap v1234: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:43 smithi076 ceph-mon[35401]: pgmap v1234: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:46:45.386 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf3d366d', quiesce took 11.1 seconds. Will release after: 16.9 2024-07-26T12:46:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:45 smithi146 ceph-mon[35807]: pgmap v1235: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:46:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:45 smithi076 ceph-mon[35401]: pgmap v1235: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:46:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:45 smithi040 ceph-mon[32397]: pgmap v1235: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:46:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:47 smithi146 ceph-mon[35807]: pgmap v1236: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:46:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:47 smithi076 ceph-mon[35401]: pgmap v1236: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:46:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:47 smithi040 ceph-mon[32397]: pgmap v1236: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:46:50.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:49 smithi076 ceph-mon[35401]: pgmap v1237: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:46:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:49 smithi040 ceph-mon[32397]: pgmap v1237: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:46:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:49 smithi146 ceph-mon[35807]: pgmap v1237: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:46:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:51 smithi076 ceph-mon[35401]: pgmap v1238: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:51 smithi040 ceph-mon[32397]: pgmap v1238: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:51 smithi146 ceph-mon[35807]: pgmap v1238: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:46:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:53 smithi040 ceph-mon[32397]: pgmap v1239: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:46:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:53 smithi146 ceph-mon[35807]: pgmap v1239: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:46:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:53 smithi076 ceph-mon[35401]: pgmap v1239: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T12:46:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:55 smithi040 ceph-mon[32397]: pgmap v1240: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T12:46:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:55 smithi146 ceph-mon[35807]: pgmap v1240: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T12:46:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:55 smithi076 ceph-mon[35401]: pgmap v1240: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T12:46:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:57 smithi040 ceph-mon[32397]: pgmap v1241: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:46:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:57 smithi146 ceph-mon[35807]: pgmap v1241: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:46:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:57 smithi076 ceph-mon[35401]: pgmap v1241: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 MiB/s wr, 9 op/s 2024-07-26T12:47:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:46:59 smithi040 ceph-mon[32397]: pgmap v1242: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 548 KiB/s wr, 11 op/s 2024-07-26T12:47:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:46:59 smithi146 ceph-mon[35807]: pgmap v1242: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 548 KiB/s wr, 11 op/s 2024-07-26T12:47:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:46:59 smithi076 ceph-mon[35401]: pgmap v1242: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 548 KiB/s wr, 11 op/s 2024-07-26T12:47:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:01 smithi040 ceph-mon[32397]: pgmap v1243: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 548 KiB/s wr, 10 op/s 2024-07-26T12:47:02.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:47:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:01 smithi146 ceph-mon[35807]: pgmap v1243: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 548 KiB/s wr, 10 op/s 2024-07-26T12:47:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:01 smithi076 ceph-mon[35401]: pgmap v1243: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 548 KiB/s wr, 10 op/s 2024-07-26T12:47:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:47:04.227 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:03 smithi040 ceph-mon[32397]: pgmap v1244: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 548 KiB/s wr, 10 op/s 2024-07-26T12:47:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:03 smithi146 ceph-mon[35807]: pgmap v1244: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 548 KiB/s wr, 10 op/s 2024-07-26T12:47:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:03 smithi076 ceph-mon[35401]: pgmap v1244: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 548 KiB/s wr, 10 op/s 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.054+0000 7f382c800640 1 -- 172.21.15.40:0/3263216162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38241057e0 msgr2=0x7f3824105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.054+0000 7f382c800640 1 --2- 172.21.15.40:0/3263216162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38241057e0 0x7f3824105bf0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3818009900 tx=0x7f381802a410 comp rx=0 tx=0).stop 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 -- 172.21.15.40:0/3263216162 shutdown_connections 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 --2- 172.21.15.40:0/3263216162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f382410ba70 0x7f38241122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 --2- 172.21.15.40:0/3263216162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382410b120 0x7f382410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 --2- 172.21.15.40:0/3263216162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38241057e0 0x7f3824105bf0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 -- 172.21.15.40:0/3263216162 >> 172.21.15.40:0/3263216162 conn(0x7f38241011f0 msgr2=0x7f3824103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:05.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 -- 172.21.15.40:0/3263216162 shutdown_connections 2024-07-26T12:47:05.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.055+0000 7f382c800640 1 -- 172.21.15.40:0/3263216162 wait complete. 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.056+0000 7f382c800640 1 Processor -- start 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.056+0000 7f382c800640 1 -- start start 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f382c800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38241057e0 0x7f382419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f382c800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 0x7f382419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f382c800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f382410ba70 0x7f38241a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f382c800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38241155f0 con 0x7f382410b120 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f382c800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3824115470 con 0x7f382410ba70 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f382c800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3824115770 con 0x7f38241057e0 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f3829400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 0x7f382419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f3829400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 0x7f382419c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59726/0 (socket says 172.21.15.40:59726) 2024-07-26T12:47:05.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.057+0000 7f3829400640 1 -- 172.21.15.40:0/4228049779 learned_addr learned my addr 172.21.15.40:0/4228049779 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:47:05.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829e00640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38241057e0 0x7f382419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:05.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f382a800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f382410ba70 0x7f38241a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829400640 1 -- 172.21.15.40:0/4228049779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38241057e0 msgr2=0x7f382419c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829400640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38241057e0 0x7f382419c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829400640 1 -- 172.21.15.40:0/4228049779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f382410ba70 msgr2=0x7f38241a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829400640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f382410ba70 0x7f38241a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829400640 1 -- 172.21.15.40:0/4228049779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38241a1fb0 con 0x7f382410b120 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.058+0000 7f3829400640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 0x7f382419c5e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f381400e9c0 tx=0x7f381400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.059+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381400ccc0 con 0x7f382410b120 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.059+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38140054b0 con 0x7f382410b120 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.059+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814010430 con 0x7f382410b120 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.059+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38241a22a0 con 0x7f382410b120 2024-07-26T12:47:05.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.059+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38241a8a00 con 0x7f382410b120 2024-07-26T12:47:05.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.060+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3824105bf0 con 0x7f382410b120 2024-07-26T12:47:05.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.063+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3814004f00 con 0x7f382410b120 2024-07-26T12:47:05.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.064+0000 7f381ea00640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f380c0b3c50 0x7f380c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:05.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.064+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f38140e4220 con 0x7f382410b120 2024-07-26T12:47:05.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.065+0000 7f3829e00640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f380c0b3c50 0x7f380c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:05.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.065+0000 7f3829e00640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f380c0b3c50 0x7f380c0b6160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3818000c00 tx=0x7f3818009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:05.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.066+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3814055600 con 0x7f382410b120 2024-07-26T12:47:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.310+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f382419d170 con 0x7f382410b120 2024-07-26T12:47:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.312+0000 7f381ea00640 1 -- 172.21.15.40:0/4228049779 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f382419d170 con 0x7f382410b120 2024-07-26T12:47:05.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:47:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:47:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:47:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f380c0b3c50 msgr2=0x7f380c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f380c0b3c50 0x7f380c0b6160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3818000c00 tx=0x7f3818009680 comp rx=0 tx=0).stop 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 msgr2=0x7f382419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 0x7f382419c5e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f381400e9c0 tx=0x7f381400ee80 comp rx=0 tx=0).stop 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 shutdown_connections 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f382410ba70 0x7f38241a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382410b120 0x7f382419c5e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f380c0b3c50 0x7f380c0b6160 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 --2- 172.21.15.40:0/4228049779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38241057e0 0x7f382419c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 >> 172.21.15.40:0/4228049779 conn(0x7f38241011f0 msgr2=0x7f38241098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 shutdown_connections 2024-07-26T12:47:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:05.315+0000 7f382c800640 1 -- 172.21.15.40:0/4228049779 wait complete. 2024-07-26T12:47:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:05 smithi040 ceph-mon[32397]: pgmap v1245: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T12:47:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:05 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4228049779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:47:06.054 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id bf3d366d --release --await' 2024-07-26T12:47:06.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id bf3d366d --release --await 2024-07-26T12:47:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:05 smithi146 ceph-mon[35807]: pgmap v1245: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T12:47:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:05 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4228049779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:47:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:05 smithi076 ceph-mon[35401]: pgmap v1245: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T12:47:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:05 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4228049779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:47:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:47:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:07 smithi040 ceph-mon[32397]: pgmap v1246: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T12:47:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:07 smithi146 ceph-mon[35807]: pgmap v1246: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T12:47:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:07 smithi076 ceph-mon[35401]: pgmap v1246: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T12:47:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 -- 172.21.15.40:0/3473029421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 msgr2=0x7f4d4810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/3473029421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d4810ef50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009ca0 tx=0x7f4d4002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 -- 172.21.15.40:0/3473029421 shutdown_connections 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/3473029421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d4810ef50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/3473029421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48107dd0 0x7f4d481081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/3473029421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48102490 0x7f4d481028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.897+0000 7f4d4ec00640 1 -- 172.21.15.40:0/3473029421 >> 172.21.15.40:0/3473029421 conn(0x7f4d48079160 msgr2=0x7f4d48079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.898+0000 7f4d4ec00640 1 -- 172.21.15.40:0/3473029421 shutdown_connections 2024-07-26T12:47:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.898+0000 7f4d4ec00640 1 -- 172.21.15.40:0/3473029421 wait complete. 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.899+0000 7f4d4ec00640 1 Processor -- start 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.899+0000 7f4d4ec00640 1 -- start start 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48102490 0x7f4d4810f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48107dd0 0x7f4d4810ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d48110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48113390 con 0x7f4d48108720 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48113210 con 0x7f4d48102490 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48113510 con 0x7f4d48107dd0 2024-07-26T12:47:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d48110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d48110460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59740/0 (socket says 172.21.15.40:59740) 2024-07-26T12:47:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d4cc00640 1 -- 172.21.15.40:0/1328464069 learned_addr learned my addr 172.21.15.40:0/1328464069 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:47:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.900+0000 7f4d47e00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48102490 0x7f4d4810f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d47400640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48107dd0 0x7f4d4810ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d4cc00640 1 -- 172.21.15.40:0/1328464069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48107dd0 msgr2=0x7f4d4810ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48107dd0 0x7f4d4810ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d4cc00640 1 -- 172.21.15.40:0/1328464069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48102490 msgr2=0x7f4d4810f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48102490 0x7f4d4810f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d4cc00640 1 -- 172.21.15.40:0/1328464069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d481a8120 con 0x7f4d48108720 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d47e00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48102490 0x7f4d4810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d48110460 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4d40005cc0 tx=0x7f4d40032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.901+0000 7f4d44c00640 1 -- 172.21.15.40:0/1328464069 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40032e00 con 0x7f4d48108720 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.902+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d481a83b0 con 0x7f4d48108720 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.902+0000 7f4d44c00640 1 -- 172.21.15.40:0/1328464069 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d400044d0 con 0x7f4d48108720 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.902+0000 7f4d44c00640 1 -- 172.21.15.40:0/1328464069 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40030b70 con 0x7f4d48108720 2024-07-26T12:47:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.902+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d481a88f0 con 0x7f4d48108720 2024-07-26T12:47:08.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.905+0000 7f4d5587e740 1 Processor -- start 2024-07-26T12:47:08.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.905+0000 7f4d44c00640 1 -- 172.21.15.40:0/1328464069 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4d40004680 con 0x7f4d48108720 2024-07-26T12:47:08.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.905+0000 7f4d5587e740 1 -- start start 2024-07-26T12:47:08.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1356afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 0x563d1356b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d1356ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d5587e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563d134e1f30 con 0x563d1319d660 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d5587e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563d134d1430 con 0x563d131c6520 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d5587e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d134d5470 con 0x563d131a5840 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d47e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 0x563d1356b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d47e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 0x563d1356b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59752/0 (socket says 172.21.15.40:59752) 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d47e00640 1 -- 172.21.15.40:0/2015973324 learned_addr learned my addr 172.21.15.40:0/2015973324 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.906+0000 7f4d47400640 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1356afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47400640 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d1356ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47e00640 1 -- 172.21.15.40:0/2015973324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 msgr2=0x563d1356ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47e00640 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d1356ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47e00640 1 -- 172.21.15.40:0/2015973324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 msgr2=0x563d1356afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47e00640 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1356afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47e00640 1 -- 172.21.15.40:0/2015973324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d13231b00 con 0x563d1319d660 2024-07-26T12:47:08.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47400640 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d1356ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:47:08.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d47e00640 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 0x563d1356b500 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800bd30 tx=0x7f4d3800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2e34229e0cd1fb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d3d200640 1 -- 172.21.15.40:0/2015973324 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38015070 con 0x563d1319d660 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d3d200640 1 -- 172.21.15.40:0/2015973324 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d3800be20 con 0x563d1319d660 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d3d200640 1 -- 172.21.15.40:0/2015973324 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011440 con 0x563d1319d660 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.907+0000 7f4d44c00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d2c0b3bd0 0x7f4d2c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.908+0000 7f4d44c00640 1 -- 172.21.15.40:0/1328464069 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4d40105340 con 0x7f4d48108720 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.908+0000 7f4d47400640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d2c0b3bd0 0x7f4d2c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.908+0000 7f4d5587e740 1 -- 172.21.15.40:0/2015973324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 msgr2=0x563d1356b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.908+0000 7f4d5587e740 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 0x563d1356b500 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800bd30 tx=0x7f4d3800f730 comp rx=0 tx=0).stop 2024-07-26T12:47:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.908+0000 7f4d47400640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d2c0b3bd0 0x7f4d2c0b60e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4d48105920 tx=0x7f4d34004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 -- 172.21.15.40:0/2015973324 shutdown_connections 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d1356ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d1319d660 0x563d1356b500 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 --2- 172.21.15.40:0/2015973324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1356afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 -- 172.21.15.40:0/2015973324 >> 172.21.15.40:0/2015973324 conn(0x563d131ba910 msgr2=0x563d13568eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 -- 172.21.15.40:0/2015973324 shutdown_connections 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 -- 172.21.15.40:0/2015973324 wait complete. 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 -- start start 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.909+0000 7f4d5587e740 1 Processor -- start 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d13576630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131a5840 0x563d13576b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d135770f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563d13334bb0 con 0x563d131c6520 2024-07-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563d1346d910 con 0x563d131a5840 2024-07-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d135797a0 con 0x563d1319d660 2024-07-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d5587e740 10 client.0 _ll_register_callbacks cb 0x563d131ddd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d135770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d135770f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59760/0 (socket says 172.21.15.40:59760) 2024-07-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.910+0000 7f4d4cc00640 1 -- 172.21.15.40:0/3759806094 learned_addr learned my addr 172.21.15.40:0/3759806094 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:47:08.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d47e00640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d13576630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d47400640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131a5840 0x563d13576b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d4cc00640 1 -- 172.21.15.40:0/3759806094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 msgr2=0x563d13576630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d13576630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d4cc00640 1 -- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131a5840 msgr2=0x563d13576b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131a5840 0x563d13576b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d4cc00640 1 -- 172.21.15.40:0/3759806094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d132a8960 con 0x563d131c6520 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d47400640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131a5840 0x563d13576b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d135770f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4d400cbf50 tx=0x7f4d400cbd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71755c325a1c3ab9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d31600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d31600640 1 -- 172.21.15.40:0/3759806094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400d0850 con 0x563d131c6520 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d31600640 1 -- 172.21.15.40:0/3759806094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4d400c8840 con 0x563d131c6520 2024-07-26T12:47:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.911+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3800be20 con 0x563d131c6520 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d31600640 1 -- 172.21.15.40:0/3759806094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4d400d5300 con 0x563d131c6520 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 10 client.16365 fetch_fsmap learned FSMap version 35 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563d135853e0 con 0x563d131c6520 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d31600640 1 -- 172.21.15.40:0/3759806094 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d3800be20 con 0x563d131c6520 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d31600640 1 -- 172.21.15.40:0/3759806094 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4d400d4e70 con 0x563d131c6520 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 10 client.16365 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 10 client.16365 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 20 client.16365 populate_metadata read hostname 'smithi040' 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d13184ea0 0x563d13588930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 4 client.16365 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.912+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d134e3e80 con 0x563d13184ea0 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.913+0000 7f4d47e00640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d13184ea0 0x563d13588930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.914+0000 7f4d47e00640 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d13184ea0 0x563d13588930 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=393850be5b99908f server_cookie=10b0861e27a87171 in_seq=0 out_seq=0 2024-07-26T12:47:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.914+0000 7f4d31600640 10 client.16365 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d31600640 1 -- 172.21.15.40:0/3759806094 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d134e3e80 con 0x563d13184ea0 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d31600640 10 client.16365 handle_command_reply: tid=0 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 client.16365 shutdown 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 msgr2=0x563d135770f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d135770f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4d400cbf50 tx=0x7f4d400cbd60 comp rx=0 tx=0).stop 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 shutdown_connections 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d13184ea0 0x563d13588930 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d135770f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131a5840 0x563d13576b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 --2- 172.21.15.40:0/3759806094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d13576630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 >> 172.21.15.40:0/3759806094 conn(0x563d131ba910 msgr2=0x563d1356e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.916+0000 7f4d31600640 0 client.16365 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:47:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.917+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 shutdown_connections 2024-07-26T12:47:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.917+0000 7f4d5587e740 1 -- 172.21.15.40:0/3759806094 wait complete. 2024-07-26T12:47:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.917+0000 7f4d5587e740 20 client.16365 trim_cache size 0 max 16384 2024-07-26T12:47:08.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.935+0000 7f4d5587e740 1 Processor -- start 2024-07-26T12:47:08.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.935+0000 7f4d5587e740 1 -- start start 2024-07-26T12:47:08.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d1319d660 0x563d13571e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d13577b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d13570050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d5587e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b0f10 con 0x563d131c6520 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d5587e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b2a50 con 0x563d1319d660 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d5587e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b15e0 con 0x563d131a5840 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d13570050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d13570050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59770/0 (socket says 172.21.15.40:59770) 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d4cc00640 1 -- 172.21.15.40:0/54327247 learned_addr learned my addr 172.21.15.40:0/54327247 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d47e00640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d1319d660 0x563d13571e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d47400640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d13577b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.936+0000 7f4d4cc00640 1 -- 172.21.15.40:0/54327247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 msgr2=0x563d13577b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d13577b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d4cc00640 1 -- 172.21.15.40:0/54327247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d1319d660 msgr2=0x563d13571e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d1319d660 0x563d13571e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d4cc00640 1 -- 172.21.15.40:0/54327247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1356de20 con 0x563d131c6520 2024-07-26T12:47:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d47e00640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d1319d660 0x563d13571e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:47:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d47400640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d13577b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:47:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d13570050 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d40033000 tx=0x7f4d4002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891e38581993a9a1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d33e00640 1 -- 172.21.15.40:0/54327247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400cbba0 con 0x563d131c6520 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d33e00640 1 -- 172.21.15.40:0/54327247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d40036020 con 0x563d131c6520 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.937+0000 7f4d33e00640 1 -- 172.21.15.40:0/54327247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400c8600 con 0x563d131c6520 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.938+0000 7f4d5587e740 1 -- 172.21.15.40:0/54327247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 msgr2=0x563d13570050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.938+0000 7f4d5587e740 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d13570050 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d40033000 tx=0x7f4d4002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.938+0000 7f4d5587e740 1 -- 172.21.15.40:0/54327247 shutdown_connections 2024-07-26T12:47:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131c6520 0x563d13570050 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d131a5840 0x563d13577b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 --2- 172.21.15.40:0/54327247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d1319d660 0x563d13571e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 -- 172.21.15.40:0/54327247 >> 172.21.15.40:0/54327247 conn(0x563d131ba910 msgr2=0x563d1356c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 -- 172.21.15.40:0/54327247 shutdown_connections 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 -- 172.21.15.40:0/54327247 wait complete. 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 -- start start 2024-07-26T12:47:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.939+0000 7f4d5587e740 1 Processor -- start 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d1357f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 0x563d1357a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1357aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b2380 con 0x563d131a5840 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b1cb0 con 0x563d131c6520 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481aeed0 con 0x563d1319d660 2024-07-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d5587e740 10 client.0 _ll_register_callbacks cb 0x7f4d400305c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.940+0000 7f4d47400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 0x563d1357a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 0x563d1357a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59772/0 (socket says 172.21.15.40:59772) 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 -- 172.21.15.40:0/1648475713 learned_addr learned my addr 172.21.15.40:0/1648475713 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47e00640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d1357f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d4cc00640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1357aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 -- 172.21.15.40:0/1648475713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 msgr2=0x563d1357f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d1357f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 -- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 msgr2=0x563d1357aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1357aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.941+0000 7f4d47400640 1 -- 172.21.15.40:0/1648475713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d1357b0a0 con 0x563d131a5840 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d47400640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 0x563d1357a4c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4d340117c0 tx=0x7f4d3400c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4104024dd89462e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d31600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:47:08.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d31600640 1 -- 172.21.15.40:0/1648475713 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3401fb80 con 0x563d131a5840 2024-07-26T12:47:08.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d31600640 1 -- 172.21.15.40:0/1648475713 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4d3401fd20 con 0x563d131a5840 2024-07-26T12:47:08.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d40036020 con 0x563d131a5840 2024-07-26T12:47:08.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d31600640 1 -- 172.21.15.40:0/1648475713 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4d34004020 con 0x563d131a5840 2024-07-26T12:47:08.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d5587e740 10 client.16371 fetch_fsmap learned FSMap version 35 2024-07-26T12:47:08.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.942+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563d135f0e90 con 0x563d131a5840 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d31600640 1 -- 172.21.15.40:0/1648475713 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d40036020 con 0x563d131a5840 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d31600640 1 -- 172.21.15.40:0/1648475713 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4d34026070 con 0x563d131a5840 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d5587e740 10 client.16371 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d5587e740 10 client.16371 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d5587e740 20 client.16371 populate_metadata read hostname 'smithi040' 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d5587e740 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d1315a250 0x563d135f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d5587e740 4 client.16371 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf3d366d", "release": true, "await": true}] 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.943+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf3d366d", "release": true, "await": true}) -- 0x563d134df920 con 0x563d1315a250 2024-07-26T12:47:08.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.944+0000 7f4d47e00640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d1315a250 0x563d135f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:47:08.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.945+0000 7f4d47e00640 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d1315a250 0x563d135f36b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc68ab6805fc9fc server_cookie=383eabbc53ffd6fb in_seq=0 out_seq=0 2024-07-26T12:47:08.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.945+0000 7f4d31600640 10 client.16371 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:47:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.994+0000 7f4d31600640 1 -- 172.21.15.40:0/1648475713 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563d134df920 con 0x563d1315a250 2024-07-26T12:47:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.994+0000 7f4d31600640 10 client.16371 handle_command_reply: tid=0 2024-07-26T12:47:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.994+0000 7f4d5587e740 1 client.16371 shutdown 2024-07-26T12:47:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 msgr2=0x563d1357a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 0x563d1357a4c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4d340117c0 tx=0x7f4d3400c3b0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 shutdown_connections 2024-07-26T12:47:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d131c6520 0x563d1357aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563d1315a250 0x563d135f36b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563d131a5840 0x563d1357a4c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 --2- 172.21.15.40:0/1648475713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d1319d660 0x563d1357f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 >> 172.21.15.40:0/1648475713 conn(0x563d131ba910 msgr2=0x563d1356bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.995+0000 7f4d31600640 0 client.16371 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:47:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.996+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 shutdown_connections 2024-07-26T12:47:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.996+0000 7f4d5587e740 1 -- 172.21.15.40:0/1648475713 wait complete. 2024-07-26T12:47:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.996+0000 7f4d5587e740 20 client.16371 trim_cache size 0 max 16384 2024-07-26T12:47:09.002 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:47:09.002 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:47:09.002 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:47:09.002 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 76, 2024-07-26T12:47:09.003 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:47:09.003 INFO:teuthology.orchestra.run.smithi040.stdout: "bf3d366d": { 2024-07-26T12:47:09.003 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 76, 2024-07-26T12:47:09.003 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:47:09.003 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:47:09.003 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:47:09.004 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:47:09.004 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:47:09.004 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:47:09.004 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.0, 2024-07-26T12:47:09.004 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:47:09.005 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:47:09.005 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:47:09.005 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:47:09.005 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:47:09.005 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:47:09.005 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:47:09.006 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:47:09.006 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:47:09.006 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:47:09.006 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:47:09.006 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:47:09.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d2c0b3bd0 msgr2=0x7f4d2c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d2c0b3bd0 0x7f4d2c0b60e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4d48105920 tx=0x7f4d34004730 comp rx=0 tx=0).stop 2024-07-26T12:47:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 msgr2=0x7f4d48110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:47:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d48110460 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4d40005cc0 tx=0x7f4d40032a10 comp rx=0 tx=0).stop 2024-07-26T12:47:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 shutdown_connections 2024-07-26T12:47:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d48108720 0x7f4d48110460 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d2c0b3bd0 0x7f4d2c0b60e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48107dd0 0x7f4d4810ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 --2- 172.21.15.40:0/1328464069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4d48102490 0x7f4d4810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:47:09.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.997+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 >> 172.21.15.40:0/1328464069 conn(0x7f4d48079160 msgr2=0x7f4d48103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:47:09.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.998+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 shutdown_connections 2024-07-26T12:47:09.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:47:08.998+0000 7f4d4ec00640 1 -- 172.21.15.40:0/1328464069 wait complete. 2024-07-26T12:47:09.862 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf3d366d', total seconds elapsed: 35.6 2024-07-26T12:47:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:09 smithi040 ceph-mon[32397]: pgmap v1247: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:47:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:09 smithi146 ceph-mon[35807]: pgmap v1247: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:47:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:09 smithi076 ceph-mon[35401]: pgmap v1247: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:47:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:11 smithi040 ceph-mon[32397]: pgmap v1248: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:47:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:11 smithi146 ceph-mon[35807]: pgmap v1248: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:47:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:11 smithi076 ceph-mon[35401]: pgmap v1248: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:47:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:13 smithi040 ceph-mon[32397]: pgmap v1249: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 476 KiB/s wr, 9 op/s 2024-07-26T12:47:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:13 smithi146 ceph-mon[35807]: pgmap v1249: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 476 KiB/s wr, 9 op/s 2024-07-26T12:47:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:13 smithi076 ceph-mon[35401]: pgmap v1249: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 476 KiB/s wr, 9 op/s 2024-07-26T12:47:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:15 smithi040 ceph-mon[32397]: pgmap v1250: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 KiB/s wr, 11 op/s 2024-07-26T12:47:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:15 smithi146 ceph-mon[35807]: pgmap v1250: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 KiB/s wr, 11 op/s 2024-07-26T12:47:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:15 smithi076 ceph-mon[35401]: pgmap v1250: 97 pgs: 97 active+clean; 4.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 KiB/s wr, 11 op/s 2024-07-26T12:47:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:17 smithi040 ceph-mon[32397]: pgmap v1251: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T12:47:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:17 smithi146 ceph-mon[35807]: pgmap v1251: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T12:47:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:17 smithi076 ceph-mon[35401]: pgmap v1251: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T12:47:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:19 smithi040 ceph-mon[32397]: pgmap v1252: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T12:47:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:19 smithi146 ceph-mon[35807]: pgmap v1252: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T12:47:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:19 smithi076 ceph-mon[35401]: pgmap v1252: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T12:47:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:21 smithi040 ceph-mon[32397]: pgmap v1253: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:47:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:21 smithi146 ceph-mon[35807]: pgmap v1253: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:47:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:21 smithi076 ceph-mon[35401]: pgmap v1253: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:47:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:23 smithi040 ceph-mon[32397]: pgmap v1254: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T12:47:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:23 smithi146 ceph-mon[35807]: pgmap v1254: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T12:47:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:23 smithi076 ceph-mon[35401]: pgmap v1254: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T12:47:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:25 smithi040 ceph-mon[32397]: pgmap v1255: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:47:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:25 smithi146 ceph-mon[35807]: pgmap v1255: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:47:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:25 smithi076 ceph-mon[35401]: pgmap v1255: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:47:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:27 smithi040 ceph-mon[32397]: pgmap v1256: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:47:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:27 smithi146 ceph-mon[35807]: pgmap v1256: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:47:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:27 smithi076 ceph-mon[35401]: pgmap v1256: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:47:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:29 smithi146 ceph-mon[35807]: pgmap v1257: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:47:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:29 smithi076 ceph-mon[35401]: pgmap v1257: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:47:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:29 smithi040 ceph-mon[32397]: pgmap v1257: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:47:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:31 smithi040 ceph-mon[32397]: pgmap v1258: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:47:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:31 smithi146 ceph-mon[35807]: pgmap v1258: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:47:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:31 smithi076 ceph-mon[35401]: pgmap v1258: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:47:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:33 smithi040 ceph-mon[32397]: pgmap v1259: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:47:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:33 smithi146 ceph-mon[35807]: pgmap v1259: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:47:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:33 smithi076 ceph-mon[35401]: pgmap v1259: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:47:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:35 smithi040 ceph-mon[32397]: pgmap v1260: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:47:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:35 smithi146 ceph-mon[35807]: pgmap v1260: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:47:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:35 smithi076 ceph-mon[35401]: pgmap v1260: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:47:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:37 smithi040 ceph-mon[32397]: pgmap v1261: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:47:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:37 smithi146 ceph-mon[35807]: pgmap v1261: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:47:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:37 smithi076 ceph-mon[35401]: pgmap v1261: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:47:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:39 smithi040 ceph-mon[32397]: pgmap v1262: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:47:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:39 smithi146 ceph-mon[35807]: pgmap v1262: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:47:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:39 smithi076 ceph-mon[35401]: pgmap v1262: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:47:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:41 smithi040 ceph-mon[32397]: pgmap v1263: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:47:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:41 smithi146 ceph-mon[35807]: pgmap v1263: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:47:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:41 smithi076 ceph-mon[35401]: pgmap v1263: 97 pgs: 97 active+clean; 4.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:47:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:43 smithi040 ceph-mon[32397]: pgmap v1264: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:47:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:47:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:43 smithi146 ceph-mon[35807]: pgmap v1264: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:47:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:47:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:43 smithi076 ceph-mon[35401]: pgmap v1264: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:47:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:47:45.172 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.172 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.172 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.172 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.218 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.218 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.218 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.218 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:45.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:45 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:47:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:45 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:47:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:45 smithi076 ceph-mon[35401]: pgmap v1265: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:47:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:45 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:47:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:45 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:47:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:45 smithi040 ceph-mon[32397]: pgmap v1265: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:47:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:45 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:47:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:45 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:47:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:45 smithi146 ceph-mon[35807]: pgmap v1265: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:47:48.155 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:47 smithi146 ceph-mon[35807]: pgmap v1266: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:47:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:47 smithi040 ceph-mon[32397]: pgmap v1266: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:47:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:47 smithi076 ceph-mon[35401]: pgmap v1266: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:47:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: pgmap v1267: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:47:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:47:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: pgmap v1267: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:47:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:47:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: pgmap v1267: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:47:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:47:50.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:47:50.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:47:50.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:47:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:50 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:47:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:50 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:47:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:50 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:47:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:50 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:47:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:50 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:47:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:50 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:47:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:51 smithi040 ceph-mon[32397]: pgmap v1268: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:47:52.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:51 smithi076 ceph-mon[35401]: pgmap v1268: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:47:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:51 smithi146 ceph-mon[35807]: pgmap v1268: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:47:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:52 smithi146 ceph-mon[35807]: pgmap v1269: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:47:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:52 smithi076 ceph-mon[35401]: pgmap v1269: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:47:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:52 smithi040 ceph-mon[32397]: pgmap v1269: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:47:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:55 smithi040 ceph-mon[32397]: pgmap v1270: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:47:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:55 smithi146 ceph-mon[35807]: pgmap v1270: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:47:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:55 smithi076 ceph-mon[35401]: pgmap v1270: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:47:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:57 smithi040 ceph-mon[32397]: pgmap v1271: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:47:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:57 smithi146 ceph-mon[35807]: pgmap v1271: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:47:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:57 smithi076 ceph-mon[35401]: pgmap v1271: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:48:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:47:59 smithi040 ceph-mon[32397]: pgmap v1272: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:48:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:47:59 smithi146 ceph-mon[35807]: pgmap v1272: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:48:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:47:59 smithi076 ceph-mon[35401]: pgmap v1272: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:48:01.863 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:48:01.863 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.05 2024-07-26T12:48:01.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:48:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:01 smithi040 ceph-mon[32397]: pgmap v1273: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:48:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:01 smithi146 ceph-mon[35807]: pgmap v1273: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:48:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:01 smithi076 ceph-mon[35401]: pgmap v1273: 97 pgs: 97 active+clean; 4.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:48:02.387 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:03 smithi040 ceph-mon[32397]: pgmap v1274: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:48:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:03 smithi146 ceph-mon[35807]: pgmap v1274: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:48:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:03 smithi076 ceph-mon[35401]: pgmap v1274: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:48:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.917+0000 7f383f200640 1 -- 172.21.15.40:0/3206996548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840101e10 msgr2=0x7f3840102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.917+0000 7f383f200640 1 --2- 172.21.15.40:0/3206996548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840101e10 0x7f3840102220 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3830009900 tx=0x7f383002a480 comp rx=0 tx=0).stop 2024-07-26T12:48:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 -- 172.21.15.40:0/3206996548 shutdown_connections 2024-07-26T12:48:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 --2- 172.21.15.40:0/3206996548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f384010f9c0 0x7f3840111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 --2- 172.21.15.40:0/3206996548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840102760 0x7f384010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 --2- 172.21.15.40:0/3206996548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840101e10 0x7f3840102220 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 -- 172.21.15.40:0/3206996548 >> 172.21.15.40:0/3206996548 conn(0x7f38400fdcf0 msgr2=0x7f3840100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 -- 172.21.15.40:0/3206996548 shutdown_connections 2024-07-26T12:48:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.918+0000 7f383f200640 1 -- 172.21.15.40:0/3206996548 wait complete. 2024-07-26T12:48:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.919+0000 7f383f200640 1 Processor -- start 2024-07-26T12:48:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.919+0000 7f383f200640 1 -- start start 2024-07-26T12:48:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f383f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3840101e10 0x7f384019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f383f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 0x7f384019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f383f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384010f9c0 0x7f38401a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f383f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3840115340 con 0x7f3840102760 2024-07-26T12:48:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f383f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f38401151c0 con 0x7f3840101e10 2024-07-26T12:48:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f383f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38401154c0 con 0x7f384010f9c0 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f3835400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 0x7f384019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f3835400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 0x7f384019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46230/0 (socket says 172.21.15.40:46230) 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.920+0000 7f3835400640 1 -- 172.21.15.40:0/802828444 learned_addr learned my addr 172.21.15.40:0/802828444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f383de00640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3840101e10 0x7f384019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f383e800640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384010f9c0 0x7f38401a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f3835400640 1 -- 172.21.15.40:0/802828444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384010f9c0 msgr2=0x7f38401a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f3835400640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384010f9c0 0x7f38401a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f3835400640 1 -- 172.21.15.40:0/802828444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3840101e10 msgr2=0x7f384019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f3835400640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3840101e10 0x7f384019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.921+0000 7f3835400640 1 -- 172.21.15.40:0/802828444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38401a1d60 con 0x7f3840102760 2024-07-26T12:48:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.922+0000 7f3835400640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 0x7f384019c390 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f382800d770 tx=0x7f382800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.922+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828017070 con 0x7f3840102760 2024-07-26T12:48:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.922+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38280054b0 con 0x7f3840102760 2024-07-26T12:48:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.922+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828004c60 con 0x7f3840102760 2024-07-26T12:48:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.922+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38401a2050 con 0x7f3840102760 2024-07-26T12:48:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.922+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38401a87b0 con 0x7f3840102760 2024-07-26T12:48:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.924+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3840102220 con 0x7f3840102760 2024-07-26T12:48:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.928+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3828004e00 con 0x7f3840102760 2024-07-26T12:48:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.932+0000 7f3837400640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38240b3bd0 0x7f38240b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.933+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f38280e39e0 con 0x7f3840102760 2024-07-26T12:48:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.933+0000 7f383de00640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38240b3bd0 0x7f38240b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.933+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f38281136a0 con 0x7f3840102760 2024-07-26T12:48:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:04.934+0000 7f383de00640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38240b3bd0 0x7f38240b60e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38300057c0 tx=0x7f38300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.221+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f384019cf20 con 0x7f3840102760 2024-07-26T12:48:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.222+0000 7f3837400640 1 -- 172.21.15.40:0/802828444 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f384019cf20 con 0x7f3840102760 2024-07-26T12:48:05.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:48:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:48:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:48:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.225+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38240b3bd0 msgr2=0x7f38240b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.225+0000 7f383f200640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38240b3bd0 0x7f38240b60e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38300057c0 tx=0x7f38300058d0 comp rx=0 tx=0).stop 2024-07-26T12:48:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.225+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 msgr2=0x7f384019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.225+0000 7f383f200640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 0x7f384019c390 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f382800d770 tx=0x7f382800dc30 comp rx=0 tx=0).stop 2024-07-26T12:48:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 shutdown_connections 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f38240b3bd0 0x7f38240b60e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384010f9c0 0x7f38401a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840102760 0x7f384019c390 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 --2- 172.21.15.40:0/802828444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3840101e10 0x7f384019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 >> 172.21.15.40:0/802828444 conn(0x7f38400fdcf0 msgr2=0x7f3840100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 shutdown_connections 2024-07-26T12:48:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:05.226+0000 7f383f200640 1 -- 172.21.15.40:0/802828444 wait complete. 2024-07-26T12:48:06.072 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 142.05 --await-for 45.0' 2024-07-26T12:48:06.073 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 142.05 --await-for 45.0 2024-07-26T12:48:06.144 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:05 smithi040 ceph-mon[32397]: pgmap v1275: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:48:06.145 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:05 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/802828444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:05 smithi146 ceph-mon[35807]: pgmap v1275: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:48:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:05 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/802828444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:05 smithi076 ceph-mon[35401]: pgmap v1275: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:48:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:05 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/802828444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:07 smithi040 ceph-mon[32397]: pgmap v1276: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:48:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:07 smithi146 ceph-mon[35807]: pgmap v1276: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:48:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:07 smithi076 ceph-mon[35401]: pgmap v1276: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.067+0000 7fc458a00640 1 -- 172.21.15.40:0/1209966072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454113cc0 msgr2=0x7fc454116190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.067+0000 7fc458a00640 1 --2- 172.21.15.40:0/1209966072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454113cc0 0x7fc454116190 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009ca0 tx=0x7fc44c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 -- 172.21.15.40:0/1209966072 shutdown_connections 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 --2- 172.21.15.40:0/1209966072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454113cc0 0x7fc454116190 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 --2- 172.21.15.40:0/1209966072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc454075800 0x7fc454075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 --2- 172.21.15.40:0/1209966072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454076db0 0x7fc4540751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 -- 172.21.15.40:0/1209966072 >> 172.21.15.40:0/1209966072 conn(0x7fc4540fee60 msgr2=0x7fc4541012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:09.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 -- 172.21.15.40:0/1209966072 shutdown_connections 2024-07-26T12:48:09.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.068+0000 7fc458a00640 1 -- 172.21.15.40:0/1209966072 wait complete. 2024-07-26T12:48:09.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.069+0000 7fc458a00640 1 Processor -- start 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.069+0000 7fc458a00640 1 -- start start 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc458a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 0x7fc4541a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc458a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc454076db0 0x7fc4541a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc458a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454113cc0 0x7fc4541a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc458a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc454119800 con 0x7fc454075800 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc458a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc454119680 con 0x7fc454076db0 2024-07-26T12:48:09.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc458a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc454119980 con 0x7fc454113cc0 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc452800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 0x7fc4541a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc452800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 0x7fc4541a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46256/0 (socket says 172.21.15.40:46256) 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.070+0000 7fc452800640 1 -- 172.21.15.40:0/215058164 learned_addr learned my addr 172.21.15.40:0/215058164 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc451e00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc454076db0 0x7fc4541a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc452800640 1 -- 172.21.15.40:0/215058164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454113cc0 msgr2=0x7fc4541a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc453200640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454113cc0 0x7fc4541a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc452800640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454113cc0 0x7fc4541a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc452800640 1 -- 172.21.15.40:0/215058164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc454076db0 msgr2=0x7fc4541a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc452800640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc454076db0 0x7fc4541a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc452800640 1 -- 172.21.15.40:0/215058164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4541a6120 con 0x7fc454075800 2024-07-26T12:48:09.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.071+0000 7fc453200640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454113cc0 0x7fc4541a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:48:09.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.072+0000 7fc452800640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 0x7fc4541a01b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc44400d770 tx=0x7fc44400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:09.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.072+0000 7fc44b400640 1 -- 172.21.15.40:0/215058164 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444017070 con 0x7fc454075800 2024-07-26T12:48:09.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.072+0000 7fc44b400640 1 -- 172.21.15.40:0/215058164 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4440054b0 con 0x7fc454075800 2024-07-26T12:48:09.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.072+0000 7fc44b400640 1 -- 172.21.15.40:0/215058164 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444004c60 con 0x7fc454075800 2024-07-26T12:48:09.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.072+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4541a6410 con 0x7fc454075800 2024-07-26T12:48:09.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.072+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541acb70 con 0x7fc454075800 2024-07-26T12:48:09.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.076+0000 7fc4601c6740 1 Processor -- start 2024-07-26T12:48:09.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 -- start start 2024-07-26T12:48:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5792850 0x5638b5b39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5769990 0x5638b5b395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b39ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5638b5aad970 con 0x5638b5771b70 2024-07-26T12:48:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5638b5a9ce70 con 0x5638b5792850 2024-07-26T12:48:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc4601c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5638b5aa0eb0 con 0x5638b5769990 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.077+0000 7fc44b400640 1 -- 172.21.15.40:0/215058164 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc444004e00 con 0x7fc454075800 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.078+0000 7fc451e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b39ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.078+0000 7fc453200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5792850 0x5638b5b39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.078+0000 7fc451e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b39ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46262/0 (socket says 172.21.15.40:46262) 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.078+0000 7fc451e00640 1 -- 172.21.15.40:0/422181670 learned_addr learned my addr 172.21.15.40:0/422181670 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.078+0000 7fc452800640 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5769990 0x5638b5b395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc451e00640 1 -- 172.21.15.40:0/422181670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5769990 msgr2=0x5638b5b395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc451e00640 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5769990 0x5638b5b395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc451e00640 1 -- 172.21.15.40:0/422181670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5792850 msgr2=0x5638b5b39060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc451e00640 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5792850 0x5638b5b39060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc451e00640 1 -- 172.21.15.40:0/422181670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b5a258e0 con 0x5638b5771b70 2024-07-26T12:48:09.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc453200640 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5792850 0x5638b5b39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:48:09.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.079+0000 7fc451e00640 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b39ae0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00bc40 tx=0x7fc43c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6864eb59d1cfd17 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:09.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.080+0000 7fc443400640 1 -- 172.21.15.40:0/422181670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c015070 con 0x5638b5771b70 2024-07-26T12:48:09.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.080+0000 7fc443400640 1 -- 172.21.15.40:0/422181670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc43c01a8f0 con 0x5638b5771b70 2024-07-26T12:48:09.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.080+0000 7fc443400640 1 -- 172.21.15.40:0/422181670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0117c0 con 0x5638b5771b70 2024-07-26T12:48:09.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.080+0000 7fc44b400640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4380b3bc0 0x7fc4380b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.080+0000 7fc44b400640 1 -- 172.21.15.40:0/215058164 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc4440e3710 con 0x7fc454075800 2024-07-26T12:48:09.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.081+0000 7fc453200640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4380b3bc0 0x7fc4380b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.081+0000 7fc4601c6740 1 -- 172.21.15.40:0/422181670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 msgr2=0x5638b5b39ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.081+0000 7fc4601c6740 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b39ae0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00bc40 tx=0x7fc43c00f730 comp rx=0 tx=0).stop 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 -- 172.21.15.40:0/422181670 shutdown_connections 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b39ae0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5769990 0x5638b5b395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 --2- 172.21.15.40:0/422181670 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5792850 0x5638b5b39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 -- 172.21.15.40:0/422181670 >> 172.21.15.40:0/422181670 conn(0x5638b5786c40 msgr2=0x5638b5b36f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc453200640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4380b3bc0 0x7fc4380b60d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009a60 tx=0x7fc44c009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 -- 172.21.15.40:0/422181670 shutdown_connections 2024-07-26T12:48:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.082+0000 7fc4601c6740 1 -- 172.21.15.40:0/422181670 wait complete. 2024-07-26T12:48:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.083+0000 7fc4601c6740 1 -- start start 2024-07-26T12:48:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.083+0000 7fc4601c6740 1 Processor -- start 2024-07-26T12:48:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 0x5638b5b44bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5771b70 0x5638b5b450f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5638b59007b0 con 0x5638b5769990 2024-07-26T12:48:09.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5638b5a39420 con 0x5638b5771b70 2024-07-26T12:48:09.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5638b5b47840 con 0x5638b5792850 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc4601c6740 10 client.0 _ll_register_callbacks cb 0x5638b57aa0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc452800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 0x5638b5b44bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc452800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 0x5638b5b44bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46264/0 (socket says 172.21.15.40:46264) 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.084+0000 7fc452800640 1 -- 172.21.15.40:0/63526598 learned_addr learned my addr 172.21.15.40:0/63526598 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc451e00640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5771b70 0x5638b5b450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc453200640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc452800640 1 -- 172.21.15.40:0/63526598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 msgr2=0x5638b5b50b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc452800640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc452800640 1 -- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5771b70 msgr2=0x5638b5b450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc452800640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5771b70 0x5638b5b450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc452800640 1 -- 172.21.15.40:0/63526598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b5a31c50 con 0x5638b5769990 2024-07-26T12:48:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc452800640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 0x5638b5b44bb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc4440e1210 tx=0x7fc444009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3e3b18b83b3dd3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.085+0000 7fc437e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:48:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.086+0000 7fc437e00640 1 -- 172.21.15.40:0/63526598 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444020070 con 0x5638b5769990 2024-07-26T12:48:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.086+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc43c01a8f0 con 0x5638b5769990 2024-07-26T12:48:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.086+0000 7fc437e00640 1 -- 172.21.15.40:0/63526598 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc4440a68f0 con 0x5638b5769990 2024-07-26T12:48:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.086+0000 7fc437e00640 1 -- 172.21.15.40:0/63526598 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc4440aad60 con 0x5638b5769990 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.086+0000 7fc4601c6740 10 client.16389 fetch_fsmap learned FSMap version 35 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.086+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5638b580cba0 con 0x5638b5769990 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc437e00640 1 -- 172.21.15.40:0/63526598 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc43c01a8f0 con 0x5638b5769990 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc437e00640 1 -- 172.21.15.40:0/63526598 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc4440e3b40 con 0x5638b5769990 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc4601c6740 10 client.16389 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc4601c6740 10 client.16389 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc4601c6740 20 client.16389 populate_metadata read hostname 'smithi040' 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc4601c6740 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b57511d0 0x5638b5b56b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc4601c6740 4 client.16389 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:48:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.087+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638b5aaf8c0 con 0x5638b57511d0 2024-07-26T12:48:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.088+0000 7fc451e00640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b57511d0 0x5638b5b56b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.089+0000 7fc451e00640 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b57511d0 0x5638b5b56b80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61cf5588deb53f87 server_cookie=47791bfaa25495d2 in_seq=0 out_seq=0 2024-07-26T12:48:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.089+0000 7fc437e00640 10 client.16389 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:09.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.091+0000 7fc437e00640 1 -- 172.21.15.40:0/63526598 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638b5aaf8c0 con 0x5638b57511d0 2024-07-26T12:48:09.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.091+0000 7fc437e00640 10 client.16389 handle_command_reply: tid=0 2024-07-26T12:48:09.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.091+0000 7fc4601c6740 1 client.16389 shutdown 2024-07-26T12:48:09.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.091+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 msgr2=0x5638b5b44bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.091+0000 7fc4601c6740 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 0x5638b5b44bb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc4440e1210 tx=0x7fc444009e60 comp rx=0 tx=0).stop 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.091+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 shutdown_connections 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5771b70 0x5638b5b450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b57511d0 0x5638b5b56b80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 --2- 172.21.15.40:0/63526598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5769990 0x5638b5b44bb0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 >> 172.21.15.40:0/63526598 conn(0x5638b5786c40 msgr2=0x5638b5b3c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc437e00640 0 client.16389 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 shutdown_connections 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 1 -- 172.21.15.40:0/63526598 wait complete. 2024-07-26T12:48:09.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.092+0000 7fc4601c6740 20 client.16389 trim_cache size 0 max 16384 2024-07-26T12:48:09.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 Processor -- start 2024-07-26T12:48:09.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 -- start start 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b3f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b3a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541b5140 con 0x5638b5771b70 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541b6c80 con 0x5638b5769990 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.113+0000 7fc4601c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541b5810 con 0x5638b5792850 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b3a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b3a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46276/0 (socket says 172.21.15.40:46276) 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 -- 172.21.15.40:0/413775751 learned_addr learned my addr 172.21.15.40:0/413775751 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc452800640 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc453200640 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 -- 172.21.15.40:0/413775751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 msgr2=0x5638b5b50950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 -- 172.21.15.40:0/413775751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 msgr2=0x5638b5b3f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b3f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.114+0000 7fc451e00640 1 -- 172.21.15.40:0/413775751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b5b46f90 con 0x5638b5771b70 2024-07-26T12:48:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.115+0000 7fc451e00640 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b3a7a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00fc30 tx=0x7fc43c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837fca306769544d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.115+0000 7fc442a00640 1 -- 172.21.15.40:0/413775751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c015040 con 0x5638b5771b70 2024-07-26T12:48:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.115+0000 7fc442a00640 1 -- 172.21.15.40:0/413775751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc43c02a020 con 0x5638b5771b70 2024-07-26T12:48:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.115+0000 7fc442a00640 1 -- 172.21.15.40:0/413775751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0048e0 con 0x5638b5771b70 2024-07-26T12:48:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 -- 172.21.15.40:0/413775751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 msgr2=0x5638b5b3a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b3a7a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00fc30 tx=0x7fc43c00bfd0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 -- 172.21.15.40:0/413775751 shutdown_connections 2024-07-26T12:48:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5792850 0x5638b5b50950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5771b70 0x5638b5b3a7a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 --2- 172.21.15.40:0/413775751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b3f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.116+0000 7fc4601c6740 1 -- 172.21.15.40:0/413775751 >> 172.21.15.40:0/413775751 conn(0x5638b5786c40 msgr2=0x5638b5b3a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.117+0000 7fc4601c6740 1 -- 172.21.15.40:0/413775751 shutdown_connections 2024-07-26T12:48:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.117+0000 7fc4601c6740 1 -- 172.21.15.40:0/413775751 wait complete. 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.117+0000 7fc4601c6740 1 -- start start 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.117+0000 7fc4601c6740 1 Processor -- start 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b4d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5771b70 0x5638b5b48590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 0x5638b5b48ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541b65b0 con 0x5638b5792850 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541b5ee0 con 0x5638b5769990 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541b3100 con 0x5638b5771b70 2024-07-26T12:48:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc4601c6740 10 client.0 _ll_register_callbacks cb 0x7fc44400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:48:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc453200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 0x5638b5b48ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.118+0000 7fc453200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 0x5638b5b48ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46290/0 (socket says 172.21.15.40:46290) 2024-07-26T12:48:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc453200640 1 -- 172.21.15.40:0/1509425759 learned_addr learned my addr 172.21.15.40:0/1509425759 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc451e00640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5771b70 0x5638b5b48590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc452800640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b4d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc453200640 1 -- 172.21.15.40:0/1509425759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5771b70 msgr2=0x5638b5b48590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc453200640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5771b70 0x5638b5b48590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc453200640 1 -- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 msgr2=0x5638b5b4d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc453200640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b4d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.119+0000 7fc453200640 1 -- 172.21.15.40:0/1509425759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b5b491c0 con 0x5638b5792850 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.120+0000 7fc453200640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 0x5638b5b48ad0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009ca0 tx=0x7fc44c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cea3f8e9a532ab server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.120+0000 7fc437e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:48:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.120+0000 7fc437e00640 1 -- 172.21.15.40:0/1509425759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c055060 con 0x5638b5792850 2024-07-26T12:48:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.120+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc43c02a020 con 0x5638b5792850 2024-07-26T12:48:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.120+0000 7fc437e00640 1 -- 172.21.15.40:0/1509425759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc44c003970 con 0x5638b5792850 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc437e00640 1 -- 172.21.15.40:0/1509425759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc44c031780 con 0x5638b5792850 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 10 client.16395 fetch_fsmap learned FSMap version 35 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5638b5bbf210 con 0x5638b5792850 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc437e00640 1 -- 172.21.15.40:0/1509425759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc43c02a020 con 0x5638b5792850 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc437e00640 1 -- 172.21.15.40:0/1509425759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc44c043040 con 0x5638b5792850 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 10 client.16395 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 10 client.16395 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 20 client.16395 populate_metadata read hostname 'smithi040' 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b5726580 0x5638b5bc1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.121+0000 7fc4601c6740 4 client.16395 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.05, "await_for": 45.0}] 2024-07-26T12:48:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.122+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.05, "await_for": 45.0}) -- 0x5638b5aab360 con 0x5638b5726580 2024-07-26T12:48:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.122+0000 7fc452800640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b5726580 0x5638b5bc1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.123+0000 7fc452800640 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b5726580 0x5638b5bc1a50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=392097f6b130104c server_cookie=dbf743a91d1cbd9e in_seq=0 out_seq=0 2024-07-26T12:48:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.123+0000 7fc437e00640 10 client.16395 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:09.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.377+0000 7fc437e00640 1 -- 172.21.15.40:0/1509425759 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5638b5aab360 con 0x5638b5726580 2024-07-26T12:48:09.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.377+0000 7fc437e00640 10 client.16395 handle_command_reply: tid=0 2024-07-26T12:48:09.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.377+0000 7fc4601c6740 1 client.16395 shutdown 2024-07-26T12:48:09.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 msgr2=0x5638b5b48ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 0x5638b5b48ad0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009ca0 tx=0x7fc44c0095c0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 shutdown_connections 2024-07-26T12:48:09.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5638b5726580 0x5638b5bc1a50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5638b5792850 0x5638b5b48ad0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638b5771b70 0x5638b5b48590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 --2- 172.21.15.40:0/1509425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638b5769990 0x5638b5b4d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 >> 172.21.15.40:0/1509425759 conn(0x5638b5786c40 msgr2=0x5638b5b45e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:09.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.378+0000 7fc437e00640 0 client.16395 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:09.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.379+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 shutdown_connections 2024-07-26T12:48:09.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.379+0000 7fc4601c6740 1 -- 172.21.15.40:0/1509425759 wait complete. 2024-07-26T12:48:09.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.379+0000 7fc4601c6740 20 client.16395 trim_cache size 0 max 16384 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 78, 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "4df55605": { 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 78, 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:48:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.1, 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:09.384 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:09.384 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:09.384 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:48:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4380b3bc0 msgr2=0x7fc4380b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4380b3bc0 0x7fc4380b60d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009a60 tx=0x7fc44c009890 comp rx=0 tx=0).stop 2024-07-26T12:48:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 msgr2=0x7fc4541a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 0x7fc4541a01b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc44400d770 tx=0x7fc44400dc30 comp rx=0 tx=0).stop 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 shutdown_connections 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4380b3bc0 0x7fc4380b60d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc454113cc0 0x7fc4541a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc454076db0 0x7fc4541a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 --2- 172.21.15.40:0/215058164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc454075800 0x7fc4541a01b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.381+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 >> 172.21.15.40:0/215058164 conn(0x7fc4540fee60 msgr2=0x7fc45410fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.382+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 shutdown_connections 2024-07-26T12:48:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:09.382+0000 7fc458a00640 1 -- 172.21.15.40:0/215058164 wait complete. 2024-07-26T12:48:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:09 smithi040 ceph-mon[32397]: pgmap v1277: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:48:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:09 smithi146 ceph-mon[35807]: pgmap v1277: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:48:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:09 smithi076 ceph-mon[35401]: pgmap v1277: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:48:10.361 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4df55605', quiesce took 8.5 seconds. Will release after: 13.55 2024-07-26T12:48:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:11 smithi040 ceph-mon[32397]: pgmap v1278: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:48:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:11 smithi146 ceph-mon[35807]: pgmap v1278: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:48:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:11 smithi076 ceph-mon[35401]: pgmap v1278: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:48:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:13 smithi040 ceph-mon[32397]: pgmap v1279: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:48:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:13 smithi146 ceph-mon[35807]: pgmap v1279: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:48:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:13 smithi076 ceph-mon[35401]: pgmap v1279: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:48:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:15 smithi040 ceph-mon[32397]: pgmap v1280: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:48:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:15 smithi146 ceph-mon[35807]: pgmap v1280: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:48:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:15 smithi076 ceph-mon[35401]: pgmap v1280: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:48:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:17 smithi040 ceph-mon[32397]: pgmap v1281: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:48:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:17 smithi146 ceph-mon[35807]: pgmap v1281: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:48:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:17 smithi076 ceph-mon[35401]: pgmap v1281: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:48:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:19 smithi040 ceph-mon[32397]: pgmap v1282: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T12:48:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:19 smithi146 ceph-mon[35807]: pgmap v1282: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T12:48:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:19 smithi076 ceph-mon[35401]: pgmap v1282: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T12:48:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:21 smithi146 ceph-mon[35807]: pgmap v1283: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T12:48:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:21 smithi040 ceph-mon[32397]: pgmap v1283: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T12:48:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:21 smithi076 ceph-mon[35401]: pgmap v1283: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T12:48:23.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:48:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:23 smithi040 ceph-mon[32397]: pgmap v1284: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T12:48:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:23 smithi146 ceph-mon[35807]: pgmap v1284: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T12:48:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:23 smithi076 ceph-mon[35401]: pgmap v1284: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T12:48:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:26.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:25 smithi040 ceph-mon[32397]: pgmap v1285: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 585 KiB/s wr, 12 op/s 2024-07-26T12:48:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:25 smithi146 ceph-mon[35807]: pgmap v1285: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 585 KiB/s wr, 12 op/s 2024-07-26T12:48:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:25 smithi076 ceph-mon[35401]: pgmap v1285: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 585 KiB/s wr, 12 op/s 2024-07-26T12:48:26.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 -- 172.21.15.40:0/3326241665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 msgr2=0x7f6b30109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:26.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3326241665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b30109e00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009900 tx=0x7f6b2402a400 comp rx=0 tx=0).stop 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 -- 172.21.15.40:0/3326241665 shutdown_connections 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3326241665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3010fc80 0x7f6b301164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3326241665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b3010f330 0x7f6b3010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3326241665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b30109e00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 -- 172.21.15.40:0/3326241665 >> 172.21.15.40:0/3326241665 conn(0x7f6b30078ff0 msgr2=0x7f6b30107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 -- 172.21.15.40:0/3326241665 shutdown_connections 2024-07-26T12:48:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.717+0000 7f6b36e00640 1 -- 172.21.15.40:0/3326241665 wait complete. 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 Processor -- start 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 -- start start 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b301a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3010f330 0x7f6b301a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b3010fc80 0x7f6b301a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301197f0 con 0x7f6b301099f0 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30119670 con 0x7f6b3010fc80 2024-07-26T12:48:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.719+0000 7f6b36e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30119970 con 0x7f6b3010f330 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b301a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b301a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39682/0 (socket says 172.21.15.40:39682) 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 -- 172.21.15.40:0/3584601689 learned_addr learned my addr 172.21.15.40:0/3584601689 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35000640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3010f330 0x7f6b301a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b36400640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b3010fc80 0x7f6b301a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 -- 172.21.15.40:0/3584601689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3010f330 msgr2=0x7f6b301a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3010f330 0x7f6b301a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 -- 172.21.15.40:0/3584601689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b3010fc80 msgr2=0x7f6b301a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:26.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b3010fc80 0x7f6b301a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.720+0000 7f6b35a00640 1 -- 172.21.15.40:0/3584601689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b301a6130 con 0x7f6b301099f0 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.721+0000 7f6b35a00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b301a0280 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009a20 tx=0x7f6b24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.721+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2403f030 con 0x7f6b301099f0 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.721+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b240035f0 con 0x7f6b301099f0 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.721+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24035070 con 0x7f6b301099f0 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.721+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b301a63c0 con 0x7f6b301099f0 2024-07-26T12:48:26.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.721+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b301a6850 con 0x7f6b301099f0 2024-07-26T12:48:26.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.723+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b30109e00 con 0x7f6b301099f0 2024-07-26T12:48:26.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.725+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6b24003aa0 con 0x7f6b301099f0 2024-07-26T12:48:26.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.727+0000 7f6b2e000640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6b180b3c00 0x7f6b180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:26.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.727+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6b24104c50 con 0x7f6b301099f0 2024-07-26T12:48:26.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.727+0000 7f6b35000640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6b180b3c00 0x7f6b180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:26.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.728+0000 7f6b35000640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6b180b3c00 0x7f6b180b6110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c005e10 tx=0x7f6b1c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:26.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.729+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6b240cc260 con 0x7f6b301099f0 2024-07-26T12:48:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.969+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b301a13b0 con 0x7f6b301099f0 2024-07-26T12:48:26.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.971+0000 7f6b2e000640 1 -- 172.21.15.40:0/3584601689 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f6b301a13b0 con 0x7f6b301099f0 2024-07-26T12:48:26.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:48:26.973 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:48:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:48:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.973+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6b180b3c00 msgr2=0x7f6b180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.973+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6b180b3c00 0x7f6b180b6110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c005e10 tx=0x7f6b1c005da0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 msgr2=0x7f6b301a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b301a0280 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009a20 tx=0x7f6b24004270 comp rx=0 tx=0).stop 2024-07-26T12:48:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 shutdown_connections 2024-07-26T12:48:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b3010fc80 0x7f6b301a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6b180b3c00 0x7f6b180b6110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3010f330 0x7f6b301a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 --2- 172.21.15.40:0/3584601689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b301099f0 0x7f6b301a0280 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 >> 172.21.15.40:0/3584601689 conn(0x7f6b30078ff0 msgr2=0x7f6b30107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 shutdown_connections 2024-07-26T12:48:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:26.974+0000 7f6b36e00640 1 -- 172.21.15.40:0/3584601689 wait complete. 2024-07-26T12:48:27.737 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 4df55605 --release --await' 2024-07-26T12:48:27.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 4df55605 --release --await 2024-07-26T12:48:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:27 smithi040 ceph-mon[32397]: pgmap v1286: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 584 KiB/s wr, 8 op/s 2024-07-26T12:48:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:27 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3584601689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:27 smithi146 ceph-mon[35807]: pgmap v1286: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 584 KiB/s wr, 8 op/s 2024-07-26T12:48:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:27 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3584601689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:27 smithi076 ceph-mon[35401]: pgmap v1286: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 584 KiB/s wr, 8 op/s 2024-07-26T12:48:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:27 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3584601689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:30.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:29 smithi040 ceph-mon[32397]: pgmap v1287: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 242 KiB/s wr, 11 op/s 2024-07-26T12:48:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:29 smithi146 ceph-mon[35807]: pgmap v1287: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 242 KiB/s wr, 11 op/s 2024-07-26T12:48:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:29 smithi076 ceph-mon[35401]: pgmap v1287: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 242 KiB/s wr, 11 op/s 2024-07-26T12:48:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 -- 172.21.15.40:0/3627260320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 msgr2=0x7f56281059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 --2- 172.21.15.40:0/3627260320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f56281059e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f561c009900 tx=0x7f561c02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 -- 172.21.15.40:0/3627260320 shutdown_connections 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 --2- 172.21.15.40:0/3627260320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f562810b860 0x7f5628112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 --2- 172.21.15.40:0/3627260320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f562810af10 0x7f562810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 --2- 172.21.15.40:0/3627260320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f56281059e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.471+0000 7f562e000640 1 -- 172.21.15.40:0/3627260320 >> 172.21.15.40:0/3627260320 conn(0x7f5628101040 msgr2=0x7f5628103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.472+0000 7f562e000640 1 -- 172.21.15.40:0/3627260320 shutdown_connections 2024-07-26T12:48:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.472+0000 7f562e000640 1 -- 172.21.15.40:0/3627260320 wait complete. 2024-07-26T12:48:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.473+0000 7f562e000640 1 Processor -- start 2024-07-26T12:48:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.473+0000 7f562e000640 1 -- start start 2024-07-26T12:48:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.473+0000 7f562e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f562819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.473+0000 7f562e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f562810af10 0x7f562819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562e000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f562810b860 0x7f56281a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562e000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56281153c0 con 0x7f56281055d0 2024-07-26T12:48:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562e000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5628115240 con 0x7f562810b860 2024-07-26T12:48:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562e000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5628115540 con 0x7f562810af10 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f562819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f562819bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39702/0 (socket says 172.21.15.40:39702) 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562cc00640 1 -- 172.21.15.40:0/955156693 learned_addr learned my addr 172.21.15.40:0/955156693 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f5627e00640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f562810af10 0x7f562819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562d600640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f562810b860 0x7f56281a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562cc00640 1 -- 172.21.15.40:0/955156693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f562810af10 msgr2=0x7f562819c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.474+0000 7f562cc00640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f562810af10 0x7f562819c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f562cc00640 1 -- 172.21.15.40:0/955156693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f562810b860 msgr2=0x7f56281a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f562cc00640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f562810b860 0x7f56281a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f562cc00640 1 -- 172.21.15.40:0/955156693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56281a1dc0 con 0x7f56281055d0 2024-07-26T12:48:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f562cc00640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f562819bf10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f561c009a20 tx=0x7f561c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f5625600640 1 -- 172.21.15.40:0/955156693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c03f030 con 0x7f56281055d0 2024-07-26T12:48:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f5625600640 1 -- 172.21.15.40:0/955156693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f561c0035f0 con 0x7f56281055d0 2024-07-26T12:48:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f5625600640 1 -- 172.21.15.40:0/955156693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c035070 con 0x7f56281055d0 2024-07-26T12:48:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.475+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56281a2050 con 0x7f56281055d0 2024-07-26T12:48:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.476+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56281a2580 con 0x7f56281055d0 2024-07-26T12:48:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.479+0000 7f56363e4740 1 Processor -- start 2024-07-26T12:48:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.479+0000 7f56363e4740 1 -- start start 2024-07-26T12:48:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f56363e4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcc9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f5625600640 1 -- 172.21.15.40:0/955156693 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f561c003aa0 con 0x7f56281055d0 2024-07-26T12:48:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f56363e4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcc96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f56363e4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcc9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f56363e4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b9bfc3ff30 con 0x55b9bf8fb660 2024-07-26T12:48:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f56363e4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b9bfc2f430 con 0x55b9bf924520 2024-07-26T12:48:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f56363e4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b9bfc33470 con 0x55b9bf903840 2024-07-26T12:48:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f562cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcc96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f562cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcc96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39714/0 (socket says 172.21.15.40:39714) 2024-07-26T12:48:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f562cc00640 1 -- 172.21.15.40:0/2953249680 learned_addr learned my addr 172.21.15.40:0/2953249680 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.480+0000 7f562d600640 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcc9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f5627e00640 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcc9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562cc00640 1 -- 172.21.15.40:0/2953249680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 msgr2=0x55b9bfcc9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562cc00640 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcc9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562cc00640 1 -- 172.21.15.40:0/2953249680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 msgr2=0x55b9bfcc9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562cc00640 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcc9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562cc00640 1 -- 172.21.15.40:0/2953249680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9bf98fb00 con 0x55b9bf8fb660 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562d600640 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcc9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.481+0000 7f562cc00640 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcc96c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f561c10c560 tx=0x7f561c10c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf5ddd96598cbb4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.482+0000 7f5625600640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56100b3c80 0x7f56100b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.482+0000 7f5619c00640 1 -- 172.21.15.40:0/2953249680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0c79c0 con 0x55b9bf8fb660 2024-07-26T12:48:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.482+0000 7f5619c00640 1 -- 172.21.15.40:0/2953249680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f561c111030 con 0x55b9bf8fb660 2024-07-26T12:48:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.482+0000 7f5619c00640 1 -- 172.21.15.40:0/2953249680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0caae0 con 0x55b9bf8fb660 2024-07-26T12:48:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.482+0000 7f562d600640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56100b3c80 0x7f56100b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.482+0000 7f5625600640 1 -- 172.21.15.40:0/955156693 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f561c104460 con 0x7f56281055d0 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 -- 172.21.15.40:0/2953249680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 msgr2=0x55b9bfcc96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcc96c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f561c10c560 tx=0x7f561c10c650 comp rx=0 tx=0).stop 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f562d600640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56100b3c80 0x7f56100b6190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f56200073f0 tx=0x7f5620007380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 -- 172.21.15.40:0/2953249680 shutdown_connections 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcc9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcc96c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 --2- 172.21.15.40:0/2953249680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcc9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 -- 172.21.15.40:0/2953249680 >> 172.21.15.40:0/2953249680 conn(0x55b9bf918910 msgr2=0x55b9bfcc7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 -- 172.21.15.40:0/2953249680 shutdown_connections 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.483+0000 7f56363e4740 1 -- 172.21.15.40:0/2953249680 wait complete. 2024-07-26T12:48:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.484+0000 7f56363e4740 1 -- start start 2024-07-26T12:48:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.484+0000 7f56363e4740 1 Processor -- start 2024-07-26T12:48:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 0x55b9bfcd4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcd52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b9bfa92bb0 con 0x55b9bf903840 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b9bfbcb910 con 0x55b9bf924520 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b9bfcd7720 con 0x55b9bf8fb660 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f56363e4740 10 client.0 _ll_register_callbacks cb 0x55b9bf93bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f5627e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 0x55b9bfcd4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f5627e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 0x55b9bfcd4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39726/0 (socket says 172.21.15.40:39726) 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f5627e00640 1 -- 172.21.15.40:0/3580113439 learned_addr learned my addr 172.21.15.40:0/3580113439 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f562d600640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcd52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.485+0000 7f562cc00640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f5627e00640 1 -- 172.21.15.40:0/3580113439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 msgr2=0x55b9bfcd47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f5627e00640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f5627e00640 1 -- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 msgr2=0x55b9bfcd52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f5627e00640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcd52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f5627e00640 1 -- 172.21.15.40:0/3580113439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9bfa06960 con 0x55b9bf903840 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f5627e00640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 0x55b9bfcd4d20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f561400efd0 tx=0x7f5614010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672d79cc987a8cb1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f560e000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f560e000640 1 -- 172.21.15.40:0/3580113439 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614004220 con 0x55b9bf903840 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f560e000640 1 -- 172.21.15.40:0/3580113439 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f56140043c0 con 0x55b9bf903840 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.486+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f561c111030 con 0x55b9bf903840 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.487+0000 7f560e000640 1 -- 172.21.15.40:0/3580113439 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f561400c910 con 0x55b9bf903840 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.487+0000 7f56363e4740 10 client.16413 fetch_fsmap learned FSMap version 35 2024-07-26T12:48:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.487+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b9bfce33e0 con 0x55b9bf903840 2024-07-26T12:48:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.487+0000 7f560e000640 1 -- 172.21.15.40:0/3580113439 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f561c111030 con 0x55b9bf903840 2024-07-26T12:48:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.487+0000 7f560e000640 1 -- 172.21.15.40:0/3580113439 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f56140047a0 con 0x55b9bf903840 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.487+0000 7f56363e4740 10 client.16413 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.488+0000 7f56363e4740 10 client.16413 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.488+0000 7f56363e4740 20 client.16413 populate_metadata read hostname 'smithi040' 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.488+0000 7f56363e4740 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8e2ea0 0x55b9bfce6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.488+0000 7f56363e4740 4 client.16413 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.488+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9bfc41e80 con 0x55b9bf8e2ea0 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.488+0000 7f562cc00640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8e2ea0 0x55b9bfce6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.489+0000 7f562cc00640 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8e2ea0 0x55b9bfce6950 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=906e0b6e0faaf77d server_cookie=ce04343433f116d7 in_seq=0 out_seq=0 2024-07-26T12:48:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.489+0000 7f560e000640 10 client.16413 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.491+0000 7f560e000640 1 -- 172.21.15.40:0/3580113439 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9bfc41e80 con 0x55b9bf8e2ea0 2024-07-26T12:48:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.491+0000 7f560e000640 10 client.16413 handle_command_reply: tid=0 2024-07-26T12:48:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.491+0000 7f56363e4740 1 client.16413 shutdown 2024-07-26T12:48:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 msgr2=0x55b9bfcd4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 0x55b9bfcd4d20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f561400efd0 tx=0x7f5614010b60 comp rx=0 tx=0).stop 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 shutdown_connections 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfcd52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8e2ea0 0x55b9bfce6950 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf903840 0x55b9bfcd4d20 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 --2- 172.21.15.40:0/3580113439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 >> 172.21.15.40:0/3580113439 conn(0x55b9bf918910 msgr2=0x55b9bfccc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f560e000640 0 client.16413 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 shutdown_connections 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 1 -- 172.21.15.40:0/3580113439 wait complete. 2024-07-26T12:48:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.492+0000 7f56363e4740 20 client.16413 trim_cache size 0 max 16384 2024-07-26T12:48:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.511+0000 7f56363e4740 1 Processor -- start 2024-07-26T12:48:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.511+0000 7f56363e4740 1 -- start start 2024-07-26T12:48:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f56363e4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfccffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f56363e4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf903840 0x55b9bfcdff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f56363e4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 0x55b9bfce0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f56363e4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56281b0e50 con 0x55b9bf924520 2024-07-26T12:48:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f56363e4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f56281b2990 con 0x55b9bf903840 2024-07-26T12:48:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f56363e4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56281b1520 con 0x55b9bf8fb660 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f562d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 0x55b9bfce0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f562d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 0x55b9bfce0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39734/0 (socket says 172.21.15.40:39734) 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.512+0000 7f562d600640 1 -- 172.21.15.40:0/1176696806 learned_addr learned my addr 172.21.15.40:0/1176696806 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f5627e00640 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf903840 0x55b9bfcdff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562cc00640 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfccffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562d600640 1 -- 172.21.15.40:0/1176696806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 msgr2=0x55b9bfccffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562d600640 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfccffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562d600640 1 -- 172.21.15.40:0/1176696806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf903840 msgr2=0x55b9bfcdff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562d600640 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf903840 0x55b9bfcdff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562d600640 1 -- 172.21.15.40:0/1176696806 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9bfccb470 con 0x55b9bf924520 2024-07-26T12:48:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.513+0000 7f562d600640 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 0x55b9bfce0440 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5620011760 tx=0x7f5620013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28449a0ebeaaa04b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.514+0000 7f5619200640 1 -- 172.21.15.40:0/1176696806 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562001e8f0 con 0x55b9bf924520 2024-07-26T12:48:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.514+0000 7f5619200640 1 -- 172.21.15.40:0/1176696806 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f562001f430 con 0x55b9bf924520 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.514+0000 7f5619200640 1 -- 172.21.15.40:0/1176696806 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620027630 con 0x55b9bf924520 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 -- 172.21.15.40:0/1176696806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 msgr2=0x55b9bfce0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 0x55b9bfce0440 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5620011760 tx=0x7f5620013000 comp rx=0 tx=0).stop 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 -- 172.21.15.40:0/1176696806 shutdown_connections 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf924520 0x55b9bfce0440 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf903840 0x55b9bfcdff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 --2- 172.21.15.40:0/1176696806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf8fb660 0x55b9bfccffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 -- 172.21.15.40:0/1176696806 >> 172.21.15.40:0/1176696806 conn(0x55b9bf918910 msgr2=0x55b9bfcdf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 -- 172.21.15.40:0/1176696806 shutdown_connections 2024-07-26T12:48:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 -- 172.21.15.40:0/1176696806 wait complete. 2024-07-26T12:48:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.515+0000 7f56363e4740 1 -- start start 2024-07-26T12:48:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 Processor -- start 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcd9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfd48280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56281b22c0 con 0x55b9bf8fb660 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f56281b1bf0 con 0x55b9bf924520 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56281aee10 con 0x55b9bf903840 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.516+0000 7f56363e4740 10 client.0 _ll_register_callbacks cb 0x7f561400e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39750/0 (socket says 172.21.15.40:39750) 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 -- 172.21.15.40:0/3628956554 learned_addr learned my addr 172.21.15.40:0/3628956554 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562d600640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfd48280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f5627e00640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcd9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 -- 172.21.15.40:0/3628956554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 msgr2=0x55b9bfcd9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcd9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 -- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 msgr2=0x55b9bfd48280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfd48280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 -- 172.21.15.40:0/3628956554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9bfd488f0 con 0x55b9bf8fb660 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562d600640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfd48280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f562cc00640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd9390 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f561c0cb070 tx=0x7f561c1046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a00662db8697ccf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.517+0000 7f560e000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f560e000640 1 -- 172.21.15.40:0/3628956554 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c049040 con 0x55b9bf8fb660 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f560e000640 1 -- 172.21.15.40:0/3628956554 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f561c10c150 con 0x55b9bf8fb660 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562001f430 con 0x55b9bf8fb660 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f560e000640 1 -- 172.21.15.40:0/3628956554 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f561c0cacc0 con 0x55b9bf8fb660 2024-07-26T12:48:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f56363e4740 10 client.16419 fetch_fsmap learned FSMap version 35 2024-07-26T12:48:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b9bfd4fd20 con 0x55b9bf8fb660 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.518+0000 7f560e000640 1 -- 172.21.15.40:0/3628956554 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f562001f430 con 0x55b9bf8fb660 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f560e000640 1 -- 172.21.15.40:0/3628956554 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f561c101fa0 con 0x55b9bf8fb660 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f56363e4740 10 client.16419 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f56363e4740 10 client.16419 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f56363e4740 20 client.16419 populate_metadata read hostname 'smithi040' 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f56363e4740 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8b8250 0x55b9bfd52320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f56363e4740 4 client.16419 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4df55605", "release": true, "await": true}] 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4df55605", "release": true, "await": true}) -- 0x55b9bfc3d920 con 0x55b9bf8b8250 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.519+0000 7f5627e00640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8b8250 0x55b9bfd52320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.520+0000 7f5627e00640 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8b8250 0x55b9bfd52320 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4527e2a76687ddf server_cookie=cd51d296b86d4619 in_seq=0 out_seq=0 2024-07-26T12:48:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.520+0000 7f560e000640 10 client.16419 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:30.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f560e000640 1 -- 172.21.15.40:0/3628956554 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b9bfc3d920 con 0x55b9bf8b8250 2024-07-26T12:48:30.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f560e000640 10 client.16419 handle_command_reply: tid=0 2024-07-26T12:48:30.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f56363e4740 1 client.16419 shutdown 2024-07-26T12:48:30.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 msgr2=0x55b9bfcd9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f56363e4740 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd9390 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f561c0cb070 tx=0x7f561c1046e0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 shutdown_connections 2024-07-26T12:48:30.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f56363e4740 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b9bf924520 0x55b9bfd48280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.580+0000 7f56363e4740 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9bf903840 0x55b9bfcd9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.581+0000 7f56363e4740 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b9bf8b8250 0x55b9bfd52320 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.581+0000 7f56363e4740 1 --2- 172.21.15.40:0/3628956554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b9bf8fb660 0x55b9bfcd9390 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.581+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 >> 172.21.15.40:0/3628956554 conn(0x55b9bf918910 msgr2=0x55b9bfce01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.581+0000 7f560e000640 0 client.16419 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.581+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 shutdown_connections 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.581+0000 7f56363e4740 1 -- 172.21.15.40:0/3628956554 wait complete. 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.582+0000 7f56363e4740 20 client.16419 trim_cache size 0 max 16384 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 80, 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "4df55605": { 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 80, 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.1, 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.583+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56100b3c80 msgr2=0x7f56100b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.583+0000 7f562e000640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56100b3c80 0x7f56100b6190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f56200073f0 tx=0x7f5620007380 comp rx=0 tx=0).stop 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.583+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 msgr2=0x7f562819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.583+0000 7f562e000640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f562819bf10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f561c009a20 tx=0x7f561c004270 comp rx=0 tx=0).stop 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 shutdown_connections 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f562810b860 0x7f56281a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56100b3c80 0x7f56100b6190 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f562810af10 0x7f562819c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 --2- 172.21.15.40:0/955156693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56281055d0 0x7f562819bf10 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:30.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 >> 172.21.15.40:0/955156693 conn(0x7f5628101040 msgr2=0x7f5628103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:30.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 shutdown_connections 2024-07-26T12:48:30.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:30.584+0000 7f562e000640 1 -- 172.21.15.40:0/955156693 wait complete. 2024-07-26T12:48:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:30 smithi040 ceph-mon[32397]: pgmap v1288: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:48:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:30 smithi146 ceph-mon[35807]: pgmap v1288: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:48:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:30 smithi076 ceph-mon[35401]: pgmap v1288: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:48:31.539 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4df55605', total seconds elapsed: 29.7 2024-07-26T12:48:31.539 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.05 2024-07-26T12:48:31.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:48:32.060 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:34.051 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:33 smithi040 ceph-mon[32397]: pgmap v1289: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:48:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:33 smithi146 ceph-mon[35807]: pgmap v1289: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:48:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:33 smithi076 ceph-mon[35401]: pgmap v1289: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:48:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 -- 172.21.15.40:0/1132243971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 msgr2=0x7f09ac10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 --2- 172.21.15.40:0/1132243971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac10fd30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009ca0 tx=0x7f09a402a8e0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 -- 172.21.15.40:0/1132243971 shutdown_connections 2024-07-26T12:48:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 --2- 172.21.15.40:0/1132243971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac10fd30 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 --2- 172.21.15.40:0/1132243971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09ac104ca0 0x7f09ac10d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 --2- 172.21.15.40:0/1132243971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09ac104270 0x7f09ac104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.379+0000 7f09b4000640 1 -- 172.21.15.40:0/1132243971 >> 172.21.15.40:0/1132243971 conn(0x7f09ac079190 msgr2=0x7f09ac0795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.380+0000 7f09b4000640 1 -- 172.21.15.40:0/1132243971 shutdown_connections 2024-07-26T12:48:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.380+0000 7f09b4000640 1 -- 172.21.15.40:0/1132243971 wait complete. 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.381+0000 7f09b4000640 1 Processor -- start 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.381+0000 7f09b4000640 1 -- start start 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b4000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09ac104270 0x7f09ac19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b4000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09ac104ca0 0x7f09ac19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b4000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b4000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac1133b0 con 0x7f09ac10d820 2024-07-26T12:48:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b4000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac113230 con 0x7f09ac104ca0 2024-07-26T12:48:34.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b4000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac113530 con 0x7f09ac104270 2024-07-26T12:48:34.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.382+0000 7f09b2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:34.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac1a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50662/0 (socket says 172.21.15.40:50662) 2024-07-26T12:48:34.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 -- 172.21.15.40:0/4294168896 learned_addr learned my addr 172.21.15.40:0/4294168896 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b0c00640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09ac104ca0 0x7f09ac19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 -- 172.21.15.40:0/4294168896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09ac104270 msgr2=0x7f09ac19c100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-26T12:48:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09ac104270 0x7f09ac19c100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 -- 172.21.15.40:0/4294168896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09ac104ca0 msgr2=0x7f09ac19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09ac104ca0 0x7f09ac19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.383+0000 7f09b2000640 1 -- 172.21.15.40:0/4294168896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ac1a2070 con 0x7f09ac10d820 2024-07-26T12:48:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.384+0000 7f09b2000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac1a1940 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006010 tx=0x7f09a4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.384+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a4004240 con 0x7f09ac10d820 2024-07-26T12:48:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.384+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09a4003e10 con 0x7f09ac10d820 2024-07-26T12:48:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.384+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a4030d90 con 0x7f09ac10d820 2024-07-26T12:48:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.384+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ac1a2300 con 0x7f09ac10d820 2024-07-26T12:48:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.384+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ac1a8ac0 con 0x7f09ac10d820 2024-07-26T12:48:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.386+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ac06bc90 con 0x7f09ac10d820 2024-07-26T12:48:34.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.390+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f09a4004b40 con 0x7f09ac10d820 2024-07-26T12:48:34.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.393+0000 7f09aa000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09900b3c50 0x7f09900b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:34.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.393+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f09a41051c0 con 0x7f09ac10d820 2024-07-26T12:48:34.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.393+0000 7f09b1600640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09900b3c50 0x7f09900b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:34.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.394+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f09a40cc7d0 con 0x7f09ac10d820 2024-07-26T12:48:34.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.395+0000 7f09b1600640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09900b3c50 0x7f09900b6160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f099c00b990 tx=0x7f099c00b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:34.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.676+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09ac104680 con 0x7f09ac10d820 2024-07-26T12:48:34.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.678+0000 7f09aa000640 1 -- 172.21.15.40:0/4294168896 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f09a40cc0d0 con 0x7f09ac10d820 2024-07-26T12:48:34.680 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:48:34.680 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:48:34.681 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:48:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.681+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09900b3c50 msgr2=0x7f09900b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.681+0000 7f09b4000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09900b3c50 0x7f09900b6160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f099c00b990 tx=0x7f099c00b370 comp rx=0 tx=0).stop 2024-07-26T12:48:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.681+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 msgr2=0x7f09ac1a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.681+0000 7f09b4000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac1a1940 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006010 tx=0x7f09a4003c20 comp rx=0 tx=0).stop 2024-07-26T12:48:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 shutdown_connections 2024-07-26T12:48:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ac10d820 0x7f09ac1a1940 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09ac104ca0 0x7f09ac19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f09900b3c50 0x7f09900b6160 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 --2- 172.21.15.40:0/4294168896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09ac104270 0x7f09ac19c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 >> 172.21.15.40:0/4294168896 conn(0x7f09ac079190 msgr2=0x7f09ac100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 shutdown_connections 2024-07-26T12:48:34.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:34.682+0000 7f09b4000640 1 -- 172.21.15.40:0/4294168896 wait complete. 2024-07-26T12:48:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:34 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4294168896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:34 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4294168896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:34 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4294168896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:35.699 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 142.05 --await-for 45.0' 2024-07-26T12:48:35.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 142.05 --await-for 45.0 2024-07-26T12:48:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:35 smithi040 ceph-mon[32397]: pgmap v1290: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 440 KiB/s wr, 11 op/s 2024-07-26T12:48:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:35 smithi146 ceph-mon[35807]: pgmap v1290: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 440 KiB/s wr, 11 op/s 2024-07-26T12:48:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:35 smithi076 ceph-mon[35401]: pgmap v1290: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 440 KiB/s wr, 11 op/s 2024-07-26T12:48:38.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:37 smithi040 ceph-mon[32397]: pgmap v1291: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 MiB/s wr, 8 op/s 2024-07-26T12:48:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:37 smithi146 ceph-mon[35807]: pgmap v1291: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 MiB/s wr, 8 op/s 2024-07-26T12:48:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:37 smithi076 ceph-mon[35401]: pgmap v1291: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 MiB/s wr, 8 op/s 2024-07-26T12:48:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 -- 172.21.15.40:0/4124198010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 msgr2=0x7fc9641022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 --2- 172.21.15.40:0/4124198010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc9641022d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc954009900 tx=0x7fc95402a480 comp rx=0 tx=0).stop 2024-07-26T12:48:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 -- 172.21.15.40:0/4124198010 shutdown_connections 2024-07-26T12:48:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 --2- 172.21.15.40:0/4124198010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 0x7fc964111e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 --2- 172.21.15.40:0/4124198010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 0x7fc96410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 --2- 172.21.15.40:0/4124198010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc9641022d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 -- 172.21.15.40:0/4124198010 >> 172.21.15.40:0/4124198010 conn(0x7fc9640fdd60 msgr2=0x7fc9641001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 -- 172.21.15.40:0/4124198010 shutdown_connections 2024-07-26T12:48:38.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.588+0000 7fc963200640 1 -- 172.21.15.40:0/4124198010 wait complete. 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 Processor -- start 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 -- start start 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc96419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 0x7fc96419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 0x7fc9641a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc964115370 con 0x7fc964101ec0 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.590+0000 7fc963200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641151f0 con 0x7fc964102810 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc963200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641154f0 con 0x7fc96410fa70 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc961e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc96419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc961e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc96419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50676/0 (socket says 172.21.15.40:50676) 2024-07-26T12:48:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc961e00640 1 -- 172.21.15.40:0/3606157319 learned_addr learned my addr 172.21.15.40:0/3606157319 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc961400640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 0x7fc96419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc962800640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 0x7fc9641a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.591+0000 7fc961e00640 1 -- 172.21.15.40:0/3606157319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 msgr2=0x7fc9641a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc961e00640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 0x7fc9641a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc961e00640 1 -- 172.21.15.40:0/3606157319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 msgr2=0x7fc96419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc961e00640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 0x7fc96419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc961e00640 1 -- 172.21.15.40:0/3606157319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9641a1d50 con 0x7fc964101ec0 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc961400640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 0x7fc96419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc962800640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 0x7fc9641a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc961e00640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc96419bde0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc954009230 tx=0x7fc954004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc95aa00640 1 -- 172.21.15.40:0/3606157319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95403f030 con 0x7fc964101ec0 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc95aa00640 1 -- 172.21.15.40:0/3606157319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc954003a80 con 0x7fc964101ec0 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.592+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9641a1fe0 con 0x7fc964101ec0 2024-07-26T12:48:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.593+0000 7fc95aa00640 1 -- 172.21.15.40:0/3606157319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954035070 con 0x7fc964101ec0 2024-07-26T12:48:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.593+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9641a87a0 con 0x7fc964101ec0 2024-07-26T12:48:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.597+0000 7fc96fdee740 1 Processor -- start 2024-07-26T12:48:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.597+0000 7fc96fdee740 1 -- start start 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.597+0000 7fc95aa00640 1 -- 172.21.15.40:0/3606157319 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc954042030 con 0x7fc964101ec0 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc43480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc439c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 0x55b44cc43f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc96fdee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b44cbb78a0 con 0x55b44c87bb70 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc96fdee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b44cba6da0 con 0x55b44c89c850 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc96fdee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b44cbaade0 con 0x55b44c873990 2024-07-26T12:48:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc961400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 0x55b44cc43f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc961400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 0x55b44cc43f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50686/0 (socket says 172.21.15.40:50686) 2024-07-26T12:48:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc961400640 1 -- 172.21.15.40:0/3871346329 learned_addr learned my addr 172.21.15.40:0/3871346329 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc962800640 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc43480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.598+0000 7fc961e00640 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.599+0000 7fc961400640 1 -- 172.21.15.40:0/3871346329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 msgr2=0x55b44cc439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.599+0000 7fc961400640 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.599+0000 7fc961400640 1 -- 172.21.15.40:0/3871346329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 msgr2=0x55b44cc43480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.599+0000 7fc961400640 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc43480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.599+0000 7fc961400640 1 -- 172.21.15.40:0/3871346329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44cb3bb70 con 0x55b44c87bb70 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.599+0000 7fc961400640 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 0x55b44cc43f00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc95000bd30 tx=0x7fc95000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2270587d71ea32f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.600+0000 7fc94f400640 1 -- 172.21.15.40:0/3871346329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950015070 con 0x55b44c87bb70 2024-07-26T12:48:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.600+0000 7fc94f400640 1 -- 172.21.15.40:0/3871346329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95000be20 con 0x55b44c87bb70 2024-07-26T12:48:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.600+0000 7fc94f400640 1 -- 172.21.15.40:0/3871346329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950011960 con 0x55b44c87bb70 2024-07-26T12:48:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.600+0000 7fc95aa00640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9480b3c40 0x7fc9480b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.600+0000 7fc95aa00640 1 -- 172.21.15.40:0/3606157319 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc954104190 con 0x7fc964101ec0 2024-07-26T12:48:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc962800640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9480b3c40 0x7fc9480b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 -- 172.21.15.40:0/3871346329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 msgr2=0x55b44cc43f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 0x55b44cc43f00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc95000bd30 tx=0x7fc95000f730 comp rx=0 tx=0).stop 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 -- 172.21.15.40:0/3871346329 shutdown_connections 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c87bb70 0x55b44cc43f00 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3871346329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc43480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 -- 172.21.15.40:0/3871346329 >> 172.21.15.40:0/3871346329 conn(0x55b44c890c40 msgr2=0x55b44cc41370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.601+0000 7fc96fdee740 1 -- 172.21.15.40:0/3871346329 shutdown_connections 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.602+0000 7fc96fdee740 1 -- 172.21.15.40:0/3871346329 wait complete. 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.602+0000 7fc962800640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9480b3c40 0x7fc9480b6150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc95c005fd0 tx=0x7fc95c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.602+0000 7fc96fdee740 1 -- start start 2024-07-26T12:48:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 Processor -- start 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc4ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc4f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c89c850 0x55b44cc5af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b44ca0a7b0 con 0x55b44c873990 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b44cb43380 con 0x55b44c87bb70 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b44cc51c60 con 0x55b44c89c850 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.603+0000 7fc96fdee740 10 client.0 _ll_register_callbacks cb 0x55b44cb52830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:48:38.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc4ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc4ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50690/0 (socket says 172.21.15.40:50690) 2024-07-26T12:48:38.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 -- 172.21.15.40:0/4168148866 learned_addr learned my addr 172.21.15.40:0/4168148866 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:38.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961400640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc4f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc962800640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c89c850 0x55b44cc5af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 -- 172.21.15.40:0/4168148866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c89c850 msgr2=0x55b44cc5af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c89c850 0x55b44cc5af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 -- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 msgr2=0x55b44cc4f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc4f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.604+0000 7fc961e00640 1 -- 172.21.15.40:0/4168148866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44c916ba0 con 0x55b44c873990 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.605+0000 7fc961e00640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc4ef40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc9540c7120 tx=0x7fc954003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5238dfdadf00ab3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.605+0000 7fc943e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.605+0000 7fc943e00640 1 -- 172.21.15.40:0/4168148866 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954049040 con 0x55b44c873990 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.605+0000 7fc943e00640 1 -- 172.21.15.40:0/4168148866 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc9540d3cc0 con 0x55b44c873990 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.605+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc95000be20 con 0x55b44c873990 2024-07-26T12:48:38.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.605+0000 7fc943e00640 1 -- 172.21.15.40:0/4168148866 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc9540cabb0 con 0x55b44c873990 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 10 client.16437 fetch_fsmap learned FSMap version 35 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b44cc5dbb0 con 0x55b44c873990 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc943e00640 1 -- 172.21.15.40:0/4168148866 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95000be20 con 0x55b44c873990 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc943e00640 1 -- 172.21.15.40:0/4168148866 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc9540ca300 con 0x55b44c873990 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 10 client.16437 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 10 client.16437 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 20 client.16437 populate_metadata read hostname 'smithi040' 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c85b1d0 0x55b44cc61030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 4 client.16437 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:48:38.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.606+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b44cbb97f0 con 0x55b44c85b1d0 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.607+0000 7fc961400640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c85b1d0 0x55b44cc61030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.608+0000 7fc961400640 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c85b1d0 0x55b44cc61030 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0be0234f247760 server_cookie=c40d30836ba6688 in_seq=0 out_seq=0 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.608+0000 7fc943e00640 10 client.16437 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc943e00640 1 -- 172.21.15.40:0/4168148866 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b44cbb97f0 con 0x55b44c85b1d0 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc943e00640 10 client.16437 handle_command_reply: tid=0 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 client.16437 shutdown 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 msgr2=0x55b44cc4ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc4ef40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc9540c7120 tx=0x7fc954003e60 comp rx=0 tx=0).stop 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 shutdown_connections 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c89c850 0x55b44cc5af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc4f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.610+0000 7fc96fdee740 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c85b1d0 0x55b44cc61030 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.611+0000 7fc96fdee740 1 --2- 172.21.15.40:0/4168148866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc4ef40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.611+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 >> 172.21.15.40:0/4168148866 conn(0x55b44c890c40 msgr2=0x55b44cc46610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.611+0000 7fc943e00640 0 client.16437 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.611+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 shutdown_connections 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.611+0000 7fc96fdee740 1 -- 172.21.15.40:0/4168148866 wait complete. 2024-07-26T12:48:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.611+0000 7fc96fdee740 20 client.16437 trim_cache size 0 max 16384 2024-07-26T12:48:38.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 Processor -- start 2024-07-26T12:48:38.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 -- start start 2024-07-26T12:48:38.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc3f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 0x55b44cc50260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641b0d60 con 0x55b44c89c850 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641b28a0 con 0x55b44c87bb70 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.635+0000 7fc96fdee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641b1430 con 0x55b44c873990 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.636+0000 7fc962800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 0x55b44cc50260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.636+0000 7fc962800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 0x55b44cc50260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50696/0 (socket says 172.21.15.40:50696) 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.636+0000 7fc962800640 1 -- 172.21.15.40:0/1682614674 learned_addr learned my addr 172.21.15.40:0/1682614674 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.636+0000 7fc961400640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc3f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.636+0000 7fc961e00640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.636+0000 7fc962800640 1 -- 172.21.15.40:0/1682614674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 msgr2=0x55b44cc495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc962800640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc962800640 1 -- 172.21.15.40:0/1682614674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 msgr2=0x55b44cc3f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc962800640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc3f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc962800640 1 -- 172.21.15.40:0/1682614674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44cc51320 con 0x55b44c89c850 2024-07-26T12:48:38.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc961400640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc3f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:48:38.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc961e00640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:48:38.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.637+0000 7fc962800640 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 0x55b44cc50260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc95c011740 tx=0x7fc95c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497bd4309b61797e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:38.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.638+0000 7fc94ea00640 1 -- 172.21.15.40:0/1682614674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c029640 con 0x55b44c89c850 2024-07-26T12:48:38.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.638+0000 7fc94ea00640 1 -- 172.21.15.40:0/1682614674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95c01f8a0 con 0x55b44c89c850 2024-07-26T12:48:38.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.638+0000 7fc94ea00640 1 -- 172.21.15.40:0/1682614674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c028750 con 0x55b44c89c850 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.638+0000 7fc96fdee740 1 -- 172.21.15.40:0/1682614674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 msgr2=0x55b44cc50260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 0x55b44cc50260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc95c011740 tx=0x7fc95c016000 comp rx=0 tx=0).stop 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 -- 172.21.15.40:0/1682614674 shutdown_connections 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c89c850 0x55b44cc50260 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c87bb70 0x55b44cc3f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 --2- 172.21.15.40:0/1682614674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c873990 0x55b44cc495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 -- 172.21.15.40:0/1682614674 >> 172.21.15.40:0/1682614674 conn(0x55b44c890c40 msgr2=0x55b44cc44e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 -- 172.21.15.40:0/1682614674 shutdown_connections 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 -- 172.21.15.40:0/1682614674 wait complete. 2024-07-26T12:48:38.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.639+0000 7fc96fdee740 1 -- start start 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 Processor -- start 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc52d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c87bb70 0x55b44cc532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc537f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641b21d0 con 0x55b44c873990 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641b1b00 con 0x55b44c89c850 2024-07-26T12:48:38.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.640+0000 7fc96fdee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc9641aed20 con 0x55b44c87bb70 2024-07-26T12:48:38.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.641+0000 7fc96fdee740 10 client.0 _ll_register_callbacks cb 0x7fc954009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:48:38.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.641+0000 7fc961e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc52d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.641+0000 7fc961e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc52d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50698/0 (socket says 172.21.15.40:50698) 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.641+0000 7fc961e00640 1 -- 172.21.15.40:0/3363393739 learned_addr learned my addr 172.21.15.40:0/3363393739 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.641+0000 7fc961400640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c87bb70 0x55b44cc532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.641+0000 7fc962800640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc961e00640 1 -- 172.21.15.40:0/3363393739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c87bb70 msgr2=0x55b44cc532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc961e00640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c87bb70 0x55b44cc532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc961e00640 1 -- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 msgr2=0x55b44cc537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc961e00640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc961e00640 1 -- 172.21.15.40:0/3363393739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44ccc87c0 con 0x55b44c873990 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc961e00640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc52d70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc9540d4030 tx=0x7fc9540c6e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53311f7d2f516d10 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:38.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc943e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:48:38.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc943e00640 1 -- 172.21.15.40:0/3363393739 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9540ea060 con 0x55b44c873990 2024-07-26T12:48:38.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc943e00640 1 -- 172.21.15.40:0/3363393739 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc9540ec240 con 0x55b44c873990 2024-07-26T12:48:38.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.642+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc95c01f8a0 con 0x55b44c873990 2024-07-26T12:48:38.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc943e00640 1 -- 172.21.15.40:0/3363393739 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc954049040 con 0x55b44c873990 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc96fdee740 10 client.16443 fetch_fsmap learned FSMap version 35 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b44ccc9a20 con 0x55b44c873990 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc943e00640 1 -- 172.21.15.40:0/3363393739 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc95c01f8a0 con 0x55b44c873990 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc943e00640 1 -- 172.21.15.40:0/3363393739 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc9540c9d70 con 0x55b44c873990 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc96fdee740 10 client.16443 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc96fdee740 10 client.16443 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc96fdee740 20 client.16443 populate_metadata read hostname 'smithi040' 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.643+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c830580 0x55b44cccc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.644+0000 7fc96fdee740 4 client.16443 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.05, "await_for": 45.0}] 2024-07-26T12:48:38.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.644+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.05, "await_for": 45.0}) -- 0x55b44cbb5290 con 0x55b44c830580 2024-07-26T12:48:38.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.644+0000 7fc961400640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c830580 0x55b44cccc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:38.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.645+0000 7fc961400640 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c830580 0x55b44cccc0f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28cbd9af9b526860 server_cookie=c5124bae540744ee in_seq=0 out_seq=0 2024-07-26T12:48:38.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.645+0000 7fc943e00640 10 client.16443 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:38.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.898+0000 7fc943e00640 1 -- 172.21.15.40:0/3363393739 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b44cbb5290 con 0x55b44c830580 2024-07-26T12:48:38.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.898+0000 7fc943e00640 10 client.16443 handle_command_reply: tid=0 2024-07-26T12:48:38.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.898+0000 7fc96fdee740 1 client.16443 shutdown 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 msgr2=0x55b44cc52d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc52d70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc9540d4030 tx=0x7fc9540c6e80 comp rx=0 tx=0).stop 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 shutdown_connections 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b44c89c850 0x55b44cc537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b44c87bb70 0x55b44cc532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b44c830580 0x55b44cccc0f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 --2- 172.21.15.40:0/3363393739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b44c873990 0x55b44cc52d70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 >> 172.21.15.40:0/3363393739 conn(0x55b44c890c40 msgr2=0x55b44cc44d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:38.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc943e00640 0 client.16443 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:48:38.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.899+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 shutdown_connections 2024-07-26T12:48:38.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.900+0000 7fc96fdee740 1 -- 172.21.15.40:0/3363393739 wait complete. 2024-07-26T12:48:38.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.900+0000 7fc96fdee740 20 client.16443 trim_cache size 0 max 16384 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 82, 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "b13a3d28": { 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 82, 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:48:38.903 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.1, 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:48:38.904 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:48:38.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.901+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9480b3c40 msgr2=0x7fc9480b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.901+0000 7fc963200640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9480b3c40 0x7fc9480b6150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc95c005fd0 tx=0x7fc95c009800 comp rx=0 tx=0).stop 2024-07-26T12:48:38.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.901+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 msgr2=0x7fc96419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:38.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.901+0000 7fc963200640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc96419bde0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc954009230 tx=0x7fc954004270 comp rx=0 tx=0).stop 2024-07-26T12:48:38.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.901+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 shutdown_connections 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.901+0000 7fc963200640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc9480b3c40 0x7fc9480b6150 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.902+0000 7fc963200640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc96410fa70 0x7fc9641a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.902+0000 7fc963200640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc964102810 0x7fc96419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.902+0000 7fc963200640 1 --2- 172.21.15.40:0/3606157319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc964101ec0 0x7fc96419bde0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.902+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 >> 172.21.15.40:0/3606157319 conn(0x7fc9640fdd60 msgr2=0x7fc964111c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.902+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 shutdown_connections 2024-07-26T12:48:38.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:38.902+0000 7fc963200640 1 -- 172.21.15.40:0/3606157319 wait complete. 2024-07-26T12:48:39.845 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b13a3d28', quiesce took 8.3 seconds. Will release after: 13.75 2024-07-26T12:48:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:39 smithi040 ceph-mon[32397]: pgmap v1292: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:48:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:39 smithi146 ceph-mon[35807]: pgmap v1292: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:48:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:39 smithi076 ceph-mon[35401]: pgmap v1292: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-07-26T12:48:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:41 smithi040 ceph-mon[32397]: pgmap v1293: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:48:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:41 smithi146 ceph-mon[35807]: pgmap v1293: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:48:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:41 smithi076 ceph-mon[35401]: pgmap v1293: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:48:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:43 smithi040 ceph-mon[32397]: pgmap v1294: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:48:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:43 smithi146 ceph-mon[35807]: pgmap v1294: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:48:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:43 smithi076 ceph-mon[35401]: pgmap v1294: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:48:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:45 smithi040 ceph-mon[32397]: pgmap v1295: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 13 op/s 2024-07-26T12:48:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:45 smithi146 ceph-mon[35807]: pgmap v1295: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 13 op/s 2024-07-26T12:48:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:45 smithi076 ceph-mon[35401]: pgmap v1295: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 13 op/s 2024-07-26T12:48:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:47 smithi040 ceph-mon[32397]: pgmap v1296: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2024-07-26T12:48:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:47 smithi146 ceph-mon[35807]: pgmap v1296: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2024-07-26T12:48:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:47 smithi076 ceph-mon[35401]: pgmap v1296: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2024-07-26T12:48:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:49 smithi040 ceph-mon[32397]: pgmap v1297: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T12:48:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:48:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:49 smithi146 ceph-mon[35807]: pgmap v1297: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T12:48:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:48:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:49 smithi076 ceph-mon[35401]: pgmap v1297: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T12:48:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:48:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:48:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:51 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:48:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:51 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:48:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:51 smithi040 ceph-mon[32397]: pgmap v1298: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 MiB/s wr, 10 op/s 2024-07-26T12:48:52.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:51 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:48:52.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:51 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:48:52.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:51 smithi076 ceph-mon[35401]: pgmap v1298: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 MiB/s wr, 10 op/s 2024-07-26T12:48:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:51 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:48:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:51 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:48:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:51 smithi146 ceph-mon[35807]: pgmap v1298: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 MiB/s wr, 10 op/s 2024-07-26T12:48:53.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:48:54.080 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:54.226 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:53 smithi040 ceph-mon[32397]: pgmap v1299: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 614 KiB/s wr, 10 op/s 2024-07-26T12:48:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:53 smithi146 ceph-mon[35807]: pgmap v1299: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 614 KiB/s wr, 10 op/s 2024-07-26T12:48:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:53 smithi076 ceph-mon[35401]: pgmap v1299: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 614 KiB/s wr, 10 op/s 2024-07-26T12:48:56.021 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:55 smithi040 ceph-mon[32397]: pgmap v1300: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 614 KiB/s wr, 11 op/s 2024-07-26T12:48:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:55 smithi146 ceph-mon[35807]: pgmap v1300: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 614 KiB/s wr, 11 op/s 2024-07-26T12:48:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:55 smithi076 ceph-mon[35401]: pgmap v1300: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 614 KiB/s wr, 11 op/s 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 -- 172.21.15.40:0/299204801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c1055f0 msgr2=0x7ff35c105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 --2- 172.21.15.40:0/299204801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c1055f0 0x7ff35c105a00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff350009900 tx=0x7ff35002a410 comp rx=0 tx=0).stop 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 -- 172.21.15.40:0/299204801 shutdown_connections 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 --2- 172.21.15.40:0/299204801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c10b880 0x7ff35c1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 --2- 172.21.15.40:0/299204801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff35c10af30 0x7ff35c10b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 --2- 172.21.15.40:0/299204801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c1055f0 0x7ff35c105a00 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 -- 172.21.15.40:0/299204801 >> 172.21.15.40:0/299204801 conn(0x7ff35c101060 msgr2=0x7ff35c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 -- 172.21.15.40:0/299204801 shutdown_connections 2024-07-26T12:48:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.347+0000 7ff362c00640 1 -- 172.21.15.40:0/299204801 wait complete. 2024-07-26T12:48:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.349+0000 7ff362c00640 1 Processor -- start 2024-07-26T12:48:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.349+0000 7ff362c00640 1 -- start start 2024-07-26T12:48:56.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.349+0000 7ff362c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c1055f0 0x7ff35c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:56.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff362c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 0x7ff35c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff362c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff35c10b880 0x7ff35c1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff362c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c115430 con 0x7ff35c10af30 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff362c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c1152b0 con 0x7ff35c10b880 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff362c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c1155b0 con 0x7ff35c1055f0 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff360e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 0x7ff35c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff360e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 0x7ff35c19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35378/0 (socket says 172.21.15.40:35378) 2024-07-26T12:48:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff360e00640 1 -- 172.21.15.40:0/1182608843 learned_addr learned my addr 172.21.15.40:0/1182608843 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:48:56.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff362200640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff35c10b880 0x7ff35c1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:56.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff361800640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c1055f0 0x7ff35c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:56.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff360e00640 1 -- 172.21.15.40:0/1182608843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c1055f0 msgr2=0x7ff35c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:56.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff360e00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c1055f0 0x7ff35c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.350+0000 7ff360e00640 1 -- 172.21.15.40:0/1182608843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff35c10b880 msgr2=0x7ff35c1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff360e00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff35c10b880 0x7ff35c1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff360e00640 1 -- 172.21.15.40:0/1182608843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c1a1dd0 con 0x7ff35c10af30 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff360e00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 0x7ff35c19c400 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d950 tx=0x7ff34800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348017070 con 0x7ff35c10af30 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff348009c30 con 0x7ff35c10af30 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3480047a0 con 0x7ff35c10af30 2024-07-26T12:48:56.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.351+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c1a20c0 con 0x7ff35c10af30 2024-07-26T12:48:56.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.352+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c1a8820 con 0x7ff35c10af30 2024-07-26T12:48:56.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.353+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c105a00 con 0x7ff35c10af30 2024-07-26T12:48:56.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.355+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff348004020 con 0x7ff35c10af30 2024-07-26T12:48:56.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.358+0000 7ff35a000640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3440b3bd0 0x7ff3440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:48:56.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.358+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff3480e3a60 con 0x7ff35c10af30 2024-07-26T12:48:56.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.358+0000 7ff361800640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3440b3bd0 0x7ff3440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:48:56.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.359+0000 7ff361800640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3440b3bd0 0x7ff3440b60e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff350006010 tx=0x7ff350000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:48:56.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.365+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff348020020 con 0x7ff35c10af30 2024-07-26T12:48:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.607+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff35c19cf90 con 0x7ff35c10af30 2024-07-26T12:48:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.609+0000 7ff35a000640 1 -- 172.21.15.40:0/1182608843 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ff3480ab070 con 0x7ff35c10af30 2024-07-26T12:48:56.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:48:56.611 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:48:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3440b3bd0 msgr2=0x7ff3440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3440b3bd0 0x7ff3440b60e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff350006010 tx=0x7ff350000bc0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 msgr2=0x7ff35c19c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 0x7ff35c19c400 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d950 tx=0x7ff34800de10 comp rx=0 tx=0).stop 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 shutdown_connections 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff35c10b880 0x7ff35c1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff35c10af30 0x7ff35c19c400 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff3440b3bd0 0x7ff3440b60e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 --2- 172.21.15.40:0/1182608843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c1055f0 0x7ff35c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:48:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 >> 172.21.15.40:0/1182608843 conn(0x7ff35c101060 msgr2=0x7ff35c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:48:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 shutdown_connections 2024-07-26T12:48:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:48:56.612+0000 7ff362c00640 1 -- 172.21.15.40:0/1182608843 wait complete. 2024-07-26T12:48:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:56 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1182608843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:56 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1182608843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:56 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1182608843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:48:57.492 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id b13a3d28 --release --await' 2024-07-26T12:48:57.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id b13a3d28 --release --await 2024-07-26T12:48:57.996 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:48:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:57 smithi040 ceph-mon[32397]: pgmap v1301: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 613 KiB/s wr, 8 op/s 2024-07-26T12:48:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:57 smithi146 ceph-mon[35807]: pgmap v1301: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 613 KiB/s wr, 8 op/s 2024-07-26T12:48:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:57 smithi076 ceph-mon[35401]: pgmap v1301: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 613 KiB/s wr, 8 op/s 2024-07-26T12:48:59.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:48:58 smithi040 ceph-mon[32397]: pgmap v1302: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T12:48:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:48:58 smithi146 ceph-mon[35807]: pgmap v1302: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T12:48:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:48:58 smithi076 ceph-mon[35401]: pgmap v1302: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 -- 172.21.15.40:0/2914406138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0107880 msgr2=0x7f62f010e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 --2- 172.21.15.40:0/2914406138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0107880 0x7f62f010e0b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f62e80074e0 tx=0x7f62e802b060 comp rx=0 tx=0).stop 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 -- 172.21.15.40:0/2914406138 shutdown_connections 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 --2- 172.21.15.40:0/2914406138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0107880 0x7f62f010e0b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 --2- 172.21.15.40:0/2914406138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f0106f30 0x7f62f0107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 --2- 172.21.15.40:0/2914406138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62f01015f0 0x7f62f0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.062+0000 7f62f5200640 1 -- 172.21.15.40:0/2914406138 >> 172.21.15.40:0/2914406138 conn(0x7f62f00780b0 msgr2=0x7f62f00784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:49:00.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.063+0000 7f62f5200640 1 -- 172.21.15.40:0/2914406138 shutdown_connections 2024-07-26T12:49:00.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.063+0000 7f62f5200640 1 -- 172.21.15.40:0/2914406138 wait complete. 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.064+0000 7f62f5200640 1 Processor -- start 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.064+0000 7f62f5200640 1 -- start start 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62f5200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f01015f0 0x7f62f01081a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62f5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 0x7f62f01086e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62f5200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62f0107880 0x7f62f0108c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62f5200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0111000 con 0x7f62f0106f30 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62f5200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0110e80 con 0x7f62f0107880 2024-07-26T12:49:00.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62f5200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0111180 con 0x7f62f01015f0 2024-07-26T12:49:00.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62e6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 0x7f62f01086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62e6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 0x7f62f01086e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35410/0 (socket says 172.21.15.40:35410) 2024-07-26T12:49:00.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.065+0000 7f62e6a00640 1 -- 172.21.15.40:0/4006839191 learned_addr learned my addr 172.21.15.40:0/4006839191 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:49:00.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62ef400640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f01015f0 0x7f62f01081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62efe00640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62f0107880 0x7f62f0108c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62e6a00640 1 -- 172.21.15.40:0/4006839191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f01015f0 msgr2=0x7f62f01081a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62e6a00640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f01015f0 0x7f62f01081a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62e6a00640 1 -- 172.21.15.40:0/4006839191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62f0107880 msgr2=0x7f62f0108c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62e6a00640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62f0107880 0x7f62f0108c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62e6a00640 1 -- 172.21.15.40:0/4006839191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f01a7f30 con 0x7f62f0106f30 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62ef400640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f01015f0 0x7f62f01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.066+0000 7f62e6a00640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 0x7f62f01086e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f62d800d750 tx=0x7f62d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.067+0000 7f62ecc00640 1 -- 172.21.15.40:0/4006839191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8017070 con 0x7f62f0106f30 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.067+0000 7f62ecc00640 1 -- 172.21.15.40:0/4006839191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62d80054b0 con 0x7f62f0106f30 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.067+0000 7f62ecc00640 1 -- 172.21.15.40:0/4006839191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8004bc0 con 0x7f62f0106f30 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.067+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f01a8220 con 0x7f62f0106f30 2024-07-26T12:49:00.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.067+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f01a8710 con 0x7f62f0106f30 2024-07-26T12:49:00.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.070+0000 7f62fd46d740 1 Processor -- start 2024-07-26T12:49:00.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.070+0000 7f62fd46d740 1 -- start start 2024-07-26T12:49:00.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62ecc00640 1 -- 172.21.15.40:0/4006839191 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f62d8009c30 con 0x7f62f0106f30 2024-07-26T12:49:00.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa638180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa6386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa638c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62fd46d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c4fa5aef30 con 0x55c4fa293520 2024-07-26T12:49:00.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62fd46d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c4fa59e430 con 0x55c4fa272840 2024-07-26T12:49:00.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62fd46d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c4fa5a2470 con 0x55c4fa26a660 2024-07-26T12:49:00.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.071+0000 7f62efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa638180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa638180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35414/0 (socket says 172.21.15.40:35414) 2024-07-26T12:49:00.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 -- 172.21.15.40:0/4069205813 learned_addr learned my addr 172.21.15.40:0/4069205813 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:49:00.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62ef400640 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa6386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62e6a00640 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa638c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 -- 172.21.15.40:0/4069205813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 msgr2=0x55c4fa6386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa6386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 -- 172.21.15.40:0/4069205813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 msgr2=0x55c4fa638c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa638c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62efe00640 1 -- 172.21.15.40:0/4069205813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fa2feb00 con 0x55c4fa293520 2024-07-26T12:49:00.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.072+0000 7f62ef400640 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa6386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62efe00640 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa638180 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f62e8005dc0 tx=0x7f62e8005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a68aa8011832284 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62ecc00640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f62d40b3c50 0x7f62d40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62ecc00640 1 -- 172.21.15.40:0/4006839191 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f62d80e3600 con 0x7f62f0106f30 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62e4c00640 1 -- 172.21.15.40:0/4069205813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8038040 con 0x55c4fa293520 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62e4c00640 1 -- 172.21.15.40:0/4069205813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62e8041070 con 0x55c4fa293520 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62ef400640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f62d40b3c50 0x7f62d40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.073+0000 7f62e4c00640 1 -- 172.21.15.40:0/4069205813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e802bd20 con 0x55c4fa293520 2024-07-26T12:49:00.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 -- 172.21.15.40:0/4069205813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 msgr2=0x55c4fa638180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa638180 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f62e8005dc0 tx=0x7f62e8005df0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62ef400640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f62d40b3c50 0x7f62d40b6160 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009750 tx=0x7f62e00096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:49:00.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 -- 172.21.15.40:0/4069205813 shutdown_connections 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa638c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa6386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 --2- 172.21.15.40:0/4069205813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa638180 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.074+0000 7f62fd46d740 1 -- 172.21.15.40:0/4069205813 >> 172.21.15.40:0/4069205813 conn(0x55c4fa287910 msgr2=0x55c4fa636070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.075+0000 7f62fd46d740 1 -- 172.21.15.40:0/4069205813 shutdown_connections 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.075+0000 7f62fd46d740 1 -- 172.21.15.40:0/4069205813 wait complete. 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.075+0000 7f62fd46d740 1 -- start start 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.075+0000 7f62fd46d740 1 Processor -- start 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa643800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa643d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa64fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c4fa401bb0 con 0x55c4fa293520 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c4fa53a910 con 0x55c4fa272840 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c4fa646900 con 0x55c4fa26a660 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.076+0000 7f62fd46d740 10 client.0 _ll_register_callbacks cb 0x55c4fa2aad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa64fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa64fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35420/0 (socket says 172.21.15.40:35420) 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 -- 172.21.15.40:0/306985291 learned_addr learned my addr 172.21.15.40:0/306985291 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62ef400640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa643800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62e6a00640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa643d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 -- 172.21.15.40:0/306985291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 msgr2=0x55c4fa643800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa643800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 -- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 msgr2=0x55c4fa643d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa643d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62efe00640 1 -- 172.21.15.40:0/306985291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4fa375960 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.077+0000 7f62e6a00640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa643d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62efe00640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa64fc20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f62e802ba00 tx=0x7f62e8009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146f4a985b57f032 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62dd600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62dd600640 1 -- 172.21.15.40:0/306985291 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e804b020 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62dd600640 1 -- 172.21.15.40:0/306985291 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f62e8007a50 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e8041070 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62dd600640 1 -- 172.21.15.40:0/306985291 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f62e8007c50 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62fd46d740 10 client.16461 fetch_fsmap learned FSMap version 35 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.078+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c4fa6525e0 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62dd600640 1 -- 172.21.15.40:0/306985291 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62e8041070 con 0x55c4fa293520 2024-07-26T12:49:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62dd600640 1 -- 172.21.15.40:0/306985291 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f62e803b070 con 0x55c4fa293520 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62fd46d740 10 client.16461 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62fd46d740 10 client.16461 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62fd46d740 20 client.16461 populate_metadata read hostname 'smithi040' 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62fd46d740 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa251ea0 0x55c4fa655940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62fd46d740 4 client.16461 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.079+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4fa5b0e80 con 0x55c4fa251ea0 2024-07-26T12:49:00.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.080+0000 7f62ef400640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa251ea0 0x55c4fa655940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.081+0000 7f62ef400640 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa251ea0 0x55c4fa655940 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ffe2f139192a351 server_cookie=99a8a9a2399199a2 in_seq=0 out_seq=0 2024-07-26T12:49:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.081+0000 7f62dd600640 10 client.16461 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62dd600640 1 -- 172.21.15.40:0/306985291 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4fa5b0e80 con 0x55c4fa251ea0 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62dd600640 10 client.16461 handle_command_reply: tid=0 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 client.16461 shutdown 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 msgr2=0x55c4fa64fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa64fc20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f62e802ba00 tx=0x7f62e8009e90 comp rx=0 tx=0).stop 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 shutdown_connections 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa251ea0 0x55c4fa655940 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa64fc20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa272840 0x55c4fa643d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 --2- 172.21.15.40:0/306985291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa26a660 0x55c4fa643800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 >> 172.21.15.40:0/306985291 conn(0x55c4fa287910 msgr2=0x55c4fa63b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62dd600640 0 client.16461 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:49:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 shutdown_connections 2024-07-26T12:49:00.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.083+0000 7f62fd46d740 1 -- 172.21.15.40:0/306985291 wait complete. 2024-07-26T12:49:00.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.084+0000 7f62fd46d740 20 client.16461 trim_cache size 0 max 16384 2024-07-26T12:49:00.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.102+0000 7f62fd46d740 1 Processor -- start 2024-07-26T12:49:00.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.102+0000 7f62fd46d740 1 -- start start 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 0x55c4fa6456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa64fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa293520 0x55c4fa63b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62fd46d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01b0e50 con 0x55c4fa26a660 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62fd46d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01b2990 con 0x55c4fa293520 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62fd46d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01b1520 con 0x55c4fa272840 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 0x55c4fa6456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 0x55c4fa6456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35424/0 (socket says 172.21.15.40:35424) 2024-07-26T12:49:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.103+0000 7f62ef400640 1 -- 172.21.15.40:0/2489229498 learned_addr learned my addr 172.21.15.40:0/2489229498 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:49:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62e6a00640 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa64fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62ef400640 1 -- 172.21.15.40:0/2489229498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 msgr2=0x55c4fa64fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62ef400640 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa64fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62ef400640 1 -- 172.21.15.40:0/2489229498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa293520 msgr2=0x55c4fa63b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62ef400640 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa293520 0x55c4fa63b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62ef400640 1 -- 172.21.15.40:0/2489229498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fa636e30 con 0x55c4fa26a660 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62e6a00640 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa64fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.104+0000 7f62ef400640 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 0x55c4fa6456e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55c4fa636e00 tx=0x7f62e0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcd5852dd9193d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.105+0000 7f62dfe00640 1 -- 172.21.15.40:0/2489229498 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e002e070 con 0x55c4fa26a660 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.105+0000 7f62dfe00640 1 -- 172.21.15.40:0/2489229498 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62e0012de0 con 0x55c4fa26a660 2024-07-26T12:49:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.105+0000 7f62dfe00640 1 -- 172.21.15.40:0/2489229498 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00285c0 con 0x55c4fa26a660 2024-07-26T12:49:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 -- 172.21.15.40:0/2489229498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 msgr2=0x55c4fa6456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 0x55c4fa6456e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55c4fa636e00 tx=0x7f62e0014000 comp rx=0 tx=0).stop 2024-07-26T12:49:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 -- 172.21.15.40:0/2489229498 shutdown_connections 2024-07-26T12:49:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa293520 0x55c4fa63b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa64fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2489229498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa26a660 0x55c4fa6456e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 -- 172.21.15.40:0/2489229498 >> 172.21.15.40:0/2489229498 conn(0x55c4fa287910 msgr2=0x55c4fa63b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 -- 172.21.15.40:0/2489229498 shutdown_connections 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.106+0000 7f62fd46d740 1 -- 172.21.15.40:0/2489229498 wait complete. 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.107+0000 7f62fd46d740 1 -- start start 2024-07-26T12:49:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.107+0000 7f62fd46d740 1 Processor -- start 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa26a660 0x55c4fa6551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa655780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa6b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01b22c0 con 0x55c4fa293520 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01b1bf0 con 0x55c4fa26a660 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01aee10 con 0x55c4fa272840 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62fd46d740 10 client.0 _ll_register_callbacks cb 0x7f62e8007250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:49:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa6b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62ef400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa26a660 0x55c4fa6551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa6b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35426/0 (socket says 172.21.15.40:35426) 2024-07-26T12:49:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62efe00640 1 -- 172.21.15.40:0/2882911272 learned_addr learned my addr 172.21.15.40:0/2882911272 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:49:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.108+0000 7f62e6a00640 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa655780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62efe00640 1 -- 172.21.15.40:0/2882911272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 msgr2=0x55c4fa655780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62efe00640 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa655780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62efe00640 1 -- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa26a660 msgr2=0x55c4fa6551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62efe00640 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa26a660 0x55c4fa6551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62efe00640 1 -- 172.21.15.40:0/2882911272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4fa63afe0 con 0x55c4fa293520 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62efe00640 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa6b6e50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f62e8054040 tx=0x7f62e8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8801f89855cb8e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.109+0000 7f62dd600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62dd600640 1 -- 172.21.15.40:0/2882911272 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e804b070 con 0x55c4fa293520 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62dd600640 1 -- 172.21.15.40:0/2882911272 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f62e8004c80 con 0x55c4fa293520 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e0012de0 con 0x55c4fa293520 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62dd600640 1 -- 172.21.15.40:0/2882911272 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f62e8061050 con 0x55c4fa293520 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62fd46d740 10 client.16467 fetch_fsmap learned FSMap version 35 2024-07-26T12:49:00.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c4fa6be680 con 0x55c4fa293520 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.110+0000 7f62dd600640 1 -- 172.21.15.40:0/2882911272 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62e0012de0 con 0x55c4fa293520 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62dd600640 1 -- 172.21.15.40:0/2882911272 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f62e8059020 con 0x55c4fa293520 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62fd46d740 10 client.16467 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62fd46d740 10 client.16467 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62fd46d740 20 client.16467 populate_metadata read hostname 'smithi040' 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa227250 0x55c4fa6c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62fd46d740 4 client.16467 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b13a3d28", "release": true, "await": true}] 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b13a3d28", "release": true, "await": true}) -- 0x55c4fa5ac920 con 0x55c4fa227250 2024-07-26T12:49:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.111+0000 7f62ef400640 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa227250 0x55c4fa6c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:49:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.112+0000 7f62ef400640 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa227250 0x55c4fa6c0e40 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77eda5bdc683e62f server_cookie=8bb85390b60d7421 in_seq=0 out_seq=0 2024-07-26T12:49:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.113+0000 7f62dd600640 10 client.16467 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.173+0000 7f62dd600640 1 -- 172.21.15.40:0/2882911272 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c4fa5ac920 con 0x55c4fa227250 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.173+0000 7f62dd600640 10 client.16467 handle_command_reply: tid=0 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.173+0000 7f62fd46d740 1 client.16467 shutdown 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 msgr2=0x55c4fa6b6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa6b6e50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f62e8054040 tx=0x7f62e8005d50 comp rx=0 tx=0).stop 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 shutdown_connections 2024-07-26T12:49:00.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c4fa227250 0x55c4fa6c0e40 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c4fa293520 0x55c4fa6b6e50 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4fa272840 0x55c4fa655780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 --2- 172.21.15.40:0/2882911272 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c4fa26a660 0x55c4fa6551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 >> 172.21.15.40:0/2882911272 conn(0x55c4fa287910 msgr2=0x55c4fa645440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.174+0000 7f62dd600640 0 client.16467 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.175+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 shutdown_connections 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.175+0000 7f62fd46d740 1 -- 172.21.15.40:0/2882911272 wait complete. 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.175+0000 7f62fd46d740 20 client.16467 trim_cache size 0 max 16384 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:49:00.178 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 84, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "b13a3d28": { 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 84, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 142.1, 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:49:00.179 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:49:00.180 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f62d40b3c50 msgr2=0x7f62d40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f62d40b3c50 0x7f62d40b6160 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009750 tx=0x7f62e00096e0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 msgr2=0x7f62f01086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 0x7f62f01086e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f62d800d750 tx=0x7f62d800dc10 comp rx=0 tx=0).stop 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 shutdown_connections 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62f0107880 0x7f62f0108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62f0106f30 0x7f62f01086e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f62d40b3c50 0x7f62d40b6160 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 --2- 172.21.15.40:0/4006839191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f01015f0 0x7f62f01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:49:00.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 >> 172.21.15.40:0/4006839191 conn(0x7f62f00780b0 msgr2=0x7f62f0104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:49:00.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.176+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 shutdown_connections 2024-07-26T12:49:00.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:49:00.177+0000 7f62f5200640 1 -- 172.21.15.40:0/4006839191 wait complete. 2024-07-26T12:49:01.087 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b13a3d28', total seconds elapsed: 29.5 2024-07-26T12:49:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:01 smithi040 ceph-mon[32397]: pgmap v1303: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:49:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:01 smithi146 ceph-mon[35807]: pgmap v1303: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:49:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:01 smithi076 ceph-mon[35401]: pgmap v1303: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:49:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:03 smithi040 ceph-mon[32397]: pgmap v1304: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 KiB/s wr, 9 op/s 2024-07-26T12:49:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:03 smithi146 ceph-mon[35807]: pgmap v1304: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 KiB/s wr, 9 op/s 2024-07-26T12:49:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:03 smithi076 ceph-mon[35401]: pgmap v1304: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 KiB/s wr, 9 op/s 2024-07-26T12:49:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:05 smithi040 ceph-mon[32397]: pgmap v1305: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:49:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:05 smithi146 ceph-mon[35807]: pgmap v1305: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:49:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:05 smithi076 ceph-mon[35401]: pgmap v1305: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:49:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:07 smithi040 ceph-mon[32397]: pgmap v1306: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-07-26T12:49:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:07 smithi146 ceph-mon[35807]: pgmap v1306: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-07-26T12:49:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:07 smithi076 ceph-mon[35401]: pgmap v1306: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-07-26T12:49:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:09 smithi040 ceph-mon[32397]: pgmap v1307: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-07-26T12:49:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:09 smithi146 ceph-mon[35807]: pgmap v1307: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-07-26T12:49:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:09 smithi076 ceph-mon[35401]: pgmap v1307: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-07-26T12:49:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:11 smithi040 ceph-mon[32397]: pgmap v1308: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-07-26T12:49:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:11 smithi146 ceph-mon[35807]: pgmap v1308: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-07-26T12:49:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:11 smithi076 ceph-mon[35401]: pgmap v1308: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.4 MiB/s wr, 10 op/s 2024-07-26T12:49:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:13 smithi040 ceph-mon[32397]: pgmap v1309: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:49:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:13 smithi146 ceph-mon[35807]: pgmap v1309: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:49:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:13 smithi076 ceph-mon[35401]: pgmap v1309: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:49:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:15 smithi040 ceph-mon[32397]: pgmap v1310: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:49:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:15 smithi146 ceph-mon[35807]: pgmap v1310: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:49:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:15 smithi076 ceph-mon[35401]: pgmap v1310: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:49:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:17 smithi040 ceph-mon[32397]: pgmap v1311: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:49:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:17 smithi146 ceph-mon[35807]: pgmap v1311: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:49:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:17 smithi076 ceph-mon[35401]: pgmap v1311: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:49:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:19 smithi040 ceph-mon[32397]: pgmap v1312: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:19 smithi146 ceph-mon[35807]: pgmap v1312: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:19 smithi076 ceph-mon[35401]: pgmap v1312: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:21 smithi040 ceph-mon[32397]: pgmap v1313: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:49:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:21 smithi146 ceph-mon[35807]: pgmap v1313: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:49:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:21 smithi076 ceph-mon[35401]: pgmap v1313: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:49:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:23 smithi040 ceph-mon[32397]: pgmap v1314: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:49:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:23 smithi146 ceph-mon[35807]: pgmap v1314: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:49:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:23 smithi076 ceph-mon[35401]: pgmap v1314: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:49:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:24 smithi146 ceph-mon[35807]: pgmap v1315: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:24 smithi076 ceph-mon[35401]: pgmap v1315: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:24 smithi040 ceph-mon[32397]: pgmap v1315: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:27 smithi040 ceph-mon[32397]: pgmap v1316: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:49:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:27 smithi146 ceph-mon[35807]: pgmap v1316: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:49:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:27 smithi076 ceph-mon[35401]: pgmap v1316: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:49:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:29 smithi040 ceph-mon[32397]: pgmap v1317: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:49:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:29 smithi146 ceph-mon[35807]: pgmap v1317: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:49:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:29 smithi076 ceph-mon[35401]: pgmap v1317: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:49:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:31 smithi040 ceph-mon[32397]: pgmap v1318: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:49:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:31 smithi146 ceph-mon[35807]: pgmap v1318: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:49:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:31 smithi076 ceph-mon[35401]: pgmap v1318: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:49:34.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:33 smithi040 ceph-mon[32397]: pgmap v1319: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:49:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:33 smithi146 ceph-mon[35807]: pgmap v1319: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:49:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:33 smithi076 ceph-mon[35401]: pgmap v1319: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:49:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:35 smithi040 ceph-mon[32397]: pgmap v1320: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:35 smithi146 ceph-mon[35807]: pgmap v1320: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:35 smithi076 ceph-mon[35401]: pgmap v1320: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:49:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:37 smithi040 ceph-mon[32397]: pgmap v1321: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:49:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:37 smithi146 ceph-mon[35807]: pgmap v1321: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:49:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:37 smithi076 ceph-mon[35401]: pgmap v1321: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:49:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:39 smithi040 ceph-mon[32397]: pgmap v1322: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:49:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:39 smithi146 ceph-mon[35807]: pgmap v1322: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:49:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:39 smithi076 ceph-mon[35401]: pgmap v1322: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:49:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:41 smithi040 ceph-mon[32397]: pgmap v1323: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:49:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:41 smithi146 ceph-mon[35807]: pgmap v1323: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:49:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:41 smithi076 ceph-mon[35401]: pgmap v1323: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:49:43.977 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:43 smithi146 ceph-mon[35807]: pgmap v1324: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:49:44.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:43 smithi040 ceph-mon[32397]: pgmap v1324: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:49:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:43 smithi076 ceph-mon[35401]: pgmap v1324: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:49:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:45 smithi040 ceph-mon[32397]: pgmap v1325: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:49:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:45 smithi146 ceph-mon[35807]: pgmap v1325: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:49:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:45 smithi076 ceph-mon[35401]: pgmap v1325: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:49:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:47 smithi040 ceph-mon[32397]: pgmap v1326: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:49:48.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:47 smithi146 ceph-mon[35807]: pgmap v1326: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:49:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:47 smithi076 ceph-mon[35401]: pgmap v1326: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:49:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:49 smithi040 ceph-mon[32397]: pgmap v1327: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:49:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:49 smithi146 ceph-mon[35807]: pgmap v1327: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:49:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:49 smithi076 ceph-mon[35401]: pgmap v1327: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:49:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:51 smithi146 ceph-mon[35807]: pgmap v1328: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:49:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:49:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:51 smithi076 ceph-mon[35401]: pgmap v1328: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:49:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:49:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:51 smithi040 ceph-mon[32397]: pgmap v1328: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:49:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:49:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:53 smithi146 ceph-mon[35807]: pgmap v1329: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:49:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:49:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:49:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:53 smithi076 ceph-mon[35401]: pgmap v1329: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:49:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:49:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:49:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:52 smithi040 ceph-mon[32397]: pgmap v1329: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:49:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:49:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:49:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:49:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:55 smithi040 ceph-mon[32397]: pgmap v1330: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:49:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:55 smithi146 ceph-mon[35807]: pgmap v1330: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:49:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:55 smithi076 ceph-mon[35401]: pgmap v1330: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:49:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:57 smithi040 ceph-mon[32397]: pgmap v1331: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:49:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:57 smithi146 ceph-mon[35807]: pgmap v1331: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:49:58.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:57 smithi076 ceph-mon[35401]: pgmap v1331: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:50:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:49:59 smithi040 ceph-mon[32397]: pgmap v1332: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T12:50:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:49:59 smithi146 ceph-mon[35807]: pgmap v1332: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T12:50:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:49:59 smithi076 ceph-mon[35401]: pgmap v1332: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T12:50:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T12:50:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T12:50:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T12:50:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:01 smithi076 ceph-mon[35401]: pgmap v1333: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:50:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:01 smithi040 ceph-mon[32397]: pgmap v1333: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:50:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:01 smithi146 ceph-mon[35807]: pgmap v1333: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:50:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:03 smithi040 ceph-mon[32397]: pgmap v1334: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:50:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:03 smithi146 ceph-mon[35807]: pgmap v1334: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:50:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:03 smithi076 ceph-mon[35401]: pgmap v1334: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:50:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:05 smithi040 ceph-mon[32397]: pgmap v1335: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:50:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:05 smithi146 ceph-mon[35807]: pgmap v1335: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:50:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:05 smithi076 ceph-mon[35401]: pgmap v1335: 97 pgs: 97 active+clean; 4.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:50:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:07 smithi040 ceph-mon[32397]: pgmap v1336: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:50:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:07 smithi146 ceph-mon[35807]: pgmap v1336: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:50:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:07 smithi076 ceph-mon[35401]: pgmap v1336: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:09 smithi040 ceph-mon[32397]: pgmap v1337: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:50:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:09 smithi146 ceph-mon[35807]: pgmap v1337: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:09 smithi076 ceph-mon[35401]: pgmap v1337: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:50:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:11 smithi040 ceph-mon[32397]: pgmap v1338: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:50:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:11 smithi146 ceph-mon[35807]: pgmap v1338: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:50:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:11 smithi076 ceph-mon[35401]: pgmap v1338: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:50:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:13 smithi146 ceph-mon[35807]: pgmap v1339: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:50:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:13 smithi076 ceph-mon[35401]: pgmap v1339: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:50:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:13 smithi040 ceph-mon[32397]: pgmap v1339: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:50:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:15 smithi146 ceph-mon[35807]: pgmap v1340: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:50:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:15 smithi076 ceph-mon[35401]: pgmap v1340: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:50:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:15 smithi040 ceph-mon[32397]: pgmap v1340: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:50:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:17 smithi040 ceph-mon[32397]: pgmap v1341: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:50:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:17 smithi146 ceph-mon[35807]: pgmap v1341: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:50:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:17 smithi076 ceph-mon[35401]: pgmap v1341: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:50:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:19 smithi040 ceph-mon[32397]: pgmap v1342: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:50:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:19 smithi146 ceph-mon[35807]: pgmap v1342: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:50:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:19 smithi076 ceph-mon[35401]: pgmap v1342: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:50:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:21 smithi040 ceph-mon[32397]: pgmap v1343: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:50:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:21 smithi146 ceph-mon[35807]: pgmap v1343: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:50:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:21 smithi076 ceph-mon[35401]: pgmap v1343: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:50:22.989 INFO:tasks.quiescer.fs.[cephfs]:Total duration (36.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:50:22.989 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.2 2024-07-26T12:50:22.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:50:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:50:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:23 smithi076 ceph-mon[35401]: pgmap v1344: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:50:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:23 smithi040 ceph-mon[32397]: pgmap v1344: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:50:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:23 smithi146 ceph-mon[35807]: pgmap v1344: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:50:26.206 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:25 smithi040 ceph-mon[32397]: pgmap v1345: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:50:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:25 smithi146 ceph-mon[35807]: pgmap v1345: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:50:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:25 smithi076 ceph-mon[35401]: pgmap v1345: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T12:50:26.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.573+0000 7f6a17200640 1 -- 172.21.15.40:0/1598093621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a181033e0 msgr2=0x7f6a181037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:26.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.573+0000 7f6a17200640 1 --2- 172.21.15.40:0/1598093621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a181033e0 0x7f6a181037f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009900 tx=0x7f6a0802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 -- 172.21.15.40:0/1598093621 shutdown_connections 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 --2- 172.21.15.40:0/1598093621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a18109670 0x7f6a1810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 --2- 172.21.15.40:0/1598093621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18108d20 0x7f6a18109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 --2- 172.21.15.40:0/1598093621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a181033e0 0x7f6a181037f0 secure :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009900 tx=0x7f6a0802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 -- 172.21.15.40:0/1598093621 >> 172.21.15.40:0/1598093621 conn(0x7f6a180fee30 msgr2=0x7f6a18101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 -- 172.21.15.40:0/1598093621 shutdown_connections 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.575+0000 7f6a17200640 1 -- 172.21.15.40:0/1598093621 wait complete. 2024-07-26T12:50:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.576+0000 7f6a17200640 1 Processor -- start 2024-07-26T12:50:26.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.576+0000 7f6a17200640 1 -- start start 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a17200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 0x7f6a18075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a17200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18109670 0x7f6a18075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a17200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a18075bc0 0x7f6a181a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a17200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6a18113240 con 0x7f6a18108d20 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a17200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181130c0 con 0x7f6a18109670 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a17200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181133c0 con 0x7f6a18075bc0 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a15e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 0x7f6a18075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a15e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 0x7f6a18075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54780/0 (socket says 172.21.15.40:54780) 2024-07-26T12:50:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.577+0000 7f6a15e00640 1 -- 172.21.15.40:0/3897806976 learned_addr learned my addr 172.21.15.40:0/3897806976 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15400640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18109670 0x7f6a18075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a16800640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a18075bc0 0x7f6a181a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15e00640 1 -- 172.21.15.40:0/3897806976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a18075bc0 msgr2=0x7f6a181a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15e00640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a18075bc0 0x7f6a181a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15e00640 1 -- 172.21.15.40:0/3897806976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18109670 msgr2=0x7f6a18075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15e00640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18109670 0x7f6a18075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15e00640 1 -- 172.21.15.40:0/3897806976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a181a8470 con 0x7f6a18108d20 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.578+0000 7f6a15400640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18109670 0x7f6a18075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:50:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.579+0000 7f6a15e00640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 0x7f6a18075140 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6a080057c0 tx=0x7f6a08003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.579+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0803f020 con 0x7f6a18108d20 2024-07-26T12:50:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.579+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a181a8700 con 0x7f6a18108d20 2024-07-26T12:50:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.579+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a0803bd00 con 0x7f6a18108d20 2024-07-26T12:50:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.579+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08035070 con 0x7f6a18108d20 2024-07-26T12:50:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.580+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a181a8bb0 con 0x7f6a18108d20 2024-07-26T12:50:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.581+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a181037f0 con 0x7f6a18108d20 2024-07-26T12:50:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.584+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6a08042020 con 0x7f6a18108d20 2024-07-26T12:50:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.586+0000 7f6a0ea00640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69fc0b3c50 0x7f69fc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.586+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6a08104a30 con 0x7f6a18108d20 2024-07-26T12:50:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.587+0000 7f6a15400640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69fc0b3c50 0x7f69fc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.588+0000 7f6a15400640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69fc0b3c50 0x7f69fc0b6160 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6a04005d00 tx=0x7f6a04005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:26.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.589+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6a08049020 con 0x7f6a18108d20 2024-07-26T12:50:26.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.863+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a1802e0c0 con 0x7f6a18108d20 2024-07-26T12:50:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.864+0000 7f6a0ea00640 1 -- 172.21.15.40:0/3897806976 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f6a080cc040 con 0x7f6a18108d20 2024-07-26T12:50:26.867 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:50:26.867 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:50:26.867 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:50:26.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69fc0b3c50 msgr2=0x7f69fc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69fc0b3c50 0x7f69fc0b6160 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6a04005d00 tx=0x7f6a04005ed0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 msgr2=0x7f6a18075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 0x7f6a18075140 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6a080057c0 tx=0x7f6a08003d50 comp rx=0 tx=0).stop 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 shutdown_connections 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69fc0b3c50 0x7f69fc0b6160 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a18075bc0 0x7f6a181a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6a18109670 0x7f6a18075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 --2- 172.21.15.40:0/3897806976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a18108d20 0x7f6a18075140 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 >> 172.21.15.40:0/3897806976 conn(0x7f6a180fee30 msgr2=0x7f6a18101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 shutdown_connections 2024-07-26T12:50:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:26.868+0000 7f6a17200640 1 -- 172.21.15.40:0/3897806976 wait complete. 2024-07-26T12:50:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3897806976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3897806976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3897806976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:27.986 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 138.2 --await-for 45.0' 2024-07-26T12:50:27.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 138.2 --await-for 45.0 2024-07-26T12:50:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:27 smithi040 ceph-mon[32397]: pgmap v1346: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:50:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:27 smithi146 ceph-mon[35807]: pgmap v1346: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:50:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:27 smithi076 ceph-mon[35401]: pgmap v1346: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:50:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:50:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:29 smithi040 ceph-mon[32397]: pgmap v1347: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:50:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:29 smithi146 ceph-mon[35807]: pgmap v1347: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:50:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:29 smithi076 ceph-mon[35401]: pgmap v1347: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:50:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 -- 172.21.15.40:0/390927751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab18109bc0 msgr2=0x7fab18109fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 --2- 172.21.15.40:0/390927751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab18109bc0 0x7fab18109fd0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fab08009900 tx=0x7fab0802a410 comp rx=0 tx=0).stop 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 -- 172.21.15.40:0/390927751 shutdown_connections 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 --2- 172.21.15.40:0/390927751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab1810fe50 0x7fab18116680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 --2- 172.21.15.40:0/390927751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab1810f500 0x7fab1810f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 --2- 172.21.15.40:0/390927751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab18109bc0 0x7fab18109fd0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 -- 172.21.15.40:0/390927751 >> 172.21.15.40:0/390927751 conn(0x7fab18077bf0 msgr2=0x7fab18107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 -- 172.21.15.40:0/390927751 shutdown_connections 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.094+0000 7fab1e600640 1 -- 172.21.15.40:0/390927751 wait complete. 2024-07-26T12:50:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 Processor -- start 2024-07-26T12:50:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 -- start start 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18109bc0 0x7fab181a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab1810f500 0x7fab181a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 0x7fab181a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fab18119a00 con 0x7fab1810fe50 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fab18119880 con 0x7fab1810f500 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.096+0000 7fab1e600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab18119b80 con 0x7fab18109bc0 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 0x7fab181a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 0x7fab181a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54792/0 (socket says 172.21.15.40:54792) 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 -- 172.21.15.40:0/1488810693 learned_addr learned my addr 172.21.15.40:0/1488810693 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab16a00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab1810f500 0x7fab181a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17400640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18109bc0 0x7fab181a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 -- 172.21.15.40:0/1488810693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18109bc0 msgr2=0x7fab181a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18109bc0 0x7fab181a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 -- 172.21.15.40:0/1488810693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab1810f500 msgr2=0x7fab181a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab1810f500 0x7fab181a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.097+0000 7fab17e00640 1 -- 172.21.15.40:0/1488810693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab181a63e0 con 0x7fab1810fe50 2024-07-26T12:50:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.098+0000 7fab17e00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 0x7fab181a5cb0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fab1000cad0 tx=0x7fab1000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.098+0000 7fab0fe00640 1 -- 172.21.15.40:0/1488810693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1000ad60 con 0x7fab1810fe50 2024-07-26T12:50:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.098+0000 7fab0fe00640 1 -- 172.21.15.40:0/1488810693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab10005020 con 0x7fab1810fe50 2024-07-26T12:50:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.098+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab181a66d0 con 0x7fab1810fe50 2024-07-26T12:50:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.098+0000 7fab0fe00640 1 -- 172.21.15.40:0/1488810693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1000f6b0 con 0x7fab1810fe50 2024-07-26T12:50:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.098+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab181ace30 con 0x7fab1810fe50 2024-07-26T12:50:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.102+0000 7fab25216740 1 Processor -- start 2024-07-26T12:50:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.103+0000 7fab0fe00640 1 -- 172.21.15.40:0/1488810693 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fab100051d0 con 0x7fab1810fe50 2024-07-26T12:50:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.103+0000 7fab25216740 1 -- start start 2024-07-26T12:50:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab25216740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab25216740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab25216740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab25216740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c24d08bd10 con 0x55c24ccf2980 2024-07-26T12:50:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab25216740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c24d036b60 con 0x55c24cd1b840 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab25216740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c24d026060 con 0x55c24ccfab60 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab17400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab17400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54800/0 (socket says 172.21.15.40:54800) 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.104+0000 7fab17400640 1 -- 172.21.15.40:0/680525593 learned_addr learned my addr 172.21.15.40:0/680525593 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab16a00640 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab0fe00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faafc0b3bd0 0x7faafc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab16a00640 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab0fe00640 1 -- 172.21.15.40:0/1488810693 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab100e3c50 con 0x7fab1810fe50 2024-07-26T12:50:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab17e00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faafc0b3bd0 0x7faafc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab17400640 1 -- 172.21.15.40:0/680525593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 msgr2=0x55c24d0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab17400640 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab17400640 1 -- 172.21.15.40:0/680525593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 msgr2=0x55c24d0c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.105+0000 7fab17400640 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.106+0000 7fab17400640 1 -- 172.21.15.40:0/680525593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c24cfadb10 con 0x55c24ccf2980 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.106+0000 7fab16a00640 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.106+0000 7fab17400640 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0c1700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fab08009900 tx=0x7fab08031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee39969dd4bc2a2b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.106+0000 7fab17e00640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faafc0b3bd0 0x7faafc0b60e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fab100a6be0 tx=0x7fab100057c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.107+0000 7fab0cc00640 1 -- 172.21.15.40:0/680525593 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08035030 con 0x55c24ccf2980 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.107+0000 7fab0cc00640 1 -- 172.21.15.40:0/680525593 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab08004030 con 0x55c24ccf2980 2024-07-26T12:50:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.107+0000 7fab0cc00640 1 -- 172.21.15.40:0/680525593 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08003ab0 con 0x55c24ccf2980 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 -- 172.21.15.40:0/680525593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 msgr2=0x55c24d0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0c1700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fab08009900 tx=0x7fab08031db0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 -- 172.21.15.40:0/680525593 shutdown_connections 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0c1700 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 --2- 172.21.15.40:0/680525593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 -- 172.21.15.40:0/680525593 >> 172.21.15.40:0/680525593 conn(0x55c24cd0f990 msgr2=0x55c24d0bf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 -- 172.21.15.40:0/680525593 shutdown_connections 2024-07-26T12:50:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.108+0000 7fab25216740 1 -- 172.21.15.40:0/680525593 wait complete. 2024-07-26T12:50:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.109+0000 7fab25216740 1 -- start start 2024-07-26T12:50:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.109+0000 7fab25216740 1 Processor -- start 2024-07-26T12:50:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccf2980 0x55c24d0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 0x55c24d0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0d8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c24cfc2520 con 0x55c24ccfab60 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c24d02a0a0 con 0x55c24cd1b840 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c24ce897a0 con 0x55c24ccf2980 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab25216740 10 client.0 _ll_register_callbacks cb 0x55c24d01ebf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.110+0000 7fab17400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 0x55c24d0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 0x55c24d0cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54816/0 (socket says 172.21.15.40:54816) 2024-07-26T12:50:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 -- 172.21.15.40:0/4239744373 learned_addr learned my addr 172.21.15.40:0/4239744373 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab16a00640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccf2980 0x55c24d0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab16a00640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0d8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 -- 172.21.15.40:0/4239744373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccf2980 msgr2=0x55c24d0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccf2980 0x55c24d0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 -- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 msgr2=0x55c24d0d8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0d8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab17400640 1 -- 172.21.15.40:0/4239744373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c24cd95b90 con 0x55c24ccfab60 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.111+0000 7fab16a00640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0d8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.112+0000 7fab17400640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 0x55c24d0cd210 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fab08032fd0 tx=0x7fab08031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8543458cf20b95ff server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.112+0000 7fab01600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.112+0000 7fab01600640 1 -- 172.21.15.40:0/4239744373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08035070 con 0x55c24ccfab60 2024-07-26T12:50:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.112+0000 7fab01600640 1 -- 172.21.15.40:0/4239744373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab08031400 con 0x55c24ccfab60 2024-07-26T12:50:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.112+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab08004030 con 0x55c24ccfab60 2024-07-26T12:50:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab01600640 1 -- 172.21.15.40:0/4239744373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fab080044b0 con 0x55c24ccfab60 2024-07-26T12:50:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab25216740 10 client.16485 fetch_fsmap learned FSMap version 35 2024-07-26T12:50:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c24d0db730 con 0x55c24ccfab60 2024-07-26T12:50:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab01600640 1 -- 172.21.15.40:0/4239744373 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab08004030 con 0x55c24ccfab60 2024-07-26T12:50:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab01600640 1 -- 172.21.15.40:0/4239744373 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fab0803c640 con 0x55c24ccfab60 2024-07-26T12:50:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab25216740 10 client.16485 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:50:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab25216740 10 client.16485 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:50:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab25216740 20 client.16485 populate_metadata read hostname 'smithi040' 2024-07-26T12:50:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.113+0000 7fab25216740 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccda1c0 0x55c24d0dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.114+0000 7fab25216740 4 client.16485 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:50:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.114+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c24d038ab0 con 0x55c24ccda1c0 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.114+0000 7fab16a00640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccda1c0 0x55c24d0dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.116+0000 7fab16a00640 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccda1c0 0x55c24d0dea90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=131e78969e843444 server_cookie=d11d6e680204890d in_seq=0 out_seq=0 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.116+0000 7fab01600640 10 client.16485 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.117+0000 7fab01600640 1 -- 172.21.15.40:0/4239744373 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c24d038ab0 con 0x55c24ccda1c0 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.117+0000 7fab01600640 10 client.16485 handle_command_reply: tid=0 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 client.16485 shutdown 2024-07-26T12:50:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 msgr2=0x55c24d0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 0x55c24d0cd210 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fab08032fd0 tx=0x7fab08031930 comp rx=0 tx=0).stop 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 shutdown_connections 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0d8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccda1c0 0x55c24d0dea90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccfab60 0x55c24d0cd210 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 --2- 172.21.15.40:0/4239744373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccf2980 0x55c24d0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 >> 172.21.15.40:0/4239744373 conn(0x55c24cd0f990 msgr2=0x55c24d0c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab01600640 0 client.16485 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 shutdown_connections 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.118+0000 7fab25216740 1 -- 172.21.15.40:0/4239744373 wait complete. 2024-07-26T12:50:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.119+0000 7fab25216740 20 client.16485 trim_cache size 0 max 16384 2024-07-26T12:50:31.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 Processor -- start 2024-07-26T12:50:31.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 -- start start 2024-07-26T12:50:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24ccfab60 0x55c24d0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24cd1b840 0x55c24d0d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fab181b5450 con 0x55c24ccf2980 2024-07-26T12:50:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fab181b6f90 con 0x55c24ccfab60 2024-07-26T12:50:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.138+0000 7fab25216740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab181b5b20 con 0x55c24cd1b840 2024-07-26T12:50:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54832/0 (socket says 172.21.15.40:54832) 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 -- 172.21.15.40:0/2019496974 learned_addr learned my addr 172.21.15.40:0/2019496974 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab17400640 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24ccfab60 0x55c24d0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24cd1b840 0x55c24d0d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 -- 172.21.15.40:0/2019496974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24cd1b840 msgr2=0x55c24d0d8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24cd1b840 0x55c24d0d8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 -- 172.21.15.40:0/2019496974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24ccfab60 msgr2=0x55c24d0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24ccfab60 0x55c24d0c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.139+0000 7fab16a00640 1 -- 172.21.15.40:0/2019496974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c24d0c49a0 con 0x55c24ccf2980 2024-07-26T12:50:31.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.140+0000 7fab16a00640 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0ce9b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fab04000c00 tx=0x7fab04009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f086a3d1ecc3998f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:31.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.140+0000 7fab03e00640 1 -- 172.21.15.40:0/2019496974 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04017910 con 0x55c24ccf2980 2024-07-26T12:50:31.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.140+0000 7fab03e00640 1 -- 172.21.15.40:0/2019496974 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab04020230 con 0x55c24ccf2980 2024-07-26T12:50:31.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.140+0000 7fab03e00640 1 -- 172.21.15.40:0/2019496974 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040153d0 con 0x55c24ccf2980 2024-07-26T12:50:31.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.141+0000 7fab25216740 1 -- 172.21.15.40:0/2019496974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 msgr2=0x55c24d0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.141+0000 7fab25216740 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0ce9b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fab04000c00 tx=0x7fab04009470 comp rx=0 tx=0).stop 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 -- 172.21.15.40:0/2019496974 shutdown_connections 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24cd1b840 0x55c24d0d8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24ccfab60 0x55c24d0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 --2- 172.21.15.40:0/2019496974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0ce9b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 -- 172.21.15.40:0/2019496974 >> 172.21.15.40:0/2019496974 conn(0x55c24cd0f990 msgr2=0x55c24d0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 -- 172.21.15.40:0/2019496974 shutdown_connections 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 -- 172.21.15.40:0/2019496974 wait complete. 2024-07-26T12:50:31.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.142+0000 7fab25216740 1 -- start start 2024-07-26T12:50:31.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 Processor -- start 2024-07-26T12:50:31.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0dfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fab181b68c0 con 0x55c24ccf2980 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fab181b61f0 con 0x55c24cd1b840 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab181b3410 con 0x55c24ccfab60 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab25216740 10 client.0 _ll_register_callbacks cb 0x7fab040097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.143+0000 7fab16a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0dfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0dfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54840/0 (socket says 172.21.15.40:54840) 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 -- 172.21.15.40:0/857932810 learned_addr learned my addr 172.21.15.40:0/857932810 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab17400640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 -- 172.21.15.40:0/857932810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 msgr2=0x55c24d0dffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0dffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 -- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 msgr2=0x55c24d0e04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0e04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.144+0000 7fab16a00640 1 -- 172.21.15.40:0/857932810 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c24d0bf2a0 con 0x55c24ccf2980 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab16a00640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0dfa60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fab0400a010 tx=0x7fab040047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9677d078ce8cca1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab01600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab01600640 1 -- 172.21.15.40:0/857932810 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04037060 con 0x55c24ccf2980 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab04020230 con 0x55c24ccf2980 2024-07-26T12:50:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab01600640 1 -- 172.21.15.40:0/857932810 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab040207f0 con 0x55c24ccf2980 2024-07-26T12:50:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab01600640 1 -- 172.21.15.40:0/857932810 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fab04017910 con 0x55c24ccf2980 2024-07-26T12:50:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab25216740 10 client.16491 fetch_fsmap learned FSMap version 35 2024-07-26T12:50:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.145+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c24d147130 con 0x55c24ccf2980 2024-07-26T12:50:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab01600640 1 -- 172.21.15.40:0/857932810 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab04020230 con 0x55c24ccf2980 2024-07-26T12:50:31.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab01600640 1 -- 172.21.15.40:0/857932810 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fab0402b720 con 0x55c24ccf2980 2024-07-26T12:50:31.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab25216740 10 client.16491 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab25216740 10 client.16491 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab25216740 20 client.16491 populate_metadata read hostname 'smithi040' 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab25216740 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccaf570 0x55c24d149880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab25216740 4 client.16491 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.2, "await_for": 45.0}] 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.146+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.2, "await_for": 45.0}) -- 0x55c24d034550 con 0x55c24ccaf570 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.147+0000 7fab17400640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccaf570 0x55c24d149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.148+0000 7fab17400640 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccaf570 0x55c24d149880 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a74560d6da9e7a45 server_cookie=3610fbac51b2c01f in_seq=0 out_seq=0 2024-07-26T12:50:31.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.148+0000 7fab01600640 10 client.16491 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab01600640 1 -- 172.21.15.40:0/857932810 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c24d034550 con 0x55c24ccaf570 2024-07-26T12:50:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab01600640 10 client.16491 handle_command_reply: tid=0 2024-07-26T12:50:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 client.16491 shutdown 2024-07-26T12:50:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 msgr2=0x55c24d0dfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0dfa60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fab0400a010 tx=0x7fab040047d0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 shutdown_connections 2024-07-26T12:50:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c24cd1b840 0x55c24d0e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c24ccfab60 0x55c24d0dffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c24ccaf570 0x55c24d149880 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 --2- 172.21.15.40:0/857932810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c24ccf2980 0x55c24d0dfa60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 >> 172.21.15.40:0/857932810 conn(0x55c24cd0f990 msgr2=0x55c24d0bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.469+0000 7fab01600640 0 client.16491 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.470+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 shutdown_connections 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.470+0000 7fab25216740 1 -- 172.21.15.40:0/857932810 wait complete. 2024-07-26T12:50:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.470+0000 7fab25216740 20 client.16491 trim_cache size 0 max 16384 2024-07-26T12:50:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:50:31.473 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:50:31.473 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:50:31.473 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 86, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "ca229aa": { 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 86, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.2, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:50:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.471+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faafc0b3bd0 msgr2=0x7faafc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.471+0000 7fab1e600640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faafc0b3bd0 0x7faafc0b60e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fab100a6be0 tx=0x7fab100057c0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.471+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 msgr2=0x7fab181a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.471+0000 7fab1e600640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 0x7fab181a5cb0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fab1000cad0 tx=0x7fab1000ced0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 shutdown_connections 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab1810fe50 0x7fab181a5cb0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab1810f500 0x7fab181a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faafc0b3bd0 0x7faafc0b60e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 --2- 172.21.15.40:0/1488810693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18109bc0 0x7fab181a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 >> 172.21.15.40:0/1488810693 conn(0x7fab18077bf0 msgr2=0x7fab181081a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 shutdown_connections 2024-07-26T12:50:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:31.472+0000 7fab1e600640 1 -- 172.21.15.40:0/1488810693 wait complete. 2024-07-26T12:50:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:31 smithi040 ceph-mon[32397]: pgmap v1348: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:50:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:31 smithi146 ceph-mon[35807]: pgmap v1348: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:50:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:31 smithi076 ceph-mon[35401]: pgmap v1348: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:50:32.392 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ca229aa', quiesce took 9.4 seconds. Will release after: 8.799999999999999 2024-07-26T12:50:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:33 smithi146 ceph-mon[35807]: pgmap v1349: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:50:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:33 smithi076 ceph-mon[35401]: pgmap v1349: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:50:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:33 smithi040 ceph-mon[32397]: pgmap v1349: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T12:50:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:35 smithi146 ceph-mon[35807]: pgmap v1350: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:50:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:35 smithi076 ceph-mon[35401]: pgmap v1350: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:50:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:35 smithi040 ceph-mon[32397]: pgmap v1350: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:50:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:37 smithi040 ceph-mon[32397]: pgmap v1351: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:50:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:37 smithi146 ceph-mon[35807]: pgmap v1351: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:50:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:37 smithi076 ceph-mon[35401]: pgmap v1351: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:50:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:39 smithi040 ceph-mon[32397]: pgmap v1352: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T12:50:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:39 smithi146 ceph-mon[35807]: pgmap v1352: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T12:50:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:39 smithi076 ceph-mon[35401]: pgmap v1352: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T12:50:41.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:50:41.688 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:50:42.155 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:41 smithi040 ceph-mon[32397]: pgmap v1353: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:50:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:41 smithi146 ceph-mon[35807]: pgmap v1353: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:50:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:41 smithi076 ceph-mon[35401]: pgmap v1353: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 -- 172.21.15.40:0/2132633096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 msgr2=0x7f1e2010f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2132633096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2010f4e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009900 tx=0x7f1e0c02a480 comp rx=0 tx=0).stop 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 -- 172.21.15.40:0/2132633096 shutdown_connections 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2132633096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1e2010fa20 0x7f1e20111e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2132633096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2010f4e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2132633096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e20101e70 0x7f1e20102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 -- 172.21.15.40:0/2132633096 >> 172.21.15.40:0/2132633096 conn(0x7f1e200fdcf0 msgr2=0x7f1e20100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 -- 172.21.15.40:0/2132633096 shutdown_connections 2024-07-26T12:50:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.842+0000 7f1e1f200640 1 -- 172.21.15.40:0/2132633096 wait complete. 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 Processor -- start 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 -- start start 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e20101e70 0x7f1e2019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1e2010fa20 0x7f1e201a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20115370 con 0x7f1e201027c0 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201151f0 con 0x7f1e2010fa20 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.844+0000 7f1e1f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201154f0 con 0x7f1e20101e70 2024-07-26T12:50:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49118/0 (socket says 172.21.15.40:49118) 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 -- 172.21.15.40:0/2347713516 learned_addr learned my addr 172.21.15.40:0/2347713516 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1de00640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e20101e70 0x7f1e2019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1e800640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1e2010fa20 0x7f1e201a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 -- 172.21.15.40:0/2347713516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e20101e70 msgr2=0x7f1e2019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e20101e70 0x7f1e2019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 -- 172.21.15.40:0/2347713516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1e2010fa20 msgr2=0x7f1e201a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1e2010fa20 0x7f1e201a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.845+0000 7f1e1d400640 1 -- 172.21.15.40:0/2347713516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e201a1d90 con 0x7f1e201027c0 2024-07-26T12:50:43.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.846+0000 7f1e1d400640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2019c3c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c02a9a0 tx=0x7f1e0c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:43.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.846+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c03f070 con 0x7f1e201027c0 2024-07-26T12:50:43.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.846+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e0c003e40 con 0x7f1e201027c0 2024-07-26T12:50:43.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.846+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e201a2020 con 0x7f1e201027c0 2024-07-26T12:50:43.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.846+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c035030 con 0x7f1e201027c0 2024-07-26T12:50:43.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.846+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e201a87e0 con 0x7f1e201027c0 2024-07-26T12:50:43.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.848+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2006af30 con 0x7f1e201027c0 2024-07-26T12:50:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.850+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1e0c042070 con 0x7f1e201027c0 2024-07-26T12:50:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.852+0000 7f1e16a00640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1e040b3bd0 0x7f1e040b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.852+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1e0c1048d0 con 0x7f1e201027c0 2024-07-26T12:50:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.852+0000 7f1e1de00640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1e040b3bd0 0x7f1e040b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.853+0000 7f1e1de00640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1e040b3bd0 0x7f1e040b60e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1e10005fd0 tx=0x7f1e10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:43.854+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1e0c0cbee0 con 0x7f1e201027c0 2024-07-26T12:50:44.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.105+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e20102280 con 0x7f1e201027c0 2024-07-26T12:50:44.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.106+0000 7f1e16a00640 1 -- 172.21.15.40:0/2347713516 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f1e20102280 con 0x7f1e201027c0 2024-07-26T12:50:44.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:50:44.108 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:50:44.108 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1e040b3bd0 msgr2=0x7f1e040b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1e040b3bd0 0x7f1e040b60e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1e10005fd0 tx=0x7f1e10005850 comp rx=0 tx=0).stop 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 msgr2=0x7f1e2019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2019c3c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c02a9a0 tx=0x7f1e0c003c20 comp rx=0 tx=0).stop 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 shutdown_connections 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1e2010fa20 0x7f1e201a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e201027c0 0x7f1e2019c3c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1e040b3bd0 0x7f1e040b60e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 --2- 172.21.15.40:0/2347713516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e20101e70 0x7f1e2019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 >> 172.21.15.40:0/2347713516 conn(0x7f1e200fdcf0 msgr2=0x7f1e20100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:44.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 shutdown_connections 2024-07-26T12:50:44.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:44.110+0000 7f1e1f200640 1 -- 172.21.15.40:0/2347713516 wait complete. 2024-07-26T12:50:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:43 smithi040 ceph-mon[32397]: pgmap v1354: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-07-26T12:50:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:43 smithi146 ceph-mon[35807]: pgmap v1354: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-07-26T12:50:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:43 smithi076 ceph-mon[35401]: pgmap v1354: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-07-26T12:50:44.991 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id ca229aa --release --await' 2024-07-26T12:50:44.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id ca229aa --release --await 2024-07-26T12:50:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2347713516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2347713516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2347713516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:45.479 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:50:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:45 smithi040 ceph-mon[32397]: pgmap v1355: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 866 KiB/s wr, 12 op/s 2024-07-26T12:50:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:45 smithi146 ceph-mon[35807]: pgmap v1355: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 866 KiB/s wr, 12 op/s 2024-07-26T12:50:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:45 smithi076 ceph-mon[35401]: pgmap v1355: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 866 KiB/s wr, 12 op/s 2024-07-26T12:50:47.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 -- 172.21.15.40:0/3038007675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460075800 msgr2=0x7fb460075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 --2- 172.21.15.40:0/3038007675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460075800 0x7fb460075c10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb448009ca0 tx=0x7fb44802a8c0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 -- 172.21.15.40:0/3038007675 shutdown_connections 2024-07-26T12:50:47.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 --2- 172.21.15.40:0/3038007675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb460113c90 0x7fb460116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 --2- 172.21.15.40:0/3038007675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460075800 0x7fb460075c10 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 --2- 172.21.15.40:0/3038007675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb460076db0 0x7fb4600751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 -- 172.21.15.40:0/3038007675 >> 172.21.15.40:0/3038007675 conn(0x7fb4600fee70 msgr2=0x7fb4601012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:47.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 -- 172.21.15.40:0/3038007675 shutdown_connections 2024-07-26T12:50:47.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.646+0000 7fb465000640 1 -- 172.21.15.40:0/3038007675 wait complete. 2024-07-26T12:50:47.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.647+0000 7fb465000640 1 Processor -- start 2024-07-26T12:50:47.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.647+0000 7fb465000640 1 -- start start 2024-07-26T12:50:47.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb465000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb460075800 0x7fb4601a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb465000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb460076db0 0x7fb4601a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb465000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 0x7fb4601a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb465000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601197d0 con 0x7fb460113c90 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb465000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb460119650 con 0x7fb460076db0 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb465000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb460119950 con 0x7fb460075800 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb45fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 0x7fb4601a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb45fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 0x7fb4601a5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49132/0 (socket says 172.21.15.40:49132) 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.648+0000 7fb45fe00640 1 -- 172.21.15.40:0/1166739828 learned_addr learned my addr 172.21.15.40:0/1166739828 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45f400640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb460075800 0x7fb4601a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45ea00640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb460076db0 0x7fb4601a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45fe00640 1 -- 172.21.15.40:0/1166739828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb460075800 msgr2=0x7fb4601a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45fe00640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb460075800 0x7fb4601a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45fe00640 1 -- 172.21.15.40:0/1166739828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb460076db0 msgr2=0x7fb4601a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45fe00640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb460076db0 0x7fb4601a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45fe00640 1 -- 172.21.15.40:0/1166739828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4601a6170 con 0x7fb460113c90 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.649+0000 7fb45fe00640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 0x7fb4601a5a40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb45800d750 tx=0x7fb45800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.650+0000 7fb457e00640 1 -- 172.21.15.40:0/1166739828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458017070 con 0x7fb460113c90 2024-07-26T12:50:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.650+0000 7fb457e00640 1 -- 172.21.15.40:0/1166739828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4580054b0 con 0x7fb460113c90 2024-07-26T12:50:47.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.650+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4601a6460 con 0x7fb460113c90 2024-07-26T12:50:47.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.650+0000 7fb457e00640 1 -- 172.21.15.40:0/1166739828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458004b90 con 0x7fb460113c90 2024-07-26T12:50:47.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.650+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4601acbc0 con 0x7fb460113c90 2024-07-26T12:50:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.654+0000 7fb46d254740 1 Processor -- start 2024-07-26T12:50:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.654+0000 7fb457e00640 1 -- 172.21.15.40:0/1166739828 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb458004d30 con 0x7fb460113c90 2024-07-26T12:50:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.654+0000 7fb46d254740 1 -- start start 2024-07-26T12:50:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb46d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb46d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1e4660 0x55b4eb5b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb46d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 0x55b4eb5b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb46d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b4eb528f30 con 0x55b4eb1ec840 2024-07-26T12:50:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb46d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b4eb518430 con 0x55b4eb20d520 2024-07-26T12:50:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb46d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b4eb51c470 con 0x55b4eb1e4660 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb45ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 0x55b4eb5b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb45ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 0x55b4eb5b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49134/0 (socket says 172.21.15.40:49134) 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb45ea00640 1 -- 172.21.15.40:0/1161792606 learned_addr learned my addr 172.21.15.40:0/1161792606 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb45f400640 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1e4660 0x55b4eb5b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.655+0000 7fb45ea00640 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb45ea00640 1 -- 172.21.15.40:0/1161792606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1e4660 msgr2=0x55b4eb5b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb45ea00640 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1e4660 0x55b4eb5b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb45ea00640 1 -- 172.21.15.40:0/1161792606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 msgr2=0x55b4eb5b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb45ea00640 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb45ea00640 1 -- 172.21.15.40:0/1161792606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4eb278b00 con 0x55b4eb1ec840 2024-07-26T12:50:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb457e00640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb4440b3bd0 0x7fb4440b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.656+0000 7fb45ea00640 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 0x55b4eb5b2c00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb46006c450 tx=0x7fb448004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ce24a8ea5cd1b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.657+0000 7fb457e00640 1 -- 172.21.15.40:0/1166739828 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb4580e3740 con 0x7fb460113c90 2024-07-26T12:50:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.657+0000 7fb45f400640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb4440b3bd0 0x7fb4440b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.657+0000 7fb454c00640 1 -- 172.21.15.40:0/1161792606 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448031980 con 0x55b4eb1ec840 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.657+0000 7fb454c00640 1 -- 172.21.15.40:0/1161792606 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb448036040 con 0x55b4eb1ec840 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.657+0000 7fb454c00640 1 -- 172.21.15.40:0/1161792606 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448030e80 con 0x55b4eb1ec840 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 -- 172.21.15.40:0/1161792606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 msgr2=0x55b4eb5b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 0x55b4eb5b2c00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb46006c450 tx=0x7fb448004a40 comp rx=0 tx=0).stop 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb45f400640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb4440b3bd0 0x7fb4440b60e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55b4eb5b0e00 tx=0x7fb45000b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 -- 172.21.15.40:0/1161792606 shutdown_connections 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1ec840 0x55b4eb5b2c00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1e4660 0x55b4eb5b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 --2- 172.21.15.40:0/1161792606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 -- 172.21.15.40:0/1161792606 >> 172.21.15.40:0/1161792606 conn(0x55b4eb201910 msgr2=0x55b4eb5b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.658+0000 7fb46d254740 1 -- 172.21.15.40:0/1161792606 shutdown_connections 2024-07-26T12:50:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.659+0000 7fb46d254740 1 -- 172.21.15.40:0/1161792606 wait complete. 2024-07-26T12:50:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.659+0000 7fb46d254740 1 -- start start 2024-07-26T12:50:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.659+0000 7fb46d254740 1 Processor -- start 2024-07-26T12:50:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b4eb37bbb0 con 0x55b4eb1e4660 2024-07-26T12:50:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b4eb4b4910 con 0x55b4eb20d520 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b4eb5c0780 con 0x55b4eb1ec840 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb46d254740 10 client.0 _ll_register_callbacks cb 0x55b4eb224d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb45f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb45f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49140/0 (socket says 172.21.15.40:49140) 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.660+0000 7fb45f400640 1 -- 172.21.15.40:0/2295184893 learned_addr learned my addr 172.21.15.40:0/2295184893 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45ea00640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45fe00640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45f400640 1 -- 172.21.15.40:0/2295184893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 msgr2=0x55b4eb5bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45f400640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5bddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45f400640 1 -- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 msgr2=0x55b4eb5c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45f400640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.661+0000 7fb45f400640 1 -- 172.21.15.40:0/2295184893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4eb2ef960 con 0x55b4eb1e4660 2024-07-26T12:50:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb45f400640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bd880 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb450013fd0 tx=0x7fb4500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeabf8e47e469ad server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb44d600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb44d600640 1 -- 172.21.15.40:0/2295184893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450029680 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb44d600640 1 -- 172.21.15.40:0/2295184893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb450029820 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb448036040 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb44d600640 1 -- 172.21.15.40:0/2295184893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb450029a20 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb46d254740 10 client.16509 fetch_fsmap learned FSMap version 35 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.662+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b4eb5cc5b0 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb44d600640 1 -- 172.21.15.40:0/2295184893 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb448036040 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb44d600640 1 -- 172.21.15.40:0/2295184893 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb45001ec50 con 0x55b4eb1e4660 2024-07-26T12:50:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb46d254740 10 client.16509 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:50:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb46d254740 10 client.16509 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:50:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb46d254740 20 client.16509 populate_metadata read hostname 'smithi040' 2024-07-26T12:50:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb46d254740 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1cbea0 0x55b4eb5cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb46d254740 4 client.16509 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:50:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.663+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4eb52ae80 con 0x55b4eb1cbea0 2024-07-26T12:50:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.664+0000 7fb45ea00640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1cbea0 0x55b4eb5cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.665+0000 7fb44d600640 10 client.16509 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.665+0000 7fb45ea00640 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1cbea0 0x55b4eb5cfae0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b04807bfd0deb64 server_cookie=1f5eba1d0a9f46dc in_seq=0 out_seq=0 2024-07-26T12:50:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb44d600640 1 -- 172.21.15.40:0/2295184893 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4eb52ae80 con 0x55b4eb1cbea0 2024-07-26T12:50:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb44d600640 10 client.16509 handle_command_reply: tid=0 2024-07-26T12:50:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 client.16509 shutdown 2024-07-26T12:50:47.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 msgr2=0x55b4eb5bd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bd880 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb450013fd0 tx=0x7fb4500046c0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 shutdown_connections 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1cbea0 0x55b4eb5cfae0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.667+0000 7fb46d254740 1 --2- 172.21.15.40:0/2295184893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bd880 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.668+0000 7fb44d600640 0 client.16509 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.668+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 >> 172.21.15.40:0/2295184893 conn(0x55b4eb201910 msgr2=0x55b4eb5b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.668+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 shutdown_connections 2024-07-26T12:50:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.668+0000 7fb46d254740 1 -- 172.21.15.40:0/2295184893 wait complete. 2024-07-26T12:50:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.668+0000 7fb46d254740 20 client.16509 trim_cache size 0 max 16384 2024-07-26T12:50:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.687+0000 7fb46d254740 1 Processor -- start 2024-07-26T12:50:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.687+0000 7fb46d254740 1 -- start start 2024-07-26T12:50:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb46d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb46d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb46d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb46d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b5200 con 0x55b4eb1e4660 2024-07-26T12:50:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb46d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b6d40 con 0x55b4eb20d520 2024-07-26T12:50:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb46d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b58d0 con 0x55b4eb1ec840 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb45f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb45f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49156/0 (socket says 172.21.15.40:49156) 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb45f400640 1 -- 172.21.15.40:0/608168687 learned_addr learned my addr 172.21.15.40:0/608168687 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb45ea00640 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.688+0000 7fb45fe00640 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.689+0000 7fb45f400640 1 -- 172.21.15.40:0/608168687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 msgr2=0x55b4eb5c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.689+0000 7fb45f400640 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.689+0000 7fb45f400640 1 -- 172.21.15.40:0/608168687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 msgr2=0x55b4eb5c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.689+0000 7fb45f400640 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.689+0000 7fb45f400640 1 -- 172.21.15.40:0/608168687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4eb5bbd80 con 0x55b4eb1e4660 2024-07-26T12:50:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.689+0000 7fb45f400640 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bf760 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb450000c00 tx=0x7fb45000b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe60f5ef2607e05 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.690+0000 7fb44fe00640 1 -- 172.21.15.40:0/608168687 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450041070 con 0x55b4eb1e4660 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.690+0000 7fb44fe00640 1 -- 172.21.15.40:0/608168687 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb450029bc0 con 0x55b4eb1e4660 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.690+0000 7fb44fe00640 1 -- 172.21.15.40:0/608168687 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450005040 con 0x55b4eb1e4660 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 -- 172.21.15.40:0/608168687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 msgr2=0x55b4eb5bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bf760 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb450000c00 tx=0x7fb45000b5e0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 -- 172.21.15.40:0/608168687 shutdown_connections 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb20d520 0x55b4eb5c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 --2- 172.21.15.40:0/608168687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb1e4660 0x55b4eb5bf760 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 -- 172.21.15.40:0/608168687 >> 172.21.15.40:0/608168687 conn(0x55b4eb201910 msgr2=0x55b4eb5ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 -- 172.21.15.40:0/608168687 shutdown_connections 2024-07-26T12:50:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.691+0000 7fb46d254740 1 -- 172.21.15.40:0/608168687 wait complete. 2024-07-26T12:50:47.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.692+0000 7fb46d254740 1 -- start start 2024-07-26T12:50:47.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.692+0000 7fb46d254740 1 Processor -- start 2024-07-26T12:50:47.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb1e4660 0x55b4eb5c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 0x55b4eb6312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b6670 con 0x55b4eb20d520 2024-07-26T12:50:47.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b5fa0 con 0x55b4eb1e4660 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b31c0 con 0x55b4eb1ec840 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb46d254740 10 client.0 _ll_register_callbacks cb 0x7fb45000b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb45fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 0x55b4eb6312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb45fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 0x55b4eb6312b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49172/0 (socket says 172.21.15.40:49172) 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.693+0000 7fb45fe00640 1 -- 172.21.15.40:0/2386049341 learned_addr learned my addr 172.21.15.40:0/2386049341 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45f400640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb1e4660 0x55b4eb5c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45ea00640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45fe00640 1 -- 172.21.15.40:0/2386049341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 msgr2=0x55b4eb5c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45fe00640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45fe00640 1 -- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb1e4660 msgr2=0x55b4eb5c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45fe00640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb1e4660 0x55b4eb5c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45fe00640 1 -- 172.21.15.40:0/2386049341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4eb631920 con 0x55b4eb20d520 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45ea00640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb45fe00640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 0x55b4eb6312b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb458000c00 tx=0x7fb4580aa0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7883f9d1defe7091 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.694+0000 7fb44d600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.695+0000 7fb44d600640 1 -- 172.21.15.40:0/2386049341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458020030 con 0x55b4eb20d520 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.695+0000 7fb44d600640 1 -- 172.21.15.40:0/2386049341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb4580a68e0 con 0x55b4eb20d520 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.695+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb450029bc0 con 0x55b4eb20d520 2024-07-26T12:50:47.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.695+0000 7fb44d600640 1 -- 172.21.15.40:0/2386049341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb4580aa650 con 0x55b4eb20d520 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.695+0000 7fb46d254740 10 client.16515 fetch_fsmap learned FSMap version 35 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.695+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b4eb638d30 con 0x55b4eb20d520 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb44d600640 1 -- 172.21.15.40:0/2386049341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb450029bc0 con 0x55b4eb20d520 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb44d600640 1 -- 172.21.15.40:0/2386049341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb4580cbbe0 con 0x55b4eb20d520 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb46d254740 10 client.16515 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb46d254740 10 client.16515 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb46d254740 20 client.16515 populate_metadata read hostname 'smithi040' 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb46d254740 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1a1250 0x55b4eb63b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:47.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb46d254740 4 client.16515 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ca229aa", "release": true, "await": true}] 2024-07-26T12:50:47.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.696+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ca229aa", "release": true, "await": true}) -- 0x55b4eb5b05d0 con 0x55b4eb1a1250 2024-07-26T12:50:47.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.697+0000 7fb45f400640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1a1250 0x55b4eb63b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:47.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.698+0000 7fb45f400640 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1a1250 0x55b4eb63b4f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a27c9656b908aea server_cookie=d9a7757f9b8d70b in_seq=0 out_seq=0 2024-07-26T12:50:47.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.698+0000 7fb44d600640 10 client.16515 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.758+0000 7fb44d600640 1 -- 172.21.15.40:0/2386049341 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b4eb5b05d0 con 0x55b4eb1a1250 2024-07-26T12:50:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.758+0000 7fb44d600640 10 client.16515 handle_command_reply: tid=0 2024-07-26T12:50:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.758+0000 7fb46d254740 1 client.16515 shutdown 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.758+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 msgr2=0x55b4eb6312b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.758+0000 7fb46d254740 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 0x55b4eb6312b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb458000c00 tx=0x7fb4580aa0a0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 shutdown_connections 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b4eb1a1250 0x55b4eb63b4f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b4eb20d520 0x55b4eb6312b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b4eb1ec840 0x55b4eb5c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 --2- 172.21.15.40:0/2386049341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b4eb1e4660 0x55b4eb5c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 >> 172.21.15.40:0/2386049341 conn(0x55b4eb201910 msgr2=0x55b4eb5beb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:47.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb44d600640 0 client.16515 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:47.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.759+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 shutdown_connections 2024-07-26T12:50:47.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.760+0000 7fb46d254740 1 -- 172.21.15.40:0/2386049341 wait complete. 2024-07-26T12:50:47.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.760+0000 7fb46d254740 20 client.16515 trim_cache size 0 max 16384 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 88, 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "ca229aa": { 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 88, 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:50:47.762 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.2, 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:47.763 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:47.764 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:47.764 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:50:47.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb4440b3bd0 msgr2=0x7fb4440b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb4440b3bd0 0x7fb4440b60e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55b4eb5b0e00 tx=0x7fb45000b4d0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 msgr2=0x7fb4601a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 0x7fb4601a5a40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb45800d750 tx=0x7fb45800dc10 comp rx=0 tx=0).stop 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 shutdown_connections 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb460113c90 0x7fb4601a5a40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb460076db0 0x7fb4601a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb4440b3bd0 0x7fb4440b60e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 --2- 172.21.15.40:0/1166739828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb460075800 0x7fb4601a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.761+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 >> 172.21.15.40:0/1166739828 conn(0x7fb4600fee70 msgr2=0x7fb46010fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.762+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 shutdown_connections 2024-07-26T12:50:47.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:47.762+0000 7fb465000640 1 -- 172.21.15.40:0/1166739828 wait complete. 2024-07-26T12:50:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:47 smithi146 ceph-mon[35807]: pgmap v1356: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 183 KiB/s wr, 8 op/s 2024-07-26T12:50:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:47 smithi076 ceph-mon[35401]: pgmap v1356: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 183 KiB/s wr, 8 op/s 2024-07-26T12:50:48.342 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:47 smithi040 ceph-mon[32397]: pgmap v1356: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 183 KiB/s wr, 8 op/s 2024-07-26T12:50:48.788 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ca229aa', total seconds elapsed: 25.8 2024-07-26T12:50:48.788 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.2 2024-07-26T12:50:48.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:50:49.320 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:50:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:49 smithi040 ceph-mon[32397]: pgmap v1357: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 183 KiB/s wr, 11 op/s 2024-07-26T12:50:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:49 smithi146 ceph-mon[35807]: pgmap v1357: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 183 KiB/s wr, 11 op/s 2024-07-26T12:50:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:49 smithi076 ceph-mon[35401]: pgmap v1357: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 183 KiB/s wr, 11 op/s 2024-07-26T12:50:51.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 -- 172.21.15.40:0/3907034274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 msgr2=0x7f3ccc110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:51.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/3907034274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc110050 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009ca0 tx=0x7f3cc402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 -- 172.21.15.40:0/3907034274 shutdown_connections 2024-07-26T12:50:51.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/3907034274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc110050 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/3907034274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ccc108ed0 0x7f3ccc1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/3907034274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc103590 0x7f3ccc1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 -- 172.21.15.40:0/3907034274 >> 172.21.15.40:0/3907034274 conn(0x7f3ccc07b280 msgr2=0x7f3ccc07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:51.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 -- 172.21.15.40:0/3907034274 shutdown_connections 2024-07-26T12:50:51.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.555+0000 7f3cd3a00640 1 -- 172.21.15.40:0/3907034274 wait complete. 2024-07-26T12:50:51.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.557+0000 7f3cd3a00640 1 Processor -- start 2024-07-26T12:50:51.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.557+0000 7f3cd3a00640 1 -- start start 2024-07-26T12:50:51.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd3a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ccc103590 0x7f3ccc19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:51.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd3a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc108ed0 0x7f3ccc19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd3a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd3a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc1133d0 con 0x7f3ccc109820 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd3a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc113250 con 0x7f3ccc103590 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd3a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc113550 con 0x7f3ccc108ed0 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc1a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49186/0 (socket says 172.21.15.40:49186) 2024-07-26T12:50:51.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd1a00640 1 -- 172.21.15.40:0/2359500196 learned_addr learned my addr 172.21.15.40:0/2359500196 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3cd1000640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ccc103590 0x7f3ccc19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.558+0000 7f3ccbe00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc108ed0 0x7f3ccc19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.559+0000 7f3cd1a00640 1 -- 172.21.15.40:0/2359500196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc108ed0 msgr2=0x7f3ccc19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.559+0000 7f3cd1a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc108ed0 0x7f3ccc19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.559+0000 7f3cd1a00640 1 -- 172.21.15.40:0/2359500196 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ccc103590 msgr2=0x7f3ccc19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.559+0000 7f3cd1a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ccc103590 0x7f3ccc19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.559+0000 7f3cd1a00640 1 -- 172.21.15.40:0/2359500196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc1a1f10 con 0x7f3ccc109820 2024-07-26T12:50:51.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.559+0000 7f3cd1a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc1a17e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4005cc0 tx=0x7f3cc4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.560+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4032e00 con 0x7f3ccc109820 2024-07-26T12:50:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.560+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cc40044d0 con 0x7f3ccc109820 2024-07-26T12:50:51.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.560+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc1a21a0 con 0x7f3ccc109820 2024-07-26T12:50:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.560+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4030b70 con 0x7f3ccc109820 2024-07-26T12:50:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.560+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc1a8960 con 0x7f3ccc109820 2024-07-26T12:50:51.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.561+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc1039a0 con 0x7f3ccc109820 2024-07-26T12:50:51.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.564+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3cc4030d10 con 0x7f3ccc109820 2024-07-26T12:50:51.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.566+0000 7f3cc9600640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cb40b3bd0 0x7f3cb40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.566+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3cc41051e0 con 0x7f3ccc109820 2024-07-26T12:50:51.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.566+0000 7f3cd1000640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cb40b3bd0 0x7f3cb40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:51.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.567+0000 7f3cd1000640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cb40b3bd0 0x7f3cb40b60e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000bbe0 tx=0x7f3cc000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:51.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.568+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3cc40cc7f0 con 0x7f3ccc109820 2024-07-26T12:50:51.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.935+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ccc1a8b90 con 0x7f3ccc109820 2024-07-26T12:50:51.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.937+0000 7f3cc9600640 1 -- 172.21.15.40:0/2359500196 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f3cc40cc0f0 con 0x7f3ccc109820 2024-07-26T12:50:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:50:51.939 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:50:51.939 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:50:51.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.940+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cb40b3bd0 msgr2=0x7f3cb40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:51.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.940+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cb40b3bd0 0x7f3cb40b60e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000bbe0 tx=0x7f3cc000b390 comp rx=0 tx=0).stop 2024-07-26T12:50:51.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.940+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 msgr2=0x7f3ccc1a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:51.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.940+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc1a17e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4005cc0 tx=0x7f3cc4032a10 comp rx=0 tx=0).stop 2024-07-26T12:50:51.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 shutdown_connections 2024-07-26T12:50:51.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ccc109820 0x7f3ccc1a17e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3cb40b3bd0 0x7f3cb40b60e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ccc108ed0 0x7f3ccc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 --2- 172.21.15.40:0/2359500196 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ccc103590 0x7f3ccc19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:51.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 >> 172.21.15.40:0/2359500196 conn(0x7f3ccc07b280 msgr2=0x7f3ccc106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:51.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 shutdown_connections 2024-07-26T12:50:51.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:51.941+0000 7f3cd3a00640 1 -- 172.21.15.40:0/2359500196 wait complete. 2024-07-26T12:50:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:51 smithi040 ceph-mon[32397]: pgmap v1358: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:50:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2359500196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:51 smithi146 ceph-mon[35807]: pgmap v1358: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:50:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2359500196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:51 smithi076 ceph-mon[35401]: pgmap v1358: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T12:50:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2359500196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:50:52.813 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 138.2 --await-for 45.0' 2024-07-26T12:50:52.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 138.2 --await-for 45.0 2024-07-26T12:50:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:53 smithi146 ceph-mon[35807]: pgmap v1359: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T12:50:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:53 smithi076 ceph-mon[35401]: pgmap v1359: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T12:50:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:50:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:53 smithi040 ceph-mon[32397]: pgmap v1359: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T12:50:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:50:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:50:54.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:50:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:50:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:50:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:55 smithi146 ceph-mon[35807]: pgmap v1360: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:50:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:50:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:50:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:55 smithi076 ceph-mon[35401]: pgmap v1360: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:50:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:50:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:50:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:50:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:55 smithi040 ceph-mon[32397]: pgmap v1360: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:50:56.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 -- 172.21.15.40:0/3322531784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 msgr2=0x7f98881164d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 --2- 172.21.15.40:0/3322531784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881164d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9880009ca0 tx=0x7f988002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 -- 172.21.15.40:0/3322531784 shutdown_connections 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 --2- 172.21.15.40:0/3322531784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881164d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 --2- 172.21.15.40:0/3322531784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f988810f350 0x7f988810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 --2- 172.21.15.40:0/3322531784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9888109a60 0x7f9888109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 -- 172.21.15.40:0/3322531784 >> 172.21.15.40:0/3322531784 conn(0x7f9888079100 msgr2=0x7f9888107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 -- 172.21.15.40:0/3322531784 shutdown_connections 2024-07-26T12:50:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.207+0000 7f9887e00640 1 -- 172.21.15.40:0/3322531784 wait complete. 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 Processor -- start 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 -- start start 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9888109a60 0x7f98881a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f988810f350 0x7f98881a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9888119810 con 0x7f988810fca0 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9888119690 con 0x7f988810f350 2024-07-26T12:50:56.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.209+0000 7f9887e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9888119990 con 0x7f9888109a60 2024-07-26T12:50:56.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56462/0 (socket says 172.21.15.40:56462) 2024-07-26T12:50:56.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 -- 172.21.15.40:0/3953302662 learned_addr learned my addr 172.21.15.40:0/3953302662 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:56.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9886a00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9888109a60 0x7f98881a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9886000640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f988810f350 0x7f98881a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 -- 172.21.15.40:0/3953302662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9888109a60 msgr2=0x7f98881a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9888109a60 0x7f98881a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 -- 172.21.15.40:0/3953302662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f988810f350 msgr2=0x7f98881a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.210+0000 7f9887400640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f988810f350 0x7f98881a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.211+0000 7f9887400640 1 -- 172.21.15.40:0/3953302662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98881a61b0 con 0x7f988810fca0 2024-07-26T12:50:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.211+0000 7f9887400640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881a5a80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9880005cc0 tx=0x7f9880032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.211+0000 7f987f400640 1 -- 172.21.15.40:0/3953302662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880032e00 con 0x7f988810fca0 2024-07-26T12:50:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.212+0000 7f987f400640 1 -- 172.21.15.40:0/3953302662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98800044d0 con 0x7f988810fca0 2024-07-26T12:50:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.212+0000 7f987f400640 1 -- 172.21.15.40:0/3953302662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880030b70 con 0x7f988810fca0 2024-07-26T12:50:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.212+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98881a6440 con 0x7f988810fca0 2024-07-26T12:50:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.212+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98881acc00 con 0x7f988810fca0 2024-07-26T12:50:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.216+0000 7f9894281740 1 Processor -- start 2024-07-26T12:50:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.216+0000 7f987f400640 1 -- 172.21.15.40:0/3953302662 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9880004680 con 0x7f988810fca0 2024-07-26T12:50:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 -- start start 2024-07-26T12:50:56.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 0x5564970b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ceeb60 0x5564970b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55649707fd10 con 0x556496ce6980 2024-07-26T12:50:56.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55649702ab60 con 0x556496ceeb60 2024-07-26T12:50:56.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.217+0000 7f9894281740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55649701a060 con 0x556496d0f840 2024-07-26T12:50:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.218+0000 7f9886a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 0x5564970b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.218+0000 7f9886a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 0x5564970b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56472/0 (socket says 172.21.15.40:56472) 2024-07-26T12:50:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.218+0000 7f9886a00640 1 -- 172.21.15.40:0/942377467 learned_addr learned my addr 172.21.15.40:0/942377467 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.218+0000 7f9886000640 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.218+0000 7f9886000640 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ceeb60 0x5564970b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886a00640 1 -- 172.21.15.40:0/942377467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 msgr2=0x5564970b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886a00640 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886a00640 1 -- 172.21.15.40:0/942377467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ceeb60 msgr2=0x5564970b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886a00640 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ceeb60 0x5564970b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886a00640 1 -- 172.21.15.40:0/942377467 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556496fa1b10 con 0x556496ce6980 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886000640 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f9886a00640 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 0x5564970b58f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f987800b760 tx=0x7f987800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2903021a64f2d887 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.219+0000 7f987f400640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f986c0b3c40 0x7f986c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.220+0000 7f987f400640 1 -- 172.21.15.40:0/3953302662 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9880104fc0 con 0x7f988810fca0 2024-07-26T12:50:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.220+0000 7f9886000640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f986c0b3c40 0x7f986c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.220+0000 7f9873400640 1 -- 172.21.15.40:0/942377467 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878003dd0 con 0x556496ce6980 2024-07-26T12:50:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.220+0000 7f9873400640 1 -- 172.21.15.40:0/942377467 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9878015070 con 0x556496ce6980 2024-07-26T12:50:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.220+0000 7f9873400640 1 -- 172.21.15.40:0/942377467 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878004c30 con 0x556496ce6980 2024-07-26T12:50:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 -- 172.21.15.40:0/942377467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 msgr2=0x5564970b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 0x5564970b58f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f987800b760 tx=0x7f987800bc20 comp rx=0 tx=0).stop 2024-07-26T12:50:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9886000640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f986c0b3c40 0x7f986c0b6150 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f987400b620 tx=0x7f987400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 -- 172.21.15.40:0/942377467 shutdown_connections 2024-07-26T12:50:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ceeb60 0x5564970b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ce6980 0x5564970b58f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 --2- 172.21.15.40:0/942377467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 -- 172.21.15.40:0/942377467 >> 172.21.15.40:0/942377467 conn(0x556496d03990 msgr2=0x5564970b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 -- 172.21.15.40:0/942377467 shutdown_connections 2024-07-26T12:50:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.221+0000 7f9894281740 1 -- 172.21.15.40:0/942377467 wait complete. 2024-07-26T12:50:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.222+0000 7f9894281740 1 -- start start 2024-07-26T12:50:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 Processor -- start 2024-07-26T12:50:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ce6980 0x5564970c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556496fb6520 con 0x556496ceeb60 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55649701e0a0 con 0x556496ce6980 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556496e7d7a0 con 0x556496d0f840 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.223+0000 7f9894281740 10 client.0 _ll_register_callbacks cb 0x556497012bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.224+0000 7f9886000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.224+0000 7f9886000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56476/0 (socket says 172.21.15.40:56476) 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.224+0000 7f9886000640 1 -- 172.21.15.40:0/532134563 learned_addr learned my addr 172.21.15.40:0/532134563 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.224+0000 7f9886a00640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ce6980 0x5564970c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.224+0000 7f9887400640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9886000640 1 -- 172.21.15.40:0/532134563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 msgr2=0x5564970ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9886000640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9886000640 1 -- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ce6980 msgr2=0x5564970c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9886000640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ce6980 0x5564970c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9886000640 1 -- 172.21.15.40:0/532134563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556496d89b90 con 0x556496ceeb60 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9886000640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c1420 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9874012700 tx=0x7f98740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470273f0480aa2cf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.225+0000 7f9867e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:50:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.226+0000 7f9867e00640 1 -- 172.21.15.40:0/532134563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98740107c0 con 0x556496ceeb60 2024-07-26T12:50:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.226+0000 7f9867e00640 1 -- 172.21.15.40:0/532134563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9874010960 con 0x556496ceeb60 2024-07-26T12:50:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.226+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9878015070 con 0x556496ceeb60 2024-07-26T12:50:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.226+0000 7f9867e00640 1 -- 172.21.15.40:0/532134563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9874010b60 con 0x556496ceeb60 2024-07-26T12:50:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.226+0000 7f9894281740 10 client.16533 fetch_fsmap learned FSMap version 35 2024-07-26T12:50:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.226+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5564970cfa00 con 0x556496ceeb60 2024-07-26T12:50:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9867e00640 1 -- 172.21.15.40:0/532134563 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9878015070 con 0x556496ceeb60 2024-07-26T12:50:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9867e00640 1 -- 172.21.15.40:0/532134563 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9874034420 con 0x556496ceeb60 2024-07-26T12:50:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9894281740 10 client.16533 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:50:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9894281740 10 client.16533 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:50:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9894281740 20 client.16533 populate_metadata read hostname 'smithi040' 2024-07-26T12:50:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9894281740 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496cce1c0 0x5564970d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9894281740 4 client.16533 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:50:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.227+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55649702cab0 con 0x556496cce1c0 2024-07-26T12:50:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.228+0000 7f9886a00640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496cce1c0 0x5564970d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.229+0000 7f9886a00640 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496cce1c0 0x5564970d2f30 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=399cde916d3d88f4 server_cookie=9aa97eb770d8f1bb in_seq=0 out_seq=0 2024-07-26T12:50:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.229+0000 7f9867e00640 10 client.16533 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.231+0000 7f9867e00640 1 -- 172.21.15.40:0/532134563 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55649702cab0 con 0x556496cce1c0 2024-07-26T12:50:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.231+0000 7f9867e00640 10 client.16533 handle_command_reply: tid=0 2024-07-26T12:50:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.231+0000 7f9894281740 1 client.16533 shutdown 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 msgr2=0x5564970c1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c1420 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9874012700 tx=0x7f98740046c0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 shutdown_connections 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496d0f840 0x5564970ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496cce1c0 0x5564970d2f30 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c1420 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 --2- 172.21.15.40:0/532134563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496ce6980 0x5564970c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 >> 172.21.15.40:0/532134563 conn(0x556496d03990 msgr2=0x5564970b8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9867e00640 0 client.16533 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 shutdown_connections 2024-07-26T12:50:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 1 -- 172.21.15.40:0/532134563 wait complete. 2024-07-26T12:50:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.232+0000 7f9894281740 20 client.16533 trim_cache size 0 max 16384 2024-07-26T12:50:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.256+0000 7f9894281740 1 Processor -- start 2024-07-26T12:50:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.256+0000 7f9894281740 1 -- start start 2024-07-26T12:50:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9894281740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9894281740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9894281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9894281740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b51e0 con 0x556496ceeb60 2024-07-26T12:50:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9894281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b6d20 con 0x556496d0f840 2024-07-26T12:50:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9894281740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b58b0 con 0x556496ce6980 2024-07-26T12:50:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9886000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9886000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56482/0 (socket says 172.21.15.40:56482) 2024-07-26T12:50:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.257+0000 7f9886000640 1 -- 172.21.15.40:0/223035554 learned_addr learned my addr 172.21.15.40:0/223035554 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886a00640 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9887400640 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886000640 1 -- 172.21.15.40:0/223035554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 msgr2=0x5564970ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886000640 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886000640 1 -- 172.21.15.40:0/223035554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 msgr2=0x5564970d86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886000640 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970d86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886000640 1 -- 172.21.15.40:0/223035554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564970bfc40 con 0x556496ceeb60 2024-07-26T12:50:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886a00640 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:50:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.258+0000 7f9886000640 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970cd030 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9874003ec0 tx=0x7f987400bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf3ed1950d84de0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.259+0000 7f9872a00640 1 -- 172.21.15.40:0/223035554 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874034420 con 0x556496ceeb60 2024-07-26T12:50:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.259+0000 7f9872a00640 1 -- 172.21.15.40:0/223035554 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9874025070 con 0x556496ceeb60 2024-07-26T12:50:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.259+0000 7f9872a00640 1 -- 172.21.15.40:0/223035554 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987403d6e0 con 0x556496ceeb60 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 -- 172.21.15.40:0/223035554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 msgr2=0x5564970cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970cd030 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9874003ec0 tx=0x7f987400bd10 comp rx=0 tx=0).stop 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 -- 172.21.15.40:0/223035554 shutdown_connections 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970cd030 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 --2- 172.21.15.40:0/223035554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 -- 172.21.15.40:0/223035554 >> 172.21.15.40:0/223035554 conn(0x556496d03990 msgr2=0x5564970bbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 -- 172.21.15.40:0/223035554 shutdown_connections 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.260+0000 7f9894281740 1 -- 172.21.15.40:0/223035554 wait complete. 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 -- start start 2024-07-26T12:50:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 Processor -- start 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b6650 con 0x556496ceeb60 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b5f80 con 0x556496d0f840 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b31a0 con 0x556496ce6980 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.261+0000 7f9894281740 10 client.0 _ll_register_callbacks cb 0x7f9874004360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56490/0 (socket says 172.21.15.40:56490) 2024-07-26T12:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 -- 172.21.15.40:0/182674650 learned_addr learned my addr 172.21.15.40:0/182674650 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886a00640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9887400640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 -- 172.21.15.40:0/182674650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 msgr2=0x5564970c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 -- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 msgr2=0x5564970c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.262+0000 7f9886000640 1 -- 172.21.15.40:0/182674650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649713a6c0 con 0x556496ceeb60 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.263+0000 7f9886000640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c4970 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9874034700 tx=0x7f9874004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395e15fd3a73d1ec server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.263+0000 7f9867e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.263+0000 7f9867e00640 1 -- 172.21.15.40:0/182674650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874034bc0 con 0x556496ceeb60 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.263+0000 7f9867e00640 1 -- 172.21.15.40:0/182674650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9874034d60 con 0x556496ceeb60 2024-07-26T12:50:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.263+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9874025070 con 0x556496ceeb60 2024-07-26T12:50:56.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9867e00640 1 -- 172.21.15.40:0/182674650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f987403d480 con 0x556496ceeb60 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 10 client.16539 fetch_fsmap learned FSMap version 35 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55649713b770 con 0x556496ceeb60 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9867e00640 1 -- 172.21.15.40:0/182674650 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9874025070 con 0x556496ceeb60 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9867e00640 1 -- 172.21.15.40:0/182674650 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f987402a670 con 0x556496ceeb60 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 10 client.16539 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 10 client.16539 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 20 client.16539 populate_metadata read hostname 'smithi040' 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496ca3570 0x55649713de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 4 client.16539 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.2, "await_for": 45.0}] 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.264+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.2, "await_for": 45.0}) -- 0x556497028550 con 0x556496ca3570 2024-07-26T12:50:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.265+0000 7f9886a00640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496ca3570 0x55649713de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:50:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.266+0000 7f9886a00640 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496ca3570 0x55649713de80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c4eb2e27453ba5 server_cookie=73db25e4a1bea0a2 in_seq=0 out_seq=0 2024-07-26T12:50:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.266+0000 7f9867e00640 10 client.16539 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:56.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.550+0000 7f9867e00640 1 -- 172.21.15.40:0/182674650 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556497028550 con 0x556496ca3570 2024-07-26T12:50:56.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.550+0000 7f9867e00640 10 client.16539 handle_command_reply: tid=0 2024-07-26T12:50:56.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.550+0000 7f9894281740 1 client.16539 shutdown 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.550+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 msgr2=0x5564970c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.550+0000 7f9894281740 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c4970 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9874034700 tx=0x7f9874004490 comp rx=0 tx=0).stop 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 shutdown_connections 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556496d0f840 0x5564970c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556496ca3570 0x55649713de80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556496ceeb60 0x5564970c4970 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 --2- 172.21.15.40:0/182674650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556496ce6980 0x5564970c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 >> 172.21.15.40:0/182674650 conn(0x556496d03990 msgr2=0x5564970b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9867e00640 0 client.16539 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:50:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 shutdown_connections 2024-07-26T12:50:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.551+0000 7f9894281740 1 -- 172.21.15.40:0/182674650 wait complete. 2024-07-26T12:50:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.552+0000 7f9894281740 20 client.16539 trim_cache size 0 max 16384 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 90, 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "6c4e0cc3": { 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 90, 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:50:56.554 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.2, 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:50:56.555 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f986c0b3c40 msgr2=0x7f986c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f986c0b3c40 0x7f986c0b6150 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f987400b620 tx=0x7f987400b390 comp rx=0 tx=0).stop 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 msgr2=0x7f98881a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881a5a80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9880005cc0 tx=0x7f9880032a10 comp rx=0 tx=0).stop 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 shutdown_connections 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f988810fca0 0x7f98881a5a80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f988810f350 0x7f98881a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f986c0b3c40 0x7f986c0b6150 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 --2- 172.21.15.40:0/3953302662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9888109a60 0x7f98881a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:50:56.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 >> 172.21.15.40:0/3953302662 conn(0x7f9888079100 msgr2=0x7f988810b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:50:56.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 shutdown_connections 2024-07-26T12:50:56.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:50:56.553+0000 7f9887e00640 1 -- 172.21.15.40:0/3953302662 wait complete. 2024-07-26T12:50:57.390 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6c4e0cc3', quiesce took 8.6 seconds. Will release after: 9.6 2024-07-26T12:50:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:57 smithi040 ceph-mon[32397]: pgmap v1361: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-07-26T12:50:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:57 smithi146 ceph-mon[35807]: pgmap v1361: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-07-26T12:50:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:57 smithi076 ceph-mon[35401]: pgmap v1361: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-07-26T12:51:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:50:59 smithi040 ceph-mon[32397]: pgmap v1362: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:51:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:50:59 smithi146 ceph-mon[35807]: pgmap v1362: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:51:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:50:59 smithi076 ceph-mon[35401]: pgmap v1362: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T12:51:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:01 smithi040 ceph-mon[32397]: pgmap v1363: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-07-26T12:51:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:01 smithi146 ceph-mon[35807]: pgmap v1363: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-07-26T12:51:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:01 smithi076 ceph-mon[35401]: pgmap v1363: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-07-26T12:51:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:03 smithi040 ceph-mon[32397]: pgmap v1364: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T12:51:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:03 smithi146 ceph-mon[35807]: pgmap v1364: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T12:51:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:03 smithi076 ceph-mon[35401]: pgmap v1364: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T12:51:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:05 smithi040 ceph-mon[32397]: pgmap v1365: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T12:51:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:05 smithi146 ceph-mon[35807]: pgmap v1365: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T12:51:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:05 smithi076 ceph-mon[35401]: pgmap v1365: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T12:51:06.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:51:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:51:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:07 smithi040 ceph-mon[32397]: pgmap v1366: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:51:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:07 smithi146 ceph-mon[35807]: pgmap v1366: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:51:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:07 smithi076 ceph-mon[35401]: pgmap v1366: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T12:51:09.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 -- 172.21.15.40:0/3881745275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4077cc0 msgr2=0x7f2dd4113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/3881745275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4077cc0 0x7f2dd4113a70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009900 tx=0x7f2dc002a410 comp rx=0 tx=0).stop 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 -- 172.21.15.40:0/3881745275 shutdown_connections 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/3881745275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/3881745275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4077cc0 0x7f2dd4113a70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/3881745275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 0x7f2dd4077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 -- 172.21.15.40:0/3881745275 >> 172.21.15.40:0/3881745275 conn(0x7f2dd41010c0 msgr2=0x7f2dd4103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 -- 172.21.15.40:0/3881745275 shutdown_connections 2024-07-26T12:51:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.574+0000 7f2dd3e00640 1 -- 172.21.15.40:0/3881745275 wait complete. 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 Processor -- start 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 -- start start 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 0x7f2dd41a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd4077cc0 0x7f2dd41a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41197c0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4119640 con 0x7f2dd4077370 2024-07-26T12:51:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.576+0000 7f2dd3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4119940 con 0x7f2dd4077cc0 2024-07-26T12:51:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56810/0 (socket says 172.21.15.40:56810) 2024-07-26T12:51:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 -- 172.21.15.40:0/4241742561 learned_addr learned my addr 172.21.15.40:0/4241742561 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd2a00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 0x7f2dd41a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd2000640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd4077cc0 0x7f2dd41a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 -- 172.21.15.40:0/4241742561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd4077cc0 msgr2=0x7f2dd41a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd4077cc0 0x7f2dd41a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 -- 172.21.15.40:0/4241742561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 msgr2=0x7f2dd41a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 0x7f2dd41a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd3400640 1 -- 172.21.15.40:0/4241742561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd41a61e0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.577+0000 7f2dd2a00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 0x7f2dd41a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:51:09.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.578+0000 7f2dd3400640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41a5ab0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00eaa0 tx=0x7f2dcc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.578+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00cdb0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.578+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2dcc005020 con 0x7f2dd4113fb0 2024-07-26T12:51:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.578+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd41a64d0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.578+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0116d0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.578+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd41acc30 con 0x7f2dd4113fb0 2024-07-26T12:51:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.580+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd4077780 con 0x7f2dd4113fb0 2024-07-26T12:51:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.582+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2dcc0051d0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.585+0000 7f2dcb400640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2db80b3bd0 0x7f2db80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:09.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.585+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2dcc0e41c0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.585+0000 7f2dd2a00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2db80b3bd0 0x7f2db80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:09.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.586+0000 7f2dd2a00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2db80b3bd0 0x7f2db80b60e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40058c0 tx=0x7f2dc4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:09.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.587+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2dcc016030 con 0x7f2dd4113fb0 2024-07-26T12:51:09.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.828+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dd41a13a0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.830+0000 7f2dcb400640 1 -- 172.21.15.40:0/4241742561 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f2dd41a13a0 con 0x7f2dd4113fb0 2024-07-26T12:51:09.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:51:09.832 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:51:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2db80b3bd0 msgr2=0x7f2db80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2db80b3bd0 0x7f2db80b60e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40058c0 tx=0x7f2dc4005850 comp rx=0 tx=0).stop 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 msgr2=0x7f2dd41a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41a5ab0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00eaa0 tx=0x7f2dcc00ef60 comp rx=0 tx=0).stop 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 shutdown_connections 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dd4113fb0 0x7f2dd41a5ab0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2db80b3bd0 0x7f2db80b60e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd4077cc0 0x7f2dd41a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 --2- 172.21.15.40:0/4241742561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd4077370 0x7f2dd41a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 >> 172.21.15.40:0/4241742561 conn(0x7f2dd41010c0 msgr2=0x7f2dd41160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 shutdown_connections 2024-07-26T12:51:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:09.833+0000 7f2dd3e00640 1 -- 172.21.15.40:0/4241742561 wait complete. 2024-07-26T12:51:10.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:09 smithi040 ceph-mon[32397]: pgmap v1367: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 MiB/s wr, 12 op/s 2024-07-26T12:51:10.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:09 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4241742561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:51:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:09 smithi146 ceph-mon[35807]: pgmap v1367: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 MiB/s wr, 12 op/s 2024-07-26T12:51:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:09 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4241742561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:51:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:09 smithi076 ceph-mon[35401]: pgmap v1367: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 MiB/s wr, 12 op/s 2024-07-26T12:51:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:09 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4241742561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:51:10.629 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 6c4e0cc3 --release --await' 2024-07-26T12:51:10.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 6c4e0cc3 --release --await 2024-07-26T12:51:11.118 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:51:12.152 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:11 smithi040 ceph-mon[32397]: pgmap v1368: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1000 KiB/s wr, 10 op/s 2024-07-26T12:51:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:11 smithi146 ceph-mon[35807]: pgmap v1368: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1000 KiB/s wr, 10 op/s 2024-07-26T12:51:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:11 smithi076 ceph-mon[35401]: pgmap v1368: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1000 KiB/s wr, 10 op/s 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.349+0000 7fe3d6400640 1 -- 172.21.15.40:0/2753645052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d010f330 msgr2=0x7fe3d010f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.349+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2753645052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d010f330 0x7fe3d010f740 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009900 tx=0x7fe3bc02a3f0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 -- 172.21.15.40:0/2753645052 shutdown_connections 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2753645052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d010fc80 0x7fe3d01164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2753645052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d010f330 0x7fe3d010f740 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2753645052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3d01099f0 0x7fe3d0109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 -- 172.21.15.40:0/2753645052 >> 172.21.15.40:0/2753645052 conn(0x7fe3d0078ff0 msgr2=0x7fe3d0107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 -- 172.21.15.40:0/2753645052 shutdown_connections 2024-07-26T12:51:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.350+0000 7fe3d6400640 1 -- 172.21.15.40:0/2753645052 wait complete. 2024-07-26T12:51:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.351+0000 7fe3d6400640 1 Processor -- start 2024-07-26T12:51:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.351+0000 7fe3d6400640 1 -- start start 2024-07-26T12:51:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.351+0000 7fe3d6400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.351+0000 7fe3d6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d010f330 0x7fe3d01a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d6400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d6400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0119840 con 0x7fe3d01099f0 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d6400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01196c0 con 0x7fe3d010fc80 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d6400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01199c0 con 0x7fe3d010f330 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d5000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d5000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32882/0 (socket says 172.21.15.40:32882) 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d5000640 1 -- 172.21.15.40:0/2559397919 learned_addr learned my addr 172.21.15.40:0/2559397919 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d010f330 0x7fe3d01a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.352+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d5000640 1 -- 172.21.15.40:0/2559397919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d010f330 msgr2=0x7fe3d01a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d5000640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d010f330 0x7fe3d01a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d5000640 1 -- 172.21.15.40:0/2559397919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3d010fc80 msgr2=0x7fe3d01a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d5000640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d5000640 1 -- 172.21.15.40:0/2559397919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01a61e0 con 0x7fe3d01099f0 2024-07-26T12:51:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d5000640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0270 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400d950 tx=0x7fe3c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3cd600640 1 -- 172.21.15.40:0/2559397919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4017070 con 0x7fe3d01099f0 2024-07-26T12:51:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3cd600640 1 -- 172.21.15.40:0/2559397919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3c4009c30 con 0x7fe3d01099f0 2024-07-26T12:51:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d01a64d0 con 0x7fe3d01099f0 2024-07-26T12:51:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.353+0000 7fe3cd600640 1 -- 172.21.15.40:0/2559397919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400f620 con 0x7fe3d01099f0 2024-07-26T12:51:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.354+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01acc30 con 0x7fe3d01099f0 2024-07-26T12:51:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.357+0000 7fe3de655740 1 Processor -- start 2024-07-26T12:51:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 -- start start 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3cd600640 1 -- 172.21.15.40:0/2559397919 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe3c4010460 con 0x7fe3d01099f0 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 0x56261c0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0adc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56261c023f50 con 0x56261bd08520 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56261c013450 con 0x56261bcdf660 2024-07-26T12:51:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3de655740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56261c017490 con 0x56261bce7840 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3d5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 0x56261c0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3d5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 0x56261c0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32890/0 (socket says 172.21.15.40:32890) 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.358+0000 7fe3d5a00640 1 -- 172.21.15.40:0/2325187043 learned_addr learned my addr 172.21.15.40:0/2325187043 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5000640 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5a00640 1 -- 172.21.15.40:0/2325187043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 msgr2=0x56261c0adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5a00640 1 -- 172.21.15.40:0/2325187043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 msgr2=0x56261c0ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5a00640 1 -- 172.21.15.40:0/2325187043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56261bd73b00 con 0x56261bd08520 2024-07-26T12:51:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:51:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.359+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 0x56261c0ad1a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ee0 tx=0x7fe3c8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f48f8fca2833b0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.360+0000 7fe3c2000640 1 -- 172.21.15.40:0/2325187043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8016070 con 0x56261bd08520 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.360+0000 7fe3c2000640 1 -- 172.21.15.40:0/2325187043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3c8004d20 con 0x56261bd08520 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.360+0000 7fe3c2000640 1 -- 172.21.15.40:0/2325187043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8012650 con 0x56261bd08520 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.360+0000 7fe3cd600640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3b80b3bd0 0x7fe3b80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.360+0000 7fe3cd600640 1 -- 172.21.15.40:0/2559397919 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3c40e3900 con 0x7fe3d01099f0 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.360+0000 7fe3d5000640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3b80b3bd0 0x7fe3b80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 -- 172.21.15.40:0/2325187043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 msgr2=0x56261c0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 0x56261c0ad1a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ee0 tx=0x7fe3c8010740 comp rx=0 tx=0).stop 2024-07-26T12:51:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 -- 172.21.15.40:0/2325187043 shutdown_connections 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 --2- 172.21.15.40:0/2325187043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bd08520 0x56261c0ad1a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 -- 172.21.15.40:0/2325187043 >> 172.21.15.40:0/2325187043 conn(0x56261bcfc910 msgr2=0x56261c0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3d5000640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3b80b3bd0 0x7fe3b80b60e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40a6890 tx=0x7fe3c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 -- 172.21.15.40:0/2325187043 shutdown_connections 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.361+0000 7fe3de655740 1 -- 172.21.15.40:0/2325187043 wait complete. 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.362+0000 7fe3de655740 1 -- start start 2024-07-26T12:51:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.362+0000 7fe3de655740 1 Processor -- start 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0b8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bce7840 0x56261c0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 0x56261c0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56261be76bb0 con 0x56261bcdf660 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56261bfaf930 con 0x56261bce7840 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56261c0bb980 con 0x56261bd08520 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3de655740 10 client.0 _ll_register_callbacks cb 0x56261bd1fd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3d5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3d5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32898/0 (socket says 172.21.15.40:32898) 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.363+0000 7fe3d5a00640 1 -- 172.21.15.40:0/3423915049 learned_addr learned my addr 172.21.15.40:0/3423915049 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bce7840 0x56261c0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3d5a00640 1 -- 172.21.15.40:0/3423915049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 msgr2=0x56261c0c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 0x56261c0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3d5a00640 1 -- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bce7840 msgr2=0x56261c0b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bce7840 0x56261c0b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3d5a00640 1 -- 172.21.15.40:0/3423915049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56261bdea960 con 0x56261bcdf660 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0b8850 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ad0 tx=0x7fe3c8004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778e7e1d79bb4fe8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:51:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3b6a00640 1 -- 172.21.15.40:0/3423915049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8016070 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3b6a00640 1 -- 172.21.15.40:0/3423915049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3c8005520 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.364+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c8004d20 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3b6a00640 1 -- 172.21.15.40:0/3423915049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe3c8026470 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3de655740 10 client.16557 fetch_fsmap learned FSMap version 35 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56261c0c75f0 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3b6a00640 1 -- 172.21.15.40:0/3423915049 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3c8004d20 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3b6a00640 1 -- 172.21.15.40:0/3423915049 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe3c800f040 con 0x56261bcdf660 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3de655740 10 client.16557 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.365+0000 7fe3de655740 10 client.16557 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.366+0000 7fe3de655740 20 client.16557 populate_metadata read hostname 'smithi040' 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.366+0000 7fe3de655740 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bcc6ea0 0x56261c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.366+0000 7fe3de655740 4 client.16557 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:51:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.366+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56261c025ea0 con 0x56261bcc6ea0 2024-07-26T12:51:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.366+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bcc6ea0 0x56261c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.368+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bcc6ea0 0x56261c0caa00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca102e5bb06998b4 server_cookie=81e5f0fbb6caabfc in_seq=0 out_seq=0 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.368+0000 7fe3b6a00640 10 client.16557 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3b6a00640 1 -- 172.21.15.40:0/3423915049 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56261c025ea0 con 0x56261bcc6ea0 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3b6a00640 10 client.16557 handle_command_reply: tid=0 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 client.16557 shutdown 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 msgr2=0x56261c0b8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0b8850 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ad0 tx=0x7fe3c8004c70 comp rx=0 tx=0).stop 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 shutdown_connections 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 0x56261c0c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bce7840 0x56261c0b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bcc6ea0 0x56261c0caa00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 --2- 172.21.15.40:0/3423915049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0b8850 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 >> 172.21.15.40:0/3423915049 conn(0x56261bcfc910 msgr2=0x56261c0b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3b6a00640 0 client.16557 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 shutdown_connections 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.370+0000 7fe3de655740 1 -- 172.21.15.40:0/3423915049 wait complete. 2024-07-26T12:51:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.371+0000 7fe3de655740 20 client.16557 trim_cache size 0 max 16384 2024-07-26T12:51:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.396+0000 7fe3de655740 1 Processor -- start 2024-07-26T12:51:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 -- start start 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ba730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 0x56261c0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 0x56261c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b52a0 con 0x56261bce7840 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b6de0 con 0x56261bcdf660 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.397+0000 7fe3de655740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b5970 con 0x56261bd08520 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 0x56261c0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 0x56261c0c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32900/0 (socket says 172.21.15.40:32900) 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 -- 172.21.15.40:0/1028281153 learned_addr learned my addr 172.21.15.40:0/1028281153 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:51:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 -- 172.21.15.40:0/1028281153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 msgr2=0x56261c0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 0x56261c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 -- 172.21.15.40:0/1028281153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 msgr2=0x56261c0ba730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ba730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.398+0000 7fe3cfe00640 1 -- 172.21.15.40:0/1028281153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56261c0b0000 con 0x56261bce7840 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.399+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 0x56261c0c4c10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc005ab0 tx=0x7fe3bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a3c4a584fa4ed2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.399+0000 7fe3c1600640 1 -- 172.21.15.40:0/1028281153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc035040 con 0x56261bce7840 2024-07-26T12:51:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.399+0000 7fe3c1600640 1 -- 172.21.15.40:0/1028281153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3bc0054d0 con 0x56261bce7840 2024-07-26T12:51:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.399+0000 7fe3c1600640 1 -- 172.21.15.40:0/1028281153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0035f0 con 0x56261bce7840 2024-07-26T12:51:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.400+0000 7fe3de655740 1 -- 172.21.15.40:0/1028281153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 msgr2=0x56261c0c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.400+0000 7fe3de655740 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 0x56261c0c4c10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc005ab0 tx=0x7fe3bc009260 comp rx=0 tx=0).stop 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 -- 172.21.15.40:0/1028281153 shutdown_connections 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bd08520 0x56261c0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bce7840 0x56261c0c4c10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 --2- 172.21.15.40:0/1028281153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bcdf660 0x56261c0ba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 -- 172.21.15.40:0/1028281153 >> 172.21.15.40:0/1028281153 conn(0x56261bcfc910 msgr2=0x56261c0a9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 -- 172.21.15.40:0/1028281153 shutdown_connections 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.401+0000 7fe3de655740 1 -- 172.21.15.40:0/1028281153 wait complete. 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.402+0000 7fe3de655740 1 -- start start 2024-07-26T12:51:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.402+0000 7fe3de655740 1 Processor -- start 2024-07-26T12:51:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.402+0000 7fe3de655740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.402+0000 7fe3de655740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.402+0000 7fe3de655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bd08520 0x56261c12af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.402+0000 7fe3de655740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b6710 con 0x56261bcdf660 2024-07-26T12:51:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3de655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b6040 con 0x56261bd08520 2024-07-26T12:51:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3de655740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b3260 con 0x56261bce7840 2024-07-26T12:51:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3de655740 10 client.0 _ll_register_callbacks cb 0x7fe3c8009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:51:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32910/0 (socket says 172.21.15.40:32910) 2024-07-26T12:51:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 -- 172.21.15.40:0/1220862478 learned_addr learned my addr 172.21.15.40:0/1220862478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:51:13.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 -- 172.21.15.40:0/1220862478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 msgr2=0x56261c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 -- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bd08520 msgr2=0x56261c12af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:51:13.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bd08520 0x56261c12af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.403+0000 7fe3d5a00640 1 -- 172.21.15.40:0/1220862478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56261c12b580 con 0x56261bcdf660 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.404+0000 7fe3d5a00640 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0cc3c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8011010 tx=0x7fe3c8009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c599eebae3abcc96 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.404+0000 7fe3b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.404+0000 7fe3b6a00640 1 -- 172.21.15.40:0/1220862478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8016030 con 0x56261bcdf660 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.404+0000 7fe3b6a00640 1 -- 172.21.15.40:0/1220862478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3c8005320 con 0x56261bcdf660 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.404+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3bc0054d0 con 0x56261bcdf660 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3b6a00640 1 -- 172.21.15.40:0/1220862478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe3c8005520 con 0x56261bcdf660 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3de655740 10 client.16563 fetch_fsmap learned FSMap version 35 2024-07-26T12:51:13.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56261c133af0 con 0x56261bcdf660 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3b6a00640 1 -- 172.21.15.40:0/1220862478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3bc0054d0 con 0x56261bcdf660 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3b6a00640 1 -- 172.21.15.40:0/1220862478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe3c801a410 con 0x56261bcdf660 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3de655740 10 client.16563 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.405+0000 7fe3de655740 10 client.16563 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.406+0000 7fe3de655740 20 client.16563 populate_metadata read hostname 'smithi040' 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.406+0000 7fe3de655740 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bc9c250 0x56261c136250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.406+0000 7fe3de655740 4 client.16563 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6c4e0cc3", "release": true, "await": true}] 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.406+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6c4e0cc3", "release": true, "await": true}) -- 0x56261c021940 con 0x56261bc9c250 2024-07-26T12:51:13.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.406+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bc9c250 0x56261c136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:51:13.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.407+0000 7fe3cfe00640 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bc9c250 0x56261c136250 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576db2b5e82a2ae3 server_cookie=6244770bf0b6f8dd in_seq=0 out_seq=0 2024-07-26T12:51:13.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.407+0000 7fe3b6a00640 10 client.16563 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:51:13.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3b6a00640 1 -- 172.21.15.40:0/1220862478 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56261c021940 con 0x56261bc9c250 2024-07-26T12:51:13.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3b6a00640 10 client.16563 handle_command_reply: tid=0 2024-07-26T12:51:13.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3de655740 1 client.16563 shutdown 2024-07-26T12:51:13.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 msgr2=0x56261c0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3de655740 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0cc3c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8011010 tx=0x7fe3c8009760 comp rx=0 tx=0).stop 2024-07-26T12:51:13.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 shutdown_connections 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.474+0000 7fe3de655740 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56261bd08520 0x56261c12af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3de655740 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56261bce7840 0x56261c0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3de655740 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56261bc9c250 0x56261c136250 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3de655740 1 --2- 172.21.15.40:0/1220862478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56261bcdf660 0x56261c0cc3c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 >> 172.21.15.40:0/1220862478 conn(0x56261bcfc910 msgr2=0x56261c0a9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3b6a00640 0 client.16563 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:51:13.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 shutdown_connections 2024-07-26T12:51:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.475+0000 7fe3de655740 1 -- 172.21.15.40:0/1220862478 wait complete. 2024-07-26T12:51:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.476+0000 7fe3de655740 20 client.16563 trim_cache size 0 max 16384 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 92, 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "6c4e0cc3": { 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 92, 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:51:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.2, 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:51:13.480 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:51:13.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3b80b3bd0 msgr2=0x7fe3b80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3b80b3bd0 0x7fe3b80b60e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40a6890 tx=0x7fe3c4000bc0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 msgr2=0x7fe3d01a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:51:13.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0270 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400d950 tx=0x7fe3c400de10 comp rx=0 tx=0).stop 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 shutdown_connections 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3d010fc80 0x7fe3d01a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3b80b3bd0 0x7fe3b80b60e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d010f330 0x7fe3d01a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 --2- 172.21.15.40:0/2559397919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d01099f0 0x7fe3d01a0270 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 >> 172.21.15.40:0/2559397919 conn(0x7fe3d0078ff0 msgr2=0x7fe3d00797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.478+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 shutdown_connections 2024-07-26T12:51:13.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:51:13.479+0000 7fe3d6400640 1 -- 172.21.15.40:0/2559397919 wait complete. 2024-07-26T12:51:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:14 smithi040 ceph-mon[32397]: pgmap v1369: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 658 KiB/s wr, 9 op/s 2024-07-26T12:51:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:14 smithi146 ceph-mon[35807]: pgmap v1369: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 658 KiB/s wr, 9 op/s 2024-07-26T12:51:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:14 smithi076 ceph-mon[35401]: pgmap v1369: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 658 KiB/s wr, 9 op/s 2024-07-26T12:51:14.359 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6c4e0cc3', total seconds elapsed: 25.6 2024-07-26T12:51:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:15 smithi146 ceph-mon[35807]: pgmap v1370: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 317 KiB/s wr, 11 op/s 2024-07-26T12:51:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:15 smithi076 ceph-mon[35401]: pgmap v1370: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 317 KiB/s wr, 11 op/s 2024-07-26T12:51:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:15 smithi040 ceph-mon[32397]: pgmap v1370: 97 pgs: 97 active+clean; 5.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 317 KiB/s wr, 11 op/s 2024-07-26T12:51:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:17 smithi040 ceph-mon[32397]: pgmap v1371: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 683 KiB/s wr, 8 op/s 2024-07-26T12:51:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:17 smithi146 ceph-mon[35807]: pgmap v1371: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 683 KiB/s wr, 8 op/s 2024-07-26T12:51:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:17 smithi076 ceph-mon[35401]: pgmap v1371: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 683 KiB/s wr, 8 op/s 2024-07-26T12:51:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:19 smithi040 ceph-mon[32397]: pgmap v1372: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 367 KiB/s wr, 11 op/s 2024-07-26T12:51:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:19 smithi146 ceph-mon[35807]: pgmap v1372: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 367 KiB/s wr, 11 op/s 2024-07-26T12:51:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:19 smithi076 ceph-mon[35401]: pgmap v1372: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 367 KiB/s wr, 11 op/s 2024-07-26T12:51:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:21 smithi040 ceph-mon[32397]: pgmap v1373: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T12:51:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:21 smithi146 ceph-mon[35807]: pgmap v1373: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T12:51:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:21 smithi076 ceph-mon[35401]: pgmap v1373: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T12:51:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:23 smithi040 ceph-mon[32397]: pgmap v1374: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T12:51:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:23 smithi146 ceph-mon[35807]: pgmap v1374: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T12:51:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:23 smithi076 ceph-mon[35401]: pgmap v1374: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T12:51:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:25 smithi146 ceph-mon[35807]: pgmap v1375: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:51:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:25 smithi076 ceph-mon[35401]: pgmap v1375: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:51:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:25 smithi040 ceph-mon[32397]: pgmap v1375: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-07-26T12:51:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:27 smithi146 ceph-mon[35807]: pgmap v1376: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:51:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:27 smithi076 ceph-mon[35401]: pgmap v1376: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:51:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:27 smithi040 ceph-mon[32397]: pgmap v1376: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 9 op/s 2024-07-26T12:51:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:30 smithi146 ceph-mon[35807]: pgmap v1377: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:51:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:30 smithi076 ceph-mon[35401]: pgmap v1377: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:51:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:30 smithi040 ceph-mon[32397]: pgmap v1377: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:51:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:31 smithi146 ceph-mon[35807]: pgmap v1378: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:51:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:31 smithi076 ceph-mon[35401]: pgmap v1378: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:51:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:31 smithi040 ceph-mon[32397]: pgmap v1378: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:51:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:33 smithi040 ceph-mon[32397]: pgmap v1379: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:51:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:33 smithi146 ceph-mon[35807]: pgmap v1379: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:51:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:33 smithi076 ceph-mon[35401]: pgmap v1379: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:51:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:35 smithi040 ceph-mon[32397]: pgmap v1380: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:35 smithi146 ceph-mon[35807]: pgmap v1380: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:35 smithi076 ceph-mon[35401]: pgmap v1380: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:37 smithi040 ceph-mon[32397]: pgmap v1381: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:51:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:37 smithi146 ceph-mon[35807]: pgmap v1381: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:51:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:37 smithi076 ceph-mon[35401]: pgmap v1381: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:51:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:39 smithi040 ceph-mon[32397]: pgmap v1382: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:51:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:39 smithi146 ceph-mon[35807]: pgmap v1382: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:51:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:39 smithi076 ceph-mon[35401]: pgmap v1382: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:51:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:41 smithi146 ceph-mon[35807]: pgmap v1383: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:51:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:41 smithi076 ceph-mon[35401]: pgmap v1383: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:51:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:41 smithi040 ceph-mon[32397]: pgmap v1383: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:51:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:44 smithi146 ceph-mon[35807]: pgmap v1384: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:51:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:44 smithi076 ceph-mon[35401]: pgmap v1384: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:51:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:44 smithi040 ceph-mon[32397]: pgmap v1384: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:51:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:45 smithi146 ceph-mon[35807]: pgmap v1385: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:45 smithi076 ceph-mon[35401]: pgmap v1385: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:45 smithi040 ceph-mon[32397]: pgmap v1385: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:47 smithi040 ceph-mon[32397]: pgmap v1386: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:51:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:47 smithi146 ceph-mon[35807]: pgmap v1386: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:51:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:47 smithi076 ceph-mon[35401]: pgmap v1386: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:51:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:49 smithi146 ceph-mon[35807]: pgmap v1387: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:51:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:49 smithi076 ceph-mon[35401]: pgmap v1387: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:51:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:49 smithi040 ceph-mon[32397]: pgmap v1387: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:51:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:51 smithi146 ceph-mon[35807]: pgmap v1388: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:51:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:51 smithi076 ceph-mon[35401]: pgmap v1388: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:51:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:51 smithi040 ceph-mon[32397]: pgmap v1388: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:51:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:53 smithi146 ceph-mon[35807]: pgmap v1389: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:51:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:53 smithi076 ceph-mon[35401]: pgmap v1389: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:51:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:53 smithi040 ceph-mon[32397]: pgmap v1389: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:51:56.283 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:56 smithi146 ceph-mon[35807]: pgmap v1390: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:56.283 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:51:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:56 smithi076 ceph-mon[35401]: pgmap v1390: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:51:56.457 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:56 smithi040 ceph-mon[32397]: pgmap v1390: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:51:56.457 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:51:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:58 smithi146 ceph-mon[35807]: pgmap v1391: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:51:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:58 smithi076 ceph-mon[35401]: pgmap v1391: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:51:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:58 smithi040 ceph-mon[32397]: pgmap v1391: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:51:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:51:59 smithi076 ceph-mon[35401]: pgmap v1392: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T12:51:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:51:59 smithi040 ceph-mon[32397]: pgmap v1392: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T12:51:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:51:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:51:59 smithi146 ceph-mon[35807]: pgmap v1392: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T12:52:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:52:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:52:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:52:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:52:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:52:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:52:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:52:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:52:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:52:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:01 smithi040 ceph-mon[32397]: pgmap v1393: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:52:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:01 smithi146 ceph-mon[35807]: pgmap v1393: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:52:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:01 smithi076 ceph-mon[35401]: pgmap v1393: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:52:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:03 smithi146 ceph-mon[35807]: pgmap v1394: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T12:52:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:03 smithi076 ceph-mon[35401]: pgmap v1394: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T12:52:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:03 smithi040 ceph-mon[32397]: pgmap v1394: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T12:52:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:05 smithi146 ceph-mon[35807]: pgmap v1395: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:52:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:05 smithi076 ceph-mon[35401]: pgmap v1395: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:52:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:05 smithi040 ceph-mon[32397]: pgmap v1395: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:52:08.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:07 smithi040 ceph-mon[32397]: pgmap v1396: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:52:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:08 smithi146 ceph-mon[35807]: pgmap v1396: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:52:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:08 smithi076 ceph-mon[35401]: pgmap v1396: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T12:52:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:10 smithi146 ceph-mon[35807]: pgmap v1397: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:52:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:10 smithi076 ceph-mon[35401]: pgmap v1397: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:52:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:10 smithi040 ceph-mon[32397]: pgmap v1397: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:52:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:12 smithi146 ceph-mon[35807]: pgmap v1398: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:52:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:12 smithi076 ceph-mon[35401]: pgmap v1398: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:52:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:12 smithi040 ceph-mon[32397]: pgmap v1398: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:52:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:13 smithi146 ceph-mon[35807]: pgmap v1399: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:52:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:13 smithi076 ceph-mon[35401]: pgmap v1399: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:52:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:13 smithi040 ceph-mon[32397]: pgmap v1399: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:52:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:15 smithi146 ceph-mon[35807]: pgmap v1400: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:52:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:15 smithi076 ceph-mon[35401]: pgmap v1400: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:52:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:15 smithi040 ceph-mon[32397]: pgmap v1400: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T12:52:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:17 smithi146 ceph-mon[35807]: pgmap v1401: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:52:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:17 smithi076 ceph-mon[35401]: pgmap v1401: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:52:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:17 smithi040 ceph-mon[32397]: pgmap v1401: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:52:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:20 smithi146 ceph-mon[35807]: pgmap v1402: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:52:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:20 smithi076 ceph-mon[35401]: pgmap v1402: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:52:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:20 smithi040 ceph-mon[32397]: pgmap v1402: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:52:21.960 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:52:21.960 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.45 2024-07-26T12:52:21.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:52:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:22 smithi146 ceph-mon[35807]: pgmap v1403: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:52:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:22 smithi076 ceph-mon[35401]: pgmap v1403: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:52:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:22 smithi040 ceph-mon[32397]: pgmap v1403: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:52:22.483 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:52:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:23 smithi146 ceph-mon[35807]: pgmap v1404: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:52:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:23 smithi076 ceph-mon[35401]: pgmap v1404: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:52:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:23 smithi040 ceph-mon[32397]: pgmap v1404: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 -- 172.21.15.40:0/3710627729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 msgr2=0x7f82dc1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3710627729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc1037f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009900 tx=0x7f82c402a410 comp rx=0 tx=0).stop 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 -- 172.21.15.40:0/3710627729 shutdown_connections 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3710627729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc109670 0x7f82dc10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3710627729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82dc108d20 0x7f82dc109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3710627729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc1037f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.895+0000 7f82e0c00640 1 -- 172.21.15.40:0/3710627729 >> 172.21.15.40:0/3710627729 conn(0x7f82dc0fee30 msgr2=0x7f82dc101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.896+0000 7f82e0c00640 1 -- 172.21.15.40:0/3710627729 shutdown_connections 2024-07-26T12:52:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.896+0000 7f82e0c00640 1 -- 172.21.15.40:0/3710627729 wait complete. 2024-07-26T12:52:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.897+0000 7f82e0c00640 1 Processor -- start 2024-07-26T12:52:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 -- start start 2024-07-26T12:52:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82dc108d20 0x7f82dc19c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc109670 0x7f82dc1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1131d0 con 0x7f82dc1033e0 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc113050 con 0x7f82dc108d20 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82e0c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc113350 con 0x7f82dc109670 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.898+0000 7f82db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc19bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35858/0 (socket says 172.21.15.40:35858) 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 -- 172.21.15.40:0/3638799697 learned_addr learned my addr 172.21.15.40:0/3638799697 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82daa00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82dc108d20 0x7f82dc19c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82dbe00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc109670 0x7f82dc1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 -- 172.21.15.40:0/3638799697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc109670 msgr2=0x7f82dc1a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc109670 0x7f82dc1a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 -- 172.21.15.40:0/3638799697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82dc108d20 msgr2=0x7f82dc19c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82dc108d20 0x7f82dc19c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.899+0000 7f82db400640 1 -- 172.21.15.40:0/3638799697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc1a1db0 con 0x7f82dc1033e0 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.900+0000 7f82db400640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc19bf00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009230 tx=0x7f82c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.900+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c403f030 con 0x7f82dc1033e0 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.900+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82c4003a80 con 0x7f82dc1033e0 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.900+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4035070 con 0x7f82dc1033e0 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.900+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc1a2040 con 0x7f82dc1033e0 2024-07-26T12:52:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.901+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc1a24d0 con 0x7f82dc1033e0 2024-07-26T12:52:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.902+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc1037f0 con 0x7f82dc1033e0 2024-07-26T12:52:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.905+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f82c4042030 con 0x7f82dc1033e0 2024-07-26T12:52:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.909+0000 7f82d3e00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82c00b3c00 0x7f82c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:24.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.909+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f82c41047c0 con 0x7f82dc1033e0 2024-07-26T12:52:24.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.909+0000 7f82daa00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82c00b3c00 0x7f82c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:24.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.910+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f82c40cbdd0 con 0x7f82dc1033e0 2024-07-26T12:52:24.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:24.910+0000 7f82daa00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82c00b3c00 0x7f82c00b6110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f82dc1089d0 tx=0x7f82cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.167+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82dc1a8980 con 0x7f82dc1033e0 2024-07-26T12:52:25.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.168+0000 7f82d3e00640 1 -- 172.21.15.40:0/3638799697 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f82c40cb6d0 con 0x7f82dc1033e0 2024-07-26T12:52:25.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:52:25.171 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:52:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:52:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.171+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82c00b3c00 msgr2=0x7f82c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.171+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82c00b3c00 0x7f82c00b6110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f82dc1089d0 tx=0x7f82cc00b390 comp rx=0 tx=0).stop 2024-07-26T12:52:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.171+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 msgr2=0x7f82dc19bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:25.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.171+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc19bf00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009230 tx=0x7f82c4004270 comp rx=0 tx=0).stop 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 shutdown_connections 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82c00b3c00 0x7f82c00b6110 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc109670 0x7f82dc1a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82dc108d20 0x7f82dc19c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 --2- 172.21.15.40:0/3638799697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82dc1033e0 0x7f82dc19bf00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 >> 172.21.15.40:0/3638799697 conn(0x7f82dc0fee30 msgr2=0x7f82dc10e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:25.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 shutdown_connections 2024-07-26T12:52:25.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:25.172+0000 7f82e0c00640 1 -- 172.21.15.40:0/3638799697 wait complete. 2024-07-26T12:52:26.071 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0' 2024-07-26T12:52:26.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0 2024-07-26T12:52:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:25 smithi146 ceph-mon[35807]: pgmap v1405: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:52:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3638799697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:52:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:25 smithi076 ceph-mon[35401]: pgmap v1405: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:52:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3638799697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:52:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:25 smithi040 ceph-mon[32397]: pgmap v1405: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:52:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3638799697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:52:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:52:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:28 smithi040 ceph-mon[32397]: pgmap v1406: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:52:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:28 smithi146 ceph-mon[35807]: pgmap v1406: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:52:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:28 smithi076 ceph-mon[35401]: pgmap v1406: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:52:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 -- 172.21.15.40:0/4066620090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104b40 msgr2=0x7f13f410d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 --2- 172.21.15.40:0/4066620090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104b40 0x7f13f410d180 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009900 tx=0x7f13e002a410 comp rx=0 tx=0).stop 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 -- 172.21.15.40:0/4066620090 shutdown_connections 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 --2- 172.21.15.40:0/4066620090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 0x7f13f410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 --2- 172.21.15.40:0/4066620090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104b40 0x7f13f410d180 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 --2- 172.21.15.40:0/4066620090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104110 0x7f13f4104520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 -- 172.21.15.40:0/4066620090 >> 172.21.15.40:0/4066620090 conn(0x7f13f40fdd60 msgr2=0x7f13f41001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.867+0000 7f13fa600640 1 -- 172.21.15.40:0/4066620090 shutdown_connections 2024-07-26T12:52:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.868+0000 7f13fa600640 1 -- 172.21.15.40:0/4066620090 wait complete. 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.869+0000 7f13fa600640 1 Processor -- start 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.869+0000 7f13fa600640 1 -- start start 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13fa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 0x7f13f4102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13fa600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104b40 0x7f13f4102560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13fa600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 0x7f13f4102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13fa600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4113150 con 0x7f13f4104110 2024-07-26T12:52:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13fa600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4112fd0 con 0x7f13f410d6c0 2024-07-26T12:52:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13fa600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41132d0 con 0x7f13f4104b40 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13f9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 0x7f13f4102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13f9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 0x7f13f4102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35878/0 (socket says 172.21.15.40:35878) 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13f9200640 1 -- 172.21.15.40:0/2753033565 learned_addr learned my addr 172.21.15.40:0/2753033565 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13ebe00640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104b40 0x7f13f4102560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.870+0000 7f13f9c00640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 0x7f13f4102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9200640 1 -- 172.21.15.40:0/2753033565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104b40 msgr2=0x7f13f4102560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9200640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104b40 0x7f13f4102560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9200640 1 -- 172.21.15.40:0/2753033565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 msgr2=0x7f13f4102aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9200640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 0x7f13f4102aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9200640 1 -- 172.21.15.40:0/2753033565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f41a7ee0 con 0x7f13f4104110 2024-07-26T12:52:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13ebe00640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104b40 0x7f13f4102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:52:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9c00640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 0x7f13f4102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:52:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.871+0000 7f13f9200640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 0x7f13f4102020 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f13e400d950 tx=0x7f13e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.872+0000 7f13f2000640 1 -- 172.21.15.40:0/2753033565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4017070 con 0x7f13f4104110 2024-07-26T12:52:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.872+0000 7f13f2000640 1 -- 172.21.15.40:0/2753033565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e4009c30 con 0x7f13f4104110 2024-07-26T12:52:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.872+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f41a81d0 con 0x7f13f4104110 2024-07-26T12:52:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.872+0000 7f13f2000640 1 -- 172.21.15.40:0/2753033565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e400f620 con 0x7f13f4104110 2024-07-26T12:52:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.872+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f41a8730 con 0x7f13f4104110 2024-07-26T12:52:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.875+0000 7f14028ae740 1 Processor -- start 2024-07-26T12:52:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 -- start start 2024-07-26T12:52:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea09060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea09ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556a4e97d970 con 0x556a4e641b70 2024-07-26T12:52:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556a4e96ce70 con 0x556a4e639990 2024-07-26T12:52:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.876+0000 7f14028ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556a4e970eb0 con 0x556a4e662850 2024-07-26T12:52:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea09ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea09ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35888/0 (socket says 172.21.15.40:35888) 2024-07-26T12:52:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 -- 172.21.15.40:0/48102742 learned_addr learned my addr 172.21.15.40:0/48102742 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13f9c00640 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea09060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 -- 172.21.15.40:0/48102742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 msgr2=0x556a4ea09060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea09060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 -- 172.21.15.40:0/48102742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 msgr2=0x556a4ea095a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T12:52:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea095a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13ebe00640 1 -- 172.21.15.40:0/48102742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4e8f58e0 con 0x556a4e641b70 2024-07-26T12:52:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.877+0000 7f13f2000640 1 -- 172.21.15.40:0/2753033565 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f13e4010460 con 0x7f13f4104110 2024-07-26T12:52:28.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.878+0000 7f13ebe00640 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea09ae0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f13f406a3b0 tx=0x7f13e0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0edef1826265c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.878+0000 7f13ea000640 1 -- 172.21.15.40:0/48102742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e003f070 con 0x556a4e641b70 2024-07-26T12:52:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.878+0000 7f13ea000640 1 -- 172.21.15.40:0/48102742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e00044c0 con 0x556a4e641b70 2024-07-26T12:52:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.878+0000 7f13ea000640 1 -- 172.21.15.40:0/48102742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0035070 con 0x556a4e641b70 2024-07-26T12:52:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.879+0000 7f14028ae740 1 -- 172.21.15.40:0/48102742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 msgr2=0x556a4ea09ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.879+0000 7f14028ae740 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea09ae0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f13f406a3b0 tx=0x7f13e0032c40 comp rx=0 tx=0).stop 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 -- 172.21.15.40:0/48102742 shutdown_connections 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea09ae0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 --2- 172.21.15.40:0/48102742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea09060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 -- 172.21.15.40:0/48102742 >> 172.21.15.40:0/48102742 conn(0x556a4e656c40 msgr2=0x556a4ea06f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 -- 172.21.15.40:0/48102742 shutdown_connections 2024-07-26T12:52:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f14028ae740 1 -- 172.21.15.40:0/48102742 wait complete. 2024-07-26T12:52:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.880+0000 7f13f2000640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f13d80b3b50 0x7f13d80b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.881+0000 7f13f2000640 1 -- 172.21.15.40:0/2753033565 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f13e40e3880 con 0x7f13f4104110 2024-07-26T12:52:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.881+0000 7f14028ae740 1 -- start start 2024-07-26T12:52:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.881+0000 7f13ebe00640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f13d80b3b50 0x7f13d80b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.881+0000 7f14028ae740 1 Processor -- start 2024-07-26T12:52:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 0x556a4ea14b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e641b70 0x556a4ea15060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556a4e7d07b0 con 0x556a4e639990 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556a4e909420 con 0x556a4e662850 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556a4ea177e0 con 0x556a4e641b70 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f14028ae740 10 client.0 _ll_register_callbacks cb 0x556a4e67a0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f13ebe00640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f13d80b3b50 0x7f13d80b6060 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f13e0032f50 tx=0x7f13e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f13f9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 0x556a4ea14b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f13f9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 0x556a4ea14b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35890/0 (socket says 172.21.15.40:35890) 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.882+0000 7f13f9200640 1 -- 172.21.15.40:0/143723908 learned_addr learned my addr 172.21.15.40:0/143723908 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13ebe00640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e641b70 0x556a4ea15060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13f9c00640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13f9200640 1 -- 172.21.15.40:0/143723908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e641b70 msgr2=0x556a4ea15060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13f9200640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e641b70 0x556a4ea15060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13f9200640 1 -- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 msgr2=0x556a4ea20b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13f9200640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.883+0000 7f13f9200640 1 -- 172.21.15.40:0/143723908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4e901c50 con 0x556a4e639990 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.884+0000 7f13f9200640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 0x556a4ea14b20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f13e4000c00 tx=0x7f13e40aa030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7060f32e18afb34 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.884+0000 7f13dea00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:52:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.884+0000 7f13dea00640 1 -- 172.21.15.40:0/143723908 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4020070 con 0x556a4e639990 2024-07-26T12:52:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.884+0000 7f13dea00640 1 -- 172.21.15.40:0/143723908 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f13e40a99f0 con 0x556a4e639990 2024-07-26T12:52:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.884+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a4e97f8c0 con 0x556a4e639990 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.885+0000 7f13dea00640 1 -- 172.21.15.40:0/143723908 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f13e40cd320 con 0x556a4e639990 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.885+0000 7f14028ae740 10 client.16581 fetch_fsmap learned FSMap version 35 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.885+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556a4e6dcba0 con 0x556a4e639990 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.885+0000 7f13dea00640 1 -- 172.21.15.40:0/143723908 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556a4e97f8c0 con 0x556a4e639990 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f13dea00640 1 -- 172.21.15.40:0/143723908 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f13e4010750 con 0x556a4e639990 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f14028ae740 10 client.16581 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f14028ae740 10 client.16581 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f14028ae740 20 client.16581 populate_metadata read hostname 'smithi040' 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f14028ae740 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e6211d0 0x556a4ea26a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f14028ae740 4 client.16581 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:52:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.886+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a4e97b360 con 0x556a4e6211d0 2024-07-26T12:52:28.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.887+0000 7f13ebe00640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e6211d0 0x556a4ea26a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.888+0000 7f13ebe00640 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e6211d0 0x556a4ea26a00 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4e4da3205e2efc server_cookie=8de8016ebdce528b in_seq=0 out_seq=0 2024-07-26T12:52:28.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.888+0000 7f13dea00640 10 client.16581 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:28.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f13dea00640 1 -- 172.21.15.40:0/143723908 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a4e97b360 con 0x556a4e6211d0 2024-07-26T12:52:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f13dea00640 10 client.16581 handle_command_reply: tid=0 2024-07-26T12:52:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 client.16581 shutdown 2024-07-26T12:52:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 msgr2=0x556a4ea14b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 0x556a4ea14b20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f13e4000c00 tx=0x7f13e40aa030 comp rx=0 tx=0).stop 2024-07-26T12:52:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 shutdown_connections 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e641b70 0x556a4ea15060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e6211d0 0x556a4ea26a00 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 --2- 172.21.15.40:0/143723908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e639990 0x556a4ea14b20 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 >> 172.21.15.40:0/143723908 conn(0x556a4e656c40 msgr2=0x556a4ea0c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.890+0000 7f13dea00640 0 client.16581 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.891+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 shutdown_connections 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.891+0000 7f14028ae740 1 -- 172.21.15.40:0/143723908 wait complete. 2024-07-26T12:52:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.891+0000 7f14028ae740 20 client.16581 trim_cache size 0 max 16384 2024-07-26T12:52:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.911+0000 7f14028ae740 1 Processor -- start 2024-07-26T12:52:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.911+0000 7f14028ae740 1 -- start start 2024-07-26T12:52:28.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f14028ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e639990 0x556a4ea16820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f14028ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea20920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f14028ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f14028ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b0d70 con 0x556a4e641b70 2024-07-26T12:52:28.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f14028ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b28b0 con 0x556a4e662850 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f14028ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b1440 con 0x556a4e639990 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea20920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea20920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35894/0 (socket says 172.21.15.40:35894) 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.912+0000 7f13ebe00640 1 -- 172.21.15.40:0/596651233 learned_addr learned my addr 172.21.15.40:0/596651233 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13f9c00640 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13f9200640 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e639990 0x556a4ea16820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13ebe00640 1 -- 172.21.15.40:0/596651233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e639990 msgr2=0x556a4ea16820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13ebe00640 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e639990 0x556a4ea16820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13ebe00640 1 -- 172.21.15.40:0/596651233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 msgr2=0x556a4ea20e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13ebe00640 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13ebe00640 1 -- 172.21.15.40:0/596651233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4ea16f20 con 0x556a4e641b70 2024-07-26T12:52:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.913+0000 7f13ebe00640 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea20920 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009900 tx=0x7f13e0009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79de61f9066c823a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.914+0000 7f13e9600640 1 -- 172.21.15.40:0/596651233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0035070 con 0x556a4e641b70 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.914+0000 7f13e9600640 1 -- 172.21.15.40:0/596651233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e0004b50 con 0x556a4e641b70 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.914+0000 7f13e9600640 1 -- 172.21.15.40:0/596651233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e003f040 con 0x556a4e641b70 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 -- 172.21.15.40:0/596651233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 msgr2=0x556a4ea20920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea20920 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009900 tx=0x7f13e0009560 comp rx=0 tx=0).stop 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 -- 172.21.15.40:0/596651233 shutdown_connections 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e662850 0x556a4ea20e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea20920 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 --2- 172.21.15.40:0/596651233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e639990 0x556a4ea16820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 -- 172.21.15.40:0/596651233 >> 172.21.15.40:0/596651233 conn(0x556a4e656c40 msgr2=0x556a4ea0a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:28.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 -- 172.21.15.40:0/596651233 shutdown_connections 2024-07-26T12:52:28.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.915+0000 7f14028ae740 1 -- 172.21.15.40:0/596651233 wait complete. 2024-07-26T12:52:28.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.916+0000 7f14028ae740 1 -- start start 2024-07-26T12:52:28.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.916+0000 7f14028ae740 1 Processor -- start 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea18a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea18fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea19510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b21e0 con 0x556a4e641b70 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b1b10 con 0x556a4e639990 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41aed30 con 0x556a4e662850 2024-07-26T12:52:28.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f14028ae740 10 client.0 _ll_register_callbacks cb 0x7f13e400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:52:28.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea18fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f13ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea18fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35902/0 (socket says 172.21.15.40:35902) 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.917+0000 7f13ebe00640 1 -- 172.21.15.40:0/82549327 learned_addr learned my addr 172.21.15.40:0/82549327 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13f9200640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea18a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13f9c00640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea19510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13ebe00640 1 -- 172.21.15.40:0/82549327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 msgr2=0x556a4ea19510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13ebe00640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea19510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13ebe00640 1 -- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 msgr2=0x556a4ea18a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13ebe00640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea18a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.918+0000 7f13ebe00640 1 -- 172.21.15.40:0/82549327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4ea8e290 con 0x556a4e641b70 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f13ebe00640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea18fd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f13e00316e0 tx=0x7f13e0031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc0e39d0e3f3a74 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f13dea00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f13dea00640 1 -- 172.21.15.40:0/82549327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0067020 con 0x556a4e641b70 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f13dea00640 1 -- 172.21.15.40:0/82549327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f13e0004d00 con 0x556a4e641b70 2024-07-26T12:52:28.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e0004b50 con 0x556a4e641b70 2024-07-26T12:52:28.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f13dea00640 1 -- 172.21.15.40:0/82549327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f13e0035030 con 0x556a4e641b70 2024-07-26T12:52:28.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f14028ae740 10 client.16587 fetch_fsmap learned FSMap version 35 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.919+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556a4ea8f4f0 con 0x556a4e641b70 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f13dea00640 1 -- 172.21.15.40:0/82549327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e0004b50 con 0x556a4e641b70 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f13dea00640 1 -- 172.21.15.40:0/82549327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f13e004b040 con 0x556a4e641b70 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f14028ae740 10 client.16587 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f14028ae740 10 client.16587 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f14028ae740 20 client.16587 populate_metadata read hostname 'smithi040' 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f14028ae740 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e5f6580 0x556a4ea91890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f14028ae740 4 client.16587 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}] 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.920+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}) -- 0x556a4e978aa0 con 0x556a4e5f6580 2024-07-26T12:52:28.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.921+0000 7f13f9200640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e5f6580 0x556a4ea91890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:28.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.922+0000 7f13f9200640 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e5f6580 0x556a4ea91890 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f87986a3830a66c5 server_cookie=5e5974078c3d09b1 in_seq=0 out_seq=0 2024-07-26T12:52:28.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:28.922+0000 7f13dea00640 10 client.16587 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.196+0000 7f13dea00640 1 -- 172.21.15.40:0/82549327 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556a4e978aa0 con 0x556a4e5f6580 2024-07-26T12:52:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.196+0000 7f13dea00640 10 client.16587 handle_command_reply: tid=0 2024-07-26T12:52:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.196+0000 7f14028ae740 1 client.16587 shutdown 2024-07-26T12:52:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 msgr2=0x556a4ea18fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea18fd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f13e00316e0 tx=0x7f13e0031710 comp rx=0 tx=0).stop 2024-07-26T12:52:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 shutdown_connections 2024-07-26T12:52:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556a4e662850 0x556a4ea19510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556a4e5f6580 0x556a4ea91890 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a4e641b70 0x556a4ea18fd0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 --2- 172.21.15.40:0/82549327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556a4e639990 0x556a4ea18a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 >> 172.21.15.40:0/82549327 conn(0x556a4e656c40 msgr2=0x556a4ea0a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.197+0000 7f13dea00640 0 client.16587 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.198+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 shutdown_connections 2024-07-26T12:52:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.198+0000 7f14028ae740 1 -- 172.21.15.40:0/82549327 wait complete. 2024-07-26T12:52:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.198+0000 7f14028ae740 20 client.16587 trim_cache size 0 max 16384 2024-07-26T12:52:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 94, 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "a817f694": { 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 94, 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:52:29.202 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:29.204 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:29.204 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:29.205 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:52:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f13d80b3b50 msgr2=0x7f13d80b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f13d80b3b50 0x7f13d80b6060 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f13e0032f50 tx=0x7f13e0000bc0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 msgr2=0x7f13f4102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 0x7f13f4102020 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f13e400d950 tx=0x7f13e400de10 comp rx=0 tx=0).stop 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 shutdown_connections 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13f410d6c0 0x7f13f4102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f13d80b3b50 0x7f13d80b6060 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f4104b40 0x7f13f4102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 --2- 172.21.15.40:0/2753033565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13f4104110 0x7f13f4102020 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.200+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 >> 172.21.15.40:0/2753033565 conn(0x7f13f40fdd60 msgr2=0x7f13f40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.201+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 shutdown_connections 2024-07-26T12:52:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:29.201+0000 7f13fa600640 1 -- 172.21.15.40:0/2753033565 wait complete. 2024-07-26T12:52:29.927 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a817f694', quiesce took 8.0 seconds. Will release after: 18.45 2024-07-26T12:52:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:30 smithi040 ceph-mon[32397]: pgmap v1407: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:52:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:30 smithi146 ceph-mon[35807]: pgmap v1407: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:52:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:30 smithi076 ceph-mon[35401]: pgmap v1407: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:52:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:32 smithi146 ceph-mon[35807]: pgmap v1408: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:52:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:32 smithi076 ceph-mon[35401]: pgmap v1408: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:52:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:32 smithi040 ceph-mon[32397]: pgmap v1408: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:52:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:33 smithi146 ceph-mon[35807]: pgmap v1409: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:52:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:33 smithi076 ceph-mon[35401]: pgmap v1409: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:52:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:33 smithi040 ceph-mon[32397]: pgmap v1409: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:52:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:36 smithi146 ceph-mon[35807]: pgmap v1410: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:52:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:36 smithi076 ceph-mon[35401]: pgmap v1410: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:52:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:36 smithi040 ceph-mon[32397]: pgmap v1410: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:52:38.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:38 smithi040 ceph-mon[32397]: pgmap v1411: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:52:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:38 smithi146 ceph-mon[35807]: pgmap v1411: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:52:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:38 smithi076 ceph-mon[35401]: pgmap v1411: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:52:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:40 smithi040 ceph-mon[32397]: pgmap v1412: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T12:52:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:40 smithi146 ceph-mon[35807]: pgmap v1412: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T12:52:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:40 smithi076 ceph-mon[35401]: pgmap v1412: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T12:52:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:41 smithi076 ceph-mon[35401]: pgmap v1413: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T12:52:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:41 smithi040 ceph-mon[32397]: pgmap v1413: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T12:52:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:41 smithi146 ceph-mon[35807]: pgmap v1413: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T12:52:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:44 smithi146 ceph-mon[35807]: pgmap v1414: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 966 KiB/s wr, 11 op/s 2024-07-26T12:52:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:44 smithi076 ceph-mon[35401]: pgmap v1414: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 966 KiB/s wr, 11 op/s 2024-07-26T12:52:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:44 smithi040 ceph-mon[32397]: pgmap v1414: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 966 KiB/s wr, 11 op/s 2024-07-26T12:52:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:46 smithi146 ceph-mon[35807]: pgmap v1415: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 625 KiB/s wr, 11 op/s 2024-07-26T12:52:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:46 smithi076 ceph-mon[35401]: pgmap v1415: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 625 KiB/s wr, 11 op/s 2024-07-26T12:52:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:46 smithi040 ceph-mon[32397]: pgmap v1415: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 625 KiB/s wr, 11 op/s 2024-07-26T12:52:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:48 smithi146 ceph-mon[35807]: pgmap v1416: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 624 KiB/s wr, 8 op/s 2024-07-26T12:52:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:48 smithi076 ceph-mon[35401]: pgmap v1416: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 624 KiB/s wr, 8 op/s 2024-07-26T12:52:48.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:52:48.461 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:48 smithi040 ceph-mon[32397]: pgmap v1416: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 624 KiB/s wr, 8 op/s 2024-07-26T12:52:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:52:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:49 smithi146 ceph-mon[35807]: pgmap v1417: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 624 KiB/s wr, 11 op/s 2024-07-26T12:52:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:49 smithi076 ceph-mon[35401]: pgmap v1417: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 624 KiB/s wr, 11 op/s 2024-07-26T12:52:49.361 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:49 smithi040 ceph-mon[32397]: pgmap v1417: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 624 KiB/s wr, 11 op/s 2024-07-26T12:52:51.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 -- 172.21.15.40:0/1625587435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e581035a0 msgr2=0x7f5e581039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 --2- 172.21.15.40:0/1625587435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e581035a0 0x7f5e581039b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009900 tx=0x7f5e4802a400 comp rx=0 tx=0).stop 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 -- 172.21.15.40:0/1625587435 shutdown_connections 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 --2- 172.21.15.40:0/1625587435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5e58109830 0x7f5e58110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 --2- 172.21.15.40:0/1625587435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e58108ee0 0x7f5e581092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 --2- 172.21.15.40:0/1625587435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e581035a0 0x7f5e581039b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 -- 172.21.15.40:0/1625587435 >> 172.21.15.40:0/1625587435 conn(0x7f5e580ff010 msgr2=0x7f5e58101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 -- 172.21.15.40:0/1625587435 shutdown_connections 2024-07-26T12:52:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.229+0000 7f5e5de00640 1 -- 172.21.15.40:0/1625587435 wait complete. 2024-07-26T12:52:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.231+0000 7f5e5de00640 1 Processor -- start 2024-07-26T12:52:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.231+0000 7f5e5de00640 1 -- start start 2024-07-26T12:52:51.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e5de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e581035a0 0x7f5e58199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e5de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 0x7f5e5819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e5de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5e58109830 0x7f5e5819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e5de00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581133e0 con 0x7f5e58108ee0 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e5de00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58113260 con 0x7f5e58109830 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e5de00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58113560 con 0x7f5e581035a0 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e56000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 0x7f5e5819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e56000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 0x7f5e5819a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59808/0 (socket says 172.21.15.40:59808) 2024-07-26T12:52:51.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e56000640 1 -- 172.21.15.40:0/574911631 learned_addr learned my addr 172.21.15.40:0/574911631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:51.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e56a00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e581035a0 0x7f5e58199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:51.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.232+0000 7f5e57400640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5e58109830 0x7f5e5819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:51.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e56000640 1 -- 172.21.15.40:0/574911631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e581035a0 msgr2=0x7f5e58199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e56000640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e581035a0 0x7f5e58199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e56000640 1 -- 172.21.15.40:0/574911631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5e58109830 msgr2=0x7f5e5819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e56000640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5e58109830 0x7f5e5819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e56000640 1 -- 172.21.15.40:0/574911631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5819fc40 con 0x7f5e58108ee0 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e56000640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 0x7f5e5819a330 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400c8c0 tx=0x7f5e4400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44007bb0 con 0x7f5e58108ee0 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5819ff30 con 0x7f5e58108ee0 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e44007d50 con 0x7f5e58108ee0 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.233+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44018660 con 0x7f5e58108ee0 2024-07-26T12:52:51.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.234+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e581a6750 con 0x7f5e58108ee0 2024-07-26T12:52:51.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.235+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e581039b0 con 0x7f5e58108ee0 2024-07-26T12:52:51.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.238+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5e4400fa00 con 0x7f5e58108ee0 2024-07-26T12:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.240+0000 7f5e5ca00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5e3c0b3c00 0x7f5e3c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.240+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5e440e3fb0 con 0x7f5e58108ee0 2024-07-26T12:52:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.240+0000 7f5e56a00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5e3c0b3c00 0x7f5e3c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.242+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5e44014030 con 0x7f5e58108ee0 2024-07-26T12:52:51.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.242+0000 7f5e56a00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5e3c0b3c00 0x7f5e3c0b6110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5e48006010 tx=0x7f5e48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.484+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e5819aec0 con 0x7f5e58108ee0 2024-07-26T12:52:51.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.486+0000 7f5e5ca00640 1 -- 172.21.15.40:0/574911631 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f5e440ab650 con 0x7f5e58108ee0 2024-07-26T12:52:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:52:51.488 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:52:51.488 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:52:51.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.488+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5e3c0b3c00 msgr2=0x7f5e3c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:51.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.488+0000 7f5e5de00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5e3c0b3c00 0x7f5e3c0b6110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5e48006010 tx=0x7f5e48000bc0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.488+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 msgr2=0x7f5e5819a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.488+0000 7f5e5de00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 0x7f5e5819a330 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400c8c0 tx=0x7f5e4400cd80 comp rx=0 tx=0).stop 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 shutdown_connections 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5e58109830 0x7f5e5819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e58108ee0 0x7f5e5819a330 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5e3c0b3c00 0x7f5e3c0b6110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 --2- 172.21.15.40:0/574911631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e581035a0 0x7f5e58199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 >> 172.21.15.40:0/574911631 conn(0x7f5e580ff010 msgr2=0x7f5e58101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 shutdown_connections 2024-07-26T12:52:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:51.489+0000 7f5e5de00640 1 -- 172.21.15.40:0/574911631 wait complete. 2024-07-26T12:52:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:52 smithi040 ceph-mon[32397]: pgmap v1418: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-07-26T12:52:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:52 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/574911631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:52:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:52 smithi146 ceph-mon[35807]: pgmap v1418: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-07-26T12:52:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:52 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/574911631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:52:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:52 smithi076 ceph-mon[35401]: pgmap v1418: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-07-26T12:52:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:52 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/574911631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:52:52.445 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id a817f694 --release --await' 2024-07-26T12:52:52.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id a817f694 --release --await 2024-07-26T12:52:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:52:54.153 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:54 smithi040 ceph-mon[32397]: pgmap v1419: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:52:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:54 smithi146 ceph-mon[35807]: pgmap v1419: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:52:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:54 smithi076 ceph-mon[35401]: pgmap v1419: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-07-26T12:52:55.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 -- 172.21.15.40:0/909954982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 msgr2=0x7f7e841122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 --2- 172.21.15.40:0/909954982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841122a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009ca0 tx=0x7f7e7c02a8c0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 -- 172.21.15.40:0/909954982 shutdown_connections 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 --2- 172.21.15.40:0/909954982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841122a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 --2- 172.21.15.40:0/909954982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e8410b120 0x7f7e8410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 --2- 172.21.15.40:0/909954982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e841057e0 0x7f7e84105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 -- 172.21.15.40:0/909954982 >> 172.21.15.40:0/909954982 conn(0x7f7e841011f0 msgr2=0x7f7e84103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.093+0000 7f7e8c200640 1 -- 172.21.15.40:0/909954982 shutdown_connections 2024-07-26T12:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.094+0000 7f7e8c200640 1 -- 172.21.15.40:0/909954982 wait complete. 2024-07-26T12:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 Processor -- start 2024-07-26T12:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 -- start start 2024-07-26T12:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e841057e0 0x7f7e8419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8410b120 0x7f7e8419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84115640 con 0x7f7e8410ba70 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841154c0 con 0x7f7e841057e0 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.095+0000 7f7e8c200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841157c0 con 0x7f7e8410b120 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.096+0000 7f7e8a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.096+0000 7f7e8a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36580/0 (socket says 172.21.15.40:36580) 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.096+0000 7f7e8a200640 1 -- 172.21.15.40:0/3963986428 learned_addr learned my addr 172.21.15.40:0/3963986428 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.096+0000 7f7e89800640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e841057e0 0x7f7e8419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.096+0000 7f7e88e00640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8410b120 0x7f7e8419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8a200640 1 -- 172.21.15.40:0/3963986428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8410b120 msgr2=0x7f7e8419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8a200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8410b120 0x7f7e8419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8a200640 1 -- 172.21.15.40:0/3963986428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e841057e0 msgr2=0x7f7e8419bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8a200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e841057e0 0x7f7e8419bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8a200640 1 -- 172.21.15.40:0/3963986428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e841a1ea0 con 0x7f7e8410ba70 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8a200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841a1830 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c005cc0 tx=0x7f7e7c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e82000640 1 -- 172.21.15.40:0/3963986428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c004040 con 0x7f7e8410ba70 2024-07-26T12:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e82000640 1 -- 172.21.15.40:0/3963986428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7c004670 con 0x7f7e8410ba70 2024-07-26T12:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e82000640 1 -- 172.21.15.40:0/3963986428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c030cc0 con 0x7f7e8410ba70 2024-07-26T12:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.097+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841a2130 con 0x7f7e8410ba70 2024-07-26T12:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.098+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841a2670 con 0x7f7e8410ba70 2024-07-26T12:52:55.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.101+0000 7f7e92e53740 1 Processor -- start 2024-07-26T12:52:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.101+0000 7f7e82000640 1 -- 172.21.15.40:0/3963986428 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7e7c0041e0 con 0x7f7e8410ba70 2024-07-26T12:52:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 -- start start 2024-07-26T12:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a566949f30 con 0x55a56662e520 2024-07-26T12:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a566939430 con 0x55a566605660 2024-07-26T12:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e92e53740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a56693d470 con 0x55a56660d840 2024-07-26T12:52:55.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.102+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669d2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36594/0 (socket says 172.21.15.40:36594) 2024-07-26T12:52:55.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 -- 172.21.15.40:0/1811489489 learned_addr learned my addr 172.21.15.40:0/1811489489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:55.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e89800640 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 -- 172.21.15.40:0/1811489489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 msgr2=0x55a5669d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 -- 172.21.15.40:0/1811489489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 msgr2=0x55a5669d3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e88e00640 1 -- 172.21.15.40:0/1811489489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a566699b00 con 0x55a56662e520 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e89800640 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.103+0000 7f7e82000640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e6c0b3c00 0x7f7e6c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.104+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669d2fc0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000af90 tx=0x7f7e7000a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12f468408c344ce server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.104+0000 7f7e82000640 1 -- 172.21.15.40:0/3963986428 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7e7c105200 con 0x7f7e8410ba70 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.104+0000 7f7e89800640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e6c0b3c00 0x7f7e6c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.104+0000 7f7e76a00640 1 -- 172.21.15.40:0/1811489489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70019030 con 0x55a56662e520 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.104+0000 7f7e76a00640 1 -- 172.21.15.40:0/1811489489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e700110d0 con 0x55a56662e520 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.104+0000 7f7e76a00640 1 -- 172.21.15.40:0/1811489489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70004c30 con 0x55a56662e520 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 -- 172.21.15.40:0/1811489489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 msgr2=0x55a5669d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669d2fc0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000af90 tx=0x7f7e7000a780 comp rx=0 tx=0).stop 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e89800640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e6c0b3c00 0x7f7e6c0b6110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55a5669d1c40 tx=0x7f7e7800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 -- 172.21.15.40:0/1811489489 shutdown_connections 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1811489489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669d2fc0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 -- 172.21.15.40:0/1811489489 >> 172.21.15.40:0/1811489489 conn(0x55a566622910 msgr2=0x55a5669d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.105+0000 7f7e92e53740 1 -- 172.21.15.40:0/1811489489 shutdown_connections 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.106+0000 7f7e92e53740 1 -- 172.21.15.40:0/1811489489 wait complete. 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.106+0000 7f7e92e53740 1 -- start start 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.106+0000 7f7e92e53740 1 Processor -- start 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a566605660 0x55a5669de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 0x55a5669dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a56679cbb0 con 0x55a56660d840 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a5668d5910 con 0x55a56662e520 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a5669e17a0 con 0x55a566605660 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e92e53740 10 client.0 _ll_register_callbacks cb 0x55a566645d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 0x55a5669dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 0x55a5669dec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36604/0 (socket says 172.21.15.40:36604) 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.107+0000 7f7e88e00640 1 -- 172.21.15.40:0/3173015455 learned_addr learned my addr 172.21.15.40:0/3173015455 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e89800640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a566605660 0x55a5669de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e8a200640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e88e00640 1 -- 172.21.15.40:0/3173015455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a566605660 msgr2=0x55a5669de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e88e00640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a566605660 0x55a5669de700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e88e00640 1 -- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 msgr2=0x55a5669eaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e88e00640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669eaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e88e00640 1 -- 172.21.15.40:0/3173015455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a566710960 con 0x55a56660d840 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e88e00640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 0x55a5669dec40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000a660 tx=0x7f7e70004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78153df894dbd6c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.108+0000 7f7e6b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e6b400640 1 -- 172.21.15.40:0/3173015455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70019040 con 0x55a56660d840 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e6b400640 1 -- 172.21.15.40:0/3173015455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7e70005220 con 0x55a56660d840 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e700110d0 con 0x55a56660d840 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e6b400640 1 -- 172.21.15.40:0/3173015455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7e700046c0 con 0x55a56660d840 2024-07-26T12:52:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e92e53740 10 client.16605 fetch_fsmap learned FSMap version 35 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a5669ed510 con 0x55a56660d840 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.109+0000 7f7e6b400640 1 -- 172.21.15.40:0/3173015455 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e700110d0 con 0x55a56660d840 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e6b400640 1 -- 172.21.15.40:0/3173015455 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7e70025070 con 0x55a56660d840 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e92e53740 10 client.16605 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e92e53740 10 client.16605 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e92e53740 20 client.16605 populate_metadata read hostname 'smithi040' 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e92e53740 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665ecea0 0x55a5669f0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e92e53740 4 client.16605 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a56694be80 con 0x55a5665ecea0 2024-07-26T12:52:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.110+0000 7f7e89800640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665ecea0 0x55a5669f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.112+0000 7f7e89800640 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665ecea0 0x55a5669f0870 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=223ee1249363687a server_cookie=e3a8ecd9400c026 in_seq=0 out_seq=0 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.112+0000 7f7e6b400640 10 client.16605 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e6b400640 1 -- 172.21.15.40:0/3173015455 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a56694be80 con 0x55a5665ecea0 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e6b400640 10 client.16605 handle_command_reply: tid=0 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 client.16605 shutdown 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 msgr2=0x55a5669dec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 0x55a5669dec40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000a660 tx=0x7f7e70004f90 comp rx=0 tx=0).stop 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 shutdown_connections 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669eaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665ecea0 0x55a5669f0870 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56660d840 0x55a5669dec40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e6b400640 0 client.16605 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 --2- 172.21.15.40:0/3173015455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a566605660 0x55a5669de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 >> 172.21.15.40:0/3173015455 conn(0x55a566622910 msgr2=0x55a5669d61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 shutdown_connections 2024-07-26T12:52:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.114+0000 7f7e92e53740 1 -- 172.21.15.40:0/3173015455 wait complete. 2024-07-26T12:52:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.115+0000 7f7e92e53740 20 client.16605 trim_cache size 0 max 16384 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 Processor -- start 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 -- start start 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669ea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b0ec0 con 0x55a56662e520 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b2a00 con 0x55a566605660 2024-07-26T12:52:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.134+0000 7f7e92e53740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b1590 con 0x55a56660d840 2024-07-26T12:52:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669eadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36620/0 (socket says 172.21.15.40:36620) 2024-07-26T12:52:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 -- 172.21.15.40:0/1507944430 learned_addr learned my addr 172.21.15.40:0/1507944430 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e89800640 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 -- 172.21.15.40:0/1507944430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 msgr2=0x55a5669ea880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669ea880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 -- 172.21.15.40:0/1507944430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 msgr2=0x55a5669d9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.135+0000 7f7e8a200640 1 -- 172.21.15.40:0/1507944430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5669e0ad0 con 0x55a56662e520 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.136+0000 7f7e8a200640 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669eadc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0c9380 tx=0x7f7e7c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b444dd195c6ca1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.136+0000 7f7e76000640 1 -- 172.21.15.40:0/1507944430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0cbc20 con 0x55a56662e520 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.136+0000 7f7e76000640 1 -- 172.21.15.40:0/1507944430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7c0e6070 con 0x55a56662e520 2024-07-26T12:52:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.136+0000 7f7e76000640 1 -- 172.21.15.40:0/1507944430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0c8400 con 0x55a56662e520 2024-07-26T12:52:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 -- 172.21.15.40:0/1507944430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 msgr2=0x55a5669eadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669eadc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0c9380 tx=0x7f7e7c003f60 comp rx=0 tx=0).stop 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 -- 172.21.15.40:0/1507944430 shutdown_connections 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a56662e520 0x55a5669eadc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1507944430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a566605660 0x55a5669d9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 -- 172.21.15.40:0/1507944430 >> 172.21.15.40:0/1507944430 conn(0x55a566622910 msgr2=0x55a5669dd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 -- 172.21.15.40:0/1507944430 shutdown_connections 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.137+0000 7f7e92e53740 1 -- 172.21.15.40:0/1507944430 wait complete. 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.138+0000 7f7e92e53740 1 -- start start 2024-07-26T12:52:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.138+0000 7f7e92e53740 1 Processor -- start 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.138+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 0x55a5669e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.138+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.138+0000 7f7e92e53740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669d99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.138+0000 7f7e92e53740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b2330 con 0x55a566605660 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e92e53740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841b1c60 con 0x55a56662e520 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e92e53740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841aee80 con 0x55a56660d840 2024-07-26T12:52:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e92e53740 10 client.0 _ll_register_callbacks cb 0x7f7e70013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 0x55a5669e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 0x55a5669e72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36634/0 (socket says 172.21.15.40:36634) 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 -- 172.21.15.40:0/1321861576 learned_addr learned my addr 172.21.15.40:0/1321861576 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e8a200640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669d99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 -- 172.21.15.40:0/1321861576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 msgr2=0x55a5669d92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 -- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 msgr2=0x55a5669d99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669d99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.139+0000 7f7e89800640 1 -- 172.21.15.40:0/1321861576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5669e5f10 con 0x55a566605660 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e89800640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 0x55a5669e72d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x55a5669f0e70 tx=0x7f7e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4718bb2334ea50a4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e6b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:52:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e6b400640 1 -- 172.21.15.40:0/1321861576 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78004220 con 0x55a566605660 2024-07-26T12:52:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e6b400640 1 -- 172.21.15.40:0/1321861576 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7e780043c0 con 0x55a566605660 2024-07-26T12:52:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7c0e6070 con 0x55a566605660 2024-07-26T12:52:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e6b400640 1 -- 172.21.15.40:0/1321861576 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7e78029690 con 0x55a566605660 2024-07-26T12:52:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.140+0000 7f7e92e53740 10 client.16611 fetch_fsmap learned FSMap version 35 2024-07-26T12:52:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a566a590e0 con 0x55a566605660 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e6b400640 1 -- 172.21.15.40:0/1321861576 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7c0e6070 con 0x55a566605660 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e6b400640 1 -- 172.21.15.40:0/1321861576 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7e78003ca0 con 0x55a566605660 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 10 client.16611 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 10 client.16611 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 20 client.16611 populate_metadata read hostname 'smithi040' 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665c2250 0x55a566a5b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 4 client.16611 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a817f694", "release": true, "await": true}] 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.141+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a817f694", "release": true, "await": true}) -- 0x55a566947920 con 0x55a5665c2250 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.142+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665c2250 0x55a566a5b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.143+0000 7f7e88e00640 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665c2250 0x55a566a5b8d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8cf6cbfd09f1e62 server_cookie=c797caa15e9452c2 in_seq=0 out_seq=0 2024-07-26T12:52:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.143+0000 7f7e6b400640 10 client.16611 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:55.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.204+0000 7f7e6b400640 1 -- 172.21.15.40:0/1321861576 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a566947920 con 0x55a5665c2250 2024-07-26T12:52:55.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.204+0000 7f7e6b400640 10 client.16611 handle_command_reply: tid=0 2024-07-26T12:52:55.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.204+0000 7f7e92e53740 1 client.16611 shutdown 2024-07-26T12:52:55.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.204+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 msgr2=0x55a5669e72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.204+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 0x55a5669e72d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x55a5669f0e70 tx=0x7f7e780046c0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 shutdown_connections 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a56662e520 0x55a5669d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a56660d840 0x55a5669d92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a5665c2250 0x55a566a5b8d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 --2- 172.21.15.40:0/1321861576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a566605660 0x55a5669e72d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e6b400640 0 client.16611 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 >> 172.21.15.40:0/1321861576 conn(0x55a566622910 msgr2=0x55a5669d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 shutdown_connections 2024-07-26T12:52:55.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.205+0000 7f7e92e53740 1 -- 172.21.15.40:0/1321861576 wait complete. 2024-07-26T12:52:55.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.206+0000 7f7e92e53740 20 client.16611 trim_cache size 0 max 16384 2024-07-26T12:52:55.208 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 96, 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "a817f694": { 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 96, 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:52:55.209 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:52:55.210 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e6c0b3c00 msgr2=0x7f7e6c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e6c0b3c00 0x7f7e6c0b6110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55a5669d1c40 tx=0x7f7e7800a250 comp rx=0 tx=0).stop 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 msgr2=0x7f7e841a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841a1830 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c005cc0 tx=0x7f7e7c032c40 comp rx=0 tx=0).stop 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 shutdown_connections 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8410ba70 0x7f7e841a1830 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7e6c0b3c00 0x7f7e6c0b6110 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8410b120 0x7f7e8419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 --2- 172.21.15.40:0/3963986428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e841057e0 0x7f7e8419bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:55.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 >> 172.21.15.40:0/3963986428 conn(0x7f7e841011f0 msgr2=0x7f7e84104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:55.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 shutdown_connections 2024-07-26T12:52:55.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:55.207+0000 7f7e8c200640 1 -- 172.21.15.40:0/3963986428 wait complete. 2024-07-26T12:52:56.178 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a817f694', total seconds elapsed: 34.2 2024-07-26T12:52:56.178 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.45 2024-07-26T12:52:56.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:52:56.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:56 smithi040 ceph-mon[32397]: pgmap v1420: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:52:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:56 smithi146 ceph-mon[35807]: pgmap v1420: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:52:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:56 smithi076 ceph-mon[35401]: pgmap v1420: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-07-26T12:52:56.701 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:52:57.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:52:57 smithi040 ceph-mon[32397]: pgmap v1421: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:52:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:52:57 smithi146 ceph-mon[35807]: pgmap v1421: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:52:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:52:57 smithi076 ceph-mon[35401]: pgmap v1421: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:52:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 -- 172.21.15.40:0/2667895439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c108d20 msgr2=0x7fbf6c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 --2- 172.21.15.40:0/2667895439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c108d20 0x7fbf6c109130 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009900 tx=0x7fbf5802a410 comp rx=0 tx=0).stop 2024-07-26T12:52:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 -- 172.21.15.40:0/2667895439 shutdown_connections 2024-07-26T12:52:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 --2- 172.21.15.40:0/2667895439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf6c109670 0x7fbf6c10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 --2- 172.21.15.40:0/2667895439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c108d20 0x7fbf6c109130 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 --2- 172.21.15.40:0/2667895439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c1033e0 0x7fbf6c1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 -- 172.21.15.40:0/2667895439 >> 172.21.15.40:0/2667895439 conn(0x7fbf6c0fee30 msgr2=0x7fbf6c101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 -- 172.21.15.40:0/2667895439 shutdown_connections 2024-07-26T12:52:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.017+0000 7fbf6be00640 1 -- 172.21.15.40:0/2667895439 wait complete. 2024-07-26T12:52:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.019+0000 7fbf6be00640 1 Processor -- start 2024-07-26T12:52:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.019+0000 7fbf6be00640 1 -- start start 2024-07-26T12:52:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.019+0000 7fbf6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c1033e0 0x7fbf6c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf6c109670 0x7fbf6c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 0x7fbf6c1a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1131e0 con 0x7fbf6c075bc0 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c113060 con 0x7fbf6c109670 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c113360 con 0x7fbf6c1033e0 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 0x7fbf6c1a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 0x7fbf6c1a7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36660/0 (socket says 172.21.15.40:36660) 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c1033e0 0x7fbf6c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6b400640 1 -- 172.21.15.40:0/3128016249 learned_addr learned my addr 172.21.15.40:0/3128016249 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:52:59.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.020+0000 7fbf6a000640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf6c109670 0x7fbf6c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.021+0000 7fbf6b400640 1 -- 172.21.15.40:0/3128016249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c1033e0 msgr2=0x7fbf6c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.021+0000 7fbf6b400640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c1033e0 0x7fbf6c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.021+0000 7fbf6b400640 1 -- 172.21.15.40:0/3128016249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf6c109670 msgr2=0x7fbf6c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.021+0000 7fbf6b400640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf6c109670 0x7fbf6c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.021+0000 7fbf6b400640 1 -- 172.21.15.40:0/3128016249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c1a8450 con 0x7fbf6c075bc0 2024-07-26T12:52:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.021+0000 7fbf6b400640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 0x7fbf6c1a7e60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400eaa0 tx=0x7fbf6400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:59.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.022+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400cdb0 con 0x7fbf6c075bc0 2024-07-26T12:52:59.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.022+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf64005020 con 0x7fbf6c075bc0 2024-07-26T12:52:59.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.022+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c1a8740 con 0x7fbf6c075bc0 2024-07-26T12:52:59.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.022+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf640116b0 con 0x7fbf6c075bc0 2024-07-26T12:52:59.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.022+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c1a8c00 con 0x7fbf6c075bc0 2024-07-26T12:52:59.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.023+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6c104660 con 0x7fbf6c075bc0 2024-07-26T12:52:59.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.027+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbf640051d0 con 0x7fbf6c075bc0 2024-07-26T12:52:59.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.029+0000 7fbf63400640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbf500b3bd0 0x7fbf500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:52:59.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.030+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbf640e40a0 con 0x7fbf6c075bc0 2024-07-26T12:52:59.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.030+0000 7fbf6aa00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbf500b3bd0 0x7fbf500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:52:59.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.031+0000 7fbf6aa00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbf500b3bd0 0x7fbf500b60e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c076b90 tx=0x7fbf5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:52:59.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.032+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbf64016030 con 0x7fbf6c075bc0 2024-07-26T12:52:59.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.287+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf6c109130 con 0x7fbf6c075bc0 2024-07-26T12:52:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.289+0000 7fbf63400640 1 -- 172.21.15.40:0/3128016249 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fbf640ab0a0 con 0x7fbf6c075bc0 2024-07-26T12:52:59.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:52:59.292 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:52:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:52:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.292+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbf500b3bd0 msgr2=0x7fbf500b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.292+0000 7fbf6be00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbf500b3bd0 0x7fbf500b60e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c076b90 tx=0x7fbf5c00b390 comp rx=0 tx=0).stop 2024-07-26T12:52:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.292+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 msgr2=0x7fbf6c1a7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:52:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.292+0000 7fbf6be00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 0x7fbf6c1a7e60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400eaa0 tx=0x7fbf6400ef60 comp rx=0 tx=0).stop 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 shutdown_connections 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6c075bc0 0x7fbf6c1a7e60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf6c109670 0x7fbf6c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbf500b3bd0 0x7fbf500b60e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 --2- 172.21.15.40:0/3128016249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c1033e0 0x7fbf6c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 >> 172.21.15.40:0/3128016249 conn(0x7fbf6c0fee30 msgr2=0x7fbf6c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:52:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 shutdown_connections 2024-07-26T12:52:59.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:52:59.293+0000 7fbf6be00640 1 -- 172.21.15.40:0/3128016249 wait complete. 2024-07-26T12:53:00.107 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0' 2024-07-26T12:53:00.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0 2024-07-26T12:53:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:00 smithi146 ceph-mon[35807]: pgmap v1422: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 400 KiB/s wr, 11 op/s 2024-07-26T12:53:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:00 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3128016249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:53:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:53:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:00 smithi076 ceph-mon[35401]: pgmap v1422: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 400 KiB/s wr, 11 op/s 2024-07-26T12:53:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:00 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3128016249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:53:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:53:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:00 smithi040 ceph-mon[32397]: pgmap v1422: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 400 KiB/s wr, 11 op/s 2024-07-26T12:53:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:00 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3128016249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:53:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:53:00.613 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:53:01.033 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:53:01.033 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:53:01.033 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:53:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:53:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:53:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:53:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:53:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:53:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:53:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:02 smithi146 ceph-mon[35807]: pgmap v1423: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 741 KiB/s wr, 10 op/s 2024-07-26T12:53:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:02 smithi076 ceph-mon[35401]: pgmap v1423: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 741 KiB/s wr, 10 op/s 2024-07-26T12:53:02.474 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:02 smithi040 ceph-mon[32397]: pgmap v1423: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 741 KiB/s wr, 10 op/s 2024-07-26T12:53:03.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 -- 172.21.15.40:0/1530237676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 msgr2=0x7fb050102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 --2- 172.21.15.40:0/1530237676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb050102470 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb040009900 tx=0x7fb04002a480 comp rx=0 tx=0).stop 2024-07-26T12:53:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 -- 172.21.15.40:0/1530237676 shutdown_connections 2024-07-26T12:53:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 --2- 172.21.15.40:0/1530237676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb05010fc10 0x7fb050112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 --2- 172.21.15.40:0/1530237676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0501029b0 0x7fb05010f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 --2- 172.21.15.40:0/1530237676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb050102470 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 -- 172.21.15.40:0/1530237676 >> 172.21.15.40:0/1530237676 conn(0x7fb050079190 msgr2=0x7fb0500795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 -- 172.21.15.40:0/1530237676 shutdown_connections 2024-07-26T12:53:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.048+0000 7fb056600640 1 -- 172.21.15.40:0/1530237676 wait complete. 2024-07-26T12:53:03.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.049+0000 7fb056600640 1 Processor -- start 2024-07-26T12:53:03.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 -- start start 2024-07-26T12:53:03.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb05019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0501029b0 0x7fb05019c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb05010fc10 0x7fb0501a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501155a0 con 0x7fb050102060 2024-07-26T12:53:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb050115420 con 0x7fb05010fc10 2024-07-26T12:53:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb056600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb050115720 con 0x7fb0501029b0 2024-07-26T12:53:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb04f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb05019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb04f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb05019bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35050/0 (socket says 172.21.15.40:35050) 2024-07-26T12:53:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.050+0000 7fb04f400640 1 -- 172.21.15.40:0/3597737203 learned_addr learned my addr 172.21.15.40:0/3597737203 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04ea00640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0501029b0 0x7fb05019c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04fe00640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb05010fc10 0x7fb0501a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04f400640 1 -- 172.21.15.40:0/3597737203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0501029b0 msgr2=0x7fb05019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04f400640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0501029b0 0x7fb05019c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04f400640 1 -- 172.21.15.40:0/3597737203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb05010fc10 msgr2=0x7fb0501a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04f400640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb05010fc10 0x7fb0501a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.051+0000 7fb04f400640 1 -- 172.21.15.40:0/3597737203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501a1e80 con 0x7fb050102060 2024-07-26T12:53:03.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.052+0000 7fb04f400640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb05019bfd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb040009a20 tx=0x7fb040004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:03.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.052+0000 7fb047e00640 1 -- 172.21.15.40:0/3597737203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04003f030 con 0x7fb050102060 2024-07-26T12:53:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.052+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501a2110 con 0x7fb050102060 2024-07-26T12:53:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.052+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a8990 con 0x7fb050102060 2024-07-26T12:53:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.052+0000 7fb047e00640 1 -- 172.21.15.40:0/3597737203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0400035f0 con 0x7fb050102060 2024-07-26T12:53:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.052+0000 7fb047e00640 1 -- 172.21.15.40:0/3597737203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040035070 con 0x7fb050102060 2024-07-26T12:53:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.057+0000 7fb05d254740 1 Processor -- start 2024-07-26T12:53:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.057+0000 7fb05d254740 1 -- start start 2024-07-26T12:53:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb05d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb05d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb05d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb05d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bde8027970 con 0x55bde7cebb70 2024-07-26T12:53:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb05d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bde8016e70 con 0x55bde7d0c850 2024-07-26T12:53:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb05d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bde801aeb0 con 0x55bde7ce3990 2024-07-26T12:53:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.058+0000 7fb047e00640 1 -- 172.21.15.40:0/3597737203 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb040003aa0 con 0x7fb050102060 2024-07-26T12:53:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.059+0000 7fb04fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.059+0000 7fb04fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:37096/0 (socket says 172.21.15.40:37096) 2024-07-26T12:53:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.059+0000 7fb04fe00640 1 -- 172.21.15.40:0/2582099712 learned_addr learned my addr 172.21.15.40:0/2582099712 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.059+0000 7fb04ea00640 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.059+0000 7fb04f400640 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.060+0000 7fb04fe00640 1 -- 172.21.15.40:0/2582099712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 msgr2=0x55bde80b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.060+0000 7fb04fe00640 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.060+0000 7fb04fe00640 1 -- 172.21.15.40:0/2582099712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 msgr2=0x55bde80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.060+0000 7fb04fe00640 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.060+0000 7fb04fe00640 1 -- 172.21.15.40:0/2582099712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde7f9f8e0 con 0x55bde7d0c850 2024-07-26T12:53:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.060+0000 7fb04fe00640 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80b2ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb048009f20 tx=0x7fb04800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e37adcc5a46a44 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.061+0000 7fb044c00640 1 -- 172.21.15.40:0/2582099712 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04801a070 con 0x55bde7d0c850 2024-07-26T12:53:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.061+0000 7fb044c00640 1 -- 172.21.15.40:0/2582099712 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0480158a0 con 0x55bde7d0c850 2024-07-26T12:53:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.061+0000 7fb044c00640 1 -- 172.21.15.40:0/2582099712 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04800a780 con 0x55bde7d0c850 2024-07-26T12:53:03.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.061+0000 7fb047e00640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0340b3c80 0x7fb0340b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.061+0000 7fb047e00640 1 -- 172.21.15.40:0/3597737203 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb040104610 con 0x7fb050102060 2024-07-26T12:53:03.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.062+0000 7fb04f400640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0340b3c80 0x7fb0340b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.062+0000 7fb05d254740 1 -- 172.21.15.40:0/2582099712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 msgr2=0x55bde80b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.062+0000 7fb05d254740 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80b2ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb048009f20 tx=0x7fb04800c8b0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 -- 172.21.15.40:0/2582099712 shutdown_connections 2024-07-26T12:53:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 --2- 172.21.15.40:0/2582099712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80b2ee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 -- 172.21.15.40:0/2582099712 >> 172.21.15.40:0/2582099712 conn(0x55bde7d00c40 msgr2=0x55bde80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb04f400640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0340b3c80 0x7fb0340b6190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb0400cb4b0 tx=0x7fb04010a530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 -- 172.21.15.40:0/2582099712 shutdown_connections 2024-07-26T12:53:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.063+0000 7fb05d254740 1 -- 172.21.15.40:0/2582099712 wait complete. 2024-07-26T12:53:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.064+0000 7fb05d254740 1 -- start start 2024-07-26T12:53:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.064+0000 7fb05d254740 1 Processor -- start 2024-07-26T12:53:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80bea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7cebb70 0x55bde80bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 0x55bde80caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bde7e7a7b0 con 0x55bde7d0c850 2024-07-26T12:53:03.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bde7fb3420 con 0x55bde7cebb70 2024-07-26T12:53:03.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bde80c16c0 con 0x55bde7ce3990 2024-07-26T12:53:03.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.065+0000 7fb05d254740 10 client.0 _ll_register_callbacks cb 0x55bde7d240a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:53:03.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 0x55bde80caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 0x55bde80caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35068/0 (socket says 172.21.15.40:35068) 2024-07-26T12:53:03.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 -- 172.21.15.40:0/3250869256 learned_addr learned my addr 172.21.15.40:0/3250869256 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:03.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04ea00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7cebb70 0x55bde80bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 -- 172.21.15.40:0/3250869256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 msgr2=0x55bde80bea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80bea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 -- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7cebb70 msgr2=0x55bde80bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.066+0000 7fb04fe00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7cebb70 0x55bde80bef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.067+0000 7fb04fe00640 1 -- 172.21.15.40:0/3250869256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde7fabc50 con 0x55bde7d0c850 2024-07-26T12:53:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.067+0000 7fb04fe00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 0x55bde80caa10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb048009fd0 tx=0x7fb048009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4372e10f48a645 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.067+0000 7fb039600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:53:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.067+0000 7fb039600640 1 -- 172.21.15.40:0/3250869256 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048028e60 con 0x55bde7d0c850 2024-07-26T12:53:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.067+0000 7fb039600640 1 -- 172.21.15.40:0/3250869256 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb048015c80 con 0x55bde7d0c850 2024-07-26T12:53:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.067+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0480158a0 con 0x55bde7d0c850 2024-07-26T12:53:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.068+0000 7fb039600640 1 -- 172.21.15.40:0/3250869256 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb04801a040 con 0x55bde7d0c850 2024-07-26T12:53:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.068+0000 7fb05d254740 10 client.16629 fetch_fsmap learned FSMap version 35 2024-07-26T12:53:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.068+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bde7d86ba0 con 0x55bde7d0c850 2024-07-26T12:53:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.068+0000 7fb039600640 1 -- 172.21.15.40:0/3250869256 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0480158a0 con 0x55bde7d0c850 2024-07-26T12:53:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb039600640 1 -- 172.21.15.40:0/3250869256 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb04800ac90 con 0x55bde7d0c850 2024-07-26T12:53:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb05d254740 10 client.16629 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:53:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb05d254740 10 client.16629 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:53:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb05d254740 20 client.16629 populate_metadata read hostname 'smithi040' 2024-07-26T12:53:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb05d254740 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ccb1d0 0x55bde80d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb05d254740 4 client.16629 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:53:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.069+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bde80298c0 con 0x55bde7ccb1d0 2024-07-26T12:53:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.070+0000 7fb04ea00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ccb1d0 0x55bde80d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.071+0000 7fb04ea00640 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ccb1d0 0x55bde80d0950 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc3f7359a261d86d server_cookie=df4c8f36b96e0070 in_seq=0 out_seq=0 2024-07-26T12:53:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.071+0000 7fb039600640 10 client.16629 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb039600640 1 -- 172.21.15.40:0/3250869256 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bde80298c0 con 0x55bde7ccb1d0 2024-07-26T12:53:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb039600640 10 client.16629 handle_command_reply: tid=0 2024-07-26T12:53:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 client.16629 shutdown 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 msgr2=0x55bde80caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 0x55bde80caa10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb048009fd0 tx=0x7fb048009af0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 shutdown_connections 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ccb1d0 0x55bde80d0950 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7d0c850 0x55bde80caa10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7cebb70 0x55bde80bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 --2- 172.21.15.40:0/3250869256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 >> 172.21.15.40:0/3250869256 conn(0x55bde7d00c40 msgr2=0x55bde80af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:03.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.073+0000 7fb039600640 0 client.16629 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:03.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.074+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 shutdown_connections 2024-07-26T12:53:03.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.074+0000 7fb05d254740 1 -- 172.21.15.40:0/3250869256 wait complete. 2024-07-26T12:53:03.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.074+0000 7fb05d254740 20 client.16629 trim_cache size 0 max 16384 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.102+0000 7fb05d254740 1 Processor -- start 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 -- start start 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7ce3990 0x55bde80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7d0c850 0x55bde80d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501acac0 con 0x55bde7cebb70 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501ae600 con 0x55bde7ce3990 2024-07-26T12:53:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb05d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501ad190 con 0x55bde7d0c850 2024-07-26T12:53:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.103+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35078/0 (socket says 172.21.15.40:35078) 2024-07-26T12:53:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 -- 172.21.15.40:0/1178894174 learned_addr learned my addr 172.21.15.40:0/1178894174 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04fe00640 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7ce3990 0x55bde80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04fe00640 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7d0c850 0x55bde80d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 -- 172.21.15.40:0/1178894174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7d0c850 msgr2=0x55bde80d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7d0c850 0x55bde80d3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 -- 172.21.15.40:0/1178894174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7ce3990 msgr2=0x55bde80ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7ce3990 0x55bde80ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 -- 172.21.15.40:0/1178894174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde80b5d40 con 0x55bde7cebb70 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04fe00640 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7d0c850 0x55bde80d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.104+0000 7fb04ea00640 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80caec0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c760 tx=0x7fb03c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35828b7b451d3e63 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.105+0000 7fb03be00640 1 -- 172.21.15.40:0/1178894174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c003de0 con 0x55bde7cebb70 2024-07-26T12:53:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.105+0000 7fb03be00640 1 -- 172.21.15.40:0/1178894174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb03c0108c0 con 0x55bde7cebb70 2024-07-26T12:53:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.105+0000 7fb03be00640 1 -- 172.21.15.40:0/1178894174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c01b8f0 con 0x55bde7cebb70 2024-07-26T12:53:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 -- 172.21.15.40:0/1178894174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 msgr2=0x55bde80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80caec0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c760 tx=0x7fb03c00cdb0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 -- 172.21.15.40:0/1178894174 shutdown_connections 2024-07-26T12:53:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7d0c850 0x55bde80d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80caec0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 --2- 172.21.15.40:0/1178894174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7ce3990 0x55bde80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 -- 172.21.15.40:0/1178894174 >> 172.21.15.40:0/1178894174 conn(0x55bde7d00c40 msgr2=0x55bde80b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 -- 172.21.15.40:0/1178894174 shutdown_connections 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.106+0000 7fb05d254740 1 -- 172.21.15.40:0/1178894174 wait complete. 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.107+0000 7fb05d254740 1 -- start start 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.107+0000 7fb05d254740 1 Processor -- start 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501adf30 con 0x55bde7cebb70 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501ad860 con 0x55bde7d0c850 2024-07-26T12:53:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501aab00 con 0x55bde7ce3990 2024-07-26T12:53:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb05d254740 10 client.0 _ll_register_callbacks cb 0x7fb048018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:53:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35086/0 (socket says 172.21.15.40:35086) 2024-07-26T12:53:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.108+0000 7fb04ea00640 1 -- 172.21.15.40:0/861336270 learned_addr learned my addr 172.21.15.40:0/861336270 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04fe00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04fe00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04ea00640 1 -- 172.21.15.40:0/861336270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 msgr2=0x55bde80d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04ea00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04ea00640 1 -- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 msgr2=0x55bde80d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04ea00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.109+0000 7fb04ea00640 1 -- 172.21.15.40:0/861336270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde8137ea0 con 0x55bde7cebb70 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.110+0000 7fb04ea00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80d1db0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb03c004570 tx=0x7fb03c010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7676a56cf51b968 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.110+0000 7fb039600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.110+0000 7fb039600640 1 -- 172.21.15.40:0/861336270 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c02b030 con 0x55bde7cebb70 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.110+0000 7fb039600640 1 -- 172.21.15.40:0/861336270 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb03c010a70 con 0x55bde7cebb70 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.110+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb03c0108c0 con 0x55bde7cebb70 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb039600640 1 -- 172.21.15.40:0/861336270 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb03c014070 con 0x55bde7cebb70 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 10 client.16635 fetch_fsmap learned FSMap version 35 2024-07-26T12:53:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bde8139070 con 0x55bde7cebb70 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb039600640 1 -- 172.21.15.40:0/861336270 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb03c0108c0 con 0x55bde7cebb70 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb039600640 1 -- 172.21.15.40:0/861336270 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb03c0048a0 con 0x55bde7cebb70 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 10 client.16635 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 10 client.16635 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 20 client.16635 populate_metadata read hostname 'smithi040' 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ca0580 0x55bde813b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 4 client.16635 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}] 2024-07-26T12:53:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.111+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}) -- 0x55bde8025360 con 0x55bde7ca0580 2024-07-26T12:53:03.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.112+0000 7fb04fe00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ca0580 0x55bde813b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:03.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.113+0000 7fb04fe00640 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ca0580 0x55bde813b8d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d812f4362875e962 server_cookie=c4bf9242673b6761 in_seq=0 out_seq=0 2024-07-26T12:53:03.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.113+0000 7fb039600640 10 client.16635 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:03 smithi076 ceph-mon[35401]: pgmap v1424: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T12:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.362+0000 7fb039600640 1 -- 172.21.15.40:0/861336270 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bde8025360 con 0x55bde7ca0580 2024-07-26T12:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.362+0000 7fb039600640 10 client.16635 handle_command_reply: tid=0 2024-07-26T12:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.362+0000 7fb05d254740 1 client.16635 shutdown 2024-07-26T12:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 msgr2=0x55bde80d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80d1db0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb03c004570 tx=0x7fb03c010430 comp rx=0 tx=0).stop 2024-07-26T12:53:03.366 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:03 smithi040 ceph-mon[32397]: pgmap v1424: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T12:53:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 shutdown_connections 2024-07-26T12:53:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bde7d0c850 0x55bde80d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bde7ca0580 0x55bde813b8d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bde7cebb70 0x55bde80d1db0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 --2- 172.21.15.40:0/861336270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde7ce3990 0x55bde80d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb039600640 0 client.16635 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.363+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 >> 172.21.15.40:0/861336270 conn(0x55bde7d00c40 msgr2=0x55bde80b89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.364+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 shutdown_connections 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.364+0000 7fb05d254740 1 -- 172.21.15.40:0/861336270 wait complete. 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.364+0000 7fb05d254740 20 client.16635 trim_cache size 0 max 16384 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 98, 2024-07-26T12:53:03.367 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "818101c1": { 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 98, 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:53:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0340b3c80 msgr2=0x7fb0340b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0340b3c80 0x7fb0340b6190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb0400cb4b0 tx=0x7fb04010a530 comp rx=0 tx=0).stop 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 msgr2=0x7fb05019bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb05019bfd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb040009a20 tx=0x7fb040004270 comp rx=0 tx=0).stop 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 shutdown_connections 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb05010fc10 0x7fb0501a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0340b3c80 0x7fb0340b6190 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0501029b0 0x7fb05019c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 --2- 172.21.15.40:0/3597737203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb050102060 0x7fb05019bfd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.366+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 >> 172.21.15.40:0/3597737203 conn(0x7fb050079190 msgr2=0x7fb0501097d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.367+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 shutdown_connections 2024-07-26T12:53:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:03.367+0000 7fb056600640 1 -- 172.21.15.40:0/3597737203 wait complete. 2024-07-26T12:53:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:03 smithi146 ceph-mon[35807]: pgmap v1424: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T12:53:04.644 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '818101c1', quiesce took 8.5 seconds. Will release after: 17.95 2024-07-26T12:53:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:06 smithi146 ceph-mon[35807]: pgmap v1425: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T12:53:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:06 smithi076 ceph-mon[35401]: pgmap v1425: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T12:53:06.420 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:06 smithi040 ceph-mon[32397]: pgmap v1425: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T12:53:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:08 smithi146 ceph-mon[35807]: pgmap v1426: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-07-26T12:53:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:08 smithi076 ceph-mon[35401]: pgmap v1426: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-07-26T12:53:08.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:08 smithi040 ceph-mon[32397]: pgmap v1426: 97 pgs: 97 active+clean; 5.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-07-26T12:53:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:09 smithi146 ceph-mon[35807]: pgmap v1427: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:53:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:09 smithi076 ceph-mon[35401]: pgmap v1427: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:53:09.421 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:09 smithi040 ceph-mon[32397]: pgmap v1427: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:53:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:12 smithi146 ceph-mon[35807]: pgmap v1428: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T12:53:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:12 smithi076 ceph-mon[35401]: pgmap v1428: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T12:53:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:12 smithi040 ceph-mon[32397]: pgmap v1428: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T12:53:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:14 smithi146 ceph-mon[35807]: pgmap v1429: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:53:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:14 smithi076 ceph-mon[35401]: pgmap v1429: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:53:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:14 smithi040 ceph-mon[32397]: pgmap v1429: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:53:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:15 smithi146 ceph-mon[35807]: pgmap v1430: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T12:53:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:15 smithi076 ceph-mon[35401]: pgmap v1430: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T12:53:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:15 smithi040 ceph-mon[32397]: pgmap v1430: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T12:53:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:18 smithi146 ceph-mon[35807]: pgmap v1431: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1013 KiB/s wr, 9 op/s 2024-07-26T12:53:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:18 smithi076 ceph-mon[35401]: pgmap v1431: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1013 KiB/s wr, 9 op/s 2024-07-26T12:53:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:18 smithi040 ceph-mon[32397]: pgmap v1431: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1013 KiB/s wr, 9 op/s 2024-07-26T12:53:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:19 smithi076 ceph-mon[35401]: pgmap v1432: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1013 KiB/s wr, 11 op/s 2024-07-26T12:53:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:19 smithi040 ceph-mon[32397]: pgmap v1432: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1013 KiB/s wr, 11 op/s 2024-07-26T12:53:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:19 smithi146 ceph-mon[35807]: pgmap v1432: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1013 KiB/s wr, 11 op/s 2024-07-26T12:53:22.276 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:22 smithi146 ceph-mon[35807]: pgmap v1433: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 671 KiB/s wr, 10 op/s 2024-07-26T12:53:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:22 smithi076 ceph-mon[35401]: pgmap v1433: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 671 KiB/s wr, 10 op/s 2024-07-26T12:53:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:22 smithi040 ceph-mon[32397]: pgmap v1433: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 671 KiB/s wr, 10 op/s 2024-07-26T12:53:22.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:53:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:53:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:23 smithi076 ceph-mon[35401]: pgmap v1434: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 671 KiB/s wr, 10 op/s 2024-07-26T12:53:23.392 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:23 smithi040 ceph-mon[32397]: pgmap v1434: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 671 KiB/s wr, 10 op/s 2024-07-26T12:53:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:23 smithi146 ceph-mon[35807]: pgmap v1434: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 671 KiB/s wr, 10 op/s 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 -- 172.21.15.40:0/1326695549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 msgr2=0x7ff4d810ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 --2- 172.21.15.40:0/1326695549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d810ef80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009ca0 tx=0x7ff4d002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 -- 172.21.15.40:0/1326695549 shutdown_connections 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 --2- 172.21.15.40:0/1326695549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d810ef80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 --2- 172.21.15.40:0/1326695549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4d8107e00 0x7ff4d8108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 --2- 172.21.15.40:0/1326695549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4d81024c0 0x7ff4d81028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 -- 172.21.15.40:0/1326695549 >> 172.21.15.40:0/1326695549 conn(0x7ff4d8079150 msgr2=0x7ff4d8079560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:25.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 -- 172.21.15.40:0/1326695549 shutdown_connections 2024-07-26T12:53:25.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.352+0000 7ff4dee00640 1 -- 172.21.15.40:0/1326695549 wait complete. 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 Processor -- start 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 -- start start 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4d81024c0 0x7ff4d819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4d8107e00 0x7ff4d819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d8112320 con 0x7ff4d8108750 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d81121a0 con 0x7ff4d8107e00 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.354+0000 7ff4dee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d81124a0 con 0x7ff4d81024c0 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.355+0000 7ff4dce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.355+0000 7ff4d7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4d81024c0 0x7ff4d819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.355+0000 7ff4cfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4d8107e00 0x7ff4d819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.355+0000 7ff4dce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d81a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50466/0 (socket says 172.21.15.40:50466) 2024-07-26T12:53:25.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.355+0000 7ff4dce00640 1 -- 172.21.15.40:0/2005733214 learned_addr learned my addr 172.21.15.40:0/2005733214 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.356+0000 7ff4dce00640 1 -- 172.21.15.40:0/2005733214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4d81024c0 msgr2=0x7ff4d819bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.356+0000 7ff4dce00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4d81024c0 0x7ff4d819bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.356+0000 7ff4dce00640 1 -- 172.21.15.40:0/2005733214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4d8107e00 msgr2=0x7ff4d819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.356+0000 7ff4dce00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4d8107e00 0x7ff4d819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.356+0000 7ff4dce00640 1 -- 172.21.15.40:0/2005733214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d81a1f60 con 0x7ff4d8108750 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.356+0000 7ff4dce00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d81a1830 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0005cc0 tx=0x7ff4d0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.357+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0032e00 con 0x7ff4d8108750 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.357+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4d00044d0 con 0x7ff4d8108750 2024-07-26T12:53:25.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.357+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0030b70 con 0x7ff4d8108750 2024-07-26T12:53:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.357+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d81a21f0 con 0x7ff4d8108750 2024-07-26T12:53:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.357+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d81a89b0 con 0x7ff4d8108750 2024-07-26T12:53:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.358+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d8103740 con 0x7ff4d8108750 2024-07-26T12:53:25.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.361+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff4d0030d10 con 0x7ff4d8108750 2024-07-26T12:53:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.362+0000 7ff4d5600640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff4bc0b3bd0 0x7ff4bc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.363+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff4d01051e0 con 0x7ff4d8108750 2024-07-26T12:53:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.363+0000 7ff4d7e00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff4bc0b3bd0 0x7ff4bc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.364+0000 7ff4d7e00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff4bc0b3bd0 0x7ff4bc0b60e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800bbe0 tx=0x7ff4c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.365+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff4d00cc7f0 con 0x7ff4d8108750 2024-07-26T12:53:25.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.612+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4d81028d0 con 0x7ff4d8108750 2024-07-26T12:53:25.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.613+0000 7ff4d5600640 1 -- 172.21.15.40:0/2005733214 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ff4d00cc0f0 con 0x7ff4d8108750 2024-07-26T12:53:25.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:53:25.615 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:53:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:53:25.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff4bc0b3bd0 msgr2=0x7ff4bc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:25.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff4bc0b3bd0 0x7ff4bc0b60e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800bbe0 tx=0x7ff4c800b390 comp rx=0 tx=0).stop 2024-07-26T12:53:25.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 msgr2=0x7ff4d81a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d81a1830 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0005cc0 tx=0x7ff4d0032a10 comp rx=0 tx=0).stop 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 shutdown_connections 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4d8108750 0x7ff4d81a1830 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4d8107e00 0x7ff4d819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff4bc0b3bd0 0x7ff4bc0b60e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 --2- 172.21.15.40:0/2005733214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4d81024c0 0x7ff4d819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.616+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 >> 172.21.15.40:0/2005733214 conn(0x7ff4d8079150 msgr2=0x7ff4d8105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.617+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 shutdown_connections 2024-07-26T12:53:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:25.617+0000 7ff4dee00640 1 -- 172.21.15.40:0/2005733214 wait complete. 2024-07-26T12:53:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:26 smithi040 ceph-mon[32397]: pgmap v1435: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:53:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2005733214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:53:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:26 smithi146 ceph-mon[35807]: pgmap v1435: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:53:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2005733214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:53:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:26 smithi076 ceph-mon[35401]: pgmap v1435: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:53:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2005733214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:53:26.487 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 818101c1 --release --await' 2024-07-26T12:53:26.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 818101c1 --release --await 2024-07-26T12:53:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:53:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:27 smithi076 ceph-mon[35401]: pgmap v1436: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:53:27.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:27 smithi040 ceph-mon[32397]: pgmap v1436: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:53:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:27 smithi146 ceph-mon[35807]: pgmap v1436: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 -- 172.21.15.40:0/937113585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148113c90 msgr2=0x7fb148116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 --2- 172.21.15.40:0/937113585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148113c90 0x7fb148116160 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb140009ca0 tx=0x7fb14002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 -- 172.21.15.40:0/937113585 shutdown_connections 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 --2- 172.21.15.40:0/937113585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148113c90 0x7fb148116160 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 --2- 172.21.15.40:0/937113585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb148075800 0x7fb148075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 --2- 172.21.15.40:0/937113585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148076db0 0x7fb1480751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.275+0000 7fb14ca00640 1 -- 172.21.15.40:0/937113585 >> 172.21.15.40:0/937113585 conn(0x7fb1480fee10 msgr2=0x7fb148101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.276+0000 7fb14ca00640 1 -- 172.21.15.40:0/937113585 shutdown_connections 2024-07-26T12:53:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.276+0000 7fb14ca00640 1 -- 172.21.15.40:0/937113585 wait complete. 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 Processor -- start 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 -- start start 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 0x7fb1481a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb148076db0 0x7fb1481a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148113c90 0x7fb1481a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481197d0 con 0x7fb148075800 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb148119650 con 0x7fb148076db0 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.277+0000 7fb14ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb148119950 con 0x7fb148113c90 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 0x7fb1481a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 0x7fb1481a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50482/0 (socket says 172.21.15.40:50482) 2024-07-26T12:53:29.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 -- 172.21.15.40:0/33520319 learned_addr learned my addr 172.21.15.40:0/33520319 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147e00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148113c90 0x7fb1481a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb13fe00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb148076db0 0x7fb1481a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 -- 172.21.15.40:0/33520319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148113c90 msgr2=0x7fb1481a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148113c90 0x7fb1481a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 -- 172.21.15.40:0/33520319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb148076db0 msgr2=0x7fb1481a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb148076db0 0x7fb1481a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.278+0000 7fb147400640 1 -- 172.21.15.40:0/33520319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1481a6050 con 0x7fb148075800 2024-07-26T12:53:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.279+0000 7fb147400640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 0x7fb1481a01a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c890 tx=0x7fb13800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.279+0000 7fb144c00640 1 -- 172.21.15.40:0/33520319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138004220 con 0x7fb148075800 2024-07-26T12:53:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.279+0000 7fb144c00640 1 -- 172.21.15.40:0/33520319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb138007e40 con 0x7fb148075800 2024-07-26T12:53:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.279+0000 7fb144c00640 1 -- 172.21.15.40:0/33520319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138004a00 con 0x7fb148075800 2024-07-26T12:53:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.279+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1481a6340 con 0x7fb148075800 2024-07-26T12:53:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.279+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1481acb60 con 0x7fb148075800 2024-07-26T12:53:29.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.284+0000 7fb154bd0740 1 Processor -- start 2024-07-26T12:53:29.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.284+0000 7fb154bd0740 1 -- start start 2024-07-26T12:53:29.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d35d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d35d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d35dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb154bd0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e87d2d3f50 con 0x55e87cf8f660 2024-07-26T12:53:29.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb154bd0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e87d2c3450 con 0x55e87cf97840 2024-07-26T12:53:29.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb154bd0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e87d2c7490 con 0x55e87cfb8520 2024-07-26T12:53:29.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb144c00640 1 -- 172.21.15.40:0/33520319 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb1380079b0 con 0x7fb148075800 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d35dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb147e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d35d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d35dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:46218/0 (socket says 172.21.15.40:46218) 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb13fe00640 1 -- 172.21.15.40:0/4022856721 learned_addr learned my addr 172.21.15.40:0/4022856721 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.285+0000 7fb147400640 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d35d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.286+0000 7fb147400640 1 -- 172.21.15.40:0/4022856721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 msgr2=0x55e87d35d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.286+0000 7fb147400640 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d35d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.286+0000 7fb147400640 1 -- 172.21.15.40:0/4022856721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 msgr2=0x55e87d35dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.286+0000 7fb147400640 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d35dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.286+0000 7fb147400640 1 -- 172.21.15.40:0/4022856721 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87d023b00 con 0x55e87cf8f660 2024-07-26T12:53:29.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.287+0000 7fb147400640 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d35d6e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb1380e1490 tx=0x7fb1380eb610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b094044bc8fee449 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:29.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.287+0000 7fb137e00640 1 -- 172.21.15.40:0/4022856721 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1380f3020 con 0x55e87cf8f660 2024-07-26T12:53:29.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.287+0000 7fb137e00640 1 -- 172.21.15.40:0/4022856721 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1380ebe10 con 0x55e87cf8f660 2024-07-26T12:53:29.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.287+0000 7fb137e00640 1 -- 172.21.15.40:0/4022856721 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1380ee7c0 con 0x55e87cf8f660 2024-07-26T12:53:29.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.287+0000 7fb144c00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1280b3c00 0x7fb1280b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb144c00640 1 -- 172.21.15.40:0/33520319 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1380e3a30 con 0x7fb148075800 2024-07-26T12:53:29.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb147e00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1280b3c00 0x7fb1280b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 -- 172.21.15.40:0/4022856721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 msgr2=0x55e87d35d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d35d6e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb1380e1490 tx=0x7fb1380eb610 comp rx=0 tx=0).stop 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 -- 172.21.15.40:0/4022856721 shutdown_connections 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d35dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d35d6e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 --2- 172.21.15.40:0/4022856721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d35d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.288+0000 7fb154bd0740 1 -- 172.21.15.40:0/4022856721 >> 172.21.15.40:0/4022856721 conn(0x55e87cfac910 msgr2=0x55e87d35b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:29.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.289+0000 7fb154bd0740 1 -- 172.21.15.40:0/4022856721 shutdown_connections 2024-07-26T12:53:29.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.289+0000 7fb154bd0740 1 -- 172.21.15.40:0/4022856721 wait complete. 2024-07-26T12:53:29.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.289+0000 7fb147e00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1280b3c00 0x7fb1280b6110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb1400094e0 tx=0x7fb140009380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:29.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.289+0000 7fb154bd0740 1 -- start start 2024-07-26T12:53:29.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 Processor -- start 2024-07-26T12:53:29.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cf8f660 0x55e87d3687e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d368d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cfb8520 0x55e87d369280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e87d126bb0 con 0x55e87cf97840 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e87d25f930 con 0x55e87cfb8520 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e87d36b9d0 con 0x55e87cf8f660 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.290+0000 7fb154bd0740 10 client.0 _ll_register_callbacks cb 0x55e87cfcfd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d368d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d368d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50510/0 (socket says 172.21.15.40:50510) 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 -- 172.21.15.40:0/3850950585 learned_addr learned my addr 172.21.15.40:0/3850950585 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb147400640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cf8f660 0x55e87d3687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb147e00640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cfb8520 0x55e87d369280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 -- 172.21.15.40:0/3850950585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cf8f660 msgr2=0x55e87d3687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cf8f660 0x55e87d3687e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 -- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cfb8520 msgr2=0x55e87d369280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cfb8520 0x55e87d369280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb13fe00640 1 -- 172.21.15.40:0/3850950585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e87d09a960 con 0x55e87cf97840 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.291+0000 7fb147400640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cf8f660 0x55e87d3687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb13fe00640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d368d20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb13000cef0 tx=0x7fb1300039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3fa20cc652f257 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb134c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb134c00640 1 -- 172.21.15.40:0/3850950585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130011a50 con 0x55e87cf97840 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb134c00640 1 -- 172.21.15.40:0/3850950585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb130011bf0 con 0x55e87cf97840 2024-07-26T12:53:29.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1380ebe10 con 0x55e87cf97840 2024-07-26T12:53:29.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb134c00640 1 -- 172.21.15.40:0/3850950585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb130011df0 con 0x55e87cf97840 2024-07-26T12:53:29.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb154bd0740 10 client.16653 fetch_fsmap learned FSMap version 35 2024-07-26T12:53:29.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.292+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e87d3776e0 con 0x55e87cf97840 2024-07-26T12:53:29.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb134c00640 1 -- 172.21.15.40:0/3850950585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1380ebe10 con 0x55e87cf97840 2024-07-26T12:53:29.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb134c00640 1 -- 172.21.15.40:0/3850950585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb130018070 con 0x55e87cf97840 2024-07-26T12:53:29.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb154bd0740 10 client.16653 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb154bd0740 10 client.16653 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb154bd0740 20 client.16653 populate_metadata read hostname 'smithi040' 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb154bd0740 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf76ea0 0x55e87d37ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb154bd0740 4 client.16653 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.293+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e87d2d5ea0 con 0x55e87cf76ea0 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.294+0000 7fb147400640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf76ea0 0x55e87d37ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.295+0000 7fb147400640 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf76ea0 0x55e87d37ac50 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aba298b6d128457f server_cookie=c215b371351c093c in_seq=0 out_seq=0 2024-07-26T12:53:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.295+0000 7fb134c00640 10 client.16653 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:29.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.297+0000 7fb134c00640 1 -- 172.21.15.40:0/3850950585 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e87d2d5ea0 con 0x55e87cf76ea0 2024-07-26T12:53:29.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.297+0000 7fb134c00640 10 client.16653 handle_command_reply: tid=0 2024-07-26T12:53:29.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.297+0000 7fb154bd0740 1 client.16653 shutdown 2024-07-26T12:53:29.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.297+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 msgr2=0x55e87d368d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.297+0000 7fb154bd0740 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d368d20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb13000cef0 tx=0x7fb1300039c0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 shutdown_connections 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cfb8520 0x55e87d369280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf76ea0 0x55e87d37ac50 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d368d20 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 --2- 172.21.15.40:0/3850950585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cf8f660 0x55e87d3687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 >> 172.21.15.40:0/3850950585 conn(0x55e87cfac910 msgr2=0x55e87d360330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb134c00640 0 client.16653 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 shutdown_connections 2024-07-26T12:53:29.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 1 -- 172.21.15.40:0/3850950585 wait complete. 2024-07-26T12:53:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.298+0000 7fb154bd0740 20 client.16653 trim_cache size 0 max 16384 2024-07-26T12:53:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.317+0000 7fb154bd0740 1 Processor -- start 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 -- start start 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf8f660 0x55e87d363cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d380410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d380950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481b5130 con 0x55e87cf97840 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481b6c70 con 0x55e87cf8f660 2024-07-26T12:53:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.318+0000 7fb154bd0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481b5800 con 0x55e87cfb8520 2024-07-26T12:53:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d380410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d380410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50524/0 (socket says 172.21.15.40:50524) 2024-07-26T12:53:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 -- 172.21.15.40:0/1006767876 learned_addr learned my addr 172.21.15.40:0/1006767876 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb147400640 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf8f660 0x55e87d363cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb147e00640 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d380950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 -- 172.21.15.40:0/1006767876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 msgr2=0x55e87d380950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d380950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 -- 172.21.15.40:0/1006767876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf8f660 msgr2=0x55e87d363cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf8f660 0x55e87d363cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb13fe00640 1 -- 172.21.15.40:0/1006767876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87d3695f0 con 0x55e87cf97840 2024-07-26T12:53:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.319+0000 7fb147400640 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf8f660 0x55e87d363cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:53:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.320+0000 7fb13fe00640 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d380410 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb1300249f0 tx=0x7fb130024a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f954fdba106b57a7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.320+0000 7fb137400640 1 -- 172.21.15.40:0/1006767876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130011230 con 0x55e87cf97840 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.320+0000 7fb137400640 1 -- 172.21.15.40:0/1006767876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb130011850 con 0x55e87cf97840 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.320+0000 7fb137400640 1 -- 172.21.15.40:0/1006767876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130005460 con 0x55e87cf97840 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 -- 172.21.15.40:0/1006767876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 msgr2=0x55e87d380410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d380410 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb1300249f0 tx=0x7fb130024a20 comp rx=0 tx=0).stop 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 -- 172.21.15.40:0/1006767876 shutdown_connections 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d380950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf97840 0x55e87d380410 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 --2- 172.21.15.40:0/1006767876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf8f660 0x55e87d363cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 -- 172.21.15.40:0/1006767876 >> 172.21.15.40:0/1006767876 conn(0x55e87cfac910 msgr2=0x55e87d36a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:29.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 -- 172.21.15.40:0/1006767876 shutdown_connections 2024-07-26T12:53:29.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.321+0000 7fb154bd0740 1 -- 172.21.15.40:0/1006767876 wait complete. 2024-07-26T12:53:29.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.322+0000 7fb154bd0740 1 -- start start 2024-07-26T12:53:29.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.322+0000 7fb154bd0740 1 Processor -- start 2024-07-26T12:53:29.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d36cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d36cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d36d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481b65a0 con 0x55e87cf8f660 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481b5ed0 con 0x55e87cf97840 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481b30f0 con 0x55e87cfb8520 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb154bd0740 10 client.0 _ll_register_callbacks cb 0x7fb1300040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb147400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d36cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb147400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d36cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50530/0 (socket says 172.21.15.40:50530) 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.323+0000 7fb147400640 1 -- 172.21.15.40:0/888061007 learned_addr learned my addr 172.21.15.40:0/888061007 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb13fe00640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d36cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147e00640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d36d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147400640 1 -- 172.21.15.40:0/888061007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 msgr2=0x55e87d36d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147400640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d36d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147400640 1 -- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 msgr2=0x55e87d36cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:53:29.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147400640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d36cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147400640 1 -- 172.21.15.40:0/888061007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e87d3e23e0 con 0x55e87cf8f660 2024-07-26T12:53:29.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147e00640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d36d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb147400640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d36cab0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb1380a69c0 tx=0x7fb1380e9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d09e5181518326f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb134c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb134c00640 1 -- 172.21.15.40:0/888061007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13801d070 con 0x55e87cf8f660 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb130011850 con 0x55e87cf8f660 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.324+0000 7fb134c00640 1 -- 172.21.15.40:0/888061007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1380043c0 con 0x55e87cf8f660 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb134c00640 1 -- 172.21.15.40:0/888061007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb1380f3040 con 0x55e87cf8f660 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 10 client.16659 fetch_fsmap learned FSMap version 35 2024-07-26T12:53:29.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e87d3e3630 con 0x55e87cf8f660 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb134c00640 1 -- 172.21.15.40:0/888061007 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb130011850 con 0x55e87cf8f660 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb134c00640 1 -- 172.21.15.40:0/888061007 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb138069ce0 con 0x55e87cf8f660 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 10 client.16659 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 10 client.16659 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 20 client.16659 populate_metadata read hostname 'smithi040' 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf4c250 0x55e87d3e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 4 client.16659 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "818101c1", "release": true, "await": true}] 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.325+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "818101c1", "release": true, "await": true}) -- 0x55e87d35fa50 con 0x55e87cf4c250 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.326+0000 7fb13fe00640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf4c250 0x55e87d3e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:53:29.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.327+0000 7fb13fe00640 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf4c250 0x55e87d3e59b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3d1c7d133e7713c server_cookie=b4f92eb6d2f1ecb9 in_seq=0 out_seq=0 2024-07-26T12:53:29.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.327+0000 7fb134c00640 10 client.16659 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb134c00640 1 -- 172.21.15.40:0/888061007 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55e87d35fa50 con 0x55e87cf4c250 2024-07-26T12:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb134c00640 10 client.16659 handle_command_reply: tid=0 2024-07-26T12:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb154bd0740 1 client.16659 shutdown 2024-07-26T12:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 msgr2=0x55e87d36cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb154bd0740 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d36cab0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb1380a69c0 tx=0x7fb1380e9fb0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 shutdown_connections 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb154bd0740 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e87cfb8520 0x55e87d36d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.381+0000 7fb154bd0740 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e87cf97840 0x55e87d36cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb154bd0740 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e87cf4c250 0x55e87d3e59b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb154bd0740 1 --2- 172.21.15.40:0/888061007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e87cf8f660 0x55e87d36cab0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 >> 172.21.15.40:0/888061007 conn(0x55e87cfac910 msgr2=0x55e87d36a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb134c00640 0 client.16659 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 shutdown_connections 2024-07-26T12:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb154bd0740 1 -- 172.21.15.40:0/888061007 wait complete. 2024-07-26T12:53:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.382+0000 7fb154bd0740 20 client.16659 trim_cache size 0 max 16384 2024-07-26T12:53:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:53:29.384 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:53:29.384 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:53:29.384 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 100, 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "818101c1": { 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 100, 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:53:29.385 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:53:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:53:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1280b3c00 msgr2=0x7fb1280b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1280b3c00 0x7fb1280b6110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb1400094e0 tx=0x7fb140009380 comp rx=0 tx=0).stop 2024-07-26T12:53:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 msgr2=0x7fb1481a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:53:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 0x7fb1481a01a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c890 tx=0x7fb13800cd50 comp rx=0 tx=0).stop 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 shutdown_connections 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1280b3c00 0x7fb1280b6110 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148113c90 0x7fb1481a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb148076db0 0x7fb1481a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 --2- 172.21.15.40:0/33520319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb148075800 0x7fb1481a01a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.384+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 >> 172.21.15.40:0/33520319 conn(0x7fb1480fee10 msgr2=0x7fb14810fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.385+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 shutdown_connections 2024-07-26T12:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:53:29.385+0000 7fb14ca00640 1 -- 172.21.15.40:0/33520319 wait complete. 2024-07-26T12:53:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:30 smithi146 ceph-mon[35807]: pgmap v1437: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:53:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:30 smithi076 ceph-mon[35401]: pgmap v1437: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:53:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:30 smithi040 ceph-mon[32397]: pgmap v1437: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:53:30.558 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '818101c1', total seconds elapsed: 34.4 2024-07-26T12:53:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:31 smithi076 ceph-mon[35401]: pgmap v1438: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:53:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:31 smithi040 ceph-mon[32397]: pgmap v1438: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:53:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:31 smithi146 ceph-mon[35807]: pgmap v1438: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:53:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:33 smithi040 ceph-mon[32397]: pgmap v1439: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-07-26T12:53:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:33 smithi146 ceph-mon[35807]: pgmap v1439: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-07-26T12:53:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:33 smithi076 ceph-mon[35401]: pgmap v1439: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-07-26T12:53:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:36 smithi146 ceph-mon[35807]: pgmap v1440: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 694 KiB/s wr, 10 op/s 2024-07-26T12:53:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:36 smithi076 ceph-mon[35401]: pgmap v1440: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 694 KiB/s wr, 10 op/s 2024-07-26T12:53:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:36 smithi040 ceph-mon[32397]: pgmap v1440: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 694 KiB/s wr, 10 op/s 2024-07-26T12:53:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:37 smithi040 ceph-mon[32397]: pgmap v1441: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T12:53:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:37 smithi146 ceph-mon[35807]: pgmap v1441: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T12:53:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:37 smithi076 ceph-mon[35401]: pgmap v1441: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T12:53:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:39 smithi040 ceph-mon[32397]: pgmap v1442: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-07-26T12:53:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:39 smithi146 ceph-mon[35807]: pgmap v1442: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-07-26T12:53:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:39 smithi076 ceph-mon[35401]: pgmap v1442: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 12 op/s 2024-07-26T12:53:41.227 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:41 smithi040 ceph-mon[32397]: pgmap v1443: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:53:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:41 smithi146 ceph-mon[35807]: pgmap v1443: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:53:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:41 smithi076 ceph-mon[35401]: pgmap v1443: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:53:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:43 smithi040 ceph-mon[32397]: pgmap v1444: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:53:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:43 smithi146 ceph-mon[35807]: pgmap v1444: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:53:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:43 smithi076 ceph-mon[35401]: pgmap v1444: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:53:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:45 smithi040 ceph-mon[32397]: pgmap v1445: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:53:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:45 smithi146 ceph-mon[35807]: pgmap v1445: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:53:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:45 smithi076 ceph-mon[35401]: pgmap v1445: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:53:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:47 smithi040 ceph-mon[32397]: pgmap v1446: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:53:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:47 smithi146 ceph-mon[35807]: pgmap v1446: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:53:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:47 smithi076 ceph-mon[35401]: pgmap v1446: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:53:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:49 smithi040 ceph-mon[32397]: pgmap v1447: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:53:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:49 smithi146 ceph-mon[35807]: pgmap v1447: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:53:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:49 smithi076 ceph-mon[35401]: pgmap v1447: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T12:53:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:51 smithi040 ceph-mon[32397]: pgmap v1448: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:53:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:51 smithi146 ceph-mon[35807]: pgmap v1448: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:53:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:51 smithi076 ceph-mon[35401]: pgmap v1448: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:53:53.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:53 smithi146 ceph-mon[35807]: pgmap v1449: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:53:53.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:53 smithi076 ceph-mon[35401]: pgmap v1449: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:53:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:53 smithi040 ceph-mon[32397]: pgmap v1449: 97 pgs: 97 active+clean; 5.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:53:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:55 smithi040 ceph-mon[32397]: pgmap v1450: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:53:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:55 smithi146 ceph-mon[35807]: pgmap v1450: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:53:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:55 smithi076 ceph-mon[35401]: pgmap v1450: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:53:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:57 smithi040 ceph-mon[32397]: pgmap v1451: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:53:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:57 smithi146 ceph-mon[35807]: pgmap v1451: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:53:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:57 smithi076 ceph-mon[35401]: pgmap v1451: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:53:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:53:59 smithi040 ceph-mon[32397]: pgmap v1452: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:53:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:53:59 smithi146 ceph-mon[35807]: pgmap v1452: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:53:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:53:59 smithi076 ceph-mon[35401]: pgmap v1452: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:01 smithi040 ceph-mon[32397]: pgmap v1453: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:54:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:01 smithi146 ceph-mon[35807]: pgmap v1453: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:54:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:01 smithi076 ceph-mon[35401]: pgmap v1453: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:54:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:54:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:54:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:54:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:54:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:54:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:54:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:03 smithi040 ceph-mon[32397]: pgmap v1454: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:54:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:54:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:54:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:03 smithi146 ceph-mon[35807]: pgmap v1454: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:54:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:54:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:54:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:03 smithi076 ceph-mon[35401]: pgmap v1454: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:05 smithi040 ceph-mon[32397]: pgmap v1455: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:05 smithi146 ceph-mon[35807]: pgmap v1455: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:05 smithi076 ceph-mon[35401]: pgmap v1455: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:07 smithi040 ceph-mon[32397]: pgmap v1456: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:54:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:07 smithi146 ceph-mon[35807]: pgmap v1456: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:54:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:07 smithi076 ceph-mon[35401]: pgmap v1456: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:54:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:09 smithi040 ceph-mon[32397]: pgmap v1457: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:09 smithi146 ceph-mon[35807]: pgmap v1457: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:09 smithi076 ceph-mon[35401]: pgmap v1457: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:11 smithi040 ceph-mon[32397]: pgmap v1458: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:54:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:11 smithi146 ceph-mon[35807]: pgmap v1458: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:54:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:11 smithi076 ceph-mon[35401]: pgmap v1458: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:54:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:13 smithi040 ceph-mon[32397]: pgmap v1459: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:54:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:13 smithi146 ceph-mon[35807]: pgmap v1459: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:54:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:13 smithi076 ceph-mon[35401]: pgmap v1459: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:54:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:15 smithi040 ceph-mon[32397]: pgmap v1460: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:54:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:15 smithi146 ceph-mon[35807]: pgmap v1460: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:54:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:15 smithi076 ceph-mon[35401]: pgmap v1460: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:54:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:17 smithi040 ceph-mon[32397]: pgmap v1461: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:54:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:17 smithi146 ceph-mon[35807]: pgmap v1461: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:54:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:17 smithi076 ceph-mon[35401]: pgmap v1461: 97 pgs: 97 active+clean; 5.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:54:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:19 smithi040 ceph-mon[32397]: pgmap v1462: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:54:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:19 smithi146 ceph-mon[35807]: pgmap v1462: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:54:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:19 smithi076 ceph-mon[35401]: pgmap v1462: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:54:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:21 smithi040 ceph-mon[32397]: pgmap v1463: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:54:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:21 smithi146 ceph-mon[35807]: pgmap v1463: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:54:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:21 smithi076 ceph-mon[35401]: pgmap v1463: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:54:23.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:23 smithi146 ceph-mon[35807]: pgmap v1464: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:54:23.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:23 smithi076 ceph-mon[35401]: pgmap v1464: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:54:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:23 smithi040 ceph-mon[32397]: pgmap v1464: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:54:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:25 smithi040 ceph-mon[32397]: pgmap v1465: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:54:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:25 smithi146 ceph-mon[35807]: pgmap v1465: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:54:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:27 smithi040 ceph-mon[32397]: pgmap v1466: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:54:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:27 smithi146 ceph-mon[35807]: pgmap v1466: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:54:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:25 smithi076 ceph-mon[35401]: pgmap v1465: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:54:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:27 smithi076 ceph-mon[35401]: pgmap v1466: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:54:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:29 smithi040 ceph-mon[32397]: pgmap v1467: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:54:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:29 smithi146 ceph-mon[35807]: pgmap v1467: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:54:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:29 smithi076 ceph-mon[35401]: pgmap v1467: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:54:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:31 smithi040 ceph-mon[32397]: pgmap v1468: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:54:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:31 smithi146 ceph-mon[35807]: pgmap v1468: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:54:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:31 smithi076 ceph-mon[35401]: pgmap v1468: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:54:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:33 smithi040 ceph-mon[32397]: pgmap v1469: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:54:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:33 smithi146 ceph-mon[35807]: pgmap v1469: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:54:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:33 smithi076 ceph-mon[35401]: pgmap v1469: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:54:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:35 smithi040 ceph-mon[32397]: pgmap v1470: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:54:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:35 smithi146 ceph-mon[35807]: pgmap v1470: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:54:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:35 smithi076 ceph-mon[35401]: pgmap v1470: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:54:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:37 smithi040 ceph-mon[32397]: pgmap v1471: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T12:54:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:37 smithi146 ceph-mon[35807]: pgmap v1471: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T12:54:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:37 smithi076 ceph-mon[35401]: pgmap v1471: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T12:54:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:39 smithi040 ceph-mon[32397]: pgmap v1472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:39 smithi146 ceph-mon[35807]: pgmap v1472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:39 smithi076 ceph-mon[35401]: pgmap v1472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:41 smithi040 ceph-mon[32397]: pgmap v1473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:54:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:41 smithi146 ceph-mon[35807]: pgmap v1473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:54:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:41 smithi076 ceph-mon[35401]: pgmap v1473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T12:54:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:43 smithi040 ceph-mon[32397]: pgmap v1474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:54:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:43 smithi146 ceph-mon[35807]: pgmap v1474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:54:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:43 smithi076 ceph-mon[35401]: pgmap v1474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:54:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:45 smithi040 ceph-mon[32397]: pgmap v1475: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:54:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:45 smithi146 ceph-mon[35807]: pgmap v1475: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:54:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:45 smithi076 ceph-mon[35401]: pgmap v1475: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:54:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:47 smithi040 ceph-mon[32397]: pgmap v1476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:54:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:47 smithi146 ceph-mon[35807]: pgmap v1476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:54:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:47 smithi076 ceph-mon[35401]: pgmap v1476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:54:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:49 smithi040 ceph-mon[32397]: pgmap v1477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:54:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:49 smithi146 ceph-mon[35807]: pgmap v1477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:54:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:49 smithi076 ceph-mon[35401]: pgmap v1477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:54:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:51 smithi040 ceph-mon[32397]: pgmap v1478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:54:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:51 smithi146 ceph-mon[35807]: pgmap v1478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:54:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:51 smithi076 ceph-mon[35401]: pgmap v1478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:54:53.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:53 smithi146 ceph-mon[35807]: pgmap v1479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:53.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:53 smithi076 ceph-mon[35401]: pgmap v1479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:53 smithi040 ceph-mon[32397]: pgmap v1479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:54:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:55 smithi040 ceph-mon[32397]: pgmap v1480: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:54:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:55 smithi146 ceph-mon[35807]: pgmap v1480: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:54:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:55 smithi076 ceph-mon[35401]: pgmap v1480: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:54:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:57 smithi040 ceph-mon[32397]: pgmap v1481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:54:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:57 smithi146 ceph-mon[35807]: pgmap v1481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:54:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:57 smithi076 ceph-mon[35401]: pgmap v1481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T12:54:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:54:59 smithi040 ceph-mon[32397]: pgmap v1482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:54:59 smithi146 ceph-mon[35807]: pgmap v1482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:54:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:54:59 smithi076 ceph-mon[35401]: pgmap v1482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:55:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:01 smithi040 ceph-mon[32397]: pgmap v1483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:55:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:01 smithi146 ceph-mon[35807]: pgmap v1483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:55:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:01 smithi076 ceph-mon[35401]: pgmap v1483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:55:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:55:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:55:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:55:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:03 smithi040 ceph-mon[32397]: pgmap v1484: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:55:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:03 smithi146 ceph-mon[35807]: pgmap v1484: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:55:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:03 smithi076 ceph-mon[35401]: pgmap v1484: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:55:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:55:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:55:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:55:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:55:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:55:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:55:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:55:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:55:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:55:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:05 smithi040 ceph-mon[32397]: pgmap v1485: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:55:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:05 smithi146 ceph-mon[35807]: pgmap v1485: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:55:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:05 smithi076 ceph-mon[35401]: pgmap v1485: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:55:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:07 smithi040 ceph-mon[32397]: pgmap v1486: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:55:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:07 smithi146 ceph-mon[35807]: pgmap v1486: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:55:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:07 smithi076 ceph-mon[35401]: pgmap v1486: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T12:55:08.802 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.4 2024-07-26T12:55:08.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:55:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:09 smithi040 ceph-mon[32397]: pgmap v1487: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:55:09.323 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:55:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:09 smithi146 ceph-mon[35807]: pgmap v1487: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:55:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:09 smithi076 ceph-mon[35401]: pgmap v1487: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:55:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:11 smithi040 ceph-mon[32397]: pgmap v1488: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:55:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:11 smithi146 ceph-mon[35807]: pgmap v1488: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:55:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:11 smithi076 ceph-mon[35401]: pgmap v1488: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 -- 172.21.15.40:0/3661444723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724107420 msgr2=0x7fd724107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 --2- 172.21.15.40:0/3661444723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724107420 0x7fd724107900 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009cd0 tx=0x7fd71c02a8e0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 -- 172.21.15.40:0/3661444723 shutdown_connections 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 --2- 172.21.15.40:0/3661444723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724107420 0x7fd724107900 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 --2- 172.21.15.40:0/3661444723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724102930 0x7fd724106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 --2- 172.21.15.40:0/3661444723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd724101fe0 0x7fd7241023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.358+0000 7fd72ac00640 1 -- 172.21.15.40:0/3661444723 >> 172.21.15.40:0/3661444723 conn(0x7fd7240fdcf0 msgr2=0x7fd724100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.359+0000 7fd72ac00640 1 -- 172.21.15.40:0/3661444723 shutdown_connections 2024-07-26T12:55:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.359+0000 7fd72ac00640 1 -- 172.21.15.40:0/3661444723 wait complete. 2024-07-26T12:55:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.360+0000 7fd72ac00640 1 Processor -- start 2024-07-26T12:55:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 -- start start 2024-07-26T12:55:12.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd724101fe0 0x7fd7241a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:12.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 0x7fd7241a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:12.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724107420 0x7fd7241a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:12.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241197e0 con 0x7fd724102930 2024-07-26T12:55:12.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd724119660 con 0x7fd724107420 2024-07-26T12:55:12.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.361+0000 7fd72ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd724119960 con 0x7fd724101fe0 2024-07-26T12:55:12.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 0x7fd7241a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:12.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 0x7fd7241a0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36846/0 (socket says 172.21.15.40:36846) 2024-07-26T12:55:12.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 -- 172.21.15.40:0/2861483167 learned_addr learned my addr 172.21.15.40:0/2861483167 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:12.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd729800640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd724101fe0 0x7fd7241a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:12.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd72a200640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724107420 0x7fd7241a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 -- 172.21.15.40:0/2861483167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd724101fe0 msgr2=0x7fd7241a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd724101fe0 0x7fd7241a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 -- 172.21.15.40:0/2861483167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724107420 msgr2=0x7fd7241a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.362+0000 7fd728e00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724107420 0x7fd7241a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd728e00640 1 -- 172.21.15.40:0/2861483167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7241a6220 con 0x7fd724102930 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd72a200640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724107420 0x7fd7241a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:55:12.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd728e00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 0x7fd7241a0850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d950 tx=0x7fd71000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:12.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710017070 con 0x7fd724102930 2024-07-26T12:55:12.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd710009c30 con 0x7fd724102930 2024-07-26T12:55:12.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7100047a0 con 0x7fd724102930 2024-07-26T12:55:12.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.363+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7241a6510 con 0x7fd724102930 2024-07-26T12:55:12.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.364+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7241acc70 con 0x7fd724102930 2024-07-26T12:55:12.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.365+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd724106e60 con 0x7fd724102930 2024-07-26T12:55:12.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.368+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd710004020 con 0x7fd724102930 2024-07-26T12:55:12.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.371+0000 7fd722000640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd70c0b3c50 0x7fd70c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.371+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd7100e3880 con 0x7fd724102930 2024-07-26T12:55:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.371+0000 7fd729800640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd70c0b3c50 0x7fd70c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:12.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.372+0000 7fd729800640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd70c0b3c50 0x7fd70c0b6160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd718005fd0 tx=0x7fd71800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:12.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.376+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd710020020 con 0x7fd724102930 2024-07-26T12:55:12.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.666+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7241acf30 con 0x7fd724102930 2024-07-26T12:55:12.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.668+0000 7fd722000640 1 -- 172.21.15.40:0/2861483167 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fd7100aae90 con 0x7fd724102930 2024-07-26T12:55:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:55:12.671 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:55:12.671 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:55:12.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.671+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd70c0b3c50 msgr2=0x7fd70c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:12.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.671+0000 7fd72ac00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd70c0b3c50 0x7fd70c0b6160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd718005fd0 tx=0x7fd71800b390 comp rx=0 tx=0).stop 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.671+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 msgr2=0x7fd7241a0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.671+0000 7fd72ac00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 0x7fd7241a0850 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d950 tx=0x7fd71000de10 comp rx=0 tx=0).stop 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.671+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 shutdown_connections 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd724107420 0x7fd7241a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd724102930 0x7fd7241a0850 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd70c0b3c50 0x7fd70c0b6160 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 --2- 172.21.15.40:0/2861483167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd724101fe0 0x7fd7241a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 >> 172.21.15.40:0/2861483167 conn(0x7fd7240fdcf0 msgr2=0x7fd724104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 shutdown_connections 2024-07-26T12:55:12.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:12.672+0000 7fd72ac00640 1 -- 172.21.15.40:0/2861483167 wait complete. 2024-07-26T12:55:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:12 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2861483167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:55:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:12 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2861483167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:55:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:12 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2861483167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:55:13.490 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 151.4 --await-for 45.0' 2024-07-26T12:55:13.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 151.4 --await-for 45.0 2024-07-26T12:55:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:13 smithi040 ceph-mon[32397]: pgmap v1489: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:55:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:55:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:13 smithi146 ceph-mon[35807]: pgmap v1489: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:55:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:13 smithi076 ceph-mon[35401]: pgmap v1489: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:55:15.478 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:15 smithi040 ceph-mon[32397]: pgmap v1490: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:55:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:15 smithi146 ceph-mon[35807]: pgmap v1490: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:55:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:15 smithi076 ceph-mon[35401]: pgmap v1490: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.446+0000 7f1d87e00640 1 -- 172.21.15.40:0/2702754841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88076db0 msgr2=0x7f1d880751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.446+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2702754841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88076db0 0x7f1d880751e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009900 tx=0x7f1d7802a410 comp rx=0 tx=0).stop 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 -- 172.21.15.40:0/2702754841 shutdown_connections 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2702754841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d88113cf0 0x7f1d881161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2702754841 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d88075800 0x7f1d88075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2702754841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88076db0 0x7f1d880751e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 -- 172.21.15.40:0/2702754841 >> 172.21.15.40:0/2702754841 conn(0x7f1d880feeb0 msgr2=0x7f1d88101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 -- 172.21.15.40:0/2702754841 shutdown_connections 2024-07-26T12:55:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.447+0000 7f1d87e00640 1 -- 172.21.15.40:0/2702754841 wait complete. 2024-07-26T12:55:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.449+0000 7f1d87e00640 1 Processor -- start 2024-07-26T12:55:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.449+0000 7f1d87e00640 1 -- start start 2024-07-26T12:55:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.449+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 0x7f1d881a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.449+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d88076db0 0x7f1d881a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.449+0000 7f1d87e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d88113cf0 0x7f1d881a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d87e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1d88119830 con 0x7f1d88075800 2024-07-26T12:55:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d87e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881196b0 con 0x7f1d88076db0 2024-07-26T12:55:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d87e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881199b0 con 0x7f1d88113cf0 2024-07-26T12:55:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d86a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 0x7f1d881a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d86a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 0x7f1d881a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60194/0 (socket says 172.21.15.40:60194) 2024-07-26T12:55:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d86a00640 1 -- 172.21.15.40:0/2536553644 learned_addr learned my addr 172.21.15.40:0/2536553644 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.450+0000 7f1d7e000640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d88076db0 0x7f1d881a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.451+0000 7f1d86a00640 1 -- 172.21.15.40:0/2536553644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d88113cf0 msgr2=0x7f1d881a5b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-26T12:55:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.451+0000 7f1d86a00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d88113cf0 0x7f1d881a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.451+0000 7f1d86a00640 1 -- 172.21.15.40:0/2536553644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d88076db0 msgr2=0x7f1d881a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.451+0000 7f1d86a00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d88076db0 0x7f1d881a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.451+0000 7f1d86a00640 1 -- 172.21.15.40:0/2536553644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d881a6250 con 0x7f1d88075800 2024-07-26T12:55:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.451+0000 7f1d86a00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 0x7f1d881a02e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1d7802a930 tx=0x7f1d78003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.452+0000 7f1d8ca00640 1 -- 172.21.15.40:0/2536553644 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7803f070 con 0x7f1d88075800 2024-07-26T12:55:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.452+0000 7f1d8ca00640 1 -- 172.21.15.40:0/2536553644 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d78003e40 con 0x7f1d88075800 2024-07-26T12:55:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.452+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d881a64e0 con 0x7f1d88075800 2024-07-26T12:55:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.452+0000 7f1d8ca00640 1 -- 172.21.15.40:0/2536553644 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78035030 con 0x7f1d88075800 2024-07-26T12:55:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.452+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d881acca0 con 0x7f1d88075800 2024-07-26T12:55:16.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.456+0000 7f1d94a2a740 1 Processor -- start 2024-07-26T12:55:16.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.456+0000 7f1d94a2a740 1 -- start start 2024-07-26T12:55:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b9816390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b98168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 0x5583b9816e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5583b97e0cf0 con 0x5583b9447980 2024-07-26T12:55:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5583b978bb40 con 0x5583b944fb60 2024-07-26T12:55:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5583b977b040 con 0x5583b9470840 2024-07-26T12:55:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d8ca00640 1 -- 172.21.15.40:0/2536553644 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1d78042070 con 0x7f1d88075800 2024-07-26T12:55:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d87400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b9816390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d7e000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 0x5583b9816e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d7e000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 0x5583b9816e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:36796/0 (socket says 172.21.15.40:36796) 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.457+0000 7f1d7e000640 1 -- 172.21.15.40:0/807471487 learned_addr learned my addr 172.21.15.40:0/807471487 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.458+0000 7f1d86a00640 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b98168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.458+0000 7f1d7e000640 1 -- 172.21.15.40:0/807471487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 msgr2=0x5583b9816390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.458+0000 7f1d7e000640 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b9816390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.458+0000 7f1d7e000640 1 -- 172.21.15.40:0/807471487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 msgr2=0x5583b98168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.458+0000 7f1d7e000640 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b98168d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.458+0000 7f1d7e000640 1 -- 172.21.15.40:0/807471487 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b9702af0 con 0x5583b944fb60 2024-07-26T12:55:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.459+0000 7f1d7e000640 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 0x5583b9816e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000bc40 tx=0x7f1d7000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da6ee857e50a9c0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.459+0000 7f1d77e00640 1 -- 172.21.15.40:0/807471487 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70015070 con 0x5583b944fb60 2024-07-26T12:55:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.460+0000 7f1d77e00640 1 -- 172.21.15.40:0/807471487 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d7001a8f0 con 0x5583b944fb60 2024-07-26T12:55:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.460+0000 7f1d77e00640 1 -- 172.21.15.40:0/807471487 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d700117a0 con 0x5583b944fb60 2024-07-26T12:55:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.460+0000 7f1d8ca00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d6c0b3c40 0x7f1d6c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.460+0000 7f1d8ca00640 1 -- 172.21.15.40:0/2536553644 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d78104470 con 0x7f1d88075800 2024-07-26T12:55:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.460+0000 7f1d87400640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d6c0b3c40 0x7f1d6c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 -- 172.21.15.40:0/807471487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 msgr2=0x5583b9816e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 0x5583b9816e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000bc40 tx=0x7f1d7000f730 comp rx=0 tx=0).stop 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 -- 172.21.15.40:0/807471487 shutdown_connections 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b944fb60 0x5583b9816e10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b98168d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/807471487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b9816390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 -- 172.21.15.40:0/807471487 >> 172.21.15.40:0/807471487 conn(0x5583b9464990 msgr2=0x5583b9814280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 -- 172.21.15.40:0/807471487 shutdown_connections 2024-07-26T12:55:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.461+0000 7f1d94a2a740 1 -- 172.21.15.40:0/807471487 wait complete. 2024-07-26T12:55:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.462+0000 7f1d94a2a740 1 -- start start 2024-07-26T12:55:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.462+0000 7f1d94a2a740 1 Processor -- start 2024-07-26T12:55:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d87400640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d6c0b3c40 0x7f1d6c0b6150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005fd0 tx=0x7f1d800094e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9821c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 0x5583b9822200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b982dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5583b9717500 con 0x5583b944fb60 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5583b977f080 con 0x5583b9447980 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5583b95de7a0 con 0x5583b9470840 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.463+0000 7f1d94a2a740 10 client.0 _ll_register_callbacks cb 0x5583b9773bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 0x5583b9822200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 0x5583b9822200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60200/0 (socket says 172.21.15.40:60200) 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 -- 172.21.15.40:0/194162464 learned_addr learned my addr 172.21.15.40:0/194162464 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d86a00640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9821c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d87400640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b982dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 -- 172.21.15.40:0/194162464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 msgr2=0x5583b982dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b982dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 -- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 msgr2=0x5583b9821c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9821c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d7e000640 1 -- 172.21.15.40:0/194162464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b94eab90 con 0x5583b944fb60 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.464+0000 7f1d87400640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b982dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d7e000640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 0x5583b9822200 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000bc10 tx=0x7f1d7000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c70f87f07eca0f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d74c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d74c00640 1 -- 172.21.15.40:0/194162464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70028060 con 0x5583b944fb60 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d74c00640 1 -- 172.21.15.40:0/194162464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d7001aaa0 con 0x5583b944fb60 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d7001a8f0 con 0x5583b944fb60 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d74c00640 1 -- 172.21.15.40:0/194162464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1d70015070 con 0x5583b944fb60 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.465+0000 7f1d94a2a740 10 client.16677 fetch_fsmap learned FSMap version 35 2024-07-26T12:55:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5583b98308f0 con 0x5583b944fb60 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d74c00640 1 -- 172.21.15.40:0/194162464 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d7001a8f0 con 0x5583b944fb60 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d74c00640 1 -- 172.21.15.40:0/194162464 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1d7002d070 con 0x5583b944fb60 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 10 client.16677 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 10 client.16677 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 20 client.16677 populate_metadata read hostname 'smithi040' 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b942f1c0 0x5583b9833d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 4 client.16677 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:55:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.466+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583b978da90 con 0x5583b942f1c0 2024-07-26T12:55:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.467+0000 7f1d86a00640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b942f1c0 0x5583b9833d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.468+0000 7f1d86a00640 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b942f1c0 0x5583b9833d00 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2202fd5d5cbce4c server_cookie=e309d42ba86d5218 in_seq=0 out_seq=0 2024-07-26T12:55:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.468+0000 7f1d74c00640 10 client.16677 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.471+0000 7f1d74c00640 1 -- 172.21.15.40:0/194162464 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583b978da90 con 0x5583b942f1c0 2024-07-26T12:55:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.471+0000 7f1d74c00640 10 client.16677 handle_command_reply: tid=0 2024-07-26T12:55:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.471+0000 7f1d94a2a740 1 client.16677 shutdown 2024-07-26T12:55:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 msgr2=0x5583b9822200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 0x5583b9822200 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000bc10 tx=0x7f1d7000bf40 comp rx=0 tx=0).stop 2024-07-26T12:55:16.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 shutdown_connections 2024-07-26T12:55:16.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b9470840 0x5583b982dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b942f1c0 0x5583b9833d00 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b944fb60 0x5583b9822200 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/194162464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9821c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 >> 172.21.15.40:0/194162464 conn(0x5583b9464990 msgr2=0x5583b9819520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d74c00640 0 client.16677 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.472+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 shutdown_connections 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.473+0000 7f1d94a2a740 1 -- 172.21.15.40:0/194162464 wait complete. 2024-07-26T12:55:16.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.473+0000 7f1d94a2a740 20 client.16677 trim_cache size 0 max 16384 2024-07-26T12:55:16.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 Processor -- start 2024-07-26T12:55:16.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 -- start start 2024-07-26T12:55:16.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9823870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b982dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 0x5583b982e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881b52b0 con 0x5583b9470840 2024-07-26T12:55:16.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881b6df0 con 0x5583b9447980 2024-07-26T12:55:16.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.497+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881b5980 con 0x5583b944fb60 2024-07-26T12:55:16.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.498+0000 7f1d87400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 0x5583b982e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.498+0000 7f1d87400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 0x5583b982e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60206/0 (socket says 172.21.15.40:60206) 2024-07-26T12:55:16.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.498+0000 7f1d87400640 1 -- 172.21.15.40:0/3463565394 learned_addr learned my addr 172.21.15.40:0/3463565394 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:16.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.498+0000 7f1d86a00640 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9823870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.498+0000 7f1d7e000640 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b982dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d87400640 1 -- 172.21.15.40:0/3463565394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 msgr2=0x5583b982dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d87400640 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b982dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d87400640 1 -- 172.21.15.40:0/3463565394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 msgr2=0x5583b9823870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d87400640 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9823870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d87400640 1 -- 172.21.15.40:0/3463565394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b9822f00 con 0x5583b9470840 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d87400640 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 0x5583b982e1f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009fd0 tx=0x7f1d80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec2609b5ba1edd7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:16.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.499+0000 7f1d77400640 1 -- 172.21.15.40:0/3463565394 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d80028670 con 0x5583b9470840 2024-07-26T12:55:16.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.500+0000 7f1d77400640 1 -- 172.21.15.40:0/3463565394 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d80023070 con 0x5583b9470840 2024-07-26T12:55:16.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.500+0000 7f1d77400640 1 -- 172.21.15.40:0/3463565394 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8001fb00 con 0x5583b9470840 2024-07-26T12:55:16.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 -- 172.21.15.40:0/3463565394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 msgr2=0x5583b982e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 0x5583b982e1f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009fd0 tx=0x7f1d80014000 comp rx=0 tx=0).stop 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 -- 172.21.15.40:0/3463565394 shutdown_connections 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9470840 0x5583b982e1f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b982dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/3463565394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9447980 0x5583b9823870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 -- 172.21.15.40:0/3463565394 >> 172.21.15.40:0/3463565394 conn(0x5583b9464990 msgr2=0x5583b9823160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 -- 172.21.15.40:0/3463565394 shutdown_connections 2024-07-26T12:55:16.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.501+0000 7f1d94a2a740 1 -- 172.21.15.40:0/3463565394 wait complete. 2024-07-26T12:55:16.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.502+0000 7f1d94a2a740 1 -- start start 2024-07-26T12:55:16.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.502+0000 7f1d94a2a740 1 Processor -- start 2024-07-26T12:55:16.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b9834d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b9835280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9470840 0x5583b98357c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881b6720 con 0x5583b9447980 2024-07-26T12:55:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881b6050 con 0x5583b9470840 2024-07-26T12:55:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881b3270 con 0x5583b944fb60 2024-07-26T12:55:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d94a2a740 10 client.0 _ll_register_callbacks cb 0x7f1d78107d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:55:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d86a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b9834d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d86a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b9834d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60222/0 (socket says 172.21.15.40:60222) 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d86a00640 1 -- 172.21.15.40:0/2025732646 learned_addr learned my addr 172.21.15.40:0/2025732646 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d7e000640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b9835280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.503+0000 7f1d87400640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9470840 0x5583b98357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d86a00640 1 -- 172.21.15.40:0/2025732646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 msgr2=0x5583b9835280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d86a00640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b9835280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d86a00640 1 -- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9470840 msgr2=0x5583b98357c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d86a00640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9470840 0x5583b98357c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d86a00640 1 -- 172.21.15.40:0/2025732646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b989b380 con 0x5583b9447980 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d87400640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9470840 0x5583b98357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d86a00640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b9834d40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1d780cb080 tx=0x7f1d7802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63269e2e6c1cf13e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d74c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d74c00640 1 -- 172.21.15.40:0/2025732646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78049040 con 0x5583b9447980 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d74c00640 1 -- 172.21.15.40:0/2025732646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d78031400 con 0x5583b9447980 2024-07-26T12:55:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.504+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d80023070 con 0x5583b9447980 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d74c00640 1 -- 172.21.15.40:0/2025732646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1d780caaf0 con 0x5583b9447980 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d94a2a740 10 client.16683 fetch_fsmap learned FSMap version 35 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5583b989c640 con 0x5583b9447980 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d74c00640 1 -- 172.21.15.40:0/2025732646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d80023070 con 0x5583b9447980 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d74c00640 1 -- 172.21.15.40:0/2025732646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1d781040b0 con 0x5583b9447980 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d94a2a740 10 client.16683 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:55:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d94a2a740 10 client.16683 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d94a2a740 20 client.16683 populate_metadata read hostname 'smithi040' 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.505+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b9404570 0x5583b989ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.506+0000 7f1d94a2a740 4 client.16683 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.4, "await_for": 45.0}] 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.506+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.4, "await_for": 45.0}) -- 0x5583b9789530 con 0x5583b9404570 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.506+0000 7f1d7e000640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b9404570 0x5583b989ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.507+0000 7f1d7e000640 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b9404570 0x5583b989ee70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841bcf79eb3778ac server_cookie=879f3525ac3960c in_seq=0 out_seq=0 2024-07-26T12:55:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.507+0000 7f1d74c00640 10 client.16683 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:16.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d74c00640 1 -- 172.21.15.40:0/2025732646 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5583b9789530 con 0x5583b9404570 2024-07-26T12:55:16.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d74c00640 10 client.16683 handle_command_reply: tid=0 2024-07-26T12:55:16.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 client.16683 shutdown 2024-07-26T12:55:16.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 msgr2=0x5583b9834d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b9834d40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1d780cb080 tx=0x7f1d7802a410 comp rx=0 tx=0).stop 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 shutdown_connections 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b9470840 0x5583b98357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5583b944fb60 0x5583b9835280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5583b9404570 0x5583b989ee70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 --2- 172.21.15.40:0/2025732646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5583b9447980 0x5583b9834d40 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.804+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 >> 172.21.15.40:0/2025732646 conn(0x5583b9464990 msgr2=0x5583b9819490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.805+0000 7f1d74c00640 0 client.16683 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.805+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 shutdown_connections 2024-07-26T12:55:16.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.805+0000 7f1d94a2a740 1 -- 172.21.15.40:0/2025732646 wait complete. 2024-07-26T12:55:16.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.805+0000 7f1d94a2a740 20 client.16683 trim_cache size 0 max 16384 2024-07-26T12:55:16.808 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 102, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "904eeec8": { 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 102, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 151.4, 2024-07-26T12:55:16.809 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:16.810 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d6c0b3c40 msgr2=0x7f1d6c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d6c0b3c40 0x7f1d6c0b6150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005fd0 tx=0x7f1d800094e0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 msgr2=0x7f1d881a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 0x7f1d881a02e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1d7802a930 tx=0x7f1d78003c20 comp rx=0 tx=0).stop 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 shutdown_connections 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1d6c0b3c40 0x7f1d6c0b6150 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d88113cf0 0x7f1d881a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d88076db0 0x7f1d881a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 --2- 172.21.15.40:0/2536553644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d88075800 0x7f1d881a02e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:16.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 >> 172.21.15.40:0/2536553644 conn(0x7f1d880feeb0 msgr2=0x7f1d8810fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:16.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 shutdown_connections 2024-07-26T12:55:16.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:16.807+0000 7f1d87e00640 1 -- 172.21.15.40:0/2536553644 wait complete. 2024-07-26T12:55:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:17 smithi040 ceph-mon[32397]: pgmap v1491: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:55:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:17 smithi146 ceph-mon[35807]: pgmap v1491: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:55:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:17 smithi076 ceph-mon[35401]: pgmap v1491: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:55:17.663 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '904eeec8', quiesce took 8.9 seconds. Will release after: 22.5 2024-07-26T12:55:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:19 smithi040 ceph-mon[32397]: pgmap v1492: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T12:55:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:19 smithi146 ceph-mon[35807]: pgmap v1492: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T12:55:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:19 smithi076 ceph-mon[35401]: pgmap v1492: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T12:55:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:21 smithi040 ceph-mon[32397]: pgmap v1493: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:55:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:21 smithi146 ceph-mon[35807]: pgmap v1493: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:55:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:21 smithi076 ceph-mon[35401]: pgmap v1493: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:55:23.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:23 smithi146 ceph-mon[35807]: pgmap v1494: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T12:55:23.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:23 smithi076 ceph-mon[35401]: pgmap v1494: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T12:55:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:23 smithi040 ceph-mon[32397]: pgmap v1494: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T12:55:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:25 smithi040 ceph-mon[32397]: pgmap v1495: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-07-26T12:55:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:25 smithi146 ceph-mon[35807]: pgmap v1495: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-07-26T12:55:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:25 smithi076 ceph-mon[35401]: pgmap v1495: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-07-26T12:55:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:27 smithi040 ceph-mon[32397]: pgmap v1496: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-07-26T12:55:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:27 smithi146 ceph-mon[35807]: pgmap v1496: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-07-26T12:55:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:27 smithi076 ceph-mon[35401]: pgmap v1496: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-07-26T12:55:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:29 smithi040 ceph-mon[32397]: pgmap v1497: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:55:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:29 smithi146 ceph-mon[35807]: pgmap v1497: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:55:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:29 smithi076 ceph-mon[35401]: pgmap v1497: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T12:55:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:31 smithi040 ceph-mon[32397]: pgmap v1498: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 776 KiB/s wr, 10 op/s 2024-07-26T12:55:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:31 smithi146 ceph-mon[35807]: pgmap v1498: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 776 KiB/s wr, 10 op/s 2024-07-26T12:55:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:31 smithi076 ceph-mon[35401]: pgmap v1498: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 776 KiB/s wr, 10 op/s 2024-07-26T12:55:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:33 smithi040 ceph-mon[32397]: pgmap v1499: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 435 KiB/s wr, 10 op/s 2024-07-26T12:55:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:33 smithi146 ceph-mon[35807]: pgmap v1499: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 435 KiB/s wr, 10 op/s 2024-07-26T12:55:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:33 smithi076 ceph-mon[35401]: pgmap v1499: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 435 KiB/s wr, 10 op/s 2024-07-26T12:55:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:35 smithi040 ceph-mon[32397]: pgmap v1500: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:55:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:35 smithi146 ceph-mon[35807]: pgmap v1500: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:55:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:35 smithi076 ceph-mon[35401]: pgmap v1500: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T12:55:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:37 smithi040 ceph-mon[32397]: pgmap v1501: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T12:55:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:37 smithi146 ceph-mon[35807]: pgmap v1501: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T12:55:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:37 smithi076 ceph-mon[35401]: pgmap v1501: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-07-26T12:55:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:39 smithi040 ceph-mon[32397]: pgmap v1502: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:55:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:39 smithi146 ceph-mon[35807]: pgmap v1502: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:55:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:39 smithi076 ceph-mon[35401]: pgmap v1502: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T12:55:40.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:55:40.627 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:55:41.390 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:41 smithi040 ceph-mon[32397]: pgmap v1503: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:55:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:41 smithi146 ceph-mon[35807]: pgmap v1503: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:55:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:41 smithi076 ceph-mon[35401]: pgmap v1503: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 -- 172.21.15.40:0/2437652101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 msgr2=0x7fdb7c0751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 --2- 172.21.15.40:0/2437652101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c0751e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009900 tx=0x7fdb6c02a410 comp rx=0 tx=0).stop 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 -- 172.21.15.40:0/2437652101 shutdown_connections 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 --2- 172.21.15.40:0/2437652101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c113e60 0x7fdb7c116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 --2- 172.21.15.40:0/2437652101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c075800 0x7fdb7c075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 --2- 172.21.15.40:0/2437652101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c0751e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 -- 172.21.15.40:0/2437652101 >> 172.21.15.40:0/2437652101 conn(0x7fdb7c07b280 msgr2=0x7fdb7c07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 -- 172.21.15.40:0/2437652101 shutdown_connections 2024-07-26T12:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.329+0000 7fdb82800640 1 -- 172.21.15.40:0/2437652101 wait complete. 2024-07-26T12:55:43.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.330+0000 7fdb82800640 1 Processor -- start 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.330+0000 7fdb82800640 1 -- start start 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb82800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c075800 0x7fdb7c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb82800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb82800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c113e60 0x7fdb7c1a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb82800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c119a00 con 0x7fdb7c076db0 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb82800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c119880 con 0x7fdb7c113e60 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb82800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c119b80 con 0x7fdb7c075800 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c1a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43458/0 (socket says 172.21.15.40:43458) 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.331+0000 7fdb7aa00640 1 -- 172.21.15.40:0/3954429757 learned_addr learned my addr 172.21.15.40:0/3954429757 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7b400640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c075800 0x7fdb7c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7be00640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c113e60 0x7fdb7c1a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7aa00640 1 -- 172.21.15.40:0/3954429757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c075800 msgr2=0x7fdb7c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7aa00640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c075800 0x7fdb7c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7aa00640 1 -- 172.21.15.40:0/3954429757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c113e60 msgr2=0x7fdb7c1a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7aa00640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c113e60 0x7fdb7c1a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7aa00640 1 -- 172.21.15.40:0/3954429757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c1a6380 con 0x7fdb7c076db0 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7b400640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c075800 0x7fdb7c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7be00640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c113e60 0x7fdb7c1a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb7aa00640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c1a09b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800e9c0 tx=0x7fdb6800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800cd80 con 0x7fdb7c076db0 2024-07-26T12:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.332+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb680054b0 con 0x7fdb7c076db0 2024-07-26T12:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.333+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68010430 con 0x7fdb7c076db0 2024-07-26T12:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.333+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c1a6670 con 0x7fdb7c076db0 2024-07-26T12:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.333+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c1acdd0 con 0x7fdb7c076db0 2024-07-26T12:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.334+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c075c10 con 0x7fdb7c076db0 2024-07-26T12:55:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.337+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdb68004f20 con 0x7fdb7c076db0 2024-07-26T12:55:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.338+0000 7fdb73e00640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdb600b3c50 0x7fdb600b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.339+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdb680e45e0 con 0x7fdb7c076db0 2024-07-26T12:55:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.339+0000 7fdb7b400640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdb600b3c50 0x7fdb600b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.340+0000 7fdb7b400640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdb600b3c50 0x7fdb600b6160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c005ab0 tx=0x7fdb6c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:43.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.340+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdb680abbf0 con 0x7fdb7c076db0 2024-07-26T12:55:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:43 smithi040 ceph-mon[32397]: pgmap v1504: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:55:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:43 smithi146 ceph-mon[35807]: pgmap v1504: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:55:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:43 smithi076 ceph-mon[35401]: pgmap v1504: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:55:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.584+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb7c1a1540 con 0x7fdb7c076db0 2024-07-26T12:55:43.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.587+0000 7fdb73e00640 1 -- 172.21.15.40:0/3954429757 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fdb680ab4f0 con 0x7fdb7c076db0 2024-07-26T12:55:43.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:55:43.590 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:55:43.590 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdb600b3c50 msgr2=0x7fdb600b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdb600b3c50 0x7fdb600b6160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c005ab0 tx=0x7fdb6c005fd0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 msgr2=0x7fdb7c1a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c1a09b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800e9c0 tx=0x7fdb6800ee80 comp rx=0 tx=0).stop 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 shutdown_connections 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb7c113e60 0x7fdb7c1a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb7c076db0 0x7fdb7c1a09b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdb600b3c50 0x7fdb600b6160 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 --2- 172.21.15.40:0/3954429757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb7c075800 0x7fdb7c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:43.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.590+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 >> 172.21.15.40:0/3954429757 conn(0x7fdb7c07b280 msgr2=0x7fdb7c112b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:43.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.591+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 shutdown_connections 2024-07-26T12:55:43.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:43.591+0000 7fdb82800640 1 -- 172.21.15.40:0/3954429757 wait complete. 2024-07-26T12:55:44.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3954429757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:55:44.533 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 904eeec8 --release --await' 2024-07-26T12:55:44.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 904eeec8 --release --await 2024-07-26T12:55:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3954429757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:55:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3954429757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:55:45.028 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:55:45.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:45 smithi040 ceph-mon[32397]: pgmap v1505: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:55:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:45 smithi146 ceph-mon[35807]: pgmap v1505: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:55:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:45 smithi076 ceph-mon[35401]: pgmap v1505: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:55:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:47 smithi040 ceph-mon[32397]: pgmap v1506: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:55:47.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 -- 172.21.15.40:0/2879738983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c10f920 msgr2=0x7fcf6c111d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 --2- 172.21.15.40:0/2879738983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c10f920 0x7fcf6c111d60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009ca0 tx=0x7fcf6402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 -- 172.21.15.40:0/2879738983 shutdown_connections 2024-07-26T12:55:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 --2- 172.21.15.40:0/2879738983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c10f920 0x7fcf6c111d60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 --2- 172.21.15.40:0/2879738983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf6c075b30 0x7fcf6c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 --2- 172.21.15.40:0/2879738983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c0751e0 0x7fcf6c0755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 -- 172.21.15.40:0/2879738983 >> 172.21.15.40:0/2879738983 conn(0x7fcf6c0fee10 msgr2=0x7fcf6c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:47.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 -- 172.21.15.40:0/2879738983 shutdown_connections 2024-07-26T12:55:47.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.305+0000 7fcf6b200640 1 -- 172.21.15.40:0/2879738983 wait complete. 2024-07-26T12:55:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.306+0000 7fcf6b200640 1 Processor -- start 2024-07-26T12:55:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 -- start start 2024-07-26T12:55:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf6c0751e0 0x7fcf6c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 0x7fcf6c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c10f920 0x7fcf6c1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1153c0 con 0x7fcf6c075b30 2024-07-26T12:55:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c115240 con 0x7fcf6c0751e0 2024-07-26T12:55:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf6b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c115540 con 0x7fcf6c10f920 2024-07-26T12:55:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 0x7fcf6c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 0x7fcf6c19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43472/0 (socket says 172.21.15.40:43472) 2024-07-26T12:55:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.307+0000 7fcf63e00640 1 -- 172.21.15.40:0/91203069 learned_addr learned my addr 172.21.15.40:0/91203069 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf6a800640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c10f920 0x7fcf6c1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf69e00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf6c0751e0 0x7fcf6c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf63e00640 1 -- 172.21.15.40:0/91203069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c10f920 msgr2=0x7fcf6c1a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf63e00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c10f920 0x7fcf6c1a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf63e00640 1 -- 172.21.15.40:0/91203069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf6c0751e0 msgr2=0x7fcf6c19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf63e00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf6c0751e0 0x7fcf6c19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf63e00640 1 -- 172.21.15.40:0/91203069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c1a1d00 con 0x7fcf6c075b30 2024-07-26T12:55:47.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.308+0000 7fcf63e00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 0x7fcf6c19c330 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400d770 tx=0x7fcf5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:47.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.309+0000 7fcf62a00640 1 -- 172.21.15.40:0/91203069 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54017070 con 0x7fcf6c075b30 2024-07-26T12:55:47.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.309+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6c1a1ff0 con 0x7fcf6c075b30 2024-07-26T12:55:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.309+0000 7fcf62a00640 1 -- 172.21.15.40:0/91203069 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf54009c30 con 0x7fcf6c075b30 2024-07-26T12:55:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.309+0000 7fcf62a00640 1 -- 172.21.15.40:0/91203069 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54003c50 con 0x7fcf6c075b30 2024-07-26T12:55:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.309+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6c1a8750 con 0x7fcf6c075b30 2024-07-26T12:55:47.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.312+0000 7fcf776ca740 1 Processor -- start 2024-07-26T12:55:47.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.312+0000 7fcf776ca740 1 -- start start 2024-07-26T12:55:47.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf62a00640 1 -- 172.21.15.40:0/91203069 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcf54003df0 con 0x7fcf6c075b30 2024-07-26T12:55:47.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x55560fff91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc2b660 0x55560fff96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc33840 0x55560fff9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf776ca740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55560ff6ff50 con 0x55560fc54520 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf776ca740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55560ff5f450 con 0x55560fc2b660 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf776ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55560ff63490 con 0x55560fc33840 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x55560fff91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x55560fff91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43482/0 (socket says 172.21.15.40:43482) 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.313+0000 7fcf6a800640 1 -- 172.21.15.40:0/3019175497 learned_addr learned my addr 172.21.15.40:0/3019175497 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf69e00640 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc2b660 0x55560fff96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf63e00640 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc33840 0x55560fff9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf6a800640 1 -- 172.21.15.40:0/3019175497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc33840 msgr2=0x55560fff9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf6a800640 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc33840 0x55560fff9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf6a800640 1 -- 172.21.15.40:0/3019175497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc2b660 msgr2=0x55560fff96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf6a800640 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc2b660 0x55560fff96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf6a800640 1 -- 172.21.15.40:0/3019175497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55560fcbfb00 con 0x55560fc54520 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf69e00640 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc2b660 0x55560fff96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.314+0000 7fcf6a800640 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x55560fff91a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcf64005cc0 tx=0x7fcf64009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e463d3ab9a2fae7b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.315+0000 7fcf5b000640 1 -- 172.21.15.40:0/3019175497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64031750 con 0x55560fc54520 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.315+0000 7fcf5b000640 1 -- 172.21.15.40:0/3019175497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf64036040 con 0x55560fc54520 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.315+0000 7fcf5b000640 1 -- 172.21.15.40:0/3019175497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64004240 con 0x55560fc54520 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.315+0000 7fcf62a00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf500b3bd0 0x7fcf500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.315+0000 7fcf62a00640 1 -- 172.21.15.40:0/91203069 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf540e3700 con 0x7fcf6c075b30 2024-07-26T12:55:47.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.315+0000 7fcf69e00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf500b3bd0 0x7fcf500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 -- 172.21.15.40:0/3019175497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 msgr2=0x55560fff91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x55560fff91a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcf64005cc0 tx=0x7fcf64009a20 comp rx=0 tx=0).stop 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 -- 172.21.15.40:0/3019175497 shutdown_connections 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc33840 0x55560fff9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc2b660 0x55560fff96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3019175497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x55560fff91a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 -- 172.21.15.40:0/3019175497 >> 172.21.15.40:0/3019175497 conn(0x55560fc48910 msgr2=0x55560fff7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 -- 172.21.15.40:0/3019175497 shutdown_connections 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf69e00640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf500b3bd0 0x7fcf500b60e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55560fff7e20 tx=0x7fcf5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.316+0000 7fcf776ca740 1 -- 172.21.15.40:0/3019175497 wait complete. 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.317+0000 7fcf776ca740 1 -- start start 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.317+0000 7fcf776ca740 1 Processor -- start 2024-07-26T12:55:47.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x555610004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x5556100052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55560fdc2bb0 con 0x55560fc54520 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55560fefb930 con 0x55560fc33840 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555610007920 con 0x55560fc2b660 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf776ca740 10 client.0 _ll_register_callbacks cb 0x55560fc6bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x5556100052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf6a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x5556100052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43494/0 (socket says 172.21.15.40:43494) 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.318+0000 7fcf6a800640 1 -- 172.21.15.40:0/2015979037 learned_addr learned my addr 172.21.15.40:0/2015979037 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf63e00640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf69e00640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x555610004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf6a800640 1 -- 172.21.15.40:0/2015979037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 msgr2=0x555610004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf6a800640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x555610004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf6a800640 1 -- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 msgr2=0x555610004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf6a800640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf6a800640 1 -- 172.21.15.40:0/2015979037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55560fd36960 con 0x55560fc54520 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf69e00640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x555610004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf6a800640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x5556100052c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402a900 tx=0x7fcf64009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746a2da07c0c118d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.319+0000 7fcf4f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf4f400640 1 -- 172.21.15.40:0/2015979037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64052020 con 0x55560fc54520 2024-07-26T12:55:47.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf4f400640 1 -- 172.21.15.40:0/2015979037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf64031750 con 0x55560fc54520 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf64036040 con 0x55560fc54520 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf4f400640 1 -- 172.21.15.40:0/2015979037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcf6404a040 con 0x55560fc54520 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf776ca740 10 client.16701 fetch_fsmap learned FSMap version 35 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5556100135f0 con 0x55560fc54520 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.320+0000 7fcf4f400640 1 -- 172.21.15.40:0/2015979037 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf64036040 con 0x55560fc54520 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf4f400640 1 -- 172.21.15.40:0/2015979037 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fcf6404d030 con 0x55560fc54520 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf776ca740 10 client.16701 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf776ca740 10 client.16701 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf776ca740 20 client.16701 populate_metadata read hostname 'smithi040' 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf776ca740 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fc12ea0 0x555610016950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf776ca740 4 client.16701 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:55:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.321+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55560ff71ea0 con 0x55560fc12ea0 2024-07-26T12:55:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.322+0000 7fcf69e00640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fc12ea0 0x555610016950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.323+0000 7fcf69e00640 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fc12ea0 0x555610016950 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb85950a102d17 server_cookie=c53bcf321e53d541 in_seq=0 out_seq=0 2024-07-26T12:55:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.323+0000 7fcf4f400640 10 client.16701 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf4f400640 1 -- 172.21.15.40:0/2015979037 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55560ff71ea0 con 0x55560fc12ea0 2024-07-26T12:55:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf4f400640 10 client.16701 handle_command_reply: tid=0 2024-07-26T12:55:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 client.16701 shutdown 2024-07-26T12:55:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 msgr2=0x5556100052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x5556100052c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402a900 tx=0x7fcf64009640 comp rx=0 tx=0).stop 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 shutdown_connections 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fc12ea0 0x555610016950 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc54520 0x5556100052c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 --2- 172.21.15.40:0/2015979037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x555610004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 >> 172.21.15.40:0/2015979037 conn(0x55560fc48910 msgr2=0x55560fffc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.325+0000 7fcf4f400640 0 client.16701 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.326+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 shutdown_connections 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.326+0000 7fcf776ca740 1 -- 172.21.15.40:0/2015979037 wait complete. 2024-07-26T12:55:47.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.326+0000 7fcf776ca740 20 client.16701 trim_cache size 0 max 16384 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 Processor -- start 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 -- start start 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x5556100066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 0x555610004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc54520 0x55560fff6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1b0dd0 con 0x55560fc33840 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1b2910 con 0x55560fc54520 2024-07-26T12:55:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.345+0000 7fcf776ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1b14a0 con 0x55560fc2b660 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 0x555610004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 0x555610004e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43504/0 (socket says 172.21.15.40:43504) 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 -- 172.21.15.40:0/3176470350 learned_addr learned my addr 172.21.15.40:0/3176470350 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf6a800640 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc54520 0x55560fff6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf69e00640 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x5556100066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 -- 172.21.15.40:0/3176470350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 msgr2=0x5556100066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x5556100066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 -- 172.21.15.40:0/3176470350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc54520 msgr2=0x55560fff6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc54520 0x55560fff6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.346+0000 7fcf63e00640 1 -- 172.21.15.40:0/3176470350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55560fffc000 con 0x55560fc33840 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.347+0000 7fcf63e00640 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 0x555610004e80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcf54003740 tx=0x7fcf540b1f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3a0a7bd027dfdf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.347+0000 7fcf5a600640 1 -- 172.21.15.40:0/3176470350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54020040 con 0x55560fc33840 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.347+0000 7fcf5a600640 1 -- 172.21.15.40:0/3176470350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf540aa610 con 0x55560fc33840 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.347+0000 7fcf5a600640 1 -- 172.21.15.40:0/3176470350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf540e5bc0 con 0x55560fc33840 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 -- 172.21.15.40:0/3176470350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 msgr2=0x555610004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 0x555610004e80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcf54003740 tx=0x7fcf540b1f90 comp rx=0 tx=0).stop 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 -- 172.21.15.40:0/3176470350 shutdown_connections 2024-07-26T12:55:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc54520 0x55560fff6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc33840 0x555610004e80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 --2- 172.21.15.40:0/3176470350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc2b660 0x5556100066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 -- 172.21.15.40:0/3176470350 >> 172.21.15.40:0/3176470350 conn(0x55560fc48910 msgr2=0x555610004770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 -- 172.21.15.40:0/3176470350 shutdown_connections 2024-07-26T12:55:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.348+0000 7fcf776ca740 1 -- 172.21.15.40:0/3176470350 wait complete. 2024-07-26T12:55:47.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.349+0000 7fcf776ca740 1 -- start start 2024-07-26T12:55:47.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.349+0000 7fcf776ca740 1 Processor -- start 2024-07-26T12:55:47.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 0x555610017a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610017f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc54520 0x5556100184d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1b2240 con 0x55560fc2b660 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1b1b70 con 0x55560fc33840 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c1aed90 con 0x55560fc54520 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf776ca740 10 client.0 _ll_register_callbacks cb 0x7fcf64009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf69e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 0x555610017a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf69e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 0x555610017a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43510/0 (socket says 172.21.15.40:43510) 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.350+0000 7fcf69e00640 1 -- 172.21.15.40:0/1498856421 learned_addr learned my addr 172.21.15.40:0/1498856421 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf63e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610017f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf6a800640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc54520 0x5556100184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf69e00640 1 -- 172.21.15.40:0/1498856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc54520 msgr2=0x5556100184d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf69e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc54520 0x5556100184d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf69e00640 1 -- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 msgr2=0x555610017f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:55:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf69e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610017f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf69e00640 1 -- 172.21.15.40:0/1498856421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55561007e0a0 con 0x55560fc2b660 2024-07-26T12:55:47.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf6a800640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc54520 0x5556100184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf63e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610017f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf69e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 0x555610017a50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c020490 tx=0x7fcf5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac002fbfd093487 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.351+0000 7fcf4f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf4f400640 1 -- 172.21.15.40:0/1498856421 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c033680 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf540aa610 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf4f400640 1 -- 172.21.15.40:0/1498856421 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf5c033820 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf4f400640 1 -- 172.21.15.40:0/1498856421 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcf5c033a20 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf776ca740 10 client.16707 fetch_fsmap learned FSMap version 35 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55561007f3d0 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.352+0000 7fcf4f400640 1 -- 172.21.15.40:0/1498856421 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf540aa610 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf4f400640 1 -- 172.21.15.40:0/1498856421 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fcf5c011450 con 0x55560fc2b660 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf776ca740 10 client.16707 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf776ca740 10 client.16707 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:55:47.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf776ca740 20 client.16707 populate_metadata read hostname 'smithi040' 2024-07-26T12:55:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf776ca740 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fbe8250 0x555610081bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:55:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf776ca740 4 client.16707 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "904eeec8", "release": true, "await": true}] 2024-07-26T12:55:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "904eeec8", "release": true, "await": true}) -- 0x55560ff6d940 con 0x55560fbe8250 2024-07-26T12:55:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.353+0000 7fcf63e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fbe8250 0x555610081bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:55:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.354+0000 7fcf63e00640 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fbe8250 0x555610081bc0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b8b7bf476c1a8bc server_cookie=76c1b68c746a6c2c in_seq=0 out_seq=0 2024-07-26T12:55:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.354+0000 7fcf4f400640 10 client.16707 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.425+0000 7fcf4f400640 1 -- 172.21.15.40:0/1498856421 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55560ff6d940 con 0x55560fbe8250 2024-07-26T12:55:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.425+0000 7fcf4f400640 10 client.16707 handle_command_reply: tid=0 2024-07-26T12:55:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.425+0000 7fcf776ca740 1 client.16707 shutdown 2024-07-26T12:55:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 msgr2=0x555610017a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 0x555610017a50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c020490 tx=0x7fcf5c0046c0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 shutdown_connections 2024-07-26T12:55:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55560fc54520 0x5556100184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55560fc33840 0x555610017f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55560fbe8250 0x555610081bc0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 --2- 172.21.15.40:0/1498856421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55560fc2b660 0x555610017a50 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 >> 172.21.15.40:0/1498856421 conn(0x55560fc48910 msgr2=0x555610005110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf4f400640 0 client.16707 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.426+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 shutdown_connections 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.427+0000 7fcf776ca740 1 -- 172.21.15.40:0/1498856421 wait complete. 2024-07-26T12:55:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.427+0000 7fcf776ca740 20 client.16707 trim_cache size 0 max 16384 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 104, 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "904eeec8": { 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 104, 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:55:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 151.4, 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:55:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:55:47.433 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.429+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf500b3bd0 msgr2=0x7fcf500b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.429+0000 7fcf6b200640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf500b3bd0 0x7fcf500b60e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55560fff7e20 tx=0x7fcf5c005f90 comp rx=0 tx=0).stop 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.429+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 msgr2=0x7fcf6c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.429+0000 7fcf6b200640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 0x7fcf6c19c330 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400d770 tx=0x7fcf5400dc30 comp rx=0 tx=0).stop 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 shutdown_connections 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf500b3bd0 0x7fcf500b60e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf6c10f920 0x7fcf6c1a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf6c075b30 0x7fcf6c19c330 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 --2- 172.21.15.40:0/91203069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf6c0751e0 0x7fcf6c19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:55:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 >> 172.21.15.40:0/91203069 conn(0x7fcf6c0fee10 msgr2=0x7fcf6c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:55:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.430+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 shutdown_connections 2024-07-26T12:55:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:55:47.431+0000 7fcf6b200640 1 -- 172.21.15.40:0/91203069 wait complete. 2024-07-26T12:55:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:47 smithi146 ceph-mon[35807]: pgmap v1506: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:55:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:47 smithi076 ceph-mon[35401]: pgmap v1506: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:55:48.476 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '904eeec8', total seconds elapsed: 39.7 2024-07-26T12:55:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:49 smithi040 ceph-mon[32397]: pgmap v1507: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:55:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:49 smithi146 ceph-mon[35807]: pgmap v1507: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:55:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:49 smithi076 ceph-mon[35401]: pgmap v1507: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:55:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:51 smithi040 ceph-mon[32397]: pgmap v1508: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:55:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:51 smithi146 ceph-mon[35807]: pgmap v1508: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:55:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:51 smithi076 ceph-mon[35401]: pgmap v1508: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:55:53.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:53 smithi146 ceph-mon[35807]: pgmap v1509: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 589 KiB/s wr, 10 op/s 2024-07-26T12:55:53.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:53 smithi076 ceph-mon[35401]: pgmap v1509: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 589 KiB/s wr, 10 op/s 2024-07-26T12:55:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:53 smithi040 ceph-mon[32397]: pgmap v1509: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 589 KiB/s wr, 10 op/s 2024-07-26T12:55:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:55 smithi040 ceph-mon[32397]: pgmap v1510: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-07-26T12:55:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:55 smithi146 ceph-mon[35807]: pgmap v1510: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-07-26T12:55:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:55 smithi076 ceph-mon[35401]: pgmap v1510: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 MiB/s wr, 11 op/s 2024-07-26T12:55:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:57 smithi040 ceph-mon[32397]: pgmap v1511: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-07-26T12:55:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:57 smithi146 ceph-mon[35807]: pgmap v1511: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-07-26T12:55:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:57 smithi076 ceph-mon[35401]: pgmap v1511: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 MiB/s wr, 8 op/s 2024-07-26T12:55:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:55:59 smithi040 ceph-mon[32397]: pgmap v1512: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T12:55:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:55:59 smithi146 ceph-mon[35807]: pgmap v1512: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T12:55:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:55:59 smithi076 ceph-mon[35401]: pgmap v1512: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T12:56:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:01 smithi040 ceph-mon[32397]: pgmap v1513: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 11 op/s 2024-07-26T12:56:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:01 smithi146 ceph-mon[35807]: pgmap v1513: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 11 op/s 2024-07-26T12:56:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:01 smithi076 ceph-mon[35401]: pgmap v1513: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 11 op/s 2024-07-26T12:56:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:03 smithi040 ceph-mon[32397]: pgmap v1514: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T12:56:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:03 smithi146 ceph-mon[35807]: pgmap v1514: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T12:56:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:03 smithi076 ceph-mon[35401]: pgmap v1514: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T12:56:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:56:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:56:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:56:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:05 smithi040 ceph-mon[32397]: pgmap v1515: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:05 smithi146 ceph-mon[35807]: pgmap v1515: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:05 smithi076 ceph-mon[35401]: pgmap v1515: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:56:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:56:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:56:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:56:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:56:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:56:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:56:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:56:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:56:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:08 smithi040 ceph-mon[32397]: pgmap v1516: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:56:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:08 smithi146 ceph-mon[35807]: pgmap v1516: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:56:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:08 smithi076 ceph-mon[35401]: pgmap v1516: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:56:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:10 smithi040 ceph-mon[32397]: pgmap v1517: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:10 smithi146 ceph-mon[35807]: pgmap v1517: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:10 smithi076 ceph-mon[35401]: pgmap v1517: 97 pgs: 97 active+clean; 6.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:12 smithi040 ceph-mon[32397]: pgmap v1518: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:56:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:12 smithi146 ceph-mon[35807]: pgmap v1518: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:56:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:12 smithi076 ceph-mon[35401]: pgmap v1518: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:56:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:14 smithi040 ceph-mon[32397]: pgmap v1519: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:14 smithi146 ceph-mon[35807]: pgmap v1519: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:14.621 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:14 smithi076 ceph-mon[35401]: pgmap v1519: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:16 smithi040 ceph-mon[32397]: pgmap v1520: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:16 smithi146 ceph-mon[35807]: pgmap v1520: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:16 smithi076 ceph-mon[35401]: pgmap v1520: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:56:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:18 smithi040 ceph-mon[32397]: pgmap v1521: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:56:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:18 smithi146 ceph-mon[35807]: pgmap v1521: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:56:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:18 smithi076 ceph-mon[35401]: pgmap v1521: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:56:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:20 smithi040 ceph-mon[32397]: pgmap v1522: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:56:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:20 smithi146 ceph-mon[35807]: pgmap v1522: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:56:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:20 smithi076 ceph-mon[35401]: pgmap v1522: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:56:22.465 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:22 smithi040 ceph-mon[32397]: pgmap v1523: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:56:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:22 smithi146 ceph-mon[35807]: pgmap v1523: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:56:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:22 smithi076 ceph-mon[35401]: pgmap v1523: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:56:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:24 smithi040 ceph-mon[32397]: pgmap v1524: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:56:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:24 smithi146 ceph-mon[35807]: pgmap v1524: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:56:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:24 smithi076 ceph-mon[35401]: pgmap v1524: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:56:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:26 smithi146 ceph-mon[35807]: pgmap v1525: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:56:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:26 smithi040 ceph-mon[32397]: pgmap v1525: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:56:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:26 smithi076 ceph-mon[35401]: pgmap v1525: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:56:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:28 smithi040 ceph-mon[32397]: pgmap v1526: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:56:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:28 smithi146 ceph-mon[35807]: pgmap v1526: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:56:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:28 smithi076 ceph-mon[35401]: pgmap v1526: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:56:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:30 smithi040 ceph-mon[32397]: pgmap v1527: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:56:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:30 smithi146 ceph-mon[35807]: pgmap v1527: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:56:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:30 smithi076 ceph-mon[35401]: pgmap v1527: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:56:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:32 smithi146 ceph-mon[35807]: pgmap v1528: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:32 smithi076 ceph-mon[35401]: pgmap v1528: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:32 smithi040 ceph-mon[32397]: pgmap v1528: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:34 smithi146 ceph-mon[35807]: pgmap v1529: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:56:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:34 smithi076 ceph-mon[35401]: pgmap v1529: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:56:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:34 smithi040 ceph-mon[32397]: pgmap v1529: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:56:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:36 smithi146 ceph-mon[35807]: pgmap v1530: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:56:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:36 smithi076 ceph-mon[35401]: pgmap v1530: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:56:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:36 smithi040 ceph-mon[32397]: pgmap v1530: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T12:56:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:38 smithi146 ceph-mon[35807]: pgmap v1531: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:56:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:38 smithi076 ceph-mon[35401]: pgmap v1531: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:56:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:38 smithi040 ceph-mon[32397]: pgmap v1531: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T12:56:40.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:40 smithi040 ceph-mon[32397]: pgmap v1532: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:56:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:40 smithi146 ceph-mon[35807]: pgmap v1532: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:56:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:40 smithi076 ceph-mon[35401]: pgmap v1532: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T12:56:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:42 smithi146 ceph-mon[35807]: pgmap v1533: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:56:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:42 smithi076 ceph-mon[35401]: pgmap v1533: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:56:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:42 smithi040 ceph-mon[32397]: pgmap v1533: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:56:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:44 smithi146 ceph-mon[35807]: pgmap v1534: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:56:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:44 smithi076 ceph-mon[35401]: pgmap v1534: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:56:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:44 smithi040 ceph-mon[32397]: pgmap v1534: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:56:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:46 smithi146 ceph-mon[35807]: pgmap v1535: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:56:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:46 smithi076 ceph-mon[35401]: pgmap v1535: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:56:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:46 smithi040 ceph-mon[32397]: pgmap v1535: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:56:46.791 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T12:56:46.792 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.2 2024-07-26T12:56:46.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:56:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:56:48.539 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:48 smithi040 ceph-mon[32397]: pgmap v1536: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:56:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:48 smithi146 ceph-mon[35807]: pgmap v1536: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:56:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:48 smithi076 ceph-mon[35401]: pgmap v1536: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:56:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 -- 172.21.15.40:0/2665985390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 msgr2=0x7fa734104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 --2- 172.21.15.40:0/2665985390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734104490 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa728009900 tx=0x7fa72802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 -- 172.21.15.40:0/2665985390 shutdown_connections 2024-07-26T12:56:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 --2- 172.21.15.40:0/2665985390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa73410d630 0x7fa73410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 --2- 172.21.15.40:0/2665985390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa734104ab0 0x7fa73410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 --2- 172.21.15.40:0/2665985390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734104490 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 -- 172.21.15.40:0/2665985390 >> 172.21.15.40:0/2665985390 conn(0x7fa7340fdcf0 msgr2=0x7fa734100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 -- 172.21.15.40:0/2665985390 shutdown_connections 2024-07-26T12:56:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.095+0000 7fa73ae00640 1 -- 172.21.15.40:0/2665985390 wait complete. 2024-07-26T12:56:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.096+0000 7fa73ae00640 1 Processor -- start 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.096+0000 7fa73ae00640 1 -- start start 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa73ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa73ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa734104ab0 0x7fa73419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa73ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa73410d630 0x7fa73419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa73ae00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa734113190 con 0x7fa734104080 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa73ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa734113010 con 0x7fa73410d630 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa73ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa734113310 con 0x7fa734104ab0 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa739a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa739a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34376/0 (socket says 172.21.15.40:34376) 2024-07-26T12:56:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.097+0000 7fa739a00640 1 -- 172.21.15.40:0/1193528517 learned_addr learned my addr 172.21.15.40:0/1193528517 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:56:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa739000640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa734104ab0 0x7fa73419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa73a400640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa73410d630 0x7fa73419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa739a00640 1 -- 172.21.15.40:0/1193528517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa734104ab0 msgr2=0x7fa73419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa739a00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa734104ab0 0x7fa73419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa739a00640 1 -- 172.21.15.40:0/1193528517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa73410d630 msgr2=0x7fa73419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa739a00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa73410d630 0x7fa73419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.098+0000 7fa739a00640 1 -- 172.21.15.40:0/1193528517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73419fab0 con 0x7fa734104080 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.099+0000 7fa739a00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734199c00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa728009230 tx=0x7fa728004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.099+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72803f030 con 0x7fa734104080 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.099+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa728003a80 con 0x7fa734104080 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.099+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728035070 con 0x7fa734104080 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.099+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73419fd40 con 0x7fa734104080 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.099+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7341a0270 con 0x7fa734104080 2024-07-26T12:56:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.101+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa734104490 con 0x7fa734104080 2024-07-26T12:56:50.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.103+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa728042030 con 0x7fa734104080 2024-07-26T12:56:50.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.105+0000 7fa732000640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa71c0b3c80 0x7fa71c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:50.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.106+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa728104700 con 0x7fa734104080 2024-07-26T12:56:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.106+0000 7fa739000640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa71c0b3c80 0x7fa71c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.107+0000 7fa739000640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa71c0b3c80 0x7fa71c0b6190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa73410fc00 tx=0x7fa72000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.109+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa7341a0270 con 0x7fa734104080 2024-07-26T12:56:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.363+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa73419ad30 con 0x7fa734104080 2024-07-26T12:56:50.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.365+0000 7fa732000640 1 -- 172.21.15.40:0/1193528517 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fa7280cbd10 con 0x7fa734104080 2024-07-26T12:56:50.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:56:50.367 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:56:50.367 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:56:50.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa71c0b3c80 msgr2=0x7fa71c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:50.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa71c0b3c80 0x7fa71c0b6190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa73410fc00 tx=0x7fa72000a2d0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 msgr2=0x7fa734199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:50.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734199c00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa728009230 tx=0x7fa728004270 comp rx=0 tx=0).stop 2024-07-26T12:56:50.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 shutdown_connections 2024-07-26T12:56:50.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa73410d630 0x7fa73419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa71c0b3c80 0x7fa71c0b6190 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa734104ab0 0x7fa73419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 --2- 172.21.15.40:0/1193528517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa734104080 0x7fa734199c00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:50.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.368+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 >> 172.21.15.40:0/1193528517 conn(0x7fa7340fdcf0 msgr2=0x7fa734107210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:50.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.369+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 shutdown_connections 2024-07-26T12:56:50.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:50.369+0000 7fa73ae00640 1 -- 172.21.15.40:0/1193528517 wait complete. 2024-07-26T12:56:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:50 smithi146 ceph-mon[35807]: pgmap v1537: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:56:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:50 smithi076 ceph-mon[35401]: pgmap v1537: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:56:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:50 smithi040 ceph-mon[32397]: pgmap v1537: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:56:51.269 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 148.2 --await-for 45.0' 2024-07-26T12:56:51.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 148.2 --await-for 45.0 2024-07-26T12:56:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1193528517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:56:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1193528517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:56:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1193528517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:56:51.819 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:56:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:52 smithi146 ceph-mon[35807]: pgmap v1538: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:52 smithi076 ceph-mon[35401]: pgmap v1538: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:52.674 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:52 smithi040 ceph-mon[32397]: pgmap v1538: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:56:54.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 -- 172.21.15.40:0/1316638122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 msgr2=0x7f3b04111e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 --2- 172.21.15.40:0/1316638122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b04111e10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009ca0 tx=0x7f3afc02a950 comp rx=0 tx=0).stop 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 -- 172.21.15.40:0/1316638122 shutdown_connections 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 --2- 172.21.15.40:0/1316638122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b04111e10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 --2- 172.21.15.40:0/1316638122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b04102790 0x7f3b0410f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 --2- 172.21.15.40:0/1316638122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b04101e40 0x7f3b04102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 -- 172.21.15.40:0/1316638122 >> 172.21.15.40:0/1316638122 conn(0x7f3b040fdd60 msgr2=0x7f3b041001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 -- 172.21.15.40:0/1316638122 shutdown_connections 2024-07-26T12:56:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.148+0000 7f3b0a800640 1 -- 172.21.15.40:0/1316638122 wait complete. 2024-07-26T12:56:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.150+0000 7f3b0a800640 1 Processor -- start 2024-07-26T12:56:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.150+0000 7f3b0a800640 1 -- start start 2024-07-26T12:56:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.150+0000 7f3b0a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b04101e40 0x7f3b0419be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.150+0000 7f3b0a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b04102790 0x7f3b0419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.150+0000 7f3b0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b041a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b0a800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041153c0 con 0x7f3b0410f9f0 2024-07-26T12:56:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b0a800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04115240 con 0x7f3b04102790 2024-07-26T12:56:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b0a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04115540 con 0x7f3b04101e40 2024-07-26T12:56:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b09e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b041a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b09e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b041a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44248/0 (socket says 172.21.15.40:44248) 2024-07-26T12:56:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b09e00640 1 -- 172.21.15.40:0/3439869916 learned_addr learned my addr 172.21.15.40:0/3439869916 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:56:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b08a00640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b04102790 0x7f3b0419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.151+0000 7f3b09400640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b04101e40 0x7f3b0419be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.152+0000 7f3b09e00640 1 -- 172.21.15.40:0/3439869916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b04101e40 msgr2=0x7f3b0419be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.152+0000 7f3b09e00640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b04101e40 0x7f3b0419be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.152+0000 7f3b09e00640 1 -- 172.21.15.40:0/3439869916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b04102790 msgr2=0x7f3b0419c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.152+0000 7f3b09e00640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b04102790 0x7f3b0419c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.152+0000 7f3b09e00640 1 -- 172.21.15.40:0/3439869916 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b041a1da0 con 0x7f3b0410f9f0 2024-07-26T12:56:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.152+0000 7f3b09e00640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b041a1670 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009dc0 tx=0x7f3afc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.153+0000 7f3b02000640 1 -- 172.21.15.40:0/3439869916 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc034040 con 0x7f3b0410f9f0 2024-07-26T12:56:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.153+0000 7f3b02000640 1 -- 172.21.15.40:0/3439869916 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3afc030850 con 0x7f3b0410f9f0 2024-07-26T12:56:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.153+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b041a2030 con 0x7f3b0410f9f0 2024-07-26T12:56:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.153+0000 7f3b02000640 1 -- 172.21.15.40:0/3439869916 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0046e0 con 0x7f3b0410f9f0 2024-07-26T12:56:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.153+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b041a87f0 con 0x7f3b0410f9f0 2024-07-26T12:56:54.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.157+0000 7f3b12a64740 1 Processor -- start 2024-07-26T12:56:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.157+0000 7f3b02000640 1 -- 172.21.15.40:0/3439869916 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3afc037020 con 0x7f3b0410f9f0 2024-07-26T12:56:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 -- start start 2024-07-26T12:56:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c03390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c038d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c03e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b8f8bcdcf0 con 0x55b8f883cb60 2024-07-26T12:56:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b8f8b78b40 con 0x55b8f8834980 2024-07-26T12:56:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.158+0000 7f3b12a64740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b8f8b68040 con 0x55b8f885d840 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.159+0000 7f3b08a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c03e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.159+0000 7f3b08a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c03e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44264/0 (socket says 172.21.15.40:44264) 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.159+0000 7f3b08a00640 1 -- 172.21.15.40:0/1707195777 learned_addr learned my addr 172.21.15.40:0/1707195777 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.159+0000 7f3b09400640 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.159+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c03390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b02000640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3aec0b3bc0 0x7f3aec0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b08a00640 1 -- 172.21.15.40:0/1707195777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 msgr2=0x55b8f8c03390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c03390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b08a00640 1 -- 172.21.15.40:0/1707195777 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 msgr2=0x55b8f8c038d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c038d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b08a00640 1 -- 172.21.15.40:0/1707195777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f8aefaf0 con 0x55b8f883cb60 2024-07-26T12:56:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b02000640 1 -- 172.21.15.40:0/3439869916 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3afc104c40 con 0x7f3b0410f9f0 2024-07-26T12:56:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c03e10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3af00126a0 tx=0x7f3af000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edf2d1e209b0e3b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.160+0000 7f3b09e00640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3aec0b3bc0 0x7f3aec0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.161+0000 7f3af6600640 1 -- 172.21.15.40:0/1707195777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0004020 con 0x55b8f883cb60 2024-07-26T12:56:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.161+0000 7f3af6600640 1 -- 172.21.15.40:0/1707195777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3af00041c0 con 0x55b8f883cb60 2024-07-26T12:56:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.161+0000 7f3af6600640 1 -- 172.21.15.40:0/1707195777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af001f670 con 0x55b8f883cb60 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 -- 172.21.15.40:0/1707195777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 msgr2=0x55b8f8c03e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b09e00640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3aec0b3bc0 0x7f3aec0b60d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3afc047040 tx=0x7f3afc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c03e10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3af00126a0 tx=0x7f3af000b650 comp rx=0 tx=0).stop 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 -- 172.21.15.40:0/1707195777 shutdown_connections 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c03e10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1707195777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c03390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 -- 172.21.15.40:0/1707195777 >> 172.21.15.40:0/1707195777 conn(0x55b8f8851990 msgr2=0x55b8f8c01280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 -- 172.21.15.40:0/1707195777 shutdown_connections 2024-07-26T12:56:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.162+0000 7f3b12a64740 1 -- 172.21.15.40:0/1707195777 wait complete. 2024-07-26T12:56:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.163+0000 7f3b12a64740 1 -- start start 2024-07-26T12:56:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.163+0000 7f3b12a64740 1 Processor -- start 2024-07-26T12:56:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f8834980 0x55b8f8c0ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c0f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f885d840 0x55b8f8c1ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b8f8b04500 con 0x55b8f883cb60 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b8f8b6c080 con 0x55b8f885d840 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b8f89cb7a0 con 0x55b8f8834980 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b12a64740 10 client.0 _ll_register_callbacks cb 0x55b8f8b60bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b09400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c0f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b09400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c0f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44276/0 (socket says 172.21.15.40:44276) 2024-07-26T12:56:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.164+0000 7f3b09400640 1 -- 172.21.15.40:0/1805706993 learned_addr learned my addr 172.21.15.40:0/1805706993 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:56:54.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f885d840 0x55b8f8c1ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b09400640 1 -- 172.21.15.40:0/1805706993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f8834980 msgr2=0x55b8f8c0ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b09400640 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f8834980 0x55b8f8c0ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b09400640 1 -- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f885d840 msgr2=0x55b8f8c1ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b09400640 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f885d840 0x55b8f8c1ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b09400640 1 -- 172.21.15.40:0/1805706993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f88d7b90 con 0x55b8f883cb60 2024-07-26T12:56:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3b09400640 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c0f370 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3af800ba10 tx=0x7f3af800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932796a54b8a9ed4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.165+0000 7f3aeaa00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:56:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3aeaa00640 1 -- 172.21.15.40:0/1805706993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8003e80 con 0x55b8f883cb60 2024-07-26T12:56:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3aeaa00640 1 -- 172.21.15.40:0/1805706993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3af8011440 con 0x55b8f883cb60 2024-07-26T12:56:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af00041c0 con 0x55b8f883cb60 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3aeaa00640 1 -- 172.21.15.40:0/1805706993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3af8011640 con 0x55b8f883cb60 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3b12a64740 10 client.16725 fetch_fsmap learned FSMap version 35 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b8f8c1d970 con 0x55b8f883cb60 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.166+0000 7f3aeaa00640 1 -- 172.21.15.40:0/1805706993 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3af00041c0 con 0x55b8f883cb60 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3aeaa00640 1 -- 172.21.15.40:0/1805706993 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3af801b8b0 con 0x55b8f883cb60 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3b12a64740 10 client.16725 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3b12a64740 10 client.16725 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:56:54.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3b12a64740 20 client.16725 populate_metadata read hostname 'smithi040' 2024-07-26T12:56:54.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f881c1c0 0x55b8f8c20e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3b12a64740 4 client.16725 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:56:54.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.167+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8f8b7aa90 con 0x55b8f881c1c0 2024-07-26T12:56:54.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.168+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f881c1c0 0x55b8f8c20e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.169+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f881c1c0 0x55b8f8c20e50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76a1b8e10c90e7f server_cookie=ad085735490b8fc in_seq=0 out_seq=0 2024-07-26T12:56:54.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.169+0000 7f3aeaa00640 10 client.16725 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:56:54.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.171+0000 7f3aeaa00640 1 -- 172.21.15.40:0/1805706993 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8f8b7aa90 con 0x55b8f881c1c0 2024-07-26T12:56:54.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.171+0000 7f3aeaa00640 10 client.16725 handle_command_reply: tid=0 2024-07-26T12:56:54.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.171+0000 7f3b12a64740 1 client.16725 shutdown 2024-07-26T12:56:54.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 msgr2=0x55b8f8c0f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c0f370 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3af800ba10 tx=0x7f3af800bed0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 shutdown_connections 2024-07-26T12:56:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f885d840 0x55b8f8c1ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f881c1c0 0x55b8f8c20e50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c0f370 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1805706993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f8834980 0x55b8f8c0ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 >> 172.21.15.40:0/1805706993 conn(0x55b8f8851990 msgr2=0x55b8f8c06520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:54.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3aeaa00640 0 client.16725 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:56:54.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 shutdown_connections 2024-07-26T12:56:54.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.172+0000 7f3b12a64740 1 -- 172.21.15.40:0/1805706993 wait complete. 2024-07-26T12:56:54.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.173+0000 7f3b12a64740 20 client.16725 trim_cache size 0 max 16384 2024-07-26T12:56:54.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.195+0000 7f3b12a64740 1 Processor -- start 2024-07-26T12:56:54.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 -- start start 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c00200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c10860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041b0da0 con 0x55b8f883cb60 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041b28e0 con 0x55b8f8834980 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b12a64740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041b1470 con 0x55b8f885d840 2024-07-26T12:56:54.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b09400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c10860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b09400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c10860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44278/0 (socket says 172.21.15.40:44278) 2024-07-26T12:56:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.196+0000 7f3b09400640 1 -- 172.21.15.40:0/1507442634 learned_addr learned my addr 172.21.15.40:0/1507442634 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:56:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c00200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b09400640 1 -- 172.21.15.40:0/1507442634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 msgr2=0x55b8f8c1ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b09400640 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b09400640 1 -- 172.21.15.40:0/1507442634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 msgr2=0x55b8f8c00200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b09400640 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c00200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b09400640 1 -- 172.21.15.40:0/1507442634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f8c0fef0 con 0x55b8f883cb60 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b08a00640 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c00200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.197+0000 7f3b09400640 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c10860 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3af8003ac0 tx=0x7f3af800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5168285ad4c39568 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.198+0000 7f3af5c00640 1 -- 172.21.15.40:0/1507442634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800b400 con 0x55b8f883cb60 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.198+0000 7f3af5c00640 1 -- 172.21.15.40:0/1507442634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3af80054d0 con 0x55b8f883cb60 2024-07-26T12:56:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.198+0000 7f3af5c00640 1 -- 172.21.15.40:0/1507442634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af801b6a0 con 0x55b8f883cb60 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 -- 172.21.15.40:0/1507442634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 msgr2=0x55b8f8c10860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c10860 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3af8003ac0 tx=0x7f3af800b710 comp rx=0 tx=0).stop 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 -- 172.21.15.40:0/1507442634 shutdown_connections 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c1ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f883cb60 0x55b8f8c10860 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 --2- 172.21.15.40:0/1507442634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f8834980 0x55b8f8c00200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 -- 172.21.15.40:0/1507442634 >> 172.21.15.40:0/1507442634 conn(0x55b8f8851990 msgr2=0x55b8f8c10150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 -- 172.21.15.40:0/1507442634 shutdown_connections 2024-07-26T12:56:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.199+0000 7f3b12a64740 1 -- 172.21.15.40:0/1507442634 wait complete. 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.200+0000 7f3b12a64740 1 -- start start 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.200+0000 7f3b12a64740 1 Processor -- start 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 0x55b8f8c17480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f883cb60 0x55b8f8c12930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c12fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041b2210 con 0x55b8f8834980 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041b1b40 con 0x55b8f883cb60 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b041aed60 con 0x55b8f885d840 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b12a64740 10 client.0 _ll_register_callbacks cb 0x7f3af80042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b08a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 0x55b8f8c17480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b08a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 0x55b8f8c17480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44280/0 (socket says 172.21.15.40:44280) 2024-07-26T12:56:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b08a00640 1 -- 172.21.15.40:0/3479927717 learned_addr learned my addr 172.21.15.40:0/3479927717 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:56:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.201+0000 7f3b09400640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f883cb60 0x55b8f8c12930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c12fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 -- 172.21.15.40:0/3479927717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 msgr2=0x55b8f8c12fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c12fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 -- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f883cb60 msgr2=0x55b8f8c12930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:56:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f883cb60 0x55b8f8c12930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 -- 172.21.15.40:0/3479927717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f8c13740 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3b08a00640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 0x55b8f8c17480 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006010 tx=0x7f3af001b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd780a89b26390 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3aeaa00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.202+0000 7f3aeaa00640 1 -- 172.21.15.40:0/3479927717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0031040 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af80054d0 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3aeaa00640 1 -- 172.21.15.40:0/3479927717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3af0005450 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3aeaa00640 1 -- 172.21.15.40:0/3479927717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3af0005650 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3b12a64740 10 client.16731 fetch_fsmap learned FSMap version 35 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b8f8c91de0 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3aeaa00640 1 -- 172.21.15.40:0/3479927717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3af80054d0 con 0x55b8f8834980 2024-07-26T12:56:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.203+0000 7f3aeaa00640 1 -- 172.21.15.40:0/3479927717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3af0004860 con 0x55b8f8834980 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b12a64740 10 client.16731 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b12a64740 10 client.16731 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b12a64740 20 client.16731 populate_metadata read hostname 'smithi040' 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b12a64740 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f87f1570 0x55b8f8c943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b12a64740 4 client.16731 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.2, "await_for": 45.0}] 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.2, "await_for": 45.0}) -- 0x55b8f8b76530 con 0x55b8f87f1570 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.204+0000 7f3b09400640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f87f1570 0x55b8f8c943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:56:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.206+0000 7f3b09400640 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f87f1570 0x55b8f8c943e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbbfdf7d74d6a08d server_cookie=4c27cf5de2a05fe3 in_seq=0 out_seq=0 2024-07-26T12:56:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.206+0000 7f3aeaa00640 10 client.16731 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:56:54.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3aeaa00640 1 -- 172.21.15.40:0/3479927717 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55b8f8b76530 con 0x55b8f87f1570 2024-07-26T12:56:54.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3aeaa00640 10 client.16731 handle_command_reply: tid=0 2024-07-26T12:56:54.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 client.16731 shutdown 2024-07-26T12:56:54.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 msgr2=0x55b8f8c17480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 0x55b8f8c17480 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006010 tx=0x7f3af001b040 comp rx=0 tx=0).stop 2024-07-26T12:56:54.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 shutdown_connections 2024-07-26T12:56:54.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b8f885d840 0x55b8f8c12fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b8f883cb60 0x55b8f8c12930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b8f87f1570 0x55b8f8c943e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 --2- 172.21.15.40:0/3479927717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b8f8834980 0x55b8f8c17480 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 >> 172.21.15.40:0/3479927717 conn(0x55b8f8851990 msgr2=0x55b8f8c04d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.491+0000 7f3aeaa00640 0 client.16731 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.492+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 shutdown_connections 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.492+0000 7f3b12a64740 1 -- 172.21.15.40:0/3479927717 wait complete. 2024-07-26T12:56:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.492+0000 7f3b12a64740 20 client.16731 trim_cache size 0 max 16384 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 106, 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "5852e7fe": { 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 106, 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:56:54.495 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.2, 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:56:54.496 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:56:54.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:56:54.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:56:54.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:56:54.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:56:54.497 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3aec0b3bc0 msgr2=0x7f3aec0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3aec0b3bc0 0x7f3aec0b60d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3afc047040 tx=0x7f3afc0095c0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 msgr2=0x7f3b041a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b041a1670 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009dc0 tx=0x7f3afc003f10 comp rx=0 tx=0).stop 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 shutdown_connections 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0410f9f0 0x7f3b041a1670 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3b04102790 0x7f3b0419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3aec0b3bc0 0x7f3aec0b60d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 --2- 172.21.15.40:0/3439869916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b04101e40 0x7f3b0419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 >> 172.21.15.40:0/3439869916 conn(0x7f3b040fdd60 msgr2=0x7f3b04111c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:56:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 shutdown_connections 2024-07-26T12:56:54.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:56:54.493+0000 7f3b0a800640 1 -- 172.21.15.40:0/3439869916 wait complete. 2024-07-26T12:56:54.538 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:54 smithi040 ceph-mon[32397]: pgmap v1539: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:56:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:54 smithi076 ceph-mon[35401]: pgmap v1539: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:56:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:54 smithi146 ceph-mon[35807]: pgmap v1539: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T12:56:55.363 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5852e7fe', quiesce took 8.6 seconds. Will release after: 19.6 2024-07-26T12:56:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:56 smithi076 ceph-mon[35401]: pgmap v1540: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:56:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:56 smithi040 ceph-mon[32397]: pgmap v1540: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:56:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:56 smithi146 ceph-mon[35807]: pgmap v1540: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:56:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:56:58 smithi040 ceph-mon[32397]: pgmap v1541: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:56:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:56:58 smithi146 ceph-mon[35807]: pgmap v1541: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:56:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:56:58 smithi076 ceph-mon[35401]: pgmap v1541: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:57:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:00 smithi040 ceph-mon[32397]: pgmap v1542: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:57:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:00 smithi146 ceph-mon[35807]: pgmap v1542: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:57:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:00 smithi076 ceph-mon[35401]: pgmap v1542: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:57:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:02 smithi040 ceph-mon[32397]: pgmap v1543: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:57:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:02 smithi146 ceph-mon[35807]: pgmap v1543: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:57:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:02 smithi076 ceph-mon[35401]: pgmap v1543: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T12:57:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:04 smithi040 ceph-mon[32397]: pgmap v1544: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.4 MiB/s wr, 11 op/s 2024-07-26T12:57:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:04 smithi146 ceph-mon[35807]: pgmap v1544: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.4 MiB/s wr, 11 op/s 2024-07-26T12:57:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:04 smithi076 ceph-mon[35401]: pgmap v1544: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.4 MiB/s wr, 11 op/s 2024-07-26T12:57:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:06 smithi040 ceph-mon[32397]: pgmap v1545: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:57:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:57:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:06 smithi146 ceph-mon[35807]: pgmap v1545: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:57:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:57:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:06 smithi076 ceph-mon[35401]: pgmap v1545: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T12:57:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:57:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:57:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:57:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:57:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:57:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:57:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:57:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:57:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:57:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:57:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:08 smithi146 ceph-mon[35807]: pgmap v1546: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T12:57:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:08 smithi076 ceph-mon[35401]: pgmap v1546: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T12:57:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:08 smithi040 ceph-mon[32397]: pgmap v1546: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T12:57:11.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:10 smithi040 ceph-mon[32397]: pgmap v1547: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T12:57:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:10 smithi146 ceph-mon[35807]: pgmap v1547: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T12:57:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:10 smithi076 ceph-mon[35401]: pgmap v1547: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T12:57:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:12 smithi146 ceph-mon[35807]: pgmap v1548: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 439 KiB/s wr, 10 op/s 2024-07-26T12:57:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:12 smithi076 ceph-mon[35401]: pgmap v1548: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 439 KiB/s wr, 10 op/s 2024-07-26T12:57:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:12 smithi040 ceph-mon[32397]: pgmap v1548: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 439 KiB/s wr, 10 op/s 2024-07-26T12:57:14.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:57:15.042 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:14 smithi040 ceph-mon[32397]: pgmap v1549: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 342 KiB/s wr, 10 op/s 2024-07-26T12:57:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:14 smithi146 ceph-mon[35807]: pgmap v1549: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 342 KiB/s wr, 10 op/s 2024-07-26T12:57:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:14 smithi076 ceph-mon[35401]: pgmap v1549: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 342 KiB/s wr, 10 op/s 2024-07-26T12:57:15.456 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:57:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:16 smithi146 ceph-mon[35807]: pgmap v1550: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T12:57:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:16 smithi076 ceph-mon[35401]: pgmap v1550: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T12:57:17.155 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:16 smithi040 ceph-mon[32397]: pgmap v1550: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T12:57:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 -- 172.21.15.40:0/3271874583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010ae00 msgr2=0x7f651010b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 --2- 172.21.15.40:0/3271874583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010ae00 0x7f651010b210 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009900 tx=0x7f64f802a490 comp rx=0 tx=0).stop 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 -- 172.21.15.40:0/3271874583 shutdown_connections 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 --2- 172.21.15.40:0/3271874583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f651010b750 0x7f6510117740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 --2- 172.21.15.40:0/3271874583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010ae00 0x7f651010b210 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 --2- 172.21.15.40:0/3271874583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010d7a0 0x7f651010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 -- 172.21.15.40:0/3271874583 >> 172.21.15.40:0/3271874583 conn(0x7f6510074a40 msgr2=0x7f651006eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 -- 172.21.15.40:0/3271874583 shutdown_connections 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.666+0000 7f6515c00640 1 -- 172.21.15.40:0/3271874583 wait complete. 2024-07-26T12:57:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.668+0000 7f6515c00640 1 Processor -- start 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.668+0000 7f6515c00640 1 -- start start 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6515c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010ae00 0x7f65101a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6515c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f651010b750 0x7f65101a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6515c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 0x7f65101aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6515c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f651011aac0 con 0x7f651010d7a0 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6515c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f651011a940 con 0x7f651010ae00 2024-07-26T12:57:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6515c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f651011ac40 con 0x7f651010b750 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f650f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 0x7f65101aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f650f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 0x7f65101aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49606/0 (socket says 172.21.15.40:49606) 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f650f400640 1 -- 172.21.15.40:0/2486348925 learned_addr learned my addr 172.21.15.40:0/2486348925 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f650ea00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010ae00 0x7f65101a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.669+0000 7f6507e00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f651010b750 0x7f65101a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650f400640 1 -- 172.21.15.40:0/2486348925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f651010b750 msgr2=0x7f65101a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:17.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650f400640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f651010b750 0x7f65101a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650f400640 1 -- 172.21.15.40:0/2486348925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010ae00 msgr2=0x7f65101a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650f400640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010ae00 0x7f65101a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650f400640 1 -- 172.21.15.40:0/2486348925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65101aa880 con 0x7f651010d7a0 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650ea00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010ae00 0x7f65101a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f650f400640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 0x7f65101aa150 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f650800cab0 tx=0x7f650800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800ae20 con 0x7f651010d7a0 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65101aab70 con 0x7f651010d7a0 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f650800f8e0 con 0x7f651010d7a0 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.670+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508018990 con 0x7f651010d7a0 2024-07-26T12:57:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.671+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65101b12d0 con 0x7f651010d7a0 2024-07-26T12:57:17.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.672+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651010b210 con 0x7f651010d7a0 2024-07-26T12:57:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.674+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f650800f450 con 0x7f651010d7a0 2024-07-26T12:57:17.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.676+0000 7f6507400640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f64f40b3c50 0x7f64f40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:17.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.676+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65080e4180 con 0x7f651010d7a0 2024-07-26T12:57:17.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.676+0000 7f650ea00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f64f40b3c50 0x7f64f40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:17.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.677+0000 7f650ea00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f64f40b3c50 0x7f64f40b6160 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6500005d90 tx=0x7f6500005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:17.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.678+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6508055600 con 0x7f651010d7a0 2024-07-26T12:57:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.924+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65101a5a40 con 0x7f651010d7a0 2024-07-26T12:57:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.927+0000 7f6507400640 1 -- 172.21.15.40:0/2486348925 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f6508014030 con 0x7f651010d7a0 2024-07-26T12:57:17.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:57:17.928 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:57:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:57:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f64f40b3c50 msgr2=0x7f64f40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f64f40b3c50 0x7f64f40b6160 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6500005d90 tx=0x7f6500005d20 comp rx=0 tx=0).stop 2024-07-26T12:57:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 msgr2=0x7f65101aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 0x7f65101aa150 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f650800cab0 tx=0x7f650800cf70 comp rx=0 tx=0).stop 2024-07-26T12:57:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 shutdown_connections 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f651010d7a0 0x7f65101aa150 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f64f40b3c50 0x7f64f40b6160 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f651010b750 0x7f65101a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 --2- 172.21.15.40:0/2486348925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f651010ae00 0x7f65101a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 >> 172.21.15.40:0/2486348925 conn(0x7f6510074a40 msgr2=0x7f651010a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 shutdown_connections 2024-07-26T12:57:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:17.930+0000 7f6515c00640 1 -- 172.21.15.40:0/2486348925 wait complete. 2024-07-26T12:57:18.662 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 5852e7fe --release --await' 2024-07-26T12:57:18.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 5852e7fe --release --await 2024-07-26T12:57:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:18 smithi040 ceph-mon[32397]: pgmap v1551: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:57:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:18 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2486348925' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:18 smithi146 ceph-mon[35807]: pgmap v1551: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:57:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:18 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2486348925' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:18 smithi076 ceph-mon[35401]: pgmap v1551: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T12:57:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:18 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2486348925' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:57:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:20 smithi040 ceph-mon[32397]: pgmap v1552: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:57:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:20 smithi146 ceph-mon[35807]: pgmap v1552: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:57:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:20 smithi076 ceph-mon[35401]: pgmap v1552: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T12:57:21.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 -- 172.21.15.40:0/459759315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54410f520 msgr2=0x7fe54410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 --2- 172.21.15.40:0/459759315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54410f520 0x7fe54410f930 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe530009900 tx=0x7fe53002a3f0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 -- 172.21.15.40:0/459759315 shutdown_connections 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 --2- 172.21.15.40:0/459759315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 0x7fe5441166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 --2- 172.21.15.40:0/459759315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54410f520 0x7fe54410f930 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 --2- 172.21.15.40:0/459759315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe544109be0 0x7fe544109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 -- 172.21.15.40:0/459759315 >> 172.21.15.40:0/459759315 conn(0x7fe544077b10 msgr2=0x7fe544107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 -- 172.21.15.40:0/459759315 shutdown_connections 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.534+0000 7fe549e00640 1 -- 172.21.15.40:0/459759315 wait complete. 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.536+0000 7fe549e00640 1 Processor -- start 2024-07-26T12:57:21.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.536+0000 7fe549e00640 1 -- start start 2024-07-26T12:57:21.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe549e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 0x7fe5441a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe549e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe54410f520 0x7fe5441a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe549e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 0x7fe5441a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe549e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441199e0 con 0x7fe544109be0 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe549e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe544119860 con 0x7fe54410f520 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe549e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe544119b60 con 0x7fe54410fe70 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe542a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 0x7fe5441a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe542a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 0x7fe5441a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49628/0 (socket says 172.21.15.40:49628) 2024-07-26T12:57:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.537+0000 7fe542a00640 1 -- 172.21.15.40:0/1212718737 learned_addr learned my addr 172.21.15.40:0/1212718737 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:21.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542000640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe54410f520 0x7fe5441a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe543400640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 0x7fe5441a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542a00640 1 -- 172.21.15.40:0/1212718737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 msgr2=0x7fe5441a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542a00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 0x7fe5441a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542a00640 1 -- 172.21.15.40:0/1212718737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe54410f520 msgr2=0x7fe5441a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542a00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe54410f520 0x7fe5441a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542a00640 1 -- 172.21.15.40:0/1212718737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5441a6360 con 0x7fe544109be0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe543400640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 0x7fe5441a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.538+0000 7fe542a00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 0x7fe5441a03f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe53400d950 tx=0x7fe53400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.539+0000 7fe548a00640 1 -- 172.21.15.40:0/1212718737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534017070 con 0x7fe544109be0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.539+0000 7fe548a00640 1 -- 172.21.15.40:0/1212718737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe534009c30 con 0x7fe544109be0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.539+0000 7fe548a00640 1 -- 172.21.15.40:0/1212718737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f620 con 0x7fe544109be0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.539+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5441a6650 con 0x7fe544109be0 2024-07-26T12:57:21.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.539+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5441acdb0 con 0x7fe544109be0 2024-07-26T12:57:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 Processor -- start 2024-07-26T12:57:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 -- start start 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 0x565278968fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe548a00640 1 -- 172.21.15.40:0/1212718737 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe534010460 con 0x7fe544109be0 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x565278969500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785a3840 0x565278969a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5652788dff30 con 0x5652785c4520 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5652788cf430 con 0x56527859b660 2024-07-26T12:57:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.543+0000 7fe550c1b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5652788d3470 con 0x5652785a3840 2024-07-26T12:57:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 0x565278968fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 0x565278968fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49638/0 (socket says 172.21.15.40:49638) 2024-07-26T12:57:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 -- 172.21.15.40:0/3800333811 learned_addr learned my addr 172.21.15.40:0/3800333811 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe542a00640 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x565278969500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe542000640 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785a3840 0x565278969a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 -- 172.21.15.40:0/3800333811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785a3840 msgr2=0x565278969a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785a3840 0x565278969a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 -- 172.21.15.40:0/3800333811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 msgr2=0x565278969500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x565278969500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe543400640 1 -- 172.21.15.40:0/3800333811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56527862fb00 con 0x5652785c4520 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.544+0000 7fe542a00640 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x565278969500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:57:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.545+0000 7fe543400640 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 0x565278968fc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009ea0 tx=0x7fe53c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cd6d7942673906 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.545+0000 7fe52fe00640 1 -- 172.21.15.40:0/3800333811 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c004d20 con 0x5652785c4520 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.545+0000 7fe52fe00640 1 -- 172.21.15.40:0/3800333811 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe53c0054b0 con 0x5652785c4520 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.545+0000 7fe52fe00640 1 -- 172.21.15.40:0/3800333811 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0116e0 con 0x5652785c4520 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.546+0000 7fe548a00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5280b3c50 0x7fe5280b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.546+0000 7fe548a00640 1 -- 172.21.15.40:0/1212718737 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5340e3880 con 0x7fe544109be0 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.546+0000 7fe542a00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5280b3c50 0x7fe5280b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.546+0000 7fe550c1b740 1 -- 172.21.15.40:0/3800333811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 msgr2=0x565278968fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.546+0000 7fe550c1b740 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 0x565278968fc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009ea0 tx=0x7fe53c009f90 comp rx=0 tx=0).stop 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 -- 172.21.15.40:0/3800333811 shutdown_connections 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785a3840 0x565278969a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x565278969500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 --2- 172.21.15.40:0/3800333811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785c4520 0x565278968fc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 -- 172.21.15.40:0/3800333811 >> 172.21.15.40:0/3800333811 conn(0x5652785b8910 msgr2=0x565278966eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:21.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 -- 172.21.15.40:0/3800333811 shutdown_connections 2024-07-26T12:57:21.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe542a00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5280b3c50 0x7fe5280b6160 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe5340aa490 tx=0x7fe534005880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:21.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 -- 172.21.15.40:0/3800333811 wait complete. 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.547+0000 7fe550c1b740 1 -- start start 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 Processor -- start 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56527859b660 0x565278974700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x565278974c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785c4520 0x565278980ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x565278732bb0 con 0x5652785a3840 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56527886b910 con 0x5652785c4520 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5652789777a0 con 0x56527859b660 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.548+0000 7fe550c1b740 10 client.0 _ll_register_callbacks cb 0x5652785dbd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x565278974c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x565278974c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49654/0 (socket says 172.21.15.40:49654) 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 -- 172.21.15.40:0/1426983413 learned_addr learned my addr 172.21.15.40:0/1426983413 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe543400640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56527859b660 0x565278974700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe543400640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785c4520 0x565278980ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 -- 172.21.15.40:0/1426983413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56527859b660 msgr2=0x565278974700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56527859b660 0x565278974700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 -- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785c4520 msgr2=0x565278980ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785c4520 0x565278980ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe542000640 1 -- 172.21.15.40:0/1426983413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652786a6960 con 0x5652785a3840 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.549+0000 7fe543400640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785c4520 0x565278980ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.550+0000 7fe542000640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x565278974c40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe530006010 tx=0x7fe530031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88cd53489d2dce1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.550+0000 7fe52cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.550+0000 7fe52cc00640 1 -- 172.21.15.40:0/1426983413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530035070 con 0x5652785a3840 2024-07-26T12:57:21.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.550+0000 7fe52cc00640 1 -- 172.21.15.40:0/1426983413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe530004040 con 0x5652785a3840 2024-07-26T12:57:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.550+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe53c0054b0 con 0x5652785a3840 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe52cc00640 1 -- 172.21.15.40:0/1426983413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe530004240 con 0x5652785a3840 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 10 client.16749 fetch_fsmap learned FSMap version 35 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x565278983540 con 0x5652785a3840 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe52cc00640 1 -- 172.21.15.40:0/1426983413 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe53c0054b0 con 0x5652785a3840 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe52cc00640 1 -- 172.21.15.40:0/1426983413 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe530004950 con 0x5652785a3840 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 10 client.16749 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 10 client.16749 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 20 client.16749 populate_metadata read hostname 'smithi040' 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278582ea0 0x565278986a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 4 client.16749 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:57:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.551+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652788e1e80 con 0x565278582ea0 2024-07-26T12:57:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.552+0000 7fe543400640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278582ea0 0x565278986a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.553+0000 7fe543400640 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278582ea0 0x565278986a60 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55b4a5e7b71f0b93 server_cookie=843e6ba52b22dfe3 in_seq=0 out_seq=0 2024-07-26T12:57:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.553+0000 7fe52cc00640 10 client.16749 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.555+0000 7fe52cc00640 1 -- 172.21.15.40:0/1426983413 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652788e1e80 con 0x565278582ea0 2024-07-26T12:57:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.555+0000 7fe52cc00640 10 client.16749 handle_command_reply: tid=0 2024-07-26T12:57:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.555+0000 7fe550c1b740 1 client.16749 shutdown 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 msgr2=0x565278974c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x565278974c40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe530006010 tx=0x7fe530031630 comp rx=0 tx=0).stop 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 shutdown_connections 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785c4520 0x565278980ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278582ea0 0x565278986a60 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x565278974c40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 --2- 172.21.15.40:0/1426983413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56527859b660 0x565278974700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 >> 172.21.15.40:0/1426983413 conn(0x5652785b8910 msgr2=0x56527896c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe52cc00640 0 client.16749 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 shutdown_connections 2024-07-26T12:57:21.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 1 -- 172.21.15.40:0/1426983413 wait complete. 2024-07-26T12:57:21.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.556+0000 7fe550c1b740 20 client.16749 trim_cache size 0 max 16384 2024-07-26T12:57:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.575+0000 7fe550c1b740 1 Processor -- start 2024-07-26T12:57:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.575+0000 7fe550c1b740 1 -- start start 2024-07-26T12:57:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 0x56527896a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785a3840 0x565278976330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe550c1b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441b5370 con 0x56527859b660 2024-07-26T12:57:21.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe550c1b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441b6eb0 con 0x5652785a3840 2024-07-26T12:57:21.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe550c1b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441b5a40 con 0x5652785c4520 2024-07-26T12:57:21.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe543400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 0x56527896a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe543400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 0x56527896a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49668/0 (socket says 172.21.15.40:49668) 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe543400640 1 -- 172.21.15.40:0/2748816007 learned_addr learned my addr 172.21.15.40:0/2748816007 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.576+0000 7fe542000640 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785a3840 0x565278976330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe543400640 1 -- 172.21.15.40:0/2748816007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 msgr2=0x5652789808b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe543400640 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe543400640 1 -- 172.21.15.40:0/2748816007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785a3840 msgr2=0x565278976330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe543400640 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785a3840 0x565278976330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe543400640 1 -- 172.21.15.40:0/2748816007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652789677a0 con 0x56527859b660 2024-07-26T12:57:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe543400640 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 0x56527896a9b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe53c002230 tx=0x7fe53c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2392938649dcde85 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe52f400640 1 -- 172.21.15.40:0/2748816007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c02f070 con 0x56527859b660 2024-07-26T12:57:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.577+0000 7fe52f400640 1 -- 172.21.15.40:0/2748816007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe53c0049c0 con 0x56527859b660 2024-07-26T12:57:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.578+0000 7fe52f400640 1 -- 172.21.15.40:0/2748816007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c028650 con 0x56527859b660 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 -- 172.21.15.40:0/2748816007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 msgr2=0x56527896a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 0x56527896a9b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe53c002230 tx=0x7fe53c009f90 comp rx=0 tx=0).stop 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 -- 172.21.15.40:0/2748816007 shutdown_connections 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789808b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5652785a3840 0x565278976330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2748816007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56527859b660 0x56527896a9b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 -- 172.21.15.40:0/2748816007 >> 172.21.15.40:0/2748816007 conn(0x5652785b8910 msgr2=0x565278975c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 -- 172.21.15.40:0/2748816007 shutdown_connections 2024-07-26T12:57:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.579+0000 7fe550c1b740 1 -- 172.21.15.40:0/2748816007 wait complete. 2024-07-26T12:57:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.580+0000 7fe550c1b740 1 -- start start 2024-07-26T12:57:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.580+0000 7fe550c1b740 1 Processor -- start 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x56527897ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x56527897cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441b67e0 con 0x5652785a3840 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441b6110 con 0x56527859b660 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441b3330 con 0x5652785c4520 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe550c1b740 10 client.0 _ll_register_callbacks cb 0x7fe530009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe542000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x56527897cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe542000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x56527897cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49674/0 (socket says 172.21.15.40:49674) 2024-07-26T12:57:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe542000640 1 -- 172.21.15.40:0/2914744648 learned_addr learned my addr 172.21.15.40:0/2914744648 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe543400640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x56527897ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.581+0000 7fe543400640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe542000640 1 -- 172.21.15.40:0/2914744648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 msgr2=0x5652789779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe542000640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789779e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe542000640 1 -- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 msgr2=0x56527897ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe542000640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x56527897ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe542000640 1 -- 172.21.15.40:0/2914744648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56527897d680 con 0x5652785a3840 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe543400640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x56527897ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe542000640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x56527897cf70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe530000c00 tx=0x7fe530032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dc17f37fe0d9d5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe52cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:57:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.582+0000 7fe52cc00640 1 -- 172.21.15.40:0/2914744648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530035040 con 0x5652785a3840 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.583+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe53c0049c0 con 0x5652785a3840 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.583+0000 7fe52cc00640 1 -- 172.21.15.40:0/2914744648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe530004f30 con 0x5652785a3840 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.583+0000 7fe52cc00640 1 -- 172.21.15.40:0/2914744648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe530004ad0 con 0x5652785a3840 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.583+0000 7fe550c1b740 10 client.16755 fetch_fsmap learned FSMap version 35 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.583+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5652789ef820 con 0x5652785a3840 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.583+0000 7fe52cc00640 1 -- 172.21.15.40:0/2914744648 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe53c0049c0 con 0x5652785a3840 2024-07-26T12:57:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe52cc00640 1 -- 172.21.15.40:0/2914744648 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe530003f10 con 0x5652785a3840 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe550c1b740 10 client.16755 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe550c1b740 10 client.16755 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe550c1b740 20 client.16755 populate_metadata read hostname 'smithi040' 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278558250 0x5652789f2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe550c1b740 4 client.16755 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5852e7fe", "release": true, "await": true}] 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5852e7fe", "release": true, "await": true}) -- 0x5652788dd920 con 0x565278558250 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.584+0000 7fe543400640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278558250 0x5652789f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.585+0000 7fe543400640 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278558250 0x5652789f2010 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3af1b03ab73f2b9 server_cookie=ea5d25b8693e135e in_seq=0 out_seq=0 2024-07-26T12:57:21.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.585+0000 7fe52cc00640 10 client.16755 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:21.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.651+0000 7fe52cc00640 1 -- 172.21.15.40:0/2914744648 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5652788dd920 con 0x565278558250 2024-07-26T12:57:21.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.651+0000 7fe52cc00640 10 client.16755 handle_command_reply: tid=0 2024-07-26T12:57:21.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.651+0000 7fe550c1b740 1 client.16755 shutdown 2024-07-26T12:57:21.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.651+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 msgr2=0x56527897cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.651+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x56527897cf70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe530000c00 tx=0x7fe530032fc0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 shutdown_connections 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5652785c4520 0x5652789779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565278558250 0x5652789f2010 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652785a3840 0x56527897cf70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 --2- 172.21.15.40:0/2914744648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56527859b660 0x56527897ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 >> 172.21.15.40:0/2914744648 conn(0x5652785b8910 msgr2=0x56527896a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe52cc00640 0 client.16755 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 shutdown_connections 2024-07-26T12:57:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 1 -- 172.21.15.40:0/2914744648 wait complete. 2024-07-26T12:57:21.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.652+0000 7fe550c1b740 20 client.16755 trim_cache size 0 max 16384 2024-07-26T12:57:21.654 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:57:21.654 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:57:21.654 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 108, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "5852e7fe": { 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 108, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.2, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:57:21.655 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:21.656 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.653+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5280b3c50 msgr2=0x7fe5280b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5280b3c50 0x7fe5280b6160 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe5340aa490 tx=0x7fe534005880 comp rx=0 tx=0).stop 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 msgr2=0x7fe5441a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 0x7fe5441a03f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe53400d950 tx=0x7fe53400de10 comp rx=0 tx=0).stop 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 shutdown_connections 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe5280b3c50 0x7fe5280b6160 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe54410fe70 0x7fe5441a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe54410f520 0x7fe5441a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 --2- 172.21.15.40:0/1212718737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe544109be0 0x7fe5441a03f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.654+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 >> 172.21.15.40:0/1212718737 conn(0x7fe544077b10 msgr2=0x7fe544108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.655+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 shutdown_connections 2024-07-26T12:57:21.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:21.655+0000 7fe549e00640 1 -- 172.21.15.40:0/1212718737 wait complete. 2024-07-26T12:57:22.555 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5852e7fe', total seconds elapsed: 35.8 2024-07-26T12:57:22.556 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.2 2024-07-26T12:57:22.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:57:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:22 smithi146 ceph-mon[35807]: pgmap v1553: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:57:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:22 smithi076 ceph-mon[35401]: pgmap v1553: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:57:23.087 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:57:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:22 smithi040 ceph-mon[32397]: pgmap v1553: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T12:57:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:24 smithi076 ceph-mon[35401]: pgmap v1554: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:57:25.086 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:24 smithi040 ceph-mon[32397]: pgmap v1554: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:57:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:24 smithi146 ceph-mon[35807]: pgmap v1554: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 -- 172.21.15.40:0/1716572853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c041033e0 msgr2=0x7f5c041037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 --2- 172.21.15.40:0/1716572853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c041033e0 0x7f5c041037f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009ca0 tx=0x7f5bf402a8d0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 -- 172.21.15.40:0/1716572853 shutdown_connections 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 --2- 172.21.15.40:0/1716572853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c04109670 0x7f5c0410fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 --2- 172.21.15.40:0/1716572853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c04108d20 0x7f5c04109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 --2- 172.21.15.40:0/1716572853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c041033e0 0x7f5c041037f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.458+0000 7f5c03200640 1 -- 172.21.15.40:0/1716572853 >> 172.21.15.40:0/1716572853 conn(0x7f5c040fee30 msgr2=0x7f5c04101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.459+0000 7f5c03200640 1 -- 172.21.15.40:0/1716572853 shutdown_connections 2024-07-26T12:57:25.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.459+0000 7f5c03200640 1 -- 172.21.15.40:0/1716572853 wait complete. 2024-07-26T12:57:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.460+0000 7f5c03200640 1 Processor -- start 2024-07-26T12:57:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.460+0000 7f5c03200640 1 -- start start 2024-07-26T12:57:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c03200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c041033e0 0x7f5c0419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c03200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 0x7f5c0419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c03200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c04109670 0x7f5c041a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c03200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04113220 con 0x7f5c04108d20 2024-07-26T12:57:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c03200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5c041130a0 con 0x7f5c041033e0 2024-07-26T12:57:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c03200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c041133a0 con 0x7f5c04109670 2024-07-26T12:57:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5bf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 0x7f5c0419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:25.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5bf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 0x7f5c0419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58118/0 (socket says 172.21.15.40:58118) 2024-07-26T12:57:25.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5bf9400640 1 -- 172.21.15.40:0/276339220 learned_addr learned my addr 172.21.15.40:0/276339220 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c01e00640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c041033e0 0x7f5c0419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.461+0000 7f5c02800640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c04109670 0x7f5c041a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bf9400640 1 -- 172.21.15.40:0/276339220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c04109670 msgr2=0x7f5c041a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bf9400640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c04109670 0x7f5c041a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bf9400640 1 -- 172.21.15.40:0/276339220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c041033e0 msgr2=0x7f5c0419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bf9400640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c041033e0 0x7f5c0419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bf9400640 1 -- 172.21.15.40:0/276339220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c041a1d60 con 0x7f5c04108d20 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bf9400640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 0x7f5c0419c450 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5bec006fd0 tx=0x7f5bec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.462+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec011830 con 0x7f5c04108d20 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.463+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bec016070 con 0x7f5c04108d20 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.463+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c041a2050 con 0x7f5c04108d20 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.463+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec010d30 con 0x7f5c04108d20 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.463+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c041a8870 con 0x7f5c04108d20 2024-07-26T12:57:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.465+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c041037f0 con 0x7f5c04108d20 2024-07-26T12:57:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.467+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5bec0119d0 con 0x7f5c04108d20 2024-07-26T12:57:25.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.469+0000 7f5bfb400640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5be80b3c40 0x7f5be80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:25.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.469+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5bec0e3370 con 0x7f5c04108d20 2024-07-26T12:57:25.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.469+0000 7f5c01e00640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5be80b3c40 0x7f5be80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:25.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.471+0000 7f5c01e00640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5be80b3c40 0x7f5be80b6150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009bf0 tx=0x7f5bf4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.474+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5bec0aa980 con 0x7f5c04108d20 2024-07-26T12:57:25.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.748+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c041a8b50 con 0x7f5c04108d20 2024-07-26T12:57:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.749+0000 7f5bfb400640 1 -- 172.21.15.40:0/276339220 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f5bec0aa280 con 0x7f5c04108d20 2024-07-26T12:57:25.750 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:57:25.750 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:57:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.752+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5be80b3c40 msgr2=0x7f5be80b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.752+0000 7f5c03200640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5be80b3c40 0x7f5be80b6150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009bf0 tx=0x7f5bf4000f40 comp rx=0 tx=0).stop 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.752+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 msgr2=0x7f5c0419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.752+0000 7f5c03200640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 0x7f5c0419c450 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5bec006fd0 tx=0x7f5bec00b8e0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 shutdown_connections 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5be80b3c40 0x7f5be80b6150 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c04109670 0x7f5c041a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c04108d20 0x7f5c0419c450 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 --2- 172.21.15.40:0/276339220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c041033e0 0x7f5c0419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 >> 172.21.15.40:0/276339220 conn(0x7f5c040fee30 msgr2=0x7f5c0410e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 shutdown_connections 2024-07-26T12:57:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:25.753+0000 7f5c03200640 1 -- 172.21.15.40:0/276339220 wait complete. 2024-07-26T12:57:26.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/276339220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/276339220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/276339220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:26.718 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 148.2 --await-for 45.0' 2024-07-26T12:57:26.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 148.2 --await-for 45.0 2024-07-26T12:57:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:26 smithi040 ceph-mon[32397]: pgmap v1555: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:57:27.234 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:57:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:26 smithi146 ceph-mon[35807]: pgmap v1555: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:57:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:26 smithi076 ceph-mon[35401]: pgmap v1555: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T12:57:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:28 smithi040 ceph-mon[32397]: pgmap v1556: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 245 KiB/s wr, 8 op/s 2024-07-26T12:57:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:28 smithi146 ceph-mon[35807]: pgmap v1556: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 245 KiB/s wr, 8 op/s 2024-07-26T12:57:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:28 smithi076 ceph-mon[35401]: pgmap v1556: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 245 KiB/s wr, 8 op/s 2024-07-26T12:57:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.647+0000 7f9dc4400640 1 -- 172.21.15.40:0/266121428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc075ab0 msgr2=0x7f9dbc10f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.647+0000 7f9dc4400640 1 --2- 172.21.15.40:0/266121428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc075ab0 0x7f9dbc10f660 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009900 tx=0x7f9da802a410 comp rx=0 tx=0).stop 2024-07-26T12:57:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 -- 172.21.15.40:0/266121428 shutdown_connections 2024-07-26T12:57:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 --2- 172.21.15.40:0/266121428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc111fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 --2- 172.21.15.40:0/266121428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc075ab0 0x7f9dbc10f660 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 --2- 172.21.15.40:0/266121428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9dbc075160 0x7f9dbc075570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 -- 172.21.15.40:0/266121428 >> 172.21.15.40:0/266121428 conn(0x7f9dbc0ff010 msgr2=0x7f9dbc101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 -- 172.21.15.40:0/266121428 shutdown_connections 2024-07-26T12:57:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.648+0000 7f9dc4400640 1 -- 172.21.15.40:0/266121428 wait complete. 2024-07-26T12:57:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.649+0000 7f9dc4400640 1 Processor -- start 2024-07-26T12:57:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 -- start start 2024-07-26T12:57:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc075160 0x7f9dbc19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9dbc075ab0 0x7f9dbc19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc115580 con 0x7f9dbc10fba0 2024-07-26T12:57:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc115400 con 0x7f9dbc075ab0 2024-07-26T12:57:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.650+0000 7f9dc4400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc115700 con 0x7f9dbc075160 2024-07-26T12:57:29.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.651+0000 7f9dc2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.651+0000 7f9dc2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc1a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58124/0 (socket says 172.21.15.40:58124) 2024-07-26T12:57:29.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.651+0000 7f9dc2400640 1 -- 172.21.15.40:0/1125438526 learned_addr learned my addr 172.21.15.40:0/1125438526 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:29.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.651+0000 7f9dc1000640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9dbc075ab0 0x7f9dbc19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.651+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc075160 0x7f9dbc19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc2400640 1 -- 172.21.15.40:0/1125438526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc075160 msgr2=0x7f9dbc19c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc2400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc075160 0x7f9dbc19c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc2400640 1 -- 172.21.15.40:0/1125438526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9dbc075ab0 msgr2=0x7f9dbc19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc2400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9dbc075ab0 0x7f9dbc19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc2400640 1 -- 172.21.15.40:0/1125438526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc1a1fe0 con 0x7f9dbc10fba0 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc075160 0x7f9dbc19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:57:29.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.652+0000 7f9dc2400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc1a18b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9db400eb10 tx=0x7f9db400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:29.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.653+0000 7f9dba000640 1 -- 172.21.15.40:0/1125438526 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4004b20 con 0x7f9dbc10fba0 2024-07-26T12:57:29.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.653+0000 7f9dba000640 1 -- 172.21.15.40:0/1125438526 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db4004cc0 con 0x7f9dbc10fba0 2024-07-26T12:57:29.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.653+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dbc1a22d0 con 0x7f9dbc10fba0 2024-07-26T12:57:29.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.653+0000 7f9dba000640 1 -- 172.21.15.40:0/1125438526 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4010690 con 0x7f9dbc10fba0 2024-07-26T12:57:29.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.653+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dbc1a8a30 con 0x7f9dbc10fba0 2024-07-26T12:57:29.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.658+0000 7f9dcb1f5740 1 Processor -- start 2024-07-26T12:57:29.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.659+0000 7f9dba000640 1 -- 172.21.15.40:0/1125438526 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9db4005020 con 0x7f9dbc10fba0 2024-07-26T12:57:29.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.659+0000 7f9dcb1f5740 1 -- start start 2024-07-26T12:57:29.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.659+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35901c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.659+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c1980 0x5612f3590700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.659+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 0x5612f3590c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.659+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5612f355ad10 con 0x5612f31c9b60 2024-07-26T12:57:29.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5612f3505b60 con 0x5612f31ea840 2024-07-26T12:57:29.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5612f34f5060 con 0x5612f31c1980 2024-07-26T12:57:29.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dc1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 0x5612f3590c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dc1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 0x5612f3590c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58134/0 (socket says 172.21.15.40:58134) 2024-07-26T12:57:29.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dc1000640 1 -- 172.21.15.40:0/4154812285 learned_addr learned my addr 172.21.15.40:0/4154812285 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:29.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c1980 0x5612f3590700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.660+0000 7f9dc1000640 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.661+0000 7f9dc1000640 1 -- 172.21.15.40:0/4154812285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c1980 msgr2=0x5612f3590700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.661+0000 7f9dc1000640 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c1980 0x5612f3590700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.661+0000 7f9dc1000640 1 -- 172.21.15.40:0/4154812285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 msgr2=0x5612f35901c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.661+0000 7f9dc1000640 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35901c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.661+0000 7f9dc1000640 1 -- 172.21.15.40:0/4154812285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f347cb10 con 0x5612f31c9b60 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.662+0000 7f9dc1000640 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 0x5612f3590c40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9da80057c0 tx=0x7f9da8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f0434effe84cbf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:29.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.662+0000 7f9dba000640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9da40b3c50 0x7f9da40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.662+0000 7f9daea00640 1 -- 172.21.15.40:0/4154812285 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8035070 con 0x5612f31c9b60 2024-07-26T12:57:29.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.662+0000 7f9dba000640 1 -- 172.21.15.40:0/1125438526 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9db40e4160 con 0x7f9dbc10fba0 2024-07-26T12:57:29.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.663+0000 7f9daea00640 1 -- 172.21.15.40:0/4154812285 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9da80044c0 con 0x5612f31c9b60 2024-07-26T12:57:29.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.663+0000 7f9daea00640 1 -- 172.21.15.40:0/4154812285 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8003bc0 con 0x5612f31c9b60 2024-07-26T12:57:29.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.663+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9da40b3c50 0x7f9da40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/4154812285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 msgr2=0x5612f3590c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9da40b3c50 0x7f9da40b6160 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x5612f358ee40 tx=0x7f9db0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 0x5612f3590c40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9da80057c0 tx=0x7f9da8005fd0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/4154812285 shutdown_connections 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c9b60 0x5612f3590c40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c1980 0x5612f3590700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/4154812285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35901c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/4154812285 >> 172.21.15.40:0/4154812285 conn(0x5612f31de990 msgr2=0x5612f358e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:29.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/4154812285 shutdown_connections 2024-07-26T12:57:29.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.664+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/4154812285 wait complete. 2024-07-26T12:57:29.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.665+0000 7f9dcb1f5740 1 -- start start 2024-07-26T12:57:29.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.665+0000 7f9dcb1f5740 1 Processor -- start 2024-07-26T12:57:29.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 0x5612f35a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5612f3491520 con 0x5612f31c1980 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5612f34f90a0 con 0x5612f31ea840 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5612f33587a0 con 0x5612f31c9b60 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.666+0000 7f9dcb1f5740 10 client.0 _ll_register_callbacks cb 0x5612f34edbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 0x5612f35a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 0x5612f35a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58150/0 (socket says 172.21.15.40:58150) 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 -- 172.21.15.40:0/1400987072 learned_addr learned my addr 172.21.15.40:0/1400987072 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1000640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc2400640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 -- 172.21.15.40:0/1400987072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 msgr2=0x5612f35a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 -- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 msgr2=0x5612f35aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.667+0000 7f9dc1a00640 1 -- 172.21.15.40:0/1400987072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f3264b90 con 0x5612f31c1980 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.668+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 0x5612f35a4ab0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9db0004620 tx=0x7f9db0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6816c1693b8e565d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.668+0000 7f9da3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:57:29.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.668+0000 7f9da3400640 1 -- 172.21.15.40:0/1400987072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db001f640 con 0x5612f31c1980 2024-07-26T12:57:29.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.668+0000 7f9da3400640 1 -- 172.21.15.40:0/1400987072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9db001f7e0 con 0x5612f31c1980 2024-07-26T12:57:29.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.668+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5612f3507ab0 con 0x5612f31c1980 2024-07-26T12:57:29.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.669+0000 7f9da3400640 1 -- 172.21.15.40:0/1400987072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9db001f9e0 con 0x5612f31c1980 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.669+0000 7f9dcb1f5740 10 client.16773 fetch_fsmap learned FSMap version 35 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.669+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5612f35b3060 con 0x5612f31c1980 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.669+0000 7f9da3400640 1 -- 172.21.15.40:0/1400987072 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5612f3507ab0 con 0x5612f31c1980 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.669+0000 7f9da3400640 1 -- 172.21.15.40:0/1400987072 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9db0029c00 con 0x5612f31c1980 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.670+0000 7f9dcb1f5740 10 client.16773 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.670+0000 7f9dcb1f5740 10 client.16773 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.670+0000 7f9dcb1f5740 20 client.16773 populate_metadata read hostname 'smithi040' 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.670+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f31a91c0 0x5612f35b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.670+0000 7f9dcb1f5740 4 client.16773 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:57:29.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.670+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612f3503550 con 0x5612f31a91c0 2024-07-26T12:57:29.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.671+0000 7f9dc1000640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f31a91c0 0x5612f35b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.672+0000 7f9dc1000640 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f31a91c0 0x5612f35b6590 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a2179266eb73cd server_cookie=2a38d00346de5879 in_seq=0 out_seq=0 2024-07-26T12:57:29.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.672+0000 7f9da3400640 10 client.16773 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:29.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9da3400640 1 -- 172.21.15.40:0/1400987072 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612f3503550 con 0x5612f31a91c0 2024-07-26T12:57:29.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9da3400640 10 client.16773 handle_command_reply: tid=0 2024-07-26T12:57:29.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 client.16773 shutdown 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 msgr2=0x5612f35a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 0x5612f35a4ab0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9db0004620 tx=0x7f9db0004730 comp rx=0 tx=0).stop 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 shutdown_connections 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31ea840 0x5612f35aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f31a91c0 0x5612f35b6590 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/1400987072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31c1980 0x5612f35a4ab0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.674+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 >> 172.21.15.40:0/1400987072 conn(0x5612f31de990 msgr2=0x5612f3593350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.675+0000 7f9da3400640 0 client.16773 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.675+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 shutdown_connections 2024-07-26T12:57:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.675+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/1400987072 wait complete. 2024-07-26T12:57:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.675+0000 7f9dcb1f5740 20 client.16773 trim_cache size 0 max 16384 2024-07-26T12:57:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.697+0000 7f9dcb1f5740 1 Processor -- start 2024-07-26T12:57:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.697+0000 7f9dcb1f5740 1 -- start start 2024-07-26T12:57:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f359dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f35932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1accf0 con 0x5612f31ea840 2024-07-26T12:57:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1ae830 con 0x5612f31c1980 2024-07-26T12:57:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1ad3c0 con 0x5612f31c9b60 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.698+0000 7f9dc2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f35932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f35932c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58156/0 (socket says 172.21.15.40:58156) 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 -- 172.21.15.40:0/2901597669 learned_addr learned my addr 172.21.15.40:0/2901597669 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f359dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc1000640 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 -- 172.21.15.40:0/2901597669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 msgr2=0x5612f35b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 -- 172.21.15.40:0/2901597669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 msgr2=0x5612f359dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f359dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.699+0000 7f9dc2400640 1 -- 172.21.15.40:0/2901597669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f31a93f0 con 0x5612f31ea840 2024-07-26T12:57:29.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.700+0000 7f9dc2400640 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f35932c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9db40e1c20 tx=0x7f9db4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d07776056409b7a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:29.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.700+0000 7f9dae000640 1 -- 172.21.15.40:0/2901597669 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db40ca070 con 0x5612f31ea840 2024-07-26T12:57:29.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.700+0000 7f9dae000640 1 -- 172.21.15.40:0/2901597669 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db40ab770 con 0x5612f31ea840 2024-07-26T12:57:29.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.700+0000 7f9dae000640 1 -- 172.21.15.40:0/2901597669 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db40ab2d0 con 0x5612f31ea840 2024-07-26T12:57:29.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/2901597669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 msgr2=0x5612f35932c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:29.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f35932c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9db40e1c20 tx=0x7f9db4005710 comp rx=0 tx=0).stop 2024-07-26T12:57:29.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/2901597669 shutdown_connections 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f35932c0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/2901597669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f359dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/2901597669 >> 172.21.15.40:0/2901597669 conn(0x5612f31de990 msgr2=0x5612f35aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/2901597669 shutdown_connections 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.702+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/2901597669 wait complete. 2024-07-26T12:57:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.703+0000 7f9dcb1f5740 1 -- start start 2024-07-26T12:57:29.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.703+0000 7f9dcb1f5740 1 Processor -- start 2024-07-26T12:57:29.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f35abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f3616ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1ae160 con 0x5612f31ea840 2024-07-26T12:57:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1ada90 con 0x5612f31c1980 2024-07-26T12:57:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1aacf0 con 0x5612f31c9b60 2024-07-26T12:57:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dcb1f5740 10 client.0 _ll_register_callbacks cb 0x7f9db0009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:57:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dc2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f3616ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dc1a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f35abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dc2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f3616ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58172/0 (socket says 172.21.15.40:58172) 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.704+0000 7f9dc2400640 1 -- 172.21.15.40:0/592415839 learned_addr learned my addr 172.21.15.40:0/592415839 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc1000640 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc2400640 1 -- 172.21.15.40:0/592415839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 msgr2=0x5612f35ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc2400640 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc2400640 1 -- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 msgr2=0x5612f35abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc2400640 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f35abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc2400640 1 -- 172.21.15.40:0/592415839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f3617350 con 0x5612f31ea840 2024-07-26T12:57:29.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9dc2400640 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f3616ce0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9db40a70f0 tx=0x7f9db40ab500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b10c281667458b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:29.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.705+0000 7f9da3400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:57:29.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.706+0000 7f9da3400640 1 -- 172.21.15.40:0/592415839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db408c060 con 0x5612f31ea840 2024-07-26T12:57:29.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.706+0000 7f9da3400640 1 -- 172.21.15.40:0/592415839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9db40b3ea0 con 0x5612f31ea840 2024-07-26T12:57:29.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.706+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db40ab770 con 0x5612f31ea840 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.706+0000 7f9da3400640 1 -- 172.21.15.40:0/592415839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9db40ca070 con 0x5612f31ea840 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.706+0000 7f9dcb1f5740 10 client.16779 fetch_fsmap learned FSMap version 35 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.706+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5612f361e600 con 0x5612f31ea840 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9da3400640 1 -- 172.21.15.40:0/592415839 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db40ab770 con 0x5612f31ea840 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9da3400640 1 -- 172.21.15.40:0/592415839 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9db40a69e0 con 0x5612f31ea840 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9dcb1f5740 10 client.16779 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:57:29.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9dcb1f5740 10 client.16779 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9dcb1f5740 20 client.16779 populate_metadata read hostname 'smithi040' 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f317e570 0x5612f3620cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9dcb1f5740 4 client.16779 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.2, "await_for": 45.0}] 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.707+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.2, "await_for": 45.0}) -- 0x5612f3500c90 con 0x5612f317e570 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.708+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f317e570 0x5612f3620cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.709+0000 7f9dc1a00640 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f317e570 0x5612f3620cf0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb02c1d7d80153a3 server_cookie=8ae35a427ceb7f6 in_seq=0 out_seq=0 2024-07-26T12:57:29.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:29.709+0000 7f9da3400640 10 client.16779 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:30.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.001+0000 7f9da3400640 1 -- 172.21.15.40:0/592415839 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5612f3500c90 con 0x5612f317e570 2024-07-26T12:57:30.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.001+0000 7f9da3400640 10 client.16779 handle_command_reply: tid=0 2024-07-26T12:57:30.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.001+0000 7f9dcb1f5740 1 client.16779 shutdown 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 msgr2=0x5612f3616ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f3616ce0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9db40a70f0 tx=0x7f9db40ab500 comp rx=0 tx=0).stop 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 shutdown_connections 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5612f317e570 0x5612f3620cf0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5612f31ea840 0x5612f3616ce0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5612f31c9b60 0x5612f35ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 --2- 172.21.15.40:0/592415839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612f31c1980 0x5612f35abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.002+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 >> 172.21.15.40:0/592415839 conn(0x5612f31de990 msgr2=0x5612f35932c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.003+0000 7f9da3400640 0 client.16779 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.003+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 shutdown_connections 2024-07-26T12:57:30.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.003+0000 7f9dcb1f5740 1 -- 172.21.15.40:0/592415839 wait complete. 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.003+0000 7f9dcb1f5740 20 client.16779 trim_cache size 0 max 16384 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 110, 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "fd987bf8": { 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 110, 2024-07-26T12:57:30.005 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.2, 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:30.007 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:30.007 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:30.007 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:57:30.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9da40b3c50 msgr2=0x7f9da40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9da40b3c50 0x7f9da40b6160 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x5612f358ee40 tx=0x7f9db0005f90 comp rx=0 tx=0).stop 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 msgr2=0x7f9dbc1a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc1a18b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9db400eb10 tx=0x7f9db400c2d0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 shutdown_connections 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dbc10fba0 0x7f9dbc1a18b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9dbc075ab0 0x7f9dbc19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9da40b3c50 0x7f9da40b6160 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 --2- 172.21.15.40:0/1125438526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dbc075160 0x7f9dbc19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 >> 172.21.15.40:0/1125438526 conn(0x7f9dbc0ff010 msgr2=0x7f9dbc108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.005+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 shutdown_connections 2024-07-26T12:57:30.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:30.006+0000 7f9dc4400640 1 -- 172.21.15.40:0/1125438526 wait complete. 2024-07-26T12:57:30.903 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fd987bf8', quiesce took 8.3 seconds. Will release after: 19.9 2024-07-26T12:57:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:30 smithi040 ceph-mon[32397]: pgmap v1557: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T12:57:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:30 smithi146 ceph-mon[35807]: pgmap v1557: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T12:57:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:30 smithi076 ceph-mon[35401]: pgmap v1557: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T12:57:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:32 smithi040 ceph-mon[32397]: pgmap v1558: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-07-26T12:57:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:32 smithi146 ceph-mon[35807]: pgmap v1558: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-07-26T12:57:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:32 smithi076 ceph-mon[35401]: pgmap v1558: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-07-26T12:57:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:34 smithi040 ceph-mon[32397]: pgmap v1559: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T12:57:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:34 smithi146 ceph-mon[35807]: pgmap v1559: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T12:57:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:34 smithi076 ceph-mon[35401]: pgmap v1559: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T12:57:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:36 smithi040 ceph-mon[32397]: pgmap v1560: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 MiB/s wr, 13 op/s 2024-07-26T12:57:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:36 smithi146 ceph-mon[35807]: pgmap v1560: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 MiB/s wr, 13 op/s 2024-07-26T12:57:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:36 smithi076 ceph-mon[35401]: pgmap v1560: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 MiB/s wr, 13 op/s 2024-07-26T12:57:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:38 smithi040 ceph-mon[32397]: pgmap v1561: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-07-26T12:57:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:38 smithi146 ceph-mon[35807]: pgmap v1561: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-07-26T12:57:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:38 smithi076 ceph-mon[35401]: pgmap v1561: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-07-26T12:57:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:40 smithi040 ceph-mon[32397]: pgmap v1562: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:57:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:40 smithi146 ceph-mon[35807]: pgmap v1562: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:57:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:40 smithi076 ceph-mon[35401]: pgmap v1562: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:57:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:42 smithi040 ceph-mon[32397]: pgmap v1563: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:57:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:42 smithi146 ceph-mon[35807]: pgmap v1563: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:57:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:42 smithi076 ceph-mon[35401]: pgmap v1563: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T12:57:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:44 smithi040 ceph-mon[32397]: pgmap v1564: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T12:57:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:44 smithi146 ceph-mon[35807]: pgmap v1564: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T12:57:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:44 smithi076 ceph-mon[35401]: pgmap v1564: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T12:57:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:46 smithi040 ceph-mon[32397]: pgmap v1565: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 351 KiB/s wr, 11 op/s 2024-07-26T12:57:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:46 smithi146 ceph-mon[35807]: pgmap v1565: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 351 KiB/s wr, 11 op/s 2024-07-26T12:57:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:46 smithi076 ceph-mon[35401]: pgmap v1565: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 351 KiB/s wr, 11 op/s 2024-07-26T12:57:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:48 smithi040 ceph-mon[32397]: pgmap v1566: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 351 KiB/s wr, 8 op/s 2024-07-26T12:57:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:48 smithi146 ceph-mon[35807]: pgmap v1566: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 351 KiB/s wr, 8 op/s 2024-07-26T12:57:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:48 smithi076 ceph-mon[35401]: pgmap v1566: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 351 KiB/s wr, 8 op/s 2024-07-26T12:57:50.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:57:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:50 smithi040 ceph-mon[32397]: pgmap v1567: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 351 KiB/s wr, 11 op/s 2024-07-26T12:57:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:57:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:50 smithi146 ceph-mon[35807]: pgmap v1567: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 351 KiB/s wr, 11 op/s 2024-07-26T12:57:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:50 smithi076 ceph-mon[35401]: pgmap v1567: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 351 KiB/s wr, 11 op/s 2024-07-26T12:57:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:52 smithi040 ceph-mon[32397]: pgmap v1568: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:57:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:52 smithi146 ceph-mon[35807]: pgmap v1568: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:57:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:52 smithi076 ceph-mon[35401]: pgmap v1568: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:57:53.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 -- 172.21.15.40:0/2067122799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348108d20 msgr2=0x7f2348109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 --2- 172.21.15.40:0/2067122799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348108d20 0x7f2348109130 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f2334009900 tx=0x7f233402a410 comp rx=0 tx=0).stop 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 -- 172.21.15.40:0/2067122799 shutdown_connections 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 --2- 172.21.15.40:0/2067122799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2348109670 0x7f234810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 --2- 172.21.15.40:0/2067122799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348108d20 0x7f2348109130 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 --2- 172.21.15.40:0/2067122799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23481033e0 0x7f23481037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 -- 172.21.15.40:0/2067122799 >> 172.21.15.40:0/2067122799 conn(0x7f23480fee30 msgr2=0x7f2348101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 -- 172.21.15.40:0/2067122799 shutdown_connections 2024-07-26T12:57:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.659+0000 7f234ec00640 1 -- 172.21.15.40:0/2067122799 wait complete. 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 Processor -- start 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 -- start start 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23481033e0 0x7f234819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2348108d20 0x7f234819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 0x7f23481a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23481131b0 con 0x7f2348109670 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2348113030 con 0x7f2348108d20 2024-07-26T12:57:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.661+0000 7f234ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2348113330 con 0x7f23481033e0 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 0x7f23481a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 0x7f23481a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50728/0 (socket says 172.21.15.40:50728) 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 -- 172.21.15.40:0/3549962521 learned_addr learned my addr 172.21.15.40:0/3549962521 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234d800640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23481033e0 0x7f234819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234ce00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2348108d20 0x7f234819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 -- 172.21.15.40:0/3549962521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23481033e0 msgr2=0x7f234819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23481033e0 0x7f234819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 -- 172.21.15.40:0/3549962521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2348108d20 msgr2=0x7f234819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2348108d20 0x7f234819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.662+0000 7f234e200640 1 -- 172.21.15.40:0/3549962521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23481a1e10 con 0x7f2348109670 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.663+0000 7f234e200640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 0x7f23481a16e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f234000eaa0 tx=0x7f234000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.663+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234000cdb0 con 0x7f2348109670 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.663+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23481a2100 con 0x7f2348109670 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.663+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2340005020 con 0x7f2348109670 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.663+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23400116d0 con 0x7f2348109670 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.663+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23481a8860 con 0x7f2348109670 2024-07-26T12:57:53.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.665+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23481037f0 con 0x7f2348109670 2024-07-26T12:57:53.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.667+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f23400051d0 con 0x7f2348109670 2024-07-26T12:57:53.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.669+0000 7f2346000640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f232c0b3c50 0x7f232c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:53.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.669+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f23400e40d0 con 0x7f2348109670 2024-07-26T12:57:53.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.669+0000 7f234d800640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f232c0b3c50 0x7f232c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:53.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.670+0000 7f234d800640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f232c0b3c50 0x7f232c0b6160 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2338005fd0 tx=0x7f233800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:53.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.671+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2340016030 con 0x7f2348109670 2024-07-26T12:57:53.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.921+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f234819cfd0 con 0x7f2348109670 2024-07-26T12:57:53.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.923+0000 7f2346000640 1 -- 172.21.15.40:0/3549962521 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f23400ab110 con 0x7f2348109670 2024-07-26T12:57:53.925 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:57:53.926 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:57:53.926 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:57:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.926+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f232c0b3c50 msgr2=0x7f232c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.926+0000 7f234ec00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f232c0b3c50 0x7f232c0b6160 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2338005fd0 tx=0x7f233800b390 comp rx=0 tx=0).stop 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.926+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 msgr2=0x7f23481a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.926+0000 7f234ec00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 0x7f23481a16e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f234000eaa0 tx=0x7f234000ef60 comp rx=0 tx=0).stop 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 shutdown_connections 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2348109670 0x7f23481a16e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2348108d20 0x7f234819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f232c0b3c50 0x7f232c0b6160 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 --2- 172.21.15.40:0/3549962521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23481033e0 0x7f234819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 >> 172.21.15.40:0/3549962521 conn(0x7f23480fee30 msgr2=0x7f234810e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 shutdown_connections 2024-07-26T12:57:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:53.927+0000 7f234ec00640 1 -- 172.21.15.40:0/3549962521 wait complete. 2024-07-26T12:57:54.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:53 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3549962521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:53 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3549962521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:54.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:53 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3549962521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:57:54.823 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id fd987bf8 --release --await' 2024-07-26T12:57:54.823 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id fd987bf8 --release --await 2024-07-26T12:57:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:54 smithi040 ceph-mon[32397]: pgmap v1569: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:57:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:57:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:54 smithi146 ceph-mon[35807]: pgmap v1569: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:57:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:54 smithi076 ceph-mon[35401]: pgmap v1569: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T12:57:57.228 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:56 smithi040 ceph-mon[32397]: pgmap v1570: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:57:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:56 smithi146 ceph-mon[35807]: pgmap v1570: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:57:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:56 smithi076 ceph-mon[35401]: pgmap v1570: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T12:57:57.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 -- 172.21.15.40:0/522840312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4102490 msgr2=0x7f58f41028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 --2- 172.21.15.40:0/522840312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4102490 0x7f58f41028a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009ca0 tx=0x7f58e402a8c0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 -- 172.21.15.40:0/522840312 shutdown_connections 2024-07-26T12:57:57.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 --2- 172.21.15.40:0/522840312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f4108720 0x7f58f410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 --2- 172.21.15.40:0/522840312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4107dd0 0x7f58f41081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 --2- 172.21.15.40:0/522840312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4102490 0x7f58f41028a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 -- 172.21.15.40:0/522840312 >> 172.21.15.40:0/522840312 conn(0x7f58f4079160 msgr2=0x7f58f4079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:57.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 -- 172.21.15.40:0/522840312 shutdown_connections 2024-07-26T12:57:57.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.592+0000 7f58fa600640 1 -- 172.21.15.40:0/522840312 wait complete. 2024-07-26T12:57:57.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.594+0000 7f58fa600640 1 Processor -- start 2024-07-26T12:57:57.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.594+0000 7f58fa600640 1 -- start start 2024-07-26T12:57:57.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.594+0000 7f58fa600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4102490 0x7f58f41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.594+0000 7f58fa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 0x7f58f4198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58fa600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f4108720 0x7f58f4199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58fa600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4112280 con 0x7f58f4107dd0 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58fa600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4112100 con 0x7f58f4102490 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58fa600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4112400 con 0x7f58f4108720 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 0x7f58f4198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 0x7f58f4198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50736/0 (socket says 172.21.15.40:50736) 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58f2a00640 1 -- 172.21.15.40:0/4019401698 learned_addr learned my addr 172.21.15.40:0/4019401698 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58f3400640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4102490 0x7f58f41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58f3e00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f4108720 0x7f58f4199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.595+0000 7f58f2a00640 1 -- 172.21.15.40:0/4019401698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f4108720 msgr2=0x7f58f4199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58f2a00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f4108720 0x7f58f4199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58f2a00640 1 -- 172.21.15.40:0/4019401698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4102490 msgr2=0x7f58f41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58f2a00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4102490 0x7f58f41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58f2a00640 1 -- 172.21.15.40:0/4019401698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f41a8090 con 0x7f58f4107dd0 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58f3400640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4102490 0x7f58f41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58f2a00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 0x7f58f4198f20 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00d770 tx=0x7f58dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58ebe00640 1 -- 172.21.15.40:0/4019401698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc017070 con 0x7f58f4107dd0 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58ebe00640 1 -- 172.21.15.40:0/4019401698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58dc009c30 con 0x7f58f4107dd0 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.596+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f41a8380 con 0x7f58f4107dd0 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.597+0000 7f58ebe00640 1 -- 172.21.15.40:0/4019401698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00f620 con 0x7f58f4107dd0 2024-07-26T12:57:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.597+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f41a88c0 con 0x7f58f4107dd0 2024-07-26T12:57:57.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.600+0000 7f59012db740 1 Processor -- start 2024-07-26T12:57:57.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 -- start start 2024-07-26T12:57:57.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f58ebe00640 1 -- 172.21.15.40:0/4019401698 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f58dc01a070 con 0x7f58f4107dd0 2024-07-26T12:57:57.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e64efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e281660 0x56034e64f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 0x56034e64fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56034e5c5f50 con 0x56034e289840 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56034e5b5450 con 0x56034e281660 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.601+0000 7f59012db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56034e5b9490 con 0x56034e2aa520 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 0x56034e64fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 0x56034e64fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50742/0 (socket says 172.21.15.40:50742) 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 -- 172.21.15.40:0/1005302709 learned_addr learned my addr 172.21.15.40:0/1005302709 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f3e00640 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e64efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f3400640 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e281660 0x56034e64f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 -- 172.21.15.40:0/1005302709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 msgr2=0x56034e64efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e64efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 -- 172.21.15.40:0/1005302709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e281660 msgr2=0x56034e64f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e281660 0x56034e64f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.602+0000 7f58f2a00640 1 -- 172.21.15.40:0/1005302709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034e315b00 con 0x56034e289840 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.603+0000 7f58f2a00640 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 0x56034e64fa60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0e9c20 tx=0x7f58dc0eb670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f86477093603e20 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.603+0000 7f58e8c00640 1 -- 172.21.15.40:0/1005302709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0f2070 con 0x56034e289840 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.603+0000 7f58ebe00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58d80b3bd0 0x7f58d80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.603+0000 7f58e8c00640 1 -- 172.21.15.40:0/1005302709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58dc0e3dc0 con 0x56034e289840 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.603+0000 7f58e8c00640 1 -- 172.21.15.40:0/1005302709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0ee680 con 0x56034e289840 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.604+0000 7f58ebe00640 1 -- 172.21.15.40:0/4019401698 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f58dc0e37d0 con 0x7f58f4107dd0 2024-07-26T12:57:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.604+0000 7f58f3e00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58d80b3bd0 0x7f58d80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.604+0000 7f59012db740 1 -- 172.21.15.40:0/1005302709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 msgr2=0x56034e64fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.604+0000 7f59012db740 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 0x56034e64fa60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0e9c20 tx=0x7f58dc0eb670 comp rx=0 tx=0).stop 2024-07-26T12:57:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f58f3e00640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58d80b3bd0 0x7f58d80b60e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00bca0 tx=0x7f58ec00b450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 -- 172.21.15.40:0/1005302709 shutdown_connections 2024-07-26T12:57:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e289840 0x56034e64fa60 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e281660 0x56034e64f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 --2- 172.21.15.40:0/1005302709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e64efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 -- 172.21.15.40:0/1005302709 >> 172.21.15.40:0/1005302709 conn(0x56034e29e910 msgr2=0x56034e64ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 -- 172.21.15.40:0/1005302709 shutdown_connections 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.605+0000 7f59012db740 1 -- 172.21.15.40:0/1005302709 wait complete. 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.606+0000 7f59012db740 1 -- start start 2024-07-26T12:57:57.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.606+0000 7f59012db740 1 Processor -- start 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.606+0000 7f59012db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e662ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.606+0000 7f59012db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e663430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f59012db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f59012db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56034e418bb0 con 0x56034e281660 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f59012db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56034e551930 con 0x56034e289840 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f59012db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56034e665ef0 con 0x56034e2aa520 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f59012db740 10 client.0 _ll_register_callbacks cb 0x56034e2c1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e662ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e662ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50752/0 (socket says 172.21.15.40:50752) 2024-07-26T12:57:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 -- 172.21.15.40:0/3397060163 learned_addr learned my addr 172.21.15.40:0/3397060163 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f2a00640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e663430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 -- 172.21.15.40:0/3397060163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 msgr2=0x56034e66f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3e00640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 -- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 msgr2=0x56034e663430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e663430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f3400640 1 -- 172.21.15.40:0/3397060163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034e38c960 con 0x56034e281660 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.607+0000 7f58f2a00640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e663430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.608+0000 7f58f3400640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e662ef0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f58e402ade0 tx=0x7f58e4031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6341ef5e6e8df93a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.608+0000 7f58e1600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.608+0000 7f58e1600640 1 -- 172.21.15.40:0/3397060163 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4003970 con 0x56034e281660 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.608+0000 7f58e1600640 1 -- 172.21.15.40:0/3397060163 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f58e4003b10 con 0x56034e281660 2024-07-26T12:57:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.608+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58dc0e3dc0 con 0x56034e281660 2024-07-26T12:57:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f58e1600640 1 -- 172.21.15.40:0/3397060163 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f58e4003d10 con 0x56034e281660 2024-07-26T12:57:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 10 client.16797 fetch_fsmap learned FSMap version 35 2024-07-26T12:57:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56034e671ca0 con 0x56034e281660 2024-07-26T12:57:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f58e1600640 1 -- 172.21.15.40:0/3397060163 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58dc0e3dc0 con 0x56034e281660 2024-07-26T12:57:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f58e1600640 1 -- 172.21.15.40:0/3397060163 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f58e404e020 con 0x56034e281660 2024-07-26T12:57:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 10 client.16797 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 10 client.16797 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 20 client.16797 populate_metadata read hostname 'smithi040' 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e268ea0 0x56034e6751a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 4 client.16797 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.609+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56034e5c7ea0 con 0x56034e268ea0 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.610+0000 7f58f2a00640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e268ea0 0x56034e6751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.611+0000 7f58f2a00640 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e268ea0 0x56034e6751a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=935104f58af7721e server_cookie=36dc9b73bf52071b in_seq=0 out_seq=0 2024-07-26T12:57:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.611+0000 7f58e1600640 10 client.16797 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:57.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.613+0000 7f58e1600640 1 -- 172.21.15.40:0/3397060163 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56034e5c7ea0 con 0x56034e268ea0 2024-07-26T12:57:57.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.613+0000 7f58e1600640 10 client.16797 handle_command_reply: tid=0 2024-07-26T12:57:57.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.613+0000 7f59012db740 1 client.16797 shutdown 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.613+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 msgr2=0x56034e662ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.613+0000 7f59012db740 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e662ef0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f58e402ade0 tx=0x7f58e4031bb0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 shutdown_connections 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e663430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e268ea0 0x56034e6751a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 --2- 172.21.15.40:0/3397060163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e662ef0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 >> 172.21.15.40:0/3397060163 conn(0x56034e29e910 msgr2=0x56034e64b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f58e1600640 0 client.16797 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 shutdown_connections 2024-07-26T12:57:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 1 -- 172.21.15.40:0/3397060163 wait complete. 2024-07-26T12:57:57.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.614+0000 7f59012db740 20 client.16797 trim_cache size 0 max 16384 2024-07-26T12:57:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.633+0000 7f59012db740 1 Processor -- start 2024-07-26T12:57:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.633+0000 7f59012db740 1 -- start start 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.633+0000 7f59012db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e664410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f59012db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e66f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f59012db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f59012db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41acc10 con 0x56034e281660 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f59012db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41ae750 con 0x56034e289840 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f59012db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41ad2e0 con 0x56034e2aa520 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f58f3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e664410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f58f3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e664410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50758/0 (socket says 172.21.15.40:50758) 2024-07-26T12:57:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f58f3400640 1 -- 172.21.15.40:0/2055369076 learned_addr learned my addr 172.21.15.40:0/2055369076 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f58f2a00640 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e66f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f58f3400640 1 -- 172.21.15.40:0/2055369076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 msgr2=0x56034e66f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.634+0000 7f58f3400640 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58f3400640 1 -- 172.21.15.40:0/2055369076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 msgr2=0x56034e66f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58f3400640 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e66f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58f3400640 1 -- 172.21.15.40:0/2055369076 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034e6641b0 con 0x56034e281660 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58f3400640 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e664410 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009bf0 tx=0x7f58e4030800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f159ed7848871809 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58e3e00640 1 -- 172.21.15.40:0/2055369076 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4003970 con 0x56034e281660 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58e3e00640 1 -- 172.21.15.40:0/2055369076 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58e4036040 con 0x56034e281660 2024-07-26T12:57:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.635+0000 7f58e3e00640 1 -- 172.21.15.40:0/2055369076 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4003eb0 con 0x56034e281660 2024-07-26T12:57:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.636+0000 7f59012db740 1 -- 172.21.15.40:0/2055369076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 msgr2=0x56034e664410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.636+0000 7f59012db740 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e664410 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009bf0 tx=0x7f58e4030800 comp rx=0 tx=0).stop 2024-07-26T12:57:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 -- 172.21.15.40:0/2055369076 shutdown_connections 2024-07-26T12:57:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e2aa520 0x56034e66f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e289840 0x56034e66f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 --2- 172.21.15.40:0/2055369076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e664410 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 -- 172.21.15.40:0/2055369076 >> 172.21.15.40:0/2055369076 conn(0x56034e29e910 msgr2=0x56034e6509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 -- 172.21.15.40:0/2055369076 shutdown_connections 2024-07-26T12:57:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 -- 172.21.15.40:0/2055369076 wait complete. 2024-07-26T12:57:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 -- start start 2024-07-26T12:57:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.637+0000 7f59012db740 1 Processor -- start 2024-07-26T12:57:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e66b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e289840 0x56034e666c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e2aa520 0x56034e667140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41ae080 con 0x56034e281660 2024-07-26T12:57:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41ad9b0 con 0x56034e2aa520 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41aabf0 con 0x56034e289840 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f59012db740 10 client.0 _ll_register_callbacks cb 0x7f58e4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f58f3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e66b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f58f3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e66b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50768/0 (socket says 172.21.15.40:50768) 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.638+0000 7f58f3400640 1 -- 172.21.15.40:0/691947634 learned_addr learned my addr 172.21.15.40:0/691947634 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3e00640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e2aa520 0x56034e667140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f2a00640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e289840 0x56034e666c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3400640 1 -- 172.21.15.40:0/691947634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e289840 msgr2=0x56034e666c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3400640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e289840 0x56034e666c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3400640 1 -- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e2aa520 msgr2=0x56034e667140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3400640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e2aa520 0x56034e667140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3400640 1 -- 172.21.15.40:0/691947634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034e6677e0 con 0x56034e281660 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f2a00640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e289840 0x56034e666c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3e00640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e2aa520 0x56034e667140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58f3400640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e66b750 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f58e4004af0 tx=0x7f58e4004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304b6f200fac3416 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.639+0000 7f58e1600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f58e1600640 1 -- 172.21.15.40:0/691947634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4030b00 con 0x56034e281660 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f58e1600640 1 -- 172.21.15.40:0/691947634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f58e4042040 con 0x56034e281660 2024-07-26T12:57:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58e4036040 con 0x56034e281660 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f58e1600640 1 -- 172.21.15.40:0/691947634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f58e4003eb0 con 0x56034e281660 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f59012db740 10 client.16803 fetch_fsmap learned FSMap version 35 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56034e6dd7a0 con 0x56034e281660 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f58e1600640 1 -- 172.21.15.40:0/691947634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58e4036040 con 0x56034e281660 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.640+0000 7f58e1600640 1 -- 172.21.15.40:0/691947634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f58e4063050 con 0x56034e281660 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f59012db740 10 client.16803 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f59012db740 10 client.16803 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:57:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f59012db740 20 client.16803 populate_metadata read hostname 'smithi040' 2024-07-26T12:57:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f59012db740 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e23e250 0x56034e6dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:57:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f59012db740 4 client.16803 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fd987bf8", "release": true, "await": true}] 2024-07-26T12:57:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fd987bf8", "release": true, "await": true}) -- 0x56034e5c3940 con 0x56034e23e250 2024-07-26T12:57:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.641+0000 7f58f2a00640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e23e250 0x56034e6dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:57:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.642+0000 7f58f2a00640 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e23e250 0x56034e6dfda0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c53ab8d20fa751e server_cookie=e3899039aa94d8a7 in_seq=0 out_seq=0 2024-07-26T12:57:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.642+0000 7f58e1600640 10 client.16803 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.693+0000 7f58e1600640 1 -- 172.21.15.40:0/691947634 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x56034e5c3940 con 0x56034e23e250 2024-07-26T12:57:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.693+0000 7f58e1600640 10 client.16803 handle_command_reply: tid=0 2024-07-26T12:57:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.693+0000 7f59012db740 1 client.16803 shutdown 2024-07-26T12:57:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 msgr2=0x56034e66b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e66b750 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f58e4004af0 tx=0x7f58e4004df0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 shutdown_connections 2024-07-26T12:57:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56034e2aa520 0x56034e667140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56034e289840 0x56034e666c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56034e23e250 0x56034e6dfda0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 --2- 172.21.15.40:0/691947634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56034e281660 0x56034e66b750 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 >> 172.21.15.40:0/691947634 conn(0x56034e29e910 msgr2=0x56034e650010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.694+0000 7f58e1600640 0 client.16803 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:57:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.695+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 shutdown_connections 2024-07-26T12:57:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.695+0000 7f59012db740 1 -- 172.21.15.40:0/691947634 wait complete. 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.695+0000 7f59012db740 20 client.16803 trim_cache size 0 max 16384 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 112, 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:57:57.698 INFO:teuthology.orchestra.run.smithi040.stdout: "fd987bf8": { 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 112, 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 148.2, 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:57:57.699 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:57:57.700 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58d80b3bd0 msgr2=0x7f58d80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58d80b3bd0 0x7f58d80b60e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00bca0 tx=0x7f58ec00b450 comp rx=0 tx=0).stop 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 msgr2=0x7f58f4198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 0x7f58f4198f20 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00d770 tx=0x7f58dc00dc30 comp rx=0 tx=0).stop 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 shutdown_connections 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58d80b3bd0 0x7f58d80b60e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f4108720 0x7f58f4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58f4107dd0 0x7f58f4198f20 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 --2- 172.21.15.40:0/4019401698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f58f4102490 0x7f58f41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:57:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.697+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 >> 172.21.15.40:0/4019401698 conn(0x7f58f4079160 msgr2=0x7f58f4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:57:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.698+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 shutdown_connections 2024-07-26T12:57:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:57:57.698+0000 7f58fa600640 1 -- 172.21.15.40:0/4019401698 wait complete. 2024-07-26T12:57:58.723 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fd987bf8', total seconds elapsed: 36.2 2024-07-26T12:57:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:57:58 smithi040 ceph-mon[32397]: pgmap v1571: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:57:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:57:58 smithi146 ceph-mon[35807]: pgmap v1571: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:57:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:57:58 smithi076 ceph-mon[35401]: pgmap v1571: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T12:58:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:00 smithi040 ceph-mon[32397]: pgmap v1572: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:58:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:00 smithi146 ceph-mon[35807]: pgmap v1572: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:58:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:00 smithi076 ceph-mon[35401]: pgmap v1572: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T12:58:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:02 smithi040 ceph-mon[32397]: pgmap v1573: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:58:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:02 smithi146 ceph-mon[35807]: pgmap v1573: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:58:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:02 smithi076 ceph-mon[35401]: pgmap v1573: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T12:58:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:04 smithi040 ceph-mon[32397]: pgmap v1574: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1014 KiB/s wr, 10 op/s 2024-07-26T12:58:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:04 smithi146 ceph-mon[35807]: pgmap v1574: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1014 KiB/s wr, 10 op/s 2024-07-26T12:58:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:04 smithi076 ceph-mon[35401]: pgmap v1574: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1014 KiB/s wr, 10 op/s 2024-07-26T12:58:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:06 smithi146 ceph-mon[35807]: pgmap v1575: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1014 KiB/s wr, 11 op/s 2024-07-26T12:58:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:06 smithi076 ceph-mon[35401]: pgmap v1575: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1014 KiB/s wr, 11 op/s 2024-07-26T12:58:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:06 smithi040 ceph-mon[32397]: pgmap v1575: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1014 KiB/s wr, 11 op/s 2024-07-26T12:58:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:58:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:58:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: pgmap v1576: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:58:09.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:58:09.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: pgmap v1576: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:58:09.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:58:09.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:58:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: pgmap v1576: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-07-26T12:58:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:58:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:58:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:58:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:58:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:10 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:58:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:10 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:58:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:10 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:58:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:10 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:58:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:10 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:58:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:10 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:58:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:10 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:58:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:10 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:58:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:10 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T12:58:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:10 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:58:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:10 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T12:58:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:10 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T12:58:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:11 smithi146 ceph-mon[35807]: pgmap v1577: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:58:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:11 smithi076 ceph-mon[35401]: pgmap v1577: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:58:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:11 smithi040 ceph-mon[32397]: pgmap v1577: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T12:58:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:13 smithi146 ceph-mon[35807]: pgmap v1578: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:58:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:13 smithi076 ceph-mon[35401]: pgmap v1578: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:58:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:13 smithi040 ceph-mon[32397]: pgmap v1578: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T12:58:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:15 smithi146 ceph-mon[35807]: pgmap v1579: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:58:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:15 smithi076 ceph-mon[35401]: pgmap v1579: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:58:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:15 smithi040 ceph-mon[32397]: pgmap v1579: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:58:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:17 smithi146 ceph-mon[35807]: pgmap v1580: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:17 smithi076 ceph-mon[35401]: pgmap v1580: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:17 smithi040 ceph-mon[32397]: pgmap v1580: 97 pgs: 97 active+clean; 6.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:19 smithi146 ceph-mon[35807]: pgmap v1581: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:19 smithi076 ceph-mon[35401]: pgmap v1581: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:19 smithi040 ceph-mon[32397]: pgmap v1581: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:21 smithi146 ceph-mon[35807]: pgmap v1582: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:21 smithi076 ceph-mon[35401]: pgmap v1582: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:21 smithi040 ceph-mon[32397]: pgmap v1582: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:23 smithi146 ceph-mon[35807]: pgmap v1583: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:58:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:23 smithi076 ceph-mon[35401]: pgmap v1583: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:58:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:23 smithi040 ceph-mon[32397]: pgmap v1583: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:58:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:25 smithi076 ceph-mon[35401]: pgmap v1584: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:58:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:25 smithi040 ceph-mon[32397]: pgmap v1584: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:58:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:25 smithi146 ceph-mon[35807]: pgmap v1584: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T12:58:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:27 smithi040 ceph-mon[32397]: pgmap v1585: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:58:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:27 smithi146 ceph-mon[35807]: pgmap v1585: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:58:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:27 smithi076 ceph-mon[35401]: pgmap v1585: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T12:58:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:29 smithi040 ceph-mon[32397]: pgmap v1586: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:29 smithi146 ceph-mon[35807]: pgmap v1586: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:29 smithi076 ceph-mon[35401]: pgmap v1586: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:30 smithi040 ceph-mon[32397]: pgmap v1587: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:30 smithi146 ceph-mon[35807]: pgmap v1587: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:30 smithi076 ceph-mon[35401]: pgmap v1587: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:32 smithi040 ceph-mon[32397]: pgmap v1588: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:58:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:32 smithi146 ceph-mon[35807]: pgmap v1588: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:58:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:32 smithi076 ceph-mon[35401]: pgmap v1588: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T12:58:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:34 smithi040 ceph-mon[32397]: pgmap v1589: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:58:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:34 smithi146 ceph-mon[35807]: pgmap v1589: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:58:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:34 smithi076 ceph-mon[35401]: pgmap v1589: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:58:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:36 smithi040 ceph-mon[32397]: pgmap v1590: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:58:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:36 smithi146 ceph-mon[35807]: pgmap v1590: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:58:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:36 smithi076 ceph-mon[35401]: pgmap v1590: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:58:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:38 smithi040 ceph-mon[32397]: pgmap v1591: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:58:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:38 smithi146 ceph-mon[35807]: pgmap v1591: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:58:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:38 smithi076 ceph-mon[35401]: pgmap v1591: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:58:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:40 smithi040 ceph-mon[32397]: pgmap v1592: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:58:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:40 smithi146 ceph-mon[35807]: pgmap v1592: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:58:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:40 smithi076 ceph-mon[35401]: pgmap v1592: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:58:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:42 smithi040 ceph-mon[32397]: pgmap v1593: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:58:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:42 smithi146 ceph-mon[35807]: pgmap v1593: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:58:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:42 smithi076 ceph-mon[35401]: pgmap v1593: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:58:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:44 smithi146 ceph-mon[35807]: pgmap v1594: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:44 smithi076 ceph-mon[35401]: pgmap v1594: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:44 smithi040 ceph-mon[32397]: pgmap v1594: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:58:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:46 smithi146 ceph-mon[35807]: pgmap v1595: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:58:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:46 smithi076 ceph-mon[35401]: pgmap v1595: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:58:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:46 smithi040 ceph-mon[32397]: pgmap v1595: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:58:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:48 smithi146 ceph-mon[35807]: pgmap v1596: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:58:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:48 smithi076 ceph-mon[35401]: pgmap v1596: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:58:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:48 smithi040 ceph-mon[32397]: pgmap v1596: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T12:58:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:50 smithi146 ceph-mon[35807]: pgmap v1597: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:50 smithi076 ceph-mon[35401]: pgmap v1597: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:50 smithi040 ceph-mon[32397]: pgmap v1597: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:52 smithi146 ceph-mon[35807]: pgmap v1598: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:58:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:52 smithi076 ceph-mon[35401]: pgmap v1598: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:58:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:52 smithi040 ceph-mon[32397]: pgmap v1598: 97 pgs: 97 active+clean; 6.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T12:58:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:54 smithi146 ceph-mon[35807]: pgmap v1599: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:58:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:54 smithi076 ceph-mon[35401]: pgmap v1599: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:58:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:54 smithi040 ceph-mon[32397]: pgmap v1599: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:58:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:56 smithi146 ceph-mon[35807]: pgmap v1600: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:56 smithi076 ceph-mon[35401]: pgmap v1600: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:56 smithi040 ceph-mon[32397]: pgmap v1600: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:58:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:58:58 smithi146 ceph-mon[35807]: pgmap v1601: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:58:58 smithi076 ceph-mon[35401]: pgmap v1601: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:58:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:58:58 smithi040 ceph-mon[32397]: pgmap v1601: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:00 smithi146 ceph-mon[35807]: pgmap v1602: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:59:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:00 smithi076 ceph-mon[35401]: pgmap v1602: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:59:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:00 smithi040 ceph-mon[32397]: pgmap v1602: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T12:59:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:02 smithi146 ceph-mon[35807]: pgmap v1603: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:59:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:02 smithi076 ceph-mon[35401]: pgmap v1603: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:59:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:02 smithi040 ceph-mon[32397]: pgmap v1603: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T12:59:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:04 smithi146 ceph-mon[35807]: pgmap v1604: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:59:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:04 smithi076 ceph-mon[35401]: pgmap v1604: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:59:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:04 smithi040 ceph-mon[32397]: pgmap v1604: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:59:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:06 smithi146 ceph-mon[35807]: pgmap v1605: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:59:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:06 smithi076 ceph-mon[35401]: pgmap v1605: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:59:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:06 smithi040 ceph-mon[32397]: pgmap v1605: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T12:59:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:08 smithi076 ceph-mon[35401]: pgmap v1606: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:08 smithi040 ceph-mon[32397]: pgmap v1606: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:08 smithi146 ceph-mon[35807]: pgmap v1606: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:59:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:59:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: pgmap v1607: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:59:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:59:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:59:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: pgmap v1607: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: pgmap v1607: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T12:59:11.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T12:59:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:12 smithi040 ceph-mon[32397]: pgmap v1608: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:59:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:12 smithi146 ceph-mon[35807]: pgmap v1608: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:59:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:12 smithi076 ceph-mon[35401]: pgmap v1608: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T12:59:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:14 smithi040 ceph-mon[32397]: pgmap v1609: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:14 smithi146 ceph-mon[35807]: pgmap v1609: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:14 smithi076 ceph-mon[35401]: pgmap v1609: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:16 smithi040 ceph-mon[32397]: pgmap v1610: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:59:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:16 smithi146 ceph-mon[35807]: pgmap v1610: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:59:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:16 smithi076 ceph-mon[35401]: pgmap v1610: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T12:59:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:18 smithi040 ceph-mon[32397]: pgmap v1611: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:18 smithi146 ceph-mon[35807]: pgmap v1611: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:18 smithi076 ceph-mon[35401]: pgmap v1611: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T12:59:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:20 smithi040 ceph-mon[32397]: pgmap v1612: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:59:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:20 smithi146 ceph-mon[35807]: pgmap v1612: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:59:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:20 smithi076 ceph-mon[35401]: pgmap v1612: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T12:59:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:22 smithi040 ceph-mon[32397]: pgmap v1613: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:22 smithi146 ceph-mon[35807]: pgmap v1613: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:22 smithi076 ceph-mon[35401]: pgmap v1613: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:24 smithi040 ceph-mon[32397]: pgmap v1614: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:59:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:24 smithi146 ceph-mon[35807]: pgmap v1614: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:59:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:24 smithi076 ceph-mon[35401]: pgmap v1614: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:59:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:26 smithi040 ceph-mon[32397]: pgmap v1615: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:59:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:26 smithi146 ceph-mon[35807]: pgmap v1615: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:59:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:26 smithi076 ceph-mon[35401]: pgmap v1615: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T12:59:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:28 smithi040 ceph-mon[32397]: pgmap v1616: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:59:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:28 smithi146 ceph-mon[35807]: pgmap v1616: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:59:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:28 smithi076 ceph-mon[35401]: pgmap v1616: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T12:59:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:30 smithi040 ceph-mon[32397]: pgmap v1617: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:59:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:30 smithi146 ceph-mon[35807]: pgmap v1617: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:59:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:30 smithi076 ceph-mon[35401]: pgmap v1617: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T12:59:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:32 smithi040 ceph-mon[32397]: pgmap v1618: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:59:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:32 smithi146 ceph-mon[35807]: pgmap v1618: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:59:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:32 smithi076 ceph-mon[35401]: pgmap v1618: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T12:59:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:34 smithi040 ceph-mon[32397]: pgmap v1619: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:59:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:34 smithi146 ceph-mon[35807]: pgmap v1619: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:59:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:34 smithi076 ceph-mon[35401]: pgmap v1619: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T12:59:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:36 smithi040 ceph-mon[32397]: pgmap v1620: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:59:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:36 smithi146 ceph-mon[35807]: pgmap v1620: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:59:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:36 smithi076 ceph-mon[35401]: pgmap v1620: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:59:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:38 smithi040 ceph-mon[32397]: pgmap v1621: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:59:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:38 smithi146 ceph-mon[35807]: pgmap v1621: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:59:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:38 smithi076 ceph-mon[35401]: pgmap v1621: 97 pgs: 97 active+clean; 6.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:59:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:40 smithi040 ceph-mon[32397]: pgmap v1622: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:59:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:40 smithi146 ceph-mon[35807]: pgmap v1622: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:59:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:40 smithi076 ceph-mon[35401]: pgmap v1622: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T12:59:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:42 smithi040 ceph-mon[32397]: pgmap v1623: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:59:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:42 smithi146 ceph-mon[35807]: pgmap v1623: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:59:43.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:42 smithi076 ceph-mon[35401]: pgmap v1623: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T12:59:43.467 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.6 2024-07-26T12:59:43.468 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:59:44.001 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:59:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:44 smithi040 ceph-mon[32397]: pgmap v1624: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:59:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:44 smithi146 ceph-mon[35807]: pgmap v1624: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:59:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:44 smithi076 ceph-mon[35401]: pgmap v1624: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 -- 172.21.15.40:0/1369923171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 msgr2=0x7f019c10f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 --2- 172.21.15.40:0/1369923171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 0x7f019c10f400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0188009900 tx=0x7f018802a3f0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 -- 172.21.15.40:0/1369923171 shutdown_connections 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 --2- 172.21.15.40:0/1369923171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c10f940 0x7f019c111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 --2- 172.21.15.40:0/1369923171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 0x7f019c10f400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 --2- 172.21.15.40:0/1369923171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c0751e0 0x7f019c0755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 -- 172.21.15.40:0/1369923171 >> 172.21.15.40:0/1369923171 conn(0x7f019c0fee30 msgr2=0x7f019c101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.642+0000 7f019b200640 1 -- 172.21.15.40:0/1369923171 shutdown_connections 2024-07-26T12:59:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.643+0000 7f019b200640 1 -- 172.21.15.40:0/1369923171 wait complete. 2024-07-26T12:59:46.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.644+0000 7f019b200640 1 Processor -- start 2024-07-26T12:59:46.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.644+0000 7f019b200640 1 -- start start 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0751e0 0x7f019c19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 0x7f019c19c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 0x7f019c1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f019c1153e0 con 0x7f019c10f940 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f019c115260 con 0x7f019c075b30 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f019c115560 con 0x7f019c0751e0 2024-07-26T12:59:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.645+0000 7f019a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 0x7f019c1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 0x7f019c1a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50122/0 (socket says 172.21.15.40:50122) 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 -- 172.21.15.40:0/3190481145 learned_addr learned my addr 172.21.15.40:0/3190481145 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f0199e00640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0751e0 0x7f019c19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f0199400640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 0x7f019c19c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 -- 172.21.15.40:0/3190481145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0751e0 msgr2=0x7f019c19be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0751e0 0x7f019c19be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 -- 172.21.15.40:0/3190481145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 msgr2=0x7f019c19c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 0x7f019c19c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.646+0000 7f019a800640 1 -- 172.21.15.40:0/3190481145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c1a1da0 con 0x7f019c10f940 2024-07-26T12:59:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.647+0000 7f019a800640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 0x7f019c1a1670 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f019400eb10 tx=0x7f019400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.647+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194004b20 con 0x7f019c10f940 2024-07-26T12:59:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.647+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0194004cc0 con 0x7f019c10f940 2024-07-26T12:59:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.647+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194010690 con 0x7f019c10f940 2024-07-26T12:59:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.647+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c1a2090 con 0x7f019c10f940 2024-07-26T12:59:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.648+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c1a87f0 con 0x7f019c10f940 2024-07-26T12:59:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.649+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019c0755f0 con 0x7f019c10f940 2024-07-26T12:59:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.652+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0194005020 con 0x7f019c10f940 2024-07-26T12:59:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.653+0000 7f0192a00640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f01800b3bd0 0x7f01800b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.654+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f01940e4190 con 0x7f019c10f940 2024-07-26T12:59:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.654+0000 7f0199e00640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f01800b3bd0 0x7f01800b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.655+0000 7f0199e00640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f01800b3bd0 0x7f01800b60e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f018c009bd0 tx=0x7f018c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.659+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f01940ab7a0 con 0x7f019c10f940 2024-07-26T12:59:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.955+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f019c19cf60 con 0x7f019c10f940 2024-07-26T12:59:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.958+0000 7f0192a00640 1 -- 172.21.15.40:0/3190481145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f01940ab0a0 con 0x7f019c10f940 2024-07-26T12:59:46.960 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T12:59:46.960 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T12:59:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T12:59:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.961+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f01800b3bd0 msgr2=0x7f01800b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.961+0000 7f019b200640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f01800b3bd0 0x7f01800b60e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f018c009bd0 tx=0x7f018c005f90 comp rx=0 tx=0).stop 2024-07-26T12:59:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.961+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 msgr2=0x7f019c1a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.961+0000 7f019b200640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 0x7f019c1a1670 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f019400eb10 tx=0x7f019400c2d0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 shutdown_connections 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019c10f940 0x7f019c1a1670 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f019c075b30 0x7f019c19c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f01800b3bd0 0x7f01800b60e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 --2- 172.21.15.40:0/3190481145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0751e0 0x7f019c19be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 >> 172.21.15.40:0/3190481145 conn(0x7f019c0fee30 msgr2=0x7f019c1094e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 shutdown_connections 2024-07-26T12:59:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:46.962+0000 7f019b200640 1 -- 172.21.15.40:0/3190481145 wait complete. 2024-07-26T12:59:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:46 smithi040 ceph-mon[32397]: pgmap v1625: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:59:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:46 smithi146 ceph-mon[35807]: pgmap v1625: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:59:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:46 smithi076 ceph-mon[35401]: pgmap v1625: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T12:59:47.783 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 133.6 --await-for 45.0' 2024-07-26T12:59:47.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 133.6 --await-for 45.0 2024-07-26T12:59:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:47 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3190481145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:59:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:47 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3190481145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:59:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:47 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3190481145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T12:59:48.310 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:59:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:48 smithi146 ceph-mon[35807]: pgmap v1626: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:48 smithi076 ceph-mon[35401]: pgmap v1626: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:48 smithi040 ceph-mon[32397]: pgmap v1626: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T12:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 -- 172.21.15.40:0/3689171886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048113e70 msgr2=0x7fe048116340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 --2- 172.21.15.40:0/3689171886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048113e70 0x7fe048116340 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe040009ca0 tx=0x7fe04002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 -- 172.21.15.40:0/3689171886 shutdown_connections 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 --2- 172.21.15.40:0/3689171886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048113e70 0x7fe048116340 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 --2- 172.21.15.40:0/3689171886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048075800 0x7fe048075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 --2- 172.21.15.40:0/3689171886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe048076db0 0x7fe0480751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 -- 172.21.15.40:0/3689171886 >> 172.21.15.40:0/3689171886 conn(0x7fe0480fefd0 msgr2=0x7fe048101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 -- 172.21.15.40:0/3689171886 shutdown_connections 2024-07-26T12:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.645+0000 7fe04d800640 1 -- 172.21.15.40:0/3689171886 wait complete. 2024-07-26T12:59:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.646+0000 7fe04d800640 1 Processor -- start 2024-07-26T12:59:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 -- start start 2024-07-26T12:59:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe048075800 0x7fe0481a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 0x7fe0481a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048113e70 0x7fe0481a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481199b0 con 0x7fe048076db0 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe048119830 con 0x7fe048075800 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.647+0000 7fe04d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe048119b30 con 0x7fe048113e70 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 0x7fe0481a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 0x7fe0481a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50150/0 (socket says 172.21.15.40:50150) 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 -- 172.21.15.40:0/520184644 learned_addr learned my addr 172.21.15.40:0/520184644 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046a00640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe048075800 0x7fe0481a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe047400640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048113e70 0x7fe0481a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 -- 172.21.15.40:0/520184644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048113e70 msgr2=0x7fe0481a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048113e70 0x7fe0481a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 -- 172.21.15.40:0/520184644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe048075800 msgr2=0x7fe0481a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe048075800 0x7fe0481a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe046000640 1 -- 172.21.15.40:0/520184644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0481a6210 con 0x7fe048076db0 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.648+0000 7fe047400640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048113e70 0x7fe0481a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.649+0000 7fe046000640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 0x7fe0481a0900 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c970 tx=0x7fe03400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.649+0000 7fe03f400640 1 -- 172.21.15.40:0/520184644 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034014070 con 0x7fe048076db0 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.649+0000 7fe03f400640 1 -- 172.21.15.40:0/520184644 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe034004440 con 0x7fe048076db0 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.649+0000 7fe03f400640 1 -- 172.21.15.40:0/520184644 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034003d40 con 0x7fe048076db0 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.649+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0481a6500 con 0x7fe048076db0 2024-07-26T12:59:50.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.650+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0481acd20 con 0x7fe048076db0 2024-07-26T12:59:50.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 Processor -- start 2024-07-26T12:59:50.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 -- start start 2024-07-26T12:59:50.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f886c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84a5b60 0x5637f886cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5637f8836d10 con 0x5637f849d980 2024-07-26T12:59:50.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.655+0000 7fe0543d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5637f87e1b60 con 0x5637f84a5b60 2024-07-26T12:59:50.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.656+0000 7fe0543d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5637f87d1060 con 0x5637f84c6840 2024-07-26T12:59:50.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.656+0000 7fe03f400640 1 -- 172.21.15.40:0/520184644 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe034017070 con 0x7fe048076db0 2024-07-26T12:59:50.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.656+0000 7fe047400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f886c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.656+0000 7fe047400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f886c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:58458/0 (socket says 172.21.15.40:58458) 2024-07-26T12:59:50.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.656+0000 7fe047400640 1 -- 172.21.15.40:0/1489776520 learned_addr learned my addr 172.21.15.40:0/1489776520 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:50.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.656+0000 7fe046a00640 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.657+0000 7fe046000640 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84a5b60 0x5637f886cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.657+0000 7fe046a00640 1 -- 172.21.15.40:0/1489776520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 msgr2=0x5637f886c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.657+0000 7fe046a00640 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f886c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.657+0000 7fe046a00640 1 -- 172.21.15.40:0/1489776520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84a5b60 msgr2=0x5637f886cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.657+0000 7fe046a00640 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84a5b60 0x5637f886cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.657+0000 7fe046a00640 1 -- 172.21.15.40:0/1489776520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f8758b10 con 0x5637f849d980 2024-07-26T12:59:50.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.658+0000 7fe03f400640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe02c0b3c80 0x7fe02c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.658+0000 7fe046a00640 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886c700 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe03800bbf0 tx=0x7fe0380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7352904095ea674 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:50.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.659+0000 7fe03f400640 1 -- 172.21.15.40:0/520184644 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0340e36c0 con 0x7fe048076db0 2024-07-26T12:59:50.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.659+0000 7fe047400640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe02c0b3c80 0x7fe02c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.659+0000 7fe033e00640 1 -- 172.21.15.40:0/1489776520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038004030 con 0x5637f849d980 2024-07-26T12:59:50.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.659+0000 7fe033e00640 1 -- 172.21.15.40:0/1489776520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0380035f0 con 0x5637f849d980 2024-07-26T12:59:50.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.659+0000 7fe033e00640 1 -- 172.21.15.40:0/1489776520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038011680 con 0x5637f849d980 2024-07-26T12:59:50.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.660+0000 7fe0543d3740 1 -- 172.21.15.40:0/1489776520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 msgr2=0x5637f886c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.660+0000 7fe047400640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe02c0b3c80 0x7fe02c0b6190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe040009a60 tx=0x7fe040004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:50.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.660+0000 7fe0543d3740 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886c700 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe03800bbf0 tx=0x7fe0380107a0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 -- 172.21.15.40:0/1489776520 shutdown_connections 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84a5b60 0x5637f886cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886c700 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 --2- 172.21.15.40:0/1489776520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f886c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 -- 172.21.15.40:0/1489776520 >> 172.21.15.40:0/1489776520 conn(0x5637f84ba990 msgr2=0x5637f886a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 -- 172.21.15.40:0/1489776520 shutdown_connections 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.661+0000 7fe0543d3740 1 -- 172.21.15.40:0/1489776520 wait complete. 2024-07-26T12:59:50.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.662+0000 7fe0543d3740 1 -- start start 2024-07-26T12:59:50.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.662+0000 7fe0543d3740 1 Processor -- start 2024-07-26T12:59:50.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f849d980 0x5637f8877cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 0x5637f8878200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f8883b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5637f876d520 con 0x5637f84a5b60 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5637f87d50a0 con 0x5637f849d980 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5637f86347a0 con 0x5637f84c6840 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe0543d3740 10 client.0 _ll_register_callbacks cb 0x5637f87c9bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe046000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 0x5637f8878200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe046000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 0x5637f8878200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50170/0 (socket says 172.21.15.40:50170) 2024-07-26T12:59:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.663+0000 7fe046000640 1 -- 172.21.15.40:0/2322582637 learned_addr learned my addr 172.21.15.40:0/2322582637 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:50.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046a00640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f849d980 0x5637f8877cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe047400640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f8883b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046000640 1 -- 172.21.15.40:0/2322582637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 msgr2=0x5637f8883b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046000640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f8883b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046000640 1 -- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f849d980 msgr2=0x5637f8877cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046000640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f849d980 0x5637f8877cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046000640 1 -- 172.21.15.40:0/2322582637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f8540b90 con 0x5637f84a5b60 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.664+0000 7fe046a00640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f849d980 0x5637f8877cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.665+0000 7fe046000640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 0x5637f8878200 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe0340aa5a0 tx=0x7fe0340aa4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d91939a4a9e8335 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.665+0000 7fe030c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.665+0000 7fe030c00640 1 -- 172.21.15.40:0/2322582637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340aad10 con 0x5637f84a5b60 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.665+0000 7fe030c00640 1 -- 172.21.15.40:0/2322582637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0340a68a0 con 0x5637f84a5b60 2024-07-26T12:59:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.665+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0380035f0 con 0x5637f84a5b60 2024-07-26T12:59:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.665+0000 7fe030c00640 1 -- 172.21.15.40:0/2322582637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe0340aa610 con 0x5637f84a5b60 2024-07-26T12:59:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe0543d3740 10 client.16821 fetch_fsmap learned FSMap version 35 2024-07-26T12:59:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5637f88867e0 con 0x5637f84a5b60 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe030c00640 1 -- 172.21.15.40:0/2322582637 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0380035f0 con 0x5637f84a5b60 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe030c00640 1 -- 172.21.15.40:0/2322582637 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe0340cbb10 con 0x5637f84a5b60 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe0543d3740 10 client.16821 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe0543d3740 10 client.16821 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.666+0000 7fe0543d3740 20 client.16821 populate_metadata read hostname 'smithi040' 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.667+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f84851c0 0x5637f8889ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.667+0000 7fe0543d3740 4 client.16821 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.667+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637f87e3ab0 con 0x5637f84851c0 2024-07-26T12:59:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.667+0000 7fe046a00640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f84851c0 0x5637f8889ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.668+0000 7fe046a00640 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f84851c0 0x5637f8889ce0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5542cf31d559e5c server_cookie=357c47850e86759b in_seq=0 out_seq=0 2024-07-26T12:59:50.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.668+0000 7fe030c00640 10 client.16821 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:59:50.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.670+0000 7fe030c00640 1 -- 172.21.15.40:0/2322582637 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637f87e3ab0 con 0x5637f84851c0 2024-07-26T12:59:50.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.670+0000 7fe030c00640 10 client.16821 handle_command_reply: tid=0 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.670+0000 7fe0543d3740 1 client.16821 shutdown 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 msgr2=0x5637f8878200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 0x5637f8878200 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe0340aa5a0 tx=0x7fe0340aa4a0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 shutdown_connections 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f8883b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f84851c0 0x5637f8889ce0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f84a5b60 0x5637f8878200 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2322582637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f849d980 0x5637f8877cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 >> 172.21.15.40:0/2322582637 conn(0x5637f84ba990 msgr2=0x5637f886f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:50.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe030c00640 0 client.16821 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:59:50.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.671+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 shutdown_connections 2024-07-26T12:59:50.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.672+0000 7fe0543d3740 1 -- 172.21.15.40:0/2322582637 wait complete. 2024-07-26T12:59:50.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.672+0000 7fe0543d3740 20 client.16821 trim_cache size 0 max 16384 2024-07-26T12:59:50.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 Processor -- start 2024-07-26T12:59:50.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 -- start start 2024-07-26T12:59:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f88799a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f845a570 0x5637f886d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481b53e0 con 0x5637f849d980 2024-07-26T12:59:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481b6f20 con 0x5637f845a570 2024-07-26T12:59:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe0543d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481b5ab0 con 0x5637f84c6840 2024-07-26T12:59:50.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.693+0000 7fe046a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50178/0 (socket says 172.21.15.40:50178) 2024-07-26T12:59:50.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 -- 172.21.15.40:0/2622814061 learned_addr learned my addr 172.21.15.40:0/2622814061 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046000640 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f88799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe047400640 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f845a570 0x5637f886d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 -- 172.21.15.40:0/2622814061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 msgr2=0x5637f88799a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f88799a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 -- 172.21.15.40:0/2622814061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f845a570 msgr2=0x5637f886d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f845a570 0x5637f886d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 -- 172.21.15.40:0/2622814061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f8870110 con 0x5637f849d980 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.694+0000 7fe046a00640 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886f930 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x5637f886ae40 tx=0x7fe03800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ea2c186844a729 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.695+0000 7fe033400640 1 -- 172.21.15.40:0/2622814061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038005240 con 0x5637f849d980 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.695+0000 7fe033400640 1 -- 172.21.15.40:0/2622814061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0380053e0 con 0x5637f849d980 2024-07-26T12:59:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.695+0000 7fe033400640 1 -- 172.21.15.40:0/2622814061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380266e0 con 0x5637f849d980 2024-07-26T12:59:50.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 -- 172.21.15.40:0/2622814061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 msgr2=0x5637f886f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886f930 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x5637f886ae40 tx=0x7fe03800b900 comp rx=0 tx=0).stop 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 -- 172.21.15.40:0/2622814061 shutdown_connections 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f845a570 0x5637f886d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f84c6840 0x5637f88799a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 --2- 172.21.15.40:0/2622814061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f886f930 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 -- 172.21.15.40:0/2622814061 >> 172.21.15.40:0/2622814061 conn(0x5637f84ba990 msgr2=0x5637f886d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 -- 172.21.15.40:0/2622814061 shutdown_connections 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.696+0000 7fe0543d3740 1 -- 172.21.15.40:0/2622814061 wait complete. 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.697+0000 7fe0543d3740 1 -- start start 2024-07-26T12:59:50.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.697+0000 7fe0543d3740 1 Processor -- start 2024-07-26T12:59:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f845a570 0x5637f887bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f887c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84c6840 0x5637f88f1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481b6850 con 0x5637f849d980 2024-07-26T12:59:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481b6180 con 0x5637f84c6840 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481b33a0 con 0x5637f845a570 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe0543d3740 10 client.0 _ll_register_callbacks cb 0x7fe034003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe046000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f887c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe046000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f887c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50190/0 (socket says 172.21.15.40:50190) 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe046000640 1 -- 172.21.15.40:0/136398097 learned_addr learned my addr 172.21.15.40:0/136398097 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.698+0000 7fe046a00640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f845a570 0x5637f887bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe047400640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84c6840 0x5637f88f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe046000640 1 -- 172.21.15.40:0/136398097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f845a570 msgr2=0x5637f887bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe046000640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f845a570 0x5637f887bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe046000640 1 -- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84c6840 msgr2=0x5637f88f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T12:59:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe046000640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84c6840 0x5637f88f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe046000640 1 -- 172.21.15.40:0/136398097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f887c900 con 0x5637f849d980 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe046000640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f887c0f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe0340e9190 tx=0x7fe0340e3b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13507a32c3cbc135 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe030c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.699+0000 7fe030c00640 1 -- 172.21.15.40:0/136398097 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03408a060 con 0x5637f849d980 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.700+0000 7fe030c00640 1 -- 172.21.15.40:0/136398097 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0340a68a0 con 0x5637f849d980 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.700+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0380053e0 con 0x5637f849d980 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.700+0000 7fe030c00640 1 -- 172.21.15.40:0/136398097 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe0340a64d0 con 0x5637f849d980 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.700+0000 7fe0543d3740 10 client.16827 fetch_fsmap learned FSMap version 35 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.700+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5637f88f2950 con 0x5637f849d980 2024-07-26T12:59:50.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.700+0000 7fe030c00640 1 -- 172.21.15.40:0/136398097 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0380053e0 con 0x5637f849d980 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe030c00640 1 -- 172.21.15.40:0/136398097 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe03408f070 con 0x5637f849d980 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe0543d3740 10 client.16827 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe0543d3740 10 client.16827 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe0543d3740 20 client.16827 populate_metadata read hostname 'smithi040' 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe0543d3740 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f88f2fe0 0x5637f88f5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe0543d3740 4 client.16827 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.6, "await_for": 45.0}] 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.6, "await_for": 45.0}) -- 0x5637f87df550 con 0x5637f88f2fe0 2024-07-26T12:59:50.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.701+0000 7fe046a00640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f88f2fe0 0x5637f88f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:50.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.702+0000 7fe046a00640 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f88f2fe0 0x5637f88f5400 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1509a63284d63954 server_cookie=a561e847e82c71ff in_seq=0 out_seq=0 2024-07-26T12:59:50.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.702+0000 7fe030c00640 10 client.16827 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T12:59:50.956 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:50 smithi040 ceph-mon[32397]: pgmap v1627: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 MiB/s wr, 15 op/s 2024-07-26T12:59:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe030c00640 1 -- 172.21.15.40:0/136398097 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5637f87df550 con 0x5637f88f2fe0 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe030c00640 10 client.16827 handle_command_reply: tid=0 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe0543d3740 1 client.16827 shutdown 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 msgr2=0x5637f887c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe0543d3740 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f887c0f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe0340e9190 tx=0x7fe0340e3b60 comp rx=0 tx=0).stop 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 shutdown_connections 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe0543d3740 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637f84c6840 0x5637f88f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.954+0000 7fe0543d3740 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5637f88f2fe0 0x5637f88f5400 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.955+0000 7fe0543d3740 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5637f849d980 0x5637f887c0f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.955+0000 7fe030c00640 0 client.16827 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.955+0000 7fe0543d3740 1 --2- 172.21.15.40:0/136398097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637f845a570 0x5637f887bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.955+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 >> 172.21.15.40:0/136398097 conn(0x5637f84ba990 msgr2=0x5637f8879740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.955+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 shutdown_connections 2024-07-26T12:59:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.955+0000 7fe0543d3740 1 -- 172.21.15.40:0/136398097 wait complete. 2024-07-26T12:59:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.956+0000 7fe0543d3740 20 client.16827 trim_cache size 0 max 16384 2024-07-26T12:59:50.959 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T12:59:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T12:59:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T12:59:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 114, 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "5d91279b": { 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 114, 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 133.6, 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T12:59:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T12:59:50.961 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.957+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe02c0b3c80 msgr2=0x7fe02c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.957+0000 7fe04d800640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe02c0b3c80 0x7fe02c0b6190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe040009a60 tx=0x7fe040004a60 comp rx=0 tx=0).stop 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.957+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 msgr2=0x7fe0481a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.957+0000 7fe04d800640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 0x7fe0481a0900 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c970 tx=0x7fe03400ce30 comp rx=0 tx=0).stop 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 shutdown_connections 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe02c0b3c80 0x7fe02c0b6190 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe048113e70 0x7fe0481a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe048076db0 0x7fe0481a0900 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 --2- 172.21.15.40:0/520184644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe048075800 0x7fe0481a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 >> 172.21.15.40:0/520184644 conn(0x7fe0480fefd0 msgr2=0x7fe04810fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 shutdown_connections 2024-07-26T12:59:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:50.958+0000 7fe04d800640 1 -- 172.21.15.40:0/520184644 wait complete. 2024-07-26T12:59:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:50 smithi146 ceph-mon[35807]: pgmap v1627: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 MiB/s wr, 15 op/s 2024-07-26T12:59:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:50 smithi076 ceph-mon[35401]: pgmap v1627: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 MiB/s wr, 15 op/s 2024-07-26T12:59:52.758 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5d91279b', quiesce took 9.3 seconds. Will release after: 4.299999999999999 2024-07-26T12:59:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:52 smithi040 ceph-mon[32397]: pgmap v1628: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.0 MiB/s wr, 10 op/s 2024-07-26T12:59:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:52 smithi146 ceph-mon[35807]: pgmap v1628: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.0 MiB/s wr, 10 op/s 2024-07-26T12:59:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:52 smithi076 ceph-mon[35401]: pgmap v1628: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.0 MiB/s wr, 10 op/s 2024-07-26T12:59:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:54 smithi146 ceph-mon[35807]: pgmap v1629: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:59:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:54 smithi076 ceph-mon[35401]: pgmap v1629: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:59:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:54 smithi040 ceph-mon[32397]: pgmap v1629: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T12:59:57.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T12:59:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:56 smithi146 ceph-mon[35807]: pgmap v1630: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:59:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:56 smithi076 ceph-mon[35401]: pgmap v1630: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:59:57.143 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:56 smithi040 ceph-mon[32397]: pgmap v1630: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T12:59:57.558 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T12:59:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 12:59:58 smithi040 ceph-mon[32397]: pgmap v1631: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.6 MiB/s wr, 10 op/s 2024-07-26T12:59:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 12:59:58 smithi146 ceph-mon[35807]: pgmap v1631: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.6 MiB/s wr, 10 op/s 2024-07-26T12:59:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 12:59:58 smithi076 ceph-mon[35401]: pgmap v1631: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.6 MiB/s wr, 10 op/s 2024-07-26T12:59:59.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 -- 172.21.15.40:0/1996627499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18109670 msgr2=0x7ffa1810fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:59.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/1996627499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18109670 0x7ffa1810fea0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009ca0 tx=0x7ffa1002a8c0 comp rx=0 tx=0).stop 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 -- 172.21.15.40:0/1996627499 shutdown_connections 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/1996627499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18109670 0x7ffa1810fea0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/1996627499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa18108d20 0x7ffa18109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/1996627499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa181033e0 0x7ffa181037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 -- 172.21.15.40:0/1996627499 >> 172.21.15.40:0/1996627499 conn(0x7ffa180fee30 msgr2=0x7ffa18101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 -- 172.21.15.40:0/1996627499 shutdown_connections 2024-07-26T12:59:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.882+0000 7ffa1ca00640 1 -- 172.21.15.40:0/1996627499 wait complete. 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.883+0000 7ffa1ca00640 1 Processor -- start 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 -- start start 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa181033e0 0x7ffa1819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 0x7ffa1819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa18109670 0x7ffa181a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa18113240 con 0x7ffa18108d20 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffa181130c0 con 0x7ffa181033e0 2024-07-26T12:59:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.884+0000 7ffa1ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa181133c0 con 0x7ffa18109670 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 0x7ffa1819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 0x7ffa1819c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34032/0 (socket says 172.21.15.40:34032) 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 -- 172.21.15.40:0/277680733 learned_addr learned my addr 172.21.15.40:0/277680733 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa17e00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa18109670 0x7ffa181a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa17400640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa181033e0 0x7ffa1819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 -- 172.21.15.40:0/277680733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa18109670 msgr2=0x7ffa181a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa18109670 0x7ffa181a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 -- 172.21.15.40:0/277680733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa181033e0 msgr2=0x7ffa1819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa181033e0 0x7ffa1819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.885+0000 7ffa16a00640 1 -- 172.21.15.40:0/277680733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa181a1d60 con 0x7ffa18108d20 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.886+0000 7ffa16a00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 0x7ffa1819c390 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d750 tx=0x7ffa0400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.886+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04017070 con 0x7ffa18108d20 2024-07-26T12:59:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.886+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa040054b0 con 0x7ffa18108d20 2024-07-26T12:59:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.886+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa181a2050 con 0x7ffa18108d20 2024-07-26T12:59:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.886+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04004bc0 con 0x7ffa18108d20 2024-07-26T12:59:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.886+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa181a87b0 con 0x7ffa18108d20 2024-07-26T12:59:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.888+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa181037f0 con 0x7ffa18108d20 2024-07-26T12:59:59.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.894+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffa04009c30 con 0x7ffa18108d20 2024-07-26T12:59:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.895+0000 7ffa0fe00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9fc0b3c50 0x7ff9fc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T12:59:59.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.896+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffa040e38f0 con 0x7ffa18108d20 2024-07-26T12:59:59.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.896+0000 7ffa17400640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9fc0b3c50 0x7ff9fc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T12:59:59.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.896+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffa040aa930 con 0x7ffa18108d20 2024-07-26T12:59:59.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T12:59:59.897+0000 7ffa17400640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9fc0b3c50 0x7ff9fc0b6160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800bbe0 tx=0x7ffa0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:00.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.141+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa181a8a90 con 0x7ffa18108d20 2024-07-26T13:00:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.143+0000 7ffa0fe00640 1 -- 172.21.15.40:0/277680733 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ffa040aee80 con 0x7ffa18108d20 2024-07-26T13:00:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:00:00.145 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:00:00.145 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:00:00.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9fc0b3c50 msgr2=0x7ff9fc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9fc0b3c50 0x7ff9fc0b6160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800bbe0 tx=0x7ffa0800b390 comp rx=0 tx=0).stop 2024-07-26T13:00:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 msgr2=0x7ffa1819c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 0x7ffa1819c390 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d750 tx=0x7ffa0400dc10 comp rx=0 tx=0).stop 2024-07-26T13:00:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 shutdown_connections 2024-07-26T13:00:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9fc0b3c50 0x7ff9fc0b6160 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:00.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa18109670 0x7ffa181a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:00.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa18108d20 0x7ffa1819c390 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:00.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 --2- 172.21.15.40:0/277680733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffa181033e0 0x7ffa1819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:00.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 >> 172.21.15.40:0/277680733 conn(0x7ffa180fee30 msgr2=0x7ffa18108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:00.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.147+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 shutdown_connections 2024-07-26T13:00:00.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:00.148+0000 7ffa1ca00640 1 -- 172.21.15.40:0/277680733 wait complete. 2024-07-26T13:00:01.016 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 5d91279b --release --await' 2024-07-26T13:00:01.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 5d91279b --release --await 2024-07-26T13:00:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:00 smithi146 ceph-mon[35807]: pgmap v1632: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T13:00:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T13:00:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:00 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/277680733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:00 smithi076 ceph-mon[35401]: pgmap v1632: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T13:00:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T13:00:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:00 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/277680733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:01.099 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:00 smithi040 ceph-mon[32397]: pgmap v1632: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T13:00:01.099 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T13:00:01.099 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:00 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/277680733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:00:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:02 smithi040 ceph-mon[32397]: pgmap v1633: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-07-26T13:00:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:02 smithi146 ceph-mon[35807]: pgmap v1633: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-07-26T13:00:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:02 smithi076 ceph-mon[35401]: pgmap v1633: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-07-26T13:00:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 -- 172.21.15.40:0/3135022057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 msgr2=0x7f0674109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 --2- 172.21.15.40:0/3135022057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f0674109e00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f0668009900 tx=0x7f066802a410 comp rx=0 tx=0).stop 2024-07-26T13:00:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 -- 172.21.15.40:0/3135022057 shutdown_connections 2024-07-26T13:00:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 --2- 172.21.15.40:0/3135022057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f067410fc80 0x7f06741164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 --2- 172.21.15.40:0/3135022057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f067410f330 0x7f067410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 --2- 172.21.15.40:0/3135022057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f0674109e00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 -- 172.21.15.40:0/3135022057 >> 172.21.15.40:0/3135022057 conn(0x7f0674078ff0 msgr2=0x7f0674107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 -- 172.21.15.40:0/3135022057 shutdown_connections 2024-07-26T13:00:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.932+0000 7f067ae00640 1 -- 172.21.15.40:0/3135022057 wait complete. 2024-07-26T13:00:03.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.933+0000 7f067ae00640 1 Processor -- start 2024-07-26T13:00:03.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.933+0000 7f067ae00640 1 -- start start 2024-07-26T13:00:03.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f06741a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f067410f330 0x7f06741a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f067410fc80 0x7f06741a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067ae00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f06741198a0 con 0x7f06741099f0 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0674119720 con 0x7f067410f330 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0674119a20 con 0x7f067410fc80 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f0679a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f06741a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f0679a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f06741a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59312/0 (socket says 172.21.15.40:59312) 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f0679a00640 1 -- 172.21.15.40:0/3594171432 learned_addr learned my addr 172.21.15.40:0/3594171432 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f0679000640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f067410f330 0x7f06741a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.934+0000 7f067a400640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f067410fc80 0x7f06741a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0679a00640 1 -- 172.21.15.40:0/3594171432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f067410fc80 msgr2=0x7f06741a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:03.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0679a00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f067410fc80 0x7f06741a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0679a00640 1 -- 172.21.15.40:0/3594171432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f067410f330 msgr2=0x7f06741a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:03.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0679a00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f067410f330 0x7f06741a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0679a00640 1 -- 172.21.15.40:0/3594171432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06741a6240 con 0x7f06741099f0 2024-07-26T13:00:03.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0679a00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f06741a02d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f066802a930 tx=0x7f0668003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:03.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0672000640 1 -- 172.21.15.40:0/3594171432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066803f070 con 0x7f06741099f0 2024-07-26T13:00:03.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f0672000640 1 -- 172.21.15.40:0/3594171432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f066803bdc0 con 0x7f06741099f0 2024-07-26T13:00:03.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.935+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06741a64d0 con 0x7f06741099f0 2024-07-26T13:00:03.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.936+0000 7f0672000640 1 -- 172.21.15.40:0/3594171432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668035030 con 0x7f06741099f0 2024-07-26T13:00:03.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.936+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06741acc90 con 0x7f06741099f0 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.939+0000 7f0683023740 1 Processor -- start 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.939+0000 7f0683023740 1 -- start start 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0672000640 1 -- 172.21.15.40:0/3594171432 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0668042070 con 0x7f06741099f0 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0683023740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00ae8e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0683023740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae8e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0683023740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae8ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0683023740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a00ae04f30 con 0x55a00aac8840 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0683023740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a00adf4430 con 0x55a00aac0660 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0683023740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a00adf8470 con 0x55a00aae9520 2024-07-26T13:00:03.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0679000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae8ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0679000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae8ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59316/0 (socket says 172.21.15.40:59316) 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.940+0000 7f0679000640 1 -- 172.21.15.40:0/4006542649 learned_addr learned my addr 172.21.15.40:0/4006542649 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679a00640 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae8e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f067a400640 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00ae8e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679000640 1 -- 172.21.15.40:0/4006542649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 msgr2=0x55a00ae8e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679000640 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00ae8e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679000640 1 -- 172.21.15.40:0/4006542649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 msgr2=0x55a00ae8e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679000640 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae8e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679000640 1 -- 172.21.15.40:0/4006542649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a00ab54b00 con 0x55a00aac8840 2024-07-26T13:00:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679a00640 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae8e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.941+0000 7f0679000640 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae8ec00 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f066000b790 tx=0x7f066000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11de60ca75cfee04 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.942+0000 7f0672000640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3bd0 0x7f065c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.942+0000 7f0666a00640 1 -- 172.21.15.40:0/4006542649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000d950 con 0x55a00aac8840 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.942+0000 7f0666a00640 1 -- 172.21.15.40:0/4006542649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0660018070 con 0x55a00aac8840 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.942+0000 7f0666a00640 1 -- 172.21.15.40:0/4006542649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660013e30 con 0x55a00aac8840 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.942+0000 7f0672000640 1 -- 172.21.15.40:0/3594171432 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06681046c0 con 0x7f06741099f0 2024-07-26T13:00:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.942+0000 7f067a400640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3bd0 0x7f065c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 -- 172.21.15.40:0/4006542649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 msgr2=0x55a00ae8ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae8ec00 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f066000b790 tx=0x7f066000bc50 comp rx=0 tx=0).stop 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f067a400640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3bd0 0x7f065c0b60e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f066c008da0 tx=0x7f066c008370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 -- 172.21.15.40:0/4006542649 shutdown_connections 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae8ec00 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae8e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 --2- 172.21.15.40:0/4006542649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00ae8e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 -- 172.21.15.40:0/4006542649 >> 172.21.15.40:0/4006542649 conn(0x55a00aadd910 msgr2=0x55a00ae8c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 -- 172.21.15.40:0/4006542649 shutdown_connections 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.943+0000 7f0683023740 1 -- 172.21.15.40:0/4006542649 wait complete. 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.944+0000 7f0683023740 1 -- start start 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.944+0000 7f0683023740 1 Processor -- start 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 0x55a00ae997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac8840 0x55a00ae99d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aae9520 0x55a00ae9a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a00ac57bb0 con 0x55a00aac0660 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a00ad90910 con 0x55a00aae9520 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a00ae9c960 con 0x55a00aac8840 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0683023740 10 client.0 _ll_register_callbacks cb 0x55a00ab00d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0679a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 0x55a00ae997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0679a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 0x55a00ae997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59330/0 (socket says 172.21.15.40:59330) 2024-07-26T13:00:03.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.945+0000 7f0679a00640 1 -- 172.21.15.40:0/3629796732 learned_addr learned my addr 172.21.15.40:0/3629796732 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679000640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac8840 0x55a00ae99d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f067a400640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aae9520 0x55a00ae9a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679a00640 1 -- 172.21.15.40:0/3629796732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac8840 msgr2=0x55a00ae99d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679a00640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac8840 0x55a00ae99d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679a00640 1 -- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aae9520 msgr2=0x55a00ae9a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679a00640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aae9520 0x55a00ae9a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679a00640 1 -- 172.21.15.40:0/3629796732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a00abcb960 con 0x55a00aac0660 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f0679a00640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 0x55a00ae997c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f06680c8880 tx=0x7f06680cb4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3efe693a685755 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.946+0000 7f065b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f065b400640 1 -- 172.21.15.40:0/3629796732 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668049070 con 0x55a00aac0660 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f065b400640 1 -- 172.21.15.40:0/3629796732 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06680c78a0 con 0x55a00aac0660 2024-07-26T13:00:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0660018070 con 0x55a00aac0660 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f065b400640 1 -- 172.21.15.40:0/3629796732 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f06680cbd10 con 0x55a00aac0660 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f0683023740 10 client.16845 fetch_fsmap learned FSMap version 35 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a00aea8600 con 0x55a00aac0660 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.947+0000 7f065b400640 1 -- 172.21.15.40:0/3629796732 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0660018070 con 0x55a00aac0660 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f065b400640 1 -- 172.21.15.40:0/3629796732 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0668031520 con 0x55a00aac0660 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0683023740 10 client.16845 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0683023740 10 client.16845 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0683023740 20 client.16845 populate_metadata read hostname 'smithi040' 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0683023740 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aaa7ea0 0x55a00aeab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0683023740 4 client.16845 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a00ae06e80 con 0x55a00aaa7ea0 2024-07-26T13:00:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.948+0000 7f0679000640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aaa7ea0 0x55a00aeab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.949+0000 7f0679000640 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aaa7ea0 0x55a00aeab9c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d25dcb76ce56bbf server_cookie=92ffe1826e5f598d in_seq=0 out_seq=0 2024-07-26T13:00:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.949+0000 7f065b400640 10 client.16845 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f065b400640 1 -- 172.21.15.40:0/3629796732 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a00ae06e80 con 0x55a00aaa7ea0 2024-07-26T13:00:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f065b400640 10 client.16845 handle_command_reply: tid=0 2024-07-26T13:00:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 client.16845 shutdown 2024-07-26T13:00:03.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 msgr2=0x55a00ae997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:03.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 0x55a00ae997c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f06680c8880 tx=0x7f06680cb4a0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 shutdown_connections 2024-07-26T13:00:03.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aae9520 0x55a00ae9a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac8840 0x55a00ae99d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aaa7ea0 0x55a00aeab9c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 --2- 172.21.15.40:0/3629796732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac0660 0x55a00ae997c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 >> 172.21.15.40:0/3629796732 conn(0x55a00aadd910 msgr2=0x55a00ae91310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f065b400640 0 client.16845 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 shutdown_connections 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.952+0000 7f0683023740 1 -- 172.21.15.40:0/3629796732 wait complete. 2024-07-26T13:00:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.953+0000 7f0683023740 20 client.16845 trim_cache size 0 max 16384 2024-07-26T13:00:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.971+0000 7f0683023740 1 Processor -- start 2024-07-26T13:00:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.971+0000 7f0683023740 1 -- start start 2024-07-26T13:00:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f0683023740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac0660 0x55a00ae9b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f0683023740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac8840 0x55a00ae8b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f0683023740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 0x55a00ae8bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f0683023740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f06741b52c0 con 0x55a00aae9520 2024-07-26T13:00:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f0683023740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06741b6e00 con 0x55a00aac8840 2024-07-26T13:00:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f0683023740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f06741b5990 con 0x55a00aac0660 2024-07-26T13:00:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f067a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 0x55a00ae8bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f067a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 0x55a00ae8bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59344/0 (socket says 172.21.15.40:59344) 2024-07-26T13:00:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.972+0000 7f067a400640 1 -- 172.21.15.40:0/3975548100 learned_addr learned my addr 172.21.15.40:0/3975548100 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f0679a00640 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac0660 0x55a00ae9b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f0679000640 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac8840 0x55a00ae8b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f067a400640 1 -- 172.21.15.40:0/3975548100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac0660 msgr2=0x55a00ae9b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f067a400640 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac0660 0x55a00ae9b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f067a400640 1 -- 172.21.15.40:0/3975548100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac8840 msgr2=0x55a00ae8b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f067a400640 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac8840 0x55a00ae8b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f067a400640 1 -- 172.21.15.40:0/3975548100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a00ae90470 con 0x55a00aae9520 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.973+0000 7f0679000640 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac8840 0x55a00ae8b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.974+0000 7f067a400640 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 0x55a00ae8bb60 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f066c0117c0 tx=0x7f066c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c504bc1c61f783 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.974+0000 7f0666000640 1 -- 172.21.15.40:0/3975548100 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c01e780 con 0x55a00aae9520 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.974+0000 7f0666000640 1 -- 172.21.15.40:0/3975548100 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f066c01edb0 con 0x55a00aae9520 2024-07-26T13:00:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.974+0000 7f0666000640 1 -- 172.21.15.40:0/3975548100 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c01fdb0 con 0x55a00aae9520 2024-07-26T13:00:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 -- 172.21.15.40:0/3975548100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 msgr2=0x55a00ae8bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 0x55a00ae8bb60 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f066c0117c0 tx=0x7f066c013000 comp rx=0 tx=0).stop 2024-07-26T13:00:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 -- 172.21.15.40:0/3975548100 shutdown_connections 2024-07-26T13:00:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aae9520 0x55a00ae8bb60 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac8840 0x55a00ae8b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 --2- 172.21.15.40:0/3975548100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aac0660 0x55a00ae9b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 -- 172.21.15.40:0/3975548100 >> 172.21.15.40:0/3975548100 conn(0x55a00aadd910 msgr2=0x55a00aea53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 -- 172.21.15.40:0/3975548100 shutdown_connections 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.975+0000 7f0683023740 1 -- 172.21.15.40:0/3975548100 wait complete. 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 -- start start 2024-07-26T13:00:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 Processor -- start 2024-07-26T13:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae9e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae9e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00af13150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f06741b6730 con 0x55a00aac8840 2024-07-26T13:00:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06741b6060 con 0x55a00aac0660 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f06741b3280 con 0x55a00aae9520 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.976+0000 7f0683023740 10 client.0 _ll_register_callbacks cb 0x7f0668009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae9e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae9e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59350/0 (socket says 172.21.15.40:59350) 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 -- 172.21.15.40:0/1483253293 learned_addr learned my addr 172.21.15.40:0/1483253293 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679a00640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae9e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f067a400640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00af13150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 -- 172.21.15.40:0/1483253293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 msgr2=0x55a00af13150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00af13150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 -- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 msgr2=0x55a00ae9e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae9e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.977+0000 7f0679000640 1 -- 172.21.15.40:0/1483253293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a00af13690 con 0x55a00aac8840 2024-07-26T13:00:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.978+0000 7f0679000640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae9e700 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f066000d530 tx=0x7f0660013c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fccf5e913180175 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:03.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.978+0000 7f065b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.978+0000 7f065b400640 1 -- 172.21.15.40:0/1483253293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660029070 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.978+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f066c01edb0 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.978+0000 7f065b400640 1 -- 172.21.15.40:0/1483253293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f066000db60 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f065b400640 1 -- 172.21.15.40:0/1483253293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0660035050 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 10 client.16851 fetch_fsmap learned FSMap version 35 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a00af14a00 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f065b400640 1 -- 172.21.15.40:0/1483253293 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f066c01edb0 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f065b400640 1 -- 172.21.15.40:0/1483253293 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f06600257d0 con 0x55a00aac8840 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 10 client.16851 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 10 client.16851 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:00:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 20 client.16851 populate_metadata read hostname 'smithi040' 2024-07-26T13:00:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aa7d250 0x55a00af16eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 4 client.16851 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5d91279b", "release": true, "await": true}] 2024-07-26T13:00:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.979+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5d91279b", "release": true, "await": true}) -- 0x55a00ae02920 con 0x55a00aa7d250 2024-07-26T13:00:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.980+0000 7f0679a00640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aa7d250 0x55a00af16eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.981+0000 7f0679a00640 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aa7d250 0x55a00af16eb0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb64948ec31b3dcf server_cookie=6c490c0dae4a1bb8 in_seq=0 out_seq=0 2024-07-26T13:00:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:03.981+0000 7f065b400640 10 client.16851 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.018+0000 7f065b400640 1 -- 172.21.15.40:0/1483253293 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55a00ae02920 con 0x55a00aa7d250 2024-07-26T13:00:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.018+0000 7f065b400640 10 client.16851 handle_command_reply: tid=0 2024-07-26T13:00:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.018+0000 7f0683023740 1 client.16851 shutdown 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 msgr2=0x55a00ae9e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae9e700 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f066000d530 tx=0x7f0660013c90 comp rx=0 tx=0).stop 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 shutdown_connections 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a00aae9520 0x55a00af13150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a00aa7d250 0x55a00af16eb0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a00aac8840 0x55a00ae9e700 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 --2- 172.21.15.40:0/1483253293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a00aac0660 0x55a00ae9e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f065b400640 0 client.16851 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:04.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 >> 172.21.15.40:0/1483253293 conn(0x55a00aadd910 msgr2=0x55a00ae98040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:04.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 shutdown_connections 2024-07-26T13:00:04.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.019+0000 7f0683023740 1 -- 172.21.15.40:0/1483253293 wait complete. 2024-07-26T13:00:04.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.020+0000 7f0683023740 20 client.16851 trim_cache size 0 max 16384 2024-07-26T13:00:04.021 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 116, 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "5d91279b": { 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 116, 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:00:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 133.6, 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:04.023 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:00:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3bd0 msgr2=0x7f065c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3bd0 0x7f065c0b60e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f066c008da0 tx=0x7f066c008370 comp rx=0 tx=0).stop 2024-07-26T13:00:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 msgr2=0x7f06741a02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f06741a02d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f066802a930 tx=0x7f0668003d60 comp rx=0 tx=0).stop 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 shutdown_connections 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f065c0b3bd0 0x7f065c0b60e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f067410fc80 0x7f06741a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f067410f330 0x7f06741a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 --2- 172.21.15.40:0/3594171432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06741099f0 0x7f06741a02d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 >> 172.21.15.40:0/3594171432 conn(0x7f0674078ff0 msgr2=0x7f0674107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.021+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 shutdown_connections 2024-07-26T13:00:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:04.022+0000 7f067ae00640 1 -- 172.21.15.40:0/3594171432 wait complete. 2024-07-26T13:00:04.863 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5d91279b', total seconds elapsed: 21.4 2024-07-26T13:00:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:04 smithi146 ceph-mon[35807]: pgmap v1634: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 945 KiB/s wr, 10 op/s 2024-07-26T13:00:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:04 smithi076 ceph-mon[35401]: pgmap v1634: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 945 KiB/s wr, 10 op/s 2024-07-26T13:00:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:04 smithi040 ceph-mon[32397]: pgmap v1634: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 945 KiB/s wr, 10 op/s 2024-07-26T13:00:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:06 smithi146 ceph-mon[35807]: pgmap v1635: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 603 KiB/s wr, 11 op/s 2024-07-26T13:00:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:06 smithi076 ceph-mon[35401]: pgmap v1635: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 603 KiB/s wr, 11 op/s 2024-07-26T13:00:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:06 smithi040 ceph-mon[32397]: pgmap v1635: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 603 KiB/s wr, 11 op/s 2024-07-26T13:00:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:08 smithi146 ceph-mon[35807]: pgmap v1636: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 683 KiB/s wr, 9 op/s 2024-07-26T13:00:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:08 smithi076 ceph-mon[35401]: pgmap v1636: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 683 KiB/s wr, 9 op/s 2024-07-26T13:00:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:08 smithi040 ceph-mon[32397]: pgmap v1636: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 683 KiB/s wr, 9 op/s 2024-07-26T13:00:11.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:10 smithi146 ceph-mon[35807]: pgmap v1637: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-07-26T13:00:11.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:00:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:10 smithi076 ceph-mon[35401]: pgmap v1637: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-07-26T13:00:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:00:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:10 smithi040 ceph-mon[32397]: pgmap v1637: 97 pgs: 97 active+clean; 6.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-07-26T13:00:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:00:12.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:12.167 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:12 smithi040 ceph-mon[32397]: pgmap v1638: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:00:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:00:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:00:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:12 smithi146 ceph-mon[35807]: pgmap v1638: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:00:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:00:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:00:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:12 smithi076 ceph-mon[35401]: pgmap v1638: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:00:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:00:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:00:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:00:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:14 smithi076 ceph-mon[35401]: pgmap v1639: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:00:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:14 smithi040 ceph-mon[32397]: pgmap v1639: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:00:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:14 smithi146 ceph-mon[35807]: pgmap v1639: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:00:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:16 smithi040 ceph-mon[32397]: pgmap v1640: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 MiB/s wr, 13 op/s 2024-07-26T13:00:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:16 smithi146 ceph-mon[35807]: pgmap v1640: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 MiB/s wr, 13 op/s 2024-07-26T13:00:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:16 smithi076 ceph-mon[35401]: pgmap v1640: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 MiB/s wr, 13 op/s 2024-07-26T13:00:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:18 smithi040 ceph-mon[32397]: pgmap v1641: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-07-26T13:00:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:18 smithi146 ceph-mon[35807]: pgmap v1641: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-07-26T13:00:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:18 smithi076 ceph-mon[35401]: pgmap v1641: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-07-26T13:00:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:20 smithi040 ceph-mon[32397]: pgmap v1642: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:00:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:20 smithi146 ceph-mon[35807]: pgmap v1642: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:00:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:20 smithi076 ceph-mon[35401]: pgmap v1642: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:00:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:22 smithi040 ceph-mon[32397]: pgmap v1643: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:00:23.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:22 smithi146 ceph-mon[35807]: pgmap v1643: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:00:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:22 smithi076 ceph-mon[35401]: pgmap v1643: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:00:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:24 smithi040 ceph-mon[32397]: pgmap v1644: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:00:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:24 smithi146 ceph-mon[35807]: pgmap v1644: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:00:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:24 smithi076 ceph-mon[35401]: pgmap v1644: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:00:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:26 smithi040 ceph-mon[32397]: pgmap v1645: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:00:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:26 smithi146 ceph-mon[35807]: pgmap v1645: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:00:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:26 smithi076 ceph-mon[35401]: pgmap v1645: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:00:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:28 smithi076 ceph-mon[35401]: pgmap v1646: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:00:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:28 smithi146 ceph-mon[35807]: pgmap v1646: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:00:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:28 smithi040 ceph-mon[32397]: pgmap v1646: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:00:30.122 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-26T13:00:30.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:00:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:00:31.094 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:30 smithi040 ceph-mon[32397]: pgmap v1647: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:00:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:30 smithi146 ceph-mon[35807]: pgmap v1647: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:00:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:30 smithi076 ceph-mon[35401]: pgmap v1647: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:00:33.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 -- 172.21.15.40:0/2528881132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa454104ba0 msgr2=0x7fa45410d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:33.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 --2- 172.21.15.40:0/2528881132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa454104ba0 0x7fa45410d0f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa440009900 tx=0x7fa44002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 -- 172.21.15.40:0/2528881132 shutdown_connections 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 --2- 172.21.15.40:0/2528881132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa45410d6b0 0x7fa45410fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 --2- 172.21.15.40:0/2528881132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa454104ba0 0x7fa45410d0f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 --2- 172.21.15.40:0/2528881132 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa454104250 0x7fa454104660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 -- 172.21.15.40:0/2528881132 >> 172.21.15.40:0/2528881132 conn(0x7fa4540fddb0 msgr2=0x7fa454100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.166+0000 7fa453e00640 1 -- 172.21.15.40:0/2528881132 shutdown_connections 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.167+0000 7fa453e00640 1 -- 172.21.15.40:0/2528881132 wait complete. 2024-07-26T13:00:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.168+0000 7fa453e00640 1 Processor -- start 2024-07-26T13:00:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.168+0000 7fa453e00640 1 -- start start 2024-07-26T13:00:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa454104250 0x7fa454199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa454104ba0 0x7fa45419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 0x7fa45419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4541131b0 con 0x7fa45410d6b0 2024-07-26T13:00:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa454113030 con 0x7fa454104250 2024-07-26T13:00:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa454113330 con 0x7fa454104ba0 2024-07-26T13:00:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 0x7fa45419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 0x7fa45419f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41106/0 (socket says 172.21.15.40:41106) 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa453400640 1 -- 172.21.15.40:0/961837930 learned_addr learned my addr 172.21.15.40:0/961837930 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.169+0000 7fa452a00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa454104250 0x7fa454199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.170+0000 7fa452000640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa454104ba0 0x7fa45419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.170+0000 7fa453400640 1 -- 172.21.15.40:0/961837930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa454104ba0 msgr2=0x7fa45419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.170+0000 7fa453400640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa454104ba0 0x7fa45419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.170+0000 7fa453400640 1 -- 172.21.15.40:0/961837930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa454104250 msgr2=0x7fa454199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.170+0000 7fa453400640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa454104250 0x7fa454199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.170+0000 7fa453400640 1 -- 172.21.15.40:0/961837930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45419fc50 con 0x7fa45410d6b0 2024-07-26T13:00:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.171+0000 7fa453400640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 0x7fa45419f520 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00eb10 tx=0x7fa44c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.171+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c004b20 con 0x7fa45410d6b0 2024-07-26T13:00:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.171+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa44c004cc0 con 0x7fa45410d6b0 2024-07-26T13:00:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.171+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45419ff40 con 0x7fa45410d6b0 2024-07-26T13:00:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.171+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c010690 con 0x7fa45410d6b0 2024-07-26T13:00:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.171+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4541a66a0 con 0x7fa45410d6b0 2024-07-26T13:00:33.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.173+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa454104660 con 0x7fa45410d6b0 2024-07-26T13:00:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.176+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa44c005020 con 0x7fa45410d6b0 2024-07-26T13:00:33.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.178+0000 7fa44b400640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4380b3bd0 0x7fa4380b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.178+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa44c0e4100 con 0x7fa45410d6b0 2024-07-26T13:00:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.178+0000 7fa452a00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4380b3bd0 0x7fa4380b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:33.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.179+0000 7fa452a00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4380b3bd0 0x7fa4380b60e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa44400bbe0 tx=0x7fa44400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.183+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa44c0ab710 con 0x7fa45410d6b0 2024-07-26T13:00:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:33 smithi040 ceph-mon[32397]: pgmap v1648: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:00:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:33 smithi146 ceph-mon[35807]: pgmap v1648: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:00:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:33 smithi076 ceph-mon[35401]: pgmap v1648: 97 pgs: 97 active+clean; 6.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:00:33.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.442+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa45402e0c0 con 0x7fa45410d6b0 2024-07-26T13:00:33.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.444+0000 7fa44b400640 1 -- 172.21.15.40:0/961837930 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fa44c0ab010 con 0x7fa45410d6b0 2024-07-26T13:00:33.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:00:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:00:33.447 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:00:33.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4380b3bd0 msgr2=0x7fa4380b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:33.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4380b3bd0 0x7fa4380b60e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa44400bbe0 tx=0x7fa44400b390 comp rx=0 tx=0).stop 2024-07-26T13:00:33.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 msgr2=0x7fa45419f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:33.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 0x7fa45419f520 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00eb10 tx=0x7fa44c00c2d0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 shutdown_connections 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa45410d6b0 0x7fa45419f520 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa4380b3bd0 0x7fa4380b60e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa454104ba0 0x7fa45419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 --2- 172.21.15.40:0/961837930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa454104250 0x7fa454199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.447+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 >> 172.21.15.40:0/961837930 conn(0x7fa4540fddb0 msgr2=0x7fa4540fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.448+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 shutdown_connections 2024-07-26T13:00:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:33.448+0000 7fa453e00640 1 -- 172.21.15.40:0/961837930 wait complete. 2024-07-26T13:00:34.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:34 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/961837930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:34.291 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-26T13:00:34.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-26T13:00:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:34 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/961837930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:34 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/961837930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:00:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:35 smithi146 ceph-mon[35807]: pgmap v1649: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:00:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:35 smithi076 ceph-mon[35401]: pgmap v1649: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:00:35.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:35 smithi040 ceph-mon[32397]: pgmap v1649: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:00:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 -- 172.21.15.40:0/1660892249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec102810 msgr2=0x7fc5ec10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 --2- 172.21.15.40:0/1660892249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec102810 0x7fc5ec10f530 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009900 tx=0x7fc5d802a480 comp rx=0 tx=0).stop 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 -- 172.21.15.40:0/1660892249 shutdown_connections 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 --2- 172.21.15.40:0/1660892249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5ec10fa70 0x7fc5ec111e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 --2- 172.21.15.40:0/1660892249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec102810 0x7fc5ec10f530 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 --2- 172.21.15.40:0/1660892249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec1022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 -- 172.21.15.40:0/1660892249 >> 172.21.15.40:0/1660892249 conn(0x7fc5ec0fdd60 msgr2=0x7fc5ec1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.144+0000 7fc5f2800640 1 -- 172.21.15.40:0/1660892249 shutdown_connections 2024-07-26T13:00:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.145+0000 7fc5f2800640 1 -- 172.21.15.40:0/1660892249 wait complete. 2024-07-26T13:00:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.146+0000 7fc5f2800640 1 Processor -- start 2024-07-26T13:00:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.146+0000 7fc5f2800640 1 -- start start 2024-07-26T13:00:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.146+0000 7fc5f2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5ec102810 0x7fc5ec19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f2800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec10fa70 0x7fc5ec1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f2800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1153d0 con 0x7fc5ec101ec0 2024-07-26T13:00:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f2800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec115250 con 0x7fc5ec10fa70 2024-07-26T13:00:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f2800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec115550 con 0x7fc5ec102810 2024-07-26T13:00:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec19bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41120/0 (socket says 172.21.15.40:41120) 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f1400640 1 -- 172.21.15.40:0/2536764528 learned_addr learned my addr 172.21.15.40:0/2536764528 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5ec102810 0x7fc5ec19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.147+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec10fa70 0x7fc5ec1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1400640 1 -- 172.21.15.40:0/2536764528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5ec102810 msgr2=0x7fc5ec19c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5ec102810 0x7fc5ec19c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1400640 1 -- 172.21.15.40:0/2536764528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec10fa70 msgr2=0x7fc5ec1a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec10fa70 0x7fc5ec1a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1400640 1 -- 172.21.15.40:0/2536764528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec1a1d10 con 0x7fc5ec101ec0 2024-07-26T13:00:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec10fa70 0x7fc5ec1a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:00:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.148+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec19bda0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d950 tx=0x7fc5e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.149+0000 7fc5ea000640 1 -- 172.21.15.40:0/2536764528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0017070 con 0x7fc5ec101ec0 2024-07-26T13:00:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.149+0000 7fc5ea000640 1 -- 172.21.15.40:0/2536764528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5e0009c30 con 0x7fc5ec101ec0 2024-07-26T13:00:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.149+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ec1a2000 con 0x7fc5ec101ec0 2024-07-26T13:00:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.149+0000 7fc5ea000640 1 -- 172.21.15.40:0/2536764528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000f620 con 0x7fc5ec101ec0 2024-07-26T13:00:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.149+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ec1a8760 con 0x7fc5ec101ec0 2024-07-26T13:00:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.153+0000 7fc5fac18740 1 Processor -- start 2024-07-26T13:00:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.153+0000 7fc5fac18740 1 -- start start 2024-07-26T13:00:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5ea000640 1 -- 172.21.15.40:0/2536764528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc5e000f7c0 con 0x7fc5ec101ec0 2024-07-26T13:00:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb04390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb04e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5fac18740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5630edacecf0 con 0x5630ed75e840 2024-07-26T13:00:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5fac18740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5630eda79b40 con 0x5630ed735980 2024-07-26T13:00:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5fac18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5630eda69040 con 0x5630ed73db60 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5f1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb04390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5f1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb04390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41122/0 (socket says 172.21.15.40:41122) 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.154+0000 7fc5f1e00640 1 -- 172.21.15.40:0/2546106739 learned_addr learned my addr 172.21.15.40:0/2546106739 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb04e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1e00640 1 -- 172.21.15.40:0/2546106739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 msgr2=0x5630edb04e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb04e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1e00640 1 -- 172.21.15.40:0/2546106739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 msgr2=0x5630edb048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1e00640 1 -- 172.21.15.40:0/2546106739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ed9f0af0 con 0x5630ed75e840 2024-07-26T13:00:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.155+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:00:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb04390 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009fb0 tx=0x7fc5e4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c4cb541cf2d53d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5ea000640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5d40b3bc0 0x7fc5d40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5ea000640 1 -- 172.21.15.40:0/2536764528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc5e00e37c0 con 0x7fc5ec101ec0 2024-07-26T13:00:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5d40b3bc0 0x7fc5d40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5de600640 1 -- 172.21.15.40:0/2546106739 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4016070 con 0x5630ed75e840 2024-07-26T13:00:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5de600640 1 -- 172.21.15.40:0/2546106739 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5e4012ba0 con 0x5630ed75e840 2024-07-26T13:00:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.156+0000 7fc5de600640 1 -- 172.21.15.40:0/2546106739 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e401bba0 con 0x5630ed75e840 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 -- 172.21.15.40:0/2546106739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 msgr2=0x5630edb04390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb04390 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009fb0 tx=0x7fc5e4010800 comp rx=0 tx=0).stop 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5f1400640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5d40b3bc0 0x7fc5d40b60d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00058c0 tx=0x7fc5e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 -- 172.21.15.40:0/2546106739 shutdown_connections 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb04e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2546106739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb04390 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 -- 172.21.15.40:0/2546106739 >> 172.21.15.40:0/2546106739 conn(0x5630ed752990 msgr2=0x5630edb02280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 -- 172.21.15.40:0/2546106739 shutdown_connections 2024-07-26T13:00:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.158+0000 7fc5fac18740 1 -- 172.21.15.40:0/2546106739 wait complete. 2024-07-26T13:00:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.159+0000 7fc5fac18740 1 -- start start 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.159+0000 7fc5fac18740 1 Processor -- start 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb0fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb10420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5630eda05500 con 0x5630ed73db60 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5630eda6d080 con 0x5630ed735980 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5630ed8cc7a0 con 0x5630ed75e840 2024-07-26T13:00:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5fac18740 10 client.0 _ll_register_callbacks cb 0x5630eda61bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:00:37.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5f1e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb0fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.160+0000 7fc5f0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb10420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb10420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41134/0 (socket says 172.21.15.40:41134) 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 -- 172.21.15.40:0/2859177860 learned_addr learned my addr 172.21.15.40:0/2859177860 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 -- 172.21.15.40:0/2859177860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 msgr2=0x5630edb1bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 -- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 msgr2=0x5630edb0fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb0fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f0a00640 1 -- 172.21.15.40:0/2859177860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ed7d8b90 con 0x5630ed73db60 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.161+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb0fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.162+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb10420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009900 tx=0x7fc5d8004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fd52c344977784 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.162+0000 7fc5d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:00:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.162+0000 7fc5d2a00640 1 -- 172.21.15.40:0/2859177860 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8035040 con 0x5630ed73db60 2024-07-26T13:00:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.162+0000 7fc5d2a00640 1 -- 172.21.15.40:0/2859177860 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc5d8005460 con 0x5630ed73db60 2024-07-26T13:00:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.162+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5e4012ba0 con 0x5630ed73db60 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.163+0000 7fc5d2a00640 1 -- 172.21.15.40:0/2859177860 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc5d80046e0 con 0x5630ed73db60 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.163+0000 7fc5fac18740 10 client.16869 fetch_fsmap learned FSMap version 35 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.163+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5630edb1e990 con 0x5630ed73db60 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.163+0000 7fc5d2a00640 1 -- 172.21.15.40:0/2859177860 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5e4012ba0 con 0x5630ed73db60 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5d2a00640 1 -- 172.21.15.40:0/2859177860 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc5d8003a80 con 0x5630ed73db60 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5fac18740 10 client.16869 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5fac18740 10 client.16869 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5fac18740 20 client.16869 populate_metadata read hostname 'smithi040' 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed71d1c0 0x5630edb21ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5fac18740 4 client.16869 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:00:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630eda7ba90 con 0x5630ed71d1c0 2024-07-26T13:00:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.164+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed71d1c0 0x5630edb21ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.166+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed71d1c0 0x5630edb21ed0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=817de13558a388b0 server_cookie=8f482540d5ed664e in_seq=0 out_seq=0 2024-07-26T13:00:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.166+0000 7fc5d2a00640 10 client.16869 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:37.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.168+0000 7fc5d2a00640 1 -- 172.21.15.40:0/2859177860 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630eda7ba90 con 0x5630ed71d1c0 2024-07-26T13:00:37.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.168+0000 7fc5d2a00640 10 client.16869 handle_command_reply: tid=0 2024-07-26T13:00:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.168+0000 7fc5fac18740 1 client.16869 shutdown 2024-07-26T13:00:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.168+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 msgr2=0x5630edb10420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.168+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb10420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009900 tx=0x7fc5d8004460 comp rx=0 tx=0).stop 2024-07-26T13:00:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 shutdown_connections 2024-07-26T13:00:37.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed71d1c0 0x5630edb21ed0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb10420 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 --2- 172.21.15.40:0/2859177860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb0fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 >> 172.21.15.40:0/2859177860 conn(0x5630ed752990 msgr2=0x5630edb07520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5d2a00640 0 client.16869 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 shutdown_connections 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 1 -- 172.21.15.40:0/2859177860 wait complete. 2024-07-26T13:00:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.169+0000 7fc5fac18740 20 client.16869 trim_cache size 0 max 16384 2024-07-26T13:00:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 Processor -- start 2024-07-26T13:00:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 -- start start 2024-07-26T13:00:37.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb05ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb1bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc00e4c0 con 0x5630ed73db60 2024-07-26T13:00:37.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc010000 con 0x5630ed735980 2024-07-26T13:00:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.191+0000 7fc5fac18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc00eb90 con 0x5630ed75e840 2024-07-26T13:00:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb1bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb1bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41146/0 (socket says 172.21.15.40:41146) 2024-07-26T13:00:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 -- 172.21.15.40:0/3037756411 learned_addr learned my addr 172.21.15.40:0/3037756411 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb05ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 -- 172.21.15.40:0/3037756411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 msgr2=0x5630edb1c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 -- 172.21.15.40:0/3037756411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 msgr2=0x5630edb05ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb05ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.192+0000 7fc5f0a00640 1 -- 172.21.15.40:0/3037756411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630edb0e1e0 con 0x5630ed73db60 2024-07-26T13:00:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.193+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb1bb60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc5d802aa70 tx=0x7fc5d8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5874948639b523b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.193+0000 7fc5ddc00640 1 -- 172.21.15.40:0/3037756411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8035030 con 0x5630ed73db60 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.193+0000 7fc5ddc00640 1 -- 172.21.15.40:0/3037756411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5d8040070 con 0x5630ed73db60 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.193+0000 7fc5ddc00640 1 -- 172.21.15.40:0/3037756411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8004ae0 con 0x5630ed73db60 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 -- 172.21.15.40:0/3037756411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 msgr2=0x5630edb1bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb1bb60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc5d802aa70 tx=0x7fc5d8001e70 comp rx=0 tx=0).stop 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 -- 172.21.15.40:0/3037756411 shutdown_connections 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed75e840 0x5630edb1c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed73db60 0x5630edb1bb60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3037756411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb05ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 -- 172.21.15.40:0/3037756411 >> 172.21.15.40:0/3037756411 conn(0x5630ed752990 msgr2=0x5630edb053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.194+0000 7fc5fac18740 1 -- 172.21.15.40:0/3037756411 shutdown_connections 2024-07-26T13:00:37.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.195+0000 7fc5fac18740 1 -- 172.21.15.40:0/3037756411 wait complete. 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.195+0000 7fc5fac18740 1 -- start start 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.195+0000 7fc5fac18740 1 Processor -- start 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb18240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb14700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb14c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc00f930 con 0x5630ed75e840 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc00f260 con 0x5630ed735980 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc00c480 con 0x5630ed73db60 2024-07-26T13:00:37.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5fac18740 10 client.0 _ll_register_callbacks cb 0x7fc5d8005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5f1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb14c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5f1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb14c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41162/0 (socket says 172.21.15.40:41162) 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.196+0000 7fc5f1e00640 1 -- 172.21.15.40:0/3471233191 learned_addr learned my addr 172.21.15.40:0/3471233191 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb14700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb18240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 -- 172.21.15.40:0/3471233191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 msgr2=0x5630edb14700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb14700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 -- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 msgr2=0x5630edb18240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb18240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 -- 172.21.15.40:0/3471233191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630edb15280 con 0x5630ed75e840 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5f1e00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb14c40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009ed0 tx=0x7fc5e4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcf899e716ca2cb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:37.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.197+0000 7fc5d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:00:37.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.198+0000 7fc5d2a00640 1 -- 172.21.15.40:0/3471233191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4039030 con 0x5630ed75e840 2024-07-26T13:00:37.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.198+0000 7fc5d2a00640 1 -- 172.21.15.40:0/3471233191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc5e4004a00 con 0x5630ed75e840 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.198+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d8040070 con 0x5630ed75e840 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.198+0000 7fc5d2a00640 1 -- 172.21.15.40:0/3471233191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc5e4023040 con 0x5630ed75e840 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.198+0000 7fc5fac18740 10 client.16875 fetch_fsmap learned FSMap version 35 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.198+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5630edb8b460 con 0x5630ed75e840 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5d2a00640 1 -- 172.21.15.40:0/3471233191 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5d8040070 con 0x5630ed75e840 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5d2a00640 1 -- 172.21.15.40:0/3471233191 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc5e400f040 con 0x5630ed75e840 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5fac18740 10 client.16875 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5fac18740 10 client.16875 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5fac18740 20 client.16875 populate_metadata read hostname 'smithi040' 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed6f2570 0x5630edb8dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5fac18740 4 client.16875 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.199+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5630eda77530 con 0x5630ed6f2570 2024-07-26T13:00:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.200+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed6f2570 0x5630edb8dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:37.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.201+0000 7fc5f0a00640 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed6f2570 0x5630edb8dab0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2184c4dca39db1 server_cookie=35b95f1d6342516f in_seq=0 out_seq=0 2024-07-26T13:00:37.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.201+0000 7fc5d2a00640 10 client.16875 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:37 smithi146 ceph-mon[35807]: pgmap v1650: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:00:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:37 smithi076 ceph-mon[35401]: pgmap v1650: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:00:37.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.475+0000 7fc5d2a00640 1 -- 172.21.15.40:0/3471233191 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5630eda77530 con 0x5630ed6f2570 2024-07-26T13:00:37.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.475+0000 7fc5d2a00640 10 client.16875 handle_command_reply: tid=0 2024-07-26T13:00:37.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.475+0000 7fc5fac18740 1 client.16875 shutdown 2024-07-26T13:00:37.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:37 smithi040 ceph-mon[32397]: pgmap v1650: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.475+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 msgr2=0x5630edb14c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.475+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb14c40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009ed0 tx=0x7fc5e4010800 comp rx=0 tx=0).stop 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 shutdown_connections 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5630ed6f2570 0x5630edb8dab0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5630ed75e840 0x5630edb14c40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5d2a00640 0 client.16875 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ed73db60 0x5630edb14700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5fac18740 1 --2- 172.21.15.40:0/3471233191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5630ed735980 0x5630edb18240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.476+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 >> 172.21.15.40:0/3471233191 conn(0x5630ed752990 msgr2=0x5630edb053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:37.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.477+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 shutdown_connections 2024-07-26T13:00:37.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.477+0000 7fc5fac18740 1 -- 172.21.15.40:0/3471233191 wait complete. 2024-07-26T13:00:37.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.477+0000 7fc5fac18740 20 client.16875 trim_cache size 0 max 16384 2024-07-26T13:00:37.479 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 118, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "9b2a5438": { 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 118, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:00:37.480 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:37.481 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:00:37.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5d40b3bc0 msgr2=0x7fc5d40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5d40b3bc0 0x7fc5d40b60d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00058c0 tx=0x7fc5e0000bc0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 msgr2=0x7fc5ec19bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:37.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec19bda0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d950 tx=0x7fc5e000de10 comp rx=0 tx=0).stop 2024-07-26T13:00:37.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 shutdown_connections 2024-07-26T13:00:37.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5ec10fa70 0x7fc5ec1a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5d40b3bc0 0x7fc5d40b60d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5ec102810 0x7fc5ec19c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 --2- 172.21.15.40:0/2536764528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5ec101ec0 0x7fc5ec19bda0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:37.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.479+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 >> 172.21.15.40:0/2536764528 conn(0x7fc5ec0fdd60 msgr2=0x7fc5ec111be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:37.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.480+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 shutdown_connections 2024-07-26T13:00:37.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:37.480+0000 7fc5f2800640 1 -- 172.21.15.40:0/2536764528 wait complete. 2024-07-26T13:00:38.344 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9b2a5438', quiesce took 8.2 seconds. Will release after: 1.8000000000000007 2024-07-26T13:00:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:39 smithi146 ceph-mon[35807]: pgmap v1651: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T13:00:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:39 smithi076 ceph-mon[35401]: pgmap v1651: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T13:00:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:39 smithi040 ceph-mon[32397]: pgmap v1651: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T13:00:40.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:00:40.636 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:00:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:41 smithi146 ceph-mon[35807]: pgmap v1652: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T13:00:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:41 smithi076 ceph-mon[35401]: pgmap v1652: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T13:00:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:41 smithi040 ceph-mon[32397]: pgmap v1652: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T13:00:42.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 -- 172.21.15.40:0/2795181476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 msgr2=0x7f53ac105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:42.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 --2- 172.21.15.40:0/2795181476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac105a00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009ca0 tx=0x7f53a002a8c0 comp rx=0 tx=0).stop 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 -- 172.21.15.40:0/2795181476 shutdown_connections 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 --2- 172.21.15.40:0/2795181476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10b880 0x7f53ac1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 --2- 172.21.15.40:0/2795181476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ac10af30 0x7f53ac10b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 --2- 172.21.15.40:0/2795181476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac105a00 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 -- 172.21.15.40:0/2795181476 >> 172.21.15.40:0/2795181476 conn(0x7f53ac101060 msgr2=0x7f53ac1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 -- 172.21.15.40:0/2795181476 shutdown_connections 2024-07-26T13:00:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.870+0000 7f53b2200640 1 -- 172.21.15.40:0/2795181476 wait complete. 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.871+0000 7f53b2200640 1 Processor -- start 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 -- start start 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10af30 0x7f53ac19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ac10b880 0x7f53ac1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac115430 con 0x7f53ac1055f0 2024-07-26T13:00:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac1152b0 con 0x7f53ac10af30 2024-07-26T13:00:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.872+0000 7f53b2200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac1155b0 con 0x7f53ac10b880 2024-07-26T13:00:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58814/0 (socket says 172.21.15.40:58814) 2024-07-26T13:00:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 -- 172.21.15.40:0/403928844 learned_addr learned my addr 172.21.15.40:0/403928844 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53abe00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10af30 0x7f53ac19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b1800640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ac10b880 0x7f53ac1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 -- 172.21.15.40:0/403928844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ac10b880 msgr2=0x7f53ac1a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ac10b880 0x7f53ac1a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 -- 172.21.15.40:0/403928844 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10af30 msgr2=0x7f53ac19c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10af30 0x7f53ac19c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53b0e00640 1 -- 172.21.15.40:0/403928844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac1a1db0 con 0x7f53ac1055f0 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.873+0000 7f53abe00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10af30 0x7f53ac19c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:00:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.874+0000 7f53b0e00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac19be40 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009dc0 tx=0x7f53a0032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:42.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.875+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0004040 con 0x7f53ac1055f0 2024-07-26T13:00:42.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.875+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac1a2040 con 0x7f53ac1055f0 2024-07-26T13:00:42.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.875+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53a0004670 con 0x7f53ac1055f0 2024-07-26T13:00:42.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.875+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0030c80 con 0x7f53ac1055f0 2024-07-26T13:00:42.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.875+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac1a8800 con 0x7f53ac1055f0 2024-07-26T13:00:42.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.877+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac105a00 con 0x7f53ac1055f0 2024-07-26T13:00:42.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.879+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f53a00041e0 con 0x7f53ac1055f0 2024-07-26T13:00:42.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.881+0000 7f53a9600640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53940b3bd0 0x7f53940b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:42.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.881+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f53a01051d0 con 0x7f53ac1055f0 2024-07-26T13:00:42.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.882+0000 7f53abe00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53940b3bd0 0x7f53940b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:42.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.882+0000 7f53abe00640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53940b3bd0 0x7f53940b60e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f53ac10aab0 tx=0x7f5398005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:42.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:42.885+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f53a00cc7e0 con 0x7f53ac1055f0 2024-07-26T13:00:43.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.135+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53ac19cf70 con 0x7f53ac1055f0 2024-07-26T13:00:43.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.137+0000 7f53a9600640 1 -- 172.21.15.40:0/403928844 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f53a0004820 con 0x7f53ac1055f0 2024-07-26T13:00:43.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:00:43.139 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:00:43.140 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:00:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53940b3bd0 msgr2=0x7f53940b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53940b3bd0 0x7f53940b60e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f53ac10aab0 tx=0x7f5398005e50 comp rx=0 tx=0).stop 2024-07-26T13:00:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 msgr2=0x7f53ac19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac19be40 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009dc0 tx=0x7f53a0032bc0 comp rx=0 tx=0).stop 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 shutdown_connections 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53940b3bd0 0x7f53940b60e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ac10b880 0x7f53ac1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53ac10af30 0x7f53ac19c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 --2- 172.21.15.40:0/403928844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53ac1055f0 0x7f53ac19be40 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.140+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 >> 172.21.15.40:0/403928844 conn(0x7f53ac101060 msgr2=0x7f53ac103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.141+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 shutdown_connections 2024-07-26T13:00:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:43.141+0000 7f53b2200640 1 -- 172.21.15.40:0/403928844 wait complete. 2024-07-26T13:00:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:43 smithi146 ceph-mon[35807]: pgmap v1653: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:00:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:43 smithi076 ceph-mon[35401]: pgmap v1653: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:00:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:43 smithi040 ceph-mon[32397]: pgmap v1653: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:00:44.088 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 9b2a5438 --release --await' 2024-07-26T13:00:44.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 9b2a5438 --release --await 2024-07-26T13:00:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/403928844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/403928844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/403928844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:00:44.603 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:00:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:45 smithi146 ceph-mon[35807]: pgmap v1654: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:00:45.325 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:45 smithi040 ceph-mon[32397]: pgmap v1654: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:00:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:45 smithi076 ceph-mon[35401]: pgmap v1654: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:00:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.112+0000 7efeda400640 1 -- 172.21.15.40:0/1920986623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4109820 msgr2=0x7efed4110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.112+0000 7efeda400640 1 --2- 172.21.15.40:0/1920986623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4109820 0x7efed4110050 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7efecc009ca0 tx=0x7efecc02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 -- 172.21.15.40:0/1920986623 shutdown_connections 2024-07-26T13:00:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 --2- 172.21.15.40:0/1920986623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4109820 0x7efed4110050 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 --2- 172.21.15.40:0/1920986623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efed4108ed0 0x7efed41092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 --2- 172.21.15.40:0/1920986623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efed4103590 0x7efed41039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 -- 172.21.15.40:0/1920986623 >> 172.21.15.40:0/1920986623 conn(0x7efed407b280 msgr2=0x7efed407b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 -- 172.21.15.40:0/1920986623 shutdown_connections 2024-07-26T13:00:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.113+0000 7efeda400640 1 -- 172.21.15.40:0/1920986623 wait complete. 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.114+0000 7efeda400640 1 Processor -- start 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.114+0000 7efeda400640 1 -- start start 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efeda400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 0x7efed419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efeda400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efed4108ed0 0x7efed419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efeda400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efed4109820 0x7efed41a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efeda400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efed41133d0 con 0x7efed4103590 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efeda400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efed4113250 con 0x7efed4109820 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efeda400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efed4113550 con 0x7efed4108ed0 2024-07-26T13:00:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efed3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 0x7efed419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efed3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 0x7efed419c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58844/0 (socket says 172.21.15.40:58844) 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.115+0000 7efed3400640 1 -- 172.21.15.40:0/3539505330 learned_addr learned my addr 172.21.15.40:0/3539505330 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3e00640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efed4109820 0x7efed41a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed2a00640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efed4108ed0 0x7efed419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3400640 1 -- 172.21.15.40:0/3539505330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efed4108ed0 msgr2=0x7efed419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efed4108ed0 0x7efed419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3400640 1 -- 172.21.15.40:0/3539505330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efed4109820 msgr2=0x7efed41a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efed4109820 0x7efed41a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3400640 1 -- 172.21.15.40:0/3539505330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed41a1fd0 con 0x7efed4103590 2024-07-26T13:00:47.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efed3400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 0x7efed419c060 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7efec400d950 tx=0x7efec400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.116+0000 7efecbe00640 1 -- 172.21.15.40:0/3539505330 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4017070 con 0x7efed4103590 2024-07-26T13:00:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.117+0000 7efecbe00640 1 -- 172.21.15.40:0/3539505330 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efec4009c30 con 0x7efed4103590 2024-07-26T13:00:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.117+0000 7efecbe00640 1 -- 172.21.15.40:0/3539505330 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec400f620 con 0x7efed4103590 2024-07-26T13:00:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.117+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed41a22c0 con 0x7efed4103590 2024-07-26T13:00:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.117+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed41a8a20 con 0x7efed4103590 2024-07-26T13:00:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.120+0000 7efee1018740 1 Processor -- start 2024-07-26T13:00:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.120+0000 7efee1018740 1 -- start start 2024-07-26T13:00:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efecbe00640 1 -- 172.21.15.40:0/3539505330 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efec4010460 con 0x7efed4103590 2024-07-26T13:00:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efee1018740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d59fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efee1018740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 0x55f0d5a00500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efee1018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a00a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efee1018740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f0d5976f30 con 0x55f0d5632660 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efee1018740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f0d5966430 con 0x55f0d565b520 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efee1018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0d596a470 con 0x55f0d563a840 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.121+0000 7efed3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 0x55f0d5a00500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 0x55f0d5a00500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58846/0 (socket says 172.21.15.40:58846) 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 -- 172.21.15.40:0/2800857539 learned_addr learned my addr 172.21.15.40:0/2800857539 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3e00640 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d59fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed2a00640 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a00a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 -- 172.21.15.40:0/2800857539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 msgr2=0x55f0d5a00a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a00a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 -- 172.21.15.40:0/2800857539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 msgr2=0x55f0d59fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d59fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.122+0000 7efed3400640 1 -- 172.21.15.40:0/2800857539 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d56c6b00 con 0x55f0d5632660 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efed3400640 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 0x55f0d5a00500 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7efec40e9c20 tx=0x7efec40eb670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4ab514884599f0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efecbe00640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efeb80b3c50 0x7efeb80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efec8c00640 1 -- 172.21.15.40:0/2800857539 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec40f2070 con 0x55f0d5632660 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efec8c00640 1 -- 172.21.15.40:0/2800857539 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efec4023a90 con 0x55f0d5632660 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efec8c00640 1 -- 172.21.15.40:0/2800857539 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec40aa0e0 con 0x55f0d5632660 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efed3e00640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efeb80b3c50 0x7efeb80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.123+0000 7efecbe00640 1 -- 172.21.15.40:0/3539505330 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efec40e3880 con 0x7efed4103590 2024-07-26T13:00:47.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.124+0000 7efee1018740 1 -- 172.21.15.40:0/2800857539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 msgr2=0x55f0d5a00500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.124+0000 7efee1018740 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 0x55f0d5a00500 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7efec40e9c20 tx=0x7efec40eb670 comp rx=0 tx=0).stop 2024-07-26T13:00:47.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.124+0000 7efed3e00640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efeb80b3c50 0x7efeb80b6160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efecc005e30 tx=0x7efecc005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 -- 172.21.15.40:0/2800857539 shutdown_connections 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a00a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d5632660 0x55f0d5a00500 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 --2- 172.21.15.40:0/2800857539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d59fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 -- 172.21.15.40:0/2800857539 >> 172.21.15.40:0/2800857539 conn(0x55f0d564f910 msgr2=0x55f0d59fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 -- 172.21.15.40:0/2800857539 shutdown_connections 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.125+0000 7efee1018740 1 -- 172.21.15.40:0/2800857539 wait complete. 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 -- start start 2024-07-26T13:00:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 Processor -- start 2024-07-26T13:00:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a0b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a0bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 0x55f0d5a0c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f0d57c9bb0 con 0x55f0d565b520 2024-07-26T13:00:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f0d5902910 con 0x55f0d5632660 2024-07-26T13:00:47.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.126+0000 7efee1018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f0d5a0e7a0 con 0x55f0d563a840 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efee1018740 10 client.0 _ll_register_callbacks cb 0x55f0d5672d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 0x55f0d5a0c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 0x55f0d5a0c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58858/0 (socket says 172.21.15.40:58858) 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 -- 172.21.15.40:0/1432956139 learned_addr learned my addr 172.21.15.40:0/1432956139 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3400640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a0b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed2a00640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a0bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 -- 172.21.15.40:0/1432956139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 msgr2=0x55f0d5a0bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a0bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 -- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 msgr2=0x55f0d5a0b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.127+0000 7efed3e00640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a0b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.128+0000 7efed3e00640 1 -- 172.21.15.40:0/1432956139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d573d960 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.128+0000 7efed3e00640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 0x55f0d5a0c050 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efecc009ca0 tx=0x7efecc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0d16cd187525f3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.128+0000 7efebd600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.128+0000 7efebd600640 1 -- 172.21.15.40:0/1432956139 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc032ea0 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.128+0000 7efebd600640 1 -- 172.21.15.40:0/1432956139 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efecc004040 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.128+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efec4023a90 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efebd600640 1 -- 172.21.15.40:0/1432956139 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efecc004240 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 10 client.16893 fetch_fsmap learned FSMap version 35 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f0d5a1a430 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efebd600640 1 -- 172.21.15.40:0/1432956139 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efec4023a90 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efebd600640 1 -- 172.21.15.40:0/1432956139 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7efecc051070 con 0x55f0d565b520 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 10 client.16893 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:00:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 10 client.16893 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:00:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 20 client.16893 populate_metadata read hostname 'smithi040' 2024-07-26T13:00:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d5619ea0 0x55f0d5a1d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 4 client.16893 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:00:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.129+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0d5978e80 con 0x55f0d5619ea0 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.130+0000 7efed3400640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d5619ea0 0x55f0d5a1d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.131+0000 7efed3400640 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d5619ea0 0x55f0d5a1d920 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f289b93695a26cf server_cookie=2d6fbdc2506813a1 in_seq=0 out_seq=0 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.131+0000 7efebd600640 10 client.16893 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efebd600640 1 -- 172.21.15.40:0/1432956139 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0d5978e80 con 0x55f0d5619ea0 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efebd600640 10 client.16893 handle_command_reply: tid=0 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efee1018740 1 client.16893 shutdown 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 msgr2=0x55f0d5a0c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efee1018740 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 0x55f0d5a0c050 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7efecc009ca0 tx=0x7efecc02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 shutdown_connections 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efee1018740 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d5619ea0 0x55f0d5a1d920 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.133+0000 7efee1018740 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d565b520 0x55f0d5a0c050 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efee1018740 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d563a840 0x55f0d5a0bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efee1018740 1 --2- 172.21.15.40:0/1432956139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a0b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 >> 172.21.15.40:0/1432956139 conn(0x55f0d564f910 msgr2=0x55f0d5a03150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efebd600640 0 client.16893 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 shutdown_connections 2024-07-26T13:00:47.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:47 smithi040 ceph-mon[32397]: pgmap v1655: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:00:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efee1018740 1 -- 172.21.15.40:0/1432956139 wait complete. 2024-07-26T13:00:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.134+0000 7efee1018740 20 client.16893 trim_cache size 0 max 16384 2024-07-26T13:00:47.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 Processor -- start 2024-07-26T13:00:47.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 -- start start 2024-07-26T13:00:47.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a230e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a23620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d565b520 0x55f0d5a087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efed41b10f0 con 0x55f0d563a840 2024-07-26T13:00:47.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efed41b2c30 con 0x55f0d5632660 2024-07-26T13:00:47.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.153+0000 7efee1018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efed41b17c0 con 0x55f0d565b520 2024-07-26T13:00:47.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a23620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a23620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58874/0 (socket says 172.21.15.40:58874) 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 -- 172.21.15.40:0/692389980 learned_addr learned my addr 172.21.15.40:0/692389980 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed3e00640 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d565b520 0x55f0d5a087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed3400640 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 -- 172.21.15.40:0/692389980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d565b520 msgr2=0x55f0d5a087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d565b520 0x55f0d5a087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 -- 172.21.15.40:0/692389980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 msgr2=0x55f0d5a230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed2a00640 1 -- 172.21.15.40:0/692389980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d5a0c890 con 0x55f0d563a840 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.154+0000 7efed3400640 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:00:47.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.155+0000 7efed2a00640 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a23620 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efec000fbe0 tx=0x7efec0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670c917538129cc4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:47.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.155+0000 7efebfe00640 1 -- 172.21.15.40:0/692389980 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec001c440 con 0x55f0d563a840 2024-07-26T13:00:47.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.155+0000 7efebfe00640 1 -- 172.21.15.40:0/692389980 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efec00118e0 con 0x55f0d563a840 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.155+0000 7efebfe00640 1 -- 172.21.15.40:0/692389980 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec001b8e0 con 0x55f0d563a840 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 -- 172.21.15.40:0/692389980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 msgr2=0x55f0d5a23620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a23620 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7efec000fbe0 tx=0x7efec0013830 comp rx=0 tx=0).stop 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 -- 172.21.15.40:0/692389980 shutdown_connections 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d565b520 0x55f0d5a087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a23620 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 --2- 172.21.15.40:0/692389980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d5632660 0x55f0d5a230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 -- 172.21.15.40:0/692389980 >> 172.21.15.40:0/692389980 conn(0x55f0d564f910 msgr2=0x55f0d5a00e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 -- 172.21.15.40:0/692389980 shutdown_connections 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.156+0000 7efee1018740 1 -- 172.21.15.40:0/692389980 wait complete. 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.157+0000 7efee1018740 1 -- start start 2024-07-26T13:00:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.157+0000 7efee1018740 1 Processor -- start 2024-07-26T13:00:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d5632660 0x55f0d5a12c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a13160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d5a860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efed41b2560 con 0x55f0d563a840 2024-07-26T13:00:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efed41b1e90 con 0x55f0d565b520 2024-07-26T13:00:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efed41af0b0 con 0x55f0d5632660 2024-07-26T13:00:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efee1018740 10 client.0 _ll_register_callbacks cb 0x7efecc004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:00:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efed2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a13160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efed2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a13160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58890/0 (socket says 172.21.15.40:58890) 2024-07-26T13:00:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efed3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d5632660 0x55f0d5a12c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.158+0000 7efed2a00640 1 -- 172.21.15.40:0/1384338063 learned_addr learned my addr 172.21.15.40:0/1384338063 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:00:47.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed3e00640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d5a860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed2a00640 1 -- 172.21.15.40:0/1384338063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d5632660 msgr2=0x55f0d5a12c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed2a00640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d5632660 0x55f0d5a12c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed2a00640 1 -- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 msgr2=0x55f0d5a860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed2a00640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d5a860d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed2a00640 1 -- 172.21.15.40:0/1384338063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d5a139e0 con 0x55f0d563a840 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed3e00640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d5a860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efed2a00640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a13160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efec0014fd0 tx=0x7efec0011680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6fde51a31bff8a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.159+0000 7efebd600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.160+0000 7efebd600640 1 -- 172.21.15.40:0/1384338063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec002b020 con 0x55f0d563a840 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.160+0000 7efebd600640 1 -- 172.21.15.40:0/1384338063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efec0011c90 con 0x55f0d563a840 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.160+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efec00118e0 con 0x55f0d563a840 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.160+0000 7efebd600640 1 -- 172.21.15.40:0/1384338063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efec0021040 con 0x55f0d563a840 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.160+0000 7efee1018740 10 client.16899 fetch_fsmap learned FSMap version 35 2024-07-26T13:00:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.160+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f0d5a87660 con 0x55f0d563a840 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efebd600640 1 -- 172.21.15.40:0/1384338063 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efec00118e0 con 0x55f0d563a840 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efebd600640 1 -- 172.21.15.40:0/1384338063 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7efec0024030 con 0x55f0d563a840 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efee1018740 10 client.16899 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efee1018740 10 client.16899 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efee1018740 20 client.16899 populate_metadata read hostname 'smithi040' 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efee1018740 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d55ef250 0x55f0d5a89c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efee1018740 4 client.16899 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9b2a5438", "release": true, "await": true}] 2024-07-26T13:00:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.161+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9b2a5438", "release": true, "await": true}) -- 0x55f0d5974920 con 0x55f0d55ef250 2024-07-26T13:00:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.162+0000 7efed3400640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d55ef250 0x55f0d5a89c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:00:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.163+0000 7efed3400640 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d55ef250 0x55f0d5a89c80 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=669cc0b0dfebb604 server_cookie=1d7f43ea268b0132 in_seq=0 out_seq=0 2024-07-26T13:00:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.163+0000 7efebd600640 10 client.16899 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.244+0000 7efebd600640 1 -- 172.21.15.40:0/1384338063 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55f0d5974920 con 0x55f0d55ef250 2024-07-26T13:00:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.244+0000 7efebd600640 10 client.16899 handle_command_reply: tid=0 2024-07-26T13:00:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.244+0000 7efee1018740 1 client.16899 shutdown 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.244+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 msgr2=0x55f0d5a13160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.244+0000 7efee1018740 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a13160 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efec0014fd0 tx=0x7efec0011680 comp rx=0 tx=0).stop 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 shutdown_connections 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f0d565b520 0x55f0d5a860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f0d55ef250 0x55f0d5a89c80 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f0d563a840 0x55f0d5a13160 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 --2- 172.21.15.40:0/1384338063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f0d5632660 0x55f0d5a12c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 >> 172.21.15.40:0/1384338063 conn(0x55f0d564f910 msgr2=0x55f0d5a168d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efebd600640 0 client.16899 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:00:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.245+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 shutdown_connections 2024-07-26T13:00:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.246+0000 7efee1018740 1 -- 172.21.15.40:0/1384338063 wait complete. 2024-07-26T13:00:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.246+0000 7efee1018740 20 client.16899 trim_cache size 0 max 16384 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 120, 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "9b2a5438": { 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 120, 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:00:47.249 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:00:47.250 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:00:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.247+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efeb80b3c50 msgr2=0x7efeb80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.247+0000 7efeda400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efeb80b3c50 0x7efeb80b6160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efecc005e30 tx=0x7efecc005c50 comp rx=0 tx=0).stop 2024-07-26T13:00:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.247+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 msgr2=0x7efed419c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.247+0000 7efeda400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 0x7efed419c060 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7efec400d950 tx=0x7efec400de10 comp rx=0 tx=0).stop 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 shutdown_connections 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efed4109820 0x7efed41a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7efeb80b3c50 0x7efeb80b6160 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efed4108ed0 0x7efed419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 --2- 172.21.15.40:0/3539505330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed4103590 0x7efed419c060 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 >> 172.21.15.40:0/3539505330 conn(0x7efed407b280 msgr2=0x7efed4106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 shutdown_connections 2024-07-26T13:00:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:00:47.248+0000 7efeda400640 1 -- 172.21.15.40:0/3539505330 wait complete. 2024-07-26T13:00:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:47 smithi146 ceph-mon[35807]: pgmap v1655: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:00:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:47 smithi076 ceph-mon[35401]: pgmap v1655: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:00:48.235 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9b2a5438', total seconds elapsed: 18.1 2024-07-26T13:00:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:49 smithi076 ceph-mon[35401]: pgmap v1656: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:00:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:49 smithi040 ceph-mon[32397]: pgmap v1656: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:00:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:49 smithi146 ceph-mon[35807]: pgmap v1656: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:00:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:51 smithi040 ceph-mon[32397]: pgmap v1657: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-07-26T13:00:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:51 smithi146 ceph-mon[35807]: pgmap v1657: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-07-26T13:00:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:51 smithi076 ceph-mon[35401]: pgmap v1657: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2024-07-26T13:00:53.345 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:53 smithi040 ceph-mon[32397]: pgmap v1658: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 434 KiB/s wr, 8 op/s 2024-07-26T13:00:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:53 smithi146 ceph-mon[35807]: pgmap v1658: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 434 KiB/s wr, 8 op/s 2024-07-26T13:00:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:53 smithi076 ceph-mon[35401]: pgmap v1658: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 434 KiB/s wr, 8 op/s 2024-07-26T13:00:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:55 smithi040 ceph-mon[32397]: pgmap v1659: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:00:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:55 smithi146 ceph-mon[35807]: pgmap v1659: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:00:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:55 smithi076 ceph-mon[35401]: pgmap v1659: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:00:57.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:57 smithi146 ceph-mon[35807]: pgmap v1660: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:00:57.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:57 smithi076 ceph-mon[35401]: pgmap v1660: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:00:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:57 smithi040 ceph-mon[32397]: pgmap v1660: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:00:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:00:58 smithi040 ceph-mon[32397]: pgmap v1661: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-07-26T13:00:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:00:58 smithi146 ceph-mon[35807]: pgmap v1661: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-07-26T13:00:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:00:58 smithi076 ceph-mon[35401]: pgmap v1661: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-07-26T13:01:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:00 smithi146 ceph-mon[35807]: pgmap v1662: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:01:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:00 smithi076 ceph-mon[35401]: pgmap v1662: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:01:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:00 smithi040 ceph-mon[32397]: pgmap v1662: 97 pgs: 97 active+clean; 7.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:01:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:02 smithi146 ceph-mon[35807]: pgmap v1663: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-07-26T13:01:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:02 smithi076 ceph-mon[35401]: pgmap v1663: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-07-26T13:01:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:02 smithi040 ceph-mon[32397]: pgmap v1663: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 MiB/s wr, 10 op/s 2024-07-26T13:01:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:04 smithi146 ceph-mon[35807]: pgmap v1664: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T13:01:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:04 smithi076 ceph-mon[35401]: pgmap v1664: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T13:01:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:04 smithi040 ceph-mon[32397]: pgmap v1664: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.6 MiB/s wr, 12 op/s 2024-07-26T13:01:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:06 smithi146 ceph-mon[35807]: pgmap v1665: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:01:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:06 smithi076 ceph-mon[35401]: pgmap v1665: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:01:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:06 smithi040 ceph-mon[32397]: pgmap v1665: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:01:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.4 2024-07-26T13:01:06.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:01:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:01:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:08 smithi146 ceph-mon[35807]: pgmap v1666: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:01:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:08 smithi076 ceph-mon[35401]: pgmap v1666: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:01:08.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:08 smithi040 ceph-mon[32397]: pgmap v1666: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:01:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 -- 172.21.15.40:0/1454911683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c109670 msgr2=0x7f235c10fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 --2- 172.21.15.40:0/1454911683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c109670 0x7f235c10fea0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2354009ca0 tx=0x7f235402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 -- 172.21.15.40:0/1454911683 shutdown_connections 2024-07-26T13:01:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 --2- 172.21.15.40:0/1454911683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c109670 0x7f235c10fea0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 --2- 172.21.15.40:0/1454911683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c108d20 0x7f235c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 --2- 172.21.15.40:0/1454911683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c1033e0 0x7f235c1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 -- 172.21.15.40:0/1454911683 >> 172.21.15.40:0/1454911683 conn(0x7f235c0fee50 msgr2=0x7f235c1012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 -- 172.21.15.40:0/1454911683 shutdown_connections 2024-07-26T13:01:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.634+0000 7f2361800640 1 -- 172.21.15.40:0/1454911683 wait complete. 2024-07-26T13:01:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.635+0000 7f2361800640 1 Processor -- start 2024-07-26T13:01:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 -- start start 2024-07-26T13:01:09.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c1033e0 0x7f235c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:09.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 0x7f235c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:09.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c109670 0x7f235c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f235c113240 con 0x7f235c108d20 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1130c0 con 0x7f235c1033e0 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.636+0000 7f2361800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1133c0 con 0x7f235c109670 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.637+0000 7f235b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 0x7f235c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.637+0000 7f235b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 0x7f235c075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53508/0 (socket says 172.21.15.40:53508) 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.637+0000 7f235b400640 1 -- 172.21.15.40:0/3145851190 learned_addr learned my addr 172.21.15.40:0/3145851190 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.637+0000 7f235be00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c1033e0 0x7f235c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.637+0000 7f2360e00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c109670 0x7f235c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.637+0000 7f235b400640 1 -- 172.21.15.40:0/3145851190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c109670 msgr2=0x7f235c075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f235b400640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c109670 0x7f235c075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f235b400640 1 -- 172.21.15.40:0/3145851190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c1033e0 msgr2=0x7f235c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f235b400640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c1033e0 0x7f235c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f235b400640 1 -- 172.21.15.40:0/3145851190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c1a7eb0 con 0x7f235c108d20 2024-07-26T13:01:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f235be00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c1033e0 0x7f235c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f2360e00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c109670 0x7f235c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f235b400640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 0x7f235c075680 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f234800d950 tx=0x7f234800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348017070 con 0x7f235c108d20 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.638+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2348009c30 con 0x7f235c108d20 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.639+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c1a81a0 con 0x7f235c108d20 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.639+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23480047a0 con 0x7f235c108d20 2024-07-26T13:01:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.639+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c1a8730 con 0x7f235c108d20 2024-07-26T13:01:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.640+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235c1037f0 con 0x7f235c108d20 2024-07-26T13:01:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.643+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2348004020 con 0x7f235c108d20 2024-07-26T13:01:09.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.646+0000 7f2358c00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23400b3c50 0x7f23400b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:09.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.647+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f23480e3d70 con 0x7f235c108d20 2024-07-26T13:01:09.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.647+0000 7f235be00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23400b3c50 0x7f23400b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.648+0000 7f235be00640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23400b3c50 0x7f23400b6160 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f234c005fd0 tx=0x7f234c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.648+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2348020020 con 0x7f235c108d20 2024-07-26T13:01:09.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.921+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f235c076440 con 0x7f235c108d20 2024-07-26T13:01:09.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.923+0000 7f2358c00640 1 -- 172.21.15.40:0/3145851190 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f235c076440 con 0x7f235c108d20 2024-07-26T13:01:09.925 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:01:09.926 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:01:09.926 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.926+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23400b3c50 msgr2=0x7f23400b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23400b3c50 0x7f23400b6160 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f234c005fd0 tx=0x7f234c005850 comp rx=0 tx=0).stop 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 msgr2=0x7f235c075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 0x7f235c075680 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f234800d950 tx=0x7f234800de10 comp rx=0 tx=0).stop 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 shutdown_connections 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f23400b3c50 0x7f23400b6160 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f235c109670 0x7f235c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235c108d20 0x7f235c075680 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 --2- 172.21.15.40:0/3145851190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f235c1033e0 0x7f235c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:09.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 >> 172.21.15.40:0/3145851190 conn(0x7f235c0fee50 msgr2=0x7f235c101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:09.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 shutdown_connections 2024-07-26T13:01:09.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:09.927+0000 7f2361800640 1 -- 172.21.15.40:0/3145851190 wait complete. 2024-07-26T13:01:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:10 smithi146 ceph-mon[35807]: pgmap v1667: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:01:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:10 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3145851190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:10 smithi076 ceph-mon[35401]: pgmap v1667: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:01:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:10 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3145851190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:10.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:10 smithi040 ceph-mon[32397]: pgmap v1667: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:01:10.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:10 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3145851190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:10.786 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130.4 --await-for 45.0' 2024-07-26T13:01:10.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130.4 --await-for 45.0 2024-07-26T13:01:11.297 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:01:12.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:12 smithi040 ceph-mon[32397]: pgmap v1668: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:01:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:12 smithi146 ceph-mon[35807]: pgmap v1668: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:01:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:12 smithi076 ceph-mon[35401]: pgmap v1668: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:01:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:01:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:01:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.616+0000 7fb00be00640 1 -- 172.21.15.40:0/57445890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c109680 msgr2=0x7fb00c10feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.616+0000 7fb00be00640 1 --2- 172.21.15.40:0/57445890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c109680 0x7fb00c10feb0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb004009900 tx=0x7fb00402a410 comp rx=0 tx=0).stop 2024-07-26T13:01:13.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:01:13.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.618 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:13.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 -- 172.21.15.40:0/57445890 shutdown_connections 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 --2- 172.21.15.40:0/57445890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c109680 0x7fb00c10feb0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 --2- 172.21.15.40:0/57445890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00c108d30 0x7fb00c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 --2- 172.21.15.40:0/57445890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb00c1033f0 0x7fb00c103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 -- 172.21.15.40:0/57445890 >> 172.21.15.40:0/57445890 conn(0x7fb00c0fee60 msgr2=0x7fb00c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 -- 172.21.15.40:0/57445890 shutdown_connections 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.617+0000 7fb00be00640 1 -- 172.21.15.40:0/57445890 wait complete. 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.618+0000 7fb00be00640 1 Processor -- start 2024-07-26T13:01:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 -- start start 2024-07-26T13:01:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 0x7fb00c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb00c108d30 0x7fb00c19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00c109680 0x7fb00c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c113250 con 0x7fb00c1033f0 2024-07-26T13:01:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c1130d0 con 0x7fb00c108d30 2024-07-26T13:01:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.619+0000 7fb00be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c1133d0 con 0x7fb00c109680 2024-07-26T13:01:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.620+0000 7fb00aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 0x7fb00c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.620+0000 7fb00aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 0x7fb00c199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48616/0 (socket says 172.21.15.40:48616) 2024-07-26T13:01:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.620+0000 7fb00aa00640 1 -- 172.21.15.40:0/4121837023 learned_addr learned my addr 172.21.15.40:0/4121837023 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.620+0000 7fb002000640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb00c108d30 0x7fb00c19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.620+0000 7fb00b400640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00c109680 0x7fb00c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.621+0000 7fb00aa00640 1 -- 172.21.15.40:0/4121837023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00c109680 msgr2=0x7fb00c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.621+0000 7fb00aa00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00c109680 0x7fb00c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.621+0000 7fb00aa00640 1 -- 172.21.15.40:0/4121837023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb00c108d30 msgr2=0x7fb00c19a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.621+0000 7fb00aa00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb00c108d30 0x7fb00c19a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.621+0000 7fb00aa00640 1 -- 172.21.15.40:0/4121837023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c19fb90 con 0x7fb00c1033f0 2024-07-26T13:01:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.621+0000 7fb00aa00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 0x7fb00c199c20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faffc00eab0 tx=0x7faffc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.622+0000 7fb003e00640 1 -- 172.21.15.40:0/4121837023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc00ce40 con 0x7fb00c1033f0 2024-07-26T13:01:13.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.622+0000 7fb003e00640 1 -- 172.21.15.40:0/4121837023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faffc011900 con 0x7fb00c1033f0 2024-07-26T13:01:13.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.622+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c19fe80 con 0x7fb00c1033f0 2024-07-26T13:01:13.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.622+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c1a65e0 con 0x7fb00c1033f0 2024-07-26T13:01:13.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.622+0000 7fb003e00640 1 -- 172.21.15.40:0/4121837023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc010990 con 0x7fb00c1033f0 2024-07-26T13:01:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.626+0000 7fb0181e6740 1 Processor -- start 2024-07-26T13:01:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.626+0000 7fb0181e6740 1 -- start start 2024-07-26T13:01:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb003e00640 1 -- 172.21.15.40:0/4121837023 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faffc011470 con 0x7fb00c1033f0 2024-07-26T13:01:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff248f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff24e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb0181e6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559c8feeed10 con 0x559c8fb7e840 2024-07-26T13:01:13.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb0181e6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559c8fe99b60 con 0x559c8fb5db60 2024-07-26T13:01:13.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb0181e6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559c8fe89060 con 0x559c8fb55980 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb00b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb00b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff243b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48626/0 (socket says 172.21.15.40:48626) 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb00aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb00b400640 1 -- 172.21.15.40:0/2529664829 learned_addr learned my addr 172.21.15.40:0/2529664829 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.627+0000 7fb002000640 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff24e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00b400640 1 -- 172.21.15.40:0/2529664829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 msgr2=0x559c8ff248f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00b400640 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff248f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00b400640 1 -- 172.21.15.40:0/2529664829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 msgr2=0x559c8ff24e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00b400640 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff24e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00b400640 1 -- 172.21.15.40:0/2529664829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8fe10b10 con 0x559c8fb7e840 2024-07-26T13:01:13.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00aa00640 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff248f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:01:13.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.628+0000 7fb00b400640 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff243b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb004009900 tx=0x7fb0040040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96863244ae863ce4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:13.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.629+0000 7faffb400640 1 -- 172.21.15.40:0/2529664829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004035030 con 0x559c8fb7e840 2024-07-26T13:01:13.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.629+0000 7faffb400640 1 -- 172.21.15.40:0/2529664829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0040044c0 con 0x559c8fb7e840 2024-07-26T13:01:13.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.629+0000 7faffb400640 1 -- 172.21.15.40:0/2529664829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0040035f0 con 0x559c8fb7e840 2024-07-26T13:01:13.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.629+0000 7fb003e00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faff00b3c40 0x7faff00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.629+0000 7fb003e00640 1 -- 172.21.15.40:0/4121837023 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faffc0e3ef0 con 0x7fb00c1033f0 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.629+0000 7fb00aa00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faff00b3c40 0x7faff00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.630+0000 7fb0181e6740 1 -- 172.21.15.40:0/2529664829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 msgr2=0x559c8ff243b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.630+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff243b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb004009900 tx=0x7fb0040040d0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.630+0000 7fb00aa00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faff00b3c40 0x7faff00b6150 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faffc0a80b0 tx=0x7faffc0e7970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 -- 172.21.15.40:0/2529664829 shutdown_connections 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff24e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff248f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2529664829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff243b0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 -- 172.21.15.40:0/2529664829 >> 172.21.15.40:0/2529664829 conn(0x559c8fb72990 msgr2=0x559c8ff222a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 -- 172.21.15.40:0/2529664829 shutdown_connections 2024-07-26T13:01:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.631+0000 7fb0181e6740 1 -- 172.21.15.40:0/2529664829 wait complete. 2024-07-26T13:01:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.632+0000 7fb0181e6740 1 -- start start 2024-07-26T13:01:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.632+0000 7fb0181e6740 1 Processor -- start 2024-07-26T13:01:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff34830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff34e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff39e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559c8fe25520 con 0x559c8fb7e840 2024-07-26T13:01:13.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559c8fe8d0a0 con 0x559c8fb5db60 2024-07-26T13:01:13.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559c8fcec7a0 con 0x559c8fb55980 2024-07-26T13:01:13.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb0181e6740 10 client.0 _ll_register_callbacks cb 0x559c8fe81bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:01:13.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb00b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb00b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff39e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48642/0 (socket says 172.21.15.40:48642) 2024-07-26T13:01:13.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb00b400640 1 -- 172.21.15.40:0/3925404265 learned_addr learned my addr 172.21.15.40:0/3925404265 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:13.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb002000640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff34e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.633+0000 7fb00b400640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff34830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fb00b400640 1 -- 172.21.15.40:0/3925404265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 msgr2=0x559c8ff34830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fb00b400640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff34830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fb00b400640 1 -- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 msgr2=0x559c8ff34e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fb00b400640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff34e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fb00b400640 1 -- 172.21.15.40:0/3925404265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8fbf8b90 con 0x559c8fb7e840 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fb00b400640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff39e30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb004004c00 tx=0x7fb004004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446c1c9819e358b8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.634+0000 7fafefe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.635+0000 7fafefe00640 1 -- 172.21.15.40:0/3925404265 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004035040 con 0x559c8fb7e840 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.635+0000 7fafefe00640 1 -- 172.21.15.40:0/3925404265 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb004005250 con 0x559c8fb7e840 2024-07-26T13:01:13.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.635+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559c8fe9bab0 con 0x559c8fb7e840 2024-07-26T13:01:13.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.635+0000 7fafefe00640 1 -- 172.21.15.40:0/3925404265 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb004005450 con 0x559c8fb7e840 2024-07-26T13:01:13.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.635+0000 7fb0181e6740 10 client.16917 fetch_fsmap learned FSMap version 35 2024-07-26T13:01:13.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.635+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559c8ff42d80 con 0x559c8fb7e840 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fafefe00640 1 -- 172.21.15.40:0/3925404265 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559c8fe9bab0 con 0x559c8fb7e840 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fafefe00640 1 -- 172.21.15.40:0/3925404265 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb004051040 con 0x559c8fb7e840 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fb0181e6740 10 client.16917 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fb0181e6740 10 client.16917 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fb0181e6740 20 client.16917 populate_metadata read hostname 'smithi040' 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fb0181e6740 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb3d1c0 0x559c8ff460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fb0181e6740 4 client.16917 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.636+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c8fe97550 con 0x559c8fb3d1c0 2024-07-26T13:01:13.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.637+0000 7fb002000640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb3d1c0 0x559c8ff460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.637+0000 7fb002000640 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb3d1c0 0x559c8ff460e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e499a459b3870afe server_cookie=45c93ce926582488 in_seq=0 out_seq=0 2024-07-26T13:01:13.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.637+0000 7fafefe00640 10 client.16917 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:13.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.639+0000 7fafefe00640 1 -- 172.21.15.40:0/3925404265 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c8fe97550 con 0x559c8fb3d1c0 2024-07-26T13:01:13.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.639+0000 7fafefe00640 10 client.16917 handle_command_reply: tid=0 2024-07-26T13:01:13.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.639+0000 7fb0181e6740 1 client.16917 shutdown 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 msgr2=0x559c8ff39e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff39e30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb004004c00 tx=0x7fb004004b00 comp rx=0 tx=0).stop 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 shutdown_connections 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb3d1c0 0x559c8ff460e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb7e840 0x559c8ff39e30 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff34e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 --2- 172.21.15.40:0/3925404265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff34830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 >> 172.21.15.40:0/3925404265 conn(0x559c8fb72990 msgr2=0x559c8ff27540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:13.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fafefe00640 0 client.16917 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:13.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 shutdown_connections 2024-07-26T13:01:13.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 1 -- 172.21.15.40:0/3925404265 wait complete. 2024-07-26T13:01:13.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.640+0000 7fb0181e6740 20 client.16917 trim_cache size 0 max 16384 2024-07-26T13:01:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.665+0000 7fb0181e6740 1 Processor -- start 2024-07-26T13:01:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.665+0000 7fb0181e6740 1 -- start start 2024-07-26T13:01:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 0x559c8ff253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff25920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb7e840 0x559c8ff25e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb0181e6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafe800e4d0 con 0x559c8fb55980 2024-07-26T13:01:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb0181e6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fafe8010010 con 0x559c8fb5db60 2024-07-26T13:01:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb0181e6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fafe800eba0 con 0x559c8fb7e840 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb00b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 0x559c8ff253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb002000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff25920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb00b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 0x559c8ff253e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48650/0 (socket says 172.21.15.40:48650) 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.666+0000 7fb00b400640 1 -- 172.21.15.40:0/765019607 learned_addr learned my addr 172.21.15.40:0/765019607 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb00b400640 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb7e840 0x559c8ff25e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb002000640 1 -- 172.21.15.40:0/765019607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb7e840 msgr2=0x559c8ff25e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb002000640 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb7e840 0x559c8ff25e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb002000640 1 -- 172.21.15.40:0/765019607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 msgr2=0x559c8ff253e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb002000640 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 0x559c8ff253e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb002000640 1 -- 172.21.15.40:0/765019607 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8ff335b0 con 0x559c8fb5db60 2024-07-26T13:01:13.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.667+0000 7fb00b400640 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 0x559c8ff253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:01:13.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.668+0000 7fb002000640 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff25920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x559c8feeede0 tx=0x7faff4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4563b46914252f20 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:13.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.668+0000 7faffaa00640 1 -- 172.21.15.40:0/765019607 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4022070 con 0x559c8fb5db60 2024-07-26T13:01:13.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.668+0000 7faffaa00640 1 -- 172.21.15.40:0/765019607 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faff4004250 con 0x559c8fb5db60 2024-07-26T13:01:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.669+0000 7faffaa00640 1 -- 172.21.15.40:0/765019607 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff401f690 con 0x559c8fb5db60 2024-07-26T13:01:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 -- 172.21.15.40:0/765019607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 msgr2=0x559c8ff25920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff25920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x559c8feeede0 tx=0x7faff4005f90 comp rx=0 tx=0).stop 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 -- 172.21.15.40:0/765019607 shutdown_connections 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb7e840 0x559c8ff25e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb5db60 0x559c8ff25920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 --2- 172.21.15.40:0/765019607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb55980 0x559c8ff253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 -- 172.21.15.40:0/765019607 >> 172.21.15.40:0/765019607 conn(0x559c8fb72990 msgr2=0x559c8ff21be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 -- 172.21.15.40:0/765019607 shutdown_connections 2024-07-26T13:01:13.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.670+0000 7fb0181e6740 1 -- 172.21.15.40:0/765019607 wait complete. 2024-07-26T13:01:13.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.671+0000 7fb0181e6740 1 -- start start 2024-07-26T13:01:13.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.671+0000 7fb0181e6740 1 Processor -- start 2024-07-26T13:01:13.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff40680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 0x559c8ff40c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb7e840 0x559c8ff3c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafe800f940 con 0x559c8fb5db60 2024-07-26T13:01:13.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fafe800f270 con 0x559c8fb7e840 2024-07-26T13:01:13.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fafe800c490 con 0x559c8fb55980 2024-07-26T13:01:13.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb0181e6740 10 client.0 _ll_register_callbacks cb 0x7faff4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb002000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 0x559c8ff40c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb00b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb002000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 0x559c8ff40c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48666/0 (socket says 172.21.15.40:48666) 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb002000640 1 -- 172.21.15.40:0/2408493219 learned_addr learned my addr 172.21.15.40:0/2408493219 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.672+0000 7fb00b400640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb7e840 0x559c8ff3c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb002000640 1 -- 172.21.15.40:0/2408493219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 msgr2=0x559c8ff40680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb002000640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff40680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb002000640 1 -- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb7e840 msgr2=0x559c8ff3c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb002000640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb7e840 0x559c8ff3c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb002000640 1 -- 172.21.15.40:0/2408493219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8ff3cc60 con 0x559c8fb5db60 2024-07-26T13:01:13.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb00b400640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb7e840 0x559c8ff3c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:13.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fb002000640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 0x559c8ff40c20 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7faff4000c00 tx=0x7faff4004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80368bfaf967f4f7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:13.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.673+0000 7fafefe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fafefe00640 1 -- 172.21.15.40:0/2408493219 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4022040 con 0x559c8fb5db60 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff4004250 con 0x559c8fb5db60 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fafefe00640 1 -- 172.21.15.40:0/2408493219 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faff4003800 con 0x559c8fb5db60 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fafefe00640 1 -- 172.21.15.40:0/2408493219 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7faff4003a00 con 0x559c8fb5db60 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fb0181e6740 10 client.16923 fetch_fsmap learned FSMap version 35 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559c8ffae0d0 con 0x559c8fb5db60 2024-07-26T13:01:13.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.674+0000 7fafefe00640 1 -- 172.21.15.40:0/2408493219 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faff4004250 con 0x559c8fb5db60 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fafefe00640 1 -- 172.21.15.40:0/2408493219 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7faff4027450 con 0x559c8fb5db60 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb0181e6740 10 client.16923 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb0181e6740 10 client.16923 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb0181e6740 20 client.16923 populate_metadata read hostname 'smithi040' 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb12570 0x559c8ffb0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb0181e6740 4 client.16923 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.4, "await_for": 45.0}] 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.4, "await_for": 45.0}) -- 0x559c8fe94c90 con 0x559c8fb12570 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.675+0000 7fb00b400640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb12570 0x559c8ffb0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.676+0000 7fb00b400640 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb12570 0x559c8ffb0880 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa5e28296dff3a3 server_cookie=fd3a98cdaf256b6f in_seq=0 out_seq=0 2024-07-26T13:01:13.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.676+0000 7fafefe00640 10 client.16923 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:13.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.900+0000 7fafefe00640 1 -- 172.21.15.40:0/2408493219 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x559c8fe94c90 con 0x559c8fb12570 2024-07-26T13:01:13.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.900+0000 7fafefe00640 10 client.16923 handle_command_reply: tid=0 2024-07-26T13:01:13.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.900+0000 7fb0181e6740 1 client.16923 shutdown 2024-07-26T13:01:13.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.901+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 msgr2=0x559c8ff40c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.901+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 0x559c8ff40c20 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7faff4000c00 tx=0x7faff4004400 comp rx=0 tx=0).stop 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.901+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 shutdown_connections 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.901+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c8fb7e840 0x559c8ff3c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559c8fb12570 0x559c8ffb0880 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559c8fb5db60 0x559c8ff40c20 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fb0181e6740 1 --2- 172.21.15.40:0/2408493219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c8fb55980 0x559c8ff40680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fafefe00640 0 client.16923 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:13.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 >> 172.21.15.40:0/2408493219 conn(0x559c8fb72990 msgr2=0x559c8ff36bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:13.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 shutdown_connections 2024-07-26T13:01:13.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.902+0000 7fb0181e6740 1 -- 172.21.15.40:0/2408493219 wait complete. 2024-07-26T13:01:13.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.903+0000 7fb0181e6740 20 client.16923 trim_cache size 0 max 16384 2024-07-26T13:01:13.904 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:01:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:01:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 122, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "74b9520c": { 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 122, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.4, 2024-07-26T13:01:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:13.906 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faff00b3c40 msgr2=0x7faff00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faff00b3c40 0x7faff00b6150 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faffc0a80b0 tx=0x7faffc0e7970 comp rx=0 tx=0).stop 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 msgr2=0x7fb00c199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 0x7fb00c199c20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faffc00eab0 tx=0x7faffc00ef70 comp rx=0 tx=0).stop 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 shutdown_connections 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faff00b3c40 0x7faff00b6150 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00c109680 0x7fb00c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb00c108d30 0x7fb00c19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 --2- 172.21.15.40:0/4121837023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00c1033f0 0x7fb00c199c20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.904+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 >> 172.21.15.40:0/4121837023 conn(0x7fb00c0fee60 msgr2=0x7fb00c101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.905+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 shutdown_connections 2024-07-26T13:01:13.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:13.905+0000 7fb00be00640 1 -- 172.21.15.40:0/4121837023 wait complete. 2024-07-26T13:01:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:14 smithi076 ceph-mon[35401]: pgmap v1669: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:01:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:01:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:01:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:14.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:14 smithi040 ceph-mon[32397]: pgmap v1669: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:01:14.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:01:14.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:01:14.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:14.722 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '74b9520c', quiesce took 7.9 seconds. Will release after: 2.5 2024-07-26T13:01:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:14 smithi146 ceph-mon[35807]: pgmap v1669: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:01:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:01:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:01:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:01:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:16 smithi076 ceph-mon[35401]: pgmap v1670: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:01:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:16 smithi040 ceph-mon[32397]: pgmap v1670: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:01:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:16 smithi146 ceph-mon[35807]: pgmap v1670: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:01:17.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:01:17.707 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:01:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:18 smithi040 ceph-mon[32397]: pgmap v1671: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:01:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:18 smithi146 ceph-mon[35807]: pgmap v1671: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:01:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:18 smithi076 ceph-mon[35401]: pgmap v1671: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:01:19.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.877+0000 7f739c800640 1 -- 172.21.15.40:0/3808348183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410b100 msgr2=0x7f739410b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.877+0000 7f739c800640 1 --2- 172.21.15.40:0/3808348183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410b100 0x7f739410b510 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7384009900 tx=0x7f738402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.877+0000 7f739c800640 1 -- 172.21.15.40:0/3808348183 shutdown_connections 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.877+0000 7f739c800640 1 --2- 172.21.15.40:0/3808348183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410ba50 0x7f7394112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.877+0000 7f739c800640 1 --2- 172.21.15.40:0/3808348183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410b100 0x7f739410b510 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.877+0000 7f739c800640 1 --2- 172.21.15.40:0/3808348183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 0x7f7394105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.878+0000 7f739c800640 1 -- 172.21.15.40:0/3808348183 >> 172.21.15.40:0/3808348183 conn(0x7f73941011f0 msgr2=0x7f7394103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.878+0000 7f739c800640 1 -- 172.21.15.40:0/3808348183 shutdown_connections 2024-07-26T13:01:19.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.878+0000 7f739c800640 1 -- 172.21.15.40:0/3808348183 wait complete. 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.879+0000 7f739c800640 1 Processor -- start 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.879+0000 7f739c800640 1 -- start start 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739c800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 0x7f739419c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739c800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410b100 0x7f739419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739c800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 0x7f73941a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739c800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7394115590 con 0x7f739410ba50 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739c800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7394115410 con 0x7f739410b100 2024-07-26T13:01:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739c800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7394115710 con 0x7f73941057c0 2024-07-26T13:01:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 0x7f73941a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 0x7f73941a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48674/0 (socket says 172.21.15.40:48674) 2024-07-26T13:01:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f739a800640 1 -- 172.21.15.40:0/1625428680 learned_addr learned my addr 172.21.15.40:0/1625428680 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f7399400640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410b100 0x7f739419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.880+0000 7f7399e00640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 0x7f739419c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f739a800640 1 -- 172.21.15.40:0/1625428680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 msgr2=0x7f739419c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f739a800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 0x7f739419c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f739a800640 1 -- 172.21.15.40:0/1625428680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410b100 msgr2=0x7f739419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f739a800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410b100 0x7f739419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f739a800640 1 -- 172.21.15.40:0/1625428680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73941a1f30 con 0x7f739410ba50 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f7399400640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410b100 0x7f739419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f7399e00640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 0x7f739419c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.881+0000 7f739a800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 0x7f73941a18c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f739000cce0 tx=0x7f739000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.882+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739000f450 con 0x7f739410ba50 2024-07-26T13:01:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.882+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f739000fa80 con 0x7f739410ba50 2024-07-26T13:01:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.882+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73941a2220 con 0x7f739410ba50 2024-07-26T13:01:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.882+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390018ad0 con 0x7f739410ba50 2024-07-26T13:01:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.882+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73941a26e0 con 0x7f739410ba50 2024-07-26T13:01:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.883+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7394105bd0 con 0x7f739410ba50 2024-07-26T13:01:19.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.886+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f739000f5f0 con 0x7f739410ba50 2024-07-26T13:01:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.888+0000 7f738ea00640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f737c0b3c00 0x7f737c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.888+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73900e45c0 con 0x7f739410ba50 2024-07-26T13:01:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.888+0000 7f7399e00640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f737c0b3c00 0x7f737c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.889+0000 7f7399e00640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f737c0b3c00 0x7f737c0b6110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7388009b40 tx=0x7f7388005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:19.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:19.890+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7390014030 con 0x7f739410ba50 2024-07-26T13:01:20.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.129+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f739419d1b0 con 0x7f739410ba50 2024-07-26T13:01:20.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.131+0000 7f738ea00640 1 -- 172.21.15.40:0/1625428680 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f739419d1b0 con 0x7f739410ba50 2024-07-26T13:01:20.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:01:20.132 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:01:20.132 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:01:20.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.133+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f737c0b3c00 msgr2=0x7f737c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.133+0000 7f739c800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f737c0b3c00 0x7f737c0b6110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7388009b40 tx=0x7f7388005e50 comp rx=0 tx=0).stop 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.133+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 msgr2=0x7f73941a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.133+0000 7f739c800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 0x7f73941a18c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f739000cce0 tx=0x7f739000a620 comp rx=0 tx=0).stop 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 shutdown_connections 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f739410ba50 0x7f73941a18c0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f739410b100 0x7f739419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f737c0b3c00 0x7f737c0b6110 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 --2- 172.21.15.40:0/1625428680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73941057c0 0x7f739419c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 >> 172.21.15.40:0/1625428680 conn(0x7f73941011f0 msgr2=0x7f7394103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 shutdown_connections 2024-07-26T13:01:20.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:20.134+0000 7f739c800640 1 -- 172.21.15.40:0/1625428680 wait complete. 2024-07-26T13:01:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:20 smithi040 ceph-mon[32397]: pgmap v1672: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:01:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:20 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1625428680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:20 smithi146 ceph-mon[35807]: pgmap v1672: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:01:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:20 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1625428680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:20 smithi076 ceph-mon[35401]: pgmap v1672: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:01:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:20 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1625428680' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:20.946 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 74b9520c --release --await' 2024-07-26T13:01:20.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 74b9520c --release --await 2024-07-26T13:01:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:01:22.606 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:22 smithi040 ceph-mon[32397]: pgmap v1673: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:01:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:22 smithi146 ceph-mon[35807]: pgmap v1673: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:01:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:22 smithi076 ceph-mon[35401]: pgmap v1673: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:01:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 -- 172.21.15.40:0/728161324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f423810f520 msgr2=0x7f423810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 --2- 172.21.15.40:0/728161324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f423810f520 0x7f423810f930 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4220009ca0 tx=0x7f422002a8b0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 -- 172.21.15.40:0/728161324 shutdown_connections 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 --2- 172.21.15.40:0/728161324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 0x7f42381166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 --2- 172.21.15.40:0/728161324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f423810f520 0x7f423810f930 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 --2- 172.21.15.40:0/728161324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238109be0 0x7f4238109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 -- 172.21.15.40:0/728161324 >> 172.21.15.40:0/728161324 conn(0x7f4238077b10 msgr2=0x7f4238107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 -- 172.21.15.40:0/728161324 shutdown_connections 2024-07-26T13:01:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.535+0000 7f423f800640 1 -- 172.21.15.40:0/728161324 wait complete. 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.536+0000 7f423f800640 1 Processor -- start 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 -- start start 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 0x7f42381a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f423810f520 0x7f42381a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 0x7f42381a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4238119a30 con 0x7f4238109be0 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42381198b0 con 0x7f423810fe70 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423f800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4238119bb0 con 0x7f423810f520 2024-07-26T13:01:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 0x7f42381a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 0x7f42381a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56838/0 (socket says 172.21.15.40:56838) 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.537+0000 7f423ce00640 1 -- 172.21.15.40:0/2786038022 learned_addr learned my addr 172.21.15.40:0/2786038022 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f4237e00640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f423810f520 0x7f42381a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423ce00640 1 -- 172.21.15.40:0/2786038022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f423810f520 msgr2=0x7f42381a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423ce00640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f423810f520 0x7f42381a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423d800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 0x7f42381a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423ce00640 1 -- 172.21.15.40:0/2786038022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 msgr2=0x7f42381a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423ce00640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 0x7f42381a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423ce00640 1 -- 172.21.15.40:0/2786038022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42381a6310 con 0x7f4238109be0 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.538+0000 7f423d800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 0x7f42381a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:01:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.539+0000 7f423ce00640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 0x7f42381a0460 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f422800c920 tx=0x7f422800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.539+0000 7f4235600640 1 -- 172.21.15.40:0/2786038022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228007c70 con 0x7f4238109be0 2024-07-26T13:01:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.539+0000 7f4235600640 1 -- 172.21.15.40:0/2786038022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4228007e10 con 0x7f4238109be0 2024-07-26T13:01:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.539+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42381a6600 con 0x7f4238109be0 2024-07-26T13:01:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.539+0000 7f4235600640 1 -- 172.21.15.40:0/2786038022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228018710 con 0x7f4238109be0 2024-07-26T13:01:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.539+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42381ace20 con 0x7f4238109be0 2024-07-26T13:01:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 Processor -- start 2024-07-26T13:01:23.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 -- start start 2024-07-26T13:01:23.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f4235600640 1 -- 172.21.15.40:0/2786038022 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f422800f450 con 0x7f4238109be0 2024-07-26T13:01:23.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863835520 0x558863bd9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863bda520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 0x558863bdaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558863b50f50 con 0x558863814840 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558863b40450 con 0x558863835520 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.543+0000 7f42463de740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558863b44490 con 0x55886380c660 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.544+0000 7f4237e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 0x558863bdaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.544+0000 7f4237e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 0x558863bdaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56854/0 (socket says 172.21.15.40:56854) 2024-07-26T13:01:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.544+0000 7f423ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863bda520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.544+0000 7f4237e00640 1 -- 172.21.15.40:0/1344042932 learned_addr learned my addr 172.21.15.40:0/1344042932 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.544+0000 7f423d800640 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863835520 0x558863bd9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.545+0000 7f4237e00640 1 -- 172.21.15.40:0/1344042932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 msgr2=0x558863bda520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.545+0000 7f4237e00640 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863bda520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.545+0000 7f4237e00640 1 -- 172.21.15.40:0/1344042932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863835520 msgr2=0x558863bd9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.545+0000 7f4237e00640 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863835520 0x558863bd9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.545+0000 7f4237e00640 1 -- 172.21.15.40:0/1344042932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588638a0b00 con 0x558863814840 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.545+0000 7f4237e00640 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 0x558863bdaa60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4220009ca0 tx=0x7f4220009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bf8462941d1225 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.546+0000 7f422e000640 1 -- 172.21.15.40:0/1344042932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42200309b0 con 0x558863814840 2024-07-26T13:01:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.546+0000 7f4235600640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42180b3c00 0x7f42180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.546+0000 7f422e000640 1 -- 172.21.15.40:0/1344042932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4220036040 con 0x558863814840 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.546+0000 7f422e000640 1 -- 172.21.15.40:0/1344042932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220004470 con 0x558863814840 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.546+0000 7f4235600640 1 -- 172.21.15.40:0/2786038022 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42280e3eb0 con 0x7f4238109be0 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.546+0000 7f423d800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42180b3c00 0x7f42180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 -- 172.21.15.40:0/1344042932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 msgr2=0x558863bdaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f423d800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42180b3c00 0x7f42180b6110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f423000bc80 tx=0x7f423000b340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 0x558863bdaa60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4220009ca0 tx=0x7f4220009a20 comp rx=0 tx=0).stop 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 -- 172.21.15.40:0/1344042932 shutdown_connections 2024-07-26T13:01:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863814840 0x558863bdaa60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863bda520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 --2- 172.21.15.40:0/1344042932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863835520 0x558863bd9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 -- 172.21.15.40:0/1344042932 >> 172.21.15.40:0/1344042932 conn(0x558863829910 msgr2=0x558863bd7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 -- 172.21.15.40:0/1344042932 shutdown_connections 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.547+0000 7f42463de740 1 -- 172.21.15.40:0/1344042932 wait complete. 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.548+0000 7f42463de740 1 -- start start 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.548+0000 7f42463de740 1 Processor -- start 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 0x558863be5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863be5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863835520 0x558863bf1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5588639a3bb0 con 0x55886380c660 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558863adc930 con 0x558863814840 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558863be8760 con 0x558863835520 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f42463de740 10 client.0 _ll_register_callbacks cb 0x55886384cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f423ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 0x558863be5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f423ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 0x558863be5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56858/0 (socket says 172.21.15.40:56858) 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.549+0000 7f423ce00640 1 -- 172.21.15.40:0/670497610 learned_addr learned my addr 172.21.15.40:0/670497610 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f4237e00640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863be5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423d800640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863835520 0x558863bf1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423ce00640 1 -- 172.21.15.40:0/670497610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863835520 msgr2=0x558863bf1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423ce00640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863835520 0x558863bf1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423ce00640 1 -- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 msgr2=0x558863be5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423ce00640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863be5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423ce00640 1 -- 172.21.15.40:0/670497610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558863917960 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f423ce00640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 0x558863be5670 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f42280aaac0 tx=0x7f42280aac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4086746b7471b0b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.550+0000 7f4226a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f4226a00640 1 -- 172.21.15.40:0/670497610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280ab4c0 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f4226a00640 1 -- 172.21.15.40:0/670497610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42280a7050 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4220036040 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f4226a00640 1 -- 172.21.15.40:0/670497610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f42280aadc0 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f42463de740 10 client.16941 fetch_fsmap learned FSMap version 35 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558863bf4500 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.551+0000 7f4226a00640 1 -- 172.21.15.40:0/670497610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4220036040 con 0x55886380c660 2024-07-26T13:01:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f4226a00640 1 -- 172.21.15.40:0/670497610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f42280ab0b0 con 0x55886380c660 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f42463de740 10 client.16941 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f42463de740 10 client.16941 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f42463de740 20 client.16941 populate_metadata read hostname 'smithi040' 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f42463de740 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637f3ea0 0x558863bf79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f42463de740 4 client.16941 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.552+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558863b52ea0 con 0x5588637f3ea0 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.553+0000 7f4237e00640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637f3ea0 0x558863bf79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.554+0000 7f4237e00640 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637f3ea0 0x558863bf79a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc1db71d354e273e server_cookie=13e177a19f648f3a in_seq=0 out_seq=0 2024-07-26T13:01:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.554+0000 7f4226a00640 10 client.16941 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f4226a00640 1 -- 172.21.15.40:0/670497610 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558863b52ea0 con 0x5588637f3ea0 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f4226a00640 10 client.16941 handle_command_reply: tid=0 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 client.16941 shutdown 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 msgr2=0x558863be5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 0x558863be5670 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f42280aaac0 tx=0x7f42280aac50 comp rx=0 tx=0).stop 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 shutdown_connections 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863835520 0x558863bf1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863be5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637f3ea0 0x558863bf79a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 --2- 172.21.15.40:0/670497610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55886380c660 0x558863be5670 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 >> 172.21.15.40:0/670497610 conn(0x558863829910 msgr2=0x558863bdd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f4226a00640 0 client.16941 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 shutdown_connections 2024-07-26T13:01:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.556+0000 7f42463de740 1 -- 172.21.15.40:0/670497610 wait complete. 2024-07-26T13:01:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.557+0000 7f42463de740 20 client.16941 trim_cache size 0 max 16384 2024-07-26T13:01:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 Processor -- start 2024-07-26T13:01:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 -- start start 2024-07-26T13:01:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863be0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863bdb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b5360 con 0x558863835520 2024-07-26T13:01:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b6ea0 con 0x558863814840 2024-07-26T13:01:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.576+0000 7f42463de740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b5a30 con 0x55886380c660 2024-07-26T13:01:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.577+0000 7f423d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.577+0000 7f423d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56872/0 (socket says 172.21.15.40:56872) 2024-07-26T13:01:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.577+0000 7f423d800640 1 -- 172.21.15.40:0/1744144440 learned_addr learned my addr 172.21.15.40:0/1744144440 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.577+0000 7f423ce00640 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863be0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.577+0000 7f4237e00640 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863bdb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f423d800640 1 -- 172.21.15.40:0/1744144440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 msgr2=0x558863be0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f423d800640 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863be0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f423d800640 1 -- 172.21.15.40:0/1744144440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 msgr2=0x558863bdb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f423d800640 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863bdb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f423d800640 1 -- 172.21.15.40:0/1744144440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558863bd8c60 con 0x558863835520 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f4237e00640 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863bdb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f423d800640 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be7550 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f423000bfb0 tx=0x7f4230013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af378e6813f957c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.578+0000 7f422d600640 1 -- 172.21.15.40:0/1744144440 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423001dca0 con 0x558863835520 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.579+0000 7f422d600640 1 -- 172.21.15.40:0/1744144440 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f423001de40 con 0x558863835520 2024-07-26T13:01:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.579+0000 7f422d600640 1 -- 172.21.15.40:0/1744144440 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230027480 con 0x558863835520 2024-07-26T13:01:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.579+0000 7f42463de740 1 -- 172.21.15.40:0/1744144440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 msgr2=0x558863be7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.579+0000 7f42463de740 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be7550 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f423000bfb0 tx=0x7f4230013000 comp rx=0 tx=0).stop 2024-07-26T13:01:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 -- 172.21.15.40:0/1744144440 shutdown_connections 2024-07-26T13:01:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be7550 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558863814840 0x558863bdb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 --2- 172.21.15.40:0/1744144440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55886380c660 0x558863be0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 -- 172.21.15.40:0/1744144440 >> 172.21.15.40:0/1744144440 conn(0x558863829910 msgr2=0x558863bd6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 -- 172.21.15.40:0/1744144440 shutdown_connections 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 -- 172.21.15.40:0/1744144440 wait complete. 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.580+0000 7f42463de740 1 -- start start 2024-07-26T13:01:23.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 Processor -- start 2024-07-26T13:01:23.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55886380c660 0x558863bedc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863814840 0x558863bee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b67d0 con 0x558863835520 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b6100 con 0x55886380c660 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b3320 con 0x558863814840 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.581+0000 7f42463de740 10 client.0 _ll_register_callbacks cb 0x7f422800a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56876/0 (socket says 172.21.15.40:56876) 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 -- 172.21.15.40:0/2736022666 learned_addr learned my addr 172.21.15.40:0/2736022666 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423ce00640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55886380c660 0x558863bedc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f4237e00640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863814840 0x558863bee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 -- 172.21.15.40:0/2736022666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863814840 msgr2=0x558863bee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863814840 0x558863bee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 -- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55886380c660 msgr2=0x558863bedc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55886380c660 0x558863bedc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.582+0000 7f423d800640 1 -- 172.21.15.40:0/2736022666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558863be9010 con 0x558863835520 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.583+0000 7f423d800640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be89d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f423001dd10 tx=0x7f423001dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5400271f5c11ca5e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.583+0000 7f4226a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.583+0000 7f4226a00640 1 -- 172.21.15.40:0/2736022666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230036060 con 0x558863835520 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.583+0000 7f4226a00640 1 -- 172.21.15.40:0/2736022666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4230027690 con 0x558863835520 2024-07-26T13:01:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.583+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423001de40 con 0x558863835520 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f4226a00640 1 -- 172.21.15.40:0/2736022666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4230004900 con 0x558863835520 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 10 client.16947 fetch_fsmap learned FSMap version 35 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558863c60a00 con 0x558863835520 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f4226a00640 1 -- 172.21.15.40:0/2736022666 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f423001de40 con 0x558863835520 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f4226a00640 1 -- 172.21.15.40:0/2736022666 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f423003b070 con 0x558863835520 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 10 client.16947 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:01:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 10 client.16947 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 20 client.16947 populate_metadata read hostname 'smithi040' 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637c9250 0x558863c63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 4 client.16947 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "74b9520c", "release": true, "await": true}] 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.584+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "74b9520c", "release": true, "await": true}) -- 0x558863b4e940 con 0x5588637c9250 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.585+0000 7f423ce00640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637c9250 0x558863c63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.586+0000 7f423ce00640 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637c9250 0x558863c63140 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfdc68cdff5b2ba9 server_cookie=ea52e13625377e1a in_seq=0 out_seq=0 2024-07-26T13:01:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.586+0000 7f4226a00640 10 client.16947 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.626+0000 7f4226a00640 1 -- 172.21.15.40:0/2736022666 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x558863b4e940 con 0x5588637c9250 2024-07-26T13:01:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.626+0000 7f4226a00640 10 client.16947 handle_command_reply: tid=0 2024-07-26T13:01:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.626+0000 7f42463de740 1 client.16947 shutdown 2024-07-26T13:01:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.626+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 msgr2=0x558863be89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.626+0000 7f42463de740 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be89d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f423001dd10 tx=0x7f423001dd40 comp rx=0 tx=0).stop 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 shutdown_connections 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588637c9250 0x558863c63140 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558863835520 0x558863be89d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558863814840 0x558863bee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 --2- 172.21.15.40:0/2736022666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55886380c660 0x558863bedc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 >> 172.21.15.40:0/2736022666 conn(0x558863829910 msgr2=0x558863be7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f4226a00640 0 client.16947 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.627+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 shutdown_connections 2024-07-26T13:01:23.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.628+0000 7f42463de740 1 -- 172.21.15.40:0/2736022666 wait complete. 2024-07-26T13:01:23.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.628+0000 7f42463de740 20 client.16947 trim_cache size 0 max 16384 2024-07-26T13:01:23.629 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:01:23.629 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:01:23.629 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 124, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "74b9520c": { 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 124, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.4, 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:01:23.630 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:23.631 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:01:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42180b3c00 msgr2=0x7f42180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42180b3c00 0x7f42180b6110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f423000bc80 tx=0x7f423000b340 comp rx=0 tx=0).stop 2024-07-26T13:01:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 msgr2=0x7f42381a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 0x7f42381a0460 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f422800c920 tx=0x7f422800cde0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 shutdown_connections 2024-07-26T13:01:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f423810fe70 0x7f42381a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f42180b3c00 0x7f42180b6110 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.629+0000 7f423f800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f423810f520 0x7f42381a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.630+0000 7f423f800640 1 --2- 172.21.15.40:0/2786038022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4238109be0 0x7f42381a0460 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.630+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 >> 172.21.15.40:0/2786038022 conn(0x7f4238077b10 msgr2=0x7f4238108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.630+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 shutdown_connections 2024-07-26T13:01:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:23.630+0000 7f423f800640 1 -- 172.21.15.40:0/2786038022 wait complete. 2024-07-26T13:01:24.540 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '74b9520c', total seconds elapsed: 17.7 2024-07-26T13:01:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:24 smithi040 ceph-mon[32397]: pgmap v1674: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:01:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:24 smithi146 ceph-mon[35807]: pgmap v1674: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:01:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:24 smithi076 ceph-mon[35401]: pgmap v1674: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:01:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:26 smithi040 ceph-mon[32397]: pgmap v1675: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T13:01:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:26 smithi146 ceph-mon[35807]: pgmap v1675: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T13:01:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:26 smithi076 ceph-mon[35401]: pgmap v1675: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-07-26T13:01:28.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:28 smithi146 ceph-mon[35807]: pgmap v1676: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:01:28.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:28 smithi076 ceph-mon[35401]: pgmap v1676: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:01:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:28 smithi040 ceph-mon[32397]: pgmap v1676: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:01:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:30 smithi040 ceph-mon[32397]: pgmap v1677: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-07-26T13:01:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:30 smithi146 ceph-mon[35807]: pgmap v1677: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-07-26T13:01:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:30 smithi076 ceph-mon[35401]: pgmap v1677: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-07-26T13:01:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:32 smithi040 ceph-mon[32397]: pgmap v1678: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:01:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:32 smithi146 ceph-mon[35807]: pgmap v1678: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:01:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:32 smithi076 ceph-mon[35401]: pgmap v1678: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:01:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:34 smithi040 ceph-mon[32397]: pgmap v1679: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T13:01:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:34 smithi146 ceph-mon[35807]: pgmap v1679: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T13:01:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:34 smithi076 ceph-mon[35401]: pgmap v1679: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T13:01:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:36 smithi040 ceph-mon[32397]: pgmap v1680: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:01:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:36 smithi146 ceph-mon[35807]: pgmap v1680: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:01:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:36 smithi076 ceph-mon[35401]: pgmap v1680: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:01:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:38 smithi040 ceph-mon[32397]: pgmap v1681: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:01:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:38 smithi146 ceph-mon[35807]: pgmap v1681: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:01:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:38 smithi076 ceph-mon[35401]: pgmap v1681: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:01:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:40 smithi040 ceph-mon[32397]: pgmap v1682: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.2 MiB/s wr, 14 op/s 2024-07-26T13:01:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:40 smithi146 ceph-mon[35807]: pgmap v1682: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.2 MiB/s wr, 14 op/s 2024-07-26T13:01:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:40 smithi076 ceph-mon[35401]: pgmap v1682: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.2 MiB/s wr, 14 op/s 2024-07-26T13:01:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:42 smithi040 ceph-mon[32397]: pgmap v1683: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:01:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:42 smithi146 ceph-mon[35807]: pgmap v1683: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:01:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:42 smithi076 ceph-mon[35401]: pgmap v1683: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:01:43.855 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:01:43.856 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.45 2024-07-26T13:01:43.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:01:44.357 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:01:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:44 smithi040 ceph-mon[32397]: pgmap v1684: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:01:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:44 smithi146 ceph-mon[35807]: pgmap v1684: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:01:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:44 smithi076 ceph-mon[35401]: pgmap v1684: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:01:46.561 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:46 smithi040 ceph-mon[32397]: pgmap v1685: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:01:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:46 smithi146 ceph-mon[35807]: pgmap v1685: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:01:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:46 smithi076 ceph-mon[35401]: pgmap v1685: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:01:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 -- 172.21.15.40:0/630320681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f81033e0 msgr2=0x7fc2f81037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/630320681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f81033e0 0x7fc2f81037f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009900 tx=0x7fc2e402a410 comp rx=0 tx=0).stop 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 -- 172.21.15.40:0/630320681 shutdown_connections 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/630320681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f8109670 0x7fc2f810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/630320681 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f8108d20 0x7fc2f8109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/630320681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f81033e0 0x7fc2f81037f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 -- 172.21.15.40:0/630320681 >> 172.21.15.40:0/630320681 conn(0x7fc2f80fee70 msgr2=0x7fc2f81012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 -- 172.21.15.40:0/630320681 shutdown_connections 2024-07-26T13:01:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.005+0000 7fc2fcc00640 1 -- 172.21.15.40:0/630320681 wait complete. 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.006+0000 7fc2fcc00640 1 Processor -- start 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.006+0000 7fc2fcc00640 1 -- start start 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2fcc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f81033e0 0x7fc2f8075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2fcc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 0x7fc2f8075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2fcc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f8109670 0x7fc2f8075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2fcc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81131f0 con 0x7fc2f8108d20 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2fcc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8113070 con 0x7fc2f81033e0 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2fcc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8113370 con 0x7fc2f8109670 2024-07-26T13:01:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2f6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 0x7fc2f8075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2f6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 0x7fc2f8075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55134/0 (socket says 172.21.15.40:55134) 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.007+0000 7fc2f6a00640 1 -- 172.21.15.40:0/3216055279 learned_addr learned my addr 172.21.15.40:0/3216055279 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f7400640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f81033e0 0x7fc2f8075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f7e00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f8109670 0x7fc2f8075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f6a00640 1 -- 172.21.15.40:0/3216055279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f8109670 msgr2=0x7fc2f8075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f6a00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f8109670 0x7fc2f8075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f6a00640 1 -- 172.21.15.40:0/3216055279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f81033e0 msgr2=0x7fc2f8075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f6a00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f81033e0 0x7fc2f8075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f6a00640 1 -- 172.21.15.40:0/3216055279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f81a7f60 con 0x7fc2f8108d20 2024-07-26T13:01:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f7400640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f81033e0 0x7fc2f8075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:01:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.008+0000 7fc2f6a00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 0x7fc2f8075680 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800d740 tx=0x7fc2e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.009+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8017070 con 0x7fc2f8108d20 2024-07-26T13:01:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.009+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2e800de50 con 0x7fc2f8108d20 2024-07-26T13:01:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.009+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800f620 con 0x7fc2f8108d20 2024-07-26T13:01:47.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.009+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f81a8250 con 0x7fc2f8108d20 2024-07-26T13:01:47.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.009+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f81a87e0 con 0x7fc2f8108d20 2024-07-26T13:01:47.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.010+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f81037f0 con 0x7fc2f8108d20 2024-07-26T13:01:47.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.013+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc2e801a070 con 0x7fc2f8108d20 2024-07-26T13:01:47.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.015+0000 7fc2efe00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2dc0b3c50 0x7fc2dc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:47.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.016+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc2e80e3610 con 0x7fc2f8108d20 2024-07-26T13:01:47.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.016+0000 7fc2f7400640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2dc0b3c50 0x7fc2dc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:47.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.017+0000 7fc2f7400640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2dc0b3c50 0x7fc2dc0b6160 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4000c00 tx=0x7fc2e4032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:47.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.017+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc2e80aace0 con 0x7fc2f8108d20 2024-07-26T13:01:47.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.274+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2f8076440 con 0x7fc2f8108d20 2024-07-26T13:01:47.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.276+0000 7fc2efe00640 1 -- 172.21.15.40:0/3216055279 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fc2e80aa5e0 con 0x7fc2f8108d20 2024-07-26T13:01:47.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:01:47.279 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:01:47.279 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:01:47.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2dc0b3c50 msgr2=0x7fc2dc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:47.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2dc0b3c50 0x7fc2dc0b6160 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4000c00 tx=0x7fc2e4032c80 comp rx=0 tx=0).stop 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 msgr2=0x7fc2f8075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 0x7fc2f8075680 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800d740 tx=0x7fc2e800dc00 comp rx=0 tx=0).stop 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 shutdown_connections 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2dc0b3c50 0x7fc2dc0b6160 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f8109670 0x7fc2f8075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f8108d20 0x7fc2f8075680 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 --2- 172.21.15.40:0/3216055279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2f81033e0 0x7fc2f8075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 >> 172.21.15.40:0/3216055279 conn(0x7fc2f80fee70 msgr2=0x7fc2f8101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:47.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 shutdown_connections 2024-07-26T13:01:47.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:47.279+0000 7fc2fcc00640 1 -- 172.21.15.40:0/3216055279 wait complete. 2024-07-26T13:01:47.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:47 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3216055279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:47 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3216055279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:47 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3216055279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:01:48.153 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0' 2024-07-26T13:01:48.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0 2024-07-26T13:01:48.654 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:01:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:48 smithi040 ceph-mon[32397]: pgmap v1686: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:01:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:48 smithi146 ceph-mon[35807]: pgmap v1686: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:01:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:48 smithi076 ceph-mon[35401]: pgmap v1686: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:01:50.731 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:50 smithi040 ceph-mon[32397]: pgmap v1687: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T13:01:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:50 smithi146 ceph-mon[35807]: pgmap v1687: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T13:01:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:50 smithi076 ceph-mon[35401]: pgmap v1687: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.101+0000 7fb9eb200640 1 -- 172.21.15.40:0/3295219022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec1040f0 msgr2=0x7fb9ec104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.101+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3295219022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec1040f0 0x7fb9ec104500 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009900 tx=0x7fb9dc02a3f0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 -- 172.21.15.40:0/3295219022 shutdown_connections 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3295219022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9ec10d6a0 0x7fb9ec10fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3295219022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec104b20 0x7fb9ec10d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3295219022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec1040f0 0x7fb9ec104500 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 -- 172.21.15.40:0/3295219022 >> 172.21.15.40:0/3295219022 conn(0x7fb9ec0fdd60 msgr2=0x7fb9ec1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 -- 172.21.15.40:0/3295219022 shutdown_connections 2024-07-26T13:01:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.102+0000 7fb9eb200640 1 -- 172.21.15.40:0/3295219022 wait complete. 2024-07-26T13:01:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.103+0000 7fb9eb200640 1 Processor -- start 2024-07-26T13:01:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.103+0000 7fb9eb200640 1 -- start start 2024-07-26T13:01:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9eb200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9ec1040f0 0x7fb9ec19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9eb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 0x7fb9ec19c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9eb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec10d6a0 0x7fb9ec1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9eb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1131a0 con 0x7fb9ec104b20 2024-07-26T13:01:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9eb200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec113020 con 0x7fb9ec1040f0 2024-07-26T13:01:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9eb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec113320 con 0x7fb9ec10d6a0 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 0x7fb9ec19c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 0x7fb9ec19c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55154/0 (socket says 172.21.15.40:55154) 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.104+0000 7fb9e1400640 1 -- 172.21.15.40:0/3242386219 learned_addr learned my addr 172.21.15.40:0/3242386219 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9ec1040f0 0x7fb9ec19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9ea800640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec10d6a0 0x7fb9ec1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9e1400640 1 -- 172.21.15.40:0/3242386219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec10d6a0 msgr2=0x7fb9ec1a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9e1400640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec10d6a0 0x7fb9ec1a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9e1400640 1 -- 172.21.15.40:0/3242386219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9ec1040f0 msgr2=0x7fb9ec19be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9e1400640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9ec1040f0 0x7fb9ec19be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9e1400640 1 -- 172.21.15.40:0/3242386219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec1a1da0 con 0x7fb9ec104b20 2024-07-26T13:01:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.105+0000 7fb9ea800640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec10d6a0 0x7fb9ec1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.106+0000 7fb9e1400640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 0x7fb9ec19c3d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400d740 tx=0x7fb9d400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.106+0000 7fb9e3400640 1 -- 172.21.15.40:0/3242386219 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4017070 con 0x7fb9ec104b20 2024-07-26T13:01:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.106+0000 7fb9e3400640 1 -- 172.21.15.40:0/3242386219 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9d400de50 con 0x7fb9ec104b20 2024-07-26T13:01:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.106+0000 7fb9e3400640 1 -- 172.21.15.40:0/3242386219 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4004c60 con 0x7fb9ec104b20 2024-07-26T13:01:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.106+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec1a2090 con 0x7fb9ec104b20 2024-07-26T13:01:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.106+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec1a87f0 con 0x7fb9ec104b20 2024-07-26T13:01:51.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 Processor -- start 2024-07-26T13:01:51.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 -- start start 2024-07-26T13:01:51.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9e3400640 1 -- 172.21.15.40:0/3242386219 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb9d4004e00 con 0x7fb9ec104b20 2024-07-26T13:01:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c380b8850 0x557c3845f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3845f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c38097b70 0x557c3845fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557c383d3970 con 0x557c3808f990 2024-07-26T13:01:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557c383c2e70 con 0x557c380b8850 2024-07-26T13:01:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.111+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557c383c6eb0 con 0x557c38097b70 2024-07-26T13:01:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.112+0000 7fb9e9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3845f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.112+0000 7fb9e9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3845f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55166/0 (socket says 172.21.15.40:55166) 2024-07-26T13:01:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.112+0000 7fb9e9e00640 1 -- 172.21.15.40:0/760617315 learned_addr learned my addr 172.21.15.40:0/760617315 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.112+0000 7fb9ea800640 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c380b8850 0x557c3845f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.112+0000 7fb9e1400640 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c38097b70 0x557c3845fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e9e00640 1 -- 172.21.15.40:0/760617315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c38097b70 msgr2=0x557c3845fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c38097b70 0x557c3845fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e9e00640 1 -- 172.21.15.40:0/760617315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c380b8850 msgr2=0x557c3845f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c380b8850 0x557c3845f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e9e00640 1 -- 172.21.15.40:0/760617315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c3834b8e0 con 0x557c3808f990 2024-07-26T13:01:51.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e3400640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9d00b3c40 0x7fb9d00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3845f5a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc02a910 tx=0x7fb9dc031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd8c87bcf422a95 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.113+0000 7fb9e3400640 1 -- 172.21.15.40:0/3242386219 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9d40e3570 con 0x7fb9ec104b20 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.114+0000 7fb9ea800640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9d00b3c40 0x7fb9d00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.114+0000 7fb9db400640 1 -- 172.21.15.40:0/760617315 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc035030 con 0x557c3808f990 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.114+0000 7fb9db400640 1 -- 172.21.15.40:0/760617315 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9dc040070 con 0x557c3808f990 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.114+0000 7fb9db400640 1 -- 172.21.15.40:0/760617315 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc003970 con 0x557c3808f990 2024-07-26T13:01:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9ea800640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9d00b3c40 0x7fb9d00b6150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4005fd0 tx=0x7fb9e4009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 -- 172.21.15.40:0/760617315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 msgr2=0x557c3845f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3845f5a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc02a910 tx=0x7fb9dc031ba0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 -- 172.21.15.40:0/760617315 shutdown_connections 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c38097b70 0x557c3845fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3845f5a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/760617315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c380b8850 0x557c3845f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 -- 172.21.15.40:0/760617315 >> 172.21.15.40:0/760617315 conn(0x557c380acc40 msgr2=0x557c3845cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.115+0000 7fb9f7e76740 1 -- 172.21.15.40:0/760617315 shutdown_connections 2024-07-26T13:01:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.116+0000 7fb9f7e76740 1 -- 172.21.15.40:0/760617315 wait complete. 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.116+0000 7fb9f7e76740 1 -- start start 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.116+0000 7fb9f7e76740 1 Processor -- start 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3846a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3846aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557c382267b0 con 0x557c3808f990 2024-07-26T13:01:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557c3835f420 con 0x557c38097b70 2024-07-26T13:01:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557c3846d7e0 con 0x557c380b8850 2024-07-26T13:01:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9f7e76740 10 client.0 _ll_register_callbacks cb 0x557c380d00a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:01:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.117+0000 7fb9e9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3846a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3846a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55168/0 (socket says 172.21.15.40:55168) 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 -- 172.21.15.40:0/1170006852 learned_addr learned my addr 172.21.15.40:0/1170006852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3846aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9ea800640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 -- 172.21.15.40:0/1170006852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 msgr2=0x557c38476b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 -- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 msgr2=0x557c3846aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3846aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.118+0000 7fb9e9e00640 1 -- 172.21.15.40:0/1170006852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c38357c50 con 0x557c3808f990 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.119+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3846a900 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0057c0 tx=0x7fb9dc02ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588fcf5fb0b17331 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.119+0000 7fb9cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.119+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1170006852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc052060 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.119+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1170006852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9dc03c850 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.119+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9dc040070 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1170006852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb9dc035040 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 10 client.16965 fetch_fsmap learned FSMap version 35 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557c38132ba0 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1170006852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9dc040070 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1170006852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb9dc057070 con 0x557c3808f990 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 10 client.16965 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 10 client.16965 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 20 client.16965 populate_metadata read hostname 'smithi040' 2024-07-26T13:01:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c380771d0 0x557c3847c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 4 client.16965 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:01:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.120+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c383d58c0 con 0x557c380771d0 2024-07-26T13:01:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.121+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c380771d0 0x557c3847c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.122+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c380771d0 0x557c3847c890 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e61e9b163195b3 server_cookie=850c9a7ae8b3aaed in_seq=0 out_seq=0 2024-07-26T13:01:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.122+0000 7fb9cfe00640 10 client.16965 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.124+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1170006852 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c383d58c0 con 0x557c380771d0 2024-07-26T13:01:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.124+0000 7fb9cfe00640 10 client.16965 handle_command_reply: tid=0 2024-07-26T13:01:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.124+0000 7fb9f7e76740 1 client.16965 shutdown 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.124+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 msgr2=0x557c3846a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.124+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3846a900 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0057c0 tx=0x7fb9dc02ab80 comp rx=0 tx=0).stop 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 shutdown_connections 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3846aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c380771d0 0x557c3847c890 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1170006852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c3808f990 0x557c3846a900 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9cfe00640 0 client.16965 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 >> 172.21.15.40:0/1170006852 conn(0x557c380acc40 msgr2=0x557c384621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 shutdown_connections 2024-07-26T13:01:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1170006852 wait complete. 2024-07-26T13:01:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.125+0000 7fb9f7e76740 20 client.16965 trim_cache size 0 max 16384 2024-07-26T13:01:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.147+0000 7fb9f7e76740 1 Processor -- start 2024-07-26T13:01:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.147+0000 7fb9f7e76740 1 -- start start 2024-07-26T13:01:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c3808f990 0x557c38465180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 0x557c3845bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1b0d80 con 0x557c38097b70 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1b28c0 con 0x557c3808f990 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1b1450 con 0x557c380b8850 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 0x557c3845bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 0x557c3845bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55176/0 (socket says 172.21.15.40:55176) 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.148+0000 7fb9e1400640 1 -- 172.21.15.40:0/1187531330 learned_addr learned my addr 172.21.15.40:0/1187531330 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c3808f990 0x557c38465180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9ea800640 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e1400640 1 -- 172.21.15.40:0/1187531330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 msgr2=0x557c38476aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e1400640 1 -- 172.21.15.40:0/1187531330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c3808f990 msgr2=0x557c38465180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c3808f990 0x557c38465180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e1400640 1 -- 172.21.15.40:0/1187531330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c3846d040 con 0x557c38097b70 2024-07-26T13:01:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.149+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c3808f990 0x557c38465180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:01:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.150+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 0x557c3845bf50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40aa410 tx=0x7fb9d40e5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb5db99d1f4db4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.150+0000 7fb9daa00640 1 -- 172.21.15.40:0/1187531330 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4020040 con 0x557c38097b70 2024-07-26T13:01:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.150+0000 7fb9daa00640 1 -- 172.21.15.40:0/1187531330 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9d40a9f90 con 0x557c38097b70 2024-07-26T13:01:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.150+0000 7fb9daa00640 1 -- 172.21.15.40:0/1187531330 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40b3530 con 0x557c38097b70 2024-07-26T13:01:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1187531330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 msgr2=0x557c3845bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 0x557c3845bf50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40aa410 tx=0x7fb9d40e5040 comp rx=0 tx=0).stop 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1187531330 shutdown_connections 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c380b8850 0x557c38476aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c38097b70 0x557c3845bf50 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1187531330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c3808f990 0x557c38465180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1187531330 >> 172.21.15.40:0/1187531330 conn(0x557c380acc40 msgr2=0x557c3845c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1187531330 shutdown_connections 2024-07-26T13:01:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.151+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1187531330 wait complete. 2024-07-26T13:01:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.152+0000 7fb9f7e76740 1 -- start start 2024-07-26T13:01:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.152+0000 7fb9f7e76740 1 Processor -- start 2024-07-26T13:01:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c3808f990 0x557c3847fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3847d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 0x557c3847d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1b21f0 con 0x557c380b8850 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1b1b20 con 0x557c38097b70 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec1aed40 con 0x557c3808f990 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.153+0000 7fb9f7e76740 10 client.0 _ll_register_callbacks cb 0x7fb9e40096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 0x557c3847d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 0x557c3847d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55190/0 (socket says 172.21.15.40:55190) 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 -- 172.21.15.40:0/1000171200 learned_addr learned my addr 172.21.15.40:0/1000171200 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c3808f990 0x557c3847fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9e1400640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3847d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 -- 172.21.15.40:0/1000171200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c3808f990 msgr2=0x557c3847fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c3808f990 0x557c3847fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 -- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 msgr2=0x557c3847d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3847d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.154+0000 7fb9ea800640 1 -- 172.21.15.40:0/1000171200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c3847dcf0 con 0x557c380b8850 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.155+0000 7fb9ea800640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 0x557c3847d780 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4011e30 tx=0x7fb9e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eee8f4f444bdf55 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.155+0000 7fb9cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.155+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1000171200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e401fbe0 con 0x557c380b8850 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.155+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1000171200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9e401fd80 con 0x557c380b8850 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.155+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d40a9f90 con 0x557c380b8850 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.156+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1000171200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb9e4004b20 con 0x557c380b8850 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.156+0000 7fb9f7e76740 10 client.16971 fetch_fsmap learned FSMap version 35 2024-07-26T13:01:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.156+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557c384ed2f0 con 0x557c380b8850 2024-07-26T13:01:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.156+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1000171200 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9d40a9f90 con 0x557c380b8850 2024-07-26T13:01:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.156+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1000171200 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb9e4032020 con 0x557c380b8850 2024-07-26T13:01:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9f7e76740 10 client.16971 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:01:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9f7e76740 10 client.16971 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:01:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9f7e76740 20 client.16971 populate_metadata read hostname 'smithi040' 2024-07-26T13:01:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c3804c580 0x557c384efc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:01:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9f7e76740 4 client.16971 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}] 2024-07-26T13:01:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}) -- 0x557c383d1360 con 0x557c3804c580 2024-07-26T13:01:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.157+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c3804c580 0x557c384efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:01:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.158+0000 7fb9e9e00640 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c3804c580 0x557c384efc20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c34cc04ebd185c server_cookie=d415fc560e7e5ce5 in_seq=0 out_seq=0 2024-07-26T13:01:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.158+0000 7fb9cfe00640 10 client.16971 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:51.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.407+0000 7fb9cfe00640 1 -- 172.21.15.40:0/1000171200 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x557c383d1360 con 0x557c3804c580 2024-07-26T13:01:51.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.407+0000 7fb9cfe00640 10 client.16971 handle_command_reply: tid=0 2024-07-26T13:01:51.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.407+0000 7fb9f7e76740 1 client.16971 shutdown 2024-07-26T13:01:51.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.407+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 msgr2=0x557c3847d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.407+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 0x557c3847d780 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4011e30 tx=0x7fb9e4004a40 comp rx=0 tx=0).stop 2024-07-26T13:01:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 shutdown_connections 2024-07-26T13:01:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557c3804c580 0x557c384efc20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557c380b8850 0x557c3847d780 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557c38097b70 0x557c3847d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 --2- 172.21.15.40:0/1000171200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c3808f990 0x557c3847fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 >> 172.21.15.40:0/1000171200 conn(0x557c380acc40 msgr2=0x557c38460090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9cfe00640 0 client.16971 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 shutdown_connections 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.408+0000 7fb9f7e76740 1 -- 172.21.15.40:0/1000171200 wait complete. 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.409+0000 7fb9f7e76740 20 client.16971 trim_cache size 0 max 16384 2024-07-26T13:01:51.411 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 126, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "69566539": { 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 126, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:01:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:01:51.413 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.410+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9d00b3c40 msgr2=0x7fb9d00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.410+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9d00b3c40 0x7fb9d00b6150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4005fd0 tx=0x7fb9e4009800 comp rx=0 tx=0).stop 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.410+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 msgr2=0x7fb9ec19c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.410+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 0x7fb9ec19c3d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400d740 tx=0x7fb9d400dc00 comp rx=0 tx=0).stop 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 shutdown_connections 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb9d00b3c40 0x7fb9d00b6150 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9ec10d6a0 0x7fb9ec1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ec104b20 0x7fb9ec19c3d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 --2- 172.21.15.40:0/3242386219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9ec1040f0 0x7fb9ec19be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 >> 172.21.15.40:0/3242386219 conn(0x7fb9ec0fdd60 msgr2=0x7fb9ec101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:01:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 shutdown_connections 2024-07-26T13:01:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:01:51.411+0000 7fb9eb200640 1 -- 172.21.15.40:0/3242386219 wait complete. 2024-07-26T13:01:52.415 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '69566539', quiesce took 8.6 seconds. Will release after: 17.85 2024-07-26T13:01:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:52 smithi040 ceph-mon[32397]: pgmap v1688: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:01:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:52 smithi146 ceph-mon[35807]: pgmap v1688: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:01:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:52 smithi076 ceph-mon[35401]: pgmap v1688: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:01:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:54 smithi040 ceph-mon[32397]: pgmap v1689: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:01:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:54 smithi146 ceph-mon[35807]: pgmap v1689: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:01:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:54 smithi076 ceph-mon[35401]: pgmap v1689: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:01:56.721 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:56 smithi040 ceph-mon[32397]: pgmap v1690: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:01:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:56 smithi146 ceph-mon[35807]: pgmap v1690: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:01:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:56 smithi076 ceph-mon[35401]: pgmap v1690: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:01:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:01:58 smithi040 ceph-mon[32397]: pgmap v1691: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:01:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:01:58 smithi146 ceph-mon[35807]: pgmap v1691: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:01:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:01:58 smithi076 ceph-mon[35401]: pgmap v1691: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:02:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:00 smithi146 ceph-mon[35807]: pgmap v1692: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-07-26T13:02:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:00 smithi076 ceph-mon[35401]: pgmap v1692: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-07-26T13:02:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:00 smithi040 ceph-mon[32397]: pgmap v1692: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-07-26T13:02:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:02 smithi146 ceph-mon[35807]: pgmap v1693: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-07-26T13:02:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:02 smithi076 ceph-mon[35401]: pgmap v1693: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-07-26T13:02:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:02 smithi040 ceph-mon[32397]: pgmap v1693: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-07-26T13:02:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:04 smithi146 ceph-mon[35807]: pgmap v1694: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T13:02:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:04 smithi076 ceph-mon[35401]: pgmap v1694: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T13:02:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:04 smithi040 ceph-mon[32397]: pgmap v1694: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 MiB/s wr, 11 op/s 2024-07-26T13:02:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:06 smithi146 ceph-mon[35807]: pgmap v1695: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 904 KiB/s wr, 11 op/s 2024-07-26T13:02:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:06 smithi076 ceph-mon[35401]: pgmap v1695: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 904 KiB/s wr, 11 op/s 2024-07-26T13:02:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:06 smithi040 ceph-mon[32397]: pgmap v1695: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 904 KiB/s wr, 11 op/s 2024-07-26T13:02:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:08 smithi146 ceph-mon[35807]: pgmap v1696: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 562 KiB/s wr, 9 op/s 2024-07-26T13:02:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:08 smithi076 ceph-mon[35401]: pgmap v1696: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 562 KiB/s wr, 9 op/s 2024-07-26T13:02:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:08 smithi040 ceph-mon[32397]: pgmap v1696: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 562 KiB/s wr, 9 op/s 2024-07-26T13:02:10.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:02:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:10 smithi040 ceph-mon[32397]: pgmap v1697: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 563 KiB/s wr, 12 op/s 2024-07-26T13:02:10.749 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:02:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:10 smithi076 ceph-mon[35401]: pgmap v1697: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 563 KiB/s wr, 12 op/s 2024-07-26T13:02:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:10 smithi146 ceph-mon[35807]: pgmap v1697: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 563 KiB/s wr, 12 op/s 2024-07-26T13:02:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:12 smithi040 ceph-mon[32397]: pgmap v1698: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 563 KiB/s wr, 8 op/s 2024-07-26T13:02:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:12 smithi076 ceph-mon[35401]: pgmap v1698: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 563 KiB/s wr, 8 op/s 2024-07-26T13:02:13.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 -- 172.21.15.40:0/3073362268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 msgr2=0x7fd404102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:13.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 --2- 172.21.15.40:0/3073362268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404102920 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009900 tx=0x7fd3f402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 -- 172.21.15.40:0/3073362268 shutdown_connections 2024-07-26T13:02:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 --2- 172.21.15.40:0/3073362268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4041087a0 0x7fd40410efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 --2- 172.21.15.40:0/3073362268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd404107e50 0x7fd404108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 --2- 172.21.15.40:0/3073362268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404102920 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.006+0000 7fd40a400640 1 -- 172.21.15.40:0/3073362268 >> 172.21.15.40:0/3073362268 conn(0x7fd4040790e0 msgr2=0x7fd4040794f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.007+0000 7fd40a400640 1 -- 172.21.15.40:0/3073362268 shutdown_connections 2024-07-26T13:02:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.007+0000 7fd40a400640 1 -- 172.21.15.40:0/3073362268 wait complete. 2024-07-26T13:02:13.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 Processor -- start 2024-07-26T13:02:13.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 -- start start 2024-07-26T13:02:13.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd404107e50 0x7fd40419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4041087a0 0x7fd40419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd404113460 con 0x7fd404102510 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041132e0 con 0x7fd4041087a0 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.008+0000 7fd40a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041135e0 con 0x7fd404107e50 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32944/0 (socket says 172.21.15.40:32944) 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 -- 172.21.15.40:0/2530046774 learned_addr learned my addr 172.21.15.40:0/2530046774 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd402a00640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd404107e50 0x7fd40419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:13.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403e00640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4041087a0 0x7fd40419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:13.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 -- 172.21.15.40:0/2530046774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd404107e50 msgr2=0x7fd40419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:13.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd404107e50 0x7fd40419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 -- 172.21.15.40:0/2530046774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4041087a0 msgr2=0x7fd40419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4041087a0 0x7fd40419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.009+0000 7fd403400640 1 -- 172.21.15.40:0/2530046774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40419fe00 con 0x7fd404102510 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.010+0000 7fd403400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404199e90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd3f402a910 tx=0x7fd3f4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.010+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f403f070 con 0x7fd404102510 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.010+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3f4003e40 con 0x7fd404102510 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.010+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4035030 con 0x7fd404102510 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.010+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4041a0090 con 0x7fd404102510 2024-07-26T13:02:13.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.010+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4041a6850 con 0x7fd404102510 2024-07-26T13:02:13.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.012+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd404103790 con 0x7fd404102510 2024-07-26T13:02:13.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.014+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd3f4042070 con 0x7fd404102510 2024-07-26T13:02:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.016+0000 7fd3fbe00640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3e80b3bd0 0x7fd3e80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.016+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3f4104520 con 0x7fd404102510 2024-07-26T13:02:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.016+0000 7fd402a00640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3e80b3bd0 0x7fd3e80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:13.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.017+0000 7fd402a00640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3e80b3bd0 0x7fd3e80b60e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0005fd0 tx=0x7fd3f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.020+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd3f40cbb30 con 0x7fd404102510 2024-07-26T13:02:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:12 smithi146 ceph-mon[35807]: pgmap v1698: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 563 KiB/s wr, 8 op/s 2024-07-26T13:02:13.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.267+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd40410a570 con 0x7fd404102510 2024-07-26T13:02:13.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.269+0000 7fd3fbe00640 1 -- 172.21.15.40:0/2530046774 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fd3f40cb430 con 0x7fd404102510 2024-07-26T13:02:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:02:13.272 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:02:13.272 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:02:13.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.272+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3e80b3bd0 msgr2=0x7fd3e80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.272+0000 7fd40a400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3e80b3bd0 0x7fd3e80b60e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0005fd0 tx=0x7fd3f0005850 comp rx=0 tx=0).stop 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 msgr2=0x7fd404199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404199e90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd3f402a910 tx=0x7fd3f4003c20 comp rx=0 tx=0).stop 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 shutdown_connections 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd4041087a0 0x7fd40419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd3e80b3bd0 0x7fd3e80b60e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd404107e50 0x7fd40419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 --2- 172.21.15.40:0/2530046774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd404102510 0x7fd404199e90 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:13.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 >> 172.21.15.40:0/2530046774 conn(0x7fd4040790e0 msgr2=0x7fd404105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:13.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 shutdown_connections 2024-07-26T13:02:13.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:13.273+0000 7fd40a400640 1 -- 172.21.15.40:0/2530046774 wait complete. 2024-07-26T13:02:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:13 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2530046774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:14.056 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 69566539 --release --await' 2024-07-26T13:02:14.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 69566539 --release --await 2024-07-26T13:02:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:13 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2530046774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:13 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2530046774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:14.529 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:02:14.861 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:14 smithi040 ceph-mon[32397]: pgmap v1699: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T13:02:14.861 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:02:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:14 smithi146 ceph-mon[35807]: pgmap v1699: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T13:02:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:02:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:14 smithi076 ceph-mon[35401]: pgmap v1699: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T13:02:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:02:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:16 smithi040 ceph-mon[32397]: pgmap v1700: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T13:02:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 -- 172.21.15.40:0/709159598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c109850 msgr2=0x7f845c110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 --2- 172.21.15.40:0/709159598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c109850 0x7f845c110080 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8454009ca0 tx=0x7f845402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 -- 172.21.15.40:0/709159598 shutdown_connections 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 --2- 172.21.15.40:0/709159598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c109850 0x7f845c110080 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 --2- 172.21.15.40:0/709159598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f845c108f00 0x7f845c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 --2- 172.21.15.40:0/709159598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c1035c0 0x7f845c1039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 -- 172.21.15.40:0/709159598 >> 172.21.15.40:0/709159598 conn(0x7f845c0ff010 msgr2=0x7f845c101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.904+0000 7f8462400640 1 -- 172.21.15.40:0/709159598 shutdown_connections 2024-07-26T13:02:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.905+0000 7f8462400640 1 -- 172.21.15.40:0/709159598 wait complete. 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 Processor -- start 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 -- start start 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 0x7f845c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c108f00 0x7f845c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f845c109850 0x7f845c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f845c113420 con 0x7f845c1035c0 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1132a0 con 0x7f845c109850 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.906+0000 7f8462400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1135a0 con 0x7f845c108f00 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 0x7f845c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 0x7f845c075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32960/0 (socket says 172.21.15.40:32960) 2024-07-26T13:02:16.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 -- 172.21.15.40:0/1804877475 learned_addr learned my addr 172.21.15.40:0/1804877475 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f8453e00640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c108f00 0x7f845c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845be00640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f845c109850 0x7f845c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 -- 172.21.15.40:0/1804877475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c108f00 msgr2=0x7f845c075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c108f00 0x7f845c075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 -- 172.21.15.40:0/1804877475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f845c109850 msgr2=0x7f845c075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f845c109850 0x7f845c075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.907+0000 7f845b400640 1 -- 172.21.15.40:0/1804877475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c1a8070 con 0x7f845c1035c0 2024-07-26T13:02:16.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.908+0000 7f845b400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 0x7f845c075140 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f844c00e9f0 tx=0x7f844c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:16.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.908+0000 7f8458c00640 1 -- 172.21.15.40:0/1804877475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c00cd80 con 0x7f845c1035c0 2024-07-26T13:02:16.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.908+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c1a8360 con 0x7f845c1035c0 2024-07-26T13:02:16.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.908+0000 7f8458c00640 1 -- 172.21.15.40:0/1804877475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f844c0054b0 con 0x7f845c1035c0 2024-07-26T13:02:16.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.908+0000 7f8458c00640 1 -- 172.21.15.40:0/1804877475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c010430 con 0x7f845c1035c0 2024-07-26T13:02:16.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.908+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c1a8850 con 0x7f845c1035c0 2024-07-26T13:02:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.912+0000 7f84691e2740 1 Processor -- start 2024-07-26T13:02:16.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.912+0000 7f84691e2740 1 -- start start 2024-07-26T13:02:16.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.912+0000 7f8458c00640 1 -- 172.21.15.40:0/1804877475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f844c0046c0 con 0x7f845c1035c0 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f84691e2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea51fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f84691e2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea52520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f84691e2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be68c840 0x55f9bea52a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f84691e2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f9be9c8f50 con 0x55f9be6ad520 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f84691e2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f9be9b8450 con 0x55f9be684660 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f84691e2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f9be9bc490 con 0x55f9be68c840 2024-07-26T13:02:16.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f845be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea51fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f845be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea51fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32974/0 (socket says 172.21.15.40:32974) 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f845be00640 1 -- 172.21.15.40:0/2850922147 learned_addr learned my addr 172.21.15.40:0/2850922147 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.913+0000 7f845b400640 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea52520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.914+0000 7f845be00640 1 -- 172.21.15.40:0/2850922147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be68c840 msgr2=0x55f9bea52a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.914+0000 7f845be00640 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be68c840 0x55f9bea52a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.914+0000 7f845be00640 1 -- 172.21.15.40:0/2850922147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 msgr2=0x55f9bea52520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.914+0000 7f845be00640 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea52520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.914+0000 7f845be00640 1 -- 172.21.15.40:0/2850922147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9be718b00 con 0x55f9be6ad520 2024-07-26T13:02:16.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.914+0000 7f845be00640 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea51fe0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8454009ca0 tx=0x7f8454009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86890e7d860abe52 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:16.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.915+0000 7f8450c00640 1 -- 172.21.15.40:0/2850922147 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454031790 con 0x55f9be6ad520 2024-07-26T13:02:16.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.915+0000 7f8458c00640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84400b3bd0 0x7f84400b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.915+0000 7f8450c00640 1 -- 172.21.15.40:0/2850922147 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8454036030 con 0x55f9be6ad520 2024-07-26T13:02:16.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.915+0000 7f8450c00640 1 -- 172.21.15.40:0/2850922147 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84540042d0 con 0x55f9be6ad520 2024-07-26T13:02:16.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.915+0000 7f8458c00640 1 -- 172.21.15.40:0/1804877475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f844c0e3fa0 con 0x7f845c1035c0 2024-07-26T13:02:16.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.915+0000 7f845b400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84400b3bd0 0x7f84400b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 -- 172.21.15.40:0/2850922147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 msgr2=0x55f9bea51fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f845b400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84400b3bd0 0x7f84400b60e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f844c0e1a60 tx=0x7f844c0e79e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea51fe0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8454009ca0 tx=0x7f8454009a20 comp rx=0 tx=0).stop 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 -- 172.21.15.40:0/2850922147 shutdown_connections 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be68c840 0x55f9bea52a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea52520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 --2- 172.21.15.40:0/2850922147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea51fe0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 -- 172.21.15.40:0/2850922147 >> 172.21.15.40:0/2850922147 conn(0x55f9be6a1910 msgr2=0x55f9bea4fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 -- 172.21.15.40:0/2850922147 shutdown_connections 2024-07-26T13:02:16.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.916+0000 7f84691e2740 1 -- 172.21.15.40:0/2850922147 wait complete. 2024-07-26T13:02:16.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.917+0000 7f84691e2740 1 -- start start 2024-07-26T13:02:16.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.917+0000 7f84691e2740 1 Processor -- start 2024-07-26T13:02:16.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 0x55f9bea5d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea5db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bea5e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55f9be81bbb0 con 0x55f9be684660 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f9be954930 con 0x55f9be68c840 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f9bea605e0 con 0x55f9be6ad520 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f84691e2740 10 client.0 _ll_register_callbacks cb 0x55f9be6c4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f845be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 0x55f9bea5d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f845be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 0x55f9bea5d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:32988/0 (socket says 172.21.15.40:32988) 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f845be00640 1 -- 172.21.15.40:0/1017736716 learned_addr learned my addr 172.21.15.40:0/1017736716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.918+0000 7f8453e00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea5db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bea5e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 -- 172.21.15.40:0/1017736716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 msgr2=0x55f9bea5e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bea5e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 -- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 msgr2=0x55f9bea5db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea5db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 -- 172.21.15.40:0/1017736716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9be78f960 con 0x55f9be684660 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f845be00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 0x55f9bea5d620 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8454009620 tx=0x7f8454003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad73066dffa168d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f8449600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.919+0000 7f8449600640 1 -- 172.21.15.40:0/1017736716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454058060 con 0x55f9be684660 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f8449600640 1 -- 172.21.15.40:0/1017736716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8454031d90 con 0x55f9be684660 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8454036030 con 0x55f9be684660 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f8449600640 1 -- 172.21.15.40:0/1017736716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f84540040b0 con 0x55f9be684660 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f84691e2740 10 client.16989 fetch_fsmap learned FSMap version 35 2024-07-26T13:02:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f9bea6c290 con 0x55f9be684660 2024-07-26T13:02:16.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f8449600640 1 -- 172.21.15.40:0/1017736716 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8454036030 con 0x55f9be684660 2024-07-26T13:02:16.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.920+0000 7f8449600640 1 -- 172.21.15.40:0/1017736716 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f845405d070 con 0x55f9be684660 2024-07-26T13:02:16.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f84691e2740 10 client.16989 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f84691e2740 10 client.16989 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f84691e2740 20 client.16989 populate_metadata read hostname 'smithi040' 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f84691e2740 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be66bea0 0x55f9bea6f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f84691e2740 4 client.16989 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9be9caea0 con 0x55f9be66bea0 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.921+0000 7f8453e00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be66bea0 0x55f9bea6f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.922+0000 7f8453e00640 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be66bea0 0x55f9bea6f5f0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cca4ca7d7b68cef server_cookie=b17de0373821b826 in_seq=0 out_seq=0 2024-07-26T13:02:16.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.922+0000 7f8449600640 10 client.16989 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:16.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.923+0000 7f8449600640 1 -- 172.21.15.40:0/1017736716 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9be9caea0 con 0x55f9be66bea0 2024-07-26T13:02:16.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.923+0000 7f8449600640 10 client.16989 handle_command_reply: tid=0 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.923+0000 7f84691e2740 1 client.16989 shutdown 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 msgr2=0x55f9bea5d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 0x55f9bea5d620 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8454009620 tx=0x7f8454003e70 comp rx=0 tx=0).stop 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 shutdown_connections 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bea5e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea5db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be66bea0 0x55f9bea6f5f0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 --2- 172.21.15.40:0/1017736716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be684660 0x55f9bea5d620 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 >> 172.21.15.40:0/1017736716 conn(0x55f9be6a1910 msgr2=0x55f9bea551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f8449600640 0 client.16989 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 shutdown_connections 2024-07-26T13:02:16.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 1 -- 172.21.15.40:0/1017736716 wait complete. 2024-07-26T13:02:16.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.924+0000 7f84691e2740 20 client.16989 trim_cache size 0 max 16384 2024-07-26T13:02:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.943+0000 7f84691e2740 1 Processor -- start 2024-07-26T13:02:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.943+0000 7f84691e2740 1 -- start start 2024-07-26T13:02:16.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f84691e2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be684660 0x55f9bea53680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f84691e2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea4f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f84691e2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea5f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f84691e2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1b0ea0 con 0x55f9be6ad520 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f84691e2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1b29e0 con 0x55f9be68c840 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f84691e2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1b1570 con 0x55f9be684660 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f845be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be684660 0x55f9bea53680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f845be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea5f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f845be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea5f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33000/0 (socket says 172.21.15.40:33000) 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.944+0000 7f845be00640 1 -- 172.21.15.40:0/1437231562 learned_addr learned my addr 172.21.15.40:0/1437231562 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f8453e00640 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea4f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f845be00640 1 -- 172.21.15.40:0/1437231562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be684660 msgr2=0x55f9bea53680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f845be00640 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be684660 0x55f9bea53680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f845be00640 1 -- 172.21.15.40:0/1437231562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 msgr2=0x55f9bea4f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f845be00640 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea4f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f845be00640 1 -- 172.21.15.40:0/1437231562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bea6f960 con 0x55f9be6ad520 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.945+0000 7f845be00640 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea5f500 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f845402aeb0 tx=0x7f8454003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f951d10aefade6f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.946+0000 7f844be00640 1 -- 172.21.15.40:0/1437231562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454063040 con 0x55f9be6ad520 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.946+0000 7f844be00640 1 -- 172.21.15.40:0/1437231562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8454036070 con 0x55f9be6ad520 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.946+0000 7f844be00640 1 -- 172.21.15.40:0/1437231562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454058040 con 0x55f9be6ad520 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 -- 172.21.15.40:0/1437231562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 msgr2=0x55f9bea5f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea5f500 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f845402aeb0 tx=0x7f8454003ee0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 -- 172.21.15.40:0/1437231562 shutdown_connections 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be6ad520 0x55f9bea5f500 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be68c840 0x55f9bea4f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 --2- 172.21.15.40:0/1437231562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be684660 0x55f9bea53680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 -- 172.21.15.40:0/1437231562 >> 172.21.15.40:0/1437231562 conn(0x55f9be6a1910 msgr2=0x55f9bea580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 -- 172.21.15.40:0/1437231562 shutdown_connections 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 -- 172.21.15.40:0/1437231562 wait complete. 2024-07-26T13:02:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.947+0000 7f84691e2740 1 -- start start 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 Processor -- start 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea62060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 0x55f9bea62640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bead0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1b2310 con 0x55f9be68c840 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1b1c40 con 0x55f9be684660 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f845c1aee60 con 0x55f9be6ad520 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.948+0000 7f84691e2740 10 client.0 _ll_register_callbacks cb 0x7f844c0e78b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:02:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 0x55f9bea62640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 0x55f9bea62640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33004/0 (socket says 172.21.15.40:33004) 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 -- 172.21.15.40:0/1971019876 learned_addr learned my addr 172.21.15.40:0/1971019876 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f845be00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bead0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f845be00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea62060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 -- 172.21.15.40:0/1971019876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 msgr2=0x55f9bead0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bead0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 -- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 msgr2=0x55f9bea62060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea62060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 -- 172.21.15.40:0/1971019876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9bead11a0 con 0x55f9be68c840 2024-07-26T13:02:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f845be00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bead0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8453e00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 0x55f9bea62640 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f845c06b2d0 tx=0x7f8444004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33af97394b24db70 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.949+0000 7f8449600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f8449600640 1 -- 172.21.15.40:0/1971019876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844401d380 con 0x55f9be68c840 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f8449600640 1 -- 172.21.15.40:0/1971019876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f844401d520 con 0x55f9be68c840 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8454036070 con 0x55f9be68c840 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f8449600640 1 -- 172.21.15.40:0/1971019876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f844401d720 con 0x55f9be68c840 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f84691e2740 10 client.16995 fetch_fsmap learned FSMap version 35 2024-07-26T13:02:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f9bead8590 con 0x55f9be68c840 2024-07-26T13:02:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.950+0000 7f8449600640 1 -- 172.21.15.40:0/1971019876 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8454036070 con 0x55f9be68c840 2024-07-26T13:02:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f8449600640 1 -- 172.21.15.40:0/1971019876 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f8444026ac0 con 0x55f9be68c840 2024-07-26T13:02:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f84691e2740 10 client.16995 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f84691e2740 10 client.16995 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f84691e2740 20 client.16995 populate_metadata read hostname 'smithi040' 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f84691e2740 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be641250 0x55f9beadad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f84691e2740 4 client.16995 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "69566539", "release": true, "await": true}] 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.951+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "69566539", "release": true, "await": true}) -- 0x55f9be9c6940 con 0x55f9be641250 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.952+0000 7f845be00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be641250 0x55f9beadad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.953+0000 7f845be00640 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be641250 0x55f9beadad50 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd6cf192212fda4 server_cookie=76a4cfd1a1fe0900 in_seq=0 out_seq=0 2024-07-26T13:02:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.953+0000 7f8449600640 10 client.16995 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.991+0000 7f8449600640 1 -- 172.21.15.40:0/1971019876 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55f9be9c6940 con 0x55f9be641250 2024-07-26T13:02:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.991+0000 7f8449600640 10 client.16995 handle_command_reply: tid=0 2024-07-26T13:02:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.991+0000 7f84691e2740 1 client.16995 shutdown 2024-07-26T13:02:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 msgr2=0x55f9bea62640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 0x55f9bea62640 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f845c06b2d0 tx=0x7f8444004410 comp rx=0 tx=0).stop 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 shutdown_connections 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9be6ad520 0x55f9bead0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55f9be641250 0x55f9beadad50 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9be68c840 0x55f9bea62640 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 --2- 172.21.15.40:0/1971019876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9be684660 0x55f9bea62060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 >> 172.21.15.40:0/1971019876 conn(0x55f9be6a1910 msgr2=0x55f9bea580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f8449600640 0 client.16995 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.992+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 shutdown_connections 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.993+0000 7f84691e2740 1 -- 172.21.15.40:0/1971019876 wait complete. 2024-07-26T13:02:16.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.993+0000 7f84691e2740 20 client.16995 trim_cache size 0 max 16384 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 128, 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "69566539": { 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 128, 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:02:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:16.997 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:16.998 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:16.998 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:02:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84400b3bd0 msgr2=0x7f84400b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84400b3bd0 0x7f84400b60e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f844c0e1a60 tx=0x7f844c0e79e0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 msgr2=0x7f845c075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 0x7f845c075140 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f844c00e9f0 tx=0x7f844c00edf0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 shutdown_connections 2024-07-26T13:02:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f845c109850 0x7f845c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f84400b3bd0 0x7f84400b60e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845c108f00 0x7f845c075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 --2- 172.21.15.40:0/1804877475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f845c1035c0 0x7f845c075140 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.994+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 >> 172.21.15.40:0/1804877475 conn(0x7f845c0ff010 msgr2=0x7f845c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.995+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 shutdown_connections 2024-07-26T13:02:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:16.995+0000 7f8462400640 1 -- 172.21.15.40:0/1804877475 wait complete. 2024-07-26T13:02:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:16 smithi146 ceph-mon[35807]: pgmap v1700: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T13:02:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:16 smithi076 ceph-mon[35401]: pgmap v1700: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-07-26T13:02:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:18.533 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '69566539', total seconds elapsed: 34.7 2024-07-26T13:02:18.533 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.45 2024-07-26T13:02:18.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:02:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:02:19.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:18 smithi040 ceph-mon[32397]: pgmap v1701: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:02:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:18 smithi146 ceph-mon[35807]: pgmap v1701: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:02:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:18 smithi076 ceph-mon[35401]: pgmap v1701: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:02:20.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:20 smithi040 ceph-mon[32397]: pgmap v1702: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T13:02:20.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:20.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:20 smithi146 ceph-mon[35807]: pgmap v1702: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T13:02:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:20 smithi076 ceph-mon[35401]: pgmap v1702: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T13:02:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.506+0000 7f8749800640 1 -- 172.21.15.40:0/1146857643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441035d0 msgr2=0x7f87441039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.506+0000 7f8749800640 1 --2- 172.21.15.40:0/1146857643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441035d0 0x7f87441039e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8734009900 tx=0x7f873402a410 comp rx=0 tx=0).stop 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 -- 172.21.15.40:0/1146857643 shutdown_connections 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 --2- 172.21.15.40:0/1146857643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8744109860 0x7f8744110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 --2- 172.21.15.40:0/1146857643 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8744108f10 0x7f8744109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 --2- 172.21.15.40:0/1146857643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87441035d0 0x7f87441039e0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 -- 172.21.15.40:0/1146857643 >> 172.21.15.40:0/1146857643 conn(0x7f87440ff000 msgr2=0x7f8744101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 -- 172.21.15.40:0/1146857643 shutdown_connections 2024-07-26T13:02:21.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.507+0000 7f8749800640 1 -- 172.21.15.40:0/1146857643 wait complete. 2024-07-26T13:02:21.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.508+0000 7f8749800640 1 Processor -- start 2024-07-26T13:02:21.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.508+0000 7f8749800640 1 -- start start 2024-07-26T13:02:21.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8749800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87441035d0 0x7f874419c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:21.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8749800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8744108f10 0x7f874419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:21.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8749800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 0x7f87441a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:21.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8749800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f87441133e0 con 0x7f8744109860 2024-07-26T13:02:21.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8749800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8744113260 con 0x7f87441035d0 2024-07-26T13:02:21.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8749800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8744113560 con 0x7f8744108f10 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8743400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 0x7f87441a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8743400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 0x7f87441a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33022/0 (socket says 172.21.15.40:33022) 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.509+0000 7f8743400640 1 -- 172.21.15.40:0/3366910977 learned_addr learned my addr 172.21.15.40:0/3366910977 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f873a000640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8744108f10 0x7f874419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f8742a00640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87441035d0 0x7f874419c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f8743400640 1 -- 172.21.15.40:0/3366910977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8744108f10 msgr2=0x7f874419c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f8743400640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8744108f10 0x7f874419c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f8743400640 1 -- 172.21.15.40:0/3366910977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87441035d0 msgr2=0x7f874419c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:21.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f8743400640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87441035d0 0x7f874419c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.510+0000 7f8743400640 1 -- 172.21.15.40:0/3366910977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87441a1fa0 con 0x7f8744109860 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.511+0000 7f8743400640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 0x7f87441a1870 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f873c00eaa0 tx=0x7f873c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.511+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c00cdb0 con 0x7f8744109860 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.511+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f873c005020 con 0x7f8744109860 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.511+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87441a2290 con 0x7f8744109860 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.511+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c0116d0 con 0x7f8744109860 2024-07-26T13:02:21.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.511+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a89f0 con 0x7f8744109860 2024-07-26T13:02:21.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.513+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8744104850 con 0x7f8744109860 2024-07-26T13:02:21.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.515+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f873c0051d0 con 0x7f8744109860 2024-07-26T13:02:21.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.518+0000 7f873be00640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87280b3bd0 0x7f87280b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:21.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.518+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f873c0e3d00 con 0x7f8744109860 2024-07-26T13:02:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.518+0000 7f8742a00640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87280b3bd0 0x7f87280b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.519+0000 7f8742a00640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87280b3bd0 0x7f87280b60e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f87340057c0 tx=0x7f87340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:21.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.522+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f873c016030 con 0x7f8744109860 2024-07-26T13:02:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.796+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87441039e0 con 0x7f8744109860 2024-07-26T13:02:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.798+0000 7f873be00640 1 -- 172.21.15.40:0/3366910977 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f873c0aacc0 con 0x7f8744109860 2024-07-26T13:02:21.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:02:21.800 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:02:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:02:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87280b3bd0 msgr2=0x7f87280b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87280b3bd0 0x7f87280b60e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f87340057c0 tx=0x7f87340058d0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 msgr2=0x7f87441a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 0x7f87441a1870 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f873c00eaa0 tx=0x7f873c00ef60 comp rx=0 tx=0).stop 2024-07-26T13:02:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 shutdown_connections 2024-07-26T13:02:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8744109860 0x7f87441a1870 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f87280b3bd0 0x7f87280b60e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8744108f10 0x7f874419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 --2- 172.21.15.40:0/3366910977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f87441035d0 0x7f874419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.801+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 >> 172.21.15.40:0/3366910977 conn(0x7f87440ff000 msgr2=0x7f87441085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.802+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 shutdown_connections 2024-07-26T13:02:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:21.802+0000 7f8749800640 1 -- 172.21.15.40:0/3366910977 wait complete. 2024-07-26T13:02:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:02:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:02:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:02:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:02:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:02:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:02:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:02:22.748 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0' 2024-07-26T13:02:22.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 146.45 --await-for 45.0 2024-07-26T13:02:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:22 smithi040 ceph-mon[32397]: pgmap v1703: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 462 KiB/s wr, 8 op/s 2024-07-26T13:02:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:22 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3366910977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:22 smithi146 ceph-mon[35807]: pgmap v1703: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 462 KiB/s wr, 8 op/s 2024-07-26T13:02:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:22 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3366910977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:22 smithi076 ceph-mon[35401]: pgmap v1703: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 462 KiB/s wr, 8 op/s 2024-07-26T13:02:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:22 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3366910977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:23.257 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:02:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:24 smithi040 ceph-mon[32397]: pgmap v1704: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.8 MiB/s wr, 10 op/s 2024-07-26T13:02:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:24 smithi146 ceph-mon[35807]: pgmap v1704: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.8 MiB/s wr, 10 op/s 2024-07-26T13:02:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:24 smithi076 ceph-mon[35401]: pgmap v1704: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.8 MiB/s wr, 10 op/s 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.668+0000 7fd39ae00640 1 -- 172.21.15.40:0/4181940738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 msgr2=0x7fd39410ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.668+0000 7fd39ae00640 1 --2- 172.21.15.40:0/4181940738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39410ed90 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009ca0 tx=0x7fd38c02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.668+0000 7fd39ae00640 1 -- 172.21.15.40:0/4181940738 shutdown_connections 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.668+0000 7fd39ae00640 1 --2- 172.21.15.40:0/4181940738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39410ed90 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.668+0000 7fd39ae00640 1 --2- 172.21.15.40:0/4181940738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd394107c10 0x7fd394108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.669+0000 7fd39ae00640 1 --2- 172.21.15.40:0/4181940738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3941022d0 0x7fd3941026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.669+0000 7fd39ae00640 1 -- 172.21.15.40:0/4181940738 >> 172.21.15.40:0/4181940738 conn(0x7fd3940fdd60 msgr2=0x7fd3941001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.669+0000 7fd39ae00640 1 -- 172.21.15.40:0/4181940738 shutdown_connections 2024-07-26T13:02:25.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.669+0000 7fd39ae00640 1 -- 172.21.15.40:0/4181940738 wait complete. 2024-07-26T13:02:25.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.670+0000 7fd39ae00640 1 Processor -- start 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.670+0000 7fd39ae00640 1 -- start start 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3941022d0 0x7fd394199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd394107c10 0x7fd39419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39ae00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd394112130 con 0x7fd394108560 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111fb0 con 0x7fd3941022d0 2024-07-26T13:02:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941122b0 con 0x7fd394107c10 2024-07-26T13:02:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50474/0 (socket says 172.21.15.40:50474) 2024-07-26T13:02:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd39a400640 1 -- 172.21.15.40:0/1009766290 learned_addr learned my addr 172.21.15.40:0/1009766290 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.671+0000 7fd399a00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3941022d0 0x7fd394199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.672+0000 7fd399000640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd394107c10 0x7fd39419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.672+0000 7fd39a400640 1 -- 172.21.15.40:0/1009766290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd394107c10 msgr2=0x7fd39419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.672+0000 7fd39a400640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd394107c10 0x7fd39419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.672+0000 7fd39a400640 1 -- 172.21.15.40:0/1009766290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3941022d0 msgr2=0x7fd394199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.672+0000 7fd39a400640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3941022d0 0x7fd394199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.672+0000 7fd39a400640 1 -- 172.21.15.40:0/1009766290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39419fba0 con 0x7fd394108560 2024-07-26T13:02:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.673+0000 7fd39a400640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39419f470 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fd38c031040 tx=0x7fd38c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.673+0000 7fd392000640 1 -- 172.21.15.40:0/1009766290 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c004040 con 0x7fd394108560 2024-07-26T13:02:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.673+0000 7fd392000640 1 -- 172.21.15.40:0/1009766290 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd38c004670 con 0x7fd394108560 2024-07-26T13:02:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.673+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39419fe30 con 0x7fd394108560 2024-07-26T13:02:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.673+0000 7fd392000640 1 -- 172.21.15.40:0/1009766290 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c030bb0 con 0x7fd394108560 2024-07-26T13:02:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.673+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3940fe170 con 0x7fd394108560 2024-07-26T13:02:25.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.677+0000 7fd3a3064740 1 Processor -- start 2024-07-26T13:02:25.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.678+0000 7fd392000640 1 -- 172.21.15.40:0/1009766290 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd38c0041e0 con 0x7fd394108560 2024-07-26T13:02:25.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 -- start start 2024-07-26T13:02:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5618cc942970 con 0x5618cc627850 2024-07-26T13:02:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5618cc931e70 con 0x5618cc606b70 2024-07-26T13:02:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.679+0000 7fd3a3064740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5618cc935eb0 con 0x5618cc5fe990 2024-07-26T13:02:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.680+0000 7fd399000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.680+0000 7fd399000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50484/0 (socket says 172.21.15.40:50484) 2024-07-26T13:02:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.680+0000 7fd399000640 1 -- 172.21.15.40:0/2050000770 learned_addr learned my addr 172.21.15.40:0/2050000770 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.680+0000 7fd399a00640 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.680+0000 7fd399000640 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd399000640 1 -- 172.21.15.40:0/2050000770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 msgr2=0x5618cc9ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd399000640 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd399000640 1 -- 172.21.15.40:0/2050000770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 msgr2=0x5618cc9ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd399000640 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd399000640 1 -- 172.21.15.40:0/2050000770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618cc8ba8e0 con 0x5618cc627850 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd392000640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd37c0b3bc0 0x7fd37c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd392000640 1 -- 172.21.15.40:0/1009766290 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd38c104fc0 con 0x7fd394108560 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.681+0000 7fd399a00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd37c0b3bc0 0x7fd37c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.682+0000 7fd399000640 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ce060 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fd3800058a0 tx=0x7fd380005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97815d52fe28d9f1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.682+0000 7fd386a00640 1 -- 172.21.15.40:0/2050000770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380005020 con 0x5618cc627850 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.682+0000 7fd386a00640 1 -- 172.21.15.40:0/2050000770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3800047a0 con 0x5618cc627850 2024-07-26T13:02:25.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.682+0000 7fd399a00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd37c0b3bc0 0x7fd37c0b60d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5618cc9ccce0 tx=0x7fd38800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:25.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.682+0000 7fd386a00640 1 -- 172.21.15.40:0/2050000770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380005650 con 0x5618cc627850 2024-07-26T13:02:25.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.683+0000 7fd3a3064740 1 -- 172.21.15.40:0/2050000770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 msgr2=0x5618cc9ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.683+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ce060 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fd3800058a0 tx=0x7fd380005c90 comp rx=0 tx=0).stop 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 -- 172.21.15.40:0/2050000770 shutdown_connections 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2050000770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ce060 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 -- 172.21.15.40:0/2050000770 >> 172.21.15.40:0/2050000770 conn(0x5618cc61bc40 msgr2=0x5618cc9cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 -- 172.21.15.40:0/2050000770 shutdown_connections 2024-07-26T13:02:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.684+0000 7fd3a3064740 1 -- 172.21.15.40:0/2050000770 wait complete. 2024-07-26T13:02:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.685+0000 7fd3a3064740 1 -- start start 2024-07-26T13:02:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.685+0000 7fd3a3064740 1 Processor -- start 2024-07-26T13:02:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 0x5618cc9e2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5618cc7957b0 con 0x5618cc606b70 2024-07-26T13:02:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5618cc8ce420 con 0x5618cc627850 2024-07-26T13:02:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5618cc9e4f70 con 0x5618cc5fe990 2024-07-26T13:02:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd3a3064740 10 client.0 _ll_register_callbacks cb 0x5618cc63f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:02:25.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.686+0000 7fd399000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 0x5618cc9e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 0x5618cc9e2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50500/0 (socket says 172.21.15.40:50500) 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 -- 172.21.15.40:0/2252925614 learned_addr learned my addr 172.21.15.40:0/2252925614 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399a00640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd39a400640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 -- 172.21.15.40:0/2252925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 msgr2=0x5618cc9e2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 -- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 msgr2=0x5618cc9ee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9ee2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.687+0000 7fd399000640 1 -- 172.21.15.40:0/2252925614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618cc8c6c50 con 0x5618cc606b70 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.688+0000 7fd399000640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 0x5618cc9e2940 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fd3800123c0 tx=0x7fd380004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbffe02387bc8ed server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.688+0000 7fd37b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.688+0000 7fd37b400640 1 -- 172.21.15.40:0/2252925614 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380004230 con 0x5618cc606b70 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.688+0000 7fd37b400640 1 -- 172.21.15.40:0/2252925614 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3800043d0 con 0x5618cc606b70 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.688+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3800047a0 con 0x5618cc606b70 2024-07-26T13:02:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.689+0000 7fd37b400640 1 -- 172.21.15.40:0/2252925614 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd38002e050 con 0x5618cc606b70 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.689+0000 7fd3a3064740 10 client.17013 fetch_fsmap learned FSMap version 35 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.689+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5618cc6a1ba0 con 0x5618cc606b70 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.689+0000 7fd37b400640 1 -- 172.21.15.40:0/2252925614 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3800047a0 con 0x5618cc606b70 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.689+0000 7fd37b400640 1 -- 172.21.15.40:0/2252925614 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd380003820 con 0x5618cc606b70 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd3a3064740 10 client.17013 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd3a3064740 10 client.17013 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd3a3064740 20 client.17013 populate_metadata read hostname 'smithi040' 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5e61d0 0x5618cc9f4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd3a3064740 4 client.17013 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:02:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618cc9448c0 con 0x5618cc5e61d0 2024-07-26T13:02:25.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.690+0000 7fd399a00640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5e61d0 0x5618cc9f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.692+0000 7fd399a00640 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5e61d0 0x5618cc9f4120 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aba0724ab6ebf3c server_cookie=77887667e20b34eb in_seq=0 out_seq=0 2024-07-26T13:02:25.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.692+0000 7fd37b400640 10 client.17013 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:25.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.693+0000 7fd37b400640 1 -- 172.21.15.40:0/2252925614 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618cc9448c0 con 0x5618cc5e61d0 2024-07-26T13:02:25.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.693+0000 7fd37b400640 10 client.17013 handle_command_reply: tid=0 2024-07-26T13:02:25.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 client.17013 shutdown 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 msgr2=0x5618cc9e2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 0x5618cc9e2940 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fd3800123c0 tx=0x7fd380004e70 comp rx=0 tx=0).stop 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 shutdown_connections 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9ee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5e61d0 0x5618cc9f4120 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc606b70 0x5618cc9e2940 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2252925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd37b400640 0 client.17013 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 >> 172.21.15.40:0/2252925614 conn(0x5618cc61bc40 msgr2=0x5618cc9d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 shutdown_connections 2024-07-26T13:02:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.694+0000 7fd3a3064740 1 -- 172.21.15.40:0/2252925614 wait complete. 2024-07-26T13:02:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.695+0000 7fd3a3064740 20 client.17013 trim_cache size 0 max 16384 2024-07-26T13:02:25.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.715+0000 7fd3a3064740 1 Processor -- start 2024-07-26T13:02:25.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.715+0000 7fd3a3064740 1 -- start start 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd3a3064740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941ac930 con 0x5618cc627850 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd3a3064740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941ae470 con 0x5618cc606b70 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd3a3064740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941ad000 con 0x5618cc5fe990 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd39a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd39a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50502/0 (socket says 172.21.15.40:50502) 2024-07-26T13:02:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd39a400640 1 -- 172.21.15.40:0/4110887434 learned_addr learned my addr 172.21.15.40:0/4110887434 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.716+0000 7fd399000640 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd399a00640 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd39a400640 1 -- 172.21.15.40:0/4110887434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 msgr2=0x5618cc9e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd39a400640 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd39a400640 1 -- 172.21.15.40:0/4110887434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 msgr2=0x5618cc9ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd39a400640 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd39a400640 1 -- 172.21.15.40:0/4110887434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618cc9e32a0 con 0x5618cc627850 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.717+0000 7fd39a400640 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ee5d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0cbea0 tx=0x7fd38c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc54341ac704534c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.718+0000 7fd386000640 1 -- 172.21.15.40:0/4110887434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0044d0 con 0x5618cc627850 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.718+0000 7fd386000640 1 -- 172.21.15.40:0/4110887434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd38c036070 con 0x5618cc627850 2024-07-26T13:02:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.718+0000 7fd386000640 1 -- 172.21.15.40:0/4110887434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0cbf10 con 0x5618cc627850 2024-07-26T13:02:25.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 -- 172.21.15.40:0/4110887434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 msgr2=0x5618cc9ee5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ee5d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0cbea0 tx=0x7fd38c0095c0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 -- 172.21.15.40:0/4110887434 shutdown_connections 2024-07-26T13:02:25.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc627850 0x5618cc9ee5d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc606b70 0x5618cc9ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 --2- 172.21.15.40:0/4110887434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc5fe990 0x5618cc9e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 -- 172.21.15.40:0/4110887434 >> 172.21.15.40:0/4110887434 conn(0x5618cc61bc40 msgr2=0x5618cc9cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:25.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 -- 172.21.15.40:0/4110887434 shutdown_connections 2024-07-26T13:02:25.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.719+0000 7fd3a3064740 1 -- 172.21.15.40:0/4110887434 wait complete. 2024-07-26T13:02:25.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.720+0000 7fd3a3064740 1 -- start start 2024-07-26T13:02:25.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.720+0000 7fd3a3064740 1 Processor -- start 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.720+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 0x5618cc9e6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.720+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc606b70 0x5618cc9e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.720+0000 7fd3a3064740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd3a3064740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941adda0 con 0x5618cc5fe990 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd3a3064740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941ad6d0 con 0x5618cc627850 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd3a3064740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941aa8f0 con 0x5618cc606b70 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd3a3064740 10 client.0 _ll_register_callbacks cb 0x7fd388004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 0x5618cc9e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 0x5618cc9e6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50508/0 (socket says 172.21.15.40:50508) 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 -- 172.21.15.40:0/2116126612 learned_addr learned my addr 172.21.15.40:0/2116126612 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399000640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc606b70 0x5618cc9e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd39a400640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 -- 172.21.15.40:0/2116126612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc606b70 msgr2=0x5618cc9e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc606b70 0x5618cc9e67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 -- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 msgr2=0x5618cc9e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9e6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.721+0000 7fd399a00640 1 -- 172.21.15.40:0/2116126612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618cca5b990 con 0x5618cc5fe990 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.722+0000 7fd399a00640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 0x5618cc9e6290 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd388004650 tx=0x7fd3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2bc853e22da10d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.722+0000 7fd37b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.722+0000 7fd37b400640 1 -- 172.21.15.40:0/2116126612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38801eb30 con 0x5618cc5fe990 2024-07-26T13:02:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.722+0000 7fd37b400640 1 -- 172.21.15.40:0/2116126612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd38801ecd0 con 0x5618cc5fe990 2024-07-26T13:02:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.722+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd38c036070 con 0x5618cc5fe990 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.723+0000 7fd37b400640 1 -- 172.21.15.40:0/2116126612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd38802a380 con 0x5618cc5fe990 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.723+0000 7fd3a3064740 10 client.17019 fetch_fsmap learned FSMap version 35 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.723+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5618cca5cc40 con 0x5618cc5fe990 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.723+0000 7fd37b400640 1 -- 172.21.15.40:0/2116126612 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd38c036070 con 0x5618cc5fe990 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.723+0000 7fd37b400640 1 -- 172.21.15.40:0/2116126612 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd388032620 con 0x5618cc5fe990 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd3a3064740 10 client.17019 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd3a3064740 10 client.17019 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd3a3064740 20 client.17019 populate_metadata read hostname 'smithi040' 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5bb580 0x5618cca5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd3a3064740 4 client.17019 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}] 2024-07-26T13:02:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.45, "await_for": 45.0}) -- 0x5618cc940360 con 0x5618cc5bb580 2024-07-26T13:02:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.724+0000 7fd399000640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5bb580 0x5618cca5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.725+0000 7fd399000640 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5bb580 0x5618cca5f450 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7604915ef3b763c3 server_cookie=f2af4d92db627090 in_seq=0 out_seq=0 2024-07-26T13:02:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.725+0000 7fd37b400640 10 client.17019 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.954+0000 7fd37b400640 1 -- 172.21.15.40:0/2116126612 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5618cc940360 con 0x5618cc5bb580 2024-07-26T13:02:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.954+0000 7fd37b400640 10 client.17019 handle_command_reply: tid=0 2024-07-26T13:02:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.954+0000 7fd3a3064740 1 client.17019 shutdown 2024-07-26T13:02:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.954+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 msgr2=0x5618cc9e6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.954+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 0x5618cc9e6290 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd388004650 tx=0x7fd3880046c0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.954+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 shutdown_connections 2024-07-26T13:02:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5618cc627850 0x5618cc9e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5618cc606b70 0x5618cc9e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5618cc5bb580 0x5618cca5f450 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 --2- 172.21.15.40:0/2116126612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5618cc5fe990 0x5618cc9e6290 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd37b400640 0 client.17019 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 >> 172.21.15.40:0/2116126612 conn(0x5618cc61bc40 msgr2=0x5618cc9cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 shutdown_connections 2024-07-26T13:02:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 1 -- 172.21.15.40:0/2116126612 wait complete. 2024-07-26T13:02:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.955+0000 7fd3a3064740 20 client.17019 trim_cache size 0 max 16384 2024-07-26T13:02:25.959 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:02:25.959 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:02:25.959 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:02:25.959 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 130, 2024-07-26T13:02:25.959 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "92487052": { 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 130, 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:02:25.960 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:02:25.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd37c0b3bc0 msgr2=0x7fd37c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd37c0b3bc0 0x7fd37c0b60d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5618cc9ccce0 tx=0x7fd38800b390 comp rx=0 tx=0).stop 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 msgr2=0x7fd39419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39419f470 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fd38c031040 tx=0x7fd38c032bc0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 shutdown_connections 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd394108560 0x7fd39419f470 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd37c0b3bc0 0x7fd37c0b60d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd394107c10 0x7fd39419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 --2- 172.21.15.40:0/1009766290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3941022d0 0x7fd394199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.957+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 >> 172.21.15.40:0/1009766290 conn(0x7fd3940fdd60 msgr2=0x7fd394100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:25.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.958+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 shutdown_connections 2024-07-26T13:02:25.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:25.958+0000 7fd39ae00640 1 -- 172.21.15.40:0/1009766290 wait complete. 2024-07-26T13:02:26.882 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '92487052', quiesce took 8.3 seconds. Will release after: 18.15 2024-07-26T13:02:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:26 smithi146 ceph-mon[35807]: pgmap v1705: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:02:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:26 smithi076 ceph-mon[35401]: pgmap v1705: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:02:27.107 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:26 smithi040 ceph-mon[32397]: pgmap v1705: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:02:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:28 smithi146 ceph-mon[35807]: pgmap v1706: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.5 MiB/s wr, 10 op/s 2024-07-26T13:02:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:28 smithi076 ceph-mon[35401]: pgmap v1706: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.5 MiB/s wr, 10 op/s 2024-07-26T13:02:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:28 smithi040 ceph-mon[32397]: pgmap v1706: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.5 MiB/s wr, 10 op/s 2024-07-26T13:02:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:30 smithi076 ceph-mon[35401]: pgmap v1707: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-07-26T13:02:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:30 smithi040 ceph-mon[32397]: pgmap v1707: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-07-26T13:02:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:30 smithi146 ceph-mon[35807]: pgmap v1707: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-07-26T13:02:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:32 smithi076 ceph-mon[35401]: pgmap v1708: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.5 MiB/s wr, 10 op/s 2024-07-26T13:02:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:32 smithi040 ceph-mon[32397]: pgmap v1708: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.5 MiB/s wr, 10 op/s 2024-07-26T13:02:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:32 smithi146 ceph-mon[35807]: pgmap v1708: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.5 MiB/s wr, 10 op/s 2024-07-26T13:02:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:34 smithi040 ceph-mon[32397]: pgmap v1709: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-07-26T13:02:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:34 smithi146 ceph-mon[35807]: pgmap v1709: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-07-26T13:02:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:34 smithi076 ceph-mon[35401]: pgmap v1709: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-07-26T13:02:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:36 smithi040 ceph-mon[32397]: pgmap v1710: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-07-26T13:02:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:36 smithi146 ceph-mon[35807]: pgmap v1710: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-07-26T13:02:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:36 smithi076 ceph-mon[35401]: pgmap v1710: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-07-26T13:02:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:38 smithi040 ceph-mon[32397]: pgmap v1711: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-07-26T13:02:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:38 smithi146 ceph-mon[35807]: pgmap v1711: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-07-26T13:02:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:38 smithi076 ceph-mon[35401]: pgmap v1711: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 MiB/s wr, 9 op/s 2024-07-26T13:02:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:40 smithi146 ceph-mon[35807]: pgmap v1712: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-07-26T13:02:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:40 smithi040 ceph-mon[32397]: pgmap v1712: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-07-26T13:02:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:40 smithi076 ceph-mon[35401]: pgmap v1712: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 MiB/s wr, 12 op/s 2024-07-26T13:02:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:42 smithi040 ceph-mon[32397]: pgmap v1713: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 546 KiB/s wr, 8 op/s 2024-07-26T13:02:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:42 smithi146 ceph-mon[35807]: pgmap v1713: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 546 KiB/s wr, 8 op/s 2024-07-26T13:02:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:42 smithi076 ceph-mon[35401]: pgmap v1713: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 546 KiB/s wr, 8 op/s 2024-07-26T13:02:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:44 smithi040 ceph-mon[32397]: pgmap v1714: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 546 KiB/s wr, 10 op/s 2024-07-26T13:02:45.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:02:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:44 smithi146 ceph-mon[35807]: pgmap v1714: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 546 KiB/s wr, 10 op/s 2024-07-26T13:02:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:44 smithi076 ceph-mon[35401]: pgmap v1714: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 546 KiB/s wr, 10 op/s 2024-07-26T13:02:45.515 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:02:47.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:46 smithi040 ceph-mon[32397]: pgmap v1715: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:02:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:46 smithi146 ceph-mon[35807]: pgmap v1715: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:02:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:46 smithi076 ceph-mon[35401]: pgmap v1715: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:02:47.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 -- 172.21.15.40:0/1755293338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde7010fb50 msgr2=0x7fde70111f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 --2- 172.21.15.40:0/1755293338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde7010fb50 0x7fde70111f70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fde68009900 tx=0x7fde6802a410 comp rx=0 tx=0).stop 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 -- 172.21.15.40:0/1755293338 shutdown_connections 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 --2- 172.21.15.40:0/1755293338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde7010fb50 0x7fde70111f70 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 --2- 172.21.15.40:0/1755293338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde70075ad0 0x7fde7010f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 --2- 172.21.15.40:0/1755293338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde70075180 0x7fde70075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 -- 172.21.15.40:0/1755293338 >> 172.21.15.40:0/1755293338 conn(0x7fde7007b280 msgr2=0x7fde7007b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 -- 172.21.15.40:0/1755293338 shutdown_connections 2024-07-26T13:02:47.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.800+0000 7fde77c00640 1 -- 172.21.15.40:0/1755293338 wait complete. 2024-07-26T13:02:47.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.801+0000 7fde77c00640 1 Processor -- start 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 -- start start 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 0x7fde7019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde70075ad0 0x7fde7019c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde7010fb50 0x7fde701a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fde70115570 con 0x7fde70075180 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fde701153f0 con 0x7fde7010fb50 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde77c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde701156f0 con 0x7fde70075ad0 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde75200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 0x7fde7019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde75200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 0x7fde7019bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52800/0 (socket says 172.21.15.40:52800) 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.802+0000 7fde75200640 1 -- 172.21.15.40:0/1921196469 learned_addr learned my addr 172.21.15.40:0/1921196469 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:47.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde6fe00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde70075ad0 0x7fde7019c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde7010fb50 0x7fde701a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75200640 1 -- 172.21.15.40:0/1921196469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde70075ad0 msgr2=0x7fde7019c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75200640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde70075ad0 0x7fde7019c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75200640 1 -- 172.21.15.40:0/1921196469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde7010fb50 msgr2=0x7fde701a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75200640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde7010fb50 0x7fde701a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:47.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75200640 1 -- 172.21.15.40:0/1921196469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde701a1ef0 con 0x7fde70075180 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.803+0000 7fde75200640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 0x7fde7019bf80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fde5800d950 tx=0x7fde5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.804+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58017070 con 0x7fde70075180 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.804+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde701a21e0 con 0x7fde70075180 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.804+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde58009c30 con 0x7fde70075180 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.804+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5800f620 con 0x7fde70075180 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.804+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde701a8940 con 0x7fde70075180 2024-07-26T13:02:47.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.805+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde70075590 con 0x7fde70075180 2024-07-26T13:02:47.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.809+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fde58005030 con 0x7fde70075180 2024-07-26T13:02:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.812+0000 7fde6d600640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fde540b3bd0 0x7fde540b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.812+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fde580e38b0 con 0x7fde70075180 2024-07-26T13:02:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.812+0000 7fde6fe00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fde540b3bd0 0x7fde540b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.813+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fde580aaec0 con 0x7fde70075180 2024-07-26T13:02:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:47.813+0000 7fde6fe00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fde540b3bd0 0x7fde540b60e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fde701114d0 tx=0x7fde60009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.055+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde7019d0b0 con 0x7fde70075180 2024-07-26T13:02:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.056+0000 7fde6d600640 1 -- 172.21.15.40:0/1921196469 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fde58009de0 con 0x7fde70075180 2024-07-26T13:02:48.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:02:48.058 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:02:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:02:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.059+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fde540b3bd0 msgr2=0x7fde540b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.059+0000 7fde77c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fde540b3bd0 0x7fde540b60e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fde701114d0 tx=0x7fde60009870 comp rx=0 tx=0).stop 2024-07-26T13:02:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.059+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 msgr2=0x7fde7019bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.059+0000 7fde77c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 0x7fde7019bf80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fde5800d950 tx=0x7fde5800de10 comp rx=0 tx=0).stop 2024-07-26T13:02:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 shutdown_connections 2024-07-26T13:02:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde7010fb50 0x7fde701a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fde540b3bd0 0x7fde540b60e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde70075ad0 0x7fde7019c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 --2- 172.21.15.40:0/1921196469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde70075180 0x7fde7019bf80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 >> 172.21.15.40:0/1921196469 conn(0x7fde7007b280 msgr2=0x7fde70101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 shutdown_connections 2024-07-26T13:02:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:48.060+0000 7fde77c00640 1 -- 172.21.15.40:0/1921196469 wait complete. 2024-07-26T13:02:49.101 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 92487052 --release --await' 2024-07-26T13:02:49.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 92487052 --release --await 2024-07-26T13:02:49.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:48 smithi040 ceph-mon[32397]: pgmap v1716: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-07-26T13:02:49.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:48 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1921196469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:48 smithi146 ceph-mon[35807]: pgmap v1716: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-07-26T13:02:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:48 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1921196469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:48 smithi076 ceph-mon[35401]: pgmap v1716: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-07-26T13:02:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:48 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1921196469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:02:49.579 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:02:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:50 smithi040 ceph-mon[32397]: pgmap v1717: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T13:02:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:50 smithi146 ceph-mon[35807]: pgmap v1717: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T13:02:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:50 smithi076 ceph-mon[35401]: pgmap v1717: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-07-26T13:02:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.909+0000 7f11e1800640 1 -- 172.21.15.40:0/91977564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 msgr2=0x7f11dc1164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.909+0000 7f11e1800640 1 --2- 172.21.15.40:0/91977564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1164b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009ca0 tx=0x7f11d402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 -- 172.21.15.40:0/91977564 shutdown_connections 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 --2- 172.21.15.40:0/91977564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1164b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 --2- 172.21.15.40:0/91977564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc10f330 0x7f11dc10f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 --2- 172.21.15.40:0/91977564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 0x7f11dc109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 -- 172.21.15.40:0/91977564 >> 172.21.15.40:0/91977564 conn(0x7f11dc078ff0 msgr2=0x7f11dc107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 -- 172.21.15.40:0/91977564 shutdown_connections 2024-07-26T13:02:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.910+0000 7f11e1800640 1 -- 172.21.15.40:0/91977564 wait complete. 2024-07-26T13:02:51.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.911+0000 7f11e1800640 1 Processor -- start 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.911+0000 7f11e1800640 1 -- start start 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e1800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 0x7f11dc1a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc10f330 0x7f11dc1a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e1800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc119840 con 0x7f11dc10fc80 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e1800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1196c0 con 0x7f11dc1099f0 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e1800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1199c0 con 0x7f11dc10f330 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52818/0 (socket says 172.21.15.40:52818) 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11e0e00640 1 -- 172.21.15.40:0/2368476206 learned_addr learned my addr 172.21.15.40:0/2368476206 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11dbe00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 0x7f11dc1a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.912+0000 7f11d3400640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc10f330 0x7f11dc1a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e0e00640 1 -- 172.21.15.40:0/2368476206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc10f330 msgr2=0x7f11dc1a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e0e00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc10f330 0x7f11dc1a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e0e00640 1 -- 172.21.15.40:0/2368476206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 msgr2=0x7f11dc1a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e0e00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 0x7f11dc1a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e0e00640 1 -- 172.21.15.40:0/2368476206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc1a6060 con 0x7f11dc10fc80 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11dbe00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 0x7f11dc1a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e0e00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1a59f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f11d4005cc0 tx=0x7f11d4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11d9600640 1 -- 172.21.15.40:0/2368476206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4032e00 con 0x7f11dc10fc80 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11d9600640 1 -- 172.21.15.40:0/2368476206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11d40044d0 con 0x7f11dc10fc80 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11d9600640 1 -- 172.21.15.40:0/2368476206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4030b70 con 0x7f11dc10fc80 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.913+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11dc1a62f0 con 0x7f11dc10fc80 2024-07-26T13:02:51.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.914+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11dc1acb70 con 0x7f11dc10fc80 2024-07-26T13:02:51.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.917+0000 7f11e99c6740 1 Processor -- start 2024-07-26T13:02:51.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.917+0000 7f11d9600640 1 -- 172.21.15.40:0/2368476206 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f11d4030d10 con 0x7f11dc10fc80 2024-07-26T13:02:51.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 -- start start 2024-07-26T13:02:51.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc25701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21a2660 0x557cc25706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc2570c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557cc24e6f50 con 0x557cc21aa840 2024-07-26T13:02:51.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557cc24d6450 con 0x557cc21a2660 2024-07-26T13:02:51.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.918+0000 7f11e99c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557cc24da490 con 0x557cc21cb520 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc2570c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc2570c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52826/0 (socket says 172.21.15.40:52826) 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 -- 172.21.15.40:0/19744946 learned_addr learned my addr 172.21.15.40:0/19744946 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc25701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11dbe00640 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21a2660 0x557cc25706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 -- 172.21.15.40:0/19744946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 msgr2=0x557cc25701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc25701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d9600640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f11c00b3c80 0x7f11c00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 -- 172.21.15.40:0/19744946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21a2660 msgr2=0x557cc25706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21a2660 0x557cc25706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d3400640 1 -- 172.21.15.40:0/19744946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc2236b00 con 0x557cc21aa840 2024-07-26T13:02:51.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11dbe00640 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21a2660 0x557cc25706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:02:51.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.919+0000 7f11d9600640 1 -- 172.21.15.40:0/2368476206 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f11d4105100 con 0x7f11dc10fc80 2024-07-26T13:02:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.920+0000 7f11e0e00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f11c00b3c80 0x7f11c00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.920+0000 7f11d3400640 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc2570c20 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005fd0 tx=0x7f11c400b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4298d7bb76bcdc7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.921+0000 7f11d1600640 1 -- 172.21.15.40:0/19744946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400e920 con 0x557cc21aa840 2024-07-26T13:02:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.921+0000 7f11e0e00640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f11c00b3c80 0x7f11c00b6190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f11d402ae80 tx=0x7f11d4032fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.921+0000 7f11d1600640 1 -- 172.21.15.40:0/19744946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c4010430 con 0x557cc21aa840 2024-07-26T13:02:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.921+0000 7f11d1600640 1 -- 172.21.15.40:0/19744946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400f620 con 0x557cc21aa840 2024-07-26T13:02:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 -- 172.21.15.40:0/19744946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 msgr2=0x557cc2570c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc2570c20 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005fd0 tx=0x7f11c400b440 comp rx=0 tx=0).stop 2024-07-26T13:02:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 -- 172.21.15.40:0/19744946 shutdown_connections 2024-07-26T13:02:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc2570c20 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21a2660 0x557cc25706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 --2- 172.21.15.40:0/19744946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc25701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 -- 172.21.15.40:0/19744946 >> 172.21.15.40:0/19744946 conn(0x557cc21bf910 msgr2=0x557cc256e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:51.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 -- 172.21.15.40:0/19744946 shutdown_connections 2024-07-26T13:02:51.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.922+0000 7f11e99c6740 1 -- 172.21.15.40:0/19744946 wait complete. 2024-07-26T13:02:51.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.923+0000 7f11e99c6740 1 -- start start 2024-07-26T13:02:51.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.923+0000 7f11e99c6740 1 Processor -- start 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.923+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21a2660 0x557cc257b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.923+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc257bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.923+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc2587c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.923+0000 7f11e99c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557cc2339bb0 con 0x557cc21aa840 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11e99c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557cc2472930 con 0x557cc21cb520 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11e99c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557cc257e980 con 0x557cc21a2660 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11e99c6740 10 client.0 _ll_register_callbacks cb 0x557cc21e2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc257bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc257bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52842/0 (socket says 172.21.15.40:52842) 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 -- 172.21.15.40:0/1086684553 learned_addr learned my addr 172.21.15.40:0/1086684553 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11d3400640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21a2660 0x557cc257b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11d3400640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc2587c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 -- 172.21.15.40:0/1086684553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21a2660 msgr2=0x557cc257b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21a2660 0x557cc257b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 -- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 msgr2=0x557cc2587c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc2587c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.924+0000 7f11dbe00640 1 -- 172.21.15.40:0/1086684553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc22ad960 con 0x557cc21aa840 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.925+0000 7f11dbe00640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc257bdf0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00bf80 tx=0x7f11cc011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca62071eaa9202 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.925+0000 7f11ca000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.925+0000 7f11ca000640 1 -- 172.21.15.40:0/1086684553 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc004230 con 0x557cc21aa840 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.925+0000 7f11ca000640 1 -- 172.21.15.40:0/1086684553 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f11cc0043d0 con 0x557cc21aa840 2024-07-26T13:02:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.925+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c4010430 con 0x557cc21aa840 2024-07-26T13:02:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11ca000640 1 -- 172.21.15.40:0/1086684553 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f11cc0035f0 con 0x557cc21aa840 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 10 client.17037 fetch_fsmap learned FSMap version 35 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557cc258a750 con 0x557cc21aa840 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11ca000640 1 -- 172.21.15.40:0/1086684553 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c4010430 con 0x557cc21aa840 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11ca000640 1 -- 172.21.15.40:0/1086684553 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f11cc0129a0 con 0x557cc21aa840 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 10 client.17037 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 10 client.17037 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 20 client.17037 populate_metadata read hostname 'smithi040' 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc2189ea0 0x557cc258dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 4 client.17037 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.926+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cc24e8ea0 con 0x557cc2189ea0 2024-07-26T13:02:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.927+0000 7f11d3400640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc2189ea0 0x557cc258dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.928+0000 7f11d3400640 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc2189ea0 0x557cc258dca0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479d64a23e015a2 server_cookie=aaf94f2e7f986b82 in_seq=0 out_seq=0 2024-07-26T13:02:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.928+0000 7f11ca000640 10 client.17037 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.930+0000 7f11ca000640 1 -- 172.21.15.40:0/1086684553 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cc24e8ea0 con 0x557cc2189ea0 2024-07-26T13:02:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.930+0000 7f11ca000640 10 client.17037 handle_command_reply: tid=0 2024-07-26T13:02:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.930+0000 7f11e99c6740 1 client.17037 shutdown 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 msgr2=0x557cc257bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc257bdf0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00bf80 tx=0x7f11cc011870 comp rx=0 tx=0).stop 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 shutdown_connections 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc2587c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc2189ea0 0x557cc258dca0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21aa840 0x557cc257bdf0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1086684553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21a2660 0x557cc257b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 >> 172.21.15.40:0/1086684553 conn(0x557cc21bf910 msgr2=0x557cc2573330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11ca000640 0 client.17037 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 shutdown_connections 2024-07-26T13:02:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 1 -- 172.21.15.40:0/1086684553 wait complete. 2024-07-26T13:02:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.931+0000 7f11e99c6740 20 client.17037 trim_cache size 0 max 16384 2024-07-26T13:02:51.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.950+0000 7f11e99c6740 1 Processor -- start 2024-07-26T13:02:51.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 -- start start 2024-07-26T13:02:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc256cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21aa840 0x557cc25718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc2587a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1b50c0 con 0x557cc21a2660 2024-07-26T13:02:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1b6c00 con 0x557cc21aa840 2024-07-26T13:02:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.951+0000 7f11e99c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1b5790 con 0x557cc21cb520 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.952+0000 7f11d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc256cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.952+0000 7f11dbe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21aa840 0x557cc25718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.952+0000 7f11d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc256cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52844/0 (socket says 172.21.15.40:52844) 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.952+0000 7f11d3400640 1 -- 172.21.15.40:0/462688570 learned_addr learned my addr 172.21.15.40:0/462688570 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.952+0000 7f11d3400640 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc2587a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d3400640 1 -- 172.21.15.40:0/462688570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 msgr2=0x557cc2587a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d3400640 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc2587a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d3400640 1 -- 172.21.15.40:0/462688570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21aa840 msgr2=0x557cc25718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d3400640 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21aa840 0x557cc25718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d3400640 1 -- 172.21.15.40:0/462688570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc258e1d0 con 0x557cc21a2660 2024-07-26T13:02:51.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d3400640 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc256cff0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005e10 tx=0x7f11c400bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec64bf696316159d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:51.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d0c00640 1 -- 172.21.15.40:0/462688570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400bbf0 con 0x557cc21a2660 2024-07-26T13:02:51.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d0c00640 1 -- 172.21.15.40:0/462688570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c40108c0 con 0x557cc21a2660 2024-07-26T13:02:51.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.953+0000 7f11d0c00640 1 -- 172.21.15.40:0/462688570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400e720 con 0x557cc21a2660 2024-07-26T13:02:51.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 -- 172.21.15.40:0/462688570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 msgr2=0x557cc256cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:51.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc256cff0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005e10 tx=0x7f11c400bb80 comp rx=0 tx=0).stop 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 -- 172.21.15.40:0/462688570 shutdown_connections 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21cb520 0x557cc2587a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21aa840 0x557cc25718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 --2- 172.21.15.40:0/462688570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc256cff0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.954+0000 7f11e99c6740 1 -- 172.21.15.40:0/462688570 >> 172.21.15.40:0/462688570 conn(0x557cc21bf910 msgr2=0x557cc25711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.955+0000 7f11e99c6740 1 -- 172.21.15.40:0/462688570 shutdown_connections 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.955+0000 7f11e99c6740 1 -- 172.21.15.40:0/462688570 wait complete. 2024-07-26T13:02:51.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.955+0000 7f11e99c6740 1 -- start start 2024-07-26T13:02:51.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.955+0000 7f11e99c6740 1 Processor -- start 2024-07-26T13:02:51.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc257fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21aa840 0x557cc25802c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc25f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1b6530 con 0x557cc21a2660 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1b5e60 con 0x557cc21cb520 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc1b3080 con 0x557cc21aa840 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11e99c6740 10 client.0 _ll_register_callbacks cb 0x7f11cc00b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc257fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc257fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52860/0 (socket says 172.21.15.40:52860) 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.956+0000 7f11d3400640 1 -- 172.21.15.40:0/1918593475 learned_addr learned my addr 172.21.15.40:0/1918593475 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11dbe00640 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21aa840 0x557cc25802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11d3400640 1 -- 172.21.15.40:0/1918593475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21aa840 msgr2=0x557cc25802c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11d3400640 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21aa840 0x557cc25802c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11d3400640 1 -- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 msgr2=0x557cc25f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:02:51.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11d3400640 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc25f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:51.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11d3400640 1 -- 172.21.15.40:0/1918593475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc2580b40 con 0x557cc21a2660 2024-07-26T13:02:51.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11d3400640 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc257fd80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005fa0 tx=0x7f11c4010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b5260bacd79b0a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:02:51.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.957+0000 7f11ca000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:02:51.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.958+0000 7f11ca000640 1 -- 172.21.15.40:0/1918593475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4010630 con 0x557cc21a2660 2024-07-26T13:02:51.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.958+0000 7f11ca000640 1 -- 172.21.15.40:0/1918593475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f11c4005040 con 0x557cc21a2660 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.958+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c40108c0 con 0x557cc21a2660 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.958+0000 7f11ca000640 1 -- 172.21.15.40:0/1918593475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f11c400bcb0 con 0x557cc21a2660 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.958+0000 7f11e99c6740 10 client.17043 fetch_fsmap learned FSMap version 35 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.958+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557cc25f6990 con 0x557cc21a2660 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11ca000640 1 -- 172.21.15.40:0/1918593475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c40108c0 con 0x557cc21a2660 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11ca000640 1 -- 172.21.15.40:0/1918593475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f11c400ec20 con 0x557cc21a2660 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11e99c6740 10 client.17043 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11e99c6740 10 client.17043 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11e99c6740 20 client.17043 populate_metadata read hostname 'smithi040' 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc215f250 0x557cc25f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11e99c6740 4 client.17043 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "92487052", "release": true, "await": true}] 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.959+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "92487052", "release": true, "await": true}) -- 0x557cc24e4940 con 0x557cc215f250 2024-07-26T13:02:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.960+0000 7f11dbe00640 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc215f250 0x557cc25f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:02:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.961+0000 7f11dbe00640 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc215f250 0x557cc25f8e80 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=796588a20c462998 server_cookie=bcd3e2800229c7e1 in_seq=0 out_seq=0 2024-07-26T13:02:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:51.961+0000 7f11ca000640 10 client.17043 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.036+0000 7f11ca000640 1 -- 172.21.15.40:0/1918593475 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x557cc24e4940 con 0x557cc215f250 2024-07-26T13:02:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.036+0000 7f11ca000640 10 client.17043 handle_command_reply: tid=0 2024-07-26T13:02:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.036+0000 7f11e99c6740 1 client.17043 shutdown 2024-07-26T13:02:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 msgr2=0x557cc257fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:52.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc257fd80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005fa0 tx=0x7f11c4010b00 comp rx=0 tx=0).stop 2024-07-26T13:02:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 shutdown_connections 2024-07-26T13:02:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557cc21cb520 0x557cc25f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557cc21aa840 0x557cc25802c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557cc215f250 0x557cc25f8e80 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 --2- 172.21.15.40:0/1918593475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557cc21a2660 0x557cc257fd80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 >> 172.21.15.40:0/1918593475 conn(0x557cc21bf910 msgr2=0x557cc257d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.037+0000 7f11ca000640 0 client.17043 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:02:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.038+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 shutdown_connections 2024-07-26T13:02:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.038+0000 7f11e99c6740 1 -- 172.21.15.40:0/1918593475 wait complete. 2024-07-26T13:02:52.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.038+0000 7f11e99c6740 20 client.17043 trim_cache size 0 max 16384 2024-07-26T13:02:52.039 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 132, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "92487052": { 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 132, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:02:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.4, 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:02:52.041 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:02:52.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.039+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f11c00b3c80 msgr2=0x7f11c00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:52.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.039+0000 7f11e1800640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f11c00b3c80 0x7f11c00b6190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f11d402ae80 tx=0x7f11d4032fa0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.039+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 msgr2=0x7f11dc1a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.039+0000 7f11e1800640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1a59f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f11d4005cc0 tx=0x7f11d4032a10 comp rx=0 tx=0).stop 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.039+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 shutdown_connections 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11dc10fc80 0x7f11dc1a59f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f11c00b3c80 0x7f11c00b6190 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc10f330 0x7f11dc1a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 --2- 172.21.15.40:0/2368476206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11dc1099f0 0x7f11dc1a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 >> 172.21.15.40:0/2368476206 conn(0x7f11dc078ff0 msgr2=0x7f11dc079670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 shutdown_connections 2024-07-26T13:02:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:02:52.040+0000 7f11e1800640 1 -- 172.21.15.40:0/2368476206 wait complete. 2024-07-26T13:02:52.971 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '92487052', total seconds elapsed: 34.4 2024-07-26T13:02:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:52 smithi040 ceph-mon[32397]: pgmap v1718: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:02:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:52 smithi146 ceph-mon[35807]: pgmap v1718: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:02:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:52 smithi076 ceph-mon[35401]: pgmap v1718: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:02:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:54 smithi040 ceph-mon[32397]: pgmap v1719: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:02:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:54 smithi146 ceph-mon[35807]: pgmap v1719: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:02:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:54 smithi076 ceph-mon[35401]: pgmap v1719: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:02:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:56 smithi040 ceph-mon[32397]: pgmap v1720: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:02:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:56 smithi146 ceph-mon[35807]: pgmap v1720: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:02:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:56 smithi076 ceph-mon[35401]: pgmap v1720: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:02:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:02:58 smithi040 ceph-mon[32397]: pgmap v1721: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:02:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:02:58 smithi146 ceph-mon[35807]: pgmap v1721: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:02:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:02:58 smithi076 ceph-mon[35401]: pgmap v1721: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:03:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:00 smithi040 ceph-mon[32397]: pgmap v1722: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-07-26T13:03:01.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:00 smithi146 ceph-mon[35807]: pgmap v1722: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-07-26T13:03:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:00 smithi076 ceph-mon[35401]: pgmap v1722: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-07-26T13:03:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:02 smithi040 ceph-mon[32397]: pgmap v1723: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T13:03:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:02 smithi146 ceph-mon[35807]: pgmap v1723: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T13:03:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:02 smithi076 ceph-mon[35401]: pgmap v1723: 97 pgs: 97 active+clean; 7.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T13:03:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:04 smithi040 ceph-mon[32397]: pgmap v1724: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:03:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:04 smithi146 ceph-mon[35807]: pgmap v1724: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:03:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:04 smithi076 ceph-mon[35401]: pgmap v1724: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:03:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:06 smithi040 ceph-mon[32397]: pgmap v1725: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.1 MiB/s wr, 13 op/s 2024-07-26T13:03:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:06 smithi146 ceph-mon[35807]: pgmap v1725: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.1 MiB/s wr, 13 op/s 2024-07-26T13:03:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:06 smithi076 ceph-mon[35401]: pgmap v1725: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.1 MiB/s wr, 13 op/s 2024-07-26T13:03:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:08 smithi040 ceph-mon[32397]: pgmap v1726: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T13:03:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:08 smithi146 ceph-mon[35807]: pgmap v1726: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T13:03:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:08 smithi076 ceph-mon[35401]: pgmap v1726: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 11 op/s 2024-07-26T13:03:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:10 smithi040 ceph-mon[32397]: pgmap v1727: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.5 MiB/s wr, 15 op/s 2024-07-26T13:03:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:10 smithi146 ceph-mon[35807]: pgmap v1727: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.5 MiB/s wr, 15 op/s 2024-07-26T13:03:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:10 smithi076 ceph-mon[35401]: pgmap v1727: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.5 MiB/s wr, 15 op/s 2024-07-26T13:03:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:12 smithi040 ceph-mon[32397]: pgmap v1728: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:03:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:12 smithi146 ceph-mon[35807]: pgmap v1728: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:03:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:12 smithi076 ceph-mon[35401]: pgmap v1728: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:03:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:14 smithi040 ceph-mon[32397]: pgmap v1729: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:03:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:14 smithi146 ceph-mon[35807]: pgmap v1729: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:03:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:14 smithi076 ceph-mon[35401]: pgmap v1729: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:03:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:16 smithi040 ceph-mon[32397]: pgmap v1730: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:03:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:16 smithi146 ceph-mon[35807]: pgmap v1730: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:03:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:16 smithi076 ceph-mon[35401]: pgmap v1730: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:03:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:18 smithi146 ceph-mon[35807]: pgmap v1731: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:18 smithi076 ceph-mon[35401]: pgmap v1731: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:18 smithi040 ceph-mon[32397]: pgmap v1731: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:20 smithi146 ceph-mon[35807]: pgmap v1732: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:03:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:20 smithi076 ceph-mon[35401]: pgmap v1732: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:03:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:20 smithi040 ceph-mon[32397]: pgmap v1732: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:03:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:03:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:03:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:03:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:23 smithi146 ceph-mon[35807]: pgmap v1733: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:03:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:03:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:03:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:23 smithi076 ceph-mon[35401]: pgmap v1733: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:03:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:03:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:03:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:23 smithi040 ceph-mon[32397]: pgmap v1733: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:03:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:03:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:03:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:25 smithi146 ceph-mon[35807]: pgmap v1734: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T13:03:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:25 smithi076 ceph-mon[35401]: pgmap v1734: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T13:03:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:25 smithi040 ceph-mon[32397]: pgmap v1734: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T13:03:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:27 smithi146 ceph-mon[35807]: pgmap v1735: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:03:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:27 smithi076 ceph-mon[35401]: pgmap v1735: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:03:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:27 smithi040 ceph-mon[32397]: pgmap v1735: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:03:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:29 smithi146 ceph-mon[35807]: pgmap v1736: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:03:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:29 smithi076 ceph-mon[35401]: pgmap v1736: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:03:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:29 smithi040 ceph-mon[32397]: pgmap v1736: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:03:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:31 smithi146 ceph-mon[35807]: pgmap v1737: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:03:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:31 smithi076 ceph-mon[35401]: pgmap v1737: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:03:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:31 smithi040 ceph-mon[32397]: pgmap v1737: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-07-26T13:03:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:33 smithi146 ceph-mon[35807]: pgmap v1738: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:03:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:33 smithi076 ceph-mon[35401]: pgmap v1738: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:03:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:33 smithi040 ceph-mon[32397]: pgmap v1738: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:03:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:35 smithi146 ceph-mon[35807]: pgmap v1739: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:03:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:35 smithi076 ceph-mon[35401]: pgmap v1739: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:03:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:35 smithi040 ceph-mon[32397]: pgmap v1739: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:03:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:37 smithi146 ceph-mon[35807]: pgmap v1740: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:03:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:37 smithi076 ceph-mon[35401]: pgmap v1740: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:03:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:37 smithi040 ceph-mon[32397]: pgmap v1740: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:03:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:39 smithi146 ceph-mon[35807]: pgmap v1741: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T13:03:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:39 smithi076 ceph-mon[35401]: pgmap v1741: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T13:03:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:39 smithi040 ceph-mon[32397]: pgmap v1741: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.7 MiB/s wr, 11 op/s 2024-07-26T13:03:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:41 smithi076 ceph-mon[35401]: pgmap v1742: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:03:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:41 smithi040 ceph-mon[32397]: pgmap v1742: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:03:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:41 smithi146 ceph-mon[35807]: pgmap v1742: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:03:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:43 smithi040 ceph-mon[32397]: pgmap v1743: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:43 smithi146 ceph-mon[35807]: pgmap v1743: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:43 smithi076 ceph-mon[35401]: pgmap v1743: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:45 smithi040 ceph-mon[32397]: pgmap v1744: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:03:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:45 smithi146 ceph-mon[35807]: pgmap v1744: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:03:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:45 smithi076 ceph-mon[35401]: pgmap v1744: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:03:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:47 smithi040 ceph-mon[32397]: pgmap v1745: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:03:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:47 smithi146 ceph-mon[35807]: pgmap v1745: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:03:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:47 smithi076 ceph-mon[35401]: pgmap v1745: 97 pgs: 97 active+clean; 7.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:03:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:49 smithi040 ceph-mon[32397]: pgmap v1746: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:03:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:49 smithi146 ceph-mon[35807]: pgmap v1746: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:03:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:49 smithi076 ceph-mon[35401]: pgmap v1746: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:03:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:51 smithi040 ceph-mon[32397]: pgmap v1747: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T13:03:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:51 smithi146 ceph-mon[35807]: pgmap v1747: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T13:03:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:51 smithi076 ceph-mon[35401]: pgmap v1747: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T13:03:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:53 smithi040 ceph-mon[32397]: pgmap v1748: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:03:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:53 smithi146 ceph-mon[35807]: pgmap v1748: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:03:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:53 smithi076 ceph-mon[35401]: pgmap v1748: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:03:55.465 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:55 smithi040 ceph-mon[32397]: pgmap v1749: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:03:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:55 smithi146 ceph-mon[35807]: pgmap v1749: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:03:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:55 smithi076 ceph-mon[35401]: pgmap v1749: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:03:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:57 smithi040 ceph-mon[32397]: pgmap v1750: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:03:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:57 smithi146 ceph-mon[35807]: pgmap v1750: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:03:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:57 smithi076 ceph-mon[35401]: pgmap v1750: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:03:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:03:59 smithi040 ceph-mon[32397]: pgmap v1751: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:03:59 smithi146 ceph-mon[35807]: pgmap v1751: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:03:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:03:59 smithi076 ceph-mon[35401]: pgmap v1751: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:04:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:01 smithi040 ceph-mon[32397]: pgmap v1752: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:04:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:01 smithi146 ceph-mon[35807]: pgmap v1752: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:04:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:01 smithi076 ceph-mon[35401]: pgmap v1752: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:04:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:03 smithi040 ceph-mon[32397]: pgmap v1753: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:04:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:03 smithi146 ceph-mon[35807]: pgmap v1753: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:04:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:03 smithi076 ceph-mon[35401]: pgmap v1753: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:04:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:04 smithi040 ceph-mon[32397]: pgmap v1754: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:04:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:04 smithi146 ceph-mon[35807]: pgmap v1754: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:04:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:04 smithi076 ceph-mon[35401]: pgmap v1754: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:04:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:06 smithi040 ceph-mon[32397]: pgmap v1755: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:04:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:06 smithi146 ceph-mon[35807]: pgmap v1755: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:04:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:06 smithi076 ceph-mon[35401]: pgmap v1755: 97 pgs: 97 active+clean; 7.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:04:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:08 smithi040 ceph-mon[32397]: pgmap v1756: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:04:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:08 smithi146 ceph-mon[35807]: pgmap v1756: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:04:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:08 smithi076 ceph-mon[35401]: pgmap v1756: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:04:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:10 smithi040 ceph-mon[32397]: pgmap v1757: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:04:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:10 smithi146 ceph-mon[35807]: pgmap v1757: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:04:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:10 smithi076 ceph-mon[35401]: pgmap v1757: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:04:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:12 smithi040 ceph-mon[32397]: pgmap v1758: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:04:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:12 smithi146 ceph-mon[35807]: pgmap v1758: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:04:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:12 smithi076 ceph-mon[35401]: pgmap v1758: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:04:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:14 smithi040 ceph-mon[32397]: pgmap v1759: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:04:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:14 smithi146 ceph-mon[35807]: pgmap v1759: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:04:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:14 smithi076 ceph-mon[35401]: pgmap v1759: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:04:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:16 smithi040 ceph-mon[32397]: pgmap v1760: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:04:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:16 smithi146 ceph-mon[35807]: pgmap v1760: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:04:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:16 smithi076 ceph-mon[35401]: pgmap v1760: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:04:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:18 smithi040 ceph-mon[32397]: pgmap v1761: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:04:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:18 smithi146 ceph-mon[35807]: pgmap v1761: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:04:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:18 smithi076 ceph-mon[35401]: pgmap v1761: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:04:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:20 smithi040 ceph-mon[32397]: pgmap v1762: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:04:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:20 smithi146 ceph-mon[35807]: pgmap v1762: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:04:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:20 smithi076 ceph-mon[35401]: pgmap v1762: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:04:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:22 smithi040 ceph-mon[32397]: pgmap v1763: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:04:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:22 smithi146 ceph-mon[35807]: pgmap v1763: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:04:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:22 smithi076 ceph-mon[35401]: pgmap v1763: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:04:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:04:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:04:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:04:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:24 smithi040 ceph-mon[32397]: pgmap v1764: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:04:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:04:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:04:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:04:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:24 smithi146 ceph-mon[35807]: pgmap v1764: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:04:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:04:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:04:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:04:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:24 smithi076 ceph-mon[35401]: pgmap v1764: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:04:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:04:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:04:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:04:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:26 smithi040 ceph-mon[32397]: pgmap v1765: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:04:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:26 smithi146 ceph-mon[35807]: pgmap v1765: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:04:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:26 smithi076 ceph-mon[35401]: pgmap v1765: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:04:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:28 smithi040 ceph-mon[32397]: pgmap v1766: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:04:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:28 smithi146 ceph-mon[35807]: pgmap v1766: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:04:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:28 smithi076 ceph-mon[35401]: pgmap v1766: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:04:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:30 smithi040 ceph-mon[32397]: pgmap v1767: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:04:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:30 smithi146 ceph-mon[35807]: pgmap v1767: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:04:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:30 smithi076 ceph-mon[35401]: pgmap v1767: 97 pgs: 97 active+clean; 7.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:04:31.215 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.8 2024-07-26T13:04:31.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:04:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:04:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:32 smithi040 ceph-mon[32397]: pgmap v1768: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:04:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:32 smithi146 ceph-mon[35807]: pgmap v1768: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:04:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:32 smithi076 ceph-mon[35401]: pgmap v1768: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:04:34.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:34 smithi040 ceph-mon[32397]: pgmap v1769: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:04:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:34 smithi146 ceph-mon[35807]: pgmap v1769: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:04:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:34 smithi076 ceph-mon[35401]: pgmap v1769: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:04:35.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 -- 172.21.15.40:0/430026501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 msgr2=0x7f3f78107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 --2- 172.21.15.40:0/430026501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f78107930 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009cd0 tx=0x7f3f7002a8f0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 -- 172.21.15.40:0/430026501 shutdown_connections 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 --2- 172.21.15.40:0/430026501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f78107930 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 --2- 172.21.15.40:0/430026501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f78102960 0x7f3f78106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 --2- 172.21.15.40:0/430026501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f78102010 0x7f3f78102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 -- 172.21.15.40:0/430026501 >> 172.21.15.40:0/430026501 conn(0x7f3f780fdd40 msgr2=0x7f3f78100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 -- 172.21.15.40:0/430026501 shutdown_connections 2024-07-26T13:04:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.290+0000 7f3f7e400640 1 -- 172.21.15.40:0/430026501 wait complete. 2024-07-26T13:04:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.292+0000 7f3f7e400640 1 Processor -- start 2024-07-26T13:04:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.292+0000 7f3f7e400640 1 -- start start 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7e400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f78102010 0x7f3f781a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7e400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f78102960 0x7f3f781a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7e400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f781a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7e400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3f781197c0 con 0x7f3f78107450 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7e400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78119640 con 0x7f3f78102010 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7e400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78119940 con 0x7f3f78102960 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f781a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7d000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f78102010 0x7f3f781a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f781a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57862/0 (socket says 172.21.15.40:57862) 2024-07-26T13:04:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f7da00640 1 -- 172.21.15.40:0/3379477442 learned_addr learned my addr 172.21.15.40:0/3379477442 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.293+0000 7f3f77e00640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f78102960 0x7f3f781a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.294+0000 7f3f7da00640 1 -- 172.21.15.40:0/3379477442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f78102960 msgr2=0x7f3f781a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.294+0000 7f3f7da00640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f78102960 0x7f3f781a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.294+0000 7f3f7da00640 1 -- 172.21.15.40:0/3379477442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f78102010 msgr2=0x7f3f781a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.294+0000 7f3f7da00640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f78102010 0x7f3f781a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.294+0000 7f3f7da00640 1 -- 172.21.15.40:0/3379477442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f781a6180 con 0x7f3f78107450 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.295+0000 7f3f7da00640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f781a5a50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3f70005cc0 tx=0x7f3f70003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.295+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70004040 con 0x7f3f78107450 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.295+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f70040070 con 0x7f3f78107450 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.295+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70045ac0 con 0x7f3f78107450 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.295+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f781a6410 con 0x7f3f78107450 2024-07-26T13:04:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.295+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f781acbd0 con 0x7f3f78107450 2024-07-26T13:04:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.297+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7806b950 con 0x7f3f78107450 2024-07-26T13:04:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.301+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f70045c60 con 0x7f3f78107450 2024-07-26T13:04:35.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.303+0000 7f3f75600640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f600b3c50 0x7f3f600b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:35.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.303+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3f70104fd0 con 0x7f3f78107450 2024-07-26T13:04:35.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.304+0000 7f3f7d000640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f600b3c50 0x7f3f600b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:35.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.305+0000 7f3f7d000640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f600b3c50 0x7f3f600b6160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c005fd0 tx=0x7f3f6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.305+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3f700cc620 con 0x7f3f78107450 2024-07-26T13:04:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.587+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f78106e90 con 0x7f3f78107450 2024-07-26T13:04:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.589+0000 7f3f75600640 1 -- 172.21.15.40:0/3379477442 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f3f78106e90 con 0x7f3f78107450 2024-07-26T13:04:35.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:04:35.591 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:04:35.592 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:04:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f600b3c50 msgr2=0x7f3f600b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f600b3c50 0x7f3f600b6160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c005fd0 tx=0x7f3f6c00b390 comp rx=0 tx=0).stop 2024-07-26T13:04:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 msgr2=0x7f3f781a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f781a5a50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3f70005cc0 tx=0x7f3f70003970 comp rx=0 tx=0).stop 2024-07-26T13:04:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 shutdown_connections 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f78107450 0x7f3f781a5a50 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3f600b3c50 0x7f3f600b6160 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f78102960 0x7f3f781a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 --2- 172.21.15.40:0/3379477442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f78102010 0x7f3f781a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.592+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 >> 172.21.15.40:0/3379477442 conn(0x7f3f780fdd40 msgr2=0x7f3f78104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.593+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 shutdown_connections 2024-07-26T13:04:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:35.593+0000 7f3f7e400640 1 -- 172.21.15.40:0/3379477442 wait complete. 2024-07-26T13:04:36.587 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130.8 --await-for 45.0' 2024-07-26T13:04:36.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130.8 --await-for 45.0 2024-07-26T13:04:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:36 smithi146 ceph-mon[35807]: pgmap v1770: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:04:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:36 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3379477442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:04:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:36 smithi076 ceph-mon[35401]: pgmap v1770: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:04:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:36 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3379477442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:04:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:36 smithi040 ceph-mon[32397]: pgmap v1770: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:04:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:36 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3379477442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:04:37.128 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:04:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:38 smithi040 ceph-mon[32397]: pgmap v1771: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:04:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:38 smithi146 ceph-mon[35807]: pgmap v1771: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:04:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:38 smithi076 ceph-mon[35401]: pgmap v1771: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:04:39.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 -- 172.21.15.40:0/91879696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 msgr2=0x7f05f41164d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 --2- 172.21.15.40:0/91879696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41164d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009ca0 tx=0x7f05ec02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 -- 172.21.15.40:0/91879696 shutdown_connections 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 --2- 172.21.15.40:0/91879696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41164d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 --2- 172.21.15.40:0/91879696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f410f350 0x7f05f410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 --2- 172.21.15.40:0/91879696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f4109a60 0x7f05f4109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 -- 172.21.15.40:0/91879696 >> 172.21.15.40:0/91879696 conn(0x7f05f4079100 msgr2=0x7f05f4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 -- 172.21.15.40:0/91879696 shutdown_connections 2024-07-26T13:04:39.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.369+0000 7f05fa800640 1 -- 172.21.15.40:0/91879696 wait complete. 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.371+0000 7f05fa800640 1 Processor -- start 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.371+0000 7f05fa800640 1 -- start start 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.371+0000 7f05fa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f4109a60 0x7f05f41a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.371+0000 7f05fa800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f410f350 0x7f05f41a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.371+0000 7f05fa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.371+0000 7f05fa800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4119810 con 0x7f05f410fca0 2024-07-26T13:04:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05fa800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4119690 con 0x7f05f410f350 2024-07-26T13:04:39.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05fa800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4119990 con 0x7f05f4109a60 2024-07-26T13:04:39.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05f9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05f9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41a59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57878/0 (socket says 172.21.15.40:57878) 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05f9e00640 1 -- 172.21.15.40:0/69676696 learned_addr learned my addr 172.21.15.40:0/69676696 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05f9400640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f4109a60 0x7f05f41a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.372+0000 7f05f8a00640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f410f350 0x7f05f41a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f9e00640 1 -- 172.21.15.40:0/69676696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f4109a60 msgr2=0x7f05f41a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f9e00640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f4109a60 0x7f05f41a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f9e00640 1 -- 172.21.15.40:0/69676696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f410f350 msgr2=0x7f05f41a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f9e00640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f410f350 0x7f05f41a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f9e00640 1 -- 172.21.15.40:0/69676696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f41a6010 con 0x7f05f410fca0 2024-07-26T13:04:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f9e00640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41a59a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f05ec005cc0 tx=0x7f05ec032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:39.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.373+0000 7f05f2000640 1 -- 172.21.15.40:0/69676696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec032e00 con 0x7f05f410fca0 2024-07-26T13:04:39.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.374+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f41a62a0 con 0x7f05f410fca0 2024-07-26T13:04:39.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.374+0000 7f05f2000640 1 -- 172.21.15.40:0/69676696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05ec0044d0 con 0x7f05f410fca0 2024-07-26T13:04:39.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.374+0000 7f05f2000640 1 -- 172.21.15.40:0/69676696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec030b70 con 0x7f05f410fca0 2024-07-26T13:04:39.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.374+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f41acb20 con 0x7f05f410fca0 2024-07-26T13:04:39.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.378+0000 7f0602bf2740 1 Processor -- start 2024-07-26T13:04:39.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.378+0000 7f05f2000640 1 -- 172.21.15.40:0/69676696 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f05ec030d10 con 0x7f05f410fca0 2024-07-26T13:04:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.378+0000 7f0602bf2740 1 -- start start 2024-07-26T13:04:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c0594390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c05948d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0594e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f0602bf2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5581c055ecf0 con 0x5581c01ee840 2024-07-26T13:04:39.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f0602bf2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5581c0509b40 con 0x5581c01cdb60 2024-07-26T13:04:39.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f0602bf2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5581c04f9040 con 0x5581c01c5980 2024-07-26T13:04:39.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f05f8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c0594390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f05f8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c0594390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57882/0 (socket says 172.21.15.40:57882) 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f05f8a00640 1 -- 172.21.15.40:0/443653908 learned_addr learned my addr 172.21.15.40:0/443653908 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.379+0000 7f05f9400640 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c05948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f8a00640 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0594e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f8a00640 1 -- 172.21.15.40:0/443653908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 msgr2=0x5581c05948d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f8a00640 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c05948d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f8a00640 1 -- 172.21.15.40:0/443653908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 msgr2=0x5581c0594e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f8a00640 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0594e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f8a00640 1 -- 172.21.15.40:0/443653908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581c0480af0 con 0x5581c01ee840 2024-07-26T13:04:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.380+0000 7f05f2000640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f05dc0b3bf0 0x7f05dc0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.381+0000 7f05f2000640 1 -- 172.21.15.40:0/69676696 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f05ec105070 con 0x7f05f410fca0 2024-07-26T13:04:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.381+0000 7f05f9400640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f05dc0b3bf0 0x7f05dc0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.381+0000 7f05f8a00640 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c0594390 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f05e000afd0 tx=0x7f05e000a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8ad3bfe07ed02e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.381+0000 7f05e6600640 1 -- 172.21.15.40:0/443653908 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0019030 con 0x5581c01ee840 2024-07-26T13:04:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.381+0000 7f05e6600640 1 -- 172.21.15.40:0/443653908 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05e00110d0 con 0x5581c01ee840 2024-07-26T13:04:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.381+0000 7f05e6600640 1 -- 172.21.15.40:0/443653908 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e000f710 con 0x5581c01ee840 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.382+0000 7f0602bf2740 1 -- 172.21.15.40:0/443653908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 msgr2=0x5581c0594390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.382+0000 7f0602bf2740 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c0594390 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f05e000afd0 tx=0x7f05e000a7c0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.382+0000 7f05f9400640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f05dc0b3bf0 0x7f05dc0b6100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x5581c0593010 tx=0x7f05e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 -- 172.21.15.40:0/443653908 shutdown_connections 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0594e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c05948d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 --2- 172.21.15.40:0/443653908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c0594390 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 -- 172.21.15.40:0/443653908 >> 172.21.15.40:0/443653908 conn(0x5581c01e2990 msgr2=0x5581c0592280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 -- 172.21.15.40:0/443653908 shutdown_connections 2024-07-26T13:04:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.383+0000 7f0602bf2740 1 -- 172.21.15.40:0/443653908 wait complete. 2024-07-26T13:04:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.384+0000 7f0602bf2740 1 -- start start 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.384+0000 7f0602bf2740 1 Processor -- start 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.384+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 0x5581c059fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.384+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.384+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01ee840 0x5581c05abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f0602bf2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5581c0495500 con 0x5581c01c5980 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f0602bf2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5581c04fd080 con 0x5581c01ee840 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f0602bf2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5581c035c7a0 con 0x5581c01cdb60 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f0602bf2740 10 client.0 _ll_register_callbacks cb 0x5581c04f1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 0x5581c059fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 0x5581c059fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57894/0 (socket says 172.21.15.40:57894) 2024-07-26T13:04:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f9400640 1 -- 172.21.15.40:0/3786756269 learned_addr learned my addr 172.21.15.40:0/3786756269 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f8a00640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f9e00640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01ee840 0x5581c05abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f9400640 1 -- 172.21.15.40:0/3786756269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 msgr2=0x5581c05a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.385+0000 7f05f9400640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05f9400640 1 -- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01ee840 msgr2=0x5581c05abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05f9400640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01ee840 0x5581c05abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05f9400640 1 -- 172.21.15.40:0/3786756269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581c0268b90 con 0x5581c01c5980 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05f8a00640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05f9400640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 0x5581c059fc30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f05e8003d30 tx=0x7f05e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3dfa2f54f40446 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05daa00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05daa00640 1 -- 172.21.15.40:0/3786756269 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e802c060 con 0x5581c01c5980 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f05daa00640 1 -- 172.21.15.40:0/3786756269 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f05e8017030 con 0x5581c01c5980 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.386+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e00110d0 con 0x5581c01c5980 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.387+0000 7f05daa00640 1 -- 172.21.15.40:0/3786756269 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f05e8027410 con 0x5581c01c5980 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.387+0000 7f0602bf2740 10 client.17061 fetch_fsmap learned FSMap version 35 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.387+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5581c05ae940 con 0x5581c01c5980 2024-07-26T13:04:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.387+0000 7f05daa00640 1 -- 172.21.15.40:0/3786756269 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05e00110d0 con 0x5581c01c5980 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.387+0000 7f05daa00640 1 -- 172.21.15.40:0/3786756269 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f05e8031070 con 0x5581c01c5980 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f0602bf2740 10 client.17061 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f0602bf2740 10 client.17061 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f0602bf2740 20 client.17061 populate_metadata read hostname 'smithi040' 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f0602bf2740 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c01ad1c0 0x5581c05b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f0602bf2740 4 client.17061 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581c050ba90 con 0x5581c01ad1c0 2024-07-26T13:04:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.388+0000 7f05f8a00640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c01ad1c0 0x5581c05b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.389+0000 7f05f8a00640 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c01ad1c0 0x5581c05b2040 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a925b66fb144856c server_cookie=6a634b2f102e7df5 in_seq=0 out_seq=0 2024-07-26T13:04:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.389+0000 7f05daa00640 10 client.17061 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.391+0000 7f05daa00640 1 -- 172.21.15.40:0/3786756269 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581c050ba90 con 0x5581c01ad1c0 2024-07-26T13:04:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.391+0000 7f05daa00640 10 client.17061 handle_command_reply: tid=0 2024-07-26T13:04:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.391+0000 7f0602bf2740 1 client.17061 shutdown 2024-07-26T13:04:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 msgr2=0x5581c059fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 0x5581c059fc30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f05e8003d30 tx=0x7f05e80046c0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 shutdown_connections 2024-07-26T13:04:39.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01ee840 0x5581c05abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c01ad1c0 0x5581c05b2040 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 --2- 172.21.15.40:0/3786756269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01c5980 0x5581c059fc30 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 >> 172.21.15.40:0/3786756269 conn(0x5581c01e2990 msgr2=0x5581c0597570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f05daa00640 0 client.17061 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 shutdown_connections 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.392+0000 7f0602bf2740 1 -- 172.21.15.40:0/3786756269 wait complete. 2024-07-26T13:04:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.393+0000 7f0602bf2740 20 client.17061 trim_cache size 0 max 16384 2024-07-26T13:04:39.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.420+0000 7f0602bf2740 1 Processor -- start 2024-07-26T13:04:39.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.420+0000 7f0602bf2740 1 -- start start 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.420+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c0597b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.420+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0591200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.420+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f0602bf2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41b5080 con 0x5581c01ee840 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f0602bf2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41b6bc0 con 0x5581c01cdb60 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f0602bf2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41b5750 con 0x5581c01c5980 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f05f9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f05f9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57896/0 (socket says 172.21.15.40:57896) 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f05f9e00640 1 -- 172.21.15.40:0/907461432 learned_addr learned my addr 172.21.15.40:0/907461432 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f05f8a00640 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0591200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.421+0000 7f05f9400640 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c0597b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05f9e00640 1 -- 172.21.15.40:0/907461432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 msgr2=0x5581c0597b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05f9e00640 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c0597b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05f9e00640 1 -- 172.21.15.40:0/907461432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 msgr2=0x5581c0591200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05f9e00640 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0591200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05f9e00640 1 -- 172.21.15.40:0/907461432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581c05971f0 con 0x5581c01ee840 2024-07-26T13:04:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05f9e00640 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a1860 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f05ec102b30 tx=0x7f05ec0cb6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056797e392b4d4d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.422+0000 7f05e5c00640 1 -- 172.21.15.40:0/907461432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0cbf80 con 0x5581c01ee840 2024-07-26T13:04:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.423+0000 7f05e5c00640 1 -- 172.21.15.40:0/907461432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05ec0e6070 con 0x5581c01ee840 2024-07-26T13:04:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.423+0000 7f05e5c00640 1 -- 172.21.15.40:0/907461432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0cc1e0 con 0x5581c01ee840 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 -- 172.21.15.40:0/907461432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 msgr2=0x5581c05a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a1860 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f05ec102b30 tx=0x7f05ec0cb6f0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 -- 172.21.15.40:0/907461432 shutdown_connections 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a1860 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01cdb60 0x5581c0591200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 --2- 172.21.15.40:0/907461432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01c5980 0x5581c0597b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 -- 172.21.15.40:0/907461432 >> 172.21.15.40:0/907461432 conn(0x5581c01e2990 msgr2=0x5581c05a1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 -- 172.21.15.40:0/907461432 shutdown_connections 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 -- 172.21.15.40:0/907461432 wait complete. 2024-07-26T13:04:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.424+0000 7f0602bf2740 1 -- start start 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 Processor -- start 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01c5980 0x5581c05a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41b64f0 con 0x5581c01ee840 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41b5e20 con 0x5581c01c5980 2024-07-26T13:04:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05f41b3040 con 0x5581c01cdb60 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.425+0000 7f0602bf2740 10 client.0 _ll_register_callbacks cb 0x7f05e8004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.426+0000 7f05f9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01c5980 0x5581c05a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.426+0000 7f05f8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.426+0000 7f05f9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.426+0000 7f05f9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01c5980 0x5581c05a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:41054/0 (socket says 172.21.15.40:41054) 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.426+0000 7f05f8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:45954/0 (socket says 172.21.15.40:45954) 2024-07-26T13:04:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.426+0000 7f05f9400640 1 -- 172.21.15.40:0/4188282275 learned_addr learned my addr 172.21.15.40:0/4188282275 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f8a00640 1 -- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01c5980 msgr2=0x5581c05a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f8a00640 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01c5980 0x5581c05a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f8a00640 1 -- 172.21.15.40:0/4188282275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 msgr2=0x5581c05a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f8a00640 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f8a00640 1 -- 172.21.15.40:0/4188282275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581c0619660 con 0x5581c01cdb60 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f9e00640 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05f8a00640 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a40c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a330 tx=0x7f05e000ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e72758cbf65b51 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.427+0000 7f05daa00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-07-26T13:04:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.428+0000 7f05daa00640 1 -- 172.21.15.40:0/4188282275 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e002d070 con 0x5581c01cdb60 2024-07-26T13:04:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.428+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05ec0e6070 con 0x5581c01cdb60 2024-07-26T13:04:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.428+0000 7f05daa00640 1 -- 172.21.15.40:0/4188282275 <== mon.1 v2:172.21.15.146:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f05e0005140 con 0x5581c01cdb60 2024-07-26T13:04:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.429+0000 7f05daa00640 1 -- 172.21.15.40:0/4188282275 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f05e0036050 con 0x5581c01cdb60 2024-07-26T13:04:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.429+0000 7f0602bf2740 10 client.26533 fetch_fsmap learned FSMap version 35 2024-07-26T13:04:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.429+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5581c061a8c0 con 0x5581c01cdb60 2024-07-26T13:04:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.429+0000 7f05daa00640 1 -- 172.21.15.40:0/4188282275 <== mon.1 v2:172.21.15.146:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05ec0e6070 con 0x5581c01cdb60 2024-07-26T13:04:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f05daa00640 1 -- 172.21.15.40:0/4188282275 <== mon.1 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f05e0039020 con 0x5581c01cdb60 2024-07-26T13:04:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f0602bf2740 10 client.26533 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:04:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f0602bf2740 10 client.26533 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:04:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f0602bf2740 20 client.26533 populate_metadata read hostname 'smithi040' 2024-07-26T13:04:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f0602bf2740 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c0182570 0x5581c061ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f0602bf2740 4 client.26533 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.8, "await_for": 45.0}] 2024-07-26T13:04:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.430+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.8, "await_for": 45.0}) -- 0x5581c0507530 con 0x5581c0182570 2024-07-26T13:04:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.431+0000 7f05f9400640 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c0182570 0x5581c061ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.432+0000 7f05f9400640 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c0182570 0x5581c061ce30 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd76dd7357b1918b server_cookie=c575a0f44560bd90 in_seq=0 out_seq=0 2024-07-26T13:04:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.432+0000 7f05daa00640 10 client.26533 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.682+0000 7f05daa00640 1 -- 172.21.15.40:0/4188282275 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5581c0507530 con 0x5581c0182570 2024-07-26T13:04:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.682+0000 7f05daa00640 10 client.26533 handle_command_reply: tid=0 2024-07-26T13:04:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.682+0000 7f0602bf2740 1 client.26533 shutdown 2024-07-26T13:04:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.682+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 msgr2=0x5581c05a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.682+0000 7f0602bf2740 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a40c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a330 tx=0x7f05e000ace0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 shutdown_connections 2024-07-26T13:04:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5581c0182570 0x5581c061ce30 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5581c01ee840 0x5581c05a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581c01cdb60 0x5581c05a40c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 --2- 172.21.15.40:0/4188282275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5581c01c5980 0x5581c05a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 >> 172.21.15.40:0/4188282275 conn(0x5581c01e2990 msgr2=0x5581c0590fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f05daa00640 0 client.26533 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 shutdown_connections 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.683+0000 7f0602bf2740 1 -- 172.21.15.40:0/4188282275 wait complete. 2024-07-26T13:04:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.684+0000 7f0602bf2740 20 client.26533 trim_cache size 0 max 16384 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 134, 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "6e844819": { 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 134, 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:04:39.687 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.8, 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:39.688 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.685+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f05dc0b3bf0 msgr2=0x7f05dc0b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.685+0000 7f05fa800640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f05dc0b3bf0 0x7f05dc0b6100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x5581c0593010 tx=0x7f05e800b390 comp rx=0 tx=0).stop 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.685+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 msgr2=0x7f05f41a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.685+0000 7f05fa800640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41a59a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f05ec005cc0 tx=0x7f05ec032a10 comp rx=0 tx=0).stop 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 shutdown_connections 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f410fca0 0x7f05f41a59a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f410f350 0x7f05f41a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f05dc0b3bf0 0x7f05dc0b6100 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 --2- 172.21.15.40:0/69676696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f4109a60 0x7f05f41a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 >> 172.21.15.40:0/69676696 conn(0x7f05f4079100 msgr2=0x7f05f4107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 shutdown_connections 2024-07-26T13:04:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:39.686+0000 7f05fa800640 1 -- 172.21.15.40:0/69676696 wait complete. 2024-07-26T13:04:40.677 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6e844819', quiesce took 9.5 seconds. Will release after: 1.3000000000000007 2024-07-26T13:04:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:40 smithi146 ceph-mon[35807]: pgmap v1772: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:04:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:40 smithi076 ceph-mon[35401]: pgmap v1772: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:04:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:40 smithi040 ceph-mon[32397]: pgmap v1772: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:04:41.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:04:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:04:42.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:42 smithi146 ceph-mon[35807]: pgmap v1773: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:04:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:42 smithi076 ceph-mon[35401]: pgmap v1773: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:04:42.860 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:42 smithi040 ceph-mon[32397]: pgmap v1773: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:04:44.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 -- 172.21.15.40:0/3532597474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae810b0f0 msgr2=0x7f6ae810b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 --2- 172.21.15.40:0/3532597474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae810b0f0 0x7f6ae810b500 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009900 tx=0x7f6ad402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 -- 172.21.15.40:0/3532597474 shutdown_connections 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 --2- 172.21.15.40:0/3532597474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810ba40 0x7f6ae8112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 --2- 172.21.15.40:0/3532597474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae810b0f0 0x7f6ae810b500 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 --2- 172.21.15.40:0/3532597474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ae81057b0 0x7f6ae8105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.771+0000 7f6aee000640 1 -- 172.21.15.40:0/3532597474 >> 172.21.15.40:0/3532597474 conn(0x7f6ae8101240 msgr2=0x7f6ae8103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.772+0000 7f6aee000640 1 -- 172.21.15.40:0/3532597474 shutdown_connections 2024-07-26T13:04:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.772+0000 7f6aee000640 1 -- 172.21.15.40:0/3532597474 wait complete. 2024-07-26T13:04:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 Processor -- start 2024-07-26T13:04:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 -- start start 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 0x7f6ae819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810b0f0 0x7f6ae819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ae810ba40 0x7f6ae81a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81155d0 con 0x7f6ae81057b0 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8115450 con 0x7f6ae810ba40 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.773+0000 7f6aee000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8115750 con 0x7f6ae810b0f0 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.774+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 0x7f6ae819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.774+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 0x7f6ae819c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44786/0 (socket says 172.21.15.40:44786) 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.774+0000 7f6ae7400640 1 -- 172.21.15.40:0/2706504894 learned_addr learned my addr 172.21.15.40:0/2706504894 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.774+0000 7f6ae6a00640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810b0f0 0x7f6ae819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.774+0000 7f6ae7e00640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ae810ba40 0x7f6ae81a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae7400640 1 -- 172.21.15.40:0/2706504894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810b0f0 msgr2=0x7f6ae819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae7400640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810b0f0 0x7f6ae819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae7400640 1 -- 172.21.15.40:0/2706504894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ae810ba40 msgr2=0x7f6ae81a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae7400640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ae810ba40 0x7f6ae81a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae7400640 1 -- 172.21.15.40:0/2706504894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae81a1fd0 con 0x7f6ae81057b0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae6a00640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810b0f0 0x7f6ae819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6ae7400640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 0x7f6ae819c060 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c890 tx=0x7f6ad800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004220 con 0x7f6ae81057b0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ad8007e40 con 0x7f6ae81057b0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81a22c0 con 0x7f6ae81057b0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.775+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004a00 con 0x7f6ae81057b0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.776+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81a8a20 con 0x7f6ae81057b0 2024-07-26T13:04:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.777+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8105bc0 con 0x7f6ae81057b0 2024-07-26T13:04:44.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.779+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6ad80079b0 con 0x7f6ae81057b0 2024-07-26T13:04:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.782+0000 7f6adfe00640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6acc0b3bd0 0x7f6acc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:44.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:44 smithi040 ceph-mon[32397]: pgmap v1774: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:04:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.782+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6ad80e3d90 con 0x7f6ae81057b0 2024-07-26T13:04:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.783+0000 7f6ae6a00640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6acc0b3bd0 0x7f6acc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:44.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.784+0000 7f6ae6a00640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6acc0b3bd0 0x7f6acc0b60e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6ad402a910 tx=0x7f6ad4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:44.785+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6ad8014030 con 0x7f6ae81057b0 2024-07-26T13:04:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:44 smithi146 ceph-mon[35807]: pgmap v1774: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:04:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:44 smithi076 ceph-mon[35401]: pgmap v1774: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:04:45.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.027+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ae819d190 con 0x7f6ae81057b0 2024-07-26T13:04:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.029+0000 7f6adfe00640 1 -- 172.21.15.40:0/2706504894 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f6ad80ab3a0 con 0x7f6ae81057b0 2024-07-26T13:04:45.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:04:45.031 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:04:45.032 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:04:45.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.032+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6acc0b3bd0 msgr2=0x7f6acc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.032+0000 7f6aee000640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6acc0b3bd0 0x7f6acc0b60e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6ad402a910 tx=0x7f6ad4000bc0 comp rx=0 tx=0).stop 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 msgr2=0x7f6ae819c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 0x7f6ae819c060 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c890 tx=0x7f6ad800cd50 comp rx=0 tx=0).stop 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 shutdown_connections 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6ae810ba40 0x7f6ae81a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6acc0b3bd0 0x7f6acc0b60e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae810b0f0 0x7f6ae819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 --2- 172.21.15.40:0/2706504894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ae81057b0 0x7f6ae819c060 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 >> 172.21.15.40:0/2706504894 conn(0x7f6ae8101240 msgr2=0x7f6ae8103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 shutdown_connections 2024-07-26T13:04:45.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:45.033+0000 7f6aee000640 1 -- 172.21.15.40:0/2706504894 wait complete. 2024-07-26T13:04:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:45 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2706504894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:04:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:45 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2706504894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:04:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:45 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2706504894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:04:45.921 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 6e844819 --release --await' 2024-07-26T13:04:45.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 6e844819 --release --await 2024-07-26T13:04:46.384 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:04:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:46 smithi146 ceph-mon[35807]: pgmap v1775: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:04:46.867 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:46 smithi040 ceph-mon[32397]: pgmap v1775: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:04:46.867 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:46 smithi076 ceph-mon[35401]: pgmap v1775: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.636+0000 7f07ac400640 1 -- 172.21.15.40:0/3985784739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 msgr2=0x7f07a4077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.636+0000 7f07ac400640 1 --2- 172.21.15.40:0/3985784739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a4077780 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0798009900 tx=0x7f079802a410 comp rx=0 tx=0).stop 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 -- 172.21.15.40:0/3985784739 shutdown_connections 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 --2- 172.21.15.40:0/3985784739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07a41141a0 0x7f07a41165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 --2- 172.21.15.40:0/3985784739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a4077cc0 0x7f07a4113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 --2- 172.21.15.40:0/3985784739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a4077780 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 -- 172.21.15.40:0/3985784739 >> 172.21.15.40:0/3985784739 conn(0x7f07a41011f0 msgr2=0x7f07a4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:48.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 -- 172.21.15.40:0/3985784739 shutdown_connections 2024-07-26T13:04:48.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.637+0000 7f07ac400640 1 -- 172.21.15.40:0/3985784739 wait complete. 2024-07-26T13:04:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.638+0000 7f07ac400640 1 Processor -- start 2024-07-26T13:04:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.638+0000 7f07ac400640 1 -- start start 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07ac400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a41a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07ac400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a4077cc0 0x7f07a41a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07ac400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07a41141a0 0x7f07a41a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07ac400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07a4119a80 con 0x7f07a4077370 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07ac400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f07a4119900 con 0x7f07a41141a0 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07ac400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07a4119c00 con 0x7f07a4077cc0 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07a9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a41a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07a9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a41a0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44790/0 (socket says 172.21.15.40:44790) 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.639+0000 7f07a9a00640 1 -- 172.21.15.40:0/1289527163 learned_addr learned my addr 172.21.15.40:0/1289527163 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9000640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a4077cc0 0x7f07a41a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07aa400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07a41141a0 0x7f07a41a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9a00640 1 -- 172.21.15.40:0/1289527163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a4077cc0 msgr2=0x7f07a41a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9a00640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a4077cc0 0x7f07a41a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9a00640 1 -- 172.21.15.40:0/1289527163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07a41141a0 msgr2=0x7f07a41a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9a00640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07a41141a0 0x7f07a41a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9a00640 1 -- 172.21.15.40:0/1289527163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a41a63c0 con 0x7f07a4077370 2024-07-26T13:04:48.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.640+0000 7f07a9a00640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a41a0510 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f079802a930 tx=0x7f0798003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:48.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.641+0000 7f07a2000640 1 -- 172.21.15.40:0/1289527163 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079803f070 con 0x7f07a4077370 2024-07-26T13:04:48.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.641+0000 7f07a2000640 1 -- 172.21.15.40:0/1289527163 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f079803bdc0 con 0x7f07a4077370 2024-07-26T13:04:48.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.641+0000 7f07a2000640 1 -- 172.21.15.40:0/1289527163 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798035030 con 0x7f07a4077370 2024-07-26T13:04:48.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.641+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a41a6650 con 0x7f07a4077370 2024-07-26T13:04:48.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.641+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a41a6ae0 con 0x7f07a4077370 2024-07-26T13:04:48.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.644+0000 7f07b309e740 1 Processor -- start 2024-07-26T13:04:48.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 -- start start 2024-07-26T13:04:48.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07a2000640 1 -- 172.21.15.40:0/1289527163 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0798042070 con 0x7f07a4077370 2024-07-26T13:04:48.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772447520 0x55c7727ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77241e660 0x55c7727ec520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 0x55c7727eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c772762f50 con 0x55c772426840 2024-07-26T13:04:48.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c772752450 con 0x55c772447520 2024-07-26T13:04:48.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.645+0000 7f07b309e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c772756490 con 0x55c77241e660 2024-07-26T13:04:48.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 0x55c7727eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 0x55c7727eca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44802/0 (socket says 172.21.15.40:44802) 2024-07-26T13:04:48.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 -- 172.21.15.40:0/2039825904 learned_addr learned my addr 172.21.15.40:0/2039825904 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:48.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9a00640 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77241e660 0x55c7727ec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07aa400640 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772447520 0x55c7727ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 -- 172.21.15.40:0/2039825904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77241e660 msgr2=0x55c7727ec520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77241e660 0x55c7727ec520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 -- 172.21.15.40:0/2039825904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772447520 msgr2=0x55c7727ebfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772447520 0x55c7727ebfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.646+0000 7f07a9000640 1 -- 172.21.15.40:0/2039825904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7724b2b00 con 0x55c772426840 2024-07-26T13:04:48.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f07a9000640 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 0x55c7727eca60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f079000cbd0 tx=0x7f079000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165dc636738987d9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:48.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f07a2000640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f078c0b3c80 0x7f078c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f07a2000640 1 -- 172.21.15.40:0/1289527163 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0798104660 con 0x7f07a4077370 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f0796a00640 1 -- 172.21.15.40:0/2039825904 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790005220 con 0x55c772426840 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f0796a00640 1 -- 172.21.15.40:0/2039825904 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0790004c30 con 0x55c772426840 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f0796a00640 1 -- 172.21.15.40:0/2039825904 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790010690 con 0x55c772426840 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.647+0000 7f07aa400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f078c0b3c80 0x7f078c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.648+0000 7f07b309e740 1 -- 172.21.15.40:0/2039825904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 msgr2=0x55c7727eca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.648+0000 7f07aa400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f078c0b3c80 0x7f078c0b6190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f079c009fd0 tx=0x7f079c00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.648+0000 7f07b309e740 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 0x55c7727eca60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f079000cbd0 tx=0x7f079000e720 comp rx=0 tx=0).stop 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 -- 172.21.15.40:0/2039825904 shutdown_connections 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772426840 0x55c7727eca60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77241e660 0x55c7727ec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 --2- 172.21.15.40:0/2039825904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772447520 0x55c7727ebfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 -- 172.21.15.40:0/2039825904 >> 172.21.15.40:0/2039825904 conn(0x55c77243b910 msgr2=0x55c7727e9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:48.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 -- 172.21.15.40:0/2039825904 shutdown_connections 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 -- 172.21.15.40:0/2039825904 wait complete. 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.649+0000 7f07b309e740 1 -- start start 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 Processor -- start 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c772803ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c7725b5bb0 con 0x55c772447520 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c7726ee930 con 0x55c77241e660 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.650+0000 7f07b309e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c7727fa7c0 con 0x55c772426840 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07b309e740 10 client.0 _ll_register_callbacks cb 0x55c77245ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c772803ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c772803ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44812/0 (socket says 172.21.15.40:44812) 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 -- 172.21.15.40:0/466260325 learned_addr learned my addr 172.21.15.40:0/466260325 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:48.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07a9a00640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07a9000640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 -- 172.21.15.40:0/466260325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 msgr2=0x55c7727f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 -- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 msgr2=0x55c7727f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.651+0000 7f07aa400640 1 -- 172.21.15.40:0/466260325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c772529960 con 0x55c772447520 2024-07-26T13:04:48.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.652+0000 7f07a9a00640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:04:48.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.652+0000 7f07aa400640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c772803ab0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f079c018e40 tx=0x7f079c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ddc69a6cbd35ca server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:48.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.652+0000 7f078b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:04:48.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.652+0000 7f078b400640 1 -- 172.21.15.40:0/466260325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c016d20 con 0x55c772447520 2024-07-26T13:04:48.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.652+0000 7f078b400640 1 -- 172.21.15.40:0/466260325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f079c018030 con 0x55c772447520 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.652+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0790004c30 con 0x55c772447520 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f078b400640 1 -- 172.21.15.40:0/466260325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f079c018230 con 0x55c772447520 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 10 client.17085 fetch_fsmap learned FSMap version 35 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c772806530 con 0x55c772447520 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f078b400640 1 -- 172.21.15.40:0/466260325 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0790004c30 con 0x55c772447520 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f078b400640 1 -- 172.21.15.40:0/466260325 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f079c016070 con 0x55c772447520 2024-07-26T13:04:48.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 10 client.17085 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:04:48.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 10 client.17085 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:04:48.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 20 client.17085 populate_metadata read hostname 'smithi040' 2024-07-26T13:04:48.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c772405ea0 0x55c772809a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 4 client.17085 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:04:48.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.653+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c772764ea0 con 0x55c772405ea0 2024-07-26T13:04:48.665 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:48 smithi040 ceph-mon[32397]: pgmap v1776: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:04:48.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.654+0000 7f07a9a00640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c772405ea0 0x55c772809a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.655+0000 7f07a9a00640 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c772405ea0 0x55c772809a50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d632ae7a59f28b1d server_cookie=300f509cbaae1755 in_seq=0 out_seq=0 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.655+0000 7f078b400640 10 client.17085 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f078b400640 1 -- 172.21.15.40:0/466260325 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c772764ea0 con 0x55c772405ea0 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f078b400640 10 client.17085 handle_command_reply: tid=0 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 client.17085 shutdown 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 msgr2=0x55c772803ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c772803ab0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f079c018e40 tx=0x7f079c004a40 comp rx=0 tx=0).stop 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 shutdown_connections 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c772405ea0 0x55c772809a50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c772803ab0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.657+0000 7f07b309e740 1 --2- 172.21.15.40:0/466260325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.658+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 >> 172.21.15.40:0/466260325 conn(0x55c77243b910 msgr2=0x55c7727ef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:48.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.658+0000 7f078b400640 0 client.17085 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:48.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.658+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 shutdown_connections 2024-07-26T13:04:48.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.658+0000 7f07b309e740 1 -- 172.21.15.40:0/466260325 wait complete. 2024-07-26T13:04:48.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.658+0000 7f07b309e740 20 client.17085 trim_cache size 0 max 16384 2024-07-26T13:04:48.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 Processor -- start 2024-07-26T13:04:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 -- start start 2024-07-26T13:04:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 0x55c7728038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772426840 0x55c772803de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772447520 0x55c7727f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41b53b0 con 0x55c77241e660 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41b6ef0 con 0x55c772426840 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.677+0000 7f07b309e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41b5a80 con 0x55c772447520 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 0x55c7728038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 0x55c7728038a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44828/0 (socket says 172.21.15.40:44828) 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 -- 172.21.15.40:0/728375124 learned_addr learned my addr 172.21.15.40:0/728375124 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07aa400640 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772447520 0x55c7727f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 -- 172.21.15.40:0/728375124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772447520 msgr2=0x55c7727f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772447520 0x55c7727f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 -- 172.21.15.40:0/728375124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772426840 msgr2=0x55c772803de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9000640 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772426840 0x55c772803de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772426840 0x55c772803de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.678+0000 7f07a9a00640 1 -- 172.21.15.40:0/728375124 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7727ee2d0 con 0x55c77241e660 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.679+0000 7f07a9a00640 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 0x55c7728038a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f07980c75f0 tx=0x7f07980d4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce272a41a1f5e46 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:48.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.679+0000 7f0796000640 1 -- 172.21.15.40:0/728375124 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798049040 con 0x55c77241e660 2024-07-26T13:04:48.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.679+0000 7f0796000640 1 -- 172.21.15.40:0/728375124 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07980cb570 con 0x55c77241e660 2024-07-26T13:04:48.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.679+0000 7f0796000640 1 -- 172.21.15.40:0/728375124 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798102230 con 0x55c77241e660 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 -- 172.21.15.40:0/728375124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 msgr2=0x55c7728038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 0x55c7728038a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f07980c75f0 tx=0x7f07980d4040 comp rx=0 tx=0).stop 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 -- 172.21.15.40:0/728375124 shutdown_connections 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772447520 0x55c7727f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c772426840 0x55c772803de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 --2- 172.21.15.40:0/728375124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77241e660 0x55c7728038a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 -- 172.21.15.40:0/728375124 >> 172.21.15.40:0/728375124 conn(0x55c77243b910 msgr2=0x55c7727f5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 -- 172.21.15.40:0/728375124 shutdown_connections 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.680+0000 7f07b309e740 1 -- 172.21.15.40:0/728375124 wait complete. 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.681+0000 7f07b309e740 1 -- start start 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.681+0000 7f07b309e740 1 Processor -- start 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.681+0000 7f07b309e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.681+0000 7f07b309e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07b309e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c7727fa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07b309e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41b6820 con 0x55c772447520 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07b309e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41b6150 con 0x55c77241e660 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07b309e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41b3370 con 0x55c772426840 2024-07-26T13:04:48.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07b309e740 10 client.0 _ll_register_callbacks cb 0x7f079c009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c7727fa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c7727fa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44842/0 (socket says 172.21.15.40:44842) 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 -- 172.21.15.40:0/1487806868 learned_addr learned my addr 172.21.15.40:0/1487806868 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07a9a00640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07a9000640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 -- 172.21.15.40:0/1487806868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 msgr2=0x55c7727fff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727fff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 -- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 msgr2=0x55c7727ffa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:04:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727ffa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.682+0000 7f07aa400640 1 -- 172.21.15.40:0/1487806868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7728006a0 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.683+0000 7f07aa400640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c7727fa9d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f079c018e40 tx=0x7f079c016ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7c2380160fd53a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.683+0000 7f078b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.683+0000 7f078b400640 1 -- 172.21.15.40:0/1487806868 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c032030 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.683+0000 7f078b400640 1 -- 172.21.15.40:0/1487806868 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f079c01e040 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.683+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07980cb570 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.683+0000 7f078b400640 1 -- 172.21.15.40:0/1487806868 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f079c02e910 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 10 client.17091 fetch_fsmap learned FSMap version 35 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c772872850 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f078b400640 1 -- 172.21.15.40:0/1487806868 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07980cb570 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f078b400640 1 -- 172.21.15.40:0/1487806868 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f079c016040 con 0x55c772447520 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 10 client.17091 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:04:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 10 client.17091 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 20 client.17091 populate_metadata read hostname 'smithi040' 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c7723db250 0x55c772874fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 4 client.17091 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6e844819", "release": true, "await": true}] 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.684+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6e844819", "release": true, "await": true}) -- 0x55c772760940 con 0x55c7723db250 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.685+0000 7f07a9a00640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c7723db250 0x55c772874fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.686+0000 7f07a9a00640 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c7723db250 0x55c772874fb0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4d868e2e459a7e server_cookie=b827d40d1d08bcd8 in_seq=0 out_seq=0 2024-07-26T13:04:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.686+0000 7f078b400640 10 client.17091 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.737+0000 7f078b400640 1 -- 172.21.15.40:0/1487806868 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55c772760940 con 0x55c7723db250 2024-07-26T13:04:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.737+0000 7f078b400640 10 client.17091 handle_command_reply: tid=0 2024-07-26T13:04:48.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.737+0000 7f07b309e740 1 client.17091 shutdown 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 msgr2=0x55c7727fa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c7727fa9d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f079c018e40 tx=0x7f079c016ea0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 shutdown_connections 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c7723db250 0x55c772874fb0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c772447520 0x55c7727fa9d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c772426840 0x55c7727fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 --2- 172.21.15.40:0/1487806868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77241e660 0x55c7727ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 >> 172.21.15.40:0/1487806868 conn(0x55c77243b910 msgr2=0x55c7727f68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.738+0000 7f078b400640 0 client.17091 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:04:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.739+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 shutdown_connections 2024-07-26T13:04:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.739+0000 7f07b309e740 1 -- 172.21.15.40:0/1487806868 wait complete. 2024-07-26T13:04:48.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.739+0000 7f07b309e740 20 client.17091 trim_cache size 0 max 16384 2024-07-26T13:04:48.742 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:04:48.742 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:04:48.742 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 136, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "6e844819": { 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 136, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.8, 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:04:48.743 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:04:48.744 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f078c0b3c80 msgr2=0x7f078c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f078c0b3c80 0x7f078c0b6190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f079c009fd0 tx=0x7f079c00e040 comp rx=0 tx=0).stop 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 msgr2=0x7f07a41a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a41a0510 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f079802a930 tx=0x7f0798003d60 comp rx=0 tx=0).stop 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 shutdown_connections 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f07a41141a0 0x7f07a41a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f078c0b3c80 0x7f078c0b6190 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a4077cc0 0x7f07a41a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 --2- 172.21.15.40:0/1289527163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a4077370 0x7f07a41a0510 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.740+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 >> 172.21.15.40:0/1289527163 conn(0x7f07a41011f0 msgr2=0x7f07a4103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.741+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 shutdown_connections 2024-07-26T13:04:48.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:04:48.741+0000 7f07ac400640 1 -- 172.21.15.40:0/1289527163 wait complete. 2024-07-26T13:04:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:48 smithi146 ceph-mon[35807]: pgmap v1776: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:04:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:48 smithi076 ceph-mon[35401]: pgmap v1776: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:04:49.692 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6e844819', total seconds elapsed: 18.5 2024-07-26T13:04:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:50 smithi146 ceph-mon[35807]: pgmap v1777: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-07-26T13:04:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:50 smithi076 ceph-mon[35401]: pgmap v1777: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-07-26T13:04:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:50 smithi040 ceph-mon[32397]: pgmap v1777: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 13 op/s 2024-07-26T13:04:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:52 smithi146 ceph-mon[35807]: pgmap v1778: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 MiB/s wr, 9 op/s 2024-07-26T13:04:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:52 smithi076 ceph-mon[35401]: pgmap v1778: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 MiB/s wr, 9 op/s 2024-07-26T13:04:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:52 smithi040 ceph-mon[32397]: pgmap v1778: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 MiB/s wr, 9 op/s 2024-07-26T13:04:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:54 smithi076 ceph-mon[35401]: pgmap v1779: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-07-26T13:04:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:54 smithi040 ceph-mon[32397]: pgmap v1779: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-07-26T13:04:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:54 smithi146 ceph-mon[35807]: pgmap v1779: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-07-26T13:04:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:56 smithi076 ceph-mon[35401]: pgmap v1780: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T13:04:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:56 smithi040 ceph-mon[32397]: pgmap v1780: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T13:04:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:56 smithi146 ceph-mon[35807]: pgmap v1780: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T13:04:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:04:58 smithi040 ceph-mon[32397]: pgmap v1781: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:04:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:04:58 smithi146 ceph-mon[35807]: pgmap v1781: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:04:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:04:58 smithi076 ceph-mon[35401]: pgmap v1781: 97 pgs: 97 active+clean; 7.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:05:00.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:00 smithi146 ceph-mon[35807]: pgmap v1782: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-07-26T13:05:00.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:00 smithi076 ceph-mon[35401]: pgmap v1782: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-07-26T13:05:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:00 smithi040 ceph-mon[32397]: pgmap v1782: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.0 MiB/s wr, 14 op/s 2024-07-26T13:05:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:02 smithi040 ceph-mon[32397]: pgmap v1783: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:05:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:02 smithi146 ceph-mon[35807]: pgmap v1783: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:05:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:02 smithi076 ceph-mon[35401]: pgmap v1783: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:05:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:04 smithi040 ceph-mon[32397]: pgmap v1784: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:05:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:04 smithi146 ceph-mon[35807]: pgmap v1784: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:05:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:04 smithi076 ceph-mon[35401]: pgmap v1784: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:05:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:06 smithi040 ceph-mon[32397]: pgmap v1785: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:05:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:06 smithi146 ceph-mon[35807]: pgmap v1785: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:05:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:06 smithi076 ceph-mon[35401]: pgmap v1785: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:05:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:08 smithi040 ceph-mon[32397]: pgmap v1786: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T13:05:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:08 smithi146 ceph-mon[35807]: pgmap v1786: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T13:05:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:08 smithi076 ceph-mon[35401]: pgmap v1786: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T13:05:09.750 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-26T13:05:09.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:05:10.261 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:05:10.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:10 smithi040 ceph-mon[32397]: pgmap v1787: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:05:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:10 smithi146 ceph-mon[35807]: pgmap v1787: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:05:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:10 smithi076 ceph-mon[35401]: pgmap v1787: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:05:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 -- 172.21.15.40:0/2174189425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded810ddd0 msgr2=0x7fded810e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 --2- 172.21.15.40:0/2174189425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded810ddd0 0x7fded810e1e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009900 tx=0x7fdecc02a3f0 comp rx=0 tx=0).stop 2024-07-26T13:05:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 -- 172.21.15.40:0/2174189425 shutdown_connections 2024-07-26T13:05:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 --2- 172.21.15.40:0/2174189425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8114060 0x7fded811a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 --2- 172.21.15.40:0/2174189425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fded8113710 0x7fded8113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 --2- 172.21.15.40:0/2174189425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded810ddd0 0x7fded810e1e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 -- 172.21.15.40:0/2174189425 >> 172.21.15.40:0/2174189425 conn(0x7fded806e4c0 msgr2=0x7fded810be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 -- 172.21.15.40:0/2174189425 shutdown_connections 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.735+0000 7fdede000640 1 -- 172.21.15.40:0/2174189425 wait complete. 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.737+0000 7fdede000640 1 Processor -- start 2024-07-26T13:05:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.737+0000 7fdede000640 1 -- start start 2024-07-26T13:05:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdede000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fded810ddd0 0x7fded81a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdede000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8113710 0x7fded81a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdede000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 0x7fded81a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdede000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fded811dc20 con 0x7fded8114060 2024-07-26T13:05:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdede000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fded811daa0 con 0x7fded810ddd0 2024-07-26T13:05:12.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdede000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fded811dda0 con 0x7fded8113710 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdedd600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 0x7fded81a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdedd600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 0x7fded81a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45872/0 (socket says 172.21.15.40:45872) 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdedd600640 1 -- 172.21.15.40:0/884085787 learned_addr learned my addr 172.21.15.40:0/884085787 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.738+0000 7fdedcc00640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fded810ddd0 0x7fded81a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fded7e00640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8113710 0x7fded81a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fdedd600640 1 -- 172.21.15.40:0/884085787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8113710 msgr2=0x7fded81a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fdedd600640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8113710 0x7fded81a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fdedd600640 1 -- 172.21.15.40:0/884085787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fded810ddd0 msgr2=0x7fded81a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fdedd600640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fded810ddd0 0x7fded81a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:12.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fdedd600640 1 -- 172.21.15.40:0/884085787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded81aa6a0 con 0x7fded8114060 2024-07-26T13:05:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.739+0000 7fded7e00640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8113710 0x7fded81a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.740+0000 7fdedd600640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 0x7fded81a9f70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fded000eaa0 tx=0x7fded000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.740+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded000cdb0 con 0x7fded8114060 2024-07-26T13:05:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.740+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fded0005020 con 0x7fded8114060 2024-07-26T13:05:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.740+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00116d0 con 0x7fded8114060 2024-07-26T13:05:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.740+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded81aa990 con 0x7fded8114060 2024-07-26T13:05:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.740+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded81b10f0 con 0x7fded8114060 2024-07-26T13:05:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.742+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded810e1e0 con 0x7fded8114060 2024-07-26T13:05:12.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.746+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fded00051d0 con 0x7fded8114060 2024-07-26T13:05:12.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.748+0000 7fded5600640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdec00b3bd0 0x7fdec00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:12.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.748+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fded00e4120 con 0x7fded8114060 2024-07-26T13:05:12.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.748+0000 7fdedcc00640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdec00b3bd0 0x7fdec00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:12.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.749+0000 7fdedcc00640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdec00b3bd0 0x7fdec00b60e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006010 tx=0x7fdecc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:12.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:12.750+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fded0016030 con 0x7fded8114060 2024-07-26T13:05:12.814 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:12 smithi040 ceph-mon[32397]: pgmap v1788: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:05:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.052+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fded81a5860 con 0x7fded8114060 2024-07-26T13:05:13.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.054+0000 7fded5600640 1 -- 172.21.15.40:0/884085787 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fded81a5860 con 0x7fded8114060 2024-07-26T13:05:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:05:13.055 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:05:13.056 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:05:13.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.057+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdec00b3bd0 msgr2=0x7fdec00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:13.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.057+0000 7fdede000640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdec00b3bd0 0x7fdec00b60e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006010 tx=0x7fdecc000bc0 comp rx=0 tx=0).stop 2024-07-26T13:05:13.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.057+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 msgr2=0x7fded81a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:13.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.057+0000 7fdede000640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 0x7fded81a9f70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fded000eaa0 tx=0x7fded000ef60 comp rx=0 tx=0).stop 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 shutdown_connections 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded8114060 0x7fded81a9f70 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdec00b3bd0 0x7fdec00b60e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded8113710 0x7fded81a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 --2- 172.21.15.40:0/884085787 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fded810ddd0 0x7fded81a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 >> 172.21.15.40:0/884085787 conn(0x7fded806e4c0 msgr2=0x7fded8112e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 shutdown_connections 2024-07-26T13:05:13.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:13.058+0000 7fdede000640 1 -- 172.21.15.40:0/884085787 wait complete. 2024-07-26T13:05:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:12 smithi146 ceph-mon[35807]: pgmap v1788: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:05:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:12 smithi076 ceph-mon[35401]: pgmap v1788: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:05:13.980 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:13 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/884085787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:14.042 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-26T13:05:14.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-26T13:05:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:13 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/884085787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:13 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/884085787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:05:14.951 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:14 smithi040 ceph-mon[32397]: pgmap v1789: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:05:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:14 smithi146 ceph-mon[35807]: pgmap v1789: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:05:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:14 smithi076 ceph-mon[35401]: pgmap v1789: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:05:16.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:16 smithi040 ceph-mon[32397]: pgmap v1790: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 -- 172.21.15.40:0/2673570822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f159410fca0 msgr2=0x7f15941164d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 --2- 172.21.15.40:0/2673570822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f159410fca0 0x7f15941164d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ca0 tx=0x7f158c02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 -- 172.21.15.40:0/2673570822 shutdown_connections 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 --2- 172.21.15.40:0/2673570822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f159410fca0 0x7f15941164d0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 --2- 172.21.15.40:0/2673570822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410f350 0x7f159410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 --2- 172.21.15.40:0/2673570822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1594109a60 0x7f1594109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 -- 172.21.15.40:0/2673570822 >> 172.21.15.40:0/2673570822 conn(0x7f1594079100 msgr2=0x7f1594107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:16.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 -- 172.21.15.40:0/2673570822 shutdown_connections 2024-07-26T13:05:16.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.882+0000 7f1599600640 1 -- 172.21.15.40:0/2673570822 wait complete. 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.884+0000 7f1599600640 1 Processor -- start 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.884+0000 7f1599600640 1 -- start start 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1599600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 0x7f15941a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1599600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f159410f350 0x7f15941a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1599600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410fca0 0x7f15941a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1599600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1594119810 con 0x7f1594109a60 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1599600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1594119690 con 0x7f159410f350 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1599600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1594119990 con 0x7f159410fca0 2024-07-26T13:05:16.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1593e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 0x7f15941a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1593e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 0x7f15941a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48924/0 (socket says 172.21.15.40:48924) 2024-07-26T13:05:16.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1593e00640 1 -- 172.21.15.40:0/1792972532 learned_addr learned my addr 172.21.15.40:0/1792972532 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:16.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1593400640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f159410f350 0x7f15941a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.885+0000 7f1598c00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410fca0 0x7f15941a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1593e00640 1 -- 172.21.15.40:0/1792972532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410fca0 msgr2=0x7f15941a59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1593e00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410fca0 0x7f15941a59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1593e00640 1 -- 172.21.15.40:0/1792972532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f159410f350 msgr2=0x7f15941a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1593e00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f159410f350 0x7f15941a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1593e00640 1 -- 172.21.15.40:0/1792972532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15941a60d0 con 0x7f1594109a60 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1598c00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410fca0 0x7f15941a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.886+0000 7f1593e00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 0x7f15941a0160 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f158400d950 tx=0x7f158400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.887+0000 7f1590c00640 1 -- 172.21.15.40:0/1792972532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584017070 con 0x7f1594109a60 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.887+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15941a63c0 con 0x7f1594109a60 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.887+0000 7f1590c00640 1 -- 172.21.15.40:0/1792972532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1584009c30 con 0x7f1594109a60 2024-07-26T13:05:16.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.887+0000 7f1590c00640 1 -- 172.21.15.40:0/1792972532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158400f620 con 0x7f1594109a60 2024-07-26T13:05:16.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.887+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15941acb20 con 0x7f1594109a60 2024-07-26T13:05:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.891+0000 7f1590c00640 1 -- 172.21.15.40:0/1792972532 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1584010460 con 0x7f1594109a60 2024-07-26T13:05:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.891+0000 7f15a1804740 1 Processor -- start 2024-07-26T13:05:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 -- start start 2024-07-26T13:05:16.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 0x565000f853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bb6980 0x565000f858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bbeb60 0x565000f85e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x565000f4fd10 con 0x565000bdf840 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x565000efab60 con 0x565000bb6980 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.892+0000 7f15a1804740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x565000eea060 con 0x565000bbeb60 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 0x565000f853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 0x565000f853b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48940/0 (socket says 172.21.15.40:48940) 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 -- 172.21.15.40:0/1030715446 learned_addr learned my addr 172.21.15.40:0/1030715446 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1593e00640 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bb6980 0x565000f858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1593400640 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bbeb60 0x565000f85e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 -- 172.21.15.40:0/1030715446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bbeb60 msgr2=0x565000f85e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bbeb60 0x565000f85e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 -- 172.21.15.40:0/1030715446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bb6980 msgr2=0x565000f858f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bb6980 0x565000f858f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1590c00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15780b3bc0 0x7f15780b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1598c00640 1 -- 172.21.15.40:0/1030715446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565000e71b10 con 0x565000bdf840 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.893+0000 7f1593e00640 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bb6980 0x565000f858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.894+0000 7f1590c00640 1 -- 172.21.15.40:0/1792972532 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15840e3850 con 0x7f1594109a60 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.894+0000 7f1598c00640 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 0x565000f853b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f158c0094e0 tx=0x7f158c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ba045f16029df2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.894+0000 7f1598c00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15780b3bc0 0x7f15780b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.895+0000 7f1589200640 1 -- 172.21.15.40:0/1030715446 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c04a040 con 0x565000bdf840 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.895+0000 7f1589200640 1 -- 172.21.15.40:0/1030715446 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f158c036040 con 0x565000bdf840 2024-07-26T13:05:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.895+0000 7f1589200640 1 -- 172.21.15.40:0/1030715446 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c004840 con 0x565000bdf840 2024-07-26T13:05:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 -- 172.21.15.40:0/1030715446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 msgr2=0x565000f853b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f1598c00640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15780b3bc0 0x7f15780b60d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f158c031920 tx=0x7f158c030680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 0x565000f853b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f158c0094e0 tx=0x7f158c009a20 comp rx=0 tx=0).stop 2024-07-26T13:05:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 -- 172.21.15.40:0/1030715446 shutdown_connections 2024-07-26T13:05:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bbeb60 0x565000f85e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bb6980 0x565000f858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 --2- 172.21.15.40:0/1030715446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bdf840 0x565000f853b0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 -- 172.21.15.40:0/1030715446 >> 172.21.15.40:0/1030715446 conn(0x565000bd3990 msgr2=0x565000f832a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:16.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 -- 172.21.15.40:0/1030715446 shutdown_connections 2024-07-26T13:05:16.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.896+0000 7f15a1804740 1 -- 172.21.15.40:0/1030715446 wait complete. 2024-07-26T13:05:16.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.897+0000 7f15a1804740 1 -- start start 2024-07-26T13:05:16.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.897+0000 7f15a1804740 1 Processor -- start 2024-07-26T13:05:16.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f90eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f9cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x565000e86520 con 0x565000bb6980 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x565000eee0a0 con 0x565000bbeb60 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x565000d4d7a0 con 0x565000bdf840 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f15a1804740 10 client.0 _ll_register_callbacks cb 0x565000ee2bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f1593e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f90eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f1593e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f90eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48954/0 (socket says 172.21.15.40:48954) 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.898+0000 7f1593e00640 1 -- 172.21.15.40:0/188447836 learned_addr learned my addr 172.21.15.40:0/188447836 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593400640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1598c00640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f9cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593e00640 1 -- 172.21.15.40:0/188447836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 msgr2=0x565000f9cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593e00640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f9cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593e00640 1 -- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 msgr2=0x565000f913f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593e00640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f913f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593e00640 1 -- 172.21.15.40:0/188447836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565000c59b90 con 0x565000bb6980 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f1593e00640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f90eb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f15840a67e0 tx=0x7f15840b3150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36712591a32a488 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.899+0000 7f157d600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f157d600640 1 -- 172.21.15.40:0/188447836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584020070 con 0x565000bb6980 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f157d600640 1 -- 172.21.15.40:0/188447836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15840cd0e0 con 0x565000bb6980 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f158c036040 con 0x565000bb6980 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f157d600640 1 -- 172.21.15.40:0/188447836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f15840cd2e0 con 0x565000bb6980 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f15a1804740 10 client.17109 fetch_fsmap learned FSMap version 35 2024-07-26T13:05:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x565000f9f930 con 0x565000bb6980 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.900+0000 7f157d600640 1 -- 172.21.15.40:0/188447836 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f158c036040 con 0x565000bb6980 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f157d600640 1 -- 172.21.15.40:0/188447836 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f15840a6160 con 0x565000bb6980 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f15a1804740 10 client.17109 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f15a1804740 10 client.17109 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f15a1804740 20 client.17109 populate_metadata read hostname 'smithi040' 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f15a1804740 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b9e1c0 0x565000fa2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f15a1804740 4 client.17109 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.901+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565000efcab0 con 0x565000b9e1c0 2024-07-26T13:05:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.902+0000 7f1593400640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b9e1c0 0x565000fa2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.903+0000 7f1593400640 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b9e1c0 0x565000fa2d20 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c5e5971db1fc19 server_cookie=5f8b4f12e7bcfd18 in_seq=0 out_seq=0 2024-07-26T13:05:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.903+0000 7f157d600640 10 client.17109 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f157d600640 1 -- 172.21.15.40:0/188447836 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565000efcab0 con 0x565000b9e1c0 2024-07-26T13:05:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f157d600640 10 client.17109 handle_command_reply: tid=0 2024-07-26T13:05:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 client.17109 shutdown 2024-07-26T13:05:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 msgr2=0x565000f90eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f90eb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f15840a67e0 tx=0x7f15840b3150 comp rx=0 tx=0).stop 2024-07-26T13:05:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 shutdown_connections 2024-07-26T13:05:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f9cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b9e1c0 0x565000fa2d20 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 --2- 172.21.15.40:0/188447836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f90eb0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 >> 172.21.15.40:0/188447836 conn(0x565000bd3990 msgr2=0x565000f88590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f157d600640 0 client.17109 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.905+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 shutdown_connections 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.906+0000 7f15a1804740 1 -- 172.21.15.40:0/188447836 wait complete. 2024-07-26T13:05:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.906+0000 7f15a1804740 20 client.17109 trim_cache size 0 max 16384 2024-07-26T13:05:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.932+0000 7f15a1804740 1 Processor -- start 2024-07-26T13:05:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.932+0000 7f15a1804740 1 -- start start 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.932+0000 7f15a1804740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bb6980 0x565000f92b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.932+0000 7f15a1804740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 0x565000f9caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f15a1804740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bdf840 0x565000f9d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f15a1804740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b5200 con 0x565000bbeb60 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f15a1804740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b6d40 con 0x565000bdf840 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f15a1804740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b58d0 con 0x565000bb6980 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1593400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 0x565000f9caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1593400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 0x565000f9caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48956/0 (socket says 172.21.15.40:48956) 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1593400640 1 -- 172.21.15.40:0/2848693190 learned_addr learned my addr 172.21.15.40:0/2848693190 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1593e00640 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bb6980 0x565000f92b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1598c00640 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bdf840 0x565000f9d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1593400640 1 -- 172.21.15.40:0/2848693190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bb6980 msgr2=0x565000f92b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.933+0000 7f1593400640 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bb6980 0x565000f92b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f1593400640 1 -- 172.21.15.40:0/2848693190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bdf840 msgr2=0x565000f9d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f1593400640 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bdf840 0x565000f9d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f1593400640 1 -- 172.21.15.40:0/2848693190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565000f861f0 con 0x565000bbeb60 2024-07-26T13:05:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f1593400640 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 0x565000f9caf0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f158000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181ead6b2b9c7df8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f157fe00640 1 -- 172.21.15.40:0/2848693190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580026440 con 0x565000bbeb60 2024-07-26T13:05:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f157fe00640 1 -- 172.21.15.40:0/2848693190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1580026a70 con 0x565000bbeb60 2024-07-26T13:05:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.934+0000 7f157fe00640 1 -- 172.21.15.40:0/2848693190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580011a10 con 0x565000bbeb60 2024-07-26T13:05:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.935+0000 7f15a1804740 1 -- 172.21.15.40:0/2848693190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 msgr2=0x565000f9caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.935+0000 7f15a1804740 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 0x565000f9caf0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f158000b390 comp rx=0 tx=0).stop 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.935+0000 7f15a1804740 1 -- 172.21.15.40:0/2848693190 shutdown_connections 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bdf840 0x565000f9d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bbeb60 0x565000f9caf0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 --2- 172.21.15.40:0/2848693190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bb6980 0x565000f92b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 -- 172.21.15.40:0/2848693190 >> 172.21.15.40:0/2848693190 conn(0x565000bd3990 msgr2=0x565000f884b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 -- 172.21.15.40:0/2848693190 shutdown_connections 2024-07-26T13:05:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 -- 172.21.15.40:0/2848693190 wait complete. 2024-07-26T13:05:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 -- start start 2024-07-26T13:05:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.936+0000 7f15a1804740 1 Processor -- start 2024-07-26T13:05:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f94c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f95170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b6670 con 0x565000bb6980 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b5fa0 con 0x565000bbeb60 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b31c0 con 0x565000bdf840 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.937+0000 7f15a1804740 10 client.0 _ll_register_callbacks cb 0x7f158400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f94c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f94c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48970/0 (socket says 172.21.15.40:48970) 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 -- 172.21.15.40:0/1015454766 learned_addr learned my addr 172.21.15.40:0/1015454766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593400640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f95170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1598c00640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 -- 172.21.15.40:0/1015454766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 msgr2=0x565000f956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 -- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 msgr2=0x565000f95170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f95170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.938+0000 7f1593e00640 1 -- 172.21.15.40:0/1015454766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500100a5b0 con 0x565000bb6980 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.939+0000 7f1593e00640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f94c30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f15840aa6f0 tx=0x7f15840e3ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ad67aeb43203b8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.939+0000 7f157d600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.939+0000 7f157d600640 1 -- 172.21.15.40:0/1015454766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584020070 con 0x565000bb6980 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.939+0000 7f157d600640 1 -- 172.21.15.40:0/1015454766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15840e9070 con 0x565000bb6980 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.939+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1580026a70 con 0x565000bb6980 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.939+0000 7f157d600640 1 -- 172.21.15.40:0/1015454766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f15840aa0b0 con 0x565000bb6980 2024-07-26T13:05:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 10 client.17115 fetch_fsmap learned FSMap version 35 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56500100b810 con 0x565000bb6980 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f157d600640 1 -- 172.21.15.40:0/1015454766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1580026a70 con 0x565000bb6980 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f157d600640 1 -- 172.21.15.40:0/1015454766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f15840c7050 con 0x565000bb6980 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 10 client.17115 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 10 client.17115 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 20 client.17115 populate_metadata read hostname 'smithi040' 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b73570 0x56500100de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 4 client.17115 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-26T13:05:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.940+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x565000ef8550 con 0x565000b73570 2024-07-26T13:05:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.941+0000 7f1593400640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b73570 0x56500100de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.942+0000 7f1593400640 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b73570 0x56500100de90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7574f49ecf9ae1 server_cookie=43249fb72655b28 in_seq=0 out_seq=0 2024-07-26T13:05:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:16.942+0000 7f157d600640 10 client.17115 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:16 smithi146 ceph-mon[35807]: pgmap v1790: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:05:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:16 smithi076 ceph-mon[35401]: pgmap v1790: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:05:17.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.201+0000 7f157d600640 1 -- 172.21.15.40:0/1015454766 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x565000ef8550 con 0x565000b73570 2024-07-26T13:05:17.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.201+0000 7f157d600640 10 client.17115 handle_command_reply: tid=0 2024-07-26T13:05:17.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.202+0000 7f15a1804740 1 client.17115 shutdown 2024-07-26T13:05:17.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.202+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 msgr2=0x565000f94c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:17.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.202+0000 7f15a1804740 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f94c30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f15840aa6f0 tx=0x7f15840e3ad0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 shutdown_connections 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565000bdf840 0x565000f956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565000bbeb60 0x565000f95170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x565000b73570 0x56500100de90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 --2- 172.21.15.40:0/1015454766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x565000bb6980 0x565000f94c30 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 >> 172.21.15.40:0/1015454766 conn(0x565000bd3990 msgr2=0x565000f884b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:17.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f157d600640 0 client.17115 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.203+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 shutdown_connections 2024-07-26T13:05:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.204+0000 7f15a1804740 1 -- 172.21.15.40:0/1015454766 wait complete. 2024-07-26T13:05:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.204+0000 7f15a1804740 20 client.17115 trim_cache size 0 max 16384 2024-07-26T13:05:17.205 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:05:17.205 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:05:17.205 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 138, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "f905d920": { 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 138, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:05:17.206 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:17.207 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.205+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15780b3bc0 msgr2=0x7f15780b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.205+0000 7f1599600640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15780b3bc0 0x7f15780b60d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f158c031920 tx=0x7f158c030680 comp rx=0 tx=0).stop 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.205+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 msgr2=0x7f15941a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.205+0000 7f1599600640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 0x7f15941a0160 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f158400d950 tx=0x7f158400de10 comp rx=0 tx=0).stop 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 shutdown_connections 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15780b3bc0 0x7f15780b60d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f159410fca0 0x7f15941a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f159410f350 0x7f15941a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 --2- 172.21.15.40:0/1792972532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1594109a60 0x7f15941a0160 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 >> 172.21.15.40:0/1792972532 conn(0x7f1594079100 msgr2=0x7f1594107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 shutdown_connections 2024-07-26T13:05:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:17.206+0000 7f1599600640 1 -- 172.21.15.40:0/1792972532 wait complete. 2024-07-26T13:05:18.034 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f905d920', quiesce took 8.3 seconds. Will release after: 1.6999999999999993 2024-07-26T13:05:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:18 smithi040 ceph-mon[32397]: pgmap v1791: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:05:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:18 smithi146 ceph-mon[35807]: pgmap v1791: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:05:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:18 smithi076 ceph-mon[35401]: pgmap v1791: 97 pgs: 97 active+clean; 7.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:05:19.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:05:20.249 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:05:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:20 smithi040 ceph-mon[32397]: pgmap v1792: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:05:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:20 smithi146 ceph-mon[35807]: pgmap v1792: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:05:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:20 smithi076 ceph-mon[35401]: pgmap v1792: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:05:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 -- 172.21.15.40:0/890219003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c103590 msgr2=0x7f538c1039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 --2- 172.21.15.40:0/890219003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c103590 0x7f538c1039a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5384009900 tx=0x7f538402a410 comp rx=0 tx=0).stop 2024-07-26T13:05:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 -- 172.21.15.40:0/890219003 shutdown_connections 2024-07-26T13:05:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 --2- 172.21.15.40:0/890219003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f538c109820 0x7f538c110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 --2- 172.21.15.40:0/890219003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f538c108ed0 0x7f538c1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 --2- 172.21.15.40:0/890219003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c103590 0x7f538c1039a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 -- 172.21.15.40:0/890219003 >> 172.21.15.40:0/890219003 conn(0x7f538c07b280 msgr2=0x7f538c07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 -- 172.21.15.40:0/890219003 shutdown_connections 2024-07-26T13:05:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.396+0000 7f5390e00640 1 -- 172.21.15.40:0/890219003 wait complete. 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.398+0000 7f5390e00640 1 Processor -- start 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.398+0000 7f5390e00640 1 -- start start 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5390e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f538c103590 0x7f538c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5390e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 0x7f538c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5390e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f538c109820 0x7f538c1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5390e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1133d0 con 0x7f538c108ed0 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5390e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f538c113250 con 0x7f538c109820 2024-07-26T13:05:22.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5390e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f538c113550 con 0x7f538c103590 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5389400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 0x7f538c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5389400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 0x7f538c19c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48990/0 (socket says 172.21.15.40:48990) 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f5389400640 1 -- 172.21.15.40:0/2259849275 learned_addr learned my addr 172.21.15.40:0/2259849275 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.399+0000 7f538a800640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f538c109820 0x7f538c1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.400+0000 7f5389e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f538c103590 0x7f538c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.400+0000 7f5389400640 1 -- 172.21.15.40:0/2259849275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f538c103590 msgr2=0x7f538c19c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.400+0000 7f5389400640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f538c103590 0x7f538c19c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.400+0000 7f5389400640 1 -- 172.21.15.40:0/2259849275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f538c109820 msgr2=0x7f538c1a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.400+0000 7f5389400640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f538c109820 0x7f538c1a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.400+0000 7f5389400640 1 -- 172.21.15.40:0/2259849275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c1a1fb0 con 0x7f538c108ed0 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.401+0000 7f5389400640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 0x7f538c19c5e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f537400db20 tx=0x7f537400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.401+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374017070 con 0x7f538c108ed0 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.401+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5374003e00 con 0x7f538c108ed0 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.401+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c1a22a0 con 0x7f538c108ed0 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.401+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374010460 con 0x7f538c108ed0 2024-07-26T13:05:22.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.401+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c1a8a00 con 0x7f538c108ed0 2024-07-26T13:05:22.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.403+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c1039a0 con 0x7f538c108ed0 2024-07-26T13:05:22.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.406+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5374004140 con 0x7f538c108ed0 2024-07-26T13:05:22.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.407+0000 7f5382a00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53700b3c50 0x7f53700b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:22.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.408+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f53740e3ce0 con 0x7f538c108ed0 2024-07-26T13:05:22.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.408+0000 7f5389e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53700b3c50 0x7f53700b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.409+0000 7f5389e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53700b3c50 0x7f53700b6160 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5384006010 tx=0x7f5384000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:22.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.409+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f53740aad20 con 0x7f538c108ed0 2024-07-26T13:05:22.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.659+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f538c19d170 con 0x7f538c108ed0 2024-07-26T13:05:22.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.661+0000 7f5382a00640 1 -- 172.21.15.40:0/2259849275 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f53740af270 con 0x7f538c108ed0 2024-07-26T13:05:22.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:05:22.703 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53700b3c50 msgr2=0x7f53700b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53700b3c50 0x7f53700b6160 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5384006010 tx=0x7f5384000bc0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 msgr2=0x7f538c19c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 0x7f538c19c5e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f537400db20 tx=0x7f537400b260 comp rx=0 tx=0).stop 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 shutdown_connections 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f538c109820 0x7f538c1a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538c108ed0 0x7f538c19c5e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f53700b3c50 0x7f53700b6160 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 --2- 172.21.15.40:0/2259849275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f538c103590 0x7f538c19c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.664+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 >> 172.21.15.40:0/2259849275 conn(0x7f538c07b280 msgr2=0x7f538c106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.665+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 shutdown_connections 2024-07-26T13:05:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:22.665+0000 7f5390e00640 1 -- 172.21.15.40:0/2259849275 wait complete. 2024-07-26T13:05:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:22 smithi040 ceph-mon[32397]: pgmap v1793: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:05:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:22 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2259849275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:22 smithi146 ceph-mon[35807]: pgmap v1793: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:05:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:22 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2259849275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:22 smithi076 ceph-mon[35401]: pgmap v1793: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:05:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:22 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2259849275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:23.503 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id f905d920 --release --await' 2024-07-26T13:05:23.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id f905d920 --release --await 2024-07-26T13:05:24.004 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:05:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:24 smithi040 ceph-mon[32397]: pgmap v1794: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:05:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:05:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:24 smithi146 ceph-mon[35807]: pgmap v1794: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:05:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:05:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:24 smithi076 ceph-mon[35401]: pgmap v1794: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:05:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:05:25.822 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:05:25.823 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:05:25.823 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:05:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:05:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:05:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:05:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:05:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:05:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:05:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 -- 172.21.15.40:0/3238570389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b810af10 msgr2=0x7f85b810b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 --2- 172.21.15.40:0/3238570389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b810af10 0x7f85b810b320 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009900 tx=0x7f85a402a410 comp rx=0 tx=0).stop 2024-07-26T13:05:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 -- 172.21.15.40:0/3238570389 shutdown_connections 2024-07-26T13:05:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 --2- 172.21.15.40:0/3238570389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b810b860 0x7f85b8112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 --2- 172.21.15.40:0/3238570389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b810af10 0x7f85b810b320 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 --2- 172.21.15.40:0/3238570389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b81055d0 0x7f85b81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 -- 172.21.15.40:0/3238570389 >> 172.21.15.40:0/3238570389 conn(0x7f85b8101040 msgr2=0x7f85b8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 -- 172.21.15.40:0/3238570389 shutdown_connections 2024-07-26T13:05:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.194+0000 7f85bec00640 1 -- 172.21.15.40:0/3238570389 wait complete. 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.195+0000 7f85bec00640 1 Processor -- start 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 -- start start 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 0x7f85b819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b810af10 0x7f85b819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b810b860 0x7f85b81a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81153d0 con 0x7f85b81055d0 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8115250 con 0x7f85b810b860 2024-07-26T13:05:26.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.196+0000 7f85bec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8115550 con 0x7f85b810af10 2024-07-26T13:05:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 0x7f85b819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 0x7f85b819be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39318/0 (socket says 172.21.15.40:39318) 2024-07-26T13:05:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 -- 172.21.15.40:0/1450809612 learned_addr learned my addr 172.21.15.40:0/1450809612 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bce00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b810af10 0x7f85b819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85be200640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b810b860 0x7f85b81a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 -- 172.21.15.40:0/1450809612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b810af10 msgr2=0x7f85b819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b810af10 0x7f85b819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 -- 172.21.15.40:0/1450809612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b810b860 msgr2=0x7f85b81a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b810b860 0x7f85b81a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85bd800640 1 -- 172.21.15.40:0/1450809612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b81a1d30 con 0x7f85b81055d0 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.197+0000 7f85be200640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b810b860 0x7f85b81a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.198+0000 7f85bd800640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 0x7f85b819be80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c920 tx=0x7f85ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.198+0000 7f85b6000640 1 -- 172.21.15.40:0/1450809612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac007c70 con 0x7f85b81055d0 2024-07-26T13:05:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.198+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b81a2020 con 0x7f85b81055d0 2024-07-26T13:05:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.198+0000 7f85b6000640 1 -- 172.21.15.40:0/1450809612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85ac007e10 con 0x7f85b81055d0 2024-07-26T13:05:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.198+0000 7f85b6000640 1 -- 172.21.15.40:0/1450809612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac018710 con 0x7f85b81055d0 2024-07-26T13:05:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.198+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b81a8840 con 0x7f85b81055d0 2024-07-26T13:05:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.202+0000 7f85c6b22740 1 Processor -- start 2024-07-26T13:05:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 -- start start 2024-07-26T13:05:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85b6000640 1 -- 172.21.15.40:0/1450809612 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f85ac00f450 con 0x7f85b81055d0 2024-07-26T13:05:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489d7520 0x561748d7c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 0x561748d7c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489b6840 0x561748d7cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561748cf2f30 con 0x5617489ae660 2024-07-26T13:05:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561748ce2430 con 0x5617489b6840 2024-07-26T13:05:26.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.203+0000 7f85c6b22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561748ce6470 con 0x5617489d7520 2024-07-26T13:05:26.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 0x561748d7c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 0x561748d7c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39324/0 (socket says 172.21.15.40:39324) 2024-07-26T13:05:26.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 -- 172.21.15.40:0/3160230809 learned_addr learned my addr 172.21.15.40:0/3160230809 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:26.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85be200640 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489d7520 0x561748d7c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bce00640 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489b6840 0x561748d7cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 -- 172.21.15.40:0/3160230809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489d7520 msgr2=0x561748d7c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489d7520 0x561748d7c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 -- 172.21.15.40:0/3160230809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489b6840 msgr2=0x561748d7cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489b6840 0x561748d7cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.204+0000 7f85bd800640 1 -- 172.21.15.40:0/3160230809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561748a42b00 con 0x5617489ae660 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85bd800640 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 0x561748d7c6c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0e7ef0 tx=0x7f85ac0ec440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4d310f5a6bdc15 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85b6000640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85a00b3c00 0x7f85a00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85b6000640 1 -- 172.21.15.40:0/1450809612 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f85ac0e3dc0 con 0x7f85b81055d0 2024-07-26T13:05:26.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85be200640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85a00b3c00 0x7f85a00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85aaa00640 1 -- 172.21.15.40:0/3160230809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0a6b90 con 0x5617489ae660 2024-07-26T13:05:26.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85aaa00640 1 -- 172.21.15.40:0/3160230809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85ac0aa7e0 con 0x5617489ae660 2024-07-26T13:05:26.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.205+0000 7f85aaa00640 1 -- 172.21.15.40:0/3160230809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0aa440 con 0x5617489ae660 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.206+0000 7f85c6b22740 1 -- 172.21.15.40:0/3160230809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 msgr2=0x561748d7c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.206+0000 7f85c6b22740 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 0x561748d7c6c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0e7ef0 tx=0x7f85ac0ec440 comp rx=0 tx=0).stop 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.206+0000 7f85be200640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85a00b3c00 0x7f85a00b6110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f85b000af80 tx=0x7f85b000a730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 -- 172.21.15.40:0/3160230809 shutdown_connections 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489b6840 0x561748d7cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489ae660 0x561748d7c6c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 --2- 172.21.15.40:0/3160230809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489d7520 0x561748d7c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 -- 172.21.15.40:0/3160230809 >> 172.21.15.40:0/3160230809 conn(0x5617489cb910 msgr2=0x561748d7a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:26.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 -- 172.21.15.40:0/3160230809 shutdown_connections 2024-07-26T13:05:26.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 -- 172.21.15.40:0/3160230809 wait complete. 2024-07-26T13:05:26.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.207+0000 7f85c6b22740 1 -- start start 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 Processor -- start 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d87e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748d93c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561748b45bb0 con 0x5617489d7520 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561748c7e910 con 0x5617489ae660 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561748d8a960 con 0x5617489b6840 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.208+0000 7f85c6b22740 10 client.0 _ll_register_callbacks cb 0x5617489eed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748d93c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748d93c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39338/0 (socket says 172.21.15.40:39338) 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 -- 172.21.15.40:0/2338743472 learned_addr learned my addr 172.21.15.40:0/2338743472 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85bd800640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85bce00640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d87e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 -- 172.21.15.40:0/2338743472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 msgr2=0x561748d87e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d87e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 -- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 msgr2=0x561748d878f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d878f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85be200640 1 -- 172.21.15.40:0/2338743472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561748ab9960 con 0x5617489d7520 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.209+0000 7f85bd800640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f85be200640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748d93c80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f85b000fe90 tx=0x7f85b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c6477323e1379f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:26.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f859f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:05:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f859f400640 1 -- 172.21.15.40:0/2338743472 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0029060 con 0x5617489d7520 2024-07-26T13:05:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f859f400640 1 -- 172.21.15.40:0/2338743472 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f85b001a670 con 0x5617489d7520 2024-07-26T13:05:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85ac0aa7e0 con 0x5617489d7520 2024-07-26T13:05:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f859f400640 1 -- 172.21.15.40:0/2338743472 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f85b001ce10 con 0x5617489d7520 2024-07-26T13:05:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f85c6b22740 10 client.17133 fetch_fsmap learned FSMap version 35 2024-07-26T13:05:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.210+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561748d96760 con 0x5617489d7520 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f859f400640 1 -- 172.21.15.40:0/2338743472 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85ac0aa7e0 con 0x5617489d7520 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f859f400640 1 -- 172.21.15.40:0/2338743472 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f85b002e070 con 0x5617489d7520 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f85c6b22740 10 client.17133 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f85c6b22740 10 client.17133 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f85c6b22740 20 client.17133 populate_metadata read hostname 'smithi040' 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561748995ea0 0x561748d99c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f85c6b22740 4 client.17133 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.211+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561748cf4e80 con 0x561748995ea0 2024-07-26T13:05:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.212+0000 7f85bd800640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561748995ea0 0x561748d99c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.213+0000 7f85bd800640 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561748995ea0 0x561748d99c70 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d69334bd5a917ca server_cookie=fea5c3a1ef0a4a2b in_seq=0 out_seq=0 2024-07-26T13:05:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.213+0000 7f859f400640 10 client.17133 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f859f400640 1 -- 172.21.15.40:0/2338743472 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561748cf4e80 con 0x561748995ea0 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f859f400640 10 client.17133 handle_command_reply: tid=0 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 client.17133 shutdown 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 msgr2=0x561748d93c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748d93c80 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f85b000fe90 tx=0x7f85b0004a40 comp rx=0 tx=0).stop 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 shutdown_connections 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561748995ea0 0x561748d99c70 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748d93c80 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d87e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f859f400640 0 client.17133 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2338743472 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 >> 172.21.15.40:0/2338743472 conn(0x5617489cb910 msgr2=0x561748d7f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 shutdown_connections 2024-07-26T13:05:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 1 -- 172.21.15.40:0/2338743472 wait complete. 2024-07-26T13:05:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.215+0000 7f85c6b22740 20 client.17133 trim_cache size 0 max 16384 2024-07-26T13:05:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.234+0000 7f85c6b22740 1 Processor -- start 2024-07-26T13:05:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.234+0000 7f85c6b22740 1 -- start start 2024-07-26T13:05:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489ae660 0x561748d7db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 0x561748d93a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489d7520 0x561748d93fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85c6b22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81b0cf0 con 0x5617489b6840 2024-07-26T13:05:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85c6b22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81b2830 con 0x5617489d7520 2024-07-26T13:05:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85c6b22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81b13c0 con 0x5617489ae660 2024-07-26T13:05:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 0x561748d93a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 0x561748d93a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39350/0 (socket says 172.21.15.40:39350) 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 -- 172.21.15.40:0/768822425 learned_addr learned my addr 172.21.15.40:0/768822425 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bd800640 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489ae660 0x561748d7db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85be200640 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489d7520 0x561748d93fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 -- 172.21.15.40:0/768822425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489ae660 msgr2=0x561748d7db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489ae660 0x561748d7db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 -- 172.21.15.40:0/768822425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489d7520 msgr2=0x561748d93fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489d7520 0x561748d93fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bce00640 1 -- 172.21.15.40:0/768822425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561748d89cc0 con 0x5617489b6840 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.235+0000 7f85bd800640 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489ae660 0x561748d7db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.236+0000 7f85bce00640 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 0x561748d93a70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f85a40057c0 tx=0x7f85a4004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5582dad12dcdd35f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.236+0000 7f85aa000640 1 -- 172.21.15.40:0/768822425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4035040 con 0x5617489b6840 2024-07-26T13:05:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.236+0000 7f85aa000640 1 -- 172.21.15.40:0/768822425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85a4003b40 con 0x5617489b6840 2024-07-26T13:05:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.236+0000 7f85aa000640 1 -- 172.21.15.40:0/768822425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a403cba0 con 0x5617489b6840 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 -- 172.21.15.40:0/768822425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 msgr2=0x561748d93a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 0x561748d93a70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f85a40057c0 tx=0x7f85a4004540 comp rx=0 tx=0).stop 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 -- 172.21.15.40:0/768822425 shutdown_connections 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489d7520 0x561748d93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489b6840 0x561748d93a70 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 --2- 172.21.15.40:0/768822425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489ae660 0x561748d7db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 -- 172.21.15.40:0/768822425 >> 172.21.15.40:0/768822425 conn(0x5617489cb910 msgr2=0x561748d82050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 -- 172.21.15.40:0/768822425 shutdown_connections 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.237+0000 7f85c6b22740 1 -- 172.21.15.40:0/768822425 wait complete. 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.238+0000 7f85c6b22740 1 -- start start 2024-07-26T13:05:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.238+0000 7f85c6b22740 1 Processor -- start 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.238+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d8c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.238+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d8c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85c6b22740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748dfb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85c6b22740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81b2160 con 0x5617489d7520 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85c6b22740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81b1a90 con 0x5617489ae660 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85c6b22740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81aecb0 con 0x5617489b6840 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85c6b22740 10 client.0 _ll_register_callbacks cb 0x7f85b000abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748dfb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748dfb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39352/0 (socket says 172.21.15.40:39352) 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 -- 172.21.15.40:0/2952500447 learned_addr learned my addr 172.21.15.40:0/2952500447 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85bd800640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d8c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85bce00640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d8c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 -- 172.21.15.40:0/2952500447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 msgr2=0x561748d8c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d8c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 -- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 msgr2=0x561748d8c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d8c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.239+0000 7f85be200640 1 -- 172.21.15.40:0/2952500447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561748dfba90 con 0x5617489d7520 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f85be200640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748dfb420 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f85b0016040 tx=0x7f85b0004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7a0bc5c3512dee server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f859f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f859f400640 1 -- 172.21.15.40:0/2952500447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0034030 con 0x5617489d7520 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f859f400640 1 -- 172.21.15.40:0/2952500447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f85b002f5f0 con 0x5617489d7520 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a4003b40 con 0x5617489d7520 2024-07-26T13:05:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f859f400640 1 -- 172.21.15.40:0/2952500447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f85b0029020 con 0x5617489d7520 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f85c6b22740 10 client.17139 fetch_fsmap learned FSMap version 35 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.240+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561748e02d60 con 0x5617489d7520 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f859f400640 1 -- 172.21.15.40:0/2952500447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85a4003b40 con 0x5617489d7520 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f859f400640 1 -- 172.21.15.40:0/2952500447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f85b002e050 con 0x5617489d7520 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f85c6b22740 10 client.17139 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f85c6b22740 10 client.17139 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f85c6b22740 20 client.17139 populate_metadata read hostname 'smithi040' 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56174896b250 0x561748e05500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f85c6b22740 4 client.17139 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f905d920", "release": true, "await": true}] 2024-07-26T13:05:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.241+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f905d920", "release": true, "await": true}) -- 0x561748cf0920 con 0x56174896b250 2024-07-26T13:05:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.242+0000 7f85bd800640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56174896b250 0x561748e05500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.243+0000 7f85bd800640 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56174896b250 0x561748e05500 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6678c02f6976e48 server_cookie=e71d9e8f76b7032f in_seq=0 out_seq=0 2024-07-26T13:05:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.243+0000 7f859f400640 10 client.17139 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.311+0000 7f859f400640 1 -- 172.21.15.40:0/2952500447 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x561748cf0920 con 0x56174896b250 2024-07-26T13:05:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.311+0000 7f859f400640 10 client.17139 handle_command_reply: tid=0 2024-07-26T13:05:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.311+0000 7f85c6b22740 1 client.17139 shutdown 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.311+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 msgr2=0x561748dfb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.311+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748dfb420 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f85b0016040 tx=0x7f85b0004d60 comp rx=0 tx=0).stop 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 shutdown_connections 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56174896b250 0x561748e05500 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5617489d7520 0x561748dfb420 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617489b6840 0x561748d8c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 --2- 172.21.15.40:0/2952500447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617489ae660 0x561748d8c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 >> 172.21.15.40:0/2952500447 conn(0x5617489cb910 msgr2=0x561748d7d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:26.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f859f400640 0 client.17139 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 shutdown_connections 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 1 -- 172.21.15.40:0/2952500447 wait complete. 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.312+0000 7f85c6b22740 20 client.17139 trim_cache size 0 max 16384 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:05:26.314 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 140, 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "f905d920": { 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 140, 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:05:26.315 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:26.316 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.313+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85a00b3c00 msgr2=0x7f85a00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.313+0000 7f85bec00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85a00b3c00 0x7f85a00b6110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f85b000af80 tx=0x7f85b000a730 comp rx=0 tx=0).stop 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.313+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 msgr2=0x7f85b819be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.313+0000 7f85bec00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 0x7f85b819be80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c920 tx=0x7f85ac00cde0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.313+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 shutdown_connections 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85b810b860 0x7f85b81a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85a00b3c00 0x7f85a00b6110 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b810af10 0x7f85b819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 --2- 172.21.15.40:0/1450809612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b81055d0 0x7f85b819be80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 >> 172.21.15.40:0/1450809612 conn(0x7f85b8101040 msgr2=0x7f85b8103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 shutdown_connections 2024-07-26T13:05:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:26.314+0000 7f85bec00640 1 -- 172.21.15.40:0/1450809612 wait complete. 2024-07-26T13:05:26.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:26 smithi040 ceph-mon[32397]: pgmap v1795: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:05:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:26 smithi146 ceph-mon[35807]: pgmap v1795: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:05:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:26 smithi076 ceph-mon[35401]: pgmap v1795: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:05:27.416 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f905d920', total seconds elapsed: 17.7 2024-07-26T13:05:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:28 smithi040 ceph-mon[32397]: pgmap v1796: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:05:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:28 smithi146 ceph-mon[35807]: pgmap v1796: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:05:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:28 smithi076 ceph-mon[35401]: pgmap v1796: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:05:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:30 smithi040 ceph-mon[32397]: pgmap v1797: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 MiB/s wr, 13 op/s 2024-07-26T13:05:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:30 smithi146 ceph-mon[35807]: pgmap v1797: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 MiB/s wr, 13 op/s 2024-07-26T13:05:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:30 smithi076 ceph-mon[35401]: pgmap v1797: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 MiB/s wr, 13 op/s 2024-07-26T13:05:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:32 smithi040 ceph-mon[32397]: pgmap v1798: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1011 KiB/s wr, 8 op/s 2024-07-26T13:05:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:32 smithi146 ceph-mon[35807]: pgmap v1798: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1011 KiB/s wr, 8 op/s 2024-07-26T13:05:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:32 smithi076 ceph-mon[35401]: pgmap v1798: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1011 KiB/s wr, 8 op/s 2024-07-26T13:05:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:34 smithi040 ceph-mon[32397]: pgmap v1799: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-07-26T13:05:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:34 smithi146 ceph-mon[35807]: pgmap v1799: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-07-26T13:05:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:34 smithi076 ceph-mon[35401]: pgmap v1799: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-07-26T13:05:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:36 smithi146 ceph-mon[35807]: pgmap v1800: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-07-26T13:05:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:36 smithi076 ceph-mon[35401]: pgmap v1800: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-07-26T13:05:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:36 smithi040 ceph-mon[32397]: pgmap v1800: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-07-26T13:05:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:38 smithi146 ceph-mon[35807]: pgmap v1801: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:05:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:38 smithi076 ceph-mon[35401]: pgmap v1801: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:05:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:38 smithi040 ceph-mon[32397]: pgmap v1801: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:05:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:40 smithi146 ceph-mon[35807]: pgmap v1802: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:05:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:40 smithi076 ceph-mon[35401]: pgmap v1802: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:05:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:40 smithi040 ceph-mon[32397]: pgmap v1802: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:05:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:42 smithi146 ceph-mon[35807]: pgmap v1803: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:05:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:42 smithi076 ceph-mon[35401]: pgmap v1803: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:05:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:42 smithi040 ceph-mon[32397]: pgmap v1803: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:05:45.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:44 smithi040 ceph-mon[32397]: pgmap v1804: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:05:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:44 smithi146 ceph-mon[35807]: pgmap v1804: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:05:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:44 smithi076 ceph-mon[35401]: pgmap v1804: 97 pgs: 97 active+clean; 8.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:05:45.989 INFO:tasks.quiescer.fs.[cephfs]:Total duration (46.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:05:45.989 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.25 2024-07-26T13:05:45.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:05:46.518 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:05:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:46 smithi040 ceph-mon[32397]: pgmap v1805: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:05:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:46 smithi146 ceph-mon[35807]: pgmap v1805: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:05:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:46 smithi076 ceph-mon[35401]: pgmap v1805: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:05:48.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 -- 172.21.15.40:0/1161887827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d00751e0 msgr2=0x7f19d00755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 --2- 172.21.15.40:0/1161887827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d00751e0 0x7f19d00755f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009900 tx=0x7f19c402a410 comp rx=0 tx=0).stop 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 -- 172.21.15.40:0/1161887827 shutdown_connections 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 --2- 172.21.15.40:0/1161887827 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d010f940 0x7f19d0111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 --2- 172.21.15.40:0/1161887827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0075b30 0x7f19d010f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 --2- 172.21.15.40:0/1161887827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d00751e0 0x7f19d00755f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 -- 172.21.15.40:0/1161887827 >> 172.21.15.40:0/1161887827 conn(0x7f19d00fee70 msgr2=0x7f19d01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 -- 172.21.15.40:0/1161887827 shutdown_connections 2024-07-26T13:05:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.968+0000 7f19d5e00640 1 -- 172.21.15.40:0/1161887827 wait complete. 2024-07-26T13:05:48.972 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:48 smithi040 ceph-mon[32397]: pgmap v1806: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:05:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.969+0000 7f19d5e00640 1 Processor -- start 2024-07-26T13:05:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 -- start start 2024-07-26T13:05:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d00751e0 0x7f19d019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 0x7f19d019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d010f940 0x7f19d01a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f19d01153a0 con 0x7f19d0075b30 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0115220 con 0x7f19d00751e0 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19d5e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0115520 con 0x7f19d010f940 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.970+0000 7f19cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 0x7f19d019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 0x7f19d019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34968/0 (socket says 172.21.15.40:34968) 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 -- 172.21.15.40:0/2928333150 learned_addr learned my addr 172.21.15.40:0/2928333150 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19d4a00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d00751e0 0x7f19d019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19d5400640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d010f940 0x7f19d01a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 -- 172.21.15.40:0/2928333150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d010f940 msgr2=0x7f19d01a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d010f940 0x7f19d01a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 -- 172.21.15.40:0/2928333150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d00751e0 msgr2=0x7f19d019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d00751e0 0x7f19d019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19cfe00640 1 -- 172.21.15.40:0/2928333150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d01a1d00 con 0x7f19d0075b30 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.971+0000 7f19d4a00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d00751e0 0x7f19d019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.972+0000 7f19cfe00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 0x7f19d019c3f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d950 tx=0x7f19bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.972+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc017070 con 0x7f19d0075b30 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.972+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19bc009c30 con 0x7f19d0075b30 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.972+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d01a1ff0 con 0x7f19d0075b30 2024-07-26T13:05:48.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.972+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00f620 con 0x7f19d0075b30 2024-07-26T13:05:48.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.972+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d01a8810 con 0x7f19d0075b30 2024-07-26T13:05:48.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.974+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d00766f0 con 0x7f19d0075b30 2024-07-26T13:05:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.978+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f19bc01a070 con 0x7f19d0075b30 2024-07-26T13:05:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.980+0000 7f19cd600640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f19b80b3c00 0x7f19b80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.980+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19bc0e3730 con 0x7f19d0075b30 2024-07-26T13:05:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.981+0000 7f19d4a00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f19b80b3c00 0x7f19b80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.981+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f19bc0aad40 con 0x7f19d0075b30 2024-07-26T13:05:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:48.982+0000 7f19d4a00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f19b80b3c00 0x7f19b80b6110 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f19c4000c00 tx=0x7f19c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:48 smithi146 ceph-mon[35807]: pgmap v1806: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:05:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:48 smithi076 ceph-mon[35401]: pgmap v1806: 97 pgs: 97 active+clean; 8.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:05:49.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.270+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19d010aac0 con 0x7f19d0075b30 2024-07-26T13:05:49.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.271+0000 7f19cd600640 1 -- 172.21.15.40:0/2928333150 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f19bc0aa640 con 0x7f19d0075b30 2024-07-26T13:05:49.274 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:05:49.274 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:05:49.274 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:05:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f19b80b3c00 msgr2=0x7f19b80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f19b80b3c00 0x7f19b80b6110 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f19c4000c00 tx=0x7f19c4005a20 comp rx=0 tx=0).stop 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 msgr2=0x7f19d019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 0x7f19d019c3f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d950 tx=0x7f19bc00de10 comp rx=0 tx=0).stop 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 shutdown_connections 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f19b80b3c00 0x7f19b80b6110 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d010f940 0x7f19d01a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19d0075b30 0x7f19d019c3f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 --2- 172.21.15.40:0/2928333150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19d00751e0 0x7f19d019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:49.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.275+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 >> 172.21.15.40:0/2928333150 conn(0x7f19d00fee70 msgr2=0x7f19d00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:49.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.276+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 shutdown_connections 2024-07-26T13:05:49.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:49.276+0000 7f19d5e00640 1 -- 172.21.15.40:0/2928333150 wait complete. 2024-07-26T13:05:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:49 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2928333150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:49 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2928333150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:49 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2928333150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:05:50.116 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0' 2024-07-26T13:05:50.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0 2024-07-26T13:05:50.619 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:05:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:50 smithi146 ceph-mon[35807]: pgmap v1807: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:05:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:50 smithi076 ceph-mon[35401]: pgmap v1807: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:05:51.083 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:50 smithi040 ceph-mon[32397]: pgmap v1807: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:05:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:52 smithi146 ceph-mon[35807]: pgmap v1808: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:05:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:52 smithi076 ceph-mon[35401]: pgmap v1808: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:05:53.108 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:52 smithi040 ceph-mon[32397]: pgmap v1808: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:05:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 -- 172.21.15.40:0/2802230021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0104110 msgr2=0x7f2cb0104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 --2- 172.21.15.40:0/2802230021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0104110 0x7f2cb0104520 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009900 tx=0x7f2ca402a410 comp rx=0 tx=0).stop 2024-07-26T13:05:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 -- 172.21.15.40:0/2802230021 shutdown_connections 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 --2- 172.21.15.40:0/2802230021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cb010d6c0 0x7f2cb010fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 --2- 172.21.15.40:0/2802230021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cb0104b40 0x7f2cb010d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 --2- 172.21.15.40:0/2802230021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0104110 0x7f2cb0104520 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 -- 172.21.15.40:0/2802230021 >> 172.21.15.40:0/2802230021 conn(0x7f2cb00fdda0 msgr2=0x7f2cb01001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 -- 172.21.15.40:0/2802230021 shutdown_connections 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.242+0000 7f2cb6600640 1 -- 172.21.15.40:0/2802230021 wait complete. 2024-07-26T13:05:53.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.244+0000 7f2cb6600640 1 Processor -- start 2024-07-26T13:05:53.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.244+0000 7f2cb6600640 1 -- start start 2024-07-26T13:05:53.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb6600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cb0104110 0x7f2cb0102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cb0104b40 0x7f2cb0102560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb6600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 0x7f2cb0102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb6600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0113230 con 0x7f2cb010d6c0 2024-07-26T13:05:53.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb6600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01130b0 con 0x7f2cb0104110 2024-07-26T13:05:53.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb6600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01133b0 con 0x7f2cb0104b40 2024-07-26T13:05:53.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 0x7f2cb0102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 0x7f2cb0102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48556/0 (socket says 172.21.15.40:48556) 2024-07-26T13:05:53.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb5c00640 1 -- 172.21.15.40:0/380077025 learned_addr learned my addr 172.21.15.40:0/380077025 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:53.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.245+0000 7f2cb5200640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cb0104110 0x7f2cb0102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.246+0000 7f2cafe00640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cb0104b40 0x7f2cb0102560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.246+0000 7f2cb5c00640 1 -- 172.21.15.40:0/380077025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cb0104b40 msgr2=0x7f2cb0102560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.246+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cb0104b40 0x7f2cb0102560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.246+0000 7f2cb5c00640 1 -- 172.21.15.40:0/380077025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cb0104110 msgr2=0x7f2cb0102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.246+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cb0104110 0x7f2cb0102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.246+0000 7f2cb5c00640 1 -- 172.21.15.40:0/380077025 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb01a7e50 con 0x7f2cb010d6c0 2024-07-26T13:05:53.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.247+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 0x7f2cb0102aa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800eaa0 tx=0x7f2ca800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:53.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.247+0000 7f2cad600640 1 -- 172.21.15.40:0/380077025 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004d20 con 0x7f2cb010d6c0 2024-07-26T13:05:53.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.247+0000 7f2cad600640 1 -- 172.21.15.40:0/380077025 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca8005020 con 0x7f2cb010d6c0 2024-07-26T13:05:53.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.247+0000 7f2cad600640 1 -- 172.21.15.40:0/380077025 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80116d0 con 0x7f2cb010d6c0 2024-07-26T13:05:53.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.247+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb01a8140 con 0x7f2cb010d6c0 2024-07-26T13:05:53.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.248+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb01a8630 con 0x7f2cb010d6c0 2024-07-26T13:05:53.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.252+0000 7f2cbea14740 1 Processor -- start 2024-07-26T13:05:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cad600640 1 -- 172.21.15.40:0/380077025 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2ca80051d0 con 0x7f2cb010d6c0 2024-07-26T13:05:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 -- start start 2024-07-26T13:05:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b1b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b1b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b1bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561012a8f8a0 con 0x561012774850 2024-07-26T13:05:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561012a7eda0 con 0x56101274b990 2024-07-26T13:05:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.253+0000 7f2cbea14740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561012a82de0 con 0x561012753b70 2024-07-26T13:05:53.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.254+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b1b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.254+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b1b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48562/0 (socket says 172.21.15.40:48562) 2024-07-26T13:05:53.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.254+0000 7f2cafe00640 1 -- 172.21.15.40:0/1709787088 learned_addr learned my addr 172.21.15.40:0/1709787088 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.254+0000 7f2cb5200640 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b1b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.254+0000 7f2cafe00640 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b1bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cafe00640 1 -- 172.21.15.40:0/1709787088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 msgr2=0x561012b1bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cafe00640 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b1bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cafe00640 1 -- 172.21.15.40:0/1709787088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 msgr2=0x561012b1b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cafe00640 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b1b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cafe00640 1 -- 172.21.15.40:0/1709787088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561012a13b70 con 0x561012774850 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cafe00640 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b1b480 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00afd0 tx=0x7f2c9c00a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36815f57f5903c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cad600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c980b3c40 0x7f2c980b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2cad600640 1 -- 172.21.15.40:0/380077025 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2ca80e3ca0 con 0x7f2cb010d6c0 2024-07-26T13:05:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.255+0000 7f2ca2000640 1 -- 172.21.15.40:0/1709787088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c019030 con 0x561012774850 2024-07-26T13:05:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.256+0000 7f2ca2000640 1 -- 172.21.15.40:0/1709787088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c9c0110d0 con 0x561012774850 2024-07-26T13:05:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.256+0000 7f2ca2000640 1 -- 172.21.15.40:0/1709787088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00f7a0 con 0x561012774850 2024-07-26T13:05:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.256+0000 7f2cb5200640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c980b3c40 0x7f2c980b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 -- 172.21.15.40:0/1709787088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 msgr2=0x561012b1b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cb5200640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c980b3c40 0x7f2c980b6150 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0103a70 tx=0x7f2ca4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b1b480 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00afd0 tx=0x7f2c9c00a7c0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 -- 172.21.15.40:0/1709787088 shutdown_connections 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b1bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b1b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 --2- 172.21.15.40:0/1709787088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b1b480 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 -- 172.21.15.40:0/1709787088 >> 172.21.15.40:0/1709787088 conn(0x561012768c40 msgr2=0x561012b19370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 -- 172.21.15.40:0/1709787088 shutdown_connections 2024-07-26T13:05:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.257+0000 7f2cbea14740 1 -- 172.21.15.40:0/1709787088 wait complete. 2024-07-26T13:05:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.258+0000 7f2cbea14740 1 -- start start 2024-07-26T13:05:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.258+0000 7f2cbea14740 1 Processor -- start 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56101274b990 0x561012b26fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b32f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5610128e27b0 con 0x561012774850 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561012a1b380 con 0x561012753b70 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561012b29c60 con 0x56101274b990 2024-07-26T13:05:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.259+0000 7f2cbea14740 10 client.0 _ll_register_callbacks cb 0x561012a2a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b32f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b32f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48570/0 (socket says 172.21.15.40:48570) 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 -- 172.21.15.40:0/2055344600 learned_addr learned my addr 172.21.15.40:0/2055344600 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5200640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56101274b990 0x561012b26fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cafe00640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b27520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 -- 172.21.15.40:0/2055344600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56101274b990 msgr2=0x561012b26fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56101274b990 0x561012b26fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 -- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 msgr2=0x561012b27520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b27520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cb5c00640 1 -- 172.21.15.40:0/2055344600 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610127eeba0 con 0x561012774850 2024-07-26T13:05:53.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.260+0000 7f2cafe00640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b27520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.261+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b32f80 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80a7e20 tx=0x7f2ca80a6430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28011e0822dc045 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.261+0000 7f2c96a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.261+0000 7f2c96a00640 1 -- 172.21.15.40:0/2055344600 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca801f040 con 0x561012774850 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.261+0000 7f2c96a00640 1 -- 172.21.15.40:0/2055344600 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2ca80920c0 con 0x561012774850 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.261+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9c0110d0 con 0x561012774850 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2c96a00640 1 -- 172.21.15.40:0/2055344600 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2ca80af1b0 con 0x561012774850 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2cbea14740 10 client.17157 fetch_fsmap learned FSMap version 35 2024-07-26T13:05:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561012b35c80 con 0x561012774850 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2c96a00640 1 -- 172.21.15.40:0/2055344600 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c9c0110d0 con 0x561012774850 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2c96a00640 1 -- 172.21.15.40:0/2055344600 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2ca800f040 con 0x561012774850 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2cbea14740 10 client.17157 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2cbea14740 10 client.17157 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.262+0000 7f2cbea14740 20 client.17157 populate_metadata read hostname 'smithi040' 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.263+0000 7f2cbea14740 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5610127331d0 0x561012b39240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.263+0000 7f2cbea14740 4 client.17157 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.263+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561012a917f0 con 0x5610127331d0 2024-07-26T13:05:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.263+0000 7f2cb5200640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5610127331d0 0x561012b39240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.265+0000 7f2cb5200640 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5610127331d0 0x561012b39240 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4998ddbc7fe62a1 server_cookie=39cc63accc171598 in_seq=0 out_seq=0 2024-07-26T13:05:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.265+0000 7f2c96a00640 10 client.17157 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.266+0000 7f2c96a00640 1 -- 172.21.15.40:0/2055344600 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561012a917f0 con 0x5610127331d0 2024-07-26T13:05:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.266+0000 7f2c96a00640 10 client.17157 handle_command_reply: tid=0 2024-07-26T13:05:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 client.17157 shutdown 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 msgr2=0x561012b32f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b32f80 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80a7e20 tx=0x7f2ca80a6430 comp rx=0 tx=0).stop 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 shutdown_connections 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5610127331d0 0x561012b39240 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b32f80 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b27520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 --2- 172.21.15.40:0/2055344600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56101274b990 0x561012b26fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2c96a00640 0 client.17157 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 >> 172.21.15.40:0/2055344600 conn(0x561012768c40 msgr2=0x561012b1e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 shutdown_connections 2024-07-26T13:05:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.267+0000 7f2cbea14740 1 -- 172.21.15.40:0/2055344600 wait complete. 2024-07-26T13:05:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.268+0000 7f2cbea14740 20 client.17157 trim_cache size 0 max 16384 2024-07-26T13:05:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 Processor -- start 2024-07-26T13:05:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 -- start start 2024-07-26T13:05:53.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 0x561012b1cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b32d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012774850 0x561012b332b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b0db0 con 0x56101274b990 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b28f0 con 0x561012753b70 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.291+0000 7f2cbea14740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b1480 con 0x561012774850 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 0x561012b1cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 0x561012b1cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48586/0 (socket says 172.21.15.40:48586) 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 -- 172.21.15.40:0/844311429 learned_addr learned my addr 172.21.15.40:0/844311429 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cafe00640 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b32d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012774850 0x561012b332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 -- 172.21.15.40:0/844311429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012774850 msgr2=0x561012b332b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012774850 0x561012b332b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 -- 172.21.15.40:0/844311429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 msgr2=0x561012b32d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b32d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.292+0000 7f2cb5200640 1 -- 172.21.15.40:0/844311429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561012b135e0 con 0x56101274b990 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.293+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012774850 0x561012b332b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.293+0000 7f2cb5200640 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 0x561012b1cbc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009900 tx=0x7f2ca403e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da08f7b99d5fbd4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.293+0000 7f2ca1600640 1 -- 172.21.15.40:0/844311429 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4035040 con 0x56101274b990 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.293+0000 7f2ca1600640 1 -- 172.21.15.40:0/844311429 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca4058070 con 0x56101274b990 2024-07-26T13:05:53.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.293+0000 7f2ca1600640 1 -- 172.21.15.40:0/844311429 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca403c6a0 con 0x56101274b990 2024-07-26T13:05:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.294+0000 7f2cbea14740 1 -- 172.21.15.40:0/844311429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 msgr2=0x561012b1cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.294+0000 7f2cbea14740 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 0x561012b1cbc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009900 tx=0x7f2ca403e070 comp rx=0 tx=0).stop 2024-07-26T13:05:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 -- 172.21.15.40:0/844311429 shutdown_connections 2024-07-26T13:05:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012774850 0x561012b332b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561012753b70 0x561012b32d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 --2- 172.21.15.40:0/844311429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56101274b990 0x561012b1cbc0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 -- 172.21.15.40:0/844311429 >> 172.21.15.40:0/844311429 conn(0x561012768c40 msgr2=0x561012b1c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 -- 172.21.15.40:0/844311429 shutdown_connections 2024-07-26T13:05:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 -- 172.21.15.40:0/844311429 wait complete. 2024-07-26T13:05:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.295+0000 7f2cbea14740 1 -- start start 2024-07-26T13:05:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 Processor -- start 2024-07-26T13:05:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b2f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b2a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b2ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b2220 con 0x561012774850 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b1b50 con 0x56101274b990 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01aed70 con 0x561012753b70 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.296+0000 7f2cbea14740 10 client.0 _ll_register_callbacks cb 0x7f2ca80aa3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b2ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b2ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48598/0 (socket says 172.21.15.40:48598) 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 -- 172.21.15.40:0/3932650893 learned_addr learned my addr 172.21.15.40:0/3932650893 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5200640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b2f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cafe00640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b2a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 -- 172.21.15.40:0/3932650893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 msgr2=0x561012b2a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b2a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 -- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 msgr2=0x561012b2f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:05:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b2f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5c00640 1 -- 172.21.15.40:0/3932650893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561012b2b500 con 0x561012774850 2024-07-26T13:05:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.297+0000 7f2cb5200640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b2f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:05:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.298+0000 7f2cb5c00640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b2ae90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80aa860 tx=0x7f2ca80922c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103a472e8345b13d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:05:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.298+0000 7f2c96a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.298+0000 7f2c96a00640 1 -- 172.21.15.40:0/3932650893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8088070 con 0x561012774850 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.298+0000 7f2c96a00640 1 -- 172.21.15.40:0/3932650893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2ca800caf0 con 0x561012774850 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.298+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca4058070 con 0x561012774850 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.298+0000 7f2c96a00640 1 -- 172.21.15.40:0/3932650893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2ca801f050 con 0x561012774850 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 10 client.17163 fetch_fsmap learned FSMap version 35 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561012ba1790 con 0x561012774850 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2c96a00640 1 -- 172.21.15.40:0/3932650893 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca4058070 con 0x561012774850 2024-07-26T13:05:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2c96a00640 1 -- 172.21.15.40:0/3932650893 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2ca80b0340 con 0x561012774850 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 10 client.17163 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 10 client.17163 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 20 client.17163 populate_metadata read hostname 'smithi040' 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561012708580 0x561012ba3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 4 client.17163 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}] 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.299+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}) -- 0x561012a8d290 con 0x561012708580 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.300+0000 7f2cb5200640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561012708580 0x561012ba3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:05:53.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.301+0000 7f2cb5200640 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561012708580 0x561012ba3da0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c970e9a682371cbf server_cookie=fe47a17c285b3a74 in_seq=0 out_seq=0 2024-07-26T13:05:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.301+0000 7f2c96a00640 10 client.17163 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:53.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2c96a00640 1 -- 172.21.15.40:0/3932650893 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x561012a8d290 con 0x561012708580 2024-07-26T13:05:53.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2c96a00640 10 client.17163 handle_command_reply: tid=0 2024-07-26T13:05:53.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 client.17163 shutdown 2024-07-26T13:05:53.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 msgr2=0x561012b2ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b2ae90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80aa860 tx=0x7f2ca80922c0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 shutdown_connections 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561012708580 0x561012ba3da0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561012774850 0x561012b2ae90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561012753b70 0x561012b2a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 --2- 172.21.15.40:0/3932650893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56101274b990 0x561012b2f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.616+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 >> 172.21.15.40:0/3932650893 conn(0x561012768c40 msgr2=0x561012b17910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.617+0000 7f2c96a00640 0 client.17163 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:05:53.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.617+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 shutdown_connections 2024-07-26T13:05:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.617+0000 7f2cbea14740 1 -- 172.21.15.40:0/3932650893 wait complete. 2024-07-26T13:05:53.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.618+0000 7f2cbea14740 20 client.17163 trim_cache size 0 max 16384 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 142, 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "bd5e9083": { 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 142, 2024-07-26T13:05:53.621 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.2, 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:05:53.622 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:05:53.623 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.619+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c980b3c40 msgr2=0x7f2c980b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.619+0000 7f2cb6600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c980b3c40 0x7f2c980b6150 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0103a70 tx=0x7f2ca4000bc0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.619+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 msgr2=0x7f2cb0102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.619+0000 7f2cb6600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 0x7f2cb0102aa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800eaa0 tx=0x7f2ca800eea0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 shutdown_connections 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb010d6c0 0x7f2cb0102aa0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c980b3c40 0x7f2c980b6150 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cb0104b40 0x7f2cb0102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 --2- 172.21.15.40:0/380077025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2cb0104110 0x7f2cb0102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:05:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 >> 172.21.15.40:0/380077025 conn(0x7f2cb00fdda0 msgr2=0x7f2cb0107240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:05:53.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 shutdown_connections 2024-07-26T13:05:53.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:05:53.620+0000 7f2cb6600640 1 -- 172.21.15.40:0/380077025 wait complete. 2024-07-26T13:05:54.602 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bd5e9083', quiesce took 8.6 seconds. Will release after: 14.65 2024-07-26T13:05:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:54 smithi146 ceph-mon[35807]: pgmap v1809: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:05:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:54 smithi076 ceph-mon[35401]: pgmap v1809: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:05:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:54 smithi040 ceph-mon[32397]: pgmap v1809: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:05:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:56 smithi076 ceph-mon[35401]: pgmap v1810: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:05:57.216 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:56 smithi040 ceph-mon[32397]: pgmap v1810: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:05:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:56 smithi146 ceph-mon[35807]: pgmap v1810: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:05:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:05:58 smithi076 ceph-mon[35401]: pgmap v1811: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:05:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:05:58 smithi040 ceph-mon[32397]: pgmap v1811: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:05:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:05:58 smithi146 ceph-mon[35807]: pgmap v1811: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:06:01.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:00 smithi146 ceph-mon[35807]: pgmap v1812: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:06:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:00 smithi040 ceph-mon[32397]: pgmap v1812: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:06:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:00 smithi076 ceph-mon[35401]: pgmap v1812: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:06:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:02 smithi040 ceph-mon[32397]: pgmap v1813: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2024-07-26T13:06:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:02 smithi146 ceph-mon[35807]: pgmap v1813: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2024-07-26T13:06:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:02 smithi076 ceph-mon[35401]: pgmap v1813: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2024-07-26T13:06:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:04 smithi040 ceph-mon[32397]: pgmap v1814: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-07-26T13:06:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:04 smithi146 ceph-mon[35807]: pgmap v1814: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-07-26T13:06:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:04 smithi076 ceph-mon[35401]: pgmap v1814: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-07-26T13:06:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:06 smithi040 ceph-mon[32397]: pgmap v1815: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:06:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:06 smithi146 ceph-mon[35807]: pgmap v1815: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:06:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:06 smithi076 ceph-mon[35401]: pgmap v1815: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:06:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:08 smithi040 ceph-mon[32397]: pgmap v1816: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 815 KiB/s wr, 9 op/s 2024-07-26T13:06:09.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:06:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:08 smithi146 ceph-mon[35807]: pgmap v1816: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 815 KiB/s wr, 9 op/s 2024-07-26T13:06:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:08 smithi076 ceph-mon[35401]: pgmap v1816: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 815 KiB/s wr, 9 op/s 2024-07-26T13:06:09.740 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:06:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:10 smithi040 ceph-mon[32397]: pgmap v1817: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 815 KiB/s wr, 12 op/s 2024-07-26T13:06:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:10 smithi146 ceph-mon[35807]: pgmap v1817: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 815 KiB/s wr, 12 op/s 2024-07-26T13:06:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:10 smithi076 ceph-mon[35401]: pgmap v1817: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 815 KiB/s wr, 12 op/s 2024-07-26T13:06:12.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 -- 172.21.15.40:0/3222859369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 msgr2=0x7f86e8109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:12.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 --2- 172.21.15.40:0/3222859369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e8109e00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009860 tx=0x7f86dc02a340 comp rx=0 tx=0).stop 2024-07-26T13:06:12.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 -- 172.21.15.40:0/3222859369 shutdown_connections 2024-07-26T13:06:12.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 --2- 172.21.15.40:0/3222859369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e810fc80 0x7f86e81164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 --2- 172.21.15.40:0/3222859369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86e810f330 0x7f86e810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 --2- 172.21.15.40:0/3222859369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e8109e00 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 -- 172.21.15.40:0/3222859369 >> 172.21.15.40:0/3222859369 conn(0x7f86e8078ff0 msgr2=0x7f86e8107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:12.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 -- 172.21.15.40:0/3222859369 shutdown_connections 2024-07-26T13:06:12.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.031+0000 7f86ede00640 1 -- 172.21.15.40:0/3222859369 wait complete. 2024-07-26T13:06:12.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.032+0000 7f86ede00640 1 Processor -- start 2024-07-26T13:06:12.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.032+0000 7f86ede00640 1 -- start start 2024-07-26T13:06:12.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86ede00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e81a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:12.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86ede00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86e810f330 0x7f86e81a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86ede00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e810fc80 0x7f86e81a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86ede00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f86e81197f0 con 0x7f86e81099f0 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86ede00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f86e8119670 con 0x7f86e810f330 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86ede00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86e8119970 con 0x7f86e810fc80 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86eca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e81a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86eca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e81a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55146/0 (socket says 172.21.15.40:55146) 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.033+0000 7f86eca00640 1 -- 172.21.15.40:0/1890011516 learned_addr learned my addr 172.21.15.40:0/1890011516 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86e7e00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86e810f330 0x7f86e81a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86ed400640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e810fc80 0x7f86e81a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86eca00640 1 -- 172.21.15.40:0/1890011516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e810fc80 msgr2=0x7f86e81a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86eca00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e810fc80 0x7f86e81a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86eca00640 1 -- 172.21.15.40:0/1890011516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86e810f330 msgr2=0x7f86e81a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86eca00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86e810f330 0x7f86e81a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86eca00640 1 -- 172.21.15.40:0/1890011516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e81a6230 con 0x7f86e81099f0 2024-07-26T13:06:12.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.034+0000 7f86eca00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e81a02c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0057c0 tx=0x7f86dc02ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:12.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.035+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc040020 con 0x7f86e81099f0 2024-07-26T13:06:12.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.035+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86dc0044d0 con 0x7f86e81099f0 2024-07-26T13:06:12.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.035+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e81a64c0 con 0x7f86e81099f0 2024-07-26T13:06:12.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.035+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc037040 con 0x7f86e81099f0 2024-07-26T13:06:12.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.035+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e81acc80 con 0x7f86e81099f0 2024-07-26T13:06:12.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.036+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e8109e00 con 0x7f86e81099f0 2024-07-26T13:06:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.039+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f86dc043020 con 0x7f86e81099f0 2024-07-26T13:06:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.040+0000 7f86e5600640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f86d00b3bd0 0x7f86d00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.040+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f86dc103de0 con 0x7f86e81099f0 2024-07-26T13:06:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.041+0000 7f86e7e00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f86d00b3bd0 0x7f86d00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:12.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.041+0000 7f86e7e00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f86d00b3bd0 0x7f86d00b60e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f86e810fb60 tx=0x7f86d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:12.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.045+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f86dc04a020 con 0x7f86e81099f0 2024-07-26T13:06:12.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.287+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86e81a13f0 con 0x7f86e81099f0 2024-07-26T13:06:12.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.289+0000 7f86e5600640 1 -- 172.21.15.40:0/1890011516 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f86dc0cb3f0 con 0x7f86e81099f0 2024-07-26T13:06:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:06:12.291 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:06:12.291 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f86d00b3bd0 msgr2=0x7f86d00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f86d00b3bd0 0x7f86d00b60e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f86e810fb60 tx=0x7f86d4009260 comp rx=0 tx=0).stop 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 msgr2=0x7f86e81a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e81a02c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0057c0 tx=0x7f86dc02ae60 comp rx=0 tx=0).stop 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 shutdown_connections 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f86d00b3bd0 0x7f86d00b60e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86e810fc80 0x7f86e81a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86e810f330 0x7f86e81a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 --2- 172.21.15.40:0/1890011516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e81099f0 0x7f86e81a02c0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:12.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 >> 172.21.15.40:0/1890011516 conn(0x7f86e8078ff0 msgr2=0x7f86e80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:12.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.292+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 shutdown_connections 2024-07-26T13:06:12.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:12.293+0000 7f86ede00640 1 -- 172.21.15.40:0/1890011516 wait complete. 2024-07-26T13:06:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:12 smithi040 ceph-mon[32397]: pgmap v1818: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 474 KiB/s wr, 8 op/s 2024-07-26T13:06:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:12 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1890011516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:13.164 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id bd5e9083 --release --await' 2024-07-26T13:06:13.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id bd5e9083 --release --await 2024-07-26T13:06:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:12 smithi146 ceph-mon[35807]: pgmap v1818: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 474 KiB/s wr, 8 op/s 2024-07-26T13:06:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:12 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1890011516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:12 smithi076 ceph-mon[35401]: pgmap v1818: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 474 KiB/s wr, 8 op/s 2024-07-26T13:06:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:12 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1890011516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:06:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:14 smithi040 ceph-mon[32397]: pgmap v1819: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 474 KiB/s wr, 10 op/s 2024-07-26T13:06:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:14 smithi146 ceph-mon[35807]: pgmap v1819: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 474 KiB/s wr, 10 op/s 2024-07-26T13:06:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:14 smithi076 ceph-mon[35401]: pgmap v1819: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 474 KiB/s wr, 10 op/s 2024-07-26T13:06:15.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 -- 172.21.15.40:0/639483348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 msgr2=0x7ff98c10f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 --2- 172.21.15.40:0/639483348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c10f4a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff984009900 tx=0x7ff98402a410 comp rx=0 tx=0).stop 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 -- 172.21.15.40:0/639483348 shutdown_connections 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 --2- 172.21.15.40:0/639483348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c10f4a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 --2- 172.21.15.40:0/639483348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff98c06b6a0 0x7ff98c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 --2- 172.21.15.40:0/639483348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff98c1108d0 0x7ff98c110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.923+0000 7ff991000640 1 -- 172.21.15.40:0/639483348 >> 172.21.15.40:0/639483348 conn(0x7ff98c06e360 msgr2=0x7ff98c070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.924+0000 7ff991000640 1 -- 172.21.15.40:0/639483348 shutdown_connections 2024-07-26T13:06:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.924+0000 7ff991000640 1 -- 172.21.15.40:0/639483348 wait complete. 2024-07-26T13:06:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 Processor -- start 2024-07-26T13:06:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 -- start start 2024-07-26T13:06:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff98c06b6a0 0x7ff98c1a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c1a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff98c1108d0 0x7ff98c1ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c122210 con 0x7ff98c06c100 2024-07-26T13:06:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c122090 con 0x7ff98c1108d0 2024-07-26T13:06:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.925+0000 7ff991000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c122390 con 0x7ff98c06b6a0 2024-07-26T13:06:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c1a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c1a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33214/0 (socket says 172.21.15.40:33214) 2024-07-26T13:06:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 -- 172.21.15.40:0/1391237269 learned_addr learned my addr 172.21.15.40:0/1391237269 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff98a800640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff98c1108d0 0x7ff98c1ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989e00640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff98c06b6a0 0x7ff98c1a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 -- 172.21.15.40:0/1391237269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff98c06b6a0 msgr2=0x7ff98c1a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff98c06b6a0 0x7ff98c1a8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 -- 172.21.15.40:0/1391237269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff98c1108d0 msgr2=0x7ff98c1ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff98c1108d0 0x7ff98c1ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.926+0000 7ff989400640 1 -- 172.21.15.40:0/1391237269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c1aeb90 con 0x7ff98c06c100 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.927+0000 7ff989400640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c1a91c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff978006fd0 tx=0x7ff97800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.927+0000 7ff982a00640 1 -- 172.21.15.40:0/1391237269 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978011830 con 0x7ff98c06c100 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.927+0000 7ff982a00640 1 -- 172.21.15.40:0/1391237269 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff978016070 con 0x7ff98c06c100 2024-07-26T13:06:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.927+0000 7ff982a00640 1 -- 172.21.15.40:0/1391237269 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978010d30 con 0x7ff98c06c100 2024-07-26T13:06:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.927+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c1aee80 con 0x7ff98c06c100 2024-07-26T13:06:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.927+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c1b55e0 con 0x7ff98c06c100 2024-07-26T13:06:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.931+0000 7ff997c08740 1 Processor -- start 2024-07-26T13:06:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.931+0000 7ff997c08740 1 -- start start 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff997c08740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 0x55c1ea963fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff997c08740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea964520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff997c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea59e840 0x55c1ea964a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff997c08740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea8daf50 con 0x55c1ea5bf520 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff997c08740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea8ca450 con 0x55c1ea596660 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff997c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea8ce490 con 0x55c1ea59e840 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff98a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 0x55c1ea963fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff982a00640 1 -- 172.21.15.40:0/1391237269 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff9780119d0 con 0x7ff98c06c100 2024-07-26T13:06:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff98a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 0x55c1ea963fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33226/0 (socket says 172.21.15.40:33226) 2024-07-26T13:06:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff98a800640 1 -- 172.21.15.40:0/3152746224 learned_addr learned my addr 172.21.15.40:0/3152746224 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.932+0000 7ff989e00640 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea964520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.933+0000 7ff98a800640 1 -- 172.21.15.40:0/3152746224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea59e840 msgr2=0x55c1ea964a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.933+0000 7ff98a800640 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea59e840 0x55c1ea964a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.933+0000 7ff98a800640 1 -- 172.21.15.40:0/3152746224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 msgr2=0x55c1ea964520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.933+0000 7ff98a800640 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea964520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.933+0000 7ff98a800640 1 -- 172.21.15.40:0/3152746224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1ea62ab00 con 0x55c1ea5bf520 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.933+0000 7ff98a800640 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 0x55c1ea963fe0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff984009900 tx=0x7ff984004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b31ac4b478f85f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.934+0000 7ff977400640 1 -- 172.21.15.40:0/3152746224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984035030 con 0x55c1ea5bf520 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.934+0000 7ff977400640 1 -- 172.21.15.40:0/3152746224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff984005de0 con 0x55c1ea5bf520 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.934+0000 7ff977400640 1 -- 172.21.15.40:0/3152746224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98403ca50 con 0x55c1ea5bf520 2024-07-26T13:06:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.934+0000 7ff982a00640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9700b3d20 0x7ff9700b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.934+0000 7ff982a00640 1 -- 172.21.15.40:0/1391237269 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9780e3230 con 0x7ff98c06c100 2024-07-26T13:06:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff989e00640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9700b3d20 0x7ff9700b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 -- 172.21.15.40:0/3152746224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 msgr2=0x55c1ea963fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 0x55c1ea963fe0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff984009900 tx=0x7ff984004310 comp rx=0 tx=0).stop 2024-07-26T13:06:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 -- 172.21.15.40:0/3152746224 shutdown_connections 2024-07-26T13:06:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea59e840 0x55c1ea964a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea964520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 --2- 172.21.15.40:0/3152746224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea5bf520 0x55c1ea963fe0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 -- 172.21.15.40:0/3152746224 >> 172.21.15.40:0/3152746224 conn(0x55c1ea5b3910 msgr2=0x55c1ea961ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 -- 172.21.15.40:0/3152746224 shutdown_connections 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.935+0000 7ff997c08740 1 -- 172.21.15.40:0/3152746224 wait complete. 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.936+0000 7ff989e00640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9700b3d20 0x7ff9700b6230 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55c1ea962c60 tx=0x7ff97c00a490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.936+0000 7ff997c08740 1 -- start start 2024-07-26T13:06:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.936+0000 7ff997c08740 1 Processor -- start 2024-07-26T13:06:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea596660 0x55c1ea96f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea96fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea5bf520 0x55c1ea97ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea72dbb0 con 0x55c1ea59e840 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea866930 con 0x55c1ea5bf520 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c1ea972760 con 0x55c1ea596660 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff997c08740 10 client.0 _ll_register_callbacks cb 0x55c1ea5d6d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea96fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea96fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33234/0 (socket says 172.21.15.40:33234) 2024-07-26T13:06:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff989400640 1 -- 172.21.15.40:0/2925459241 learned_addr learned my addr 172.21.15.40:0/2925459241 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.937+0000 7ff989e00640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea596660 0x55c1ea96f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff98a800640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea5bf520 0x55c1ea97ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff989400640 1 -- 172.21.15.40:0/2925459241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea596660 msgr2=0x55c1ea96f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff989400640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea596660 0x55c1ea96f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff989400640 1 -- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea5bf520 msgr2=0x55c1ea97ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff989400640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea5bf520 0x55c1ea97ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff989400640 1 -- 172.21.15.40:0/2925459241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1ea6a1960 con 0x55c1ea59e840 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff989400640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea96fc60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff9780a6200 tx=0x7ff9780a99b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac5881dd1c10fc9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff96be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:06:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff96be00640 1 -- 172.21.15.40:0/2925459241 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9780ae780 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff96be00640 1 -- 172.21.15.40:0/2925459241 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9780a6410 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.938+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c1ea8dcea0 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff96be00640 1 -- 172.21.15.40:0/2925459241 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff9780b3230 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 10 client.17181 fetch_fsmap learned FSMap version 35 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c1ea97e4d0 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff96be00640 1 -- 172.21.15.40:0/2925459241 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c1ea8dcea0 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff96be00640 1 -- 172.21.15.40:0/2925459241 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ff9780a5af0 con 0x55c1ea59e840 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 10 client.17181 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 10 client.17181 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:06:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 20 client.17181 populate_metadata read hostname 'smithi040' 2024-07-26T13:06:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea57dea0 0x55c1ea9818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 4 client.17181 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:06:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.939+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1ea8d8940 con 0x55c1ea57dea0 2024-07-26T13:06:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.940+0000 7ff989e00640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea57dea0 0x55c1ea9818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.941+0000 7ff989e00640 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea57dea0 0x55c1ea9818f0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14cf564a1d172663 server_cookie=9f4bda185c8a0386 in_seq=0 out_seq=0 2024-07-26T13:06:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.941+0000 7ff96be00640 10 client.17181 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.943+0000 7ff96be00640 1 -- 172.21.15.40:0/2925459241 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1ea8d8940 con 0x55c1ea57dea0 2024-07-26T13:06:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.943+0000 7ff96be00640 10 client.17181 handle_command_reply: tid=0 2024-07-26T13:06:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.943+0000 7ff997c08740 1 client.17181 shutdown 2024-07-26T13:06:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.943+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 msgr2=0x55c1ea96fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:15.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.943+0000 7ff997c08740 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea96fc60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff9780a6200 tx=0x7ff9780a99b0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 shutdown_connections 2024-07-26T13:06:15.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea5bf520 0x55c1ea97ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea57dea0 0x55c1ea9818f0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea96fc60 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 --2- 172.21.15.40:0/2925459241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea596660 0x55c1ea96f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 >> 172.21.15.40:0/2925459241 conn(0x55c1ea5b3910 msgr2=0x55c1ea9671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff96be00640 0 client.17181 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 shutdown_connections 2024-07-26T13:06:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 1 -- 172.21.15.40:0/2925459241 wait complete. 2024-07-26T13:06:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.944+0000 7ff997c08740 20 client.17181 trim_cache size 0 max 16384 2024-07-26T13:06:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.963+0000 7ff997c08740 1 Processor -- start 2024-07-26T13:06:15.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.963+0000 7ff997c08740 1 -- start start 2024-07-26T13:06:15.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff997c08740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea967680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff997c08740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea971600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff997c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea97b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff997c08740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1bdbd0 con 0x55c1ea59e840 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff997c08740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1bf710 con 0x55c1ea596660 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff997c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1be2a0 con 0x55c1ea5bf520 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea971600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea971600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33240/0 (socket says 172.21.15.40:33240) 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff989400640 1 -- 172.21.15.40:0/64773541 learned_addr learned my addr 172.21.15.40:0/64773541 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff989e00640 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea967680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.964+0000 7ff98a800640 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea97b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff989400640 1 -- 172.21.15.40:0/64773541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 msgr2=0x55c1ea97b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff989400640 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea97b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff989400640 1 -- 172.21.15.40:0/64773541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 msgr2=0x55c1ea967680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff989400640 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea967680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff989400640 1 -- 172.21.15.40:0/64773541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1ea9662d0 con 0x55c1ea59e840 2024-07-26T13:06:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff98a800640 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea97b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff989400640 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea971600 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff9780aa110 tx=0x7ff9780a9a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccff59ddecd8af0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff976a00640 1 -- 172.21.15.40:0/64773541 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9780ae780 con 0x55c1ea59e840 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff976a00640 1 -- 172.21.15.40:0/64773541 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9780a6770 con 0x55c1ea59e840 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.965+0000 7ff976a00640 1 -- 172.21.15.40:0/64773541 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9780a6410 con 0x55c1ea59e840 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 -- 172.21.15.40:0/64773541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 msgr2=0x55c1ea971600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea971600 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff9780aa110 tx=0x7ff9780a9a20 comp rx=0 tx=0).stop 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 -- 172.21.15.40:0/64773541 shutdown_connections 2024-07-26T13:06:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea97b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea971600 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 --2- 172.21.15.40:0/64773541 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea967680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.966+0000 7ff997c08740 1 -- 172.21.15.40:0/64773541 >> 172.21.15.40:0/64773541 conn(0x55c1ea5b3910 msgr2=0x55c1ea965630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.967+0000 7ff997c08740 1 -- 172.21.15.40:0/64773541 shutdown_connections 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.967+0000 7ff997c08740 1 -- 172.21.15.40:0/64773541 wait complete. 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.967+0000 7ff997c08740 1 -- start start 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.967+0000 7ff997c08740 1 Processor -- start 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea9779c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea977f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea972970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1bf040 con 0x55c1ea59e840 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1be970 con 0x55c1ea596660 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1bbb90 con 0x55c1ea5bf520 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff997c08740 10 client.0 _ll_register_callbacks cb 0x7ff9780092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea977f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff989400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea977f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33242/0 (socket says 172.21.15.40:33242) 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff989400640 1 -- 172.21.15.40:0/361424730 learned_addr learned my addr 172.21.15.40:0/361424730 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.968+0000 7ff989e00640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea9779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff98a800640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea972970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff989400640 1 -- 172.21.15.40:0/361424730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 msgr2=0x55c1ea972970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff989400640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea972970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff989400640 1 -- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 msgr2=0x55c1ea9779c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff989400640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea9779c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff989400640 1 -- 172.21.15.40:0/361424730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1ea978640 con 0x55c1ea59e840 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff989400640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea977f00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff9780a6940 tx=0x7ff978000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b2e4a3f2b8a72 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff96be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff96be00640 1 -- 172.21.15.40:0/361424730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9780ae780 con 0x55c1ea59e840 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff96be00640 1 -- 172.21.15.40:0/361424730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9780a5af0 con 0x55c1ea59e840 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.969+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9780a6770 con 0x55c1ea59e840 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff96be00640 1 -- 172.21.15.40:0/361424730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff9780a93e0 con 0x55c1ea59e840 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 10 client.17187 fetch_fsmap learned FSMap version 35 2024-07-26T13:06:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c1ea9ea620 con 0x55c1ea59e840 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff96be00640 1 -- 172.21.15.40:0/361424730 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9780a6770 con 0x55c1ea59e840 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff96be00640 1 -- 172.21.15.40:0/361424730 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ff9780a9580 con 0x55c1ea59e840 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 10 client.17187 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 10 client.17187 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 20 client.17187 populate_metadata read hostname 'smithi040' 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea553250 0x55c1ea9ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 4 client.17187 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bd5e9083", "release": true, "await": true}] 2024-07-26T13:06:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.970+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bd5e9083", "release": true, "await": true}) -- 0x55c1ea8d6080 con 0x55c1ea553250 2024-07-26T13:06:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.971+0000 7ff989e00640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea553250 0x55c1ea9ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.972+0000 7ff989e00640 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea553250 0x55c1ea9ecb00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c4535979693506 server_cookie=60382adc8e2ce42e in_seq=0 out_seq=0 2024-07-26T13:06:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:15.972+0000 7ff96be00640 10 client.17187 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.026+0000 7ff96be00640 1 -- 172.21.15.40:0/361424730 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55c1ea8d6080 con 0x55c1ea553250 2024-07-26T13:06:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.026+0000 7ff96be00640 10 client.17187 handle_command_reply: tid=0 2024-07-26T13:06:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.026+0000 7ff997c08740 1 client.17187 shutdown 2024-07-26T13:06:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 msgr2=0x55c1ea977f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea977f00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff9780a6940 tx=0x7ff978000bc0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 shutdown_connections 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c1ea5bf520 0x55c1ea972970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c1ea553250 0x55c1ea9ecb00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c1ea59e840 0x55c1ea977f00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 --2- 172.21.15.40:0/361424730 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1ea596660 0x55c1ea9779c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 >> 172.21.15.40:0/361424730 conn(0x55c1ea5b3910 msgr2=0x55c1ea971590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.027+0000 7ff96be00640 0 client.17187 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.028+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 shutdown_connections 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.028+0000 7ff997c08740 1 -- 172.21.15.40:0/361424730 wait complete. 2024-07-26T13:06:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.028+0000 7ff997c08740 20 client.17187 trim_cache size 0 max 16384 2024-07-26T13:06:16.031 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:06:16.031 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:06:16.031 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:06:16.031 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 144, 2024-07-26T13:06:16.031 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:06:16.031 INFO:teuthology.orchestra.run.smithi040.stdout: "bd5e9083": { 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 144, 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.2, 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:06:16.032 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:16.033 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:06:16.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.029+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9700b3d20 msgr2=0x7ff9700b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:16.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.029+0000 7ff991000640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9700b3d20 0x7ff9700b6230 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55c1ea962c60 tx=0x7ff97c00a490 comp rx=0 tx=0).stop 2024-07-26T13:06:16.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.029+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 msgr2=0x7ff98c1a91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:16.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.029+0000 7ff991000640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c1a91c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff978006fd0 tx=0x7ff97800b8e0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 shutdown_connections 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff98c1108d0 0x7ff98c1ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff98c06c100 0x7ff98c1a91c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff9700b3d20 0x7ff9700b6230 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 --2- 172.21.15.40:0/1391237269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff98c06b6a0 0x7ff98c1a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 >> 172.21.15.40:0/1391237269 conn(0x7ff98c06e360 msgr2=0x7ff98c10d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.030+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 shutdown_connections 2024-07-26T13:06:16.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:16.031+0000 7ff991000640 1 -- 172.21.15.40:0/1391237269 wait complete. 2024-07-26T13:06:16.851 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bd5e9083', total seconds elapsed: 30.9 2024-07-26T13:06:16.851 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.25 2024-07-26T13:06:16.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:06:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:16 smithi040 ceph-mon[32397]: pgmap v1820: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:06:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:16 smithi146 ceph-mon[35807]: pgmap v1820: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:06:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:16 smithi076 ceph-mon[35401]: pgmap v1820: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:06:17.342 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:06:19.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:18 smithi040 ceph-mon[32397]: pgmap v1821: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:06:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:18 smithi146 ceph-mon[35807]: pgmap v1821: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:06:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:18 smithi076 ceph-mon[35401]: pgmap v1821: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:06:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 -- 172.21.15.40:0/3787537000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b010d6a0 msgr2=0x7f65b010fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 --2- 172.21.15.40:0/3787537000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b010d6a0 0x7f65b010fb90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009ca0 tx=0x7f65a802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 -- 172.21.15.40:0/3787537000 shutdown_connections 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 --2- 172.21.15.40:0/3787537000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b010d6a0 0x7f65b010fb90 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 --2- 172.21.15.40:0/3787537000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65b0104b90 0x7f65b010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 --2- 172.21.15.40:0/3787537000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b0104240 0x7f65b0104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 -- 172.21.15.40:0/3787537000 >> 172.21.15.40:0/3787537000 conn(0x7f65b00fdd80 msgr2=0x7f65b01001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 -- 172.21.15.40:0/3787537000 shutdown_connections 2024-07-26T13:06:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.745+0000 7f65b4c00640 1 -- 172.21.15.40:0/3787537000 wait complete. 2024-07-26T13:06:19.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.746+0000 7f65b4c00640 1 Processor -- start 2024-07-26T13:06:19.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 -- start start 2024-07-26T13:06:19.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65b0104240 0x7f65b0101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:19.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 0x7f65b01024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b010d6a0 0x7f65b0102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0113230 con 0x7f65b0104b90 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f65b01130b0 con 0x7f65b010d6a0 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65b4c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65b01133b0 con 0x7f65b0104240 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.747+0000 7f65a6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 0x7f65b01024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 0x7f65b01024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33260/0 (socket says 172.21.15.40:33260) 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 -- 172.21.15.40:0/1978631969 learned_addr learned my addr 172.21.15.40:0/1978631969 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:19.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65af400640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65b0104240 0x7f65b0101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65afe00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b010d6a0 0x7f65b0102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 -- 172.21.15.40:0/1978631969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65b0104240 msgr2=0x7f65b0101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65b0104240 0x7f65b0101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 -- 172.21.15.40:0/1978631969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b010d6a0 msgr2=0x7f65b0102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b010d6a0 0x7f65b0102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.748+0000 7f65a6a00640 1 -- 172.21.15.40:0/1978631969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b01a7ec0 con 0x7f65b0104b90 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.749+0000 7f65a6a00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 0x7f65b01024c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f659800d750 tx=0x7f659800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:19.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.749+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598017070 con 0x7f65b0104b90 2024-07-26T13:06:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.749+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b01a81b0 con 0x7f65b0104b90 2024-07-26T13:06:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.749+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65980054b0 con 0x7f65b0104b90 2024-07-26T13:06:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.749+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598004bc0 con 0x7f65b0104b90 2024-07-26T13:06:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.749+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b01a86f0 con 0x7f65b0104b90 2024-07-26T13:06:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.751+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b0104650 con 0x7f65b0104b90 2024-07-26T13:06:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.754+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6598009c30 con 0x7f65b0104b90 2024-07-26T13:06:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.756+0000 7f65acc00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65900b3c50 0x7f65900b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.756+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65980e39f0 con 0x7f65b0104b90 2024-07-26T13:06:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.756+0000 7f65af400640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65900b3c50 0x7f65900b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.757+0000 7f65af400640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65900b3c50 0x7f65900b6160 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f65b01039d0 tx=0x7f65a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:19.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:19.758+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f65980ab080 con 0x7f65b0104b90 2024-07-26T13:06:20.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.055+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65b01a8a20 con 0x7f65b0104b90 2024-07-26T13:06:20.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.057+0000 7f65acc00640 1 -- 172.21.15.40:0/1978631969 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f65980aa980 con 0x7f65b0104b90 2024-07-26T13:06:20.059 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:06:20.059 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:06:20.060 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:06:20.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.060+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65900b3c50 msgr2=0x7f65900b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:20.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.060+0000 7f65b4c00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65900b3c50 0x7f65900b6160 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f65b01039d0 tx=0x7f65a000b390 comp rx=0 tx=0).stop 2024-07-26T13:06:20.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.060+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 msgr2=0x7f65b01024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:20.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.060+0000 7f65b4c00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 0x7f65b01024c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f659800d750 tx=0x7f659800dc10 comp rx=0 tx=0).stop 2024-07-26T13:06:20.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 shutdown_connections 2024-07-26T13:06:20.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b010d6a0 0x7f65b0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:20.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b0104b90 0x7f65b01024c0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:20.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f65900b3c50 0x7f65900b6160 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:20.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 --2- 172.21.15.40:0/1978631969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65b0104240 0x7f65b0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:20.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 >> 172.21.15.40:0/1978631969 conn(0x7f65b00fdd80 msgr2=0x7f65b01071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:20.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 shutdown_connections 2024-07-26T13:06:20.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:20.061+0000 7f65b4c00640 1 -- 172.21.15.40:0/1978631969 wait complete. 2024-07-26T13:06:20.972 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0' 2024-07-26T13:06:20.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 143.25 --await-for 45.0 2024-07-26T13:06:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:20 smithi040 ceph-mon[32397]: pgmap v1822: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 551 KiB/s wr, 11 op/s 2024-07-26T13:06:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:20 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1978631969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:20 smithi146 ceph-mon[35807]: pgmap v1822: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 551 KiB/s wr, 11 op/s 2024-07-26T13:06:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:20 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1978631969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:20 smithi076 ceph-mon[35401]: pgmap v1822: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 551 KiB/s wr, 11 op/s 2024-07-26T13:06:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:20 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1978631969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:21.518 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:06:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:22 smithi040 ceph-mon[32397]: pgmap v1823: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T13:06:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:22 smithi146 ceph-mon[35807]: pgmap v1823: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T13:06:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:22 smithi076 ceph-mon[35401]: pgmap v1823: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-07-26T13:06:23.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.895+0000 7f2853a00640 1 -- 172.21.15.40:0/559667260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 msgr2=0x7f284c110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.895+0000 7f2853a00640 1 --2- 172.21.15.40:0/559667260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c110070 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2844009ca0 tx=0x7f284402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.895+0000 7f2853a00640 1 -- 172.21.15.40:0/559667260 shutdown_connections 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.895+0000 7f2853a00640 1 --2- 172.21.15.40:0/559667260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c110070 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.895+0000 7f2853a00640 1 --2- 172.21.15.40:0/559667260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 0x7f284c109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.896+0000 7f2853a00640 1 --2- 172.21.15.40:0/559667260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f284c1035b0 0x7f284c1039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.896+0000 7f2853a00640 1 -- 172.21.15.40:0/559667260 >> 172.21.15.40:0/559667260 conn(0x7f284c0fefe0 msgr2=0x7f284c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.896+0000 7f2853a00640 1 -- 172.21.15.40:0/559667260 shutdown_connections 2024-07-26T13:06:23.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.896+0000 7f2853a00640 1 -- 172.21.15.40:0/559667260 wait complete. 2024-07-26T13:06:23.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.897+0000 7f2853a00640 1 Processor -- start 2024-07-26T13:06:23.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.897+0000 7f2853a00640 1 -- start start 2024-07-26T13:06:23.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2853a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f284c1035b0 0x7f284c076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2853a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 0x7f284c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2853a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2853a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f284c113410 con 0x7f284c109840 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2853a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f284c113290 con 0x7f284c108ef0 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2853a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f284c113590 con 0x7f284c1035b0 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2851a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2851a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47956/0 (socket says 172.21.15.40:47956) 2024-07-26T13:06:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.898+0000 7f2851a00640 1 -- 172.21.15.40:0/3250997182 learned_addr learned my addr 172.21.15.40:0/3250997182 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f2851000640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f284c1035b0 0x7f284c076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f284be00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 0x7f284c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f2851a00640 1 -- 172.21.15.40:0/3250997182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f284c1035b0 msgr2=0x7f284c076b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f2851a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f284c1035b0 0x7f284c076b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f2851a00640 1 -- 172.21.15.40:0/3250997182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 msgr2=0x7f284c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f2851a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 0x7f284c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.899+0000 7f2851a00640 1 -- 172.21.15.40:0/3250997182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c075ea0 con 0x7f284c109840 2024-07-26T13:06:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.900+0000 7f284be00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 0x7f284c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.900+0000 7f2851a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c075680 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2844031040 tx=0x7f2844032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.900+0000 7f2849600640 1 -- 172.21.15.40:0/3250997182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844004040 con 0x7f284c109840 2024-07-26T13:06:23.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.900+0000 7f2849600640 1 -- 172.21.15.40:0/3250997182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2844004670 con 0x7f284c109840 2024-07-26T13:06:23.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.901+0000 7f2849600640 1 -- 172.21.15.40:0/3250997182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844030bb0 con 0x7f284c109840 2024-07-26T13:06:23.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.901+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c1ac720 con 0x7f284c109840 2024-07-26T13:06:23.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.901+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284c1acc10 con 0x7f284c109840 2024-07-26T13:06:23.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.905+0000 7f285a5e0740 1 Processor -- start 2024-07-26T13:06:23.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.905+0000 7f2849600640 1 -- 172.21.15.40:0/3250997182 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f28440041e0 con 0x7f284c109840 2024-07-26T13:06:23.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.905+0000 7f285a5e0740 1 -- start start 2024-07-26T13:06:23.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd65a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd28a990 0x558bcd65a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd65ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f285a5e0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558bcd5ce8a0 con 0x558bcd2b3850 2024-07-26T13:06:23.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f285a5e0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558bcd5bdda0 con 0x558bcd292b70 2024-07-26T13:06:23.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f285a5e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558bcd5c1de0 con 0x558bcd28a990 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f284be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd65a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.906+0000 7f284be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd65a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47970/0 (socket says 172.21.15.40:47970) 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 -- 172.21.15.40:0/2742947129 learned_addr learned my addr 172.21.15.40:0/2742947129 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f2851000640 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd28a990 0x558bcd65a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd65ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 -- 172.21.15.40:0/2742947129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd28a990 msgr2=0x558bcd65a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd28a990 0x558bcd65a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 -- 172.21.15.40:0/2742947129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 msgr2=0x558bcd65ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd65ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.907+0000 7f284be00640 1 -- 172.21.15.40:0/2742947129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bcd552b70 con 0x558bcd2b3850 2024-07-26T13:06:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.908+0000 7f284be00640 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd65a2a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f28380135e0 tx=0x7f283800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd3d7ff12c5a38f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.908+0000 7f2849600640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28340b3bd0 0x7f28340b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.908+0000 7f2849600640 1 -- 172.21.15.40:0/3250997182 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2844105310 con 0x7f284c109840 2024-07-26T13:06:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.908+0000 7f2851000640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28340b3bd0 0x7f28340b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.909+0000 7f2851000640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28340b3bd0 0x7f28340b60e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x558bcd658f20 tx=0x7f284000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.912+0000 7f283e000640 1 -- 172.21.15.40:0/2742947129 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838019030 con 0x558bcd2b3850 2024-07-26T13:06:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.912+0000 7f283e000640 1 -- 172.21.15.40:0/2742947129 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2838011950 con 0x558bcd2b3850 2024-07-26T13:06:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.912+0000 7f283e000640 1 -- 172.21.15.40:0/2742947129 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283801d880 con 0x558bcd2b3850 2024-07-26T13:06:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.913+0000 7f285a5e0740 1 -- 172.21.15.40:0/2742947129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 msgr2=0x558bcd65a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.913+0000 7f285a5e0740 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd65a2a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f28380135e0 tx=0x7f283800b6d0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 -- 172.21.15.40:0/2742947129 shutdown_connections 2024-07-26T13:06:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd65ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd28a990 0x558bcd65a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 --2- 172.21.15.40:0/2742947129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd65a2a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 -- 172.21.15.40:0/2742947129 >> 172.21.15.40:0/2742947129 conn(0x558bcd2a7c40 msgr2=0x558bcd658190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 -- 172.21.15.40:0/2742947129 shutdown_connections 2024-07-26T13:06:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.914+0000 7f285a5e0740 1 -- 172.21.15.40:0/2742947129 wait complete. 2024-07-26T13:06:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.915+0000 7f285a5e0740 1 -- start start 2024-07-26T13:06:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.915+0000 7f285a5e0740 1 Processor -- start 2024-07-26T13:06:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.915+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd665e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.915+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd6663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.915+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd2b3850 0x558bcd671d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f285a5e0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558bcd4217b0 con 0x558bcd28a990 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f285a5e0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558bcd55a380 con 0x558bcd2b3850 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f285a5e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558bcd668a80 con 0x558bcd292b70 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f285a5e0740 10 client.0 _ll_register_callbacks cb 0x558bcd569830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f2851000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd665e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f2851000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd665e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47980/0 (socket says 172.21.15.40:47980) 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f2851000640 1 -- 172.21.15.40:0/1274557019 learned_addr learned my addr 172.21.15.40:0/1274557019 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f284be00640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd6663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.916+0000 7f2851a00640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd2b3850 0x558bcd671d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2851000640 1 -- 172.21.15.40:0/1274557019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 msgr2=0x558bcd6663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2851000640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd6663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2851000640 1 -- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd2b3850 msgr2=0x558bcd671d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2851000640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd2b3850 0x558bcd671d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2851000640 1 -- 172.21.15.40:0/1274557019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bcd32dba0 con 0x558bcd28a990 2024-07-26T13:06:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2851000640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd665e70 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2840003dd0 tx=0x7f2840004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2127608cbc138a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.917+0000 7f2832a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:06:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.918+0000 7f2832a00640 1 -- 172.21.15.40:0/1274557019 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284002c060 con 0x558bcd28a990 2024-07-26T13:06:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.918+0000 7f2832a00640 1 -- 172.21.15.40:0/1274557019 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2840017030 con 0x558bcd28a990 2024-07-26T13:06:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.918+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2838011950 con 0x558bcd28a990 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.918+0000 7f2832a00640 1 -- 172.21.15.40:0/1274557019 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2840027410 con 0x558bcd28a990 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.918+0000 7f285a5e0740 10 client.17205 fetch_fsmap learned FSMap version 35 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.918+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558bcd674b00 con 0x558bcd28a990 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f2832a00640 1 -- 172.21.15.40:0/1274557019 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2838011950 con 0x558bcd28a990 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f2832a00640 1 -- 172.21.15.40:0/1274557019 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2840031070 con 0x558bcd28a990 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f285a5e0740 10 client.17205 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f285a5e0740 10 client.17205 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f285a5e0740 20 client.17205 populate_metadata read hostname 'smithi040' 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd2721d0 0x558bcd678030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f285a5e0740 4 client.17205 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:06:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.919+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bcd5d07f0 con 0x558bcd2721d0 2024-07-26T13:06:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.920+0000 7f284be00640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd2721d0 0x558bcd678030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.921+0000 7f284be00640 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd2721d0 0x558bcd678030 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32532588983e69e0 server_cookie=9a875d65efee9b89 in_seq=0 out_seq=0 2024-07-26T13:06:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.921+0000 7f2832a00640 10 client.17205 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f2832a00640 1 -- 172.21.15.40:0/1274557019 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bcd5d07f0 con 0x558bcd2721d0 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f2832a00640 10 client.17205 handle_command_reply: tid=0 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 client.17205 shutdown 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 msgr2=0x558bcd665e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd665e70 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2840003dd0 tx=0x7f2840004730 comp rx=0 tx=0).stop 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 shutdown_connections 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd2b3850 0x558bcd671d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd6663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd2721d0 0x558bcd678030 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1274557019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd665e70 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 >> 172.21.15.40:0/1274557019 conn(0x558bcd2a7c40 msgr2=0x558bcd656910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.923+0000 7f2832a00640 0 client.17205 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.924+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 shutdown_connections 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.924+0000 7f285a5e0740 1 -- 172.21.15.40:0/1274557019 wait complete. 2024-07-26T13:06:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.924+0000 7f285a5e0740 20 client.17205 trim_cache size 0 max 16384 2024-07-26T13:06:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.943+0000 7f285a5e0740 1 Processor -- start 2024-07-26T13:06:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.943+0000 7f285a5e0740 1 -- start start 2024-07-26T13:06:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd28a990 0x558bcd6644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd671b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd6720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f285a5e0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b5380 con 0x558bcd2b3850 2024-07-26T13:06:23.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f285a5e0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b6ec0 con 0x558bcd28a990 2024-07-26T13:06:23.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f285a5e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b5a50 con 0x558bcd292b70 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f2851a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd6720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f2851a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd6720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47988/0 (socket says 172.21.15.40:47988) 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f2851a00640 1 -- 172.21.15.40:0/3095346138 learned_addr learned my addr 172.21.15.40:0/3095346138 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f2851000640 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd28a990 0x558bcd6644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.944+0000 7f284be00640 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd671b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851a00640 1 -- 172.21.15.40:0/3095346138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 msgr2=0x558bcd671b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851a00640 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd671b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851a00640 1 -- 172.21.15.40:0/3095346138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd28a990 msgr2=0x558bcd6644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851a00640 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd28a990 0x558bcd6644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851a00640 1 -- 172.21.15.40:0/3095346138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bcd656ff0 con 0x558bcd2b3850 2024-07-26T13:06:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851000640 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd28a990 0x558bcd6644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f2851a00640 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd6720a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f28440c9490 tx=0x7f2844030640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1e30dad3bbf7dd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f283d600640 1 -- 172.21.15.40:0/3095346138 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844009540 con 0x558bcd2b3850 2024-07-26T13:06:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f283d600640 1 -- 172.21.15.40:0/3095346138 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28440e6070 con 0x558bcd2b3850 2024-07-26T13:06:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.945+0000 7f283d600640 1 -- 172.21.15.40:0/3095346138 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28440d0820 con 0x558bcd2b3850 2024-07-26T13:06:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.946+0000 7f285a5e0740 1 -- 172.21.15.40:0/3095346138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 msgr2=0x558bcd6720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.946+0000 7f285a5e0740 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd6720a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f28440c9490 tx=0x7f2844030640 comp rx=0 tx=0).stop 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 -- 172.21.15.40:0/3095346138 shutdown_connections 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd2b3850 0x558bcd6720a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd292b70 0x558bcd671b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 --2- 172.21.15.40:0/3095346138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd28a990 0x558bcd6644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 -- 172.21.15.40:0/3095346138 >> 172.21.15.40:0/3095346138 conn(0x558bcd2a7c40 msgr2=0x558bcd65f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 -- 172.21.15.40:0/3095346138 shutdown_connections 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 -- 172.21.15.40:0/3095346138 wait complete. 2024-07-26T13:06:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.947+0000 7f285a5e0740 1 -- start start 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 Processor -- start 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd669cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd66a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd2b3850 0x558bcd66a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b67f0 con 0x558bcd28a990 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b6120 con 0x558bcd292b70 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b3340 con 0x558bcd2b3850 2024-07-26T13:06:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.948+0000 7f285a5e0740 10 client.0 _ll_register_callbacks cb 0x7f2840003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:06:23.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd669cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd669cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47996/0 (socket says 172.21.15.40:47996) 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 -- 172.21.15.40:0/1330161104 learned_addr learned my addr 172.21.15.40:0/1330161104 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f284be00640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd66a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851a00640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd2b3850 0x558bcd66a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 -- 172.21.15.40:0/1330161104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd2b3850 msgr2=0x558bcd66a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd2b3850 0x558bcd66a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 -- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 msgr2=0x558bcd66a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.949+0000 7f2851000640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd66a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f2851000640 1 -- 172.21.15.40:0/1330161104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bcd6df920 con 0x558bcd28a990 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f2851a00640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd2b3850 0x558bcd66a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f2851000640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd669cf0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2840006010 tx=0x7f2840011fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a40a1970984f93 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f2832a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:06:23.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f2832a00640 1 -- 172.21.15.40:0/1330161104 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840037070 con 0x558bcd28a990 2024-07-26T13:06:23.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f2832a00640 1 -- 172.21.15.40:0/1330161104 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2840004bb0 con 0x558bcd28a990 2024-07-26T13:06:23.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.950+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28440e6070 con 0x558bcd28a990 2024-07-26T13:06:23.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f2832a00640 1 -- 172.21.15.40:0/1330161104 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f284002c020 con 0x558bcd28a990 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f285a5e0740 10 client.17211 fetch_fsmap learned FSMap version 35 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558bcd6e0c10 con 0x558bcd28a990 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f2832a00640 1 -- 172.21.15.40:0/1330161104 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28440e6070 con 0x558bcd28a990 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f2832a00640 1 -- 172.21.15.40:0/1330161104 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2840031040 con 0x558bcd28a990 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f285a5e0740 10 client.17211 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f285a5e0740 10 client.17211 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f285a5e0740 20 client.17211 populate_metadata read hostname 'smithi040' 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.951+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd247580 0x558bcd6e3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.952+0000 7f285a5e0740 4 client.17211 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}] 2024-07-26T13:06:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.952+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.25, "await_for": 45.0}) -- 0x558bcd5cc290 con 0x558bcd247580 2024-07-26T13:06:23.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.954+0000 7f284be00640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd247580 0x558bcd6e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:23.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.955+0000 7f284be00640 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd247580 0x558bcd6e3470 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa7dd440cc1ef6 server_cookie=faaed4a96d6008c5 in_seq=0 out_seq=0 2024-07-26T13:06:23.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:23.955+0000 7f2832a00640 10 client.17211 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:24.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.233+0000 7f2832a00640 1 -- 172.21.15.40:0/1330161104 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x558bcd5cc290 con 0x558bcd247580 2024-07-26T13:06:24.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.233+0000 7f2832a00640 10 client.17211 handle_command_reply: tid=0 2024-07-26T13:06:24.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.233+0000 7f285a5e0740 1 client.17211 shutdown 2024-07-26T13:06:24.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 msgr2=0x558bcd669cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:24.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd669cf0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2840006010 tx=0x7f2840011fa0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 shutdown_connections 2024-07-26T13:06:24.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558bcd2b3850 0x558bcd66a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558bcd292b70 0x558bcd66a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558bcd247580 0x558bcd6e3470 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 --2- 172.21.15.40:0/1330161104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558bcd28a990 0x558bcd669cf0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 >> 172.21.15.40:0/1330161104 conn(0x558bcd2a7c40 msgr2=0x558bcd6644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.234+0000 7f2832a00640 0 client.17211 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:24.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.235+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 shutdown_connections 2024-07-26T13:06:24.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.235+0000 7f285a5e0740 1 -- 172.21.15.40:0/1330161104 wait complete. 2024-07-26T13:06:24.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.235+0000 7f285a5e0740 20 client.17211 trim_cache size 0 max 16384 2024-07-26T13:06:24.240 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:06:24.240 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:06:24.240 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:06:24.240 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 146, 2024-07-26T13:06:24.241 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:06:24.241 INFO:teuthology.orchestra.run.smithi040.stdout: "963c948c": { 2024-07-26T13:06:24.241 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 146, 2024-07-26T13:06:24.241 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:06:24.241 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:06:24.241 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:06:24.242 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:06:24.242 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:06:24.242 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:06:24.242 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.2, 2024-07-26T13:06:24.242 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:06:24.243 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:06:24.243 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:06:24.243 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:06:24.243 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:06:24.243 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:06:24.243 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:24.244 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:24.244 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:24.244 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:24.244 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:24.244 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:06:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28340b3bd0 msgr2=0x7f28340b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28340b3bd0 0x7f28340b60e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x558bcd658f20 tx=0x7f284000b390 comp rx=0 tx=0).stop 2024-07-26T13:06:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 msgr2=0x7f284c075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c075680 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2844031040 tx=0x7f2844032bc0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 shutdown_connections 2024-07-26T13:06:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c109840 0x7f284c075680 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f284c108ef0 0x7f284c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f28340b3bd0 0x7f28340b60e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 --2- 172.21.15.40:0/3250997182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f284c1035b0 0x7f284c076b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.237+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 >> 172.21.15.40:0/3250997182 conn(0x7f284c0fefe0 msgr2=0x7f284c1084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:24.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.238+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 shutdown_connections 2024-07-26T13:06:24.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:24.238+0000 7f2853a00640 1 -- 172.21.15.40:0/3250997182 wait complete. 2024-07-26T13:06:25.171 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:24 smithi040 ceph-mon[32397]: pgmap v1824: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:06:25.175 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '963c948c', quiesce took 8.3 seconds. Will release after: 14.95 2024-07-26T13:06:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:24 smithi146 ceph-mon[35807]: pgmap v1824: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:06:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:24 smithi076 ceph-mon[35401]: pgmap v1824: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:06:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:06:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:06:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:06:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:26 smithi040 ceph-mon[32397]: pgmap v1825: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-07-26T13:06:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:06:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:06:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:06:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:26 smithi146 ceph-mon[35807]: pgmap v1825: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-07-26T13:06:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:06:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:06:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:06:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:26 smithi076 ceph-mon[35401]: pgmap v1825: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 MiB/s wr, 12 op/s 2024-07-26T13:06:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:06:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:06:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:06:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:28 smithi040 ceph-mon[32397]: pgmap v1826: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:06:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:28 smithi146 ceph-mon[35807]: pgmap v1826: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:06:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:28 smithi076 ceph-mon[35401]: pgmap v1826: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:06:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:30 smithi040 ceph-mon[32397]: pgmap v1827: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.5 MiB/s wr, 14 op/s 2024-07-26T13:06:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:30 smithi146 ceph-mon[35807]: pgmap v1827: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.5 MiB/s wr, 14 op/s 2024-07-26T13:06:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:30 smithi076 ceph-mon[35401]: pgmap v1827: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.5 MiB/s wr, 14 op/s 2024-07-26T13:06:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:32 smithi040 ceph-mon[32397]: pgmap v1828: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:06:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:32 smithi146 ceph-mon[35807]: pgmap v1828: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:06:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:32 smithi076 ceph-mon[35401]: pgmap v1828: 97 pgs: 97 active+clean; 8.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:06:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:34 smithi040 ceph-mon[32397]: pgmap v1829: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-07-26T13:06:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:34 smithi146 ceph-mon[35807]: pgmap v1829: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-07-26T13:06:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:34 smithi076 ceph-mon[35401]: pgmap v1829: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-07-26T13:06:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:36 smithi040 ceph-mon[32397]: pgmap v1830: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1000 KiB/s wr, 11 op/s 2024-07-26T13:06:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:36 smithi146 ceph-mon[35807]: pgmap v1830: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1000 KiB/s wr, 11 op/s 2024-07-26T13:06:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:36 smithi076 ceph-mon[35401]: pgmap v1830: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1000 KiB/s wr, 11 op/s 2024-07-26T13:06:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:38 smithi040 ceph-mon[32397]: pgmap v1831: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1000 KiB/s wr, 10 op/s 2024-07-26T13:06:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:38 smithi146 ceph-mon[35807]: pgmap v1831: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1000 KiB/s wr, 10 op/s 2024-07-26T13:06:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:38 smithi076 ceph-mon[35401]: pgmap v1831: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1000 KiB/s wr, 10 op/s 2024-07-26T13:06:40.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:06:40.611 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:06:41.074 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:40 smithi040 ceph-mon[32397]: pgmap v1832: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 999 KiB/s wr, 12 op/s 2024-07-26T13:06:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:40 smithi146 ceph-mon[35807]: pgmap v1832: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 999 KiB/s wr, 12 op/s 2024-07-26T13:06:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:40 smithi076 ceph-mon[35401]: pgmap v1832: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 999 KiB/s wr, 12 op/s 2024-07-26T13:06:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 -- 172.21.15.40:0/3516877037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 msgr2=0x7fddbc0755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 --2- 172.21.15.40:0/3516877037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc0755f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fddac009900 tx=0x7fddac02a400 comp rx=0 tx=0).stop 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 -- 172.21.15.40:0/3516877037 shutdown_connections 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 --2- 172.21.15.40:0/3516877037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddbc10f940 0x7fddbc111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 --2- 172.21.15.40:0/3516877037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc075b30 0x7fddbc10f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 --2- 172.21.15.40:0/3516877037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc0755f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 -- 172.21.15.40:0/3516877037 >> 172.21.15.40:0/3516877037 conn(0x7fddbc0fee70 msgr2=0x7fddbc1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 -- 172.21.15.40:0/3516877037 shutdown_connections 2024-07-26T13:06:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.773+0000 7fddc1400640 1 -- 172.21.15.40:0/3516877037 wait complete. 2024-07-26T13:06:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 Processor -- start 2024-07-26T13:06:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 -- start start 2024-07-26T13:06:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc075b30 0x7fddbc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddbc10f940 0x7fddbc1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc1153d0 con 0x7fddbc0751e0 2024-07-26T13:06:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc115250 con 0x7fddbc10f940 2024-07-26T13:06:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.775+0000 7fddc1400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc115550 con 0x7fddbc075b30 2024-07-26T13:06:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc19be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38416/0 (socket says 172.21.15.40:38416) 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 -- 172.21.15.40:0/707116284 learned_addr learned my addr 172.21.15.40:0/707116284 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddc0a00640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddbc10f940 0x7fddbc1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddb3400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc075b30 0x7fddbc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 -- 172.21.15.40:0/707116284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc075b30 msgr2=0x7fddbc19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc075b30 0x7fddbc19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 -- 172.21.15.40:0/707116284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddbc10f940 msgr2=0x7fddbc1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddbc10f940 0x7fddbc1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.776+0000 7fddbbe00640 1 -- 172.21.15.40:0/707116284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc1a1d10 con 0x7fddbc0751e0 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.777+0000 7fddbbe00640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc19be60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fddac02a920 tx=0x7fddac003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.777+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac03f070 con 0x7fddbc0751e0 2024-07-26T13:06:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.777+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddac003e40 con 0x7fddbc0751e0 2024-07-26T13:06:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.777+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac035030 con 0x7fddbc0751e0 2024-07-26T13:06:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.777+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc1a1fa0 con 0x7fddbc0751e0 2024-07-26T13:06:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.777+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc1a2430 con 0x7fddbc0751e0 2024-07-26T13:06:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.778+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc0755f0 con 0x7fddbc0751e0 2024-07-26T13:06:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.781+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fddac042070 con 0x7fddbc0751e0 2024-07-26T13:06:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.783+0000 7fddb9600640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdda00b3c00 0x7fdda00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.783+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fddac104900 con 0x7fddbc0751e0 2024-07-26T13:06:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.783+0000 7fddb3400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdda00b3c00 0x7fdda00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:42.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.784+0000 7fddb3400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdda00b3c00 0x7fdda00b6110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005fd0 tx=0x7fdda4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:42.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:42.785+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fddac0cbf10 con 0x7fddbc0751e0 2024-07-26T13:06:43.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.030+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddbc1a8940 con 0x7fddbc0751e0 2024-07-26T13:06:43.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.031+0000 7fddb9600640 1 -- 172.21.15.40:0/707116284 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fddac0cb810 con 0x7fddbc0751e0 2024-07-26T13:06:43.033 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:06:43.033 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:06:43.033 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:06:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdda00b3c00 msgr2=0x7fdda00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdda00b3c00 0x7fdda00b6110 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005fd0 tx=0x7fdda4005850 comp rx=0 tx=0).stop 2024-07-26T13:06:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 msgr2=0x7fddbc19be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc19be60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fddac02a920 tx=0x7fddac003c20 comp rx=0 tx=0).stop 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 shutdown_connections 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddbc10f940 0x7fddbc1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdda00b3c00 0x7fdda00b6110 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc075b30 0x7fddbc19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 --2- 172.21.15.40:0/707116284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddbc0751e0 0x7fddbc19be60 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 >> 172.21.15.40:0/707116284 conn(0x7fddbc0fee70 msgr2=0x7fddbc109520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 shutdown_connections 2024-07-26T13:06:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:43.035+0000 7fddc1400640 1 -- 172.21.15.40:0/707116284 wait complete. 2024-07-26T13:06:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:42 smithi146 ceph-mon[35807]: pgmap v1833: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 658 KiB/s wr, 8 op/s 2024-07-26T13:06:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:42 smithi076 ceph-mon[35401]: pgmap v1833: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 658 KiB/s wr, 8 op/s 2024-07-26T13:06:43.441 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:42 smithi040 ceph-mon[32397]: pgmap v1833: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 658 KiB/s wr, 8 op/s 2024-07-26T13:06:43.843 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 963c948c --release --await' 2024-07-26T13:06:43.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 963c948c --release --await 2024-07-26T13:06:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:43 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/707116284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:43 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/707116284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:43 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/707116284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:06:44.343 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:06:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:45 smithi040 ceph-mon[32397]: pgmap v1834: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 658 KiB/s wr, 10 op/s 2024-07-26T13:06:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:45 smithi146 ceph-mon[35807]: pgmap v1834: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 658 KiB/s wr, 10 op/s 2024-07-26T13:06:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:45 smithi076 ceph-mon[35401]: pgmap v1834: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 658 KiB/s wr, 10 op/s 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 -- 172.21.15.40:0/130630686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 msgr2=0x7fa3901023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 --2- 172.21.15.40:0/130630686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901023f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa380009cd0 tx=0x7fa38002a8f0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 -- 172.21.15.40:0/130630686 shutdown_connections 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 --2- 172.21.15.40:0/130630686 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390107420 0x7fa390107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 --2- 172.21.15.40:0/130630686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390102930 0x7fa390106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 --2- 172.21.15.40:0/130630686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901023f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 -- 172.21.15.40:0/130630686 >> 172.21.15.40:0/130630686 conn(0x7fa3900fdcf0 msgr2=0x7fa390100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 -- 172.21.15.40:0/130630686 shutdown_connections 2024-07-26T13:06:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.539+0000 7fa397000640 1 -- 172.21.15.40:0/130630686 wait complete. 2024-07-26T13:06:46.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.540+0000 7fa397000640 1 Processor -- start 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.540+0000 7fa397000640 1 -- start start 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa397000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa397000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390102930 0x7fa3901a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa397000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390107420 0x7fa3901a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa397000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901197e0 con 0x7fa390101fe0 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa397000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa390119660 con 0x7fa390102930 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa397000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa390119960 con 0x7fa390107420 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa395c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa395c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41722/0 (socket says 172.21.15.40:41722) 2024-07-26T13:06:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa395c00640 1 -- 172.21.15.40:0/1729930380 learned_addr learned my addr 172.21.15.40:0/1729930380 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:46.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa395200640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390102930 0x7fa3901a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.541+0000 7fa396600640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390107420 0x7fa3901a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395c00640 1 -- 172.21.15.40:0/1729930380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390107420 msgr2=0x7fa3901a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395c00640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390107420 0x7fa3901a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395c00640 1 -- 172.21.15.40:0/1729930380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390102930 msgr2=0x7fa3901a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395c00640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390102930 0x7fa3901a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395c00640 1 -- 172.21.15.40:0/1729930380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3901a6140 con 0x7fa390101fe0 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395200640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390102930 0x7fa3901a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa396600640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390107420 0x7fa3901a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.542+0000 7fa395c00640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901a0290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa380000f80 tx=0x7fa380003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:46.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.543+0000 7fa38e000640 1 -- 172.21.15.40:0/1729930380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380004240 con 0x7fa390101fe0 2024-07-26T13:06:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.543+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3901a63d0 con 0x7fa390101fe0 2024-07-26T13:06:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.543+0000 7fa38e000640 1 -- 172.21.15.40:0/1729930380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa380040070 con 0x7fa390101fe0 2024-07-26T13:06:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.543+0000 7fa38e000640 1 -- 172.21.15.40:0/1729930380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380045ca0 con 0x7fa390101fe0 2024-07-26T13:06:46.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.543+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3901a6910 con 0x7fa390101fe0 2024-07-26T13:06:46.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.549+0000 7fa38e000640 1 -- 172.21.15.40:0/1729930380 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa380045470 con 0x7fa390101fe0 2024-07-26T13:06:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.549+0000 7fa39f27c740 1 Processor -- start 2024-07-26T13:06:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.549+0000 7fa39f27c740 1 -- start start 2024-07-26T13:06:46.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.549+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b01b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.549+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b01b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.549+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b01bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa39f27c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55cf5af91f50 con 0x55cf5ac55840 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa39f27c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cf5af81450 con 0x55cf5ac76520 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa39f27c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cf5af85490 con 0x55cf5ac4d660 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa395200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b01bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa395200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b01bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41738/0 (socket says 172.21.15.40:41738) 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa395200640 1 -- 172.21.15.40:0/3760302408 learned_addr learned my addr 172.21.15.40:0/3760302408 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa396600640 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b01b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.550+0000 7fa395c00640 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b01b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.551+0000 7fa395200640 1 -- 172.21.15.40:0/3760302408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 msgr2=0x55cf5b01b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.551+0000 7fa395200640 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b01b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.551+0000 7fa395200640 1 -- 172.21.15.40:0/3760302408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 msgr2=0x55cf5b01b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.551+0000 7fa395200640 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b01b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.551+0000 7fa395200640 1 -- 172.21.15.40:0/3760302408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf5ace1b00 con 0x55cf5ac55840 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.551+0000 7fa38e000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa3740b3c00 0x7fa3740b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.552+0000 7fa395200640 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b01bc20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00bcd0 tx=0x7fa37c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1985a535c42cbf71 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.552+0000 7fa38e000640 1 -- 172.21.15.40:0/1729930380 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa380104e50 con 0x7fa390101fe0 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.552+0000 7fa396600640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa3740b3c00 0x7fa3740b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.552+0000 7fa386a00640 1 -- 172.21.15.40:0/3760302408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c015070 con 0x55cf5ac55840 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.552+0000 7fa386a00640 1 -- 172.21.15.40:0/3760302408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa37c01a8f0 con 0x55cf5ac55840 2024-07-26T13:06:46.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.552+0000 7fa386a00640 1 -- 172.21.15.40:0/3760302408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c011870 con 0x55cf5ac55840 2024-07-26T13:06:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 -- 172.21.15.40:0/3760302408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 msgr2=0x55cf5b01bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b01bc20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00bcd0 tx=0x7fa37c00f730 comp rx=0 tx=0).stop 2024-07-26T13:06:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa396600640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa3740b3c00 0x7fa3740b6110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa38800cd20 tx=0x7fa38800c4b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 -- 172.21.15.40:0/3760302408 shutdown_connections 2024-07-26T13:06:46.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b01bc20 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b01b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 --2- 172.21.15.40:0/3760302408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b01b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.553+0000 7fa39f27c740 1 -- 172.21.15.40:0/3760302408 >> 172.21.15.40:0/3760302408 conn(0x55cf5ac6a910 msgr2=0x55cf5b019090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.554+0000 7fa39f27c740 1 -- 172.21.15.40:0/3760302408 shutdown_connections 2024-07-26T13:06:46.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.554+0000 7fa39f27c740 1 -- 172.21.15.40:0/3760302408 wait complete. 2024-07-26T13:06:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.554+0000 7fa39f27c740 1 -- start start 2024-07-26T13:06:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.554+0000 7fa39f27c740 1 Processor -- start 2024-07-26T13:06:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b026820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b026d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b032c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55cf5ade4bb0 con 0x55cf5ac4d660 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cf5af1d930 con 0x55cf5ac76520 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cf5b029980 con 0x55cf5ac55840 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa39f27c740 10 client.0 _ll_register_callbacks cb 0x55cf5ac8dd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.555+0000 7fa395c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b026820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b026820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41752/0 (socket says 172.21.15.40:41752) 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 -- 172.21.15.40:0/554828254 learned_addr learned my addr 172.21.15.40:0/554828254 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395200640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b026d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa396600640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b032c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 -- 172.21.15.40:0/554828254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 msgr2=0x55cf5b026d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b026d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 -- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 msgr2=0x55cf5b032c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b032c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa395c00640 1 -- 172.21.15.40:0/554828254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf5ad58960 con 0x55cf5ac4d660 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.556+0000 7fa396600640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b032c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa395c00640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b026820 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa3800cbaa0 tx=0x7fa3800c7d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371169b1d41f5f3d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa37b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa37b400640 1 -- 172.21.15.40:0/554828254 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380045e40 con 0x55cf5ac4d660 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa37b400640 1 -- 172.21.15.40:0/554828254 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa3800cc210 con 0x55cf5ac4d660 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa37c01a8f0 con 0x55cf5ac4d660 2024-07-26T13:06:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa37b400640 1 -- 172.21.15.40:0/554828254 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa3800098c0 con 0x55cf5ac4d660 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa39f27c740 10 client.17229 fetch_fsmap learned FSMap version 35 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.557+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cf5b035650 con 0x55cf5ac4d660 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa37b400640 1 -- 172.21.15.40:0/554828254 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa37c01a8f0 con 0x55cf5ac4d660 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa37b400640 1 -- 172.21.15.40:0/554828254 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fa38004d030 con 0x55cf5ac4d660 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa39f27c740 10 client.17229 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa39f27c740 10 client.17229 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa39f27c740 20 client.17229 populate_metadata read hostname 'smithi040' 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa39f27c740 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac34ea0 0x55cf5b038af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa39f27c740 4 client.17229 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:06:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.558+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf5af93ea0 con 0x55cf5ac34ea0 2024-07-26T13:06:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.559+0000 7fa395200640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac34ea0 0x55cf5b038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.560+0000 7fa395200640 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac34ea0 0x55cf5b038af0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f71596717aaa7a server_cookie=3dde592c29e84f20 in_seq=0 out_seq=0 2024-07-26T13:06:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.560+0000 7fa37b400640 10 client.17229 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa37b400640 1 -- 172.21.15.40:0/554828254 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf5af93ea0 con 0x55cf5ac34ea0 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa37b400640 10 client.17229 handle_command_reply: tid=0 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 client.17229 shutdown 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 msgr2=0x55cf5b026820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b026820 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa3800cbaa0 tx=0x7fa3800c7d20 comp rx=0 tx=0).stop 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 shutdown_connections 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b032c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b026d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac34ea0 0x55cf5b038af0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 --2- 172.21.15.40:0/554828254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b026820 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa37b400640 0 client.17229 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.562+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 >> 172.21.15.40:0/554828254 conn(0x55cf5ac6a910 msgr2=0x55cf5b01e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.563+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 shutdown_connections 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.563+0000 7fa39f27c740 1 -- 172.21.15.40:0/554828254 wait complete. 2024-07-26T13:06:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.563+0000 7fa39f27c740 20 client.17229 trim_cache size 0 max 16384 2024-07-26T13:06:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 Processor -- start 2024-07-26T13:06:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 -- start start 2024-07-26T13:06:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b0285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b03e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b03e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b5070 con 0x55cf5ac4d660 2024-07-26T13:06:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b6bb0 con 0x55cf5ac76520 2024-07-26T13:06:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.583+0000 7fa39f27c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b5740 con 0x55cf5ac55840 2024-07-26T13:06:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b0285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b0285e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41766/0 (socket says 172.21.15.40:41766) 2024-07-26T13:06:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 -- 172.21.15.40:0/151450244 learned_addr learned my addr 172.21.15.40:0/151450244 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395200640 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b03e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa396600640 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b03e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 -- 172.21.15.40:0/151450244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 msgr2=0x55cf5b03e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b03e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 -- 172.21.15.40:0/151450244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 msgr2=0x55cf5b03e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b03e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.584+0000 7fa395c00640 1 -- 172.21.15.40:0/151450244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf5b01d490 con 0x55cf5ac4d660 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.585+0000 7fa396600640 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b03e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.585+0000 7fa395c00640 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b0285e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa3800c8340 tx=0x7fa3800c7d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ddc3e4795a4ca5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.585+0000 7fa386000640 1 -- 172.21.15.40:0/151450244 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380009540 con 0x55cf5ac4d660 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.585+0000 7fa386000640 1 -- 172.21.15.40:0/151450244 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa380036040 con 0x55cf5ac4d660 2024-07-26T13:06:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.585+0000 7fa386000640 1 -- 172.21.15.40:0/151450244 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380108540 con 0x55cf5ac4d660 2024-07-26T13:06:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 -- 172.21.15.40:0/151450244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 msgr2=0x55cf5b0285e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b0285e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa3800c8340 tx=0x7fa3800c7d90 comp rx=0 tx=0).stop 2024-07-26T13:06:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 -- 172.21.15.40:0/151450244 shutdown_connections 2024-07-26T13:06:46.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b03e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac55840 0x55cf5b03e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 --2- 172.21.15.40:0/151450244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac4d660 0x55cf5b0285e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.586+0000 7fa39f27c740 1 -- 172.21.15.40:0/151450244 >> 172.21.15.40:0/151450244 conn(0x55cf5ac6a910 msgr2=0x55cf5b01cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.587+0000 7fa39f27c740 1 -- 172.21.15.40:0/151450244 shutdown_connections 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.587+0000 7fa39f27c740 1 -- 172.21.15.40:0/151450244 wait complete. 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.587+0000 7fa39f27c740 1 -- start start 2024-07-26T13:06:46.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 Processor -- start 2024-07-26T13:06:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b02ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b02b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b02b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b64e0 con 0x55cf5ac55840 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b5e10 con 0x55cf5ac76520 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.588+0000 7fa39f27c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa3901b3030 con 0x55cf5ac4d660 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.589+0000 7fa39f27c740 10 client.0 _ll_register_callbacks cb 0x7fa380009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.589+0000 7fa395200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b02b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.589+0000 7fa395200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b02b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41774/0 (socket says 172.21.15.40:41774) 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.589+0000 7fa395200640 1 -- 172.21.15.40:0/1661307492 learned_addr learned my addr 172.21.15.40:0/1661307492 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.589+0000 7fa395c00640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b02ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.589+0000 7fa396600640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b02b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa395200640 1 -- 172.21.15.40:0/1661307492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 msgr2=0x55cf5b02ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa395200640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b02ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa395200640 1 -- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 msgr2=0x55cf5b02b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa395200640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b02b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa395200640 1 -- 172.21.15.40:0/1661307492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf5b0a04d0 con 0x55cf5ac55840 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa396600640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b02b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa395200640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b02b270 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00fc30 tx=0x7fa37c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6673b816d7ff64 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa37b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa37b400640 1 -- 172.21.15.40:0/1661307492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c015040 con 0x55cf5ac55840 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa37b400640 1 -- 172.21.15.40:0/1661307492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa37c005450 con 0x55cf5ac55840 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.590+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa380036040 con 0x55cf5ac55840 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.591+0000 7fa37b400640 1 -- 172.21.15.40:0/1661307492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa37c004680 con 0x55cf5ac55840 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.591+0000 7fa39f27c740 10 client.17235 fetch_fsmap learned FSMap version 35 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.591+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cf5b0a17c0 con 0x55cf5ac55840 2024-07-26T13:06:46.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.591+0000 7fa37b400640 1 -- 172.21.15.40:0/1661307492 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa380036040 con 0x55cf5ac55840 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.591+0000 7fa37b400640 1 -- 172.21.15.40:0/1661307492 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fa37c039050 con 0x55cf5ac55840 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa39f27c740 10 client.17235 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa39f27c740 10 client.17235 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa39f27c740 20 client.17235 populate_metadata read hostname 'smithi040' 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa39f27c740 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac0a250 0x55cf5b0a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa39f27c740 4 client.17235 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "963c948c", "release": true, "await": true}] 2024-07-26T13:06:46.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "963c948c", "release": true, "await": true}) -- 0x55cf5af8f940 con 0x55cf5ac0a250 2024-07-26T13:06:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.592+0000 7fa395c00640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac0a250 0x55cf5b0a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:06:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.593+0000 7fa395c00640 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac0a250 0x55cf5b0a3c10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2836d19cad1c5949 server_cookie=13aa33e247c03ccc in_seq=0 out_seq=0 2024-07-26T13:06:46.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.593+0000 7fa37b400640 10 client.17235 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.651+0000 7fa37b400640 1 -- 172.21.15.40:0/1661307492 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55cf5af8f940 con 0x55cf5ac0a250 2024-07-26T13:06:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.651+0000 7fa37b400640 10 client.17235 handle_command_reply: tid=0 2024-07-26T13:06:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.651+0000 7fa39f27c740 1 client.17235 shutdown 2024-07-26T13:06:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 msgr2=0x55cf5b02b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b02b270 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00fc30 tx=0x7fa37c00b840 comp rx=0 tx=0).stop 2024-07-26T13:06:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 shutdown_connections 2024-07-26T13:06:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cf5ac76520 0x55cf5b02b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55cf5ac0a250 0x55cf5b0a3c10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf5ac55840 0x55cf5b02b270 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 --2- 172.21.15.40:0/1661307492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf5ac4d660 0x55cf5b02ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 >> 172.21.15.40:0/1661307492 conn(0x55cf5ac6a910 msgr2=0x55cf5b01c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.652+0000 7fa37b400640 0 client.17235 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.653+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 shutdown_connections 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.653+0000 7fa39f27c740 1 -- 172.21.15.40:0/1661307492 wait complete. 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.653+0000 7fa39f27c740 20 client.17235 trim_cache size 0 max 16384 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:06:46.654 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 148, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "963c948c": { 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 148, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.2, 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:06:46.655 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:06:46.656 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.654+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa3740b3c00 msgr2=0x7fa3740b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.654+0000 7fa397000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa3740b3c00 0x7fa3740b6110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa38800cd20 tx=0x7fa38800c4b0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.654+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 msgr2=0x7fa3901a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.654+0000 7fa397000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901a0290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa380000f80 tx=0x7fa380003ba0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.654+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 shutdown_connections 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.654+0000 7fa397000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa3740b3c00 0x7fa3740b6110 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.655+0000 7fa397000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa390107420 0x7fa3901a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.655+0000 7fa397000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa390102930 0x7fa3901a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.655+0000 7fa397000640 1 --2- 172.21.15.40:0/1729930380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa390101fe0 0x7fa3901a0290 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:06:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.655+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 >> 172.21.15.40:0/1729930380 conn(0x7fa3900fdcf0 msgr2=0x7fa390104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:06:46.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.655+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 shutdown_connections 2024-07-26T13:06:46.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:06:46.655+0000 7fa397000640 1 -- 172.21.15.40:0/1729930380 wait complete. 2024-07-26T13:06:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:47 smithi040 ceph-mon[32397]: pgmap v1835: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:06:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:47 smithi146 ceph-mon[35807]: pgmap v1835: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:06:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:47 smithi076 ceph-mon[35401]: pgmap v1835: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:06:47.706 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '963c948c', total seconds elapsed: 30.9 2024-07-26T13:06:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:49 smithi146 ceph-mon[35807]: pgmap v1836: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-07-26T13:06:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:49 smithi076 ceph-mon[35401]: pgmap v1836: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-07-26T13:06:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:49 smithi040 ceph-mon[32397]: pgmap v1836: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-07-26T13:06:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:51 smithi146 ceph-mon[35807]: pgmap v1837: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T13:06:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:51 smithi076 ceph-mon[35401]: pgmap v1837: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T13:06:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:51 smithi040 ceph-mon[32397]: pgmap v1837: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T13:06:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:53 smithi146 ceph-mon[35807]: pgmap v1838: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:06:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:53 smithi076 ceph-mon[35401]: pgmap v1838: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:06:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:53 smithi040 ceph-mon[32397]: pgmap v1838: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:06:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:55 smithi146 ceph-mon[35807]: pgmap v1839: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:06:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:55 smithi076 ceph-mon[35401]: pgmap v1839: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:06:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:55 smithi040 ceph-mon[32397]: pgmap v1839: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:06:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:57 smithi146 ceph-mon[35807]: pgmap v1840: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:06:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:57 smithi076 ceph-mon[35401]: pgmap v1840: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:06:57.375 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:57 smithi040 ceph-mon[32397]: pgmap v1840: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:06:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:06:59 smithi146 ceph-mon[35807]: pgmap v1841: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:06:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:06:59 smithi076 ceph-mon[35401]: pgmap v1841: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:06:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:06:59 smithi040 ceph-mon[32397]: pgmap v1841: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:07:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:01 smithi146 ceph-mon[35807]: pgmap v1842: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:07:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:01 smithi076 ceph-mon[35401]: pgmap v1842: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:07:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:01 smithi040 ceph-mon[32397]: pgmap v1842: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:07:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:03 smithi146 ceph-mon[35807]: pgmap v1843: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:07:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:03 smithi076 ceph-mon[35401]: pgmap v1843: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:07:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:03 smithi040 ceph-mon[32397]: pgmap v1843: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:07:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:05 smithi076 ceph-mon[35401]: pgmap v1844: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:07:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:05 smithi040 ceph-mon[32397]: pgmap v1844: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:07:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:05 smithi146 ceph-mon[35807]: pgmap v1844: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:07:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:07 smithi076 ceph-mon[35401]: pgmap v1845: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:07:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:07 smithi040 ceph-mon[32397]: pgmap v1845: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:07:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:07 smithi146 ceph-mon[35807]: pgmap v1845: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:07:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:09 smithi040 ceph-mon[32397]: pgmap v1846: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:09 smithi146 ceph-mon[35807]: pgmap v1846: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:09 smithi076 ceph-mon[35401]: pgmap v1846: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:11 smithi040 ceph-mon[32397]: pgmap v1847: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T13:07:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:11 smithi146 ceph-mon[35807]: pgmap v1847: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T13:07:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:11 smithi076 ceph-mon[35401]: pgmap v1847: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-07-26T13:07:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:13 smithi040 ceph-mon[32397]: pgmap v1848: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:07:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:13 smithi146 ceph-mon[35807]: pgmap v1848: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:07:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:13 smithi076 ceph-mon[35401]: pgmap v1848: 97 pgs: 97 active+clean; 8.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:07:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:15 smithi040 ceph-mon[32397]: pgmap v1849: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:07:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:15 smithi146 ceph-mon[35807]: pgmap v1849: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:07:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:15 smithi076 ceph-mon[35401]: pgmap v1849: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:07:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:17 smithi040 ceph-mon[32397]: pgmap v1850: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:07:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:17 smithi146 ceph-mon[35807]: pgmap v1850: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:07:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:17 smithi076 ceph-mon[35401]: pgmap v1850: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:07:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:19 smithi040 ceph-mon[32397]: pgmap v1851: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:19 smithi146 ceph-mon[35807]: pgmap v1851: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:19 smithi076 ceph-mon[35401]: pgmap v1851: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:21 smithi040 ceph-mon[32397]: pgmap v1852: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:07:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:21 smithi146 ceph-mon[35807]: pgmap v1852: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:07:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:21 smithi076 ceph-mon[35401]: pgmap v1852: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:07:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:23 smithi040 ceph-mon[32397]: pgmap v1853: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:07:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:23 smithi146 ceph-mon[35807]: pgmap v1853: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:07:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:23 smithi076 ceph-mon[35401]: pgmap v1853: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:07:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:25 smithi040 ceph-mon[32397]: pgmap v1854: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:07:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:25 smithi146 ceph-mon[35807]: pgmap v1854: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:07:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:25 smithi076 ceph-mon[35401]: pgmap v1854: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:07:27.439 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:27 smithi040 ceph-mon[32397]: pgmap v1855: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:07:27.439 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:07:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:27 smithi146 ceph-mon[35807]: pgmap v1855: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:07:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:07:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:27 smithi076 ceph-mon[35401]: pgmap v1855: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:07:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:07:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:29 smithi040 ceph-mon[32397]: pgmap v1856: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:07:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:07:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:07:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:29 smithi146 ceph-mon[35807]: pgmap v1856: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:07:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:07:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:07:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:29 smithi076 ceph-mon[35401]: pgmap v1856: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:07:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:07:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:07:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:31 smithi040 ceph-mon[32397]: pgmap v1857: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:07:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:31 smithi146 ceph-mon[35807]: pgmap v1857: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:07:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:31 smithi076 ceph-mon[35401]: pgmap v1857: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:07:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:33 smithi040 ceph-mon[32397]: pgmap v1858: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:33 smithi146 ceph-mon[35807]: pgmap v1858: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:33 smithi076 ceph-mon[35401]: pgmap v1858: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:35 smithi040 ceph-mon[32397]: pgmap v1859: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:07:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:35 smithi146 ceph-mon[35807]: pgmap v1859: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:07:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:35 smithi076 ceph-mon[35401]: pgmap v1859: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:07:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:37 smithi040 ceph-mon[32397]: pgmap v1860: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:07:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:37 smithi146 ceph-mon[35807]: pgmap v1860: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:07:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:37 smithi076 ceph-mon[35401]: pgmap v1860: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:07:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:39 smithi040 ceph-mon[32397]: pgmap v1861: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:07:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:39 smithi146 ceph-mon[35807]: pgmap v1861: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:07:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:39 smithi076 ceph-mon[35401]: pgmap v1861: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:07:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:41 smithi040 ceph-mon[32397]: pgmap v1862: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:07:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:41 smithi146 ceph-mon[35807]: pgmap v1862: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:07:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:41 smithi076 ceph-mon[35401]: pgmap v1862: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:07:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:43 smithi040 ceph-mon[32397]: pgmap v1863: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:07:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:43 smithi146 ceph-mon[35807]: pgmap v1863: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:07:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:43 smithi076 ceph-mon[35401]: pgmap v1863: 97 pgs: 97 active+clean; 8.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:07:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:44 smithi146 ceph-mon[35807]: pgmap v1864: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:07:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:44 smithi076 ceph-mon[35401]: pgmap v1864: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:07:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:44 smithi040 ceph-mon[32397]: pgmap v1864: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:07:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:46 smithi146 ceph-mon[35807]: pgmap v1865: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:07:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:46 smithi076 ceph-mon[35401]: pgmap v1865: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:07:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:46 smithi040 ceph-mon[32397]: pgmap v1865: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:07:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:48 smithi146 ceph-mon[35807]: pgmap v1866: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:07:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:48 smithi076 ceph-mon[35401]: pgmap v1866: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:07:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:48 smithi040 ceph-mon[32397]: pgmap v1866: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:07:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:50 smithi146 ceph-mon[35807]: pgmap v1867: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:07:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:50 smithi076 ceph-mon[35401]: pgmap v1867: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:07:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:50 smithi040 ceph-mon[32397]: pgmap v1867: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:07:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:52 smithi146 ceph-mon[35807]: pgmap v1868: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:52 smithi076 ceph-mon[35401]: pgmap v1868: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:52 smithi040 ceph-mon[32397]: pgmap v1868: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:07:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:54 smithi146 ceph-mon[35807]: pgmap v1869: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:07:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:54 smithi076 ceph-mon[35401]: pgmap v1869: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:07:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:54 smithi040 ceph-mon[32397]: pgmap v1869: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:07:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:56 smithi146 ceph-mon[35807]: pgmap v1870: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:07:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:56 smithi076 ceph-mon[35401]: pgmap v1870: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:07:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:56 smithi040 ceph-mon[32397]: pgmap v1870: 97 pgs: 97 active+clean; 8.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:07:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:07:58 smithi146 ceph-mon[35807]: pgmap v1871: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:07:58 smithi076 ceph-mon[35401]: pgmap v1871: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:07:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:07:58 smithi040 ceph-mon[32397]: pgmap v1871: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:08:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:00 smithi146 ceph-mon[35807]: pgmap v1872: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:08:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:00 smithi076 ceph-mon[35401]: pgmap v1872: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:08:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:00 smithi040 ceph-mon[32397]: pgmap v1872: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:08:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:02 smithi146 ceph-mon[35807]: pgmap v1873: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:08:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:02 smithi076 ceph-mon[35401]: pgmap v1873: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:08:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:02 smithi040 ceph-mon[32397]: pgmap v1873: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:08:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:04 smithi146 ceph-mon[35807]: pgmap v1874: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:08:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:04 smithi076 ceph-mon[35401]: pgmap v1874: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:08:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:04 smithi040 ceph-mon[32397]: pgmap v1874: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:08:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:06 smithi146 ceph-mon[35807]: pgmap v1875: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:08:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:06 smithi076 ceph-mon[35401]: pgmap v1875: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:08:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:06 smithi040 ceph-mon[32397]: pgmap v1875: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:08:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:08 smithi146 ceph-mon[35807]: pgmap v1876: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:08:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:08 smithi076 ceph-mon[35401]: pgmap v1876: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:08:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:08 smithi040 ceph-mon[32397]: pgmap v1876: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:08:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:10 smithi076 ceph-mon[35401]: pgmap v1877: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:08:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:10 smithi040 ceph-mon[32397]: pgmap v1877: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:08:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:10 smithi146 ceph-mon[35807]: pgmap v1877: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:08:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:12 smithi040 ceph-mon[32397]: pgmap v1878: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-07-26T13:08:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:12 smithi146 ceph-mon[35807]: pgmap v1878: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-07-26T13:08:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:12 smithi076 ceph-mon[35401]: pgmap v1878: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-07-26T13:08:14.064 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.3 2024-07-26T13:08:14.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:08:14.578 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:08:14.894 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:14 smithi040 ceph-mon[32397]: pgmap v1879: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:08:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:14 smithi146 ceph-mon[35807]: pgmap v1879: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:08:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:14 smithi076 ceph-mon[35401]: pgmap v1879: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:08:16.844 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:16 smithi040 ceph-mon[32397]: pgmap v1880: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:08:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:16 smithi146 ceph-mon[35807]: pgmap v1880: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:08:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:16 smithi076 ceph-mon[35401]: pgmap v1880: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 -- 172.21.15.40:0/3359778067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c102020 msgr2=0x7f1a1c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 --2- 172.21.15.40:0/3359778067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c102020 0x7f1a1c102430 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009930 tx=0x7f1a1002a440 comp rx=0 tx=0).stop 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 -- 172.21.15.40:0/3359778067 shutdown_connections 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 --2- 172.21.15.40:0/3359778067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a1c107460 0x7f1a1c107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 --2- 172.21.15.40:0/3359778067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c102970 0x7f1a1c106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 --2- 172.21.15.40:0/3359778067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c102020 0x7f1a1c102430 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 -- 172.21.15.40:0/3359778067 >> 172.21.15.40:0/3359778067 conn(0x7f1a1c0fdd50 msgr2=0x7f1a1c1001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:17.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 -- 172.21.15.40:0/3359778067 shutdown_connections 2024-07-26T13:08:17.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.251+0000 7f1a22c00640 1 -- 172.21.15.40:0/3359778067 wait complete. 2024-07-26T13:08:17.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.252+0000 7f1a22c00640 1 Processor -- start 2024-07-26T13:08:17.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.252+0000 7f1a22c00640 1 -- start start 2024-07-26T13:08:17.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c102020 0x7f1a1c1a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:17.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a1c102970 0x7f1a1c1a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:17.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 0x7f1a1c1a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:17.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c1197b0 con 0x7f1a1c107460 2024-07-26T13:08:17.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c119630 con 0x7f1a1c102970 2024-07-26T13:08:17.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c119930 con 0x7f1a1c102020 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.253+0000 7f1a22200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 0x7f1a1c1a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 0x7f1a1c1a5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53578/0 (socket says 172.21.15.40:53578) 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 -- 172.21.15.40:0/1138388990 learned_addr learned my addr 172.21.15.40:0/1138388990 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a21800640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c102020 0x7f1a1c1a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a20e00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a1c102970 0x7f1a1c1a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 -- 172.21.15.40:0/1138388990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c102020 msgr2=0x7f1a1c1a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c102020 0x7f1a1c1a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 -- 172.21.15.40:0/1138388990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a1c102970 msgr2=0x7f1a1c1a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a1c102970 0x7f1a1c1a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.254+0000 7f1a22200640 1 -- 172.21.15.40:0/1138388990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c1a60b0 con 0x7f1a1c107460 2024-07-26T13:08:17.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.255+0000 7f1a22200640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 0x7f1a1c1a5a40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400cce0 tx=0x7f1a1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:17.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.255+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400f450 con 0x7f1a1c107460 2024-07-26T13:08:17.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.255+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1c1a63a0 con 0x7f1a1c107460 2024-07-26T13:08:17.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.255+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1c1acbc0 con 0x7f1a1c107460 2024-07-26T13:08:17.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.255+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a1400fa80 con 0x7f1a1c107460 2024-07-26T13:08:17.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.256+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140189c0 con 0x7f1a1c107460 2024-07-26T13:08:17.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.257+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc0052c0 con 0x7f1a1c107460 2024-07-26T13:08:17.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.260+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1a1400f5f0 con 0x7f1a1c107460 2024-07-26T13:08:17.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.262+0000 7f1a1a000640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1a040b3c80 0x7f1a040b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:17.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.262+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1a140e3dd0 con 0x7f1a1c107460 2024-07-26T13:08:17.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.262+0000 7f1a21800640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1a040b3c80 0x7f1a040b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.263+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1a14014030 con 0x7f1a1c107460 2024-07-26T13:08:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.263+0000 7f1a21800640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1a040b3c80 0x7f1a040b6190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1a10005ec0 tx=0x7f1a100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:17.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.541+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19fc0055b0 con 0x7f1a1c107460 2024-07-26T13:08:17.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.542+0000 7f1a1a000640 1 -- 172.21.15.40:0/1138388990 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f1a140ab460 con 0x7f1a1c107460 2024-07-26T13:08:17.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:08:17.545 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:08:17.545 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:08:17.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1a040b3c80 msgr2=0x7f1a040b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:17.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1a040b3c80 0x7f1a040b6190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1a10005ec0 tx=0x7f1a100058d0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 msgr2=0x7f1a1c1a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 0x7f1a1c1a5a40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400cce0 tx=0x7f1a1400a620 comp rx=0 tx=0).stop 2024-07-26T13:08:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 shutdown_connections 2024-07-26T13:08:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a1c107460 0x7f1a1c1a5a40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a1c102970 0x7f1a1c1a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1a040b3c80 0x7f1a040b6190 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 --2- 172.21.15.40:0/1138388990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c102020 0x7f1a1c1a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.546+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 >> 172.21.15.40:0/1138388990 conn(0x7f1a1c0fdd50 msgr2=0x7f1a1c104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.547+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 shutdown_connections 2024-07-26T13:08:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:17.547+0000 7f1a22c00640 1 -- 172.21.15.40:0/1138388990 wait complete. 2024-07-26T13:08:17.957 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1138388990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:08:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1138388990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:08:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1138388990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:08:18.423 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 146.3 --await-for 45.0' 2024-07-26T13:08:18.423 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 146.3 --await-for 45.0 2024-07-26T13:08:18.948 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:08:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:18 smithi040 ceph-mon[32397]: pgmap v1881: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:08:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:18 smithi146 ceph-mon[35807]: pgmap v1881: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:08:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:18 smithi076 ceph-mon[35401]: pgmap v1881: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:08:20.896 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:20 smithi040 ceph-mon[32397]: pgmap v1882: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:08:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:20 smithi146 ceph-mon[35807]: pgmap v1882: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:08:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:20 smithi076 ceph-mon[35401]: pgmap v1882: 97 pgs: 97 active+clean; 8.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.264+0000 7fa7c1a00640 1 -- 172.21.15.40:0/465136976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc10d660 msgr2=0x7fa7bc10fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.264+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/465136976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc10d660 0x7fa7bc10fb70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009ca0 tx=0x7fa7b402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 -- 172.21.15.40:0/465136976 shutdown_connections 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/465136976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc10d660 0x7fa7bc10fb70 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/465136976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/465136976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7bc1040b0 0x7fa7bc1044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 -- 172.21.15.40:0/465136976 >> 172.21.15.40:0/465136976 conn(0x7fa7bc0fdd60 msgr2=0x7fa7bc1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 -- 172.21.15.40:0/465136976 shutdown_connections 2024-07-26T13:08:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.265+0000 7fa7c1a00640 1 -- 172.21.15.40:0/465136976 wait complete. 2024-07-26T13:08:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.266+0000 7fa7c1a00640 1 Processor -- start 2024-07-26T13:08:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.266+0000 7fa7c1a00640 1 -- start start 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7c1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7bc1040b0 0x7fa7bc101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7c1a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7c1a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc10d660 0x7fa7bc102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7c1a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1131f0 con 0x7fa7bc104ae0 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7c1a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc113070 con 0x7fa7bc10d660 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7c1a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc113370 con 0x7fa7bc1040b0 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.267+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc102500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53596/0 (socket says 172.21.15.40:53596) 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 -- 172.21.15.40:0/1749888956 learned_addr learned my addr 172.21.15.40:0/1749888956 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7bc1040b0 0x7fa7bc101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7c1000640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc10d660 0x7fa7bc102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 -- 172.21.15.40:0/1749888956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7bc1040b0 msgr2=0x7fa7bc101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7bc1040b0 0x7fa7bc101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 -- 172.21.15.40:0/1749888956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc10d660 msgr2=0x7fa7bc102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc10d660 0x7fa7bc102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7bb400640 1 -- 172.21.15.40:0/1749888956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1a7e80 con 0x7fa7bc104ae0 2024-07-26T13:08:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.268+0000 7fa7c1000640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc10d660 0x7fa7bc102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:08:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.269+0000 7fa7bb400640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc102500 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800d740 tx=0x7fa7a800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.269+0000 7fa7b8c00640 1 -- 172.21.15.40:0/1749888956 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8017070 con 0x7fa7bc104ae0 2024-07-26T13:08:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.269+0000 7fa7b8c00640 1 -- 172.21.15.40:0/1749888956 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7a800de50 con 0x7fa7bc104ae0 2024-07-26T13:08:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.269+0000 7fa7b8c00640 1 -- 172.21.15.40:0/1749888956 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800f620 con 0x7fa7bc104ae0 2024-07-26T13:08:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.269+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a8170 con 0x7fa7bc104ae0 2024-07-26T13:08:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.269+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a8660 con 0x7fa7bc104ae0 2024-07-26T13:08:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 Processor -- start 2024-07-26T13:08:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 -- start start 2024-07-26T13:08:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7b8c00640 1 -- 172.21.15.40:0/1749888956 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa7a801a070 con 0x7fa7bc104ae0 2024-07-26T13:08:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d75fa980 0x5586d79c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5586d7993d10 con 0x5586d7602b60 2024-07-26T13:08:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5586d793eb60 con 0x5586d7623840 2024-07-26T13:08:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.274+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5586d792e060 con 0x5586d75fa980 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.275+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.275+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53598/0 (socket says 172.21.15.40:53598) 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.275+0000 7fa7bb400640 1 -- 172.21.15.40:0/4191976209 learned_addr learned my addr 172.21.15.40:0/4191976209 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.275+0000 7fa7c1000640 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.275+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d75fa980 0x5586d79c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.276+0000 7fa7bb400640 1 -- 172.21.15.40:0/4191976209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d75fa980 msgr2=0x5586d79c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.276+0000 7fa7bb400640 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d75fa980 0x5586d79c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.276+0000 7fa7bb400640 1 -- 172.21.15.40:0/4191976209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 msgr2=0x5586d79c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.276+0000 7fa7bb400640 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.276+0000 7fa7bb400640 1 -- 172.21.15.40:0/4191976209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d78b5b10 con 0x5586d7602b60 2024-07-26T13:08:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.276+0000 7fa7bb400640 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79c9e30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80e96d0 tx=0x7fa7a80e9b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677fc3944c3b14 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.277+0000 7fa7b1600640 1 -- 172.21.15.40:0/4191976209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a80f6070 con 0x5586d7602b60 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.277+0000 7fa7b1600640 1 -- 172.21.15.40:0/4191976209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7a80e3be0 con 0x5586d7602b60 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.277+0000 7fa7b1600640 1 -- 172.21.15.40:0/4191976209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a80e5430 con 0x5586d7602b60 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.277+0000 7fa7b8c00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa7a00b3c40 0x7fa7a00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.277+0000 7fa7b8c00640 1 -- 172.21.15.40:0/1749888956 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa7a80e35b0 con 0x7fa7bc104ae0 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.277+0000 7fa7c1000640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa7a00b3c40 0x7fa7a00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/4191976209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 msgr2=0x5586d79c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79c9e30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80e96d0 tx=0x7fa7a80e9b90 comp rx=0 tx=0).stop 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/4191976209 shutdown_connections 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79c9e30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d75fa980 0x5586d79c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/4191976209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/4191976209 >> 172.21.15.40:0/4191976209 conn(0x5586d7617990 msgr2=0x5586d79c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.278+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/4191976209 shutdown_connections 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.279+0000 7fa7c1000640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa7a00b3c40 0x7fa7a00b6150 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4006010 tx=0x7fa7b40098e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.279+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/4191976209 wait complete. 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.279+0000 7fa7c9cc7740 1 -- start start 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 Processor -- start 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7602b60 0x5586d79d5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5586d78ca520 con 0x5586d75fa980 2024-07-26T13:08:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5586d79320a0 con 0x5586d7602b60 2024-07-26T13:08:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.280+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5586d77917a0 con 0x5586d7623840 2024-07-26T13:08:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.281+0000 7fa7c9cc7740 10 client.0 _ll_register_callbacks cb 0x5586d7926bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.281+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.281+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53606/0 (socket says 172.21.15.40:53606) 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.281+0000 7fa7bbe00640 1 -- 172.21.15.40:0/3797917139 learned_addr learned my addr 172.21.15.40:0/3797917139 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.281+0000 7fa7bb400640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7602b60 0x5586d79d5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.281+0000 7fa7c1000640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7bbe00640 1 -- 172.21.15.40:0/3797917139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 msgr2=0x5586d79e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7bbe00640 1 -- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7602b60 msgr2=0x5586d79d5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7602b60 0x5586d79d5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7bbe00640 1 -- 172.21.15.40:0/3797917139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d769db90 con 0x5586d75fa980 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7c1000640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d4c20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00bf20 tx=0x7fa7ac0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9527d742849df7 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7a6000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7a6000640 1 -- 172.21.15.40:0/3797917139 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac021060 con 0x5586d75fa980 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.282+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7a80e3be0 con 0x5586d75fa980 2024-07-26T13:08:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.283+0000 7fa7a6000640 1 -- 172.21.15.40:0/3797917139 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa7ac010690 con 0x5586d75fa980 2024-07-26T13:08:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.283+0000 7fa7a6000640 1 -- 172.21.15.40:0/3797917139 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa7ac010890 con 0x5586d75fa980 2024-07-26T13:08:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.283+0000 7fa7c9cc7740 10 client.17253 fetch_fsmap learned FSMap version 35 2024-07-26T13:08:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.283+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5586d79e39b0 con 0x5586d75fa980 2024-07-26T13:08:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.283+0000 7fa7a6000640 1 -- 172.21.15.40:0/3797917139 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7a80e3be0 con 0x5586d75fa980 2024-07-26T13:08:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7a6000640 1 -- 172.21.15.40:0/3797917139 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fa7ac0047a0 con 0x5586d75fa980 2024-07-26T13:08:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7c9cc7740 10 client.17253 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7c9cc7740 10 client.17253 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7c9cc7740 20 client.17253 populate_metadata read hostname 'smithi040' 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75e21c0 0x5586d79e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7c9cc7740 4 client.17253 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.284+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586d7940ab0 con 0x5586d75e21c0 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.285+0000 7fa7bb400640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75e21c0 0x5586d79e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.286+0000 7fa7bb400640 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75e21c0 0x5586d79e6e60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc8eb7f4297c78a server_cookie=8c435e3504b0b5bd in_seq=0 out_seq=0 2024-07-26T13:08:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.286+0000 7fa7a6000640 10 client.17253 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7a6000640 1 -- 172.21.15.40:0/3797917139 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586d7940ab0 con 0x5586d75e21c0 2024-07-26T13:08:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7a6000640 10 client.17253 handle_command_reply: tid=0 2024-07-26T13:08:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 client.17253 shutdown 2024-07-26T13:08:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 msgr2=0x5586d79d4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d4c20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00bf20 tx=0x7fa7ac0128e0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 shutdown_connections 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7602b60 0x5586d79d5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75e21c0 0x5586d79e6e60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/3797917139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d4c20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 >> 172.21.15.40:0/3797917139 conn(0x5586d7617990 msgr2=0x5586d79cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7a6000640 0 client.17253 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 shutdown_connections 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.288+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/3797917139 wait complete. 2024-07-26T13:08:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.289+0000 7fa7c9cc7740 20 client.17253 trim_cache size 0 max 16384 2024-07-26T13:08:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.315+0000 7fa7c9cc7740 1 Processor -- start 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.315+0000 7fa7c9cc7740 1 -- start start 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.315+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.315+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7602b60 0x5586d79e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.315+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79e1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1b0ea0 con 0x5586d75fa980 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1b29e0 con 0x5586d7623840 2024-07-26T13:08:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1b1570 con 0x5586d7602b60 2024-07-26T13:08:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7bbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53616/0 (socket says 172.21.15.40:53616) 2024-07-26T13:08:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7bbe00640 1 -- 172.21.15.40:0/2517871437 learned_addr learned my addr 172.21.15.40:0/2517871437 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7bb400640 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7602b60 0x5586d79e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7c1000640 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.316+0000 7fa7bbe00640 1 -- 172.21.15.40:0/2517871437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7602b60 msgr2=0x5586d79e0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7602b60 0x5586d79e0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7bbe00640 1 -- 172.21.15.40:0/2517871437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 msgr2=0x5586d79e1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79e1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7bbe00640 1 -- 172.21.15.40:0/2517871437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d79e15a0 con 0x5586d75fa980 2024-07-26T13:08:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d6b00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac004d80 tx=0x7fa7ac0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef31eb71afeceacc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7b0c00640 1 -- 172.21.15.40:0/2517871437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac02b070 con 0x5586d75fa980 2024-07-26T13:08:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7b0c00640 1 -- 172.21.15.40:0/2517871437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7ac02d070 con 0x5586d75fa980 2024-07-26T13:08:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.317+0000 7fa7b0c00640 1 -- 172.21.15.40:0/2517871437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac000e60 con 0x5586d75fa980 2024-07-26T13:08:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.318+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/2517871437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 msgr2=0x5586d79d6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.318+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d6b00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac004d80 tx=0x7fa7ac0058d0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/2517871437 shutdown_connections 2024-07-26T13:08:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d7623840 0x5586d79e1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7602b60 0x5586d79e0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/2517871437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d75fa980 0x5586d79d6b00 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/2517871437 >> 172.21.15.40:0/2517871437 conn(0x5586d7617990 msgr2=0x5586d79d4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/2517871437 shutdown_connections 2024-07-26T13:08:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/2517871437 wait complete. 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.319+0000 7fa7c9cc7740 1 -- start start 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 Processor -- start 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d75fa980 0x5586d79dd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79d91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1b2310 con 0x5586d7602b60 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1b1c40 con 0x5586d75fa980 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1aee60 con 0x5586d7623840 2024-07-26T13:08:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.320+0000 7fa7c9cc7740 10 client.0 _ll_register_callbacks cb 0x7fa7ac00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:08:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79d8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53620/0 (socket says 172.21.15.40:53620) 2024-07-26T13:08:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 -- 172.21.15.40:0/189832761 learned_addr learned my addr 172.21.15.40:0/189832761 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d75fa980 0x5586d79dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7c1000640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79d91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 -- 172.21.15.40:0/189832761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 msgr2=0x5586d79d91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79d91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 -- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d75fa980 msgr2=0x5586d79dd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d75fa980 0x5586d79dd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.321+0000 7fa7bb400640 1 -- 172.21.15.40:0/189832761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d7a4e630 con 0x5586d7602b60 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.322+0000 7fa7bb400640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79d8aa0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80eb0b0 tx=0x7fa7a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5f0b08d62030f3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.322+0000 7fa7a6000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.322+0000 7fa7a6000640 1 -- 172.21.15.40:0/189832761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8021070 con 0x5586d7602b60 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.322+0000 7fa7a6000640 1 -- 172.21.15.40:0/189832761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa7a80a6790 con 0x5586d7602b60 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.322+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ac02d070 con 0x5586d7602b60 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7a6000640 1 -- 172.21.15.40:0/189832761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa7a80a63c0 con 0x5586d7602b60 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 10 client.17259 fetch_fsmap learned FSMap version 35 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5586d7a4f790 con 0x5586d7602b60 2024-07-26T13:08:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7a6000640 1 -- 172.21.15.40:0/189832761 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7ac02d070 con 0x5586d7602b60 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7a6000640 1 -- 172.21.15.40:0/189832761 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fa7a80e9150 con 0x5586d7602b60 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 10 client.17259 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 10 client.17259 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 20 client.17259 populate_metadata read hostname 'smithi040' 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75b7570 0x5586d7a51b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 4 client.17259 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.3, "await_for": 45.0}] 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.323+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.3, "await_for": 45.0}) -- 0x5586d793c550 con 0x5586d75b7570 2024-07-26T13:08:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.324+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75b7570 0x5586d7a51b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.325+0000 7fa7bbe00640 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75b7570 0x5586d7a51b90 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25238d39edb6bbd server_cookie=dcc82041ba5e8c09 in_seq=0 out_seq=0 2024-07-26T13:08:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.325+0000 7fa7a6000640 10 client.17259 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.650+0000 7fa7a6000640 1 -- 172.21.15.40:0/189832761 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5586d793c550 con 0x5586d75b7570 2024-07-26T13:08:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.650+0000 7fa7a6000640 10 client.17259 handle_command_reply: tid=0 2024-07-26T13:08:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.651+0000 7fa7c9cc7740 1 client.17259 shutdown 2024-07-26T13:08:21.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.651+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 msgr2=0x5586d79d8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.651+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79d8aa0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80eb0b0 tx=0x7fa7a8000bc0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 shutdown_connections 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586d7623840 0x5586d79d91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5586d75b7570 0x5586d7a51b90 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5586d7602b60 0x5586d79d8aa0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7c9cc7740 1 --2- 172.21.15.40:0/189832761 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5586d75fa980 0x5586d79dd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7a6000640 0 client.17259 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.652+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 >> 172.21.15.40:0/189832761 conn(0x5586d7617990 msgr2=0x5586d79d4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.653+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 shutdown_connections 2024-07-26T13:08:21.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.653+0000 7fa7c9cc7740 1 -- 172.21.15.40:0/189832761 wait complete. 2024-07-26T13:08:21.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.653+0000 7fa7c9cc7740 20 client.17259 trim_cache size 0 max 16384 2024-07-26T13:08:21.656 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:08:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:08:21.656 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 150, 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "3e29ec5d": { 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 150, 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:08:21.657 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.3, 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:21.658 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:21.659 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:21.659 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:08:21.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa7a00b3c40 msgr2=0x7fa7a00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa7a00b3c40 0x7fa7a00b6150 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4006010 tx=0x7fa7b40098e0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 msgr2=0x7fa7bc102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc102500 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800d740 tx=0x7fa7a800dc00 comp rx=0 tx=0).stop 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 shutdown_connections 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7bc10d660 0x7fa7bc102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7bc104ae0 0x7fa7bc102500 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa7a00b3c40 0x7fa7a00b6150 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 --2- 172.21.15.40:0/1749888956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7bc1040b0 0x7fa7bc101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 >> 172.21.15.40:0/1749888956 conn(0x7fa7bc0fdd60 msgr2=0x7fa7bc0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 shutdown_connections 2024-07-26T13:08:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:21.655+0000 7fa7c1a00640 1 -- 172.21.15.40:0/1749888956 wait complete. 2024-07-26T13:08:22.466 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e29ec5d', quiesce took 8.4 seconds. Will release after: 17.9 2024-07-26T13:08:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:22 smithi040 ceph-mon[32397]: pgmap v1883: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:08:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:22 smithi146 ceph-mon[35807]: pgmap v1883: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:08:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:22 smithi076 ceph-mon[35401]: pgmap v1883: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:08:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:24 smithi040 ceph-mon[32397]: pgmap v1884: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:08:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:24 smithi146 ceph-mon[35807]: pgmap v1884: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:08:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:24 smithi076 ceph-mon[35401]: pgmap v1884: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:08:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:26 smithi040 ceph-mon[32397]: pgmap v1885: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:08:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:26 smithi146 ceph-mon[35807]: pgmap v1885: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:08:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:26 smithi076 ceph-mon[35401]: pgmap v1885: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:08:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:28 smithi040 ceph-mon[32397]: pgmap v1886: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:08:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:08:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:28 smithi146 ceph-mon[35807]: pgmap v1886: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:08:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:08:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:28 smithi076 ceph-mon[35401]: pgmap v1886: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:08:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:08:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: pgmap v1887: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T13:08:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:08:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: pgmap v1887: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:08:31.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: pgmap v1887: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-07-26T13:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:08:31.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:08:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:31 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:08:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:31 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:08:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:31 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:08:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:31 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:08:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:31 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:08:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:31 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:08:32.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:32 smithi146 ceph-mon[35807]: pgmap v1888: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T13:08:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:32 smithi040 ceph-mon[32397]: pgmap v1888: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T13:08:32.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:32 smithi076 ceph-mon[35401]: pgmap v1888: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2024-07-26T13:08:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:34 smithi040 ceph-mon[32397]: pgmap v1889: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T13:08:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:34 smithi146 ceph-mon[35807]: pgmap v1889: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T13:08:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:34 smithi076 ceph-mon[35401]: pgmap v1889: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-07-26T13:08:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:36 smithi040 ceph-mon[32397]: pgmap v1890: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 654 KiB/s wr, 10 op/s 2024-07-26T13:08:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:36 smithi146 ceph-mon[35807]: pgmap v1890: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 654 KiB/s wr, 10 op/s 2024-07-26T13:08:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:36 smithi076 ceph-mon[35401]: pgmap v1890: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 654 KiB/s wr, 10 op/s 2024-07-26T13:08:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:38 smithi040 ceph-mon[32397]: pgmap v1891: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 654 KiB/s wr, 9 op/s 2024-07-26T13:08:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:38 smithi146 ceph-mon[35807]: pgmap v1891: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 654 KiB/s wr, 9 op/s 2024-07-26T13:08:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:38 smithi076 ceph-mon[35401]: pgmap v1891: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 654 KiB/s wr, 9 op/s 2024-07-26T13:08:40.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:08:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:08:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:40 smithi040 ceph-mon[32397]: pgmap v1892: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 313 KiB/s wr, 12 op/s 2024-07-26T13:08:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:40 smithi146 ceph-mon[35807]: pgmap v1892: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 313 KiB/s wr, 12 op/s 2024-07-26T13:08:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:40 smithi076 ceph-mon[35401]: pgmap v1892: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 313 KiB/s wr, 12 op/s 2024-07-26T13:08:42.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:42 smithi040 ceph-mon[32397]: pgmap v1893: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 852 B/s wr, 8 op/s 2024-07-26T13:08:43.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 -- 172.21.15.40:0/1907731748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86081099f0 msgr2=0x7f8608109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:43.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 --2- 172.21.15.40:0/1907731748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86081099f0 0x7f8608109e00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009900 tx=0x7f85fc02a3f0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 -- 172.21.15.40:0/1907731748 shutdown_connections 2024-07-26T13:08:43.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 --2- 172.21.15.40:0/1907731748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 0x7f86081164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 --2- 172.21.15.40:0/1907731748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f860810f330 0x7f860810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 --2- 172.21.15.40:0/1907731748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86081099f0 0x7f8608109e00 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 -- 172.21.15.40:0/1907731748 >> 172.21.15.40:0/1907731748 conn(0x7f8608078ff0 msgr2=0x7f8608107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:43.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 -- 172.21.15.40:0/1907731748 shutdown_connections 2024-07-26T13:08:43.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.058+0000 7f860ec00640 1 -- 172.21.15.40:0/1907731748 wait complete. 2024-07-26T13:08:43.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.059+0000 7f860ec00640 1 Processor -- start 2024-07-26T13:08:43.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 -- start start 2024-07-26T13:08:43.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86081099f0 0x7f86081a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:43.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 0x7f86081a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:43.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 0x7f86081a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f86081198a0 con 0x7f860810f330 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8608119720 con 0x7f86081099f0 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8608119a20 con 0x7f860810fc80 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.060+0000 7f860ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 0x7f86081a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 0x7f86081a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56816/0 (socket says 172.21.15.40:56816) 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 -- 172.21.15.40:0/1187946537 learned_addr learned my addr 172.21.15.40:0/1187946537 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860d800640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86081099f0 0x7f86081a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:43.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860e200640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 0x7f86081a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:43.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 -- 172.21.15.40:0/1187946537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 msgr2=0x7f86081a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:43.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 0x7f86081a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 -- 172.21.15.40:0/1187946537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86081099f0 msgr2=0x7f86081a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:43.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86081099f0 0x7f86081a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860ce00640 1 -- 172.21.15.40:0/1187946537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86081a61c0 con 0x7f860810f330 2024-07-26T13:08:43.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.061+0000 7f860e200640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 0x7f86081a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.062+0000 7f860ce00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 0x7f86081a08b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c8c0 tx=0x7f85f400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.062+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4007bb0 con 0x7f860810f330 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.062+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86081a64b0 con 0x7f860810f330 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.062+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85f4007d50 con 0x7f860810f330 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.062+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4018660 con 0x7f860810f330 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.062+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86081accd0 con 0x7f860810f330 2024-07-26T13:08:43.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.063+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8608109e00 con 0x7f860810f330 2024-07-26T13:08:43.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.066+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f85f400fa00 con 0x7f860810f330 2024-07-26T13:08:43.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.068+0000 7f8606000640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85f00b3c00 0x7f85f00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:43.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.069+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f85f40e3f40 con 0x7f860810f330 2024-07-26T13:08:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:42 smithi146 ceph-mon[35807]: pgmap v1893: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 852 B/s wr, 8 op/s 2024-07-26T13:08:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.069+0000 7f860d800640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85f00b3c00 0x7f85f00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.070+0000 7f860d800640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85f00b3c00 0x7f85f00b6110 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f85fc006010 tx=0x7f85fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.070+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f85f4014030 con 0x7f860810f330 2024-07-26T13:08:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:42 smithi076 ceph-mon[35401]: pgmap v1893: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 852 B/s wr, 8 op/s 2024-07-26T13:08:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.311+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86081a1440 con 0x7f860810f330 2024-07-26T13:08:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.313+0000 7f8606000640 1 -- 172.21.15.40:0/1187946537 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f85f40ab5e0 con 0x7f860810f330 2024-07-26T13:08:43.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:08:43.315 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:08:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:08:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85f00b3c00 msgr2=0x7f85f00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85f00b3c00 0x7f85f00b6110 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f85fc006010 tx=0x7f85fc000bc0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 msgr2=0x7f86081a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 0x7f86081a08b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c8c0 tx=0x7f85f400cd80 comp rx=0 tx=0).stop 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 shutdown_connections 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f85f00b3c00 0x7f85f00b6110 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860810fc80 0x7f86081a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f860810f330 0x7f86081a08b0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 --2- 172.21.15.40:0/1187946537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86081099f0 0x7f86081a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.316+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 >> 172.21.15.40:0/1187946537 conn(0x7f8608078ff0 msgr2=0x7f8608108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.317+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 shutdown_connections 2024-07-26T13:08:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:43.317+0000 7f860ec00640 1 -- 172.21.15.40:0/1187946537 wait complete. 2024-07-26T13:08:43.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:43 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1187946537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:08:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:43 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1187946537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:08:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:43 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1187946537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:08:44.134 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 3e29ec5d --release --await' 2024-07-26T13:08:44.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 3e29ec5d --release --await 2024-07-26T13:08:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:08:45.001 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:44 smithi040 ceph-mon[32397]: pgmap v1894: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T13:08:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:44 smithi146 ceph-mon[35807]: pgmap v1894: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T13:08:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:44 smithi076 ceph-mon[35401]: pgmap v1894: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-07-26T13:08:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 -- 172.21.15.40:0/2840099637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410f330 msgr2=0x7f1c5410f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 --2- 172.21.15.40:0/2840099637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410f330 0x7f1c5410f740 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009ca0 tx=0x7f1c3c02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 -- 172.21.15.40:0/2840099637 shutdown_connections 2024-07-26T13:08:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 --2- 172.21.15.40:0/2840099637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c5410fc80 0x7f1c541164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 --2- 172.21.15.40:0/2840099637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410f330 0x7f1c5410f740 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 --2- 172.21.15.40:0/2840099637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c541099f0 0x7f1c54109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 -- 172.21.15.40:0/2840099637 >> 172.21.15.40:0/2840099637 conn(0x7f1c54078ff0 msgr2=0x7f1c54107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:46.851 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:46 smithi040 ceph-mon[32397]: pgmap v1895: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:08:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.848+0000 7f1c58e00640 1 -- 172.21.15.40:0/2840099637 shutdown_connections 2024-07-26T13:08:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.849+0000 7f1c58e00640 1 -- 172.21.15.40:0/2840099637 wait complete. 2024-07-26T13:08:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.850+0000 7f1c58e00640 1 Processor -- start 2024-07-26T13:08:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.850+0000 7f1c58e00640 1 -- start start 2024-07-26T13:08:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.850+0000 7f1c58e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c541099f0 0x7f1c541a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c58e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c5410f330 0x7f1c541a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c58e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 0x7f1c541a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c58e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54119840 con 0x7f1c5410fc80 2024-07-26T13:08:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c58e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541196c0 con 0x7f1c5410f330 2024-07-26T13:08:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c58e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541199c0 con 0x7f1c541099f0 2024-07-26T13:08:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 0x7f1c541a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 0x7f1c541a5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56824/0 (socket says 172.21.15.40:56824) 2024-07-26T13:08:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 -- 172.21.15.40:0/3753264509 learned_addr learned my addr 172.21.15.40:0/3753264509 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53400640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c541099f0 0x7f1c541a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c5410f330 0x7f1c541a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 -- 172.21.15.40:0/3753264509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c541099f0 msgr2=0x7f1c541a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c541099f0 0x7f1c541a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 -- 172.21.15.40:0/3753264509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c5410f330 msgr2=0x7f1c541a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.851+0000 7f1c53e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c5410f330 0x7f1c541a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.852+0000 7f1c53e00640 1 -- 172.21.15.40:0/3753264509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c541a6120 con 0x7f1c5410fc80 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.852+0000 7f1c53e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 0x7f1c541a5ab0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00d750 tx=0x7f1c4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.852+0000 7f1c50c00640 1 -- 172.21.15.40:0/3753264509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c017070 con 0x7f1c5410fc80 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.852+0000 7f1c50c00640 1 -- 172.21.15.40:0/3753264509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c4c0054b0 con 0x7f1c5410fc80 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.852+0000 7f1c50c00640 1 -- 172.21.15.40:0/3753264509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c004b90 con 0x7f1c5410fc80 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.852+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c541a6410 con 0x7f1c5410fc80 2024-07-26T13:08:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.853+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c541acc30 con 0x7f1c5410fc80 2024-07-26T13:08:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.856+0000 7f1c61061740 1 Processor -- start 2024-07-26T13:08:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.856+0000 7f1c50c00640 1 -- 172.21.15.40:0/3753264509 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1c4c004d30 con 0x7f1c5410fc80 2024-07-26T13:08:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 -- start start 2024-07-26T13:08:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56435a229f30 con 0x564359ee5660 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56435a219430 con 0x564359f0e520 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c61061740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56435a21d470 con 0x564359eed840 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c53400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c53400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56828/0 (socket says 172.21.15.40:56828) 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.857+0000 7f1c53400640 1 -- 172.21.15.40:0/952659759 learned_addr learned my addr 172.21.15.40:0/952659759 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c53400640 1 -- 172.21.15.40:0/952659759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 msgr2=0x56435a2b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c53400640 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c53400640 1 -- 172.21.15.40:0/952659759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 msgr2=0x56435a2b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c53400640 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c53400640 1 -- 172.21.15.40:0/952659759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564359f79b00 con 0x564359ee5660 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.858+0000 7f1c53400640 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2b36c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400cc60 tx=0x7f1c4400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf79bc5944abf4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.859+0000 7f1c50c00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c380b3c80 0x7f1c380b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.859+0000 7f1c48c00640 1 -- 172.21.15.40:0/952659759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44014070 con 0x564359ee5660 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.859+0000 7f1c48c00640 1 -- 172.21.15.40:0/952659759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c440047a0 con 0x564359ee5660 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.859+0000 7f1c48c00640 1 -- 172.21.15.40:0/952659759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44010690 con 0x564359ee5660 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.859+0000 7f1c50c00640 1 -- 172.21.15.40:0/3753264509 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1c4c0e3640 con 0x7f1c5410fc80 2024-07-26T13:08:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.859+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c380b3c80 0x7f1c380b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 -- 172.21.15.40:0/952659759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 msgr2=0x56435a2b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2b36c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400cc60 tx=0x7f1c4400e720 comp rx=0 tx=0).stop 2024-07-26T13:08:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c380b3c80 0x7f1c380b6190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006010 tx=0x7f1c3c009380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 -- 172.21.15.40:0/952659759 shutdown_connections 2024-07-26T13:08:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2b36c0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 --2- 172.21.15.40:0/952659759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 -- 172.21.15.40:0/952659759 >> 172.21.15.40:0/952659759 conn(0x564359f02910 msgr2=0x56435a2b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 -- 172.21.15.40:0/952659759 shutdown_connections 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.860+0000 7f1c61061740 1 -- 172.21.15.40:0/952659759 wait complete. 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.861+0000 7f1c61061740 1 -- start start 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.861+0000 7f1c61061740 1 Processor -- start 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2be800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2bed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2cac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56435a07cbb0 con 0x564359ee5660 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56435a1b5910 con 0x564359f0e520 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56435a2c1960 con 0x564359eed840 2024-07-26T13:08:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c61061740 10 client.0 _ll_register_callbacks cb 0x564359f25d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c53400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c53400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2be800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56844/0 (socket says 172.21.15.40:56844) 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.862+0000 7f1c53400640 1 -- 172.21.15.40:0/3141494023 learned_addr learned my addr 172.21.15.40:0/3141494023 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53e00640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53400640 1 -- 172.21.15.40:0/3141494023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 msgr2=0x56435a2bed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53400640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2bed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53400640 1 -- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 msgr2=0x56435a2cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53400640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53400640 1 -- 172.21.15.40:0/3141494023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564359ff0960 con 0x564359ee5660 2024-07-26T13:08:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53e00640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:08:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c53400640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2be800 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1c44000c00 tx=0x7f1c44010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1725287cb4a3685 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.863+0000 7f1c41600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c41600640 1 -- 172.21.15.40:0/3141494023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44027060 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c41600640 1 -- 172.21.15.40:0/3141494023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1c44018620 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c440047a0 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c41600640 1 -- 172.21.15.40:0/3141494023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1c44014070 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c61061740 10 client.17277 fetch_fsmap learned FSMap version 35 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56435a2cd640 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.864+0000 7f1c41600640 1 -- 172.21.15.40:0/3141494023 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c440047a0 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c41600640 1 -- 172.21.15.40:0/3141494023 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1c4402c070 con 0x564359ee5660 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c61061740 10 client.17277 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c61061740 10 client.17277 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c61061740 20 client.17277 populate_metadata read hostname 'smithi040' 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c61061740 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359eccea0 0x56435a2d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c61061740 4 client.17277 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:08:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.865+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56435a22be80 con 0x564359eccea0 2024-07-26T13:08:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.866+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359eccea0 0x56435a2d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.867+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359eccea0 0x56435a2d0a50 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68e9c13cf175c67e server_cookie=ebea37500c05b140 in_seq=0 out_seq=0 2024-07-26T13:08:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.867+0000 7f1c41600640 10 client.17277 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c41600640 1 -- 172.21.15.40:0/3141494023 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56435a22be80 con 0x564359eccea0 2024-07-26T13:08:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c41600640 10 client.17277 handle_command_reply: tid=0 2024-07-26T13:08:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 client.17277 shutdown 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 msgr2=0x56435a2be800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2be800 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1c44000c00 tx=0x7f1c44010c10 comp rx=0 tx=0).stop 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 shutdown_connections 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359eed840 0x56435a2bed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359eccea0 0x56435a2d0a50 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 --2- 172.21.15.40:0/3141494023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359ee5660 0x56435a2be800 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 >> 172.21.15.40:0/3141494023 conn(0x564359f02910 msgr2=0x56435a2b6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c41600640 0 client.17277 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 shutdown_connections 2024-07-26T13:08:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.869+0000 7f1c61061740 1 -- 172.21.15.40:0/3141494023 wait complete. 2024-07-26T13:08:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.870+0000 7f1c61061740 20 client.17277 trim_cache size 0 max 16384 2024-07-26T13:08:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.888+0000 7f1c61061740 1 Processor -- start 2024-07-26T13:08:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.888+0000 7f1c61061740 1 -- start start 2024-07-26T13:08:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c61061740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c61061740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 0x56435a2b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c61061740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c61061740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541b5280 con 0x564359eed840 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c61061740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541b6dc0 con 0x564359f0e520 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c61061740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541b5950 con 0x564359ee5660 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c4aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 0x56435a2b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c4aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 0x56435a2b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56854/0 (socket says 172.21.15.40:56854) 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.889+0000 7f1c4aa00640 1 -- 172.21.15.40:0/1542781676 learned_addr learned my addr 172.21.15.40:0/1542781676 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:46.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c53400640 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c53e00640 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c4aa00640 1 -- 172.21.15.40:0/1542781676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 msgr2=0x56435a2ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c4aa00640 1 -- 172.21.15.40:0/1542781676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 msgr2=0x56435a2b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c4aa00640 1 -- 172.21.15.40:0/1542781676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435a2bf730 con 0x564359eed840 2024-07-26T13:08:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.890+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 0x56435a2b41b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c035000 tx=0x7f1c3c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a4cd22969f5f1b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.891+0000 7f1c43e00640 1 -- 172.21.15.40:0/1542781676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c030bc0 con 0x564359eed840 2024-07-26T13:08:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.891+0000 7f1c43e00640 1 -- 172.21.15.40:0/1542781676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c3c036040 con 0x564359eed840 2024-07-26T13:08:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.891+0000 7f1c43e00640 1 -- 172.21.15.40:0/1542781676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c046450 con 0x564359eed840 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.891+0000 7f1c61061740 1 -- 172.21.15.40:0/1542781676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 msgr2=0x56435a2b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.891+0000 7f1c61061740 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 0x56435a2b41b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c035000 tx=0x7f1c3c040000 comp rx=0 tx=0).stop 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 -- 172.21.15.40:0/1542781676 shutdown_connections 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359f0e520 0x56435a2b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359eed840 0x56435a2b41b0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 --2- 172.21.15.40:0/1542781676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 -- 172.21.15.40:0/1542781676 >> 172.21.15.40:0/1542781676 conn(0x564359f02910 msgr2=0x56435a2c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 -- 172.21.15.40:0/1542781676 shutdown_connections 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 -- 172.21.15.40:0/1542781676 wait complete. 2024-07-26T13:08:46.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 -- start start 2024-07-26T13:08:46.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.892+0000 7f1c61061740 1 Processor -- start 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359eed840 0x56435a2d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 0x56435a337fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541b66f0 con 0x564359f0e520 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541b6020 con 0x564359eed840 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c541b3240 con 0x564359ee5660 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c61061740 10 client.0 _ll_register_callbacks cb 0x7f1c4400cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.893+0000 7f1c53e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 0x56435a337fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 0x56435a337fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56868/0 (socket says 172.21.15.40:56868) 2024-07-26T13:08:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 -- 172.21.15.40:0/78369257 learned_addr learned my addr 172.21.15.40:0/78369257 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53400640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c4aa00640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359eed840 0x56435a2d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 -- 172.21.15.40:0/78369257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 msgr2=0x56435a2d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 -- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359eed840 msgr2=0x56435a2d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359eed840 0x56435a2d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 -- 172.21.15.40:0/78369257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435a3384e0 con 0x564359f0e520 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53400640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c53e00640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 0x56435a337fa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0a65d0 tx=0x7f1c4c0aa120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168bb4e001f51a5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.894+0000 7f1c41600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c41600640 1 -- 172.21.15.40:0/78369257 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0c4060 con 0x564359f0e520 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c41600640 1 -- 172.21.15.40:0/78369257 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1c4c005020 con 0x564359f0e520 2024-07-26T13:08:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c3c036040 con 0x564359f0e520 2024-07-26T13:08:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c41600640 1 -- 172.21.15.40:0/78369257 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c020070 con 0x564359f0e520 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c61061740 10 client.17283 fetch_fsmap learned FSMap version 35 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56435a3395f0 con 0x564359f0e520 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c41600640 1 -- 172.21.15.40:0/78369257 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c3c036040 con 0x564359f0e520 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.895+0000 7f1c41600640 1 -- 172.21.15.40:0/78369257 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1c4c0a5ec0 con 0x564359f0e520 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c61061740 10 client.17283 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c61061740 10 client.17283 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c61061740 20 client.17283 populate_metadata read hostname 'smithi040' 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c61061740 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359ea2250 0x56435a33bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c61061740 4 client.17283 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e29ec5d", "release": true, "await": true}] 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e29ec5d", "release": true, "await": true}) -- 0x56435a227920 con 0x564359ea2250 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.896+0000 7f1c53400640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359ea2250 0x56435a33bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:08:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.897+0000 7f1c53400640 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359ea2250 0x56435a33bd80 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1be380f97afdcac server_cookie=a7170a6396fca3d8 in_seq=0 out_seq=0 2024-07-26T13:08:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.897+0000 7f1c41600640 10 client.17283 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c41600640 1 -- 172.21.15.40:0/78369257 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x56435a227920 con 0x564359ea2250 2024-07-26T13:08:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c41600640 10 client.17283 handle_command_reply: tid=0 2024-07-26T13:08:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c61061740 1 client.17283 shutdown 2024-07-26T13:08:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 msgr2=0x56435a337fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c61061740 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 0x56435a337fa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0a65d0 tx=0x7f1c4c0aa120 comp rx=0 tx=0).stop 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 shutdown_connections 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c61061740 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x564359ea2250 0x56435a33bd80 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.961+0000 7f1c61061740 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564359f0e520 0x56435a337fa0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.962+0000 7f1c61061740 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564359eed840 0x56435a2d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.962+0000 7f1c61061740 1 --2- 172.21.15.40:0/78369257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564359ee5660 0x56435a2d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.962+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 >> 172.21.15.40:0/78369257 conn(0x564359f02910 msgr2=0x56435a2b8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.962+0000 7f1c41600640 0 client.17283 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.962+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 shutdown_connections 2024-07-26T13:08:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.962+0000 7f1c61061740 1 -- 172.21.15.40:0/78369257 wait complete. 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.963+0000 7f1c61061740 20 client.17283 trim_cache size 0 max 16384 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 152, 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout: "3e29ec5d": { 2024-07-26T13:08:46.965 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 152, 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.3, 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:08:46.966 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:08:46.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.964+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c380b3c80 msgr2=0x7f1c380b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.964+0000 7f1c58e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c380b3c80 0x7f1c380b6190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006010 tx=0x7f1c3c009380 comp rx=0 tx=0).stop 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.964+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 msgr2=0x7f1c541a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.964+0000 7f1c58e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 0x7f1c541a5ab0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00d750 tx=0x7f1c4c00dc10 comp rx=0 tx=0).stop 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 shutdown_connections 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c5410fc80 0x7f1c541a5ab0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c5410f330 0x7f1c541a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1c380b3c80 0x7f1c380b6190 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 --2- 172.21.15.40:0/3753264509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c541099f0 0x7f1c541a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 >> 172.21.15.40:0/3753264509 conn(0x7f1c54078ff0 msgr2=0x7f1c540797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 shutdown_connections 2024-07-26T13:08:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:08:46.965+0000 7f1c58e00640 1 -- 172.21.15.40:0/3753264509 wait complete. 2024-07-26T13:08:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:46 smithi146 ceph-mon[35807]: pgmap v1895: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:08:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:46 smithi076 ceph-mon[35401]: pgmap v1895: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:08:47.835 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e29ec5d', total seconds elapsed: 33.8 2024-07-26T13:08:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:48 smithi146 ceph-mon[35807]: pgmap v1896: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:08:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:48 smithi076 ceph-mon[35401]: pgmap v1896: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:08:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:48 smithi040 ceph-mon[32397]: pgmap v1896: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:08:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:50 smithi146 ceph-mon[35807]: pgmap v1897: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-07-26T13:08:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:50 smithi076 ceph-mon[35401]: pgmap v1897: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-07-26T13:08:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:50 smithi040 ceph-mon[32397]: pgmap v1897: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-07-26T13:08:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:52 smithi146 ceph-mon[35807]: pgmap v1898: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 29 KiB/s wr, 8 op/s 2024-07-26T13:08:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:52 smithi076 ceph-mon[35401]: pgmap v1898: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 29 KiB/s wr, 8 op/s 2024-07-26T13:08:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:52 smithi040 ceph-mon[32397]: pgmap v1898: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 29 KiB/s wr, 8 op/s 2024-07-26T13:08:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:54 smithi146 ceph-mon[35807]: pgmap v1899: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:08:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:54 smithi076 ceph-mon[35401]: pgmap v1899: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:08:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:54 smithi040 ceph-mon[32397]: pgmap v1899: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:08:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:56 smithi146 ceph-mon[35807]: pgmap v1900: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:08:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:56 smithi076 ceph-mon[35401]: pgmap v1900: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:08:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:56 smithi040 ceph-mon[32397]: pgmap v1900: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:08:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:08:58 smithi146 ceph-mon[35807]: pgmap v1901: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:08:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:08:58 smithi076 ceph-mon[35401]: pgmap v1901: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:08:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:08:58 smithi040 ceph-mon[32397]: pgmap v1901: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:09:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:00 smithi146 ceph-mon[35807]: pgmap v1902: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:09:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:00 smithi076 ceph-mon[35401]: pgmap v1902: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:09:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:00 smithi040 ceph-mon[32397]: pgmap v1902: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:09:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:02 smithi146 ceph-mon[35807]: pgmap v1903: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:02 smithi076 ceph-mon[35401]: pgmap v1903: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:02 smithi040 ceph-mon[32397]: pgmap v1903: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:04 smithi146 ceph-mon[35807]: pgmap v1904: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:09:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:04 smithi076 ceph-mon[35401]: pgmap v1904: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:09:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:04 smithi040 ceph-mon[32397]: pgmap v1904: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:09:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:06 smithi146 ceph-mon[35807]: pgmap v1905: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:09:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:06 smithi076 ceph-mon[35401]: pgmap v1905: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:09:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:06 smithi040 ceph-mon[32397]: pgmap v1905: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:09:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:08 smithi076 ceph-mon[35401]: pgmap v1906: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:09:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:08 smithi040 ceph-mon[32397]: pgmap v1906: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:09:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:08 smithi146 ceph-mon[35807]: pgmap v1906: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:09:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:10 smithi076 ceph-mon[35401]: pgmap v1907: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:09:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:10 smithi040 ceph-mon[32397]: pgmap v1907: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:09:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:10 smithi146 ceph-mon[35807]: pgmap v1907: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:09:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:12 smithi040 ceph-mon[32397]: pgmap v1908: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:12 smithi146 ceph-mon[35807]: pgmap v1908: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:12 smithi076 ceph-mon[35401]: pgmap v1908: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:14 smithi040 ceph-mon[32397]: pgmap v1909: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:09:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:14 smithi146 ceph-mon[35807]: pgmap v1909: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:09:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:14 smithi076 ceph-mon[35401]: pgmap v1909: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:09:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:16 smithi040 ceph-mon[32397]: pgmap v1910: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:09:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:16 smithi146 ceph-mon[35807]: pgmap v1910: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:09:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:16 smithi076 ceph-mon[35401]: pgmap v1910: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:09:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:18 smithi040 ceph-mon[32397]: pgmap v1911: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:09:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:18 smithi146 ceph-mon[35807]: pgmap v1911: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:09:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:18 smithi076 ceph-mon[35401]: pgmap v1911: 97 pgs: 97 active+clean; 8.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:09:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:20 smithi040 ceph-mon[32397]: pgmap v1912: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:09:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:20 smithi146 ceph-mon[35807]: pgmap v1912: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:09:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:20 smithi076 ceph-mon[35401]: pgmap v1912: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:09:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:22 smithi040 ceph-mon[32397]: pgmap v1913: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:09:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:22 smithi146 ceph-mon[35807]: pgmap v1913: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:09:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:22 smithi076 ceph-mon[35401]: pgmap v1913: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:09:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:24 smithi040 ceph-mon[32397]: pgmap v1914: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:09:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:24 smithi146 ceph-mon[35807]: pgmap v1914: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:09:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:24 smithi076 ceph-mon[35401]: pgmap v1914: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:09:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:26 smithi040 ceph-mon[32397]: pgmap v1915: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:09:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:26 smithi146 ceph-mon[35807]: pgmap v1915: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:09:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:26 smithi076 ceph-mon[35401]: pgmap v1915: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:09:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:28 smithi040 ceph-mon[32397]: pgmap v1916: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:09:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:28 smithi146 ceph-mon[35807]: pgmap v1916: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:09:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:28 smithi076 ceph-mon[35401]: pgmap v1916: 97 pgs: 97 active+clean; 8.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:09:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:30 smithi040 ceph-mon[32397]: pgmap v1917: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T13:09:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:09:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:30 smithi146 ceph-mon[35807]: pgmap v1917: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T13:09:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:09:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:30 smithi076 ceph-mon[35401]: pgmap v1917: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-07-26T13:09:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: pgmap v1918: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:09:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:09:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: pgmap v1918: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:09:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:09:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:09:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: pgmap v1918: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:09:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:33 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:09:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:33 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:09:34.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:33 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:09:34.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:33 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:09:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:33 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:09:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:33 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:09:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:34 smithi040 ceph-mon[32397]: pgmap v1919: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:09:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:34 smithi146 ceph-mon[35807]: pgmap v1919: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:09:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:34 smithi076 ceph-mon[35401]: pgmap v1919: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:09:36.679 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.6 2024-07-26T13:09:36.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:09:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:09:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:36 smithi040 ceph-mon[32397]: pgmap v1920: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:09:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:36 smithi146 ceph-mon[35807]: pgmap v1920: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:09:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:36 smithi076 ceph-mon[35401]: pgmap v1920: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:09:39.231 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:38 smithi040 ceph-mon[32397]: pgmap v1921: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:09:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:38 smithi146 ceph-mon[35807]: pgmap v1921: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:09:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:38 smithi076 ceph-mon[35401]: pgmap v1921: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:09:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 -- 172.21.15.40:0/2188173014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075ab0 msgr2=0x7f281810f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 --2- 172.21.15.40:0/2188173014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075ab0 0x7f281810f460 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2804009900 tx=0x7f280402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 -- 172.21.15.40:0/2188173014 shutdown_connections 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 --2- 172.21.15.40:0/2188173014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f281810f9a0 0x7f2818111dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 --2- 172.21.15.40:0/2188173014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075ab0 0x7f281810f460 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 --2- 172.21.15.40:0/2188173014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2818075160 0x7f2818075570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 -- 172.21.15.40:0/2188173014 >> 172.21.15.40:0/2188173014 conn(0x7f28180fee10 msgr2=0x7f2818101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.621+0000 7f2817200640 1 -- 172.21.15.40:0/2188173014 shutdown_connections 2024-07-26T13:09:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.622+0000 7f2817200640 1 -- 172.21.15.40:0/2188173014 wait complete. 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.623+0000 7f2817200640 1 Processor -- start 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.623+0000 7f2817200640 1 -- start start 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.623+0000 7f2817200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 0x7f281819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.623+0000 7f2817200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2818075ab0 0x7f281819c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.623+0000 7f2817200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281810f9a0 0x7f28181a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2817200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2818115360 con 0x7f2818075160 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2817200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f28181151e0 con 0x7f2818075ab0 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2817200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28181154e0 con 0x7f281810f9a0 2024-07-26T13:09:39.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2815e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 0x7f281819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:39.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2815e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 0x7f281819be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37238/0 (socket says 172.21.15.40:37238) 2024-07-26T13:09:39.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2815e00640 1 -- 172.21.15.40:0/3558662423 learned_addr learned my addr 172.21.15.40:0/3558662423 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:39.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2815400640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2818075ab0 0x7f281819c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:39.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.624+0000 7f2816800640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281810f9a0 0x7f28181a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815e00640 1 -- 172.21.15.40:0/3558662423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281810f9a0 msgr2=0x7f28181a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815e00640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281810f9a0 0x7f28181a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815e00640 1 -- 172.21.15.40:0/3558662423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2818075ab0 msgr2=0x7f281819c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815e00640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2818075ab0 0x7f281819c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815e00640 1 -- 172.21.15.40:0/3558662423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28181a1ce0 con 0x7f2818075160 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815400640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2818075ab0 0x7f281819c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f2815e00640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 0x7f281819be30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f280800c920 tx=0x7f280800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.625+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808007c70 con 0x7f2818075160 2024-07-26T13:09:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.626+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2808007e10 con 0x7f2818075160 2024-07-26T13:09:39.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.626+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28181a1fd0 con 0x7f2818075160 2024-07-26T13:09:39.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.626+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181a87f0 con 0x7f2818075160 2024-07-26T13:09:39.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.626+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808018710 con 0x7f2818075160 2024-07-26T13:09:39.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.627+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2818076670 con 0x7f2818075160 2024-07-26T13:09:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.630+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f280800f450 con 0x7f2818075160 2024-07-26T13:09:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.632+0000 7f280ea00640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27fc0b3c00 0x7f27fc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.633+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28080e4110 con 0x7f2818075160 2024-07-26T13:09:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.633+0000 7f2815400640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27fc0b3c00 0x7f27fc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.634+0000 7f2815400640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27fc0b3c00 0x7f27fc0b6110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f28040057c0 tx=0x7f2804009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.636+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2808014030 con 0x7f2818075160 2024-07-26T13:09:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.930+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f281810ab80 con 0x7f2818075160 2024-07-26T13:09:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.932+0000 7f280ea00640 1 -- 172.21.15.40:0/3558662423 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f28080ab7b0 con 0x7f2818075160 2024-07-26T13:09:39.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:09:39.935 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:09:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.935+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27fc0b3c00 msgr2=0x7f27fc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.935+0000 7f2817200640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27fc0b3c00 0x7f27fc0b6110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f28040057c0 tx=0x7f2804009680 comp rx=0 tx=0).stop 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.935+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 msgr2=0x7f281819be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 0x7f281819be30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f280800c920 tx=0x7f280800cde0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 shutdown_connections 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f27fc0b3c00 0x7f27fc0b6110 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f281810f9a0 0x7f28181a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2818075ab0 0x7f281819c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 --2- 172.21.15.40:0/3558662423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2818075160 0x7f281819be30 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 >> 172.21.15.40:0/3558662423 conn(0x7f28180fee10 msgr2=0x7f28180ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 shutdown_connections 2024-07-26T13:09:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:39.936+0000 7f2817200640 1 -- 172.21.15.40:0/3558662423 wait complete. 2024-07-26T13:09:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:39 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3558662423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:09:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:39 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3558662423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:09:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:39 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3558662423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:09:40.860 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130.6 --await-for 45.0' 2024-07-26T13:09:40.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130.6 --await-for 45.0 2024-07-26T13:09:41.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:40 smithi040 ceph-mon[32397]: pgmap v1922: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:09:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:40 smithi146 ceph-mon[35807]: pgmap v1922: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:09:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:40 smithi076 ceph-mon[35401]: pgmap v1922: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:09:41.352 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:09:43.132 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:42 smithi040 ceph-mon[32397]: pgmap v1923: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:09:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:42 smithi146 ceph-mon[35807]: pgmap v1923: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:09:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:42 smithi076 ceph-mon[35401]: pgmap v1923: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:09:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 -- 172.21.15.40:0/1168378534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02381035a0 msgr2=0x7f02381039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 --2- 172.21.15.40:0/1168378534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02381035a0 0x7f02381039b0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0228009900 tx=0x7f022802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 -- 172.21.15.40:0/1168378534 shutdown_connections 2024-07-26T13:09:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 --2- 172.21.15.40:0/1168378534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0238109830 0x7f0238110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 --2- 172.21.15.40:0/1168378534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0238108ee0 0x7f02381092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 --2- 172.21.15.40:0/1168378534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02381035a0 0x7f02381039b0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 -- 172.21.15.40:0/1168378534 >> 172.21.15.40:0/1168378534 conn(0x7f02380fefd0 msgr2=0x7f0238101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.699+0000 7f023ea00640 1 -- 172.21.15.40:0/1168378534 shutdown_connections 2024-07-26T13:09:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.700+0000 7f023ea00640 1 -- 172.21.15.40:0/1168378534 wait complete. 2024-07-26T13:09:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.701+0000 7f023ea00640 1 Processor -- start 2024-07-26T13:09:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.701+0000 7f023ea00640 1 -- start start 2024-07-26T13:09:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02381035a0 0x7f023819c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 0x7f023819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0238109830 0x7f02381a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ea00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f02381133b0 con 0x7f0238108ee0 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ea00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0238113230 con 0x7f0238109830 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0238113530 con 0x7f02381035a0 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f022fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 0x7f023819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f022fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 0x7f023819c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44968/0 (socket says 172.21.15.40:44968) 2024-07-26T13:09:43.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f022fe00640 1 -- 172.21.15.40:0/2255622493 learned_addr learned my addr 172.21.15.40:0/2255622493 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:43.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f0237e00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02381035a0 0x7f023819c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.702+0000 7f023ca00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0238109830 0x7f02381a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f022fe00640 1 -- 172.21.15.40:0/2255622493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02381035a0 msgr2=0x7f023819c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f022fe00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02381035a0 0x7f023819c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f022fe00640 1 -- 172.21.15.40:0/2255622493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0238109830 msgr2=0x7f02381a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f022fe00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0238109830 0x7f02381a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f022fe00640 1 -- 172.21.15.40:0/2255622493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02381a1f70 con 0x7f0238108ee0 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f0237e00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02381035a0 0x7f023819c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f022fe00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 0x7f023819c5a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f022000d750 tx=0x7f022000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.703+0000 7f0235600640 1 -- 172.21.15.40:0/2255622493 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220017070 con 0x7f0238108ee0 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.704+0000 7f0235600640 1 -- 172.21.15.40:0/2255622493 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02200054b0 con 0x7f0238108ee0 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.704+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02381a2260 con 0x7f0238108ee0 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.704+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02381a89c0 con 0x7f0238108ee0 2024-07-26T13:09:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.704+0000 7f0235600640 1 -- 172.21.15.40:0/2255622493 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220004bc0 con 0x7f0238108ee0 2024-07-26T13:09:43.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.707+0000 7f02457d3740 1 Processor -- start 2024-07-26T13:09:43.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 -- start start 2024-07-26T13:09:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 0x55efe36b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe32e3980 0x55efe36b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55efe367ccf0 con 0x55efe32ebb60 2024-07-26T13:09:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55efe3627b40 con 0x55efe330c840 2024-07-26T13:09:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.708+0000 7f02457d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55efe3617040 con 0x55efe32e3980 2024-07-26T13:09:43.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.709+0000 7f023ca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 0x55efe36b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.709+0000 7f023ca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 0x55efe36b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:39376/0 (socket says 172.21.15.40:39376) 2024-07-26T13:09:43.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.709+0000 7f023ca00640 1 -- 172.21.15.40:0/1497069473 learned_addr learned my addr 172.21.15.40:0/1497069473 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:43.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.709+0000 7f0237e00640 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe32e3980 0x55efe36b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f0235600640 1 -- 172.21.15.40:0/2255622493 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0220009c30 con 0x7f0238108ee0 2024-07-26T13:09:43.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f022fe00640 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f0237e00640 1 -- 172.21.15.40:0/1497069473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 msgr2=0x55efe36b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f0237e00640 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 0x55efe36b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f0237e00640 1 -- 172.21.15.40:0/1497069473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 msgr2=0x55efe36b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f0237e00640 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f0237e00640 1 -- 172.21.15.40:0/1497069473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe359eaf0 con 0x55efe32e3980 2024-07-26T13:09:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.710+0000 7f023ca00640 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 0x55efe36b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:09:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.711+0000 7f0237e00640 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe32e3980 0x55efe36b26e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f02280057c0 tx=0x7f0228032dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d3c4c6d8e8c2a81 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.711+0000 7f022d200640 1 -- 172.21.15.40:0/1497069473 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022803f070 con 0x55efe32e3980 2024-07-26T13:09:43.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.712+0000 7f022d200640 1 -- 172.21.15.40:0/1497069473 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0228005de0 con 0x55efe32e3980 2024-07-26T13:09:43.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.712+0000 7f022d200640 1 -- 172.21.15.40:0/1497069473 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228035070 con 0x55efe32e3980 2024-07-26T13:09:43.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.712+0000 7f0235600640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f021c0b3c50 0x7f021c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.712+0000 7f0235600640 1 -- 172.21.15.40:0/2255622493 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f02200e35a0 con 0x7f0238108ee0 2024-07-26T13:09:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f023ca00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f021c0b3c50 0x7f021c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 -- 172.21.15.40:0/1497069473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe32e3980 msgr2=0x55efe36b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe32e3980 0x55efe36b26e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f02280057c0 tx=0x7f0228032dd0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 -- 172.21.15.40:0/1497069473 shutdown_connections 2024-07-26T13:09:43.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe32e3980 0x55efe36b26e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 --2- 172.21.15.40:0/1497069473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe330c840 0x55efe36b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 -- 172.21.15.40:0/1497069473 >> 172.21.15.40:0/1497069473 conn(0x55efe3300990 msgr2=0x55efe36b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:43.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 -- 172.21.15.40:0/1497069473 shutdown_connections 2024-07-26T13:09:43.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.713+0000 7f02457d3740 1 -- 172.21.15.40:0/1497069473 wait complete. 2024-07-26T13:09:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.714+0000 7f023ca00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f021c0b3c50 0x7f021c0b6160 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0230005c40 tx=0x7f02300097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.714+0000 7f02457d3740 1 -- start start 2024-07-26T13:09:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.715+0000 7f02457d3740 1 Processor -- start 2024-07-26T13:09:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.715+0000 7f02457d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f02457d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f02457d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe330c840 0x55efe36d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f02457d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55efe35b3500 con 0x55efe32ebb60 2024-07-26T13:09:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f02457d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55efe361b080 con 0x55efe32e3980 2024-07-26T13:09:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f02457d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55efe347a7a0 con 0x55efe330c840 2024-07-26T13:09:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f02457d3740 10 client.0 _ll_register_callbacks cb 0x55efe360fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:09:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f0237e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f022fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f0237e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:39390/0 (socket says 172.21.15.40:39390) 2024-07-26T13:09:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.716+0000 7f0237e00640 1 -- 172.21.15.40:0/35711978 learned_addr learned my addr 172.21.15.40:0/35711978 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f023ca00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe330c840 0x55efe36d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f022fe00640 1 -- 172.21.15.40:0/35711978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe330c840 msgr2=0x55efe36d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f022fe00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe330c840 0x55efe36d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f022fe00640 1 -- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 msgr2=0x55efe36c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f022fe00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f022fe00640 1 -- 172.21.15.40:0/35711978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe3386b90 con 0x55efe32ebb60 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.717+0000 7f023ca00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe330c840 0x55efe36d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.718+0000 7f022fe00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36c66c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f02200aa440 tx=0x7f0220004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f8f6eb60555ef5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.718+0000 7f0225600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:09:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.718+0000 7f0225600640 1 -- 172.21.15.40:0/35711978 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220020050 con 0x55efe32ebb60 2024-07-26T13:09:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.718+0000 7f0225600640 1 -- 172.21.15.40:0/35711978 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f02200b30d0 con 0x55efe32ebb60 2024-07-26T13:09:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.718+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55efe3629a90 con 0x55efe32ebb60 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.719+0000 7f0225600640 1 -- 172.21.15.40:0/35711978 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f02200a9e00 con 0x55efe32ebb60 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.719+0000 7f02457d3740 10 client.17301 fetch_fsmap learned FSMap version 35 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.719+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55efe36d4df0 con 0x55efe32ebb60 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.719+0000 7f0225600640 1 -- 172.21.15.40:0/35711978 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55efe3629a90 con 0x55efe32ebb60 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.719+0000 7f0225600640 1 -- 172.21.15.40:0/35711978 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f02200e3110 con 0x55efe32ebb60 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.720+0000 7f02457d3740 10 client.17301 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.720+0000 7f02457d3740 10 client.17301 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.720+0000 7f02457d3740 20 client.17301 populate_metadata read hostname 'smithi040' 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.720+0000 7f02457d3740 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe32cb1c0 0x55efe36d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.720+0000 7f02457d3740 4 client.17301 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:09:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.720+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efe3625530 con 0x55efe32cb1c0 2024-07-26T13:09:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.721+0000 7f0237e00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe32cb1c0 0x55efe36d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.722+0000 7f0237e00640 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe32cb1c0 0x55efe36d83e0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=212ae7218aad9981 server_cookie=1bc2e81c431e0bde in_seq=0 out_seq=0 2024-07-26T13:09:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.722+0000 7f0225600640 10 client.17301 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:43.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.724+0000 7f0225600640 1 -- 172.21.15.40:0/35711978 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efe3625530 con 0x55efe32cb1c0 2024-07-26T13:09:43.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.724+0000 7f0225600640 10 client.17301 handle_command_reply: tid=0 2024-07-26T13:09:43.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.724+0000 7f02457d3740 1 client.17301 shutdown 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 msgr2=0x55efe36c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36c66c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f02200aa440 tx=0x7f0220004730 comp rx=0 tx=0).stop 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 shutdown_connections 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe330c840 0x55efe36d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe32cb1c0 0x55efe36d83e0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36c66c0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 --2- 172.21.15.40:0/35711978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 >> 172.21.15.40:0/35711978 conn(0x55efe3300990 msgr2=0x55efe36ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f0225600640 0 client.17301 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 shutdown_connections 2024-07-26T13:09:43.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 1 -- 172.21.15.40:0/35711978 wait complete. 2024-07-26T13:09:43.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.725+0000 7f02457d3740 20 client.17301 trim_cache size 0 max 16384 2024-07-26T13:09:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.753+0000 7f02457d3740 1 Processor -- start 2024-07-26T13:09:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.753+0000 7f02457d3740 1 -- start start 2024-07-26T13:09:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f02457d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe36c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f02457d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f02457d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f02457d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f021400e480 con 0x55efe32ebb60 2024-07-26T13:09:43.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f02457d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f021400ffc0 con 0x55efe32e3980 2024-07-26T13:09:43.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f02457d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f021400eb50 con 0x55efe3300990 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f023ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f023ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36d20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44996/0 (socket says 172.21.15.40:44996) 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f023ca00640 1 -- 172.21.15.40:0/1709503705 learned_addr learned my addr 172.21.15.40:0/1709503705 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.754+0000 7f0237e00640 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe36c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f022fe00640 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f023ca00640 1 -- 172.21.15.40:0/1709503705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 msgr2=0x55efe36c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f023ca00640 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe36c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f023ca00640 1 -- 172.21.15.40:0/1709503705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 msgr2=0x55efe36c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f023ca00640 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f023ca00640 1 -- 172.21.15.40:0/1709503705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe36af7c0 con 0x55efe32ebb60 2024-07-26T13:09:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.755+0000 7f022fe00640 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.756+0000 7f023ca00640 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36d20a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f0230010700 tx=0x7f0230015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad50a8cedfb577ce server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.756+0000 7f0227e00640 1 -- 172.21.15.40:0/1709503705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023001e610 con 0x55efe32ebb60 2024-07-26T13:09:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.756+0000 7f0227e00640 1 -- 172.21.15.40:0/1709503705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f023001ec40 con 0x55efe32ebb60 2024-07-26T13:09:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.756+0000 7f0227e00640 1 -- 172.21.15.40:0/1709503705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023001cb50 con 0x55efe32ebb60 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 -- 172.21.15.40:0/1709503705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 msgr2=0x55efe36d20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36d20a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f0230010700 tx=0x7f0230015000 comp rx=0 tx=0).stop 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 -- 172.21.15.40:0/1709503705 shutdown_connections 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32ebb60 0x55efe36d20a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32e3980 0x55efe36c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 --2- 172.21.15.40:0/1709503705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe36c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 -- 172.21.15.40:0/1709503705 >> 172.21.15.40:0/1709503705 conn(0x55efe36c1ad0 msgr2=0x55efe36b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.757+0000 7f02457d3740 1 -- 172.21.15.40:0/1709503705 shutdown_connections 2024-07-26T13:09:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.758+0000 7f02457d3740 1 -- 172.21.15.40:0/1709503705 wait complete. 2024-07-26T13:09:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.758+0000 7f02457d3740 1 -- start start 2024-07-26T13:09:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.758+0000 7f02457d3740 1 Processor -- start 2024-07-26T13:09:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 0x55efe36ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32ebb60 0x55efe36cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe373fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f021400f8f0 con 0x55efe32e3980 2024-07-26T13:09:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f021400f220 con 0x55efe32ebb60 2024-07-26T13:09:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f021400c440 con 0x55efe3300990 2024-07-26T13:09:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f02457d3740 10 client.0 _ll_register_callbacks cb 0x7f0220009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.759+0000 7f0237e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 0x55efe36ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 0x55efe36ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45006/0 (socket says 172.21.15.40:45006) 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 -- 172.21.15.40:0/1022305737 learned_addr learned my addr 172.21.15.40:0/1022305737 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f023ca00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe373fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f022fe00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32ebb60 0x55efe36cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 -- 172.21.15.40:0/1022305737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 msgr2=0x55efe373fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe373fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 -- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32ebb60 msgr2=0x55efe36cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32ebb60 0x55efe36cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:43.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 -- 172.21.15.40:0/1022305737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe37400b0 con 0x55efe32e3980 2024-07-26T13:09:43.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0237e00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 0x55efe36ca820 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0228009900 tx=0x7f02280051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee4ffdc3d224a2e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:43.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.760+0000 7f0225600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.761+0000 7f0225600640 1 -- 172.21.15.40:0/1022305737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022803f040 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.761+0000 7f0225600640 1 -- 172.21.15.40:0/1022305737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0228031610 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.761+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f023001ec40 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.761+0000 7f0225600640 1 -- 172.21.15.40:0/1022305737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0228035070 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.761+0000 7f02457d3740 10 client.17307 fetch_fsmap learned FSMap version 35 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.761+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55efe3741310 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f0225600640 1 -- 172.21.15.40:0/1022305737 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f023001ec40 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f0225600640 1 -- 172.21.15.40:0/1022305737 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0228056030 con 0x55efe32e3980 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f02457d3740 10 client.17307 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:09:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f02457d3740 10 client.17307 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f02457d3740 20 client.17307 populate_metadata read hostname 'smithi040' 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f02457d3740 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe330c840 0x55efe37436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f02457d3740 4 client.17307 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.6, "await_for": 45.0}] 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.762+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.6, "await_for": 45.0}) -- 0x55efe3622c70 con 0x55efe330c840 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.763+0000 7f022fe00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe330c840 0x55efe37436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.764+0000 7f0225600640 10 client.17307 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:43.764+0000 7f022fe00640 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe330c840 0x55efe37436c0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a18167cee789600b server_cookie=dddf40c8e0b3092d in_seq=0 out_seq=0 2024-07-26T13:09:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.041+0000 7f0225600640 1 -- 172.21.15.40:0/1022305737 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55efe3622c70 con 0x55efe330c840 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.041+0000 7f0225600640 10 client.17307 handle_command_reply: tid=0 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.041+0000 7f02457d3740 1 client.17307 shutdown 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 msgr2=0x55efe36ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 0x55efe36ca820 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0228009900 tx=0x7f02280051e0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 shutdown_connections 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efe3300990 0x55efe373fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efe32ebb60 0x55efe36cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55efe330c840 0x55efe37436c0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 --2- 172.21.15.40:0/1022305737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55efe32e3980 0x55efe36ca820 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 >> 172.21.15.40:0/1022305737 conn(0x55efe36c1ad0 msgr2=0x55efe36c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.042+0000 7f0225600640 0 client.17307 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.043+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 shutdown_connections 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.043+0000 7f02457d3740 1 -- 172.21.15.40:0/1022305737 wait complete. 2024-07-26T13:09:44.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.043+0000 7f02457d3740 20 client.17307 trim_cache size 0 max 16384 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 154, 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "fd31d373": { 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 154, 2024-07-26T13:09:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.6, 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:44.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:44.048 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:44.048 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:44.048 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:44.048 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:09:44.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.044+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f021c0b3c50 msgr2=0x7f021c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.044+0000 7f023ea00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f021c0b3c50 0x7f021c0b6160 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0230005c40 tx=0x7f02300097e0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.044+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 msgr2=0x7f023819c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.044+0000 7f023ea00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 0x7f023819c5a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f022000d750 tx=0x7f022000dc10 comp rx=0 tx=0).stop 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 shutdown_connections 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0238109830 0x7f02381a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0238108ee0 0x7f023819c5a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f021c0b3c50 0x7f021c0b6160 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 --2- 172.21.15.40:0/2255622493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02381035a0 0x7f023819c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 >> 172.21.15.40:0/2255622493 conn(0x7f02380fefd0 msgr2=0x7f023810e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 shutdown_connections 2024-07-26T13:09:44.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:44.045+0000 7f023ea00640 1 -- 172.21.15.40:0/2255622493 wait complete. 2024-07-26T13:09:44.927 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fd31d373', quiesce took 8.2 seconds. Will release after: 2.4000000000000004 2024-07-26T13:09:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:45 smithi040 ceph-mon[32397]: pgmap v1924: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:09:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:45 smithi146 ceph-mon[35807]: pgmap v1924: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:09:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:45 smithi076 ceph-mon[35401]: pgmap v1924: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:09:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:47 smithi146 ceph-mon[35807]: pgmap v1925: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:09:47.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:09:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:47 smithi076 ceph-mon[35401]: pgmap v1925: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:09:47.414 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:47 smithi040 ceph-mon[32397]: pgmap v1925: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:09:47.823 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:09:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:49 smithi146 ceph-mon[35807]: pgmap v1926: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:09:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:49 smithi076 ceph-mon[35401]: pgmap v1926: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:09:49.479 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:49 smithi040 ceph-mon[32397]: pgmap v1926: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:09:50.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 -- 172.21.15.40:0/2022047558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7920104270 msgr2=0x7f7920104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 --2- 172.21.15.40:0/2022047558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7920104270 0x7f7920104680 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7910009900 tx=0x7f791002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 -- 172.21.15.40:0/2022047558 shutdown_connections 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 --2- 172.21.15.40:0/2022047558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f792010d820 0x7f792010fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 --2- 172.21.15.40:0/2022047558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 0x7f792010d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 --2- 172.21.15.40:0/2022047558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7920104270 0x7f7920104680 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 -- 172.21.15.40:0/2022047558 >> 172.21.15.40:0/2022047558 conn(0x7f7920079160 msgr2=0x7f7920079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 -- 172.21.15.40:0/2022047558 shutdown_connections 2024-07-26T13:09:50.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.376+0000 7f7925800640 1 -- 172.21.15.40:0/2022047558 wait complete. 2024-07-26T13:09:50.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 Processor -- start 2024-07-26T13:09:50.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 -- start start 2024-07-26T13:09:50.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7920104270 0x7f7920102180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:50.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 0x7f79201026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:50.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 0x7f7920102c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:50.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7920113360 con 0x7f792010d820 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79201131e0 con 0x7f7920104270 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.378+0000 7f7925800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79201134e0 con 0x7f7920104ca0 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 0x7f7920102c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 0x7f7920102c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45038/0 (socket says 172.21.15.40:45038) 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 -- 172.21.15.40:0/465831 learned_addr learned my addr 172.21.15.40:0/465831 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791ea00640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7920104270 0x7f7920102180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f7917e00640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 0x7f79201026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 -- 172.21.15.40:0/465831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 msgr2=0x7f79201026c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 0x7f79201026c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 -- 172.21.15.40:0/465831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7920104270 msgr2=0x7f7920102180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7920104270 0x7f7920102180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791f400640 1 -- 172.21.15.40:0/465831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79201a80d0 con 0x7f792010d820 2024-07-26T13:09:50.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f791ea00640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7920104270 0x7f7920102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:50.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.379+0000 7f7917e00640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 0x7f79201026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:50.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.380+0000 7f791f400640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 0x7f7920102c00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f791800eaa0 tx=0x7f791800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:50.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.380+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791800cdb0 con 0x7f792010d820 2024-07-26T13:09:50.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.380+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7918005020 con 0x7f792010d820 2024-07-26T13:09:50.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.380+0000 7f7925800640 1 -- 172.21.15.40:0/465831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79201a83c0 con 0x7f792010d820 2024-07-26T13:09:50.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.380+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180116d0 con 0x7f792010d820 2024-07-26T13:09:50.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.380+0000 7f7925800640 1 -- 172.21.15.40:0/465831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79201a88b0 con 0x7f792010d820 2024-07-26T13:09:50.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.381+0000 7f7925800640 1 -- 172.21.15.40:0/465831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7920104680 con 0x7f792010d820 2024-07-26T13:09:50.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.386+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f79180051d0 con 0x7f792010d820 2024-07-26T13:09:50.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.388+0000 7f7917400640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79040b3bd0 0x7f79040b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:50.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.388+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f79180e4200 con 0x7f792010d820 2024-07-26T13:09:50.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.388+0000 7f791ea00640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79040b3bd0 0x7f79040b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:50.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.389+0000 7f791ea00640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79040b3bd0 0x7f79040b60e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f79100057c0 tx=0x7f7910005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:50.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.389+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7918016030 con 0x7f792010d820 2024-07-26T13:09:50.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.632+0000 7f7925800640 1 -- 172.21.15.40:0/465831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7920103480 con 0x7f792010d820 2024-07-26T13:09:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.633+0000 7f7917400640 1 -- 172.21.15.40:0/465831 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f79180ab810 con 0x7f792010d820 2024-07-26T13:09:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:09:50.636 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:09:50.636 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:09:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.636+0000 7f7925800640 1 -- 172.21.15.40:0/465831 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79040b3bd0 msgr2=0x7f79040b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.636+0000 7f7925800640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79040b3bd0 0x7f79040b60e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f79100057c0 tx=0x7f7910005de0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 -- 172.21.15.40:0/465831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 msgr2=0x7f7920102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:50.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 0x7f7920102c00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f791800eaa0 tx=0x7f791800ef60 comp rx=0 tx=0).stop 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 -- 172.21.15.40:0/465831 shutdown_connections 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792010d820 0x7f7920102c00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79040b3bd0 0x7f79040b60e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920104ca0 0x7f79201026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 --2- 172.21.15.40:0/465831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7920104270 0x7f7920102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 -- 172.21.15.40:0/465831 >> 172.21.15.40:0/465831 conn(0x7f7920079160 msgr2=0x7f79200ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 -- 172.21.15.40:0/465831 shutdown_connections 2024-07-26T13:09:50.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:50.637+0000 7f7925800640 1 -- 172.21.15.40:0/465831 wait complete. 2024-07-26T13:09:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:51 smithi146 ceph-mon[35807]: pgmap v1927: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:09:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:51 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/465831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:09:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:51 smithi076 ceph-mon[35401]: pgmap v1927: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:09:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:51 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/465831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:09:51.457 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:51 smithi040 ceph-mon[32397]: pgmap v1927: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:09:51.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:51 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/465831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:09:51.513 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id fd31d373 --release --await' 2024-07-26T13:09:51.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id fd31d373 --release --await 2024-07-26T13:09:51.997 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:09:53.219 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:53 smithi040 ceph-mon[32397]: pgmap v1928: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:53 smithi146 ceph-mon[35807]: pgmap v1928: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:53 smithi076 ceph-mon[35401]: pgmap v1928: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:09:54.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 -- 172.21.15.40:0/2425011232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10f330 msgr2=0x7f4cfc10f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 --2- 172.21.15.40:0/2425011232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10f330 0x7f4cfc10f740 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009900 tx=0x7f4ce802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 -- 172.21.15.40:0/2425011232 shutdown_connections 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 --2- 172.21.15.40:0/2425011232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 --2- 172.21.15.40:0/2425011232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10f330 0x7f4cfc10f740 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 --2- 172.21.15.40:0/2425011232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 0x7f4cfc109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 -- 172.21.15.40:0/2425011232 >> 172.21.15.40:0/2425011232 conn(0x7f4cfc078ff0 msgr2=0x7f4cfc107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 -- 172.21.15.40:0/2425011232 shutdown_connections 2024-07-26T13:09:55.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.997+0000 7f4cfb200640 1 -- 172.21.15.40:0/2425011232 wait complete. 2024-07-26T13:09:55.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 Processor -- start 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 -- start start 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 0x7f4cfc1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4cfc10f330 0x7f4cfc1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1197f0 con 0x7f4cfc10fc80 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc119670 con 0x7f4cfc10f330 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:54.999+0000 7f4cfb200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc119970 con 0x7f4cfc1099f0 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60612/0 (socket says 172.21.15.40:60612) 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 -- 172.21.15.40:0/3706301766 learned_addr learned my addr 172.21.15.40:0/3706301766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:55.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 0x7f4cfc1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4cfc10f330 0x7f4cfc1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 -- 172.21.15.40:0/3706301766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 msgr2=0x7f4cfc1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 0x7f4cfc1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 -- 172.21.15.40:0/3706301766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4cfc10f330 msgr2=0x7f4cfc1a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4cfc10f330 0x7f4cfc1a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cfa800640 1 -- 172.21.15.40:0/3706301766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc1a61b0 con 0x7f4cfc10fc80 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.000+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 0x7f4cfc1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.001+0000 7f4cfa800640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1a5b40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400eaa0 tx=0x7f4cf400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.001+0000 7f4cf2a00640 1 -- 172.21.15.40:0/3706301766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400cdb0 con 0x7f4cfc10fc80 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.001+0000 7f4cf2a00640 1 -- 172.21.15.40:0/3706301766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf4005020 con 0x7f4cfc10fc80 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.001+0000 7f4cf2a00640 1 -- 172.21.15.40:0/3706301766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40116d0 con 0x7f4cfc10fc80 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.001+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc1a64a0 con 0x7f4cfc10fc80 2024-07-26T13:09:55.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.001+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc1a6960 con 0x7f4cfc10fc80 2024-07-26T13:09:55.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.005+0000 7f4d079f9740 1 Processor -- start 2024-07-26T13:09:55.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.005+0000 7f4cf2a00640 1 -- 172.21.15.40:0/3706301766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4cf40051d0 con 0x7f4cfc10fc80 2024-07-26T13:09:55.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 -- start start 2024-07-26T13:09:55.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffca81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffca86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffca8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a1ffc1ef50 con 0x55a1ff8e2840 2024-07-26T13:09:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a1ffc0e450 con 0x55a1ff8da660 2024-07-26T13:09:55.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4d079f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a1ffc12490 con 0x55a1ff903520 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.006+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffca8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffca8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60620/0 (socket says 172.21.15.40:60620) 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 -- 172.21.15.40:0/2974137341 learned_addr learned my addr 172.21.15.40:0/2974137341 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffca81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffca86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 -- 172.21.15.40:0/2974137341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 msgr2=0x55a1ffca81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffca81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 -- 172.21.15.40:0/2974137341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 msgr2=0x55a1ffca86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffca86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.007+0000 7f4cf9400640 1 -- 172.21.15.40:0/2974137341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ff96eb00 con 0x55a1ff8e2840 2024-07-26T13:09:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4cf2a00640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4ce00b3c00 0x7f4ce00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4cf9400640 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffca8c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8005ab0 tx=0x7f4ce8005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df11161b3943ebc0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4cf2a00640 1 -- 172.21.15.40:0/3706301766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4cf40e3e70 con 0x7f4cfc10fc80 2024-07-26T13:09:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4ce00b3c00 0x7f4ce00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4ce7000640 1 -- 172.21.15.40:0/2974137341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8035040 con 0x55a1ff8e2840 2024-07-26T13:09:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4ce7000640 1 -- 172.21.15.40:0/2974137341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ce8032c10 con 0x55a1ff8e2840 2024-07-26T13:09:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.008+0000 7f4ce7000640 1 -- 172.21.15.40:0/2974137341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8003d80 con 0x55a1ff8e2840 2024-07-26T13:09:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.009+0000 7f4d079f9740 1 -- 172.21.15.40:0/2974137341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 msgr2=0x55a1ffca8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.009+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4ce00b3c00 0x7f4ce00b6110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55a1ffca6e20 tx=0x7f4cec0084c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.009+0000 7f4d079f9740 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffca8c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8005ab0 tx=0x7f4ce8005a40 comp rx=0 tx=0).stop 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 -- 172.21.15.40:0/2974137341 shutdown_connections 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffca8c20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffca86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 --2- 172.21.15.40:0/2974137341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffca81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 -- 172.21.15.40:0/2974137341 >> 172.21.15.40:0/2974137341 conn(0x55a1ff8f7910 msgr2=0x55a1ffca6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 -- 172.21.15.40:0/2974137341 shutdown_connections 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 -- 172.21.15.40:0/2974137341 wait complete. 2024-07-26T13:09:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.010+0000 7f4d079f9740 1 -- start start 2024-07-26T13:09:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 Processor -- start 2024-07-26T13:09:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcb3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcbfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55a1ffa71bb0 con 0x55a1ff8e2840 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a1ffbaa930 con 0x55a1ff8da660 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a1ffcb6920 con 0x55a1ff903520 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.011+0000 7f4d079f9740 10 client.0 _ll_register_callbacks cb 0x55a1ff91ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcb3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcb3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60626/0 (socket says 172.21.15.40:60626) 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 -- 172.21.15.40:0/3193148974 learned_addr learned my addr 172.21.15.40:0/3193148974 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cfa800640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcbfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 -- 172.21.15.40:0/3193148974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 msgr2=0x55a1ffcbfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcbfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 -- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 msgr2=0x55a1ffcb38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.012+0000 7f4cf9400640 1 -- 172.21.15.40:0/3193148974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ff9e5960 con 0x55a1ff8e2840 2024-07-26T13:09:55.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcb3de0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce80314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cba54b8274c8ed server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:55.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4cdb400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4cdb400640 1 -- 172.21.15.40:0/3193148974 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8035050 con 0x55a1ff8e2840 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4cdb400640 1 -- 172.21.15.40:0/3193148974 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4ce8005030 con 0x55a1ff8e2840 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce8032c10 con 0x55a1ff8e2840 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4cdb400640 1 -- 172.21.15.40:0/3193148974 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4ce8031850 con 0x55a1ff8e2840 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4d079f9740 10 client.17325 fetch_fsmap learned FSMap version 35 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.013+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a1ffcc2690 con 0x55a1ff8e2840 2024-07-26T13:09:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4cdb400640 1 -- 172.21.15.40:0/3193148974 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ce8032c10 con 0x55a1ff8e2840 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4cdb400640 1 -- 172.21.15.40:0/3193148974 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4ce803a040 con 0x55a1ff8e2840 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4d079f9740 10 client.17325 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4d079f9740 10 client.17325 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4d079f9740 20 client.17325 populate_metadata read hostname 'smithi040' 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff8c1ea0 0x55a1ffcc59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4d079f9740 4 client.17325 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.014+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1ffc20ea0 con 0x55a1ff8c1ea0 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.015+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff8c1ea0 0x55a1ffcc59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.016+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff8c1ea0 0x55a1ffcc59f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aede0c802c97dd8f server_cookie=8cb027ffcf65ebdb in_seq=0 out_seq=0 2024-07-26T13:09:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.016+0000 7f4cdb400640 10 client.17325 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4cdb400640 1 -- 172.21.15.40:0/3193148974 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1ffc20ea0 con 0x55a1ff8c1ea0 2024-07-26T13:09:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4cdb400640 10 client.17325 handle_command_reply: tid=0 2024-07-26T13:09:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 client.17325 shutdown 2024-07-26T13:09:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 msgr2=0x55a1ffcb3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcb3de0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce80314b0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 shutdown_connections 2024-07-26T13:09:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcbfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff8c1ea0 0x55a1ffcc59f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcb3de0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3193148974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 >> 172.21.15.40:0/3193148974 conn(0x55a1ff8f7910 msgr2=0x55a1ffcab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4cdb400640 0 client.17325 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.018+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 shutdown_connections 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.019+0000 7f4d079f9740 1 -- 172.21.15.40:0/3193148974 wait complete. 2024-07-26T13:09:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.019+0000 7f4d079f9740 20 client.17325 trim_cache size 0 max 16384 2024-07-26T13:09:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.038+0000 7f4d079f9740 1 Processor -- start 2024-07-26T13:09:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.038+0000 7f4d079f9740 1 -- start start 2024-07-26T13:09:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.039+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.039+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcbfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.039+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcb0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.039+0000 7f4d079f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1b51f0 con 0x55a1ff8e2840 2024-07-26T13:09:55.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.039+0000 7f4d079f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1b6d30 con 0x55a1ff8da660 2024-07-26T13:09:55.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.039+0000 7f4d079f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1b58c0 con 0x55a1ff903520 2024-07-26T13:09:55.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcbfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcbfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60636/0 (socket says 172.21.15.40:60636) 2024-07-26T13:09:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 -- 172.21.15.40:0/3875776631 learned_addr learned my addr 172.21.15.40:0/3875776631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cfa800640 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcb0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 -- 172.21.15.40:0/3875776631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 msgr2=0x55a1ffcb0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcb0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 -- 172.21.15.40:0/3875776631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 msgr2=0x55a1ffcb54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9400640 1 -- 172.21.15.40:0/3875776631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ffca6980 con 0x55a1ff8e2840 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.040+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.041+0000 7f4cf9400640 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcbfb80 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f4ce802a910 tx=0x7f4ce8003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392d31ca278bc1fc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.041+0000 7f4ce6600640 1 -- 172.21.15.40:0/3875776631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8035070 con 0x55a1ff8e2840 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.041+0000 7f4ce6600640 1 -- 172.21.15.40:0/3875776631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ce80044d0 con 0x55a1ff8e2840 2024-07-26T13:09:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.041+0000 7f4ce6600640 1 -- 172.21.15.40:0/3875776631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8004a40 con 0x55a1ff8e2840 2024-07-26T13:09:55.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 -- 172.21.15.40:0/3875776631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 msgr2=0x55a1ffcbfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcbfb80 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f4ce802a910 tx=0x7f4ce8003800 comp rx=0 tx=0).stop 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 -- 172.21.15.40:0/3875776631 shutdown_connections 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffcb0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcbfb80 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 --2- 172.21.15.40:0/3875776631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcb54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 -- 172.21.15.40:0/3875776631 >> 172.21.15.40:0/3875776631 conn(0x55a1ff8f7910 msgr2=0x55a1ffcb4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 -- 172.21.15.40:0/3875776631 shutdown_connections 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.042+0000 7f4d079f9740 1 -- 172.21.15.40:0/3875776631 wait complete. 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.043+0000 7f4d079f9740 1 -- start start 2024-07-26T13:09:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.043+0000 7f4d079f9740 1 Processor -- start 2024-07-26T13:09:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcc70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcc7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffd2cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1b6660 con 0x55a1ff8e2840 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1b5f90 con 0x55a1ff8da660 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc1b31b0 con 0x55a1ff903520 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4d079f9740 10 client.0 _ll_register_callbacks cb 0x7f4cec008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcc7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4cf9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcc7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60644/0 (socket says 172.21.15.40:60644) 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4cf9400640 1 -- 172.21.15.40:0/1707558135 learned_addr learned my addr 172.21.15.40:0/1707558135 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.044+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcc70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cfa800640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffd2cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cf9400640 1 -- 172.21.15.40:0/1707558135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 msgr2=0x55a1ffd2cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cf9400640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffd2cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cf9400640 1 -- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 msgr2=0x55a1ffcc70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:09:55.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cf9400640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcc70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cf9400640 1 -- 172.21.15.40:0/1707558135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ffd2d530 con 0x55a1ff8e2840 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cf9400640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcc7650 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f4ce803f040 tx=0x7f4ce8004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210024b81cd56a56 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.045+0000 7f4cdb400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4cdb400640 1 -- 172.21.15.40:0/1707558135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8035070 con 0x55a1ff8e2840 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4cdb400640 1 -- 172.21.15.40:0/1707558135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4ce8005130 con 0x55a1ff8e2840 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce80044d0 con 0x55a1ff8e2840 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4cdb400640 1 -- 172.21.15.40:0/1707558135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4ce80316a0 con 0x55a1ff8e2840 2024-07-26T13:09:55.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4d079f9740 10 client.17331 fetch_fsmap learned FSMap version 35 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a1ffd2e7f0 con 0x55a1ff8e2840 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.046+0000 7f4cdb400640 1 -- 172.21.15.40:0/1707558135 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ce80044d0 con 0x55a1ff8e2840 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4cdb400640 1 -- 172.21.15.40:0/1707558135 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4ce8067070 con 0x55a1ff8e2840 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4d079f9740 10 client.17331 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4d079f9740 10 client.17331 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4d079f9740 20 client.17331 populate_metadata read hostname 'smithi040' 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4d079f9740 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff897250 0x55a1ffd30e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4d079f9740 4 client.17331 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fd31d373", "release": true, "await": true}] 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.047+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fd31d373", "release": true, "await": true}) -- 0x55a1ffc1c940 con 0x55a1ff897250 2024-07-26T13:09:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.048+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff897250 0x55a1ffd30e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:09:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.049+0000 7f4cf9e00640 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff897250 0x55a1ffd30e60 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8b264832d14100 server_cookie=7102c4cc15830322 in_seq=0 out_seq=0 2024-07-26T13:09:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.049+0000 7f4cdb400640 10 client.17331 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.130+0000 7f4cdb400640 1 -- 172.21.15.40:0/1707558135 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55a1ffc1c940 con 0x55a1ff897250 2024-07-26T13:09:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.130+0000 7f4cdb400640 10 client.17331 handle_command_reply: tid=0 2024-07-26T13:09:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.130+0000 7f4d079f9740 1 client.17331 shutdown 2024-07-26T13:09:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 msgr2=0x55a1ffcc7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcc7650 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f4ce803f040 tx=0x7f4ce8004950 comp rx=0 tx=0).stop 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 shutdown_connections 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a1ff903520 0x55a1ffd2cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55a1ff897250 0x55a1ffd30e60 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a1ff8e2840 0x55a1ffcc7650 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 --2- 172.21.15.40:0/1707558135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a1ff8da660 0x55a1ffcc70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 >> 172.21.15.40:0/1707558135 conn(0x55a1ff8f7910 msgr2=0x55a1ffcb2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.131+0000 7f4cdb400640 0 client.17331 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.132+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 shutdown_connections 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.132+0000 7f4d079f9740 1 -- 172.21.15.40:0/1707558135 wait complete. 2024-07-26T13:09:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.132+0000 7f4d079f9740 20 client.17331 trim_cache size 0 max 16384 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 156, 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "fd31d373": { 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 156, 2024-07-26T13:09:55.135 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.6, 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:09:55.136 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:55.137 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:55.137 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:55.137 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:55.137 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:09:55.137 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:09:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.133+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4ce00b3c00 msgr2=0x7f4ce00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.133+0000 7f4cfb200640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4ce00b3c00 0x7f4ce00b6110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55a1ffca6e20 tx=0x7f4cec0084c0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.133+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 msgr2=0x7f4cfc1a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.133+0000 7f4cfb200640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1a5b40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400eaa0 tx=0x7f4cf400ef60 comp rx=0 tx=0).stop 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 shutdown_connections 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cfc10fc80 0x7f4cfc1a5b40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4cfc10f330 0x7f4cfc1a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4ce00b3c00 0x7f4ce00b6110 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 --2- 172.21.15.40:0/3706301766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc1099f0 0x7f4cfc1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 >> 172.21.15.40:0/3706301766 conn(0x7f4cfc078ff0 msgr2=0x7f4cfc0799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 shutdown_connections 2024-07-26T13:09:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:09:55.134+0000 7f4cfb200640 1 -- 172.21.15.40:0/3706301766 wait complete. 2024-07-26T13:09:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:55 smithi146 ceph-mon[35807]: pgmap v1929: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:09:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:55 smithi076 ceph-mon[35401]: pgmap v1929: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:09:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:55 smithi040 ceph-mon[32397]: pgmap v1929: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:09:56.047 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fd31d373', total seconds elapsed: 19.4 2024-07-26T13:09:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:57 smithi146 ceph-mon[35807]: pgmap v1930: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:09:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:57 smithi076 ceph-mon[35401]: pgmap v1930: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:09:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:57 smithi040 ceph-mon[32397]: pgmap v1930: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:09:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:09:59 smithi146 ceph-mon[35807]: pgmap v1931: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:09:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:09:59 smithi076 ceph-mon[35401]: pgmap v1931: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:09:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:09:59 smithi040 ceph-mon[32397]: pgmap v1931: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2024-07-26T13:10:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T13:10:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T13:10:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T13:10:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:01 smithi146 ceph-mon[35807]: pgmap v1932: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-07-26T13:10:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:01 smithi076 ceph-mon[35401]: pgmap v1932: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-07-26T13:10:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:01 smithi040 ceph-mon[32397]: pgmap v1932: 97 pgs: 97 active+clean; 8.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-07-26T13:10:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:03 smithi076 ceph-mon[35401]: pgmap v1933: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:10:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:03 smithi040 ceph-mon[32397]: pgmap v1933: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:10:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:03 smithi146 ceph-mon[35807]: pgmap v1933: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:10:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:05 smithi076 ceph-mon[35401]: pgmap v1934: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T13:10:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:05 smithi040 ceph-mon[32397]: pgmap v1934: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T13:10:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:05 smithi146 ceph-mon[35807]: pgmap v1934: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-07-26T13:10:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:07 smithi040 ceph-mon[32397]: pgmap v1935: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-07-26T13:10:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:07 smithi146 ceph-mon[35807]: pgmap v1935: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-07-26T13:10:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:07 smithi076 ceph-mon[35401]: pgmap v1935: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.6 MiB/s wr, 11 op/s 2024-07-26T13:10:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:09 smithi040 ceph-mon[32397]: pgmap v1936: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:10:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:09 smithi146 ceph-mon[35807]: pgmap v1936: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:10:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:09 smithi076 ceph-mon[35401]: pgmap v1936: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:10:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:11 smithi040 ceph-mon[32397]: pgmap v1937: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:10:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:11 smithi146 ceph-mon[35807]: pgmap v1937: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:10:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:11 smithi076 ceph-mon[35401]: pgmap v1937: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:10:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:13 smithi040 ceph-mon[32397]: pgmap v1938: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:10:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:13 smithi146 ceph-mon[35807]: pgmap v1938: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:10:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:13 smithi076 ceph-mon[35401]: pgmap v1938: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:10:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:15 smithi040 ceph-mon[32397]: pgmap v1939: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:10:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:15 smithi146 ceph-mon[35807]: pgmap v1939: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:10:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:15 smithi076 ceph-mon[35401]: pgmap v1939: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:10:15.734 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-26T13:10:15.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:10:16.316 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:10:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:17 smithi040 ceph-mon[32397]: pgmap v1940: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:10:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:17 smithi146 ceph-mon[35807]: pgmap v1940: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:10:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:17 smithi076 ceph-mon[35401]: pgmap v1940: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:10:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 -- 172.21.15.40:0/443192987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 msgr2=0x7fd0901037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 --2- 172.21.15.40:0/443192987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd0901037f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd084009900 tx=0x7fd08402a410 comp rx=0 tx=0).stop 2024-07-26T13:10:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 -- 172.21.15.40:0/443192987 shutdown_connections 2024-07-26T13:10:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 --2- 172.21.15.40:0/443192987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 0x7fd09010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 --2- 172.21.15.40:0/443192987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd090108d20 0x7fd090109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 --2- 172.21.15.40:0/443192987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd0901037f0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 -- 172.21.15.40:0/443192987 >> 172.21.15.40:0/443192987 conn(0x7fd0900fee30 msgr2=0x7fd090101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 -- 172.21.15.40:0/443192987 shutdown_connections 2024-07-26T13:10:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.687+0000 7fd097000640 1 -- 172.21.15.40:0/443192987 wait complete. 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.689+0000 7fd097000640 1 Processor -- start 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.689+0000 7fd097000640 1 -- start start 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd097000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd090075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd097000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd090108d20 0x7fd090075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd097000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 0x7fd090075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd097000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901131f0 con 0x7fd0901033e0 2024-07-26T13:10:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd097000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd090113070 con 0x7fd090109670 2024-07-26T13:10:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd097000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd090113370 con 0x7fd090108d20 2024-07-26T13:10:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd095c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd090075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd095c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd090075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59638/0 (socket says 172.21.15.40:59638) 2024-07-26T13:10:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd095c00640 1 -- 172.21.15.40:0/2535450095 learned_addr learned my addr 172.21.15.40:0/2535450095 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.690+0000 7fd096600640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 0x7fd090075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd095200640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd090108d20 0x7fd090075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd095c00640 1 -- 172.21.15.40:0/2535450095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd090108d20 msgr2=0x7fd090075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd095c00640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd090108d20 0x7fd090075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd095c00640 1 -- 172.21.15.40:0/2535450095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 msgr2=0x7fd090075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd095c00640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 0x7fd090075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd095c00640 1 -- 172.21.15.40:0/2535450095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0901a7f00 con 0x7fd0901033e0 2024-07-26T13:10:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.691+0000 7fd096600640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 0x7fd090075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:10:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.692+0000 7fd095c00640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd090075140 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd084009230 tx=0x7fd0840319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.692+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08403f030 con 0x7fd0901033e0 2024-07-26T13:10:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.692+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0840043d0 con 0x7fd0901033e0 2024-07-26T13:10:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.693+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0901a8190 con 0x7fd0901033e0 2024-07-26T13:10:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.693+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084035070 con 0x7fd0901033e0 2024-07-26T13:10:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.693+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0901a86c0 con 0x7fd0901033e0 2024-07-26T13:10:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.694+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0901037f0 con 0x7fd0901033e0 2024-07-26T13:10:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.698+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd084042030 con 0x7fd0901033e0 2024-07-26T13:10:18.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.700+0000 7fd08e000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd0780b3c50 0x7fd0780b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.700+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd0841043e0 con 0x7fd0901033e0 2024-07-26T13:10:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.700+0000 7fd095200640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd0780b3c50 0x7fd0780b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.701+0000 7fd095200640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd0780b3c50 0x7fd0780b6160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd090108900 tx=0x7fd07c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:18.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:18.705+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd0840cb9f0 con 0x7fd0901033e0 2024-07-26T13:10:19.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.012+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd090076440 con 0x7fd0901033e0 2024-07-26T13:10:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.013+0000 7fd08e000640 1 -- 172.21.15.40:0/2535450095 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fd0840cb2f0 con 0x7fd0901033e0 2024-07-26T13:10:19.015 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:10:19.016 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:10:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:10:19.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.016+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd0780b3c50 msgr2=0x7fd0780b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:19.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.016+0000 7fd097000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd0780b3c50 0x7fd0780b6160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd090108900 tx=0x7fd07c005f90 comp rx=0 tx=0).stop 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.016+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 msgr2=0x7fd090075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.016+0000 7fd097000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd090075140 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd084009230 tx=0x7fd0840319a0 comp rx=0 tx=0).stop 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 shutdown_connections 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd090109670 0x7fd090075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd0780b3c50 0x7fd0780b6160 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd090108d20 0x7fd090075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 --2- 172.21.15.40:0/2535450095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0901033e0 0x7fd090075140 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 >> 172.21.15.40:0/2535450095 conn(0x7fd0900fee30 msgr2=0x7fd090101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 shutdown_connections 2024-07-26T13:10:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:19.017+0000 7fd097000640 1 -- 172.21.15.40:0/2535450095 wait complete. 2024-07-26T13:10:19.417 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:19 smithi040 ceph-mon[32397]: pgmap v1941: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:10:19.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:19 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2535450095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:19 smithi146 ceph-mon[35807]: pgmap v1941: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:10:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:19 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2535450095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:19 smithi076 ceph-mon[35401]: pgmap v1941: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:10:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:19 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2535450095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:19.993 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-26T13:10:19.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-26T13:10:20.471 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:10:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:21 smithi040 ceph-mon[32397]: pgmap v1942: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:10:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:21 smithi146 ceph-mon[35807]: pgmap v1942: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:10:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:21 smithi076 ceph-mon[35401]: pgmap v1942: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:10:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 -- 172.21.15.40:0/2829490337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a810d970 msgr2=0x7f35a810fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 --2- 172.21.15.40:0/2829490337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a810d970 0x7f35a810fe60 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009900 tx=0x7f35a002a410 comp rx=0 tx=0).stop 2024-07-26T13:10:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 -- 172.21.15.40:0/2829490337 shutdown_connections 2024-07-26T13:10:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 --2- 172.21.15.40:0/2829490337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a810d970 0x7f35a810fe60 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 --2- 172.21.15.40:0/2829490337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35a8104dd0 0x7f35a810d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 --2- 172.21.15.40:0/2829490337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8104480 0x7f35a8104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 -- 172.21.15.40:0/2829490337 >> 172.21.15.40:0/2829490337 conn(0x7f35a8079150 msgr2=0x7f35a8079560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 -- 172.21.15.40:0/2829490337 shutdown_connections 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.022+0000 7f35ae200640 1 -- 172.21.15.40:0/2829490337 wait complete. 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.024+0000 7f35ae200640 1 Processor -- start 2024-07-26T13:10:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.024+0000 7f35ae200640 1 -- start start 2024-07-26T13:10:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35ae200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 0x7f35a819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35ae200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35a8104dd0 0x7f35a819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35ae200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a810d970 0x7f35a81a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35ae200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f35a81134f0 con 0x7f35a8104480 2024-07-26T13:10:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35ae200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f35a8113370 con 0x7f35a8104dd0 2024-07-26T13:10:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35ae200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35a8113670 con 0x7f35a810d970 2024-07-26T13:10:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 0x7f35a819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 0x7f35a819c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55596/0 (socket says 172.21.15.40:55596) 2024-07-26T13:10:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35a7400640 1 -- 172.21.15.40:0/2487094520 learned_addr learned my addr 172.21.15.40:0/2487094520 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f359ea00640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35a8104dd0 0x7f35a819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.025+0000 7f35a7e00640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a810d970 0x7f35a81a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.026+0000 7f35a7400640 1 -- 172.21.15.40:0/2487094520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a810d970 msgr2=0x7f35a81a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.026+0000 7f35a7400640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a810d970 0x7f35a81a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.026+0000 7f35a7400640 1 -- 172.21.15.40:0/2487094520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35a8104dd0 msgr2=0x7f35a819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.026+0000 7f35a7400640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35a8104dd0 0x7f35a819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.026+0000 7f35a7400640 1 -- 172.21.15.40:0/2487094520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a81a2070 con 0x7f35a8104480 2024-07-26T13:10:23.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.026+0000 7f35a7400640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 0x7f35a819c100 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f359800eb90 tx=0x7f359800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:23.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.027+0000 7f35a4c00640 1 -- 172.21.15.40:0/2487094520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598004d20 con 0x7f35a8104480 2024-07-26T13:10:23.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.027+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a81a2360 con 0x7f35a8104480 2024-07-26T13:10:23.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.027+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a81a8ac0 con 0x7f35a8104480 2024-07-26T13:10:23.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.027+0000 7f35a4c00640 1 -- 172.21.15.40:0/2487094520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f359800ee90 con 0x7f35a8104480 2024-07-26T13:10:23.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.027+0000 7f35a4c00640 1 -- 172.21.15.40:0/2487094520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598010690 con 0x7f35a8104480 2024-07-26T13:10:23.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.031+0000 7f35b4e7e740 1 Processor -- start 2024-07-26T13:10:23.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 -- start start 2024-07-26T13:10:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 0x564562ddb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a0c980 0x564562ddb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562ddbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564562da5cf0 con 0x564562a35840 2024-07-26T13:10:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564562d50b40 con 0x564562a0c980 2024-07-26T13:10:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.032+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564562d40040 con 0x564562a14b60 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 0x564562ddb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 0x564562ddb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55604/0 (socket says 172.21.15.40:55604) 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 -- 172.21.15.40:0/596341450 learned_addr learned my addr 172.21.15.40:0/596341450 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a4c00640 1 -- 172.21.15.40:0/2487094520 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3598004fc0 con 0x7f35a8104480 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f359ea00640 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562ddbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 -- 172.21.15.40:0/596341450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 msgr2=0x564562ddbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562ddbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 -- 172.21.15.40:0/596341450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a0c980 msgr2=0x564562ddb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a0c980 0x564562ddb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.033+0000 7f35a7e00640 1 -- 172.21.15.40:0/596341450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564562cc7af0 con 0x564562a35840 2024-07-26T13:10:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.034+0000 7f35a7e00640 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 0x564562ddb1a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009900 tx=0x7f35a00040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba234b01dd9faee server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.034+0000 7f3597e00640 1 -- 172.21.15.40:0/596341450 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035030 con 0x564562a35840 2024-07-26T13:10:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.035+0000 7f3597e00640 1 -- 172.21.15.40:0/596341450 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35a00044c0 con 0x564562a35840 2024-07-26T13:10:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.035+0000 7f3597e00640 1 -- 172.21.15.40:0/596341450 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00035f0 con 0x564562a35840 2024-07-26T13:10:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.035+0000 7f35a4c00640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f358c0b3c50 0x7f358c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35a4c00640 1 -- 172.21.15.40:0/2487094520 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f35980e40f0 con 0x7f35a8104480 2024-07-26T13:10:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35a7400640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f358c0b3c50 0x7f358c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 -- 172.21.15.40:0/596341450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 msgr2=0x564562ddb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 0x564562ddb1a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009900 tx=0x7f35a00040d0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 -- 172.21.15.40:0/596341450 shutdown_connections 2024-07-26T13:10:23.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562ddbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a0c980 0x564562ddb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/596341450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a35840 0x564562ddb1a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 -- 172.21.15.40:0/596341450 >> 172.21.15.40:0/596341450 conn(0x564562a29990 msgr2=0x564562dd9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 -- 172.21.15.40:0/596341450 shutdown_connections 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.036+0000 7f35b4e7e740 1 -- 172.21.15.40:0/596341450 wait complete. 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.037+0000 7f35a7400640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f358c0b3c50 0x7f358c0b6160 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f35980e4390 tx=0x7f359800af00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.037+0000 7f35b4e7e740 1 -- start start 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.037+0000 7f35b4e7e740 1 Processor -- start 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562de6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564562cdc500 con 0x564562a0c980 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564562d44080 con 0x564562a35840 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564562ba37a0 con 0x564562a14b60 2024-07-26T13:10:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35b4e7e740 10 client.0 _ll_register_callbacks cb 0x564562d38bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:10:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562de6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562de6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55614/0 (socket says 172.21.15.40:55614) 2024-07-26T13:10:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.038+0000 7f35a7e00640 1 -- 172.21.15.40:0/1953029167 learned_addr learned my addr 172.21.15.40:0/1953029167 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f359ea00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f35a7e00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f35a7e00640 1 -- 172.21.15.40:0/1953029167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 msgr2=0x564562de7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f35a7e00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f35a7e00640 1 -- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 msgr2=0x564562df2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f35a7e00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.039+0000 7f35a7e00640 1 -- 172.21.15.40:0/1953029167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564562aafb90 con 0x564562a0c980 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.040+0000 7f35a7e00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562de6d00 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f35a0004b40 tx=0x7f35a0009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c95383f9ef0c42 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.040+0000 7f3594c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:10:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.040+0000 7f3594c00640 1 -- 172.21.15.40:0/1953029167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035030 con 0x564562a0c980 2024-07-26T13:10:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.040+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564562d52a90 con 0x564562a0c980 2024-07-26T13:10:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.040+0000 7f3594c00640 1 -- 172.21.15.40:0/1953029167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f35a0004ca0 con 0x564562a0c980 2024-07-26T13:10:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f3594c00640 1 -- 172.21.15.40:0/1953029167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f35a0004ea0 con 0x564562a0c980 2024-07-26T13:10:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 10 client.17349 fetch_fsmap learned FSMap version 35 2024-07-26T13:10:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564562df57c0 con 0x564562a0c980 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f3594c00640 1 -- 172.21.15.40:0/1953029167 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564562d52a90 con 0x564562a0c980 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f3594c00640 1 -- 172.21.15.40:0/1953029167 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f35a003b740 con 0x564562a0c980 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 10 client.17349 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 10 client.17349 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 20 client.17349 populate_metadata read hostname 'smithi040' 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629f41c0 0x564562df8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 4 client.17349 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.041+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564562d4e530 con 0x5645629f41c0 2024-07-26T13:10:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.042+0000 7f359ea00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629f41c0 0x564562df8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.043+0000 7f359ea00640 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629f41c0 0x564562df8b20 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa99f32f97f4566a server_cookie=5fd36bfc6360d561 in_seq=0 out_seq=0 2024-07-26T13:10:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.043+0000 7f3594c00640 10 client.17349 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.045+0000 7f3594c00640 1 -- 172.21.15.40:0/1953029167 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564562d4e530 con 0x5645629f41c0 2024-07-26T13:10:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.045+0000 7f3594c00640 10 client.17349 handle_command_reply: tid=0 2024-07-26T13:10:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.045+0000 7f35b4e7e740 1 client.17349 shutdown 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 msgr2=0x564562de6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562de6d00 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f35a0004b40 tx=0x7f35a0009230 comp rx=0 tx=0).stop 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 shutdown_connections 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629f41c0 0x564562df8b20 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/1953029167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562de6d00 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 >> 172.21.15.40:0/1953029167 conn(0x564562a29990 msgr2=0x564562dde330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f3594c00640 0 client.17349 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 shutdown_connections 2024-07-26T13:10:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.046+0000 7f35b4e7e740 1 -- 172.21.15.40:0/1953029167 wait complete. 2024-07-26T13:10:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.047+0000 7f35b4e7e740 20 client.17349 trim_cache size 0 max 16384 2024-07-26T13:10:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 Processor -- start 2024-07-26T13:10:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 -- start start 2024-07-26T13:10:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562ddcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f358400e4a0 con 0x564562a0c980 2024-07-26T13:10:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f358400ffe0 con 0x564562a35840 2024-07-26T13:10:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.071+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f358400eb70 con 0x564562a14b60 2024-07-26T13:10:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562ddcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562ddcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55628/0 (socket says 172.21.15.40:55628) 2024-07-26T13:10:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 -- 172.21.15.40:0/3169947251 learned_addr learned my addr 172.21.15.40:0/3169947251 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f359ea00640 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 -- 172.21.15.40:0/3169947251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 msgr2=0x564562de8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 -- 172.21.15.40:0/3169947251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 msgr2=0x564562df2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.072+0000 7f35a7e00640 1 -- 172.21.15.40:0/3169947251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564562de94b0 con 0x564562a0c980 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.073+0000 7f35a7e00640 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562ddcb90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f35a002a930 tx=0x7f35a0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b86e3f53be28fd server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.073+0000 7f3597400640 1 -- 172.21.15.40:0/3169947251 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035040 con 0x564562a0c980 2024-07-26T13:10:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.073+0000 7f3597400640 1 -- 172.21.15.40:0/3169947251 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35a004d040 con 0x564562a0c980 2024-07-26T13:10:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.073+0000 7f3597400640 1 -- 172.21.15.40:0/3169947251 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0005040 con 0x564562a0c980 2024-07-26T13:10:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.074+0000 7f35b4e7e740 1 -- 172.21.15.40:0/3169947251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 msgr2=0x564562ddcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.074+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562ddcb90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f35a002a930 tx=0x7f35a0009680 comp rx=0 tx=0).stop 2024-07-26T13:10:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 -- 172.21.15.40:0/3169947251 shutdown_connections 2024-07-26T13:10:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a35840 0x564562df2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a14b60 0x564562de8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/3169947251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562ddcb90 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 -- 172.21.15.40:0/3169947251 >> 172.21.15.40:0/3169947251 conn(0x564562a29990 msgr2=0x564562de8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 -- 172.21.15.40:0/3169947251 shutdown_connections 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 -- 172.21.15.40:0/3169947251 wait complete. 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.075+0000 7f35b4e7e740 1 -- start start 2024-07-26T13:10:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 Processor -- start 2024-07-26T13:10:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562dfc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a14b60 0x564562df9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a35840 0x564562df9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f358400f910 con 0x564562a0c980 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f358400f240 con 0x564562a14b60 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f358400c460 con 0x564562a35840 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.076+0000 7f35b4e7e740 10 client.0 _ll_register_callbacks cb 0x7f35980093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.077+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562dfc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.077+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562dfc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55632/0 (socket says 172.21.15.40:55632) 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.077+0000 7f35a7e00640 1 -- 172.21.15.40:0/2433731146 learned_addr learned my addr 172.21.15.40:0/2433731146 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.077+0000 7f359ea00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a14b60 0x564562df9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.077+0000 7f35a7e00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a35840 0x564562df9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35a7e00640 1 -- 172.21.15.40:0/2433731146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a35840 msgr2=0x564562df9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35a7e00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a35840 0x564562df9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35a7e00640 1 -- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a14b60 msgr2=0x564562df9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35a7e00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a14b60 0x564562df9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35a7e00640 1 -- 172.21.15.40:0/2433731146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564562dfa0d0 con 0x564562a0c980 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35a7e00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562dfc0b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f35a003bac0 tx=0x7f35a003ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf84d3ecf4de02b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f3594c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:10:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f3594c00640 1 -- 172.21.15.40:0/2433731146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0061070 con 0x564562a0c980 2024-07-26T13:10:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f3594c00640 1 -- 172.21.15.40:0/2433731146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f35a0005040 con 0x564562a0c980 2024-07-26T13:10:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.078+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35a004d040 con 0x564562a0c980 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.079+0000 7f3594c00640 1 -- 172.21.15.40:0/2433731146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f35a0035070 con 0x564562a0c980 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.079+0000 7f35b4e7e740 10 client.17355 fetch_fsmap learned FSMap version 35 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.079+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564562dfa0d0 con 0x564562a0c980 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.079+0000 7f3594c00640 1 -- 172.21.15.40:0/2433731146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35a004d040 con 0x564562a0c980 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f3594c00640 1 -- 172.21.15.40:0/2433731146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f35a00439c0 con 0x564562a0c980 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f35b4e7e740 10 client.17355 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f35b4e7e740 10 client.17355 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f35b4e7e740 20 client.17355 populate_metadata read hostname 'smithi040' 2024-07-26T13:10:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629c9570 0x564562e6ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f35b4e7e740 4 client.17355 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-26T13:10:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x564562d4bc70 con 0x5645629c9570 2024-07-26T13:10:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.080+0000 7f359ea00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629c9570 0x564562e6ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.081+0000 7f359ea00640 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629c9570 0x564562e6ba40 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1befab3eb7e91b85 server_cookie=721b1b615ada8bf9 in_seq=0 out_seq=0 2024-07-26T13:10:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.082+0000 7f3594c00640 10 client.17355 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:23.308 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:23 smithi040 ceph-mon[32397]: pgmap v1943: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:10:23.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.307+0000 7f3594c00640 1 -- 172.21.15.40:0/2433731146 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x564562d4bc70 con 0x5645629c9570 2024-07-26T13:10:23.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.307+0000 7f3594c00640 10 client.17355 handle_command_reply: tid=0 2024-07-26T13:10:23.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.307+0000 7f35b4e7e740 1 client.17355 shutdown 2024-07-26T13:10:23.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.307+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 msgr2=0x564562dfc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.307+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562dfc0b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f35a003bac0 tx=0x7f35a003ba50 comp rx=0 tx=0).stop 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 shutdown_connections 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564562a35840 0x564562df9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564562a14b60 0x564562df9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5645629c9570 0x564562e6ba40 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 --2- 172.21.15.40:0/2433731146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564562a0c980 0x564562dfc0b0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 >> 172.21.15.40:0/2433731146 conn(0x564562a29990 msgr2=0x564562de8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f3594c00640 0 client.17355 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.308+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 shutdown_connections 2024-07-26T13:10:23.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.309+0000 7f35b4e7e740 1 -- 172.21.15.40:0/2433731146 wait complete. 2024-07-26T13:10:23.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.309+0000 7f35b4e7e740 20 client.17355 trim_cache size 0 max 16384 2024-07-26T13:10:23.311 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:10:23.311 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:10:23.311 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 158, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "b6b64c4c": { 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 158, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:10:23.312 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:23.313 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.310+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f358c0b3c50 msgr2=0x7f358c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.310+0000 7f35ae200640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f358c0b3c50 0x7f358c0b6160 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f35980e4390 tx=0x7f359800af00 comp rx=0 tx=0).stop 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.310+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 msgr2=0x7f35a819c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.310+0000 7f35ae200640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 0x7f35a819c100 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f359800eb90 tx=0x7f359800c6a0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 shutdown_connections 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f358c0b3c50 0x7f358c0b6160 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a810d970 0x7f35a81a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35a8104dd0 0x7f35a819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 --2- 172.21.15.40:0/2487094520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a8104480 0x7f35a819c100 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 >> 172.21.15.40:0/2487094520 conn(0x7f35a8079150 msgr2=0x7f35a810c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 shutdown_connections 2024-07-26T13:10:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:23.311+0000 7f35ae200640 1 -- 172.21.15.40:0/2487094520 wait complete. 2024-07-26T13:10:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:23 smithi146 ceph-mon[35807]: pgmap v1943: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:10:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:23 smithi076 ceph-mon[35401]: pgmap v1943: 97 pgs: 97 active+clean; 8.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:10:24.215 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b6b64c4c', quiesce took 8.5 seconds. Will release after: 1.5 2024-07-26T13:10:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:25 smithi040 ceph-mon[32397]: pgmap v1944: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:10:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:25 smithi146 ceph-mon[35807]: pgmap v1944: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:10:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:25 smithi076 ceph-mon[35401]: pgmap v1944: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:10:25.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:10:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:10:27.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:27 smithi040 ceph-mon[32397]: pgmap v1945: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:10:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:27 smithi146 ceph-mon[35807]: pgmap v1945: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:10:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:27 smithi076 ceph-mon[35401]: pgmap v1945: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 -- 172.21.15.40:0/1464999428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 msgr2=0x7f1cd81037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 --2- 172.21.15.40:0/1464999428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd81037d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009900 tx=0x7f1cc002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 -- 172.21.15.40:0/1464999428 shutdown_connections 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 --2- 172.21.15.40:0/1464999428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd8109650 0x7f1cd810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 --2- 172.21.15.40:0/1464999428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd8108d00 0x7f1cd8109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 --2- 172.21.15.40:0/1464999428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd81037d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 -- 172.21.15.40:0/1464999428 >> 172.21.15.40:0/1464999428 conn(0x7f1cd80fee10 msgr2=0x7f1cd8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 -- 172.21.15.40:0/1464999428 shutdown_connections 2024-07-26T13:10:28.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.451+0000 7f1cde600640 1 -- 172.21.15.40:0/1464999428 wait complete. 2024-07-26T13:10:28.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.452+0000 7f1cde600640 1 Processor -- start 2024-07-26T13:10:28.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.453+0000 7f1cde600640 1 -- start start 2024-07-26T13:10:28.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.453+0000 7f1cde600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd8199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:28.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.453+0000 7f1cde600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd8108d00 0x7f1cd819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:28.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cde600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd8109650 0x7f1cd819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:28.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cde600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd8113220 con 0x7f1cd81033c0 2024-07-26T13:10:28.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cde600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd81130a0 con 0x7f1cd8109650 2024-07-26T13:10:28.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cde600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd81133a0 con 0x7f1cd8108d00 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd8199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd8199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55642/0 (socket says 172.21.15.40:55642) 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 -- 172.21.15.40:0/2788010886 learned_addr learned my addr 172.21.15.40:0/2788010886 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1ccfe00640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd8108d00 0x7f1cd819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cddc00640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd8109650 0x7f1cd819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 -- 172.21.15.40:0/2788010886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd8108d00 msgr2=0x7f1cd819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd8108d00 0x7f1cd819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 -- 172.21.15.40:0/2788010886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd8109650 msgr2=0x7f1cd819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd8109650 0x7f1cd819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.454+0000 7f1cdd200640 1 -- 172.21.15.40:0/2788010886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd819fb20 con 0x7f1cd81033c0 2024-07-26T13:10:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.455+0000 7f1cdd200640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd8199c70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f1cc002a910 tx=0x7f1cc0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.455+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc003f070 con 0x7f1cd81033c0 2024-07-26T13:10:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.455+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cc0003e40 con 0x7f1cd81033c0 2024-07-26T13:10:28.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.455+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0035030 con 0x7f1cd81033c0 2024-07-26T13:10:28.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.455+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd819fdb0 con 0x7f1cd81033c0 2024-07-26T13:10:28.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.456+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd81a0240 con 0x7f1cd81033c0 2024-07-26T13:10:28.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.457+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd81037d0 con 0x7f1cd81033c0 2024-07-26T13:10:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.459+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1cc0042070 con 0x7f1cd81033c0 2024-07-26T13:10:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.463+0000 7f1cd6000640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3c80 0x7f1cb80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.464+0000 7f1ccfe00640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3c80 0x7f1cb80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.464+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1cc0104880 con 0x7f1cd81033c0 2024-07-26T13:10:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.465+0000 7f1ccfe00640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3c80 0x7f1cb80b6190 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8005fd0 tx=0x7f1cc8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.467+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1cc00cbe90 con 0x7f1cd81033c0 2024-07-26T13:10:28.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.711+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cd819ada0 con 0x7f1cd81033c0 2024-07-26T13:10:28.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.712+0000 7f1cd6000640 1 -- 172.21.15.40:0/2788010886 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f1cc00cb790 con 0x7f1cd81033c0 2024-07-26T13:10:28.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:10:28.715 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:10:28.715 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:10:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.715+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3c80 msgr2=0x7f1cb80b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.715+0000 7f1cde600640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3c80 0x7f1cb80b6190 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8005fd0 tx=0x7f1cc8005850 comp rx=0 tx=0).stop 2024-07-26T13:10:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.715+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 msgr2=0x7f1cd8199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.715+0000 7f1cde600640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd8199c70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f1cc002a910 tx=0x7f1cc0003c20 comp rx=0 tx=0).stop 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 shutdown_connections 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd8109650 0x7f1cd819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3c80 0x7f1cb80b6190 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd8108d00 0x7f1cd819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 --2- 172.21.15.40:0/2788010886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd81033c0 0x7f1cd8199c70 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 >> 172.21.15.40:0/2788010886 conn(0x7f1cd80fee10 msgr2=0x7f1cd8101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 shutdown_connections 2024-07-26T13:10:28.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:28.716+0000 7f1cde600640 1 -- 172.21.15.40:0/2788010886 wait complete. 2024-07-26T13:10:29.323 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:29 smithi040 ceph-mon[32397]: pgmap v1946: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:10:29.323 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:29 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2788010886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:29 smithi146 ceph-mon[35807]: pgmap v1946: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:10:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:29 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2788010886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:29 smithi076 ceph-mon[35401]: pgmap v1946: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:10:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:29 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2788010886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:29.619 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id b6b64c4c --release --await' 2024-07-26T13:10:29.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id b6b64c4c --release --await 2024-07-26T13:10:30.120 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:10:31.329 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:31 smithi040 ceph-mon[32397]: pgmap v1947: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:10:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:31 smithi146 ceph-mon[35807]: pgmap v1947: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:10:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:31 smithi076 ceph-mon[35401]: pgmap v1947: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 -- 172.21.15.40:0/3709847437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 msgr2=0x7fb2ec1046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/3709847437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec1046c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009900 tx=0x7fb2dc02a410 comp rx=0 tx=0).stop 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 -- 172.21.15.40:0/3709847437 shutdown_connections 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/3709847437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec10d860 0x7fb2ec10fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/3709847437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 0x7fb2ec10d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/3709847437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec1046c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 -- 172.21.15.40:0/3709847437 >> 172.21.15.40:0/3709847437 conn(0x7fb2ec079160 msgr2=0x7fb2ec079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 -- 172.21.15.40:0/3709847437 shutdown_connections 2024-07-26T13:10:33.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.003+0000 7fb2f0a00640 1 -- 172.21.15.40:0/3709847437 wait complete. 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.004+0000 7fb2f0a00640 1 Processor -- start 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.004+0000 7fb2f0a00640 1 -- start start 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2f0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec19c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2f0a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 0x7fb2ec19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2f0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec10d860 0x7fb2ec1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2f0a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec113340 con 0x7fb2ec1042b0 2024-07-26T13:10:33.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2f0a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1131c0 con 0x7fb2ec104ce0 2024-07-26T13:10:33.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2f0a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1134c0 con 0x7fb2ec10d860 2024-07-26T13:10:33.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2e9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec19c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2e9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec19c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58616/0 (socket says 172.21.15.40:58616) 2024-07-26T13:10:33.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2e9e00640 1 -- 172.21.15.40:0/1421606833 learned_addr learned my addr 172.21.15.40:0/1421606833 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:33.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.005+0000 7fb2ea800640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec10d860 0x7fb2ec1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9400640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 0x7fb2ec19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9e00640 1 -- 172.21.15.40:0/1421606833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec10d860 msgr2=0x7fb2ec1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec10d860 0x7fb2ec1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9e00640 1 -- 172.21.15.40:0/1421606833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 msgr2=0x7fb2ec19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 0x7fb2ec19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9e00640 1 -- 172.21.15.40:0/1421606833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ec1a1fa0 con 0x7fb2ec1042b0 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9400640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 0x7fb2ec19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.006+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec19c030 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005940 tx=0x7fb2dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.007+0000 7fb2e2a00640 1 -- 172.21.15.40:0/1421606833 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc03f030 con 0x7fb2ec1042b0 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.007+0000 7fb2e2a00640 1 -- 172.21.15.40:0/1421606833 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2dc004440 con 0x7fb2ec1042b0 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.007+0000 7fb2e2a00640 1 -- 172.21.15.40:0/1421606833 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc035070 con 0x7fb2ec1042b0 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.007+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ec1a2230 con 0x7fb2ec1042b0 2024-07-26T13:10:33.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.007+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ec1a89f0 con 0x7fb2ec1042b0 2024-07-26T13:10:33.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.010+0000 7fb2f77ce740 1 Processor -- start 2024-07-26T13:10:33.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 -- start start 2024-07-26T13:10:33.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888fb520 0x562b88c9ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88ca0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88ca0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562b88c16f30 con 0x562b888da840 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b88c06430 con 0x562b888d2660 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.011+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b88c0a470 con 0x562b888fb520 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88ca0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88ca0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58632/0 (socket says 172.21.15.40:58632) 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 -- 172.21.15.40:0/3424527680 learned_addr learned my addr 172.21.15.40:0/3424527680 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e2a00640 1 -- 172.21.15.40:0/1421606833 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb2dc042030 con 0x7fb2ec1042b0 2024-07-26T13:10:33.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2ea800640 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888fb520 0x562b88c9ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88ca0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 -- 172.21.15.40:0/3424527680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888fb520 msgr2=0x562b88c9ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888fb520 0x562b88c9ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 -- 172.21.15.40:0/3424527680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 msgr2=0x562b88ca0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.012+0000 7fb2e9400640 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88ca0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.013+0000 7fb2e9400640 1 -- 172.21.15.40:0/3424527680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b88966b00 con 0x562b888da840 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.013+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88ca0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.013+0000 7fb2e9400640 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88ca0a40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009cb0 tx=0x7fb2d80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe3eed69b1ee7c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.013+0000 7fb2d7000640 1 -- 172.21.15.40:0/3424527680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8004020 con 0x562b888da840 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.013+0000 7fb2d7000640 1 -- 172.21.15.40:0/3424527680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2d80035f0 con 0x562b888da840 2024-07-26T13:10:33.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.013+0000 7fb2d7000640 1 -- 172.21.15.40:0/3424527680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8012670 con 0x562b888da840 2024-07-26T13:10:33.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.014+0000 7fb2e2a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2d00b3c50 0x7fb2d00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.014+0000 7fb2e2a00640 1 -- 172.21.15.40:0/1421606833 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb2dc103ff0 con 0x7fb2ec1042b0 2024-07-26T13:10:33.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.014+0000 7fb2ea800640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2d00b3c50 0x7fb2d00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.014+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3424527680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 msgr2=0x562b88ca0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.014+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88ca0a40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009cb0 tx=0x7fb2d80117b0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3424527680 shutdown_connections 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88ca0a40 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88ca0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3424527680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888fb520 0x562b88c9ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3424527680 >> 172.21.15.40:0/3424527680 conn(0x562b888ef910 msgr2=0x562b88c9deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3424527680 shutdown_connections 2024-07-26T13:10:33.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2ea800640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2d00b3c50 0x7fb2d00b6160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4005fd0 tx=0x7fb2e4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:33.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.015+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3424527680 wait complete. 2024-07-26T13:10:33.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.016+0000 7fb2f77ce740 1 -- start start 2024-07-26T13:10:33.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.016+0000 7fb2f77ce740 1 Processor -- start 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cabb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x562b88a69bb0 con 0x562b888fb520 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b88ba2910 con 0x562b888d2660 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b88cae7a0 con 0x562b888da840 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.017+0000 7fb2f77ce740 10 client.0 _ll_register_callbacks cb 0x562b88912d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58644/0 (socket says 172.21.15.40:58644) 2024-07-26T13:10:33.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 -- 172.21.15.40:0/3700055045 learned_addr learned my addr 172.21.15.40:0/3700055045 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2e9400640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cabb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 -- 172.21.15.40:0/3700055045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 msgr2=0x562b88cabb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cabb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 -- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 msgr2=0x562b88cab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.018+0000 7fb2ea800640 1 -- 172.21.15.40:0/3700055045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b889dd960 con 0x562b888fb520 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.019+0000 7fb2ea800640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cac0e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4011db0 tx=0x7fb2e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69823ed425cf1ec server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.019+0000 7fb2cb400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.019+0000 7fb2cb400640 1 -- 172.21.15.40:0/3700055045 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4020620 con 0x562b888fb520 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.019+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2d80035f0 con 0x562b888fb520 2024-07-26T13:10:33.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.019+0000 7fb2cb400640 1 -- 172.21.15.40:0/3700055045 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb2e40207c0 con 0x562b888fb520 2024-07-26T13:10:33.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2cb400640 1 -- 172.21.15.40:0/3700055045 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb2e4004b20 con 0x562b888fb520 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 10 client.17373 fetch_fsmap learned FSMap version 35 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562b88cba4f0 con 0x562b888fb520 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2cb400640 1 -- 172.21.15.40:0/3700055045 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2d80035f0 con 0x562b888fb520 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2cb400640 1 -- 172.21.15.40:0/3700055045 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb2e4031020 con 0x562b888fb520 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 10 client.17373 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 10 client.17373 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 20 client.17373 populate_metadata read hostname 'smithi040' 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b888b9ea0 0x562b88cbda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 4 client.17373 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.020+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b88c18e80 con 0x562b888b9ea0 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.021+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b888b9ea0 0x562b88cbda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.022+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b888b9ea0 0x562b88cbda40 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e3690faa82003a server_cookie=1a1579260733d364 in_seq=0 out_seq=0 2024-07-26T13:10:33.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.022+0000 7fb2cb400640 10 client.17373 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:33.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2cb400640 1 -- 172.21.15.40:0/3700055045 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b88c18e80 con 0x562b888b9ea0 2024-07-26T13:10:33.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2cb400640 10 client.17373 handle_command_reply: tid=0 2024-07-26T13:10:33.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 client.17373 shutdown 2024-07-26T13:10:33.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 msgr2=0x562b88cac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cac0e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4011db0 tx=0x7fb2e4004a40 comp rx=0 tx=0).stop 2024-07-26T13:10:33.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 shutdown_connections 2024-07-26T13:10:33.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b888b9ea0 0x562b88cbda40 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cac0e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cabb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3700055045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 >> 172.21.15.40:0/3700055045 conn(0x562b888ef910 msgr2=0x562b88ca3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.024+0000 7fb2cb400640 0 client.17373 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.025+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 shutdown_connections 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.025+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3700055045 wait complete. 2024-07-26T13:10:33.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.025+0000 7fb2f77ce740 20 client.17373 trim_cache size 0 max 16384 2024-07-26T13:10:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 Processor -- start 2024-07-26T13:10:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 -- start start 2024-07-26T13:10:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 0x562b88ca0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88cc3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888fb520 0x562b88cc3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1b0f90 con 0x562b888da840 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1b2ad0 con 0x562b888fb520 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.044+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1b1660 con 0x562b888d2660 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.045+0000 7fb2e9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 0x562b88ca0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.045+0000 7fb2e9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 0x562b88ca0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:40124/0 (socket says 172.21.15.40:40124) 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.045+0000 7fb2e9e00640 1 -- 172.21.15.40:0/3947308291 learned_addr learned my addr 172.21.15.40:0/3947308291 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.045+0000 7fb2e9400640 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88cc3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.045+0000 7fb2ea800640 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888fb520 0x562b88cc3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.046+0000 7fb2e9e00640 1 -- 172.21.15.40:0/3947308291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888fb520 msgr2=0x562b88cc3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.046+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888fb520 0x562b88cc3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.046+0000 7fb2e9e00640 1 -- 172.21.15.40:0/3947308291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 msgr2=0x562b88cc3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.046+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88cc3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.046+0000 7fb2e9e00640 1 -- 172.21.15.40:0/3947308291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b88cac8e0 con 0x562b888d2660 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.046+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 0x562b88ca0ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0caeb0 tx=0x7fb2dc106480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd0c1c8e9820e191 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.047+0000 7fb2d6600640 1 -- 172.21.15.40:0/3947308291 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc049040 con 0x562b888d2660 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.047+0000 7fb2d6600640 1 -- 172.21.15.40:0/3947308291 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2dc0d3fd0 con 0x562b888d2660 2024-07-26T13:10:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.047+0000 7fb2d6600640 1 -- 172.21.15.40:0/3947308291 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc003c80 con 0x562b888d2660 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3947308291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 msgr2=0x562b88ca0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 0x562b88ca0ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0caeb0 tx=0x7fb2dc106480 comp rx=0 tx=0).stop 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3947308291 shutdown_connections 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888fb520 0x562b88cc3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888da840 0x562b88cc3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/3947308291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888d2660 0x562b88ca0ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3947308291 >> 172.21.15.40:0/3947308291 conn(0x562b888ef910 msgr2=0x562b88cabf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3947308291 shutdown_connections 2024-07-26T13:10:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.048+0000 7fb2f77ce740 1 -- 172.21.15.40:0/3947308291 wait complete. 2024-07-26T13:10:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.049+0000 7fb2f77ce740 1 -- start start 2024-07-26T13:10:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.049+0000 7fb2f77ce740 1 Processor -- start 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cb4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cb16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cb1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1b2400 con 0x562b888fb520 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1b1d30 con 0x562b888d2660 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1aef50 con 0x562b888da840 2024-07-26T13:10:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.050+0000 7fb2f77ce740 10 client.0 _ll_register_callbacks cb 0x7fb2e4009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:10:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.051+0000 7fb2ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cb1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.051+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cb16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.051+0000 7fb2e9e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cb4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.051+0000 7fb2ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cb1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58654/0 (socket says 172.21.15.40:58654) 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.051+0000 7fb2e9e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cb4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:36878/0 (socket says 172.21.15.40:36878) 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.051+0000 7fb2ea800640 1 -- 172.21.15.40:0/2054963860 learned_addr learned my addr 172.21.15.40:0/2054963860 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2e9e00640 1 -- 172.21.15.40:0/2054963860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 msgr2=0x562b88cb16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cb16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2e9e00640 1 -- 172.21.15.40:0/2054963860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 msgr2=0x562b88cb1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cb1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2e9e00640 1 -- 172.21.15.40:0/2054963860 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b88cb2440 con 0x562b888d2660 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2ea800640 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cb1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2e9e00640 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cb4200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0c8190 tx=0x7fb2dc101df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdaad83d600d5dbb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2cb400640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:10:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2cb400640 1 -- 172.21.15.40:0/2054963860 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc049070 con 0x562b888d2660 2024-07-26T13:10:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2dc0d3fd0 con 0x562b888d2660 2024-07-26T13:10:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.052+0000 7fb2cb400640 1 -- 172.21.15.40:0/2054963860 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb2dc003c80 con 0x562b888d2660 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2cb400640 1 -- 172.21.15.40:0/2054963860 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb2dc106070 con 0x562b888d2660 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 10 client.36851 fetch_fsmap learned FSMap version 35 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562b88d262c0 con 0x562b888d2660 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2cb400640 1 -- 172.21.15.40:0/2054963860 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2dc0d3fd0 con 0x562b888d2660 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2cb400640 1 -- 172.21.15.40:0/2054963860 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb2dc0d3b40 con 0x562b888d2660 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 10 client.36851 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 10 client.36851 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 20 client.36851 populate_metadata read hostname 'smithi040' 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b8888f250 0x562b88d289e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.053+0000 7fb2f77ce740 4 client.36851 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b6b64c4c", "release": true, "await": true}] 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.054+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b6b64c4c", "release": true, "await": true}) -- 0x562b88c14920 con 0x562b8888f250 2024-07-26T13:10:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.054+0000 7fb2e9400640 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b8888f250 0x562b88d289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.055+0000 7fb2e9400640 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b8888f250 0x562b88d289e0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40cf23f43b47899b server_cookie=a7d49866cd733a78 in_seq=0 out_seq=0 2024-07-26T13:10:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.055+0000 7fb2cb400640 10 client.36851 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.122+0000 7fb2cb400640 1 -- 172.21.15.40:0/2054963860 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x562b88c14920 con 0x562b8888f250 2024-07-26T13:10:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.122+0000 7fb2cb400640 10 client.36851 handle_command_reply: tid=0 2024-07-26T13:10:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.122+0000 7fb2f77ce740 1 client.36851 shutdown 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 msgr2=0x562b88cb4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cb4200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0c8190 tx=0x7fb2dc101df0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 shutdown_connections 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x562b8888f250 0x562b88d289e0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b888fb520 0x562b88cb1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2cb400640 0 client.36851 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b888da840 0x562b88cb16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 --2- 172.21.15.40:0/2054963860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b888d2660 0x562b88cb4200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 >> 172.21.15.40:0/2054963860 conn(0x562b888ef910 msgr2=0x562b88cb72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 shutdown_connections 2024-07-26T13:10:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.123+0000 7fb2f77ce740 1 -- 172.21.15.40:0/2054963860 wait complete. 2024-07-26T13:10:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.124+0000 7fb2f77ce740 20 client.36851 trim_cache size 0 max 16384 2024-07-26T13:10:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:10:33.125 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 160, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "b6b64c4c": { 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 160, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:10:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:10:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.125+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2d00b3c50 msgr2=0x7fb2d00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.125+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2d00b3c50 0x7fb2d00b6160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4005fd0 tx=0x7fb2e4009600 comp rx=0 tx=0).stop 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.125+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 msgr2=0x7fb2ec19c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.125+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec19c030 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005940 tx=0x7fb2dc004040 comp rx=0 tx=0).stop 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 shutdown_connections 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb2d00b3c50 0x7fb2d00b6160 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec10d860 0x7fb2ec1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2ec104ce0 0x7fb2ec19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 --2- 172.21.15.40:0/1421606833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2ec1042b0 0x7fb2ec19c030 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 >> 172.21.15.40:0/1421606833 conn(0x7fb2ec079160 msgr2=0x7fb2ec109860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 shutdown_connections 2024-07-26T13:10:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:33.126+0000 7fb2f0a00640 1 -- 172.21.15.40:0/1421606833 wait complete. 2024-07-26T13:10:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:33 smithi040 ceph-mon[32397]: pgmap v1948: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T13:10:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:10:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:33 smithi146 ceph-mon[35807]: pgmap v1948: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T13:10:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:10:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:33 smithi076 ceph-mon[35401]: pgmap v1948: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T13:10:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:10:34.017 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b6b64c4c', total seconds elapsed: 18.3 2024-07-26T13:10:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:34 smithi040 ceph-mon[32397]: pgmap v1949: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T13:10:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:34 smithi146 ceph-mon[35807]: pgmap v1949: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T13:10:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:34 smithi076 ceph-mon[35401]: pgmap v1949: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 MiB/s wr, 11 op/s 2024-07-26T13:10:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:10:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:10:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:10:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:10:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:10:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:10:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:10:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:36 smithi040 ceph-mon[32397]: pgmap v1950: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:10:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:36 smithi146 ceph-mon[35807]: pgmap v1950: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:10:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:36 smithi076 ceph-mon[35401]: pgmap v1950: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:10:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:38 smithi040 ceph-mon[32397]: pgmap v1951: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2024-07-26T13:10:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:38 smithi146 ceph-mon[35807]: pgmap v1951: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2024-07-26T13:10:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:38 smithi076 ceph-mon[35401]: pgmap v1951: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2024-07-26T13:10:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:40 smithi040 ceph-mon[32397]: pgmap v1952: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-07-26T13:10:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:40 smithi146 ceph-mon[35807]: pgmap v1952: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-07-26T13:10:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:40 smithi076 ceph-mon[35401]: pgmap v1952: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2024-07-26T13:10:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:42 smithi040 ceph-mon[32397]: pgmap v1953: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T13:10:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:42 smithi146 ceph-mon[35807]: pgmap v1953: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T13:10:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:42 smithi076 ceph-mon[35401]: pgmap v1953: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 10 op/s 2024-07-26T13:10:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:44 smithi040 ceph-mon[32397]: pgmap v1954: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:10:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:44 smithi146 ceph-mon[35807]: pgmap v1954: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:10:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:44 smithi076 ceph-mon[35401]: pgmap v1954: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.3 MiB/s wr, 13 op/s 2024-07-26T13:10:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:46 smithi040 ceph-mon[32397]: pgmap v1955: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T13:10:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:46 smithi146 ceph-mon[35807]: pgmap v1955: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T13:10:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:46 smithi076 ceph-mon[35401]: pgmap v1955: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T13:10:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:48 smithi040 ceph-mon[32397]: pgmap v1956: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 MiB/s wr, 11 op/s 2024-07-26T13:10:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:48 smithi146 ceph-mon[35807]: pgmap v1956: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 MiB/s wr, 11 op/s 2024-07-26T13:10:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:48 smithi076 ceph-mon[35401]: pgmap v1956: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 MiB/s wr, 11 op/s 2024-07-26T13:10:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:50 smithi040 ceph-mon[32397]: pgmap v1957: 97 pgs: 97 active+clean; 9.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.5 MiB/s wr, 14 op/s 2024-07-26T13:10:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:50 smithi146 ceph-mon[35807]: pgmap v1957: 97 pgs: 97 active+clean; 9.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.5 MiB/s wr, 14 op/s 2024-07-26T13:10:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:50 smithi076 ceph-mon[35401]: pgmap v1957: 97 pgs: 97 active+clean; 9.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.5 MiB/s wr, 14 op/s 2024-07-26T13:10:52.590 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-26T13:10:52.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:10:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:52 smithi040 ceph-mon[32397]: pgmap v1958: 97 pgs: 97 active+clean; 9.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:10:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:52 smithi146 ceph-mon[35807]: pgmap v1958: 97 pgs: 97 active+clean; 9.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:10:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:52 smithi076 ceph-mon[35401]: pgmap v1958: 97 pgs: 97 active+clean; 9.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:10:53.125 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:10:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:54 smithi040 ceph-mon[32397]: pgmap v1959: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:10:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:54 smithi146 ceph-mon[35807]: pgmap v1959: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:10:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:54 smithi076 ceph-mon[35401]: pgmap v1959: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 -- 172.21.15.40:0/3792597346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 msgr2=0x7fbc34105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3792597346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc34105a00 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009900 tx=0x7fbc2802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 -- 172.21.15.40:0/3792597346 shutdown_connections 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3792597346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc3410b880 0x7fbc341120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3792597346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 0x7fbc3410b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3792597346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc34105a00 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 -- 172.21.15.40:0/3792597346 >> 172.21.15.40:0/3792597346 conn(0x7fbc34101060 msgr2=0x7fbc341034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:55.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 -- 172.21.15.40:0/3792597346 shutdown_connections 2024-07-26T13:10:55.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.730+0000 7fbc3a800640 1 -- 172.21.15.40:0/3792597346 wait complete. 2024-07-26T13:10:55.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.732+0000 7fbc3a800640 1 Processor -- start 2024-07-26T13:10:55.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.732+0000 7fbc3a800640 1 -- start start 2024-07-26T13:10:55.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.732+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc3419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:55.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 0x7fbc3419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc3410b880 0x7fbc341a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc3a800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34115430 con 0x7fbc341055f0 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc3a800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341152b0 con 0x7fbc3410b880 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc3a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc341155b0 con 0x7fbc3410af30 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc39400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc3419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc39400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc3419be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53378/0 (socket says 172.21.15.40:53378) 2024-07-26T13:10:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc39400640 1 -- 172.21.15.40:0/3345643423 learned_addr learned my addr 172.21.15.40:0/3345643423 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:55.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc38a00640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 0x7fbc3419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:55.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.733+0000 7fbc39e00640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc3410b880 0x7fbc341a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:55.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc39400640 1 -- 172.21.15.40:0/3345643423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 msgr2=0x7fbc3419c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:55.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc39400640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 0x7fbc3419c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc39400640 1 -- 172.21.15.40:0/3345643423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc3410b880 msgr2=0x7fbc341a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc39400640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc3410b880 0x7fbc341a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc39400640 1 -- 172.21.15.40:0/3345643423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc341a1d90 con 0x7fbc341055f0 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc38a00640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 0x7fbc3419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc39400640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc3419be20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbc2802a910 tx=0x7fbc28003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.734+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2803f070 con 0x7fbc341055f0 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.735+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc28003e40 con 0x7fbc341055f0 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.735+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc341a2020 con 0x7fbc341055f0 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.735+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28035030 con 0x7fbc341055f0 2024-07-26T13:10:55.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.735+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc341a87e0 con 0x7fbc341055f0 2024-07-26T13:10:55.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.736+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc34105a00 con 0x7fbc341055f0 2024-07-26T13:10:55.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.739+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbc28042070 con 0x7fbc341055f0 2024-07-26T13:10:55.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.741+0000 7fbc32000640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbc1c0b3bd0 0x7fbc1c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:55.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.742+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbc281048d0 con 0x7fbc341055f0 2024-07-26T13:10:55.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.742+0000 7fbc38a00640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbc1c0b3bd0 0x7fbc1c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:55.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.743+0000 7fbc38a00640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbc1c0b3bd0 0x7fbc1c0b60e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbc200058c0 tx=0x7fbc20005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:55.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:55.743+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbc280cbee0 con 0x7fbc341055f0 2024-07-26T13:10:56.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.011+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc3410d600 con 0x7fbc341055f0 2024-07-26T13:10:56.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.012+0000 7fbc32000640 1 -- 172.21.15.40:0/3345643423 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fbc280cb7e0 con 0x7fbc341055f0 2024-07-26T13:10:56.015 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:10:56.015 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:10:56.015 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:10:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.015+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbc1c0b3bd0 msgr2=0x7fbc1c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.015+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbc1c0b3bd0 0x7fbc1c0b60e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbc200058c0 tx=0x7fbc20005850 comp rx=0 tx=0).stop 2024-07-26T13:10:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 msgr2=0x7fbc3419be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc3419be20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbc2802a910 tx=0x7fbc28003c20 comp rx=0 tx=0).stop 2024-07-26T13:10:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 shutdown_connections 2024-07-26T13:10:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc3410b880 0x7fbc341a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbc1c0b3bd0 0x7fbc1c0b60e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3410af30 0x7fbc3419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 --2- 172.21.15.40:0/3345643423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc341055f0 0x7fbc3419be20 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 >> 172.21.15.40:0/3345643423 conn(0x7fbc34101060 msgr2=0x7fbc34103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.016+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 shutdown_connections 2024-07-26T13:10:56.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:56.017+0000 7fbc3a800640 1 -- 172.21.15.40:0/3345643423 wait complete. 2024-07-26T13:10:56.888 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:56 smithi040 ceph-mon[32397]: pgmap v1960: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:10:56.888 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:56 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3345643423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:56.958 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-26T13:10:56.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-26T13:10:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:56 smithi146 ceph-mon[35807]: pgmap v1960: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:10:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:56 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3345643423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:56 smithi076 ceph-mon[35401]: pgmap v1960: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:10:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:56 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3345643423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:10:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:10:58.880 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:10:58 smithi040 ceph-mon[32397]: pgmap v1961: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:10:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:10:58 smithi146 ceph-mon[35807]: pgmap v1961: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:10:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:10:58 smithi076 ceph-mon[35401]: pgmap v1961: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:10:59.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 -- 172.21.15.40:0/1318599625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 msgr2=0x7fcd0c0755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1318599625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c0755f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009900 tx=0x7fccfc02a410 comp rx=0 tx=0).stop 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 -- 172.21.15.40:0/1318599625 shutdown_connections 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1318599625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd0c10f950 0x7fcd0c111d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1318599625 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd0c075b30 0x7fcd0c10f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1318599625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c0755f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.854+0000 7fcd0be00640 1 -- 172.21.15.40:0/1318599625 >> 172.21.15.40:0/1318599625 conn(0x7fcd0c0fee60 msgr2=0x7fcd0c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.855+0000 7fcd0be00640 1 -- 172.21.15.40:0/1318599625 shutdown_connections 2024-07-26T13:10:59.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.855+0000 7fcd0be00640 1 -- 172.21.15.40:0/1318599625 wait complete. 2024-07-26T13:10:59.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.856+0000 7fcd0be00640 1 Processor -- start 2024-07-26T13:10:59.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.856+0000 7fcd0be00640 1 -- start start 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd0c075b30 0x7fcd0c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd0c10f950 0x7fcd0c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1153b0 con 0x7fcd0c0751e0 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c115230 con 0x7fcd0c10f950 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c115530 con 0x7fcd0c075b30 2024-07-26T13:10:59.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53388/0 (socket says 172.21.15.40:53388) 2024-07-26T13:10:59.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.857+0000 7fcd0aa00640 1 -- 172.21.15.40:0/1442047743 learned_addr learned my addr 172.21.15.40:0/1442047743 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:59.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0a000640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd0c075b30 0x7fcd0c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0b400640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd0c10f950 0x7fcd0c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0aa00640 1 -- 172.21.15.40:0/1442047743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd0c075b30 msgr2=0x7fcd0c19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd0c075b30 0x7fcd0c19c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0aa00640 1 -- 172.21.15.40:0/1442047743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd0c10f950 msgr2=0x7fcd0c1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd0c10f950 0x7fcd0c1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.858+0000 7fcd0aa00640 1 -- 172.21.15.40:0/1442047743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c1a1d90 con 0x7fcd0c0751e0 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.859+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c19be20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009230 tx=0x7fccfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.859+0000 7fcd03400640 1 -- 172.21.15.40:0/1442047743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc03f030 con 0x7fcd0c0751e0 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.859+0000 7fcd03400640 1 -- 172.21.15.40:0/1442047743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccfc003a80 con 0x7fcd0c0751e0 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.859+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c1a2020 con 0x7fcd0c0751e0 2024-07-26T13:10:59.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.859+0000 7fcd03400640 1 -- 172.21.15.40:0/1442047743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc035070 con 0x7fcd0c0751e0 2024-07-26T13:10:59.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.859+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c1a87e0 con 0x7fcd0c0751e0 2024-07-26T13:10:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.863+0000 7fcd18222740 1 Processor -- start 2024-07-26T13:10:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.863+0000 7fcd18222740 1 -- start start 2024-07-26T13:10:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd18222740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a420390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd18222740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4208d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd18222740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a059b60 0x55849a420e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd18222740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55849a3eacf0 con 0x55849a051980 2024-07-26T13:10:59.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd18222740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55849a395b40 con 0x55849a07a840 2024-07-26T13:10:59.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd18222740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55849a385040 con 0x55849a059b60 2024-07-26T13:10:59.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a420390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd0a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a059b60 0x55849a420e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd03400640 1 -- 172.21.15.40:0/1442047743 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fccfc042030 con 0x7fcd0c0751e0 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a420390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:49106/0 (socket says 172.21.15.40:49106) 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.864+0000 7fcd0b400640 1 -- 172.21.15.40:0/4250072975 learned_addr learned my addr 172.21.15.40:0/4250072975 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.865+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.865+0000 7fcd0b400640 1 -- 172.21.15.40:0/4250072975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a059b60 msgr2=0x55849a420e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.865+0000 7fcd0b400640 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a059b60 0x55849a420e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.865+0000 7fcd0b400640 1 -- 172.21.15.40:0/4250072975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 msgr2=0x55849a4208d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.865+0000 7fcd0b400640 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4208d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.865+0000 7fcd0b400640 1 -- 172.21.15.40:0/4250072975 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849a30caf0 con 0x55849a07a840 2024-07-26T13:10:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.866+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:10:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.866+0000 7fcd0b400640 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a420390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009ee0 tx=0x7fcd04010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348ae04940eb2af1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.867+0000 7fccf7400640 1 -- 172.21.15.40:0/4250072975 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04016070 con 0x55849a07a840 2024-07-26T13:10:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.867+0000 7fccf7400640 1 -- 172.21.15.40:0/4250072975 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd04004d20 con 0x55849a07a840 2024-07-26T13:10:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.867+0000 7fccf7400640 1 -- 172.21.15.40:0/4250072975 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd040126b0 con 0x55849a07a840 2024-07-26T13:10:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.867+0000 7fcd03400640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fccf00b3c40 0x7fccf00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.867+0000 7fcd03400640 1 -- 172.21.15.40:0/1442047743 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fccfc1040a0 con 0x7fcd0c0751e0 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.867+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fccf00b3c40 0x7fccf00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 -- 172.21.15.40:0/4250072975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 msgr2=0x55849a420390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a420390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009ee0 tx=0x7fcd04010740 comp rx=0 tx=0).stop 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 -- 172.21.15.40:0/4250072975 shutdown_connections 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a059b60 0x55849a420e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 --2- 172.21.15.40:0/4250072975 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a420390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 -- 172.21.15.40:0/4250072975 >> 172.21.15.40:0/4250072975 conn(0x55849a06e990 msgr2=0x55849a41e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.868+0000 7fcd18222740 1 -- 172.21.15.40:0/4250072975 shutdown_connections 2024-07-26T13:10:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.869+0000 7fcd18222740 1 -- 172.21.15.40:0/4250072975 wait complete. 2024-07-26T13:10:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.869+0000 7fcd0aa00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fccf00b3c40 0x7fccf00b6150 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0c7070 tx=0x7fccfc107d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.869+0000 7fcd18222740 1 -- start start 2024-07-26T13:10:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.870+0000 7fcd18222740 1 Processor -- start 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.870+0000 7fcd18222740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a42bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.870+0000 7fcd18222740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd18222740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 0x55849a437d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd18222740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55849a321500 con 0x55849a07a840 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd18222740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55849a389080 con 0x55849a059b60 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd18222740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55849a1e87a0 con 0x55849a051980 2024-07-26T13:10:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd18222740 10 client.0 _ll_register_callbacks cb 0x55849a37dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:10:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 0x55849a437d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 0x55849a437d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53412/0 (socket says 172.21.15.40:53412) 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd0b400640 1 -- 172.21.15.40:0/2873421476 learned_addr learned my addr 172.21.15.40:0/2873421476 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd0b400640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a42bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.871+0000 7fcd0a000640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fcd0b400640 1 -- 172.21.15.40:0/2873421476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 msgr2=0x55849a42bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fcd0b400640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a42bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fcd0b400640 1 -- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 msgr2=0x55849a42c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fcd0b400640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fcd0b400640 1 -- 172.21.15.40:0/2873421476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849a0f4b90 con 0x55849a07a840 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fcd0b400640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 0x55849a437d60 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009ca0 tx=0x7fcd04009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ef02bbb37e1650 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fccebe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:10:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.872+0000 7fccebe00640 1 -- 172.21.15.40:0/2873421476 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04016040 con 0x55849a07a840 2024-07-26T13:10:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.873+0000 7fccebe00640 1 -- 172.21.15.40:0/2873421476 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd04004ed0 con 0x55849a07a840 2024-07-26T13:10:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.873+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd04004d20 con 0x55849a07a840 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.873+0000 7fccebe00640 1 -- 172.21.15.40:0/2873421476 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcd04030050 con 0x55849a07a840 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.873+0000 7fcd18222740 10 client.17397 fetch_fsmap learned FSMap version 35 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.873+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55849a43a9b0 con 0x55849a07a840 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fccebe00640 1 -- 172.21.15.40:0/2873421476 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd04004d20 con 0x55849a07a840 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fccebe00640 1 -- 172.21.15.40:0/2873421476 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fcd04028020 con 0x55849a07a840 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fcd18222740 10 client.17397 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fcd18222740 10 client.17397 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fcd18222740 20 client.17397 populate_metadata read hostname 'smithi040' 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fcd18222740 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a0391c0 0x55849a43de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fcd18222740 4 client.17397 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:10:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.874+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55849a397a90 con 0x55849a0391c0 2024-07-26T13:10:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.875+0000 7fcd0a000640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a0391c0 0x55849a43de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.876+0000 7fcd0a000640 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a0391c0 0x55849a43de80 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61edb11ef0957cc server_cookie=7c8e8727f05e5192 in_seq=0 out_seq=0 2024-07-26T13:10:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.876+0000 7fccebe00640 10 client.17397 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fccebe00640 1 -- 172.21.15.40:0/2873421476 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55849a397a90 con 0x55849a0391c0 2024-07-26T13:10:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fccebe00640 10 client.17397 handle_command_reply: tid=0 2024-07-26T13:10:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 client.17397 shutdown 2024-07-26T13:10:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 msgr2=0x55849a437d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 0x55849a437d60 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009ca0 tx=0x7fcd04009a40 comp rx=0 tx=0).stop 2024-07-26T13:10:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 shutdown_connections 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a0391c0 0x55849a43de80 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a07a840 0x55849a437d60 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 --2- 172.21.15.40:0/2873421476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a42bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fccebe00640 0 client.17397 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.878+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 >> 172.21.15.40:0/2873421476 conn(0x55849a06e990 msgr2=0x55849a423520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.879+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 shutdown_connections 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.879+0000 7fcd18222740 1 -- 172.21.15.40:0/2873421476 wait complete. 2024-07-26T13:10:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.879+0000 7fcd18222740 20 client.17397 trim_cache size 0 max 16384 2024-07-26T13:10:59.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 Processor -- start 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 -- start start 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a41d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 0x55849a41dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a443520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1b0d30 con 0x55849a059b60 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1b2870 con 0x55849a07a840 2024-07-26T13:10:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.906+0000 7fcd18222740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1b1400 con 0x55849a051980 2024-07-26T13:10:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 0x55849a41dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a41d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 0x55849a41dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53428/0 (socket says 172.21.15.40:53428) 2024-07-26T13:10:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 -- 172.21.15.40:0/1950542152 learned_addr learned my addr 172.21.15.40:0/1950542152 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0b400640 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a443520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 -- 172.21.15.40:0/1950542152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 msgr2=0x55849a41d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a41d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 -- 172.21.15.40:0/1950542152 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 msgr2=0x55849a443520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a443520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.907+0000 7fcd0a000640 1 -- 172.21.15.40:0/1950542152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849a426970 con 0x55849a059b60 2024-07-26T13:10:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.908+0000 7fcd0a000640 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 0x55849a41dd90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fccf8004650 tx=0x7fccf800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06bd669ede79eeb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.908+0000 7fccf6a00640 1 -- 172.21.15.40:0/1950542152 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011440 con 0x55849a059b60 2024-07-26T13:10:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.908+0000 7fccf6a00640 1 -- 172.21.15.40:0/1950542152 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccf8011a70 con 0x55849a059b60 2024-07-26T13:10:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.908+0000 7fccf6a00640 1 -- 172.21.15.40:0/1950542152 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf801d8e0 con 0x55849a059b60 2024-07-26T13:10:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.909+0000 7fcd18222740 1 -- 172.21.15.40:0/1950542152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 msgr2=0x55849a41dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:10:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.909+0000 7fcd18222740 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 0x55849a41dd90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fccf8004650 tx=0x7fccf800b390 comp rx=0 tx=0).stop 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.909+0000 7fcd18222740 1 -- 172.21.15.40:0/1950542152 shutdown_connections 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a07a840 0x55849a443520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a059b60 0x55849a41dd90 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 --2- 172.21.15.40:0/1950542152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a051980 0x55849a41d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 -- 172.21.15.40:0/1950542152 >> 172.21.15.40:0/1950542152 conn(0x55849a06e990 msgr2=0x55849a42a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 -- 172.21.15.40:0/1950542152 shutdown_connections 2024-07-26T13:10:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 -- 172.21.15.40:0/1950542152 wait complete. 2024-07-26T13:10:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.910+0000 7fcd18222740 1 -- start start 2024-07-26T13:10:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 Processor -- start 2024-07-26T13:10:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a07a840 0x55849a42fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1b21a0 con 0x55849a051980 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1b1ad0 con 0x55849a059b60 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1aecf0 con 0x55849a07a840 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.911+0000 7fcd18222740 10 client.0 _ll_register_callbacks cb 0x7fccfc107c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53436/0 (socket says 172.21.15.40:53436) 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 -- 172.21.15.40:0/3663054849 learned_addr learned my addr 172.21.15.40:0/3663054849 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:10:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0a000640 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 -- 172.21.15.40:0/3663054849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a07a840 msgr2=0x55849a42fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a07a840 0x55849a42fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 -- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 msgr2=0x55849a42f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.912+0000 7fcd0b400640 1 -- 172.21.15.40:0/3663054849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849a42fff0 con 0x55849a051980 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.913+0000 7fcd0b400640 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4340c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009fd0 tx=0x7fcd04000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bacbc2e045bf5c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.913+0000 7fccebe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.913+0000 7fccebe00640 1 -- 172.21.15.40:0/3663054849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04039020 con 0x55849a051980 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.913+0000 7fccebe00640 1 -- 172.21.15.40:0/3663054849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd04005aa0 con 0x55849a051980 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.913+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf8011a70 con 0x55849a051980 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fccebe00640 1 -- 172.21.15.40:0/3663054849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcd04016040 con 0x55849a051980 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 10 client.17403 fetch_fsmap learned FSMap version 35 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55849a4a6130 con 0x55849a051980 2024-07-26T13:10:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fccebe00640 1 -- 172.21.15.40:0/3663054849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccf8011a70 con 0x55849a051980 2024-07-26T13:10:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fccebe00640 1 -- 172.21.15.40:0/3663054849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fcd04028040 con 0x55849a051980 2024-07-26T13:10:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 10 client.17403 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:10:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 10 client.17403 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:10:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 20 client.17403 populate_metadata read hostname 'smithi040' 2024-07-26T13:10:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a00e570 0x55849a4a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:10:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 4 client.17403 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-26T13:10:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.914+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55849a393530 con 0x55849a00e570 2024-07-26T13:10:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.915+0000 7fcd0a000640 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a00e570 0x55849a4a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:10:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.916+0000 7fcd0a000640 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a00e570 0x55849a4a88a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6504c832a60e53f server_cookie=520425e7d49d1ba in_seq=0 out_seq=0 2024-07-26T13:10:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:10:59.916+0000 7fccebe00640 10 client.17403 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:00.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.188+0000 7fccebe00640 1 -- 172.21.15.40:0/3663054849 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55849a393530 con 0x55849a00e570 2024-07-26T13:11:00.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.188+0000 7fccebe00640 10 client.17403 handle_command_reply: tid=0 2024-07-26T13:11:00.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.188+0000 7fcd18222740 1 client.17403 shutdown 2024-07-26T13:11:00.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 msgr2=0x55849a4340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:00.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4340c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009fd0 tx=0x7fcd04000f40 comp rx=0 tx=0).stop 2024-07-26T13:11:00.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 shutdown_connections 2024-07-26T13:11:00.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849a07a840 0x55849a42fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55849a059b60 0x55849a42f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55849a00e570 0x55849a4a88a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 --2- 172.21.15.40:0/3663054849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55849a051980 0x55849a4340c0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 >> 172.21.15.40:0/3663054849 conn(0x55849a06e990 msgr2=0x55849a42ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.189+0000 7fccebe00640 0 client.17403 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.190+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 shutdown_connections 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.190+0000 7fcd18222740 1 -- 172.21.15.40:0/3663054849 wait complete. 2024-07-26T13:11:00.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.190+0000 7fcd18222740 20 client.17403 trim_cache size 0 max 16384 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 162, 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "11aa112": { 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 162, 2024-07-26T13:11:00.193 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:00.194 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:00.195 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:00.195 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:00.195 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:00.195 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:00.195 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fccf00b3c40 msgr2=0x7fccf00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fccf00b3c40 0x7fccf00b6150 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0c7070 tx=0x7fccfc107d30 comp rx=0 tx=0).stop 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 msgr2=0x7fcd0c19be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c19be20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009230 tx=0x7fccfc004270 comp rx=0 tx=0).stop 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 shutdown_connections 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd0c10f950 0x7fcd0c1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fccf00b3c40 0x7fccf00b6150 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd0c075b30 0x7fcd0c19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 --2- 172.21.15.40:0/1442047743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd0c0751e0 0x7fcd0c19be20 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.192+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 >> 172.21.15.40:0/1442047743 conn(0x7fcd0c0fee60 msgr2=0x7fcd0c1083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:00.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.193+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 shutdown_connections 2024-07-26T13:11:00.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:00.193+0000 7fcd0be00640 1 -- 172.21.15.40:0/1442047743 wait complete. 2024-07-26T13:11:00.941 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:00 smithi040 ceph-mon[32397]: pgmap v1962: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:11:01.011 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '11aa112', quiesce took 8.4 seconds. Will release after: 1.5999999999999996 2024-07-26T13:11:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:00 smithi146 ceph-mon[35807]: pgmap v1962: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:11:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:00 smithi076 ceph-mon[35401]: pgmap v1962: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:11:02.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:11:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:02 smithi040 ceph-mon[32397]: pgmap v1963: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:11:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:02 smithi146 ceph-mon[35807]: pgmap v1963: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:11:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:02 smithi076 ceph-mon[35401]: pgmap v1963: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:11:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:11:05.066 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:04 smithi040 ceph-mon[32397]: pgmap v1964: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:11:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:04 smithi076 ceph-mon[35401]: pgmap v1964: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:11:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:04 smithi146 ceph-mon[35807]: pgmap v1964: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 -- 172.21.15.40:0/159541408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 msgr2=0x7fdf60112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 --2- 172.21.15.40:0/159541408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf60112290 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009be0 tx=0x7fdf5802a6c0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 -- 172.21.15.40:0/159541408 shutdown_connections 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 --2- 172.21.15.40:0/159541408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf60112290 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 --2- 172.21.15.40:0/159541408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf6010b110 0x7fdf6010b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 --2- 172.21.15.40:0/159541408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf601057d0 0x7fdf60105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.432+0000 7fdf67a00640 1 -- 172.21.15.40:0/159541408 >> 172.21.15.40:0/159541408 conn(0x7fdf60101220 msgr2=0x7fdf60103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.433+0000 7fdf67a00640 1 -- 172.21.15.40:0/159541408 shutdown_connections 2024-07-26T13:11:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.433+0000 7fdf67a00640 1 -- 172.21.15.40:0/159541408 wait complete. 2024-07-26T13:11:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.435+0000 7fdf67a00640 1 Processor -- start 2024-07-26T13:11:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.435+0000 7fdf67a00640 1 -- start start 2024-07-26T13:11:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.436+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf601057d0 0x7fdf6019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.436+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf6010b110 0x7fdf6019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.436+0000 7fdf67a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf601a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.436+0000 7fdf67a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601155e0 con 0x7fdf6010ba60 2024-07-26T13:11:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.436+0000 7fdf67a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60115460 con 0x7fdf601057d0 2024-07-26T13:11:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.436+0000 7fdf67a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60115760 con 0x7fdf6010b110 2024-07-26T13:11:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf601a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf6010b110 0x7fdf6019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf601a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35450/0 (socket says 172.21.15.40:35450) 2024-07-26T13:11:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 -- 172.21.15.40:0/3138885192 learned_addr learned my addr 172.21.15.40:0/3138885192 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65000640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf601057d0 0x7fdf6019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 -- 172.21.15.40:0/3138885192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf6010b110 msgr2=0x7fdf6019c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf6010b110 0x7fdf6019c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 -- 172.21.15.40:0/3138885192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf601057d0 msgr2=0x7fdf6019bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf601057d0 0x7fdf6019bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.437+0000 7fdf65a00640 1 -- 172.21.15.40:0/3138885192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf601a1f20 con 0x7fdf6010ba60 2024-07-26T13:11:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.438+0000 7fdf5fe00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf6010b110 0x7fdf6019c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:11:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.439+0000 7fdf65a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf601a17f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fdf58004af0 tx=0x7fdf58030b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.439+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58041020 con 0x7fdf6010ba60 2024-07-26T13:11:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.439+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf58037040 con 0x7fdf6010ba60 2024-07-26T13:11:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.439+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58036070 con 0x7fdf6010ba60 2024-07-26T13:11:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.439+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf601a21b0 con 0x7fdf6010ba60 2024-07-26T13:11:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.440+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601a8970 con 0x7fdf6010ba60 2024-07-26T13:11:05.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.441+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60105be0 con 0x7fdf6010ba60 2024-07-26T13:11:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.444+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdf58044020 con 0x7fdf6010ba60 2024-07-26T13:11:05.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.446+0000 7fdf5d600640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf480b3c50 0x7fdf480b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:05.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.446+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf58104760 con 0x7fdf6010ba60 2024-07-26T13:11:05.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.446+0000 7fdf65000640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf480b3c50 0x7fdf480b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:05.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.447+0000 7fdf65000640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf480b3c50 0x7fdf480b6160 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009b60 tx=0x7fdf54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:05.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.448+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fdf5804b020 con 0x7fdf6010ba60 2024-07-26T13:11:05.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.694+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf6010d850 con 0x7fdf6010ba60 2024-07-26T13:11:05.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.696+0000 7fdf5d600640 1 -- 172.21.15.40:0/3138885192 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fdf580cbdf0 con 0x7fdf6010ba60 2024-07-26T13:11:05.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:11:05.698 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:11:05.699 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf480b3c50 msgr2=0x7fdf480b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf480b3c50 0x7fdf480b6160 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009b60 tx=0x7fdf54005f90 comp rx=0 tx=0).stop 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 msgr2=0x7fdf601a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf601a17f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fdf58004af0 tx=0x7fdf58030b80 comp rx=0 tx=0).stop 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 shutdown_connections 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf6010ba60 0x7fdf601a17f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdf480b3c50 0x7fdf480b6160 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf6010b110 0x7fdf6019c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 --2- 172.21.15.40:0/3138885192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf601057d0 0x7fdf6019bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:05.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 >> 172.21.15.40:0/3138885192 conn(0x7fdf60101220 msgr2=0x7fdf60103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:05.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.699+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 shutdown_connections 2024-07-26T13:11:05.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:05.700+0000 7fdf67a00640 1 -- 172.21.15.40:0/3138885192 wait complete. 2024-07-26T13:11:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:05 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3138885192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:05 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3138885192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:05 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3138885192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:06.561 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 11aa112 --release --await' 2024-07-26T13:11:06.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 11aa112 --release --await 2024-07-26T13:11:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:11:07.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:06 smithi040 ceph-mon[32397]: pgmap v1965: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:11:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:06 smithi146 ceph-mon[35807]: pgmap v1965: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:11:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:06 smithi076 ceph-mon[35401]: pgmap v1965: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:11:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 -- 172.21.15.40:0/2350798794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f8109670 msgr2=0x7f55f810fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 --2- 172.21.15.40:0/2350798794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f8109670 0x7f55f810fea0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009ca0 tx=0x7f55f002a8c0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 -- 172.21.15.40:0/2350798794 shutdown_connections 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 --2- 172.21.15.40:0/2350798794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f8109670 0x7f55f810fea0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 --2- 172.21.15.40:0/2350798794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55f8108d20 0x7f55f8109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 --2- 172.21.15.40:0/2350798794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f81033e0 0x7f55f81037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 -- 172.21.15.40:0/2350798794 >> 172.21.15.40:0/2350798794 conn(0x7f55f80fee30 msgr2=0x7f55f8101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 -- 172.21.15.40:0/2350798794 shutdown_connections 2024-07-26T13:11:09.172 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:08 smithi040 ceph-mon[32397]: pgmap v1966: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:11:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.169+0000 7f55fce00640 1 -- 172.21.15.40:0/2350798794 wait complete. 2024-07-26T13:11:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 Processor -- start 2024-07-26T13:11:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 -- start start 2024-07-26T13:11:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 0x7f55f819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55f8108d20 0x7f55f819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f8109670 0x7f55f81a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8113240 con 0x7f55f81033e0 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81130c0 con 0x7f55f8108d20 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.171+0000 7f55fce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81133c0 con 0x7f55f8109670 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 0x7f55f819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 0x7f55f819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35482/0 (socket says 172.21.15.40:35482) 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 -- 172.21.15.40:0/3387850956 learned_addr learned my addr 172.21.15.40:0/3387850956 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55efe00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55f8108d20 0x7f55f819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f8109670 0x7f55f81a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 -- 172.21.15.40:0/3387850956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f8109670 msgr2=0x7f55f81a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f8109670 0x7f55f81a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 -- 172.21.15.40:0/3387850956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55f8108d20 msgr2=0x7f55f819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55f8108d20 0x7f55f819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7400640 1 -- 172.21.15.40:0/3387850956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f81a1d80 con 0x7f55f81033e0 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.172+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f8109670 0x7f55f81a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.173+0000 7f55f7400640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 0x7f55f819be10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f55e800d770 tx=0x7f55e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.173+0000 7f55f4c00640 1 -- 172.21.15.40:0/3387850956 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8017070 con 0x7f55f81033e0 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.173+0000 7f55f4c00640 1 -- 172.21.15.40:0/3387850956 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e80054b0 con 0x7f55f81033e0 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.173+0000 7f55f4c00640 1 -- 172.21.15.40:0/3387850956 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8004c60 con 0x7f55f81033e0 2024-07-26T13:11:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.173+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f81a2070 con 0x7f55f81033e0 2024-07-26T13:11:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.173+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f81a87d0 con 0x7f55f81033e0 2024-07-26T13:11:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.177+0000 7f5605046740 1 Processor -- start 2024-07-26T13:11:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.177+0000 7f5605046740 1 -- start start 2024-07-26T13:11:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.177+0000 7f55f4c00640 1 -- 172.21.15.40:0/3387850956 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f55e8004e00 con 0x7f55f81033e0 2024-07-26T13:11:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f5605046740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5cef09520 0x55b5cf2ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f5605046740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f5605046740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee8840 0x55b5cf2aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f5605046740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b5cf224f30 con 0x55b5ceee0660 2024-07-26T13:11:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f5605046740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b5cf214430 con 0x55b5ceee8840 2024-07-26T13:11:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f5605046740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b5cf218470 con 0x55b5cef09520 2024-07-26T13:11:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f55f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f55f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35488/0 (socket says 172.21.15.40:35488) 2024-07-26T13:11:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.178+0000 7f55f7400640 1 -- 172.21.15.40:0/519816214 learned_addr learned my addr 172.21.15.40:0/519816214 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55f7e00640 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5cef09520 0x55b5cf2ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55efe00640 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee8840 0x55b5cf2aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55f7400640 1 -- 172.21.15.40:0/519816214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5cef09520 msgr2=0x55b5cf2ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55f7400640 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5cef09520 0x55b5cf2ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55f7400640 1 -- 172.21.15.40:0/519816214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee8840 msgr2=0x55b5cf2aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55f7400640 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee8840 0x55b5cf2aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55f7400640 1 -- 172.21.15.40:0/519816214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5cef74b00 con 0x55b5ceee0660 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.179+0000 7f55efe00640 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee8840 0x55b5cf2aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55f7400640 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2ae6c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f55e80e9c20 tx=0x7f55e80eb670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8060873a824f0a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55f4c00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55dc0b3c50 0x7f55dc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55f4c00640 1 -- 172.21.15.40:0/3387850956 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f55e80e36b0 con 0x7f55f81033e0 2024-07-26T13:11:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55dc0b3c50 0x7f55dc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55ecc00640 1 -- 172.21.15.40:0/519816214 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e80f2070 con 0x55b5ceee0660 2024-07-26T13:11:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55ecc00640 1 -- 172.21.15.40:0/519816214 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e80aa0d0 con 0x55b5ceee0660 2024-07-26T13:11:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.180+0000 7f55ecc00640 1 -- 172.21.15.40:0/519816214 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e80a6480 con 0x55b5ceee0660 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 -- 172.21.15.40:0/519816214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 msgr2=0x55b5cf2ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2ae6c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f55e80e9c20 tx=0x7f55e80eb670 comp rx=0 tx=0).stop 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55dc0b3c50 0x7f55dc0b6160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006010 tx=0x7f55f0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 -- 172.21.15.40:0/519816214 shutdown_connections 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee8840 0x55b5cf2aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2ae6c0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 --2- 172.21.15.40:0/519816214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5cef09520 0x55b5cf2ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.181+0000 7f5605046740 1 -- 172.21.15.40:0/519816214 >> 172.21.15.40:0/519816214 conn(0x55b5ceefd910 msgr2=0x55b5cf2ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.182+0000 7f5605046740 1 -- 172.21.15.40:0/519816214 shutdown_connections 2024-07-26T13:11:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.182+0000 7f5605046740 1 -- 172.21.15.40:0/519816214 wait complete. 2024-07-26T13:11:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.182+0000 7f5605046740 1 -- start start 2024-07-26T13:11:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 Processor -- start 2024-07-26T13:11:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee0660 0x55b5cf2b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 0x55b5cf2b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b5cf077bb0 con 0x55b5ceee8840 2024-07-26T13:11:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b5cf1b0910 con 0x55b5cef09520 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b5cf2bc960 con 0x55b5ceee0660 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.183+0000 7f5605046740 10 client.0 _ll_register_callbacks cb 0x55b5cef20d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 0x55b5cf2b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 0x55b5cf2b9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35504/0 (socket says 172.21.15.40:35504) 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 -- 172.21.15.40:0/704461422 learned_addr learned my addr 172.21.15.40:0/704461422 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55f7e00640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55f7400640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee0660 0x55b5cf2b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 -- 172.21.15.40:0/704461422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee0660 msgr2=0x55b5cf2b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee0660 0x55b5cf2b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 -- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 msgr2=0x55b5cf2c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.184+0000 7f55efe00640 1 -- 172.21.15.40:0/704461422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5cefeb960 con 0x55b5ceee8840 2024-07-26T13:11:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f55efe00640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 0x55b5cf2b9e30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f55e000be50 tx=0x7f55e00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d6ac35a82dd527 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f55e5600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:11:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f55e5600640 1 -- 172.21.15.40:0/704461422 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0012650 con 0x55b5ceee8840 2024-07-26T13:11:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f55e5600640 1 -- 172.21.15.40:0/704461422 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f55e00127f0 con 0x55b5ceee8840 2024-07-26T13:11:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e80aa0d0 con 0x55b5ceee8840 2024-07-26T13:11:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f55e5600640 1 -- 172.21.15.40:0/704461422 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f55e00129f0 con 0x55b5ceee8840 2024-07-26T13:11:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f5605046740 10 client.17421 fetch_fsmap learned FSMap version 35 2024-07-26T13:11:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.185+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b5cf2c87b0 con 0x55b5ceee8840 2024-07-26T13:11:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f55e5600640 1 -- 172.21.15.40:0/704461422 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e80aa0d0 con 0x55b5ceee8840 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f55e5600640 1 -- 172.21.15.40:0/704461422 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f55e001bbc0 con 0x55b5ceee8840 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f5605046740 10 client.17421 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f5605046740 10 client.17421 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f5605046740 20 client.17421 populate_metadata read hostname 'smithi040' 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f5605046740 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5ceec7ea0 0x55b5cf2cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f5605046740 4 client.17421 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.186+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5cf226e80 con 0x55b5ceec7ea0 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.187+0000 7f55f7400640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5ceec7ea0 0x55b5cf2cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.188+0000 7f55f7400640 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5ceec7ea0 0x55b5cf2cbcf0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e810accd9d5af8 server_cookie=5ab8a35634f5de29 in_seq=0 out_seq=0 2024-07-26T13:11:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.188+0000 7f55e5600640 10 client.17421 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f55e5600640 1 -- 172.21.15.40:0/704461422 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5cf226e80 con 0x55b5ceec7ea0 2024-07-26T13:11:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f55e5600640 10 client.17421 handle_command_reply: tid=0 2024-07-26T13:11:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 client.17421 shutdown 2024-07-26T13:11:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 msgr2=0x55b5cf2b9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 0x55b5cf2b9e30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f55e000be50 tx=0x7f55e00117b0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 shutdown_connections 2024-07-26T13:11:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5ceec7ea0 0x55b5cf2cbcf0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee8840 0x55b5cf2b9e30 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 --2- 172.21.15.40:0/704461422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee0660 0x55b5cf2b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 >> 172.21.15.40:0/704461422 conn(0x55b5ceefd910 msgr2=0x55b5cf2b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f55e5600640 0 client.17421 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 shutdown_connections 2024-07-26T13:11:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.190+0000 7f5605046740 1 -- 172.21.15.40:0/704461422 wait complete. 2024-07-26T13:11:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.191+0000 7f5605046740 20 client.17421 trim_cache size 0 max 16384 2024-07-26T13:11:09.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 Processor -- start 2024-07-26T13:11:09.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 -- start start 2024-07-26T13:11:09.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b0dd0 con 0x55b5ceee0660 2024-07-26T13:11:09.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b2910 con 0x55b5cef09520 2024-07-26T13:11:09.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.210+0000 7f5605046740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b14a0 con 0x55b5ceee8840 2024-07-26T13:11:09.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.211+0000 7f55f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.211+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.211+0000 7f55f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2bb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35506/0 (socket says 172.21.15.40:35506) 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.211+0000 7f55f7400640 1 -- 172.21.15.40:0/4174350375 learned_addr learned my addr 172.21.15.40:0/4174350375 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.211+0000 7f55efe00640 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55f7400640 1 -- 172.21.15.40:0/4174350375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 msgr2=0x55b5cf2af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55f7400640 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55f7400640 1 -- 172.21.15.40:0/4174350375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 msgr2=0x55b5cf2c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55f7400640 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55f7400640 1 -- 172.21.15.40:0/4174350375 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5cf2b0470 con 0x55b5ceee0660 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55f7400640 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2bb7d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f55e80a6640 tx=0x7f55e80b30c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf936efbd272022 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55e7e00640 1 -- 172.21.15.40:0/4174350375 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8020040 con 0x55b5ceee0660 2024-07-26T13:11:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55e7e00640 1 -- 172.21.15.40:0/4174350375 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e80aa0d0 con 0x55b5ceee0660 2024-07-26T13:11:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.212+0000 7f55e7e00640 1 -- 172.21.15.40:0/4174350375 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e80a9d30 con 0x55b5ceee0660 2024-07-26T13:11:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 -- 172.21.15.40:0/4174350375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 msgr2=0x55b5cf2bb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2bb7d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f55e80a6640 tx=0x7f55e80b30c0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 -- 172.21.15.40:0/4174350375 shutdown_connections 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5cef09520 0x55b5cf2c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 --2- 172.21.15.40:0/4174350375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5ceee0660 0x55b5cf2bb7d0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.213+0000 7f5605046740 1 -- 172.21.15.40:0/4174350375 >> 172.21.15.40:0/4174350375 conn(0x55b5ceefd910 msgr2=0x55b5cf2af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.214+0000 7f5605046740 1 -- 172.21.15.40:0/4174350375 shutdown_connections 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.214+0000 7f5605046740 1 -- 172.21.15.40:0/4174350375 wait complete. 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.214+0000 7f5605046740 1 -- start start 2024-07-26T13:11:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.214+0000 7f5605046740 1 Processor -- start 2024-07-26T13:11:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee0660 0x55b5cf2bda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 0x55b5cf2be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b2240 con 0x55b5cef09520 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b1b70 con 0x55b5ceee0660 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81aed90 con 0x55b5ceee8840 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f5605046740 10 client.0 _ll_register_callbacks cb 0x7f55e0005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 0x55b5cf2be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 0x55b5cf2be4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35508/0 (socket says 172.21.15.40:35508) 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.215+0000 7f55f7e00640 1 -- 172.21.15.40:0/3844031831 learned_addr learned my addr 172.21.15.40:0/3844031831 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7400640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee0660 0x55b5cf2bda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55efe00640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7e00640 1 -- 172.21.15.40:0/3844031831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 msgr2=0x55b5cf2bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7e00640 1 -- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee0660 msgr2=0x55b5cf2bda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee0660 0x55b5cf2bda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7e00640 1 -- 172.21.15.40:0/3844031831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5cf333460 con 0x55b5cef09520 2024-07-26T13:11:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7400640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee0660 0x55b5cf2bda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55f7e00640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 0x55b5cf2be4a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f55f0035000 tx=0x7f55f002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd82f3e40ad1105 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.216+0000 7f55e5600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f55e5600640 1 -- 172.21.15.40:0/3844031831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0031770 con 0x55b5cef09520 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e80aa0d0 con 0x55b5cef09520 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f55e5600640 1 -- 172.21.15.40:0/3844031831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f55f0041030 con 0x55b5cef09520 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f55e5600640 1 -- 172.21.15.40:0/3844031831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f55f0003b80 con 0x55b5cef09520 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f5605046740 10 client.17427 fetch_fsmap learned FSMap version 35 2024-07-26T13:11:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b5cf334690 con 0x55b5cef09520 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.217+0000 7f55e5600640 1 -- 172.21.15.40:0/3844031831 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55e80aa0d0 con 0x55b5cef09520 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f55e5600640 1 -- 172.21.15.40:0/3844031831 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f55f00534b0 con 0x55b5cef09520 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f5605046740 10 client.17427 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f5605046740 10 client.17427 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f5605046740 20 client.17427 populate_metadata read hostname 'smithi040' 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f5605046740 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5cee9d250 0x55b5cf336eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f5605046740 4 client.17427 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "11aa112", "release": true, "await": true}] 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "11aa112", "release": true, "await": true}) -- 0x55b5cf222920 con 0x55b5cee9d250 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.218+0000 7f55f7400640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5cee9d250 0x55b5cf336eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.219+0000 7f55f7400640 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5cee9d250 0x55b5cf336eb0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4eaabc641d26e9 server_cookie=ad1214fdc7fa887e in_seq=0 out_seq=0 2024-07-26T13:11:09.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.219+0000 7f55e5600640 10 client.17427 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:09.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.270+0000 7f55e5600640 1 -- 172.21.15.40:0/3844031831 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55b5cf222920 con 0x55b5cee9d250 2024-07-26T13:11:09.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.270+0000 7f55e5600640 10 client.17427 handle_command_reply: tid=0 2024-07-26T13:11:09.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.270+0000 7f5605046740 1 client.17427 shutdown 2024-07-26T13:11:09.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 msgr2=0x55b5cf2be4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 0x55b5cf2be4a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f55f0035000 tx=0x7f55f002a8c0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 shutdown_connections 2024-07-26T13:11:09.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b5cee9d250 0x55b5cf336eb0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b5cef09520 0x55b5cf2be4a0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b5ceee8840 0x55b5cf2bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 --2- 172.21.15.40:0/3844031831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b5ceee0660 0x55b5cf2bda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f55e5600640 0 client.17427 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.271+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 >> 172.21.15.40:0/3844031831 conn(0x55b5ceefd910 msgr2=0x55b5cf2af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.272+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 shutdown_connections 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.272+0000 7f5605046740 1 -- 172.21.15.40:0/3844031831 wait complete. 2024-07-26T13:11:09.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.272+0000 7f5605046740 20 client.17427 trim_cache size 0 max 16384 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 164, 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "11aa112": { 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 164, 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:09.275 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:09.276 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.273+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55dc0b3c50 msgr2=0x7f55dc0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.273+0000 7f55fce00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55dc0b3c50 0x7f55dc0b6160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006010 tx=0x7f55f0004a40 comp rx=0 tx=0).stop 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.273+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 msgr2=0x7f55f819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.273+0000 7f55fce00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 0x7f55f819be10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f55e800d770 tx=0x7f55e800dc30 comp rx=0 tx=0).stop 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 shutdown_connections 2024-07-26T13:11:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f55dc0b3c50 0x7f55dc0b6160 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55f8109670 0x7f55f81a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f55f8108d20 0x7f55f819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 --2- 172.21.15.40:0/3387850956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f81033e0 0x7f55f819be10 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 >> 172.21.15.40:0/3387850956 conn(0x7f55f80fee30 msgr2=0x7f55f81062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 shutdown_connections 2024-07-26T13:11:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:09.274+0000 7f55fce00640 1 -- 172.21.15.40:0/3387850956 wait complete. 2024-07-26T13:11:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:08 smithi146 ceph-mon[35807]: pgmap v1966: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:11:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:08 smithi076 ceph-mon[35401]: pgmap v1966: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:11:10.072 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '11aa112', total seconds elapsed: 17.5 2024-07-26T13:11:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:10 smithi040 ceph-mon[32397]: pgmap v1967: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-07-26T13:11:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:10 smithi146 ceph-mon[35807]: pgmap v1967: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-07-26T13:11:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:10 smithi076 ceph-mon[35401]: pgmap v1967: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-07-26T13:11:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:12 smithi040 ceph-mon[32397]: pgmap v1968: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-07-26T13:11:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:12 smithi146 ceph-mon[35807]: pgmap v1968: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-07-26T13:11:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:12 smithi076 ceph-mon[35401]: pgmap v1968: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-07-26T13:11:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:14 smithi040 ceph-mon[32397]: pgmap v1969: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:11:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:14 smithi146 ceph-mon[35807]: pgmap v1969: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:11:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:14 smithi076 ceph-mon[35401]: pgmap v1969: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:11:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:16 smithi040 ceph-mon[32397]: pgmap v1970: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T13:11:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:16 smithi146 ceph-mon[35807]: pgmap v1970: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T13:11:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:16 smithi076 ceph-mon[35401]: pgmap v1970: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T13:11:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:18 smithi040 ceph-mon[32397]: pgmap v1971: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:11:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:18 smithi146 ceph-mon[35807]: pgmap v1971: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:11:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:18 smithi076 ceph-mon[35401]: pgmap v1971: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:11:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:20 smithi040 ceph-mon[32397]: pgmap v1972: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:11:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:20 smithi146 ceph-mon[35807]: pgmap v1972: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:11:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:20 smithi076 ceph-mon[35401]: pgmap v1972: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:11:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:22 smithi040 ceph-mon[32397]: pgmap v1973: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2024-07-26T13:11:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:22 smithi146 ceph-mon[35807]: pgmap v1973: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2024-07-26T13:11:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:22 smithi076 ceph-mon[35401]: pgmap v1973: 97 pgs: 97 active+clean; 9.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2024-07-26T13:11:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:24 smithi040 ceph-mon[32397]: pgmap v1974: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:11:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:24 smithi146 ceph-mon[35807]: pgmap v1974: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:11:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:24 smithi076 ceph-mon[35401]: pgmap v1974: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:11:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:26 smithi040 ceph-mon[32397]: pgmap v1975: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T13:11:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:26 smithi146 ceph-mon[35807]: pgmap v1975: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T13:11:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:26 smithi076 ceph-mon[35401]: pgmap v1975: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T13:11:28.645 INFO:tasks.quiescer.fs.[cephfs]:Total duration (46.2) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:11:28.645 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.1 2024-07-26T13:11:28.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:11:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:28 smithi040 ceph-mon[32397]: pgmap v1976: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:11:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:11:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:28 smithi146 ceph-mon[35807]: pgmap v1976: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:11:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:28 smithi076 ceph-mon[35401]: pgmap v1976: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:11:31.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:30 smithi040 ceph-mon[32397]: pgmap v1977: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:11:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:30 smithi146 ceph-mon[35807]: pgmap v1977: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:11:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:30 smithi076 ceph-mon[35401]: pgmap v1977: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:11:31.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.579+0000 7fc78fc00640 1 -- 172.21.15.40:0/2902270404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788102490 msgr2=0x7fc7881028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.579+0000 7fc78fc00640 1 --2- 172.21.15.40:0/2902270404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788102490 0x7fc7881028a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009900 tx=0x7fc77c02a410 comp rx=0 tx=0).stop 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.579+0000 7fc78fc00640 1 -- 172.21.15.40:0/2902270404 shutdown_connections 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.579+0000 7fc78fc00640 1 --2- 172.21.15.40:0/2902270404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc788108720 0x7fc78810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.580+0000 7fc78fc00640 1 --2- 172.21.15.40:0/2902270404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc788107dd0 0x7fc7881081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.580+0000 7fc78fc00640 1 --2- 172.21.15.40:0/2902270404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788102490 0x7fc7881028a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.580+0000 7fc78fc00640 1 -- 172.21.15.40:0/2902270404 >> 172.21.15.40:0/2902270404 conn(0x7fc788079160 msgr2=0x7fc788079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.580+0000 7fc78fc00640 1 -- 172.21.15.40:0/2902270404 shutdown_connections 2024-07-26T13:11:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.580+0000 7fc78fc00640 1 -- 172.21.15.40:0/2902270404 wait complete. 2024-07-26T13:11:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.581+0000 7fc78fc00640 1 Processor -- start 2024-07-26T13:11:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.581+0000 7fc78fc00640 1 -- start start 2024-07-26T13:11:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.582+0000 7fc78fc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc788102490 0x7fc78810f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.582+0000 7fc78fc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc788107dd0 0x7fc78810ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.582+0000 7fc78fc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 0x7fc788110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.582+0000 7fc78fc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc788113360 con 0x7fc788108720 2024-07-26T13:11:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.582+0000 7fc78fc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881131e0 con 0x7fc788102490 2024-07-26T13:11:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.582+0000 7fc78fc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881134e0 con 0x7fc788107dd0 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 0x7fc788110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78d200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc788102490 0x7fc78810f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 0x7fc788110460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59050/0 (socket says 172.21.15.40:59050) 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 -- 172.21.15.40:0/1998200627 learned_addr learned my addr 172.21.15.40:0/1998200627 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc787e00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc788107dd0 0x7fc78810ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 -- 172.21.15.40:0/1998200627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc788107dd0 msgr2=0x7fc78810ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc788107dd0 0x7fc78810ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 -- 172.21.15.40:0/1998200627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc788102490 msgr2=0x7fc78810f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc788102490 0x7fc78810f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.583+0000 7fc78dc00640 1 -- 172.21.15.40:0/1998200627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7881a8050 con 0x7fc788108720 2024-07-26T13:11:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.585+0000 7fc78dc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 0x7fc788110460 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc78000eaa0 tx=0x7fc78000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.585+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78000cdb0 con 0x7fc788108720 2024-07-26T13:11:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.585+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc780005020 con 0x7fc788108720 2024-07-26T13:11:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.585+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7881a8340 con 0x7fc788108720 2024-07-26T13:11:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.585+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7800116d0 con 0x7fc788108720 2024-07-26T13:11:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.585+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7881a8880 con 0x7fc788108720 2024-07-26T13:11:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.586+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7881028a0 con 0x7fc788108720 2024-07-26T13:11:31.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.589+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc7800051d0 con 0x7fc788108720 2024-07-26T13:11:31.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.592+0000 7fc785600640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc7700b3bd0 0x7fc7700b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:31.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.592+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc7800e3d40 con 0x7fc788108720 2024-07-26T13:11:31.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.592+0000 7fc78d200640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc7700b3bd0 0x7fc7700b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:31.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.593+0000 7fc78d200640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc7700b3bd0 0x7fc7700b60e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc788111430 tx=0x7fc77c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:31.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.597+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc780016030 con 0x7fc788108720 2024-07-26T13:11:31.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.892+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc78802e0c0 con 0x7fc788108720 2024-07-26T13:11:31.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.894+0000 7fc785600640 1 -- 172.21.15.40:0/1998200627 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fc7800aad00 con 0x7fc788108720 2024-07-26T13:11:31.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:11:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:11:31.896 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:11:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.896+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc7700b3bd0 msgr2=0x7fc7700b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc7700b3bd0 0x7fc7700b60e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc788111430 tx=0x7fc77c0058d0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 msgr2=0x7fc788110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 0x7fc788110460 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc78000eaa0 tx=0x7fc78000ef60 comp rx=0 tx=0).stop 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 shutdown_connections 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc788108720 0x7fc788110460 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc7700b3bd0 0x7fc7700b60e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc788107dd0 0x7fc78810ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 --2- 172.21.15.40:0/1998200627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc788102490 0x7fc78810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 >> 172.21.15.40:0/1998200627 conn(0x7fc788079160 msgr2=0x7fc788100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 shutdown_connections 2024-07-26T13:11:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:31.897+0000 7fc78fc00640 1 -- 172.21.15.40:0/1998200627 wait complete. 2024-07-26T13:11:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:31 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1998200627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:31 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1998200627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:31 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1998200627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:32.808 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 143.1 --await-for 45.0' 2024-07-26T13:11:32.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 143.1 --await-for 45.0 2024-07-26T13:11:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:32 smithi040 ceph-mon[32397]: pgmap v1978: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:11:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:32 smithi146 ceph-mon[35807]: pgmap v1978: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:11:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:32 smithi076 ceph-mon[35401]: pgmap v1978: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:11:33.375 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:11:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:34 smithi040 ceph-mon[32397]: pgmap v1979: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:11:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:34 smithi146 ceph-mon[35807]: pgmap v1979: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:11:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:34 smithi076 ceph-mon[35401]: pgmap v1979: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:11:36.174 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:11:36.174 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.174 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.174 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.174 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:11:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:11:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 -- 172.21.15.40:0/867076962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410ba80 msgr2=0x7f35541122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 --2- 172.21.15.40:0/867076962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410ba80 0x7f35541122b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f354c009ca0 tx=0x7f354c02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 -- 172.21.15.40:0/867076962 shutdown_connections 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 --2- 172.21.15.40:0/867076962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410ba80 0x7f35541122b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 --2- 172.21.15.40:0/867076962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355410b130 0x7f355410b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 --2- 172.21.15.40:0/867076962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35541057f0 0x7f3554105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 -- 172.21.15.40:0/867076962 >> 172.21.15.40:0/867076962 conn(0x7f3554101200 msgr2=0x7f3554103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 -- 172.21.15.40:0/867076962 shutdown_connections 2024-07-26T13:11:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.438+0000 7f3559e00640 1 -- 172.21.15.40:0/867076962 wait complete. 2024-07-26T13:11:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 Processor -- start 2024-07-26T13:11:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 -- start start 2024-07-26T13:11:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 0x7f355419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410b130 0x7f355419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355410ba80 0x7f35541a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3554115650 con 0x7f35541057f0 2024-07-26T13:11:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f35541154d0 con 0x7f355410ba80 2024-07-26T13:11:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.440+0000 7f3559e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35541157d0 con 0x7f355410b130 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 0x7f355419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 0x7f355419bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33882/0 (socket says 172.21.15.40:33882) 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 -- 172.21.15.40:0/3160823217 learned_addr learned my addr 172.21.15.40:0/3160823217 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552000640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410b130 0x7f355419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3553400640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355410ba80 0x7f35541a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 -- 172.21.15.40:0/3160823217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410b130 msgr2=0x7f355419c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410b130 0x7f355419c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 -- 172.21.15.40:0/3160823217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355410ba80 msgr2=0x7f35541a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355410ba80 0x7f35541a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.441+0000 7f3552a00640 1 -- 172.21.15.40:0/3160823217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35541a1f50 con 0x7f35541057f0 2024-07-26T13:11:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.442+0000 7f3552a00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 0x7f355419bfe0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f354400e9f0 tx=0x7f354400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.442+0000 7f3558a00640 1 -- 172.21.15.40:0/3160823217 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354400cd80 con 0x7f35541057f0 2024-07-26T13:11:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.442+0000 7f3558a00640 1 -- 172.21.15.40:0/3160823217 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440054b0 con 0x7f35541057f0 2024-07-26T13:11:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.442+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35541a2240 con 0x7f35541057f0 2024-07-26T13:11:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.442+0000 7f3558a00640 1 -- 172.21.15.40:0/3160823217 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544010430 con 0x7f35541057f0 2024-07-26T13:11:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.442+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35541a89a0 con 0x7f35541057f0 2024-07-26T13:11:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 Processor -- start 2024-07-26T13:11:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 -- start start 2024-07-26T13:11:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3558a00640 1 -- 172.21.15.40:0/3160823217 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f35440105f0 con 0x7f35541057f0 2024-07-26T13:11:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508e9d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508e9d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ad6b60 0x556508e9dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556508e67cf0 con 0x556508ace980 2024-07-26T13:11:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556508e12b40 con 0x556508ad6b60 2024-07-26T13:11:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.447+0000 7f3560be9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556508e02040 con 0x556508af7840 2024-07-26T13:11:36.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.448+0000 7f3552a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508e9d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.448+0000 7f3553400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508e9d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.448+0000 7f3552a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508e9d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33888/0 (socket says 172.21.15.40:33888) 2024-07-26T13:11:36.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.448+0000 7f3552a00640 1 -- 172.21.15.40:0/1619722242 learned_addr learned my addr 172.21.15.40:0/1619722242 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.448+0000 7f3552000640 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ad6b60 0x556508e9dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3552a00640 1 -- 172.21.15.40:0/1619722242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 msgr2=0x556508e9d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3552a00640 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508e9d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3552a00640 1 -- 172.21.15.40:0/1619722242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ad6b60 msgr2=0x556508e9dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3552a00640 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ad6b60 0x556508e9dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3552a00640 1 -- 172.21.15.40:0/1619722242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556508d89af0 con 0x556508ace980 2024-07-26T13:11:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3553400640 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508e9d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3558a00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35380b3c50 0x7f35380b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.449+0000 7f3552a00640 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508e9d6e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f35440e7e50 tx=0x7f35440e7f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef93e65e6fa6bab3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.450+0000 7f3553400640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35380b3c50 0x7f35380b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.450+0000 7f3558a00640 1 -- 172.21.15.40:0/3160823217 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f35440e3f40 con 0x7f35541057f0 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.450+0000 7f353fe00640 1 -- 172.21.15.40:0/1619722242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440a6d10 con 0x556508ace980 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.450+0000 7f353fe00640 1 -- 172.21.15.40:0/1619722242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440aa960 con 0x556508ace980 2024-07-26T13:11:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.450+0000 7f353fe00640 1 -- 172.21.15.40:0/1619722242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440aa5c0 con 0x556508ace980 2024-07-26T13:11:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.451+0000 7f3560be9740 1 -- 172.21.15.40:0/1619722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 msgr2=0x556508e9d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.451+0000 7f3553400640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35380b3c50 0x7f35380b6160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f354c006010 tx=0x7f354c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.451+0000 7f3560be9740 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508e9d6e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f35440e7e50 tx=0x7f35440e7f40 comp rx=0 tx=0).stop 2024-07-26T13:11:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 -- 172.21.15.40:0/1619722242 shutdown_connections 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ad6b60 0x556508e9dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508e9d6e0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 --2- 172.21.15.40:0/1619722242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508e9d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 -- 172.21.15.40:0/1619722242 >> 172.21.15.40:0/1619722242 conn(0x556508aeb990 msgr2=0x556508e9b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 -- 172.21.15.40:0/1619722242 shutdown_connections 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.452+0000 7f3560be9740 1 -- 172.21.15.40:0/1619722242 wait complete. 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.453+0000 7f3560be9740 1 -- start start 2024-07-26T13:11:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.453+0000 7f3560be9740 1 Processor -- start 2024-07-26T13:11:36.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508ea8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ea91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508af7840 0x556508eb4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556508d9e500 con 0x556508ace980 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556508e06080 con 0x556508af7840 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556508c657a0 con 0x556508ad6b60 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3560be9740 10 client.0 _ll_register_callbacks cb 0x556508dfabd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3552a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508ea8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3552a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508ea8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33904/0 (socket says 172.21.15.40:33904) 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3552a00640 1 -- 172.21.15.40:0/2622535038 learned_addr learned my addr 172.21.15.40:0/2622535038 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3552000640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ea91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.454+0000 7f3553400640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508af7840 0x556508eb4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f3552a00640 1 -- 172.21.15.40:0/2622535038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 msgr2=0x556508ea91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f3552a00640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ea91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f3552a00640 1 -- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508af7840 msgr2=0x556508eb4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f3552a00640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508af7840 0x556508eb4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f3552a00640 1 -- 172.21.15.40:0/2622535038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556508b71b90 con 0x556508ace980 2024-07-26T13:11:36.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f3552a00640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508ea8c90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f35440a6ed0 tx=0x7f3544004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288a54f2017510d6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:36.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.455+0000 7f353cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:11:36.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f353cc00640 1 -- 172.21.15.40:0/2622535038 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440aa7a0 con 0x556508ace980 2024-07-26T13:11:36.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f353cc00640 1 -- 172.21.15.40:0/2622535038 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f35440a7440 con 0x556508ace980 2024-07-26T13:11:36.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35440aa960 con 0x556508ace980 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f353cc00640 1 -- 172.21.15.40:0/2622535038 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f35440aac20 con 0x556508ace980 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f3560be9740 10 client.17445 fetch_fsmap learned FSMap version 35 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556508eb7750 con 0x556508ace980 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.456+0000 7f353cc00640 1 -- 172.21.15.40:0/2622535038 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440aa960 con 0x556508ace980 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f353cc00640 1 -- 172.21.15.40:0/2622535038 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f35440ab0b0 con 0x556508ace980 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3560be9740 10 client.17445 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3560be9740 10 client.17445 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3560be9740 20 client.17445 populate_metadata read hostname 'smithi040' 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3560be9740 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508ab61c0 0x556508ebaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3560be9740 4 client.17445 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:11:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556508e14a90 con 0x556508ab61c0 2024-07-26T13:11:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.457+0000 7f3552000640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508ab61c0 0x556508ebaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.458+0000 7f353cc00640 10 client.17445 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.458+0000 7f3552000640 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508ab61c0 0x556508ebaab0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee166fcfcdb7887b server_cookie=3149399637a31d36 in_seq=0 out_seq=0 2024-07-26T13:11:36.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.460+0000 7f353cc00640 1 -- 172.21.15.40:0/2622535038 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556508e14a90 con 0x556508ab61c0 2024-07-26T13:11:36.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.460+0000 7f353cc00640 10 client.17445 handle_command_reply: tid=0 2024-07-26T13:11:36.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.460+0000 7f3560be9740 1 client.17445 shutdown 2024-07-26T13:11:36.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.460+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 msgr2=0x556508ea8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.460+0000 7f3560be9740 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508ea8c90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f35440a6ed0 tx=0x7f3544004a00 comp rx=0 tx=0).stop 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 shutdown_connections 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508af7840 0x556508eb4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ea91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508ab61c0 0x556508ebaab0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 --2- 172.21.15.40:0/2622535038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ace980 0x556508ea8c90 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 >> 172.21.15.40:0/2622535038 conn(0x556508aeb990 msgr2=0x556508ea0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f353cc00640 0 client.17445 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 shutdown_connections 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 1 -- 172.21.15.40:0/2622535038 wait complete. 2024-07-26T13:11:36.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.461+0000 7f3560be9740 20 client.17445 trim_cache size 0 max 16384 2024-07-26T13:11:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.484+0000 7f3560be9740 1 Processor -- start 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.484+0000 7f3560be9740 1 -- start start 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3560be9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ea8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3560be9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 0x556508ebdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3560be9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508ebe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3560be9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b1010 con 0x556508ad6b60 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3560be9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b2b50 con 0x556508ace980 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3560be9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b16e0 con 0x556508af7840 2024-07-26T13:11:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3552000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 0x556508ebdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3552000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 0x556508ebdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33906/0 (socket says 172.21.15.40:33906) 2024-07-26T13:11:36.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3552000640 1 -- 172.21.15.40:0/1669194380 learned_addr learned my addr 172.21.15.40:0/1669194380 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:36.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.485+0000 7f3552a00640 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ea8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3553400640 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508ebe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3552000640 1 -- 172.21.15.40:0/1669194380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 msgr2=0x556508ebe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3552000640 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508ebe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3552000640 1 -- 172.21.15.40:0/1669194380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 msgr2=0x556508ea8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3552000640 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ea8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3552000640 1 -- 172.21.15.40:0/1669194380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556508ea9520 con 0x556508ad6b60 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.486+0000 7f3552000640 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 0x556508ebdae0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x556508e12c70 tx=0x7f3540014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e5d63ff91400e6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.487+0000 7f353f400640 1 -- 172.21.15.40:0/1669194380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540004030 con 0x556508ad6b60 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.487+0000 7f353f400640 1 -- 172.21.15.40:0/1669194380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556508e14a90 con 0x556508ad6b60 2024-07-26T13:11:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.487+0000 7f353f400640 1 -- 172.21.15.40:0/1669194380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540003850 con 0x556508ad6b60 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 -- 172.21.15.40:0/1669194380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 msgr2=0x556508ebdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 0x556508ebdae0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x556508e12c70 tx=0x7f3540014040 comp rx=0 tx=0).stop 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 -- 172.21.15.40:0/1669194380 shutdown_connections 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508af7840 0x556508ebe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508ad6b60 0x556508ebdae0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 --2- 172.21.15.40:0/1669194380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ea8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 -- 172.21.15.40:0/1669194380 >> 172.21.15.40:0/1669194380 conn(0x556508aeb990 msgr2=0x556508ea22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.488+0000 7f3560be9740 1 -- 172.21.15.40:0/1669194380 shutdown_connections 2024-07-26T13:11:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.489+0000 7f3560be9740 1 -- 172.21.15.40:0/1669194380 wait complete. 2024-07-26T13:11:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.489+0000 7f3560be9740 1 -- start start 2024-07-26T13:11:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.489+0000 7f3560be9740 1 Processor -- start 2024-07-26T13:11:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ebbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ebc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 0x556508f2a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b2480 con 0x556508af7840 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f35541b1db0 con 0x556508ace980 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35541aefd0 con 0x556508ad6b60 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3560be9740 10 client.0 _ll_register_callbacks cb 0x7f3540009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3553400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 0x556508f2a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.490+0000 7f3553400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 0x556508f2a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33910/0 (socket says 172.21.15.40:33910) 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3553400640 1 -- 172.21.15.40:0/4234749489 learned_addr learned my addr 172.21.15.40:0/4234749489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3552a00640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ebbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3552000640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ebc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3553400640 1 -- 172.21.15.40:0/4234749489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 msgr2=0x556508ebc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3553400640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ebc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3553400640 1 -- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 msgr2=0x556508ebbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3553400640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ebbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3553400640 1 -- 172.21.15.40:0/4234749489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556508ebc950 con 0x556508af7840 2024-07-26T13:11:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.491+0000 7f3552000640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ebc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.492+0000 7f3553400640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 0x556508f2a810 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f354c009ca0 tx=0x7f354c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0d0bdcfed7e248 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.492+0000 7f353cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.492+0000 7f353cc00640 1 -- 172.21.15.40:0/4234749489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c058060 con 0x556508af7840 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.492+0000 7f353cc00640 1 -- 172.21.15.40:0/4234749489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f354c042030 con 0x556508af7840 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.492+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556508e14a90 con 0x556508af7840 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f353cc00640 1 -- 172.21.15.40:0/4234749489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f354c030ba0 con 0x556508af7840 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 10 client.17451 fetch_fsmap learned FSMap version 35 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556508f2bce0 con 0x556508af7840 2024-07-26T13:11:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f353cc00640 1 -- 172.21.15.40:0/4234749489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556508e14a90 con 0x556508af7840 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f353cc00640 1 -- 172.21.15.40:0/4234749489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f354c05d070 con 0x556508af7840 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 10 client.17451 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 10 client.17451 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 20 client.17451 populate_metadata read hostname 'smithi040' 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508a8b570 0x556508f2e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 4 client.17451 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.1, "await_for": 45.0}] 2024-07-26T13:11:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.493+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.1, "await_for": 45.0}) -- 0x556508e10530 con 0x556508a8b570 2024-07-26T13:11:36.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.494+0000 7f3552a00640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508a8b570 0x556508f2e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:36.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.495+0000 7f3552a00640 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508a8b570 0x556508f2e570 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9400d4e33530579f server_cookie=69f1e96b6a61307e in_seq=0 out_seq=0 2024-07-26T13:11:36.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.495+0000 7f353cc00640 10 client.17451 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:36.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.686+0000 7f353cc00640 1 -- 172.21.15.40:0/4234749489 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x556508e10530 con 0x556508a8b570 2024-07-26T13:11:36.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.686+0000 7f353cc00640 10 client.17451 handle_command_reply: tid=0 2024-07-26T13:11:36.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.686+0000 7f3560be9740 1 client.17451 shutdown 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.686+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 msgr2=0x556508f2a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 0x556508f2a810 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f354c009ca0 tx=0x7f354c02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 shutdown_connections 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556508a8b570 0x556508f2e570 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556508af7840 0x556508f2a810 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556508ad6b60 0x556508ebc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 --2- 172.21.15.40:0/4234749489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556508ace980 0x556508ebbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 >> 172.21.15.40:0/4234749489 conn(0x556508aeb990 msgr2=0x556508ea2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f353cc00640 0 client.17451 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 shutdown_connections 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 1 -- 172.21.15.40:0/4234749489 wait complete. 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.687+0000 7f3560be9740 20 client.17451 trim_cache size 0 max 16384 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:11:36.690 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 166, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "2d24a8fc": { 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 166, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.1, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:11:36.691 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:36.692 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35380b3c50 msgr2=0x7f35380b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35380b3c50 0x7f35380b6160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f354c006010 tx=0x7f354c009360 comp rx=0 tx=0).stop 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 msgr2=0x7f355419bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 0x7f355419bfe0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f354400e9f0 tx=0x7f354400edf0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 shutdown_connections 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355410ba80 0x7f35541a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f35380b3c50 0x7f35380b6160 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355410b130 0x7f355419c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 --2- 172.21.15.40:0/3160823217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35541057f0 0x7f355419bfe0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 >> 172.21.15.40:0/3160823217 conn(0x7f3554101200 msgr2=0x7f3554104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 shutdown_connections 2024-07-26T13:11:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:36.689+0000 7f3559e00640 1 -- 172.21.15.40:0/3160823217 wait complete. 2024-07-26T13:11:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:36 smithi040 ceph-mon[32397]: pgmap v1980: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:11:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:11:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:11:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:36 smithi146 ceph-mon[35807]: pgmap v1980: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:11:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:11:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:11:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:36 smithi076 ceph-mon[35401]: pgmap v1980: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:11:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:11:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:11:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:11:37.560 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2d24a8fc', quiesce took 8.9 seconds. Will release after: 14.200000000000001 2024-07-26T13:11:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:38 smithi040 ceph-mon[32397]: pgmap v1981: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:11:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:38 smithi146 ceph-mon[35807]: pgmap v1981: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:11:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:38 smithi076 ceph-mon[35401]: pgmap v1981: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:11:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:40 smithi146 ceph-mon[35807]: pgmap v1982: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:11:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:40 smithi076 ceph-mon[35401]: pgmap v1982: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:11:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:40 smithi040 ceph-mon[32397]: pgmap v1982: 97 pgs: 97 active+clean; 9.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:11:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:42 smithi146 ceph-mon[35807]: pgmap v1983: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:11:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:42 smithi076 ceph-mon[35401]: pgmap v1983: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:11:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:42 smithi040 ceph-mon[32397]: pgmap v1983: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:11:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:45 smithi146 ceph-mon[35807]: pgmap v1984: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-07-26T13:11:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:45 smithi076 ceph-mon[35401]: pgmap v1984: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-07-26T13:11:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:44 smithi040 ceph-mon[32397]: pgmap v1984: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-07-26T13:11:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:47 smithi146 ceph-mon[35807]: pgmap v1985: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T13:11:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:47 smithi076 ceph-mon[35401]: pgmap v1985: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T13:11:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:47 smithi040 ceph-mon[32397]: pgmap v1985: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 MiB/s wr, 12 op/s 2024-07-26T13:11:49.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:49 smithi040 ceph-mon[32397]: pgmap v1986: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 10 op/s 2024-07-26T13:11:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:49 smithi146 ceph-mon[35807]: pgmap v1986: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 10 op/s 2024-07-26T13:11:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:49 smithi076 ceph-mon[35401]: pgmap v1986: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 10 op/s 2024-07-26T13:11:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:51 smithi146 ceph-mon[35807]: pgmap v1987: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:11:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:51 smithi076 ceph-mon[35401]: pgmap v1987: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:11:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:51 smithi040 ceph-mon[32397]: pgmap v1987: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:11:51.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:11:52.253 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:11:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:53 smithi040 ceph-mon[32397]: pgmap v1988: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 829 KiB/s wr, 9 op/s 2024-07-26T13:11:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:53 smithi146 ceph-mon[35807]: pgmap v1988: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 829 KiB/s wr, 9 op/s 2024-07-26T13:11:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:53 smithi076 ceph-mon[35401]: pgmap v1988: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 829 KiB/s wr, 9 op/s 2024-07-26T13:11:54.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 -- 172.21.15.40:0/863393606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c109650 msgr2=0x7f399c10fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:54.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 --2- 172.21.15.40:0/863393606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c109650 0x7f399c10fe80 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3994009ca0 tx=0x7f399402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 -- 172.21.15.40:0/863393606 shutdown_connections 2024-07-26T13:11:54.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 --2- 172.21.15.40:0/863393606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c109650 0x7f399c10fe80 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 --2- 172.21.15.40:0/863393606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c108d00 0x7f399c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 --2- 172.21.15.40:0/863393606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f399c1033c0 0x7f399c1037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 -- 172.21.15.40:0/863393606 >> 172.21.15.40:0/863393606 conn(0x7f399c0fee10 msgr2=0x7f399c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:54.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.712+0000 7f399be00640 1 -- 172.21.15.40:0/863393606 shutdown_connections 2024-07-26T13:11:54.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.713+0000 7f399be00640 1 -- 172.21.15.40:0/863393606 wait complete. 2024-07-26T13:11:54.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.714+0000 7f399be00640 1 Processor -- start 2024-07-26T13:11:54.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.714+0000 7f399be00640 1 -- start start 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f399c1033c0 0x7f399c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 0x7f399c075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c109650 0x7f399c075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f399c113220 con 0x7f399c108d00 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1130a0 con 0x7f399c1033c0 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1133a0 con 0x7f399c109650 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 0x7f399c075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 0x7f399c075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52426/0 (socket says 172.21.15.40:52426) 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399a000640 1 -- 172.21.15.40:0/1578794889 learned_addr learned my addr 172.21.15.40:0/1578794889 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:54.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.715+0000 7f399aa00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f399c1033c0 0x7f399c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399b400640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c109650 0x7f399c075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399a000640 1 -- 172.21.15.40:0/1578794889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c109650 msgr2=0x7f399c075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399a000640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c109650 0x7f399c075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399a000640 1 -- 172.21.15.40:0/1578794889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f399c1033c0 msgr2=0x7f399c075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399a000640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f399c1033c0 0x7f399c075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399a000640 1 -- 172.21.15.40:0/1578794889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c1a7e00 con 0x7f399c108d00 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399b400640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c109650 0x7f399c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f399a000640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 0x7f399c075680 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f398800d750 tx=0x7f398800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988017070 con 0x7f399c108d00 2024-07-26T13:11:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.716+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39880054b0 con 0x7f399c108d00 2024-07-26T13:11:54.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.717+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988004bc0 con 0x7f399c108d00 2024-07-26T13:11:54.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.717+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c1a80f0 con 0x7f399c108d00 2024-07-26T13:11:54.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.717+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c1a85e0 con 0x7f399c108d00 2024-07-26T13:11:54.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.718+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399c1037d0 con 0x7f399c108d00 2024-07-26T13:11:54.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.722+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3988009c30 con 0x7f399c108d00 2024-07-26T13:11:54.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.723+0000 7f3993400640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39800b3c50 0x7f39800b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.724+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f39880e3aa0 con 0x7f399c108d00 2024-07-26T13:11:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.724+0000 7f399aa00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39800b3c50 0x7f39800b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.724+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f39880ab130 con 0x7f399c108d00 2024-07-26T13:11:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.725+0000 7f399aa00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39800b3c50 0x7f39800b6160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f398c005e10 tx=0x7f398c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.970+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f399c076440 con 0x7f399c108d00 2024-07-26T13:11:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.972+0000 7f3993400640 1 -- 172.21.15.40:0/1578794889 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f39880aaa30 con 0x7f399c108d00 2024-07-26T13:11:54.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:11:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:11:54.974 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:11:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39800b3c50 msgr2=0x7f39800b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39800b3c50 0x7f39800b6160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f398c005e10 tx=0x7f398c005da0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 msgr2=0x7f399c075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 0x7f399c075680 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f398800d750 tx=0x7f398800dc10 comp rx=0 tx=0).stop 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 shutdown_connections 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f39800b3c50 0x7f39800b6160 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f399c109650 0x7f399c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f399c108d00 0x7f399c075680 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 --2- 172.21.15.40:0/1578794889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f399c1033c0 0x7f399c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 >> 172.21.15.40:0/1578794889 conn(0x7f399c0fee10 msgr2=0x7f399c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 shutdown_connections 2024-07-26T13:11:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:54.976+0000 7f399be00640 1 -- 172.21.15.40:0/1578794889 wait complete. 2024-07-26T13:11:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:55 smithi040 ceph-mon[32397]: pgmap v1989: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 488 KiB/s wr, 11 op/s 2024-07-26T13:11:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:55 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1578794889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:55 smithi146 ceph-mon[35807]: pgmap v1989: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 488 KiB/s wr, 11 op/s 2024-07-26T13:11:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:55 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1578794889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:55 smithi076 ceph-mon[35401]: pgmap v1989: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 488 KiB/s wr, 11 op/s 2024-07-26T13:11:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:55 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1578794889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:11:55.711 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 2d24a8fc --release --await' 2024-07-26T13:11:55.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 2d24a8fc --release --await 2024-07-26T13:11:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:11:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:57 smithi146 ceph-mon[35807]: pgmap v1990: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:11:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:57 smithi076 ceph-mon[35401]: pgmap v1990: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:11:57.447 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:57 smithi040 ceph-mon[32397]: pgmap v1990: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-07-26T13:11:58.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.447+0000 7fd1af200640 1 -- 172.21.15.40:0/1515405195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8077cc0 msgr2=0x7fd1a8113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.447+0000 7fd1af200640 1 --2- 172.21.15.40:0/1515405195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8077cc0 0x7fd1a8113a40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd198009900 tx=0x7fd19802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 -- 172.21.15.40:0/1515405195 shutdown_connections 2024-07-26T13:11:58.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 --2- 172.21.15.40:0/1515405195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8113f80 0x7fd1a81163a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 --2- 172.21.15.40:0/1515405195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8077cc0 0x7fd1a8113a40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 --2- 172.21.15.40:0/1515405195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd1a8077370 0x7fd1a8077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 -- 172.21.15.40:0/1515405195 >> 172.21.15.40:0/1515405195 conn(0x7fd1a8101010 msgr2=0x7fd1a8103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:58.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 -- 172.21.15.40:0/1515405195 shutdown_connections 2024-07-26T13:11:58.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.448+0000 7fd1af200640 1 -- 172.21.15.40:0/1515405195 wait complete. 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.449+0000 7fd1af200640 1 Processor -- start 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.449+0000 7fd1af200640 1 -- start start 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1af200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8077370 0x7fd1a81a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1af200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd1a8077cc0 0x7fd1a81a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1af200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 0x7fd1a81a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1af200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8119790 con 0x7fd1a8113f80 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1af200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8119610 con 0x7fd1a8077cc0 2024-07-26T13:11:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1af200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8119910 con 0x7fd1a8077370 2024-07-26T13:11:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 0x7fd1a81a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 0x7fd1a81a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52450/0 (socket says 172.21.15.40:52450) 2024-07-26T13:11:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1ae800640 1 -- 172.21.15.40:0/2771805960 learned_addr learned my addr 172.21.15.40:0/2771805960 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1ad400640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd1a8077cc0 0x7fd1a81a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.450+0000 7fd1ade00640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8077370 0x7fd1a81a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ae800640 1 -- 172.21.15.40:0/2771805960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8077370 msgr2=0x7fd1a81a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ae800640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8077370 0x7fd1a81a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ae800640 1 -- 172.21.15.40:0/2771805960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd1a8077cc0 msgr2=0x7fd1a81a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ae800640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd1a8077cc0 0x7fd1a81a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ae800640 1 -- 172.21.15.40:0/2771805960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a81a61b0 con 0x7fd1a8113f80 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ade00640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8077370 0x7fd1a81a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.451+0000 7fd1ae800640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 0x7fd1a81a5a80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400e970 tx=0x7fd1a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.452+0000 7fd1a2a00640 1 -- 172.21.15.40:0/2771805960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400ccc0 con 0x7fd1a8113f80 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.452+0000 7fd1a2a00640 1 -- 172.21.15.40:0/2771805960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1a400ce60 con 0x7fd1a8113f80 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.452+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a81a64a0 con 0x7fd1a8113f80 2024-07-26T13:11:58.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.452+0000 7fd1a2a00640 1 -- 172.21.15.40:0/2771805960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4010430 con 0x7fd1a8113f80 2024-07-26T13:11:58.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.452+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a81acc00 con 0x7fd1a8113f80 2024-07-26T13:11:58.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.456+0000 7fd1b7465740 1 Processor -- start 2024-07-26T13:11:58.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.456+0000 7fd1a2a00640 1 -- 172.21.15.40:0/2771805960 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd1a4004ef0 con 0x7fd1a8113f80 2024-07-26T13:11:58.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 -- start start 2024-07-26T13:11:58.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d3a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d3ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c774cb0f30 con 0x55c774995520 2024-07-26T13:11:58.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c774ca0430 con 0x55c77496c660 2024-07-26T13:11:58.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1b7465740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c774ca4470 con 0x55c774974840 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.457+0000 7fd1ad400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52466/0 (socket says 172.21.15.40:52466) 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 -- 172.21.15.40:0/742088189 learned_addr learned my addr 172.21.15.40:0/742088189 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ade00640 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d3a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d3ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 -- 172.21.15.40:0/742088189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 msgr2=0x55c774d3ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d3ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 -- 172.21.15.40:0/742088189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 msgr2=0x55c774d3a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d3a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.458+0000 7fd1ad400640 1 -- 172.21.15.40:0/742088189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c774a00b00 con 0x55c774995520 2024-07-26T13:11:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd1a2a00640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd1900b3c50 0x7fd1900b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd1ad400640 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3a180 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c00 tx=0x7fd198005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447daaa91aa91cb4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd1a2a00640 1 -- 172.21.15.40:0/2771805960 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd1a40e3ff0 con 0x7fd1a8113f80 2024-07-26T13:11:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd1ade00640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd1900b3c50 0x7fd1900b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd197000640 1 -- 172.21.15.40:0/742088189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198044020 con 0x55c774995520 2024-07-26T13:11:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd197000640 1 -- 172.21.15.40:0/742088189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1980044c0 con 0x55c774995520 2024-07-26T13:11:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.459+0000 7fd197000640 1 -- 172.21.15.40:0/742088189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198035040 con 0x55c774995520 2024-07-26T13:11:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.460+0000 7fd1b7465740 1 -- 172.21.15.40:0/742088189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 msgr2=0x55c774d3a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.460+0000 7fd1b7465740 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3a180 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c00 tx=0x7fd198005fd0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.460+0000 7fd1ade00640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd1900b3c50 0x7fd1900b6160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55c774d38e00 tx=0x7fd19c009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 -- 172.21.15.40:0/742088189 shutdown_connections 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d3ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d3a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 --2- 172.21.15.40:0/742088189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3a180 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 -- 172.21.15.40:0/742088189 >> 172.21.15.40:0/742088189 conn(0x55c774989910 msgr2=0x55c774d38070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 -- 172.21.15.40:0/742088189 shutdown_connections 2024-07-26T13:11:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 -- 172.21.15.40:0/742088189 wait complete. 2024-07-26T13:11:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.461+0000 7fd1b7465740 1 -- start start 2024-07-26T13:11:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 Processor -- start 2024-07-26T13:11:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 0x55c774d45830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d45d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774995520 0x55c774d51c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c774b03bb0 con 0x55c77496c660 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c774c3c910 con 0x55c774974840 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c774d48900 con 0x55c774995520 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.462+0000 7fd1b7465740 10 client.0 _ll_register_callbacks cb 0x55c7749acd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 0x55c774d45830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 0x55c774d45830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52480/0 (socket says 172.21.15.40:52480) 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 -- 172.21.15.40:0/791234131 learned_addr learned my addr 172.21.15.40:0/791234131 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ad400640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d45d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ae800640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774995520 0x55c774d51c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 -- 172.21.15.40:0/791234131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774995520 msgr2=0x55c774d51c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774995520 0x55c774d51c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 -- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 msgr2=0x55c774d45d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d45d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.463+0000 7fd1ade00640 1 -- 172.21.15.40:0/791234131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c774a77960 con 0x55c77496c660 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd1ade00640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 0x55c774d45830 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd19c011d90 tx=0x7fd19c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408e184adf826dd9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd18b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd18b400640 1 -- 172.21.15.40:0/791234131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c020620 con 0x55c77496c660 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd18b400640 1 -- 172.21.15.40:0/791234131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd19c0207c0 con 0x55c77496c660 2024-07-26T13:11:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c774cb2e80 con 0x55c77496c660 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd18b400640 1 -- 172.21.15.40:0/791234131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd19c0209c0 con 0x55c77496c660 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd1b7465740 10 client.17469 fetch_fsmap learned FSMap version 35 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.464+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c774d54640 con 0x55c77496c660 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd18b400640 1 -- 172.21.15.40:0/791234131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c774cb2e80 con 0x55c77496c660 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd18b400640 1 -- 172.21.15.40:0/791234131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd19c00f040 con 0x55c77496c660 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd1b7465740 10 client.17469 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd1b7465740 10 client.17469 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd1b7465740 20 client.17469 populate_metadata read hostname 'smithi040' 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd1b7465740 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774953ea0 0x55c774d57c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd1b7465740 4 client.17469 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:11:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.465+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c774cae920 con 0x55c774953ea0 2024-07-26T13:11:58.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.466+0000 7fd1ad400640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774953ea0 0x55c774d57c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.467+0000 7fd1ad400640 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774953ea0 0x55c774d57c30 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48841be01074ffbb server_cookie=84943c392dace703 in_seq=0 out_seq=0 2024-07-26T13:11:58.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.467+0000 7fd18b400640 10 client.17469 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:58.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd18b400640 1 -- 172.21.15.40:0/791234131 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c774cae920 con 0x55c774953ea0 2024-07-26T13:11:58.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd18b400640 10 client.17469 handle_command_reply: tid=0 2024-07-26T13:11:58.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 client.17469 shutdown 2024-07-26T13:11:58.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 msgr2=0x55c774d45830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 0x55c774d45830 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd19c011d90 tx=0x7fd19c004a40 comp rx=0 tx=0).stop 2024-07-26T13:11:58.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 shutdown_connections 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774995520 0x55c774d51c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d45d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774953ea0 0x55c774d57c30 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 --2- 172.21.15.40:0/791234131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c77496c660 0x55c774d45830 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 >> 172.21.15.40:0/791234131 conn(0x55c774989910 msgr2=0x55c774d3d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.469+0000 7fd18b400640 0 client.17469 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.470+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 shutdown_connections 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.470+0000 7fd1b7465740 1 -- 172.21.15.40:0/791234131 wait complete. 2024-07-26T13:11:58.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.470+0000 7fd1b7465740 20 client.17469 trim_cache size 0 max 16384 2024-07-26T13:11:58.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.489+0000 7fd1b7465740 1 Processor -- start 2024-07-26T13:11:58.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.489+0000 7fd1b7465740 1 -- start start 2024-07-26T13:11:58.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d40fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1b7465740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81b5200 con 0x55c774995520 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1b7465740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81b6d40 con 0x55c77496c660 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1b7465740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81b58d0 con 0x55c774974840 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52490/0 (socket says 172.21.15.40:52490) 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1ae800640 1 -- 172.21.15.40:0/2045113526 learned_addr learned my addr 172.21.15.40:0/2045113526 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1ad400640 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.490+0000 7fd1ade00640 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d40fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd1ae800640 1 -- 172.21.15.40:0/2045113526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 msgr2=0x55c774d44a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd1ae800640 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d44a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd1ae800640 1 -- 172.21.15.40:0/2045113526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 msgr2=0x55c774d40fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd1ae800640 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d40fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd1ae800640 1 -- 172.21.15.40:0/2045113526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c774d3c470 con 0x55c774995520 2024-07-26T13:11:58.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd1ae800640 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3f400 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40aae90 tx=0x7fd1a40aaa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad40dbf045575da server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd196600640 1 -- 172.21.15.40:0/2045113526 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40c4020 con 0x55c774995520 2024-07-26T13:11:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd196600640 1 -- 172.21.15.40:0/2045113526 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1a40aaf00 con 0x55c774995520 2024-07-26T13:11:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.491+0000 7fd196600640 1 -- 172.21.15.40:0/2045113526 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ab3c0 con 0x55c774995520 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 -- 172.21.15.40:0/2045113526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 msgr2=0x55c774d3f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3f400 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40aae90 tx=0x7fd1a40aaa10 comp rx=0 tx=0).stop 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 -- 172.21.15.40:0/2045113526 shutdown_connections 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d3f400 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c774974840 0x55c774d44a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 --2- 172.21.15.40:0/2045113526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c77496c660 0x55c774d40fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.492+0000 7fd1b7465740 1 -- 172.21.15.40:0/2045113526 >> 172.21.15.40:0/2045113526 conn(0x55c774989910 msgr2=0x55c774d3db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.493+0000 7fd1b7465740 1 -- 172.21.15.40:0/2045113526 shutdown_connections 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.493+0000 7fd1b7465740 1 -- 172.21.15.40:0/2045113526 wait complete. 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.493+0000 7fd1b7465740 1 -- start start 2024-07-26T13:11:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.493+0000 7fd1b7465740 1 Processor -- start 2024-07-26T13:11:58.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77496c660 0x55c774d4db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d4e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d48b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81b6670 con 0x55c774995520 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81b5fa0 con 0x55c774974840 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81b31c0 con 0x55c77496c660 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1b7465740 10 client.0 _ll_register_callbacks cb 0x7fd19c009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d48b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d48b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52494/0 (socket says 172.21.15.40:52494) 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.494+0000 7fd1ae800640 1 -- 172.21.15.40:0/440273951 learned_addr learned my addr 172.21.15.40:0/440273951 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:11:58.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ade00640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77496c660 0x55c774d4db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ad400640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d4e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ae800640 1 -- 172.21.15.40:0/440273951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77496c660 msgr2=0x55c774d4db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ae800640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77496c660 0x55c774d4db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ae800640 1 -- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 msgr2=0x55c774d4e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ae800640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d4e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ae800640 1 -- 172.21.15.40:0/440273951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c774d4e710 con 0x55c774995520 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd1ae800640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d48b40 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400d010 tx=0x7fd1a40b3fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79121b4f433a6bc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:11:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.495+0000 7fd18b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:11:58.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd18b400640 1 -- 172.21.15.40:0/440273951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40c9020 con 0x55c774995520 2024-07-26T13:11:58.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd18b400640 1 -- 172.21.15.40:0/440273951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd1a40ab370 con 0x55c774995520 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1a40aaf00 con 0x55c774995520 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd18b400640 1 -- 172.21.15.40:0/440273951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd1a40c4070 con 0x55c774995520 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd1b7465740 10 client.17475 fetch_fsmap learned FSMap version 35 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c774dc08e0 con 0x55c774995520 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd18b400640 1 -- 172.21.15.40:0/440273951 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1a40aaf00 con 0x55c774995520 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd18b400640 1 -- 172.21.15.40:0/440273951 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd1a40a69e0 con 0x55c774995520 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.496+0000 7fd1b7465740 10 client.17475 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.497+0000 7fd1b7465740 10 client.17475 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.497+0000 7fd1b7465740 20 client.17475 populate_metadata read hostname 'smithi040' 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.497+0000 7fd1b7465740 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774929250 0x55c774dc3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.497+0000 7fd1b7465740 4 client.17475 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2d24a8fc", "release": true, "await": true}] 2024-07-26T13:11:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.497+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2d24a8fc", "release": true, "await": true}) -- 0x55c774cac060 con 0x55c774929250 2024-07-26T13:11:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.497+0000 7fd1ade00640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774929250 0x55c774dc3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:11:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.498+0000 7fd1ade00640 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774929250 0x55c774dc3070 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703cb3620158bbb3 server_cookie=5d8ca16a01414d32 in_seq=0 out_seq=0 2024-07-26T13:11:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.498+0000 7fd18b400640 10 client.17475 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:58.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.549+0000 7fd18b400640 1 -- 172.21.15.40:0/440273951 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55c774cac060 con 0x55c774929250 2024-07-26T13:11:58.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.550+0000 7fd18b400640 10 client.17475 handle_command_reply: tid=0 2024-07-26T13:11:58.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.550+0000 7fd1b7465740 1 client.17475 shutdown 2024-07-26T13:11:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.550+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 msgr2=0x55c774d48b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.550+0000 7fd1b7465740 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d48b40 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400d010 tx=0x7fd1a40b3fb0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 shutdown_connections 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c774929250 0x55c774dc3070 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c774995520 0x55c774d48b40 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c774974840 0x55c774d4e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 --2- 172.21.15.40:0/440273951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c77496c660 0x55c774d4db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 >> 172.21.15.40:0/440273951 conn(0x55c774989910 msgr2=0x55c774d3db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd18b400640 0 client.17475 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:11:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 shutdown_connections 2024-07-26T13:11:58.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.551+0000 7fd1b7465740 1 -- 172.21.15.40:0/440273951 wait complete. 2024-07-26T13:11:58.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.552+0000 7fd1b7465740 20 client.17475 trim_cache size 0 max 16384 2024-07-26T13:11:58.553 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:11:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:11:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 168, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "2d24a8fc": { 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 168, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.1, 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:11:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:11:58.555 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd1900b3c50 msgr2=0x7fd1900b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd1900b3c50 0x7fd1900b6160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55c774d38e00 tx=0x7fd19c009880 comp rx=0 tx=0).stop 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 msgr2=0x7fd1a81a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 0x7fd1a81a5a80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400e970 tx=0x7fd1a400ed70 comp rx=0 tx=0).stop 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 shutdown_connections 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1a8113f80 0x7fd1a81a5a80 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd1a8077cc0 0x7fd1a81a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd1900b3c50 0x7fd1900b6160 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 --2- 172.21.15.40:0/2771805960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8077370 0x7fd1a81a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:11:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.553+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 >> 172.21.15.40:0/2771805960 conn(0x7fd1a8101010 msgr2=0x7fd1a8103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:11:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.554+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 shutdown_connections 2024-07-26T13:11:58.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:11:58.554+0000 7fd1af200640 1 -- 172.21.15.40:0/2771805960 wait complete. 2024-07-26T13:11:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:11:59 smithi146 ceph-mon[35807]: pgmap v1991: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:11:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:11:59 smithi076 ceph-mon[35401]: pgmap v1991: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:11:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:11:59 smithi040 ceph-mon[32397]: pgmap v1991: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-07-26T13:11:59.753 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2d24a8fc', total seconds elapsed: 31.1 2024-07-26T13:11:59.754 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.1 2024-07-26T13:11:59.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:12:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:12:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:01 smithi040 ceph-mon[32397]: pgmap v1992: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:12:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:01 smithi146 ceph-mon[35807]: pgmap v1992: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:12:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:01 smithi076 ceph-mon[35401]: pgmap v1992: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:12:02.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.720+0000 7fa1bbe00640 1 -- 172.21.15.40:0/3243325959 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8031800 con 0x7fa1bc108ed0 2024-07-26T13:12:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.721+0000 7fa1c4400640 1 -- 172.21.15.40:0/3243325959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 msgr2=0x7fa1bc1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.721+0000 7fa1c4400640 1 --2- 172.21.15.40:0/3243325959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc1092e0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009900 tx=0x7fa1a802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:12:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 -- 172.21.15.40:0/3243325959 shutdown_connections 2024-07-26T13:12:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 --2- 172.21.15.40:0/3243325959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc109820 0x7fa1bc110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 --2- 172.21.15.40:0/3243325959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc1092e0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 --2- 172.21.15.40:0/3243325959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc103590 0x7fa1bc1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 -- 172.21.15.40:0/3243325959 >> 172.21.15.40:0/3243325959 conn(0x7fa1bc07b280 msgr2=0x7fa1bc07b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 -- 172.21.15.40:0/3243325959 shutdown_connections 2024-07-26T13:12:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.722+0000 7fa1c4400640 1 -- 172.21.15.40:0/3243325959 wait complete. 2024-07-26T13:12:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.723+0000 7fa1c4400640 1 Processor -- start 2024-07-26T13:12:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 -- start start 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 0x7fa1bc19c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc109820 0x7fa1bc1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc075e30 con 0x7fa1bc108ed0 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc075cb0 con 0x7fa1bc103590 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.724+0000 7fa1c4400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc075fb0 con 0x7fa1bc109820 2024-07-26T13:12:02.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.725+0000 7fa1c1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.725+0000 7fa1c1a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 0x7fa1bc19c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.725+0000 7fa1c1a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 0x7fa1bc19c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:55994/0 (socket says 172.21.15.40:55994) 2024-07-26T13:12:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.725+0000 7fa1c1a00640 1 -- 172.21.15.40:0/1503406486 learned_addr learned my addr 172.21.15.40:0/1503406486 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.725+0000 7fa1c1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52508/0 (socket says 172.21.15.40:52508) 2024-07-26T13:12:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.725+0000 7fa1c2400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc109820 0x7fa1bc1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.726+0000 7fa1c1a00640 1 -- 172.21.15.40:0/1503406486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc109820 msgr2=0x7fa1bc1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.726+0000 7fa1c1a00640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc109820 0x7fa1bc1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.726+0000 7fa1c1a00640 1 -- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 msgr2=0x7fa1bc19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.726+0000 7fa1c1a00640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.726+0000 7fa1c1a00640 1 -- 172.21.15.40:0/1503406486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc1a1fa0 con 0x7fa1bc103590 2024-07-26T13:12:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.726+0000 7fa1c1000640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:12:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.727+0000 7fa1c1a00640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 0x7fa1bc19c030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000d770 tx=0x7fa1b000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.727+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0017070 con 0x7fa1bc103590 2024-07-26T13:12:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.727+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc1a2290 con 0x7fa1bc103590 2024-07-26T13:12:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.727+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc1a89f0 con 0x7fa1bc103590 2024-07-26T13:12:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.727+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1b00054b0 con 0x7fa1bc103590 2024-07-26T13:12:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.727+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0020060 con 0x7fa1bc103590 2024-07-26T13:12:02.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.729+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19c0052c0 con 0x7fa1bc103590 2024-07-26T13:12:02.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.733+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa1b0009c30 con 0x7fa1bc103590 2024-07-26T13:12:02.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.735+0000 7fa1ba000640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa1a40b3c50 0x7fa1a40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:02.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.735+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa1b00e3770 con 0x7fa1bc103590 2024-07-26T13:12:02.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.736+0000 7fa1c1000640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa1a40b3c50 0x7fa1a40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:02.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.737+0000 7fa1c1000640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa1a40b3c50 0x7fa1a40b6160 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8005940 tx=0x7fa1a80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:02.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:02.748+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa1b00046c0 con 0x7fa1bc103590 2024-07-26T13:12:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.075+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa19c0055b0 con 0x7fa1bc103590 2024-07-26T13:12:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.077+0000 7fa1ba000640 1 -- 172.21.15.40:0/1503406486 <== mon.2 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fa1b00aa7f0 con 0x7fa1bc103590 2024-07-26T13:12:03.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:12:03.079 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:12:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:12:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa1a40b3c50 msgr2=0x7fa1a40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa1a40b3c50 0x7fa1a40b6160 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8005940 tx=0x7fa1a80058d0 comp rx=0 tx=0).stop 2024-07-26T13:12:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 msgr2=0x7fa1bc19c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 0x7fa1bc19c030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000d770 tx=0x7fa1b000dc30 comp rx=0 tx=0).stop 2024-07-26T13:12:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 shutdown_connections 2024-07-26T13:12:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa1a40b3c50 0x7fa1a40b6160 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1bc109820 0x7fa1bc1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1bc108ed0 0x7fa1bc19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 --2- 172.21.15.40:0/1503406486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa1bc103590 0x7fa1bc19c030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.080+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 >> 172.21.15.40:0/1503406486 conn(0x7fa1bc07b280 msgr2=0x7fa1bc106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.081+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 shutdown_connections 2024-07-26T13:12:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:03.081+0000 7fa1c4400640 1 -- 172.21.15.40:0/1503406486 wait complete. 2024-07-26T13:12:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:03 smithi146 ceph-mon[35807]: pgmap v1993: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:12:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:03 smithi076 ceph-mon[35401]: pgmap v1993: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:12:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:03 smithi040 ceph-mon[32397]: pgmap v1993: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:12:03.943 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 143.1 --await-for 45.0' 2024-07-26T13:12:03.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 143.1 --await-for 45.0 2024-07-26T13:12:04.119 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:04 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1503406486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:12:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:04 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1503406486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:12:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:04 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1503406486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:12:04.460 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:12:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:05 smithi076 ceph-mon[35401]: pgmap v1994: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T13:12:05.360 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:05 smithi040 ceph-mon[32397]: pgmap v1994: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T13:12:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:05 smithi146 ceph-mon[35807]: pgmap v1994: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T13:12:07.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 -- 172.21.15.40:0/76003551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 msgr2=0x7f5af8109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 --2- 172.21.15.40:0/76003551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af8109170 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009900 tx=0x7f5ae802a410 comp rx=0 tx=0).stop 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 -- 172.21.15.40:0/76003551 shutdown_connections 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 --2- 172.21.15.40:0/76003551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5af81096b0 0x7f5af810fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 --2- 172.21.15.40:0/76003551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af8109170 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 --2- 172.21.15.40:0/76003551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af8103420 0x7f5af8103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 -- 172.21.15.40:0/76003551 >> 172.21.15.40:0/76003551 conn(0x7f5af80feeb0 msgr2=0x7f5af8101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 -- 172.21.15.40:0/76003551 shutdown_connections 2024-07-26T13:12:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.320+0000 7f5aff200640 1 -- 172.21.15.40:0/76003551 wait complete. 2024-07-26T13:12:07.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.322+0000 7f5aff200640 1 Processor -- start 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.322+0000 7f5aff200640 1 -- start start 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5aff200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5af8103420 0x7f5af819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5aff200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af819c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5aff200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af81096b0 0x7f5af81a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5aff200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8113220 con 0x7f5af8108d60 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5aff200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81130a0 con 0x7f5af8103420 2024-07-26T13:12:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5aff200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81133a0 con 0x7f5af81096b0 2024-07-26T13:12:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5afd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af819c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5afd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af819c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59756/0 (socket says 172.21.15.40:59756) 2024-07-26T13:12:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.323+0000 7f5afd400640 1 -- 172.21.15.40:0/4049544962 learned_addr learned my addr 172.21.15.40:0/4049544962 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afde00640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5af8103420 0x7f5af819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afe800640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af81096b0 0x7f5af81a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afd400640 1 -- 172.21.15.40:0/4049544962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af81096b0 msgr2=0x7f5af81a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afd400640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af81096b0 0x7f5af81a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afd400640 1 -- 172.21.15.40:0/4049544962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5af8103420 msgr2=0x7f5af819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afd400640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5af8103420 0x7f5af819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afd400640 1 -- 172.21.15.40:0/4049544962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af81a1de0 con 0x7f5af8108d60 2024-07-26T13:12:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.324+0000 7f5afd400640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af819c410 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5ae802a930 tx=0x7f5ae8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.325+0000 7f5aeea00640 1 -- 172.21.15.40:0/4049544962 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae803f070 con 0x7f5af8108d60 2024-07-26T13:12:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.325+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af81a2070 con 0x7f5af8108d60 2024-07-26T13:12:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.325+0000 7f5aeea00640 1 -- 172.21.15.40:0/4049544962 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae803baf0 con 0x7f5af8108d60 2024-07-26T13:12:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.325+0000 7f5aeea00640 1 -- 172.21.15.40:0/4049544962 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8035030 con 0x7f5af8108d60 2024-07-26T13:12:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.325+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af81a8830 con 0x7f5af8108d60 2024-07-26T13:12:07.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.329+0000 7f5aeea00640 1 -- 172.21.15.40:0/4049544962 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5ae8042070 con 0x7f5af8108d60 2024-07-26T13:12:07.330 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:07 smithi040 ceph-mon[32397]: pgmap v1995: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-07-26T13:12:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.330+0000 7f5b075bf740 1 Processor -- start 2024-07-26T13:12:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.330+0000 7f5b075bf740 1 -- start start 2024-07-26T13:12:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d7a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d7a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d7ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5b075bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559f91d44cf0 con 0x559f919ab980 2024-07-26T13:12:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5b075bf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559f91cefb40 con 0x559f919d4840 2024-07-26T13:12:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5b075bf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559f91cdf040 con 0x559f919b3b60 2024-07-26T13:12:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5afe800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d7a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5afe800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d7a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:55114/0 (socket says 172.21.15.40:55114) 2024-07-26T13:12:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5afe800640 1 -- 172.21.15.40:0/478169459 learned_addr learned my addr 172.21.15.40:0/478169459 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.331+0000 7f5afd400640 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d7ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5afde00640 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d7a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5afe800640 1 -- 172.21.15.40:0/478169459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 msgr2=0x559f91d7ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5afe800640 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d7ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5aeea00640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ae40b3bc0 0x7f5ae40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5afe800640 1 -- 172.21.15.40:0/478169459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 msgr2=0x559f91d7a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5afe800640 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d7a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5afe800640 1 -- 172.21.15.40:0/478169459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f91c66af0 con 0x559f919d4840 2024-07-26T13:12:07.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.332+0000 7f5aeea00640 1 -- 172.21.15.40:0/4049544962 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5ae8104300 con 0x7f5af8108d60 2024-07-26T13:12:07.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.333+0000 7f5afe800640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ae40b3bc0 0x7f5ae40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.333+0000 7f5afe800640 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d7a390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009c10 tx=0x7f5af40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c598bd724732888 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.334+0000 7f5ae3000640 1 -- 172.21.15.40:0/478169459 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4012450 con 0x559f919d4840 2024-07-26T13:12:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.334+0000 7f5ae3000640 1 -- 172.21.15.40:0/478169459 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5af401c980 con 0x559f919d4840 2024-07-26T13:12:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.334+0000 7f5ae3000640 1 -- 172.21.15.40:0/478169459 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af401b7c0 con 0x559f919d4840 2024-07-26T13:12:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.334+0000 7f5afe800640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ae40b3bc0 0x7f5ae40b60d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5af4020000 tx=0x7f5af4021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.335+0000 7f5b075bf740 1 -- 172.21.15.40:0/478169459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 msgr2=0x559f91d7a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.335+0000 7f5b075bf740 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d7a390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009c10 tx=0x7f5af40117b0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.335+0000 7f5b075bf740 1 -- 172.21.15.40:0/478169459 shutdown_connections 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.335+0000 7f5b075bf740 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d7ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.335+0000 7f5b075bf740 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d7a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.335+0000 7f5b075bf740 1 --2- 172.21.15.40:0/478169459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d7a390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.336+0000 7f5b075bf740 1 -- 172.21.15.40:0/478169459 >> 172.21.15.40:0/478169459 conn(0x559f919c8990 msgr2=0x559f91d78280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.336+0000 7f5b075bf740 1 -- 172.21.15.40:0/478169459 shutdown_connections 2024-07-26T13:12:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.336+0000 7f5b075bf740 1 -- 172.21.15.40:0/478169459 wait complete. 2024-07-26T13:12:07.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.336+0000 7f5b075bf740 1 -- start start 2024-07-26T13:12:07.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 Processor -- start 2024-07-26T13:12:07.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d85ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d86430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d91d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559f91c7b500 con 0x559f919ab980 2024-07-26T13:12:07.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559f91ce3080 con 0x559f919d4840 2024-07-26T13:12:07.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.337+0000 7f5b075bf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559f91b427a0 con 0x559f919b3b60 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5b075bf740 10 client.0 _ll_register_callbacks cb 0x559f91cd7bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d85ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d85ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59778/0 (socket says 172.21.15.40:59778) 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 -- 172.21.15.40:0/2195727584 learned_addr learned my addr 172.21.15.40:0/2195727584 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afd400640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d86430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 -- 172.21.15.40:0/2195727584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 msgr2=0x559f91d86430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d86430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 -- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 msgr2=0x559f91d91d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d91d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afde00640 1 -- 172.21.15.40:0/2195727584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f91a4eb90 con 0x559f919ab980 2024-07-26T13:12:07.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.338+0000 7f5afd400640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d86430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:12:07.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.339+0000 7f5afde00640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d85ef0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5af00119d0 tx=0x7f5af0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976acbadeb1b5128 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:07.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.339+0000 7f5ad7400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:12:07.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.339+0000 7f5ad7400640 1 -- 172.21.15.40:0/2195727584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0010c60 con 0x559f919ab980 2024-07-26T13:12:07.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.339+0000 7f5ad7400640 1 -- 172.21.15.40:0/2195727584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5af0010e00 con 0x559f919ab980 2024-07-26T13:12:07.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.339+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af401c980 con 0x559f919ab980 2024-07-26T13:12:07.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.340+0000 7f5ad7400640 1 -- 172.21.15.40:0/2195727584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5af0003970 con 0x559f919ab980 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.340+0000 7f5b075bf740 10 client.17493 fetch_fsmap learned FSMap version 35 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.340+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559f91d94980 con 0x559f919ab980 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.340+0000 7f5ad7400640 1 -- 172.21.15.40:0/2195727584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5af401c980 con 0x559f919ab980 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5ad7400640 1 -- 172.21.15.40:0/2195727584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f5af001a410 con 0x559f919ab980 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5b075bf740 10 client.17493 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5b075bf740 10 client.17493 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5b075bf740 20 client.17493 populate_metadata read hostname 'smithi040' 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5b075bf740 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f919931c0 0x559f91d97fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5b075bf740 4 client.17493 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.341+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f91cf1a90 con 0x559f919931c0 2024-07-26T13:12:07.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.342+0000 7f5afd400640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f919931c0 0x559f91d97fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.343+0000 7f5afd400640 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f919931c0 0x559f91d97fa0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7b80d7bea1db732 server_cookie=f38d1af89b9ac14a in_seq=0 out_seq=0 2024-07-26T13:12:07.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.343+0000 7f5ad7400640 10 client.17493 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:07.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5ad7400640 1 -- 172.21.15.40:0/2195727584 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f91cf1a90 con 0x559f919931c0 2024-07-26T13:12:07.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5ad7400640 10 client.17493 handle_command_reply: tid=0 2024-07-26T13:12:07.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 client.17493 shutdown 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 msgr2=0x559f91d85ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d85ef0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5af00119d0 tx=0x7f5af0011e90 comp rx=0 tx=0).stop 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 shutdown_connections 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919d4840 0x559f91d91d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d86430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f919931c0 0x559f91d97fa0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 --2- 172.21.15.40:0/2195727584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919ab980 0x559f91d85ef0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 >> 172.21.15.40:0/2195727584 conn(0x559f919c8990 msgr2=0x559f91d7d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.345+0000 7f5ad7400640 0 client.17493 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.346+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 shutdown_connections 2024-07-26T13:12:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.346+0000 7f5b075bf740 1 -- 172.21.15.40:0/2195727584 wait complete. 2024-07-26T13:12:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.347+0000 7f5b075bf740 20 client.17493 trim_cache size 0 max 16384 2024-07-26T13:12:07.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.370+0000 7f5b075bf740 1 Processor -- start 2024-07-26T13:12:07.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.370+0000 7f5b075bf740 1 -- start start 2024-07-26T13:12:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.370+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d91b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.370+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d92040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f91968570 0x559f91d9d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5b075bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b0da0 con 0x559f919d4840 2024-07-26T13:12:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5b075bf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b28e0 con 0x559f91968570 2024-07-26T13:12:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5b075bf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b1470 con 0x559f919b3b60 2024-07-26T13:12:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5afd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d92040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5afd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d92040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59780/0 (socket says 172.21.15.40:59780) 2024-07-26T13:12:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5afd400640 1 -- 172.21.15.40:0/10283584 learned_addr learned my addr 172.21.15.40:0/10283584 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5afde00640 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d91b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.371+0000 7f5afe800640 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f91968570 0x559f91d9d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afd400640 1 -- 172.21.15.40:0/10283584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 msgr2=0x559f91d91b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afd400640 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d91b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afd400640 1 -- 172.21.15.40:0/10283584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f91968570 msgr2=0x559f91d9d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afd400640 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f91968570 0x559f91d9d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afd400640 1 -- 172.21.15.40:0/10283584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f91d80920 con 0x559f919d4840 2024-07-26T13:12:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afde00640 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d91b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:12:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5afd400640 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d92040 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80c7290 tx=0x7f5ae8005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0b5bb9eb39102f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.372+0000 7f5ae2600640 1 -- 172.21.15.40:0/10283584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8049040 con 0x559f919d4840 2024-07-26T13:12:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.373+0000 7f5ae2600640 1 -- 172.21.15.40:0/10283584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae8031400 con 0x559f919d4840 2024-07-26T13:12:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.373+0000 7f5ae2600640 1 -- 172.21.15.40:0/10283584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80cf810 con 0x559f919d4840 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 -- 172.21.15.40:0/10283584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 msgr2=0x559f91d92040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d92040 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80c7290 tx=0x7f5ae8005de0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 -- 172.21.15.40:0/10283584 shutdown_connections 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f91968570 0x559f91d9d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d92040 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 --2- 172.21.15.40:0/10283584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f919b3b60 0x559f91d91b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 -- 172.21.15.40:0/10283584 >> 172.21.15.40:0/10283584 conn(0x559f919c8990 msgr2=0x559f91d84570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 -- 172.21.15.40:0/10283584 shutdown_connections 2024-07-26T13:12:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.374+0000 7f5b075bf740 1 -- 172.21.15.40:0/10283584 wait complete. 2024-07-26T13:12:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.375+0000 7f5b075bf740 1 -- start start 2024-07-26T13:12:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.375+0000 7f5b075bf740 1 Processor -- start 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f91968570 0x559f91d89c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919b3b60 0x559f91d8a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d8a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b2210 con 0x559f919d4840 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b1b40 con 0x559f919b3b60 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81aed60 con 0x559f91968570 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5b075bf740 10 client.0 _ll_register_callbacks cb 0x7f5af0009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5afe800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d8a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5afe800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d8a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59786/0 (socket says 172.21.15.40:59786) 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5afe800640 1 -- 172.21.15.40:0/3958823503 learned_addr learned my addr 172.21.15.40:0/3958823503 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5afde00640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f91968570 0x559f91d89c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.376+0000 7f5afd400640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919b3b60 0x559f91d8a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5afe800640 1 -- 172.21.15.40:0/3958823503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f91968570 msgr2=0x559f91d89c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5afe800640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f91968570 0x559f91d89c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5afe800640 1 -- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919b3b60 msgr2=0x559f91d8a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5afe800640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919b3b60 0x559f91d8a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5afe800640 1 -- 172.21.15.40:0/3958823503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f91dff870 con 0x559f919d4840 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5afe800640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d8a6c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f5af401bda0 tx=0x7f5af401bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62b0c5f0fc8e819 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.377+0000 7f5ad7400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:12:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.378+0000 7f5ad7400640 1 -- 172.21.15.40:0/3958823503 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4038060 con 0x559f919d4840 2024-07-26T13:12:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.378+0000 7f5ad7400640 1 -- 172.21.15.40:0/3958823503 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5af4022040 con 0x559f919d4840 2024-07-26T13:12:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.378+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f91ced530 con 0x559f919d4840 2024-07-26T13:12:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.378+0000 7f5ad7400640 1 -- 172.21.15.40:0/3958823503 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5af4012450 con 0x559f919d4840 2024-07-26T13:12:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.378+0000 7f5b075bf740 10 client.17499 fetch_fsmap learned FSMap version 35 2024-07-26T13:12:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.378+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559f91e00ad0 con 0x559f919d4840 2024-07-26T13:12:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5ad7400640 1 -- 172.21.15.40:0/3958823503 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559f91ced530 con 0x559f919d4840 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5ad7400640 1 -- 172.21.15.40:0/3958823503 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f5af403d070 con 0x559f919d4840 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5b075bf740 10 client.17499 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5b075bf740 10 client.17499 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5b075bf740 20 client.17499 populate_metadata read hostname 'smithi040' 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5b075bf740 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f91e01000 0x559f91e03420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5b075bf740 4 client.17499 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.1, "await_for": 45.0}] 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.379+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.1, "await_for": 45.0}) -- 0x559f91ceac70 con 0x559f91e01000 2024-07-26T13:12:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.380+0000 7f5afde00640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f91e01000 0x559f91e03420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:07.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.381+0000 7f5afde00640 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f91e01000 0x559f91e03420 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce34c2049a8bc6ce server_cookie=4457da2ab60a1c7c in_seq=0 out_seq=0 2024-07-26T13:12:07.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.381+0000 7f5ad7400640 10 client.17499 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:07 smithi146 ceph-mon[35807]: pgmap v1995: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-07-26T13:12:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:07 smithi076 ceph-mon[35401]: pgmap v1995: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 11 op/s 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.669+0000 7f5ad7400640 1 -- 172.21.15.40:0/3958823503 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x559f91ceac70 con 0x559f91e01000 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.669+0000 7f5ad7400640 10 client.17499 handle_command_reply: tid=0 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.669+0000 7f5b075bf740 1 client.17499 shutdown 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 msgr2=0x559f91d8a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d8a6c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f5af401bda0 tx=0x7f5af401bdd0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 shutdown_connections 2024-07-26T13:12:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559f91e01000 0x559f91e03420 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559f919d4840 0x559f91d8a6c0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5ad7400640 0 client.17499 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559f919b3b60 0x559f91d8a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 --2- 172.21.15.40:0/3958823503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559f91968570 0x559f91d89c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.670+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 >> 172.21.15.40:0/3958823503 conn(0x559f919c8990 msgr2=0x559f91d7b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.671+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 shutdown_connections 2024-07-26T13:12:07.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.671+0000 7f5b075bf740 1 -- 172.21.15.40:0/3958823503 wait complete. 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.671+0000 7f5b075bf740 20 client.17499 trim_cache size 0 max 16384 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 170, 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout: "3b29e7e1": { 2024-07-26T13:12:07.673 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 170, 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.1, 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:12:07.674 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:12:07.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ae40b3bc0 msgr2=0x7f5ae40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ae40b3bc0 0x7f5ae40b60d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5af4020000 tx=0x7f5af4021000 comp rx=0 tx=0).stop 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 msgr2=0x7f5af819c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af819c410 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5ae802a930 tx=0x7f5ae8003b90 comp rx=0 tx=0).stop 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 shutdown_connections 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5ae40b3bc0 0x7f5ae40b60d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5af81096b0 0x7f5af81a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af8108d60 0x7f5af819c410 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 --2- 172.21.15.40:0/4049544962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5af8103420 0x7f5af819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 >> 172.21.15.40:0/4049544962 conn(0x7f5af80feeb0 msgr2=0x7f5af8107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.673+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 shutdown_connections 2024-07-26T13:12:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:07.674+0000 7f5aff200640 1 -- 172.21.15.40:0/4049544962 wait complete. 2024-07-26T13:12:08.507 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3b29e7e1', quiesce took 8.8 seconds. Will release after: 14.3 2024-07-26T13:12:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:09 smithi040 ceph-mon[32397]: pgmap v1996: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:12:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:09 smithi146 ceph-mon[35807]: pgmap v1996: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:12:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:09 smithi076 ceph-mon[35401]: pgmap v1996: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:12:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:11 smithi040 ceph-mon[32397]: pgmap v1997: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T13:12:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:11 smithi146 ceph-mon[35807]: pgmap v1997: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T13:12:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:11 smithi076 ceph-mon[35401]: pgmap v1997: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T13:12:13.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:13 smithi040 ceph-mon[32397]: pgmap v1998: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 10 op/s 2024-07-26T13:12:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:13 smithi146 ceph-mon[35807]: pgmap v1998: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 10 op/s 2024-07-26T13:12:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:13 smithi076 ceph-mon[35401]: pgmap v1998: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 10 op/s 2024-07-26T13:12:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:15 smithi040 ceph-mon[32397]: pgmap v1999: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T13:12:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:15 smithi146 ceph-mon[35807]: pgmap v1999: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T13:12:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:15 smithi076 ceph-mon[35401]: pgmap v1999: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T13:12:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:17 smithi040 ceph-mon[32397]: pgmap v2000: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:12:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:17 smithi146 ceph-mon[35807]: pgmap v2000: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:12:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:17 smithi076 ceph-mon[35401]: pgmap v2000: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:12:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:19 smithi040 ceph-mon[32397]: pgmap v2001: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T13:12:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:19 smithi146 ceph-mon[35807]: pgmap v2001: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T13:12:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:19 smithi076 ceph-mon[35401]: pgmap v2001: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.3 MiB/s wr, 11 op/s 2024-07-26T13:12:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:21 smithi040 ceph-mon[32397]: pgmap v2002: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T13:12:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:21 smithi146 ceph-mon[35807]: pgmap v2002: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T13:12:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:21 smithi076 ceph-mon[35401]: pgmap v2002: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T13:12:22.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:12:23.319 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:12:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:23 smithi040 ceph-mon[32397]: pgmap v2003: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T13:12:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:23 smithi146 ceph-mon[35807]: pgmap v2003: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T13:12:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:23 smithi076 ceph-mon[35401]: pgmap v2003: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-07-26T13:12:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:25 smithi040 ceph-mon[32397]: pgmap v2004: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 618 KiB/s wr, 11 op/s 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 -- 172.21.15.40:0/513826307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c10af30 msgr2=0x7f4b7c10b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 --2- 172.21.15.40:0/513826307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c10af30 0x7f4b7c10b340 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009900 tx=0x7f4b6802a410 comp rx=0 tx=0).stop 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 -- 172.21.15.40:0/513826307 shutdown_connections 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 --2- 172.21.15.40:0/513826307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c10b880 0x7f4b7c1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 --2- 172.21.15.40:0/513826307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c10af30 0x7f4b7c10b340 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 --2- 172.21.15.40:0/513826307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 -- 172.21.15.40:0/513826307 >> 172.21.15.40:0/513826307 conn(0x7f4b7c101060 msgr2=0x7f4b7c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 -- 172.21.15.40:0/513826307 shutdown_connections 2024-07-26T13:12:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.510+0000 7f4b80c00640 1 -- 172.21.15.40:0/513826307 wait complete. 2024-07-26T13:12:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.511+0000 7f4b80c00640 1 Processor -- start 2024-07-26T13:12:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 -- start start 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c10af30 0x7f4b7c19c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c10b880 0x7f4b7c1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c1153a0 con 0x7f4b7c1055f0 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c115220 con 0x7f4b7c10b880 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b80c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c115520 con 0x7f4b7c10af30 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.512+0000 7f4b7b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c19be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50392/0 (socket says 172.21.15.40:50392) 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 -- 172.21.15.40:0/3167522160 learned_addr learned my addr 172.21.15.40:0/3167522160 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:25.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7aa00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c10af30 0x7f4b7c19c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7be00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c10b880 0x7f4b7c1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 -- 172.21.15.40:0/3167522160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c10af30 msgr2=0x7f4b7c19c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c10af30 0x7f4b7c19c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 -- 172.21.15.40:0/3167522160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c10b880 msgr2=0x7f4b7c1a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c10b880 0x7f4b7c1a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 -- 172.21.15.40:0/3167522160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c1a1da0 con 0x7f4b7c1055f0 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7be00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c10b880 0x7f4b7c1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:12:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.513+0000 7f4b7b400640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c19be30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00d950 tx=0x7f4b6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.514+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c017070 con 0x7f4b7c1055f0 2024-07-26T13:12:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.514+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6c009c30 con 0x7f4b7c1055f0 2024-07-26T13:12:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.514+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c1a2090 con 0x7f4b7c1055f0 2024-07-26T13:12:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.514+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c1a87f0 con 0x7f4b7c1055f0 2024-07-26T13:12:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.514+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c020060 con 0x7f4b7c1055f0 2024-07-26T13:12:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.515+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c105a00 con 0x7f4b7c1055f0 2024-07-26T13:12:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.518+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4b6c010460 con 0x7f4b7c1055f0 2024-07-26T13:12:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.519+0000 7f4b73e00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b600b3bd0 0x7f4b600b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.520+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4b6c0e3f20 con 0x7f4b7c1055f0 2024-07-26T13:12:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.520+0000 7f4b7aa00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b600b3bd0 0x7f4b600b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.521+0000 7f4b7aa00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b600b3bd0 0x7f4b600b60e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4b680057c0 tx=0x7f4b68000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.521+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f4b6c0ab530 con 0x7f4b7c1055f0 2024-07-26T13:12:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:25 smithi146 ceph-mon[35807]: pgmap v2004: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 618 KiB/s wr, 11 op/s 2024-07-26T13:12:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:25 smithi076 ceph-mon[35401]: pgmap v2004: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 618 KiB/s wr, 11 op/s 2024-07-26T13:12:25.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.770+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b7c02e0c0 con 0x7f4b7c1055f0 2024-07-26T13:12:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.772+0000 7f4b73e00640 1 -- 172.21.15.40:0/3167522160 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f4b6c009de0 con 0x7f4b7c1055f0 2024-07-26T13:12:25.774 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:12:25.774 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:12:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:12:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b600b3bd0 msgr2=0x7f4b600b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b600b3bd0 0x7f4b600b60e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4b680057c0 tx=0x7f4b68000bc0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 msgr2=0x7f4b7c19be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c19be30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00d950 tx=0x7f4b6c00de10 comp rx=0 tx=0).stop 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 shutdown_connections 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b7c10b880 0x7f4b7c1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b600b3bd0 0x7f4b600b60e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c10af30 0x7f4b7c19c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 --2- 172.21.15.40:0/3167522160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b7c1055f0 0x7f4b7c19be30 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.775+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 >> 172.21.15.40:0/3167522160 conn(0x7f4b7c101060 msgr2=0x7f4b7c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.776+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 shutdown_connections 2024-07-26T13:12:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:25.776+0000 7f4b80c00640 1 -- 172.21.15.40:0/3167522160 wait complete. 2024-07-26T13:12:26.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:26 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3167522160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:12:26.539 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 3b29e7e1 --release --await' 2024-07-26T13:12:26.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 3b29e7e1 --release --await 2024-07-26T13:12:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:26 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3167522160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:12:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:26 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3167522160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:12:27.025 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:12:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:27 smithi040 ceph-mon[32397]: pgmap v2005: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:12:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:27 smithi146 ceph-mon[35807]: pgmap v2005: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:12:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:27 smithi076 ceph-mon[35401]: pgmap v2005: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:12:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 -- 172.21.15.40:0/3568194703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 msgr2=0x7f031c10f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 --2- 172.21.15.40:0/3568194703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c10f740 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0304009900 tx=0x7f030402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 -- 172.21.15.40:0/3568194703 shutdown_connections 2024-07-26T13:12:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 --2- 172.21.15.40:0/3568194703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f031c10fc80 0x7f031c1164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 --2- 172.21.15.40:0/3568194703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c10f740 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 --2- 172.21.15.40:0/3568194703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f031c1099f0 0x7f031c109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 -- 172.21.15.40:0/3568194703 >> 172.21.15.40:0/3568194703 conn(0x7f031c078ff0 msgr2=0x7f031c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 -- 172.21.15.40:0/3568194703 shutdown_connections 2024-07-26T13:12:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.196+0000 7f0321600640 1 -- 172.21.15.40:0/3568194703 wait complete. 2024-07-26T13:12:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.198+0000 7f0321600640 1 Processor -- start 2024-07-26T13:12:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.198+0000 7f0321600640 1 -- start start 2024-07-26T13:12:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0321600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f031c1099f0 0x7f031c1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0321600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c1a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0321600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f031c10fc80 0x7f031c1a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0321600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f031c119840 con 0x7f031c10f330 2024-07-26T13:12:29.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0321600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1196c0 con 0x7f031c1099f0 2024-07-26T13:12:29.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0321600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1199c0 con 0x7f031c10fc80 2024-07-26T13:12:29.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0313e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c1a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0313e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c1a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50406/0 (socket says 172.21.15.40:50406) 2024-07-26T13:12:29.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0313e00640 1 -- 172.21.15.40:0/1987901216 learned_addr learned my addr 172.21.15.40:0/1987901216 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:29.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f031be00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f031c1099f0 0x7f031c1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.199+0000 7f0320c00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f031c10fc80 0x7f031c1a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0313e00640 1 -- 172.21.15.40:0/1987901216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f031c10fc80 msgr2=0x7f031c1a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0313e00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f031c10fc80 0x7f031c1a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0313e00640 1 -- 172.21.15.40:0/1987901216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f031c1099f0 msgr2=0x7f031c1a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0313e00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f031c1099f0 0x7f031c1a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0313e00640 1 -- 172.21.15.40:0/1987901216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c1a6200 con 0x7f031c10f330 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0313e00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c1a0830 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f030402a910 tx=0x7f0304003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.200+0000 7f0319600640 1 -- 172.21.15.40:0/1987901216 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030403f070 con 0x7f031c10f330 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.201+0000 7f0319600640 1 -- 172.21.15.40:0/1987901216 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0304003e10 con 0x7f031c10f330 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.201+0000 7f0319600640 1 -- 172.21.15.40:0/1987901216 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304035030 con 0x7f031c10f330 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.201+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c1a6490 con 0x7f031c10f330 2024-07-26T13:12:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.201+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c1acc50 con 0x7f031c10f330 2024-07-26T13:12:29.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.206+0000 7f0329842740 1 Processor -- start 2024-07-26T13:12:29.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.206+0000 7f0329842740 1 -- start start 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0329842740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c17f520 0x56022c5241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0319600640 1 -- 172.21.15.40:0/1987901216 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0304042070 con 0x7f031c10f330 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0329842740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c5246e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0329842740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c524c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0329842740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56022c49af50 con 0x56022c15e840 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0329842740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56022c48a450 con 0x56022c156660 2024-07-26T13:12:29.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0329842740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56022c48e490 con 0x56022c17f520 2024-07-26T13:12:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0313e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c524c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0313e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c524c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50420/0 (socket says 172.21.15.40:50420) 2024-07-26T13:12:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.207+0000 7f0313e00640 1 -- 172.21.15.40:0/321612735 learned_addr learned my addr 172.21.15.40:0/321612735 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f031be00640 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c5246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0320c00640 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c17f520 0x56022c5241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0313e00640 1 -- 172.21.15.40:0/321612735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c17f520 msgr2=0x56022c5241a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0313e00640 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c17f520 0x56022c5241a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0313e00640 1 -- 172.21.15.40:0/321612735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 msgr2=0x56022c5246e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0313e00640 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c5246e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0313e00640 1 -- 172.21.15.40:0/321612735 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022c1eab00 con 0x56022c15e840 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.208+0000 7f0313e00640 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c524c20 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f030410c590 tx=0x7f030410c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30aea9777339b2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.209+0000 7f0311200640 1 -- 172.21.15.40:0/321612735 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304106520 con 0x56022c15e840 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.209+0000 7f0311200640 1 -- 172.21.15.40:0/321612735 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0304104c90 con 0x56022c15e840 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.209+0000 7f0311200640 1 -- 172.21.15.40:0/321612735 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304115ad0 con 0x56022c15e840 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.209+0000 7f0319600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03000b3c50 0x7f03000b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0319600640 1 -- 172.21.15.40:0/1987901216 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f03041043d0 con 0x7f031c10f330 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0320c00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03000b3c50 0x7f03000b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 -- 172.21.15.40:0/321612735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 msgr2=0x56022c524c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c524c20 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f030410c590 tx=0x7f030410c680 comp rx=0 tx=0).stop 2024-07-26T13:12:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 -- 172.21.15.40:0/321612735 shutdown_connections 2024-07-26T13:12:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c524c20 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c5246e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 --2- 172.21.15.40:0/321612735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c17f520 0x56022c5241a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 -- 172.21.15.40:0/321612735 >> 172.21.15.40:0/321612735 conn(0x56022c173910 msgr2=0x56022c522090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.210+0000 7f0329842740 1 -- 172.21.15.40:0/321612735 shutdown_connections 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.211+0000 7f0329842740 1 -- 172.21.15.40:0/321612735 wait complete. 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.211+0000 7f0320c00640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03000b3c50 0x7f03000b6160 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0314005fd0 tx=0x7f0314009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.211+0000 7f0329842740 1 -- start start 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 Processor -- start 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c52f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c52fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c53b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56022c2edbb0 con 0x56022c17f520 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56022c426930 con 0x56022c156660 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56022c532740 con 0x56022c15e840 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.212+0000 7f0329842740 10 client.0 _ll_register_callbacks cb 0x56022c196d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c53b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c53b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50424/0 (socket says 172.21.15.40:50424) 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 -- 172.21.15.40:0/3689524893 learned_addr learned my addr 172.21.15.40:0/3689524893 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f031be00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c52f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0313e00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c52fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 -- 172.21.15.40:0/3689524893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 msgr2=0x56022c52fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c52fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 -- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 msgr2=0x56022c52f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c52f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f0320c00640 1 -- 172.21.15.40:0/3689524893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56022c261960 con 0x56022c17f520 2024-07-26T13:12:29.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.213+0000 7f031be00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c52f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:12:29.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0320c00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c53b9f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f0314009680 tx=0x7f0314004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b7240486621633 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:29.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0309600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:12:29.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0309600640 1 -- 172.21.15.40:0/3689524893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031400ece0 con 0x56022c17f520 2024-07-26T13:12:29.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0309600640 1 -- 172.21.15.40:0/3689524893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f031401f420 con 0x56022c17f520 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0304104c90 con 0x56022c17f520 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0309600640 1 -- 172.21.15.40:0/3689524893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f031401f620 con 0x56022c17f520 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0329842740 10 client.17517 fetch_fsmap learned FSMap version 35 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.214+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56022c53e430 con 0x56022c17f520 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0309600640 1 -- 172.21.15.40:0/3689524893 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0304104c90 con 0x56022c17f520 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0309600640 1 -- 172.21.15.40:0/3689524893 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f031400f040 con 0x56022c17f520 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0329842740 10 client.17517 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0329842740 10 client.17517 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0329842740 20 client.17517 populate_metadata read hostname 'smithi040' 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0329842740 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c13dea0 0x56022c541980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0329842740 4 client.17517 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.215+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56022c49cea0 con 0x56022c13dea0 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.216+0000 7f031be00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c13dea0 0x56022c541980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.217+0000 7f031be00640 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c13dea0 0x56022c541980 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34e8cd9a6cb5c32 server_cookie=ce814b375ae088db in_seq=0 out_seq=0 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.217+0000 7f0309600640 10 client.17517 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0309600640 1 -- 172.21.15.40:0/3689524893 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56022c49cea0 con 0x56022c13dea0 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0309600640 10 client.17517 handle_command_reply: tid=0 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 client.17517 shutdown 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 msgr2=0x56022c53b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c53b9f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f0314009680 tx=0x7f0314004a40 comp rx=0 tx=0).stop 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 shutdown_connections 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c13dea0 0x56022c541980 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c53b9f0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c52fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 --2- 172.21.15.40:0/3689524893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c52f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 >> 172.21.15.40:0/3689524893 conn(0x56022c173910 msgr2=0x56022c527330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.219+0000 7f0309600640 0 client.17517 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.220+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 shutdown_connections 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.220+0000 7f0329842740 1 -- 172.21.15.40:0/3689524893 wait complete. 2024-07-26T13:12:29.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.220+0000 7f0329842740 20 client.17517 trim_cache size 0 max 16384 2024-07-26T13:12:29.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 Processor -- start 2024-07-26T13:12:29.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 -- start start 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c53b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c53bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c52a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1b5210 con 0x56022c17f520 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1b6d50 con 0x56022c156660 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.239+0000 7f0329842740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1b58e0 con 0x56022c15e840 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c52a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c52a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50428/0 (socket says 172.21.15.40:50428) 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 -- 172.21.15.40:0/2606685214 learned_addr learned my addr 172.21.15.40:0/2606685214 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f031be00640 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c53b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0313e00640 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c53bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 -- 172.21.15.40:0/2606685214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 msgr2=0x56022c53bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c53bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 -- 172.21.15.40:0/2606685214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 msgr2=0x56022c53b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c53b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f0320c00640 1 -- 172.21.15.40:0/2606685214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022c526490 con 0x56022c17f520 2024-07-26T13:12:29.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.240+0000 7f031be00640 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c53b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:12:29.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.241+0000 7f0320c00640 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c52a990 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f031400a010 tx=0x7f0314005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c6b9c8dc849ba0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.241+0000 7f030be00640 1 -- 172.21.15.40:0/2606685214 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140124e0 con 0x56022c17f520 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.241+0000 7f030be00640 1 -- 172.21.15.40:0/2606685214 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f031401f420 con 0x56022c17f520 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.241+0000 7f030be00640 1 -- 172.21.15.40:0/2606685214 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031401fbf0 con 0x56022c17f520 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 -- 172.21.15.40:0/2606685214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 msgr2=0x56022c52a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c52a990 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f031400a010 tx=0x7f0314005ac0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 -- 172.21.15.40:0/2606685214 shutdown_connections 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c17f520 0x56022c52a990 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c15e840 0x56022c53bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 --2- 172.21.15.40:0/2606685214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c156660 0x56022c53b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 -- 172.21.15.40:0/2606685214 >> 172.21.15.40:0/2606685214 conn(0x56022c173910 msgr2=0x56022c531510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:29.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 -- 172.21.15.40:0/2606685214 shutdown_connections 2024-07-26T13:12:29.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.242+0000 7f0329842740 1 -- 172.21.15.40:0/2606685214 wait complete. 2024-07-26T13:12:29.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.243+0000 7f0329842740 1 -- start start 2024-07-26T13:12:29.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.243+0000 7f0329842740 1 Processor -- start 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c156660 0x56022c537fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c5344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c17f520 0x56022c534a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1b6680 con 0x56022c15e840 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1b5fb0 con 0x56022c17f520 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1b31d0 con 0x56022c156660 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0329842740 10 client.0 _ll_register_callbacks cb 0x7f0314009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c5344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c5344f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50434/0 (socket says 172.21.15.40:50434) 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 -- 172.21.15.40:0/3690844019 learned_addr learned my addr 172.21.15.40:0/3690844019 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f031be00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c156660 0x56022c537fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0320c00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c17f520 0x56022c534a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 -- 172.21.15.40:0/3690844019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c156660 msgr2=0x56022c537fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c156660 0x56022c537fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 -- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c17f520 msgr2=0x56022c534a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c17f520 0x56022c534a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0313e00640 1 -- 172.21.15.40:0/3690844019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56022c535170 con 0x56022c15e840 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.244+0000 7f0320c00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c17f520 0x56022c534a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:12:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0313e00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c5344f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f030402a430 tx=0x7f0304107a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc87436a56c8bbc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0309600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0309600640 1 -- 172.21.15.40:0/3690844019 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304049040 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0309600640 1 -- 172.21.15.40:0/3690844019 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f030410c150 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f031401f420 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0309600640 1 -- 172.21.15.40:0/3690844019 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f03040c71e0 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0329842740 10 client.17523 fetch_fsmap learned FSMap version 35 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.245+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56022c5ab050 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0309600640 1 -- 172.21.15.40:0/3690844019 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f031401f420 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0309600640 1 -- 172.21.15.40:0/3690844019 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0304101f50 con 0x56022c15e840 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0329842740 10 client.17523 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0329842740 10 client.17523 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:12:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0329842740 20 client.17523 populate_metadata read hostname 'smithi040' 2024-07-26T13:12:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0329842740 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c113250 0x56022c5ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:12:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0329842740 4 client.17523 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3b29e7e1", "release": true, "await": true}] 2024-07-26T13:12:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.246+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3b29e7e1", "release": true, "await": true}) -- 0x56022c498940 con 0x56022c113250 2024-07-26T13:12:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.247+0000 7f031be00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c113250 0x56022c5ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:12:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.248+0000 7f031be00640 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c113250 0x56022c5ad540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cadb9245ff557ace server_cookie=925b80932140c529 in_seq=0 out_seq=0 2024-07-26T13:12:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.248+0000 7f0309600640 10 client.17523 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:29.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.301+0000 7f0309600640 1 -- 172.21.15.40:0/3690844019 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x56022c498940 con 0x56022c113250 2024-07-26T13:12:29.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.301+0000 7f0309600640 10 client.17523 handle_command_reply: tid=0 2024-07-26T13:12:29.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.301+0000 7f0329842740 1 client.17523 shutdown 2024-07-26T13:12:29.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 msgr2=0x56022c5344f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c5344f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f030402a430 tx=0x7f0304107a50 comp rx=0 tx=0).stop 2024-07-26T13:12:29.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 shutdown_connections 2024-07-26T13:12:29.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56022c17f520 0x56022c534a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56022c113250 0x56022c5ad540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56022c15e840 0x56022c5344f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 --2- 172.21.15.40:0/3690844019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56022c156660 0x56022c537fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 >> 172.21.15.40:0/3690844019 conn(0x56022c173910 msgr2=0x56022c52a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:29.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0309600640 0 client.17523 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:12:29.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 shutdown_connections 2024-07-26T13:12:29.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.302+0000 7f0329842740 1 -- 172.21.15.40:0/3690844019 wait complete. 2024-07-26T13:12:29.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.303+0000 7f0329842740 20 client.17523 trim_cache size 0 max 16384 2024-07-26T13:12:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 172, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "3b29e7e1": { 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 172, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:12:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.1, 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:12:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03000b3c50 msgr2=0x7f03000b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03000b3c50 0x7f03000b6160 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0314005fd0 tx=0x7f0314009580 comp rx=0 tx=0).stop 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 msgr2=0x7f031c1a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c1a0830 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f030402a910 tx=0x7f0304003c20 comp rx=0 tx=0).stop 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 shutdown_connections 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f03000b3c50 0x7f03000b6160 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f031c10fc80 0x7f031c1a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f031c10f330 0x7f031c1a0830 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 --2- 172.21.15.40:0/1987901216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f031c1099f0 0x7f031c1a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:12:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.304+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 >> 172.21.15.40:0/1987901216 conn(0x7f031c078ff0 msgr2=0x7f031c108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:12:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.305+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 shutdown_connections 2024-07-26T13:12:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:12:29.305+0000 7f0321600640 1 -- 172.21.15.40:0/1987901216 wait complete. 2024-07-26T13:12:29.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:29 smithi040 ceph-mon[32397]: pgmap v2006: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T13:12:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:29 smithi146 ceph-mon[35807]: pgmap v2006: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T13:12:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:29 smithi076 ceph-mon[35401]: pgmap v2006: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-07-26T13:12:30.191 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3b29e7e1', total seconds elapsed: 30.4 2024-07-26T13:12:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:31 smithi040 ceph-mon[32397]: pgmap v2007: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T13:12:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:31 smithi146 ceph-mon[35807]: pgmap v2007: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T13:12:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:31 smithi076 ceph-mon[35401]: pgmap v2007: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-07-26T13:12:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:33 smithi040 ceph-mon[32397]: pgmap v2008: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:12:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:33 smithi146 ceph-mon[35807]: pgmap v2008: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:12:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:33 smithi076 ceph-mon[35401]: pgmap v2008: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:12:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:35 smithi040 ceph-mon[32397]: pgmap v2009: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 748 KiB/s wr, 11 op/s 2024-07-26T13:12:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:35 smithi146 ceph-mon[35807]: pgmap v2009: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 748 KiB/s wr, 11 op/s 2024-07-26T13:12:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:35 smithi076 ceph-mon[35401]: pgmap v2009: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 748 KiB/s wr, 11 op/s 2024-07-26T13:12:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:37 smithi040 ceph-mon[32397]: pgmap v2010: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 748 KiB/s wr, 10 op/s 2024-07-26T13:12:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:12:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:37 smithi146 ceph-mon[35807]: pgmap v2010: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 748 KiB/s wr, 10 op/s 2024-07-26T13:12:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:12:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:37 smithi076 ceph-mon[35401]: pgmap v2010: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 748 KiB/s wr, 10 op/s 2024-07-26T13:12:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:12:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:39 smithi040 ceph-mon[32397]: pgmap v2011: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 MiB/s wr, 9 op/s 2024-07-26T13:12:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:39 smithi146 ceph-mon[35807]: pgmap v2011: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 MiB/s wr, 9 op/s 2024-07-26T13:12:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:39 smithi076 ceph-mon[35401]: pgmap v2011: 97 pgs: 97 active+clean; 9.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 MiB/s wr, 9 op/s 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: pgmap v2012: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: pgmap v2012: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:12:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: pgmap v2012: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:12:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:12:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:12:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:12:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:12:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:12:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:12:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:12:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:43 smithi146 ceph-mon[35807]: pgmap v2013: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:12:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:43 smithi076 ceph-mon[35401]: pgmap v2013: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:12:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:43 smithi040 ceph-mon[32397]: pgmap v2013: 97 pgs: 97 active+clean; 9.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:12:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:45 smithi146 ceph-mon[35807]: pgmap v2014: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 13 op/s 2024-07-26T13:12:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:45 smithi076 ceph-mon[35401]: pgmap v2014: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 13 op/s 2024-07-26T13:12:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:45 smithi040 ceph-mon[32397]: pgmap v2014: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.1 MiB/s wr, 13 op/s 2024-07-26T13:12:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:47 smithi146 ceph-mon[35807]: pgmap v2015: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:12:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:47 smithi076 ceph-mon[35401]: pgmap v2015: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:12:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:47 smithi040 ceph-mon[32397]: pgmap v2015: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:12:49.320 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:49 smithi040 ceph-mon[32397]: pgmap v2016: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.3 MiB/s wr, 11 op/s 2024-07-26T13:12:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:49 smithi146 ceph-mon[35807]: pgmap v2016: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.3 MiB/s wr, 11 op/s 2024-07-26T13:12:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:49 smithi076 ceph-mon[35401]: pgmap v2016: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.3 MiB/s wr, 11 op/s 2024-07-26T13:12:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:51 smithi146 ceph-mon[35807]: pgmap v2017: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:12:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:51 smithi076 ceph-mon[35401]: pgmap v2017: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:12:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:51 smithi040 ceph-mon[32397]: pgmap v2017: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:12:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:53 smithi146 ceph-mon[35807]: pgmap v2018: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:12:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:53 smithi076 ceph-mon[35401]: pgmap v2018: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:12:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:53 smithi040 ceph-mon[32397]: pgmap v2018: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:12:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:55 smithi076 ceph-mon[35401]: pgmap v2019: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:12:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:55 smithi040 ceph-mon[32397]: pgmap v2019: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:12:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:55 smithi146 ceph-mon[35807]: pgmap v2019: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:12:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:57 smithi076 ceph-mon[35401]: pgmap v2020: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:12:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:57 smithi040 ceph-mon[32397]: pgmap v2020: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:12:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:57 smithi146 ceph-mon[35807]: pgmap v2020: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:12:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:12:59 smithi040 ceph-mon[32397]: pgmap v2021: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:12:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:12:59 smithi146 ceph-mon[35807]: pgmap v2021: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:12:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:12:59 smithi076 ceph-mon[35401]: pgmap v2021: 97 pgs: 97 active+clean; 9.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:13:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:01 smithi040 ceph-mon[32397]: pgmap v2022: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:13:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:01 smithi146 ceph-mon[35807]: pgmap v2022: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:13:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:01 smithi076 ceph-mon[35401]: pgmap v2022: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-07-26T13:13:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:03 smithi040 ceph-mon[32397]: pgmap v2023: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:13:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:03 smithi146 ceph-mon[35807]: pgmap v2023: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:13:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:03 smithi076 ceph-mon[35401]: pgmap v2023: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:13:05.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:05 smithi146 ceph-mon[35807]: pgmap v2024: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:13:05.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:05 smithi076 ceph-mon[35401]: pgmap v2024: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:13:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:05 smithi040 ceph-mon[32397]: pgmap v2024: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:13:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:07 smithi146 ceph-mon[35807]: pgmap v2025: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:13:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:07 smithi040 ceph-mon[32397]: pgmap v2025: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:13:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:07 smithi076 ceph-mon[35401]: pgmap v2025: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:13:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:09 smithi040 ceph-mon[32397]: pgmap v2026: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:13:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:09 smithi146 ceph-mon[35807]: pgmap v2026: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:13:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:09 smithi076 ceph-mon[35401]: pgmap v2026: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:13:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:11 smithi040 ceph-mon[32397]: pgmap v2027: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:13:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:11 smithi146 ceph-mon[35807]: pgmap v2027: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:13:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:11 smithi076 ceph-mon[35401]: pgmap v2027: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:13:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:13 smithi040 ceph-mon[32397]: pgmap v2028: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:13:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:13 smithi146 ceph-mon[35807]: pgmap v2028: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:13:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:13 smithi076 ceph-mon[35401]: pgmap v2028: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:13:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:15 smithi040 ceph-mon[32397]: pgmap v2029: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:13:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:15 smithi146 ceph-mon[35807]: pgmap v2029: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:13:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:15 smithi076 ceph-mon[35401]: pgmap v2029: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:13:17.446 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:17 smithi146 ceph-mon[35807]: pgmap v2030: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:13:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:17 smithi040 ceph-mon[32397]: pgmap v2030: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:13:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:17 smithi076 ceph-mon[35401]: pgmap v2030: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:13:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:19 smithi040 ceph-mon[32397]: pgmap v2031: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:13:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:19 smithi146 ceph-mon[35807]: pgmap v2031: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:13:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:19 smithi076 ceph-mon[35401]: pgmap v2031: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:13:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:21 smithi040 ceph-mon[32397]: pgmap v2032: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:13:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:21 smithi146 ceph-mon[35807]: pgmap v2032: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:13:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:21 smithi076 ceph-mon[35401]: pgmap v2032: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:13:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:23 smithi040 ceph-mon[32397]: pgmap v2033: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:23 smithi146 ceph-mon[35807]: pgmap v2033: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:23 smithi076 ceph-mon[35401]: pgmap v2033: 97 pgs: 97 active+clean; 9.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:25 smithi040 ceph-mon[32397]: pgmap v2034: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:13:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:25 smithi146 ceph-mon[35807]: pgmap v2034: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:13:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:25 smithi076 ceph-mon[35401]: pgmap v2034: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:13:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:27 smithi040 ceph-mon[32397]: pgmap v2035: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:13:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:27 smithi146 ceph-mon[35807]: pgmap v2035: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:13:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:27 smithi076 ceph-mon[35401]: pgmap v2035: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:13:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:29 smithi040 ceph-mon[32397]: pgmap v2036: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:29 smithi146 ceph-mon[35807]: pgmap v2036: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:29 smithi076 ceph-mon[35401]: pgmap v2036: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:31 smithi040 ceph-mon[32397]: pgmap v2037: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:13:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:31 smithi146 ceph-mon[35807]: pgmap v2037: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:13:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:31 smithi076 ceph-mon[35401]: pgmap v2037: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-07-26T13:13:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:33 smithi040 ceph-mon[32397]: pgmap v2038: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:33 smithi146 ceph-mon[35807]: pgmap v2038: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:33 smithi076 ceph-mon[35401]: pgmap v2038: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:35 smithi040 ceph-mon[32397]: pgmap v2039: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:13:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:35 smithi146 ceph-mon[35807]: pgmap v2039: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:13:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:35 smithi076 ceph-mon[35401]: pgmap v2039: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:13:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:37 smithi040 ceph-mon[32397]: pgmap v2040: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:13:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:37 smithi146 ceph-mon[35807]: pgmap v2040: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:13:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:37 smithi076 ceph-mon[35401]: pgmap v2040: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:13:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:39 smithi040 ceph-mon[32397]: pgmap v2041: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:13:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:39 smithi146 ceph-mon[35807]: pgmap v2041: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:13:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:39 smithi076 ceph-mon[35401]: pgmap v2041: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:13:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:41 smithi146 ceph-mon[35807]: pgmap v2042: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T13:13:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:41 smithi076 ceph-mon[35401]: pgmap v2042: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T13:13:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:41 smithi040 ceph-mon[32397]: pgmap v2042: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-07-26T13:13:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:42 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:13:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:42 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:13:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:42 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:13:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:43 smithi146 ceph-mon[35807]: pgmap v2043: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:13:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:13:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:13:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:43 smithi076 ceph-mon[35401]: pgmap v2043: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:13:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:13:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:13:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:43 smithi040 ceph-mon[32397]: pgmap v2043: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:13:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:13:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:13:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:13:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:45 smithi146 ceph-mon[35807]: pgmap v2044: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:13:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:45 smithi076 ceph-mon[35401]: pgmap v2044: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:13:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:45 smithi040 ceph-mon[32397]: pgmap v2044: 97 pgs: 97 active+clean; 9.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:13:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:47 smithi146 ceph-mon[35807]: pgmap v2045: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:13:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:47 smithi076 ceph-mon[35401]: pgmap v2045: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:13:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:47 smithi040 ceph-mon[32397]: pgmap v2045: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:13:49.542 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:49 smithi040 ceph-mon[32397]: pgmap v2046: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:13:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:49 smithi146 ceph-mon[35807]: pgmap v2046: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:13:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:49 smithi076 ceph-mon[35401]: pgmap v2046: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:13:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:50 smithi146 ceph-mon[35807]: pgmap v2047: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:13:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:50 smithi076 ceph-mon[35401]: pgmap v2047: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:13:50.613 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:50 smithi040 ceph-mon[32397]: pgmap v2047: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:13:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:52 smithi040 ceph-mon[32397]: pgmap v2048: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:13:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:52 smithi146 ceph-mon[35807]: pgmap v2048: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:13:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:52 smithi076 ceph-mon[35401]: pgmap v2048: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:13:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:54 smithi040 ceph-mon[32397]: pgmap v2049: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:13:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:54 smithi146 ceph-mon[35807]: pgmap v2049: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:13:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:54 smithi076 ceph-mon[35401]: pgmap v2049: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:13:55.992 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-07-26T13:13:55.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:13:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:13:56.977 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:56 smithi040 ceph-mon[32397]: pgmap v2050: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:13:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:56 smithi146 ceph-mon[35807]: pgmap v2050: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:13:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:56 smithi076 ceph-mon[35401]: pgmap v2050: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:13:58.975 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:13:58 smithi040 ceph-mon[32397]: pgmap v2051: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:13:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:13:58 smithi146 ceph-mon[35807]: pgmap v2051: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:13:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:13:58 smithi076 ceph-mon[35401]: pgmap v2051: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 -- 172.21.15.40:0/588982000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a010d650 msgr2=0x7f79a010fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 --2- 172.21.15.40:0/588982000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a010d650 0x7f79a010fb40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f7998009ca0 tx=0x7f799802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 -- 172.21.15.40:0/588982000 shutdown_connections 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 --2- 172.21.15.40:0/588982000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a010d650 0x7f79a010fb40 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 --2- 172.21.15.40:0/588982000 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a0104b40 0x7f79a010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 --2- 172.21.15.40:0/588982000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a01041f0 0x7f79a0104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:13:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 -- 172.21.15.40:0/588982000 >> 172.21.15.40:0/588982000 conn(0x7f79a00fdcf0 msgr2=0x7f79a0100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:13:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 -- 172.21.15.40:0/588982000 shutdown_connections 2024-07-26T13:13:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.756+0000 7f79a5c00640 1 -- 172.21.15.40:0/588982000 wait complete. 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.758+0000 7f79a5c00640 1 Processor -- start 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.758+0000 7f79a5c00640 1 -- start start 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a01041f0 0x7f79a0101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 0x7f79a0102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a010d650 0x7f79a01029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01131c0 con 0x7f79a0104b40 2024-07-26T13:13:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0113040 con 0x7f79a01041f0 2024-07-26T13:13:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0113340 con 0x7f79a010d650 2024-07-26T13:13:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f799f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 0x7f79a0102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:13:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f799f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 0x7f79a0102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44446/0 (socket says 172.21.15.40:44446) 2024-07-26T13:13:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f799f400640 1 -- 172.21.15.40:0/2885022157 learned_addr learned my addr 172.21.15.40:0/2885022157 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:13:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f799fe00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a01041f0 0x7f79a0101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:13:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.759+0000 7f79a5200640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a010d650 0x7f79a01029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799f400640 1 -- 172.21.15.40:0/2885022157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a010d650 msgr2=0x7f79a01029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799f400640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a010d650 0x7f79a01029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799f400640 1 -- 172.21.15.40:0/2885022157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a01041f0 msgr2=0x7f79a0101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799f400640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a01041f0 0x7f79a0101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799f400640 1 -- 172.21.15.40:0/2885022157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a01a7ed0 con 0x7f79a0104b40 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799fe00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a01041f0 0x7f79a0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.760+0000 7f799f400640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 0x7f79a0102470 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f798800d740 tx=0x7f798800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:13:59.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.761+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988017070 con 0x7f79a0104b40 2024-07-26T13:13:59.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.761+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f798800de50 con 0x7f79a0104b40 2024-07-26T13:13:59.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.761+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a01a81c0 con 0x7f79a0104b40 2024-07-26T13:13:59.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.761+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798800f620 con 0x7f79a0104b40 2024-07-26T13:13:59.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.761+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a01a8700 con 0x7f79a0104b40 2024-07-26T13:13:59.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.762+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a0104600 con 0x7f79a0104b40 2024-07-26T13:13:59.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.765+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f798801a070 con 0x7f79a0104b40 2024-07-26T13:13:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.768+0000 7f799cc00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79800b3bd0 0x7f79800b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:13:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.768+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f79880e3730 con 0x7f79a0104b40 2024-07-26T13:13:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.768+0000 7f799fe00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79800b3bd0 0x7f79800b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:13:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.769+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f79880aad40 con 0x7f79a0104b40 2024-07-26T13:13:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:13:59.769+0000 7f799fe00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79800b3bd0 0x7f79800b60e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7990005fd0 tx=0x7f7990005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.031+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79a01a8b00 con 0x7f79a0104b40 2024-07-26T13:14:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.032+0000 7f799cc00640 1 -- 172.21.15.40:0/2885022157 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f79880aa640 con 0x7f79a0104b40 2024-07-26T13:14:00.035 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:14:00.035 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:14:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:14:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79800b3bd0 msgr2=0x7f79800b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79800b3bd0 0x7f79800b60e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7990005fd0 tx=0x7f7990005850 comp rx=0 tx=0).stop 2024-07-26T13:14:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 msgr2=0x7f79a0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 0x7f79a0102470 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f798800d740 tx=0x7f798800dc00 comp rx=0 tx=0).stop 2024-07-26T13:14:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 shutdown_connections 2024-07-26T13:14:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f79800b3bd0 0x7f79800b60e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:00.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a010d650 0x7f79a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:00.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79a0104b40 0x7f79a0102470 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:00.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 --2- 172.21.15.40:0/2885022157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f79a01041f0 0x7f79a0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:00.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.036+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 >> 172.21.15.40:0/2885022157 conn(0x7f79a00fdcf0 msgr2=0x7f79a0107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:00.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.038+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 shutdown_connections 2024-07-26T13:14:00.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:00.038+0000 7f79a5c00640 1 -- 172.21.15.40:0/2885022157 wait complete. 2024-07-26T13:14:00.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:00 smithi040 ceph-mon[32397]: pgmap v2052: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:14:00.975 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-07-26T13:14:00.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-07-26T13:14:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:00 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2885022157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:00 smithi146 ceph-mon[35807]: pgmap v2052: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:14:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:00 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2885022157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:00 smithi076 ceph-mon[35401]: pgmap v2052: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:14:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:00 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2885022157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:01.628 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:14:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:02 smithi040 ceph-mon[32397]: pgmap v2053: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:14:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:02 smithi146 ceph-mon[35807]: pgmap v2053: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:14:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:02 smithi076 ceph-mon[35401]: pgmap v2053: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:14:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 -- 172.21.15.40:0/1242818080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd41019f0 msgr2=0x7f1cd4101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 --2- 172.21.15.40:0/1242818080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd41019f0 0x7f1cd4101e00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009900 tx=0x7f1cc402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 -- 172.21.15.40:0/1242818080 shutdown_connections 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 --2- 172.21.15.40:0/1242818080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 0x7f1cd41100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 --2- 172.21.15.40:0/1242818080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd4108f30 0x7f1cd4109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 --2- 172.21.15.40:0/1242818080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd41019f0 0x7f1cd4101e00 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 -- 172.21.15.40:0/1242818080 >> 172.21.15.40:0/1242818080 conn(0x7f1cd40797f0 msgr2=0x7f1cd4079c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 -- 172.21.15.40:0/1242818080 shutdown_connections 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.993+0000 7f1cd9200640 1 -- 172.21.15.40:0/1242818080 wait complete. 2024-07-26T13:14:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.994+0000 7f1cd9200640 1 Processor -- start 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.994+0000 7f1cd9200640 1 -- start start 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd41019f0 0x7f1cd419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 0x7f1cd419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd9200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 0x7f1cd41a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd9200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4113430 con 0x7f1cd4108f30 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd9200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41132b0 con 0x7f1cd4109880 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd9200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41135b0 con 0x7f1cd41019f0 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 0x7f1cd419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 0x7f1cd419c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57078/0 (socket says 172.21.15.40:57078) 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.995+0000 7f1cd1400640 1 -- 172.21.15.40:0/455608760 learned_addr learned my addr 172.21.15.40:0/455608760 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd41019f0 0x7f1cd419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd2800640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 0x7f1cd41a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1400640 1 -- 172.21.15.40:0/455608760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd41019f0 msgr2=0x7f1cd419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1400640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd41019f0 0x7f1cd419c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1400640 1 -- 172.21.15.40:0/455608760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 msgr2=0x7f1cd41a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1400640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 0x7f1cd41a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1400640 1 -- 172.21.15.40:0/455608760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd41a1f90 con 0x7f1cd4108f30 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd2800640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 0x7f1cd41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.996+0000 7f1cd1400640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 0x7f1cd419c680 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c8c0 tx=0x7f1cc000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.997+0000 7f1ccaa00640 1 -- 172.21.15.40:0/455608760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0007bb0 con 0x7f1cd4108f30 2024-07-26T13:14:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.997+0000 7f1ccaa00640 1 -- 172.21.15.40:0/455608760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cc0007d50 con 0x7f1cd4108f30 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.997+0000 7f1ccaa00640 1 -- 172.21.15.40:0/455608760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00186a0 con 0x7f1cd4108f30 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.997+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd41a2280 con 0x7f1cd4108f30 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:03.997+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd41a8aa0 con 0x7f1cd4108f30 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 Processor -- start 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 -- start start 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977d6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977d6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556f977a0d10 con 0x556f9740fb60 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556f9774bb60 con 0x556f97407980 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.001+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556f9773b060 con 0x556f97430840 2024-07-26T13:14:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.002+0000 7f1cd1e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977d6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.002+0000 7f1cd2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.002+0000 7f1cd2800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977d61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:56482/0 (socket says 172.21.15.40:56482) 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.002+0000 7f1cd2800640 1 -- 172.21.15.40:0/1639481678 learned_addr learned my addr 172.21.15.40:0/1639481678 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.003+0000 7f1cd2800640 1 -- 172.21.15.40:0/1639481678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 msgr2=0x556f977d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.003+0000 7f1cd2800640 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977d6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.003+0000 7f1cd2800640 1 -- 172.21.15.40:0/1639481678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 msgr2=0x556f977d6c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.003+0000 7f1cd2800640 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977d6c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.003+0000 7f1cd2800640 1 -- 172.21.15.40:0/1639481678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f976c2b10 con 0x556f97430840 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.003+0000 7f1cd2800640 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977d61c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc008de0 tx=0x7f1ccc00d710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ef3c5aef0cc910 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.004+0000 7f1cbf400640 1 -- 172.21.15.40:0/1639481678 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00f830 con 0x556f97430840 2024-07-26T13:14:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.004+0000 7f1cbf400640 1 -- 172.21.15.40:0/1639481678 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ccc00e3b0 con 0x556f97430840 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.004+0000 7f1cbf400640 1 -- 172.21.15.40:0/1639481678 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00fe60 con 0x556f97430840 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1ccaa00640 1 -- 172.21.15.40:0/455608760 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1cc000fa00 con 0x7f1cd4108f30 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1639481678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 msgr2=0x556f977d61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977d61c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc008de0 tx=0x7f1ccc00d710 comp rx=0 tx=0).stop 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1639481678 shutdown_connections 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977d6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977d6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1639481678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977d61c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.005+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1639481678 >> 172.21.15.40:0/1639481678 conn(0x556f97424990 msgr2=0x556f977d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.006+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1639481678 shutdown_connections 2024-07-26T13:14:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.006+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1639481678 wait complete. 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.006+0000 7f1cdfe61740 1 -- start start 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 Processor -- start 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1ccaa00640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3b10 0x7f1cb80b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f9740fb60 0x556f977e2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 0x556f977edb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556f976d7520 con 0x556f97430840 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556f9773f0a0 con 0x556f97407980 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556f9759e7a0 con 0x556f9740fb60 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1cdfe61740 10 client.0 _ll_register_callbacks cb 0x556f97733bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.007+0000 7f1ccaa00640 1 -- 172.21.15.40:0/455608760 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1cc00e3d30 con 0x7f1cd4108f30 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd2800640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3b10 0x7f1cb80b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 0x556f977edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 0x556f977edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57082/0 (socket says 172.21.15.40:57082) 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd2800640 1 -- 172.21.15.40:0/1583974972 learned_addr learned my addr 172.21.15.40:0/1583974972 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd1400640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f9740fb60 0x556f977e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd2800640 1 -- 172.21.15.40:0/1583974972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f9740fb60 msgr2=0x556f977e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.008+0000 7f1cd2800640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f9740fb60 0x556f977e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cd2800640 1 -- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 msgr2=0x556f977e1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cd2800640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977e1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cd2800640 1 -- 172.21.15.40:0/1583974972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f974aab90 con 0x556f97430840 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cd2800640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3b10 0x7f1cb80b6020 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00ec50 tx=0x7f1ccc00ee50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cd2800640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 0x556f977edb40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc005cc0 tx=0x7f1ccc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f0082e63933187 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cb3e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cb3e00640 1 -- 172.21.15.40:0/1583974972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc004c40 con 0x556f97430840 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.009+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ccc00e3b0 con 0x556f97430840 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.010+0000 7f1cb3e00640 1 -- 172.21.15.40:0/1583974972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ccc004de0 con 0x556f97430840 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.010+0000 7f1cb3e00640 1 -- 172.21.15.40:0/1583974972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ccc018480 con 0x556f97430840 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.010+0000 7f1cdfe61740 10 client.17538 fetch_fsmap learned FSMap version 35 2024-07-26T13:14:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.010+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556f977f0810 con 0x556f97430840 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.010+0000 7f1cb3e00640 1 -- 172.21.15.40:0/1583974972 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ccc00e3b0 con 0x556f97430840 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.010+0000 7f1cb3e00640 1 -- 172.21.15.40:0/1583974972 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1ccc005030 con 0x556f97430840 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cdfe61740 10 client.17538 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cdfe61740 10 client.17538 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cdfe61740 20 client.17538 populate_metadata read hostname 'smithi040' 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973ef1c0 0x556f977f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cdfe61740 4 client.17538 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f9774dab0 con 0x556f973ef1c0 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.011+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973ef1c0 0x556f977f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.012+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973ef1c0 0x556f977f3bc0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=903c1b4d735aec65 server_cookie=602ad715387395f5 in_seq=0 out_seq=0 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.012+0000 7f1cb3e00640 10 client.17538 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.014+0000 7f1cb3e00640 1 -- 172.21.15.40:0/1583974972 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f9774dab0 con 0x556f973ef1c0 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.014+0000 7f1cb3e00640 10 client.17538 handle_command_reply: tid=0 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.014+0000 7f1cdfe61740 1 client.17538 shutdown 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 msgr2=0x556f977edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 0x556f977edb40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc005cc0 tx=0x7f1ccc00d710 comp rx=0 tx=0).stop 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 shutdown_connections 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973ef1c0 0x556f977f3bc0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97430840 0x556f977edb40 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f9740fb60 0x556f977e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/1583974972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97407980 0x556f977e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cb3e00640 0 client.17538 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 >> 172.21.15.40:0/1583974972 conn(0x556f97424990 msgr2=0x556f977d9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 shutdown_connections 2024-07-26T13:14:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 1 -- 172.21.15.40:0/1583974972 wait complete. 2024-07-26T13:14:04.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.015+0000 7f1cdfe61740 20 client.17538 trim_cache size 0 max 16384 2024-07-26T13:14:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.038+0000 7f1cdfe61740 1 Processor -- start 2024-07-26T13:14:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.038+0000 7f1cdfe61740 1 -- start start 2024-07-26T13:14:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 0x556f977e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f9740fb60 0x556f977dd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41b1050 con 0x556f97407980 2024-07-26T13:14:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41b2b90 con 0x556f9740fb60 2024-07-26T13:14:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41b1720 con 0x556f97430840 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cd1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 0x556f977e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cd1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 0x556f977e3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57084/0 (socket says 172.21.15.40:57084) 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cd1e00640 1 -- 172.21.15.40:0/2671597537 learned_addr learned my addr 172.21.15.40:0/2671597537 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cd1400640 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f9740fb60 0x556f977dd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.039+0000 7f1cd2800640 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cd1e00640 1 -- 172.21.15.40:0/2671597537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 msgr2=0x556f977e1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977e1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cd1e00640 1 -- 172.21.15.40:0/2671597537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f9740fb60 msgr2=0x556f977dd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f9740fb60 0x556f977dd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cd1e00640 1 -- 172.21.15.40:0/2671597537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f977d90c0 con 0x556f97407980 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 0x556f977e3a00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4005ab0 tx=0x7f1cc4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db3309987ab5b75 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cbea00640 1 -- 172.21.15.40:0/2671597537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4035040 con 0x556f97407980 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cbea00640 1 -- 172.21.15.40:0/2671597537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cc4046340 con 0x556f97407980 2024-07-26T13:14:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.040+0000 7f1cbea00640 1 -- 172.21.15.40:0/2671597537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc403d6b0 con 0x556f97407980 2024-07-26T13:14:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.041+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2671597537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 msgr2=0x556f977e3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.041+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 0x556f977e3a00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4005ab0 tx=0x7f1cc4005a20 comp rx=0 tx=0).stop 2024-07-26T13:14:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2671597537 shutdown_connections 2024-07-26T13:14:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97430840 0x556f977e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f9740fb60 0x556f977dd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2671597537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f97407980 0x556f977e3a00 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2671597537 >> 172.21.15.40:0/2671597537 conn(0x556f97424990 msgr2=0x556f977d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2671597537 shutdown_connections 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2671597537 wait complete. 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.042+0000 7f1cdfe61740 1 -- start start 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 Processor -- start 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97407980 0x556f977e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97430840 0x556f977ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41b24c0 con 0x556f9740fb60 2024-07-26T13:14:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41b1df0 con 0x556f97430840 2024-07-26T13:14:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41af010 con 0x556f97407980 2024-07-26T13:14:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cdfe61740 10 client.0 _ll_register_callbacks cb 0x7f1cc4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:14:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.043+0000 7f1cd1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977e9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57090/0 (socket says 172.21.15.40:57090) 2024-07-26T13:14:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 -- 172.21.15.40:0/2548440902 learned_addr learned my addr 172.21.15.40:0/2548440902 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97407980 0x556f977e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd2800640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97430840 0x556f977ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 -- 172.21.15.40:0/2548440902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97407980 msgr2=0x556f977e9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97407980 0x556f977e9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 -- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97430840 msgr2=0x556f977ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97430840 0x556f977ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.044+0000 7f1cd1400640 1 -- 172.21.15.40:0/2548440902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f977d37e0 con 0x556f9740fb60 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cd1400640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977e9fe0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000cfd0 tx=0x7f1cc00aa850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96785f7617a75fff server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cb3e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cb3e00640 1 -- 172.21.15.40:0/2548440902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc001f510 con 0x556f9740fb60 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cb3e00640 1 -- 172.21.15.40:0/2548440902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1cc00aaee0 con 0x556f9740fb60 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cc4046340 con 0x556f9740fb60 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cb3e00640 1 -- 172.21.15.40:0/2548440902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1cc00af280 con 0x556f9740fb60 2024-07-26T13:14:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cdfe61740 10 client.17544 fetch_fsmap learned FSMap version 35 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.045+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556f9785c400 con 0x556f9740fb60 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cb3e00640 1 -- 172.21.15.40:0/2548440902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cc4046340 con 0x556f9740fb60 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cb3e00640 1 -- 172.21.15.40:0/2548440902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f1cc00920b0 con 0x556f9740fb60 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cdfe61740 10 client.17544 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cdfe61740 10 client.17544 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cdfe61740 20 client.17544 populate_metadata read hostname 'smithi040' 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973c4570 0x556f9785ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cdfe61740 4 client.17544 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.046+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x556f97749550 con 0x556f973c4570 2024-07-26T13:14:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.047+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973c4570 0x556f9785ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.048+0000 7f1cd1e00640 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973c4570 0x556f9785ebb0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96f3d8c06a97b9 server_cookie=674abd569a7fb0b3 in_seq=0 out_seq=0 2024-07-26T13:14:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.048+0000 7f1cb3e00640 10 client.17544 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.344+0000 7f1cb3e00640 1 -- 172.21.15.40:0/2548440902 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x556f97749550 con 0x556f973c4570 2024-07-26T13:14:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.344+0000 7f1cb3e00640 10 client.17544 handle_command_reply: tid=0 2024-07-26T13:14:04.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.344+0000 7f1cdfe61740 1 client.17544 shutdown 2024-07-26T13:14:04.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 msgr2=0x556f977e9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977e9fe0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000cfd0 tx=0x7f1cc00aa850 comp rx=0 tx=0).stop 2024-07-26T13:14:04.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 shutdown_connections 2024-07-26T13:14:04.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556f97430840 0x556f977ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556f973c4570 0x556f9785ebb0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556f9740fb60 0x556f977e9fe0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 --2- 172.21.15.40:0/2548440902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f97407980 0x556f977e9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 >> 172.21.15.40:0/2548440902 conn(0x556f97424990 msgr2=0x556f977e38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.345+0000 7f1cb3e00640 0 client.17544 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.346+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 shutdown_connections 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.346+0000 7f1cdfe61740 1 -- 172.21.15.40:0/2548440902 wait complete. 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.346+0000 7f1cdfe61740 20 client.17544 trim_cache size 0 max 16384 2024-07-26T13:14:04.348 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 174, 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "a8cb07cb": { 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 174, 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:14:04.349 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 136.6, 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:04.350 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:14:04.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.347+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3b10 msgr2=0x7f1cb80b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.347+0000 7f1cd9200640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3b10 0x7f1cb80b6020 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00ec50 tx=0x7f1ccc00ee50 comp rx=0 tx=0).stop 2024-07-26T13:14:04.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.347+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 msgr2=0x7f1cd419c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:04.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.347+0000 7f1cd9200640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 0x7f1cd419c680 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c8c0 tx=0x7f1cc000cd80 comp rx=0 tx=0).stop 2024-07-26T13:14:04.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 shutdown_connections 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1cd4109880 0x7f1cd41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cd4108f30 0x7f1cd419c680 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1cb80b3b10 0x7f1cb80b6020 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 --2- 172.21.15.40:0/455608760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cd41019f0 0x7f1cd419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 >> 172.21.15.40:0/455608760 conn(0x7f1cd40797f0 msgr2=0x7f1cd4106d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 shutdown_connections 2024-07-26T13:14:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:04.348+0000 7f1cd9200640 1 -- 172.21.15.40:0/455608760 wait complete. 2024-07-26T13:14:05.144 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:04 smithi040 ceph-mon[32397]: pgmap v2054: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:14:05.216 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a8cb07cb', quiesce took 9.2 seconds. Will release after: 7.400000000000002 2024-07-26T13:14:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:04 smithi146 ceph-mon[35807]: pgmap v2054: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:14:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:04 smithi076 ceph-mon[35401]: pgmap v2054: 97 pgs: 97 active+clean; 9.7 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:14:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:06 smithi040 ceph-mon[32397]: pgmap v2055: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:14:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:06 smithi146 ceph-mon[35807]: pgmap v2055: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:14:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:06 smithi076 ceph-mon[35401]: pgmap v2055: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:14:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:08 smithi040 ceph-mon[32397]: pgmap v2056: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:14:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:08 smithi146 ceph-mon[35807]: pgmap v2056: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:14:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:08 smithi076 ceph-mon[35401]: pgmap v2056: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:14:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:10 smithi040 ceph-mon[32397]: pgmap v2057: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:14:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:10 smithi146 ceph-mon[35807]: pgmap v2057: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:14:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:10 smithi076 ceph-mon[35401]: pgmap v2057: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:14:12.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:14:13.156 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:14:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:12 smithi040 ceph-mon[32397]: pgmap v2058: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T13:14:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:12 smithi146 ceph-mon[35807]: pgmap v2058: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T13:14:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:12 smithi076 ceph-mon[35401]: pgmap v2058: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 9 op/s 2024-07-26T13:14:15.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:14 smithi040 ceph-mon[32397]: pgmap v2059: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:14:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:14 smithi146 ceph-mon[35807]: pgmap v2059: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:14:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:14 smithi076 ceph-mon[35401]: pgmap v2059: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 -- 172.21.15.40:0/3896818769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 msgr2=0x7f37d0109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 --2- 172.21.15.40:0/3896818769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0109110 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009900 tx=0x7f37bc02a400 comp rx=0 tx=0).stop 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 -- 172.21.15.40:0/3896818769 shutdown_connections 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 --2- 172.21.15.40:0/3896818769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d0109650 0x7f37d010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 --2- 172.21.15.40:0/3896818769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0109110 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 --2- 172.21.15.40:0/3896818769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d01033c0 0x7f37d01037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 -- 172.21.15.40:0/3896818769 >> 172.21.15.40:0/3896818769 conn(0x7f37d00fee10 msgr2=0x7f37d0101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 -- 172.21.15.40:0/3896818769 shutdown_connections 2024-07-26T13:14:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.384+0000 7f37d5e00640 1 -- 172.21.15.40:0/3896818769 wait complete. 2024-07-26T13:14:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 Processor -- start 2024-07-26T13:14:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 -- start start 2024-07-26T13:14:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d01033c0 0x7f37d0075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d0109650 0x7f37d0075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f37d0113170 con 0x7f37d0108d00 2024-07-26T13:14:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f37d0112ff0 con 0x7f37d01033c0 2024-07-26T13:14:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.386+0000 7f37d5e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f37d01132f0 con 0x7f37d0109650 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.387+0000 7f37cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.387+0000 7f37cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37366/0 (socket says 172.21.15.40:37366) 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.387+0000 7f37cfe00640 1 -- 172.21.15.40:0/2521659512 learned_addr learned my addr 172.21.15.40:0/2521659512 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.387+0000 7f37d4a00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d01033c0 0x7f37d0075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.387+0000 7f37d5400640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d0109650 0x7f37d0075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cfe00640 1 -- 172.21.15.40:0/2521659512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d0109650 msgr2=0x7f37d0075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cfe00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d0109650 0x7f37d0075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cfe00640 1 -- 172.21.15.40:0/2521659512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d01033c0 msgr2=0x7f37d0075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cfe00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d01033c0 0x7f37d0075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cfe00640 1 -- 172.21.15.40:0/2521659512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d01a7e50 con 0x7f37d0108d00 2024-07-26T13:14:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cfe00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0075680 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f37bc005940 tx=0x7f37bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc03f030 con 0x7f37d0108d00 2024-07-26T13:14:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37bc003c90 con 0x7f37d0108d00 2024-07-26T13:14:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc035070 con 0x7f37d0108d00 2024-07-26T13:14:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.388+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d01a80e0 con 0x7f37d0108d00 2024-07-26T13:14:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.389+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d01a8610 con 0x7f37d0108d00 2024-07-26T13:14:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.390+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d01037d0 con 0x7f37d0108d00 2024-07-26T13:14:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.393+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f37bc042030 con 0x7f37d0108d00 2024-07-26T13:14:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.395+0000 7f37cd600640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f37b80b3c50 0x7f37b80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.395+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f37bc1045f0 con 0x7f37d0108d00 2024-07-26T13:14:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.395+0000 7f37d4a00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f37b80b3c50 0x7f37b80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.396+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f37bc0cbc00 con 0x7f37d0108d00 2024-07-26T13:14:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.396+0000 7f37d4a00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f37b80b3c50 0x7f37b80b6160 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37d0076b90 tx=0x7f37c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.644+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37d010b490 con 0x7f37d0108d00 2024-07-26T13:14:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.645+0000 7f37cd600640 1 -- 172.21.15.40:0/2521659512 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f37d010b490 con 0x7f37d0108d00 2024-07-26T13:14:15.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:14:15.647 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:14:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:14:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.649+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f37b80b3c50 msgr2=0x7f37b80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.649+0000 7f37d5e00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f37b80b3c50 0x7f37b80b6160 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37d0076b90 tx=0x7f37c400a2d0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.649+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 msgr2=0x7f37d0075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.649+0000 7f37d5e00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0075680 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f37bc005940 tx=0x7f37bc0042f0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 shutdown_connections 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f37b80b3c50 0x7f37b80b6160 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d0109650 0x7f37d0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d0108d00 0x7f37d0075680 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 --2- 172.21.15.40:0/2521659512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d01033c0 0x7f37d0075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 >> 172.21.15.40:0/2521659512 conn(0x7f37d00fee10 msgr2=0x7f37d0101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 shutdown_connections 2024-07-26T13:14:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:15.650+0000 7f37d5e00640 1 -- 172.21.15.40:0/2521659512 wait complete. 2024-07-26T13:14:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:15 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2521659512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:15 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2521659512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:15 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2521659512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:16.479 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id a8cb07cb --release --await' 2024-07-26T13:14:16.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id a8cb07cb --release --await 2024-07-26T13:14:16.968 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:14:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:16 smithi040 ceph-mon[32397]: pgmap v2060: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:14:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:16 smithi146 ceph-mon[35807]: pgmap v2060: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:14:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:16 smithi076 ceph-mon[35401]: pgmap v2060: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.062+0000 7f0827e00640 1 -- 172.21.15.40:0/1970661558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033c0 msgr2=0x7f08281037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.062+0000 7f0827e00640 1 --2- 172.21.15.40:0/1970661558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033c0 0x7f08281037d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f0818009900 tx=0x7f081802a410 comp rx=0 tx=0).stop 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.062+0000 7f0827e00640 1 -- 172.21.15.40:0/1970661558 shutdown_connections 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.062+0000 7f0827e00640 1 --2- 172.21.15.40:0/1970661558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109650 0x7f082810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.062+0000 7f0827e00640 1 --2- 172.21.15.40:0/1970661558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828108d00 0x7f0828109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.062+0000 7f0827e00640 1 --2- 172.21.15.40:0/1970661558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033c0 0x7f08281037d0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.063+0000 7f0827e00640 1 -- 172.21.15.40:0/1970661558 >> 172.21.15.40:0/1970661558 conn(0x7f08280fee10 msgr2=0x7f0828101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.063+0000 7f0827e00640 1 -- 172.21.15.40:0/1970661558 shutdown_connections 2024-07-26T13:14:19.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.063+0000 7f0827e00640 1 -- 172.21.15.40:0/1970661558 wait complete. 2024-07-26T13:14:19.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.064+0000 7f0827e00640 1 Processor -- start 2024-07-26T13:14:19.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 -- start start 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08281033c0 0x7f0828199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 0x7f082819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109650 0x7f082819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08281131b0 con 0x7f0828108d00 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0828113030 con 0x7f08281033c0 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.065+0000 7f0827e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0828113330 con 0x7f0828109650 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 0x7f082819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 0x7f082819a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37374/0 (socket says 172.21.15.40:37374) 2024-07-26T13:14:19.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 -- 172.21.15.40:0/4110075263 learned_addr learned my addr 172.21.15.40:0/4110075263 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:19.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826a00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08281033c0 0x7f0828199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0827400640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109650 0x7f082819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 -- 172.21.15.40:0/4110075263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109650 msgr2=0x7f082819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109650 0x7f082819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 -- 172.21.15.40:0/4110075263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08281033c0 msgr2=0x7f0828199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08281033c0 0x7f0828199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.066+0000 7f0826000640 1 -- 172.21.15.40:0/4110075263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082819fbb0 con 0x7f0828108d00 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.067+0000 7f0826000640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 0x7f082819a1e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f081400d740 tx=0x7f081400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.067+0000 7f081f400640 1 -- 172.21.15.40:0/4110075263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814017070 con 0x7f0828108d00 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.067+0000 7f081f400640 1 -- 172.21.15.40:0/4110075263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f081400de50 con 0x7f0828108d00 2024-07-26T13:14:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.067+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082819fea0 con 0x7f0828108d00 2024-07-26T13:14:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.067+0000 7f081f400640 1 -- 172.21.15.40:0/4110075263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081400f620 con 0x7f0828108d00 2024-07-26T13:14:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.067+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08281a6600 con 0x7f0828108d00 2024-07-26T13:14:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.072+0000 7f08342cb740 1 Processor -- start 2024-07-26T13:14:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.072+0000 7f08342cb740 1 -- start start 2024-07-26T13:14:19.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f08342cb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b2f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f08342cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b2f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f08342cb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90769840 0x560d90b2fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f08342cb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560d90aa5f50 con 0x560d9078a520 2024-07-26T13:14:19.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f08342cb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560d90a95450 con 0x560d90769840 2024-07-26T13:14:19.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f08342cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560d90a99490 con 0x560d90761660 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f0827400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b2f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f0827400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b2f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37390/0 (socket says 172.21.15.40:37390) 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f0827400640 1 -- 172.21.15.40:0/3422428662 learned_addr learned my addr 172.21.15.40:0/3422428662 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.073+0000 7f081f400640 1 -- 172.21.15.40:0/4110075263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f081401a070 con 0x7f0828108d00 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0826a00640 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b2f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0827400640 1 -- 172.21.15.40:0/3422428662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 msgr2=0x560d90b2f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0827400640 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b2f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0827400640 1 -- 172.21.15.40:0/3422428662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90769840 msgr2=0x560d90b2fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0827400640 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90769840 0x560d90b2fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0827400640 1 -- 172.21.15.40:0/3422428662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d907f5b00 con 0x560d9078a520 2024-07-26T13:14:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.074+0000 7f0827400640 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b2f1a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0820010370 tx=0x7f0820010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7895dde30bdf108d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.075+0000 7f0813400640 1 -- 172.21.15.40:0/3422428662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820016070 con 0x560d9078a520 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.075+0000 7f0813400640 1 -- 172.21.15.40:0/3422428662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0820004d20 con 0x560d9078a520 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.075+0000 7f0813400640 1 -- 172.21.15.40:0/3422428662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820012720 con 0x560d9078a520 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.075+0000 7f081f400640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3c50 0x7f080c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f081f400640 1 -- 172.21.15.40:0/4110075263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08140e3540 con 0x7f0828108d00 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 -- 172.21.15.40:0/3422428662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 msgr2=0x560d90b2f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b2f1a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0820010370 tx=0x7f0820010830 comp rx=0 tx=0).stop 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f0826a00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3c50 0x7f080c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 -- 172.21.15.40:0/3422428662 shutdown_connections 2024-07-26T13:14:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90769840 0x560d90b2fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b2f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 --2- 172.21.15.40:0/3422428662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b2f1a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 -- 172.21.15.40:0/3422428662 >> 172.21.15.40:0/3422428662 conn(0x560d9077e910 msgr2=0x560d90b2d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 -- 172.21.15.40:0/3422428662 shutdown_connections 2024-07-26T13:14:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.076+0000 7f08342cb740 1 -- 172.21.15.40:0/3422428662 wait complete. 2024-07-26T13:14:19.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.077+0000 7f0826a00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3c50 0x7f080c0b6160 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f08180057c0 tx=0x7f08180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:19.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.077+0000 7f08342cb740 1 -- start start 2024-07-26T13:14:19.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.077+0000 7f08342cb740 1 Processor -- start 2024-07-26T13:14:19.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b3ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 0x560d90b3f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560d908f8bb0 con 0x560d90769840 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560d90a31930 con 0x560d9078a520 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560d90b41ce0 con 0x560d90761660 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f08342cb740 10 client.0 _ll_register_callbacks cb 0x560d907a1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f0826000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 0x560d90b3f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f0826000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 0x560d90b3f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37404/0 (socket says 172.21.15.40:37404) 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.078+0000 7f0826000640 1 -- 172.21.15.40:0/2709162215 learned_addr learned my addr 172.21.15.40:0/2709162215 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826a00640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b3ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0827400640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826000640 1 -- 172.21.15.40:0/2709162215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 msgr2=0x560d90b3ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826000640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b3ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826000640 1 -- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 msgr2=0x560d90b4b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826000640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826000640 1 -- 172.21.15.40:0/2709162215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9086c960 con 0x560d90769840 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826a00640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b3ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:14:19.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0826000640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 0x560d90b3f190 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0814010c00 tx=0x7f08140a9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07d26094ea74198 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.079+0000 7f0807e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f0807e00640 1 -- 172.21.15.40:0/2709162215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814021050 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f0807e00640 1 -- 172.21.15.40:0/2709162215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08140a6790 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0820004d20 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f0807e00640 1 -- 172.21.15.40:0/2709162215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f08140aea50 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f08342cb740 10 client.17562 fetch_fsmap learned FSMap version 35 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d90b4da20 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.080+0000 7f0807e00640 1 -- 172.21.15.40:0/2709162215 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0820004d20 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f0807e00640 1 -- 172.21.15.40:0/2709162215 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f08140bfc10 con 0x560d90769840 2024-07-26T13:14:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f08342cb740 10 client.17562 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:14:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f08342cb740 10 client.17562 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:14:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f08342cb740 20 client.17562 populate_metadata read hostname 'smithi040' 2024-07-26T13:14:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f08342cb740 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d90748ea0 0x560d90b50d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f08342cb740 4 client.17562 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:14:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.081+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d90aa7ea0 con 0x560d90748ea0 2024-07-26T13:14:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.082+0000 7f0826a00640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d90748ea0 0x560d90b50d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.083+0000 7f0826a00640 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d90748ea0 0x560d90b50d80 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb3ad1753856a23 server_cookie=4e3d92c81fea1caa in_seq=0 out_seq=0 2024-07-26T13:14:19.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.083+0000 7f0807e00640 10 client.17562 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f0807e00640 1 -- 172.21.15.40:0/2709162215 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d90aa7ea0 con 0x560d90748ea0 2024-07-26T13:14:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f0807e00640 10 client.17562 handle_command_reply: tid=0 2024-07-26T13:14:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f08342cb740 1 client.17562 shutdown 2024-07-26T13:14:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 msgr2=0x560d90b3f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f08342cb740 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 0x560d90b3f190 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0814010c00 tx=0x7f08140a9d60 comp rx=0 tx=0).stop 2024-07-26T13:14:19.087 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:18 smithi040 ceph-mon[32397]: pgmap v2061: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 shutdown_connections 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f08342cb740 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.085+0000 7f08342cb740 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d90748ea0 0x560d90b50d80 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.086+0000 7f08342cb740 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90769840 0x560d90b3f190 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.086+0000 7f08342cb740 1 --2- 172.21.15.40:0/2709162215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90761660 0x560d90b3ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.086+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 >> 172.21.15.40:0/2709162215 conn(0x560d9077e910 msgr2=0x560d90b2b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.086+0000 7f0807e00640 0 client.17562 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:19.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.086+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 shutdown_connections 2024-07-26T13:14:19.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.086+0000 7f08342cb740 1 -- 172.21.15.40:0/2709162215 wait complete. 2024-07-26T13:14:19.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.087+0000 7f08342cb740 20 client.17562 trim_cache size 0 max 16384 2024-07-26T13:14:19.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 Processor -- start 2024-07-26T13:14:19.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 -- start start 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 0x560d90b40b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b4ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08281ac9a0 con 0x560d90761660 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f08281ae4e0 con 0x560d9078a520 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.106+0000 7f08342cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08281ad070 con 0x560d90769840 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 0x560d90b40b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 0x560d90b40b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37414/0 (socket says 172.21.15.40:37414) 2024-07-26T13:14:19.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 -- 172.21.15.40:0/2469544717 learned_addr learned my addr 172.21.15.40:0/2469544717 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:19.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0827400640 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826000640 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b4ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 -- 172.21.15.40:0/2469544717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 msgr2=0x560d90b4ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b4ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 -- 172.21.15.40:0/2469544717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 msgr2=0x560d90b4b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 -- 172.21.15.40:0/2469544717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d90b2ff90 con 0x560d90761660 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0827400640 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.107+0000 7f0826a00640 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 0x560d90b40b30 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f0818033000 tx=0x7f081803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77596670bf453255 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.108+0000 7f0812a00640 1 -- 172.21.15.40:0/2469544717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818035070 con 0x560d90761660 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.108+0000 7f0812a00640 1 -- 172.21.15.40:0/2469544717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0818004360 con 0x560d90761660 2024-07-26T13:14:19.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.108+0000 7f0812a00640 1 -- 172.21.15.40:0/2469544717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081804f620 con 0x560d90761660 2024-07-26T13:14:19.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 -- 172.21.15.40:0/2469544717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 msgr2=0x560d90b40b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 0x560d90b40b30 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f0818033000 tx=0x7f081803f000 comp rx=0 tx=0).stop 2024-07-26T13:14:19.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 -- 172.21.15.40:0/2469544717 shutdown_connections 2024-07-26T13:14:19.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d9078a520 0x560d90b4b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b4ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 --2- 172.21.15.40:0/2469544717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d90761660 0x560d90b40b30 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 -- 172.21.15.40:0/2469544717 >> 172.21.15.40:0/2469544717 conn(0x560d9077e910 msgr2=0x560d90b301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:19.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 -- 172.21.15.40:0/2469544717 shutdown_connections 2024-07-26T13:14:19.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 -- 172.21.15.40:0/2469544717 wait complete. 2024-07-26T13:14:19.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.109+0000 7f08342cb740 1 -- start start 2024-07-26T13:14:19.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 Processor -- start 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90761660 0x560d90b47680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b43b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b44080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08281ade10 con 0x560d9078a520 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f08281ad740 con 0x560d90761660 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08281aa960 con 0x560d90769840 2024-07-26T13:14:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.110+0000 7f08342cb740 10 client.0 _ll_register_callbacks cb 0x7f0814010b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b44080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b44080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37424/0 (socket says 172.21.15.40:37424) 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 -- 172.21.15.40:0/2212327383 learned_addr learned my addr 172.21.15.40:0/2212327383 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0826a00640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90761660 0x560d90b47680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0826000640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b43b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 -- 172.21.15.40:0/2212327383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 msgr2=0x560d90b43b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b43b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 -- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90761660 msgr2=0x560d90b47680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90761660 0x560d90b47680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0827400640 1 -- 172.21.15.40:0/2212327383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d90b44810 con 0x560d9078a520 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.111+0000 7f0826a00640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90761660 0x560d90b47680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:14:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f0827400640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b44080 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f0820006010 tx=0x7f0820004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb87fadcaac5a0e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:19.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f0807e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:14:19.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f0807e00640 1 -- 172.21.15.40:0/2212327383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820016050 con 0x560d9078a520 2024-07-26T13:14:19.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f0807e00640 1 -- 172.21.15.40:0/2212327383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0820005450 con 0x560d9078a520 2024-07-26T13:14:19.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0818004360 con 0x560d9078a520 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f0807e00640 1 -- 172.21.15.40:0/2212327383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0820005650 con 0x560d9078a520 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f08342cb740 10 client.17568 fetch_fsmap learned FSMap version 35 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.112+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d90bba470 con 0x560d9078a520 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f0807e00640 1 -- 172.21.15.40:0/2212327383 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0818004360 con 0x560d9078a520 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f0807e00640 1 -- 172.21.15.40:0/2212327383 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f082000f040 con 0x560d9078a520 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f08342cb740 10 client.17568 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f08342cb740 10 client.17568 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f08342cb740 20 client.17568 populate_metadata read hostname 'smithi040' 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f08342cb740 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d9071e250 0x560d90bbc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f08342cb740 4 client.17568 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a8cb07cb", "release": true, "await": true}] 2024-07-26T13:14:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.113+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a8cb07cb", "release": true, "await": true}) -- 0x560d90aa3940 con 0x560d9071e250 2024-07-26T13:14:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.114+0000 7f0826a00640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d9071e250 0x560d90bbc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.115+0000 7f0826a00640 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d9071e250 0x560d90bbc9f0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=225c41b8a44d0f60 server_cookie=e98c0a462bc08bee in_seq=0 out_seq=0 2024-07-26T13:14:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.115+0000 7f0807e00640 10 client.17568 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:19.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.168+0000 7f0807e00640 1 -- 172.21.15.40:0/2212327383 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x560d90aa3940 con 0x560d9071e250 2024-07-26T13:14:19.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.168+0000 7f0807e00640 10 client.17568 handle_command_reply: tid=0 2024-07-26T13:14:19.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.168+0000 7f08342cb740 1 client.17568 shutdown 2024-07-26T13:14:19.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 msgr2=0x560d90b44080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b44080 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f0820006010 tx=0x7f0820004e00 comp rx=0 tx=0).stop 2024-07-26T13:14:19.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 shutdown_connections 2024-07-26T13:14:19.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560d9071e250 0x560d90bbc9f0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560d9078a520 0x560d90b44080 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d90769840 0x560d90b43b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 --2- 172.21.15.40:0/2212327383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d90761660 0x560d90b47680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f0807e00640 0 client.17568 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:14:19.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.169+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 >> 172.21.15.40:0/2212327383 conn(0x560d9077e910 msgr2=0x560d90b3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:19.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.170+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 shutdown_connections 2024-07-26T13:14:19.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.170+0000 7f08342cb740 1 -- 172.21.15.40:0/2212327383 wait complete. 2024-07-26T13:14:19.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.170+0000 7f08342cb740 20 client.17568 trim_cache size 0 max 16384 2024-07-26T13:14:19.173 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:14:19.173 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:14:19.173 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:14:19.173 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 176, 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "a8cb07cb": { 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 176, 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 136.6, 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:14:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:14:19.175 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3c50 msgr2=0x7f080c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3c50 0x7f080c0b6160 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f08180057c0 tx=0x7f08180058d0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 msgr2=0x7f082819a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 0x7f082819a1e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f081400d740 tx=0x7f081400dc00 comp rx=0 tx=0).stop 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 shutdown_connections 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3c50 0x7f080c0b6160 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109650 0x7f082819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d00 0x7f082819a1e0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 --2- 172.21.15.40:0/4110075263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f08281033c0 0x7f0828199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.172+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 >> 172.21.15.40:0/4110075263 conn(0x7f08280fee10 msgr2=0x7f0828101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.173+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 shutdown_connections 2024-07-26T13:14:19.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:19.173+0000 7f0827e00640 1 -- 172.21.15.40:0/4110075263 wait complete. 2024-07-26T13:14:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:18 smithi146 ceph-mon[35807]: pgmap v2061: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:14:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:18 smithi076 ceph-mon[35401]: pgmap v2061: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:14:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:20 smithi146 ceph-mon[35807]: pgmap v2062: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 699 KiB/s wr, 12 op/s 2024-07-26T13:14:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:20 smithi076 ceph-mon[35401]: pgmap v2062: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 699 KiB/s wr, 12 op/s 2024-07-26T13:14:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:20 smithi040 ceph-mon[32397]: pgmap v2062: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 699 KiB/s wr, 12 op/s 2024-07-26T13:14:21.889 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a8cb07cb', total seconds elapsed: 25.9 2024-07-26T13:14:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:23 smithi146 ceph-mon[35807]: pgmap v2063: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 357 KiB/s wr, 8 op/s 2024-07-26T13:14:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:23 smithi076 ceph-mon[35401]: pgmap v2063: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 357 KiB/s wr, 8 op/s 2024-07-26T13:14:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:22 smithi040 ceph-mon[32397]: pgmap v2063: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 357 KiB/s wr, 8 op/s 2024-07-26T13:14:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:25 smithi146 ceph-mon[35807]: pgmap v2064: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T13:14:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:25 smithi076 ceph-mon[35401]: pgmap v2064: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T13:14:25.489 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:25 smithi040 ceph-mon[32397]: pgmap v2064: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-07-26T13:14:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:27 smithi146 ceph-mon[35807]: pgmap v2065: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:14:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:27 smithi076 ceph-mon[35401]: pgmap v2065: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:14:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:27 smithi040 ceph-mon[32397]: pgmap v2065: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:14:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:29 smithi146 ceph-mon[35807]: pgmap v2066: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:14:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:29 smithi076 ceph-mon[35401]: pgmap v2066: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:14:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:29 smithi040 ceph-mon[32397]: pgmap v2066: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:14:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:31 smithi146 ceph-mon[35807]: pgmap v2067: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-07-26T13:14:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:31 smithi076 ceph-mon[35401]: pgmap v2067: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-07-26T13:14:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:31 smithi040 ceph-mon[32397]: pgmap v2067: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 14 op/s 2024-07-26T13:14:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:33 smithi040 ceph-mon[32397]: pgmap v2068: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:14:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:33 smithi146 ceph-mon[35807]: pgmap v2068: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:14:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:33 smithi076 ceph-mon[35401]: pgmap v2068: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:14:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:35 smithi146 ceph-mon[35807]: pgmap v2069: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T13:14:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:35 smithi076 ceph-mon[35401]: pgmap v2069: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T13:14:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:35 smithi040 ceph-mon[32397]: pgmap v2069: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-07-26T13:14:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:37 smithi076 ceph-mon[35401]: pgmap v2070: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T13:14:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:37 smithi146 ceph-mon[35807]: pgmap v2070: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T13:14:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:37 smithi040 ceph-mon[32397]: pgmap v2070: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-07-26T13:14:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:39 smithi146 ceph-mon[35807]: pgmap v2071: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:14:39.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:39 smithi076 ceph-mon[35401]: pgmap v2071: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:14:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:39 smithi040 ceph-mon[32397]: pgmap v2071: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:14:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:41 smithi146 ceph-mon[35807]: pgmap v2072: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-07-26T13:14:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:41 smithi076 ceph-mon[35401]: pgmap v2072: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-07-26T13:14:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:41 smithi040 ceph-mon[32397]: pgmap v2072: 97 pgs: 97 active+clean; 9.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-07-26T13:14:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:43 smithi076 ceph-mon[35401]: pgmap v2073: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:14:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:43 smithi040 ceph-mon[32397]: pgmap v2073: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:14:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:43 smithi146 ceph-mon[35807]: pgmap v2073: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:14:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:14:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:14:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:14:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:45 smithi040 ceph-mon[32397]: pgmap v2074: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:14:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:14:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:14:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:14:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:45 smithi146 ceph-mon[35807]: pgmap v2074: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:14:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:14:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:14:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:14:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:45 smithi076 ceph-mon[35401]: pgmap v2074: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:14:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:14:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:14:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:14:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:47 smithi040 ceph-mon[32397]: pgmap v2075: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:14:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:47 smithi146 ceph-mon[35807]: pgmap v2075: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:14:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:47 smithi076 ceph-mon[35401]: pgmap v2075: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:14:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:49 smithi040 ceph-mon[32397]: pgmap v2076: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:14:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:49 smithi146 ceph-mon[35807]: pgmap v2076: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:49 smithi076 ceph-mon[35401]: pgmap v2076: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:14:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:51 smithi040 ceph-mon[32397]: pgmap v2077: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:14:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:51 smithi146 ceph-mon[35807]: pgmap v2077: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:14:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:51 smithi076 ceph-mon[35401]: pgmap v2077: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:14:52.719 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:14:52.719 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.2 2024-07-26T13:14:52.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:14:53.293 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:14:53.445 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:53 smithi040 ceph-mon[32397]: pgmap v2078: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:14:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:53 smithi146 ceph-mon[35807]: pgmap v2078: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:14:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:53 smithi076 ceph-mon[35401]: pgmap v2078: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:14:55.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:55 smithi040 ceph-mon[32397]: pgmap v2079: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:14:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:55 smithi146 ceph-mon[35807]: pgmap v2079: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:14:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:55 smithi076 ceph-mon[35401]: pgmap v2079: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:14:56.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 -- 172.21.15.40:0/3859492413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c075800 msgr2=0x7f2d9c075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:56.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 --2- 172.21.15.40:0/3859492413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c075800 0x7f2d9c075c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009860 tx=0x7f2d8c02a340 comp rx=0 tx=0).stop 2024-07-26T13:14:56.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 -- 172.21.15.40:0/3859492413 shutdown_connections 2024-07-26T13:14:56.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 --2- 172.21.15.40:0/3859492413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d9c113cb0 0x7f2d9c116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 --2- 172.21.15.40:0/3859492413 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c075800 0x7f2d9c075c10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 --2- 172.21.15.40:0/3859492413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c0751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 -- 172.21.15.40:0/3859492413 >> 172.21.15.40:0/3859492413 conn(0x7f2d9c0fee70 msgr2=0x7f2d9c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:56.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 -- 172.21.15.40:0/3859492413 shutdown_connections 2024-07-26T13:14:56.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.068+0000 7f2da3200640 1 -- 172.21.15.40:0/3859492413 wait complete. 2024-07-26T13:14:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.069+0000 7f2da3200640 1 Processor -- start 2024-07-26T13:14:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 -- start start 2024-07-26T13:14:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c1a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c113cb0 0x7f2d9c1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d9c1a5b70 0x7f2d9c1a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c119760 con 0x7f2d9c076db0 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c1195e0 con 0x7f2d9c113cb0 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c1198e0 con 0x7f2d9c1a5b70 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.070+0000 7f2da1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c1a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c1a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40468/0 (socket says 172.21.15.40:40468) 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 -- 172.21.15.40:0/1504353780 learned_addr learned my addr 172.21.15.40:0/1504353780 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1400640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c113cb0 0x7f2d9c1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da2800640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d9c1a5b70 0x7f2d9c1a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 -- 172.21.15.40:0/1504353780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d9c1a5b70 msgr2=0x7f2d9c1a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d9c1a5b70 0x7f2d9c1a5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 -- 172.21.15.40:0/1504353780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c113cb0 msgr2=0x7f2d9c1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c113cb0 0x7f2d9c1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1e00640 1 -- 172.21.15.40:0/1504353780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9c1a6750 con 0x7f2d9c076db0 2024-07-26T13:14:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.071+0000 7f2da1400640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c113cb0 0x7f2d9c1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.072+0000 7f2da1e00640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c1a03f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000e9c0 tx=0x7f2d9000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.072+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000cde0 con 0x7f2d9c076db0 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.072+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d900035f0 con 0x7f2d9c076db0 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.072+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9c1accf0 con 0x7f2d9c076db0 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.072+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90010690 con 0x7f2d9c076db0 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.072+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9c1ad0e0 con 0x7f2d9c076db0 2024-07-26T13:14:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.074+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d9c075c10 con 0x7f2d9c076db0 2024-07-26T13:14:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.077+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2d90004000 con 0x7f2d9c076db0 2024-07-26T13:14:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.079+0000 7f2d96a00640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d840b3bd0 0x7f2d840b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:14:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.079+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2d900e4050 con 0x7f2d9c076db0 2024-07-26T13:14:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.079+0000 7f2da1400640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d840b3bd0 0x7f2d840b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:14:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.080+0000 7f2da1400640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d840b3bd0 0x7f2d840b60e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c008000 tx=0x7f2d8c005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:14:56.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.085+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2d900ab660 con 0x7f2d9c076db0 2024-07-26T13:14:56.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.371+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d9c1ad4a0 con 0x7f2d9c076db0 2024-07-26T13:14:56.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.373+0000 7f2d96a00640 1 -- 172.21.15.40:0/1504353780 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f2d900aaf60 con 0x7f2d9c076db0 2024-07-26T13:14:56.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:14:56.375 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:14:56.375 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:14:56.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d840b3bd0 msgr2=0x7f2d840b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:56.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d840b3bd0 0x7f2d840b60e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c008000 tx=0x7f2d8c005c90 comp rx=0 tx=0).stop 2024-07-26T13:14:56.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 msgr2=0x7f2d9c1a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:14:56.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c1a03f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000e9c0 tx=0x7f2d9000ee80 comp rx=0 tx=0).stop 2024-07-26T13:14:56.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 shutdown_connections 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d840b3bd0 0x7f2d840b60e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d9c1a5b70 0x7f2d9c1a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d9c113cb0 0x7f2d9c1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 --2- 172.21.15.40:0/1504353780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d9c076db0 0x7f2d9c1a03f0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.376+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 >> 172.21.15.40:0/1504353780 conn(0x7f2d9c0fee70 msgr2=0x7f2d9c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.377+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 shutdown_connections 2024-07-26T13:14:56.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:14:56.377+0000 7f2da3200640 1 -- 172.21.15.40:0/1504353780 wait complete. 2024-07-26T13:14:57.318 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 141.2 --await-for 45.0' 2024-07-26T13:14:57.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 141.2 --await-for 45.0 2024-07-26T13:14:57.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:57 smithi040 ceph-mon[32397]: pgmap v2080: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:14:57.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:57 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1504353780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:57 smithi146 ceph-mon[35807]: pgmap v2080: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:14:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:57 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1504353780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:57 smithi076 ceph-mon[35401]: pgmap v2080: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:14:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:57 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1504353780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:14:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:14:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:14:59 smithi040 ceph-mon[32397]: pgmap v2081: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:14:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:14:59 smithi146 ceph-mon[35807]: pgmap v2081: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:14:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:14:59 smithi076 ceph-mon[35401]: pgmap v2081: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:15:00.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 -- 172.21.15.40:0/2454987109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810f350 msgr2=0x7f513810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 --2- 172.21.15.40:0/2454987109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810f350 0x7f513810f760 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5128009900 tx=0x7f512802a410 comp rx=0 tx=0).stop 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 -- 172.21.15.40:0/2454987109 shutdown_connections 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 --2- 172.21.15.40:0/2454987109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f513810fca0 0x7f51381164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 --2- 172.21.15.40:0/2454987109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810f350 0x7f513810f760 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 --2- 172.21.15.40:0/2454987109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5138109a60 0x7f5138109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 -- 172.21.15.40:0/2454987109 >> 172.21.15.40:0/2454987109 conn(0x7f5138079100 msgr2=0x7f5138107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 -- 172.21.15.40:0/2454987109 shutdown_connections 2024-07-26T13:15:00.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.198+0000 7f513ca00640 1 -- 172.21.15.40:0/2454987109 wait complete. 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.200+0000 7f513ca00640 1 Processor -- start 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.200+0000 7f513ca00640 1 -- start start 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f513ca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5138109a60 0x7f51381a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f513ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f513810f350 0x7f51381a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f513ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 0x7f51381a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f513ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51381197c0 con 0x7f513810fca0 2024-07-26T13:15:00.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f513ca00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5138119640 con 0x7f5138109a60 2024-07-26T13:15:00.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f513ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5138119940 con 0x7f513810f350 2024-07-26T13:15:00.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f5137200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 0x7f51381a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f5137200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 0x7f51381a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40488/0 (socket says 172.21.15.40:40488) 2024-07-26T13:15:00.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f5137200640 1 -- 172.21.15.40:0/4181078134 learned_addr learned my addr 172.21.15.40:0/4181078134 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:00.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.201+0000 7f5136800640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5138109a60 0x7f51381a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5135e00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f513810f350 0x7f51381a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5137200640 1 -- 172.21.15.40:0/4181078134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f513810f350 msgr2=0x7f51381a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5137200640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f513810f350 0x7f51381a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5137200640 1 -- 172.21.15.40:0/4181078134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5138109a60 msgr2=0x7f51381a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5137200640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5138109a60 0x7f51381a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5137200640 1 -- 172.21.15.40:0/4181078134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51381a6140 con 0x7f513810fca0 2024-07-26T13:15:00.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.202+0000 7f5137200640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 0x7f51381a5a10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f513000eaa0 tx=0x7f513000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:00.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.203+0000 7f512f400640 1 -- 172.21.15.40:0/4181078134 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000cdb0 con 0x7f513810fca0 2024-07-26T13:15:00.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.203+0000 7f512f400640 1 -- 172.21.15.40:0/4181078134 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5130005020 con 0x7f513810fca0 2024-07-26T13:15:00.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.203+0000 7f512f400640 1 -- 172.21.15.40:0/4181078134 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51300116d0 con 0x7f513810fca0 2024-07-26T13:15:00.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.203+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51381a6430 con 0x7f513810fca0 2024-07-26T13:15:00.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.203+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381acb90 con 0x7f513810fca0 2024-07-26T13:15:00.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.208+0000 7f51441e5740 1 Processor -- start 2024-07-26T13:15:00.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.208+0000 7f512f400640 1 -- 172.21.15.40:0/4181078134 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5130004a40 con 0x7f513810fca0 2024-07-26T13:15:00.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 -- start start 2024-07-26T13:15:00.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 0x55e6d9772390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d97728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d9772e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e6d973ccf0 con 0x55e6d93cc840 2024-07-26T13:15:00.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e6d96e7b40 con 0x55e6d93abb60 2024-07-26T13:15:00.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.209+0000 7f51441e5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e6d96d7040 con 0x55e6d93a3980 2024-07-26T13:15:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 0x55e6d9772390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 0x55e6d9772390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40494/0 (socket says 172.21.15.40:40494) 2024-07-26T13:15:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 -- 172.21.15.40:0/1467666856 learned_addr learned my addr 172.21.15.40:0/1467666856 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5136800640 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d97728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d9772e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 -- 172.21.15.40:0/1467666856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 msgr2=0x55e6d97728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d97728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 -- 172.21.15.40:0/1467666856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 msgr2=0x55e6d9772e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d9772e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.210+0000 7f5135e00640 1 -- 172.21.15.40:0/1467666856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d965eaf0 con 0x55e6d93cc840 2024-07-26T13:15:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f512f400640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f511c0b3bc0 0x7f511c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f512f400640 1 -- 172.21.15.40:0/4181078134 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f51300e3ca0 con 0x7f513810fca0 2024-07-26T13:15:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f5136800640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f511c0b3bc0 0x7f511c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f5135e00640 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 0x55e6d9772390 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f51280057c0 tx=0x7f5128005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398c61e078aaeab9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f5127400640 1 -- 172.21.15.40:0/1467666856 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128035070 con 0x55e6d93cc840 2024-07-26T13:15:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f5127400640 1 -- 172.21.15.40:0/1467666856 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51280044c0 con 0x55e6d93cc840 2024-07-26T13:15:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.211+0000 7f5127400640 1 -- 172.21.15.40:0/1467666856 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128003bb0 con 0x55e6d93cc840 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.212+0000 7f51441e5740 1 -- 172.21.15.40:0/1467666856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 msgr2=0x55e6d9772390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.212+0000 7f51441e5740 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 0x55e6d9772390 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f51280057c0 tx=0x7f5128005fd0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.212+0000 7f5136800640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f511c0b3bc0 0x7f511c0b60d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55e6d9771010 tx=0x7f512000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 -- 172.21.15.40:0/1467666856 shutdown_connections 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d9772e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d97728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 --2- 172.21.15.40:0/1467666856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93cc840 0x55e6d9772390 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 -- 172.21.15.40:0/1467666856 >> 172.21.15.40:0/1467666856 conn(0x55e6d93c0990 msgr2=0x55e6d9770280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:00.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 -- 172.21.15.40:0/1467666856 shutdown_connections 2024-07-26T13:15:00.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.213+0000 7f51441e5740 1 -- 172.21.15.40:0/1467666856 wait complete. 2024-07-26T13:15:00.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.214+0000 7f51441e5740 1 -- start start 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.214+0000 7f51441e5740 1 Processor -- start 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d977df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d977e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9789c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e6d9673500 con 0x55e6d93abb60 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e6d96db080 con 0x55e6d93cc840 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e6d953a7a0 con 0x55e6d93a3980 2024-07-26T13:15:00.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f51441e5740 10 client.0 _ll_register_callbacks cb 0x55e6d96cfbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:00.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.215+0000 7f5135e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d977e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d977e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40504/0 (socket says 172.21.15.40:40504) 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 -- 172.21.15.40:0/52349053 learned_addr learned my addr 172.21.15.40:0/52349053 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5136800640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d977df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5137200640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9789c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 -- 172.21.15.40:0/52349053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 msgr2=0x55e6d977df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d977df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 -- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 msgr2=0x55e6d9789c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9789c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.216+0000 7f5135e00640 1 -- 172.21.15.40:0/52349053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d9446b90 con 0x55e6d93abb60 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f5135e00640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d977e460 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f512802a450 tx=0x7f5128005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e94984b80f5908 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f511be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f511be00640 1 -- 172.21.15.40:0/52349053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512804e070 con 0x55e6d93abb60 2024-07-26T13:15:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f511be00640 1 -- 172.21.15.40:0/52349053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5128003930 con 0x55e6d93abb60 2024-07-26T13:15:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6d96e9a90 con 0x55e6d93abb60 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f511be00640 1 -- 172.21.15.40:0/52349053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f512805a050 con 0x55e6d93abb60 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f51441e5740 10 client.17586 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.217+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e6d978c970 con 0x55e6d93abb60 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f511be00640 1 -- 172.21.15.40:0/52349053 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e6d96e9a90 con 0x55e6d93abb60 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f511be00640 1 -- 172.21.15.40:0/52349053 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f512804a5a0 con 0x55e6d93abb60 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f51441e5740 10 client.17586 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f51441e5740 10 client.17586 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f51441e5740 20 client.17586 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f51441e5740 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d938b1c0 0x55e6d978fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f51441e5740 4 client.17586 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:15:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.218+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6d96e5530 con 0x55e6d938b1c0 2024-07-26T13:15:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.219+0000 7f5136800640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d938b1c0 0x55e6d978fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.221+0000 7f5136800640 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d938b1c0 0x55e6d978fcd0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9640db1e9f16a85 server_cookie=2b101d4f31a8954e in_seq=0 out_seq=0 2024-07-26T13:15:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.221+0000 7f511be00640 10 client.17586 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f511be00640 1 -- 172.21.15.40:0/52349053 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6d96e5530 con 0x55e6d938b1c0 2024-07-26T13:15:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f511be00640 10 client.17586 handle_command_reply: tid=0 2024-07-26T13:15:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 client.17586 shutdown 2024-07-26T13:15:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 msgr2=0x55e6d977e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d977e460 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f512802a450 tx=0x7f5128005850 comp rx=0 tx=0).stop 2024-07-26T13:15:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 shutdown_connections 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9789c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d938b1c0 0x55e6d978fcd0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d977e460 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 --2- 172.21.15.40:0/52349053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d977df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 >> 172.21.15.40:0/52349053 conn(0x55e6d93c0990 msgr2=0x55e6d9775570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.223+0000 7f511be00640 0 client.17586 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.224+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 shutdown_connections 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.224+0000 7f51441e5740 1 -- 172.21.15.40:0/52349053 wait complete. 2024-07-26T13:15:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.224+0000 7f51441e5740 20 client.17586 trim_cache size 0 max 16384 2024-07-26T13:15:00.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.243+0000 7f51441e5740 1 Processor -- start 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.243+0000 7f51441e5740 1 -- start start 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f51441e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 0x55e6d9773d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f51441e5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d976f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f51441e5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93cc840 0x55e6d976fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f51441e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51381b50d0 con 0x55e6d93a3980 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f51441e5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f51381b6c10 con 0x55e6d93abb60 2024-07-26T13:15:00.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f51441e5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51381b57a0 con 0x55e6d93cc840 2024-07-26T13:15:00.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f5136800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 0x55e6d9773d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f5136800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 0x55e6d9773d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40518/0 (socket says 172.21.15.40:40518) 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f5136800640 1 -- 172.21.15.40:0/1127510399 learned_addr learned my addr 172.21.15.40:0/1127510399 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.244+0000 7f5135e00640 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d976f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5137200640 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93cc840 0x55e6d976fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5136800640 1 -- 172.21.15.40:0/1127510399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93cc840 msgr2=0x55e6d976fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5136800640 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93cc840 0x55e6d976fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5136800640 1 -- 172.21.15.40:0/1127510399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 msgr2=0x55e6d976f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5136800640 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d976f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5136800640 1 -- 172.21.15.40:0/1127510399 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d97748b0 con 0x55e6d93a3980 2024-07-26T13:15:00.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.245+0000 7f5136800640 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 0x55e6d9773d80 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x55e6d9774c40 tx=0x7f5120016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3b38db573a23ee server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.246+0000 7f5126a00640 1 -- 172.21.15.40:0/1127510399 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120030070 con 0x55e6d93a3980 2024-07-26T13:15:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.246+0000 7f5126a00640 1 -- 172.21.15.40:0/1127510399 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51200054b0 con 0x55e6d93a3980 2024-07-26T13:15:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.246+0000 7f5126a00640 1 -- 172.21.15.40:0/1127510399 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512002c6a0 con 0x55e6d93a3980 2024-07-26T13:15:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 -- 172.21.15.40:0/1127510399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 msgr2=0x55e6d9773d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 0x55e6d9773d80 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x55e6d9774c40 tx=0x7f5120016000 comp rx=0 tx=0).stop 2024-07-26T13:15:00.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 -- 172.21.15.40:0/1127510399 shutdown_connections 2024-07-26T13:15:00.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93cc840 0x55e6d976fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93abb60 0x55e6d976f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 --2- 172.21.15.40:0/1127510399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93a3980 0x55e6d9773d80 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 -- 172.21.15.40:0/1127510399 >> 172.21.15.40:0/1127510399 conn(0x55e6d93c0990 msgr2=0x55e6d97774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 -- 172.21.15.40:0/1127510399 shutdown_connections 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.247+0000 7f51441e5740 1 -- 172.21.15.40:0/1127510399 wait complete. 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.248+0000 7f51441e5740 1 -- start start 2024-07-26T13:15:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.248+0000 7f51441e5740 1 Processor -- start 2024-07-26T13:15:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d9793230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d9790700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9790c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51381b6540 con 0x55e6d93abb60 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f51381b5e70 con 0x55e6d93cc840 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51381b3090 con 0x55e6d93a3980 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f51441e5740 10 client.0 _ll_register_callbacks cb 0x7f512803e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f5135e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d9790700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f5135e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d9790700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40530/0 (socket says 172.21.15.40:40530) 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f5135e00640 1 -- 172.21.15.40:0/3728398753 learned_addr learned my addr 172.21.15.40:0/3728398753 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f5137200640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9790c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.249+0000 7f5136800640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d9793230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5135e00640 1 -- 172.21.15.40:0/3728398753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 msgr2=0x55e6d9793230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5135e00640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d9793230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5135e00640 1 -- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 msgr2=0x55e6d9790c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5135e00640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9790c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5135e00640 1 -- 172.21.15.40:0/3728398753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d9791230 con 0x55e6d93abb60 2024-07-26T13:15:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5137200640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9790c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:15:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f5135e00640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d9790700 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5128006010 tx=0x7f512804ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1982b14740b58e8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f511be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f511be00640 1 -- 172.21.15.40:0/3728398753 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128063060 con 0x55e6d93abb60 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f511be00640 1 -- 172.21.15.40:0/3728398753 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f512804a430 con 0x55e6d93abb60 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.250+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51200054b0 con 0x55e6d93abb60 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.251+0000 7f511be00640 1 -- 172.21.15.40:0/3728398753 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f512804e040 con 0x55e6d93abb60 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.251+0000 7f51441e5740 10 client.17592 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.251+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e6d97f7fa0 con 0x55e6d93abb60 2024-07-26T13:15:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.251+0000 7f511be00640 1 -- 172.21.15.40:0/3728398753 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51200054b0 con 0x55e6d93abb60 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f511be00640 1 -- 172.21.15.40:0/3728398753 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f5128068070 con 0x55e6d93abb60 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f51441e5740 10 client.17592 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f51441e5740 10 client.17592 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f51441e5740 20 client.17592 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f51441e5740 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d9360570 0x55e6d97fa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f51441e5740 4 client.17592 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.2, "await_for": 45.0}] 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.2, "await_for": 45.0}) -- 0x55e6d96e2c70 con 0x55e6d9360570 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.252+0000 7f5136800640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d9360570 0x55e6d97fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.254+0000 7f5136800640 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d9360570 0x55e6d97fa760 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b37076686b401e2 server_cookie=7a71bb8b97daa050 in_seq=0 out_seq=0 2024-07-26T13:15:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.254+0000 7f511be00640 10 client.17592 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.517+0000 7f511be00640 1 -- 172.21.15.40:0/3728398753 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55e6d96e2c70 con 0x55e6d9360570 2024-07-26T13:15:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.517+0000 7f511be00640 10 client.17592 handle_command_reply: tid=0 2024-07-26T13:15:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.517+0000 7f51441e5740 1 client.17592 shutdown 2024-07-26T13:15:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.518+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 msgr2=0x55e6d9790700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.518+0000 7f51441e5740 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d9790700 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5128006010 tx=0x7f512804ad90 comp rx=0 tx=0).stop 2024-07-26T13:15:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 shutdown_connections 2024-07-26T13:15:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d93cc840 0x55e6d9790c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e6d9360570 0x55e6d97fa760 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e6d93abb60 0x55e6d9790700 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f511be00640 0 client.17592 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 --2- 172.21.15.40:0/3728398753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6d93a3980 0x55e6d9793230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 >> 172.21.15.40:0/3728398753 conn(0x55e6d93c0990 msgr2=0x55e6d97774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 shutdown_connections 2024-07-26T13:15:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.519+0000 7f51441e5740 1 -- 172.21.15.40:0/3728398753 wait complete. 2024-07-26T13:15:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.520+0000 7f51441e5740 20 client.17592 trim_cache size 0 max 16384 2024-07-26T13:15:00.522 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:15:00.522 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:15:00.522 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:15:00.522 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 178, 2024-07-26T13:15:00.522 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "9d80ecc1": { 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 178, 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.2, 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:15:00.523 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:00.524 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f511c0b3bc0 msgr2=0x7f511c0b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f511c0b3bc0 0x7f511c0b60d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55e6d9771010 tx=0x7f512000b410 comp rx=0 tx=0).stop 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 msgr2=0x7f51381a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 0x7f51381a5a10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f513000eaa0 tx=0x7f513000ef60 comp rx=0 tx=0).stop 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 shutdown_connections 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513810fca0 0x7f51381a5a10 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f511c0b3bc0 0x7f511c0b60d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f513810f350 0x7f51381a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 --2- 172.21.15.40:0/4181078134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5138109a60 0x7f51381a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.521+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 >> 172.21.15.40:0/4181078134 conn(0x7f5138079100 msgr2=0x7f5138108140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.522+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 shutdown_connections 2024-07-26T13:15:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:00.522+0000 7f513ca00640 1 -- 172.21.15.40:0/4181078134 wait complete. 2024-07-26T13:15:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:01 smithi040 ceph-mon[32397]: pgmap v2082: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:15:01.339 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9d80ecc1', quiesce took 8.6 seconds. Will release after: 12.6 2024-07-26T13:15:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:01 smithi146 ceph-mon[35807]: pgmap v2082: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:15:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:01 smithi076 ceph-mon[35401]: pgmap v2082: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:15:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:03 smithi040 ceph-mon[32397]: pgmap v2083: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:15:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:03 smithi146 ceph-mon[35807]: pgmap v2083: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:15:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:03 smithi076 ceph-mon[35401]: pgmap v2083: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:15:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:05 smithi040 ceph-mon[32397]: pgmap v2084: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:15:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:05 smithi146 ceph-mon[35807]: pgmap v2084: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:15:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:05 smithi076 ceph-mon[35401]: pgmap v2084: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:15:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:07 smithi040 ceph-mon[32397]: pgmap v2085: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:15:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:07 smithi146 ceph-mon[35807]: pgmap v2085: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:15:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:07 smithi076 ceph-mon[35401]: pgmap v2085: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:15:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:09 smithi040 ceph-mon[32397]: pgmap v2086: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T13:15:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:09 smithi146 ceph-mon[35807]: pgmap v2086: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T13:15:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:09 smithi076 ceph-mon[35401]: pgmap v2086: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T13:15:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:11 smithi040 ceph-mon[32397]: pgmap v2087: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T13:15:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:11 smithi146 ceph-mon[35807]: pgmap v2087: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T13:15:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:11 smithi076 ceph-mon[35401]: pgmap v2087: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T13:15:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:13 smithi040 ceph-mon[32397]: pgmap v2088: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-07-26T13:15:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:13 smithi146 ceph-mon[35807]: pgmap v2088: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-07-26T13:15:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:13 smithi076 ceph-mon[35401]: pgmap v2088: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-07-26T13:15:13.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:15:14.438 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:15:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:15 smithi040 ceph-mon[32397]: pgmap v2089: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T13:15:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:15 smithi146 ceph-mon[35807]: pgmap v2089: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T13:15:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:15 smithi076 ceph-mon[35401]: pgmap v2089: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.572+0000 7f6064a00640 1 -- 172.21.15.40:0/893430707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 msgr2=0x7f60601164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 --2- 172.21.15.40:0/893430707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601164b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6058009ca0 tx=0x7f605802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 -- 172.21.15.40:0/893430707 shutdown_connections 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 --2- 172.21.15.40:0/893430707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601164b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 --2- 172.21.15.40:0/893430707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f606010f330 0x7f606010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 --2- 172.21.15.40:0/893430707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60601099f0 0x7f6060109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 -- 172.21.15.40:0/893430707 >> 172.21.15.40:0/893430707 conn(0x7f6060078ff0 msgr2=0x7f6060107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:16.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 -- 172.21.15.40:0/893430707 shutdown_connections 2024-07-26T13:15:16.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.573+0000 7f6064a00640 1 -- 172.21.15.40:0/893430707 wait complete. 2024-07-26T13:15:16.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.574+0000 7f6064a00640 1 Processor -- start 2024-07-26T13:15:16.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 -- start start 2024-07-26T13:15:16.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60601099f0 0x7f60601a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:16.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606010f330 0x7f60601a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:16.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6060119840 con 0x7f606010fc80 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f60601196c0 con 0x7f60601099f0 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.575+0000 7f6064a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f60601199c0 con 0x7f606010f330 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42296/0 (socket says 172.21.15.40:42296) 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 -- 172.21.15.40:0/3052054073 learned_addr learned my addr 172.21.15.40:0/3052054073 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605e800640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60601099f0 0x7f60601a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f6057e00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606010f330 0x7f60601a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 -- 172.21.15.40:0/3052054073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606010f330 msgr2=0x7f60601a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606010f330 0x7f60601a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 -- 172.21.15.40:0/3052054073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60601099f0 msgr2=0x7f60601a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.576+0000 7f605f200640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60601099f0 0x7f60601a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.577+0000 7f605f200640 1 -- 172.21.15.40:0/3052054073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60601a61c0 con 0x7f606010fc80 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.577+0000 7f605f200640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601a5a90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6058031040 tx=0x7f6058032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.577+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058004040 con 0x7f606010fc80 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.577+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6058004670 con 0x7f606010fc80 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.577+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60601a6450 con 0x7f606010fc80 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.577+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058030bb0 con 0x7f606010fc80 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.578+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60601acc10 con 0x7f606010fc80 2024-07-26T13:15:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.579+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6060109e00 con 0x7f606010fc80 2024-07-26T13:15:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.581+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f60580041e0 con 0x7f606010fc80 2024-07-26T13:15:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.583+0000 7f6057400640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f60440b3c50 0x7f60440b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.583+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f60581050c0 con 0x7f606010fc80 2024-07-26T13:15:16.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.583+0000 7f605e800640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f60440b3c50 0x7f60440b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:16.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.584+0000 7f605e800640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f60440b3c50 0x7f60440b6160 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6050005fd0 tx=0x7f605000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:16.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.585+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f60580cc6d0 con 0x7f606010fc80 2024-07-26T13:15:16.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.828+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6060111ad0 con 0x7f606010fc80 2024-07-26T13:15:16.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.830+0000 7f6057400640 1 -- 172.21.15.40:0/3052054073 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f60580cbfd0 con 0x7f606010fc80 2024-07-26T13:15:16.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:15:16.832 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:15:16.832 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.832+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f60440b3c50 msgr2=0x7f60440b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.832+0000 7f6064a00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f60440b3c50 0x7f60440b6160 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6050005fd0 tx=0x7f605000b390 comp rx=0 tx=0).stop 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 msgr2=0x7f60601a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601a5a90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6058031040 tx=0x7f6058032bc0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 shutdown_connections 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606010fc80 0x7f60601a5a90 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f60440b3c50 0x7f60440b6160 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f606010f330 0x7f60601a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 --2- 172.21.15.40:0/3052054073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60601099f0 0x7f60601a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 >> 172.21.15.40:0/3052054073 conn(0x7f6060078ff0 msgr2=0x7f6060079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 shutdown_connections 2024-07-26T13:15:16.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:16.833+0000 7f6064a00640 1 -- 172.21.15.40:0/3052054073 wait complete. 2024-07-26T13:15:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:17 smithi040 ceph-mon[32397]: pgmap v2090: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:15:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3052054073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:17 smithi146 ceph-mon[35807]: pgmap v2090: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:15:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3052054073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:17 smithi076 ceph-mon[35401]: pgmap v2090: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:15:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3052054073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:17.767 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 9d80ecc1 --release --await' 2024-07-26T13:15:17.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 9d80ecc1 --release --await 2024-07-26T13:15:18.254 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:15:19.420 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:19 smithi040 ceph-mon[32397]: pgmap v2091: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:15:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:19 smithi146 ceph-mon[35807]: pgmap v2091: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:15:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:19 smithi076 ceph-mon[35401]: pgmap v2091: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.462+0000 7f082da00640 1 -- 172.21.15.40:0/2762667792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d20 msgr2=0x7f0828109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.462+0000 7f082da00640 1 --2- 172.21.15.40:0/2762667792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d20 0x7f0828109130 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0810009900 tx=0x7f081002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 -- 172.21.15.40:0/2762667792 shutdown_connections 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 --2- 172.21.15.40:0/2762667792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828109670 0x7f082810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 --2- 172.21.15.40:0/2762667792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0828108d20 0x7f0828109130 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 --2- 172.21.15.40:0/2762667792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08281033e0 0x7f08281037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 -- 172.21.15.40:0/2762667792 >> 172.21.15.40:0/2762667792 conn(0x7f08280fee70 msgr2=0x7f08281012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 -- 172.21.15.40:0/2762667792 shutdown_connections 2024-07-26T13:15:20.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.463+0000 7f082da00640 1 -- 172.21.15.40:0/2762667792 wait complete. 2024-07-26T13:15:20.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.465+0000 7f082da00640 1 Processor -- start 2024-07-26T13:15:20.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.465+0000 7f082da00640 1 -- start start 2024-07-26T13:15:20.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f082da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 0x7f082819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f082da00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828108d20 0x7f082819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f082da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109670 0x7f08281a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f082da00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08281131e0 con 0x7f08281033e0 2024-07-26T13:15:20.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f082da00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0828113060 con 0x7f0828108d20 2024-07-26T13:15:20.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f082da00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0828113360 con 0x7f0828109670 2024-07-26T13:15:20.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f0827e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 0x7f082819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f0827e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 0x7f082819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42316/0 (socket says 172.21.15.40:42316) 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f0827e00640 1 -- 172.21.15.40:0/1102789836 learned_addr learned my addr 172.21.15.40:0/1102789836 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.466+0000 7f081fe00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828108d20 0x7f082819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f082d000640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109670 0x7f08281a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f0827e00640 1 -- 172.21.15.40:0/1102789836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109670 msgr2=0x7f08281a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f0827e00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109670 0x7f08281a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f0827e00640 1 -- 172.21.15.40:0/1102789836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828108d20 msgr2=0x7f082819c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f0827e00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828108d20 0x7f082819c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f0827e00640 1 -- 172.21.15.40:0/1102789836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08281a1d00 con 0x7f08281033e0 2024-07-26T13:15:20.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.467+0000 7f0827e00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 0x7f082819be50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f081800d950 tx=0x7f081800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:20.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.468+0000 7f0825600640 1 -- 172.21.15.40:0/1102789836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818017030 con 0x7f08281033e0 2024-07-26T13:15:20.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.468+0000 7f0825600640 1 -- 172.21.15.40:0/1102789836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0818004020 con 0x7f08281033e0 2024-07-26T13:15:20.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.468+0000 7f0825600640 1 -- 172.21.15.40:0/1102789836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08180055d0 con 0x7f08281033e0 2024-07-26T13:15:20.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.468+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08281a1ff0 con 0x7f08281033e0 2024-07-26T13:15:20.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.469+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08281a24b0 con 0x7f08281033e0 2024-07-26T13:15:20.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.472+0000 7f0835c86740 1 Processor -- start 2024-07-26T13:15:20.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.472+0000 7f0835c86740 1 -- start start 2024-07-26T13:15:20.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0825600640 1 -- 172.21.15.40:0/1102789836 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0818009a30 con 0x7f08281033e0 2024-07-26T13:15:20.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0835c86740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a0f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0835c86740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a0f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0835c86740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a0fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0835c86740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563346985f50 con 0x56334666a520 2024-07-26T13:15:20.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0835c86740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563346975450 con 0x563346649840 2024-07-26T13:15:20.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f0835c86740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563346979490 con 0x563346641660 2024-07-26T13:15:20.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f082d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a0f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.473+0000 7f082d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a0f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42320/0 (socket says 172.21.15.40:42320) 2024-07-26T13:15:20.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f082d000640 1 -- 172.21.15.40:0/2104065898 learned_addr learned my addr 172.21.15.40:0/2104065898 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:20.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f081fe00640 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a0fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f0827e00640 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a0f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f082d000640 1 -- 172.21.15.40:0/2104065898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 msgr2=0x563346a0f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f082d000640 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a0f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f082d000640 1 -- 172.21.15.40:0/2104065898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 msgr2=0x563346a0fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f082d000640 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a0fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.474+0000 7f082d000640 1 -- 172.21.15.40:0/2104065898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633466d5b00 con 0x56334666a520 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.475+0000 7f082d000640 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a0f1a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0820007dd0 tx=0x7f082000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13996c752d0c136 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.475+0000 7f081d600640 1 -- 172.21.15.40:0/2104065898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820014070 con 0x56334666a520 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.475+0000 7f081d600640 1 -- 172.21.15.40:0/2104065898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0820004d20 con 0x56334666a520 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.475+0000 7f081d600640 1 -- 172.21.15.40:0/2104065898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820010720 con 0x56334666a520 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.475+0000 7f0825600640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3d50 0x7f080c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.476+0000 7f0825600640 1 -- 172.21.15.40:0/1102789836 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08180e3580 con 0x7f08281033e0 2024-07-26T13:15:20.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.476+0000 7f0827e00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3d50 0x7f080c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.476+0000 7f0827e00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3d50 0x7f080c0b6260 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f08180a6510 tx=0x7f08180e6af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:20.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.476+0000 7f0835c86740 1 -- 172.21.15.40:0/2104065898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 msgr2=0x563346a0f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.476+0000 7f0835c86740 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a0f1a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0820007dd0 tx=0x7f082000e720 comp rx=0 tx=0).stop 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 -- 172.21.15.40:0/2104065898 shutdown_connections 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a0fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a0f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 --2- 172.21.15.40:0/2104065898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a0f1a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 -- 172.21.15.40:0/2104065898 >> 172.21.15.40:0/2104065898 conn(0x56334665e910 msgr2=0x563346a0d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 -- 172.21.15.40:0/2104065898 shutdown_connections 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 -- 172.21.15.40:0/2104065898 wait complete. 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.477+0000 7f0835c86740 1 -- start start 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 Processor -- start 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a1a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5633467d8bb0 con 0x563346649840 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563346911930 con 0x563346641660 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563346a1d980 con 0x56334666a520 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.478+0000 7f0835c86740 10 client.0 _ll_register_callbacks cb 0x563346681d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42332/0 (socket says 172.21.15.40:42332) 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 -- 172.21.15.40:0/3148669246 learned_addr learned my addr 172.21.15.40:0/3148669246 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f082d000640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a1a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f082d000640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 -- 172.21.15.40:0/3148669246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 msgr2=0x563346a26ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a26ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 -- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 msgr2=0x563346a1a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a1a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.479+0000 7f081fe00640 1 -- 172.21.15.40:0/3148669246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56334674c960 con 0x563346649840 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.480+0000 7f081fe00640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1adf0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f0810005ab0 tx=0x7f0810004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb2167b4afc145d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.480+0000 7f0816000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.480+0000 7f0816000640 1 -- 172.21.15.40:0/3148669246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810035070 con 0x563346649840 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.480+0000 7f0816000640 1 -- 172.21.15.40:0/3148669246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0810003c40 con 0x563346649840 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.480+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0820004d20 con 0x563346649840 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.481+0000 7f0816000640 1 -- 172.21.15.40:0/3148669246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0810003e40 con 0x563346649840 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.481+0000 7f0835c86740 10 client.17610 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.481+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563346a296f0 con 0x563346649840 2024-07-26T13:15:20.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.481+0000 7f0816000640 1 -- 172.21.15.40:0/3148669246 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0820004d20 con 0x563346649840 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.481+0000 7f0816000640 1 -- 172.21.15.40:0/3148669246 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0810031520 con 0x563346649840 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f0835c86740 10 client.17610 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f0835c86740 10 client.17610 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f0835c86740 20 client.17610 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f0835c86740 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563346628ea0 0x563346a2cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f0835c86740 4 client.17610 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563346987ea0 con 0x563346628ea0 2024-07-26T13:15:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.482+0000 7f082d000640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563346628ea0 0x563346a2cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.483+0000 7f082d000640 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563346628ea0 0x563346a2cc30 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f8add34ed6eae2 server_cookie=13ce3a67c1807008 in_seq=0 out_seq=0 2024-07-26T13:15:20.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.483+0000 7f0816000640 10 client.17610 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.485+0000 7f0816000640 1 -- 172.21.15.40:0/3148669246 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563346987ea0 con 0x563346628ea0 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.485+0000 7f0816000640 10 client.17610 handle_command_reply: tid=0 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.485+0000 7f0835c86740 1 client.17610 shutdown 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 msgr2=0x563346a1adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1adf0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f0810005ab0 tx=0x7f0810004600 comp rx=0 tx=0).stop 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 shutdown_connections 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a26ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563346628ea0 0x563346a2cc30 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1adf0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 --2- 172.21.15.40:0/3148669246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a1a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0816000640 0 client.17610 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 >> 172.21.15.40:0/3148669246 conn(0x56334665e910 msgr2=0x563346a12380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 shutdown_connections 2024-07-26T13:15:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 1 -- 172.21.15.40:0/3148669246 wait complete. 2024-07-26T13:15:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.486+0000 7f0835c86740 20 client.17610 trim_cache size 0 max 16384 2024-07-26T13:15:20.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.505+0000 7f0835c86740 1 Processor -- start 2024-07-26T13:15:20.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 -- start start 2024-07-26T13:15:20.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a10b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a26a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a26fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08281b0cf0 con 0x56334666a520 2024-07-26T13:15:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f08281b2830 con 0x563346649840 2024-07-26T13:15:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.506+0000 7f0835c86740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08281b13c0 con 0x563346641660 2024-07-26T13:15:20.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a26fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f081fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a26a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a26fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42336/0 (socket says 172.21.15.40:42336) 2024-07-26T13:15:20.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 -- 172.21.15.40:0/3432133488 learned_addr learned my addr 172.21.15.40:0/3432133488 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a10b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 -- 172.21.15.40:0/3432133488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 msgr2=0x563346a10b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a10b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 -- 172.21.15.40:0/3432133488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 msgr2=0x563346a26a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a26a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.507+0000 7f082d000640 1 -- 172.21.15.40:0/3432133488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563346a12000 con 0x56334666a520 2024-07-26T13:15:20.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.508+0000 7f082d000640 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a26fd0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f08200075e0 tx=0x7f08200059e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df48cea34cccdb49 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.508+0000 7f081cc00640 1 -- 172.21.15.40:0/3432133488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820014040 con 0x56334666a520 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.508+0000 7f081cc00640 1 -- 172.21.15.40:0/3432133488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0820029ba0 con 0x56334666a520 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.508+0000 7f081cc00640 1 -- 172.21.15.40:0/3432133488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820021040 con 0x56334666a520 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 -- 172.21.15.40:0/3432133488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 msgr2=0x563346a26fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a26fd0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f08200075e0 tx=0x7f08200059e0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 -- 172.21.15.40:0/3432133488 shutdown_connections 2024-07-26T13:15:20.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56334666a520 0x563346a26fd0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346649840 0x563346a26a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 --2- 172.21.15.40:0/3432133488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563346641660 0x563346a10b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 -- 172.21.15.40:0/3432133488 >> 172.21.15.40:0/3432133488 conn(0x56334665e910 msgr2=0x563346a0b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 -- 172.21.15.40:0/3432133488 shutdown_connections 2024-07-26T13:15:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.510+0000 7f0835c86740 1 -- 172.21.15.40:0/3432133488 wait complete. 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.511+0000 7f0835c86740 1 -- start start 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.511+0000 7f0835c86740 1 Processor -- start 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.511+0000 7f0835c86740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f0835c86740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f0835c86740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a20160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f0835c86740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08281b2160 con 0x563346649840 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f0835c86740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f08281b1a90 con 0x563346641660 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f0835c86740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08281aecb0 con 0x56334666a520 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f0835c86740 10 client.0 _ll_register_callbacks cb 0x7f0810009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f081fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f081fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42350/0 (socket says 172.21.15.40:42350) 2024-07-26T13:15:20.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f081fe00640 1 -- 172.21.15.40:0/1465707784 learned_addr learned my addr 172.21.15.40:0/1465707784 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:20.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f082d000640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.512+0000 7f082d000640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a20160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f081fe00640 1 -- 172.21.15.40:0/1465707784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 msgr2=0x563346a20160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f081fe00640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a20160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f081fe00640 1 -- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 msgr2=0x563346a234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f081fe00640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a234a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f081fe00640 1 -- 172.21.15.40:0/1465707784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563346a95410 con 0x563346649840 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f081fe00640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1fa50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f081002a910 tx=0x7f0810031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85b8a63224abc27 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f0816000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.513+0000 7f0816000640 1 -- 172.21.15.40:0/1465707784 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810035040 con 0x563346649840 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.514+0000 7f0816000640 1 -- 172.21.15.40:0/1465707784 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0810031600 con 0x563346649840 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.514+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0820029ba0 con 0x563346649840 2024-07-26T13:15:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.514+0000 7f0816000640 1 -- 172.21.15.40:0/1465707784 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0810003c50 con 0x563346649840 2024-07-26T13:15:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.514+0000 7f0835c86740 10 client.17616 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.514+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563346a965a0 con 0x563346649840 2024-07-26T13:15:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.514+0000 7f0816000640 1 -- 172.21.15.40:0/1465707784 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0820029ba0 con 0x563346649840 2024-07-26T13:15:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0816000640 1 -- 172.21.15.40:0/1465707784 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f0810045430 con 0x563346649840 2024-07-26T13:15:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0835c86740 10 client.17616 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0835c86740 10 client.17616 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0835c86740 20 client.17616 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0835c86740 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5633465fe250 0x563346a98d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0835c86740 4 client.17616 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9d80ecc1", "release": true, "await": true}] 2024-07-26T13:15:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.515+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9d80ecc1", "release": true, "await": true}) -- 0x563346983940 con 0x5633465fe250 2024-07-26T13:15:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.516+0000 7f082d000640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5633465fe250 0x563346a98d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.517+0000 7f082d000640 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5633465fe250 0x563346a98d90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68cfec3631fb9d5d server_cookie=f5081ce87b27222f in_seq=0 out_seq=0 2024-07-26T13:15:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.517+0000 7f0816000640 10 client.17616 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:20.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.580+0000 7f0816000640 1 -- 172.21.15.40:0/1465707784 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x563346983940 con 0x5633465fe250 2024-07-26T13:15:20.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.580+0000 7f0816000640 10 client.17616 handle_command_reply: tid=0 2024-07-26T13:15:20.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.580+0000 7f0835c86740 1 client.17616 shutdown 2024-07-26T13:15:20.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 msgr2=0x563346a1fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1fa50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f081002a910 tx=0x7f0810031bb0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 shutdown_connections 2024-07-26T13:15:20.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56334666a520 0x563346a20160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5633465fe250 0x563346a98d90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563346649840 0x563346a1fa50 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 --2- 172.21.15.40:0/1465707784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563346641660 0x563346a234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 >> 172.21.15.40:0/1465707784 conn(0x56334665e910 msgr2=0x563346a0b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.581+0000 7f0816000640 0 client.17616 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.582+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 shutdown_connections 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.582+0000 7f0835c86740 1 -- 172.21.15.40:0/1465707784 wait complete. 2024-07-26T13:15:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.582+0000 7f0835c86740 20 client.17616 trim_cache size 0 max 16384 2024-07-26T13:15:20.585 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:15:20.585 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:15:20.585 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 180, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "9d80ecc1": { 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 180, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.2, 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:15:20.586 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:20.587 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:15:20.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3d50 msgr2=0x7f080c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3d50 0x7f080c0b6260 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f08180a6510 tx=0x7f08180e6af0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 msgr2=0x7f082819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:20.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 0x7f082819be50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f081800d950 tx=0x7f081800de10 comp rx=0 tx=0).stop 2024-07-26T13:15:20.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 shutdown_connections 2024-07-26T13:15:20.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f080c0b3d50 0x7f080c0b6260 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0828109670 0x7f08281a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0828108d20 0x7f082819c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 --2- 172.21.15.40:0/1102789836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08281033e0 0x7f082819be50 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:20.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.584+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 >> 172.21.15.40:0/1102789836 conn(0x7f08280fee70 msgr2=0x7f0828107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:20.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.585+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 shutdown_connections 2024-07-26T13:15:20.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:20.585+0000 7f082da00640 1 -- 172.21.15.40:0/1102789836 wait complete. 2024-07-26T13:15:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:21 smithi040 ceph-mon[32397]: pgmap v2092: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:15:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:21 smithi146 ceph-mon[35807]: pgmap v2092: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:15:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:21 smithi076 ceph-mon[35401]: pgmap v2092: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:15:21.584 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9d80ecc1', total seconds elapsed: 28.9 2024-07-26T13:15:21.584 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.2 2024-07-26T13:15:21.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:15:22.116 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:15:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:23 smithi040 ceph-mon[32397]: pgmap v2093: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:15:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:23 smithi146 ceph-mon[35807]: pgmap v2093: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:15:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:23 smithi076 ceph-mon[35401]: pgmap v2093: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:15:24.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 -- 172.21.15.40:0/910410869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4077cc0 msgr2=0x7f32f4113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:24.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 --2- 172.21.15.40:0/910410869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4077cc0 0x7f32f4113c30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009900 tx=0x7f32e802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 -- 172.21.15.40:0/910410869 shutdown_connections 2024-07-26T13:15:24.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 --2- 172.21.15.40:0/910410869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32f4114170 0x7f32f4116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 --2- 172.21.15.40:0/910410869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4077cc0 0x7f32f4113c30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 --2- 172.21.15.40:0/910410869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f4077370 0x7f32f4077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 -- 172.21.15.40:0/910410869 >> 172.21.15.40:0/910410869 conn(0x7f32f4101240 msgr2=0x7f32f4103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:24.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.516+0000 7f32fb600640 1 -- 172.21.15.40:0/910410869 shutdown_connections 2024-07-26T13:15:24.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.517+0000 7f32fb600640 1 -- 172.21.15.40:0/910410869 wait complete. 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.518+0000 7f32fb600640 1 Processor -- start 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.518+0000 7f32fb600640 1 -- start start 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32fb600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32f4077370 0x7f32f41a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32fb600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f4077cc0 0x7f32f41a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32fb600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 0x7f32f41a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32fb600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4119980 con 0x7f32f4114170 2024-07-26T13:15:24.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32fb600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4119800 con 0x7f32f4077370 2024-07-26T13:15:24.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32fb600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4119b00 con 0x7f32f4077cc0 2024-07-26T13:15:24.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32f9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 0x7f32f41a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:24.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32f9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 0x7f32f41a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35642/0 (socket says 172.21.15.40:35642) 2024-07-26T13:15:24.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32f9600640 1 -- 172.21.15.40:0/3198450430 learned_addr learned my addr 172.21.15.40:0/3198450430 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:24.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32f8c00640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32f4077370 0x7f32f41a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:24.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.519+0000 7f32f3e00640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f4077cc0 0x7f32f41a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.520+0000 7f32f9600640 1 -- 172.21.15.40:0/3198450430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f4077cc0 msgr2=0x7f32f41a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.520+0000 7f32f9600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f4077cc0 0x7f32f41a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.520+0000 7f32f9600640 1 -- 172.21.15.40:0/3198450430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32f4077370 msgr2=0x7f32f41a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.520+0000 7f32f9600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32f4077370 0x7f32f41a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.520+0000 7f32f9600640 1 -- 172.21.15.40:0/3198450430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f41a6340 con 0x7f32f4114170 2024-07-26T13:15:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.520+0000 7f32f9600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 0x7f32f41a5cd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00eaa0 tx=0x7f32ec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.521+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec004d20 con 0x7f32f4114170 2024-07-26T13:15:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.521+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32ec005020 con 0x7f32f4114170 2024-07-26T13:15:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.521+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f41a6630 con 0x7f32f4114170 2024-07-26T13:15:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.521+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0116d0 con 0x7f32f4114170 2024-07-26T13:15:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.521+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f41a6af0 con 0x7f32f4114170 2024-07-26T13:15:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.522+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f4077780 con 0x7f32f4114170 2024-07-26T13:15:24.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.525+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f32ec0051d0 con 0x7f32f4114170 2024-07-26T13:15:24.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.528+0000 7f32f1600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f32dc0b3c00 0x7f32dc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:24.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.528+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f32ec0e3c70 con 0x7f32f4114170 2024-07-26T13:15:24.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.528+0000 7f32f8c00640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f32dc0b3c00 0x7f32dc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.529+0000 7f32f8c00640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f32dc0b3c00 0x7f32dc0b6110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f32e000abe0 tx=0x7f32e000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.532+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f32ec016030 con 0x7f32f4114170 2024-07-26T13:15:24.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.813+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32f402e0c0 con 0x7f32f4114170 2024-07-26T13:15:24.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.816+0000 7f32f1600640 1 -- 172.21.15.40:0/3198450430 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f32ec0ab280 con 0x7f32f4114170 2024-07-26T13:15:24.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:15:24.819 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:15:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:15:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.819+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f32dc0b3c00 msgr2=0x7f32dc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.819+0000 7f32fb600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f32dc0b3c00 0x7f32dc0b6110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f32e000abe0 tx=0x7f32e000a2d0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.819+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 msgr2=0x7f32f41a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.819+0000 7f32fb600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 0x7f32f41a5cd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00eaa0 tx=0x7f32ec00eea0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 shutdown_connections 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32f4114170 0x7f32f41a5cd0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f32dc0b3c00 0x7f32dc0b6110 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f4077cc0 0x7f32f41a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 --2- 172.21.15.40:0/3198450430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f32f4077370 0x7f32f41a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 >> 172.21.15.40:0/3198450430 conn(0x7f32f4101240 msgr2=0x7f32f41162b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 shutdown_connections 2024-07-26T13:15:24.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:24.820+0000 7f32fb600640 1 -- 172.21.15.40:0/3198450430 wait complete. 2024-07-26T13:15:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:25 smithi040 ceph-mon[32397]: pgmap v2094: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 788 KiB/s wr, 11 op/s 2024-07-26T13:15:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3198450430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:25 smithi146 ceph-mon[35807]: pgmap v2094: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 788 KiB/s wr, 11 op/s 2024-07-26T13:15:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3198450430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:25 smithi076 ceph-mon[35401]: pgmap v2094: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 788 KiB/s wr, 11 op/s 2024-07-26T13:15:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3198450430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:25.725 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 141.2 --await-for 45.0' 2024-07-26T13:15:25.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 141.2 --await-for 45.0 2024-07-26T13:15:26.261 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:15:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:27 smithi040 ceph-mon[32397]: pgmap v2095: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 788 KiB/s wr, 10 op/s 2024-07-26T13:15:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:27 smithi146 ceph-mon[35807]: pgmap v2095: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 788 KiB/s wr, 10 op/s 2024-07-26T13:15:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:27 smithi076 ceph-mon[35401]: pgmap v2095: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 788 KiB/s wr, 10 op/s 2024-07-26T13:15:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 -- 172.21.15.40:0/1293623587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 msgr2=0x7f3a7010f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1293623587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7010f4b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c02a480 comp rx=0 tx=0).stop 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 -- 172.21.15.40:0/1293623587 shutdown_connections 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1293623587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a7010f9f0 0x7f3a70111e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1293623587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7010f4b0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1293623587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 0x7f3a70102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 -- 172.21.15.40:0/1293623587 >> 172.21.15.40:0/1293623587 conn(0x7f3a700fdd60 msgr2=0x7f3a701001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 -- 172.21.15.40:0/1293623587 shutdown_connections 2024-07-26T13:15:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.781+0000 7f3a6f200640 1 -- 172.21.15.40:0/1293623587 wait complete. 2024-07-26T13:15:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 Processor -- start 2024-07-26T13:15:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 -- start start 2024-07-26T13:15:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 0x7f3a7019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a7010f9f0 0x7f3a701a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3a70115360 con 0x7f3a70102790 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701151e0 con 0x7f3a7010f9f0 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.783+0000 7f3a6f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701154e0 con 0x7f3a70101e40 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35664/0 (socket says 172.21.15.40:35664) 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 -- 172.21.15.40:0/1976006574 learned_addr learned my addr 172.21.15.40:0/1976006574 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 0x7f3a7019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6e800640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a7010f9f0 0x7f3a701a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 -- 172.21.15.40:0/1976006574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 msgr2=0x7f3a7019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 0x7f3a7019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 -- 172.21.15.40:0/1976006574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a7010f9f0 msgr2=0x7f3a701a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a7010f9f0 0x7f3a701a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.784+0000 7f3a6d400640 1 -- 172.21.15.40:0/1976006574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a701a1d00 con 0x7f3a70102790 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.785+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 0x7f3a7019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.785+0000 7f3a6d400640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7019c3f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009230 tx=0x7f3a5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.785+0000 7f3a66a00640 1 -- 172.21.15.40:0/1976006574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c03f030 con 0x7f3a70102790 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.785+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a701a1f90 con 0x7f3a70102790 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.785+0000 7f3a66a00640 1 -- 172.21.15.40:0/1976006574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a5c003a80 con 0x7f3a70102790 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.785+0000 7f3a66a00640 1 -- 172.21.15.40:0/1976006574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c035070 con 0x7f3a70102790 2024-07-26T13:15:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.786+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a701a2470 con 0x7f3a70102790 2024-07-26T13:15:28.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.790+0000 7f3a7b88a740 1 Processor -- start 2024-07-26T13:15:28.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 -- start start 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a66a00640 1 -- 172.21.15.40:0/1976006574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3a5c042030 con 0x7f3a70102790 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555a7e76ed10 con 0x555a7e3fe840 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555a7e719b60 con 0x555a7e3ddb60 2024-07-26T13:15:28.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.791+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555a7e709060 con 0x555a7e3d5980 2024-07-26T13:15:28.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.792+0000 7f3a6e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.792+0000 7f3a6e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35678/0 (socket says 172.21.15.40:35678) 2024-07-26T13:15:28.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.792+0000 7f3a6e800640 1 -- 172.21.15.40:0/825726983 learned_addr learned my addr 172.21.15.40:0/825726983 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:28.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.792+0000 7f3a6de00640 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.792+0000 7f3a6d400640 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6e800640 1 -- 172.21.15.40:0/825726983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 msgr2=0x555a7e7a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6e800640 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6e800640 1 -- 172.21.15.40:0/825726983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 msgr2=0x555a7e7a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6e800640 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7a4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6e800640 1 -- 172.21.15.40:0/825726983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7e690b10 con 0x555a7e3fe840 2024-07-26T13:15:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6d400640 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.793+0000 7f3a6e800640 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7a43b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3a68007e50 tx=0x7f3a6800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5300cd06e72734c3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.794+0000 7f3a66a00640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a540b3bf0 0x7f3a540b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.794+0000 7f3a5b000640 1 -- 172.21.15.40:0/825726983 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68014070 con 0x555a7e3fe840 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.794+0000 7f3a5b000640 1 -- 172.21.15.40:0/825726983 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a6800ee90 con 0x555a7e3fe840 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.794+0000 7f3a5b000640 1 -- 172.21.15.40:0/825726983 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a680052b0 con 0x555a7e3fe840 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.794+0000 7f3a66a00640 1 -- 172.21.15.40:0/1976006574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a5c1041f0 con 0x7f3a70102790 2024-07-26T13:15:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.794+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a540b3bf0 0x7f3a540b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 -- 172.21.15.40:0/825726983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 msgr2=0x555a7e7a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7a43b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3a68007e50 tx=0x7f3a6800e720 comp rx=0 tx=0).stop 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a540b3bf0 0x7f3a540b6100 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x555a7e7a3030 tx=0x7f3a6000b5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 -- 172.21.15.40:0/825726983 shutdown_connections 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/825726983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7a43b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.795+0000 7f3a7b88a740 1 -- 172.21.15.40:0/825726983 >> 172.21.15.40:0/825726983 conn(0x555a7e3f2990 msgr2=0x555a7e7a22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.796+0000 7f3a7b88a740 1 -- 172.21.15.40:0/825726983 shutdown_connections 2024-07-26T13:15:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.796+0000 7f3a7b88a740 1 -- 172.21.15.40:0/825726983 wait complete. 2024-07-26T13:15:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.796+0000 7f3a7b88a740 1 -- start start 2024-07-26T13:15:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.797+0000 7f3a7b88a740 1 Processor -- start 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.797+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.797+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555a7e6a5520 con 0x555a7e3fe840 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555a7e70d0a0 con 0x555a7e3ddb60 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555a7e56c7a0 con 0x555a7e3d5980 2024-07-26T13:15:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a7b88a740 10 client.0 _ll_register_callbacks cb 0x555a7e701bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a6e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a6e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7bbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35682/0 (socket says 172.21.15.40:35682) 2024-07-26T13:15:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a6e800640 1 -- 172.21.15.40:0/1504887601 learned_addr learned my addr 172.21.15.40:0/1504887601 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.798+0000 7f3a6d400640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a6e800640 1 -- 172.21.15.40:0/1504887601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 msgr2=0x555a7e7afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a6e800640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a6e800640 1 -- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 msgr2=0x555a7e7b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a6e800640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a6e800640 1 -- 172.21.15.40:0/1504887601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7e478b90 con 0x555a7e3fe840 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a6e800640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7bbd60 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3a68010ee0 tx=0x7f3a68010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239c77c9dc876492 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.799+0000 7f3a4f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.800+0000 7f3a4f400640 1 -- 172.21.15.40:0/1504887601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68027060 con 0x555a7e3fe840 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.800+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a6800ee90 con 0x555a7e3fe840 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.800+0000 7f3a4f400640 1 -- 172.21.15.40:0/1504887601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a680109e0 con 0x555a7e3fe840 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.800+0000 7f3a4f400640 1 -- 172.21.15.40:0/1504887601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3a68014070 con 0x555a7e3fe840 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.800+0000 7f3a7b88a740 10 client.17634 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.800+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555a7e7be910 con 0x555a7e3fe840 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a4f400640 1 -- 172.21.15.40:0/1504887601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a6800ee90 con 0x555a7e3fe840 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a4f400640 1 -- 172.21.15.40:0/1504887601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3a68022410 con 0x555a7e3fe840 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a7b88a740 10 client.17634 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a7b88a740 10 client.17634 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a7b88a740 20 client.17634 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e3bd1c0 0x555a7e7c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a7b88a740 4 client.17634 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:15:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.801+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a7e71bab0 con 0x555a7e3bd1c0 2024-07-26T13:15:28.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.802+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e3bd1c0 0x555a7e7c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.803+0000 7f3a6de00640 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e3bd1c0 0x555a7e7c1c70 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7e394e9dd26aee server_cookie=ce981fe7104fd22d in_seq=0 out_seq=0 2024-07-26T13:15:28.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.803+0000 7f3a4f400640 10 client.17634 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a4f400640 1 -- 172.21.15.40:0/1504887601 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a7e71bab0 con 0x555a7e3bd1c0 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a4f400640 10 client.17634 handle_command_reply: tid=0 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 client.17634 shutdown 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 msgr2=0x555a7e7bbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7bbd60 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3a68010ee0 tx=0x7f3a68010870 comp rx=0 tx=0).stop 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 shutdown_connections 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e3bd1c0 0x555a7e7c1c70 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7bbd60 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/1504887601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 >> 172.21.15.40:0/1504887601 conn(0x555a7e3f2990 msgr2=0x555a7e7a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:28.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.805+0000 7f3a4f400640 0 client.17634 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:28.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.806+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 shutdown_connections 2024-07-26T13:15:28.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.806+0000 7f3a7b88a740 1 -- 172.21.15.40:0/1504887601 wait complete. 2024-07-26T13:15:28.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.806+0000 7f3a7b88a740 20 client.17634 trim_cache size 0 max 16384 2024-07-26T13:15:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 Processor -- start 2024-07-26T13:15:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 -- start start 2024-07-26T13:15:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701b0d50 con 0x555a7e3fe840 2024-07-26T13:15:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701b2890 con 0x555a7e3ddb60 2024-07-26T13:15:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.825+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701b1420 con 0x555a7e3d5980 2024-07-26T13:15:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35692/0 (socket says 172.21.15.40:35692) 2024-07-26T13:15:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 -- 172.21.15.40:0/91141571 learned_addr learned my addr 172.21.15.40:0/91141571 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6de00640 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6d400640 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 -- 172.21.15.40:0/91141571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 msgr2=0x555a7e7a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 -- 172.21.15.40:0/91141571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 msgr2=0x555a7e7afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.826+0000 7f3a6e800640 1 -- 172.21.15.40:0/91141571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7e79c580 con 0x555a7e3fe840 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.827+0000 7f3a6e800640 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7b1860 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800eba0 tx=0x7f3a68005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc652964d9a55f4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.827+0000 7f3a5a600640 1 -- 172.21.15.40:0/91141571 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68027070 con 0x555a7e3fe840 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.827+0000 7f3a5a600640 1 -- 172.21.15.40:0/91141571 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a68022b80 con 0x555a7e3fe840 2024-07-26T13:15:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.827+0000 7f3a5a600640 1 -- 172.21.15.40:0/91141571 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68031080 con 0x555a7e3fe840 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 -- 172.21.15.40:0/91141571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 msgr2=0x555a7e7b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7b1860 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800eba0 tx=0x7f3a68005e90 comp rx=0 tx=0).stop 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 -- 172.21.15.40:0/91141571 shutdown_connections 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3fe840 0x555a7e7b1860 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3ddb60 0x555a7e7afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/91141571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3d5980 0x555a7e7a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 -- 172.21.15.40:0/91141571 >> 172.21.15.40:0/91141571 conn(0x555a7e3f2990 msgr2=0x555a7e7b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.828+0000 7f3a7b88a740 1 -- 172.21.15.40:0/91141571 shutdown_connections 2024-07-26T13:15:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.829+0000 7f3a7b88a740 1 -- 172.21.15.40:0/91141571 wait complete. 2024-07-26T13:15:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.829+0000 7f3a7b88a740 1 -- start start 2024-07-26T13:15:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.829+0000 7f3a7b88a740 1 Processor -- start 2024-07-26T13:15:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 0x555a7e7c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3ddb60 0x555a7e7c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3fe840 0x555a7e821200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701b21c0 con 0x555a7e3d5980 2024-07-26T13:15:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701b1af0 con 0x555a7e3fe840 2024-07-26T13:15:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a701aed10 con 0x555a7e3ddb60 2024-07-26T13:15:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a7b88a740 10 client.0 _ll_register_callbacks cb 0x7f3a6000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.830+0000 7f3a6de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 0x555a7e7c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 0x555a7e7c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35696/0 (socket says 172.21.15.40:35696) 2024-07-26T13:15:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 -- 172.21.15.40:0/3360303555 learned_addr learned my addr 172.21.15.40:0/3360303555 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6d400640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3ddb60 0x555a7e7c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6e800640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3fe840 0x555a7e821200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 -- 172.21.15.40:0/3360303555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3ddb60 msgr2=0x555a7e7c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3ddb60 0x555a7e7c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 -- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3fe840 msgr2=0x555a7e821200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3fe840 0x555a7e821200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.831+0000 7f3a6de00640 1 -- 172.21.15.40:0/3360303555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7e821870 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a6de00640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 0x555a7e7c26f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3a60012fd0 tx=0x7f3a600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d81513d7426f9d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a4f400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a4f400640 1 -- 172.21.15.40:0/3360303555 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60004020 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a4f400640 1 -- 172.21.15.40:0/3360303555 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a600041c0 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a68022b80 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a4f400640 1 -- 172.21.15.40:0/3360303555 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3a60037050 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a7b88a740 10 client.17640 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.832+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555a7e829dd0 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a4f400640 1 -- 172.21.15.40:0/3360303555 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a68022b80 con 0x555a7e3d5980 2024-07-26T13:15:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a4f400640 1 -- 172.21.15.40:0/3360303555 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f3a60003680 con 0x555a7e3d5980 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a7b88a740 10 client.17640 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a7b88a740 10 client.17640 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a7b88a740 20 client.17640 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e392570 0x555a7e82c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a7b88a740 4 client.17640 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.2, "await_for": 45.0}] 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.833+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.2, "await_for": 45.0}) -- 0x555a7e717550 con 0x555a7e392570 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.834+0000 7f3a6d400640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e392570 0x555a7e82c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:28.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.835+0000 7f3a6d400640 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e392570 0x555a7e82c5e0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed64528cf54bc9b server_cookie=e24ef932d45c9a5e in_seq=0 out_seq=0 2024-07-26T13:15:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:28.835+0000 7f3a4f400640 10 client.17640 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:29.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a4f400640 1 -- 172.21.15.40:0/3360303555 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x555a7e717550 con 0x555a7e392570 2024-07-26T13:15:29.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a4f400640 10 client.17640 handle_command_reply: tid=0 2024-07-26T13:15:29.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 client.17640 shutdown 2024-07-26T13:15:29.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 msgr2=0x555a7e7c26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:29.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 0x555a7e7c26f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3a60012fd0 tx=0x7f3a600046c0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 shutdown_connections 2024-07-26T13:15:29.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555a7e3fe840 0x555a7e821200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555a7e3ddb60 0x555a7e7c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x555a7e392570 0x555a7e82c5e0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 --2- 172.21.15.40:0/3360303555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555a7e3d5980 0x555a7e7c26f0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.127+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 >> 172.21.15.40:0/3360303555 conn(0x555a7e3f2990 msgr2=0x555a7e7af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:29.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.128+0000 7f3a4f400640 0 client.17640 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:29.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.128+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 shutdown_connections 2024-07-26T13:15:29.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.128+0000 7f3a7b88a740 1 -- 172.21.15.40:0/3360303555 wait complete. 2024-07-26T13:15:29.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.128+0000 7f3a7b88a740 20 client.17640 trim_cache size 0 max 16384 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 182, 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "5692b6cb": { 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 182, 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:15:29.131 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.2, 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:29.132 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:15:29.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a540b3bf0 msgr2=0x7f3a540b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:29.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a540b3bf0 0x7f3a540b6100 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x555a7e7a3030 tx=0x7f3a6000b5a0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 msgr2=0x7f3a7019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:29.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7019c3f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009230 tx=0x7f3a5c004270 comp rx=0 tx=0).stop 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 shutdown_connections 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a7010f9f0 0x7f3a701a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a70102790 0x7f3a7019c3f0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3a540b3bf0 0x7f3a540b6100 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 --2- 172.21.15.40:0/1976006574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a70101e40 0x7f3a7019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 >> 172.21.15.40:0/1976006574 conn(0x7f3a700fdd60 msgr2=0x7f3a70100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.130+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 shutdown_connections 2024-07-26T13:15:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:29.131+0000 7f3a6f200640 1 -- 172.21.15.40:0/1976006574 wait complete. 2024-07-26T13:15:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:29 smithi040 ceph-mon[32397]: pgmap v2096: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:15:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:29 smithi146 ceph-mon[35807]: pgmap v2096: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:15:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:29 smithi076 ceph-mon[35401]: pgmap v2096: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:15:30.136 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5692b6cb', quiesce took 8.6 seconds. Will release after: 12.6 2024-07-26T13:15:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:31 smithi146 ceph-mon[35807]: pgmap v2097: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:15:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:31 smithi076 ceph-mon[35401]: pgmap v2097: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:15:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:31 smithi040 ceph-mon[32397]: pgmap v2097: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:15:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:33 smithi146 ceph-mon[35807]: pgmap v2098: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 10 op/s 2024-07-26T13:15:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:33 smithi076 ceph-mon[35401]: pgmap v2098: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 10 op/s 2024-07-26T13:15:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:33 smithi040 ceph-mon[32397]: pgmap v2098: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 10 op/s 2024-07-26T13:15:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:35 smithi146 ceph-mon[35807]: pgmap v2099: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-07-26T13:15:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:35 smithi076 ceph-mon[35401]: pgmap v2099: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-07-26T13:15:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:35 smithi040 ceph-mon[32397]: pgmap v2099: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.1 MiB/s wr, 13 op/s 2024-07-26T13:15:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:37 smithi146 ceph-mon[35807]: pgmap v2100: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:15:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:37 smithi076 ceph-mon[35401]: pgmap v2100: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:15:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:37 smithi040 ceph-mon[32397]: pgmap v2100: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:15:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:39 smithi146 ceph-mon[35807]: pgmap v2101: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T13:15:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:39 smithi076 ceph-mon[35401]: pgmap v2101: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T13:15:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:39 smithi040 ceph-mon[32397]: pgmap v2101: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.9 MiB/s wr, 12 op/s 2024-07-26T13:15:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:41 smithi146 ceph-mon[35807]: pgmap v2102: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-07-26T13:15:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:41 smithi076 ceph-mon[35401]: pgmap v2102: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-07-26T13:15:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:41 smithi040 ceph-mon[32397]: pgmap v2102: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-07-26T13:15:42.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:15:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:15:43.540 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:43 smithi040 ceph-mon[32397]: pgmap v2103: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:15:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:43 smithi146 ceph-mon[35807]: pgmap v2103: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:15:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:43 smithi076 ceph-mon[35401]: pgmap v2103: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-07-26T13:15:45.402 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:45 smithi040 ceph-mon[32397]: pgmap v2104: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 626 KiB/s wr, 11 op/s 2024-07-26T13:15:45.402 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:15:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:45 smithi146 ceph-mon[35807]: pgmap v2104: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 626 KiB/s wr, 11 op/s 2024-07-26T13:15:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:15:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:45 smithi076 ceph-mon[35401]: pgmap v2104: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 626 KiB/s wr, 11 op/s 2024-07-26T13:15:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:15:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 -- 172.21.15.40:0/2530237431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 msgr2=0x7fa51c0755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 --2- 172.21.15.40:0/2530237431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c0755f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009900 tx=0x7fa50c02a410 comp rx=0 tx=0).stop 2024-07-26T13:15:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 -- 172.21.15.40:0/2530237431 shutdown_connections 2024-07-26T13:15:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 --2- 172.21.15.40:0/2530237431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c10f940 0x7fa51c111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 --2- 172.21.15.40:0/2530237431 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51c075b30 0x7fa51c10f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 --2- 172.21.15.40:0/2530237431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c0755f0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 -- 172.21.15.40:0/2530237431 >> 172.21.15.40:0/2530237431 conn(0x7fa51c0fee70 msgr2=0x7fa51c1012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 -- 172.21.15.40:0/2530237431 shutdown_connections 2024-07-26T13:15:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.611+0000 7fa520c00640 1 -- 172.21.15.40:0/2530237431 wait complete. 2024-07-26T13:15:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.612+0000 7fa520c00640 1 Processor -- start 2024-07-26T13:15:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 -- start start 2024-07-26T13:15:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51c075b30 0x7fa51c19c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c10f940 0x7fa51c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c115380 con 0x7fa51c0751e0 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c115200 con 0x7fa51c075b30 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.613+0000 7fa520c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c115500 con 0x7fa51c10f940 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60558/0 (socket says 172.21.15.40:60558) 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 -- 172.21.15.40:0/2103814972 learned_addr learned my addr 172.21.15.40:0/2103814972 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51aa00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51c075b30 0x7fa51c19c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51be00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c10f940 0x7fa51c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 -- 172.21.15.40:0/2103814972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c10f940 msgr2=0x7fa51c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c10f940 0x7fa51c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 -- 172.21.15.40:0/2103814972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51c075b30 msgr2=0x7fa51c19c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51c075b30 0x7fa51c19c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.614+0000 7fa51b400640 1 -- 172.21.15.40:0/2103814972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c1a1ca0 con 0x7fa51c0751e0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.615+0000 7fa51b400640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c19bdf0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009230 tx=0x7fa50c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.615+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c03f030 con 0x7fa51c0751e0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.615+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa50c003a80 con 0x7fa51c0751e0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.615+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c1a1f30 con 0x7fa51c0751e0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.615+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c035070 con 0x7fa51c0751e0 2024-07-26T13:15:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.615+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c1a2410 con 0x7fa51c0751e0 2024-07-26T13:15:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.616+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51c0755f0 con 0x7fa51c0751e0 2024-07-26T13:15:45.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.619+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa50c042030 con 0x7fa51c0751e0 2024-07-26T13:15:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.621+0000 7fa513e00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa5000b3c00 0x7fa5000b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.621+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa50c104740 con 0x7fa51c0751e0 2024-07-26T13:15:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.621+0000 7fa51aa00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa5000b3c00 0x7fa5000b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.622+0000 7fa51aa00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa5000b3c00 0x7fa5000b6110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa51c111e90 tx=0x7fa508005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.623+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa50c0cbd90 con 0x7fa51c0751e0 2024-07-26T13:15:45.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.873+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa51c1a8900 con 0x7fa51c0751e0 2024-07-26T13:15:45.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.874+0000 7fa513e00640 1 -- 172.21.15.40:0/2103814972 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fa50c0cb690 con 0x7fa51c0751e0 2024-07-26T13:15:45.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:15:45.876 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:15:45.876 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa5000b3c00 msgr2=0x7fa5000b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa5000b3c00 0x7fa5000b6110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa51c111e90 tx=0x7fa508005f90 comp rx=0 tx=0).stop 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 msgr2=0x7fa51c19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c19bdf0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009230 tx=0x7fa50c004270 comp rx=0 tx=0).stop 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 shutdown_connections 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa5000b3c00 0x7fa5000b6110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c10f940 0x7fa51c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa51c075b30 0x7fa51c19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 --2- 172.21.15.40:0/2103814972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa51c0751e0 0x7fa51c19bdf0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 >> 172.21.15.40:0/2103814972 conn(0x7fa51c0fee70 msgr2=0x7fa51c109520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 shutdown_connections 2024-07-26T13:15:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:45.877+0000 7fa520c00640 1 -- 172.21.15.40:0/2103814972 wait complete. 2024-07-26T13:15:46.539 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:15:46.539 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:15:46.540 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:15:46.540 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:46 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2103814972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:15:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:15:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:15:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:46 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2103814972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:15:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:15:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:15:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:46 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2103814972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:15:46.589 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 5692b6cb --release --await' 2024-07-26T13:15:46.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 5692b6cb --release --await 2024-07-26T13:15:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:15:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:47 smithi146 ceph-mon[35807]: pgmap v2105: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 625 KiB/s wr, 10 op/s 2024-07-26T13:15:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:47 smithi076 ceph-mon[35401]: pgmap v2105: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 625 KiB/s wr, 10 op/s 2024-07-26T13:15:47.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:47 smithi040 ceph-mon[32397]: pgmap v2105: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 625 KiB/s wr, 10 op/s 2024-07-26T13:15:48.388 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:48 smithi040 ceph-mon[32397]: pgmap v2106: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 284 KiB/s wr, 10 op/s 2024-07-26T13:15:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:48 smithi146 ceph-mon[35807]: pgmap v2106: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 284 KiB/s wr, 10 op/s 2024-07-26T13:15:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:48 smithi076 ceph-mon[35401]: pgmap v2106: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 284 KiB/s wr, 10 op/s 2024-07-26T13:15:49.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 -- 172.21.15.40:0/2175672450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b41090f0 msgr2=0x7f26b4109500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 --2- 172.21.15.40:0/2175672450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b41090f0 0x7f26b4109500 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009930 tx=0x7f26a402a420 comp rx=0 tx=0).stop 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 -- 172.21.15.40:0/2175672450 shutdown_connections 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 --2- 172.21.15.40:0/2175672450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26b4101a50 0x7f26b410fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 --2- 172.21.15.40:0/2175672450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b4101100 0x7f26b4101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 --2- 172.21.15.40:0/2175672450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b41090f0 0x7f26b4109500 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 -- 172.21.15.40:0/2175672450 >> 172.21.15.40:0/2175672450 conn(0x7f26b40780b0 msgr2=0x7f26b40784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 -- 172.21.15.40:0/2175672450 shutdown_connections 2024-07-26T13:15:49.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.332+0000 7f26b9c00640 1 -- 172.21.15.40:0/2175672450 wait complete. 2024-07-26T13:15:49.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.334+0000 7f26b9c00640 1 Processor -- start 2024-07-26T13:15:49.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.334+0000 7f26b9c00640 1 -- start start 2024-07-26T13:15:49.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26b9c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26b4101100 0x7f26b4102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26b9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 0x7f26b4103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26b9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b41090f0 0x7f26b4103640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26b9c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4113210 con 0x7f26b4101a50 2024-07-26T13:15:49.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26b9c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4113090 con 0x7f26b4101100 2024-07-26T13:15:49.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26b9c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4113390 con 0x7f26b41090f0 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26abe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 0x7f26b4103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26abe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 0x7f26b4103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60568/0 (socket says 172.21.15.40:60568) 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.335+0000 7f26abe00640 1 -- 172.21.15.40:0/84772760 learned_addr learned my addr 172.21.15.40:0/84772760 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26b3e00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26b4101100 0x7f26b4102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26b9200640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b41090f0 0x7f26b4103640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26abe00640 1 -- 172.21.15.40:0/84772760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b41090f0 msgr2=0x7f26b4103640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26abe00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b41090f0 0x7f26b4103640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26abe00640 1 -- 172.21.15.40:0/84772760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26b4101100 msgr2=0x7f26b4102bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26abe00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26b4101100 0x7f26b4102bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26abe00640 1 -- 172.21.15.40:0/84772760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b41a7f60 con 0x7f26b4101a50 2024-07-26T13:15:49.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.336+0000 7f26abe00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 0x7f26b4103100 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d750 tx=0x7f269c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:49.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.337+0000 7f26b1600640 1 -- 172.21.15.40:0/84772760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c017070 con 0x7f26b4101a50 2024-07-26T13:15:49.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.337+0000 7f26b1600640 1 -- 172.21.15.40:0/84772760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269c0054b0 con 0x7f26b4101a50 2024-07-26T13:15:49.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.337+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b41a8250 con 0x7f26b4101a50 2024-07-26T13:15:49.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.337+0000 7f26b1600640 1 -- 172.21.15.40:0/84772760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c004bc0 con 0x7f26b4101a50 2024-07-26T13:15:49.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.337+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41a8760 con 0x7f26b4101a50 2024-07-26T13:15:49.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 Processor -- start 2024-07-26T13:15:49.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 -- start start 2024-07-26T13:15:49.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26b1600640 1 -- 172.21.15.40:0/84772760 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f269c009c30 con 0x7f26b4101a50 2024-07-26T13:15:49.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7aec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd771e660 0x55bdd7aec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 0x55bdd7aecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bdd7a62f50 con 0x55bdd7726840 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bdd7a52450 con 0x55bdd7747520 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.341+0000 7f26c1e63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bdd7a56490 con 0x55bdd771e660 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.342+0000 7f26abe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 0x55bdd7aecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.342+0000 7f26abe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 0x55bdd7aecc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60576/0 (socket says 172.21.15.40:60576) 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.342+0000 7f26b9200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7aec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.342+0000 7f26abe00640 1 -- 172.21.15.40:0/3276025224 learned_addr learned my addr 172.21.15.40:0/3276025224 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:49.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.342+0000 7f26b3e00640 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd771e660 0x55bdd7aec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26abe00640 1 -- 172.21.15.40:0/3276025224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd771e660 msgr2=0x55bdd7aec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26abe00640 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd771e660 0x55bdd7aec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26abe00640 1 -- 172.21.15.40:0/3276025224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 msgr2=0x55bdd7aec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26abe00640 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7aec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26abe00640 1 -- 172.21.15.40:0/3276025224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd77b2b00 con 0x55bdd7726840 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26abe00640 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 0x55bdd7aecc20 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f269c0e96d0 tx=0x7f269c0e9b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59f131186c0d2c2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26a9600640 1 -- 172.21.15.40:0/3276025224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0f6070 con 0x55bdd7726840 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26a9600640 1 -- 172.21.15.40:0/3276025224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269c0e3bc0 con 0x55bdd7726840 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.343+0000 7f26a9600640 1 -- 172.21.15.40:0/3276025224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0e5380 con 0x55bdd7726840 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.344+0000 7f26b1600640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26980b3c50 0x7f26980b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.344+0000 7f26b1600640 1 -- 172.21.15.40:0/84772760 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f269c0e35d0 con 0x7f26b4101a50 2024-07-26T13:15:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.344+0000 7f26b9200640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26980b3c50 0x7f26980b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 -- 172.21.15.40:0/3276025224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 msgr2=0x55bdd7aecc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 0x55bdd7aecc20 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f269c0e96d0 tx=0x7f269c0e9b90 comp rx=0 tx=0).stop 2024-07-26T13:15:49.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 -- 172.21.15.40:0/3276025224 shutdown_connections 2024-07-26T13:15:49.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd7726840 0x55bdd7aecc20 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd771e660 0x55bdd7aec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3276025224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7aec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 -- 172.21.15.40:0/3276025224 >> 172.21.15.40:0/3276025224 conn(0x55bdd773b910 msgr2=0x55bdd7aea090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:49.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26b9200640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26980b3c50 0x7f26980b6160 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f26ac005fd0 tx=0x7f26ac009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:49.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 -- 172.21.15.40:0/3276025224 shutdown_connections 2024-07-26T13:15:49.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.345+0000 7f26c1e63740 1 -- 172.21.15.40:0/3276025224 wait complete. 2024-07-26T13:15:49.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 -- start start 2024-07-26T13:15:49.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 Processor -- start 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7af7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7af8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55bdd78b5bb0 con 0x55bdd771e660 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bdd79ee930 con 0x55bdd7747520 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.346+0000 7f26c1e63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bdd7afa980 con 0x55bdd7726840 2024-07-26T13:15:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26c1e63740 10 client.0 _ll_register_callbacks cb 0x55bdd775ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60580/0 (socket says 172.21.15.40:60580) 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 -- 172.21.15.40:0/3361877210 learned_addr learned my addr 172.21.15.40:0/3361877210 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26abe00640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7af7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b9200640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7af8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 -- 172.21.15.40:0/3361877210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 msgr2=0x55bdd7af7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7af7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 -- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 msgr2=0x55bdd7af8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7af8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.347+0000 7f26b3e00640 1 -- 172.21.15.40:0/3361877210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd7829960 con 0x55bdd771e660 2024-07-26T13:15:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26b9200640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7af8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26b3e00640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af77d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005ab0 tx=0x7f26a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c63a7c1b3cb09b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26a2000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26a2000640 1 -- 172.21.15.40:0/3361877210 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4035040 con 0x55bdd771e660 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26a2000640 1 -- 172.21.15.40:0/3361877210 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f26a4003c40 con 0x55bdd771e660 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269c0e3bc0 con 0x55bdd771e660 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.348+0000 7f26a2000640 1 -- 172.21.15.40:0/3361877210 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f26a4003e40 con 0x55bdd771e660 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 10 client.17658 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bdd7b06650 con 0x55bdd771e660 2024-07-26T13:15:49.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26a2000640 1 -- 172.21.15.40:0/3361877210 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f269c0e3bc0 con 0x55bdd771e660 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26a2000640 1 -- 172.21.15.40:0/3361877210 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f26a4031520 con 0x55bdd771e660 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 10 client.17658 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 10 client.17658 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 20 client.17658 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd7705ea0 0x55bdd7b09c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 4 client.17658 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.349+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdd7a64ea0 con 0x55bdd7705ea0 2024-07-26T13:15:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.350+0000 7f26abe00640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd7705ea0 0x55bdd7b09c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.351+0000 7f26abe00640 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd7705ea0 0x55bdd7b09c20 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12aeadeac9d969 server_cookie=b66ad9dfe863630e in_seq=0 out_seq=0 2024-07-26T13:15:49.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.351+0000 7f26a2000640 10 client.17658 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26a2000640 1 -- 172.21.15.40:0/3361877210 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bdd7a64ea0 con 0x55bdd7705ea0 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26a2000640 10 client.17658 handle_command_reply: tid=0 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 client.17658 shutdown 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 msgr2=0x55bdd7af77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af77d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005ab0 tx=0x7f26a4004600 comp rx=0 tx=0).stop 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 shutdown_connections 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7af8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7af7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd7705ea0 0x55bdd7b09c20 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 --2- 172.21.15.40:0/3361877210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af77d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 >> 172.21.15.40:0/3361877210 conn(0x55bdd773b910 msgr2=0x55bdd7aef330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:49.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.353+0000 7f26a2000640 0 client.17658 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:49.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.354+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 shutdown_connections 2024-07-26T13:15:49.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.354+0000 7f26c1e63740 1 -- 172.21.15.40:0/3361877210 wait complete. 2024-07-26T13:15:49.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.354+0000 7f26c1e63740 20 client.17658 trim_cache size 0 max 16384 2024-07-26T13:15:49.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.373+0000 7f26c1e63740 1 Processor -- start 2024-07-26T13:15:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.373+0000 7f26c1e63740 1 -- start start 2024-07-26T13:15:49.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7726840 0x55bdd7b03190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7747520 0x55bdd7b036d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26c1e63740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41b0da0 con 0x55bdd771e660 2024-07-26T13:15:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26c1e63740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41b28e0 con 0x55bdd7726840 2024-07-26T13:15:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26c1e63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41b1470 con 0x55bdd7747520 2024-07-26T13:15:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60582/0 (socket says 172.21.15.40:60582) 2024-07-26T13:15:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.374+0000 7f26b3e00640 1 -- 172.21.15.40:0/2475945852 learned_addr learned my addr 172.21.15.40:0/2475945852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26abe00640 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7726840 0x55bdd7b03190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26b9200640 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7747520 0x55bdd7b036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26b3e00640 1 -- 172.21.15.40:0/2475945852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7747520 msgr2=0x55bdd7b036d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26b3e00640 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7747520 0x55bdd7b036d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26b3e00640 1 -- 172.21.15.40:0/2475945852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7726840 msgr2=0x55bdd7b03190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26b3e00640 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7726840 0x55bdd7b03190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.375+0000 7f26b3e00640 1 -- 172.21.15.40:0/2475945852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd7af8a90 con 0x55bdd771e660 2024-07-26T13:15:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.376+0000 7f26b3e00640 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af2cf0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f26a4031940 tx=0x7f26a402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c14b31c15cb27b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.376+0000 7f26a8c00640 1 -- 172.21.15.40:0/2475945852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4035040 con 0x55bdd771e660 2024-07-26T13:15:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.376+0000 7f26a8c00640 1 -- 172.21.15.40:0/2475945852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26a4003c40 con 0x55bdd771e660 2024-07-26T13:15:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.376+0000 7f26a8c00640 1 -- 172.21.15.40:0/2475945852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a403cb30 con 0x55bdd771e660 2024-07-26T13:15:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.377+0000 7f26c1e63740 1 -- 172.21.15.40:0/2475945852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 msgr2=0x55bdd7af2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.377+0000 7f26c1e63740 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af2cf0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f26a4031940 tx=0x7f26a402a420 comp rx=0 tx=0).stop 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 -- 172.21.15.40:0/2475945852 shutdown_connections 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7747520 0x55bdd7b036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7726840 0x55bdd7b03190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 --2- 172.21.15.40:0/2475945852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7af2cf0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 -- 172.21.15.40:0/2475945852 >> 172.21.15.40:0/2475945852 conn(0x55bdd773b910 msgr2=0x55bdd7b02a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 -- 172.21.15.40:0/2475945852 shutdown_connections 2024-07-26T13:15:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.378+0000 7f26c1e63740 1 -- 172.21.15.40:0/2475945852 wait complete. 2024-07-26T13:15:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.379+0000 7f26c1e63740 1 -- start start 2024-07-26T13:15:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.379+0000 7f26c1e63740 1 Processor -- start 2024-07-26T13:15:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7afc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7afc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7b713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41b2210 con 0x55bdd771e660 2024-07-26T13:15:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41b1b40 con 0x55bdd7747520 2024-07-26T13:15:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41aed60 con 0x55bdd7726840 2024-07-26T13:15:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.380+0000 7f26c1e63740 10 client.0 _ll_register_callbacks cb 0x7f26a4005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7afc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7afc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60594/0 (socket says 172.21.15.40:60594) 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 -- 172.21.15.40:0/1940973510 learned_addr learned my addr 172.21.15.40:0/1940973510 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26abe00640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7afc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b9200640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7b713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 -- 172.21.15.40:0/1940973510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 msgr2=0x55bdd7afc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7afc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 -- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 msgr2=0x55bdd7b713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:15:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7b713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b3e00640 1 -- 172.21.15.40:0/1940973510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd7b719e0 con 0x55bdd771e660 2024-07-26T13:15:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.381+0000 7f26b9200640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7b713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:15:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.382+0000 7f26b3e00640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7afc2b0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f26a403c770 tx=0x7f26a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0159b77d4e8ea0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:15:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.382+0000 7f26a2000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.382+0000 7f26a2000640 1 -- 172.21.15.40:0/1940973510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4035070 con 0x55bdd771e660 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.382+0000 7f26a2000640 1 -- 172.21.15.40:0/1940973510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f26a4003a40 con 0x55bdd771e660 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.382+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a4003c40 con 0x55bdd771e660 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.383+0000 7f26a2000640 1 -- 172.21.15.40:0/1940973510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f26a4031610 con 0x55bdd771e660 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.383+0000 7f26c1e63740 10 client.17664 fetch_fsmap learned FSMap version 35 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.383+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bdd7b72ca0 con 0x55bdd771e660 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.383+0000 7f26a2000640 1 -- 172.21.15.40:0/1940973510 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26a4003c40 con 0x55bdd771e660 2024-07-26T13:15:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26a2000640 1 -- 172.21.15.40:0/1940973510 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f26a405d640 con 0x55bdd771e660 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26c1e63740 10 client.17664 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26c1e63740 10 client.17664 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26c1e63740 20 client.17664 populate_metadata read hostname 'smithi040' 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26c1e63740 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd76db250 0x55bdd7b75310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26c1e63740 4 client.17664 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5692b6cb", "release": true, "await": true}] 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5692b6cb", "release": true, "await": true}) -- 0x55bdd7a60940 con 0x55bdd76db250 2024-07-26T13:15:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.384+0000 7f26abe00640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd76db250 0x55bdd7b75310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:15:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.385+0000 7f26abe00640 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd76db250 0x55bdd7b75310 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60bcf62aa8989342 server_cookie=f6c9c8c118129a11 in_seq=0 out_seq=0 2024-07-26T13:15:49.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.385+0000 7f26a2000640 10 client.17664 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.456+0000 7f26a2000640 1 -- 172.21.15.40:0/1940973510 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55bdd7a60940 con 0x55bdd76db250 2024-07-26T13:15:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.456+0000 7f26a2000640 10 client.17664 handle_command_reply: tid=0 2024-07-26T13:15:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.456+0000 7f26c1e63740 1 client.17664 shutdown 2024-07-26T13:15:49.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 msgr2=0x55bdd7afc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7afc2b0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f26a403c770 tx=0x7f26a40045e0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 shutdown_connections 2024-07-26T13:15:49.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bdd7747520 0x55bdd7b713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bdd7726840 0x55bdd7afc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55bdd76db250 0x55bdd7b75310 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 --2- 172.21.15.40:0/1940973510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bdd771e660 0x55bdd7afc2b0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 >> 172.21.15.40:0/1940973510 conn(0x55bdd773b910 msgr2=0x55bdd7af2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.457+0000 7f26a2000640 0 client.17664 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.458+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 shutdown_connections 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.458+0000 7f26c1e63740 1 -- 172.21.15.40:0/1940973510 wait complete. 2024-07-26T13:15:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.458+0000 7f26c1e63740 20 client.17664 trim_cache size 0 max 16384 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 184, 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "5692b6cb": { 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 184, 2024-07-26T13:15:49.461 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 141.2, 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:15:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:49.463 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:49.463 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:49.463 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:49.463 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:15:49.463 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:15:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.459+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26980b3c50 msgr2=0x7f26980b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.459+0000 7f26b9c00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26980b3c50 0x7f26980b6160 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f26ac005fd0 tx=0x7f26ac009740 comp rx=0 tx=0).stop 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 msgr2=0x7f26b4103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 0x7f26b4103100 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d750 tx=0x7f269c00dc10 comp rx=0 tx=0).stop 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 shutdown_connections 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f26980b3c50 0x7f26980b6160 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b41090f0 0x7f26b4103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b4101a50 0x7f26b4103100 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 --2- 172.21.15.40:0/84772760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26b4101100 0x7f26b4102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 >> 172.21.15.40:0/84772760 conn(0x7f26b40780b0 msgr2=0x7f26b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.460+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 shutdown_connections 2024-07-26T13:15:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:15:49.461+0000 7f26b9c00640 1 -- 172.21.15.40:0/84772760 wait complete. 2024-07-26T13:15:50.450 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5692b6cb', total seconds elapsed: 28.9 2024-07-26T13:15:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:50 smithi146 ceph-mon[35807]: pgmap v2107: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:15:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:50 smithi076 ceph-mon[35401]: pgmap v2107: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:15:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:50 smithi040 ceph-mon[32397]: pgmap v2107: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:15:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:52 smithi146 ceph-mon[35807]: pgmap v2108: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:15:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:52 smithi076 ceph-mon[35401]: pgmap v2108: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:15:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:52 smithi040 ceph-mon[32397]: pgmap v2108: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:15:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:54 smithi146 ceph-mon[35807]: pgmap v2109: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-07-26T13:15:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:54 smithi076 ceph-mon[35401]: pgmap v2109: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-07-26T13:15:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:54 smithi040 ceph-mon[32397]: pgmap v2109: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-07-26T13:15:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:56 smithi146 ceph-mon[35807]: pgmap v2110: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-07-26T13:15:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:56 smithi076 ceph-mon[35401]: pgmap v2110: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-07-26T13:15:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:56 smithi040 ceph-mon[32397]: pgmap v2110: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-07-26T13:15:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:15:58 smithi146 ceph-mon[35807]: pgmap v2111: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 10 op/s 2024-07-26T13:15:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:15:58 smithi076 ceph-mon[35401]: pgmap v2111: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 10 op/s 2024-07-26T13:15:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:15:58 smithi040 ceph-mon[32397]: pgmap v2111: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 10 op/s 2024-07-26T13:16:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:00 smithi146 ceph-mon[35807]: pgmap v2112: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:16:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:00 smithi076 ceph-mon[35401]: pgmap v2112: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:16:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:00 smithi040 ceph-mon[32397]: pgmap v2112: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:16:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:02 smithi146 ceph-mon[35807]: pgmap v2113: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T13:16:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:02 smithi076 ceph-mon[35401]: pgmap v2113: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T13:16:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:02 smithi040 ceph-mon[32397]: pgmap v2113: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.1 MiB/s wr, 9 op/s 2024-07-26T13:16:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:04 smithi146 ceph-mon[35807]: pgmap v2114: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:16:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:04 smithi076 ceph-mon[35401]: pgmap v2114: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:16:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:04 smithi040 ceph-mon[32397]: pgmap v2114: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:16:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:06 smithi146 ceph-mon[35807]: pgmap v2115: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:06 smithi076 ceph-mon[35401]: pgmap v2115: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:06 smithi040 ceph-mon[32397]: pgmap v2115: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:08 smithi146 ceph-mon[35807]: pgmap v2116: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:16:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:08 smithi076 ceph-mon[35401]: pgmap v2116: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:16:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:08 smithi040 ceph-mon[32397]: pgmap v2116: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:16:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:10 smithi076 ceph-mon[35401]: pgmap v2117: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:16:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:10 smithi040 ceph-mon[32397]: pgmap v2117: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:16:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:10 smithi146 ceph-mon[35807]: pgmap v2117: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:16:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:12 smithi076 ceph-mon[35401]: pgmap v2118: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:16:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:12 smithi040 ceph-mon[32397]: pgmap v2118: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:16:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:12 smithi146 ceph-mon[35807]: pgmap v2118: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:16:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:14 smithi040 ceph-mon[32397]: pgmap v2119: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:16:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:14 smithi146 ceph-mon[35807]: pgmap v2119: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:16:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:14 smithi076 ceph-mon[35401]: pgmap v2119: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:16:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:16 smithi040 ceph-mon[32397]: pgmap v2120: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:16 smithi146 ceph-mon[35807]: pgmap v2120: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:16 smithi076 ceph-mon[35401]: pgmap v2120: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:18 smithi040 ceph-mon[32397]: pgmap v2121: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:16:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:18 smithi146 ceph-mon[35807]: pgmap v2121: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:16:19.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:18 smithi076 ceph-mon[35401]: pgmap v2121: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:16:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:20 smithi040 ceph-mon[32397]: pgmap v2122: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:16:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:20 smithi146 ceph-mon[35807]: pgmap v2122: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:16:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:20 smithi076 ceph-mon[35401]: pgmap v2122: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:16:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:22 smithi040 ceph-mon[32397]: pgmap v2123: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:16:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:22 smithi146 ceph-mon[35807]: pgmap v2123: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:16:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:22 smithi076 ceph-mon[35401]: pgmap v2123: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:16:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:24 smithi040 ceph-mon[32397]: pgmap v2124: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:16:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:24 smithi146 ceph-mon[35807]: pgmap v2124: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:16:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:24 smithi076 ceph-mon[35401]: pgmap v2124: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:16:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:26 smithi040 ceph-mon[32397]: pgmap v2125: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:16:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:26 smithi146 ceph-mon[35807]: pgmap v2125: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:16:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:26 smithi076 ceph-mon[35401]: pgmap v2125: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:16:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:28 smithi040 ceph-mon[32397]: pgmap v2126: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:16:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:28 smithi146 ceph-mon[35807]: pgmap v2126: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:16:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:28 smithi076 ceph-mon[35401]: pgmap v2126: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:16:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:30 smithi040 ceph-mon[32397]: pgmap v2127: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:16:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:30 smithi146 ceph-mon[35807]: pgmap v2127: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:16:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:30 smithi076 ceph-mon[35401]: pgmap v2127: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:16:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:32 smithi040 ceph-mon[32397]: pgmap v2128: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:32 smithi146 ceph-mon[35807]: pgmap v2128: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:16:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:32 smithi076 ceph-mon[35401]: pgmap v2128: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:16:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:34 smithi040 ceph-mon[32397]: pgmap v2129: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:16:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:34 smithi146 ceph-mon[35807]: pgmap v2129: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:16:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:34 smithi076 ceph-mon[35401]: pgmap v2129: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:16:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:36 smithi040 ceph-mon[32397]: pgmap v2130: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:36 smithi146 ceph-mon[35807]: pgmap v2130: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:36 smithi076 ceph-mon[35401]: pgmap v2130: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:38 smithi040 ceph-mon[32397]: pgmap v2131: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:38 smithi146 ceph-mon[35807]: pgmap v2131: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:38 smithi076 ceph-mon[35401]: pgmap v2131: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:16:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:40 smithi040 ceph-mon[32397]: pgmap v2132: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:16:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:40 smithi146 ceph-mon[35807]: pgmap v2132: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:16:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:40 smithi076 ceph-mon[35401]: pgmap v2132: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:16:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:42 smithi040 ceph-mon[32397]: pgmap v2133: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:16:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:42 smithi146 ceph-mon[35807]: pgmap v2133: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:16:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:42 smithi076 ceph-mon[35401]: pgmap v2133: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:16:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:44 smithi040 ceph-mon[32397]: pgmap v2134: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:16:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:44 smithi146 ceph-mon[35807]: pgmap v2134: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:16:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:44 smithi076 ceph-mon[35401]: pgmap v2134: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:16:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:46 smithi040 ceph-mon[32397]: pgmap v2135: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:16:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:16:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:46 smithi146 ceph-mon[35807]: pgmap v2135: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:16:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:16:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:46 smithi076 ceph-mon[35401]: pgmap v2135: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:16:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:16:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:48 smithi040 ceph-mon[32397]: pgmap v2136: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:16:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:48 smithi146 ceph-mon[35807]: pgmap v2136: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:16:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:48 smithi076 ceph-mon[35401]: pgmap v2136: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:16:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:50 smithi040 ceph-mon[32397]: pgmap v2137: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:16:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:50 smithi146 ceph-mon[35807]: pgmap v2137: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:16:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:50 smithi076 ceph-mon[35401]: pgmap v2137: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:16:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:52 smithi040 ceph-mon[32397]: pgmap v2138: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:16:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:52 smithi146 ceph-mon[35807]: pgmap v2138: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:16:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:52 smithi076 ceph-mon[35401]: pgmap v2138: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-07-26T13:16:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:54 smithi040 ceph-mon[32397]: pgmap v2139: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:16:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:16:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:16:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:54 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:54 smithi146 ceph-mon[35807]: pgmap v2139: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:16:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:16:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:16:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:54 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:54 smithi076 ceph-mon[35401]: pgmap v2139: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:16:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:16:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:16:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:54 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:16:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:56 smithi040 ceph-mon[32397]: pgmap v2140: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:16:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:56 smithi146 ceph-mon[35807]: pgmap v2140: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:16:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:56 smithi076 ceph-mon[35401]: pgmap v2140: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:16:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:16:58 smithi040 ceph-mon[32397]: pgmap v2141: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 13 op/s 2024-07-26T13:16:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:16:58 smithi146 ceph-mon[35807]: pgmap v2141: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 13 op/s 2024-07-26T13:16:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:16:58 smithi076 ceph-mon[35401]: pgmap v2141: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 13 op/s 2024-07-26T13:17:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:00 smithi040 ceph-mon[32397]: pgmap v2142: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:17:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:00 smithi146 ceph-mon[35807]: pgmap v2142: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:17:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:00 smithi076 ceph-mon[35401]: pgmap v2142: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:17:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:02 smithi040 ceph-mon[32397]: pgmap v2143: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:17:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:02 smithi146 ceph-mon[35807]: pgmap v2143: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:17:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:02 smithi076 ceph-mon[35401]: pgmap v2143: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.7 MiB/s wr, 10 op/s 2024-07-26T13:17:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:04 smithi040 ceph-mon[32397]: pgmap v2144: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:17:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:04 smithi146 ceph-mon[35807]: pgmap v2144: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:17:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:04 smithi076 ceph-mon[35401]: pgmap v2144: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:17:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:06 smithi040 ceph-mon[32397]: pgmap v2145: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T13:17:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:06 smithi146 ceph-mon[35807]: pgmap v2145: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T13:17:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:06 smithi076 ceph-mon[35401]: pgmap v2145: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 11 op/s 2024-07-26T13:17:09.195 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.0 2024-07-26T13:17:09.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:17:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:08 smithi040 ceph-mon[32397]: pgmap v2146: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:17:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:08 smithi146 ceph-mon[35807]: pgmap v2146: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:17:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:08 smithi076 ceph-mon[35401]: pgmap v2146: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:17:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:17:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:10 smithi040 ceph-mon[32397]: pgmap v2147: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:17:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:10 smithi146 ceph-mon[35807]: pgmap v2147: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:17:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:10 smithi076 ceph-mon[35401]: pgmap v2147: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:17:12.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 -- 172.21.15.40:0/1610792693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c1028d0 msgr2=0x7f9c2c102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 --2- 172.21.15.40:0/1610792693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c1028d0 0x7f9c2c102ce0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009900 tx=0x7f9c1c02a410 comp rx=0 tx=0).stop 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 -- 172.21.15.40:0/1610792693 shutdown_connections 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 --2- 172.21.15.40:0/1610792693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c105310 0x7f9c2c10ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 --2- 172.21.15.40:0/1610792693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 0x7f9c2c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 --2- 172.21.15.40:0/1610792693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c1028d0 0x7f9c2c102ce0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.627+0000 7f9c2be00640 1 -- 172.21.15.40:0/1610792693 >> 172.21.15.40:0/1610792693 conn(0x7f9c2c0774d0 msgr2=0x7f9c2c077910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.628+0000 7f9c2be00640 1 -- 172.21.15.40:0/1610792693 shutdown_connections 2024-07-26T13:17:12.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.628+0000 7f9c2be00640 1 -- 172.21.15.40:0/1610792693 wait complete. 2024-07-26T13:17:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.629+0000 7f9c2be00640 1 Processor -- start 2024-07-26T13:17:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.629+0000 7f9c2be00640 1 -- start start 2024-07-26T13:17:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1028d0 0x7f9c2c19beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 0x7f9c2c19c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 0x7f9c2c1a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c1120b0 con 0x7f9c2c105310 2024-07-26T13:17:12.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c111f30 con 0x7f9c2c1049c0 2024-07-26T13:17:12.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c112230 con 0x7f9c2c1028d0 2024-07-26T13:17:12.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 0x7f9c2c1a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:12.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 0x7f9c2c1a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38202/0 (socket says 172.21.15.40:38202) 2024-07-26T13:17:12.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2b400640 1 -- 172.21.15.40:0/440654481 learned_addr learned my addr 172.21.15.40:0/440654481 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c2aa00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1028d0 0x7f9c2c19beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.630+0000 7f9c23e00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 0x7f9c2c19c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c2b400640 1 -- 172.21.15.40:0/440654481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1028d0 msgr2=0x7f9c2c19beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c2b400640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1028d0 0x7f9c2c19beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c2b400640 1 -- 172.21.15.40:0/440654481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 msgr2=0x7f9c2c19c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c2b400640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 0x7f9c2c19c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c2b400640 1 -- 172.21.15.40:0/440654481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c1a1e20 con 0x7f9c2c105310 2024-07-26T13:17:12.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c23e00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 0x7f9c2c19c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:17:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.631+0000 7f9c2b400640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 0x7f9c2c1a16f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400eaa0 tx=0x7f9c2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.632+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400cdb0 con 0x7f9c2c105310 2024-07-26T13:17:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.632+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c24005020 con 0x7f9c2c105310 2024-07-26T13:17:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.632+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c1a2110 con 0x7f9c2c105310 2024-07-26T13:17:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.632+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c240116d0 con 0x7f9c2c105310 2024-07-26T13:17:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.632+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c1a8870 con 0x7f9c2c105310 2024-07-26T13:17:12.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.633+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2c102ce0 con 0x7f9c2c105310 2024-07-26T13:17:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.637+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9c240051d0 con 0x7f9c2c105310 2024-07-26T13:17:12.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.639+0000 7f9c23400640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c100b3bd0 0x7f9c100b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:12.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.639+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9c240e42e0 con 0x7f9c2c105310 2024-07-26T13:17:12.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.639+0000 7f9c2aa00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c100b3bd0 0x7f9c100b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:12.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.640+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9c24016030 con 0x7f9c2c105310 2024-07-26T13:17:12.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.640+0000 7f9c2aa00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c100b3bd0 0x7f9c100b60e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000c00 tx=0x7f9c1c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:12.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.917+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c2c19cfe0 con 0x7f9c2c105310 2024-07-26T13:17:12.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.919+0000 7f9c23400640 1 -- 172.21.15.40:0/440654481 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f9c2c19cfe0 con 0x7f9c2c105310 2024-07-26T13:17:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:17:12.921 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:17:12.922 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:17:12.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.923+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c100b3bd0 msgr2=0x7f9c100b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:12.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.923+0000 7f9c2be00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c100b3bd0 0x7f9c100b60e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000c00 tx=0x7f9c1c009680 comp rx=0 tx=0).stop 2024-07-26T13:17:12.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.923+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 msgr2=0x7f9c2c1a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:12.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.923+0000 7f9c2be00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 0x7f9c2c1a16f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400eaa0 tx=0x7f9c2400ef60 comp rx=0 tx=0).stop 2024-07-26T13:17:12.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 shutdown_connections 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c2c105310 0x7f9c2c1a16f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c2c1049c0 0x7f9c2c19c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9c100b3bd0 0x7f9c100b60e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 --2- 172.21.15.40:0/440654481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1028d0 0x7f9c2c19beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 >> 172.21.15.40:0/440654481 conn(0x7f9c2c0774d0 msgr2=0x7f9c2c10e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.924+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 shutdown_connections 2024-07-26T13:17:12.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:12.925+0000 7f9c2be00640 1 -- 172.21.15.40:0/440654481 wait complete. 2024-07-26T13:17:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:12 smithi040 ceph-mon[32397]: pgmap v2148: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:17:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:12 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/440654481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:17:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:12 smithi146 ceph-mon[35807]: pgmap v2148: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:17:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:12 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/440654481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:17:13.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:12 smithi076 ceph-mon[35401]: pgmap v2148: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-07-26T13:17:13.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:12 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/440654481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:17:13.952 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 143.0 --await-for 45.0' 2024-07-26T13:17:13.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 143.0 --await-for 45.0 2024-07-26T13:17:14.621 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:17:15.032 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:14 smithi040 ceph-mon[32397]: pgmap v2149: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:17:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:14 smithi146 ceph-mon[35807]: pgmap v2149: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:17:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:14 smithi076 ceph-mon[35401]: pgmap v2149: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 -- 172.21.15.40:0/2082496813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c10fa70 msgr2=0x7f2c6c111e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 --2- 172.21.15.40:0/2082496813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c10fa70 0x7f2c6c111e90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ca0 tx=0x7f2c6402a950 comp rx=0 tx=0).stop 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 -- 172.21.15.40:0/2082496813 shutdown_connections 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 --2- 172.21.15.40:0/2082496813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c10fa70 0x7f2c6c111e90 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 --2- 172.21.15.40:0/2082496813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c6c102810 0x7f2c6c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 --2- 172.21.15.40:0/2082496813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c6c101ec0 0x7f2c6c1022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.953+0000 7f2c6be00640 1 -- 172.21.15.40:0/2082496813 >> 172.21.15.40:0/2082496813 conn(0x7f2c6c0fdd60 msgr2=0x7f2c6c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.954+0000 7f2c6be00640 1 -- 172.21.15.40:0/2082496813 shutdown_connections 2024-07-26T13:17:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.954+0000 7f2c6be00640 1 -- 172.21.15.40:0/2082496813 wait complete. 2024-07-26T13:17:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.955+0000 7f2c6be00640 1 Processor -- start 2024-07-26T13:17:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 -- start start 2024-07-26T13:17:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c6c101ec0 0x7f2c6c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 0x7f2c6c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c6c10fa70 0x7f2c6c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1153b0 con 0x7f2c6c102810 2024-07-26T13:17:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c115230 con 0x7f2c6c10fa70 2024-07-26T13:17:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c115530 con 0x7f2c6c101ec0 2024-07-26T13:17:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.956+0000 7f2c6a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 0x7f2c6c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 0x7f2c6c19c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48374/0 (socket says 172.21.15.40:48374) 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 -- 172.21.15.40:0/1404420804 learned_addr learned my addr 172.21.15.40:0/1404420804 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c6c101ec0 0x7f2c6c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6b400640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c6c10fa70 0x7f2c6c1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 -- 172.21.15.40:0/1404420804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c6c101ec0 msgr2=0x7f2c6c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c6c101ec0 0x7f2c6c19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 -- 172.21.15.40:0/1404420804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c6c10fa70 msgr2=0x7f2c6c1a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c6c10fa70 0x7f2c6c1a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.957+0000 7f2c6a000640 1 -- 172.21.15.40:0/1404420804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c1a1cd0 con 0x7f2c6c102810 2024-07-26T13:17:16.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.958+0000 7f2c6a000640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 0x7f2c6c19c300 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800d950 tx=0x7f2c5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:16.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.958+0000 7f2c63400640 1 -- 172.21.15.40:0/1404420804 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58017070 con 0x7f2c6c102810 2024-07-26T13:17:16.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.958+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c1a1fc0 con 0x7f2c6c102810 2024-07-26T13:17:16.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.958+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c1a8720 con 0x7f2c6c102810 2024-07-26T13:17:16.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.958+0000 7f2c63400640 1 -- 172.21.15.40:0/1404420804 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c58009c30 con 0x7f2c6c102810 2024-07-26T13:17:16.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.958+0000 7f2c63400640 1 -- 172.21.15.40:0/1404420804 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5800f620 con 0x7f2c6c102810 2024-07-26T13:17:16.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.964+0000 7f2c63400640 1 -- 172.21.15.40:0/1404420804 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2c58010460 con 0x7f2c6c102810 2024-07-26T13:17:16.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.966+0000 7f2c63400640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c500b3c40 0x7f2c500b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.966+0000 7f2c63400640 1 -- 172.21.15.40:0/1404420804 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2c580e37d0 con 0x7f2c6c102810 2024-07-26T13:17:16.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.966+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c500b3c40 0x7f2c500b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.967+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c500b3c40 0x7f2c500b6150 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00bbe0 tx=0x7f2c5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.980+0000 7f2c788ae740 1 Processor -- start 2024-07-26T13:17:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 -- start start 2024-07-26T13:17:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477fd840 0x559647ba33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647ba38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 0x559647ba3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559647b6dd10 con 0x5596477dcb60 2024-07-26T13:17:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559647b18b60 con 0x5596477d4980 2024-07-26T13:17:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.981+0000 7f2c788ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559647b08060 con 0x5596477fd840 2024-07-26T13:17:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.982+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 0x559647ba3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.982+0000 7f2c6a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647ba38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.982+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 0x559647ba3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48386/0 (socket says 172.21.15.40:48386) 2024-07-26T13:17:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.982+0000 7f2c6b400640 1 -- 172.21.15.40:0/441997854 learned_addr learned my addr 172.21.15.40:0/441997854 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.982+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477fd840 0x559647ba33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6b400640 1 -- 172.21.15.40:0/441997854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477fd840 msgr2=0x559647ba33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6b400640 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477fd840 0x559647ba33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6b400640 1 -- 172.21.15.40:0/441997854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 msgr2=0x559647ba38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6b400640 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647ba38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6b400640 1 -- 172.21.15.40:0/441997854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559647a8fb10 con 0x5596477dcb60 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6a000640 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647ba38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:17:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.983+0000 7f2c6b400640 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 0x559647ba3e30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2c64035000 tx=0x7f2c64009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed19e5d6ca5770b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.988+0000 7f2c57e00640 1 -- 172.21.15.40:0/441997854 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64034040 con 0x5596477dcb60 2024-07-26T13:17:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.988+0000 7f2c57e00640 1 -- 172.21.15.40:0/441997854 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c64003e00 con 0x5596477dcb60 2024-07-26T13:17:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.988+0000 7f2c57e00640 1 -- 172.21.15.40:0/441997854 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c640042a0 con 0x5596477dcb60 2024-07-26T13:17:16.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 -- 172.21.15.40:0/441997854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 msgr2=0x559647ba3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:16.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 0x559647ba3e30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2c64035000 tx=0x7f2c64009a20 comp rx=0 tx=0).stop 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 -- 172.21.15.40:0/441997854 shutdown_connections 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477dcb60 0x559647ba3e30 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647ba38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 --2- 172.21.15.40:0/441997854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477fd840 0x559647ba33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 -- 172.21.15.40:0/441997854 >> 172.21.15.40:0/441997854 conn(0x5596477f1990 msgr2=0x559647ba12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 -- 172.21.15.40:0/441997854 shutdown_connections 2024-07-26T13:17:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.990+0000 7f2c788ae740 1 -- 172.21.15.40:0/441997854 wait complete. 2024-07-26T13:17:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.991+0000 7f2c788ae740 1 -- start start 2024-07-26T13:17:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.991+0000 7f2c788ae740 1 Processor -- start 2024-07-26T13:17:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 0x559647bb76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bb7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477fd840 0x559647bc3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559647aa4520 con 0x5596477d4980 2024-07-26T13:17:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559647b0c0a0 con 0x5596477fd840 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55964796b7a0 con 0x5596477dcb60 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c788ae740 10 client.0 _ll_register_callbacks cb 0x559647b00bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.992+0000 7f2c6aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 0x559647bb76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 0x559647bb76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48394/0 (socket says 172.21.15.40:48394) 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 -- 172.21.15.40:0/794510146 learned_addr learned my addr 172.21.15.40:0/794510146 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6a000640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bb7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6b400640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477fd840 0x559647bc3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 -- 172.21.15.40:0/794510146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 msgr2=0x559647bb7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bb7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 -- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477fd840 msgr2=0x559647bc3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477fd840 0x559647bc3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6aa00640 1 -- 172.21.15.40:0/794510146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559647877b90 con 0x5596477d4980 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.993+0000 7f2c6b400640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477fd840 0x559647bc3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.994+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 0x559647bb76b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0117c0 tx=0x7f2c5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1f5c0c192c6428 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.994+0000 7f2c54c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:17:16.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.994+0000 7f2c54c00640 1 -- 172.21.15.40:0/794510146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c01fbb0 con 0x5596477d4980 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.994+0000 7f2c54c00640 1 -- 172.21.15.40:0/794510146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2c5c01fd50 con 0x5596477d4980 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.994+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c64003e00 con 0x5596477d4980 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.995+0000 7f2c54c00640 1 -- 172.21.15.40:0/794510146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2c5c028440 con 0x5596477d4980 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.995+0000 7f2c788ae740 10 client.17682 fetch_fsmap learned FSMap version 35 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.995+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559647bc6120 con 0x5596477d4980 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.995+0000 7f2c54c00640 1 -- 172.21.15.40:0/794510146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c64003e00 con 0x5596477d4980 2024-07-26T13:17:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.995+0000 7f2c54c00640 1 -- 172.21.15.40:0/794510146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2c5c026070 con 0x5596477d4980 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c788ae740 10 client.17682 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c788ae740 10 client.17682 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c788ae740 20 client.17682 populate_metadata read hostname 'smithi040' 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c788ae740 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5596477bc1c0 0x559647bc96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c788ae740 4 client.17682 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559647b1aab0 con 0x5596477bc1c0 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.996+0000 7f2c6a000640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5596477bc1c0 0x559647bc96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.997+0000 7f2c6a000640 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5596477bc1c0 0x559647bc96f0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8c01e7a37568cc server_cookie=f44f868fd0dc625d in_seq=0 out_seq=0 2024-07-26T13:17:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.997+0000 7f2c54c00640 10 client.17682 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.999+0000 7f2c54c00640 1 -- 172.21.15.40:0/794510146 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559647b1aab0 con 0x5596477bc1c0 2024-07-26T13:17:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.999+0000 7f2c54c00640 10 client.17682 handle_command_reply: tid=0 2024-07-26T13:17:17.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:16.999+0000 7f2c788ae740 1 client.17682 shutdown 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 msgr2=0x559647bb76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 0x559647bb76b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0117c0 tx=0x7f2c5c004730 comp rx=0 tx=0).stop 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 shutdown_connections 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477fd840 0x559647bc3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bb7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5596477bc1c0 0x559647bc96f0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 --2- 172.21.15.40:0/794510146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477d4980 0x559647bb76b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 >> 172.21.15.40:0/794510146 conn(0x5596477f1990 msgr2=0x559647b9f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c54c00640 0 client.17682 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 shutdown_connections 2024-07-26T13:17:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 1 -- 172.21.15.40:0/794510146 wait complete. 2024-07-26T13:17:17.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.000+0000 7f2c788ae740 20 client.17682 trim_cache size 0 max 16384 2024-07-26T13:17:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.020+0000 7f2c788ae740 1 Processor -- start 2024-07-26T13:17:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 -- start start 2024-07-26T13:17:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477d4980 0x559647bb7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477dcb60 0x559647bc3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bc37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ac980 con 0x5596477fd840 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ae4c0 con 0x5596477dcb60 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.021+0000 7f2c788ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ad050 con 0x5596477d4980 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bc37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bc37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48400/0 (socket says 172.21.15.40:48400) 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 -- 172.21.15.40:0/70187716 learned_addr learned my addr 172.21.15.40:0/70187716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477d4980 0x559647bb7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6a000640 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477dcb60 0x559647bc3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 -- 172.21.15.40:0/70187716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477d4980 msgr2=0x559647bb7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477d4980 0x559647bb7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 -- 172.21.15.40:0/70187716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477dcb60 msgr2=0x559647bc3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477dcb60 0x559647bc3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6b400640 1 -- 172.21.15.40:0/70187716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559647bb6410 con 0x5596477fd840 2024-07-26T13:17:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.022+0000 7f2c6a000640 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477dcb60 0x559647bc3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:17:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.023+0000 7f2c6b400640 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bc37a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2c64004af0 tx=0x7f2c64005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c18b581e42b59e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.023+0000 7f2c57400640 1 -- 172.21.15.40:0/70187716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64034040 con 0x5596477fd840 2024-07-26T13:17:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.023+0000 7f2c57400640 1 -- 172.21.15.40:0/70187716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c64005c60 con 0x5596477fd840 2024-07-26T13:17:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.023+0000 7f2c57400640 1 -- 172.21.15.40:0/70187716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64004040 con 0x5596477fd840 2024-07-26T13:17:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 -- 172.21.15.40:0/70187716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 msgr2=0x559647bc37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bc37a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2c64004af0 tx=0x7f2c64005bf0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 -- 172.21.15.40:0/70187716 shutdown_connections 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bc37a0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477dcb60 0x559647bc3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 --2- 172.21.15.40:0/70187716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477d4980 0x559647bb7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.024+0000 7f2c788ae740 1 -- 172.21.15.40:0/70187716 >> 172.21.15.40:0/70187716 conn(0x5596477f1990 msgr2=0x559647bb25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.025+0000 7f2c788ae740 1 -- 172.21.15.40:0/70187716 shutdown_connections 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.025+0000 7f2c788ae740 1 -- 172.21.15.40:0/70187716 wait complete. 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.025+0000 7f2c788ae740 1 -- start start 2024-07-26T13:17:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.025+0000 7f2c788ae740 1 Processor -- start 2024-07-26T13:17:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647bbf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bbad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bbb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1addf0 con 0x5596477fd840 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ad720 con 0x5596477d4980 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1aa9c0 con 0x5596477dcb60 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.026+0000 7f2c788ae740 10 client.0 _ll_register_callbacks cb 0x7f2c5c010cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bbb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bbb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48402/0 (socket says 172.21.15.40:48402) 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 -- 172.21.15.40:0/539239257 learned_addr learned my addr 172.21.15.40:0/539239257 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647bbf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6a000640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bbad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 -- 172.21.15.40:0/539239257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 msgr2=0x559647bbad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bbad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 -- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 msgr2=0x559647bbf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647bbf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.027+0000 7f2c6b400640 1 -- 172.21.15.40:0/539239257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559647bbb7d0 con 0x5596477fd840 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c6b400640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bbb260 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009dc0 tx=0x7f2c64009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6b75195fffb8e0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c54c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c54c00640 1 -- 172.21.15.40:0/539239257 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64034040 con 0x5596477fd840 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c54c00640 1 -- 172.21.15.40:0/539239257 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2c64049070 con 0x5596477fd840 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c64005c60 con 0x5596477fd840 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c54c00640 1 -- 172.21.15.40:0/539239257 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2c64003b80 con 0x5596477fd840 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c788ae740 10 client.17688 fetch_fsmap learned FSMap version 35 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.028+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559647c31b70 con 0x5596477fd840 2024-07-26T13:17:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c54c00640 1 -- 172.21.15.40:0/539239257 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c64005c60 con 0x5596477fd840 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c54c00640 1 -- 172.21.15.40:0/539239257 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2c6405e030 con 0x5596477fd840 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c788ae740 10 client.17688 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c788ae740 10 client.17688 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c788ae740 20 client.17688 populate_metadata read hostname 'smithi040' 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c788ae740 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559647791570 0x559647c33da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c788ae740 4 client.17688 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.0, "await_for": 45.0}] 2024-07-26T13:17:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.029+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.0, "await_for": 45.0}) -- 0x559647b16550 con 0x559647791570 2024-07-26T13:17:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.030+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559647791570 0x559647c33da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.032+0000 7f2c54c00640 10 client.17688 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.032+0000 7f2c6aa00640 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559647791570 0x559647c33da0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef6f3f6723b62d2 server_cookie=245dda9d8a0072a1 in_seq=0 out_seq=0 2024-07-26T13:17:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:16 smithi040 ceph-mon[32397]: pgmap v2150: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:16 smithi146 ceph-mon[35807]: pgmap v2150: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:16 smithi076 ceph-mon[35401]: pgmap v2150: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:17.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.345+0000 7f2c54c00640 1 -- 172.21.15.40:0/539239257 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x559647b16550 con 0x559647791570 2024-07-26T13:17:17.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.345+0000 7f2c54c00640 10 client.17688 handle_command_reply: tid=0 2024-07-26T13:17:17.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 client.17688 shutdown 2024-07-26T13:17:17.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 msgr2=0x559647bbb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:17.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bbb260 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009dc0 tx=0x7f2c64009880 comp rx=0 tx=0).stop 2024-07-26T13:17:17.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 shutdown_connections 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x559647791570 0x559647c33da0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5596477fd840 0x559647bbb260 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596477dcb60 0x559647bbad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.346+0000 7f2c788ae740 1 --2- 172.21.15.40:0/539239257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596477d4980 0x559647bbf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.347+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 >> 172.21.15.40:0/539239257 conn(0x5596477f1990 msgr2=0x559647bb25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.347+0000 7f2c54c00640 0 client.17688 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.347+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 shutdown_connections 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.347+0000 7f2c788ae740 1 -- 172.21.15.40:0/539239257 wait complete. 2024-07-26T13:17:17.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.347+0000 7f2c788ae740 20 client.17688 trim_cache size 0 max 16384 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 186, 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "4dd4885": { 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 186, 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:17:17.349 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.0, 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:17:17.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:17.351 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c500b3c40 msgr2=0x7f2c500b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c500b3c40 0x7f2c500b6150 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00bbe0 tx=0x7f2c5c00b390 comp rx=0 tx=0).stop 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 msgr2=0x7f2c6c19c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 0x7f2c6c19c300 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800d950 tx=0x7f2c5800de10 comp rx=0 tx=0).stop 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 shutdown_connections 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c6c10fa70 0x7f2c6c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6c102810 0x7f2c6c19c300 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2c500b3c40 0x7f2c500b6150 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 --2- 172.21.15.40:0/1404420804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c6c101ec0 0x7f2c6c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.349+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 >> 172.21.15.40:0/1404420804 conn(0x7f2c6c0fdd60 msgr2=0x7f2c6c100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:17.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.350+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 shutdown_connections 2024-07-26T13:17:17.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:17.350+0000 7f2c6be00640 1 -- 172.21.15.40:0/1404420804 wait complete. 2024-07-26T13:17:18.424 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4dd4885', quiesce took 9.2 seconds. Will release after: 13.8 2024-07-26T13:17:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:18 smithi146 ceph-mon[35807]: pgmap v2151: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:18 smithi076 ceph-mon[35401]: pgmap v2151: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:18 smithi040 ceph-mon[32397]: pgmap v2151: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:20 smithi146 ceph-mon[35807]: pgmap v2152: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:17:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:20 smithi076 ceph-mon[35401]: pgmap v2152: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:17:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:20 smithi040 ceph-mon[32397]: pgmap v2152: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:17:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:23 smithi040 ceph-mon[32397]: pgmap v2153: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:17:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:23 smithi146 ceph-mon[35807]: pgmap v2153: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:17:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:23 smithi076 ceph-mon[35401]: pgmap v2153: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:17:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:25 smithi146 ceph-mon[35807]: pgmap v2154: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:17:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:25 smithi076 ceph-mon[35401]: pgmap v2154: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:17:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:25 smithi040 ceph-mon[32397]: pgmap v2154: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:17:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:27 smithi146 ceph-mon[35807]: pgmap v2155: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:17:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:27 smithi076 ceph-mon[35401]: pgmap v2155: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:17:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:27 smithi040 ceph-mon[32397]: pgmap v2155: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:17:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:29 smithi146 ceph-mon[35807]: pgmap v2156: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:17:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:29 smithi076 ceph-mon[35401]: pgmap v2156: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:17:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:29 smithi040 ceph-mon[32397]: pgmap v2156: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:17:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:31 smithi146 ceph-mon[35807]: pgmap v2157: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-07-26T13:17:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:31 smithi076 ceph-mon[35401]: pgmap v2157: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-07-26T13:17:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:31 smithi040 ceph-mon[32397]: pgmap v2157: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2024-07-26T13:17:32.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:17:32.718 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:17:33.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:33 smithi040 ceph-mon[32397]: pgmap v2158: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 737 KiB/s wr, 8 op/s 2024-07-26T13:17:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:33 smithi146 ceph-mon[35807]: pgmap v2158: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 737 KiB/s wr, 8 op/s 2024-07-26T13:17:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:33 smithi076 ceph-mon[35401]: pgmap v2158: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 737 KiB/s wr, 8 op/s 2024-07-26T13:17:35.075 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:35 smithi040 ceph-mon[32397]: pgmap v2159: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 396 KiB/s wr, 11 op/s 2024-07-26T13:17:35.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 -- 172.21.15.40:0/1374439346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6481033e0 msgr2=0x7fb6481037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:35.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 --2- 172.21.15.40:0/1374439346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6481033e0 0x7fb6481037f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fb638009900 tx=0x7fb63802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 -- 172.21.15.40:0/1374439346 shutdown_connections 2024-07-26T13:17:35.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 --2- 172.21.15.40:0/1374439346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb648109670 0x7fb64810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 --2- 172.21.15.40:0/1374439346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb648108d20 0x7fb648109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 --2- 172.21.15.40:0/1374439346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6481033e0 0x7fb6481037f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 -- 172.21.15.40:0/1374439346 >> 172.21.15.40:0/1374439346 conn(0x7fb6480fee70 msgr2=0x7fb6481012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:35.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 -- 172.21.15.40:0/1374439346 shutdown_connections 2024-07-26T13:17:35.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.231+0000 7fb64ea00640 1 -- 172.21.15.40:0/1374439346 wait complete. 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 Processor -- start 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 -- start start 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6481033e0 0x7fb64819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb648108d20 0x7fb64819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 0x7fb6481a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481131d0 con 0x7fb648109670 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb648113050 con 0x7fb6481033e0 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.233+0000 7fb64ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb648113350 con 0x7fb648108d20 2024-07-26T13:17:35.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 0x7fb6481a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 0x7fb6481a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34058/0 (socket says 172.21.15.40:34058) 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 -- 172.21.15.40:0/249656646 learned_addr learned my addr 172.21.15.40:0/249656646 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64d600640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6481033e0 0x7fb64819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64cc00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb648108d20 0x7fb64819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 -- 172.21.15.40:0/249656646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb648108d20 msgr2=0x7fb64819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb648108d20 0x7fb64819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 -- 172.21.15.40:0/249656646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6481033e0 msgr2=0x7fb64819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6481033e0 0x7fb64819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.234+0000 7fb64e000640 1 -- 172.21.15.40:0/249656646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6481a1d50 con 0x7fb648109670 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.235+0000 7fb64e000640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 0x7fb6481a16e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fb64000cce0 tx=0x7fb64000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.235+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64000f450 con 0x7fb648109670 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.235+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb64000fa80 con 0x7fb648109670 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.235+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb640018ad0 con 0x7fb648109670 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.235+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6481a2040 con 0x7fb648109670 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.235+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6481a8860 con 0x7fb648109670 2024-07-26T13:17:35.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.237+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6481037f0 con 0x7fb648109670 2024-07-26T13:17:35.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.240+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb64000f5f0 con 0x7fb648109670 2024-07-26T13:17:35.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.242+0000 7fb646000640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb62c0b3c80 0x7fb62c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:35.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.242+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb6400e43c0 con 0x7fb648109670 2024-07-26T13:17:35.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.242+0000 7fb64d600640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb62c0b3c80 0x7fb62c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:35.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.243+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb640014030 con 0x7fb648109670 2024-07-26T13:17:35.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.243+0000 7fb64d600640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb62c0b3c80 0x7fb62c0b6190 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb6380057c0 tx=0x7fb6380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:35 smithi146 ceph-mon[35807]: pgmap v2159: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 396 KiB/s wr, 11 op/s 2024-07-26T13:17:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:35 smithi076 ceph-mon[35401]: pgmap v2159: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 396 KiB/s wr, 11 op/s 2024-07-26T13:17:35.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.487+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb64819cfd0 con 0x7fb648109670 2024-07-26T13:17:35.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.489+0000 7fb646000640 1 -- 172.21.15.40:0/249656646 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fb6400abae0 con 0x7fb648109670 2024-07-26T13:17:35.490 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:17:35.490 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:17:35.490 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:17:35.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb62c0b3c80 msgr2=0x7fb62c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:35.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb62c0b3c80 0x7fb62c0b6190 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb6380057c0 tx=0x7fb6380058d0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 msgr2=0x7fb6481a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:35.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 0x7fb6481a16e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fb64000cce0 tx=0x7fb64000a620 comp rx=0 tx=0).stop 2024-07-26T13:17:35.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 shutdown_connections 2024-07-26T13:17:35.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb648109670 0x7fb6481a16e0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb62c0b3c80 0x7fb62c0b6190 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb648108d20 0x7fb64819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 --2- 172.21.15.40:0/249656646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6481033e0 0x7fb64819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:35.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.492+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 >> 172.21.15.40:0/249656646 conn(0x7fb6480fee70 msgr2=0x7fb64810e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:35.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.493+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 shutdown_connections 2024-07-26T13:17:35.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:35.493+0000 7fb64ea00640 1 -- 172.21.15.40:0/249656646 wait complete. 2024-07-26T13:17:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:36 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/249656646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:17:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:36 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/249656646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:17:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:36 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/249656646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:17:36.407 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 4dd4885 --release --await' 2024-07-26T13:17:36.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 4dd4885 --release --await 2024-07-26T13:17:36.878 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:17:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:37 smithi146 ceph-mon[35807]: pgmap v2160: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-07-26T13:17:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:37 smithi076 ceph-mon[35401]: pgmap v2160: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-07-26T13:17:37.370 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:37 smithi040 ceph-mon[32397]: pgmap v2160: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-07-26T13:17:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:39 smithi076 ceph-mon[35401]: pgmap v2161: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:17:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 -- 172.21.15.40:0/822062882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 msgr2=0x7f8854077780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 --2- 172.21.15.40:0/822062882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f8854077780 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8848009900 tx=0x7f884802a410 comp rx=0 tx=0).stop 2024-07-26T13:17:39.474 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:39 smithi040 ceph-mon[32397]: pgmap v2161: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:17:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 -- 172.21.15.40:0/822062882 shutdown_connections 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 --2- 172.21.15.40:0/822062882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854113fa0 0x7f88541163c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 --2- 172.21.15.40:0/822062882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8854077cc0 0x7f8854113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 --2- 172.21.15.40:0/822062882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f8854077780 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.471+0000 7f885b200640 1 -- 172.21.15.40:0/822062882 >> 172.21.15.40:0/822062882 conn(0x7f88541010b0 msgr2=0x7f8854103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.472+0000 7f885b200640 1 -- 172.21.15.40:0/822062882 shutdown_connections 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.472+0000 7f885b200640 1 -- 172.21.15.40:0/822062882 wait complete. 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.473+0000 7f885b200640 1 Processor -- start 2024-07-26T13:17:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.473+0000 7f885b200640 1 -- start start 2024-07-26T13:17:39.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f885b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f88541a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f885b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8854077cc0 0x7f88541a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f885b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854113fa0 0x7f88541a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f885b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88541197d0 con 0x7f8854077370 2024-07-26T13:17:39.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f885b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8854119650 con 0x7f8854113fa0 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f885b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8854119950 con 0x7f8854077cc0 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f8859e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f88541a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f8859e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f88541a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34074/0 (socket says 172.21.15.40:34074) 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.474+0000 7f8859e00640 1 -- 172.21.15.40:0/2806711605 learned_addr learned my addr 172.21.15.40:0/2806711605 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f885a800640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854113fa0 0x7f88541a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859400640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8854077cc0 0x7f88541a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859e00640 1 -- 172.21.15.40:0/2806711605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8854077cc0 msgr2=0x7f88541a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859e00640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8854077cc0 0x7f88541a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859e00640 1 -- 172.21.15.40:0/2806711605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854113fa0 msgr2=0x7f88541a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859e00640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854113fa0 0x7f88541a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859e00640 1 -- 172.21.15.40:0/2806711605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88541a61f0 con 0x7f8854077370 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.475+0000 7f8859e00640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f88541a0280 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f8848009230 tx=0x7f88480319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:39.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.476+0000 7f884ea00640 1 -- 172.21.15.40:0/2806711605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884803f030 con 0x7f8854077370 2024-07-26T13:17:39.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.476+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88541a6480 con 0x7f8854077370 2024-07-26T13:17:39.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.476+0000 7f884ea00640 1 -- 172.21.15.40:0/2806711605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88480043d0 con 0x7f8854077370 2024-07-26T13:17:39.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.476+0000 7f884ea00640 1 -- 172.21.15.40:0/2806711605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848035070 con 0x7f8854077370 2024-07-26T13:17:39.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.476+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88541acc40 con 0x7f8854077370 2024-07-26T13:17:39.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.480+0000 7f884ea00640 1 -- 172.21.15.40:0/2806711605 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8848042030 con 0x7f8854077370 2024-07-26T13:17:39.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.481+0000 7f884ea00640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f883c0b3bd0 0x7f883c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.481+0000 7f884ea00640 1 -- 172.21.15.40:0/2806711605 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8848104080 con 0x7f8854077370 2024-07-26T13:17:39.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.482+0000 7f8859400640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f883c0b3bd0 0x7f883c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.482+0000 7f8859400640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f883c0b3bd0 0x7f883c0b60e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f88541146f0 tx=0x7f8844005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 Processor -- start 2024-07-26T13:17:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 -- start start 2024-07-26T13:17:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb690031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb690036e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c3d840 0x55fb69003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55fb68f79f50 con 0x55fb68c35660 2024-07-26T13:17:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55fb68f69450 con 0x55fb68c3d840 2024-07-26T13:17:39.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.493+0000 7f8863496740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb68f6d490 con 0x55fb68c5e520 2024-07-26T13:17:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb690036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb690036e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34088/0 (socket says 172.21.15.40:34088) 2024-07-26T13:17:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 -- 172.21.15.40:0/2534566880 learned_addr learned my addr 172.21.15.40:0/2534566880 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859e00640 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb690031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f885a800640 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c3d840 0x55fb69003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 -- 172.21.15.40:0/2534566880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 msgr2=0x55fb690031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb690031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 -- 172.21.15.40:0/2534566880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c3d840 msgr2=0x55fb69003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c3d840 0x55fb69003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f8859400640 1 -- 172.21.15.40:0/2534566880 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb68cc9b00 con 0x55fb68c35660 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.494+0000 7f885a800640 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c3d840 0x55fb69003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.495+0000 7f8859400640 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb690036e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f8844011f20 tx=0x7f8844014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1ba3201a7a4a8c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.495+0000 7f8843000640 1 -- 172.21.15.40:0/2534566880 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884401f620 con 0x55fb68c35660 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.495+0000 7f8843000640 1 -- 172.21.15.40:0/2534566880 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f884401fc50 con 0x55fb68c35660 2024-07-26T13:17:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.495+0000 7f8843000640 1 -- 172.21.15.40:0/2534566880 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844027a50 con 0x55fb68c35660 2024-07-26T13:17:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 -- 172.21.15.40:0/2534566880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 msgr2=0x55fb690036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb690036e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f8844011f20 tx=0x7f8844014000 comp rx=0 tx=0).stop 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 -- 172.21.15.40:0/2534566880 shutdown_connections 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c3d840 0x55fb69003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb690036e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 --2- 172.21.15.40:0/2534566880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb690031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 -- 172.21.15.40:0/2534566880 >> 172.21.15.40:0/2534566880 conn(0x55fb68c52910 msgr2=0x55fb69001090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 -- 172.21.15.40:0/2534566880 shutdown_connections 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.496+0000 7f8863496740 1 -- 172.21.15.40:0/2534566880 wait complete. 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.497+0000 7f8863496740 1 -- start start 2024-07-26T13:17:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.497+0000 7f8863496740 1 Processor -- start 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb6900e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb6900ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb6901aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55fb68dccbb0 con 0x55fb68c35660 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55fb68f05930 con 0x55fb68c5e520 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb69011980 con 0x55fb68c3d840 2024-07-26T13:17:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8863496740 10 client.0 _ll_register_callbacks cb 0x55fb68c75d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb6900e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb6900e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34100/0 (socket says 172.21.15.40:34100) 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 -- 172.21.15.40:0/3550177632 learned_addr learned my addr 172.21.15.40:0/3550177632 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859400640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb6900ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 -- 172.21.15.40:0/3550177632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 msgr2=0x55fb6900ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f885a800640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb6901aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb6900ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 -- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 msgr2=0x55fb6901aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb6901aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.498+0000 7f8859e00640 1 -- 172.21.15.40:0/3550177632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb68d40960 con 0x55fb68c35660 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8859400640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb6900ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:17:39.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f885a800640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb6901aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8859e00640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb6900e8d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f88480c7050 tx=0x7f88480ca740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31c04ed7ca2b03f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8837400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8837400640 1 -- 172.21.15.40:0/3550177632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88480e5060 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8837400640 1 -- 172.21.15.40:0/3550177632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f88480cb440 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f884401fc50 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.499+0000 7f8837400640 1 -- 172.21.15.40:0/3550177632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8848049040 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 10 client.17706 fetch_fsmap learned FSMap version 35 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fb6901d690 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8837400640 1 -- 172.21.15.40:0/3550177632 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f884401fc50 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8837400640 1 -- 172.21.15.40:0/3550177632 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f88480d3bf0 con 0x55fb68c35660 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 10 client.17706 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:17:39.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 10 client.17706 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:17:39.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 20 client.17706 populate_metadata read hostname 'smithi040' 2024-07-26T13:17:39.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68c1cea0 0x55fb69020b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 4 client.17706 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:17:39.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.500+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb68f7bea0 con 0x55fb68c1cea0 2024-07-26T13:17:39.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.501+0000 7f8859400640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68c1cea0 0x55fb69020b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.502+0000 7f8859400640 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68c1cea0 0x55fb69020b90 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd7f161e4f11d67a server_cookie=f538e1947de40019 in_seq=0 out_seq=0 2024-07-26T13:17:39.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.502+0000 7f8837400640 10 client.17706 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:39.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.504+0000 7f8837400640 1 -- 172.21.15.40:0/3550177632 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb68f7bea0 con 0x55fb68c1cea0 2024-07-26T13:17:39.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.504+0000 7f8837400640 10 client.17706 handle_command_reply: tid=0 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.504+0000 7f8863496740 1 client.17706 shutdown 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 msgr2=0x55fb6900e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb6900e8d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f88480c7050 tx=0x7f88480ca740 comp rx=0 tx=0).stop 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 shutdown_connections 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb6901aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb6900ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68c1cea0 0x55fb69020b90 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 --2- 172.21.15.40:0/3550177632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb6900e8d0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 >> 172.21.15.40:0/3550177632 conn(0x55fb68c52910 msgr2=0x55fb69006330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8837400640 0 client.17706 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 shutdown_connections 2024-07-26T13:17:39.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 1 -- 172.21.15.40:0/3550177632 wait complete. 2024-07-26T13:17:39.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.505+0000 7f8863496740 20 client.17706 trim_cache size 0 max 16384 2024-07-26T13:17:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.524+0000 7f8863496740 1 Processor -- start 2024-07-26T13:17:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.524+0000 7f8863496740 1 -- start start 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8863496740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c35660 0x55fb68fffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8863496740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 0x55fb69010500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8863496740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb6901aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8863496740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b5180 con 0x55fb68c3d840 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8863496740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b6cc0 con 0x55fb68c35660 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8863496740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b5850 con 0x55fb68c5e520 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 0x55fb69010500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 0x55fb69010500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34110/0 (socket says 172.21.15.40:34110) 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 -- 172.21.15.40:0/3123598325 learned_addr learned my addr 172.21.15.40:0/3123598325 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859e00640 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c35660 0x55fb68fffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 -- 172.21.15.40:0/3123598325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 msgr2=0x55fb6901aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb6901aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 -- 172.21.15.40:0/3123598325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c35660 msgr2=0x55fb68fffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c35660 0x55fb68fffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859400640 1 -- 172.21.15.40:0/3123598325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb69006000 con 0x55fb68c3d840 2024-07-26T13:17:39.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.525+0000 7f8859e00640 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c35660 0x55fb68fffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:17:39.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.526+0000 7f8859400640 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 0x55fb69010500 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f88440276a0 tx=0x7f8844011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07d542ea651e9c2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:39.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.526+0000 7f8842600640 1 -- 172.21.15.40:0/3123598325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844005040 con 0x55fb68c3d840 2024-07-26T13:17:39.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.526+0000 7f8842600640 1 -- 172.21.15.40:0/3123598325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8844027740 con 0x55fb68c3d840 2024-07-26T13:17:39.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.526+0000 7f8842600640 1 -- 172.21.15.40:0/3123598325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884401f640 con 0x55fb68c3d840 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 -- 172.21.15.40:0/3123598325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 msgr2=0x55fb69010500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 0x55fb69010500 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f88440276a0 tx=0x7f8844011b50 comp rx=0 tx=0).stop 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 -- 172.21.15.40:0/3123598325 shutdown_connections 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c5e520 0x55fb6901aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c3d840 0x55fb69010500 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 --2- 172.21.15.40:0/3123598325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c35660 0x55fb68fffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 -- 172.21.15.40:0/3123598325 >> 172.21.15.40:0/3123598325 conn(0x55fb68c52910 msgr2=0x55fb6900fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 -- 172.21.15.40:0/3123598325 shutdown_connections 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.527+0000 7f8863496740 1 -- 172.21.15.40:0/3123598325 wait complete. 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.528+0000 7f8863496740 1 -- start start 2024-07-26T13:17:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.528+0000 7f8863496740 1 Processor -- start 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb69012c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb690131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb69013710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b65f0 con 0x55fb68c35660 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b5f20 con 0x55fb68c5e520 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b3140 con 0x55fb68c3d840 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8863496740 10 client.0 _ll_register_callbacks cb 0x7f8848004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8859e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb69012c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8859e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb69012c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34122/0 (socket says 172.21.15.40:34122) 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8859e00640 1 -- 172.21.15.40:0/1604320242 learned_addr learned my addr 172.21.15.40:0/1604320242 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f885a800640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb69013710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.529+0000 7f8859400640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb690131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8859e00640 1 -- 172.21.15.40:0/1604320242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 msgr2=0x55fb690131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8859e00640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb690131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8859e00640 1 -- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 msgr2=0x55fb69013710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8859e00640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb69013710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8859e00640 1 -- 172.21.15.40:0/1604320242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb69088520 con 0x55fb68c35660 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f885a800640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb69013710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8859e00640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb69012c90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f88480d3f60 tx=0x7f88480cab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8716694985edf1 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8837400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8837400640 1 -- 172.21.15.40:0/1604320242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88480e5020 con 0x55fb68c35660 2024-07-26T13:17:39.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8837400640 1 -- 172.21.15.40:0/1604320242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f88480c75c0 con 0x55fb68c35660 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.530+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8844027740 con 0x55fb68c35660 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8837400640 1 -- 172.21.15.40:0/1604320242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f88480ec2b0 con 0x55fb68c35660 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 10 client.17712 fetch_fsmap learned FSMap version 35 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fb69089710 con 0x55fb68c35660 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8837400640 1 -- 172.21.15.40:0/1604320242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8844027740 con 0x55fb68c35660 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8837400640 1 -- 172.21.15.40:0/1604320242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f88480cf040 con 0x55fb68c35660 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 10 client.17712 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 10 client.17712 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 20 client.17712 populate_metadata read hostname 'smithi040' 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68bf2250 0x55fb6908bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 4 client.17712 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4dd4885", "release": true, "await": true}] 2024-07-26T13:17:39.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.531+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4dd4885", "release": true, "await": true}) -- 0x55fb68f77940 con 0x55fb68bf2250 2024-07-26T13:17:39.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.532+0000 7f8859400640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68bf2250 0x55fb6908bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:17:39.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.533+0000 7f8859400640 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68bf2250 0x55fb6908bd00 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b26727505cc8e4 server_cookie=532b3f332bd8b9a6 in_seq=0 out_seq=0 2024-07-26T13:17:39.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.533+0000 7f8837400640 10 client.17712 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:39 smithi146 ceph-mon[35807]: pgmap v2161: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:17:39.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8837400640 1 -- 172.21.15.40:0/1604320242 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55fb68f77940 con 0x55fb68bf2250 2024-07-26T13:17:39.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8837400640 10 client.17712 handle_command_reply: tid=0 2024-07-26T13:17:39.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8863496740 1 client.17712 shutdown 2024-07-26T13:17:39.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 msgr2=0x55fb69012c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8863496740 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb69012c90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f88480d3f60 tx=0x7f88480cab80 comp rx=0 tx=0).stop 2024-07-26T13:17:39.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 shutdown_connections 2024-07-26T13:17:39.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8863496740 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fb68c5e520 0x55fb69013710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.590+0000 7f8863496740 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb68c3d840 0x55fb690131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.591+0000 7f8863496740 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55fb68bf2250 0x55fb6908bd00 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.591+0000 7f8863496740 1 --2- 172.21.15.40:0/1604320242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55fb68c35660 0x55fb69012c90 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.591+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 >> 172.21.15.40:0/1604320242 conn(0x55fb68c52910 msgr2=0x55fb69004b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:39.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.591+0000 7f8837400640 0 client.17712 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.591+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 shutdown_connections 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.591+0000 7f8863496740 1 -- 172.21.15.40:0/1604320242 wait complete. 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.592+0000 7f8863496740 20 client.17712 trim_cache size 0 max 16384 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 188, 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout: "4dd4885": { 2024-07-26T13:17:39.594 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 188, 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 143.0, 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:17:39.595 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:17:39.596 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f883c0b3bd0 msgr2=0x7f883c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f883c0b3bd0 0x7f883c0b60e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f88541146f0 tx=0x7f8844005f90 comp rx=0 tx=0).stop 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 msgr2=0x7f88541a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f88541a0280 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f8848009230 tx=0x7f88480319a0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 shutdown_connections 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8854113fa0 0x7f88541a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f883c0b3bd0 0x7f883c0b60e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8854077cc0 0x7f88541a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 --2- 172.21.15.40:0/2806711605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8854077370 0x7f88541a0280 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.593+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 >> 172.21.15.40:0/2806711605 conn(0x7f88541010b0 msgr2=0x7f88541160c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.594+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 shutdown_connections 2024-07-26T13:17:39.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:17:39.594+0000 7f885b200640 1 -- 172.21.15.40:0/2806711605 wait complete. 2024-07-26T13:17:40.594 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4dd4885', total seconds elapsed: 31.4 2024-07-26T13:17:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:41 smithi076 ceph-mon[35401]: pgmap v2162: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:17:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:41 smithi040 ceph-mon[32397]: pgmap v2162: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:17:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:41 smithi146 ceph-mon[35807]: pgmap v2162: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:17:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:43 smithi040 ceph-mon[32397]: pgmap v2163: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:17:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:43 smithi146 ceph-mon[35807]: pgmap v2163: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:17:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:43 smithi076 ceph-mon[35401]: pgmap v2163: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:17:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:45 smithi040 ceph-mon[32397]: pgmap v2164: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T13:17:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:45 smithi146 ceph-mon[35807]: pgmap v2164: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T13:17:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:45 smithi076 ceph-mon[35401]: pgmap v2164: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 341 KiB/s wr, 10 op/s 2024-07-26T13:17:47.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:47 smithi040 ceph-mon[32397]: pgmap v2165: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:17:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:47 smithi146 ceph-mon[35807]: pgmap v2165: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:17:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:47 smithi076 ceph-mon[35401]: pgmap v2165: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-07-26T13:17:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:49 smithi040 ceph-mon[32397]: pgmap v2166: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2024-07-26T13:17:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:49 smithi146 ceph-mon[35807]: pgmap v2166: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2024-07-26T13:17:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:49 smithi076 ceph-mon[35401]: pgmap v2166: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2024-07-26T13:17:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:51 smithi040 ceph-mon[32397]: pgmap v2167: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:17:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:51 smithi146 ceph-mon[35807]: pgmap v2167: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:17:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:51 smithi076 ceph-mon[35401]: pgmap v2167: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.3 MiB/s wr, 12 op/s 2024-07-26T13:17:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:53 smithi040 ceph-mon[32397]: pgmap v2168: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-07-26T13:17:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:53 smithi146 ceph-mon[35807]: pgmap v2168: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-07-26T13:17:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:53 smithi076 ceph-mon[35401]: pgmap v2168: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 9 op/s 2024-07-26T13:17:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:55 smithi040 ceph-mon[32397]: pgmap v2169: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:17:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:17:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:55 smithi146 ceph-mon[35807]: pgmap v2169: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:17:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:17:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:55 smithi076 ceph-mon[35401]: pgmap v2169: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:17:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:17:57.248 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:57 smithi146 ceph-mon[35807]: pgmap v2170: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:57 smithi076 ceph-mon[35401]: pgmap v2170: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:57 smithi040 ceph-mon[32397]: pgmap v2170: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:59.314 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:17:59 smithi146 ceph-mon[35807]: pgmap v2171: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:17:59 smithi040 ceph-mon[32397]: pgmap v2171: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:17:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:17:59 smithi076 ceph-mon[35401]: pgmap v2171: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: pgmap v2172: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: pgmap v2172: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: pgmap v2172: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:18:01.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:18:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:03 smithi040 ceph-mon[32397]: pgmap v2173: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:18:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:03 smithi146 ceph-mon[35807]: pgmap v2173: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:18:03.719 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:03 smithi076 ceph-mon[35401]: pgmap v2173: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:18:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:05 smithi040 ceph-mon[32397]: pgmap v2174: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:05 smithi146 ceph-mon[35807]: pgmap v2174: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:05 smithi076 ceph-mon[35401]: pgmap v2174: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:07.422 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:07 smithi146 ceph-mon[35807]: pgmap v2175: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:18:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:07 smithi040 ceph-mon[32397]: pgmap v2175: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:18:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:07 smithi076 ceph-mon[35401]: pgmap v2175: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:18:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:09 smithi040 ceph-mon[32397]: pgmap v2176: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:18:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:09 smithi146 ceph-mon[35807]: pgmap v2176: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:18:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:09 smithi076 ceph-mon[35401]: pgmap v2176: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:18:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:11 smithi040 ceph-mon[32397]: pgmap v2177: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:18:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:11 smithi146 ceph-mon[35807]: pgmap v2177: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:18:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:11 smithi076 ceph-mon[35401]: pgmap v2177: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:18:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:13 smithi040 ceph-mon[32397]: pgmap v2178: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:18:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:13 smithi146 ceph-mon[35807]: pgmap v2178: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:18:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:13 smithi076 ceph-mon[35401]: pgmap v2178: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:18:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:15 smithi040 ceph-mon[32397]: pgmap v2179: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:15 smithi146 ceph-mon[35807]: pgmap v2179: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:15 smithi076 ceph-mon[35401]: pgmap v2179: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:17 smithi040 ceph-mon[32397]: pgmap v2180: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:18:17.518 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:17 smithi146 ceph-mon[35807]: pgmap v2180: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:18:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:17 smithi076 ceph-mon[35401]: pgmap v2180: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:18:19.468 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:19 smithi076 ceph-mon[35401]: pgmap v2181: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:19 smithi040 ceph-mon[32397]: pgmap v2181: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:19 smithi146 ceph-mon[35807]: pgmap v2181: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:21 smithi040 ceph-mon[32397]: pgmap v2182: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:18:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:21 smithi146 ceph-mon[35807]: pgmap v2182: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:18:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:21 smithi076 ceph-mon[35401]: pgmap v2182: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:18:23.309 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.8 2024-07-26T13:18:23.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:18:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:23 smithi040 ceph-mon[32397]: pgmap v2183: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:18:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:23 smithi146 ceph-mon[35807]: pgmap v2183: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:18:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:23 smithi076 ceph-mon[35401]: pgmap v2183: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:18:23.873 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:18:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:25 smithi146 ceph-mon[35807]: pgmap v2184: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:25 smithi076 ceph-mon[35401]: pgmap v2184: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:25.602 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:25 smithi040 ceph-mon[32397]: pgmap v2184: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:18:27.550 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:27 smithi040 ceph-mon[32397]: pgmap v2185: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.547+0000 7f1b3d000640 1 -- 172.21.15.40:0/410973155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b381017c0 msgr2=0x7f1b38101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.547+0000 7f1b3d000640 1 --2- 172.21.15.40:0/410973155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b381017c0 0x7f1b38101bd0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009900 tx=0x7f1b2802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 -- 172.21.15.40:0/410973155 shutdown_connections 2024-07-26T13:18:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 --2- 172.21.15.40:0/410973155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b38109650 0x7f1b3810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 --2- 172.21.15.40:0/410973155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38108d00 0x7f1b38109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 --2- 172.21.15.40:0/410973155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b381017c0 0x7f1b38101bd0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 -- 172.21.15.40:0/410973155 >> 172.21.15.40:0/410973155 conn(0x7f1b380774d0 msgr2=0x7f1b38077910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 -- 172.21.15.40:0/410973155 shutdown_connections 2024-07-26T13:18:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.548+0000 7f1b3d000640 1 -- 172.21.15.40:0/410973155 wait complete. 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.549+0000 7f1b3d000640 1 Processor -- start 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 -- start start 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b381017c0 0x7f1b3819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38108d00 0x7f1b3819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 0x7f1b381a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381131b0 con 0x7f1b38109650 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38113030 con 0x7f1b381017c0 2024-07-26T13:18:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.550+0000 7f1b3d000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38113330 con 0x7f1b38108d00 2024-07-26T13:18:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.551+0000 7f1b37e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 0x7f1b381a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.551+0000 7f1b37e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 0x7f1b381a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56820/0 (socket says 172.21.15.40:56820) 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.551+0000 7f1b37e00640 1 -- 172.21.15.40:0/2951534050 learned_addr learned my addr 172.21.15.40:0/2951534050 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.551+0000 7f1b37400640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b381017c0 0x7f1b3819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.551+0000 7f1b36a00640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38108d00 0x7f1b3819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.552+0000 7f1b37e00640 1 -- 172.21.15.40:0/2951534050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38108d00 msgr2=0x7f1b3819c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.552+0000 7f1b37e00640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38108d00 0x7f1b3819c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.552+0000 7f1b37e00640 1 -- 172.21.15.40:0/2951534050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b381017c0 msgr2=0x7f1b3819be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.552+0000 7f1b37e00640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b381017c0 0x7f1b3819be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.552+0000 7f1b37e00640 1 -- 172.21.15.40:0/2951534050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b381a1db0 con 0x7f1b38109650 2024-07-26T13:18:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.552+0000 7f1b37e00640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 0x7f1b381a1680 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000eaa0 tx=0x7f1b3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.553+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000cdb0 con 0x7f1b38109650 2024-07-26T13:18:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.553+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b381a20a0 con 0x7f1b38109650 2024-07-26T13:18:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.553+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b30005020 con 0x7f1b38109650 2024-07-26T13:18:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.553+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300116d0 con 0x7f1b38109650 2024-07-26T13:18:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.553+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b381a8800 con 0x7f1b38109650 2024-07-26T13:18:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.555+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b38101bd0 con 0x7f1b38109650 2024-07-26T13:18:27.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.558+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b300051d0 con 0x7f1b38109650 2024-07-26T13:18:27.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.559+0000 7f1b2fe00640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1b1c0b3bd0 0x7f1b1c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:27.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.560+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1b300e3d40 con 0x7f1b38109650 2024-07-26T13:18:27.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.560+0000 7f1b37400640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1b1c0b3bd0 0x7f1b1c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:27.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.561+0000 7f1b37400640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1b1c0b3bd0 0x7f1b1c0b60e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1b280057c0 tx=0x7f1b280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:27.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.565+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f1b30016030 con 0x7f1b38109650 2024-07-26T13:18:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:27 smithi146 ceph-mon[35807]: pgmap v2185: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:27 smithi076 ceph-mon[35401]: pgmap v2185: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.839+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b381a8b70 con 0x7f1b38109650 2024-07-26T13:18:27.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.841+0000 7f1b2fe00640 1 -- 172.21.15.40:0/2951534050 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f1b300aad00 con 0x7f1b38109650 2024-07-26T13:18:27.843 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:18:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:18:27.843 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:18:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.844+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1b1c0b3bd0 msgr2=0x7f1b1c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.844+0000 7f1b3d000640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1b1c0b3bd0 0x7f1b1c0b60e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1b280057c0 tx=0x7f1b280058d0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.844+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 msgr2=0x7f1b381a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.844+0000 7f1b3d000640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 0x7f1b381a1680 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000eaa0 tx=0x7f1b3000ef60 comp rx=0 tx=0).stop 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 shutdown_connections 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b38109650 0x7f1b381a1680 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f1b1c0b3bd0 0x7f1b1c0b60e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38108d00 0x7f1b3819c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 --2- 172.21.15.40:0/2951534050 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b381017c0 0x7f1b3819be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 >> 172.21.15.40:0/2951534050 conn(0x7f1b380774d0 msgr2=0x7f1b38106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 shutdown_connections 2024-07-26T13:18:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:27.845+0000 7f1b3d000640 1 -- 172.21.15.40:0/2951534050 wait complete. 2024-07-26T13:18:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:28 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2951534050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:18:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:28 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2951534050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:18:28.622 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:28 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2951534050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:18:28.710 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 152.8 --await-for 45.0' 2024-07-26T13:18:28.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 152.8 --await-for 45.0 2024-07-26T13:18:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:18:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:29 smithi146 ceph-mon[35807]: pgmap v2186: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:18:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:29 smithi076 ceph-mon[35401]: pgmap v2186: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:18:29.631 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:29 smithi040 ceph-mon[32397]: pgmap v2186: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:18:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:31 smithi146 ceph-mon[35807]: pgmap v2187: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:18:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:31 smithi076 ceph-mon[35401]: pgmap v2187: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 -- 172.21.15.40:0/3632120149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69601024b0 msgr2=0x7f69601028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 --2- 172.21.15.40:0/3632120149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69601024b0 0x7f69601028c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6950009860 tx=0x7f695002a340 comp rx=0 tx=0).stop 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 -- 172.21.15.40:0/3632120149 shutdown_connections 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 --2- 172.21.15.40:0/3632120149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6960108740 0x7f696010ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 --2- 172.21.15.40:0/3632120149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f6960108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 --2- 172.21.15.40:0/3632120149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69601024b0 0x7f69601028c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.661+0000 7f6965600640 1 -- 172.21.15.40:0/3632120149 >> 172.21.15.40:0/3632120149 conn(0x7f6960079190 msgr2=0x7f69600795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:31.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:31 smithi040 ceph-mon[32397]: pgmap v2187: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:18:31.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.662+0000 7f6965600640 1 -- 172.21.15.40:0/3632120149 shutdown_connections 2024-07-26T13:18:31.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.662+0000 7f6965600640 1 -- 172.21.15.40:0/3632120149 wait complete. 2024-07-26T13:18:31.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.664+0000 7f6965600640 1 Processor -- start 2024-07-26T13:18:31.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.664+0000 7f6965600640 1 -- start start 2024-07-26T13:18:31.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.665+0000 7f6965600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69601024b0 0x7f6960103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.665+0000 7f6965600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f69601041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.665+0000 7f6965600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6960108740 0x7f6960104720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.665+0000 7f6965600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112250 con 0x7f6960107df0 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.665+0000 7f6965600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69601120d0 con 0x7f6960108740 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.665+0000 7f6965600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69601123d0 con 0x7f69601024b0 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f69601041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f69601041e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56830/0 (socket says 172.21.15.40:56830) 2024-07-26T13:18:31.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 -- 172.21.15.40:0/2511269809 learned_addr learned my addr 172.21.15.40:0/2511269809 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:31.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695f400640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6960108740 0x7f6960104720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695ea00640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69601024b0 0x7f6960103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 -- 172.21.15.40:0/2511269809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69601024b0 msgr2=0x7f6960103ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:31.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69601024b0 0x7f6960103ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 -- 172.21.15.40:0/2511269809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6960108740 msgr2=0x7f6960104720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6960108740 0x7f6960104720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695e000640 1 -- 172.21.15.40:0/2511269809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69601a8070 con 0x7f6960107df0 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.666+0000 7f695ea00640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69601024b0 0x7f6960103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.667+0000 7f695e000640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f69601041e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e9a0 tx=0x7f694c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.667+0000 7f6957400640 1 -- 172.21.15.40:0/2511269809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00cd80 con 0x7f6960107df0 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.667+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69601a8360 con 0x7f6960107df0 2024-07-26T13:18:31.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.667+0000 7f6957400640 1 -- 172.21.15.40:0/2511269809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f694c0035f0 con 0x7f6960107df0 2024-07-26T13:18:31.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.667+0000 7f6957400640 1 -- 172.21.15.40:0/2511269809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c010690 con 0x7f6960107df0 2024-07-26T13:18:31.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.667+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69601a88f0 con 0x7f6960107df0 2024-07-26T13:18:31.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.672+0000 7f6957400640 1 -- 172.21.15.40:0/2511269809 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f694c003fb0 con 0x7f6960107df0 2024-07-26T13:18:31.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.674+0000 7f6957400640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69440b3c50 0x7f69440b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.674+0000 7f6957400640 1 -- 172.21.15.40:0/2511269809 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f694c0e3ff0 con 0x7f6960107df0 2024-07-26T13:18:31.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.674+0000 7f695ea00640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69440b3c50 0x7f69440b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.675+0000 7f695ea00640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69440b3c50 0x7f69440b6160 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f695002a860 tx=0x7f695002cca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.961+0000 7f696c24a740 1 Processor -- start 2024-07-26T13:18:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.961+0000 7f696c24a740 1 -- start start 2024-07-26T13:18:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.962+0000 7f696c24a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c2e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.962+0000 7f696c24a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf15980 0x561f7c2e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.962+0000 7f696c24a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf1db60 0x561f7c2e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.962+0000 7f696c24a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561f7c2aed10 con 0x561f7bf3e840 2024-07-26T13:18:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.962+0000 7f696c24a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561f7c259b60 con 0x561f7bf15980 2024-07-26T13:18:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.962+0000 7f696c24a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561f7c249060 con 0x561f7bf1db60 2024-07-26T13:18:31.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.963+0000 7f695ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c2e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.963+0000 7f695ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c2e41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56844/0 (socket says 172.21.15.40:56844) 2024-07-26T13:18:31.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.963+0000 7f695ea00640 1 -- 172.21.15.40:0/3393710099 learned_addr learned my addr 172.21.15.40:0/3393710099 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:31.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.963+0000 7f695e000640 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf15980 0x561f7c2e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.963+0000 7f695f400640 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf1db60 0x561f7c2e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.964+0000 7f695ea00640 1 -- 172.21.15.40:0/3393710099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf1db60 msgr2=0x561f7c2e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:31.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.964+0000 7f695ea00640 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf1db60 0x561f7c2e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.964+0000 7f695ea00640 1 -- 172.21.15.40:0/3393710099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf15980 msgr2=0x561f7c2e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:31.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.964+0000 7f695ea00640 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf15980 0x561f7c2e4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.964+0000 7f695ea00640 1 -- 172.21.15.40:0/3393710099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7c1d0b10 con 0x561f7bf3e840 2024-07-26T13:18:31.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.964+0000 7f695e000640 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf15980 0x561f7c2e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:18:31.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.965+0000 7f695ea00640 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c2e41c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f6950005d00 tx=0x7f695003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bacfc2e0544317 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:31.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.965+0000 7f694b400640 1 -- 172.21.15.40:0/3393710099 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950037040 con 0x561f7bf3e840 2024-07-26T13:18:31.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.965+0000 7f694b400640 1 -- 172.21.15.40:0/3393710099 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f695004c070 con 0x561f7bf3e840 2024-07-26T13:18:31.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.965+0000 7f694b400640 1 -- 172.21.15.40:0/3393710099 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69500046c0 con 0x561f7bf3e840 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.967+0000 7f696c24a740 1 -- 172.21.15.40:0/3393710099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 msgr2=0x561f7c2e41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.967+0000 7f696c24a740 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c2e41c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f6950005d00 tx=0x7f695003b000 comp rx=0 tx=0).stop 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 -- 172.21.15.40:0/3393710099 shutdown_connections 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf1db60 0x561f7c2e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf15980 0x561f7c2e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 --2- 172.21.15.40:0/3393710099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c2e41c0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 -- 172.21.15.40:0/3393710099 >> 172.21.15.40:0/3393710099 conn(0x561f7bf32990 msgr2=0x561f7c2e20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 -- 172.21.15.40:0/3393710099 shutdown_connections 2024-07-26T13:18:31.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.968+0000 7f696c24a740 1 -- 172.21.15.40:0/3393710099 wait complete. 2024-07-26T13:18:31.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.969+0000 7f696c24a740 1 -- start start 2024-07-26T13:18:31.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.969+0000 7f696c24a740 1 Processor -- start 2024-07-26T13:18:31.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2f8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561f7c1e5520 con 0x561f7bf3e840 2024-07-26T13:18:31.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561f7c24d0a0 con 0x561f7bf1db60 2024-07-26T13:18:31.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561f7c0ac7a0 con 0x561f7bf15980 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.970+0000 7f696c24a740 10 client.0 _ll_register_callbacks cb 0x561f7c241bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.971+0000 7f695ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.971+0000 7f695f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.971+0000 7f695f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56860/0 (socket says 172.21.15.40:56860) 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.971+0000 7f695f400640 1 -- 172.21.15.40:0/3129642347 learned_addr learned my addr 172.21.15.40:0/3129642347 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.971+0000 7f695e000640 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f695f400640 1 -- 172.21.15.40:0/3129642347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 msgr2=0x561f7c2f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:31.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f695f400640 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f695f400640 1 -- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 msgr2=0x561f7c2f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:31.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f695f400640 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f695f400640 1 -- 172.21.15.40:0/3129642347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7bfb8b90 con 0x561f7bf3e840 2024-07-26T13:18:31.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f695f400640 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304220 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f695800fc00 tx=0x7f695800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7130a944a149ec server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:31.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.972+0000 7f693fe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:18:31.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.973+0000 7f693fe00640 1 -- 172.21.15.40:0/3129642347 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69580195f0 con 0x561f7bf3e840 2024-07-26T13:18:31.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.973+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f695004c070 con 0x561f7bf3e840 2024-07-26T13:18:31.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.973+0000 7f693fe00640 1 -- 172.21.15.40:0/3129642347 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6958019790 con 0x561f7bf3e840 2024-07-26T13:18:31.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.973+0000 7f693fe00640 1 -- 172.21.15.40:0/3129642347 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6958019990 con 0x561f7bf3e840 2024-07-26T13:18:31.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.974+0000 7f696c24a740 10 client.17730 fetch_fsmap learned FSMap version 35 2024-07-26T13:18:31.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.974+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561f7c306e50 con 0x561f7bf3e840 2024-07-26T13:18:31.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.974+0000 7f693fe00640 1 -- 172.21.15.40:0/3129642347 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f695004c070 con 0x561f7bf3e840 2024-07-26T13:18:31.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.974+0000 7f693fe00640 1 -- 172.21.15.40:0/3129642347 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f695800b040 con 0x561f7bf3e840 2024-07-26T13:18:31.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.975+0000 7f696c24a740 10 client.17730 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:18:31.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.975+0000 7f696c24a740 10 client.17730 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:18:31.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.975+0000 7f696c24a740 20 client.17730 populate_metadata read hostname 'smithi040' 2024-07-26T13:18:31.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.975+0000 7f696c24a740 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7befd1c0 0x561f7c30a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:31.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.975+0000 7f696c24a740 4 client.17730 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:18:31.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.975+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f7c25bab0 con 0x561f7befd1c0 2024-07-26T13:18:31.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.976+0000 7f695ea00640 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7befd1c0 0x561f7c30a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:31.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.977+0000 7f695ea00640 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7befd1c0 0x561f7c30a330 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5ef3be8a30c592 server_cookie=1bdaf77799ee4eea in_seq=0 out_seq=0 2024-07-26T13:18:31.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.977+0000 7f693fe00640 10 client.17730 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:18:31.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f693fe00640 1 -- 172.21.15.40:0/3129642347 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f7c25bab0 con 0x561f7befd1c0 2024-07-26T13:18:31.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f693fe00640 10 client.17730 handle_command_reply: tid=0 2024-07-26T13:18:31.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 client.17730 shutdown 2024-07-26T13:18:31.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 msgr2=0x561f7c304220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:31.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304220 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f695800fc00 tx=0x7f695800d7b0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 shutdown_connections 2024-07-26T13:18:31.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7befd1c0 0x561f7c30a330 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304220 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 --2- 172.21.15.40:0/3129642347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.979+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 >> 172.21.15.40:0/3129642347 conn(0x561f7bf32990 msgr2=0x561f7c2e73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.980+0000 7f693fe00640 0 client.17730 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.980+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 shutdown_connections 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.980+0000 7f696c24a740 1 -- 172.21.15.40:0/3129642347 wait complete. 2024-07-26T13:18:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:31.980+0000 7f696c24a740 20 client.17730 trim_cache size 0 max 16384 2024-07-26T13:18:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.004+0000 7f696c24a740 1 Processor -- start 2024-07-26T13:18:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.004+0000 7f696c24a740 1 -- start start 2024-07-26T13:18:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f696c24a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f696c24a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f696c24a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f696c24a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69601acc00 con 0x561f7bf3e840 2024-07-26T13:18:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f696c24a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ae740 con 0x561f7bf1db60 2024-07-26T13:18:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f696c24a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ad2d0 con 0x561f7bf15980 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f695f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f695f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56864/0 (socket says 172.21.15.40:56864) 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f695f400640 1 -- 172.21.15.40:0/1344486148 learned_addr learned my addr 172.21.15.40:0/1344486148 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f695e000640 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.005+0000 7f695ea00640 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.006+0000 7f695f400640 1 -- 172.21.15.40:0/1344486148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 msgr2=0x561f7c2e1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.006+0000 7f695f400640 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2e1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.006+0000 7f695f400640 1 -- 172.21.15.40:0/1344486148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 msgr2=0x561f7c2e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.006+0000 7f695f400640 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.006+0000 7f695f400640 1 -- 172.21.15.40:0/1344486148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7c2e8280 con 0x561f7bf3e840 2024-07-26T13:18:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.006+0000 7f695e000640 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:18:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.007+0000 7f695f400640 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304010 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6958022ba0 tx=0x7f695800dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b157d5dd3846d9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.007+0000 7f694aa00640 1 -- 172.21.15.40:0/1344486148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958031070 con 0x561f7bf3e840 2024-07-26T13:18:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.007+0000 7f694aa00640 1 -- 172.21.15.40:0/1344486148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f695801e070 con 0x561f7bf3e840 2024-07-26T13:18:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.007+0000 7f694aa00640 1 -- 172.21.15.40:0/1344486148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958004e30 con 0x561f7bf3e840 2024-07-26T13:18:32.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 -- 172.21.15.40:0/1344486148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 msgr2=0x561f7c304010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:32.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304010 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6958022ba0 tx=0x7f695800dcb0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 -- 172.21.15.40:0/1344486148 shutdown_connections 2024-07-26T13:18:32.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf3e840 0x561f7c304010 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 --2- 172.21.15.40:0/1344486148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf15980 0x561f7c2e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.008+0000 7f696c24a740 1 -- 172.21.15.40:0/1344486148 >> 172.21.15.40:0/1344486148 conn(0x561f7bf32990 msgr2=0x561f7c2e51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.009+0000 7f696c24a740 1 -- 172.21.15.40:0/1344486148 shutdown_connections 2024-07-26T13:18:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.009+0000 7f696c24a740 1 -- 172.21.15.40:0/1344486148 wait complete. 2024-07-26T13:18:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.009+0000 7f696c24a740 1 -- start start 2024-07-26T13:18:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.010+0000 7f696c24a740 1 Processor -- start 2024-07-26T13:18:32.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.010+0000 7f696c24a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 0x561f7c2fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.010+0000 7f696c24a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f696c24a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf3e840 0x561f7c370a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f696c24a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ae070 con 0x561f7bf15980 2024-07-26T13:18:32.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f696c24a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ad9a0 con 0x561f7bf1db60 2024-07-26T13:18:32.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f696c24a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69601aac60 con 0x561f7bf3e840 2024-07-26T13:18:32.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f696c24a740 10 client.0 _ll_register_callbacks cb 0x7f6958009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f695ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 0x561f7c2fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f695ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 0x561f7c2fb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56874/0 (socket says 172.21.15.40:56874) 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f695ea00640 1 -- 172.21.15.40:0/2056715940 learned_addr learned my addr 172.21.15.40:0/2056715940 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f695e000640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.011+0000 7f695ea00640 1 -- 172.21.15.40:0/2056715940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf3e840 msgr2=0x561f7c370a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695f400640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf3e840 0x561f7c370a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695ea00640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf3e840 0x561f7c370a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695ea00640 1 -- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 msgr2=0x561f7c2fbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695ea00640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2fbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695ea00640 1 -- 172.21.15.40:0/2056715940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7c370fc0 con 0x561f7bf15980 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695e000640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695f400640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf3e840 0x561f7c370a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f695ea00640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 0x561f7c2fb570 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f695005afd0 tx=0x7f695002a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50be02dd926585f2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.012+0000 7f693fe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.013+0000 7f693fe00640 1 -- 172.21.15.40:0/2056715940 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950037040 con 0x561f7bf15980 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.013+0000 7f693fe00640 1 -- 172.21.15.40:0/2056715940 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6950030340 con 0x561f7bf15980 2024-07-26T13:18:32.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.013+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f695801e070 con 0x561f7bf15980 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.013+0000 7f693fe00640 1 -- 172.21.15.40:0/2056715940 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6950030540 con 0x561f7bf15980 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.013+0000 7f696c24a740 10 client.17736 fetch_fsmap learned FSMap version 35 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.013+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561f7c372150 con 0x561f7bf15980 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f693fe00640 1 -- 172.21.15.40:0/2056715940 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f695801e070 con 0x561f7bf15980 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f693fe00640 1 -- 172.21.15.40:0/2056715940 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f695005a3b0 con 0x561f7bf15980 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f696c24a740 10 client.17736 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f696c24a740 10 client.17736 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f696c24a740 20 client.17736 populate_metadata read hostname 'smithi040' 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f696c24a740 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7bed2570 0x561f7c374530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f696c24a740 4 client.17736 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.8, "await_for": 45.0}] 2024-07-26T13:18:32.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.014+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.8, "await_for": 45.0}) -- 0x561f7c257550 con 0x561f7bed2570 2024-07-26T13:18:32.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.015+0000 7f695e000640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7bed2570 0x561f7c374530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:32.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.016+0000 7f695e000640 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7bed2570 0x561f7c374530 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad19ad442d55257 server_cookie=db0073e48972deae in_seq=0 out_seq=0 2024-07-26T13:18:32.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.016+0000 7f693fe00640 10 client.17736 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:18:32.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f693fe00640 1 -- 172.21.15.40:0/2056715940 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x561f7c257550 con 0x561f7bed2570 2024-07-26T13:18:32.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f693fe00640 10 client.17736 handle_command_reply: tid=0 2024-07-26T13:18:32.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 client.17736 shutdown 2024-07-26T13:18:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 msgr2=0x561f7c2fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 0x561f7c2fb570 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f695005afd0 tx=0x7f695002a340 comp rx=0 tx=0).stop 2024-07-26T13:18:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 shutdown_connections 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f7bf3e840 0x561f7c370a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561f7bf1db60 0x561f7c2fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561f7bed2570 0x561f7c374530 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.280+0000 7f696c24a740 1 --2- 172.21.15.40:0/2056715940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561f7bf15980 0x561f7c2fb570 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.281+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 >> 172.21.15.40:0/2056715940 conn(0x561f7bf32990 msgr2=0x561f7c2e5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.281+0000 7f693fe00640 0 client.17736 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.281+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 shutdown_connections 2024-07-26T13:18:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.281+0000 7f696c24a740 1 -- 172.21.15.40:0/2056715940 wait complete. 2024-07-26T13:18:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.282+0000 7f696c24a740 20 client.17736 trim_cache size 0 max 16384 2024-07-26T13:18:32.284 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:18:32.284 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:18:32.284 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 190, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "f462e18b": { 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 190, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 152.8, 2024-07-26T13:18:32.285 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:18:32.286 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:18:32.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.283+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69440b3c50 msgr2=0x7f69440b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:32.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.283+0000 7f6965600640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69440b3c50 0x7f69440b6160 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f695002a860 tx=0x7f695002cca0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.283+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 msgr2=0x7f69601041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:32.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.283+0000 7f6965600640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f69601041e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e9a0 tx=0x7f694c00ee60 comp rx=0 tx=0).stop 2024-07-26T13:18:32.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 shutdown_connections 2024-07-26T13:18:32.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6960108740 0x7f6960104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960107df0 0x7f69601041e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f69440b3c50 0x7f69440b6160 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 --2- 172.21.15.40:0/2511269809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69601024b0 0x7f6960103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:32.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 >> 172.21.15.40:0/2511269809 conn(0x7f6960079190 msgr2=0x7f6960101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:32.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 shutdown_connections 2024-07-26T13:18:32.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:32.284+0000 7f6965600640 1 -- 172.21.15.40:0/2511269809 wait complete. 2024-07-26T13:18:33.123 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f462e18b', quiesce took 9.8 seconds. Will release after: 22.999999999999996 2024-07-26T13:18:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:33 smithi040 ceph-mon[32397]: pgmap v2188: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:18:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:33 smithi146 ceph-mon[35807]: pgmap v2188: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:18:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:33 smithi076 ceph-mon[35401]: pgmap v2188: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:18:35.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:35 smithi146 ceph-mon[35807]: pgmap v2189: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 14 op/s 2024-07-26T13:18:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:35 smithi076 ceph-mon[35401]: pgmap v2189: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 14 op/s 2024-07-26T13:18:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:35 smithi040 ceph-mon[32397]: pgmap v2189: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 14 op/s 2024-07-26T13:18:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:37 smithi146 ceph-mon[35807]: pgmap v2190: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:37 smithi076 ceph-mon[35401]: pgmap v2190: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:37 smithi040 ceph-mon[32397]: pgmap v2190: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:18:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:39 smithi146 ceph-mon[35807]: pgmap v2191: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:18:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:39 smithi076 ceph-mon[35401]: pgmap v2191: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:18:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:39 smithi040 ceph-mon[32397]: pgmap v2191: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:18:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:41 smithi146 ceph-mon[35807]: pgmap v2192: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T13:18:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:41 smithi076 ceph-mon[35401]: pgmap v2192: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T13:18:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:41 smithi040 ceph-mon[32397]: pgmap v2192: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 MiB/s wr, 13 op/s 2024-07-26T13:18:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:43 smithi146 ceph-mon[35807]: pgmap v2193: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:18:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:43 smithi076 ceph-mon[35401]: pgmap v2193: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:18:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:43 smithi040 ceph-mon[32397]: pgmap v2193: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 10 op/s 2024-07-26T13:18:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:45 smithi146 ceph-mon[35807]: pgmap v2194: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-07-26T13:18:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:45 smithi076 ceph-mon[35401]: pgmap v2194: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-07-26T13:18:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:45 smithi040 ceph-mon[32397]: pgmap v2194: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.6 MiB/s wr, 13 op/s 2024-07-26T13:18:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:47 smithi146 ceph-mon[35807]: pgmap v2195: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:18:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:47 smithi076 ceph-mon[35401]: pgmap v2195: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:18:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:47 smithi040 ceph-mon[32397]: pgmap v2195: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:18:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:49 smithi076 ceph-mon[35401]: pgmap v2196: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:18:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:49 smithi040 ceph-mon[32397]: pgmap v2196: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:18:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:49 smithi146 ceph-mon[35807]: pgmap v2196: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 578 KiB/s wr, 10 op/s 2024-07-26T13:18:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:51 smithi076 ceph-mon[35401]: pgmap v2197: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 236 KiB/s wr, 11 op/s 2024-07-26T13:18:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:51 smithi040 ceph-mon[32397]: pgmap v2197: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 236 KiB/s wr, 11 op/s 2024-07-26T13:18:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:51 smithi146 ceph-mon[35807]: pgmap v2197: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 236 KiB/s wr, 11 op/s 2024-07-26T13:18:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:52 smithi040 ceph-mon[32397]: pgmap v2198: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:18:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:52 smithi146 ceph-mon[35807]: pgmap v2198: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:18:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:52 smithi076 ceph-mon[35401]: pgmap v2198: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-07-26T13:18:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:54 smithi040 ceph-mon[32397]: pgmap v2199: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:18:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:54 smithi146 ceph-mon[35807]: pgmap v2199: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:18:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:54 smithi076 ceph-mon[35401]: pgmap v2199: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:18:56.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:18:56.658 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:18:57.083 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:56 smithi040 ceph-mon[32397]: pgmap v2200: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:18:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:56 smithi146 ceph-mon[35807]: pgmap v2200: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:18:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:56 smithi076 ceph-mon[35401]: pgmap v2200: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:18:59.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 -- 172.21.15.40:0/2878907408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 msgr2=0x7f97681122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:59.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 --2- 172.21.15.40:0/2878907408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681122a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9760009ca0 tx=0x7f976002a8c0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.155 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:58 smithi040 ceph-mon[32397]: pgmap v2201: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 -- 172.21.15.40:0/2878907408 shutdown_connections 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 --2- 172.21.15.40:0/2878907408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681122a0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 --2- 172.21.15.40:0/2878907408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976810b120 0x7f976810b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 --2- 172.21.15.40:0/2878907408 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 0x7f9768105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 -- 172.21.15.40:0/2878907408 >> 172.21.15.40:0/2878907408 conn(0x7f97681011f0 msgr2=0x7f9768103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 -- 172.21.15.40:0/2878907408 shutdown_connections 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.153+0000 7f976ec00640 1 -- 172.21.15.40:0/2878907408 wait complete. 2024-07-26T13:18:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.154+0000 7f976ec00640 1 Processor -- start 2024-07-26T13:18:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 -- start start 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 0x7f976819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976810b120 0x7f976819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9768115640 con 0x7f976810ba70 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f97681154c0 con 0x7f97681057e0 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.155+0000 7f976ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97681157c0 con 0x7f976810b120 2024-07-26T13:18:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42094/0 (socket says 172.21.15.40:42094) 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 -- 172.21.15.40:0/2700306392 learned_addr learned my addr 172.21.15.40:0/2700306392 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f9767400640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976810b120 0x7f976819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f9767e00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 0x7f976819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 -- 172.21.15.40:0/2700306392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976810b120 msgr2=0x7f976819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976810b120 0x7f976819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 -- 172.21.15.40:0/2700306392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 msgr2=0x7f976819bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 0x7f976819bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f976cc00640 1 -- 172.21.15.40:0/2700306392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97681a1f60 con 0x7f976810ba70 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.156+0000 7f9767e00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 0x7f976819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:18:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.157+0000 7f976cc00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681a1830 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f9760031040 tx=0x7f9760032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.157+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9760004040 con 0x7f976810ba70 2024-07-26T13:18:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.157+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9760004670 con 0x7f976810ba70 2024-07-26T13:18:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.157+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9760030bb0 con 0x7f976810ba70 2024-07-26T13:18:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.157+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97681a21f0 con 0x7f976810ba70 2024-07-26T13:18:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.157+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97681a89b0 con 0x7f976810ba70 2024-07-26T13:18:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.159+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9768105bf0 con 0x7f976810ba70 2024-07-26T13:18:59.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.161+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f97600041e0 con 0x7f976810ba70 2024-07-26T13:18:59.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.163+0000 7f9764c00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f974c0b3c50 0x7f974c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:18:59.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.163+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9760105170 con 0x7f976810ba70 2024-07-26T13:18:59.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.163+0000 7f9767e00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f974c0b3c50 0x7f974c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:18:59.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.164+0000 7f9767e00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f974c0b3c50 0x7f974c0b6160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9758005d00 tx=0x7f9758005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:18:59.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.166+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f97600cc780 con 0x7f976810ba70 2024-07-26T13:18:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:58 smithi146 ceph-mon[35807]: pgmap v2201: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:18:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:58 smithi076 ceph-mon[35401]: pgmap v2201: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:18:59.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.405+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f976810d8c0 con 0x7f976810ba70 2024-07-26T13:18:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.407+0000 7f9764c00640 1 -- 172.21.15.40:0/2700306392 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f97600cc080 con 0x7f976810ba70 2024-07-26T13:18:59.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:18:59.410 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:18:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:18:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f974c0b3c50 msgr2=0x7f974c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f974c0b3c50 0x7f974c0b6160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9758005d00 tx=0x7f9758005c70 comp rx=0 tx=0).stop 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 msgr2=0x7f97681a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681a1830 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f9760031040 tx=0x7f9760032bc0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 shutdown_connections 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976810ba70 0x7f97681a1830 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f974c0b3c50 0x7f974c0b6160 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976810b120 0x7f976819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 --2- 172.21.15.40:0/2700306392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97681057e0 0x7f976819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.410+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 >> 172.21.15.40:0/2700306392 conn(0x7f97681011f0 msgr2=0x7f9768104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.411+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 shutdown_connections 2024-07-26T13:18:59.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:18:59.411+0000 7f976ec00640 1 -- 172.21.15.40:0/2700306392 wait complete. 2024-07-26T13:19:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:18:59 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2700306392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:19:00.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:18:59 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2700306392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:19:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:18:59 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2700306392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:19:00.356 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id f462e18b --release --await' 2024-07-26T13:19:00.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id f462e18b --release --await 2024-07-26T13:19:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:19:01.167 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:00 smithi040 ceph-mon[32397]: pgmap v2202: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:19:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:00 smithi146 ceph-mon[35807]: pgmap v2202: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:19:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:00 smithi076 ceph-mon[35401]: pgmap v2202: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:19:02.030 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:19:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:19:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:19:03.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: pgmap v2203: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:19:03.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:19:03.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:19:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.160+0000 7f15d5800640 1 -- 172.21.15.40:0/2686517503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0075800 msgr2=0x7f15d0075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.160+0000 7f15d5800640 1 --2- 172.21.15.40:0/2686517503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0075800 0x7f15d0075c10 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009900 tx=0x7f15bc02a410 comp rx=0 tx=0).stop 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 -- 172.21.15.40:0/2686517503 shutdown_connections 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 --2- 172.21.15.40:0/2686517503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15d0113cb0 0x7f15d0116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 --2- 172.21.15.40:0/2686517503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0075800 0x7f15d0075c10 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 --2- 172.21.15.40:0/2686517503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0076db0 0x7f15d00751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 -- 172.21.15.40:0/2686517503 >> 172.21.15.40:0/2686517503 conn(0x7f15d00fee70 msgr2=0x7f15d01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 -- 172.21.15.40:0/2686517503 shutdown_connections 2024-07-26T13:19:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.161+0000 7f15d5800640 1 -- 172.21.15.40:0/2686517503 wait complete. 2024-07-26T13:19:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 Processor -- start 2024-07-26T13:19:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 -- start start 2024-07-26T13:19:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0075800 0x7f15d01a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 0x7f15d01a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15d0113cb0 0x7f15d01a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0119760 con 0x7f15d0076db0 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01195e0 con 0x7f15d0113cb0 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.163+0000 7f15d5800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01198e0 con 0x7f15d0075800 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 0x7f15d01a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 0x7f15d01a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48356/0 (socket says 172.21.15.40:48356) 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 -- 172.21.15.40:0/4135410336 learned_addr learned my addr 172.21.15.40:0/4135410336 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cfe00640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0075800 0x7f15d01a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15d4e00640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15d0113cb0 0x7f15d01a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 -- 172.21.15.40:0/4135410336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0075800 msgr2=0x7f15d01a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0075800 0x7f15d01a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 -- 172.21.15.40:0/4135410336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15d0113cb0 msgr2=0x7f15d01a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15d0113cb0 0x7f15d01a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cf400640 1 -- 172.21.15.40:0/4135410336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d01a6240 con 0x7f15d0076db0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.164+0000 7f15cfe00640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0075800 0x7f15d01a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.165+0000 7f15cf400640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 0x7f15d01a0870 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f15bc005940 tx=0x7f15bc005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.165+0000 7f15ccc00640 1 -- 172.21.15.40:0/4135410336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc03f030 con 0x7f15d0076db0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.165+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d01a64d0 con 0x7f15d0076db0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.165+0000 7f15ccc00640 1 -- 172.21.15.40:0/4135410336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15bc0043d0 con 0x7f15d0076db0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.165+0000 7f15ccc00640 1 -- 172.21.15.40:0/4135410336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc035070 con 0x7f15d0076db0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.165+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01acc90 con 0x7f15d0076db0 2024-07-26T13:19:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.169+0000 7f15ccc00640 1 -- 172.21.15.40:0/4135410336 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f15bc042030 con 0x7f15d0076db0 2024-07-26T13:19:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.171+0000 7f15ccc00640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15b40b3bd0 0x7f15b40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.171+0000 7f15ccc00640 1 -- 172.21.15.40:0/4135410336 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15bc104060 con 0x7f15d0076db0 2024-07-26T13:19:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.171+0000 7f15cfe00640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15b40b3bd0 0x7f15b40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.172+0000 7f15cfe00640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15b40b3bd0 0x7f15b40b60e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f15c0005fd0 tx=0x7f15c0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:19:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.198+0000 7f15dd9d6740 1 Processor -- start 2024-07-26T13:19:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.198+0000 7f15dd9d6740 1 -- start start 2024-07-26T13:19:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.198+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 0x55c592b561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.198+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592788660 0x55c592b566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b56c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c592accf50 con 0x55c5927b1520 2024-07-26T13:19:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c592abc450 con 0x55c592790840 2024-07-26T13:19:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c592ac0490 con 0x55c592788660 2024-07-26T13:19:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 0x55c592b561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 0x55c592b561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48358/0 (socket says 172.21.15.40:48358) 2024-07-26T13:19:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15cfe00640 1 -- 172.21.15.40:0/3639337305 learned_addr learned my addr 172.21.15.40:0/3639337305 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:19:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15cf400640 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592788660 0x55c592b566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.199+0000 7f15d4e00640 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b56c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.200+0000 7f15cfe00640 1 -- 172.21.15.40:0/3639337305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592788660 msgr2=0x55c592b566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.200+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592788660 0x55c592b566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.200+0000 7f15cfe00640 1 -- 172.21.15.40:0/3639337305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 msgr2=0x55c592b56c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.200+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b56c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.200+0000 7f15cfe00640 1 -- 172.21.15.40:0/3639337305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59281cb00 con 0x55c5927b1520 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.200+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 0x55c592b561a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009ab0 tx=0x7f15c0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9365054d4cec93a3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.201+0000 7f15c5600640 1 -- 172.21.15.40:0/3639337305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c000e940 con 0x55c5927b1520 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.201+0000 7f15c5600640 1 -- 172.21.15.40:0/3639337305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c001e420 con 0x55c5927b1520 2024-07-26T13:19:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.201+0000 7f15c5600640 1 -- 172.21.15.40:0/3639337305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c001c3b0 con 0x55c5927b1520 2024-07-26T13:19:03.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3639337305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 msgr2=0x55c592b561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 0x55c592b561a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009ab0 tx=0x7f15c0013000 comp rx=0 tx=0).stop 2024-07-26T13:19:03.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3639337305 shutdown_connections 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b56c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592788660 0x55c592b566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3639337305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c5927b1520 0x55c592b561a0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3639337305 >> 172.21.15.40:0/3639337305 conn(0x55c5927a5910 msgr2=0x55c592b54090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3639337305 shutdown_connections 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.202+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3639337305 wait complete. 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.203+0000 7f15dd9d6740 1 -- start start 2024-07-26T13:19:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.203+0000 7f15dd9d6740 1 Processor -- start 2024-07-26T13:19:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b61960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b61ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b6dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c59291fbb0 con 0x55c592788660 2024-07-26T13:19:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c592a58930 con 0x55c592790840 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c592b64980 con 0x55c59276fea0 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15dd9d6740 10 client.0 _ll_register_callbacks cb 0x55c5927c8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b61960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b61960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48360/0 (socket says 172.21.15.40:48360) 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15cfe00640 1 -- 172.21.15.40:0/3455881795 learned_addr learned my addr 172.21.15.40:0/3455881795 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15cf400640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b61ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.204+0000 7f15d4e00640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b6dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cfe00640 1 -- 172.21.15.40:0/3455881795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 msgr2=0x55c592b6dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b6dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cfe00640 1 -- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 msgr2=0x55c592b61ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b61ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cfe00640 1 -- 172.21.15.40:0/3455881795 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c592893960 con 0x55c592788660 2024-07-26T13:19:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cf400640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b61ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b61960 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009a80 tx=0x7f15c0009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6efbd26ef1b614b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15ba000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15ba000640 1 -- 172.21.15.40:0/3455881795 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004a40 con 0x55c592788660 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.205+0000 7f15ba000640 1 -- 172.21.15.40:0/3455881795 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15c0004be0 con 0x55c592788660 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.206+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c001e420 con 0x55c592788660 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.206+0000 7f15ba000640 1 -- 172.21.15.40:0/3455881795 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f15c0004de0 con 0x55c592788660 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.206+0000 7f15dd9d6740 10 client.17754 fetch_fsmap learned FSMap version 35 2024-07-26T13:19:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.206+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c592b707b0 con 0x55c592788660 2024-07-26T13:19:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.206+0000 7f15ba000640 1 -- 172.21.15.40:0/3455881795 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c001e420 con 0x55c592788660 2024-07-26T13:19:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.206+0000 7f15ba000640 1 -- 172.21.15.40:0/3455881795 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f15c0005530 con 0x55c592788660 2024-07-26T13:19:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15dd9d6740 10 client.17754 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15dd9d6740 10 client.17754 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15dd9d6740 20 client.17754 populate_metadata read hostname 'smithi040' 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592745250 0x55c592b73b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15dd9d6740 4 client.17754 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c592aceea0 con 0x55c592745250 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.207+0000 7f15cf400640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592745250 0x55c592b73b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.208+0000 7f15cf400640 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592745250 0x55c592b73b10 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4874753f09aa7221 server_cookie=82a83c3b5b75eb9e in_seq=0 out_seq=0 2024-07-26T13:19:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.208+0000 7f15ba000640 10 client.17754 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:19:03.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.210+0000 7f15ba000640 1 -- 172.21.15.40:0/3455881795 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c592aceea0 con 0x55c592745250 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.210+0000 7f15ba000640 10 client.17754 handle_command_reply: tid=0 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.210+0000 7f15dd9d6740 1 client.17754 shutdown 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 msgr2=0x55c592b61960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b61960 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009a80 tx=0x7f15c0009d30 comp rx=0 tx=0).stop 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 shutdown_connections 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b6dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592b61ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592745250 0x55c592b73b10 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3455881795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b61960 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 >> 172.21.15.40:0/3455881795 conn(0x55c5927a5910 msgr2=0x55c592b59380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:19:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15ba000640 0 client.17754 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:19:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 shutdown_connections 2024-07-26T13:19:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3455881795 wait complete. 2024-07-26T13:19:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.211+0000 7f15dd9d6740 20 client.17754 trim_cache size 0 max 16384 2024-07-26T13:19:03.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.230+0000 7f15dd9d6740 1 Processor -- start 2024-07-26T13:19:03.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 -- start start 2024-07-26T13:19:03.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 0x55c592b63590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592788660 0x55c592b6da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592790840 0x55c592b6dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01b5280 con 0x55c59276fea0 2024-07-26T13:19:03.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01b6dc0 con 0x55c592788660 2024-07-26T13:19:03.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01b5950 con 0x55c592790840 2024-07-26T13:19:03.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 0x55c592b63590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 0x55c592b63590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48370/0 (socket says 172.21.15.40:48370) 2024-07-26T13:19:03.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.231+0000 7f15cfe00640 1 -- 172.21.15.40:0/3581388819 learned_addr learned my addr 172.21.15.40:0/3581388819 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:19:03.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cf400640 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592788660 0x55c592b6da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cfe00640 1 -- 172.21.15.40:0/3581388819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592790840 msgr2=0x55c592b6dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592790840 0x55c592b6dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cfe00640 1 -- 172.21.15.40:0/3581388819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592788660 msgr2=0x55c592b6da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592788660 0x55c592b6da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cfe00640 1 -- 172.21.15.40:0/3581388819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c592b58490 con 0x55c59276fea0 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.232+0000 7f15cfe00640 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 0x55c592b63590 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f15c0000f80 tx=0x7f15c00314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ff7f1571e6249c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.233+0000 7f15c4c00640 1 -- 172.21.15.40:0/3581388819 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011500 con 0x55c59276fea0 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.233+0000 7f15c4c00640 1 -- 172.21.15.40:0/3581388819 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0040020 con 0x55c59276fea0 2024-07-26T13:19:03.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.233+0000 7f15c4c00640 1 -- 172.21.15.40:0/3581388819 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004b00 con 0x55c59276fea0 2024-07-26T13:19:03.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3581388819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 msgr2=0x55c592b63590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 0x55c592b63590 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f15c0000f80 tx=0x7f15c00314a0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3581388819 shutdown_connections 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c592790840 0x55c592b6dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592788660 0x55c592b6da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/3581388819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c59276fea0 0x55c592b63590 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3581388819 >> 172.21.15.40:0/3581388819 conn(0x55c5927a5910 msgr2=0x55c592b62e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3581388819 shutdown_connections 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.234+0000 7f15dd9d6740 1 -- 172.21.15.40:0/3581388819 wait complete. 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.235+0000 7f15dd9d6740 1 -- start start 2024-07-26T13:19:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.235+0000 7f15dd9d6740 1 Processor -- start 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.235+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b66200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b66740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15dd9d6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592bdb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01b66f0 con 0x55c592788660 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01b6020 con 0x55c592790840 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15dd9d6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01b3240 con 0x55c59276fea0 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15dd9d6740 10 client.0 _ll_register_callbacks cb 0x7f15c8009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b66740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b66740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48374/0 (socket says 172.21.15.40:48374) 2024-07-26T13:19:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cf400640 1 -- 172.21.15.40:0/947774651 learned_addr learned my addr 172.21.15.40:0/947774651 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cfe00640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b66200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15d4e00640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592bdb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cf400640 1 -- 172.21.15.40:0/947774651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 msgr2=0x55c592b66200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cf400640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b66200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.236+0000 7f15cf400640 1 -- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 msgr2=0x55c592bdb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15cf400640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592bdb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15cf400640 1 -- 172.21.15.40:0/947774651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c592bdb720 con 0x55c592788660 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15cf400640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b66740 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f15bc000c00 tx=0x7f15bc0cb760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66008444bfd6fa2c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15ba000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15ba000640 1 -- 172.21.15.40:0/947774651 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0e5070 con 0x55c592788660 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15ba000640 1 -- 172.21.15.40:0/947774651 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15bc003c10 con 0x55c592788660 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.237+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c0040020 con 0x55c592788660 2024-07-26T13:19:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15ba000640 1 -- 172.21.15.40:0/947774651 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f15bc049040 con 0x55c592788660 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 10 client.17760 fetch_fsmap learned FSMap version 35 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c592bdca40 con 0x55c592788660 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15ba000640 1 -- 172.21.15.40:0/947774651 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0040020 con 0x55c592788660 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15ba000640 1 -- 172.21.15.40:0/947774651 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f15bc090100 con 0x55c592788660 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 10 client.17760 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 10 client.17760 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 20 client.17760 populate_metadata read hostname 'smithi040' 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592bdd240 0x55c592bdf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 4 client.17760 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f462e18b", "release": true, "await": true}] 2024-07-26T13:19:03.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.238+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f462e18b", "release": true, "await": true}) -- 0x55c592aca940 con 0x55c592bdd240 2024-07-26T13:19:03.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.239+0000 7f15cfe00640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592bdd240 0x55c592bdf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:19:03.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.240+0000 7f15cfe00640 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592bdd240 0x55c592bdf660 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=559701a4037ec3cc server_cookie=4411e4f4d5569898 in_seq=0 out_seq=0 2024-07-26T13:19:03.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.240+0000 7f15ba000640 10 client.17760 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:19:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.306+0000 7f15ba000640 1 -- 172.21.15.40:0/947774651 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55c592aca940 con 0x55c592bdd240 2024-07-26T13:19:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.306+0000 7f15ba000640 10 client.17760 handle_command_reply: tid=0 2024-07-26T13:19:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.306+0000 7f15dd9d6740 1 client.17760 shutdown 2024-07-26T13:19:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.307+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 msgr2=0x55c592b66740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.307+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b66740 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f15bc000c00 tx=0x7f15bc0cb760 comp rx=0 tx=0).stop 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.307+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 shutdown_connections 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.307+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c592790840 0x55c592bdb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.307+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c592bdd240 0x55c592bdf660 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.308+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c592788660 0x55c592b66740 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.308+0000 7f15dd9d6740 1 --2- 172.21.15.40:0/947774651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c59276fea0 0x55c592b66200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.308+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 >> 172.21.15.40:0/947774651 conn(0x55c5927a5910 msgr2=0x55c592b637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:19:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.308+0000 7f15ba000640 0 client.17760 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:19:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.308+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 shutdown_connections 2024-07-26T13:19:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.309+0000 7f15dd9d6740 1 -- 172.21.15.40:0/947774651 wait complete. 2024-07-26T13:19:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.309+0000 7f15dd9d6740 20 client.17760 trim_cache size 0 max 16384 2024-07-26T13:19:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 192, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "f462e18b": { 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 192, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:19:03.312 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 152.8, 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:19:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:19:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15b40b3bd0 msgr2=0x7f15b40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15b40b3bd0 0x7f15b40b60e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f15c0005fd0 tx=0x7f15c0009500 comp rx=0 tx=0).stop 2024-07-26T13:19:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 msgr2=0x7f15d01a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:19:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 0x7f15d01a0870 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f15bc005940 tx=0x7f15bc005e30 comp rx=0 tx=0).stop 2024-07-26T13:19:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 shutdown_connections 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15d0113cb0 0x7f15d01a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d0076db0 0x7f15d01a0870 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f15b40b3bd0 0x7f15b40b60e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 --2- 172.21.15.40:0/4135410336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15d0075800 0x7f15d01a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.311+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 >> 172.21.15.40:0/4135410336 conn(0x7f15d00fee70 msgr2=0x7f15d010fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.312+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 shutdown_connections 2024-07-26T13:19:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:19:03.312+0000 7f15d5800640 1 -- 172.21.15.40:0/4135410336 wait complete. 2024-07-26T13:19:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: pgmap v2203: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:19:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:19:03.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:19:03.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:19:03.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: pgmap v2203: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:19:03.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:19:04.313 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f462e18b', total seconds elapsed: 41.0 2024-07-26T13:19:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:05 smithi076 ceph-mon[35401]: pgmap v2204: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T13:19:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:05 smithi040 ceph-mon[32397]: pgmap v2204: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T13:19:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:05 smithi146 ceph-mon[35807]: pgmap v2204: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T13:19:07.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:07 smithi146 ceph-mon[35807]: pgmap v2205: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T13:19:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:07 smithi040 ceph-mon[32397]: pgmap v2205: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T13:19:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:07 smithi076 ceph-mon[35401]: pgmap v2205: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T13:19:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:09 smithi040 ceph-mon[32397]: pgmap v2206: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 KiB/s wr, 10 op/s 2024-07-26T13:19:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:09 smithi146 ceph-mon[35807]: pgmap v2206: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 KiB/s wr, 10 op/s 2024-07-26T13:19:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:09 smithi076 ceph-mon[35401]: pgmap v2206: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 KiB/s wr, 10 op/s 2024-07-26T13:19:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:11 smithi040 ceph-mon[32397]: pgmap v2207: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T13:19:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:11 smithi146 ceph-mon[35807]: pgmap v2207: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T13:19:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:11 smithi076 ceph-mon[35401]: pgmap v2207: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T13:19:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:13 smithi040 ceph-mon[32397]: pgmap v2208: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-07-26T13:19:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:13 smithi146 ceph-mon[35807]: pgmap v2208: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-07-26T13:19:13.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:13 smithi076 ceph-mon[35401]: pgmap v2208: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-07-26T13:19:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:15 smithi040 ceph-mon[32397]: pgmap v2209: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:19:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:15 smithi146 ceph-mon[35807]: pgmap v2209: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:19:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:15 smithi076 ceph-mon[35401]: pgmap v2209: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:19:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:17 smithi040 ceph-mon[32397]: pgmap v2210: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:19:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:17 smithi146 ceph-mon[35807]: pgmap v2210: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:19:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:17 smithi076 ceph-mon[35401]: pgmap v2210: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:19:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:19 smithi040 ceph-mon[32397]: pgmap v2211: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T13:19:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:19 smithi146 ceph-mon[35807]: pgmap v2211: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T13:19:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:19 smithi076 ceph-mon[35401]: pgmap v2211: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T13:19:21.408 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:21 smithi040 ceph-mon[32397]: pgmap v2212: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:19:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:21 smithi146 ceph-mon[35807]: pgmap v2212: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:19:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:21 smithi076 ceph-mon[35401]: pgmap v2212: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:19:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:23 smithi040 ceph-mon[32397]: pgmap v2213: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:19:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:23 smithi146 ceph-mon[35807]: pgmap v2213: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:19:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:23 smithi076 ceph-mon[35401]: pgmap v2213: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:19:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:25 smithi040 ceph-mon[32397]: pgmap v2214: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:19:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:25 smithi146 ceph-mon[35807]: pgmap v2214: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:19:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:25 smithi076 ceph-mon[35401]: pgmap v2214: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:19:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:27 smithi040 ceph-mon[32397]: pgmap v2215: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:19:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:27 smithi146 ceph-mon[35807]: pgmap v2215: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:19:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:27 smithi076 ceph-mon[35401]: pgmap v2215: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:19:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:29 smithi040 ceph-mon[32397]: pgmap v2216: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:19:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:29 smithi146 ceph-mon[35807]: pgmap v2216: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:19:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:29 smithi076 ceph-mon[35401]: pgmap v2216: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:19:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:31 smithi040 ceph-mon[32397]: pgmap v2217: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:19:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:31 smithi146 ceph-mon[35807]: pgmap v2217: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:19:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:31 smithi076 ceph-mon[35401]: pgmap v2217: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:19:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:33 smithi040 ceph-mon[32397]: pgmap v2218: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:19:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:33 smithi146 ceph-mon[35807]: pgmap v2218: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:19:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:33 smithi076 ceph-mon[35401]: pgmap v2218: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:19:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:35 smithi040 ceph-mon[32397]: pgmap v2219: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:19:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:35 smithi146 ceph-mon[35807]: pgmap v2219: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:19:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:35 smithi076 ceph-mon[35401]: pgmap v2219: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:19:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:37 smithi040 ceph-mon[32397]: pgmap v2220: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:19:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:37 smithi146 ceph-mon[35807]: pgmap v2220: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:19:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:37 smithi076 ceph-mon[35401]: pgmap v2220: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-07-26T13:19:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:39 smithi040 ceph-mon[32397]: pgmap v2221: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:39 smithi146 ceph-mon[35807]: pgmap v2221: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:39 smithi076 ceph-mon[35401]: pgmap v2221: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:41 smithi040 ceph-mon[32397]: pgmap v2222: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:19:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:41 smithi146 ceph-mon[35807]: pgmap v2222: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:19:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:41 smithi076 ceph-mon[35401]: pgmap v2222: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:19:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:43 smithi040 ceph-mon[32397]: pgmap v2223: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:19:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:43 smithi146 ceph-mon[35807]: pgmap v2223: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:19:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:43 smithi076 ceph-mon[35401]: pgmap v2223: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-07-26T13:19:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:45 smithi040 ceph-mon[32397]: pgmap v2224: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:45 smithi146 ceph-mon[35807]: pgmap v2224: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:45 smithi076 ceph-mon[35401]: pgmap v2224: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:47 smithi040 ceph-mon[32397]: pgmap v2225: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:19:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:47 smithi146 ceph-mon[35807]: pgmap v2225: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:19:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:47 smithi076 ceph-mon[35401]: pgmap v2225: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-07-26T13:19:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:49 smithi146 ceph-mon[35807]: pgmap v2226: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:19:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:49 smithi076 ceph-mon[35401]: pgmap v2226: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:19:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:49 smithi040 ceph-mon[32397]: pgmap v2226: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:19:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:51 smithi146 ceph-mon[35807]: pgmap v2227: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:19:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:51 smithi076 ceph-mon[35401]: pgmap v2227: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:19:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:51 smithi040 ceph-mon[32397]: pgmap v2227: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:19:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:53 smithi146 ceph-mon[35807]: pgmap v2228: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:19:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:53 smithi076 ceph-mon[35401]: pgmap v2228: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:19:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:53 smithi040 ceph-mon[32397]: pgmap v2228: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:19:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:55 smithi146 ceph-mon[35807]: pgmap v2229: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:19:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:55 smithi076 ceph-mon[35401]: pgmap v2229: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:19:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:55 smithi040 ceph-mon[32397]: pgmap v2229: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:19:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:57 smithi146 ceph-mon[35807]: pgmap v2230: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:19:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:57 smithi076 ceph-mon[35401]: pgmap v2230: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:19:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:57 smithi040 ceph-mon[32397]: pgmap v2230: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:19:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:19:59 smithi146 ceph-mon[35807]: pgmap v2231: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:19:59 smithi076 ceph-mon[35401]: pgmap v2231: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:19:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:19:59 smithi040 ceph-mon[32397]: pgmap v2231: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:20:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T13:20:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T13:20:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T13:20:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:01 smithi146 ceph-mon[35807]: pgmap v2232: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:20:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:01 smithi076 ceph-mon[35401]: pgmap v2232: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:20:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:01 smithi040 ceph-mon[32397]: pgmap v2232: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:20:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:03 smithi146 ceph-mon[35807]: pgmap v2233: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:20:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:20:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:03 smithi076 ceph-mon[35401]: pgmap v2233: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:20:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:20:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:03 smithi040 ceph-mon[32397]: pgmap v2233: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:20:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:20:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:20:05.229 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.9 2024-07-26T13:20:05.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:20:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:05 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:20:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:05 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:20:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:05 smithi146 ceph-mon[35807]: pgmap v2234: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:20:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:05 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:20:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:05 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:20:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:05 smithi076 ceph-mon[35401]: pgmap v2234: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:20:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:05 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:20:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:05 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:20:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:05 smithi040 ceph-mon[32397]: pgmap v2234: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:20:05.847 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:20:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:07 smithi076 ceph-mon[35401]: pgmap v2235: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:20:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:07 smithi040 ceph-mon[32397]: pgmap v2235: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:20:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:07 smithi146 ceph-mon[35807]: pgmap v2235: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:20:09.711 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:09 smithi040 ceph-mon[32397]: pgmap v2236: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 -- 172.21.15.40:0/3977256876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 msgr2=0x7fbac81037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 --2- 172.21.15.40:0/3977256876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81037f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009900 tx=0x7fbab002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 -- 172.21.15.40:0/3977256876 shutdown_connections 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 --2- 172.21.15.40:0/3977256876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac8109670 0x7fbac810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 --2- 172.21.15.40:0/3977256876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac8108d20 0x7fbac8109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 --2- 172.21.15.40:0/3977256876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81037f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 -- 172.21.15.40:0/3977256876 >> 172.21.15.40:0/3977256876 conn(0x7fbac80fee70 msgr2=0x7fbac81012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 -- 172.21.15.40:0/3977256876 shutdown_connections 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.709+0000 7fbacce00640 1 -- 172.21.15.40:0/3977256876 wait complete. 2024-07-26T13:20:09.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.711+0000 7fbacce00640 1 Processor -- start 2024-07-26T13:20:09.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.711+0000 7fbacce00640 1 -- start start 2024-07-26T13:20:09.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbacce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:09.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbacce00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac8108d20 0x7fbac81a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:09.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbacce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac8109670 0x7fbac81abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:09.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbacce00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbac8113240 con 0x7fbac81033e0 2024-07-26T13:20:09.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbacce00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbac81130c0 con 0x7fbac8108d20 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbacce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbac81133c0 con 0x7fbac8109670 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbac7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbac7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36552/0 (socket says 172.21.15.40:36552) 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.712+0000 7fbac7400640 1 -- 172.21.15.40:0/2046882763 learned_addr learned my addr 172.21.15.40:0/2046882763 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbabea00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac8108d20 0x7fbac81a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbac7e00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac8109670 0x7fbac81abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbac7400640 1 -- 172.21.15.40:0/2046882763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac8109670 msgr2=0x7fbac81abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbac7400640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac8109670 0x7fbac81abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbac7400640 1 -- 172.21.15.40:0/2046882763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac8108d20 msgr2=0x7fbac81a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbac7400640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac8108d20 0x7fbac81a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:09.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.713+0000 7fbac7400640 1 -- 172.21.15.40:0/2046882763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac81ac4e0 con 0x7fbac81033e0 2024-07-26T13:20:09.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.714+0000 7fbac7400640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81a0f20 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fbab002a910 tx=0x7fbab0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:09.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.714+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab003f070 con 0x7fbac81033e0 2024-07-26T13:20:09.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.714+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac81ac6b0 con 0x7fbac81033e0 2024-07-26T13:20:09.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.714+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbab0003e40 con 0x7fbac81033e0 2024-07-26T13:20:09.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.714+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0035030 con 0x7fbac81033e0 2024-07-26T13:20:09.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.715+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac81acb40 con 0x7fbac81033e0 2024-07-26T13:20:09.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.716+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac81037f0 con 0x7fbac81033e0 2024-07-26T13:20:09.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.720+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbab0042070 con 0x7fbac81033e0 2024-07-26T13:20:09.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.722+0000 7fbac4c00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbaac0b3bd0 0x7fbaac0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:09.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.722+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbab0104780 con 0x7fbac81033e0 2024-07-26T13:20:09.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.722+0000 7fbabea00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbaac0b3bd0 0x7fbaac0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:09.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.723+0000 7fbabea00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbaac0b3bd0 0x7fbaac0b60e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbac8105310 tx=0x7fbab8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:09.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.724+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fbab00cb740 con 0x7fbac81033e0 2024-07-26T13:20:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:09 smithi146 ceph-mon[35807]: pgmap v2236: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:20:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:09 smithi076 ceph-mon[35401]: pgmap v2236: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:20:09.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.996+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbac810f640 con 0x7fbac81033e0 2024-07-26T13:20:09.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:09.998+0000 7fbac4c00640 1 -- 172.21.15.40:0/2046882763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fbac810f640 con 0x7fbac81033e0 2024-07-26T13:20:09.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:20:09.999 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:20:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbaac0b3bd0 msgr2=0x7fbaac0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbaac0b3bd0 0x7fbaac0b60e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbac8105310 tx=0x7fbab8009680 comp rx=0 tx=0).stop 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 msgr2=0x7fbac81a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81a0f20 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fbab002a910 tx=0x7fbab0003c20 comp rx=0 tx=0).stop 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 shutdown_connections 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fbaac0b3bd0 0x7fbaac0b60e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac8109670 0x7fbac81abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbac8108d20 0x7fbac81a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 --2- 172.21.15.40:0/2046882763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac81033e0 0x7fbac81a0f20 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.001+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 >> 172.21.15.40:0/2046882763 conn(0x7fbac80fee70 msgr2=0x7fbac8108440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.002+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 shutdown_connections 2024-07-26T13:20:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:10.002+0000 7fbacce00640 1 -- 172.21.15.40:0/2046882763 wait complete. 2024-07-26T13:20:10.631 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:10 smithi040 ceph-mon[32397]: pgmap v2237: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:20:10.631 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:10 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2046882763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:10 smithi146 ceph-mon[35807]: pgmap v2237: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:20:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:10 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2046882763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:10 smithi076 ceph-mon[35401]: pgmap v2237: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:20:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:10 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2046882763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:11.083 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 133.9 --await-for 45.0' 2024-07-26T13:20:11.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 133.9 --await-for 45.0 2024-07-26T13:20:11.636 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:20:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:12 smithi040 ceph-mon[32397]: pgmap v2238: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:20:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:12 smithi146 ceph-mon[35807]: pgmap v2238: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:20:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:12 smithi076 ceph-mon[35401]: pgmap v2238: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.506+0000 7fb99d400640 1 -- 172.21.15.40:0/4188915725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 msgr2=0x7fb99810fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.506+0000 7fb99d400640 1 --2- 172.21.15.40:0/4188915725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99810fb70 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fb988009900 tx=0x7fb98802a410 comp rx=0 tx=0).stop 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 -- 172.21.15.40:0/4188915725 shutdown_connections 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 --2- 172.21.15.40:0/4188915725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99810fb70 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 --2- 172.21.15.40:0/4188915725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb998104b70 0x7fb99810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 --2- 172.21.15.40:0/4188915725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb998104220 0x7fb998104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 -- 172.21.15.40:0/4188915725 >> 172.21.15.40:0/4188915725 conn(0x7fb9980fdd60 msgr2=0x7fb9981001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 -- 172.21.15.40:0/4188915725 shutdown_connections 2024-07-26T13:20:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.507+0000 7fb99d400640 1 -- 172.21.15.40:0/4188915725 wait complete. 2024-07-26T13:20:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.508+0000 7fb99d400640 1 Processor -- start 2024-07-26T13:20:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 -- start start 2024-07-26T13:20:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb998104220 0x7fb998199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb998104b70 0x7fb99819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981131c0 con 0x7fb99810d680 2024-07-26T13:20:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb998113040 con 0x7fb998104220 2024-07-26T13:20:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.509+0000 7fb99d400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb998113340 con 0x7fb998104b70 2024-07-26T13:20:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53362/0 (socket says 172.21.15.40:53362) 2024-07-26T13:20:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 -- 172.21.15.40:0/2033196818 learned_addr learned my addr 172.21.15.40:0/2033196818 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb997400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb998104b70 0x7fb99819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb997e00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb998104220 0x7fb998199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 -- 172.21.15.40:0/2033196818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb998104b70 msgr2=0x7fb99819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb998104b70 0x7fb99819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 -- 172.21.15.40:0/2033196818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb998104220 msgr2=0x7fb998199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb998104220 0x7fb998199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.510+0000 7fb99ca00640 1 -- 172.21.15.40:0/2033196818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99819fba0 con 0x7fb99810d680 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.511+0000 7fb99ca00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99819f470 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb988005ab0 tx=0x7fb9880040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.511+0000 7fb994c00640 1 -- 172.21.15.40:0/2033196818 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98803f030 con 0x7fb99810d680 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.511+0000 7fb994c00640 1 -- 172.21.15.40:0/2033196818 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb988003a80 con 0x7fb99810d680 2024-07-26T13:20:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.511+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99819fe30 con 0x7fb99810d680 2024-07-26T13:20:14.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.511+0000 7fb994c00640 1 -- 172.21.15.40:0/2033196818 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988035070 con 0x7fb99810d680 2024-07-26T13:20:14.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.512+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9981a65f0 con 0x7fb99810d680 2024-07-26T13:20:14.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.516+0000 7fb994c00640 1 -- 172.21.15.40:0/2033196818 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb988042030 con 0x7fb99810d680 2024-07-26T13:20:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.517+0000 7fb994c00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb97c0b3c40 0x7fb97c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.518+0000 7fb994c00640 1 -- 172.21.15.40:0/2033196818 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb988103fe0 con 0x7fb99810d680 2024-07-26T13:20:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.518+0000 7fb997e00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb97c0b3c40 0x7fb97c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.519+0000 7fb997e00640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb97c0b3c40 0x7fb97c0b6150 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb990005fd0 tx=0x7fb990009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:14.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.539+0000 7fb9a57fc740 1 Processor -- start 2024-07-26T13:20:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.539+0000 7fb9a57fc740 1 -- start start 2024-07-26T13:20:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 0x55e4cb636390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb267980 0x55e4cb6368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb26fb60 0x55e4cb636e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e4cb600cf0 con 0x55e4cb290840 2024-07-26T13:20:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e4cb5abb40 con 0x55e4cb26fb60 2024-07-26T13:20:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e4cb59b040 con 0x55e4cb267980 2024-07-26T13:20:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb997e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 0x55e4cb636390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb997e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 0x55e4cb636390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53374/0 (socket says 172.21.15.40:53374) 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.540+0000 7fb997e00640 1 -- 172.21.15.40:0/3383000712 learned_addr learned my addr 172.21.15.40:0/3383000712 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997400640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb267980 0x55e4cb6368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb99ca00640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb26fb60 0x55e4cb636e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997e00640 1 -- 172.21.15.40:0/3383000712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb267980 msgr2=0x55e4cb6368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997e00640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb267980 0x55e4cb6368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997e00640 1 -- 172.21.15.40:0/3383000712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb26fb60 msgr2=0x55e4cb636e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997e00640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb26fb60 0x55e4cb636e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997e00640 1 -- 172.21.15.40:0/3383000712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4cb522af0 con 0x55e4cb290840 2024-07-26T13:20:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb997400640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb267980 0x55e4cb6368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:20:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.541+0000 7fb99ca00640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb26fb60 0x55e4cb636e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:20:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.542+0000 7fb997e00640 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 0x55e4cb636390 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb9900049b0 tx=0x7fb990013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbce49de1971a7c6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.542+0000 7fb98d200640 1 -- 172.21.15.40:0/3383000712 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990023070 con 0x55e4cb290840 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.542+0000 7fb98d200640 1 -- 172.21.15.40:0/3383000712 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb99001fae0 con 0x55e4cb290840 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.542+0000 7fb98d200640 1 -- 172.21.15.40:0/3383000712 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990011960 con 0x55e4cb290840 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.543+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3383000712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 msgr2=0x55e4cb636390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.543+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 0x55e4cb636390 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fb9900049b0 tx=0x7fb990013000 comp rx=0 tx=0).stop 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.543+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3383000712 shutdown_connections 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.543+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb26fb60 0x55e4cb636e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.543+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb267980 0x55e4cb6368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.544+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3383000712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb290840 0x55e4cb636390 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.544+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3383000712 >> 172.21.15.40:0/3383000712 conn(0x55e4cb284990 msgr2=0x55e4cb634280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.544+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3383000712 shutdown_connections 2024-07-26T13:20:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.544+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3383000712 wait complete. 2024-07-26T13:20:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.544+0000 7fb9a57fc740 1 -- start start 2024-07-26T13:20:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 Processor -- start 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb646000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 0x55e4cb6465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb6520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e4cb537500 con 0x55e4cb26fb60 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e4cb59f080 con 0x55e4cb267980 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e4cb3fe7a0 con 0x55e4cb290840 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.545+0000 7fb9a57fc740 10 client.0 _ll_register_callbacks cb 0x55e4cb593bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:20:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 0x55e4cb6465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 0x55e4cb6465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53380/0 (socket says 172.21.15.40:53380) 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 -- 172.21.15.40:0/1476501436 learned_addr learned my addr 172.21.15.40:0/1476501436 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb99ca00640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb6520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997e00640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb646000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 -- 172.21.15.40:0/1476501436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 msgr2=0x55e4cb6520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb6520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 -- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 msgr2=0x55e4cb646000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb646000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb997400640 1 -- 172.21.15.40:0/1476501436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4cb30ab90 con 0x55e4cb26fb60 2024-07-26T13:20:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.546+0000 7fb99ca00640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb6520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.547+0000 7fb997400640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 0x55e4cb6465a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb98000b990 tx=0x7fb98000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a792c2fa8a5bfdf server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.547+0000 7fb985600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.547+0000 7fb985600640 1 -- 172.21.15.40:0/1476501436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98001b440 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.547+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb99001fae0 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.547+0000 7fb985600640 1 -- 172.21.15.40:0/1476501436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb98001b5e0 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb985600640 1 -- 172.21.15.40:0/1476501436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb98001b7e0 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 10 client.17778 fetch_fsmap learned FSMap version 35 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e4cb654ce0 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb985600640 1 -- 172.21.15.40:0/1476501436 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb99001fae0 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb985600640 1 -- 172.21.15.40:0/1476501436 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb980019020 con 0x55e4cb26fb60 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 10 client.17778 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 10 client.17778 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 20 client.17778 populate_metadata read hostname 'smithi040' 2024-07-26T13:20:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb24f1c0 0x55e4cb6582d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 4 client.17778 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:20:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.548+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4cb5ada90 con 0x55e4cb24f1c0 2024-07-26T13:20:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.549+0000 7fb997e00640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb24f1c0 0x55e4cb6582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.551+0000 7fb985600640 10 client.17778 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.551+0000 7fb997e00640 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb24f1c0 0x55e4cb6582d0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33381d018510dec5 server_cookie=8d34ecbbe672febb in_seq=0 out_seq=0 2024-07-26T13:20:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb985600640 1 -- 172.21.15.40:0/1476501436 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4cb5ada90 con 0x55e4cb24f1c0 2024-07-26T13:20:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb985600640 10 client.17778 handle_command_reply: tid=0 2024-07-26T13:20:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 client.17778 shutdown 2024-07-26T13:20:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 msgr2=0x55e4cb6465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 0x55e4cb6465a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb98000b990 tx=0x7fb98000be50 comp rx=0 tx=0).stop 2024-07-26T13:20:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 shutdown_connections 2024-07-26T13:20:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb6520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb24f1c0 0x55e4cb6582d0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb26fb60 0x55e4cb6465a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb985600640 0 client.17778 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1476501436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb646000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.553+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 >> 172.21.15.40:0/1476501436 conn(0x55e4cb284990 msgr2=0x55e4cb632840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.554+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 shutdown_connections 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.554+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1476501436 wait complete. 2024-07-26T13:20:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.554+0000 7fb9a57fc740 20 client.17778 trim_cache size 0 max 16384 2024-07-26T13:20:14.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.575+0000 7fb9a57fc740 1 Processor -- start 2024-07-26T13:20:14.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.575+0000 7fb9a57fc740 1 -- start start 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb6411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb647ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb65da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981ac990 con 0x55e4cb224570 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981ae4d0 con 0x55e4cb267980 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981ad060 con 0x55e4cb290840 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb99ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb65da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb99ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb65da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53390/0 (socket says 172.21.15.40:53390) 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb99ca00640 1 -- 172.21.15.40:0/3681122015 learned_addr learned my addr 172.21.15.40:0/3681122015 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb997e00640 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb6411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.576+0000 7fb997400640 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb647ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb99ca00640 1 -- 172.21.15.40:0/3681122015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 msgr2=0x55e4cb647ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb99ca00640 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb647ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb99ca00640 1 -- 172.21.15.40:0/3681122015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 msgr2=0x55e4cb6411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb99ca00640 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb6411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb99ca00640 1 -- 172.21.15.40:0/3681122015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4cb632f20 con 0x55e4cb224570 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb99ca00640 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb65da90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb9880c8250 tx=0x7fb9880ca750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb9e09e9fadc323 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.577+0000 7fb987e00640 1 -- 172.21.15.40:0/3681122015 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988049040 con 0x55e4cb224570 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.578+0000 7fb987e00640 1 -- 172.21.15.40:0/3681122015 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9880e5070 con 0x55e4cb224570 2024-07-26T13:20:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.578+0000 7fb987e00640 1 -- 172.21.15.40:0/3681122015 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880cb240 con 0x55e4cb224570 2024-07-26T13:20:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3681122015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 msgr2=0x55e4cb65da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb65da90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb9880c8250 tx=0x7fb9880ca750 comp rx=0 tx=0).stop 2024-07-26T13:20:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3681122015 shutdown_connections 2024-07-26T13:20:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb65da90 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb647ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/3681122015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb6411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3681122015 >> 172.21.15.40:0/3681122015 conn(0x55e4cb284990 msgr2=0x55e4cb644880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3681122015 shutdown_connections 2024-07-26T13:20:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.579+0000 7fb9a57fc740 1 -- 172.21.15.40:0/3681122015 wait complete. 2024-07-26T13:20:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.580+0000 7fb9a57fc740 1 -- start start 2024-07-26T13:20:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.580+0000 7fb9a57fc740 1 Processor -- start 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.580+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb6404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.580+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb64e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.580+0000 7fb9a57fc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb64e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981ade00 con 0x55e4cb224570 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981ad730 con 0x55e4cb267980 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb9a57fc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981aa970 con 0x55e4cb290840 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb9a57fc740 10 client.0 _ll_register_callbacks cb 0x7fb980004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:20:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb6404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb6404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53396/0 (socket says 172.21.15.40:53396) 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 -- 172.21.15.40:0/1823697024 learned_addr learned my addr 172.21.15.40:0/1823697024 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997400640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb64e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb99ca00640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb64e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 -- 172.21.15.40:0/1823697024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 msgr2=0x55e4cb64e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb64e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 -- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 msgr2=0x55e4cb64e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb64e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.581+0000 7fb997e00640 1 -- 172.21.15.40:0/1823697024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4cb63d9e0 con 0x55e4cb224570 2024-07-26T13:20:14.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.582+0000 7fb997e00640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb6404e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb990012cb0 tx=0x7fb990011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718d9772477bedc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.582+0000 7fb985600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.582+0000 7fb985600640 1 -- 172.21.15.40:0/1823697024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990023070 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.582+0000 7fb985600640 1 -- 172.21.15.40:0/1823697024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb990004df0 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.582+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9880e5070 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb985600640 1 -- 172.21.15.40:0/1823697024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb99001f450 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb9a57fc740 10 client.17784 fetch_fsmap learned FSMap version 35 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e4cb6c54b0 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb985600640 1 -- 172.21.15.40:0/1823697024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9880e5070 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb985600640 1 -- 172.21.15.40:0/1823697024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb99000f040 con 0x55e4cb224570 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb9a57fc740 10 client.17784 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb9a57fc740 10 client.17784 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb9a57fc740 20 client.17784 populate_metadata read hostname 'smithi040' 2024-07-26T13:20:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.583+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb6c59f0 0x55e4cb6c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.584+0000 7fb9a57fc740 4 client.17784 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.9, "await_for": 45.0}] 2024-07-26T13:20:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.584+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.9, "await_for": 45.0}) -- 0x55e4cb5a9530 con 0x55e4cb6c59f0 2024-07-26T13:20:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.584+0000 7fb997400640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb6c59f0 0x55e4cb6c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.585+0000 7fb997400640 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb6c59f0 0x55e4cb6c7e10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f21c9f90a4ae7a server_cookie=b8842a3777d16500 in_seq=0 out_seq=0 2024-07-26T13:20:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.585+0000 7fb985600640 10 client.17784 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:14.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.851+0000 7fb985600640 1 -- 172.21.15.40:0/1823697024 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55e4cb5a9530 con 0x55e4cb6c59f0 2024-07-26T13:20:14.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.851+0000 7fb985600640 10 client.17784 handle_command_reply: tid=0 2024-07-26T13:20:14.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.851+0000 7fb9a57fc740 1 client.17784 shutdown 2024-07-26T13:20:14.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 msgr2=0x55e4cb6404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb6404e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb990012cb0 tx=0x7fb990011560 comp rx=0 tx=0).stop 2024-07-26T13:20:14.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 shutdown_connections 2024-07-26T13:20:14.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e4cb290840 0x55e4cb64e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e4cb267980 0x55e4cb64e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e4cb6c59f0 0x55e4cb6c7e10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 --2- 172.21.15.40:0/1823697024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e4cb224570 0x55e4cb6404e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 >> 172.21.15.40:0/1823697024 conn(0x55e4cb284990 msgr2=0x55e4cb6472c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.852+0000 7fb985600640 0 client.17784 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.853+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 shutdown_connections 2024-07-26T13:20:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.853+0000 7fb9a57fc740 1 -- 172.21.15.40:0/1823697024 wait complete. 2024-07-26T13:20:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.853+0000 7fb9a57fc740 20 client.17784 trim_cache size 0 max 16384 2024-07-26T13:20:14.855 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:20:14.855 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:20:14.855 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 194, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "d0b241d6": { 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 194, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 133.9, 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:20:14.856 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:14.857 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.854+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb97c0b3c40 msgr2=0x7fb97c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.854+0000 7fb99d400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb97c0b3c40 0x7fb97c0b6150 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb990005fd0 tx=0x7fb990009680 comp rx=0 tx=0).stop 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.854+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 msgr2=0x7fb99819f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.854+0000 7fb99d400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99819f470 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb988005ab0 tx=0x7fb9880040e0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 shutdown_connections 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb99810d680 0x7fb99819f470 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb97c0b3c40 0x7fb97c0b6150 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb998104b70 0x7fb99819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 --2- 172.21.15.40:0/2033196818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb998104220 0x7fb998199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:14.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 >> 172.21.15.40:0/2033196818 conn(0x7fb9980fdd60 msgr2=0x7fb9981071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:14.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 shutdown_connections 2024-07-26T13:20:14.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:14.855+0000 7fb99d400640 1 -- 172.21.15.40:0/2033196818 wait complete. 2024-07-26T13:20:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:14 smithi076 ceph-mon[35401]: pgmap v2239: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:20:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:14 smithi040 ceph-mon[32397]: pgmap v2239: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:20:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:14 smithi146 ceph-mon[35807]: pgmap v2239: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 14 op/s 2024-07-26T13:20:15.760 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd0b241d6', quiesce took 10.5 seconds. Will release after: 3.4000000000000004 2024-07-26T13:20:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:16 smithi040 ceph-mon[32397]: pgmap v2240: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:16 smithi146 ceph-mon[35807]: pgmap v2240: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:16 smithi076 ceph-mon[35401]: pgmap v2240: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:19.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:20:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:18 smithi040 ceph-mon[32397]: pgmap v2241: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:18 smithi146 ceph-mon[35807]: pgmap v2241: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:18 smithi076 ceph-mon[35401]: pgmap v2241: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:19.694 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:20:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:20 smithi040 ceph-mon[32397]: pgmap v2242: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:20:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:20 smithi146 ceph-mon[35807]: pgmap v2242: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:20:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:20 smithi076 ceph-mon[35401]: pgmap v2242: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:20:22.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.138+0000 7f3e9f000640 1 -- 172.21.15.40:0/2398955549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98101e10 msgr2=0x7f3e98102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:22.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.138+0000 7f3e9f000640 1 --2- 172.21.15.40:0/2398955549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98101e10 0x7f3e98102220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009ca0 tx=0x7f3e8802a950 comp rx=0 tx=0).stop 2024-07-26T13:20:22.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.138+0000 7f3e9f000640 1 -- 172.21.15.40:0/2398955549 shutdown_connections 2024-07-26T13:20:22.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.138+0000 7f3e9f000640 1 --2- 172.21.15.40:0/2398955549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9810f9c0 0x7f3e98111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.138+0000 7f3e9f000640 1 --2- 172.21.15.40:0/2398955549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e98102760 0x7f3e9810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.138+0000 7f3e9f000640 1 --2- 172.21.15.40:0/2398955549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98101e10 0x7f3e98102220 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.139+0000 7f3e9f000640 1 -- 172.21.15.40:0/2398955549 >> 172.21.15.40:0/2398955549 conn(0x7f3e980fdcf0 msgr2=0x7f3e98100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:22.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.139+0000 7f3e9f000640 1 -- 172.21.15.40:0/2398955549 shutdown_connections 2024-07-26T13:20:22.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.139+0000 7f3e9f000640 1 -- 172.21.15.40:0/2398955549 wait complete. 2024-07-26T13:20:22.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.140+0000 7f3e9f000640 1 Processor -- start 2024-07-26T13:20:22.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.140+0000 7f3e9f000640 1 -- start start 2024-07-26T13:20:22.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.140+0000 7f3e9f000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e98101e10 0x7f3e9819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:22.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.140+0000 7f3e9f000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 0x7f3e9819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:22.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.140+0000 7f3e9f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9810f9c0 0x7f3e981a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:22.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9f000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98115390 con 0x7f3e98102760 2024-07-26T13:20:22.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9f000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98115210 con 0x7f3e98101e10 2024-07-26T13:20:22.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98115510 con 0x7f3e9810f9c0 2024-07-26T13:20:22.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 0x7f3e9819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:22.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 0x7f3e9819c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53406/0 (socket says 172.21.15.40:53406) 2024-07-26T13:20:22.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 -- 172.21.15.40:0/476847204 learned_addr learned my addr 172.21.15.40:0/476847204 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:22.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9e600640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9810f9c0 0x7f3e981a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:22.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9dc00640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e98101e10 0x7f3e9819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:22.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 -- 172.21.15.40:0/476847204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9810f9c0 msgr2=0x7f3e981a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:22.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9810f9c0 0x7f3e981a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 -- 172.21.15.40:0/476847204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e98101e10 msgr2=0x7f3e9819be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:22.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e98101e10 0x7f3e9819be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.141+0000 7f3e9d200640 1 -- 172.21.15.40:0/476847204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e981a1cb0 con 0x7f3e98102760 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.142+0000 7f3e9d200640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 0x7f3e9819c3a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c920 tx=0x7f3e8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.142+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84007c70 con 0x7f3e98102760 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.142+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e981a1fa0 con 0x7f3e98102760 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.142+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e84007e10 con 0x7f3e98102760 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.142+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840186f0 con 0x7f3e98102760 2024-07-26T13:20:22.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.142+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e981a87c0 con 0x7f3e98102760 2024-07-26T13:20:22.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.144+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e98102220 con 0x7f3e98102760 2024-07-26T13:20:22.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.146+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3e8400f450 con 0x7f3e98102760 2024-07-26T13:20:22.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.148+0000 7f3e96000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e7c0b3c80 0x7f3e7c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:22.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.148+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3e840e4050 con 0x7f3e98102760 2024-07-26T13:20:22.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.148+0000 7f3e9dc00640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e7c0b3c80 0x7f3e7c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:22.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.149+0000 7f3e9dc00640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e7c0b3c80 0x7f3e7c0b6190 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3e88005e30 tx=0x7f3e88005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:22.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.150+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3e84014030 con 0x7f3e98102760 2024-07-26T13:20:22.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.389+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e9819cf30 con 0x7f3e98102760 2024-07-26T13:20:22.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.391+0000 7f3e96000640 1 -- 172.21.15.40:0/476847204 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f3e840ab770 con 0x7f3e98102760 2024-07-26T13:20:22.393 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:20:22.393 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:20:22.394 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e7c0b3c80 msgr2=0x7f3e7c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e7c0b3c80 0x7f3e7c0b6190 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3e88005e30 tx=0x7f3e88005d80 comp rx=0 tx=0).stop 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 msgr2=0x7f3e9819c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 0x7f3e9819c3a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c920 tx=0x7f3e8400cde0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 shutdown_connections 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3e7c0b3c80 0x7f3e7c0b6190 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9810f9c0 0x7f3e981a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e98102760 0x7f3e9819c3a0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 --2- 172.21.15.40:0/476847204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3e98101e10 0x7f3e9819be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.395+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 >> 172.21.15.40:0/476847204 conn(0x7f3e980fdcf0 msgr2=0x7f3e98111b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:22.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.396+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 shutdown_connections 2024-07-26T13:20:22.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:22.396+0000 7f3e9f000640 1 -- 172.21.15.40:0/476847204 wait complete. 2024-07-26T13:20:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:22 smithi040 ceph-mon[32397]: pgmap v2243: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 MiB/s wr, 10 op/s 2024-07-26T13:20:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:22 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/476847204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:22 smithi146 ceph-mon[35807]: pgmap v2243: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 MiB/s wr, 10 op/s 2024-07-26T13:20:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:22 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/476847204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:23.332 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id d0b241d6 --release --await' 2024-07-26T13:20:23.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id d0b241d6 --release --await 2024-07-26T13:20:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:22 smithi076 ceph-mon[35401]: pgmap v2243: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 MiB/s wr, 10 op/s 2024-07-26T13:20:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:22 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/476847204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:23.812 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:20:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:24 smithi040 ceph-mon[32397]: pgmap v2244: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T13:20:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:24 smithi146 ceph-mon[35807]: pgmap v2244: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T13:20:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:24 smithi076 ceph-mon[35401]: pgmap v2244: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.5 MiB/s wr, 13 op/s 2024-07-26T13:20:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 -- 172.21.15.40:0/837984300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939410af10 msgr2=0x7f939410b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 --2- 172.21.15.40:0/837984300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939410af10 0x7f939410b320 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9380009900 tx=0x7f938002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 -- 172.21.15.40:0/837984300 shutdown_connections 2024-07-26T13:20:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 --2- 172.21.15.40:0/837984300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f939410b860 0x7f9394112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 --2- 172.21.15.40:0/837984300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939410af10 0x7f939410b320 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 --2- 172.21.15.40:0/837984300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f93941055d0 0x7f93941059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 -- 172.21.15.40:0/837984300 >> 172.21.15.40:0/837984300 conn(0x7f9394101040 msgr2=0x7f9394103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 -- 172.21.15.40:0/837984300 shutdown_connections 2024-07-26T13:20:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.231+0000 7f9393e00640 1 -- 172.21.15.40:0/837984300 wait complete. 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 Processor -- start 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 -- start start 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 0x7f939419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f939410af10 0x7f939419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f939410b860 0x7f93941a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9394115380 con 0x7f93941055d0 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9394115200 con 0x7f939410b860 2024-07-26T13:20:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.233+0000 7f9393e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9394115500 con 0x7f939410af10 2024-07-26T13:20:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 0x7f939419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 0x7f939419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38944/0 (socket says 172.21.15.40:38944) 2024-07-26T13:20:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 -- 172.21.15.40:0/3814789469 learned_addr learned my addr 172.21.15.40:0/3814789469 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392000640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f939410af10 0x7f939419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9393400640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f939410b860 0x7f93941a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 -- 172.21.15.40:0/3814789469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f939410af10 msgr2=0x7f939419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f939410af10 0x7f939419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 -- 172.21.15.40:0/3814789469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f939410b860 msgr2=0x7f93941a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f939410b860 0x7f93941a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.234+0000 7f9392a00640 1 -- 172.21.15.40:0/3814789469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93941a1d20 con 0x7f93941055d0 2024-07-26T13:20:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.235+0000 7f9392a00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 0x7f939419be70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f938400d950 tx=0x7f938400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.235+0000 7f9398a00640 1 -- 172.21.15.40:0/3814789469 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384017070 con 0x7f93941055d0 2024-07-26T13:20:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.235+0000 7f9398a00640 1 -- 172.21.15.40:0/3814789469 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9384009c30 con 0x7f93941055d0 2024-07-26T13:20:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.235+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93941a2010 con 0x7f93941055d0 2024-07-26T13:20:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.235+0000 7f9398a00640 1 -- 172.21.15.40:0/3814789469 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938400f620 con 0x7f93941055d0 2024-07-26T13:20:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.235+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93941a8830 con 0x7f93941055d0 2024-07-26T13:20:26.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 Processor -- start 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 -- start start 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f9398a00640 1 -- 172.21.15.40:0/3814789469 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9384010460 con 0x7f93941055d0 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f18c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c412e8ef50 con 0x55c412b4a660 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c412e7e450 con 0x55c412b52840 2024-07-26T13:20:26.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.239+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c412e82490 con 0x55c412b73520 2024-07-26T13:20:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f186e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38956/0 (socket says 172.21.15.40:38956) 2024-07-26T13:20:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 -- 172.21.15.40:0/4005083785 learned_addr learned my addr 172.21.15.40:0/4005083785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9393400640 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392000640 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f18c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 -- 172.21.15.40:0/4005083785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 msgr2=0x55c412f181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 -- 172.21.15.40:0/4005083785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 msgr2=0x55c412f18c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f18c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.240+0000 7f9392a00640 1 -- 172.21.15.40:0/4005083785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412bdeb00 con 0x55c412b4a660 2024-07-26T13:20:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.241+0000 7f9392a00640 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f186e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f93840e9a90 tx=0x7f93840e9f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78858e942e92f84c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.241+0000 7f937fe00640 1 -- 172.21.15.40:0/4005083785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840f2070 con 0x55c412b4a660 2024-07-26T13:20:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.241+0000 7f9398a00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f93780b3c00 0x7f93780b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.241+0000 7f937fe00640 1 -- 172.21.15.40:0/4005083785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93840a6aa0 con 0x55c412b4a660 2024-07-26T13:20:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.241+0000 7f937fe00640 1 -- 172.21.15.40:0/4005083785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840a6180 con 0x55c412b4a660 2024-07-26T13:20:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.242+0000 7f9393400640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f93780b3c00 0x7f93780b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.242+0000 7f9398a00640 1 -- 172.21.15.40:0/3814789469 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f93840e3900 con 0x7f93941055d0 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.242+0000 7f93a0aa4740 1 -- 172.21.15.40:0/4005083785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 msgr2=0x55c412f186e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.242+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f186e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f93840e9a90 tx=0x7f93840e9f50 comp rx=0 tx=0).stop 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f9393400640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f93780b3c00 0x7f93780b6110 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f938c007ed0 tx=0x7f938c007680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 -- 172.21.15.40:0/4005083785 shutdown_connections 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f18c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f186e0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/4005083785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 -- 172.21.15.40:0/4005083785 >> 172.21.15.40:0/4005083785 conn(0x55c412b67910 msgr2=0x55c412f16090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 -- 172.21.15.40:0/4005083785 shutdown_connections 2024-07-26T13:20:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 -- 172.21.15.40:0/4005083785 wait complete. 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.243+0000 7f93a0aa4740 1 -- start start 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 Processor -- start 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f23ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c412ce1bb0 con 0x55c412b4a660 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c412e1a930 con 0x55c412b52840 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c412f26980 con 0x55c412b73520 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.244+0000 7f93a0aa4740 10 client.0 _ll_register_callbacks cb 0x55c412b8ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:20:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f23760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38970/0 (socket says 172.21.15.40:38970) 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 -- 172.21.15.40:0/964109261 learned_addr learned my addr 172.21.15.40:0/964109261 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392000640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f23ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9393400640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 -- 172.21.15.40:0/964109261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 msgr2=0x55c412f241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 -- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 msgr2=0x55c412f23ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f23ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.245+0000 7f9392a00640 1 -- 172.21.15.40:0/964109261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c412c55960 con 0x55c412b4a660 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f9392a00640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f23760 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f93840aa9d0 tx=0x7f93840097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b1a768d60681f4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f937cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f937cc00640 1 -- 172.21.15.40:0/964109261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840a9a70 con 0x55c412b4a660 2024-07-26T13:20:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f937cc00640 1 -- 172.21.15.40:0/964109261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f93840a6e00 con 0x55c412b4a660 2024-07-26T13:20:26.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93840a6aa0 con 0x55c412b4a660 2024-07-26T13:20:26.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f937cc00640 1 -- 172.21.15.40:0/964109261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f93840a9da0 con 0x55c412b4a660 2024-07-26T13:20:26.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f93a0aa4740 10 client.17802 fetch_fsmap learned FSMap version 35 2024-07-26T13:20:26.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.246+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c412f325c0 con 0x55c412b4a660 2024-07-26T13:20:26.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f937cc00640 1 -- 172.21.15.40:0/964109261 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93840a6aa0 con 0x55c412b4a660 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f937cc00640 1 -- 172.21.15.40:0/964109261 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f93840ebc70 con 0x55c412b4a660 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f93a0aa4740 10 client.17802 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f93a0aa4740 10 client.17802 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f93a0aa4740 20 client.17802 populate_metadata read hostname 'smithi040' 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b31ea0 0x55c412f35920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f93a0aa4740 4 client.17802 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.247+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c412e90ea0 con 0x55c412b31ea0 2024-07-26T13:20:26.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.248+0000 7f9392000640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b31ea0 0x55c412f35920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.249+0000 7f9392000640 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b31ea0 0x55c412f35920 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a568dd9c79ca038 server_cookie=5c2c3bc5477db8 in_seq=0 out_seq=0 2024-07-26T13:20:26.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.249+0000 7f937cc00640 10 client.17802 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f937cc00640 1 -- 172.21.15.40:0/964109261 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c412e90ea0 con 0x55c412b31ea0 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f937cc00640 10 client.17802 handle_command_reply: tid=0 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 client.17802 shutdown 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 msgr2=0x55c412f23760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f23760 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f93840aa9d0 tx=0x7f93840097b0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 shutdown_connections 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b73520 0x55c412f241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b52840 0x55c412f23ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b31ea0 0x55c412f35920 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f937cc00640 0 client.17802 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/964109261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b4a660 0x55c412f23760 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 >> 172.21.15.40:0/964109261 conn(0x55c412b67910 msgr2=0x55c412f1b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:26.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 shutdown_connections 2024-07-26T13:20:26.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.251+0000 7f93a0aa4740 1 -- 172.21.15.40:0/964109261 wait complete. 2024-07-26T13:20:26.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.252+0000 7f93a0aa4740 20 client.17802 trim_cache size 0 max 16384 2024-07-26T13:20:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 Processor -- start 2024-07-26T13:20:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 -- start start 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f25640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f1eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f15640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f93941b0d40 con 0x55c412b31ea0 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f93941b2880 con 0x55c412b4a660 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.271+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f93941b1410 con 0x55c412b52840 2024-07-26T13:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f25640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f25640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38986/0 (socket says 172.21.15.40:38986) 2024-07-26T13:20:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 -- 172.21.15.40:0/977192142 learned_addr learned my addr 172.21.15.40:0/977192142 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392000640 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f1eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9393400640 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f15640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 -- 172.21.15.40:0/977192142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 msgr2=0x55c412f15640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f15640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 -- 172.21.15.40:0/977192142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 msgr2=0x55c412f1eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f1eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392a00640 1 -- 172.21.15.40:0/977192142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412f1a490 con 0x55c412b31ea0 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.272+0000 7f9392000640 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f1eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.273+0000 7f9392a00640 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f25640 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f93840aa510 tx=0x7f93840e9f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8193d34a1d5afa server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.273+0000 7f937f400640 1 -- 172.21.15.40:0/977192142 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384020070 con 0x55c412b31ea0 2024-07-26T13:20:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.273+0000 7f937f400640 1 -- 172.21.15.40:0/977192142 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93840c4020 con 0x55c412b31ea0 2024-07-26T13:20:26.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.273+0000 7f937f400640 1 -- 172.21.15.40:0/977192142 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840f2070 con 0x55c412b31ea0 2024-07-26T13:20:26.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 -- 172.21.15.40:0/977192142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 msgr2=0x55c412f25640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f25640 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f93840aa510 tx=0x7f93840e9f50 comp rx=0 tx=0).stop 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 -- 172.21.15.40:0/977192142 shutdown_connections 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f15640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f1eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/977192142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f25640 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 -- 172.21.15.40:0/977192142 >> 172.21.15.40:0/977192142 conn(0x55c412b67910 msgr2=0x55c412f1e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 -- 172.21.15.40:0/977192142 shutdown_connections 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.274+0000 7f93a0aa4740 1 -- 172.21.15.40:0/977192142 wait complete. 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.275+0000 7f93a0aa4740 1 -- start start 2024-07-26T13:20:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.275+0000 7f93a0aa4740 1 Processor -- start 2024-07-26T13:20:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f36f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f93941b21b0 con 0x55c412b31ea0 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f93941b1ae0 con 0x55c412b4a660 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f93941aed00 con 0x55c412b52840 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f93a0aa4740 10 client.0 _ll_register_callbacks cb 0x7f938c007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f36f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f9392a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f36f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38996/0 (socket says 172.21.15.40:38996) 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f9392a00640 1 -- 172.21.15.40:0/2223823893 learned_addr learned my addr 172.21.15.40:0/2223823893 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:26.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f9392000640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.276+0000 7f9392a00640 1 -- 172.21.15.40:0/2223823893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 msgr2=0x55c412f9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9393400640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9392a00640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f9ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9392a00640 1 -- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 msgr2=0x55c412f374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:20:26.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9392a00640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9392a00640 1 -- 172.21.15.40:0/2223823893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c412f9d3b0 con 0x55c412b31ea0 2024-07-26T13:20:26.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9393400640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:20:26.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f9392a00640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f36f70 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f93840058c0 tx=0x7f93840097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e530c71c361564e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:26.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.277+0000 7f937cc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:20:26.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f937cc00640 1 -- 172.21.15.40:0/2223823893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384020070 con 0x55c412b31ea0 2024-07-26T13:20:26.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f937cc00640 1 -- 172.21.15.40:0/2223823893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f93840a6e00 con 0x55c412b31ea0 2024-07-26T13:20:26.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93840c4020 con 0x55c412b31ea0 2024-07-26T13:20:26.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f937cc00640 1 -- 172.21.15.40:0/2223823893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f93840f2070 con 0x55c412b31ea0 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f93a0aa4740 10 client.17808 fetch_fsmap learned FSMap version 35 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c412f9d3b0 con 0x55c412b31ea0 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.278+0000 7f937cc00640 1 -- 172.21.15.40:0/2223823893 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93840c4020 con 0x55c412b31ea0 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f937cc00640 1 -- 172.21.15.40:0/2223823893 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f93840a6aa0 con 0x55c412b31ea0 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f93a0aa4740 10 client.17808 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f93a0aa4740 10 client.17808 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f93a0aa4740 20 client.17808 populate_metadata read hostname 'smithi040' 2024-07-26T13:20:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b73520 0x55c412fa09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:26.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f93a0aa4740 4 client.17808 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d0b241d6", "release": true, "await": true}] 2024-07-26T13:20:26.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.279+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d0b241d6", "release": true, "await": true}) -- 0x55c412e8c940 con 0x55c412b73520 2024-07-26T13:20:26.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.280+0000 7f9392000640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b73520 0x55c412fa09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:26.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.280+0000 7f9392000640 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b73520 0x55c412fa09f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac1cf8ee93f9d37 server_cookie=db0374461382df60 in_seq=0 out_seq=0 2024-07-26T13:20:26.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.280+0000 7f937cc00640 10 client.17808 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:26.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.328+0000 7f937cc00640 1 -- 172.21.15.40:0/2223823893 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55c412e8c940 con 0x55c412b73520 2024-07-26T13:20:26.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.328+0000 7f937cc00640 10 client.17808 handle_command_reply: tid=0 2024-07-26T13:20:26.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.328+0000 7f93a0aa4740 1 client.17808 shutdown 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.328+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 msgr2=0x55c412f36f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.328+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f36f70 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f93840058c0 tx=0x7f93840097b0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 shutdown_connections 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c412b52840 0x55c412f9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c412b4a660 0x55c412f374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c412b73520 0x55c412fa09f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 --2- 172.21.15.40:0/2223823893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c412b31ea0 0x55c412f36f70 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f937cc00640 0 client.17808 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 >> 172.21.15.40:0/2223823893 conn(0x55c412b67910 msgr2=0x55c412f253a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 shutdown_connections 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 1 -- 172.21.15.40:0/2223823893 wait complete. 2024-07-26T13:20:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.329+0000 7f93a0aa4740 20 client.17808 trim_cache size 0 max 16384 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 196, 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "d0b241d6": { 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 196, 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:20:26.332 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 133.9, 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:20:26.333 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:20:26.334 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:20:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.331+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f93780b3c00 msgr2=0x7f93780b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.331+0000 7f9393e00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f93780b3c00 0x7f93780b6110 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f938c007ed0 tx=0x7f938c007680 comp rx=0 tx=0).stop 2024-07-26T13:20:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.331+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 msgr2=0x7f939419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.331+0000 7f9393e00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 0x7f939419be70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f938400d950 tx=0x7f938400de10 comp rx=0 tx=0).stop 2024-07-26T13:20:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 shutdown_connections 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f939410b860 0x7f93941a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f93780b3c00 0x7f93780b6110 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f939410af10 0x7f939419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 --2- 172.21.15.40:0/3814789469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93941055d0 0x7f939419be70 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 >> 172.21.15.40:0/3814789469 conn(0x7f9394101040 msgr2=0x7f9394103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 shutdown_connections 2024-07-26T13:20:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:26.332+0000 7f9393e00640 1 -- 172.21.15.40:0/3814789469 wait complete. 2024-07-26T13:20:27.211 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:26 smithi040 ceph-mon[32397]: pgmap v2245: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-07-26T13:20:27.266 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd0b241d6', total seconds elapsed: 22.0 2024-07-26T13:20:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:26 smithi146 ceph-mon[35807]: pgmap v2245: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-07-26T13:20:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:26 smithi076 ceph-mon[35401]: pgmap v2245: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 MiB/s wr, 11 op/s 2024-07-26T13:20:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:28 smithi040 ceph-mon[32397]: pgmap v2246: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:20:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:28 smithi146 ceph-mon[35807]: pgmap v2246: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:20:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:28 smithi076 ceph-mon[35401]: pgmap v2246: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:20:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:30 smithi040 ceph-mon[32397]: pgmap v2247: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 562 KiB/s wr, 11 op/s 2024-07-26T13:20:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:30 smithi146 ceph-mon[35807]: pgmap v2247: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 562 KiB/s wr, 11 op/s 2024-07-26T13:20:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:30 smithi076 ceph-mon[35401]: pgmap v2247: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 562 KiB/s wr, 11 op/s 2024-07-26T13:20:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:32 smithi040 ceph-mon[32397]: pgmap v2248: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 KiB/s wr, 8 op/s 2024-07-26T13:20:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:32 smithi146 ceph-mon[35807]: pgmap v2248: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 KiB/s wr, 8 op/s 2024-07-26T13:20:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:32 smithi076 ceph-mon[35401]: pgmap v2248: 97 pgs: 97 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 KiB/s wr, 8 op/s 2024-07-26T13:20:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:34 smithi040 ceph-mon[32397]: pgmap v2249: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:20:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:34 smithi146 ceph-mon[35807]: pgmap v2249: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:20:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:34 smithi076 ceph-mon[35401]: pgmap v2249: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:20:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:36 smithi040 ceph-mon[32397]: pgmap v2250: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T13:20:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:36 smithi146 ceph-mon[35807]: pgmap v2250: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T13:20:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:36 smithi076 ceph-mon[35401]: pgmap v2250: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T13:20:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:38 smithi076 ceph-mon[35401]: pgmap v2251: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T13:20:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:38 smithi146 ceph-mon[35807]: pgmap v2251: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T13:20:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:38 smithi040 ceph-mon[32397]: pgmap v2251: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T13:20:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:40 smithi146 ceph-mon[35807]: pgmap v2252: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-07-26T13:20:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:40 smithi076 ceph-mon[35401]: pgmap v2252: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-07-26T13:20:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:40 smithi040 ceph-mon[32397]: pgmap v2252: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 12 op/s 2024-07-26T13:20:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:42 smithi146 ceph-mon[35807]: pgmap v2253: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.1 MiB/s wr, 10 op/s 2024-07-26T13:20:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:42 smithi076 ceph-mon[35401]: pgmap v2253: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.1 MiB/s wr, 10 op/s 2024-07-26T13:20:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:42 smithi040 ceph-mon[32397]: pgmap v2253: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.1 MiB/s wr, 10 op/s 2024-07-26T13:20:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:45 smithi146 ceph-mon[35807]: pgmap v2254: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:20:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:45 smithi076 ceph-mon[35401]: pgmap v2254: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:20:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:45 smithi040 ceph-mon[32397]: pgmap v2254: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:20:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:47 smithi146 ceph-mon[35807]: pgmap v2255: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:20:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:47 smithi076 ceph-mon[35401]: pgmap v2255: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:20:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:47 smithi040 ceph-mon[32397]: pgmap v2255: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:20:49.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:49 smithi040 ceph-mon[32397]: pgmap v2256: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:20:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:49 smithi146 ceph-mon[35807]: pgmap v2256: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:20:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:49 smithi076 ceph-mon[35401]: pgmap v2256: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:20:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:51 smithi146 ceph-mon[35807]: pgmap v2257: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:20:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:51 smithi076 ceph-mon[35401]: pgmap v2257: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:20:51.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:51 smithi040 ceph-mon[32397]: pgmap v2257: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:20:53.081 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-07-26T13:20:53.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:20:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:53 smithi146 ceph-mon[35807]: pgmap v2258: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:20:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:53 smithi076 ceph-mon[35401]: pgmap v2258: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:20:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:53 smithi040 ceph-mon[32397]: pgmap v2258: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:20:53.647 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:20:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:55 smithi040 ceph-mon[32397]: pgmap v2259: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:55 smithi146 ceph-mon[35807]: pgmap v2259: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:55 smithi076 ceph-mon[35401]: pgmap v2259: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:20:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.807+0000 7f408fe00640 1 -- 172.21.15.40:0/442584588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4090104b40 msgr2=0x7f409010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.807+0000 7f408fe00640 1 --2- 172.21.15.40:0/442584588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4090104b40 0x7f409010d090 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f4078009900 tx=0x7f407802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 -- 172.21.15.40:0/442584588 shutdown_connections 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 --2- 172.21.15.40:0/442584588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f409010d650 0x7f409010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 --2- 172.21.15.40:0/442584588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4090104b40 0x7f409010d090 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 --2- 172.21.15.40:0/442584588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40901041f0 0x7f4090104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 -- 172.21.15.40:0/442584588 >> 172.21.15.40:0/442584588 conn(0x7f40900fdcd0 msgr2=0x7f4090100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 -- 172.21.15.40:0/442584588 shutdown_connections 2024-07-26T13:20:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.808+0000 7f408fe00640 1 -- 172.21.15.40:0/442584588 wait complete. 2024-07-26T13:20:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.809+0000 7f408fe00640 1 Processor -- start 2024-07-26T13:20:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.809+0000 7f408fe00640 1 -- start start 2024-07-26T13:20:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.810+0000 7f408fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40901041f0 0x7f4090199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.810+0000 7f408fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4090104b40 0x7f409019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.810+0000 7f408fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 0x7f409019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.810+0000 7f408fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4090113130 con 0x7f409010d650 2024-07-26T13:20:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.810+0000 7f408fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4090112fb0 con 0x7f4090104b40 2024-07-26T13:20:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.810+0000 7f408fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f40901132b0 con 0x7f40901041f0 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 0x7f409019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 0x7f409019f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35344/0 (socket says 172.21.15.40:35344) 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 -- 172.21.15.40:0/2988066409 learned_addr learned my addr 172.21.15.40:0/2988066409 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408ea00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40901041f0 0x7f4090199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408e000640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4090104b40 0x7f409019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 -- 172.21.15.40:0/2988066409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40901041f0 msgr2=0x7f4090199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40901041f0 0x7f4090199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 -- 172.21.15.40:0/2988066409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4090104b40 msgr2=0x7f409019a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4090104b40 0x7f409019a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.811+0000 7f408f400640 1 -- 172.21.15.40:0/2988066409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409019fb70 con 0x7f409010d650 2024-07-26T13:20:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.812+0000 7f408f400640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 0x7f409019f440 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f408800d750 tx=0x7f408800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.812+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088017070 con 0x7f409010d650 2024-07-26T13:20:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.812+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40880054b0 con 0x7f409010d650 2024-07-26T13:20:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.812+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088004b90 con 0x7f409010d650 2024-07-26T13:20:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.812+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409019fe60 con 0x7f409010d650 2024-07-26T13:20:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.813+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901a65c0 con 0x7f409010d650 2024-07-26T13:20:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.814+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409006ba90 con 0x7f409010d650 2024-07-26T13:20:56.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.819+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4088004d30 con 0x7f409010d650 2024-07-26T13:20:56.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.821+0000 7f4087400640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40740b3bd0 0x7f40740b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:20:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.822+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f40880e39d0 con 0x7f409010d650 2024-07-26T13:20:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.822+0000 7f408ea00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40740b3bd0 0x7f40740b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:20:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.823+0000 7f408ea00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40740b3bd0 0x7f40740b60e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4080005fd0 tx=0x7f4080009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:20:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:56.823+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f40880aa990 con 0x7f409010d650 2024-07-26T13:20:57.077 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:57 smithi040 ceph-mon[32397]: pgmap v2260: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:20:57.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.131+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4090104600 con 0x7f409010d650 2024-07-26T13:20:57.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.133+0000 7f4087400640 1 -- 172.21.15.40:0/2988066409 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f40880aeee0 con 0x7f409010d650 2024-07-26T13:20:57.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:20:57.135 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:20:57.135 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:20:57.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40740b3bd0 msgr2=0x7f40740b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:57.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40740b3bd0 0x7f40740b60e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4080005fd0 tx=0x7f4080009680 comp rx=0 tx=0).stop 2024-07-26T13:20:57.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 msgr2=0x7f409019f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:20:57.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 0x7f409019f440 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f408800d750 tx=0x7f408800dc10 comp rx=0 tx=0).stop 2024-07-26T13:20:57.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 shutdown_connections 2024-07-26T13:20:57.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409010d650 0x7f409019f440 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:57.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4090104b40 0x7f409019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:57.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f40740b3bd0 0x7f40740b60e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:57.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 --2- 172.21.15.40:0/2988066409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40901041f0 0x7f4090199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:20:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.136+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 >> 172.21.15.40:0/2988066409 conn(0x7f40900fdcd0 msgr2=0x7f40900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:20:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.137+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 shutdown_connections 2024-07-26T13:20:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:20:57.137+0000 7f408fe00640 1 -- 172.21.15.40:0/2988066409 wait complete. 2024-07-26T13:20:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:57 smithi146 ceph-mon[35807]: pgmap v2260: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:20:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:57 smithi076 ceph-mon[35401]: pgmap v2260: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:20:58.042 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0' 2024-07-26T13:20:58.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0 2024-07-26T13:20:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:58 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2988066409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:58 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2988066409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:58 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2988066409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:20:58.548 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:20:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:20:59 smithi146 ceph-mon[35807]: pgmap v2261: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:20:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:20:59 smithi076 ceph-mon[35401]: pgmap v2261: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:20:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:20:59 smithi040 ceph-mon[32397]: pgmap v2261: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:21:00.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 -- 172.21.15.40:0/3955932245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c10d8a0 msgr2=0x7f9b4c10fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:00.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3955932245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c10d8a0 0x7f9b4c10fd40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009be0 tx=0x7f9b4402a6c0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 -- 172.21.15.40:0/3955932245 shutdown_connections 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3955932245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c10d8a0 0x7f9b4c10fd40 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3955932245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c104d20 0x7f9b4c10d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3955932245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c1042f0 0x7f9b4c104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 -- 172.21.15.40:0/3955932245 >> 172.21.15.40:0/3955932245 conn(0x7f9b4c079190 msgr2=0x7f9b4c0795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.832+0000 7f9b53c00640 1 -- 172.21.15.40:0/3955932245 shutdown_connections 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.833+0000 7f9b53c00640 1 -- 172.21.15.40:0/3955932245 wait complete. 2024-07-26T13:21:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.834+0000 7f9b53c00640 1 Processor -- start 2024-07-26T13:21:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.834+0000 7f9b53c00640 1 -- start start 2024-07-26T13:21:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b53c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c1042f0 0x7f9b4c19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b53c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 0x7f9b4c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b53c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c10d8a0 0x7f9b4c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b53c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c113360 con 0x7f9b4c104d20 2024-07-26T13:21:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b53c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1131e0 con 0x7f9b4c10d8a0 2024-07-26T13:21:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b53c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1134e0 con 0x7f9b4c1042f0 2024-07-26T13:21:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b4be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 0x7f9b4c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b4be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 0x7f9b4c19c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35354/0 (socket says 172.21.15.40:35354) 2024-07-26T13:21:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.835+0000 7f9b4be00640 1 -- 172.21.15.40:0/3312546857 learned_addr learned my addr 172.21.15.40:0/3312546857 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b51200640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c1042f0 0x7f9b4c19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b51c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c10d8a0 0x7f9b4c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b4be00640 1 -- 172.21.15.40:0/3312546857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c1042f0 msgr2=0x7f9b4c19bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b4be00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c1042f0 0x7f9b4c19bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b4be00640 1 -- 172.21.15.40:0/3312546857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c10d8a0 msgr2=0x7f9b4c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b4be00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c10d8a0 0x7f9b4c1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.836+0000 7f9b4be00640 1 -- 172.21.15.40:0/3312546857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c1a1f40 con 0x7f9b4c104d20 2024-07-26T13:21:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.837+0000 7f9b4be00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 0x7f9b4c19c570 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800e9c0 tx=0x7f9b3800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.837+0000 7f9b49600640 1 -- 172.21.15.40:0/3312546857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800ccc0 con 0x7f9b4c104d20 2024-07-26T13:21:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.837+0000 7f9b49600640 1 -- 172.21.15.40:0/3312546857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b380054b0 con 0x7f9b4c104d20 2024-07-26T13:21:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.837+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c1a2230 con 0x7f9b4c104d20 2024-07-26T13:21:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.837+0000 7f9b49600640 1 -- 172.21.15.40:0/3312546857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38010430 con 0x7f9b4c104d20 2024-07-26T13:21:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.837+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c1a8990 con 0x7f9b4c104d20 2024-07-26T13:21:00.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.842+0000 7f9b49600640 1 -- 172.21.15.40:0/3312546857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9b38004eb0 con 0x7f9b4c104d20 2024-07-26T13:21:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.844+0000 7f9b49600640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9b340b3bd0 0x7f9b340b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.844+0000 7f9b49600640 1 -- 172.21.15.40:0/3312546857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9b380e41f0 con 0x7f9b4c104d20 2024-07-26T13:21:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.844+0000 7f9b51200640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9b340b3bd0 0x7f9b340b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.845+0000 7f9b51200640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9b340b3bd0 0x7f9b340b60e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c06b5d0 tx=0x7f9b40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:00.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 Processor -- start 2024-07-26T13:21:00.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 -- start start 2024-07-26T13:21:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563925104840 0x5639254aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563925474d10 con 0x5639250e3b60 2024-07-26T13:21:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56392541fb60 con 0x5639250db980 2024-07-26T13:21:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.882+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56392540f060 con 0x563925104840 2024-07-26T13:21:00.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.883+0000 7f9b51c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.883+0000 7f9b51c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35356/0 (socket says 172.21.15.40:35356) 2024-07-26T13:21:00.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.883+0000 7f9b51c00640 1 -- 172.21.15.40:0/269317461 learned_addr learned my addr 172.21.15.40:0/269317461 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:00.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.883+0000 7f9b51200640 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563925104840 0x5639254aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.883+0000 7f9b4be00640 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b51c00640 1 -- 172.21.15.40:0/269317461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563925104840 msgr2=0x5639254aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b51c00640 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563925104840 0x5639254aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b51c00640 1 -- 172.21.15.40:0/269317461 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 msgr2=0x5639254aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b51c00640 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b51c00640 1 -- 172.21.15.40:0/269317461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563925396b10 con 0x5639250e3b60 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b4be00640 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:21:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.884+0000 7f9b51c00640 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254aac40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009be0 tx=0x7f9b44009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2dfab548956782f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:00.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.885+0000 7f9b3e000640 1 -- 172.21.15.40:0/269317461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44040030 con 0x5639250e3b60 2024-07-26T13:21:00.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.885+0000 7f9b3e000640 1 -- 172.21.15.40:0/269317461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b44037040 con 0x5639250e3b60 2024-07-26T13:21:00.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.885+0000 7f9b3e000640 1 -- 172.21.15.40:0/269317461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44036070 con 0x5639250e3b60 2024-07-26T13:21:00.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/269317461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 msgr2=0x5639254aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:00.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254aac40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009be0 tx=0x7f9b44009390 comp rx=0 tx=0).stop 2024-07-26T13:21:00.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/269317461 shutdown_connections 2024-07-26T13:21:00.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254aac40 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/269317461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563925104840 0x5639254aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/269317461 >> 172.21.15.40:0/269317461 conn(0x5639250f8990 msgr2=0x5639254a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.886+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/269317461 shutdown_connections 2024-07-26T13:21:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.887+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/269317461 wait complete. 2024-07-26T13:21:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.887+0000 7f9b5a9d1740 1 -- start start 2024-07-26T13:21:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.888+0000 7f9b5a9d1740 1 Processor -- start 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.888+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.888+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250e3b60 0x5639254b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 0x5639254c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5639253ab520 con 0x563925104840 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5639254130a0 con 0x5639250e3b60 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5639252727a0 con 0x5639250db980 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b5a9d1740 10 client.0 _ll_register_callbacks cb 0x563925407bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b51c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 0x5639254c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b51c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 0x5639254c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35370/0 (socket says 172.21.15.40:35370) 2024-07-26T13:21:00.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b51c00640 1 -- 172.21.15.40:0/2049685021 learned_addr learned my addr 172.21.15.40:0/2049685021 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:00.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b4be00640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250e3b60 0x5639254b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.889+0000 7f9b51200640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b51c00640 1 -- 172.21.15.40:0/2049685021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 msgr2=0x5639254b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b51c00640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b51c00640 1 -- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250e3b60 msgr2=0x5639254b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b51c00640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250e3b60 0x5639254b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b51c00640 1 -- 172.21.15.40:0/2049685021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56392517eb90 con 0x563925104840 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b51c00640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 0x5639254c1ae0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9b44005cc0 tx=0x7f9b44009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ae5647e48f45ec server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.890+0000 7f9b32a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.891+0000 7f9b32a00640 1 -- 172.21.15.40:0/2049685021 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44036050 con 0x563925104840 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.891+0000 7f9b32a00640 1 -- 172.21.15.40:0/2049685021 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9b44030860 con 0x563925104840 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.891+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b44037040 con 0x563925104840 2024-07-26T13:21:00.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.891+0000 7f9b32a00640 1 -- 172.21.15.40:0/2049685021 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9b44040040 con 0x563925104840 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.891+0000 7f9b5a9d1740 10 client.17826 fetch_fsmap learned FSMap version 35 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.891+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5639254c4710 con 0x563925104840 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b32a00640 1 -- 172.21.15.40:0/2049685021 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b44037040 con 0x563925104840 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b32a00640 1 -- 172.21.15.40:0/2049685021 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9b44004690 con 0x563925104840 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b5a9d1740 10 client.17826 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b5a9d1740 10 client.17826 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b5a9d1740 20 client.17826 populate_metadata read hostname 'smithi040' 2024-07-26T13:21:00.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5639250c31c0 0x5639254c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b5a9d1740 4 client.17826 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:21:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.892+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563925421ab0 con 0x5639250c31c0 2024-07-26T13:21:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.893+0000 7f9b51200640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5639250c31c0 0x5639254c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.894+0000 7f9b51200640 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5639250c31c0 0x5639254c7a70 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13e510a0f7b98799 server_cookie=c730654157d0e498 in_seq=0 out_seq=0 2024-07-26T13:21:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.894+0000 7f9b32a00640 10 client.17826 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b32a00640 1 -- 172.21.15.40:0/2049685021 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563925421ab0 con 0x5639250c31c0 2024-07-26T13:21:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b32a00640 10 client.17826 handle_command_reply: tid=0 2024-07-26T13:21:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 client.17826 shutdown 2024-07-26T13:21:00.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 msgr2=0x5639254c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:00.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 0x5639254c1ae0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9b44005cc0 tx=0x7f9b44009500 comp rx=0 tx=0).stop 2024-07-26T13:21:00.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 shutdown_connections 2024-07-26T13:21:00.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5639250c31c0 0x5639254c7a70 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563925104840 0x5639254c1ae0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250e3b60 0x5639254b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.897+0000 7f9b32a00640 0 client.17826 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.896+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2049685021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.897+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 >> 172.21.15.40:0/2049685021 conn(0x5639250f8990 msgr2=0x5639254ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.897+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 shutdown_connections 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.897+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2049685021 wait complete. 2024-07-26T13:21:00.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.897+0000 7f9b5a9d1740 20 client.17826 trim_cache size 0 max 16384 2024-07-26T13:21:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.920+0000 7f9b5a9d1740 1 Processor -- start 2024-07-26T13:21:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 -- start start 2024-07-26T13:21:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 0x5639254b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250e3b60 0x5639254c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1b0fb0 con 0x5639250c31c0 2024-07-26T13:21:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1b2af0 con 0x5639250db980 2024-07-26T13:21:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1b1680 con 0x5639250e3b60 2024-07-26T13:21:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b51200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 0x5639254b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b51200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 0x5639254b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35380/0 (socket says 172.21.15.40:35380) 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.921+0000 7f9b51200640 1 -- 172.21.15.40:0/2485511575 learned_addr learned my addr 172.21.15.40:0/2485511575 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b4be00640 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b51c00640 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250e3b60 0x5639254c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b51200640 1 -- 172.21.15.40:0/2485511575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250e3b60 msgr2=0x5639254c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b51200640 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250e3b60 0x5639254c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b51200640 1 -- 172.21.15.40:0/2485511575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 msgr2=0x5639254a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b51200640 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b51200640 1 -- 172.21.15.40:0/2485511575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639254a8a20 con 0x5639250c31c0 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.922+0000 7f9b4be00640 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.923+0000 7f9b51200640 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 0x5639254b02e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000e630 tx=0x7f9b40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb6fa2d6eec05f2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.923+0000 7f9b3d600640 1 -- 172.21.15.40:0/2485511575 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40005020 con 0x5639250c31c0 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.923+0000 7f9b3d600640 1 -- 172.21.15.40:0/2485511575 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b400047a0 con 0x5639250c31c0 2024-07-26T13:21:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.923+0000 7f9b3d600640 1 -- 172.21.15.40:0/2485511575 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4001d730 con 0x5639250c31c0 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2485511575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 msgr2=0x5639254b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 0x5639254b02e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000e630 tx=0x7f9b40014000 comp rx=0 tx=0).stop 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2485511575 shutdown_connections 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250e3b60 0x5639254c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250db980 0x5639254a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/2485511575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250c31c0 0x5639254b02e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2485511575 >> 172.21.15.40:0/2485511575 conn(0x5639250f8990 msgr2=0x5639254a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.924+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2485511575 shutdown_connections 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.925+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/2485511575 wait complete. 2024-07-26T13:21:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.925+0000 7f9b5a9d1740 1 -- start start 2024-07-26T13:21:00.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.925+0000 7f9b5a9d1740 1 Processor -- start 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250c31c0 0x5639254caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1b2420 con 0x5639250e3b60 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1b1d50 con 0x5639250c31c0 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1aef70 con 0x5639250db980 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.926+0000 7f9b5a9d1740 10 client.0 _ll_register_callbacks cb 0x7f9b38005660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:21:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35392/0 (socket says 172.21.15.40:35392) 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 -- 172.21.15.40:0/810054632 learned_addr learned my addr 172.21.15.40:0/810054632 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51200640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250c31c0 0x5639254caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b4be00640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 -- 172.21.15.40:0/810054632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 msgr2=0x5639254c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 -- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250c31c0 msgr2=0x5639254caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250c31c0 0x5639254caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51c00640 1 -- 172.21.15.40:0/810054632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639254c8e80 con 0x5639250e3b60 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b51200640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250c31c0 0x5639254caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.927+0000 7f9b4be00640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:21:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b51c00640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254c8940 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000f80 tx=0x7f9b44003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7d3d45d091496f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:00.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b32a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b32a00640 1 -- 172.21.15.40:0/810054632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4405c030 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b32a00640 1 -- 172.21.15.40:0/810054632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9b44002030 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b400047a0 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b32a00640 1 -- 172.21.15.40:0/810054632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9b44036040 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b5a9d1740 10 client.17832 fetch_fsmap learned FSMap version 35 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.928+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56392552fc90 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b32a00640 1 -- 172.21.15.40:0/810054632 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b400047a0 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b32a00640 1 -- 172.21.15.40:0/810054632 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f9b44030860 con 0x5639250e3b60 2024-07-26T13:21:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b5a9d1740 10 client.17832 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b5a9d1740 10 client.17832 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b5a9d1740 20 client.17832 populate_metadata read hostname 'smithi040' 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563925104840 0x563925532450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b5a9d1740 4 client.17832 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}] 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.929+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}) -- 0x56392541d550 con 0x563925104840 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.930+0000 7f9b51200640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563925104840 0x563925532450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.931+0000 7f9b51200640 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563925104840 0x563925532450 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a41c6645f9647a server_cookie=979d00722a9f1fa9 in_seq=0 out_seq=0 2024-07-26T13:21:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:00.931+0000 7f9b32a00640 10 client.17832 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.222+0000 7f9b32a00640 1 -- 172.21.15.40:0/810054632 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x56392541d550 con 0x563925104840 2024-07-26T13:21:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.222+0000 7f9b32a00640 10 client.17832 handle_command_reply: tid=0 2024-07-26T13:21:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.222+0000 7f9b5a9d1740 1 client.17832 shutdown 2024-07-26T13:21:01.224 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:01 smithi040 ceph-mon[32397]: pgmap v2262: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:21:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 msgr2=0x5639254c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254c8940 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000f80 tx=0x7f9b44003970 comp rx=0 tx=0).stop 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 shutdown_connections 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563925104840 0x563925532450 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5639250e3b60 0x5639254c8940 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639250db980 0x5639254c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 --2- 172.21.15.40:0/810054632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5639250c31c0 0x5639254caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 >> 172.21.15.40:0/810054632 conn(0x5639250f8990 msgr2=0x5639254a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.223+0000 7f9b32a00640 0 client.17832 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.224+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 shutdown_connections 2024-07-26T13:21:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.224+0000 7f9b5a9d1740 1 -- 172.21.15.40:0/810054632 wait complete. 2024-07-26T13:21:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.224+0000 7f9b5a9d1740 20 client.17832 trim_cache size 0 max 16384 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 198, 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "d3e35e7f": { 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 198, 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:21:01.227 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 145.2, 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:01.228 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9b340b3bd0 msgr2=0x7f9b340b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9b340b3bd0 0x7f9b340b60e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c06b5d0 tx=0x7f9b40009260 comp rx=0 tx=0).stop 2024-07-26T13:21:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 msgr2=0x7f9b4c19c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 0x7f9b4c19c570 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800e9c0 tx=0x7f9b3800edc0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 shutdown_connections 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b4c10d8a0 0x7f9b4c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b4c104d20 0x7f9b4c19c570 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f9b340b3bd0 0x7f9b340b60e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 --2- 172.21.15.40:0/3312546857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b4c1042f0 0x7f9b4c19bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 >> 172.21.15.40:0/3312546857 conn(0x7f9b4c079190 msgr2=0x7f9b4c0fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.226+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 shutdown_connections 2024-07-26T13:21:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:01.227+0000 7f9b53c00640 1 -- 172.21.15.40:0/3312546857 wait complete. 2024-07-26T13:21:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:01 smithi076 ceph-mon[35401]: pgmap v2262: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:21:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:01 smithi146 ceph-mon[35807]: pgmap v2262: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:21:02.071 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd3e35e7f', quiesce took 9.0 seconds. Will release after: 16.2 2024-07-26T13:21:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:03 smithi076 ceph-mon[35401]: pgmap v2263: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:21:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:03 smithi040 ceph-mon[32397]: pgmap v2263: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:21:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:03 smithi146 ceph-mon[35807]: pgmap v2263: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:21:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:05 smithi040 ceph-mon[32397]: pgmap v2264: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:21:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:05 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:21:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:05 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:05 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:05 smithi146 ceph-mon[35807]: pgmap v2264: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:21:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:05 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:21:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:05 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:05 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:05 smithi076 ceph-mon[35401]: pgmap v2264: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 MiB/s wr, 14 op/s 2024-07-26T13:21:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:05 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:21:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:05 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:05 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:21:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:21:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:21:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:21:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:21:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:21:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:21:07.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:07 smithi146 ceph-mon[35807]: pgmap v2265: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:21:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:07 smithi040 ceph-mon[32397]: pgmap v2265: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:21:07.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:07 smithi076 ceph-mon[35401]: pgmap v2265: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:21:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:09 smithi040 ceph-mon[32397]: pgmap v2266: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-07-26T13:21:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:09 smithi146 ceph-mon[35807]: pgmap v2266: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-07-26T13:21:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:09 smithi076 ceph-mon[35401]: pgmap v2266: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-07-26T13:21:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:11 smithi040 ceph-mon[32397]: pgmap v2267: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-07-26T13:21:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:11 smithi146 ceph-mon[35807]: pgmap v2267: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-07-26T13:21:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:11 smithi076 ceph-mon[35401]: pgmap v2267: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-07-26T13:21:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:13 smithi040 ceph-mon[32397]: pgmap v2268: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-07-26T13:21:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:13 smithi146 ceph-mon[35807]: pgmap v2268: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-07-26T13:21:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:13 smithi076 ceph-mon[35401]: pgmap v2268: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 9 op/s 2024-07-26T13:21:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:15 smithi040 ceph-mon[32397]: pgmap v2269: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:21:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:15 smithi146 ceph-mon[35807]: pgmap v2269: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:21:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:15 smithi076 ceph-mon[35401]: pgmap v2269: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:21:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:17 smithi040 ceph-mon[32397]: pgmap v2270: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 KiB/s wr, 10 op/s 2024-07-26T13:21:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:17 smithi146 ceph-mon[35807]: pgmap v2270: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 KiB/s wr, 10 op/s 2024-07-26T13:21:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:17 smithi076 ceph-mon[35401]: pgmap v2270: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 KiB/s wr, 10 op/s 2024-07-26T13:21:18.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:21:18.757 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:21:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:19 smithi040 ceph-mon[32397]: pgmap v2271: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 512 KiB/s wr, 10 op/s 2024-07-26T13:21:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:19 smithi146 ceph-mon[35807]: pgmap v2271: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 512 KiB/s wr, 10 op/s 2024-07-26T13:21:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:19 smithi076 ceph-mon[35401]: pgmap v2271: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 512 KiB/s wr, 10 op/s 2024-07-26T13:21:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:21 smithi040 ceph-mon[32397]: pgmap v2272: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:21:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:21 smithi146 ceph-mon[35807]: pgmap v2272: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:21:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:21 smithi076 ceph-mon[35401]: pgmap v2272: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:21:22.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.200+0000 7f2d33200640 1 -- 172.21.15.40:0/2270551299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 msgr2=0x7f2d34111d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.200+0000 7f2d33200640 1 --2- 172.21.15.40:0/2270551299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d34111d80 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009900 tx=0x7f2d2c02a410 comp rx=0 tx=0).stop 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.200+0000 7f2d33200640 1 -- 172.21.15.40:0/2270551299 shutdown_connections 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.200+0000 7f2d33200640 1 --2- 172.21.15.40:0/2270551299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d34111d80 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.200+0000 7f2d33200640 1 --2- 172.21.15.40:0/2270551299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d34075b30 0x7f2d3410f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.200+0000 7f2d33200640 1 --2- 172.21.15.40:0/2270551299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d340751e0 0x7f2d340755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.201+0000 7f2d33200640 1 -- 172.21.15.40:0/2270551299 >> 172.21.15.40:0/2270551299 conn(0x7f2d340fee70 msgr2=0x7f2d341012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.201+0000 7f2d33200640 1 -- 172.21.15.40:0/2270551299 shutdown_connections 2024-07-26T13:21:22.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.201+0000 7f2d33200640 1 -- 172.21.15.40:0/2270551299 wait complete. 2024-07-26T13:21:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.202+0000 7f2d33200640 1 Processor -- start 2024-07-26T13:21:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.202+0000 7f2d33200640 1 -- start start 2024-07-26T13:21:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d33200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d340751e0 0x7f2d3419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d33200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d34075b30 0x7f2d3419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d33200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d341a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d33200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34115390 con 0x7f2d3410f940 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d33200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34115210 con 0x7f2d34075b30 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d33200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34115510 con 0x7f2d340751e0 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d341a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d341a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48242/0 (socket says 172.21.15.40:48242) 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 -- 172.21.15.40:0/1089131540 learned_addr learned my addr 172.21.15.40:0/1089131540 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d31400640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d34075b30 0x7f2d3419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d31e00640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d340751e0 0x7f2d3419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:22.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 -- 172.21.15.40:0/1089131540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d340751e0 msgr2=0x7f2d3419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:22.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d340751e0 0x7f2d3419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 -- 172.21.15.40:0/1089131540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d34075b30 msgr2=0x7f2d3419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:22.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d34075b30 0x7f2d3419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.203+0000 7f2d32800640 1 -- 172.21.15.40:0/1089131540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d341a1d50 con 0x7f2d3410f940 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.204+0000 7f2d32800640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d341a1620 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c005ab0 tx=0x7f2d2c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.204+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c03f030 con 0x7f2d3410f940 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.204+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d2c0043d0 con 0x7f2d3410f940 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.204+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c035070 con 0x7f2d3410f940 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.204+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d341a1fe0 con 0x7f2d3410f940 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.204+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d341a87a0 con 0x7f2d3410f940 2024-07-26T13:21:22.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.206+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d340755f0 con 0x7f2d3410f940 2024-07-26T13:21:22.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.208+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2d2c042030 con 0x7f2d3410f940 2024-07-26T13:21:22.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.209+0000 7f2d2aa00640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d180b3c50 0x7f2d180b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:22.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.210+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2d2c1043f0 con 0x7f2d3410f940 2024-07-26T13:21:22.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.210+0000 7f2d31e00640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d180b3c50 0x7f2d180b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:22.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.211+0000 7f2d31e00640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d180b3c50 0x7f2d180b6160 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2d24005fd0 tx=0x7f2d24009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:22.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.212+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2d2c0cba00 con 0x7f2d3410f940 2024-07-26T13:21:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.442+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d341a8970 con 0x7f2d3410f940 2024-07-26T13:21:22.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.444+0000 7f2d2aa00640 1 -- 172.21.15.40:0/1089131540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f2d2c0cb300 con 0x7f2d3410f940 2024-07-26T13:21:22.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:21:22.445 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:21:22.446 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:21:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.447+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d180b3c50 msgr2=0x7f2d180b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.447+0000 7f2d33200640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d180b3c50 0x7f2d180b6160 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2d24005fd0 tx=0x7f2d24009500 comp rx=0 tx=0).stop 2024-07-26T13:21:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.447+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 msgr2=0x7f2d341a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.447+0000 7f2d33200640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d341a1620 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c005ab0 tx=0x7f2d2c005e10 comp rx=0 tx=0).stop 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 shutdown_connections 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d3410f940 0x7f2d341a1620 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2d34075b30 0x7f2d3419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2d180b3c50 0x7f2d180b6160 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 --2- 172.21.15.40:0/1089131540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d340751e0 0x7f2d3419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 >> 172.21.15.40:0/1089131540 conn(0x7f2d340fee70 msgr2=0x7f2d341094e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 shutdown_connections 2024-07-26T13:21:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:22.448+0000 7f2d33200640 1 -- 172.21.15.40:0/1089131540 wait complete. 2024-07-26T13:21:23.206 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id d3e35e7f --release --await' 2024-07-26T13:21:23.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id d3e35e7f --release --await 2024-07-26T13:21:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:23 smithi040 ceph-mon[32397]: pgmap v2273: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-07-26T13:21:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:23 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1089131540' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:21:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:23 smithi146 ceph-mon[35807]: pgmap v2273: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-07-26T13:21:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:23 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1089131540' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:21:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:23 smithi076 ceph-mon[35401]: pgmap v2273: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-07-26T13:21:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:23 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1089131540' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:21:23.704 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:21:25.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:25 smithi040 ceph-mon[32397]: pgmap v2274: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:21:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:25 smithi146 ceph-mon[35807]: pgmap v2274: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:21:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:25 smithi076 ceph-mon[35401]: pgmap v2274: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:21:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3618734172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c410af20 msgr2=0x7fe4c410b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3618734172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c410af20 0x7fe4c410b330 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009900 tx=0x7fe4b002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3618734172 shutdown_connections 2024-07-26T13:21:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3618734172 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 0x7fe4c41120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3618734172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c410af20 0x7fe4c410b330 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3618734172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c41055e0 0x7fe4c41059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3618734172 >> 172.21.15.40:0/3618734172 conn(0x7fe4c41010b0 msgr2=0x7fe4c4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3618734172 shutdown_connections 2024-07-26T13:21:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.021+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3618734172 wait complete. 2024-07-26T13:21:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.022+0000 7fe4c8c00640 1 Processor -- start 2024-07-26T13:21:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.022+0000 7fe4c8c00640 1 -- start start 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 0x7fe4c419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c410af20 0x7fe4c419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 0x7fe4c41a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c8c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41153b0 con 0x7fe4c41055e0 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c8c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4115230 con 0x7fe4c410b870 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c8c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4115530 con 0x7fe4c410af20 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 0x7fe4c419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 0x7fe4c419bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39918/0 (socket says 172.21.15.40:39918) 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.023+0000 7fe4c3400640 1 -- 172.21.15.40:0/3566064631 learned_addr learned my addr 172.21.15.40:0/3566064631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 0x7fe4c41a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c410af20 0x7fe4c419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3400640 1 -- 172.21.15.40:0/3566064631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c410af20 msgr2=0x7fe4c419c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3400640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c410af20 0x7fe4c419c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3400640 1 -- 172.21.15.40:0/3566064631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 msgr2=0x7fe4c41a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3400640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 0x7fe4c41a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3400640 1 -- 172.21.15.40:0/3566064631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c41a1d50 con 0x7fe4c41055e0 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 0x7fe4c41a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c410af20 0x7fe4c419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:21:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.024+0000 7fe4c3400640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 0x7fe4c419bea0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d770 tx=0x7fe4b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.025+0000 7fe4bbe00640 1 -- 172.21.15.40:0/3566064631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4017070 con 0x7fe4c41055e0 2024-07-26T13:21:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.025+0000 7fe4bbe00640 1 -- 172.21.15.40:0/3566064631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4b40054b0 con 0x7fe4c41055e0 2024-07-26T13:21:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.025+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c41a2040 con 0x7fe4c41055e0 2024-07-26T13:21:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.025+0000 7fe4bbe00640 1 -- 172.21.15.40:0/3566064631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4004c60 con 0x7fe4c41055e0 2024-07-26T13:21:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.025+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c41a8860 con 0x7fe4c41055e0 2024-07-26T13:21:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.029+0000 7fe4bbe00640 1 -- 172.21.15.40:0/3566064631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe4b4004e00 con 0x7fe4c41055e0 2024-07-26T13:21:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.030+0000 7fe4bbe00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe4a80b3c80 0x7fe4a80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.030+0000 7fe4bbe00640 1 -- 172.21.15.40:0/3566064631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe4b40e3690 con 0x7fe4c41055e0 2024-07-26T13:21:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.031+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe4a80b3c80 0x7fe4a80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.031+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe4a80b3c80 0x7fe4a80b6190 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0006010 tx=0x7fe4b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 Processor -- start 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 -- start start 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 0x558be9e281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e286e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a62840 0x558be9e28c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558be9d9ef50 con 0x558be9a62840 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558be9d8e450 con 0x558be9a83520 2024-07-26T13:21:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.054+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558be9d92490 con 0x558be9a5a660 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.055+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a62840 0x558be9e28c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.055+0000 7fe4c2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e286e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.055+0000 7fe4c3400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 0x558be9e281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.055+0000 7fe4c3400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 0x558be9e281a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:38186/0 (socket says 172.21.15.40:38186) 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.055+0000 7fe4c3400640 1 -- 172.21.15.40:0/2145328948 learned_addr learned my addr 172.21.15.40:0/2145328948 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2145328948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 msgr2=0x558be9e286e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e286e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2145328948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 msgr2=0x558be9e281a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 0x558be9e281a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2145328948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be9aeeb00 con 0x558be9a62840 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3400640 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 0x558be9e281a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.056+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a62840 0x558be9e28c20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc008da0 tx=0x7fe4bc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344a5f72ac57e788 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.057+0000 7fe4afe00640 1 -- 172.21.15.40:0/2145328948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00f830 con 0x558be9a62840 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.057+0000 7fe4afe00640 1 -- 172.21.15.40:0/2145328948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4bc00de20 con 0x558be9a62840 2024-07-26T13:21:26.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.057+0000 7fe4afe00640 1 -- 172.21.15.40:0/2145328948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc018df0 con 0x558be9a62840 2024-07-26T13:21:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2145328948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a62840 msgr2=0x558be9e28c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a62840 0x558be9e28c20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc008da0 tx=0x7fe4bc00d710 comp rx=0 tx=0).stop 2024-07-26T13:21:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2145328948 shutdown_connections 2024-07-26T13:21:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a62840 0x558be9e28c20 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e286e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2145328948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a83520 0x558be9e281a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2145328948 >> 172.21.15.40:0/2145328948 conn(0x558be9a77910 msgr2=0x558be9e26090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2145328948 shutdown_connections 2024-07-26T13:21:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2145328948 wait complete. 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.058+0000 7fe4d0e69740 1 -- start start 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 Processor -- start 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e33820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e33d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558be9bf1bb0 con 0x558be9a83520 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558be9d2a930 con 0x558be9a5a660 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558be9e36980 con 0x558be9a62840 2024-07-26T13:21:26.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.059+0000 7fe4d0e69740 10 client.0 _ll_register_callbacks cb 0x558be9a9ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39938/0 (socket says 172.21.15.40:39938) 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 -- 172.21.15.40:0/980672120 learned_addr learned my addr 172.21.15.40:0/980672120 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e33d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3400640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e33820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 -- 172.21.15.40:0/980672120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 msgr2=0x558be9e33d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e33d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 -- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 msgr2=0x558be9e33820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e33820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.060+0000 7fe4c3e00640 1 -- 172.21.15.40:0/980672120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be9b65960 con 0x558be9a83520 2024-07-26T13:21:26.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.061+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3fc70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00e010 tx=0x7fe4bc019d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198afef982a7bc79 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:26.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.061+0000 7fe4acc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:21:26.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.061+0000 7fe4acc00640 1 -- 172.21.15.40:0/980672120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc004e50 con 0x558be9a83520 2024-07-26T13:21:26.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.061+0000 7fe4acc00640 1 -- 172.21.15.40:0/980672120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe4bc00f630 con 0x558be9a83520 2024-07-26T13:21:26.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.061+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4bc00de20 con 0x558be9a83520 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.062+0000 7fe4acc00640 1 -- 172.21.15.40:0/980672120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe4bc019ea0 con 0x558be9a83520 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.062+0000 7fe4d0e69740 10 client.17850 fetch_fsmap learned FSMap version 35 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.062+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558be9e42650 con 0x558be9a83520 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.062+0000 7fe4acc00640 1 -- 172.21.15.40:0/980672120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4bc00de20 con 0x558be9a83520 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.062+0000 7fe4acc00640 1 -- 172.21.15.40:0/980672120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe4bc0054d0 con 0x558be9a83520 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4d0e69740 10 client.17850 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4d0e69740 10 client.17850 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:21:26.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4d0e69740 20 client.17850 populate_metadata read hostname 'smithi040' 2024-07-26T13:21:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a41ea0 0x558be9e45ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4d0e69740 4 client.17850 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:21:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558be9da0ea0 con 0x558be9a41ea0 2024-07-26T13:21:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.063+0000 7fe4c3400640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a41ea0 0x558be9e45ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.064+0000 7fe4c3400640 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a41ea0 0x558be9e45ac0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4df71307fa8201 server_cookie=874dfb8d844675bc in_seq=0 out_seq=0 2024-07-26T13:21:26.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.064+0000 7fe4acc00640 10 client.17850 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.066+0000 7fe4acc00640 1 -- 172.21.15.40:0/980672120 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558be9da0ea0 con 0x558be9a41ea0 2024-07-26T13:21:26.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.066+0000 7fe4acc00640 10 client.17850 handle_command_reply: tid=0 2024-07-26T13:21:26.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.066+0000 7fe4d0e69740 1 client.17850 shutdown 2024-07-26T13:21:26.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.066+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 msgr2=0x558be9e3fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3fc70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00e010 tx=0x7fe4bc019d30 comp rx=0 tx=0).stop 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 shutdown_connections 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a41ea0 0x558be9e45ac0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3fc70 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e33d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/980672120 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e33820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 >> 172.21.15.40:0/980672120 conn(0x558be9a77910 msgr2=0x558be9e2b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4acc00640 0 client.17850 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 shutdown_connections 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 1 -- 172.21.15.40:0/980672120 wait complete. 2024-07-26T13:21:26.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.067+0000 7fe4d0e69740 20 client.17850 trim_cache size 0 max 16384 2024-07-26T13:21:26.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.086+0000 7fe4d0e69740 1 Processor -- start 2024-07-26T13:21:26.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.086+0000 7fe4d0e69740 1 -- start start 2024-07-26T13:21:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e2ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e3fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41b0d20 con 0x558be9a83520 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41b2860 con 0x558be9a5a660 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41b13f0 con 0x558be9a62840 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39946/0 (socket says 172.21.15.40:39946) 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4c3e00640 1 -- 172.21.15.40:0/906795765 learned_addr learned my addr 172.21.15.40:0/906795765 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.087+0000 7fe4c3400640 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e2ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e3fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3e00640 1 -- 172.21.15.40:0/906795765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 msgr2=0x558be9e3fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e3fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3e00640 1 -- 172.21.15.40:0/906795765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 msgr2=0x558be9e2ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e2ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3e00640 1 -- 172.21.15.40:0/906795765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be9e26c90 con 0x558be9a83520 2024-07-26T13:21:26.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3400640 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e2ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.088+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3ffa0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00d750 tx=0x7fe4bc019e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692bdd4058e7689f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.089+0000 7fe4af400640 1 -- 172.21.15.40:0/906795765 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc023470 con 0x558be9a83520 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.089+0000 7fe4af400640 1 -- 172.21.15.40:0/906795765 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4bc028070 con 0x558be9a83520 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.089+0000 7fe4af400640 1 -- 172.21.15.40:0/906795765 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc023cd0 con 0x558be9a83520 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 -- 172.21.15.40:0/906795765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 msgr2=0x558be9e3ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3ffa0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00d750 tx=0x7fe4bc019e20 comp rx=0 tx=0).stop 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 -- 172.21.15.40:0/906795765 shutdown_connections 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9e3ffa0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a62840 0x558be9e3fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/906795765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a5a660 0x558be9e2ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 -- 172.21.15.40:0/906795765 >> 172.21.15.40:0/906795765 conn(0x558be9a77910 msgr2=0x558be9e320a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 -- 172.21.15.40:0/906795765 shutdown_connections 2024-07-26T13:21:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.090+0000 7fe4d0e69740 1 -- 172.21.15.40:0/906795765 wait complete. 2024-07-26T13:21:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 -- start start 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 Processor -- start 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e38420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a62840 0x558be9e389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9ea7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41b2190 con 0x558be9a83520 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41b1ac0 con 0x558be9a62840 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41aece0 con 0x558be9a5a660 2024-07-26T13:21:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.091+0000 7fe4d0e69740 10 client.0 _ll_register_callbacks cb 0x7fe4b40a6460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9ea7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9ea7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39948/0 (socket says 172.21.15.40:39948) 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2909942237 learned_addr learned my addr 172.21.15.40:0/2909942237 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a62840 0x558be9e389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3400640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e38420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2909942237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 msgr2=0x558be9e38420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e38420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a62840 msgr2=0x558be9e389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a62840 0x558be9e389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3e00640 1 -- 172.21.15.40:0/2909942237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be9ea77a0 con 0x558be9a83520 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c2a00640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a62840 0x558be9e389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:21:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.092+0000 7fe4c3400640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e38420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.093+0000 7fe4c3e00640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9ea7130 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc005b40 tx=0x7fe4bc008d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb42bf364926f687 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.093+0000 7fe4acc00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.093+0000 7fe4acc00640 1 -- 172.21.15.40:0/2909942237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc047020 con 0x558be9a83520 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.093+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4bc028070 con 0x558be9a83520 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.093+0000 7fe4acc00640 1 -- 172.21.15.40:0/2909942237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe4bc023670 con 0x558be9a83520 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4acc00640 1 -- 172.21.15.40:0/2909942237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe4bc023a10 con 0x558be9a83520 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 10 client.17856 fetch_fsmap learned FSMap version 35 2024-07-26T13:21:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558be9eaeb20 con 0x558be9a83520 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4acc00640 1 -- 172.21.15.40:0/2909942237 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4bc028070 con 0x558be9a83520 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4acc00640 1 -- 172.21.15.40:0/2909942237 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe4bc037070 con 0x558be9a83520 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 10 client.17856 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 10 client.17856 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 20 client.17856 populate_metadata read hostname 'smithi040' 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a17250 0x558be9eb11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:21:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 4 client.17856 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d3e35e7f", "release": true, "await": true}] 2024-07-26T13:21:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.094+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d3e35e7f", "release": true, "await": true}) -- 0x558be9d9c940 con 0x558be9a17250 2024-07-26T13:21:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.095+0000 7fe4c3400640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a17250 0x558be9eb11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:21:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.096+0000 7fe4c3400640 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a17250 0x558be9eb11a0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feb5bcfda04272d4 server_cookie=67456219db431a0b in_seq=0 out_seq=0 2024-07-26T13:21:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.096+0000 7fe4acc00640 10 client.17856 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:26.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.152+0000 7fe4acc00640 1 -- 172.21.15.40:0/2909942237 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x558be9d9c940 con 0x558be9a17250 2024-07-26T13:21:26.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.152+0000 7fe4acc00640 10 client.17856 handle_command_reply: tid=0 2024-07-26T13:21:26.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.152+0000 7fe4d0e69740 1 client.17856 shutdown 2024-07-26T13:21:26.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 msgr2=0x558be9ea7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9ea7130 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc005b40 tx=0x7fe4bc008d60 comp rx=0 tx=0).stop 2024-07-26T13:21:26.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 shutdown_connections 2024-07-26T13:21:26.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x558be9a17250 0x558be9eb11a0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558be9a83520 0x558be9ea7130 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558be9a62840 0x558be9e389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 --2- 172.21.15.40:0/2909942237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558be9a5a660 0x558be9e38420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4acc00640 0 client.17856 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.153+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 >> 172.21.15.40:0/2909942237 conn(0x558be9a77910 msgr2=0x558be9e2eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.154+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 shutdown_connections 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.154+0000 7fe4d0e69740 1 -- 172.21.15.40:0/2909942237 wait complete. 2024-07-26T13:21:26.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.154+0000 7fe4d0e69740 20 client.17856 trim_cache size 0 max 16384 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 200, 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "d3e35e7f": { 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 200, 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:21:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 145.2, 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:26.157 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:21:26.158 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:21:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe4a80b3c80 msgr2=0x7fe4a80b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe4a80b3c80 0x7fe4a80b6190 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0006010 tx=0x7fe4b0000bc0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 msgr2=0x7fe4c419bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:21:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 0x7fe4c419bea0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d770 tx=0x7fe4b400dc30 comp rx=0 tx=0).stop 2024-07-26T13:21:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 shutdown_connections 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c410b870 0x7fe4c41a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe4a80b3c80 0x7fe4a80b6190 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4c410af20 0x7fe4c419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 --2- 172.21.15.40:0/3566064631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c41055e0 0x7fe4c419bea0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.156+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 >> 172.21.15.40:0/3566064631 conn(0x7fe4c41010b0 msgr2=0x7fe4c41034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.157+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 shutdown_connections 2024-07-26T13:21:26.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:21:26.157+0000 7fe4c8c00640 1 -- 172.21.15.40:0/3566064631 wait complete. 2024-07-26T13:21:27.076 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd3e35e7f', total seconds elapsed: 34.0 2024-07-26T13:21:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:27 smithi040 ceph-mon[32397]: pgmap v2275: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:21:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:27 smithi146 ceph-mon[35807]: pgmap v2275: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:21:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:27 smithi076 ceph-mon[35401]: pgmap v2275: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:21:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:29 smithi040 ceph-mon[32397]: pgmap v2276: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:21:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:29 smithi146 ceph-mon[35807]: pgmap v2276: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:21:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:29 smithi076 ceph-mon[35401]: pgmap v2276: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:21:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:31 smithi040 ceph-mon[32397]: pgmap v2277: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T13:21:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:31 smithi146 ceph-mon[35807]: pgmap v2277: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T13:21:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:31 smithi076 ceph-mon[35401]: pgmap v2277: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T13:21:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:33 smithi040 ceph-mon[32397]: pgmap v2278: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:21:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:33 smithi146 ceph-mon[35807]: pgmap v2278: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:21:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:33 smithi076 ceph-mon[35401]: pgmap v2278: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 KiB/s wr, 8 op/s 2024-07-26T13:21:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:35 smithi040 ceph-mon[32397]: pgmap v2279: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:21:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:35 smithi146 ceph-mon[35807]: pgmap v2279: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:21:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:35 smithi076 ceph-mon[35401]: pgmap v2279: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:21:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:37 smithi040 ceph-mon[32397]: pgmap v2280: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-07-26T13:21:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:37 smithi146 ceph-mon[35807]: pgmap v2280: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-07-26T13:21:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:37 smithi076 ceph-mon[35401]: pgmap v2280: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-07-26T13:21:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:39 smithi040 ceph-mon[32397]: pgmap v2281: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:21:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:39 smithi146 ceph-mon[35807]: pgmap v2281: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:21:39.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:39 smithi076 ceph-mon[35401]: pgmap v2281: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 MiB/s wr, 11 op/s 2024-07-26T13:21:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:41 smithi040 ceph-mon[32397]: pgmap v2282: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T13:21:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:41 smithi146 ceph-mon[35807]: pgmap v2282: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T13:21:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:41 smithi076 ceph-mon[35401]: pgmap v2282: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T13:21:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:43 smithi040 ceph-mon[32397]: pgmap v2283: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T13:21:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:43 smithi146 ceph-mon[35807]: pgmap v2283: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T13:21:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:43 smithi076 ceph-mon[35401]: pgmap v2283: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T13:21:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:45 smithi040 ceph-mon[32397]: pgmap v2284: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T13:21:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:45 smithi146 ceph-mon[35807]: pgmap v2284: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T13:21:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:45 smithi076 ceph-mon[35401]: pgmap v2284: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.8 MiB/s wr, 13 op/s 2024-07-26T13:21:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:47 smithi146 ceph-mon[35807]: pgmap v2285: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:21:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:47 smithi076 ceph-mon[35401]: pgmap v2285: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:21:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:47 smithi040 ceph-mon[32397]: pgmap v2285: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:21:49.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:49 smithi040 ceph-mon[32397]: pgmap v2286: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:21:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:49 smithi146 ceph-mon[35807]: pgmap v2286: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:21:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:49 smithi076 ceph-mon[35401]: pgmap v2286: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:21:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:51 smithi146 ceph-mon[35807]: pgmap v2287: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:21:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:51 smithi076 ceph-mon[35401]: pgmap v2287: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:21:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:51 smithi040 ceph-mon[32397]: pgmap v2287: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:21:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:53 smithi146 ceph-mon[35807]: pgmap v2288: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:21:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:53 smithi076 ceph-mon[35401]: pgmap v2288: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:21:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:53 smithi040 ceph-mon[32397]: pgmap v2288: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-07-26T13:21:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:55 smithi146 ceph-mon[35807]: pgmap v2289: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:21:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:55 smithi076 ceph-mon[35401]: pgmap v2289: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:21:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:55 smithi040 ceph-mon[32397]: pgmap v2289: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-07-26T13:21:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:57 smithi146 ceph-mon[35807]: pgmap v2290: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:21:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:57 smithi076 ceph-mon[35401]: pgmap v2290: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:21:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:57 smithi040 ceph-mon[32397]: pgmap v2290: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:21:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:21:59 smithi146 ceph-mon[35807]: pgmap v2291: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:21:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:21:59 smithi076 ceph-mon[35401]: pgmap v2291: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:21:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:21:59 smithi040 ceph-mon[32397]: pgmap v2291: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:22:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:01 smithi146 ceph-mon[35807]: pgmap v2292: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:22:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:01 smithi076 ceph-mon[35401]: pgmap v2292: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:22:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:01 smithi040 ceph-mon[32397]: pgmap v2292: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:22:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:03 smithi146 ceph-mon[35807]: pgmap v2293: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:22:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:03 smithi076 ceph-mon[35401]: pgmap v2293: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:22:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:03 smithi040 ceph-mon[32397]: pgmap v2293: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:22:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:05 smithi146 ceph-mon[35807]: pgmap v2294: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:22:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:05 smithi076 ceph-mon[35401]: pgmap v2294: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:22:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:05 smithi040 ceph-mon[32397]: pgmap v2294: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.3 MiB/s wr, 13 op/s 2024-07-26T13:22:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:07 smithi146 ceph-mon[35807]: pgmap v2295: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:22:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:07 smithi076 ceph-mon[35401]: pgmap v2295: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:07 smithi040 ceph-mon[32397]: pgmap v2295: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:22:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:22:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:08 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:22:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:22:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:08 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:22:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:22:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:08 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:22:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:09 smithi146 ceph-mon[35807]: pgmap v2296: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:22:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:09 smithi076 ceph-mon[35401]: pgmap v2296: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:22:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:09 smithi040 ceph-mon[32397]: pgmap v2296: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:22:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:11 smithi076 ceph-mon[35401]: pgmap v2297: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:22:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:11 smithi040 ceph-mon[32397]: pgmap v2297: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:22:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:11 smithi146 ceph-mon[35807]: pgmap v2297: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:22:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:13 smithi040 ceph-mon[32397]: pgmap v2298: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:22:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:13 smithi146 ceph-mon[35807]: pgmap v2298: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:22:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:13 smithi076 ceph-mon[35401]: pgmap v2298: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-07-26T13:22:13.878 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:22:13.878 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-26T13:22:13.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:22:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:22:15.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:15 smithi040 ceph-mon[32397]: pgmap v2299: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:22:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:15 smithi146 ceph-mon[35807]: pgmap v2299: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:22:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:15 smithi076 ceph-mon[35401]: pgmap v2299: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:22:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 -- 172.21.15.40:0/1120099245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 msgr2=0x7f83d81039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 --2- 172.21.15.40:0/1120099245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d81039a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009900 tx=0x7f83cc02a410 comp rx=0 tx=0).stop 2024-07-26T13:22:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 -- 172.21.15.40:0/1120099245 shutdown_connections 2024-07-26T13:22:17.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 --2- 172.21.15.40:0/1120099245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83d8109820 0x7f83d8110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 --2- 172.21.15.40:0/1120099245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d8108ed0 0x7f83d81092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 --2- 172.21.15.40:0/1120099245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d81039a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 -- 172.21.15.40:0/1120099245 >> 172.21.15.40:0/1120099245 conn(0x7f83d807b280 msgr2=0x7f83d807b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:17.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.406+0000 7f83df800640 1 -- 172.21.15.40:0/1120099245 shutdown_connections 2024-07-26T13:22:17.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.407+0000 7f83df800640 1 -- 172.21.15.40:0/1120099245 wait complete. 2024-07-26T13:22:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.408+0000 7f83df800640 1 Processor -- start 2024-07-26T13:22:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.408+0000 7f83df800640 1 -- start start 2024-07-26T13:22:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.408+0000 7f83df800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d8075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83df800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d8108ed0 0x7f83d8075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83df800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83d8109820 0x7f83d8075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83df800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81133f0 con 0x7f83d8103590 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83df800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8113270 con 0x7f83d8109820 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83df800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8113570 con 0x7f83d8108ed0 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83dce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d8075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83dce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d8075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44398/0 (socket says 172.21.15.40:44398) 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83dce00640 1 -- 172.21.15.40:0/1378303324 learned_addr learned my addr 172.21.15.40:0/1378303324 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83dd800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83d8109820 0x7f83d8075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.409+0000 7f83d7e00640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d8108ed0 0x7f83d8075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.410+0000 7f83dce00640 1 -- 172.21.15.40:0/1378303324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d8108ed0 msgr2=0x7f83d8075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.410+0000 7f83dce00640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d8108ed0 0x7f83d8075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.410+0000 7f83dce00640 1 -- 172.21.15.40:0/1378303324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83d8109820 msgr2=0x7f83d8075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.410+0000 7f83dce00640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83d8109820 0x7f83d8075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.410+0000 7f83dce00640 1 -- 172.21.15.40:0/1378303324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d81a8100 con 0x7f83d8103590 2024-07-26T13:22:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.410+0000 7f83dce00640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d8075140 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f83cc02a930 tx=0x7f83cc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.411+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc03f070 con 0x7f83d8103590 2024-07-26T13:22:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.411+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83cc003e40 con 0x7f83d8103590 2024-07-26T13:22:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.411+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d81a8390 con 0x7f83d8103590 2024-07-26T13:22:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.411+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc035030 con 0x7f83d8103590 2024-07-26T13:22:17.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.411+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d81a8870 con 0x7f83d8103590 2024-07-26T13:22:17.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.412+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d81039a0 con 0x7f83d8103590 2024-07-26T13:22:17.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.416+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f83cc042070 con 0x7f83d8103590 2024-07-26T13:22:17.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.418+0000 7f83d5600640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83c00b3bd0 0x7f83c00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:17.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.419+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f83cc1043f0 con 0x7f83d8103590 2024-07-26T13:22:17.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.419+0000 7f83d7e00640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83c00b3bd0 0x7f83c00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:17.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.420+0000 7f83d7e00640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83c00b3bd0 0x7f83c00b60e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f83d8105fd0 tx=0x7f83c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:17.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.423+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f83cc0cb3b0 con 0x7f83d8103590 2024-07-26T13:22:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:17 smithi040 ceph-mon[32397]: pgmap v2300: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:17.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.735+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83d8076440 con 0x7f83d8103590 2024-07-26T13:22:17.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.736+0000 7f83d5600640 1 -- 172.21.15.40:0/1378303324 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f83cc0cf900 con 0x7f83d8103590 2024-07-26T13:22:17.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:22:17.738 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:22:17.739 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:22:17.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83c00b3bd0 msgr2=0x7f83c00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:17.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83c00b3bd0 0x7f83c00b60e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f83d8105fd0 tx=0x7f83c800b390 comp rx=0 tx=0).stop 2024-07-26T13:22:17.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 msgr2=0x7f83d8075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:17.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d8075140 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f83cc02a930 tx=0x7f83cc003c20 comp rx=0 tx=0).stop 2024-07-26T13:22:17.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 shutdown_connections 2024-07-26T13:22:17.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f83d8109820 0x7f83d8075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f83c00b3bd0 0x7f83c00b60e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d8108ed0 0x7f83d8075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 --2- 172.21.15.40:0/1378303324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8103590 0x7f83d8075140 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:17.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.740+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 >> 172.21.15.40:0/1378303324 conn(0x7f83d807b280 msgr2=0x7f83d8106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:17.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.741+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 shutdown_connections 2024-07-26T13:22:17.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:17.741+0000 7f83df800640 1 -- 172.21.15.40:0/1378303324 wait complete. 2024-07-26T13:22:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:17 smithi146 ceph-mon[35807]: pgmap v2300: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:17 smithi076 ceph-mon[35401]: pgmap v2300: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:18 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1378303324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:18 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1378303324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:18 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1378303324' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:18.945 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-26T13:22:18.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-26T13:22:19.482 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:22:19.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:19 smithi040 ceph-mon[32397]: pgmap v2301: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:22:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:19 smithi146 ceph-mon[35807]: pgmap v2301: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:22:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:19 smithi076 ceph-mon[35401]: pgmap v2301: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:22:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:21 smithi040 ceph-mon[32397]: pgmap v2302: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:22:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:21 smithi146 ceph-mon[35807]: pgmap v2302: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:22:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:21 smithi076 ceph-mon[35401]: pgmap v2302: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:22:21.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 -- 172.21.15.40:0/1839089885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb8109830 msgr2=0x7fddb8110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:21.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 --2- 172.21.15.40:0/1839089885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb8109830 0x7fddb8110060 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009ca0 tx=0x7fddb002a8c0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 -- 172.21.15.40:0/1839089885 shutdown_connections 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 --2- 172.21.15.40:0/1839089885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb8109830 0x7fddb8110060 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 --2- 172.21.15.40:0/1839089885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddb8108ee0 0x7fddb81092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 --2- 172.21.15.40:0/1839089885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb81035a0 0x7fddb81039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 -- 172.21.15.40:0/1839089885 >> 172.21.15.40:0/1839089885 conn(0x7fddb80fefd0 msgr2=0x7fddb8101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 -- 172.21.15.40:0/1839089885 shutdown_connections 2024-07-26T13:22:21.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.847+0000 7fddbd400640 1 -- 172.21.15.40:0/1839089885 wait complete. 2024-07-26T13:22:21.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.850+0000 7fddbd400640 1 Processor -- start 2024-07-26T13:22:21.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.850+0000 7fddbd400640 1 -- start start 2024-07-26T13:22:21.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.851+0000 7fddbd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 0x7fddb8199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.851+0000 7fddbd400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddb8108ee0 0x7fddb819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.851+0000 7fddbd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb8109830 0x7fddb819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.851+0000 7fddbd400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81133e0 con 0x7fddb81035a0 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.851+0000 7fddbd400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fddb8113260 con 0x7fddb8108ee0 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.851+0000 7fddbd400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddb8113560 con 0x7fddb8109830 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.852+0000 7fddb6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 0x7fddb8199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.852+0000 7fddb6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 0x7fddb8199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44414/0 (socket says 172.21.15.40:44414) 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.852+0000 7fddb6800640 1 -- 172.21.15.40:0/758753786 learned_addr learned my addr 172.21.15.40:0/758753786 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.852+0000 7fddafe00640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddb8108ee0 0x7fddb819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.852+0000 7fddb7200640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb8109830 0x7fddb819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb6800640 1 -- 172.21.15.40:0/758753786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb8109830 msgr2=0x7fddb819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb6800640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb8109830 0x7fddb819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb6800640 1 -- 172.21.15.40:0/758753786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddb8108ee0 msgr2=0x7fddb819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb6800640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddb8108ee0 0x7fddb819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb6800640 1 -- 172.21.15.40:0/758753786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb819fd80 con 0x7fddb81035a0 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb7200640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb8109830 0x7fddb819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddb6800640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 0x7fddb8199e10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdda800d950 tx=0x7fdda800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.853+0000 7fddaf400640 1 -- 172.21.15.40:0/758753786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8017070 con 0x7fddb81035a0 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.854+0000 7fddaf400640 1 -- 172.21.15.40:0/758753786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdda8009c30 con 0x7fddb81035a0 2024-07-26T13:22:21.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.854+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb81a0070 con 0x7fddb81035a0 2024-07-26T13:22:21.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.854+0000 7fddaf400640 1 -- 172.21.15.40:0/758753786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda800f620 con 0x7fddb81035a0 2024-07-26T13:22:21.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.854+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb81a67d0 con 0x7fddb81035a0 2024-07-26T13:22:21.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.858+0000 7fddaf400640 1 -- 172.21.15.40:0/758753786 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdda8010460 con 0x7fddb81035a0 2024-07-26T13:22:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.859+0000 7fddaf400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd9c0b3c50 0x7fdd9c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.860+0000 7fddaf400640 1 -- 172.21.15.40:0/758753786 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdda80e37d0 con 0x7fddb81035a0 2024-07-26T13:22:21.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.860+0000 7fddafe00640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd9c0b3c50 0x7fdd9c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.861+0000 7fddafe00640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd9c0b3c50 0x7fdd9c0b6160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fddb8105870 tx=0x7fdda000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:21.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.962+0000 7fddc3fc3740 1 Processor -- start 2024-07-26T13:22:21.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.963+0000 7fddc3fc3740 1 -- start start 2024-07-26T13:22:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.963+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.963+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.963+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39bec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.963+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5588f3988cf0 con 0x5588f35ef980 2024-07-26T13:22:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.963+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5588f3933b40 con 0x5588f3618840 2024-07-26T13:22:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.964+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5588f3923040 con 0x5588f35f7b60 2024-07-26T13:22:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.964+0000 7fddafe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.964+0000 7fddafe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39be6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44426/0 (socket says 172.21.15.40:44426) 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.964+0000 7fddafe00640 1 -- 172.21.15.40:0/2033064615 learned_addr learned my addr 172.21.15.40:0/2033064615 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.964+0000 7fddb6800640 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddb7200640 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddafe00640 1 -- 172.21.15.40:0/2033064615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 msgr2=0x5588f39bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddafe00640 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddafe00640 1 -- 172.21.15.40:0/2033064615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 msgr2=0x5588f39be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddafe00640 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddafe00640 1 -- 172.21.15.40:0/2033064615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f38aaaf0 con 0x5588f35ef980 2024-07-26T13:22:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.965+0000 7fddb7200640 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.966+0000 7fddafe00640 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39be6e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fdda0010f10 tx=0x7fdda0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcf6126e8ae270 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.966+0000 7fdda7400640 1 -- 172.21.15.40:0/2033064615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0005220 con 0x5588f35ef980 2024-07-26T13:22:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.966+0000 7fdda7400640 1 -- 172.21.15.40:0/2033064615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdda0004c30 con 0x5588f35ef980 2024-07-26T13:22:21.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.966+0000 7fdda7400640 1 -- 172.21.15.40:0/2033064615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda001e750 con 0x5588f35ef980 2024-07-26T13:22:21.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 -- 172.21.15.40:0/2033064615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 msgr2=0x5588f39be6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:21.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39be6e0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fdda0010f10 tx=0x7fdda0013000 comp rx=0 tx=0).stop 2024-07-26T13:22:21.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 -- 172.21.15.40:0/2033064615 shutdown_connections 2024-07-26T13:22:21.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39be6e0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/2033064615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.968+0000 7fddc3fc3740 1 -- 172.21.15.40:0/2033064615 >> 172.21.15.40:0/2033064615 conn(0x5588f360c990 msgr2=0x5588f39bc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:21.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.969+0000 7fddc3fc3740 1 -- 172.21.15.40:0/2033064615 shutdown_connections 2024-07-26T13:22:21.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.969+0000 7fddc3fc3740 1 -- 172.21.15.40:0/2033064615 wait complete. 2024-07-26T13:22:21.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.970+0000 7fddc3fc3740 1 -- start start 2024-07-26T13:22:21.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.971+0000 7fddc3fc3740 1 Processor -- start 2024-07-26T13:22:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39d5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5588f38bf500 con 0x5588f35ef980 2024-07-26T13:22:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5588f3927080 con 0x5588f3618840 2024-07-26T13:22:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5588f37867a0 con 0x5588f35f7b60 2024-07-26T13:22:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddc3fc3740 10 client.0 _ll_register_callbacks cb 0x5588f391bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:22:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddb6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.972+0000 7fddb6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44438/0 (socket says 172.21.15.40:44438) 2024-07-26T13:22:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb6800640 1 -- 172.21.15.40:0/907262144 learned_addr learned my addr 172.21.15.40:0/907262144 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddafe00640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb7200640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb6800640 1 -- 172.21.15.40:0/907262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 msgr2=0x5588f39ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb6800640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb6800640 1 -- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 msgr2=0x5588f39d5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb6800640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39d5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb6800640 1 -- 172.21.15.40:0/907262144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f3692b90 con 0x5588f35ef980 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.973+0000 7fddb7200640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39d5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.974+0000 7fddafe00640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.974+0000 7fddb6800640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39c9d70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdda80aa3e0 tx=0x7fdda80aa150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f5b2eb7197a99c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.974+0000 7fdd9be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:22:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.974+0000 7fdd9be00640 1 -- 172.21.15.40:0/907262144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8020040 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.974+0000 7fdd9be00640 1 -- 172.21.15.40:0/907262144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdda80a6cd0 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.974+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda0004c30 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.975+0000 7fdd9be00640 1 -- 172.21.15.40:0/907262144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdda80cd280 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.975+0000 7fddc3fc3740 10 client.17874 fetch_fsmap learned FSMap version 35 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.975+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5588f39d88a0 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.975+0000 7fdd9be00640 1 -- 172.21.15.40:0/907262144 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdda0004c30 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fdd9be00640 1 -- 172.21.15.40:0/907262144 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fdda80cbbe0 con 0x5588f35ef980 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fddc3fc3740 10 client.17874 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fddc3fc3740 10 client.17874 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fddc3fc3740 20 client.17874 populate_metadata read hostname 'smithi040' 2024-07-26T13:22:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35d71c0 0x5588f39dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fddc3fc3740 4 client.17874 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:22:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.976+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588f3935a90 con 0x5588f35d71c0 2024-07-26T13:22:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.977+0000 7fddafe00640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35d71c0 0x5588f39dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.978+0000 7fddafe00640 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35d71c0 0x5588f39dbcc0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb9eeec6f0249e59 server_cookie=17c733f74f2d0616 in_seq=0 out_seq=0 2024-07-26T13:22:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.978+0000 7fdd9be00640 10 client.17874 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.980+0000 7fdd9be00640 1 -- 172.21.15.40:0/907262144 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588f3935a90 con 0x5588f35d71c0 2024-07-26T13:22:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.980+0000 7fdd9be00640 10 client.17874 handle_command_reply: tid=0 2024-07-26T13:22:21.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.980+0000 7fddc3fc3740 1 client.17874 shutdown 2024-07-26T13:22:21.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.980+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 msgr2=0x5588f39c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.980+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39c9d70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fdda80aa3e0 tx=0x7fdda80aa150 comp rx=0 tx=0).stop 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 shutdown_connections 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f39d5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35f7b60 0x5588f39ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35d71c0 0x5588f39dbcc0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/907262144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39c9d70 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 >> 172.21.15.40:0/907262144 conn(0x5588f360c990 msgr2=0x5588f39c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fdd9be00640 0 client.17874 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 shutdown_connections 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 1 -- 172.21.15.40:0/907262144 wait complete. 2024-07-26T13:22:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:21.981+0000 7fddc3fc3740 20 client.17874 trim_cache size 0 max 16384 2024-07-26T13:22:22.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.010+0000 7fddc3fc3740 1 Processor -- start 2024-07-26T13:22:22.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.010+0000 7fddc3fc3740 1 -- start start 2024-07-26T13:22:22.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39d5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f35f7b60 0x5588f39cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f3618840 0x5588f39e1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81b1080 con 0x5588f35ef980 2024-07-26T13:22:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81b2bc0 con 0x5588f35f7b60 2024-07-26T13:22:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81b1750 con 0x5588f3618840 2024-07-26T13:22:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddb6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddb6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44448/0 (socket says 172.21.15.40:44448) 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.011+0000 7fddb6800640 1 -- 172.21.15.40:0/115968675 learned_addr learned my addr 172.21.15.40:0/115968675 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddb7200640 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f3618840 0x5588f39e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddafe00640 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f35f7b60 0x5588f39cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddb6800640 1 -- 172.21.15.40:0/115968675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f3618840 msgr2=0x5588f39e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddb6800640 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f3618840 0x5588f39e1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddb6800640 1 -- 172.21.15.40:0/115968675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f35f7b60 msgr2=0x5588f39cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddb6800640 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f35f7b60 0x5588f39cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.012+0000 7fddb6800640 1 -- 172.21.15.40:0/115968675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f39b62b0 con 0x5588f35ef980 2024-07-26T13:22:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.013+0000 7fddb6800640 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39d5910 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdda80aa670 tx=0x7fdda80aa4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a978f65d630bca8e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.013+0000 7fdda6a00640 1 -- 172.21.15.40:0/115968675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8088020 con 0x5588f35ef980 2024-07-26T13:22:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.014+0000 7fdda6a00640 1 -- 172.21.15.40:0/115968675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdda8009de0 con 0x5588f35ef980 2024-07-26T13:22:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.014+0000 7fdda6a00640 1 -- 172.21.15.40:0/115968675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80aece0 con 0x5588f35ef980 2024-07-26T13:22:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 -- 172.21.15.40:0/115968675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 msgr2=0x5588f39d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39d5910 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdda80aa670 tx=0x7fdda80aa4b0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 -- 172.21.15.40:0/115968675 shutdown_connections 2024-07-26T13:22:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f3618840 0x5588f39e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f35f7b60 0x5588f39cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/115968675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35ef980 0x5588f39d5910 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 -- 172.21.15.40:0/115968675 >> 172.21.15.40:0/115968675 conn(0x5588f360c990 msgr2=0x5588f39cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 -- 172.21.15.40:0/115968675 shutdown_connections 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.015+0000 7fddc3fc3740 1 -- 172.21.15.40:0/115968675 wait complete. 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.016+0000 7fddc3fc3740 1 -- start start 2024-07-26T13:22:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.016+0000 7fddc3fc3740 1 Processor -- start 2024-07-26T13:22:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35ef980 0x5588f39cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 0x5588f39ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f3a4bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81b24f0 con 0x5588f35f7b60 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81b1e20 con 0x5588f3618840 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81af040 con 0x5588f35ef980 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.017+0000 7fddc3fc3740 10 client.0 _ll_register_callbacks cb 0x7fdda80b30d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddafe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 0x5588f39ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddb6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35ef980 0x5588f39cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddafe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 0x5588f39ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44460/0 (socket says 172.21.15.40:44460) 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddb6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35ef980 0x5588f39cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43996/0 (socket says 172.21.15.40:43996) 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddafe00640 1 -- 172.21.15.40:0/1655903456 learned_addr learned my addr 172.21.15.40:0/1655903456 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddb7200640 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f3a4bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.018+0000 7fddafe00640 1 -- 172.21.15.40:0/1655903456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35ef980 msgr2=0x5588f39cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.019+0000 7fddafe00640 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35ef980 0x5588f39cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.019+0000 7fddafe00640 1 -- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 msgr2=0x5588f3a4bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.019+0000 7fddafe00640 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f3a4bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.019+0000 7fddafe00640 1 -- 172.21.15.40:0/1655903456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f3a4c180 con 0x5588f35f7b60 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.019+0000 7fddafe00640 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 0x5588f39ce290 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdda0010f10 tx=0x7fdda000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579bfa2e241d7d68 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.019+0000 7fdd9be00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.020+0000 7fdd9be00640 1 -- 172.21.15.40:0/1655903456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0035630 con 0x5588f35f7b60 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.020+0000 7fdd9be00640 1 -- 172.21.15.40:0/1655903456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdda00357d0 con 0x5588f35f7b60 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.020+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda8009de0 con 0x5588f35f7b60 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.020+0000 7fdd9be00640 1 -- 172.21.15.40:0/1655903456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdda00359d0 con 0x5588f35f7b60 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.020+0000 7fddc3fc3740 10 client.17880 fetch_fsmap learned FSMap version 35 2024-07-26T13:22:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.020+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5588f3a4d290 con 0x5588f35f7b60 2024-07-26T13:22:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fdd9be00640 1 -- 172.21.15.40:0/1655903456 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdda8009de0 con 0x5588f35f7b60 2024-07-26T13:22:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fdd9be00640 1 -- 172.21.15.40:0/1655903456 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fdda0045050 con 0x5588f35f7b60 2024-07-26T13:22:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fddc3fc3740 10 client.17880 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:22:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fddc3fc3740 10 client.17880 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fddc3fc3740 20 client.17880 populate_metadata read hostname 'smithi040' 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35ac570 0x5588f3a4f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fddc3fc3740 4 client.17880 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.021+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5588f3931530 con 0x5588f35ac570 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.022+0000 7fddb6800640 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35ac570 0x5588f3a4f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.023+0000 7fddb6800640 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35ac570 0x5588f3a4f930 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb40c607864cbc4 server_cookie=63ddc7fddb743675 in_seq=0 out_seq=0 2024-07-26T13:22:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.023+0000 7fdd9be00640 10 client.17880 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:22.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.239+0000 7fdd9be00640 1 -- 172.21.15.40:0/1655903456 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5588f3931530 con 0x5588f35ac570 2024-07-26T13:22:22.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.240+0000 7fdd9be00640 10 client.17880 handle_command_reply: tid=0 2024-07-26T13:22:22.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.240+0000 7fddc3fc3740 1 client.17880 shutdown 2024-07-26T13:22:22.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.240+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 msgr2=0x5588f39ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.240+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 0x5588f39ce290 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdda0010f10 tx=0x7fdda000b860 comp rx=0 tx=0).stop 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 shutdown_connections 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5588f3618840 0x5588f3a4bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5588f35ac570 0x5588f3a4f930 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5588f35f7b60 0x5588f39ce290 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fddc3fc3740 1 --2- 172.21.15.40:0/1655903456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5588f35ef980 0x5588f39cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 >> 172.21.15.40:0/1655903456 conn(0x5588f360c990 msgr2=0x5588f39bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:22.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.241+0000 7fdd9be00640 0 client.17880 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.242+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 shutdown_connections 2024-07-26T13:22:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.242+0000 7fddc3fc3740 1 -- 172.21.15.40:0/1655903456 wait complete. 2024-07-26T13:22:22.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.242+0000 7fddc3fc3740 20 client.17880 trim_cache size 0 max 16384 2024-07-26T13:22:22.245 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:22:22.245 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:22:22.245 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 202, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "ff61723c": { 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 202, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 150.0, 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:22:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:22.247 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:22:22.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd9c0b3c50 msgr2=0x7fdd9c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd9c0b3c50 0x7fdd9c0b6160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fddb8105870 tx=0x7fdda000b390 comp rx=0 tx=0).stop 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 msgr2=0x7fddb8199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 0x7fddb8199e10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdda800d950 tx=0x7fdda800de10 comp rx=0 tx=0).stop 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 shutdown_connections 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fdd9c0b3c50 0x7fdd9c0b6160 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddb8109830 0x7fddb819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fddb8108ee0 0x7fddb819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 --2- 172.21.15.40:0/758753786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddb81035a0 0x7fddb8199e10 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.244+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 >> 172.21.15.40:0/758753786 conn(0x7fddb80fefd0 msgr2=0x7fddb8108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.245+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 shutdown_connections 2024-07-26T13:22:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:22.245+0000 7fddbd400640 1 -- 172.21.15.40:0/758753786 wait complete. 2024-07-26T13:22:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:22 smithi040 ceph-mon[32397]: pgmap v2303: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:22:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:22 smithi146 ceph-mon[35807]: pgmap v2303: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:22:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:22 smithi076 ceph-mon[35401]: pgmap v2303: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:22:23.181 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ff61723c', quiesce took 9.3 seconds. Will release after: 20.7 2024-07-26T13:22:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:24 smithi040 ceph-mon[32397]: pgmap v2304: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:22:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:24 smithi146 ceph-mon[35807]: pgmap v2304: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:22:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:24 smithi076 ceph-mon[35401]: pgmap v2304: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:22:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:26 smithi040 ceph-mon[32397]: pgmap v2305: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:22:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:26 smithi146 ceph-mon[35807]: pgmap v2305: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:22:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:26 smithi076 ceph-mon[35401]: pgmap v2305: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-07-26T13:22:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:28 smithi146 ceph-mon[35807]: pgmap v2306: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:28 smithi076 ceph-mon[35401]: pgmap v2306: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:28 smithi040 ceph-mon[32397]: pgmap v2306: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:22:31.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:30 smithi146 ceph-mon[35807]: pgmap v2307: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:22:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:30 smithi076 ceph-mon[35401]: pgmap v2307: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:22:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:30 smithi040 ceph-mon[32397]: pgmap v2307: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:22:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:32 smithi146 ceph-mon[35807]: pgmap v2308: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:22:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:32 smithi076 ceph-mon[35401]: pgmap v2308: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:22:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:32 smithi040 ceph-mon[32397]: pgmap v2308: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 10 op/s 2024-07-26T13:22:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:35 smithi146 ceph-mon[35807]: pgmap v2309: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T13:22:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:35 smithi076 ceph-mon[35401]: pgmap v2309: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T13:22:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:35 smithi040 ceph-mon[32397]: pgmap v2309: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 MiB/s wr, 12 op/s 2024-07-26T13:22:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:37 smithi146 ceph-mon[35807]: pgmap v2310: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 911 KiB/s wr, 10 op/s 2024-07-26T13:22:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:37 smithi076 ceph-mon[35401]: pgmap v2310: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 911 KiB/s wr, 10 op/s 2024-07-26T13:22:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:37 smithi040 ceph-mon[32397]: pgmap v2310: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 911 KiB/s wr, 10 op/s 2024-07-26T13:22:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:39 smithi146 ceph-mon[35807]: pgmap v2311: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 570 KiB/s wr, 10 op/s 2024-07-26T13:22:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:39 smithi076 ceph-mon[35401]: pgmap v2311: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 570 KiB/s wr, 10 op/s 2024-07-26T13:22:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:39 smithi040 ceph-mon[32397]: pgmap v2311: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 570 KiB/s wr, 10 op/s 2024-07-26T13:22:41.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:41 smithi146 ceph-mon[35807]: pgmap v2312: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 570 KiB/s wr, 11 op/s 2024-07-26T13:22:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:41 smithi076 ceph-mon[35401]: pgmap v2312: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 570 KiB/s wr, 11 op/s 2024-07-26T13:22:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:41 smithi040 ceph-mon[32397]: pgmap v2312: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 570 KiB/s wr, 11 op/s 2024-07-26T13:22:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:43 smithi146 ceph-mon[35807]: pgmap v2313: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 342 KiB/s wr, 8 op/s 2024-07-26T13:22:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:43 smithi076 ceph-mon[35401]: pgmap v2313: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 342 KiB/s wr, 8 op/s 2024-07-26T13:22:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:43 smithi040 ceph-mon[32397]: pgmap v2313: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 342 KiB/s wr, 8 op/s 2024-07-26T13:22:43.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:22:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:22:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:45 smithi040 ceph-mon[32397]: pgmap v2314: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:22:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:45 smithi146 ceph-mon[35807]: pgmap v2314: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:22:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:45 smithi076 ceph-mon[35401]: pgmap v2314: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 -- 172.21.15.40:0/1648865488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168109670 msgr2=0x7fb16810fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 --2- 172.21.15.40:0/1648865488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168109670 0x7fb16810fea0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb160009900 tx=0x7fb16002a400 comp rx=0 tx=0).stop 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 -- 172.21.15.40:0/1648865488 shutdown_connections 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 --2- 172.21.15.40:0/1648865488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168109670 0x7fb16810fea0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 --2- 172.21.15.40:0/1648865488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168108d20 0x7fb168109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 --2- 172.21.15.40:0/1648865488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1681033e0 0x7fb1681037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 -- 172.21.15.40:0/1648865488 >> 172.21.15.40:0/1648865488 conn(0x7fb1680fee70 msgr2=0x7fb1681012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 -- 172.21.15.40:0/1648865488 shutdown_connections 2024-07-26T13:22:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.791+0000 7fb16de00640 1 -- 172.21.15.40:0/1648865488 wait complete. 2024-07-26T13:22:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.793+0000 7fb16de00640 1 Processor -- start 2024-07-26T13:22:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.793+0000 7fb16de00640 1 -- start start 2024-07-26T13:22:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1681033e0 0x7fb168075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 0x7fb168075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168109670 0x7fb168075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16de00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb168113220 con 0x7fb168108d20 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16de00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681130a0 con 0x7fb168109670 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16de00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681133a0 con 0x7fb1681033e0 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 0x7fb168075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb167e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 0x7fb168075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51790/0 (socket says 172.21.15.40:51790) 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb167e00640 1 -- 172.21.15.40:0/1681219340 learned_addr learned my addr 172.21.15.40:0/1681219340 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16ca00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1681033e0 0x7fb168075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.794+0000 7fb16d400640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168109670 0x7fb168075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb167e00640 1 -- 172.21.15.40:0/1681219340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1681033e0 msgr2=0x7fb168075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb167e00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1681033e0 0x7fb168075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb167e00640 1 -- 172.21.15.40:0/1681219340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168109670 msgr2=0x7fb168075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb167e00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168109670 0x7fb168075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb167e00640 1 -- 172.21.15.40:0/1681219340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1681a7f10 con 0x7fb168108d20 2024-07-26T13:22:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb16d400640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168109670 0x7fb168075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb167e00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 0x7fb168075680 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb15000cce0 tx=0x7fb15000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150004b20 con 0x7fb168108d20 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1681a8200 con 0x7fb168108d20 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb150004cc0 con 0x7fb168108d20 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15000f6b0 con 0x7fb168108d20 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.795+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1681a8740 con 0x7fb168108d20 2024-07-26T13:22:46.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.797+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1681037f0 con 0x7fb168108d20 2024-07-26T13:22:46.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.800+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb15000f850 con 0x7fb168108d20 2024-07-26T13:22:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.802+0000 7fb165600640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1480b3bd0 0x7fb1480b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.802+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1500e4070 con 0x7fb168108d20 2024-07-26T13:22:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.802+0000 7fb16ca00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1480b3bd0 0x7fb1480b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:46.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.803+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb150014030 con 0x7fb168108d20 2024-07-26T13:22:46.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:46.803+0000 7fb16ca00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1480b3bd0 0x7fb1480b60e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb158005fd0 tx=0x7fb158005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.042+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb168076440 con 0x7fb168108d20 2024-07-26T13:22:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.052+0000 7fb165600640 1 -- 172.21.15.40:0/1681219340 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fb1500ab680 con 0x7fb168108d20 2024-07-26T13:22:47.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:22:47.053 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:22:47.053 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:22:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1480b3bd0 msgr2=0x7fb1480b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1480b3bd0 0x7fb1480b60e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb158005fd0 tx=0x7fb158005e40 comp rx=0 tx=0).stop 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 msgr2=0x7fb168075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 0x7fb168075680 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb15000cce0 tx=0x7fb15000a620 comp rx=0 tx=0).stop 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 shutdown_connections 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb168109670 0x7fb168075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb168108d20 0x7fb168075680 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1480b3bd0 0x7fb1480b60e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 --2- 172.21.15.40:0/1681219340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1681033e0 0x7fb168075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 >> 172.21.15.40:0/1681219340 conn(0x7fb1680fee70 msgr2=0x7fb168101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 shutdown_connections 2024-07-26T13:22:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:47.055+0000 7fb16de00640 1 -- 172.21.15.40:0/1681219340 wait complete. 2024-07-26T13:22:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:47 smithi146 ceph-mon[35807]: pgmap v2315: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:22:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:47 smithi076 ceph-mon[35401]: pgmap v2315: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:22:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:47 smithi040 ceph-mon[32397]: pgmap v2315: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:22:47.979 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id ff61723c --release --await' 2024-07-26T13:22:47.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id ff61723c --release --await 2024-07-26T13:22:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:48 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1681219340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:48 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1681219340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:48 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1681219340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:22:49.214 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:49 smithi040 ceph-mon[32397]: pgmap v2316: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:22:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:49 smithi146 ceph-mon[35807]: pgmap v2316: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:22:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:49 smithi076 ceph-mon[35401]: pgmap v2316: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-07-26T13:22:50.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.749+0000 7fe7d3e00640 1 -- 172.21.15.40:0/146394447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d40751e0 msgr2=0x7fe7d40755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.749+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/146394447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d40751e0 0x7fe7d40755f0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009ca0 tx=0x7fe7c402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 -- 172.21.15.40:0/146394447 shutdown_connections 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/146394447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d410f920 0x7fe7d4111d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/146394447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d4075b30 0x7fe7d410f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/146394447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d40751e0 0x7fe7d40755f0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 -- 172.21.15.40:0/146394447 >> 172.21.15.40:0/146394447 conn(0x7fe7d40fee10 msgr2=0x7fe7d4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 -- 172.21.15.40:0/146394447 shutdown_connections 2024-07-26T13:22:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.750+0000 7fe7d3e00640 1 -- 172.21.15.40:0/146394447 wait complete. 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.751+0000 7fe7d3e00640 1 Processor -- start 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.751+0000 7fe7d3e00640 1 -- start start 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.751+0000 7fe7d3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d40751e0 0x7fe7d419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.751+0000 7fe7d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4075b30 0x7fe7d419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 0x7fe7d41a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41153d0 con 0x7fe7d410f920 2024-07-26T13:22:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4115250 con 0x7fe7d40751e0 2024-07-26T13:22:50.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4115550 con 0x7fe7d4075b30 2024-07-26T13:22:50.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 0x7fe7d41a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 0x7fe7d41a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51808/0 (socket says 172.21.15.40:51808) 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d3400640 1 -- 172.21.15.40:0/3681912696 learned_addr learned my addr 172.21.15.40:0/3681912696 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d2000640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4075b30 0x7fe7d419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.752+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d40751e0 0x7fe7d419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7d3400640 1 -- 172.21.15.40:0/3681912696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4075b30 msgr2=0x7fe7d419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7d3400640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4075b30 0x7fe7d419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7d3400640 1 -- 172.21.15.40:0/3681912696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d40751e0 msgr2=0x7fe7d419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7d3400640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d40751e0 0x7fe7d419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7d3400640 1 -- 172.21.15.40:0/3681912696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d41a1d50 con 0x7fe7d410f920 2024-07-26T13:22:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7d3400640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 0x7fe7d41a1620 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00d750 tx=0x7fe7cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.753+0000 7fe7cb400640 1 -- 172.21.15.40:0/3681912696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc017070 con 0x7fe7d410f920 2024-07-26T13:22:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.754+0000 7fe7cb400640 1 -- 172.21.15.40:0/3681912696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7cc0054b0 con 0x7fe7d410f920 2024-07-26T13:22:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.754+0000 7fe7cb400640 1 -- 172.21.15.40:0/3681912696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc004b90 con 0x7fe7d410f920 2024-07-26T13:22:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.754+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d41a2040 con 0x7fe7d410f920 2024-07-26T13:22:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.754+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d41a87a0 con 0x7fe7d410f920 2024-07-26T13:22:50.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.757+0000 7fe7e023f740 1 Processor -- start 2024-07-26T13:22:50.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.758+0000 7fe7cb400640 1 -- 172.21.15.40:0/3681912696 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe7cc004d30 con 0x7fe7d410f920 2024-07-26T13:22:50.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.758+0000 7fe7e023f740 1 -- start start 2024-07-26T13:22:50.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c27551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c27556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2755c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7e023f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e1c26cbf50 con 0x55e1c2387660 2024-07-26T13:22:50.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7e023f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e1c26bb450 con 0x55e1c23b0520 2024-07-26T13:22:50.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7e023f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e1c26bf490 con 0x55e1c238f840 2024-07-26T13:22:50.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7d2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c27556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7d2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c27556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51820/0 (socket says 172.21.15.40:51820) 2024-07-26T13:22:50.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.759+0000 7fe7d2a00640 1 -- 172.21.15.40:0/3896694184 learned_addr learned my addr 172.21.15.40:0/3896694184 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:50.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2000640 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c27551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2000640 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2755c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2a00640 1 -- 172.21.15.40:0/3896694184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 msgr2=0x55e1c2755c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2755c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2a00640 1 -- 172.21.15.40:0/3896694184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 msgr2=0x55e1c27551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c27551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2a00640 1 -- 172.21.15.40:0/3896694184 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1c241bb00 con 0x55e1c2387660 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2000640 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2755c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7cb400640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe7b80b3c50 0x7fe7b80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.760+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c27556e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009ca0 tx=0x7fe7c4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b398d20f1db5e2d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.761+0000 7fe7cb400640 1 -- 172.21.15.40:0/3681912696 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe7cc0e3560 con 0x7fe7d410f920 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.761+0000 7fe7d2000640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe7b80b3c50 0x7fe7b80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.761+0000 7fe7c3400640 1 -- 172.21.15.40:0/3896694184 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4031980 con 0x55e1c2387660 2024-07-26T13:22:50.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.761+0000 7fe7c3400640 1 -- 172.21.15.40:0/3896694184 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c4036030 con 0x55e1c2387660 2024-07-26T13:22:50.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.761+0000 7fe7c3400640 1 -- 172.21.15.40:0/3896694184 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4004440 con 0x55e1c2387660 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 -- 172.21.15.40:0/3896694184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 msgr2=0x55e1c27556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c27556e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009ca0 tx=0x7fe7c4009a20 comp rx=0 tx=0).stop 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7d2000640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe7b80b3c50 0x7fe7b80b6160 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40ffe00 tx=0x7fe7bc014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 -- 172.21.15.40:0/3896694184 shutdown_connections 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2755c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c27556e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 --2- 172.21.15.40:0/3896694184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c27551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 -- 172.21.15.40:0/3896694184 >> 172.21.15.40:0/3896694184 conn(0x55e1c23a4910 msgr2=0x55e1c2753090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.762+0000 7fe7e023f740 1 -- 172.21.15.40:0/3896694184 shutdown_connections 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.763+0000 7fe7e023f740 1 -- 172.21.15.40:0/3896694184 wait complete. 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.763+0000 7fe7e023f740 1 -- start start 2024-07-26T13:22:50.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.763+0000 7fe7e023f740 1 Processor -- start 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c2760830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2760d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c276cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e1c251ebb0 con 0x55e1c2387660 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e1c2657930 con 0x55e1c23b0520 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e1c27637a0 con 0x55e1c238f840 2024-07-26T13:22:50.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7e023f740 10 client.0 _ll_register_callbacks cb 0x55e1c23c7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7d2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c2760830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7d2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c2760830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51822/0 (socket says 172.21.15.40:51822) 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.764+0000 7fe7d2a00640 1 -- 172.21.15.40:0/707742373 learned_addr learned my addr 172.21.15.40:0/707742373 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2000640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2760d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d3400640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c276cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2a00640 1 -- 172.21.15.40:0/707742373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 msgr2=0x55e1c2760d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2760d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2a00640 1 -- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 msgr2=0x55e1c276cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c276cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2a00640 1 -- 172.21.15.40:0/707742373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1c2492960 con 0x55e1c2387660 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d3400640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c276cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:50.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c2760830 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe7c402ade0 tx=0x7fe7c402b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b2df9bf823ccce server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:50.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.765+0000 7fe7b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:22:50.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7b7e00640 1 -- 172.21.15.40:0/707742373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c404a040 con 0x55e1c2387660 2024-07-26T13:22:50.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7b7e00640 1 -- 172.21.15.40:0/707742373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe7c4031b80 con 0x55e1c2387660 2024-07-26T13:22:50.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c4036030 con 0x55e1c2387660 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7b7e00640 1 -- 172.21.15.40:0/707742373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe7c4031dc0 con 0x55e1c2387660 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7e023f740 10 client.17898 fetch_fsmap learned FSMap version 35 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e1c276f3f0 con 0x55e1c2387660 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.766+0000 7fe7b7e00640 1 -- 172.21.15.40:0/707742373 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c4036030 con 0x55e1c2387660 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7b7e00640 1 -- 172.21.15.40:0/707742373 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe7c404d030 con 0x55e1c2387660 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7e023f740 10 client.17898 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7e023f740 10 client.17898 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:22:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7e023f740 20 client.17898 populate_metadata read hostname 'smithi040' 2024-07-26T13:22:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7e023f740 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c236eea0 0x55e1c2772750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7e023f740 4 client.17898 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:22:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.767+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1c26cdea0 con 0x55e1c236eea0 2024-07-26T13:22:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.768+0000 7fe7d2000640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c236eea0 0x55e1c2772750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.769+0000 7fe7d2000640 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c236eea0 0x55e1c2772750 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b6d790b72b95f8 server_cookie=2cd42bee87d06fb9 in_seq=0 out_seq=0 2024-07-26T13:22:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.769+0000 7fe7b7e00640 10 client.17898 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7b7e00640 1 -- 172.21.15.40:0/707742373 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1c26cdea0 con 0x55e1c236eea0 2024-07-26T13:22:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7b7e00640 10 client.17898 handle_command_reply: tid=0 2024-07-26T13:22:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 client.17898 shutdown 2024-07-26T13:22:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 msgr2=0x55e1c2760830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c2760830 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe7c402ade0 tx=0x7fe7c402b020 comp rx=0 tx=0).stop 2024-07-26T13:22:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 shutdown_connections 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c23b0520 0x55e1c276cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2760d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.771+0000 7fe7e023f740 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c236eea0 0x55e1c2772750 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.772+0000 7fe7e023f740 1 --2- 172.21.15.40:0/707742373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c2387660 0x55e1c2760830 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.772+0000 7fe7b7e00640 0 client.17898 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.772+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 >> 172.21.15.40:0/707742373 conn(0x55e1c23a4910 msgr2=0x55e1c2758330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.772+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 shutdown_connections 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.772+0000 7fe7e023f740 1 -- 172.21.15.40:0/707742373 wait complete. 2024-07-26T13:22:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.772+0000 7fe7e023f740 20 client.17898 trim_cache size 0 max 16384 2024-07-26T13:22:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.791+0000 7fe7e023f740 1 Processor -- start 2024-07-26T13:22:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.791+0000 7fe7e023f740 1 -- start start 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c275ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c275bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c2777d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7e023f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b0d90 con 0x55e1c23b0520 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7e023f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b28d0 con 0x55e1c2387660 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7e023f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b1460 con 0x55e1c238f840 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c2777d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c2777d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51828/0 (socket says 172.21.15.40:51828) 2024-07-26T13:22:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7d3400640 1 -- 172.21.15.40:0/1711992327 learned_addr learned my addr 172.21.15.40:0/1711992327 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c275ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.792+0000 7fe7d2000640 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c275bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.793+0000 7fe7d3400640 1 -- 172.21.15.40:0/1711992327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 msgr2=0x55e1c275bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.793+0000 7fe7d3400640 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c275bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.793+0000 7fe7d3400640 1 -- 172.21.15.40:0/1711992327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 msgr2=0x55e1c275ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.793+0000 7fe7d3400640 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c275ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.793+0000 7fe7d3400640 1 -- 172.21.15.40:0/1711992327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1c275f790 con 0x55e1c23b0520 2024-07-26T13:22:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.793+0000 7fe7d3400640 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c2777d20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc005780 tx=0x7fe7cc0a9d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaeaefe4e0e95fb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.794+0000 7fe7c2a00640 1 -- 172.21.15.40:0/1711992327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc020040 con 0x55e1c23b0520 2024-07-26T13:22:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.794+0000 7fe7c2a00640 1 -- 172.21.15.40:0/1711992327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7cc0b3520 con 0x55e1c23b0520 2024-07-26T13:22:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.794+0000 7fe7c2a00640 1 -- 172.21.15.40:0/1711992327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0e3370 con 0x55e1c23b0520 2024-07-26T13:22:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 -- 172.21.15.40:0/1711992327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 msgr2=0x55e1c2777d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c2777d20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc005780 tx=0x7fe7cc0a9d50 comp rx=0 tx=0).stop 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 -- 172.21.15.40:0/1711992327 shutdown_connections 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c2777d20 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c275bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 --2- 172.21.15.40:0/1711992327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c275ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 -- 172.21.15.40:0/1711992327 >> 172.21.15.40:0/1711992327 conn(0x55e1c23a4910 msgr2=0x55e1c275b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 -- 172.21.15.40:0/1711992327 shutdown_connections 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.795+0000 7fe7e023f740 1 -- 172.21.15.40:0/1711992327 wait complete. 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.796+0000 7fe7e023f740 1 -- start start 2024-07-26T13:22:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.796+0000 7fe7e023f740 1 Processor -- start 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c2764a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2764f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c27654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b2200 con 0x55e1c23b0520 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41b1b30 con 0x55e1c2387660 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41aed50 con 0x55e1c238f840 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7e023f740 10 client.0 _ll_register_callbacks cb 0x7fe7c4009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:22:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c27654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7d2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2764f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7d2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c2764a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c27654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51830/0 (socket says 172.21.15.40:51830) 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.797+0000 7fe7d3400640 1 -- 172.21.15.40:0/654183119 learned_addr learned my addr 172.21.15.40:0/654183119 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7d3400640 1 -- 172.21.15.40:0/654183119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 msgr2=0x55e1c2764f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7d3400640 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2764f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7d3400640 1 -- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 msgr2=0x55e1c2764a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7d3400640 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c2764a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7d3400640 1 -- 172.21.15.40:0/654183119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1c27e2660 con 0x55e1c23b0520 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7d3400640 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c27654c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc000c00 tx=0x7fe7cc005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76d061fafa89c88 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.798+0000 7fe7b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7b7e00640 1 -- 172.21.15.40:0/654183119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc020050 con 0x55e1c23b0520 2024-07-26T13:22:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7b7e00640 1 -- 172.21.15.40:0/654183119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe7cc0a67b0 con 0x55e1c23b0520 2024-07-26T13:22:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7cc0b3520 con 0x55e1c23b0520 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7b7e00640 1 -- 172.21.15.40:0/654183119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe7cc0e3110 con 0x55e1c23b0520 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7e023f740 10 client.17904 fetch_fsmap learned FSMap version 35 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e1c27e3970 con 0x55e1c23b0520 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.799+0000 7fe7b7e00640 1 -- 172.21.15.40:0/654183119 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7cc0b3520 con 0x55e1c23b0520 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7b7e00640 1 -- 172.21.15.40:0/654183119 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fe7cc0bfb10 con 0x55e1c23b0520 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7e023f740 10 client.17904 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7e023f740 10 client.17904 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7e023f740 20 client.17904 populate_metadata read hostname 'smithi040' 2024-07-26T13:22:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7e023f740 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c2344250 0x55e1c27e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7e023f740 4 client.17904 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ff61723c", "release": true, "await": true}] 2024-07-26T13:22:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ff61723c", "release": true, "await": true}) -- 0x55e1c27617a0 con 0x55e1c2344250 2024-07-26T13:22:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.800+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c2344250 0x55e1c27e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.801+0000 7fe7d2a00640 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c2344250 0x55e1c27e6020 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56b14e03ca5b1ad server_cookie=7762b10903208a4e in_seq=0 out_seq=0 2024-07-26T13:22:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.801+0000 7fe7b7e00640 10 client.17904 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.874+0000 7fe7b7e00640 1 -- 172.21.15.40:0/654183119 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55e1c27617a0 con 0x55e1c2344250 2024-07-26T13:22:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.874+0000 7fe7b7e00640 10 client.17904 handle_command_reply: tid=0 2024-07-26T13:22:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.874+0000 7fe7e023f740 1 client.17904 shutdown 2024-07-26T13:22:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.874+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 msgr2=0x55e1c27654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.874+0000 7fe7e023f740 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c27654c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc000c00 tx=0x7fe7cc005ab0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 shutdown_connections 2024-07-26T13:22:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e1c2344250 0x55e1c27e6020 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e1c23b0520 0x55e1c27654c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e1c238f840 0x55e1c2764f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7b7e00640 0 client.17904 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:22:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 --2- 172.21.15.40:0/654183119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e1c2387660 0x55e1c2764a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 >> 172.21.15.40:0/654183119 conn(0x55e1c23a4910 msgr2=0x55e1c275bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.875+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 shutdown_connections 2024-07-26T13:22:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.876+0000 7fe7e023f740 1 -- 172.21.15.40:0/654183119 wait complete. 2024-07-26T13:22:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.876+0000 7fe7e023f740 20 client.17904 trim_cache size 0 max 16384 2024-07-26T13:22:50.877 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 204, 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "ff61723c": { 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 204, 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:22:50.878 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 150.0, 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:22:50.879 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:22:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.877+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe7b80b3c50 msgr2=0x7fe7b80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.877+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe7b80b3c50 0x7fe7b80b6160 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40ffe00 tx=0x7fe7bc014040 comp rx=0 tx=0).stop 2024-07-26T13:22:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.877+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 msgr2=0x7fe7d41a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.877+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 0x7fe7d41a1620 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00d750 tx=0x7fe7cc00dc10 comp rx=0 tx=0).stop 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 shutdown_connections 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d410f920 0x7fe7d41a1620 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe7b80b3c50 0x7fe7b80b6160 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4075b30 0x7fe7d419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 --2- 172.21.15.40:0/3681912696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d40751e0 0x7fe7d419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 >> 172.21.15.40:0/3681912696 conn(0x7fe7d40fee10 msgr2=0x7fe7d41094c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 shutdown_connections 2024-07-26T13:22:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:50.878+0000 7fe7d3e00640 1 -- 172.21.15.40:0/3681912696 wait complete. 2024-07-26T13:22:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:51 smithi146 ceph-mon[35807]: pgmap v2317: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:22:51.328 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:51 smithi040 ceph-mon[32397]: pgmap v2317: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:22:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:51 smithi076 ceph-mon[35401]: pgmap v2317: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 11 op/s 2024-07-26T13:22:51.725 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ff61723c', total seconds elapsed: 37.8 2024-07-26T13:22:51.725 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-26T13:22:51.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:22:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:22:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:53 smithi076 ceph-mon[35401]: pgmap v2318: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:22:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:53 smithi040 ceph-mon[32397]: pgmap v2318: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:22:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:53 smithi146 ceph-mon[35807]: pgmap v2318: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:22:55.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:55 smithi040 ceph-mon[32397]: pgmap v2319: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T13:22:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 -- 172.21.15.40:0/2579704873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24102040 msgr2=0x7f5c24102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 --2- 172.21.15.40:0/2579704873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24102040 0x7f5c24102450 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009930 tx=0x7f5c1402a420 comp rx=0 tx=0).stop 2024-07-26T13:22:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 -- 172.21.15.40:0/2579704873 shutdown_connections 2024-07-26T13:22:55.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 --2- 172.21.15.40:0/2579704873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c24107480 0x7f5c24107960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 --2- 172.21.15.40:0/2579704873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c24102990 0x7f5c24106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 --2- 172.21.15.40:0/2579704873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24102040 0x7f5c24102450 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 -- 172.21.15.40:0/2579704873 >> 172.21.15.40:0/2579704873 conn(0x7f5c240fdd50 msgr2=0x7f5c241001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:55.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 -- 172.21.15.40:0/2579704873 shutdown_connections 2024-07-26T13:22:55.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.284+0000 7f5c29200640 1 -- 172.21.15.40:0/2579704873 wait complete. 2024-07-26T13:22:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.285+0000 7f5c29200640 1 Processor -- start 2024-07-26T13:22:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 -- start start 2024-07-26T13:22:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c24102040 0x7f5c241a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c24102990 0x7f5c241a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 0x7f5c241a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5c241197d0 con 0x7f5c24107480 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24119650 con 0x7f5c24102040 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c29200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24119950 con 0x7f5c24102990 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.286+0000 7f5c22800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 0x7f5c241a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 0x7f5c241a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39838/0 (socket says 172.21.15.40:39838) 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 -- 172.21.15.40:0/990819698 learned_addr learned my addr 172.21.15.40:0/990819698 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c21e00640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c24102040 0x7f5c241a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 -- 172.21.15.40:0/990819698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c24102990 msgr2=0x7f5c241a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c24102990 0x7f5c241a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 -- 172.21.15.40:0/990819698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c24102040 msgr2=0x7f5c241a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c24102040 0x7f5c241a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 -- 172.21.15.40:0/990819698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c241a6270 con 0x7f5c24107480 2024-07-26T13:22:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.287+0000 7f5c22800640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 0x7f5c241a5b40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00eaa0 tx=0x7f5c1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.288+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c00cdb0 con 0x7f5c24107480 2024-07-26T13:22:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.288+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c1c005020 con 0x7f5c24107480 2024-07-26T13:22:55.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.288+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c241a6560 con 0x7f5c24107480 2024-07-26T13:22:55.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.288+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0116d0 con 0x7f5c24107480 2024-07-26T13:22:55.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.288+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c241accc0 con 0x7f5c24107480 2024-07-26T13:22:55.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.289+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c000052c0 con 0x7f5c24107480 2024-07-26T13:22:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.292+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5c1c004a40 con 0x7f5c24107480 2024-07-26T13:22:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.294+0000 7f5c1aa00640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5c080b3c50 0x7f5c080b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.295+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5c1c0e3f50 con 0x7f5c24107480 2024-07-26T13:22:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.295+0000 7f5c21e00640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5c080b3c50 0x7f5c080b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.296+0000 7f5c21e00640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5c080b3c50 0x7f5c080b6160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5c14005f70 tx=0x7f5c14005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.297+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f5c1c016030 con 0x7f5c24107480 2024-07-26T13:22:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:55 smithi076 ceph-mon[35401]: pgmap v2319: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T13:22:55.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.540+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c000055b0 con 0x7f5c24107480 2024-07-26T13:22:55.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.542+0000 7f5c1aa00640 1 -- 172.21.15.40:0/990819698 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f5c1c0ab5e0 con 0x7f5c24107480 2024-07-26T13:22:55.543 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:22:55.543 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:22:55.544 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:22:55.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5c080b3c50 msgr2=0x7f5c080b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:55.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5c080b3c50 0x7f5c080b6160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5c14005f70 tx=0x7f5c14005fd0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 msgr2=0x7f5c241a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:55.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 0x7f5c241a5b40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00eaa0 tx=0x7f5c1c00ef60 comp rx=0 tx=0).stop 2024-07-26T13:22:55.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 shutdown_connections 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c24107480 0x7f5c241a5b40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f5c080b3c50 0x7f5c080b6160 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c24102990 0x7f5c241a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 --2- 172.21.15.40:0/990819698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c24102040 0x7f5c241a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.545+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 >> 172.21.15.40:0/990819698 conn(0x7f5c240fdd50 msgr2=0x7f5c24104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.546+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 shutdown_connections 2024-07-26T13:22:55.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:55.546+0000 7f5c29200640 1 -- 172.21.15.40:0/990819698 wait complete. 2024-07-26T13:22:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:55 smithi146 ceph-mon[35807]: pgmap v2319: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-07-26T13:22:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:56 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/990819698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:56.430 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-26T13:22:56.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-26T13:22:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:56 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/990819698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:56 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/990819698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:22:56.992 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:22:57.357 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:57 smithi040 ceph-mon[32397]: pgmap v2320: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:22:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:57 smithi146 ceph-mon[35807]: pgmap v2320: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:22:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:57 smithi076 ceph-mon[35401]: pgmap v2320: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2024-07-26T13:22:59.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 -- 172.21.15.40:0/879951286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 msgr2=0x7fb200102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:59.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 --2- 172.21.15.40:0/879951286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb200102420 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009930 tx=0x7fb1f402a420 comp rx=0 tx=0).stop 2024-07-26T13:22:59.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 -- 172.21.15.40:0/879951286 shutdown_connections 2024-07-26T13:22:59.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 --2- 172.21.15.40:0/879951286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb200107450 0x7fb200107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:59.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 --2- 172.21.15.40:0/879951286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200102960 0x7fb200106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 --2- 172.21.15.40:0/879951286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb200102420 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 -- 172.21.15.40:0/879951286 >> 172.21.15.40:0/879951286 conn(0x7fb2000fdd60 msgr2=0x7fb2001001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:22:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 -- 172.21.15.40:0/879951286 shutdown_connections 2024-07-26T13:22:59.391 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:22:59 smithi040 ceph-mon[32397]: pgmap v2321: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:22:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.388+0000 7fb206400640 1 -- 172.21.15.40:0/879951286 wait complete. 2024-07-26T13:22:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 Processor -- start 2024-07-26T13:22:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 -- start start 2024-07-26T13:22:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb2001a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb200102960 0x7fb2001a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200107450 0x7fb2001a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001197c0 con 0x7fb200102010 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb200119640 con 0x7fb200107450 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.390+0000 7fb206400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb200119940 con 0x7fb200102960 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.391+0000 7fb205000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb2001a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.391+0000 7fb205000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb2001a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39850/0 (socket says 172.21.15.40:39850) 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.391+0000 7fb205000640 1 -- 172.21.15.40:0/2520106275 learned_addr learned my addr 172.21.15.40:0/2520106275 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.391+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb200102960 0x7fb2001a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.391+0000 7fb205a00640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200107450 0x7fb2001a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205000640 1 -- 172.21.15.40:0/2520106275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb200102960 msgr2=0x7fb2001a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205000640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb200102960 0x7fb2001a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205000640 1 -- 172.21.15.40:0/2520106275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200107450 msgr2=0x7fb2001a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:22:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205000640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200107450 0x7fb2001a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:22:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205000640 1 -- 172.21.15.40:0/2520106275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2001a61e0 con 0x7fb200102010 2024-07-26T13:22:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205a00640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200107450 0x7fb2001a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:22:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.392+0000 7fb205000640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb2001a0270 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4005940 tx=0x7fb1f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.393+0000 7fb1fd600640 1 -- 172.21.15.40:0/2520106275 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f403f030 con 0x7fb200102010 2024-07-26T13:22:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.393+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2001a6470 con 0x7fb200102010 2024-07-26T13:22:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.393+0000 7fb1fd600640 1 -- 172.21.15.40:0/2520106275 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1f4003c90 con 0x7fb200102010 2024-07-26T13:22:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.393+0000 7fb1fd600640 1 -- 172.21.15.40:0/2520106275 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4035070 con 0x7fb200102010 2024-07-26T13:22:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.393+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2001acc30 con 0x7fb200102010 2024-07-26T13:22:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.397+0000 7fb1fd600640 1 -- 172.21.15.40:0/2520106275 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb1f4042030 con 0x7fb200102010 2024-07-26T13:22:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.398+0000 7fb1fd600640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1e80b3bc0 0x7fb1e80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:22:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.399+0000 7fb1fd600640 1 -- 172.21.15.40:0/2520106275 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1f4104160 con 0x7fb200102010 2024-07-26T13:22:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.399+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1e80b3bc0 0x7fb1e80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:22:59.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:22:59.400+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1e80b3bc0 0x7fb1e80b60d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb200107c70 tx=0x7fb1f000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:22:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:22:59 smithi146 ceph-mon[35807]: pgmap v2321: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:22:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:22:59 smithi076 ceph-mon[35401]: pgmap v2321: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:23:00.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.015+0000 7fb20e68f740 1 Processor -- start 2024-07-26T13:23:00.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.015+0000 7fb20e68f740 1 -- start start 2024-07-26T13:23:00.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84e04840 0x557e851aa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 0x557e851aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84de3b60 0x557e851aae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb20e68f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557e85174cf0 con 0x557e84ddb980 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb20e68f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557e8511fb40 con 0x557e84e04840 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb20e68f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557e8510f040 con 0x557e84de3b60 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb1ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 0x557e851aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb1ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 0x557e851aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39862/0 (socket says 172.21.15.40:39862) 2024-07-26T13:23:00.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.016+0000 7fb1ffe00640 1 -- 172.21.15.40:0/2992364128 learned_addr learned my addr 172.21.15.40:0/2992364128 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb205000640 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84e04840 0x557e851aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb205a00640 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84de3b60 0x557e851aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb1ffe00640 1 -- 172.21.15.40:0/2992364128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84de3b60 msgr2=0x557e851aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84de3b60 0x557e851aae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb1ffe00640 1 -- 172.21.15.40:0/2992364128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84e04840 msgr2=0x557e851aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84e04840 0x557e851aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.017+0000 7fb1ffe00640 1 -- 172.21.15.40:0/2992364128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e85096af0 con 0x557e84ddb980 2024-07-26T13:23:00.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.018+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 0x557e851aa8d0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000baa0 tx=0x7fb1f0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b1eb5824de141b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:00.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.018+0000 7fb1ee000640 1 -- 172.21.15.40:0/2992364128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f001e620 con 0x557e84ddb980 2024-07-26T13:23:00.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.018+0000 7fb1ee000640 1 -- 172.21.15.40:0/2992364128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1f001ec50 con 0x557e84ddb980 2024-07-26T13:23:00.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.018+0000 7fb1ee000640 1 -- 172.21.15.40:0/2992364128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f001cb30 con 0x557e84ddb980 2024-07-26T13:23:00.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 -- 172.21.15.40:0/2992364128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 msgr2=0x557e851aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:00.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 0x557e851aa8d0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000baa0 tx=0x7fb1f0013000 comp rx=0 tx=0).stop 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 -- 172.21.15.40:0/2992364128 shutdown_connections 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84de3b60 0x557e851aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84ddb980 0x557e851aa8d0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 --2- 172.21.15.40:0/2992364128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84e04840 0x557e851aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 -- 172.21.15.40:0/2992364128 >> 172.21.15.40:0/2992364128 conn(0x557e84df8990 msgr2=0x557e851a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.019+0000 7fb20e68f740 1 -- 172.21.15.40:0/2992364128 shutdown_connections 2024-07-26T13:23:00.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.020+0000 7fb20e68f740 1 -- 172.21.15.40:0/2992364128 wait complete. 2024-07-26T13:23:00.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.020+0000 7fb20e68f740 1 -- start start 2024-07-26T13:23:00.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 Processor -- start 2024-07-26T13:23:00.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 0x557e851b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557e850ab500 con 0x557e84de3b60 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557e85113080 con 0x557e84ddb980 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557e84f727a0 con 0x557e84e04840 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.021+0000 7fb20e68f740 10 client.0 _ll_register_callbacks cb 0x557e85107bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 0x557e851b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 0x557e851b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39872/0 (socket says 172.21.15.40:39872) 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 -- 172.21.15.40:0/445673759 learned_addr learned my addr 172.21.15.40:0/445673759 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb205000640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb205a00640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 -- 172.21.15.40:0/445673759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 msgr2=0x557e851c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 -- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 msgr2=0x557e851b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb1ffe00640 1 -- 172.21.15.40:0/445673759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e84e7eb90 con 0x557e84de3b60 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.022+0000 7fb205000640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.023+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 0x557e851b63d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0006010 tx=0x7fb1f001caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dff28e2be0a2a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.023+0000 7fb1e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.023+0000 7fb1e2a00640 1 -- 172.21.15.40:0/445673759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f001cea0 con 0x557e84de3b60 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.023+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1f001ec50 con 0x557e84de3b60 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.023+0000 7fb1e2a00640 1 -- 172.21.15.40:0/445673759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1f001e420 con 0x557e84de3b60 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.024+0000 7fb1e2a00640 1 -- 172.21.15.40:0/445673759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb1f001e660 con 0x557e84de3b60 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.024+0000 7fb20e68f740 10 client.17922 fetch_fsmap learned FSMap version 35 2024-07-26T13:23:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.024+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557e851c4940 con 0x557e84de3b60 2024-07-26T13:23:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.024+0000 7fb1e2a00640 1 -- 172.21.15.40:0/445673759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1f001ec50 con 0x557e84de3b60 2024-07-26T13:23:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb1e2a00640 1 -- 172.21.15.40:0/445673759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb1f002f920 con 0x557e84de3b60 2024-07-26T13:23:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb20e68f740 10 client.17922 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:23:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb20e68f740 10 client.17922 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb20e68f740 20 client.17922 populate_metadata read hostname 'smithi040' 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb20e68f740 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e84dc31c0 0x557e851c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb20e68f740 4 client.17922 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.025+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e85121a90 con 0x557e84dc31c0 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.026+0000 7fb205000640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e84dc31c0 0x557e851c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.027+0000 7fb205000640 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e84dc31c0 0x557e851c7d00 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87acdf912e6229a0 server_cookie=3b09a1d77e9acea6 in_seq=0 out_seq=0 2024-07-26T13:23:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.027+0000 7fb1e2a00640 10 client.17922 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:00.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb1e2a00640 1 -- 172.21.15.40:0/445673759 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e85121a90 con 0x557e84dc31c0 2024-07-26T13:23:00.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb1e2a00640 10 client.17922 handle_command_reply: tid=0 2024-07-26T13:23:00.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 client.17922 shutdown 2024-07-26T13:23:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 msgr2=0x557e851b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 0x557e851b63d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0006010 tx=0x7fb1f001caa0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 shutdown_connections 2024-07-26T13:23:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e84dc31c0 0x557e851c7d00 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84de3b60 0x557e851b63d0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 --2- 172.21.15.40:0/445673759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 >> 172.21.15.40:0/445673759 conn(0x557e84df8990 msgr2=0x557e851ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.029+0000 7fb1e2a00640 0 client.17922 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.030+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 shutdown_connections 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.030+0000 7fb20e68f740 1 -- 172.21.15.40:0/445673759 wait complete. 2024-07-26T13:23:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.030+0000 7fb20e68f740 20 client.17922 trim_cache size 0 max 16384 2024-07-26T13:23:00.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.049+0000 7fb20e68f740 1 Processor -- start 2024-07-26T13:23:00.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.049+0000 7fb20e68f740 1 -- start start 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb20e68f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001b51c0 con 0x557e84d98570 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb20e68f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001b6d00 con 0x557e84ddb980 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb20e68f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001b5890 con 0x557e84e04840 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.050+0000 7fb205a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851c21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39880/0 (socket says 172.21.15.40:39880) 2024-07-26T13:23:00.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 -- 172.21.15.40:0/1041615428 learned_addr learned my addr 172.21.15.40:0/1041615428 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:00.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205000640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 -- 172.21.15.40:0/1041615428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 msgr2=0x557e851c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 -- 172.21.15.40:0/1041615428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 msgr2=0x557e851b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205a00640 1 -- 172.21.15.40:0/1041615428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e851b6d30 con 0x557e84d98570 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb205000640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.051+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.052+0000 7fb205a00640 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851c21c0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009ed0 tx=0x7fb1f80127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db65131a240d10e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.052+0000 7fb1ed600640 1 -- 172.21.15.40:0/1041615428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8020070 con 0x557e84d98570 2024-07-26T13:23:00.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.053+0000 7fb1ed600640 1 -- 172.21.15.40:0/1041615428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1f801b8a0 con 0x557e84d98570 2024-07-26T13:23:00.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.053+0000 7fb1ed600640 1 -- 172.21.15.40:0/1041615428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8010830 con 0x557e84d98570 2024-07-26T13:23:00.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 -- 172.21.15.40:0/1041615428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 msgr2=0x557e851c21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:00.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851c21c0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009ed0 tx=0x7fb1f80127c0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 -- 172.21.15.40:0/1041615428 shutdown_connections 2024-07-26T13:23:00.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851c21c0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 --2- 172.21.15.40:0/1041615428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 -- 172.21.15.40:0/1041615428 >> 172.21.15.40:0/1041615428 conn(0x557e84df8990 msgr2=0x557e851b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:00.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 -- 172.21.15.40:0/1041615428 shutdown_connections 2024-07-26T13:23:00.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.054+0000 7fb20e68f740 1 -- 172.21.15.40:0/1041615428 wait complete. 2024-07-26T13:23:00.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.055+0000 7fb20e68f740 1 -- start start 2024-07-26T13:23:00.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.055+0000 7fb20e68f740 1 Processor -- start 2024-07-26T13:23:00.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001b6630 con 0x557e84d98570 2024-07-26T13:23:00.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001b5f60 con 0x557e84ddb980 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001b3180 con 0x557e84e04840 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb20e68f740 10 client.0 _ll_register_callbacks cb 0x7fb1f4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb205000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb205000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39892/0 (socket says 172.21.15.40:39892) 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb205000640 1 -- 172.21.15.40:0/3314910532 learned_addr learned my addr 172.21.15.40:0/3314910532 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.056+0000 7fb205a00640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205000640 1 -- 172.21.15.40:0/3314910532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 msgr2=0x557e851c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205000640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205000640 1 -- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 msgr2=0x557e851c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205000640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205000640 1 -- 172.21.15.40:0/3314910532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e851c9820 con 0x557e84d98570 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205a00640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb205000640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851cb540 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009630 tx=0x7fb1f40cb830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4effaf21ac881bd0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb1e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb1e2a00640 1 -- 172.21.15.40:0/3314910532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4049040 con 0x557e84d98570 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb1e2a00640 1 -- 172.21.15.40:0/3314910532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1f4003800 con 0x557e84d98570 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.057+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1f801b8a0 con 0x557e84d98570 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.058+0000 7fb1e2a00640 1 -- 172.21.15.40:0/3314910532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb1f40ec330 con 0x557e84d98570 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.058+0000 7fb20e68f740 10 client.17928 fetch_fsmap learned FSMap version 35 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.058+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557e85230310 con 0x557e84d98570 2024-07-26T13:23:00.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.058+0000 7fb1e2a00640 1 -- 172.21.15.40:0/3314910532 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1f801b8a0 con 0x557e84d98570 2024-07-26T13:23:00.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.058+0000 7fb1e2a00640 1 -- 172.21.15.40:0/3314910532 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fb1f40d3c90 con 0x557e84d98570 2024-07-26T13:23:00.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb20e68f740 10 client.17928 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:23:00.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb20e68f740 10 client.17928 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:23:00.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb20e68f740 20 client.17928 populate_metadata read hostname 'smithi040' 2024-07-26T13:23:00.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb20e68f740 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e85230b30 0x557e85232f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:00.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb20e68f740 4 client.17928 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-07-26T13:23:00.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x557e8511d530 con 0x557e85230b30 2024-07-26T13:23:00.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.059+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e85230b30 0x557e85232f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:00.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.060+0000 7fb1ffe00640 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e85230b30 0x557e85232f50 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42edb0d8fa6006a server_cookie=924717612985c6a0 in_seq=0 out_seq=0 2024-07-26T13:23:00.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.060+0000 7fb1e2a00640 10 client.17928 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:00.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.349+0000 7fb1e2a00640 1 -- 172.21.15.40:0/3314910532 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x557e8511d530 con 0x557e85230b30 2024-07-26T13:23:00.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.349+0000 7fb1e2a00640 10 client.17928 handle_command_reply: tid=0 2024-07-26T13:23:00.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.349+0000 7fb20e68f740 1 client.17928 shutdown 2024-07-26T13:23:00.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.350+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 msgr2=0x557e851cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:00.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.350+0000 7fb20e68f740 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851cb540 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009630 tx=0x7fb1f40cb830 comp rx=0 tx=0).stop 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 shutdown_connections 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557e84e04840 0x557e851c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557e84ddb980 0x557e851c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x557e85230b30 0x557e85232f50 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 --2- 172.21.15.40:0/3314910532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557e84d98570 0x557e851cb540 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 >> 172.21.15.40:0/3314910532 conn(0x557e84df8990 msgr2=0x557e851ab2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:00.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb1e2a00640 0 client.17928 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:00.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.351+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 shutdown_connections 2024-07-26T13:23:00.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.352+0000 7fb20e68f740 1 -- 172.21.15.40:0/3314910532 wait complete. 2024-07-26T13:23:00.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.352+0000 7fb20e68f740 20 client.17928 trim_cache size 0 max 16384 2024-07-26T13:23:00.354 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:23:00.354 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 206, 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "46bb2212": { 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 206, 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:23:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 150.0, 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:23:00.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1e80b3bc0 msgr2=0x7fb1e80b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:00.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1e80b3bc0 0x7fb1e80b60d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb200107c70 tx=0x7fb1f000b410 comp rx=0 tx=0).stop 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 msgr2=0x7fb2001a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb2001a0270 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4005940 tx=0x7fb1f40042f0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 shutdown_connections 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb200107450 0x7fb2001a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb1e80b3bc0 0x7fb1e80b60d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb200102960 0x7fb2001a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.354+0000 7fb206400640 1 --2- 172.21.15.40:0/2520106275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb200102010 0x7fb2001a0270 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.355+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 >> 172.21.15.40:0/2520106275 conn(0x7fb2000fdd60 msgr2=0x7fb200104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.355+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 shutdown_connections 2024-07-26T13:23:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:00.355+0000 7fb206400640 1 -- 172.21.15.40:0/2520106275 wait complete. 2024-07-26T13:23:01.204 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '46bb2212', quiesce took 9.5 seconds. Will release after: 20.5 2024-07-26T13:23:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:01 smithi040 ceph-mon[32397]: pgmap v2322: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:23:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:01 smithi146 ceph-mon[35807]: pgmap v2322: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:23:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:01 smithi076 ceph-mon[35401]: pgmap v2322: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-07-26T13:23:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:03 smithi040 ceph-mon[32397]: pgmap v2323: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T13:23:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:03 smithi146 ceph-mon[35807]: pgmap v2323: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T13:23:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:03 smithi076 ceph-mon[35401]: pgmap v2323: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.8 MiB/s wr, 9 op/s 2024-07-26T13:23:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:05 smithi040 ceph-mon[32397]: pgmap v2324: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T13:23:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:05 smithi146 ceph-mon[35807]: pgmap v2324: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T13:23:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:05 smithi076 ceph-mon[35401]: pgmap v2324: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 MiB/s wr, 12 op/s 2024-07-26T13:23:07.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:07 smithi040 ceph-mon[32397]: pgmap v2325: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:23:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:07 smithi146 ceph-mon[35807]: pgmap v2325: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:23:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:07 smithi076 ceph-mon[35401]: pgmap v2325: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-07-26T13:23:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:09 smithi040 ceph-mon[32397]: pgmap v2326: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:23:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:23:09.506 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:09 smithi146 ceph-mon[35807]: pgmap v2326: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:23:09.507 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:23:09.510 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:09 smithi076 ceph-mon[35401]: pgmap v2326: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-07-26T13:23:09.510 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:23:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:11 smithi040 ceph-mon[32397]: pgmap v2327: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:23:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:11 smithi146 ceph-mon[35807]: pgmap v2327: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:23:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:11 smithi076 ceph-mon[35401]: pgmap v2327: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.8 MiB/s wr, 12 op/s 2024-07-26T13:23:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:13 smithi040 ceph-mon[32397]: pgmap v2328: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T13:23:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:23:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:23:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:13 smithi146 ceph-mon[35807]: pgmap v2328: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T13:23:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:23:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:23:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:13 smithi076 ceph-mon[35401]: pgmap v2328: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2024-07-26T13:23:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:23:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:23:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:23:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:15 smithi040 ceph-mon[32397]: pgmap v2329: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T13:23:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:15 smithi146 ceph-mon[35807]: pgmap v2329: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T13:23:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:15 smithi076 ceph-mon[35401]: pgmap v2329: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-07-26T13:23:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:17 smithi040 ceph-mon[32397]: pgmap v2330: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 804 KiB/s wr, 10 op/s 2024-07-26T13:23:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:17 smithi146 ceph-mon[35807]: pgmap v2330: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 804 KiB/s wr, 10 op/s 2024-07-26T13:23:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:17 smithi076 ceph-mon[35401]: pgmap v2330: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 804 KiB/s wr, 10 op/s 2024-07-26T13:23:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:19 smithi040 ceph-mon[32397]: pgmap v2331: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 122 KiB/s wr, 10 op/s 2024-07-26T13:23:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:19 smithi146 ceph-mon[35807]: pgmap v2331: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 122 KiB/s wr, 10 op/s 2024-07-26T13:23:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:19 smithi076 ceph-mon[35401]: pgmap v2331: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 122 KiB/s wr, 10 op/s 2024-07-26T13:23:21.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:23:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:21 smithi040 ceph-mon[32397]: pgmap v2332: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-07-26T13:23:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:21 smithi146 ceph-mon[35807]: pgmap v2332: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-07-26T13:23:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:21 smithi076 ceph-mon[35401]: pgmap v2332: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-07-26T13:23:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:23:23.442 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:23 smithi040 ceph-mon[32397]: pgmap v2333: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:23:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:23 smithi146 ceph-mon[35807]: pgmap v2333: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:23:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:23 smithi076 ceph-mon[35401]: pgmap v2333: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.385+0000 7ff5aea00640 1 -- 172.21.15.40:0/1876756216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8108530 msgr2=0x7ff5a810ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.385+0000 7ff5aea00640 1 --2- 172.21.15.40:0/1876756216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8108530 0x7ff5a810ed60 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009ca0 tx=0x7ff5a002a8c0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 -- 172.21.15.40:0/1876756216 shutdown_connections 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 --2- 172.21.15.40:0/1876756216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8108530 0x7ff5a810ed60 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 --2- 172.21.15.40:0/1876756216 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5a8107be0 0x7ff5a8107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 --2- 172.21.15.40:0/1876756216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 0x7ff5a81026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 -- 172.21.15.40:0/1876756216 >> 172.21.15.40:0/1876756216 conn(0x7ff5a80fdcf0 msgr2=0x7ff5a8100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 -- 172.21.15.40:0/1876756216 shutdown_connections 2024-07-26T13:23:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.386+0000 7ff5aea00640 1 -- 172.21.15.40:0/1876756216 wait complete. 2024-07-26T13:23:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.387+0000 7ff5aea00640 1 Processor -- start 2024-07-26T13:23:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.387+0000 7ff5aea00640 1 -- start start 2024-07-26T13:23:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5aea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 0x7ff5a819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5aea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 0x7ff5a819c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5aea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5a8108530 0x7ff5a81a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5aea00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81120e0 con 0x7ff5a8107be0 2024-07-26T13:23:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5aea00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8111f60 con 0x7ff5a8108530 2024-07-26T13:23:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5aea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8112260 con 0x7ff5a81022a0 2024-07-26T13:23:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5acc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 0x7ff5a819c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:24.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5acc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 0x7ff5a819c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44062/0 (socket says 172.21.15.40:44062) 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.388+0000 7ff5acc00640 1 -- 172.21.15.40:0/3685421574 learned_addr learned my addr 172.21.15.40:0/3685421574 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5ad600640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 0x7ff5a819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5ae000640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5a8108530 0x7ff5a81a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5acc00640 1 -- 172.21.15.40:0/3685421574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 msgr2=0x7ff5a819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5acc00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 0x7ff5a819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5acc00640 1 -- 172.21.15.40:0/3685421574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5a8108530 msgr2=0x7ff5a81a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5acc00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5a8108530 0x7ff5a81a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5acc00640 1 -- 172.21.15.40:0/3685421574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a81a1da0 con 0x7ff5a8107be0 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5ad600640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 0x7ff5a819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:23:24.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.389+0000 7ff5acc00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 0x7ff5a819c3d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ff59400d740 tx=0x7ff59400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.390+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594017070 con 0x7ff5a8107be0 2024-07-26T13:23:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.390+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff59400de50 con 0x7ff5a8107be0 2024-07-26T13:23:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.390+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59400f620 con 0x7ff5a8107be0 2024-07-26T13:23:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.390+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a81a2090 con 0x7ff5a8107be0 2024-07-26T13:23:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.390+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a81a87f0 con 0x7ff5a8107be0 2024-07-26T13:23:24.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.392+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a81026b0 con 0x7ff5a8107be0 2024-07-26T13:23:24.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.394+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff59401a070 con 0x7ff5a8107be0 2024-07-26T13:23:24.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.396+0000 7ff5a6000640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff5900b3c50 0x7ff5900b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:24.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.397+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff5940e3510 con 0x7ff5a8107be0 2024-07-26T13:23:24.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.397+0000 7ff5ad600640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff5900b3c50 0x7ff5900b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:24.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.398+0000 7ff5ad600640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff5900b3c50 0x7ff5900b6160 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0058c0 tx=0x7ff59c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:24.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.398+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ff5940aaba0 con 0x7ff5a8107be0 2024-07-26T13:23:24.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.640+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5a819cf60 con 0x7ff5a8107be0 2024-07-26T13:23:24.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.641+0000 7ff5a6000640 1 -- 172.21.15.40:0/3685421574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7ff5940b1e20 con 0x7ff5a8107be0 2024-07-26T13:23:24.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:23:24.643 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:23:24.644 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:23:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.644+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff5900b3c50 msgr2=0x7ff5900b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.644+0000 7ff5aea00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff5900b3c50 0x7ff5900b6160 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0058c0 tx=0x7ff59c005850 comp rx=0 tx=0).stop 2024-07-26T13:23:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.644+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 msgr2=0x7ff5a819c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.644+0000 7ff5aea00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 0x7ff5a819c3d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ff59400d740 tx=0x7ff59400dc00 comp rx=0 tx=0).stop 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 shutdown_connections 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff5a8108530 0x7ff5a81a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a8107be0 0x7ff5a819c3d0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff5900b3c50 0x7ff5900b6160 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 --2- 172.21.15.40:0/3685421574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5a81022a0 0x7ff5a819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 >> 172.21.15.40:0/3685421574 conn(0x7ff5a80fdcf0 msgr2=0x7ff5a8106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 shutdown_connections 2024-07-26T13:23:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:24.645+0000 7ff5aea00640 1 -- 172.21.15.40:0/3685421574 wait complete. 2024-07-26T13:23:25.564 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 46bb2212 --release --await' 2024-07-26T13:23:25.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 46bb2212 --release --await 2024-07-26T13:23:25.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:25 smithi040 ceph-mon[32397]: pgmap v2334: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T13:23:25.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3685421574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:23:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:25 smithi146 ceph-mon[35807]: pgmap v2334: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T13:23:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3685421574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:23:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:25 smithi076 ceph-mon[35401]: pgmap v2334: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-07-26T13:23:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3685421574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:23:26.125 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:23:26.630 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:26 smithi040 ceph-mon[32397]: pgmap v2335: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T13:23:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:26 smithi146 ceph-mon[35807]: pgmap v2335: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T13:23:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:26 smithi076 ceph-mon[35401]: pgmap v2335: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-07-26T13:23:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 -- 172.21.15.40:0/75365407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82601055c0 msgr2=0x7f82601059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 --2- 172.21.15.40:0/75365407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82601055c0 0x7f82601059d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f8254009900 tx=0x7f825402a410 comp rx=0 tx=0).stop 2024-07-26T13:23:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 -- 172.21.15.40:0/75365407 shutdown_connections 2024-07-26T13:23:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 --2- 172.21.15.40:0/75365407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f826010b850 0x7f8260112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 --2- 172.21.15.40:0/75365407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f826010af00 0x7f826010b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 --2- 172.21.15.40:0/75365407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82601055c0 0x7f82601059d0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 -- 172.21.15.40:0/75365407 >> 172.21.15.40:0/75365407 conn(0x7f8260101010 msgr2=0x7f8260103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 -- 172.21.15.40:0/75365407 shutdown_connections 2024-07-26T13:23:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.555+0000 7f8267200640 1 -- 172.21.15.40:0/75365407 wait complete. 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 Processor -- start 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 -- start start 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82601055c0 0x7f826019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f826010af00 0x7f826019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 0x7f82601a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8260115420 con 0x7f826010b850 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f82601152a0 con 0x7f82601055c0 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.557+0000 7f8267200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82601155a0 con 0x7f826010af00 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 0x7f82601a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 0x7f82601a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44076/0 (socket says 172.21.15.40:44076) 2024-07-26T13:23:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 -- 172.21.15.40:0/1799906792 learned_addr learned my addr 172.21.15.40:0/1799906792 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8265400640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f826010af00 0x7f826019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8265e00640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82601055c0 0x7f826019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 -- 172.21.15.40:0/1799906792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f826010af00 msgr2=0x7f826019c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f826010af00 0x7f826019c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 -- 172.21.15.40:0/1799906792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82601055c0 msgr2=0x7f826019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82601055c0 0x7f826019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8266800640 1 -- 172.21.15.40:0/1799906792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82601a1de0 con 0x7f826010b850 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.558+0000 7f8265e00640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82601055c0 0x7f826019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.559+0000 7f8266800640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 0x7f82601a16b0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f825c00eaa0 tx=0x7f825c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.559+0000 7f825aa00640 1 -- 172.21.15.40:0/1799906792 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c00cdb0 con 0x7f826010b850 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.559+0000 7f825aa00640 1 -- 172.21.15.40:0/1799906792 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f825c005020 con 0x7f826010b850 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.559+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82601a20d0 con 0x7f826010b850 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.559+0000 7f825aa00640 1 -- 172.21.15.40:0/1799906792 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0116d0 con 0x7f826010b850 2024-07-26T13:23:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.559+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82601a8830 con 0x7f826010b850 2024-07-26T13:23:28.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.563+0000 7f826f48c740 1 Processor -- start 2024-07-26T13:23:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.564+0000 7f825aa00640 1 -- 172.21.15.40:0/1799906792 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f825c0051d0 con 0x7f826010b850 2024-07-26T13:23:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.564+0000 7f826f48c740 1 -- start start 2024-07-26T13:23:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.564+0000 7f826f48c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.564+0000 7f826f48c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f826f48c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f826f48c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c37811cf30 con 0x55c377de0840 2024-07-26T13:23:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f826f48c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c37810c430 con 0x55c377dd8660 2024-07-26T13:23:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f826f48c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c378110470 con 0x55c377e01520 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f8265400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f8265400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44080/0 (socket says 172.21.15.40:44080) 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f8265400640 1 -- 172.21.15.40:0/1127197420 learned_addr learned my addr 172.21.15.40:0/1127197420 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f8265e00640 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.565+0000 7f8265400640 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265400640 1 -- 172.21.15.40:0/1127197420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 msgr2=0x55c3781a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265400640 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265400640 1 -- 172.21.15.40:0/1127197420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 msgr2=0x55c3781a66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265400640 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781a66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265400640 1 -- 172.21.15.40:0/1127197420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c377e6cb00 con 0x55c377de0840 2024-07-26T13:23:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f825aa00640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82480b3bd0 0x7f82480b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265400640 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781a6c00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f8250005d00 tx=0x7f8250005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4705d91b05cae241 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f825aa00640 1 -- 172.21.15.40:0/1799906792 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f825c0e3df0 con 0x7f826010b850 2024-07-26T13:23:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.566+0000 7f8265e00640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82480b3bd0 0x7f82480b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.567+0000 7f824f000640 1 -- 172.21.15.40:0/1127197420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250012ca0 con 0x55c377de0840 2024-07-26T13:23:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.567+0000 7f824f000640 1 -- 172.21.15.40:0/1127197420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8250012e40 con 0x55c377de0840 2024-07-26T13:23:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.567+0000 7f824f000640 1 -- 172.21.15.40:0/1127197420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250004a00 con 0x55c377de0840 2024-07-26T13:23:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 -- 172.21.15.40:0/1127197420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 msgr2=0x55c3781a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f8265e00640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82480b3bd0 0x7f82480b60e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8254006010 tx=0x7f8254009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781a6c00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f8250005d00 tx=0x7f8250005c90 comp rx=0 tx=0).stop 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 -- 172.21.15.40:0/1127197420 shutdown_connections 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781a6c00 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781a66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 --2- 172.21.15.40:0/1127197420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 -- 172.21.15.40:0/1127197420 >> 172.21.15.40:0/1127197420 conn(0x55c377df5910 msgr2=0x55c3781a4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 -- 172.21.15.40:0/1127197420 shutdown_connections 2024-07-26T13:23:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.568+0000 7f826f48c740 1 -- 172.21.15.40:0/1127197420 wait complete. 2024-07-26T13:23:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.569+0000 7f826f48c740 1 -- start start 2024-07-26T13:23:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.569+0000 7f826f48c740 1 Processor -- start 2024-07-26T13:23:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377dd8660 0x55c3781b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377de0840 0x55c3781b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 0x55c3781bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55c377f6fbb0 con 0x55c377e01520 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c3780a8910 con 0x55c377de0840 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c3781b4960 con 0x55c377dd8660 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f826f48c740 10 client.0 _ll_register_callbacks cb 0x55c377e18d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f8266800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 0x55c3781bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f8266800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 0x55c3781bdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44084/0 (socket says 172.21.15.40:44084) 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f8266800640 1 -- 172.21.15.40:0/344578718 learned_addr learned my addr 172.21.15.40:0/344578718 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f8265400640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377de0840 0x55c3781b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.570+0000 7f8265e00640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377dd8660 0x55c3781b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8266800640 1 -- 172.21.15.40:0/344578718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377dd8660 msgr2=0x55c3781b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8266800640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377dd8660 0x55c3781b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8266800640 1 -- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377de0840 msgr2=0x55c3781b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8266800640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377de0840 0x55c3781b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8266800640 1 -- 172.21.15.40:0/344578718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c377ee3960 con 0x55c377e01520 2024-07-26T13:23:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8265e00640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377dd8660 0x55c3781b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:23:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8266800640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 0x55c3781bdc80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f825c0aac90 tx=0x7f825c0aa970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb6c928c9ca4a6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8243400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:23:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8243400640 1 -- 172.21.15.40:0/344578718 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c01f040 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f8243400640 1 -- 172.21.15.40:0/344578718 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f825c0a9f60 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.571+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c37811ee80 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f8243400640 1 -- 172.21.15.40:0/344578718 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f825c0b3db0 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 10 client.17946 fetch_fsmap learned FSMap version 35 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c3781c06d0 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f8243400640 1 -- 172.21.15.40:0/344578718 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c37811ee80 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f8243400640 1 -- 172.21.15.40:0/344578718 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f825c00f040 con 0x55c377e01520 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 10 client.17946 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 10 client.17946 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 20 client.17946 populate_metadata read hostname 'smithi040' 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377dbfea0 0x55c3781c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 4 client.17946 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:23:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.572+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c37811a920 con 0x55c377dbfea0 2024-07-26T13:23:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.573+0000 7f8265e00640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377dbfea0 0x55c3781c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.575+0000 7f8265e00640 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377dbfea0 0x55c3781c3a70 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d296e52616e4177c server_cookie=d3fdcddda7b94477 in_seq=0 out_seq=0 2024-07-26T13:23:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.575+0000 7f8243400640 10 client.17946 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.576+0000 7f8243400640 1 -- 172.21.15.40:0/344578718 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c37811a920 con 0x55c377dbfea0 2024-07-26T13:23:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f8243400640 10 client.17946 handle_command_reply: tid=0 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 client.17946 shutdown 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 msgr2=0x55c3781bdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 0x55c3781bdc80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f825c0aac90 tx=0x7f825c0aa970 comp rx=0 tx=0).stop 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 shutdown_connections 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377dbfea0 0x55c3781c3a70 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377e01520 0x55c3781bdc80 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377de0840 0x55c3781b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 --2- 172.21.15.40:0/344578718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377dd8660 0x55c3781b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f8243400640 0 client.17946 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 >> 172.21.15.40:0/344578718 conn(0x55c377df5910 msgr2=0x55c3781a9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 shutdown_connections 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 1 -- 172.21.15.40:0/344578718 wait complete. 2024-07-26T13:23:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.577+0000 7f826f48c740 20 client.17946 trim_cache size 0 max 16384 2024-07-26T13:23:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 Processor -- start 2024-07-26T13:23:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 -- start start 2024-07-26T13:23:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b0d80 con 0x55c377de0840 2024-07-26T13:23:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b28c0 con 0x55c377dd8660 2024-07-26T13:23:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.597+0000 7f826f48c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b1450 con 0x55c377e01520 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44094/0 (socket says 172.21.15.40:44094) 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 -- 172.21.15.40:0/1276362140 learned_addr learned my addr 172.21.15.40:0/1276362140 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265e00640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8266800640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 -- 172.21.15.40:0/1276362140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 msgr2=0x55c3781c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 -- 172.21.15.40:0/1276362140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 msgr2=0x55c3781b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265400640 1 -- 172.21.15.40:0/1276362140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3781afd10 con 0x55c377de0840 2024-07-26T13:23:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8265e00640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:23:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.598+0000 7f8266800640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:23:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.599+0000 7f8265400640 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781c9230 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f825000ba60 tx=0x7f825000ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2a02c6d7925bc5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.599+0000 7f824e600640 1 -- 172.21.15.40:0/1276362140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82500054e0 con 0x55c377de0840 2024-07-26T13:23:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.599+0000 7f824e600640 1 -- 172.21.15.40:0/1276362140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8250016070 con 0x55c377de0840 2024-07-26T13:23:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.599+0000 7f824e600640 1 -- 172.21.15.40:0/1276362140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250010d70 con 0x55c377de0840 2024-07-26T13:23:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.600+0000 7f826f48c740 1 -- 172.21.15.40:0/1276362140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 msgr2=0x55c3781c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.600+0000 7f826f48c740 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781c9230 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f825000ba60 tx=0x7f825000ba90 comp rx=0 tx=0).stop 2024-07-26T13:23:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 -- 172.21.15.40:0/1276362140 shutdown_connections 2024-07-26T13:23:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377e01520 0x55c3781c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377de0840 0x55c3781c9230 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 --2- 172.21.15.40:0/1276362140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377dd8660 0x55c3781b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 -- 172.21.15.40:0/1276362140 >> 172.21.15.40:0/1276362140 conn(0x55c377df5910 msgr2=0x55c3781a7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 -- 172.21.15.40:0/1276362140 shutdown_connections 2024-07-26T13:23:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 -- 172.21.15.40:0/1276362140 wait complete. 2024-07-26T13:23:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 -- start start 2024-07-26T13:23:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.601+0000 7f826f48c740 1 Processor -- start 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 0x55c3781b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377de0840 0x55c3781b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377e01520 0x55c3781b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b21f0 con 0x55c377dd8660 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b1b20 con 0x55c377e01520 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82601aed40 con 0x55c377de0840 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.602+0000 7f826f48c740 10 client.0 _ll_register_callbacks cb 0x7f825c0a6bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 0x55c3781b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 0x55c3781b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44104/0 (socket says 172.21.15.40:44104) 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 -- 172.21.15.40:0/2013506432 learned_addr learned my addr 172.21.15.40:0/2013506432 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265400640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377de0840 0x55c3781b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8266800640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377e01520 0x55c3781b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 -- 172.21.15.40:0/2013506432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377de0840 msgr2=0x55c3781b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377de0840 0x55c3781b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 -- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377e01520 msgr2=0x55c3781b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377e01520 0x55c3781b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8265e00640 1 -- 172.21.15.40:0/2013506432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37822b230 con 0x55c377dd8660 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.603+0000 7f8266800640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377e01520 0x55c3781b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f8265e00640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 0x55c3781b5ae0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f825402aa00 tx=0x7f8254009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627f0be37bd18e3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f8243400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:23:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f8243400640 1 -- 172.21.15.40:0/2013506432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254035040 con 0x55c377dd8660 2024-07-26T13:23:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f8243400640 1 -- 172.21.15.40:0/2013506432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8254004c50 con 0x55c377dd8660 2024-07-26T13:23:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8250016070 con 0x55c377dd8660 2024-07-26T13:23:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f8243400640 1 -- 172.21.15.40:0/2013506432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8254004e50 con 0x55c377dd8660 2024-07-26T13:23:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f826f48c740 10 client.17952 fetch_fsmap learned FSMap version 35 2024-07-26T13:23:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.604+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c37822c4f0 con 0x55c377dd8660 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f8243400640 1 -- 172.21.15.40:0/2013506432 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8250016070 con 0x55c377dd8660 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f8243400640 1 -- 172.21.15.40:0/2013506432 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f825403c6b0 con 0x55c377dd8660 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f826f48c740 10 client.17952 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f826f48c740 10 client.17952 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f826f48c740 20 client.17952 populate_metadata read hostname 'smithi040' 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f826f48c740 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377d95250 0x55c37822ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f826f48c740 4 client.17952 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "46bb2212", "release": true, "await": true}] 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.605+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "46bb2212", "release": true, "await": true}) -- 0x55c378118060 con 0x55c377d95250 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.606+0000 7f8265400640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377d95250 0x55c37822ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:23:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.607+0000 7f8265400640 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377d95250 0x55c37822ece0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41d0b30d51f4b2dd server_cookie=f58fc0830b147ce3 in_seq=0 out_seq=0 2024-07-26T13:23:28.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.607+0000 7f8243400640 10 client.17952 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:28.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f8243400640 1 -- 172.21.15.40:0/2013506432 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55c378118060 con 0x55c377d95250 2024-07-26T13:23:28.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f8243400640 10 client.17952 handle_command_reply: tid=0 2024-07-26T13:23:28.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 client.17952 shutdown 2024-07-26T13:23:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 msgr2=0x55c3781b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 0x55c3781b5ae0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f825402aa00 tx=0x7f8254009260 comp rx=0 tx=0).stop 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 shutdown_connections 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c377e01520 0x55c3781b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c377de0840 0x55c3781b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.653+0000 7f826f48c740 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55c377d95250 0x55c37822ece0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.654+0000 7f826f48c740 1 --2- 172.21.15.40:0/2013506432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55c377dd8660 0x55c3781b5ae0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.654+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 >> 172.21.15.40:0/2013506432 conn(0x55c377df5910 msgr2=0x55c3781a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.654+0000 7f8243400640 0 client.17952 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.654+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 shutdown_connections 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.654+0000 7f826f48c740 1 -- 172.21.15.40:0/2013506432 wait complete. 2024-07-26T13:23:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.654+0000 7f826f48c740 20 client.17952 trim_cache size 0 max 16384 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 208, 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "46bb2212": { 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 208, 2024-07-26T13:23:28.657 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 150.0, 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:23:28.658 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:28.659 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:28.659 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:28.659 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:28.659 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:23:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:23:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82480b3bd0 msgr2=0x7f82480b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82480b3bd0 0x7f82480b60e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8254006010 tx=0x7f8254009560 comp rx=0 tx=0).stop 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 msgr2=0x7f82601a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 0x7f82601a16b0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f825c00eaa0 tx=0x7f825c00ef60 comp rx=0 tx=0).stop 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 shutdown_connections 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826010b850 0x7f82601a16b0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f82480b3bd0 0x7f82480b60e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f826010af00 0x7f826019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 --2- 172.21.15.40:0/1799906792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82601055c0 0x7f826019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 >> 172.21.15.40:0/1799906792 conn(0x7f8260101010 msgr2=0x7f8260103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.656+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 shutdown_connections 2024-07-26T13:23:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:23:28.657+0000 7f8267200640 1 -- 172.21.15.40:0/1799906792 wait complete. 2024-07-26T13:23:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:29 smithi146 ceph-mon[35807]: pgmap v2336: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:23:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:29 smithi076 ceph-mon[35401]: pgmap v2336: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:23:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:29 smithi040 ceph-mon[32397]: pgmap v2336: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:23:29.627 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '46bb2212', total seconds elapsed: 37.9 2024-07-26T13:23:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:31 smithi146 ceph-mon[35807]: pgmap v2337: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:23:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:31 smithi076 ceph-mon[35401]: pgmap v2337: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:23:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:31 smithi040 ceph-mon[32397]: pgmap v2337: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:23:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:33 smithi146 ceph-mon[35807]: pgmap v2338: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:23:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:33 smithi076 ceph-mon[35401]: pgmap v2338: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:23:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:33 smithi040 ceph-mon[32397]: pgmap v2338: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-07-26T13:23:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:35 smithi146 ceph-mon[35807]: pgmap v2339: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 220 KiB/s wr, 10 op/s 2024-07-26T13:23:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:35 smithi076 ceph-mon[35401]: pgmap v2339: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 220 KiB/s wr, 10 op/s 2024-07-26T13:23:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:35 smithi040 ceph-mon[32397]: pgmap v2339: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 220 KiB/s wr, 10 op/s 2024-07-26T13:23:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:37 smithi146 ceph-mon[35807]: pgmap v2340: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T13:23:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:37 smithi076 ceph-mon[35401]: pgmap v2340: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T13:23:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:37 smithi040 ceph-mon[32397]: pgmap v2340: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T13:23:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:39 smithi146 ceph-mon[35807]: pgmap v2341: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-07-26T13:23:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:39 smithi076 ceph-mon[35401]: pgmap v2341: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-07-26T13:23:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:39 smithi040 ceph-mon[32397]: pgmap v2341: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 MiB/s wr, 10 op/s 2024-07-26T13:23:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:41 smithi040 ceph-mon[32397]: pgmap v2342: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T13:23:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:41 smithi146 ceph-mon[35807]: pgmap v2342: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T13:23:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:41 smithi076 ceph-mon[35401]: pgmap v2342: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-07-26T13:23:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:43 smithi040 ceph-mon[32397]: pgmap v2343: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.2 MiB/s wr, 9 op/s 2024-07-26T13:23:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:43 smithi146 ceph-mon[35807]: pgmap v2343: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.2 MiB/s wr, 9 op/s 2024-07-26T13:23:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:43 smithi076 ceph-mon[35401]: pgmap v2343: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.2 MiB/s wr, 9 op/s 2024-07-26T13:23:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:45 smithi146 ceph-mon[35807]: pgmap v2344: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.2 MiB/s wr, 13 op/s 2024-07-26T13:23:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:45 smithi076 ceph-mon[35401]: pgmap v2344: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.2 MiB/s wr, 13 op/s 2024-07-26T13:23:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:45 smithi040 ceph-mon[32397]: pgmap v2344: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.2 MiB/s wr, 13 op/s 2024-07-26T13:23:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:47 smithi146 ceph-mon[35807]: pgmap v2345: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:23:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:47 smithi076 ceph-mon[35401]: pgmap v2345: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:23:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:47 smithi040 ceph-mon[32397]: pgmap v2345: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:23:49.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:49 smithi040 ceph-mon[32397]: pgmap v2346: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:23:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:49 smithi146 ceph-mon[35807]: pgmap v2346: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:23:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:49 smithi076 ceph-mon[35401]: pgmap v2346: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:23:51.475 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:51 smithi040 ceph-mon[32397]: pgmap v2347: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:23:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:51 smithi146 ceph-mon[35807]: pgmap v2347: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:23:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:51 smithi076 ceph-mon[35401]: pgmap v2347: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:23:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:53 smithi146 ceph-mon[35807]: pgmap v2348: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:23:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:53 smithi076 ceph-mon[35401]: pgmap v2348: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:23:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:53 smithi040 ceph-mon[32397]: pgmap v2348: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-07-26T13:23:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:55 smithi146 ceph-mon[35807]: pgmap v2349: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:23:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:55 smithi076 ceph-mon[35401]: pgmap v2349: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:23:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:55 smithi040 ceph-mon[32397]: pgmap v2349: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:23:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:57 smithi146 ceph-mon[35807]: pgmap v2350: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:23:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:57 smithi076 ceph-mon[35401]: pgmap v2350: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:23:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:57 smithi040 ceph-mon[32397]: pgmap v2350: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:23:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:23:59 smithi146 ceph-mon[35807]: pgmap v2351: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:23:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:23:59 smithi076 ceph-mon[35401]: pgmap v2351: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:23:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:23:59 smithi040 ceph-mon[32397]: pgmap v2351: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:01 smithi146 ceph-mon[35807]: pgmap v2352: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:24:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:01 smithi076 ceph-mon[35401]: pgmap v2352: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:24:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:01 smithi040 ceph-mon[32397]: pgmap v2352: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:24:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:03 smithi146 ceph-mon[35807]: pgmap v2353: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:24:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:03 smithi076 ceph-mon[35401]: pgmap v2353: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:24:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:03 smithi040 ceph-mon[32397]: pgmap v2353: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:24:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:05 smithi146 ceph-mon[35807]: pgmap v2354: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:24:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:05 smithi076 ceph-mon[35401]: pgmap v2354: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:24:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:05 smithi040 ceph-mon[32397]: pgmap v2354: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:24:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:07 smithi076 ceph-mon[35401]: pgmap v2355: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:07 smithi040 ceph-mon[32397]: pgmap v2355: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:07 smithi146 ceph-mon[35807]: pgmap v2355: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:09 smithi076 ceph-mon[35401]: pgmap v2356: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:09 smithi040 ceph-mon[32397]: pgmap v2356: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:09 smithi146 ceph-mon[35807]: pgmap v2356: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:11 smithi040 ceph-mon[32397]: pgmap v2357: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:24:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:11 smithi146 ceph-mon[35807]: pgmap v2357: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:24:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:11 smithi076 ceph-mon[35401]: pgmap v2357: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:24:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:13 smithi040 ceph-mon[32397]: pgmap v2358: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:24:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:13 smithi146 ceph-mon[35807]: pgmap v2358: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:24:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:13 smithi076 ceph-mon[35401]: pgmap v2358: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:24:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:24:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:24:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:24:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:24:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:24:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:24:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:24:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:24:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:24:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:15 smithi040 ceph-mon[32397]: pgmap v2359: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:24:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:15 smithi146 ceph-mon[35807]: pgmap v2359: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:24:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:15 smithi076 ceph-mon[35401]: pgmap v2359: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 14 op/s 2024-07-26T13:24:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:17 smithi040 ceph-mon[32397]: pgmap v2360: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:17 smithi146 ceph-mon[35807]: pgmap v2360: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:17 smithi076 ceph-mon[35401]: pgmap v2360: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:19 smithi040 ceph-mon[32397]: pgmap v2361: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:19 smithi146 ceph-mon[35807]: pgmap v2361: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:19 smithi076 ceph-mon[35401]: pgmap v2361: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:21 smithi040 ceph-mon[32397]: pgmap v2362: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:24:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:21 smithi146 ceph-mon[35807]: pgmap v2362: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:24:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:21 smithi076 ceph-mon[35401]: pgmap v2362: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:24:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:23 smithi040 ceph-mon[32397]: pgmap v2363: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:24:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:23 smithi146 ceph-mon[35807]: pgmap v2363: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:24:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:23 smithi076 ceph-mon[35401]: pgmap v2363: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:24:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:25 smithi040 ceph-mon[32397]: pgmap v2364: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:24:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:25 smithi146 ceph-mon[35807]: pgmap v2364: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:24:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:25 smithi076 ceph-mon[35401]: pgmap v2364: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:24:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:27 smithi040 ceph-mon[32397]: pgmap v2365: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:27 smithi146 ceph-mon[35807]: pgmap v2365: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:27 smithi076 ceph-mon[35401]: pgmap v2365: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:28 smithi040 ceph-mon[32397]: pgmap v2366: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:24:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:28 smithi146 ceph-mon[35807]: pgmap v2366: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:24:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:28 smithi076 ceph-mon[35401]: pgmap v2366: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:24:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:31 smithi146 ceph-mon[35807]: pgmap v2367: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T13:24:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:31 smithi076 ceph-mon[35401]: pgmap v2367: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T13:24:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:31 smithi040 ceph-mon[32397]: pgmap v2367: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-07-26T13:24:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:33 smithi146 ceph-mon[35807]: pgmap v2368: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:24:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:33 smithi076 ceph-mon[35401]: pgmap v2368: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:24:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:33 smithi040 ceph-mon[32397]: pgmap v2368: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.0 MiB/s wr, 10 op/s 2024-07-26T13:24:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:35 smithi146 ceph-mon[35807]: pgmap v2369: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:24:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:35 smithi076 ceph-mon[35401]: pgmap v2369: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:24:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:35 smithi040 ceph-mon[32397]: pgmap v2369: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:24:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:37 smithi146 ceph-mon[35807]: pgmap v2370: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:37 smithi076 ceph-mon[35401]: pgmap v2370: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:37 smithi040 ceph-mon[32397]: pgmap v2370: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:39 smithi146 ceph-mon[35807]: pgmap v2371: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:39 smithi076 ceph-mon[35401]: pgmap v2371: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:39 smithi040 ceph-mon[32397]: pgmap v2371: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:24:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:41 smithi076 ceph-mon[35401]: pgmap v2372: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:41 smithi040 ceph-mon[32397]: pgmap v2372: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:41 smithi146 ceph-mon[35807]: pgmap v2372: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:43 smithi076 ceph-mon[35401]: pgmap v2373: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:24:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:43 smithi040 ceph-mon[32397]: pgmap v2373: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:24:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:43 smithi146 ceph-mon[35807]: pgmap v2373: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-07-26T13:24:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:45 smithi040 ceph-mon[32397]: pgmap v2374: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:24:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:45 smithi146 ceph-mon[35807]: pgmap v2374: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:24:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:45 smithi076 ceph-mon[35401]: pgmap v2374: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 MiB/s wr, 13 op/s 2024-07-26T13:24:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:47 smithi040 ceph-mon[32397]: pgmap v2375: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:47 smithi146 ceph-mon[35807]: pgmap v2375: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:47 smithi076 ceph-mon[35401]: pgmap v2375: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:49 smithi040 ceph-mon[32397]: pgmap v2376: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:49 smithi146 ceph-mon[35807]: pgmap v2376: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:49 smithi076 ceph-mon[35401]: pgmap v2376: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:24:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:51 smithi040 ceph-mon[32397]: pgmap v2377: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:24:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:51 smithi146 ceph-mon[35807]: pgmap v2377: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:24:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:51 smithi076 ceph-mon[35401]: pgmap v2377: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:24:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:53 smithi040 ceph-mon[32397]: pgmap v2378: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:24:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:53 smithi146 ceph-mon[35807]: pgmap v2378: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:24:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:53 smithi076 ceph-mon[35401]: pgmap v2378: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:24:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:55 smithi040 ceph-mon[32397]: pgmap v2379: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:24:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:55 smithi146 ceph-mon[35807]: pgmap v2379: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:24:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:55 smithi076 ceph-mon[35401]: pgmap v2379: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:24:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:57 smithi040 ceph-mon[32397]: pgmap v2380: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:57 smithi146 ceph-mon[35807]: pgmap v2380: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:57 smithi076 ceph-mon[35401]: pgmap v2380: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:24:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:24:59 smithi040 ceph-mon[32397]: pgmap v2381: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:24:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:24:59 smithi146 ceph-mon[35807]: pgmap v2381: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:24:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:24:59 smithi076 ceph-mon[35401]: pgmap v2381: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:01 smithi040 ceph-mon[32397]: pgmap v2382: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:25:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:01 smithi146 ceph-mon[35807]: pgmap v2382: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:25:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:01 smithi076 ceph-mon[35401]: pgmap v2382: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-07-26T13:25:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:03 smithi040 ceph-mon[32397]: pgmap v2383: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:03 smithi146 ceph-mon[35807]: pgmap v2383: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:03 smithi076 ceph-mon[35401]: pgmap v2383: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:05 smithi040 ceph-mon[32397]: pgmap v2384: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:05 smithi146 ceph-mon[35807]: pgmap v2384: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:05 smithi076 ceph-mon[35401]: pgmap v2384: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:07 smithi040 ceph-mon[32397]: pgmap v2385: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:25:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:07 smithi146 ceph-mon[35807]: pgmap v2385: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:25:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:07 smithi076 ceph-mon[35401]: pgmap v2385: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-07-26T13:25:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:09 smithi040 ceph-mon[32397]: pgmap v2386: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:25:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:09 smithi146 ceph-mon[35807]: pgmap v2386: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:25:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:09 smithi076 ceph-mon[35401]: pgmap v2386: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:25:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:11 smithi040 ceph-mon[32397]: pgmap v2387: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:25:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:11 smithi146 ceph-mon[35807]: pgmap v2387: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:25:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:11 smithi076 ceph-mon[35401]: pgmap v2387: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:25:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:13 smithi040 ceph-mon[32397]: pgmap v2388: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:13 smithi146 ceph-mon[35807]: pgmap v2388: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:13 smithi076 ceph-mon[35401]: pgmap v2388: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:15 smithi040 ceph-mon[32397]: pgmap v2389: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:25:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:25:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:15 smithi146 ceph-mon[35807]: pgmap v2389: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:25:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:25:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:15 smithi076 ceph-mon[35401]: pgmap v2389: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.7 MiB/s wr, 14 op/s 2024-07-26T13:25:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:25:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:25:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:25:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:25:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:25:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:25:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:25:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:25:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:25:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:25:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:17 smithi040 ceph-mon[32397]: pgmap v2390: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:25:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:17 smithi146 ceph-mon[35807]: pgmap v2390: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:25:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:17 smithi076 ceph-mon[35401]: pgmap v2390: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:25:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:19 smithi040 ceph-mon[32397]: pgmap v2391: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:19 smithi146 ceph-mon[35807]: pgmap v2391: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:19 smithi076 ceph-mon[35401]: pgmap v2391: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:25:21.057 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.1 2024-07-26T13:25:21.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:25:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:21 smithi040 ceph-mon[32397]: pgmap v2392: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:25:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:21 smithi146 ceph-mon[35807]: pgmap v2392: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:25:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:21 smithi076 ceph-mon[35401]: pgmap v2392: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:25:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:25:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:23 smithi040 ceph-mon[32397]: pgmap v2393: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:23 smithi146 ceph-mon[35807]: pgmap v2393: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:23 smithi076 ceph-mon[35401]: pgmap v2393: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 MiB/s wr, 10 op/s 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 -- 172.21.15.40:0/2109635143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc460109be0 msgr2=0x7fc460109ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 --2- 172.21.15.40:0/2109635143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc460109be0 0x7fc460109ff0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc450009900 tx=0x7fc45002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 -- 172.21.15.40:0/2109635143 shutdown_connections 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 --2- 172.21.15.40:0/2109635143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc46010fe70 0x7fc4601166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 --2- 172.21.15.40:0/2109635143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc46010f520 0x7fc46010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 --2- 172.21.15.40:0/2109635143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc460109be0 0x7fc460109ff0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 -- 172.21.15.40:0/2109635143 >> 172.21.15.40:0/2109635143 conn(0x7fc460077b10 msgr2=0x7fc460107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 -- 172.21.15.40:0/2109635143 shutdown_connections 2024-07-26T13:25:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.781+0000 7fc467200640 1 -- 172.21.15.40:0/2109635143 wait complete. 2024-07-26T13:25:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.783+0000 7fc467200640 1 Processor -- start 2024-07-26T13:25:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.783+0000 7fc467200640 1 -- start start 2024-07-26T13:25:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc467200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc460109be0 0x7fc4601a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc467200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 0x7fc4601a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc467200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc46010fe70 0x7fc4601a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc467200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601199e0 con 0x7fc46010f520 2024-07-26T13:25:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc467200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc460119860 con 0x7fc460109be0 2024-07-26T13:25:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc467200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc460119b60 con 0x7fc46010fe70 2024-07-26T13:25:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc457400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 0x7fc4601a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc457400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 0x7fc4601a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39992/0 (socket says 172.21.15.40:39992) 2024-07-26T13:25:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.784+0000 7fc457400640 1 -- 172.21.15.40:0/1398533146 learned_addr learned my addr 172.21.15.40:0/1398533146 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc45fe00640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc460109be0 0x7fc4601a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc465200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc46010fe70 0x7fc4601a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc457400640 1 -- 172.21.15.40:0/1398533146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc46010fe70 msgr2=0x7fc4601a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc457400640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc46010fe70 0x7fc4601a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc457400640 1 -- 172.21.15.40:0/1398533146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc460109be0 msgr2=0x7fc4601a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc457400640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc460109be0 0x7fc4601a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.785+0000 7fc457400640 1 -- 172.21.15.40:0/1398533146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4601a6480 con 0x7fc46010f520 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.786+0000 7fc457400640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 0x7fc4601a0ab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc44800d750 tx=0x7fc44800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.786+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448017070 con 0x7fc46010f520 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.786+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4601a6770 con 0x7fc46010f520 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.786+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4480054b0 con 0x7fc46010f520 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.786+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448004bc0 con 0x7fc46010f520 2024-07-26T13:25:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.786+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4601aced0 con 0x7fc46010f520 2024-07-26T13:25:24.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.788+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc460109ff0 con 0x7fc46010f520 2024-07-26T13:25:24.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.791+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc448009c30 con 0x7fc46010f520 2024-07-26T13:25:24.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.793+0000 7fc45d600640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4440b3c50 0x7fc4440b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:24.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.794+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc4480e34e0 con 0x7fc46010f520 2024-07-26T13:25:24.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.794+0000 7fc45fe00640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4440b3c50 0x7fc4440b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:24.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.795+0000 7fc45fe00640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4440b3c50 0x7fc4440b6160 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc4500057c0 tx=0x7fc4500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:24.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:24.798+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc4480aa4e0 con 0x7fc46010f520 2024-07-26T13:25:25.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.082+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4601116b0 con 0x7fc46010f520 2024-07-26T13:25:25.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.083+0000 7fc45d600640 1 -- 172.21.15.40:0/1398533146 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7fc4480aea30 con 0x7fc46010f520 2024-07-26T13:25:25.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:25:25.085 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:25:25.085 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:25:25.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.086+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4440b3c50 msgr2=0x7fc4440b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:25.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.086+0000 7fc467200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4440b3c50 0x7fc4440b6160 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc4500057c0 tx=0x7fc4500058d0 comp rx=0 tx=0).stop 2024-07-26T13:25:25.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.086+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 msgr2=0x7fc4601a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:25.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.086+0000 7fc467200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 0x7fc4601a0ab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc44800d750 tx=0x7fc44800dc10 comp rx=0 tx=0).stop 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 shutdown_connections 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc4440b3c50 0x7fc4440b6160 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc46010fe70 0x7fc4601a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc46010f520 0x7fc4601a0ab0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 --2- 172.21.15.40:0/1398533146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc460109be0 0x7fc4601a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 >> 172.21.15.40:0/1398533146 conn(0x7fc460077b10 msgr2=0x7fc4601080d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 shutdown_connections 2024-07-26T13:25:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:25.087+0000 7fc467200640 1 -- 172.21.15.40:0/1398533146 wait complete. 2024-07-26T13:25:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:25 smithi040 ceph-mon[32397]: pgmap v2394: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:25:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1398533146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:25:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:25 smithi146 ceph-mon[35807]: pgmap v2394: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:25:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1398533146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:25:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:25 smithi076 ceph-mon[35401]: pgmap v2394: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:25:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1398533146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:25:26.250 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 137.1 --await-for 45.0' 2024-07-26T13:25:26.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 137.1 --await-for 45.0 2024-07-26T13:25:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:25:27.519 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:27 smithi040 ceph-mon[32397]: pgmap v2395: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:25:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:27 smithi146 ceph-mon[35807]: pgmap v2395: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:25:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:27 smithi076 ceph-mon[35401]: pgmap v2395: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-07-26T13:25:29.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 -- 172.21.15.40:0/3116436932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72010fa50 msgr2=0x7ff720111e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 --2- 172.21.15.40:0/3116436932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72010fa50 0x7ff720111e70 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff718009ca0 tx=0x7ff71802a940 comp rx=0 tx=0).stop 2024-07-26T13:25:29.272 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:29 smithi040 ceph-mon[32397]: pgmap v2396: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 -- 172.21.15.40:0/3116436932 shutdown_connections 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 --2- 172.21.15.40:0/3116436932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72010fa50 0x7ff720111e70 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 --2- 172.21.15.40:0/3116436932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7201027f0 0x7ff72010f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 --2- 172.21.15.40:0/3116436932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff720101ea0 0x7ff7201022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.270+0000 7ff726c00640 1 -- 172.21.15.40:0/3116436932 >> 172.21.15.40:0/3116436932 conn(0x7ff7200fdd60 msgr2=0x7ff7201001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.271+0000 7ff726c00640 1 -- 172.21.15.40:0/3116436932 shutdown_connections 2024-07-26T13:25:29.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.271+0000 7ff726c00640 1 -- 172.21.15.40:0/3116436932 wait complete. 2024-07-26T13:25:29.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.272+0000 7ff726c00640 1 Processor -- start 2024-07-26T13:25:29.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 -- start start 2024-07-26T13:25:29.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 0x7ff72019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7201027f0 0x7ff72019c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff72010fa50 0x7ff7201a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201153a0 con 0x7ff720101ea0 2024-07-26T13:25:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff720115220 con 0x7ff7201027f0 2024-07-26T13:25:29.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.273+0000 7ff726c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff720115520 con 0x7ff72010fa50 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 0x7ff72019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 0x7ff72019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40012/0 (socket says 172.21.15.40:40012) 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 -- 172.21.15.40:0/3897948257 learned_addr learned my addr 172.21.15.40:0/3897948257 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff726200640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff72010fa50 0x7ff7201a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff724e00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7201027f0 0x7ff72019c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 -- 172.21.15.40:0/3897948257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff72010fa50 msgr2=0x7ff7201a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff72010fa50 0x7ff7201a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 -- 172.21.15.40:0/3897948257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7201027f0 msgr2=0x7ff72019c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7201027f0 0x7ff72019c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.274+0000 7ff725800640 1 -- 172.21.15.40:0/3897948257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7201a1bc0 con 0x7ff720101ea0 2024-07-26T13:25:29.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.275+0000 7ff725800640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 0x7ff72019bd10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c920 tx=0x7ff71400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:29.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.275+0000 7ff71e000640 1 -- 172.21.15.40:0/3897948257 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714007c70 con 0x7ff720101ea0 2024-07-26T13:25:29.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.275+0000 7ff71e000640 1 -- 172.21.15.40:0/3897948257 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff714007e10 con 0x7ff720101ea0 2024-07-26T13:25:29.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.275+0000 7ff71e000640 1 -- 172.21.15.40:0/3897948257 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714018710 con 0x7ff720101ea0 2024-07-26T13:25:29.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.275+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7201a1eb0 con 0x7ff720101ea0 2024-07-26T13:25:29.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.275+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7201a86d0 con 0x7ff720101ea0 2024-07-26T13:25:29.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.280+0000 7ff71e000640 1 -- 172.21.15.40:0/3897948257 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff71400f450 con 0x7ff720101ea0 2024-07-26T13:25:29.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.281+0000 7ff71e000640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff7080b3c70 0x7ff7080b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.282+0000 7ff71e000640 1 -- 172.21.15.40:0/3897948257 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7140e3e30 con 0x7ff720101ea0 2024-07-26T13:25:29.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.282+0000 7ff724e00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff7080b3c70 0x7ff7080b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.283+0000 7ff724e00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff7080b3c70 0x7ff7080b6180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff70c005e10 tx=0x7ff70c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.371+0000 7ff72ee75740 1 Processor -- start 2024-07-26T13:25:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.371+0000 7ff72ee75740 1 -- start start 2024-07-26T13:25:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583171e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583171e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583171ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff72ee75740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5558316e8cf0 con 0x55583134f980 2024-07-26T13:25:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff72ee75740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555831693b40 con 0x555831357b60 2024-07-26T13:25:29.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff72ee75740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555831683040 con 0x555831378840 2024-07-26T13:25:29.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff724e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583171e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff724e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583171e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40026/0 (socket says 172.21.15.40:40026) 2024-07-26T13:25:29.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.372+0000 7ff724e00640 1 -- 172.21.15.40:0/1338138286 learned_addr learned my addr 172.21.15.40:0/1338138286 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:29.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff725800640 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583171e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff726200640 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583171ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff724e00640 1 -- 172.21.15.40:0/1338138286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 msgr2=0x55583171e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff724e00640 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583171e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff724e00640 1 -- 172.21.15.40:0/1338138286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 msgr2=0x55583171ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff724e00640 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583171ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.373+0000 7ff724e00640 1 -- 172.21.15.40:0/1338138286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583160aaf0 con 0x55583134f980 2024-07-26T13:25:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.374+0000 7ff724e00640 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583171e8d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00a320 tx=0x7ff70c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136cd0db4c550787 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.374+0000 7ff712a00640 1 -- 172.21.15.40:0/1338138286 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c021070 con 0x55583134f980 2024-07-26T13:25:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.374+0000 7ff712a00640 1 -- 172.21.15.40:0/1338138286 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff70c01dae0 con 0x55583134f980 2024-07-26T13:25:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.374+0000 7ff712a00640 1 -- 172.21.15.40:0/1338138286 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00f9b0 con 0x55583134f980 2024-07-26T13:25:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 -- 172.21.15.40:0/1338138286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 msgr2=0x55583171e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583171e8d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00a320 tx=0x7ff70c011000 comp rx=0 tx=0).stop 2024-07-26T13:25:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 -- 172.21.15.40:0/1338138286 shutdown_connections 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583171ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583171e8d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 --2- 172.21.15.40:0/1338138286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583171e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 -- 172.21.15.40:0/1338138286 >> 172.21.15.40:0/1338138286 conn(0x55583136c990 msgr2=0x55583171c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 -- 172.21.15.40:0/1338138286 shutdown_connections 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.376+0000 7ff72ee75740 1 -- 172.21.15.40:0/1338138286 wait complete. 2024-07-26T13:25:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.377+0000 7ff72ee75740 1 -- start start 2024-07-26T13:25:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.377+0000 7ff72ee75740 1 Processor -- start 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x555831729f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x555831735ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55583161f500 con 0x55583134f980 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555831687080 con 0x555831357b60 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5558314e67a0 con 0x555831378840 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.378+0000 7ff72ee75740 10 client.0 _ll_register_callbacks cb 0x55583167bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x555831729f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x555831729f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40032/0 (socket says 172.21.15.40:40032) 2024-07-26T13:25:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 -- 172.21.15.40:0/2248921304 learned_addr learned my addr 172.21.15.40:0/2248921304 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff724e00640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff726200640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x555831735ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 -- 172.21.15.40:0/2248921304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 msgr2=0x555831735ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x555831735ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 -- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 msgr2=0x55583172a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff725800640 1 -- 172.21.15.40:0/2248921304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558313f2b90 con 0x55583134f980 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.379+0000 7ff724e00640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff725800640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x555831729f10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7ff71401f000 tx=0x7ff71400fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cf7bdefa62648 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff707400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:25:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff707400640 1 -- 172.21.15.40:0/2248921304 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140b3df0 con 0x55583134f980 2024-07-26T13:25:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff707400640 1 -- 172.21.15.40:0/2248921304 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7140aafa0 con 0x55583134f980 2024-07-26T13:25:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff70c01dae0 con 0x55583134f980 2024-07-26T13:25:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff707400640 1 -- 172.21.15.40:0/2248921304 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff7140ab1a0 con 0x55583134f980 2024-07-26T13:25:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.380+0000 7ff72ee75740 10 client.17970 fetch_fsmap learned FSMap version 35 2024-07-26T13:25:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555831738a30 con 0x55583134f980 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff707400640 1 -- 172.21.15.40:0/2248921304 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff70c01dae0 con 0x55583134f980 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff707400640 1 -- 172.21.15.40:0/2248921304 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ff7140a68b0 con 0x55583134f980 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 10 client.17970 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 10 client.17970 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 20 client.17970 populate_metadata read hostname 'smithi040' 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5558313371c0 0x55583173bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 4 client.17970 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.381+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555831695a90 con 0x5558313371c0 2024-07-26T13:25:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.382+0000 7ff724e00640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5558313371c0 0x55583173bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.384+0000 7ff707400640 10 client.17970 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.384+0000 7ff724e00640 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5558313371c0 0x55583173bf00 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8256ed6e295d2f server_cookie=475599386c27839a in_seq=0 out_seq=0 2024-07-26T13:25:29.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.385+0000 7ff707400640 1 -- 172.21.15.40:0/2248921304 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555831695a90 con 0x5558313371c0 2024-07-26T13:25:29.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.385+0000 7ff707400640 10 client.17970 handle_command_reply: tid=0 2024-07-26T13:25:29.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 client.17970 shutdown 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 msgr2=0x555831729f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x555831729f10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7ff71401f000 tx=0x7ff71400fca0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 shutdown_connections 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x555831735ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5558313371c0 0x55583173bf00 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2248921304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x555831729f10 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 >> 172.21.15.40:0/2248921304 conn(0x55583136c990 msgr2=0x555831721520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:29.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff707400640 0 client.17970 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.386+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 shutdown_connections 2024-07-26T13:25:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.387+0000 7ff72ee75740 1 -- 172.21.15.40:0/2248921304 wait complete. 2024-07-26T13:25:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.387+0000 7ff72ee75740 20 client.17970 trim_cache size 0 max 16384 2024-07-26T13:25:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.413+0000 7ff72ee75740 1 Processor -- start 2024-07-26T13:25:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.413+0000 7ff72ee75740 1 -- start start 2024-07-26T13:25:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55583134f980 0x55583171fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 0x555831735ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831378840 0x555831736010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff72ee75740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201b0cb0 con 0x555831357b60 2024-07-26T13:25:29.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff72ee75740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201b27f0 con 0x555831378840 2024-07-26T13:25:29.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff72ee75740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201b1380 con 0x55583134f980 2024-07-26T13:25:29.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff724e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 0x555831735ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff724e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 0x555831735ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40040/0 (socket says 172.21.15.40:40040) 2024-07-26T13:25:29.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.414+0000 7ff724e00640 1 -- 172.21.15.40:0/2552361033 learned_addr learned my addr 172.21.15.40:0/2552361033 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff725800640 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55583134f980 0x55583171fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff726200640 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831378840 0x555831736010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff724e00640 1 -- 172.21.15.40:0/2552361033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55583134f980 msgr2=0x55583171fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff724e00640 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55583134f980 0x55583171fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff724e00640 1 -- 172.21.15.40:0/2552361033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831378840 msgr2=0x555831736010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff724e00640 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831378840 0x555831736010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.415+0000 7ff724e00640 1 -- 172.21.15.40:0/2552361033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558317211f0 con 0x555831357b60 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.416+0000 7ff724e00640 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 0x555831735ad0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00f010 tx=0x7ff70c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d911a444c85a3e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.416+0000 7ff712000640 1 -- 172.21.15.40:0/2552361033 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c021040 con 0x555831357b60 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.416+0000 7ff712000640 1 -- 172.21.15.40:0/2552361033 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff70c01d450 con 0x555831357b60 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.416+0000 7ff712000640 1 -- 172.21.15.40:0/2552361033 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00f900 con 0x555831357b60 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 -- 172.21.15.40:0/2552361033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 msgr2=0x555831735ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 0x555831735ad0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00f010 tx=0x7ff70c005850 comp rx=0 tx=0).stop 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 -- 172.21.15.40:0/2552361033 shutdown_connections 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831378840 0x555831736010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555831357b60 0x555831735ad0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 --2- 172.21.15.40:0/2552361033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55583134f980 0x55583171fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 -- 172.21.15.40:0/2552361033 >> 172.21.15.40:0/2552361033 conn(0x55583136c990 msgr2=0x55583171f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:29.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.417+0000 7ff72ee75740 1 -- 172.21.15.40:0/2552361033 shutdown_connections 2024-07-26T13:25:29.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.418+0000 7ff72ee75740 1 -- 172.21.15.40:0/2552361033 wait complete. 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.418+0000 7ff72ee75740 1 -- start start 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.418+0000 7ff72ee75740 1 Processor -- start 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583172f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583172fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201b2120 con 0x55583134f980 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201b1a50 con 0x555831357b60 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7201aec70 con 0x555831378840 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.419+0000 7ff72ee75740 10 client.0 _ll_register_callbacks cb 0x7ff71400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:25:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583172f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583172f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40050/0 (socket says 172.21.15.40:40050) 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 -- 172.21.15.40:0/3073471879 learned_addr learned my addr 172.21.15.40:0/3073471879 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff724e00640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff726200640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583172fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 -- 172.21.15.40:0/3073471879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 msgr2=0x55583172fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583172fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 -- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 msgr2=0x55583172f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.420+0000 7ff725800640 1 -- 172.21.15.40:0/3073471879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558317ac0f0 con 0x55583134f980 2024-07-26T13:25:29.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.421+0000 7ff725800640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583172f290 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff7140a9a60 tx=0x7ff7140b0910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b82a3686d96f7a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.421+0000 7ff707400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.421+0000 7ff707400640 1 -- 172.21.15.40:0/3073471879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140b3df0 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.421+0000 7ff707400640 1 -- 172.21.15.40:0/3073471879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7140a7330 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.421+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff70c01d450 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff707400640 1 -- 172.21.15.40:0/3073471879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff7140b3b70 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 10 client.17976 fetch_fsmap learned FSMap version 35 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5558317ad350 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff707400640 1 -- 172.21.15.40:0/3073471879 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff70c01d450 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff707400640 1 -- 172.21.15.40:0/3073471879 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7ff7140920e0 con 0x55583134f980 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 10 client.17976 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 10 client.17976 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 20 client.17976 populate_metadata read hostname 'smithi040' 2024-07-26T13:25:29.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55583130c570 0x5558317af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.422+0000 7ff72ee75740 4 client.17976 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.1, "await_for": 45.0}] 2024-07-26T13:25:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.423+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.1, "await_for": 45.0}) -- 0x555831691530 con 0x55583130c570 2024-07-26T13:25:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.423+0000 7ff724e00640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55583130c570 0x5558317af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.424+0000 7ff724e00640 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55583130c570 0x5558317af910 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99b14055a12b040e server_cookie=693a4034b9b320db in_seq=0 out_seq=0 2024-07-26T13:25:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.424+0000 7ff707400640 10 client.17976 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:29.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:29 smithi146 ceph-mon[35807]: pgmap v2396: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:25:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:29 smithi076 ceph-mon[35401]: pgmap v2396: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-07-26T13:25:29.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.680+0000 7ff707400640 1 -- 172.21.15.40:0/3073471879 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x555831691530 con 0x55583130c570 2024-07-26T13:25:29.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.680+0000 7ff707400640 10 client.17976 handle_command_reply: tid=0 2024-07-26T13:25:29.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.680+0000 7ff72ee75740 1 client.17976 shutdown 2024-07-26T13:25:29.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 msgr2=0x55583172f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583172f290 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff7140a9a60 tx=0x7ff7140b0910 comp rx=0 tx=0).stop 2024-07-26T13:25:29.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 shutdown_connections 2024-07-26T13:25:29.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555831378840 0x55583172fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555831357b60 0x55583172f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55583130c570 0x5558317af910 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 --2- 172.21.15.40:0/3073471879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55583134f980 0x55583172f290 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff707400640 0 client.17976 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.681+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 >> 172.21.15.40:0/3073471879 conn(0x55583136c990 msgr2=0x55583171c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.682+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 shutdown_connections 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.682+0000 7ff72ee75740 1 -- 172.21.15.40:0/3073471879 wait complete. 2024-07-26T13:25:29.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.682+0000 7ff72ee75740 20 client.17976 trim_cache size 0 max 16384 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 210, 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "5baec094": { 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 210, 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:25:29.684 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 137.1, 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:29.685 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:29.686 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:29.686 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:25:29.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff7080b3c70 msgr2=0x7ff7080b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff7080b3c70 0x7ff7080b6180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff70c005e10 tx=0x7ff70c005da0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 msgr2=0x7ff72019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 0x7ff72019bd10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c920 tx=0x7ff71400cde0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 shutdown_connections 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ff7080b3c70 0x7ff7080b6180 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff72010fa50 0x7ff7201a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7201027f0 0x7ff72019c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 --2- 172.21.15.40:0/3897948257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff720101ea0 0x7ff72019bd10 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.684+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 >> 172.21.15.40:0/3897948257 conn(0x7ff7200fdd60 msgr2=0x7ff720100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.685+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 shutdown_connections 2024-07-26T13:25:29.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:29.685+0000 7ff726c00640 1 -- 172.21.15.40:0/3897948257 wait complete. 2024-07-26T13:25:30.572 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5baec094', quiesce took 9.5 seconds. Will release after: 7.600000000000001 2024-07-26T13:25:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:31 smithi146 ceph-mon[35807]: pgmap v2397: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:25:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:31 smithi076 ceph-mon[35401]: pgmap v2397: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:25:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:31 smithi040 ceph-mon[32397]: pgmap v2397: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:25:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:33 smithi146 ceph-mon[35807]: pgmap v2398: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:25:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:33 smithi076 ceph-mon[35401]: pgmap v2398: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:25:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:33 smithi040 ceph-mon[32397]: pgmap v2398: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:25:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:35 smithi146 ceph-mon[35807]: pgmap v2399: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:25:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:35 smithi076 ceph-mon[35401]: pgmap v2399: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:25:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:35 smithi040 ceph-mon[32397]: pgmap v2399: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-07-26T13:25:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:37 smithi146 ceph-mon[35807]: pgmap v2400: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:25:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:37 smithi076 ceph-mon[35401]: pgmap v2400: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:25:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:37 smithi040 ceph-mon[32397]: pgmap v2400: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:25:38.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:25:38.656 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:25:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:39 smithi040 ceph-mon[32397]: pgmap v2401: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:25:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:39 smithi146 ceph-mon[35807]: pgmap v2401: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:25:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:39 smithi076 ceph-mon[35401]: pgmap v2401: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2024-07-26T13:25:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 -- 172.21.15.40:0/812596018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 msgr2=0x7f578c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 --2- 172.21.15.40:0/812596018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c107ff0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5778009900 tx=0x7f577802a410 comp rx=0 tx=0).stop 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 -- 172.21.15.40:0/812596018 shutdown_connections 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 --2- 172.21.15.40:0/812596018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c108530 0x7f578c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 --2- 172.21.15.40:0/812596018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c107ff0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 --2- 172.21.15.40:0/812596018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f578c1022a0 0x7f578c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.971+0000 7f5792a00640 1 -- 172.21.15.40:0/812596018 >> 172.21.15.40:0/812596018 conn(0x7f578c0fdcf0 msgr2=0x7f578c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.972+0000 7f5792a00640 1 -- 172.21.15.40:0/812596018 shutdown_connections 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.972+0000 7f5792a00640 1 -- 172.21.15.40:0/812596018 wait complete. 2024-07-26T13:25:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 Processor -- start 2024-07-26T13:25:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 -- start start 2024-07-26T13:25:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f578c1022a0 0x7f578c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:40.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c108530 0x7f578c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f578c1131c0 con 0x7f578c107be0 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f578c113040 con 0x7f578c1022a0 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.973+0000 7f5792a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f578c113340 con 0x7f578c108530 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50194/0 (socket says 172.21.15.40:50194) 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 -- 172.21.15.40:0/1039554705 learned_addr learned my addr 172.21.15.40:0/1039554705 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:40.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5791600640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f578c1022a0 0x7f578c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5792000640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c108530 0x7f578c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 -- 172.21.15.40:0/1039554705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c108530 msgr2=0x7f578c19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c108530 0x7f578c19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 -- 172.21.15.40:0/1039554705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f578c1022a0 msgr2=0x7f578c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f578c1022a0 0x7f578c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.974+0000 7f5790c00640 1 -- 172.21.15.40:0/1039554705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c19fb80 con 0x7f578c107be0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.975+0000 7f5790c00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c19a1b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5778005940 tx=0x7f57780040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.975+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577803f030 con 0x7f578c107be0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.975+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5778003a80 con 0x7f578c107be0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.975+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578c19fe10 con 0x7f578c107be0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.975+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578c1a65d0 con 0x7f578c107be0 2024-07-26T13:25:40.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.976+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778035070 con 0x7f578c107be0 2024-07-26T13:25:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.977+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578c1026b0 con 0x7f578c107be0 2024-07-26T13:25:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.979+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5778042030 con 0x7f578c107be0 2024-07-26T13:25:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.981+0000 7f578a000640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57740b3bd0 0x7f57740b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:40.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.981+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5778104640 con 0x7f578c107be0 2024-07-26T13:25:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.981+0000 7f5791600640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57740b3bd0 0x7f57740b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:40.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.982+0000 7f5791600640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57740b3bd0 0x7f57740b60e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5780005fd0 tx=0x7f5780005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:40.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:40.983+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f57780cbc50 con 0x7f578c107be0 2024-07-26T13:25:41.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.236+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f578c19ad40 con 0x7f578c107be0 2024-07-26T13:25:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.237+0000 7f578a000640 1 -- 172.21.15.40:0/1039554705 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f57780cb550 con 0x7f578c107be0 2024-07-26T13:25:41.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:25:41.239 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:25:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:25:41.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57740b3bd0 msgr2=0x7f57740b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:41.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57740b3bd0 0x7f57740b60e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5780005fd0 tx=0x7f5780005850 comp rx=0 tx=0).stop 2024-07-26T13:25:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 msgr2=0x7f578c19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c19a1b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5778005940 tx=0x7f57780040e0 comp rx=0 tx=0).stop 2024-07-26T13:25:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 shutdown_connections 2024-07-26T13:25:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f57740b3bd0 0x7f57740b60e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c108530 0x7f578c19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f578c107be0 0x7f578c19a1b0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 --2- 172.21.15.40:0/1039554705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f578c1022a0 0x7f578c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.240+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 >> 172.21.15.40:0/1039554705 conn(0x7f578c0fdcf0 msgr2=0x7f578c100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.241+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 shutdown_connections 2024-07-26T13:25:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:41.241+0000 7f5792a00640 1 -- 172.21.15.40:0/1039554705 wait complete. 2024-07-26T13:25:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:41 smithi146 ceph-mon[35807]: pgmap v2402: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T13:25:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:41 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1039554705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:25:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:41 smithi076 ceph-mon[35401]: pgmap v2402: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T13:25:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:41 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1039554705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:25:41.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:41 smithi040 ceph-mon[32397]: pgmap v2402: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 MiB/s wr, 13 op/s 2024-07-26T13:25:41.630 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:41 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1039554705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:25:42.012 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 5baec094 --release --await' 2024-07-26T13:25:42.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 5baec094 --release --await 2024-07-26T13:25:42.513 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:25:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:43 smithi146 ceph-mon[35807]: pgmap v2403: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-07-26T13:25:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:43 smithi076 ceph-mon[35401]: pgmap v2403: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-07-26T13:25:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:43 smithi040 ceph-mon[32397]: pgmap v2403: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-07-26T13:25:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 -- 172.21.15.40:0/3464212869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f570010fb70 msgr2=0x7f5700111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 --2- 172.21.15.40:0/3464212869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f570010fb70 0x7f5700111f90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009ca0 tx=0x7f56f802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 -- 172.21.15.40:0/3464212869 shutdown_connections 2024-07-26T13:25:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 --2- 172.21.15.40:0/3464212869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f570010fb70 0x7f5700111f90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 --2- 172.21.15.40:0/3464212869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5700075ad0 0x7f570010f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 --2- 172.21.15.40:0/3464212869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5700075180 0x7f5700075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 -- 172.21.15.40:0/3464212869 >> 172.21.15.40:0/3464212869 conn(0x7f57000ff000 msgr2=0x7f5700101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 -- 172.21.15.40:0/3464212869 shutdown_connections 2024-07-26T13:25:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.723+0000 7f5706200640 1 -- 172.21.15.40:0/3464212869 wait complete. 2024-07-26T13:25:44.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 Processor -- start 2024-07-26T13:25:44.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 -- start start 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 0x7f570019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5700075ad0 0x7f570019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f570010fb70 0x7f57001a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57001155d0 con 0x7f5700075180 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5700115450 con 0x7f5700075ad0 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.725+0000 7f5706200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5700115750 con 0x7f570010fb70 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 0x7f570019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 0x7f570019bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39864/0 (socket says 172.21.15.40:39864) 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 -- 172.21.15.40:0/4221226083 learned_addr learned my addr 172.21.15.40:0/4221226083 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56fea00640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5700075ad0 0x7f570019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ffe00640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f570010fb70 0x7f57001a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 -- 172.21.15.40:0/4221226083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f570010fb70 msgr2=0x7f57001a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f570010fb70 0x7f57001a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 -- 172.21.15.40:0/4221226083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5700075ad0 msgr2=0x7f570019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5700075ad0 0x7f570019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ff400640 1 -- 172.21.15.40:0/4221226083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57001a1f10 con 0x7f5700075180 2024-07-26T13:25:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.726+0000 7f56ffe00640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f570010fb70 0x7f57001a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:25:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.727+0000 7f56ff400640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 0x7f570019bfa0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f56f000d950 tx=0x7f56f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.727+0000 7f56f7e00640 1 -- 172.21.15.40:0/4221226083 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0017030 con 0x7f5700075180 2024-07-26T13:25:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.727+0000 7f56f7e00640 1 -- 172.21.15.40:0/4221226083 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56f0004020 con 0x7f5700075180 2024-07-26T13:25:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.727+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57001a2200 con 0x7f5700075180 2024-07-26T13:25:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.727+0000 7f56f7e00640 1 -- 172.21.15.40:0/4221226083 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00055d0 con 0x7f5700075180 2024-07-26T13:25:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.727+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57001a8960 con 0x7f5700075180 2024-07-26T13:25:44.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.731+0000 7f56f7e00640 1 -- 172.21.15.40:0/4221226083 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f56f0009a30 con 0x7f5700075180 2024-07-26T13:25:44.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.733+0000 7f56f7e00640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56e40b3bd0 0x7f56e40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.733+0000 7f56f7e00640 1 -- 172.21.15.40:0/4221226083 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f56f00e37a0 con 0x7f5700075180 2024-07-26T13:25:44.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.733+0000 7f56fea00640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56e40b3bd0 0x7f56e40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.734+0000 7f56fea00640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56e40b3bd0 0x7f56e40b60e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f56ec005fd0 tx=0x7f56ec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:44.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 Processor -- start 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 -- start start 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b627fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b628520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b628a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56383b59ef50 con 0x56383b283520 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56383b58e450 con 0x56383b262840 2024-07-26T13:25:44.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.759+0000 7f570cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56383b592490 con 0x56383b25a660 2024-07-26T13:25:44.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.760+0000 7f56ff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b627fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.760+0000 7f56ff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b627fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39872/0 (socket says 172.21.15.40:39872) 2024-07-26T13:25:44.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.760+0000 7f56ff400640 1 -- 172.21.15.40:0/4152254127 learned_addr learned my addr 172.21.15.40:0/4152254127 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.760+0000 7f56fea00640 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b628520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.760+0000 7f56ffe00640 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b628a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ff400640 1 -- 172.21.15.40:0/4152254127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 msgr2=0x56383b628520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ff400640 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b628520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ff400640 1 -- 172.21.15.40:0/4152254127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 msgr2=0x56383b628a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ff400640 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b628a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ff400640 1 -- 172.21.15.40:0/4152254127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383b2eeb00 con 0x56383b283520 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ff400640 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b627fe0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f56f00045f0 tx=0x7f56f00a9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415a9e7043466602 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ebe00640 1 -- 172.21.15.40:0/4152254127 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00aecb0 con 0x56383b283520 2024-07-26T13:25:44.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.761+0000 7f56ebe00640 1 -- 172.21.15.40:0/4152254127 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56f00b3760 con 0x56383b283520 2024-07-26T13:25:44.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.762+0000 7f56ebe00640 1 -- 172.21.15.40:0/4152254127 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00cbbb0 con 0x56383b283520 2024-07-26T13:25:44.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 -- 172.21.15.40:0/4152254127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 msgr2=0x56383b627fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b627fe0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f56f00045f0 tx=0x7f56f00a9f20 comp rx=0 tx=0).stop 2024-07-26T13:25:44.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 -- 172.21.15.40:0/4152254127 shutdown_connections 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b628a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b628520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 --2- 172.21.15.40:0/4152254127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b627fe0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 -- 172.21.15.40:0/4152254127 >> 172.21.15.40:0/4152254127 conn(0x56383b277910 msgr2=0x56383b625ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 -- 172.21.15.40:0/4152254127 shutdown_connections 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.763+0000 7f570cfee740 1 -- 172.21.15.40:0/4152254127 wait complete. 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.764+0000 7f570cfee740 1 -- start start 2024-07-26T13:25:44.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.764+0000 7f570cfee740 1 Processor -- start 2024-07-26T13:25:44.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.764+0000 7f570cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b633750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.764+0000 7f570cfee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b633c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f570cfee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f570cfee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56383b3f1bb0 con 0x56383b283520 2024-07-26T13:25:44.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f570cfee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56383b52a930 con 0x56383b262840 2024-07-26T13:25:44.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f570cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56383b636700 con 0x56383b25a660 2024-07-26T13:25:44.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f570cfee740 10 client.0 _ll_register_callbacks cb 0x56383b29ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:25:44.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f56ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f56ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39886/0 (socket says 172.21.15.40:39886) 2024-07-26T13:25:44.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f56ffe00640 1 -- 172.21.15.40:0/1453345497 learned_addr learned my addr 172.21.15.40:0/1453345497 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f56ff400640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b633750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.765+0000 7f56fea00640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b633c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56ffe00640 1 -- 172.21.15.40:0/1453345497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 msgr2=0x56383b633750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56ffe00640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b633750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56ffe00640 1 -- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 msgr2=0x56383b633c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56ffe00640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b633c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56ffe00640 1 -- 172.21.15.40:0/1453345497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383b365960 con 0x56383b283520 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56ffe00640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fa50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f56f8035000 tx=0x7f56f8031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce24a2cc55e9188e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:44.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.766+0000 7f56e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:25:44.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.767+0000 7f56e8c00640 1 -- 172.21.15.40:0/1453345497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8003970 con 0x56383b283520 2024-07-26T13:25:44.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.767+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56f00b3760 con 0x56383b283520 2024-07-26T13:25:44.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.767+0000 7f56e8c00640 1 -- 172.21.15.40:0/1453345497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f56f8003b10 con 0x56383b283520 2024-07-26T13:25:44.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.767+0000 7f56e8c00640 1 -- 172.21.15.40:0/1453345497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f56f8003d10 con 0x56383b283520 2024-07-26T13:25:44.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.767+0000 7f570cfee740 10 client.17994 fetch_fsmap learned FSMap version 35 2024-07-26T13:25:44.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.767+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56383b642540 con 0x56383b283520 2024-07-26T13:25:44.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f56e8c00640 1 -- 172.21.15.40:0/1453345497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56f00b3760 con 0x56383b283520 2024-07-26T13:25:44.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f56e8c00640 1 -- 172.21.15.40:0/1453345497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f56f804d020 con 0x56383b283520 2024-07-26T13:25:44.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f570cfee740 10 client.17994 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f570cfee740 10 client.17994 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f570cfee740 20 client.17994 populate_metadata read hostname 'smithi040' 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f570cfee740 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b241ea0 0x56383b645a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f570cfee740 4 client.17994 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.768+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56383b5a0ea0 con 0x56383b241ea0 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.769+0000 7f56ff400640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b241ea0 0x56383b645a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.770+0000 7f56ff400640 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b241ea0 0x56383b645a00 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd30ac2c986b9d0 server_cookie=ec591221e60a6866 in_seq=0 out_seq=0 2024-07-26T13:25:44.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.770+0000 7f56e8c00640 10 client.17994 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:44.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f56e8c00640 1 -- 172.21.15.40:0/1453345497 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56383b5a0ea0 con 0x56383b241ea0 2024-07-26T13:25:44.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f56e8c00640 10 client.17994 handle_command_reply: tid=0 2024-07-26T13:25:44.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 client.17994 shutdown 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 msgr2=0x56383b63fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fa50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f56f8035000 tx=0x7f56f8031bb0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 shutdown_connections 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b241ea0 0x56383b645a00 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fa50 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b633c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 --2- 172.21.15.40:0/1453345497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b633750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 >> 172.21.15.40:0/1453345497 conn(0x56383b277910 msgr2=0x56383b62b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f56e8c00640 0 client.17994 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 shutdown_connections 2024-07-26T13:25:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.772+0000 7f570cfee740 1 -- 172.21.15.40:0/1453345497 wait complete. 2024-07-26T13:25:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.773+0000 7f570cfee740 20 client.17994 trim_cache size 0 max 16384 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.796+0000 7f570cfee740 1 Processor -- start 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.796+0000 7f570cfee740 1 -- start start 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f570cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b6299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f570cfee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f570cfee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f570cfee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57001b0f50 con 0x56383b283520 2024-07-26T13:25:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f570cfee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f57001b2a90 con 0x56383b262840 2024-07-26T13:25:44.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f570cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57001b1620 con 0x56383b25a660 2024-07-26T13:25:44.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f56ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f56ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39894/0 (socket says 172.21.15.40:39894) 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f56ffe00640 1 -- 172.21.15.40:0/2694167995 learned_addr learned my addr 172.21.15.40:0/2694167995 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f56ff400640 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b6299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.797+0000 7f56fea00640 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.798+0000 7f56ffe00640 1 -- 172.21.15.40:0/2694167995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 msgr2=0x56383b6299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.798+0000 7f56ffe00640 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b6299d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.798+0000 7f56ffe00640 1 -- 172.21.15.40:0/2694167995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 msgr2=0x56383b63f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.798+0000 7f56ffe00640 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.798+0000 7f56ffe00640 1 -- 172.21.15.40:0/2694167995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383b635b20 con 0x56383b283520 2024-07-26T13:25:44.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.798+0000 7f56ffe00640 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fd80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f56f8002230 tx=0x7f56f802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a751a85526c0e063 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:44.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.799+0000 7f56eb400640 1 -- 172.21.15.40:0/2694167995 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8003970 con 0x56383b283520 2024-07-26T13:25:44.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.799+0000 7f56eb400640 1 -- 172.21.15.40:0/2694167995 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56f8036050 con 0x56383b283520 2024-07-26T13:25:44.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.799+0000 7f56eb400640 1 -- 172.21.15.40:0/2694167995 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f80308b0 con 0x56383b283520 2024-07-26T13:25:44.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 -- 172.21.15.40:0/2694167995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 msgr2=0x56383b63fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fd80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f56f8002230 tx=0x7f56f802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 -- 172.21.15.40:0/2694167995 shutdown_connections 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b283520 0x56383b63fd80 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 --2- 172.21.15.40:0/2694167995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b25a660 0x56383b6299d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 -- 172.21.15.40:0/2694167995 >> 172.21.15.40:0/2694167995 conn(0x56383b277910 msgr2=0x56383b633500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 -- 172.21.15.40:0/2694167995 shutdown_connections 2024-07-26T13:25:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.800+0000 7f570cfee740 1 -- 172.21.15.40:0/2694167995 wait complete. 2024-07-26T13:25:44.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.801+0000 7f570cfee740 1 -- start start 2024-07-26T13:25:44.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.801+0000 7f570cfee740 1 Processor -- start 2024-07-26T13:25:44.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 0x56383b63b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b283520 0x56383b636970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57001b23c0 con 0x56383b25a660 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f57001b1cf0 con 0x56383b262840 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57001aef10 con 0x56383b283520 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f570cfee740 10 client.0 _ll_register_callbacks cb 0x7f56f8009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f56ff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 0x56383b63b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f56ff400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 0x56383b63b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39898/0 (socket says 172.21.15.40:39898) 2024-07-26T13:25:44.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f56ff400640 1 -- 172.21.15.40:0/2783476267 learned_addr learned my addr 172.21.15.40:0/2783476267 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f56fea00640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.802+0000 7f56ffe00640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b283520 0x56383b636970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56ff400640 1 -- 172.21.15.40:0/2783476267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b283520 msgr2=0x56383b636970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56ff400640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b283520 0x56383b636970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56ff400640 1 -- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 msgr2=0x56383b63bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56ff400640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56ff400640 1 -- 172.21.15.40:0/2783476267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383b636eb0 con 0x56383b25a660 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56ff400640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 0x56383b63b9c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f56f00aa3b0 tx=0x7f56f00aa480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9985cd3fd8f1307 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:25:44.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56e8c00640 1 -- 172.21.15.40:0/2783476267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00b3760 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f56e8c00640 1 -- 172.21.15.40:0/2783476267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f56f00cd180 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.803+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56f8036050 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f56e8c00640 1 -- 172.21.15.40:0/2783476267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f56f00041d0 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 10 client.18000 fetch_fsmap learned FSMap version 35 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56383b6ae8a0 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f56e8c00640 1 -- 172.21.15.40:0/2783476267 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56f8036050 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f56e8c00640 1 -- 172.21.15.40:0/2783476267 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f56f00cbc40 con 0x56383b25a660 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 10 client.18000 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 10 client.18000 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 20 client.18000 populate_metadata read hostname 'smithi040' 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b217250 0x56383b6b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:25:44.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 4 client.18000 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5baec094", "release": true, "await": true}] 2024-07-26T13:25:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.804+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5baec094", "release": true, "await": true}) -- 0x56383b59c940 con 0x56383b217250 2024-07-26T13:25:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.805+0000 7f56fea00640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b217250 0x56383b6b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:25:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.806+0000 7f56fea00640 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b217250 0x56383b6b0c20 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fed937dad48481 server_cookie=ec8561939f8073e2 in_seq=0 out_seq=0 2024-07-26T13:25:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.806+0000 7f56e8c00640 10 client.18000 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.874+0000 7f56e8c00640 1 -- 172.21.15.40:0/2783476267 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x56383b59c940 con 0x56383b217250 2024-07-26T13:25:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.874+0000 7f56e8c00640 10 client.18000 handle_command_reply: tid=0 2024-07-26T13:25:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.874+0000 7f570cfee740 1 client.18000 shutdown 2024-07-26T13:25:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 msgr2=0x56383b63b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 0x56383b63b9c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f56f00aa3b0 tx=0x7f56f00aa480 comp rx=0 tx=0).stop 2024-07-26T13:25:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 shutdown_connections 2024-07-26T13:25:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56383b283520 0x56383b636970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56383b262840 0x56383b63bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56383b217250 0x56383b6b0c20 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 --2- 172.21.15.40:0/2783476267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56383b25a660 0x56383b63b9c0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 >> 172.21.15.40:0/2783476267 conn(0x56383b277910 msgr2=0x56383b6297a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.875+0000 7f56e8c00640 0 client.18000 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.876+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 shutdown_connections 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.876+0000 7f570cfee740 1 -- 172.21.15.40:0/2783476267 wait complete. 2024-07-26T13:25:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.876+0000 7f570cfee740 20 client.18000 trim_cache size 0 max 16384 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 212, 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "5baec094": { 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 212, 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:25:44.879 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 137.1, 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:25:44.880 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:25:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.877+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56e40b3bd0 msgr2=0x7f56e40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.877+0000 7f5706200640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56e40b3bd0 0x7f56e40b60e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f56ec005fd0 tx=0x7f56ec005850 comp rx=0 tx=0).stop 2024-07-26T13:25:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.877+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 msgr2=0x7f570019bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:25:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.877+0000 7f5706200640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 0x7f570019bfa0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f56f000d950 tx=0x7f56f000de10 comp rx=0 tx=0).stop 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 shutdown_connections 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56e40b3bd0 0x7f56e40b60e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f570010fb70 0x7f57001a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5700075ad0 0x7f570019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 --2- 172.21.15.40:0/4221226083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5700075180 0x7f570019bfa0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 >> 172.21.15.40:0/4221226083 conn(0x7f57000ff000 msgr2=0x7f5700109710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.878+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 shutdown_connections 2024-07-26T13:25:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:25:44.879+0000 7f5706200640 1 -- 172.21.15.40:0/4221226083 wait complete. 2024-07-26T13:25:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:45 smithi146 ceph-mon[35807]: pgmap v2404: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 958 KiB/s wr, 12 op/s 2024-07-26T13:25:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:45 smithi076 ceph-mon[35401]: pgmap v2404: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 958 KiB/s wr, 12 op/s 2024-07-26T13:25:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:45 smithi040 ceph-mon[32397]: pgmap v2404: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 958 KiB/s wr, 12 op/s 2024-07-26T13:25:45.831 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5baec094', total seconds elapsed: 24.8 2024-07-26T13:25:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:47 smithi146 ceph-mon[35807]: pgmap v2405: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 616 KiB/s wr, 10 op/s 2024-07-26T13:25:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:47 smithi076 ceph-mon[35401]: pgmap v2405: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 616 KiB/s wr, 10 op/s 2024-07-26T13:25:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:47 smithi040 ceph-mon[32397]: pgmap v2405: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 616 KiB/s wr, 10 op/s 2024-07-26T13:25:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:49 smithi146 ceph-mon[35807]: pgmap v2406: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 KiB/s wr, 10 op/s 2024-07-26T13:25:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:49 smithi076 ceph-mon[35401]: pgmap v2406: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 KiB/s wr, 10 op/s 2024-07-26T13:25:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:49 smithi040 ceph-mon[32397]: pgmap v2406: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 KiB/s wr, 10 op/s 2024-07-26T13:25:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:51 smithi146 ceph-mon[35807]: pgmap v2407: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 408 KiB/s wr, 11 op/s 2024-07-26T13:25:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:51 smithi076 ceph-mon[35401]: pgmap v2407: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 408 KiB/s wr, 11 op/s 2024-07-26T13:25:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:51 smithi040 ceph-mon[32397]: pgmap v2407: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 408 KiB/s wr, 11 op/s 2024-07-26T13:25:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:53 smithi076 ceph-mon[35401]: pgmap v2408: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 408 KiB/s wr, 8 op/s 2024-07-26T13:25:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:53 smithi040 ceph-mon[32397]: pgmap v2408: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 408 KiB/s wr, 8 op/s 2024-07-26T13:25:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:53 smithi146 ceph-mon[35807]: pgmap v2408: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 408 KiB/s wr, 8 op/s 2024-07-26T13:25:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:55 smithi076 ceph-mon[35401]: pgmap v2409: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:25:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:55 smithi040 ceph-mon[32397]: pgmap v2409: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:25:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:55 smithi146 ceph-mon[35807]: pgmap v2409: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 MiB/s wr, 11 op/s 2024-07-26T13:25:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:57 smithi040 ceph-mon[32397]: pgmap v2410: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T13:25:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:57 smithi146 ceph-mon[35807]: pgmap v2410: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T13:25:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:57 smithi076 ceph-mon[35401]: pgmap v2410: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.1 MiB/s wr, 10 op/s 2024-07-26T13:25:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:25:59 smithi040 ceph-mon[32397]: pgmap v2411: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T13:25:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:25:59 smithi146 ceph-mon[35807]: pgmap v2411: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T13:25:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:25:59 smithi076 ceph-mon[35401]: pgmap v2411: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-07-26T13:26:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:01 smithi040 ceph-mon[32397]: pgmap v2412: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:01 smithi146 ceph-mon[35807]: pgmap v2412: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:01 smithi076 ceph-mon[35401]: pgmap v2412: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:03.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:03 smithi040 ceph-mon[32397]: pgmap v2413: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:26:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:03 smithi146 ceph-mon[35807]: pgmap v2413: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:26:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:03 smithi076 ceph-mon[35401]: pgmap v2413: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:26:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:05 smithi040 ceph-mon[32397]: pgmap v2414: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:26:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:05 smithi146 ceph-mon[35807]: pgmap v2414: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:26:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:05 smithi076 ceph-mon[35401]: pgmap v2414: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:26:07.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:07 smithi146 ceph-mon[35807]: pgmap v2415: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:07.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:07 smithi076 ceph-mon[35401]: pgmap v2415: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:07 smithi040 ceph-mon[32397]: pgmap v2415: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:09 smithi040 ceph-mon[32397]: pgmap v2416: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:09 smithi146 ceph-mon[35807]: pgmap v2416: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:09 smithi076 ceph-mon[35401]: pgmap v2416: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:11 smithi040 ceph-mon[32397]: pgmap v2417: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:26:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:11 smithi146 ceph-mon[35807]: pgmap v2417: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:26:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:11 smithi076 ceph-mon[35401]: pgmap v2417: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:26:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:13 smithi040 ceph-mon[32397]: pgmap v2418: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:26:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:13 smithi146 ceph-mon[35807]: pgmap v2418: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:26:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:13 smithi076 ceph-mon[35401]: pgmap v2418: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-07-26T13:26:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:15 smithi040 ceph-mon[32397]: pgmap v2419: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:26:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:15 smithi146 ceph-mon[35807]: pgmap v2419: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:26:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:15 smithi076 ceph-mon[35401]: pgmap v2419: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:26:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:26:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:26:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:26:17.590 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-07-26T13:26:17.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:26:17.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:17 smithi040 ceph-mon[32397]: pgmap v2420: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:17.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:26:17.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:26:17.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:26:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:17 smithi146 ceph-mon[35807]: pgmap v2420: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:26:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:26:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:26:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:17 smithi076 ceph-mon[35401]: pgmap v2420: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:26:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:26:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:26:18.111 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:26:18.609 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:18 smithi040 ceph-mon[32397]: pgmap v2421: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:18 smithi146 ceph-mon[35807]: pgmap v2421: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:18 smithi076 ceph-mon[35401]: pgmap v2421: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-07-26T13:26:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:21 smithi040 ceph-mon[32397]: pgmap v2422: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:26:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:21 smithi146 ceph-mon[35807]: pgmap v2422: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:26:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:21 smithi076 ceph-mon[35401]: pgmap v2422: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:26:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 -- 172.21.15.40:0/971308838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7010f520 msgr2=0x7f0c7010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 --2- 172.21.15.40:0/971308838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7010f520 0x7f0c7010f930 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009900 tx=0x7f0c5802a410 comp rx=0 tx=0).stop 2024-07-26T13:26:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 -- 172.21.15.40:0/971308838 shutdown_connections 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 --2- 172.21.15.40:0/971308838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c7010fe70 0x7f0c701166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 --2- 172.21.15.40:0/971308838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7010f520 0x7f0c7010f930 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 --2- 172.21.15.40:0/971308838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c70109be0 0x7f0c70109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 -- 172.21.15.40:0/971308838 >> 172.21.15.40:0/971308838 conn(0x7f0c70077b10 msgr2=0x7f0c70107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 -- 172.21.15.40:0/971308838 shutdown_connections 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.714+0000 7f0c75600640 1 -- 172.21.15.40:0/971308838 wait complete. 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 Processor -- start 2024-07-26T13:26:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 -- start start 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 0x7f0c701a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c7010f520 0x7f0c701a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c7010fe70 0x7f0c701a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70119a30 con 0x7f0c70109be0 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701198b0 con 0x7f0c7010f520 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.716+0000 7f0c75600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70119bb0 con 0x7f0c7010fe70 2024-07-26T13:26:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c6ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 0x7f0c701a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c6ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 0x7f0c701a04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44766/0 (socket says 172.21.15.40:44766) 2024-07-26T13:26:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c6ea00640 1 -- 172.21.15.40:0/4196701465 learned_addr learned my addr 172.21.15.40:0/4196701465 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c66000640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c7010f520 0x7f0c701a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c6f400640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c7010fe70 0x7f0c701a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c6ea00640 1 -- 172.21.15.40:0/4196701465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c7010fe70 msgr2=0x7f0c701a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.717+0000 7f0c6ea00640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c7010fe70 0x7f0c701a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.718+0000 7f0c6ea00640 1 -- 172.21.15.40:0/4196701465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c7010f520 msgr2=0x7f0c701a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.718+0000 7f0c6ea00640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c7010f520 0x7f0c701a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.718+0000 7f0c6ea00640 1 -- 172.21.15.40:0/4196701465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c701a6410 con 0x7f0c70109be0 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.718+0000 7f0c66000640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c7010f520 0x7f0c701a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.718+0000 7f0c6ea00640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 0x7f0c701a04a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000db80 tx=0x7f0c6000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.718+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60017070 con 0x7f0c70109be0 2024-07-26T13:26:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.719+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c60004020 con 0x7f0c70109be0 2024-07-26T13:26:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.719+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c701a6700 con 0x7f0c70109be0 2024-07-26T13:26:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.719+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000be60 con 0x7f0c70109be0 2024-07-26T13:26:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.719+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c701ace60 con 0x7f0c70109be0 2024-07-26T13:26:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.720+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c4c0052c0 con 0x7f0c70109be0 2024-07-26T13:26:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.724+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0c60003b70 con 0x7f0c70109be0 2024-07-26T13:26:21.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.726+0000 7f0c67e00640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c540b3c50 0x7f0c540b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:21.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.727+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c600e3ea0 con 0x7f0c70109be0 2024-07-26T13:26:21.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.727+0000 7f0c66000640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c540b3c50 0x7f0c540b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.728+0000 7f0c66000640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c540b3c50 0x7f0c540b6160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0c5802a930 tx=0x7f0c58000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:21.729+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0c600ab530 con 0x7f0c70109be0 2024-07-26T13:26:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.021+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c4c0055b0 con 0x7f0c70109be0 2024-07-26T13:26:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.023+0000 7f0c67e00640 1 -- 172.21.15.40:0/4196701465 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f0c600e1e20 con 0x7f0c70109be0 2024-07-26T13:26:22.024 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:26:22.025 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:26:22.025 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:26:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c540b3c50 msgr2=0x7f0c540b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c540b3c50 0x7f0c540b6160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0c5802a930 tx=0x7f0c58000bc0 comp rx=0 tx=0).stop 2024-07-26T13:26:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 msgr2=0x7f0c701a04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 0x7f0c701a04a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000db80 tx=0x7f0c6000b630 comp rx=0 tx=0).stop 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 shutdown_connections 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0c540b3c50 0x7f0c540b6160 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c7010fe70 0x7f0c701a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c7010f520 0x7f0c701a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 --2- 172.21.15.40:0/4196701465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c70109be0 0x7f0c701a04a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 >> 172.21.15.40:0/4196701465 conn(0x7f0c70077b10 msgr2=0x7f0c70107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 shutdown_connections 2024-07-26T13:26:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:22.026+0000 7f0c75600640 1 -- 172.21.15.40:0/4196701465 wait complete. 2024-07-26T13:26:22.467 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:22 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/4196701465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:22 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/4196701465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:22 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/4196701465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:23.010 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-07-26T13:26:23.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-07-26T13:26:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:23 smithi040 ceph-mon[32397]: pgmap v2423: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:26:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:23 smithi146 ceph-mon[35807]: pgmap v2423: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:26:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:26:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:23 smithi076 ceph-mon[35401]: pgmap v2423: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.0 MiB/s wr, 10 op/s 2024-07-26T13:26:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:25 smithi040 ceph-mon[32397]: pgmap v2424: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:26:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:25 smithi146 ceph-mon[35807]: pgmap v2424: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:26:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:25 smithi076 ceph-mon[35401]: pgmap v2424: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-07-26T13:26:26.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.900+0000 7f4b35e00640 1 -- 172.21.15.40:0/2919968759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 msgr2=0x7f4b3010b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:26.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.900+0000 7f4b35e00640 1 --2- 172.21.15.40:0/2919968759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3010b370 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009900 tx=0x7f4b1c02a410 comp rx=0 tx=0).stop 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 -- 172.21.15.40:0/2919968759 shutdown_connections 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 --2- 172.21.15.40:0/2919968759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3010b8b0 0x7f4b301120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 --2- 172.21.15.40:0/2919968759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3010b370 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 --2- 172.21.15.40:0/2919968759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b30105620 0x7f4b30105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 -- 172.21.15.40:0/2919968759 >> 172.21.15.40:0/2919968759 conn(0x7f4b301010b0 msgr2=0x7f4b30103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 -- 172.21.15.40:0/2919968759 shutdown_connections 2024-07-26T13:26:26.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.901+0000 7f4b35e00640 1 -- 172.21.15.40:0/2919968759 wait complete. 2024-07-26T13:26:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.903+0000 7f4b35e00640 1 Processor -- start 2024-07-26T13:26:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.903+0000 7f4b35e00640 1 -- start start 2024-07-26T13:26:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b35e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b30105620 0x7f4b3019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b35e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b35e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3010b8b0 0x7f4b301a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b35e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30115440 con 0x7f4b3010af60 2024-07-26T13:26:26.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b35e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301152c0 con 0x7f4b30105620 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b35e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301155c0 con 0x7f4b3010b8b0 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b2fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b2fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3019c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40768/0 (socket says 172.21.15.40:40768) 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b2fe00640 1 -- 172.21.15.40:0/3600922843 learned_addr learned my addr 172.21.15.40:0/3600922843 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.904+0000 7f4b34a00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b30105620 0x7f4b3019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.905+0000 7f4b35400640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3010b8b0 0x7f4b301a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.905+0000 7f4b2fe00640 1 -- 172.21.15.40:0/3600922843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3010b8b0 msgr2=0x7f4b301a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.905+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3010b8b0 0x7f4b301a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.905+0000 7f4b2fe00640 1 -- 172.21.15.40:0/3600922843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b30105620 msgr2=0x7f4b3019beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.905+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b30105620 0x7f4b3019beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.905+0000 7f4b2fe00640 1 -- 172.21.15.40:0/3600922843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301a1d60 con 0x7f4b3010af60 2024-07-26T13:26:26.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.906+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3019c450 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c02a930 tx=0x7f4b1c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:26.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.906+0000 7f4b2d600640 1 -- 172.21.15.40:0/3600922843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c03f070 con 0x7f4b3010af60 2024-07-26T13:26:26.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.906+0000 7f4b2d600640 1 -- 172.21.15.40:0/3600922843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b1c003e10 con 0x7f4b3010af60 2024-07-26T13:26:26.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.906+0000 7f4b2d600640 1 -- 172.21.15.40:0/3600922843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c035030 con 0x7f4b3010af60 2024-07-26T13:26:26.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.907+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b301a1ff0 con 0x7f4b3010af60 2024-07-26T13:26:26.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.907+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b301a2480 con 0x7f4b3010af60 2024-07-26T13:26:26.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.912+0000 7f4b2d600640 1 -- 172.21.15.40:0/3600922843 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4b1c042070 con 0x7f4b3010af60 2024-07-26T13:26:26.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.913+0000 7f4b2d600640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b180b3c70 0x7f4b180b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.913+0000 7f4b2d600640 1 -- 172.21.15.40:0/3600922843 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4b1c104210 con 0x7f4b3010af60 2024-07-26T13:26:26.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.914+0000 7f4b34a00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b180b3c70 0x7f4b180b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.915+0000 7f4b34a00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b180b3c70 0x7f4b180b6180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400abe0 tx=0x7f4b2400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.954+0000 7f4b3e09b740 1 Processor -- start 2024-07-26T13:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.954+0000 7f4b3e09b740 1 -- start start 2024-07-26T13:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.955+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d89421b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.955+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.955+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d89421be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.955+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55d8941e5d10 con 0x55d893e75840 2024-07-26T13:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.955+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d894190b60 con 0x55d893e54b60 2024-07-26T13:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.955+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d894180060 con 0x55d893e4c980 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.956+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d89421b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.956+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d89421b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40774/0 (socket says 172.21.15.40:40774) 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.956+0000 7f4b34a00640 1 -- 172.21.15.40:0/1592396931 learned_addr learned my addr 172.21.15.40:0/1592396931 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.956+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.956+0000 7f4b35400640 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d89421be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b34a00640 1 -- 172.21.15.40:0/1592396931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 msgr2=0x55d89421b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b34a00640 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b34a00640 1 -- 172.21.15.40:0/1592396931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 msgr2=0x55d89421be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b34a00640 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d89421be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b34a00640 1 -- 172.21.15.40:0/1592396931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d894107b10 con 0x55d893e75840 2024-07-26T13:26:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b35400640 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d89421be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:26:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.957+0000 7f4b34a00640 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d89421b3b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400ffd0 tx=0x7f4b24012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc05b85c67020201 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.958+0000 7f4b21c00640 1 -- 172.21.15.40:0/1592396931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24016070 con 0x55d893e75840 2024-07-26T13:26:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.958+0000 7f4b21c00640 1 -- 172.21.15.40:0/1592396931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2401b8b0 con 0x55d893e75840 2024-07-26T13:26:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.958+0000 7f4b21c00640 1 -- 172.21.15.40:0/1592396931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2401c820 con 0x55d893e75840 2024-07-26T13:26:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1592396931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 msgr2=0x55d89421b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:26.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d89421b3b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400ffd0 tx=0x7f4b24012000 comp rx=0 tx=0).stop 2024-07-26T13:26:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1592396931 shutdown_connections 2024-07-26T13:26:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d89421be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1592396931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d89421b3b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.959+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1592396931 >> 172.21.15.40:0/1592396931 conn(0x55d893e69990 msgr2=0x55d8942192a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.960+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1592396931 shutdown_connections 2024-07-26T13:26:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.960+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1592396931 wait complete. 2024-07-26T13:26:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.960+0000 7f4b3e09b740 1 -- start start 2024-07-26T13:26:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.961+0000 7f4b3e09b740 1 Processor -- start 2024-07-26T13:26:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d894226ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894227420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55d89411c520 con 0x55d893e75840 2024-07-26T13:26:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d8941840a0 con 0x55d893e54b60 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d893fe37a0 con 0x55d893e4c980 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b3e09b740 10 client.0 _ll_register_callbacks cb 0x55d894178bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b35400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d894226ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d894226ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41224/0 (socket says 172.21.15.40:41224) 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b2fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894227420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b34a00640 1 -- 172.21.15.40:0/2813609881 learned_addr learned my addr 172.21.15.40:0/2813609881 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.962+0000 7f4b35400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40784/0 (socket says 172.21.15.40:40784) 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.963+0000 7f4b35400640 1 -- 172.21.15.40:0/2813609881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 msgr2=0x55d894226ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.963+0000 7f4b35400640 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d894226ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.963+0000 7f4b35400640 1 -- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 msgr2=0x55d894227420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.963+0000 7f4b35400640 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894227420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.963+0000 7f4b35400640 1 -- 172.21.15.40:0/2813609881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d893eefb90 con 0x55d893e75840 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b35400640 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232d00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f4b280126f0 tx=0x7f4b28012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0276bb4f78637bc server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b16000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b16000640 1 -- 172.21.15.40:0/2813609881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28003d80 con 0x55d893e75840 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2401b8b0 con 0x55d893e75840 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b16000640 1 -- 172.21.15.40:0/2813609881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4b28010950 con 0x55d893e75840 2024-07-26T13:26:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b16000640 1 -- 172.21.15.40:0/2813609881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4b28010b50 con 0x55d893e75840 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.964+0000 7f4b3e09b740 10 client.18018 fetch_fsmap learned FSMap version 35 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d894235a50 con 0x55d893e75840 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b16000640 1 -- 172.21.15.40:0/2813609881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2401b8b0 con 0x55d893e75840 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b16000640 1 -- 172.21.15.40:0/2813609881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4b28019070 con 0x55d893e75840 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b3e09b740 10 client.18018 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b3e09b740 10 client.18018 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b3e09b740 20 client.18018 populate_metadata read hostname 'smithi040' 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.965+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e341c0 0x55d894238f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.966+0000 7f4b3e09b740 4 client.18018 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.966+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d894192ab0 con 0x55d893e341c0 2024-07-26T13:26:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.967+0000 7f4b34a00640 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e341c0 0x55d894238f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.968+0000 7f4b34a00640 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e341c0 0x55d894238f70 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c70407bc9738dac server_cookie=f1b8f5f385567cf8 in_seq=0 out_seq=0 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.968+0000 7f4b16000640 10 client.18018 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.970+0000 7f4b16000640 1 -- 172.21.15.40:0/2813609881 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d894192ab0 con 0x55d893e341c0 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.970+0000 7f4b16000640 10 client.18018 handle_command_reply: tid=0 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.970+0000 7f4b3e09b740 1 client.18018 shutdown 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.970+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 msgr2=0x55d894232d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.970+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232d00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f4b280126f0 tx=0x7f4b28012bb0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 shutdown_connections 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e341c0 0x55d894238f70 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232d00 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894227420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/2813609881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d894226ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 >> 172.21.15.40:0/2813609881 conn(0x55d893e69990 msgr2=0x55d89421e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:26.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b16000640 0 client.18018 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:26.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 shutdown_connections 2024-07-26T13:26:26.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 1 -- 172.21.15.40:0/2813609881 wait complete. 2024-07-26T13:26:26.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.971+0000 7f4b3e09b740 20 client.18018 trim_cache size 0 max 16384 2024-07-26T13:26:26.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 Processor -- start 2024-07-26T13:26:26.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 -- start start 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894221e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b0da0 con 0x55d893e75840 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b28e0 con 0x55d893e54b60 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.991+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b1470 con 0x55d893e4c980 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40786/0 (socket says 172.21.15.40:40786) 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 -- 172.21.15.40:0/756935487 learned_addr learned my addr 172.21.15.40:0/756935487 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:26.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b34a00640 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894221e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 -- 172.21.15.40:0/756935487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 msgr2=0x55d89421ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 -- 172.21.15.40:0/756935487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 msgr2=0x55d894221e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894221e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.992+0000 7f4b35400640 1 -- 172.21.15.40:0/756935487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8942275c0 con 0x55d893e75840 2024-07-26T13:26:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.993+0000 7f4b35400640 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232af0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4b2801b4c0 tx=0x7f4b28009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7400f30c055f86 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.993+0000 7f4b21200640 1 -- 172.21.15.40:0/756935487 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28012070 con 0x55d893e75840 2024-07-26T13:26:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.993+0000 7f4b21200640 1 -- 172.21.15.40:0/756935487 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2802a070 con 0x55d893e75840 2024-07-26T13:26:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.993+0000 7f4b21200640 1 -- 172.21.15.40:0/756935487 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b280050b0 con 0x55d893e75840 2024-07-26T13:26:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 -- 172.21.15.40:0/756935487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 msgr2=0x55d894232af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232af0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4b2801b4c0 tx=0x7f4b28009d40 comp rx=0 tx=0).stop 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 -- 172.21.15.40:0/756935487 shutdown_connections 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e75840 0x55d894232af0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e54b60 0x55d894221e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/756935487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e4c980 0x55d89421ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.994+0000 7f4b3e09b740 1 -- 172.21.15.40:0/756935487 >> 172.21.15.40:0/756935487 conn(0x55d893e69990 msgr2=0x55d894225560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.995+0000 7f4b3e09b740 1 -- 172.21.15.40:0/756935487 shutdown_connections 2024-07-26T13:26:26.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.995+0000 7f4b3e09b740 1 -- 172.21.15.40:0/756935487 wait complete. 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.995+0000 7f4b3e09b740 1 -- start start 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 Processor -- start 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 0x55d89422f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e54b60 0x55d89422a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e75840 0x55d89422aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b2210 con 0x55d893e4c980 2024-07-26T13:26:26.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b1b40 con 0x55d893e75840 2024-07-26T13:26:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301aed60 con 0x55d893e54b60 2024-07-26T13:26:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.996+0000 7f4b3e09b740 10 client.0 _ll_register_callbacks cb 0x7f4b28009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:26:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 0x55d89422f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 0x55d89422f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40796/0 (socket says 172.21.15.40:40796) 2024-07-26T13:26:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 -- 172.21.15.40:0/1674788274 learned_addr learned my addr 172.21.15.40:0/1674788274 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e54b60 0x55d89422a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:27.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b35400640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e75840 0x55d89422aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:27.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 -- 172.21.15.40:0/1674788274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e54b60 msgr2=0x55d89422a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:27.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e54b60 0x55d89422a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 -- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e75840 msgr2=0x55d89422aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e75840 0x55d89422aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b34a00640 1 -- 172.21.15.40:0/1674788274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d89422af40 con 0x55d893e4c980 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.997+0000 7f4b35400640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e75840 0x55d89422aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.998+0000 7f4b34a00640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 0x55d89422f010 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400a9c0 tx=0x7f4b24010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527b737103c38cde server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.998+0000 7f4b16000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.998+0000 7f4b16000640 1 -- 172.21.15.40:0/1674788274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24016030 con 0x55d893e4c980 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.998+0000 7f4b16000640 1 -- 172.21.15.40:0/1674788274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4b24005240 con 0x55d893e4c980 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.998+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2802a070 con 0x55d893e4c980 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b16000640 1 -- 172.21.15.40:0/1674788274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4b2402a040 con 0x55d893e4c980 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 10 client.18024 fetch_fsmap learned FSMap version 35 2024-07-26T13:26:27.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d8942a12c0 con 0x55d893e4c980 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b16000640 1 -- 172.21.15.40:0/1674788274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b2802a070 con 0x55d893e4c980 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b16000640 1 -- 172.21.15.40:0/1674788274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f4b2401c530 con 0x55d893e4c980 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 10 client.18024 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 10 client.18024 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 20 client.18024 populate_metadata read hostname 'smithi040' 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e09570 0x55d8942a3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 4 client.18024 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:26.999+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55d89418e550 con 0x55d893e09570 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.000+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e09570 0x55d8942a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.001+0000 7f4b2fe00640 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e09570 0x55d8942a3930 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d790957f4c4ee2f6 server_cookie=16b0616650d3f40e in_seq=0 out_seq=0 2024-07-26T13:26:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.001+0000 7f4b16000640 10 client.18024 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:27 smithi040 ceph-mon[32397]: pgmap v2425: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T13:26:27.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.295+0000 7f4b16000640 1 -- 172.21.15.40:0/1674788274 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55d89418e550 con 0x55d893e09570 2024-07-26T13:26:27.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.295+0000 7f4b16000640 10 client.18024 handle_command_reply: tid=0 2024-07-26T13:26:27.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.295+0000 7f4b3e09b740 1 client.18024 shutdown 2024-07-26T13:26:27.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 msgr2=0x55d89422f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 0x55d89422f010 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400a9c0 tx=0x7f4b24010f00 comp rx=0 tx=0).stop 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 shutdown_connections 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d893e75840 0x55d89422aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d893e54b60 0x55d89422a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d893e09570 0x55d8942a3930 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 --2- 172.21.15.40:0/1674788274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d893e4c980 0x55d89422f010 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b16000640 0 client.18024 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.296+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 >> 172.21.15.40:0/1674788274 conn(0x55d893e69990 msgr2=0x55d8942254f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.297+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 shutdown_connections 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.297+0000 7f4b3e09b740 1 -- 172.21.15.40:0/1674788274 wait complete. 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.297+0000 7f4b3e09b740 20 client.18024 trim_cache size 0 max 16384 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:26:27.299 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 214, 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "10794cb": { 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 214, 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:26:27.301 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:26:27.301 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:26:27.301 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:26:27.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:26:27.301 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:26:27.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:27.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:27.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:27.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:27.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:27.302 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:26:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.298+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b180b3c70 msgr2=0x7f4b180b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.298+0000 7f4b35e00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b180b3c70 0x7f4b180b6180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400abe0 tx=0x7f4b2400a2d0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.298+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 msgr2=0x7f4b3019c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.298+0000 7f4b35e00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3019c450 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c02a930 tx=0x7f4b1c003c20 comp rx=0 tx=0).stop 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 shutdown_connections 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4b180b3c70 0x7f4b180b6180 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3010b8b0 0x7f4b301a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3010af60 0x7f4b3019c450 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 --2- 172.21.15.40:0/3600922843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b30105620 0x7f4b3019beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 >> 172.21.15.40:0/3600922843 conn(0x7f4b301010b0 msgr2=0x7f4b301034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 shutdown_connections 2024-07-26T13:26:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:27.299+0000 7f4b35e00640 1 -- 172.21.15.40:0/3600922843 wait complete. 2024-07-26T13:26:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:27 smithi146 ceph-mon[35807]: pgmap v2425: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T13:26:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:27 smithi076 ceph-mon[35401]: pgmap v2425: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 12 op/s 2024-07-26T13:26:28.244 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '10794cb', quiesce took 10.7 seconds. Will release after: -0.6999999999999993 2024-07-26T13:26:28.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:26:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:26:29.230 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:29 smithi040 ceph-mon[32397]: pgmap v2426: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.0 MiB/s wr, 12 op/s 2024-07-26T13:26:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:29 smithi146 ceph-mon[35807]: pgmap v2426: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.0 MiB/s wr, 12 op/s 2024-07-26T13:26:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:29 smithi076 ceph-mon[35401]: pgmap v2426: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.0 MiB/s wr, 12 op/s 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 -- 172.21.15.40:0/1695687652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f241055d0 msgr2=0x7f2f241059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 --2- 172.21.15.40:0/1695687652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f241055d0 0x7f2f241059e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009900 tx=0x7f2f1402a410 comp rx=0 tx=0).stop 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 -- 172.21.15.40:0/1695687652 shutdown_connections 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 --2- 172.21.15.40:0/1695687652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2410b860 0x7f2f24112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 --2- 172.21.15.40:0/1695687652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f2410af10 0x7f2f2410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 --2- 172.21.15.40:0/1695687652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f241055d0 0x7f2f241059e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 -- 172.21.15.40:0/1695687652 >> 172.21.15.40:0/1695687652 conn(0x7f2f24101040 msgr2=0x7f2f24103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 -- 172.21.15.40:0/1695687652 shutdown_connections 2024-07-26T13:26:31.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:30.999+0000 7f2f23200640 1 -- 172.21.15.40:0/1695687652 wait complete. 2024-07-26T13:26:31.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.000+0000 7f2f23200640 1 Processor -- start 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.000+0000 7f2f23200640 1 -- start start 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f23200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f241055d0 0x7f2f2419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f23200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 0x7f2f2419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f23200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2410b860 0x7f2f241a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f23200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241153e0 con 0x7f2f2410af10 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f23200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24115260 con 0x7f2f241055d0 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f23200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24115560 con 0x7f2f2410b860 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f21400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 0x7f2f2419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f21400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 0x7f2f2419c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40820/0 (socket says 172.21.15.40:40820) 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f21400640 1 -- 172.21.15.40:0/2309717790 learned_addr learned my addr 172.21.15.40:0/2309717790 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:31.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.001+0000 7f2f21e00640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f241055d0 0x7f2f2419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:31.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f22800640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2410b860 0x7f2f241a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:31.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21400640 1 -- 172.21.15.40:0/2309717790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2410b860 msgr2=0x7f2f241a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:31.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21400640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2410b860 0x7f2f241a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21400640 1 -- 172.21.15.40:0/2309717790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f241055d0 msgr2=0x7f2f2419be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21400640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f241055d0 0x7f2f2419be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21400640 1 -- 172.21.15.40:0/2309717790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f241a1de0 con 0x7f2f2410af10 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21e00640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f241055d0 0x7f2f2419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f21400640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 0x7f2f2419c410 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000e9f0 tx=0x7f2f1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000ccc0 con 0x7f2f2410af10 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f100108c0 con 0x7f2f2410af10 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.002+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f241a20d0 con 0x7f2f2410af10 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.003+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f10018750 con 0x7f2f2410af10 2024-07-26T13:26:31.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.003+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241a8830 con 0x7f2f2410af10 2024-07-26T13:26:31.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.004+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f241059e0 con 0x7f2f2410af10 2024-07-26T13:26:31.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.007+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2f10010430 con 0x7f2f2410af10 2024-07-26T13:26:31.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.011+0000 7f2f1aa00640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2f080b3c50 0x7f2f080b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:31.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.012+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2f100e44d0 con 0x7f2f2410af10 2024-07-26T13:26:31.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.012+0000 7f2f21e00640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2f080b3c50 0x7f2f080b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.013+0000 7f2f21e00640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2f080b3c50 0x7f2f080b6160 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.013+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f2f100abae0 con 0x7f2f2410af10 2024-07-26T13:26:31.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.254+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f2419cfa0 con 0x7f2f2410af10 2024-07-26T13:26:31.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:31 smithi040 ceph-mon[32397]: pgmap v2427: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:26:31.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.256+0000 7f2f1aa00640 1 -- 172.21.15.40:0/2309717790 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f2f100ab3e0 con 0x7f2f2410af10 2024-07-26T13:26:31.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:26:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:26:31.259 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:26:31.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2f080b3c50 msgr2=0x7f2f080b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:31.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2f080b3c50 0x7f2f080b6160 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f14005a20 comp rx=0 tx=0).stop 2024-07-26T13:26:31.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 msgr2=0x7f2f2419c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:31.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 0x7f2f2419c410 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000e9f0 tx=0x7f2f1000eeb0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 shutdown_connections 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2f080b3c50 0x7f2f080b6160 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2410b860 0x7f2f241a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2410af10 0x7f2f2419c410 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 --2- 172.21.15.40:0/2309717790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f241055d0 0x7f2f2419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.259+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 >> 172.21.15.40:0/2309717790 conn(0x7f2f24101040 msgr2=0x7f2f24103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.260+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 shutdown_connections 2024-07-26T13:26:31.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:31.260+0000 7f2f23200640 1 -- 172.21.15.40:0/2309717790 wait complete. 2024-07-26T13:26:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:31 smithi146 ceph-mon[35807]: pgmap v2427: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:26:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:31 smithi076 ceph-mon[35401]: pgmap v2427: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:26:32.115 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 10794cb --release --await' 2024-07-26T13:26:32.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 10794cb --release --await 2024-07-26T13:26:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:32 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2309717790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:32 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2309717790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:32 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2309717790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:26:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:33 smithi040 ceph-mon[32397]: pgmap v2428: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:26:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:33 smithi146 ceph-mon[35807]: pgmap v2428: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:26:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:33 smithi076 ceph-mon[35401]: pgmap v2428: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:26:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 -- 172.21.15.40:0/2891768636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 msgr2=0x7f293c10fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 --2- 172.21.15.40:0/2891768636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c10fd40 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2934009900 tx=0x7f293402a410 comp rx=0 tx=0).stop 2024-07-26T13:26:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 -- 172.21.15.40:0/2891768636 shutdown_connections 2024-07-26T13:26:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 --2- 172.21.15.40:0/2891768636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c10fd40 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 --2- 172.21.15.40:0/2891768636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f293c104d20 0x7f293c10d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 --2- 172.21.15.40:0/2891768636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293c1042f0 0x7f293c104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 -- 172.21.15.40:0/2891768636 >> 172.21.15.40:0/2891768636 conn(0x7f293c079170 msgr2=0x7f293c079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 -- 172.21.15.40:0/2891768636 shutdown_connections 2024-07-26T13:26:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.806+0000 7f2943600640 1 -- 172.21.15.40:0/2891768636 wait complete. 2024-07-26T13:26:34.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.808+0000 7f2943600640 1 Processor -- start 2024-07-26T13:26:34.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.808+0000 7f2943600640 1 -- start start 2024-07-26T13:26:34.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2943600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f293c1042f0 0x7f293c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2943600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293c104d20 0x7f293c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2943600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2943600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1133b0 con 0x7f293c10d8a0 2024-07-26T13:26:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2943600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f293c113230 con 0x7f293c1042f0 2024-07-26T13:26:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2943600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f293c113530 con 0x7f293c104d20 2024-07-26T13:26:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.809+0000 7f2941600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56912/0 (socket says 172.21.15.40:56912) 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 -- 172.21.15.40:0/2925342041 learned_addr learned my addr 172.21.15.40:0/2925342041 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2940c00640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f293c1042f0 0x7f293c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f293be00640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293c104d20 0x7f293c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 -- 172.21.15.40:0/2925342041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293c104d20 msgr2=0x7f293c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293c104d20 0x7f293c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 -- 172.21.15.40:0/2925342041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f293c1042f0 msgr2=0x7f293c199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f293c1042f0 0x7f293c199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.810+0000 7f2941600640 1 -- 172.21.15.40:0/2925342041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c19fd30 con 0x7f293c10d8a0 2024-07-26T13:26:34.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.811+0000 7f2941600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c19f600 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2934004770 tx=0x7f2934003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:34.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.811+0000 7f2939600640 1 -- 172.21.15.40:0/2925342041 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293403f070 con 0x7f293c10d8a0 2024-07-26T13:26:34.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.811+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293c19ffc0 con 0x7f293c10d8a0 2024-07-26T13:26:34.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.811+0000 7f2939600640 1 -- 172.21.15.40:0/2925342041 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f293403bd00 con 0x7f293c10d8a0 2024-07-26T13:26:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.811+0000 7f2939600640 1 -- 172.21.15.40:0/2925342041 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934035030 con 0x7f293c10d8a0 2024-07-26T13:26:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.811+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293c1020e0 con 0x7f293c10d8a0 2024-07-26T13:26:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.815+0000 7f294a27e740 1 Processor -- start 2024-07-26T13:26:34.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.815+0000 7f2939600640 1 -- 172.21.15.40:0/2925342041 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2934042070 con 0x7f293c10d8a0 2024-07-26T13:26:34.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 -- start start 2024-07-26T13:26:34.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c49efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c49f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c49fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56479c415f50 con 0x56479c0d9840 2024-07-26T13:26:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56479c405450 con 0x56479c0fa520 2024-07-26T13:26:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.816+0000 7f294a27e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56479c409490 con 0x56479c0d1660 2024-07-26T13:26:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c49fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c49fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56922/0 (socket says 172.21.15.40:56922) 2024-07-26T13:26:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 -- 172.21.15.40:0/216502280 learned_addr learned my addr 172.21.15.40:0/216502280 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f2940c00640 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c49f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c49efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 -- 172.21.15.40:0/216502280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 msgr2=0x56479c49f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c49f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 -- 172.21.15.40:0/216502280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 msgr2=0x56479c49efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c49efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.817+0000 7f293be00640 1 -- 172.21.15.40:0/216502280 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479c165b00 con 0x56479c0d9840 2024-07-26T13:26:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.818+0000 7f2939600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f29200b3bd0 0x7f29200b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.818+0000 7f2939600640 1 -- 172.21.15.40:0/2925342041 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2934104370 con 0x7f293c10d8a0 2024-07-26T13:26:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.818+0000 7f2940c00640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f29200b3bd0 0x7f29200b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.818+0000 7f293be00640 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c49fa60 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2924009990 tx=0x7f2924011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a158fe332dd0466f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.818+0000 7f2931c00640 1 -- 172.21.15.40:0/216502280 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924024070 con 0x56479c0d9840 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.819+0000 7f2931c00640 1 -- 172.21.15.40:0/216502280 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f292401b670 con 0x56479c0d9840 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.819+0000 7f2931c00640 1 -- 172.21.15.40:0/216502280 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29240044c0 con 0x56479c0d9840 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 -- 172.21.15.40:0/216502280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 msgr2=0x56479c49fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c49fa60 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2924009990 tx=0x7f2924011040 comp rx=0 tx=0).stop 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f2940c00640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f29200b3bd0 0x7f29200b60e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x56479c49dc60 tx=0x7f292c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 -- 172.21.15.40:0/216502280 shutdown_connections 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c49fa60 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c49f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 --2- 172.21.15.40:0/216502280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c49efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 -- 172.21.15.40:0/216502280 >> 172.21.15.40:0/216502280 conn(0x56479c0ee910 msgr2=0x56479c49ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 -- 172.21.15.40:0/216502280 shutdown_connections 2024-07-26T13:26:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.820+0000 7f294a27e740 1 -- 172.21.15.40:0/216502280 wait complete. 2024-07-26T13:26:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.821+0000 7f294a27e740 1 -- start start 2024-07-26T13:26:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.821+0000 7f294a27e740 1 Processor -- start 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.821+0000 7f294a27e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 0x56479c4aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.821+0000 7f294a27e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d9840 0x56479c4aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.821+0000 7f294a27e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c4b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f294a27e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56479c268bb0 con 0x56479c0d1660 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f294a27e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56479c3a1930 con 0x56479c0fa520 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f294a27e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56479c4ad7c0 con 0x56479c0d9840 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f294a27e740 10 client.0 _ll_register_callbacks cb 0x56479c111d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 0x56479c4aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 0x56479c4aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56936/0 (socket says 172.21.15.40:56936) 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 -- 172.21.15.40:0/456319045 learned_addr learned my addr 172.21.15.40:0/456319045 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f293be00640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d9840 0x56479c4aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2941600640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c4b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 -- 172.21.15.40:0/456319045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d9840 msgr2=0x56479c4aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d9840 0x56479c4aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 -- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 msgr2=0x56479c4b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c4b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.822+0000 7f2940c00640 1 -- 172.21.15.40:0/456319045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479c1dc960 con 0x56479c0d1660 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f2940c00640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 0x56479c4aa680 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f292c0042c0 tx=0x7f292c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de629076386dda5b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f292a000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f292a000640 1 -- 172.21.15.40:0/456319045 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c004840 con 0x56479c0d1660 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f292401b670 con 0x56479c0d1660 2024-07-26T13:26:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f292a000640 1 -- 172.21.15.40:0/456319045 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f292c020420 con 0x56479c0d1660 2024-07-26T13:26:34.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f292a000640 1 -- 172.21.15.40:0/456319045 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f292c020620 con 0x56479c0d1660 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.823+0000 7f294a27e740 10 client.18042 fetch_fsmap learned FSMap version 35 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56479c4b9510 con 0x56479c0d1660 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f292a000640 1 -- 172.21.15.40:0/456319045 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f292401b670 con 0x56479c0d1660 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f292a000640 1 -- 172.21.15.40:0/456319045 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f292c00f040 con 0x56479c0d1660 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 10 client.18042 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 10 client.18042 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 20 client.18042 populate_metadata read hostname 'smithi040' 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c0b8ea0 0x56479c4bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 4 client.18042 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.824+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56479c417ea0 con 0x56479c0b8ea0 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.825+0000 7f293be00640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c0b8ea0 0x56479c4bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.826+0000 7f293be00640 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c0b8ea0 0x56479c4bca40 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6277b662b8f0cd38 server_cookie=ceb99c24bc913496 in_seq=0 out_seq=0 2024-07-26T13:26:34.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.826+0000 7f292a000640 10 client.18042 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:34.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.828+0000 7f292a000640 1 -- 172.21.15.40:0/456319045 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56479c417ea0 con 0x56479c0b8ea0 2024-07-26T13:26:34.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.828+0000 7f292a000640 10 client.18042 handle_command_reply: tid=0 2024-07-26T13:26:34.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.828+0000 7f294a27e740 1 client.18042 shutdown 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 msgr2=0x56479c4aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 0x56479c4aa680 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f292c0042c0 tx=0x7f292c004a40 comp rx=0 tx=0).stop 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 shutdown_connections 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0fa520 0x56479c4b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d9840 0x56479c4aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c0b8ea0 0x56479c4bca40 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 --2- 172.21.15.40:0/456319045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d1660 0x56479c4aa680 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f292a000640 0 client.18042 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:34.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 >> 172.21.15.40:0/456319045 conn(0x56479c0ee910 msgr2=0x56479c4a21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:34.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 shutdown_connections 2024-07-26T13:26:34.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 1 -- 172.21.15.40:0/456319045 wait complete. 2024-07-26T13:26:34.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.829+0000 7f294a27e740 20 client.18042 trim_cache size 0 max 16384 2024-07-26T13:26:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 Processor -- start 2024-07-26T13:26:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 -- start start 2024-07-26T13:26:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d1660 0x56479c4b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c4b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0fa520 0x56479c4c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1acb90 con 0x56479c0d9840 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1ae6d0 con 0x56479c0d1660 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.855+0000 7f294a27e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1ad260 con 0x56479c0fa520 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c4b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c4b6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56948/0 (socket says 172.21.15.40:56948) 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 -- 172.21.15.40:0/2621018762 learned_addr learned my addr 172.21.15.40:0/2621018762 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f2940c00640 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d1660 0x56479c4b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f2941600640 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0fa520 0x56479c4c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 -- 172.21.15.40:0/2621018762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0fa520 msgr2=0x56479c4c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0fa520 0x56479c4c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 -- 172.21.15.40:0/2621018762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d1660 msgr2=0x56479c4b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d1660 0x56479c4b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f293be00640 1 -- 172.21.15.40:0/2621018762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479c4a8b80 con 0x56479c0d9840 2024-07-26T13:26:34.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.856+0000 7f2940c00640 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d1660 0x56479c4b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:26:34.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.857+0000 7f293be00640 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c4b6de0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f2924009960 tx=0x7f2924005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5f6b84279c1c9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:34.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.857+0000 7f2931200640 1 -- 172.21.15.40:0/2621018762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924024040 con 0x56479c0d9840 2024-07-26T13:26:34.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.857+0000 7f2931200640 1 -- 172.21.15.40:0/2621018762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29240055b0 con 0x56479c0d9840 2024-07-26T13:26:34.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.857+0000 7f2931200640 1 -- 172.21.15.40:0/2621018762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924003850 con 0x56479c0d9840 2024-07-26T13:26:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 -- 172.21.15.40:0/2621018762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 msgr2=0x56479c4b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c4b6de0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f2924009960 tx=0x7f2924005440 comp rx=0 tx=0).stop 2024-07-26T13:26:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 -- 172.21.15.40:0/2621018762 shutdown_connections 2024-07-26T13:26:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0fa520 0x56479c4c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0d9840 0x56479c4b6de0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 --2- 172.21.15.40:0/2621018762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d1660 0x56479c4b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 -- 172.21.15.40:0/2621018762 >> 172.21.15.40:0/2621018762 conn(0x56479c0ee910 msgr2=0x56479c4a4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.858+0000 7f294a27e740 1 -- 172.21.15.40:0/2621018762 shutdown_connections 2024-07-26T13:26:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.859+0000 7f294a27e740 1 -- 172.21.15.40:0/2621018762 wait complete. 2024-07-26T13:26:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.859+0000 7f294a27e740 1 -- start start 2024-07-26T13:26:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.859+0000 7f294a27e740 1 Processor -- start 2024-07-26T13:26:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c4af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d9840 0x56479c4af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 0x56479c51e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1ae000 con 0x56479c0fa520 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1ad930 con 0x56479c0d9840 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1aab50 con 0x56479c0d1660 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.860+0000 7f294a27e740 10 client.0 _ll_register_callbacks cb 0x7f292c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 0x56479c51e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 0x56479c51e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56950/0 (socket says 172.21.15.40:56950) 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f293be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d9840 0x56479c4af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 -- 172.21.15.40:0/3926842582 learned_addr learned my addr 172.21.15.40:0/3926842582 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2940c00640 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c4af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 -- 172.21.15.40:0/3926842582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 msgr2=0x56479c4af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c4af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 -- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d9840 msgr2=0x56479c4af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d9840 0x56479c4af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.861+0000 7f2941600640 1 -- 172.21.15.40:0/3926842582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479c51e8f0 con 0x56479c0fa520 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f2941600640 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 0x56479c51e280 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f29340c85a0 tx=0x7f2934005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5449dcde2b2632 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f292a000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f292a000640 1 -- 172.21.15.40:0/3926842582 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934049040 con 0x56479c0fa520 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f292a000640 1 -- 172.21.15.40:0/3926842582 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f29340c75c0 con 0x56479c0fa520 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29240055b0 con 0x56479c0fa520 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f292a000640 1 -- 172.21.15.40:0/3926842582 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f29340cf880 con 0x56479c0fa520 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f294a27e740 10 client.18048 fetch_fsmap learned FSMap version 35 2024-07-26T13:26:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.862+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56479c525d00 con 0x56479c0fa520 2024-07-26T13:26:34.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f292a000640 1 -- 172.21.15.40:0/3926842582 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29240055b0 con 0x56479c0fa520 2024-07-26T13:26:34.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f292a000640 1 -- 172.21.15.40:0/3926842582 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2934103030 con 0x56479c0fa520 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f294a27e740 10 client.18048 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f294a27e740 10 client.18048 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f294a27e740 20 client.18048 populate_metadata read hostname 'smithi040' 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f294a27e740 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c08e250 0x56479c5284f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f294a27e740 4 client.18048 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "10794cb", "release": true, "await": true}] 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.863+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "10794cb", "release": true, "await": true}) -- 0x56479c413940 con 0x56479c08e250 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.864+0000 7f2940c00640 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c08e250 0x56479c5284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.865+0000 7f2940c00640 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c08e250 0x56479c5284f0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a083cf1bda50c0 server_cookie=fe1f9acb215cb821 in_seq=0 out_seq=0 2024-07-26T13:26:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.865+0000 7f292a000640 10 client.18048 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:34.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.939+0000 7f292a000640 1 -- 172.21.15.40:0/3926842582 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56479c413940 con 0x56479c08e250 2024-07-26T13:26:34.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.939+0000 7f292a000640 10 client.18048 handle_command_reply: tid=0 2024-07-26T13:26:34.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.939+0000 7f294a27e740 1 client.18048 shutdown 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.940+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 msgr2=0x56479c51e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.940+0000 7f294a27e740 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 0x56479c51e280 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f29340c85a0 tx=0x7f2934005de0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.940+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 shutdown_connections 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.940+0000 7f294a27e740 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56479c08e250 0x56479c5284f0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.940+0000 7f294a27e740 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56479c0fa520 0x56479c51e280 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.941+0000 7f294a27e740 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56479c0d9840 0x56479c4af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.941+0000 7f294a27e740 1 --2- 172.21.15.40:0/3926842582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56479c0d1660 0x56479c4af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.941+0000 7f292a000640 0 client.18048 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:26:34.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.941+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 >> 172.21.15.40:0/3926842582 conn(0x56479c0ee910 msgr2=0x56479c4b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:34.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.941+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 shutdown_connections 2024-07-26T13:26:34.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.941+0000 7f294a27e740 1 -- 172.21.15.40:0/3926842582 wait complete. 2024-07-26T13:26:34.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.942+0000 7f294a27e740 20 client.18048 trim_cache size 0 max 16384 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 216, 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "10794cb": { 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 216, 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:26:34.943 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 130.0, 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:34.944 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:34.945 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:34.945 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:26:34.945 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:26:34.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.943+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f29200b3bd0 msgr2=0x7f29200b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.943+0000 7f2943600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f29200b3bd0 0x7f29200b60e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x56479c49dc60 tx=0x7f292c009680 comp rx=0 tx=0).stop 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.943+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 msgr2=0x7f293c19f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.943+0000 7f2943600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c19f600 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2934004770 tx=0x7f2934003cd0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 shutdown_connections 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f293c10d8a0 0x7f293c19f600 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f29200b3bd0 0x7f29200b60e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f293c104d20 0x7f293c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 --2- 172.21.15.40:0/2925342041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f293c1042f0 0x7f293c199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:34.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 >> 172.21.15.40:0/2925342041 conn(0x7f293c079170 msgr2=0x7f293c100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:34.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 shutdown_connections 2024-07-26T13:26:34.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:34.944+0000 7f2943600640 1 -- 172.21.15.40:0/2925342041 wait complete. 2024-07-26T13:26:35.480 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:35 smithi040 ceph-mon[32397]: pgmap v2429: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-07-26T13:26:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:35 smithi146 ceph-mon[35807]: pgmap v2429: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-07-26T13:26:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:35 smithi076 ceph-mon[35401]: pgmap v2429: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-07-26T13:26:35.938 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '10794cb', total seconds elapsed: 18.3 2024-07-26T13:26:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:37 smithi040 ceph-mon[32397]: pgmap v2430: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:26:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:37 smithi146 ceph-mon[35807]: pgmap v2430: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:26:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:37 smithi076 ceph-mon[35401]: pgmap v2430: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 MiB/s wr, 11 op/s 2024-07-26T13:26:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:39 smithi040 ceph-mon[32397]: pgmap v2431: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:26:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:39 smithi146 ceph-mon[35807]: pgmap v2431: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:26:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:39 smithi076 ceph-mon[35401]: pgmap v2431: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2024-07-26T13:26:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:41 smithi040 ceph-mon[32397]: pgmap v2432: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T13:26:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:41 smithi146 ceph-mon[35807]: pgmap v2432: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T13:26:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:41 smithi076 ceph-mon[35401]: pgmap v2432: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2024-07-26T13:26:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:43 smithi040 ceph-mon[32397]: pgmap v2433: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T13:26:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:43 smithi146 ceph-mon[35807]: pgmap v2433: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T13:26:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:43 smithi076 ceph-mon[35401]: pgmap v2433: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-07-26T13:26:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:45 smithi040 ceph-mon[32397]: pgmap v2434: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:26:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:45 smithi146 ceph-mon[35807]: pgmap v2434: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:26:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:45 smithi076 ceph-mon[35401]: pgmap v2434: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.7 MiB/s wr, 11 op/s 2024-07-26T13:26:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:47 smithi040 ceph-mon[32397]: pgmap v2435: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T13:26:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:47 smithi146 ceph-mon[35807]: pgmap v2435: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T13:26:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:47 smithi076 ceph-mon[35401]: pgmap v2435: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2024-07-26T13:26:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:49 smithi040 ceph-mon[32397]: pgmap v2436: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T13:26:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:49 smithi146 ceph-mon[35807]: pgmap v2436: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T13:26:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:49 smithi076 ceph-mon[35401]: pgmap v2436: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-07-26T13:26:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:51 smithi040 ceph-mon[32397]: pgmap v2437: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T13:26:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:51 smithi146 ceph-mon[35807]: pgmap v2437: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T13:26:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:51 smithi076 ceph-mon[35401]: pgmap v2437: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-07-26T13:26:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:53 smithi040 ceph-mon[32397]: pgmap v2438: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:26:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:53 smithi146 ceph-mon[35807]: pgmap v2438: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:26:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:53 smithi076 ceph-mon[35401]: pgmap v2438: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-07-26T13:26:54.511 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-07-26T13:26:54.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:26:55.038 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:26:55.471 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:55 smithi040 ceph-mon[32397]: pgmap v2439: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:26:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:55 smithi146 ceph-mon[35807]: pgmap v2439: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:26:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:55 smithi076 ceph-mon[35401]: pgmap v2439: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-07-26T13:26:57.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:57 smithi040 ceph-mon[32397]: pgmap v2440: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:57 smithi146 ceph-mon[35807]: pgmap v2440: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:57 smithi076 ceph-mon[35401]: pgmap v2440: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:26:58.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 -- 172.21.15.40:0/2610176113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd8104290 msgr2=0x7f3bd81046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 --2- 172.21.15.40:0/2610176113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd8104290 0x7f3bd81046a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009900 tx=0x7f3bcc02a410 comp rx=0 tx=0).stop 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 -- 172.21.15.40:0/2610176113 shutdown_connections 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 --2- 172.21.15.40:0/2610176113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bd810d840 0x7f3bd810fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 --2- 172.21.15.40:0/2610176113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104cc0 0x7f3bd810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 --2- 172.21.15.40:0/2610176113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd8104290 0x7f3bd81046a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 -- 172.21.15.40:0/2610176113 >> 172.21.15.40:0/2610176113 conn(0x7f3bd8079170 msgr2=0x7f3bd8079580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 -- 172.21.15.40:0/2610176113 shutdown_connections 2024-07-26T13:26:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.202+0000 7f3be0800640 1 -- 172.21.15.40:0/2610176113 wait complete. 2024-07-26T13:26:58.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.204+0000 7f3be0800640 1 Processor -- start 2024-07-26T13:26:58.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.204+0000 7f3be0800640 1 -- start start 2024-07-26T13:26:58.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3be0800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104290 0x7f3bd819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:58.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3be0800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bd8104cc0 0x7f3bd819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:58.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3be0800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 0x7f3bd81a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3be0800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8113380 con 0x7f3bd810d840 2024-07-26T13:26:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3be0800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8113200 con 0x7f3bd8104cc0 2024-07-26T13:26:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3be0800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8113500 con 0x7f3bd8104290 2024-07-26T13:26:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3bde800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 0x7f3bd81a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3bde800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 0x7f3bd81a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53674/0 (socket says 172.21.15.40:53674) 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3bde800640 1 -- 172.21.15.40:0/3338417235 learned_addr learned my addr 172.21.15.40:0/3338417235 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3bdde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104290 0x7f3bd819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.205+0000 7f3bdd400640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bd8104cc0 0x7f3bd819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bde800640 1 -- 172.21.15.40:0/3338417235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104290 msgr2=0x7f3bd819c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bde800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104290 0x7f3bd819c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bde800640 1 -- 172.21.15.40:0/3338417235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bd8104cc0 msgr2=0x7f3bd819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bde800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bd8104cc0 0x7f3bd819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bde800640 1 -- 172.21.15.40:0/3338417235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd81a1ee0 con 0x7f3bd810d840 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bdde00640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104290 0x7f3bd819c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:26:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.206+0000 7f3bde800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 0x7f3bd81a1870 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400eaa0 tx=0x7f3bd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.207+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400cdb0 con 0x7f3bd810d840 2024-07-26T13:26:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.207+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bd4005020 con 0x7f3bd810d840 2024-07-26T13:26:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.207+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd81a21d0 con 0x7f3bd810d840 2024-07-26T13:26:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.207+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40116d0 con 0x7f3bd810d840 2024-07-26T13:26:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.207+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd81a89f0 con 0x7f3bd810d840 2024-07-26T13:26:58.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.208+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd806bc10 con 0x7f3bd810d840 2024-07-26T13:26:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.211+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3bd40051d0 con 0x7f3bd810d840 2024-07-26T13:26:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.213+0000 7f3bd2a00640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3bc00b3c80 0x7f3bc00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:26:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.213+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3bd40e41a0 con 0x7f3bd810d840 2024-07-26T13:26:58.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.213+0000 7f3bdde00640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3bc00b3c80 0x7f3bc00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:26:58.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.214+0000 7f3bdde00640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3bc00b3c80 0x7f3bc00b6190 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc006010 tx=0x7f3bcc005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:26:58.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.216+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f3bd4016030 con 0x7f3bd810d840 2024-07-26T13:26:58.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.473+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bd81046a0 con 0x7f3bd810d840 2024-07-26T13:26:58.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.475+0000 7f3bd2a00640 1 -- 172.21.15.40:0/3338417235 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f3bd40ab870 con 0x7f3bd810d840 2024-07-26T13:26:58.476 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:26:58.477 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:26:58.477 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:26:58.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3bc00b3c80 msgr2=0x7f3bc00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:58.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3bc00b3c80 0x7f3bc00b6190 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc006010 tx=0x7f3bcc005de0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 msgr2=0x7f3bd81a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:26:58.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 0x7f3bd81a1870 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400eaa0 tx=0x7f3bd400ef60 comp rx=0 tx=0).stop 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 shutdown_connections 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bd810d840 0x7f3bd81a1870 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bd8104cc0 0x7f3bd819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f3bc00b3c80 0x7f3bc00b6190 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 --2- 172.21.15.40:0/3338417235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bd8104290 0x7f3bd819c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 >> 172.21.15.40:0/3338417235 conn(0x7f3bd8079170 msgr2=0x7f3bd81000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 shutdown_connections 2024-07-26T13:26:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:26:58.478+0000 7f3be0800640 1 -- 172.21.15.40:0/3338417235 wait complete. 2024-07-26T13:26:59.298 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-07-26T13:26:59.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-07-26T13:26:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:59 smithi146 ceph-mon[35807]: pgmap v2441: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:26:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:26:59 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3338417235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:59 smithi076 ceph-mon[35401]: pgmap v2441: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:26:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:26:59 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3338417235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:59 smithi040 ceph-mon[32397]: pgmap v2441: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:26:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:26:59 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3338417235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:26:59.821 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:27:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:01 smithi146 ceph-mon[35807]: pgmap v2442: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:27:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:01 smithi076 ceph-mon[35401]: pgmap v2442: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:27:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:01 smithi040 ceph-mon[32397]: pgmap v2442: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-07-26T13:27:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 -- 172.21.15.40:0/865246944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7510104b70 msgr2=0x7f751010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 --2- 172.21.15.40:0/865246944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7510104b70 0x7f751010d0c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009900 tx=0x7f74fc02a410 comp rx=0 tx=0).stop 2024-07-26T13:27:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 -- 172.21.15.40:0/865246944 shutdown_connections 2024-07-26T13:27:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 --2- 172.21.15.40:0/865246944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f751010d680 0x7f751010fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 --2- 172.21.15.40:0/865246944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7510104b70 0x7f751010d0c0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 --2- 172.21.15.40:0/865246944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510104220 0x7f7510104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:02.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.370+0000 7f7515000640 1 -- 172.21.15.40:0/865246944 >> 172.21.15.40:0/865246944 conn(0x7f75100fdd60 msgr2=0x7f75101001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:02.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.371+0000 7f7515000640 1 -- 172.21.15.40:0/865246944 shutdown_connections 2024-07-26T13:27:02.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.371+0000 7f7515000640 1 -- 172.21.15.40:0/865246944 wait complete. 2024-07-26T13:27:02.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.372+0000 7f7515000640 1 Processor -- start 2024-07-26T13:27:02.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.372+0000 7f7515000640 1 -- start start 2024-07-26T13:27:02.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f7515000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510104220 0x7f751019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:02.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f7515000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7510104b70 0x7f751019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:02.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f7515000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 0x7f75101a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:02.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f7515000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7510113160 con 0x7f751010d680 2024-07-26T13:27:02.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f7515000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7510112fe0 con 0x7f7510104b70 2024-07-26T13:27:02.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f7515000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75101132e0 con 0x7f7510104220 2024-07-26T13:27:02.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.373+0000 7f750fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 0x7f75101a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 0x7f75101a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53700/0 (socket says 172.21.15.40:53700) 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 -- 172.21.15.40:0/833604262 learned_addr learned my addr 172.21.15.40:0/833604262 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750f400640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510104220 0x7f751019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750ea00640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7510104b70 0x7f751019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 -- 172.21.15.40:0/833604262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510104220 msgr2=0x7f751019be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510104220 0x7f751019be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 -- 172.21.15.40:0/833604262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7510104b70 msgr2=0x7f751019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7510104b70 0x7f751019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:02.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.374+0000 7f750fe00640 1 -- 172.21.15.40:0/833604262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75101a1e00 con 0x7f751010d680 2024-07-26T13:27:02.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.375+0000 7f750fe00640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 0x7f75101a16d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f750800eaa0 tx=0x7f750800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:02.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.375+0000 7f7507e00640 1 -- 172.21.15.40:0/833604262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750800cdb0 con 0x7f751010d680 2024-07-26T13:27:02.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.375+0000 7f7507e00640 1 -- 172.21.15.40:0/833604262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7508005020 con 0x7f751010d680 2024-07-26T13:27:02.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.375+0000 7f7507e00640 1 -- 172.21.15.40:0/833604262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75080116d0 con 0x7f751010d680 2024-07-26T13:27:02.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.375+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75101a20f0 con 0x7f751010d680 2024-07-26T13:27:02.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.376+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75101a8850 con 0x7f751010d680 2024-07-26T13:27:02.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.380+0000 7f7507e00640 1 -- 172.21.15.40:0/833604262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f75080051d0 con 0x7f751010d680 2024-07-26T13:27:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.382+0000 7f7507e00640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74f40b3bc0 0x7f74f40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.383+0000 7f7507e00640 1 -- 172.21.15.40:0/833604262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f75080e3d40 con 0x7f751010d680 2024-07-26T13:27:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.383+0000 7f750f400640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74f40b3bc0 0x7f74f40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:02.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:02.384+0000 7f750f400640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74f40b3bc0 0x7f74f40b60d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f750000bbe0 tx=0x7f750000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:03.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.241+0000 7f751d3f1740 1 Processor -- start 2024-07-26T13:27:03.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.242+0000 7f751d3f1740 1 -- start start 2024-07-26T13:27:03.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.243+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d34a840 0x563f8d6f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.243+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.243+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d329b60 0x563f8d6f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.243+0000 7f751d3f1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563f8d6bad10 con 0x563f8d329b60 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.243+0000 7f751d3f1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563f8d665b60 con 0x563f8d34a840 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.243+0000 7f751d3f1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563f8d655060 con 0x563f8d321980 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.244+0000 7f750f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d34a840 0x563f8d6f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.244+0000 7f750ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.244+0000 7f750fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d329b60 0x563f8d6f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.244+0000 7f750ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:34098/0 (socket says 172.21.15.40:34098) 2024-07-26T13:27:03.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.244+0000 7f750ea00640 1 -- 172.21.15.40:0/1831969962 learned_addr learned my addr 172.21.15.40:0/1831969962 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:03.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.245+0000 7f750ea00640 1 -- 172.21.15.40:0/1831969962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d34a840 msgr2=0x563f8d6f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.245+0000 7f750ea00640 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d34a840 0x563f8d6f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.245+0000 7f750ea00640 1 -- 172.21.15.40:0/1831969962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d329b60 msgr2=0x563f8d6f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.245+0000 7f750ea00640 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d329b60 0x563f8d6f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.245+0000 7f750ea00640 1 -- 172.21.15.40:0/1831969962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f8d5dcb10 con 0x563f8d321980 2024-07-26T13:27:03.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.246+0000 7f750ea00640 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f08f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0057c0 tx=0x7f74fc031ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fb1bdcefd9723d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:03.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.246+0000 7f7504c00640 1 -- 172.21.15.40:0/1831969962 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc040070 con 0x563f8d321980 2024-07-26T13:27:03.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.247+0000 7f7504c00640 1 -- 172.21.15.40:0/1831969962 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74fc004030 con 0x563f8d321980 2024-07-26T13:27:03.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.247+0000 7f7504c00640 1 -- 172.21.15.40:0/1831969962 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc035040 con 0x563f8d321980 2024-07-26T13:27:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 -- 172.21.15.40:0/1831969962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 msgr2=0x563f8d6f08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f08f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0057c0 tx=0x7f74fc031ba0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 -- 172.21.15.40:0/1831969962 shutdown_connections 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d329b60 0x563f8d6f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f08f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1831969962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d34a840 0x563f8d6f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 -- 172.21.15.40:0/1831969962 >> 172.21.15.40:0/1831969962 conn(0x563f8d33e990 msgr2=0x563f8d6ee2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 -- 172.21.15.40:0/1831969962 shutdown_connections 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.248+0000 7f751d3f1740 1 -- 172.21.15.40:0/1831969962 wait complete. 2024-07-26T13:27:03.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.249+0000 7f751d3f1740 1 -- start start 2024-07-26T13:27:03.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.250+0000 7f751d3f1740 1 Processor -- start 2024-07-26T13:27:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d6fbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d707d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563f8d5f1520 con 0x563f8d321980 2024-07-26T13:27:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563f8d6590a0 con 0x563f8d329b60 2024-07-26T13:27:03.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563f8d4b87a0 con 0x563f8d34a840 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f751d3f1740 10 client.0 _ll_register_callbacks cb 0x563f8d64dbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f750f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d6fbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f750f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d6fbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46368/0 (socket says 172.21.15.40:46368) 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f750f400640 1 -- 172.21.15.40:0/1836100338 learned_addr learned my addr 172.21.15.40:0/1836100338 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.251+0000 7f750ea00640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750fe00640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d707d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750f400640 1 -- 172.21.15.40:0/1836100338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 msgr2=0x563f8d707d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750f400640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d707d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750f400640 1 -- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 msgr2=0x563f8d6fc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750f400640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750f400640 1 -- 172.21.15.40:0/1836100338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f8d3c4b90 con 0x563f8d321980 2024-07-26T13:27:03.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750fe00640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d707d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:27:03.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750ea00640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:27:03.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.252+0000 7f750f400640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d6fbe50 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f75000117e0 tx=0x7f7500004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dbb611b5ae90b9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:03.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.253+0000 7f74f9600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.253+0000 7f74f9600640 1 -- 172.21.15.40:0/1836100338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750001fbb0 con 0x563f8d321980 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.253+0000 7f74f9600640 1 -- 172.21.15.40:0/1836100338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f750001fd50 con 0x563f8d321980 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.253+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74fc004030 con 0x563f8d321980 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.253+0000 7f74f9600640 1 -- 172.21.15.40:0/1836100338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7500028440 con 0x563f8d321980 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f751d3f1740 10 client.18066 fetch_fsmap learned FSMap version 35 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563f8d70a960 con 0x563f8d321980 2024-07-26T13:27:03.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f74f9600640 1 -- 172.21.15.40:0/1836100338 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74fc004030 con 0x563f8d321980 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f74f9600640 1 -- 172.21.15.40:0/1836100338 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7500026070 con 0x563f8d321980 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f751d3f1740 10 client.18066 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f751d3f1740 10 client.18066 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f751d3f1740 20 client.18066 populate_metadata read hostname 'smithi040' 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.254+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d3091c0 0x563f8d70def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.255+0000 7f751d3f1740 4 client.18066 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:27:03.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.255+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f8d667ab0 con 0x563f8d3091c0 2024-07-26T13:27:03.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.255+0000 7f750ea00640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d3091c0 0x563f8d70def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.256+0000 7f750ea00640 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d3091c0 0x563f8d70def0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b01cc511a12bad65 server_cookie=303a039ea09fdc15 in_seq=0 out_seq=0 2024-07-26T13:27:03.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.256+0000 7f74f9600640 10 client.18066 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:03.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.258+0000 7f74f9600640 1 -- 172.21.15.40:0/1836100338 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f8d667ab0 con 0x563f8d3091c0 2024-07-26T13:27:03.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.258+0000 7f74f9600640 10 client.18066 handle_command_reply: tid=0 2024-07-26T13:27:03.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.258+0000 7f751d3f1740 1 client.18066 shutdown 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 msgr2=0x563f8d6fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d6fbe50 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f75000117e0 tx=0x7f7500004730 comp rx=0 tx=0).stop 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 shutdown_connections 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d707d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d3091c0 0x563f8d70def0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1836100338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d6fbe50 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 >> 172.21.15.40:0/1836100338 conn(0x563f8d33e990 msgr2=0x563f8d6f3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:03.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f74f9600640 0 client.18066 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:03.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.259+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 shutdown_connections 2024-07-26T13:27:03.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.260+0000 7f751d3f1740 1 -- 172.21.15.40:0/1836100338 wait complete. 2024-07-26T13:27:03.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.260+0000 7f751d3f1740 20 client.18066 trim_cache size 0 max 16384 2024-07-26T13:27:03.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.286+0000 7f751d3f1740 1 Processor -- start 2024-07-26T13:27:03.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.286+0000 7f751d3f1740 1 -- start start 2024-07-26T13:27:03.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.287+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.287+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.287+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 0x563f8d707af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.287+0000 7f751d3f1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75101b0e10 con 0x563f8d34a840 2024-07-26T13:27:03.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.287+0000 7f751d3f1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75101b2950 con 0x563f8d329b60 2024-07-26T13:27:03.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.287+0000 7f751d3f1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75101b14e0 con 0x563f8d321980 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 0x563f8d707af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 0x563f8d707af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46376/0 (socket says 172.21.15.40:46376) 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 -- 172.21.15.40:0/2025651493 learned_addr learned my addr 172.21.15.40:0/2025651493 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750ea00640 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750f400640 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 -- 172.21.15.40:0/2025651493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 msgr2=0x563f8d6f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 -- 172.21.15.40:0/2025651493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 msgr2=0x563f8d6fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.288+0000 7f750fe00640 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.289+0000 7f750fe00640 1 -- 172.21.15.40:0/2025651493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f8d6f3210 con 0x563f8d34a840 2024-07-26T13:27:03.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.289+0000 7f750fe00640 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 0x563f8d707af0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f75080a7f70 tx=0x7f7508092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25642d8a9243b330 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:03.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.289+0000 7f74fbe00640 1 -- 172.21.15.40:0/2025651493 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750801f040 con 0x563f8d34a840 2024-07-26T13:27:03.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.289+0000 7f74fbe00640 1 -- 172.21.15.40:0/2025651493 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75080e1910 con 0x563f8d34a840 2024-07-26T13:27:03.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.289+0000 7f74fbe00640 1 -- 172.21.15.40:0/2025651493 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75080a68d0 con 0x563f8d34a840 2024-07-26T13:27:03.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.290+0000 7f751d3f1740 1 -- 172.21.15.40:0/2025651493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 msgr2=0x563f8d707af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:03.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.290+0000 7f751d3f1740 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 0x563f8d707af0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f75080a7f70 tx=0x7f7508092040 comp rx=0 tx=0).stop 2024-07-26T13:27:03.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 -- 172.21.15.40:0/2025651493 shutdown_connections 2024-07-26T13:27:03.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d34a840 0x563f8d707af0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 --2- 172.21.15.40:0/2025651493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d321980 0x563f8d6f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 -- 172.21.15.40:0/2025651493 >> 172.21.15.40:0/2025651493 conn(0x563f8d33e990 msgr2=0x563f8d6f13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:03.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 -- 172.21.15.40:0/2025651493 shutdown_connections 2024-07-26T13:27:03.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.291+0000 7f751d3f1740 1 -- 172.21.15.40:0/2025651493 wait complete. 2024-07-26T13:27:03.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.292+0000 7f751d3f1740 1 -- start start 2024-07-26T13:27:03.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.292+0000 7f751d3f1740 1 Processor -- start 2024-07-26T13:27:03.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d704500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d7000c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75101b2280 con 0x563f8d321980 2024-07-26T13:27:03.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75101b1bb0 con 0x563f8d329b60 2024-07-26T13:27:03.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75101aedd0 con 0x563f8d34a840 2024-07-26T13:27:03.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f751d3f1740 10 client.0 _ll_register_callbacks cb 0x7f7500010cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:27:03.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f750f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d704500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f750f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d704500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46380/0 (socket says 172.21.15.40:46380) 2024-07-26T13:27:03.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f750f400640 1 -- 172.21.15.40:0/1527841316 learned_addr learned my addr 172.21.15.40:0/1527841316 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:03.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.293+0000 7f750ea00640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750fe00640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d7000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750f400640 1 -- 172.21.15.40:0/1527841316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 msgr2=0x563f8d7000c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750f400640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d7000c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750f400640 1 -- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 msgr2=0x563f8d6ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750f400640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6ff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750f400640 1 -- 172.21.15.40:0/1527841316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f8d7756c0 con 0x563f8d321980 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750ea00640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f750f400640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d704500 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f75000117e0 tx=0x7f7500032910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f820e4368e56e74 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.294+0000 7f74f9600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f74f9600640 1 -- 172.21.15.40:0/1527841316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750001f800 con 0x563f8d321980 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f74f9600640 1 -- 172.21.15.40:0/1527841316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f750001f9a0 con 0x563f8d321980 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75080e1910 con 0x563f8d321980 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f74f9600640 1 -- 172.21.15.40:0/1527841316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f750001fba0 con 0x563f8d321980 2024-07-26T13:27:03.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f751d3f1740 10 client.18072 fetch_fsmap learned FSMap version 35 2024-07-26T13:27:03.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563f8d776820 con 0x563f8d321980 2024-07-26T13:27:03.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.295+0000 7f74f9600640 1 -- 172.21.15.40:0/1527841316 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75080e1910 con 0x563f8d321980 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f74f9600640 1 -- 172.21.15.40:0/1527841316 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f7500026040 con 0x563f8d321980 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f751d3f1740 10 client.18072 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f751d3f1740 10 client.18072 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f751d3f1740 20 client.18072 populate_metadata read hostname 'smithi040' 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d2de570 0x563f8d779080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f751d3f1740 4 client.18072 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.296+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x563f8d663550 con 0x563f8d2de570 2024-07-26T13:27:03.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.297+0000 7f750ea00640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d2de570 0x563f8d779080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:03.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.298+0000 7f750ea00640 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d2de570 0x563f8d779080 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fa39e38ff7414 server_cookie=671172f938e258f1 in_seq=0 out_seq=0 2024-07-26T13:27:03.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.298+0000 7f74f9600640 10 client.18072 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:03 smithi146 ceph-mon[35807]: pgmap v2443: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:27:03.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.574+0000 7f74f9600640 1 -- 172.21.15.40:0/1527841316 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x563f8d663550 con 0x563f8d2de570 2024-07-26T13:27:03.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.574+0000 7f74f9600640 10 client.18072 handle_command_reply: tid=0 2024-07-26T13:27:03.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.574+0000 7f751d3f1740 1 client.18072 shutdown 2024-07-26T13:27:03.576 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:03 smithi040 ceph-mon[32397]: pgmap v2443: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:27:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.574+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 msgr2=0x563f8d704500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.574+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d704500 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f75000117e0 tx=0x7f7500032910 comp rx=0 tx=0).stop 2024-07-26T13:27:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 shutdown_connections 2024-07-26T13:27:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563f8d34a840 0x563f8d7000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f8d329b60 0x563f8d6ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563f8d2de570 0x563f8d779080 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 --2- 172.21.15.40:0/1527841316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563f8d321980 0x563f8d704500 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 >> 172.21.15.40:0/1527841316 conn(0x563f8d33e990 msgr2=0x563f8d6f54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f74f9600640 0 client.18072 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.575+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 shutdown_connections 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.576+0000 7f751d3f1740 1 -- 172.21.15.40:0/1527841316 wait complete. 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.576+0000 7f751d3f1740 20 client.18072 trim_cache size 0 max 16384 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:27:03.578 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 218, 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "3f4c017c": { 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 218, 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 144.5, 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:27:03.579 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:03.580 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:27:03.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.577+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74f40b3bc0 msgr2=0x7f74f40b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:03.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.577+0000 7f7515000640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74f40b3bc0 0x7f74f40b60d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f750000bbe0 tx=0x7f750000b390 comp rx=0 tx=0).stop 2024-07-26T13:27:03.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.577+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 msgr2=0x7f75101a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.577+0000 7f7515000640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 0x7f75101a16d0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f750800eaa0 tx=0x7f750800ef60 comp rx=0 tx=0).stop 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 shutdown_connections 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751010d680 0x7f75101a16d0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7510104b70 0x7f751019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f74f40b3bc0 0x7f74f40b60d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 --2- 172.21.15.40:0/833604262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510104220 0x7f751019be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 >> 172.21.15.40:0/833604262 conn(0x7f75100fdd60 msgr2=0x7f75100fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 shutdown_connections 2024-07-26T13:27:03.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:03.578+0000 7f7515000640 1 -- 172.21.15.40:0/833604262 wait complete. 2024-07-26T13:27:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:03 smithi076 ceph-mon[35401]: pgmap v2443: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.0 MiB/s wr, 11 op/s 2024-07-26T13:27:04.383 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3f4c017c', quiesce took 9.9 seconds. Will release after: 14.6 2024-07-26T13:27:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:05 smithi146 ceph-mon[35807]: pgmap v2444: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:27:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:05 smithi076 ceph-mon[35401]: pgmap v2444: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:27:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:05 smithi040 ceph-mon[32397]: pgmap v2444: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 14 op/s 2024-07-26T13:27:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:07 smithi076 ceph-mon[35401]: pgmap v2445: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:27:07.599 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:07 smithi040 ceph-mon[32397]: pgmap v2445: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:27:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:07 smithi146 ceph-mon[35807]: pgmap v2445: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 12 op/s 2024-07-26T13:27:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:09 smithi076 ceph-mon[35401]: pgmap v2446: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:27:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:09 smithi040 ceph-mon[32397]: pgmap v2446: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:27:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:09 smithi146 ceph-mon[35807]: pgmap v2446: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:27:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:11 smithi040 ceph-mon[32397]: pgmap v2447: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:27:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:11 smithi146 ceph-mon[35807]: pgmap v2447: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:27:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:11 smithi076 ceph-mon[35401]: pgmap v2447: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-07-26T13:27:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:13 smithi040 ceph-mon[32397]: pgmap v2448: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 MiB/s wr, 9 op/s 2024-07-26T13:27:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:13 smithi146 ceph-mon[35807]: pgmap v2448: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 MiB/s wr, 9 op/s 2024-07-26T13:27:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:13 smithi076 ceph-mon[35401]: pgmap v2448: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 MiB/s wr, 9 op/s 2024-07-26T13:27:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:15 smithi040 ceph-mon[32397]: pgmap v2449: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T13:27:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:15 smithi146 ceph-mon[35807]: pgmap v2449: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T13:27:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:15 smithi076 ceph-mon[35401]: pgmap v2449: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 12 op/s 2024-07-26T13:27:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:17 smithi040 ceph-mon[32397]: pgmap v2450: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T13:27:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:27:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:17 smithi146 ceph-mon[35807]: pgmap v2450: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T13:27:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:27:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:17 smithi076 ceph-mon[35401]: pgmap v2450: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-07-26T13:27:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:27:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:27:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:27:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:27:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:27:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:27:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:27:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:27:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:27:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:27:18.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:27:19.487 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:27:19.643 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:19 smithi040 ceph-mon[32397]: pgmap v2451: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 585 KiB/s wr, 10 op/s 2024-07-26T13:27:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:19 smithi146 ceph-mon[35807]: pgmap v2451: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 585 KiB/s wr, 10 op/s 2024-07-26T13:27:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:19 smithi076 ceph-mon[35401]: pgmap v2451: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 585 KiB/s wr, 10 op/s 2024-07-26T13:27:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:21 smithi040 ceph-mon[32397]: pgmap v2452: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 585 KiB/s wr, 11 op/s 2024-07-26T13:27:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:21 smithi146 ceph-mon[35807]: pgmap v2452: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 585 KiB/s wr, 11 op/s 2024-07-26T13:27:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:21 smithi076 ceph-mon[35401]: pgmap v2452: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 585 KiB/s wr, 11 op/s 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 -- 172.21.15.40:0/3400345490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 msgr2=0x7f9a1010fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 --2- 172.21.15.40:0/3400345490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a1010fea0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009ca0 tx=0x7f9a0802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 -- 172.21.15.40:0/3400345490 shutdown_connections 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 --2- 172.21.15.40:0/3400345490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a1010fea0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 --2- 172.21.15.40:0/3400345490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a10108d20 0x7f9a10109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 --2- 172.21.15.40:0/3400345490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a101033e0 0x7f9a101037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 -- 172.21.15.40:0/3400345490 >> 172.21.15.40:0/3400345490 conn(0x7f9a100fee70 msgr2=0x7f9a101012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.178+0000 7f9a0f200640 1 -- 172.21.15.40:0/3400345490 shutdown_connections 2024-07-26T13:27:22.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.179+0000 7f9a0f200640 1 -- 172.21.15.40:0/3400345490 wait complete. 2024-07-26T13:27:22.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.180+0000 7f9a0f200640 1 Processor -- start 2024-07-26T13:27:22.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.180+0000 7f9a0f200640 1 -- start start 2024-07-26T13:27:22.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a101033e0 0x7f9a1019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:22.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10108d20 0x7f9a1019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:22.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a101a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:22.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10113220 con 0x7f9a10109670 2024-07-26T13:27:22.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101130a0 con 0x7f9a10108d20 2024-07-26T13:27:22.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101133a0 con 0x7f9a101033e0 2024-07-26T13:27:22.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a101a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a101a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42044/0 (socket says 172.21.15.40:42044) 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0e800640 1 -- 172.21.15.40:0/26298530 learned_addr learned my addr 172.21.15.40:0/26298530 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0de00640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a101033e0 0x7f9a1019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.181+0000 7f9a0d400640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10108d20 0x7f9a1019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.182+0000 7f9a0e800640 1 -- 172.21.15.40:0/26298530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a101033e0 msgr2=0x7f9a1019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.182+0000 7f9a0e800640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a101033e0 0x7f9a1019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.182+0000 7f9a0e800640 1 -- 172.21.15.40:0/26298530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10108d20 msgr2=0x7f9a1019c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:22.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.182+0000 7f9a0e800640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10108d20 0x7f9a1019c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.182+0000 7f9a0e800640 1 -- 172.21.15.40:0/26298530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a101a1d60 con 0x7f9a10109670 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.183+0000 7f9a0e800640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a101a1630 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9a08031040 tx=0x7f9a08032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.183+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08004040 con 0x7f9a10109670 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.183+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a08004670 con 0x7f9a10109670 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.183+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08030bf0 con 0x7f9a10109670 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.183+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a101a1ff0 con 0x7f9a10109670 2024-07-26T13:27:22.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.183+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101a87b0 con 0x7f9a10109670 2024-07-26T13:27:22.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.185+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a101037f0 con 0x7f9a10109670 2024-07-26T13:27:22.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.187+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9a080041e0 con 0x7f9a10109670 2024-07-26T13:27:22.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.189+0000 7f9a06a00640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f99f40b3c50 0x7f99f40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.189+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a081051b0 con 0x7f9a10109670 2024-07-26T13:27:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.190+0000 7f9a0de00640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f99f40b3c50 0x7f99f40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.190+0000 7f9a0de00640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f99f40b3c50 0x7f99f40b6160 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000bbe0 tx=0x7f9a0000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:22.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.198+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f9a080cc7c0 con 0x7f9a10109670 2024-07-26T13:27:22.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.463+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a1019cf20 con 0x7f9a10109670 2024-07-26T13:27:22.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.464+0000 7f9a06a00640 1 -- 172.21.15.40:0/26298530 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11975 (secure 0 0 0) 0x7f9a080cc0c0 con 0x7f9a10109670 2024-07-26T13:27:22.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:27:22.466 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"btime":"2024-07-26T12:27:57:208173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T12:27:56.354256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:27:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 35 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f99f40b3c50 msgr2=0x7f99f40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f99f40b3c50 0x7f99f40b6160 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000bbe0 tx=0x7f9a0000b390 comp rx=0 tx=0).stop 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 msgr2=0x7f9a101a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a101a1630 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9a08031040 tx=0x7f9a08032bc0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 shutdown_connections 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a10109670 0x7f9a101a1630 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10108d20 0x7f9a1019c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f99f40b3c50 0x7f99f40b6160 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 --2- 172.21.15.40:0/26298530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a101033e0 0x7f9a1019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.467+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 >> 172.21.15.40:0/26298530 conn(0x7f9a100fee70 msgr2=0x7f9a1010e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.468+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 shutdown_connections 2024-07-26T13:27:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:22.468+0000 7f9a0f200640 1 -- 172.21.15.40:0/26298530 wait complete. 2024-07-26T13:27:23.488 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 3f4c017c --release --await' 2024-07-26T13:27:23.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 3f4c017c --release --await 2024-07-26T13:27:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:23 smithi040 ceph-mon[32397]: pgmap v2453: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 584 KiB/s wr, 8 op/s 2024-07-26T13:27:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:23 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/26298530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:27:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:23 smithi146 ceph-mon[35807]: pgmap v2453: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 584 KiB/s wr, 8 op/s 2024-07-26T13:27:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:23 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/26298530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:27:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:23 smithi076 ceph-mon[35401]: pgmap v2453: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 584 KiB/s wr, 8 op/s 2024-07-26T13:27:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:23 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/26298530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:27:23.987 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:27:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:25 smithi040 ceph-mon[32397]: pgmap v2454: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:27:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:25 smithi146 ceph-mon[35807]: pgmap v2454: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:27:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:25 smithi076 ceph-mon[35401]: pgmap v2454: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-07-26T13:27:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 -- 172.21.15.40:0/3216711891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810af10 msgr2=0x7f2a7810b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3216711891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810af10 0x7f2a7810b320 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009900 tx=0x7f2a6002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 -- 172.21.15.40:0/3216711891 shutdown_connections 2024-07-26T13:27:26.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3216711891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810b860 0x7f2a78112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3216711891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810af10 0x7f2a7810b320 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3216711891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a781055d0 0x7f2a781059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 -- 172.21.15.40:0/3216711891 >> 172.21.15.40:0/3216711891 conn(0x7f2a78101040 msgr2=0x7f2a78103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 -- 172.21.15.40:0/3216711891 shutdown_connections 2024-07-26T13:27:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.427+0000 7f2a7d000640 1 -- 172.21.15.40:0/3216711891 wait complete. 2024-07-26T13:27:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.429+0000 7f2a7d000640 1 Processor -- start 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.429+0000 7f2a7d000640 1 -- start start 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a781055d0 0x7f2a7819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810af10 0x7f2a7819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a7d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 0x7f2a781a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a7d000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781153f0 con 0x7f2a7810b860 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a7d000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a78115270 con 0x7f2a781055d0 2024-07-26T13:27:26.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a7d000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a78115570 con 0x7f2a7810af10 2024-07-26T13:27:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 0x7f2a781a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 0x7f2a781a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41022/0 (socket says 172.21.15.40:41022) 2024-07-26T13:27:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a77e00640 1 -- 172.21.15.40:0/3785599276 learned_addr learned my addr 172.21.15.40:0/3785599276 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.430+0000 7f2a77400640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a781055d0 0x7f2a7819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810af10 0x7f2a7819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a77e00640 1 -- 172.21.15.40:0/3785599276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810af10 msgr2=0x7f2a7819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810af10 0x7f2a7819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a77e00640 1 -- 172.21.15.40:0/3785599276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a781055d0 msgr2=0x7f2a7819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a781055d0 0x7f2a7819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a77e00640 1 -- 172.21.15.40:0/3785599276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a781a1e10 con 0x7f2a7810b860 2024-07-26T13:27:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810af10 0x7f2a7819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:27:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.431+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 0x7f2a781a16e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000d750 tx=0x7f2a7000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.432+0000 7f2a74c00640 1 -- 172.21.15.40:0/3785599276 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70017070 con 0x7f2a7810b860 2024-07-26T13:27:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.432+0000 7f2a74c00640 1 -- 172.21.15.40:0/3785599276 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a700054b0 con 0x7f2a7810b860 2024-07-26T13:27:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.432+0000 7f2a74c00640 1 -- 172.21.15.40:0/3785599276 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70004b90 con 0x7f2a7810b860 2024-07-26T13:27:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.432+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a781a2100 con 0x7f2a7810b860 2024-07-26T13:27:26.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.432+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a781a8860 con 0x7f2a7810b860 2024-07-26T13:27:26.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.436+0000 7f2a74c00640 1 -- 172.21.15.40:0/3785599276 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2a70004d30 con 0x7f2a7810b860 2024-07-26T13:27:26.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.437+0000 7f2a74c00640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2a5c0b3c50 0x7f2a5c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.437+0000 7f2a74c00640 1 -- 172.21.15.40:0/3785599276 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2a700e3610 con 0x7f2a7810b860 2024-07-26T13:27:26.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.437+0000 7f2a77400640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2a5c0b3c50 0x7f2a5c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.438+0000 7f2a77400640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2a5c0b3c50 0x7f2a5c0b6160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2a68005fd0 tx=0x7f2a68009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.462+0000 7f2a85259740 1 Processor -- start 2024-07-26T13:27:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.462+0000 7f2a85259740 1 -- start start 2024-07-26T13:27:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a85259740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b100520 0x56212b4a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a85259740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0d7660 0x56212b4a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a85259740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a85259740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56212b41bf30 con 0x56212b0df840 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a85259740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56212b40b430 con 0x56212b0d7660 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a85259740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56212b40f470 con 0x56212b100520 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41028/0 (socket says 172.21.15.40:41028) 2024-07-26T13:27:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.463+0000 7f2a77e00640 1 -- 172.21.15.40:0/3651948514 learned_addr learned my addr 172.21.15.40:0/3651948514 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0d7660 0x56212b4a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77400640 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b100520 0x56212b4a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77e00640 1 -- 172.21.15.40:0/3651948514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b100520 msgr2=0x56212b4a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b100520 0x56212b4a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77e00640 1 -- 172.21.15.40:0/3651948514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0d7660 msgr2=0x56212b4a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0d7660 0x56212b4a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77e00640 1 -- 172.21.15.40:0/3651948514 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56212b16bb00 con 0x56212b0df840 2024-07-26T13:27:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4a5c00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f2a700a65a0 tx=0x7f2a700aa030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedb5038e5763308 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.464+0000 7f2a6cc00640 1 -- 172.21.15.40:0/3651948514 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70020050 con 0x56212b0df840 2024-07-26T13:27:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.465+0000 7f2a6cc00640 1 -- 172.21.15.40:0/3651948514 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a700cd0b0 con 0x56212b0df840 2024-07-26T13:27:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.465+0000 7f2a6cc00640 1 -- 172.21.15.40:0/3651948514 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a700a6950 con 0x56212b0df840 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 -- 172.21.15.40:0/3651948514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 msgr2=0x56212b4a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4a5c00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f2a700a65a0 tx=0x7f2a700aa030 comp rx=0 tx=0).stop 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 -- 172.21.15.40:0/3651948514 shutdown_connections 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4a5c00 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0d7660 0x56212b4a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 --2- 172.21.15.40:0/3651948514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b100520 0x56212b4a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 -- 172.21.15.40:0/3651948514 >> 172.21.15.40:0/3651948514 conn(0x56212b0f4910 msgr2=0x56212b4a3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 -- 172.21.15.40:0/3651948514 shutdown_connections 2024-07-26T13:27:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.466+0000 7f2a85259740 1 -- 172.21.15.40:0/3651948514 wait complete. 2024-07-26T13:27:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.467+0000 7f2a85259740 1 -- start start 2024-07-26T13:27:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.467+0000 7f2a85259740 1 Processor -- start 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.467+0000 7f2a85259740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a85259740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a85259740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a85259740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56212b26ebb0 con 0x56212b0df840 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a85259740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56212b3a7910 con 0x56212b100520 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a85259740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56212b4b3960 con 0x56212b0d7660 2024-07-26T13:27:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a85259740 10 client.0 _ll_register_callbacks cb 0x56212b117d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a6ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a6ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41032/0 (socket says 172.21.15.40:41032) 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a6ea00640 1 -- 172.21.15.40:0/2634023954 learned_addr learned my addr 172.21.15.40:0/2634023954 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a77400640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.468+0000 7f2a77e00640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a6ea00640 1 -- 172.21.15.40:0/2634023954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 msgr2=0x56212b4b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a6ea00640 1 -- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 msgr2=0x56212b4b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a6ea00640 1 -- 172.21.15.40:0/2634023954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56212b1e2960 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4b0d00 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f2a600057c0 tx=0x7f2a600052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2098051bb68f312e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.469+0000 7f2a65600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a65600640 1 -- 172.21.15.40:0/2634023954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60035030 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a65600640 1 -- 172.21.15.40:0/2634023954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2a600048c0 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56212b41de80 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a65600640 1 -- 172.21.15.40:0/2634023954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a60004ac0 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a85259740 10 client.18090 fetch_fsmap learned FSMap version 35 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56212b4bf600 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.470+0000 7f2a65600640 1 -- 172.21.15.40:0/2634023954 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56212b41de80 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a65600640 1 -- 172.21.15.40:0/2634023954 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2a60044470 con 0x56212b0df840 2024-07-26T13:27:26.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a85259740 10 client.18090 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a85259740 10 client.18090 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a85259740 20 client.18090 populate_metadata read hostname 'smithi040' 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a85259740 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b0beea0 0x56212b4c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a85259740 4 client.18090 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56212b419920 con 0x56212b0beea0 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.471+0000 7f2a77400640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b0beea0 0x56212b4c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.473+0000 7f2a77400640 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b0beea0 0x56212b4c2b70 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d59d9465e2808317 server_cookie=a6b4ed8845dbf980 in_seq=0 out_seq=0 2024-07-26T13:27:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.473+0000 7f2a65600640 10 client.18090 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:26.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a65600640 1 -- 172.21.15.40:0/2634023954 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56212b419920 con 0x56212b0beea0 2024-07-26T13:27:26.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a65600640 10 client.18090 handle_command_reply: tid=0 2024-07-26T13:27:26.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 client.18090 shutdown 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 msgr2=0x56212b4b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4b0d00 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f2a600057c0 tx=0x7f2a600052d0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 shutdown_connections 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b0beea0 0x56212b4c2b70 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4b0d00 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a65600640 0 client.18090 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:26.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 --2- 172.21.15.40:0/2634023954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 >> 172.21.15.40:0/2634023954 conn(0x56212b0f4910 msgr2=0x56212b4a8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:26.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 shutdown_connections 2024-07-26T13:27:26.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.475+0000 7f2a85259740 1 -- 172.21.15.40:0/2634023954 wait complete. 2024-07-26T13:27:26.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.476+0000 7f2a85259740 20 client.18090 trim_cache size 0 max 16384 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 Processor -- start 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 -- start start 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4c8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781b0d70 con 0x56212b0df840 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781b28b0 con 0x56212b100520 2024-07-26T13:27:26.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.495+0000 7f2a85259740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781b1440 con 0x56212b0d7660 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41036/0 (socket says 172.21.15.40:41036) 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 -- 172.21.15.40:0/1832084605 learned_addr learned my addr 172.21.15.40:0/1832084605 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a77400640 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a77e00640 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 -- 172.21.15.40:0/1832084605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 msgr2=0x56212b4a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 -- 172.21.15.40:0/1832084605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 msgr2=0x56212b4c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a6ea00640 1 -- 172.21.15.40:0/1832084605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56212b4a7470 con 0x56212b0df840 2024-07-26T13:27:26.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.496+0000 7f2a77400640 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:27:26.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.497+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4c8350 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f2a6002a430 tx=0x7f2a600056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eec4334f6b14658 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:26.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.497+0000 7f2a67e00640 1 -- 172.21.15.40:0/1832084605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60035040 con 0x56212b0df840 2024-07-26T13:27:26.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.497+0000 7f2a67e00640 1 -- 172.21.15.40:0/1832084605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a6003f070 con 0x56212b0df840 2024-07-26T13:27:26.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.497+0000 7f2a67e00640 1 -- 172.21.15.40:0/1832084605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60004920 con 0x56212b0df840 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 -- 172.21.15.40:0/1832084605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 msgr2=0x56212b4c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4c8350 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f2a6002a430 tx=0x7f2a600056d0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 -- 172.21.15.40:0/1832084605 shutdown_connections 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b100520 0x56212b4c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b0df840 0x56212b4c8350 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 --2- 172.21.15.40:0/1832084605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 -- 172.21.15.40:0/1832084605 >> 172.21.15.40:0/1832084605 conn(0x56212b0f4910 msgr2=0x56212b4a61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.498+0000 7f2a85259740 1 -- 172.21.15.40:0/1832084605 shutdown_connections 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.499+0000 7f2a85259740 1 -- 172.21.15.40:0/1832084605 wait complete. 2024-07-26T13:27:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.499+0000 7f2a85259740 1 -- start start 2024-07-26T13:27:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.499+0000 7f2a85259740 1 Processor -- start 2024-07-26T13:27:26.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0df840 0x56212b4b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 0x56212b4b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781b21e0 con 0x56212b100520 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781b1b10 con 0x56212b0df840 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a781aed30 con 0x56212b0d7660 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a85259740 10 client.0 _ll_register_callbacks cb 0x7f2a60009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 0x56212b4b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 0x56212b4b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41052/0 (socket says 172.21.15.40:41052) 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.500+0000 7f2a77e00640 1 -- 172.21.15.40:0/3588682853 learned_addr learned my addr 172.21.15.40:0/3588682853 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a6ea00640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0df840 0x56212b4b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77400640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77e00640 1 -- 172.21.15.40:0/3588682853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 msgr2=0x56212b4b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77e00640 1 -- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0df840 msgr2=0x56212b4b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0df840 0x56212b4b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77e00640 1 -- 172.21.15.40:0/3588682853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56212b4b56c0 con 0x56212b100520 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a77e00640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 0x56212b4b4f50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f2a700a7790 tx=0x7f2a70009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270fb5e854a0f86d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.501+0000 7f2a65600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a65600640 1 -- 172.21.15.40:0/3588682853 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a700aeb20 con 0x56212b100520 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a6003f070 con 0x56212b100520 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a65600640 1 -- 172.21.15.40:0/3588682853 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2a700bfbc0 con 0x56212b100520 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a65600640 1 -- 172.21.15.40:0/3588682853 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a70020020 con 0x56212b100520 2024-07-26T13:27:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a85259740 10 client.18096 fetch_fsmap learned FSMap version 35 2024-07-26T13:27:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56212b52b410 con 0x56212b100520 2024-07-26T13:27:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a65600640 1 -- 172.21.15.40:0/3588682853 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a6003f070 con 0x56212b100520 2024-07-26T13:27:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.502+0000 7f2a65600640 1 -- 172.21.15.40:0/3588682853 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2a700e3110 con 0x56212b100520 2024-07-26T13:27:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a85259740 10 client.18096 fetch_fsmap finished waiting for FSMap version 35 2024-07-26T13:27:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a85259740 10 client.18096 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:27:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a85259740 20 client.18096 populate_metadata read hostname 'smithi040' 2024-07-26T13:27:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a85259740 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b094250 0x56212b52d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:27:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a85259740 4 client.18096 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f4c017c", "release": true, "await": true}] 2024-07-26T13:27:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f4c017c", "release": true, "await": true}) -- 0x56212b417060 con 0x56212b094250 2024-07-26T13:27:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.503+0000 7f2a77400640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b094250 0x56212b52d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:27:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.504+0000 7f2a77400640 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b094250 0x56212b52d750 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3069be4c1e2cdb server_cookie=6c02559bea7d4a21 in_seq=0 out_seq=0 2024-07-26T13:27:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.504+0000 7f2a65600640 10 client.18096 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:26.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.566+0000 7f2a65600640 1 -- 172.21.15.40:0/3588682853 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x56212b417060 con 0x56212b094250 2024-07-26T13:27:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.566+0000 7f2a65600640 10 client.18096 handle_command_reply: tid=0 2024-07-26T13:27:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.566+0000 7f2a85259740 1 client.18096 shutdown 2024-07-26T13:27:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 msgr2=0x56212b4b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 0x56212b4b4f50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f2a700a7790 tx=0x7f2a70009ea0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 shutdown_connections 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x56212b094250 0x56212b52d750 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56212b100520 0x56212b4b4f50 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56212b0df840 0x56212b4b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 --2- 172.21.15.40:0/3588682853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56212b0d7660 0x56212b4b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a65600640 0 client.18096 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 >> 172.21.15.40:0/3588682853 conn(0x56212b0f4910 msgr2=0x56212b4a61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.567+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 shutdown_connections 2024-07-26T13:27:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.568+0000 7f2a85259740 1 -- 172.21.15.40:0/3588682853 wait complete. 2024-07-26T13:27:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.568+0000 7f2a85259740 20 client.18096 trim_cache size 0 max 16384 2024-07-26T13:27:26.570 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:27:26.570 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 35, 2024-07-26T13:27:26.570 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:27:26.570 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 220, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "3f4c017c": { 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 220, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 144.5, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:27:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:27:26.572 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2a5c0b3c50 msgr2=0x7f2a5c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2a5c0b3c50 0x7f2a5c0b6160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2a68005fd0 tx=0x7f2a68009680 comp rx=0 tx=0).stop 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 msgr2=0x7f2a781a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 0x7f2a781a16e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000d750 tx=0x7f2a7000dc10 comp rx=0 tx=0).stop 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 shutdown_connections 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7810b860 0x7f2a781a16e0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f2a5c0b3c50 0x7f2a5c0b6160 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7810af10 0x7f2a7819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 --2- 172.21.15.40:0/3785599276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a781055d0 0x7f2a7819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.570+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 >> 172.21.15.40:0/3785599276 conn(0x7f2a78101040 msgr2=0x7f2a78103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.571+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 shutdown_connections 2024-07-26T13:27:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:27:26.571+0000 7f2a7d000640 1 -- 172.21.15.40:0/3785599276 wait complete. 2024-07-26T13:27:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:27 smithi040 ceph-mon[32397]: pgmap v2455: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-07-26T13:27:27.610 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3f4c017c', total seconds elapsed: 33.1 2024-07-26T13:27:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:27 smithi146 ceph-mon[35807]: pgmap v2455: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-07-26T13:27:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:27 smithi076 ceph-mon[35401]: pgmap v2455: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-07-26T13:27:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:29 smithi040 ceph-mon[32397]: pgmap v2456: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:27:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:29 smithi146 ceph-mon[35807]: pgmap v2456: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:27:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:29 smithi076 ceph-mon[35401]: pgmap v2456: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:27:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:31 smithi040 ceph-mon[32397]: pgmap v2457: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:27:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:31 smithi146 ceph-mon[35807]: pgmap v2457: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:27:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:31 smithi076 ceph-mon[35401]: pgmap v2457: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-07-26T13:27:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:33 smithi040 ceph-mon[32397]: pgmap v2458: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 780 KiB/s wr, 8 op/s 2024-07-26T13:27:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:33 smithi146 ceph-mon[35807]: pgmap v2458: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 780 KiB/s wr, 8 op/s 2024-07-26T13:27:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:33 smithi076 ceph-mon[35401]: pgmap v2458: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 780 KiB/s wr, 8 op/s 2024-07-26T13:27:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:35 smithi040 ceph-mon[32397]: pgmap v2459: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:27:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:35 smithi146 ceph-mon[35807]: pgmap v2459: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:27:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:35 smithi076 ceph-mon[35401]: pgmap v2459: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2024-07-26T13:27:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:37 smithi040 ceph-mon[32397]: pgmap v2460: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:27:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:37 smithi146 ceph-mon[35807]: pgmap v2460: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:27:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:37 smithi076 ceph-mon[35401]: pgmap v2460: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-07-26T13:27:38.713 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:38 smithi040 ceph-mon[32397]: pgmap v2461: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:27:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:38 smithi146 ceph-mon[35807]: pgmap v2461: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:27:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:38 smithi076 ceph-mon[35401]: pgmap v2461: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.1 MiB/s wr, 11 op/s 2024-07-26T13:27:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:41 smithi040 ceph-mon[32397]: pgmap v2462: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:27:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:41 smithi146 ceph-mon[35807]: pgmap v2462: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:27:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:41 smithi076 ceph-mon[35401]: pgmap v2462: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-07-26T13:27:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:43 smithi040 ceph-mon[32397]: pgmap v2463: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T13:27:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:43 smithi146 ceph-mon[35807]: pgmap v2463: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T13:27:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:43 smithi076 ceph-mon[35401]: pgmap v2463: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.8 MiB/s wr, 10 op/s 2024-07-26T13:27:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:45 smithi040 ceph-mon[32397]: pgmap v2464: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:27:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:45 smithi146 ceph-mon[35807]: pgmap v2464: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:27:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:45 smithi076 ceph-mon[35401]: pgmap v2464: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-07-26T13:27:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:47 smithi040 ceph-mon[32397]: pgmap v2465: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:27:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:47 smithi146 ceph-mon[35807]: pgmap v2465: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:27:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:47 smithi076 ceph-mon[35401]: pgmap v2465: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-07-26T13:27:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:49 smithi040 ceph-mon[32397]: pgmap v2466: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:27:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:49 smithi146 ceph-mon[35807]: pgmap v2466: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:27:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:49 smithi076 ceph-mon[35401]: pgmap v2466: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-07-26T13:27:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:51 smithi040 ceph-mon[32397]: pgmap v2467: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:27:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:51 smithi146 ceph-mon[35807]: pgmap v2467: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:27:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:51 smithi076 ceph-mon[35401]: pgmap v2467: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-07-26T13:27:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:53 smithi040 ceph-mon[32397]: pgmap v2468: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:27:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:53 smithi146 ceph-mon[35807]: pgmap v2468: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:27:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:53 smithi076 ceph-mon[35401]: pgmap v2468: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-07-26T13:27:53.893 INFO:tasks.workunit.client.0.smithi040.stdout:fs setup took 3739 secs 2024-07-26T13:27:54.827 INFO:tasks.workunit.client.0.smithi040.stdout:Syncing()...0 sec 2024-07-26T13:27:54.830 INFO:tasks.workunit.client.0.smithi040.stdout:Starting Actual Benchmark At: Fri Jul 26 13:27:54 2024 2024-07-26T13:27:54.830 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:27:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:55 smithi040 ceph-mon[32397]: pgmap v2469: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:27:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:55 smithi146 ceph-mon[35807]: pgmap v2469: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:27:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:55 smithi076 ceph-mon[35401]: pgmap v2469: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-07-26T13:27:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:57 smithi040 ceph-mon[32397]: pgmap v2470: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.4 MiB/s wr, 40 op/s 2024-07-26T13:27:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:57 smithi146 ceph-mon[35807]: pgmap v2470: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.4 MiB/s wr, 40 op/s 2024-07-26T13:27:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:57 smithi076 ceph-mon[35401]: pgmap v2470: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.4 MiB/s wr, 40 op/s 2024-07-26T13:27:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:27:59 smithi040 ceph-mon[32397]: pgmap v2471: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.6 MiB/s wr, 503 op/s 2024-07-26T13:27:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:27:59 smithi146 ceph-mon[35807]: pgmap v2471: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.6 MiB/s wr, 503 op/s 2024-07-26T13:27:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:27:59 smithi076 ceph-mon[35401]: pgmap v2471: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.6 MiB/s wr, 503 op/s 2024-07-26T13:28:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:01 smithi040 ceph-mon[32397]: pgmap v2472: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 808 op/s 2024-07-26T13:28:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:01 smithi146 ceph-mon[35807]: pgmap v2472: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 808 op/s 2024-07-26T13:28:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:01 smithi076 ceph-mon[35401]: pgmap v2472: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 808 op/s 2024-07-26T13:28:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:02 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:02 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:02 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:03 smithi146 ceph-mon[35807]: pgmap v2473: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 1.35k op/s 2024-07-26T13:28:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:03 smithi076 ceph-mon[35401]: pgmap v2473: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 1.35k op/s 2024-07-26T13:28:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:03 smithi040 ceph-mon[32397]: pgmap v2473: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 1.35k op/s 2024-07-26T13:28:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:05 smithi146 ceph-mon[35807]: pgmap v2474: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 2.59k op/s 2024-07-26T13:28:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:05 smithi076 ceph-mon[35401]: pgmap v2474: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 2.59k op/s 2024-07-26T13:28:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:05 smithi040 ceph-mon[32397]: pgmap v2474: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 2.59k op/s 2024-07-26T13:28:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:07 smithi146 ceph-mon[35807]: pgmap v2475: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 3.17k op/s 2024-07-26T13:28:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:07 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:07 smithi076 ceph-mon[35401]: pgmap v2475: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 3.17k op/s 2024-07-26T13:28:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:07 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:07 smithi040 ceph-mon[32397]: pgmap v2475: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 3.17k op/s 2024-07-26T13:28:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:07 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:09 smithi146 ceph-mon[35807]: pgmap v2476: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.18k op/s 2024-07-26T13:28:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:09 smithi076 ceph-mon[35401]: pgmap v2476: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.18k op/s 2024-07-26T13:28:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:09 smithi040 ceph-mon[32397]: pgmap v2476: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.18k op/s 2024-07-26T13:28:11.569 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:11 smithi146 ceph-mon[35807]: pgmap v2477: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 17 MiB/s wr, 4.16k op/s 2024-07-26T13:28:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:11 smithi076 ceph-mon[35401]: pgmap v2477: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 17 MiB/s wr, 4.16k op/s 2024-07-26T13:28:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:11 smithi040 ceph-mon[32397]: pgmap v2477: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 17 MiB/s wr, 4.16k op/s 2024-07-26T13:28:13.111 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.6 2024-07-26T13:28:13.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:28:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:13 smithi040 ceph-mon[32397]: pgmap v2478: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:28:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:13 smithi146 ceph-mon[35807]: pgmap v2478: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:28:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:13 smithi076 ceph-mon[35401]: pgmap v2478: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:28:13.923 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:28:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:15 smithi146 ceph-mon[35807]: pgmap v2479: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 20 MiB/s wr, 5.18k op/s 2024-07-26T13:28:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:15 smithi076 ceph-mon[35401]: pgmap v2479: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 20 MiB/s wr, 5.18k op/s 2024-07-26T13:28:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:15 smithi040 ceph-mon[32397]: pgmap v2479: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 20 MiB/s wr, 5.18k op/s 2024-07-26T13:28:17.438 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:17 smithi040 ceph-mon[32397]: pgmap v2480: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-07-26T13:28:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:17 smithi146 ceph-mon[35807]: pgmap v2480: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-07-26T13:28:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:17 smithi076 ceph-mon[35401]: pgmap v2480: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 -- 172.21.15.40:0/1681010450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0076db0 msgr2=0x7fc5b00751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 --2- 172.21.15.40:0/1681010450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0076db0 0x7fc5b00751e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009900 tx=0x7fc5a402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 -- 172.21.15.40:0/1681010450 shutdown_connections 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 --2- 172.21.15.40:0/1681010450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0113cb0 0x7fc5b0116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 --2- 172.21.15.40:0/1681010450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5b0075800 0x7fc5b0075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 --2- 172.21.15.40:0/1681010450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0076db0 0x7fc5b00751e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.265+0000 7fc5b5e00640 1 -- 172.21.15.40:0/1681010450 >> 172.21.15.40:0/1681010450 conn(0x7fc5b00fee70 msgr2=0x7fc5b01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:18.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.267+0000 7fc5b5e00640 1 -- 172.21.15.40:0/1681010450 shutdown_connections 2024-07-26T13:28:18.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.267+0000 7fc5b5e00640 1 -- 172.21.15.40:0/1681010450 wait complete. 2024-07-26T13:28:18.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.269+0000 7fc5b5e00640 1 Processor -- start 2024-07-26T13:28:18.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.269+0000 7fc5b5e00640 1 -- start start 2024-07-26T13:28:18.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 0x7fc5b01a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:18.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5b0076db0 0x7fc5b01a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:18.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0113cb0 0x7fc5b01a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:18.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b5e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01197f0 con 0x7fc5b0075800 2024-07-26T13:28:18.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b5e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0119670 con 0x7fc5b0076db0 2024-07-26T13:28:18.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b5e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0119970 con 0x7fc5b0113cb0 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b4a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 0x7fc5b01a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b4a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 0x7fc5b01a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37448/0 (socket says 172.21.15.40:37448) 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5b4a00640 1 -- 172.21.15.40:0/802749255 learned_addr learned my addr 172.21.15.40:0/802749255 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.270+0000 7fc5afe00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5b0076db0 0x7fc5b01a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b5400640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0113cb0 0x7fc5b01a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b4a00640 1 -- 172.21.15.40:0/802749255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0113cb0 msgr2=0x7fc5b01a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b4a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0113cb0 0x7fc5b01a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b4a00640 1 -- 172.21.15.40:0/802749255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5b0076db0 msgr2=0x7fc5b01a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b4a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5b0076db0 0x7fc5b01a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b4a00640 1 -- 172.21.15.40:0/802749255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b01a6150 con 0x7fc5b0075800 2024-07-26T13:28:18.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.271+0000 7fc5b4a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 0x7fc5b01a01e0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402a910 tx=0x7fc5a4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:18.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.272+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a403f070 con 0x7fc5b0075800 2024-07-26T13:28:18.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.272+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5a403baf0 con 0x7fc5b0075800 2024-07-26T13:28:18.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.272+0000 7fc5b5e00640 1 -- 172.21.15.40:0/802749255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b01a63e0 con 0x7fc5b0075800 2024-07-26T13:28:18.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.272+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4035030 con 0x7fc5b0075800 2024-07-26T13:28:18.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.272+0000 7fc5b5e00640 1 -- 172.21.15.40:0/802749255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01acba0 con 0x7fc5b0075800 2024-07-26T13:28:18.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.274+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b0075c10 con 0x7fc5b0075800 2024-07-26T13:28:18.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.277+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc5a4042070 con 0x7fc5b0075800 2024-07-26T13:28:18.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.280+0000 7fc5ad600640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5980b3c50 0x7fc5980b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:18.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.280+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc5a41041d0 con 0x7fc5b0075800 2024-07-26T13:28:18.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.281+0000 7fc5afe00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5980b3c50 0x7fc5980b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:18.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.282+0000 7fc5afe00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5980b3c50 0x7fc5980b6160 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0095f0 tx=0x7fc59c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:18.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.286+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fc5a40cb820 con 0x7fc5b0075800 2024-07-26T13:28:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.682+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5b01a1310 con 0x7fc5b0075800 2024-07-26T13:28:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.684+0000 7fc5ad600640 1 -- 172.21.15.40:0/802749255 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11982 (secure 0 0 0) 0x7fc5a40cb120 con 0x7fc5b0075800 2024-07-26T13:28:18.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:28:18.690 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":37,"btime":"2024-07-26T13:28:06:251947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:28:05.369059+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:28:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 37 2024-07-26T13:28:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.688+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5980b3c50 msgr2=0x7fc5980b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5980b3c50 0x7fc5980b6160 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0095f0 tx=0x7fc59c005f90 comp rx=0 tx=0).stop 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 msgr2=0x7fc5b01a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 0x7fc5b01a01e0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402a910 tx=0x7fc5a4003b90 comp rx=0 tx=0).stop 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 shutdown_connections 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc5980b3c50 0x7fc5980b6160 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0113cb0 0x7fc5b01a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5b0076db0 0x7fc5b01a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 --2- 172.21.15.40:0/802749255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5b0075800 0x7fc5b01a01e0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 >> 172.21.15.40:0/802749255 conn(0x7fc5b00fee70 msgr2=0x7fc5b010fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 shutdown_connections 2024-07-26T13:28:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:18.689+0000 7fc5a2a00640 1 -- 172.21.15.40:0/802749255 wait complete. 2024-07-26T13:28:19.308 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:19 smithi040 ceph-mon[32397]: pgmap v2481: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 5.07k op/s 2024-07-26T13:28:19.308 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:19 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/802749255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:28:19.308 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:19 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:28:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:19 smithi146 ceph-mon[35807]: pgmap v2481: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 5.07k op/s 2024-07-26T13:28:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:19 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/802749255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:28:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:19 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:28:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:19 smithi076 ceph-mon[35401]: pgmap v2481: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 5.07k op/s 2024-07-26T13:28:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:19 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/802749255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:28:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:19 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:28:19.681 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0' 2024-07-26T13:28:19.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0 2024-07-26T13:28:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:28:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:21 smithi040 ceph-mon[32397]: pgmap v2482: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:28:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:28:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:28:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:28:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:21 smithi146 ceph-mon[35807]: pgmap v2482: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:28:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:28:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:28:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:28:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:21 smithi076 ceph-mon[35401]: pgmap v2482: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:28:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:28:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:28:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:28:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:23 smithi076 ceph-mon[35401]: pgmap v2483: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2024-07-26T13:28:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:23 smithi040 ceph-mon[32397]: pgmap v2483: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2024-07-26T13:28:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:23 smithi146 ceph-mon[35807]: pgmap v2483: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2024-07-26T13:28:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:25 smithi076 ceph-mon[35401]: pgmap v2484: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 MiB/s wr, 5.07k op/s 2024-07-26T13:28:25.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:25 smithi040 ceph-mon[32397]: pgmap v2484: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 MiB/s wr, 5.07k op/s 2024-07-26T13:28:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:25 smithi146 ceph-mon[35807]: pgmap v2484: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 MiB/s wr, 5.07k op/s 2024-07-26T13:28:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.701+0000 7fcf87800640 1 -- 172.21.15.40:0/20376300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80109840 msgr2=0x7fcf80110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.701+0000 7fcf87800640 1 --2- 172.21.15.40:0/20376300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80109840 0x7fcf80110070 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ca0 tx=0x7fcf7802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 -- 172.21.15.40:0/20376300 shutdown_connections 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 --2- 172.21.15.40:0/20376300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf80109840 0x7fcf80110070 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 --2- 172.21.15.40:0/20376300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 0x7fcf80109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 --2- 172.21.15.40:0/20376300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf801035b0 0x7fcf801039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 -- 172.21.15.40:0/20376300 >> 172.21.15.40:0/20376300 conn(0x7fcf800ff000 msgr2=0x7fcf80101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 -- 172.21.15.40:0/20376300 shutdown_connections 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.702+0000 7fcf87800640 1 -- 172.21.15.40:0/20376300 wait complete. 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.704+0000 7fcf87800640 1 Processor -- start 2024-07-26T13:28:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.705+0000 7fcf87800640 1 -- start start 2024-07-26T13:28:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf87800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 0x7fcf80199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf87800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 0x7fcf8019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf87800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80109840 0x7fcf8019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf87800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80113410 con 0x7fcf801035b0 2024-07-26T13:28:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf87800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80113290 con 0x7fcf80109840 2024-07-26T13:28:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf87800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80113590 con 0x7fcf80108ef0 2024-07-26T13:28:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.706+0000 7fcf84e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 0x7fcf80199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.707+0000 7fcf84e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 0x7fcf80199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44764/0 (socket says 172.21.15.40:44764) 2024-07-26T13:28:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.707+0000 7fcf84e00640 1 -- 172.21.15.40:0/3437993036 learned_addr learned my addr 172.21.15.40:0/3437993036 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.707+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 0x7fcf8019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.707+0000 7fcf85800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80109840 0x7fcf8019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf84e00640 1 -- 172.21.15.40:0/3437993036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 msgr2=0x7fcf8019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:26.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf84e00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 0x7fcf8019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf84e00640 1 -- 172.21.15.40:0/3437993036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80109840 msgr2=0x7fcf8019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf84e00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80109840 0x7fcf8019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf84e00640 1 -- 172.21.15.40:0/3437993036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8019fc50 con 0x7fcf801035b0 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 0x7fcf8019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.708+0000 7fcf84e00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 0x7fcf80199da0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c920 tx=0x7fcf7000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.709+0000 7fcf7d600640 1 -- 172.21.15.40:0/3437993036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70007c70 con 0x7fcf801035b0 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.710+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8019ff40 con 0x7fcf801035b0 2024-07-26T13:28:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.710+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf80075020 con 0x7fcf801035b0 2024-07-26T13:28:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.712+0000 7fcf7d600640 1 -- 172.21.15.40:0/3437993036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf70007e10 con 0x7fcf801035b0 2024-07-26T13:28:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.712+0000 7fcf7d600640 1 -- 172.21.15.40:0/3437993036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70004d70 con 0x7fcf801035b0 2024-07-26T13:28:26.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.726+0000 7fcf7d600640 1 -- 172.21.15.40:0/3437993036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcf7000f450 con 0x7fcf801035b0 2024-07-26T13:28:26.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.732+0000 7fcf7d600640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c80 0x7fcf640b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.733+0000 7fcf7d600640 1 -- 172.21.15.40:0/3437993036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf700e4b60 con 0x7fcf801035b0 2024-07-26T13:28:26.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.733+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c80 0x7fcf640b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.736+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c80 0x7fcf640b6190 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf801058b0 tx=0x7fcf6c012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.739+0000 7fcf8e3cf740 1 Processor -- start 2024-07-26T13:28:26.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.739+0000 7fcf8e3cf740 1 -- start start 2024-07-26T13:28:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.740+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbda1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.740+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbda6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.740+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbdac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.740+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556aafba4cf0 con 0x556aaf834840 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.740+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556aafb4fb40 con 0x556aaf80b980 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.740+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556aafb3f040 con 0x556aaf813b60 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.741+0000 7fcf85800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbdac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.741+0000 7fcf85800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbdac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:34508/0 (socket says 172.21.15.40:34508) 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.741+0000 7fcf85800640 1 -- 172.21.15.40:0/2091823074 learned_addr learned my addr 172.21.15.40:0/2091823074 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.742+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbda6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.742+0000 7fcf85800640 1 -- 172.21.15.40:0/2091823074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 msgr2=0x556aafbda6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.742+0000 7fcf85800640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbda6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.742+0000 7fcf85800640 1 -- 172.21.15.40:0/2091823074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 msgr2=0x556aafbda1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.743+0000 7fcf84e00640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbda1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.743+0000 7fcf85800640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbda1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.743+0000 7fcf85800640 1 -- 172.21.15.40:0/2091823074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aafac6af0 con 0x556aaf813b60 2024-07-26T13:28:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.743+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbda6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:28:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.743+0000 7fcf84e00640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbda1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:28:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.744+0000 7fcf85800640 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbdac20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802aeb0 tx=0x7fcf78031590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da04f13b8ce29dd2 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.745+0000 7fcf76000640 1 -- 172.21.15.40:0/2091823074 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf78031b80 con 0x556aaf813b60 2024-07-26T13:28:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.745+0000 7fcf76000640 1 -- 172.21.15.40:0/2091823074 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf78036030 con 0x556aaf813b60 2024-07-26T13:28:26.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.745+0000 7fcf76000640 1 -- 172.21.15.40:0/2091823074 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf780044d0 con 0x556aaf813b60 2024-07-26T13:28:26.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.746+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/2091823074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 msgr2=0x556aafbdac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:26.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.746+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbdac20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802aeb0 tx=0x7fcf78031590 comp rx=0 tx=0).stop 2024-07-26T13:28:26.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.747+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/2091823074 shutdown_connections 2024-07-26T13:28:26.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.747+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbdac20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.747+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbda6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.747+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/2091823074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbda1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.747+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/2091823074 >> 172.21.15.40:0/2091823074 conn(0x556aaf828990 msgr2=0x556aafbd8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.748+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/2091823074 shutdown_connections 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.748+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/2091823074 wait complete. 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.749+0000 7fcf8e3cf740 1 -- start start 2024-07-26T13:28:26.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.750+0000 7fcf8e3cf740 1 Processor -- start 2024-07-26T13:28:26.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.751+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbe5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.751+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbe61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.751+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbfa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.752+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbe61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.752+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbe61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:34518/0 (socket says 172.21.15.40:34518) 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.752+0000 7fcf84e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbe5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.752+0000 7fcf84e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbe5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.753+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556aafadb500 con 0x556aaf834840 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.753+0000 7fcf85800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbfa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.753+0000 7fcf85800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbfa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44786/0 (socket says 172.21.15.40:44786) 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.753+0000 7fcf85800640 1 -- 172.21.15.40:0/1010809822 learned_addr learned my addr 172.21.15.40:0/1010809822 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:26.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.753+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556aafb43080 con 0x556aaf80b980 2024-07-26T13:28:26.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.753+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556aaf9a27a0 con 0x556aaf813b60 2024-07-26T13:28:26.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.754+0000 7fcf8e3cf740 10 client.0 _ll_register_callbacks cb 0x556aafb37bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:28:26.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.755+0000 7fcf85800640 1 -- 172.21.15.40:0/1010809822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 msgr2=0x556aafbe61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.755+0000 7fcf85800640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbe61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.755+0000 7fcf85800640 1 -- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 msgr2=0x556aafbe5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.755+0000 7fcf85800640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbe5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.755+0000 7fcf85800640 1 -- 172.21.15.40:0/1010809822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aaf8aeb90 con 0x556aaf834840 2024-07-26T13:28:26.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.756+0000 7fcf84e00640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbe5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:28:26.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.756+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbe61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:28:26.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.756+0000 7fcf85800640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbfa1b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802ade0 tx=0x7fcf780317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8d2909b0ce6c4b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:26.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.756+0000 7fcf6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:28:26.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.757+0000 7fcf6aa00640 1 -- 172.21.15.40:0/1010809822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7804a040 con 0x556aaf834840 2024-07-26T13:28:26.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.758+0000 7fcf6aa00640 1 -- 172.21.15.40:0/1010809822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf78003b70 con 0x556aaf834840 2024-07-26T13:28:26.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.758+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf78036030 con 0x556aaf834840 2024-07-26T13:28:26.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.759+0000 7fcf6aa00640 1 -- 172.21.15.40:0/1010809822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fcf78003d70 con 0x556aaf834840 2024-07-26T13:28:26.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.759+0000 7fcf8e3cf740 10 client.18111 fetch_fsmap learned FSMap version 37 2024-07-26T13:28:26.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.759+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556aafbfccd0 con 0x556aaf834840 2024-07-26T13:28:26.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.760+0000 7fcf6aa00640 1 -- 172.21.15.40:0/1010809822 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf78036030 con 0x556aaf834840 2024-07-26T13:28:26.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.760+0000 7fcf6aa00640 1 -- 172.21.15.40:0/1010809822 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fcf7804d030 con 0x556aaf834840 2024-07-26T13:28:26.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.762+0000 7fcf8e3cf740 10 client.18111 fetch_fsmap finished waiting for FSMap version 37 2024-07-26T13:28:26.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.762+0000 7fcf8e3cf740 10 client.18111 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:28:26.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.762+0000 7fcf8e3cf740 20 client.18111 populate_metadata read hostname 'smithi040' 2024-07-26T13:28:26.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.762+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf7f31c0 0x556aafc00030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.762+0000 7fcf8e3cf740 4 client.18111 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:28:26.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.762+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aafb51a90 con 0x556aaf7f31c0 2024-07-26T13:28:26.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.763+0000 7fcf84e00640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf7f31c0 0x556aafc00030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.764+0000 7fcf84e00640 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf7f31c0 0x556aafc00030 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16418c41f9bb7bc server_cookie=55a3755ce64fe253 in_seq=0 out_seq=0 2024-07-26T13:28:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.764+0000 7fcf6aa00640 10 client.18111 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.766+0000 7fcf6aa00640 1 -- 172.21.15.40:0/1010809822 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556aafb51a90 con 0x556aaf7f31c0 2024-07-26T13:28:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.766+0000 7fcf6aa00640 10 client.18111 handle_command_reply: tid=0 2024-07-26T13:28:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.767+0000 7fcf8e3cf740 1 client.18111 shutdown 2024-07-26T13:28:26.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.769+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 msgr2=0x556aafbfa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:26.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.769+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbfa1b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802ade0 tx=0x7fcf780317e0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.769+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 shutdown_connections 2024-07-26T13:28:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.770+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf7f31c0 0x556aafc00030 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.770+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf834840 0x556aafbfa1b0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.770+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf813b60 0x556aafbe61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.771+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/1010809822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf80b980 0x556aafbe5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.771+0000 7fcf6aa00640 0 client.18111 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.771+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 >> 172.21.15.40:0/1010809822 conn(0x556aaf828990 msgr2=0x556aafbdd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:26.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.772+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 shutdown_connections 2024-07-26T13:28:26.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.773+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/1010809822 wait complete. 2024-07-26T13:28:26.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.774+0000 7fcf8e3cf740 20 client.18111 trim_cache size 0 max 16384 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.824+0000 7fcf8e3cf740 1 Processor -- start 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.824+0000 7fcf8e3cf740 1 -- start start 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.825+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf7f31c0 0x556aafbd6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.825+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 0x556aafbe02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.825+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf813b60 0x556aafbe7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.825+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6000e510 con 0x556aaf813b60 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.825+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60010110 con 0x556aaf7f31c0 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.825+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6000ebe0 con 0x556aaf80b980 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.826+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 0x556aafbe02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.827+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 0x556aafbe02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:34528/0 (socket says 172.21.15.40:34528) 2024-07-26T13:28:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.827+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4168216225 learned_addr learned my addr 172.21.15.40:0/4168216225 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.827+0000 7fcf85800640 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf813b60 0x556aafbe7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.827+0000 7fcf84e00640 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf7f31c0 0x556aafbd6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.830+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4168216225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf7f31c0 msgr2=0x556aafbd6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.830+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf7f31c0 0x556aafbd6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.830+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4168216225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf813b60 msgr2=0x556aafbe7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.830+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf813b60 0x556aafbe7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.830+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4168216225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aafbe3f90 con 0x556aaf80b980 2024-07-26T13:28:26.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.830+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 0x556aafbe02c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0035f0 tx=0x7fcf6c01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a25605daf79df server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:26.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.831+0000 7fcf75600640 1 -- 172.21.15.40:0/4168216225 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00b820 con 0x556aaf80b980 2024-07-26T13:28:26.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.831+0000 7fcf75600640 1 -- 172.21.15.40:0/4168216225 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf6c02b070 con 0x556aaf80b980 2024-07-26T13:28:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.831+0000 7fcf75600640 1 -- 172.21.15.40:0/4168216225 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c026cf0 con 0x556aaf80b980 2024-07-26T13:28:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4168216225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 msgr2=0x556aafbe02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 0x556aafbe02c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0035f0 tx=0x7fcf6c01c000 comp rx=0 tx=0).stop 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4168216225 shutdown_connections 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf813b60 0x556aafbe7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf80b980 0x556aafbe02c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4168216225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf7f31c0 0x556aafbd6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.832+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4168216225 >> 172.21.15.40:0/4168216225 conn(0x556aaf828990 msgr2=0x556aafbdb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.834+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4168216225 shutdown_connections 2024-07-26T13:28:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.834+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4168216225 wait complete. 2024-07-26T13:28:26.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.835+0000 7fcf8e3cf740 1 -- start start 2024-07-26T13:28:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.836+0000 7fcf8e3cf740 1 Processor -- start 2024-07-26T13:28:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.836+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf7f31c0 0x556aafbf1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.836+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 0x556aafbf1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.836+0000 7fcf8e3cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf813b60 0x556aafbf5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6000fa40 con 0x556aaf80b980 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6000f2b0 con 0x556aaf813b60 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf8e3cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6000c4d0 con 0x556aaf7f31c0 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf8e3cf740 10 client.0 _ll_register_callbacks cb 0x7fcf780314e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 0x556aafbf1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 0x556aafbf1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44798/0 (socket says 172.21.15.40:44798) 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf7fe00640 1 -- 172.21.15.40:0/4010839883 learned_addr learned my addr 172.21.15.40:0/4010839883 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf84e00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf7f31c0 0x556aafbf1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.837+0000 7fcf85800640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf813b60 0x556aafbf5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf84e00640 1 -- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf813b60 msgr2=0x556aafbf5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf84e00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf813b60 0x556aafbf5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf84e00640 1 -- 172.21.15.40:0/4010839883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 msgr2=0x556aafbf1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf84e00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 0x556aafbf1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf84e00640 1 -- 172.21.15.40:0/4010839883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aafbf64c0 con 0x556aaf7f31c0 2024-07-26T13:28:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 0x556aafbf1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf84e00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf7f31c0 0x556aafbf1980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf700e2620 tx=0x7fcf700e24f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a05c3e318e97d9d server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.838+0000 7fcf6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.839+0000 7fcf6aa00640 1 -- 172.21.15.40:0/4010839883 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf700aba70 con 0x556aaf7f31c0 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.839+0000 7fcf6aa00640 1 -- 172.21.15.40:0/4010839883 <== mon.1 v2:172.21.15.146:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcf700a8060 con 0x556aaf7f31c0 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.839+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf6c02b070 con 0x556aaf7f31c0 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.839+0000 7fcf6aa00640 1 -- 172.21.15.40:0/4010839883 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fcf700b0070 con 0x556aaf7f31c0 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.839+0000 7fcf8e3cf740 10 client.27481 fetch_fsmap learned FSMap version 37 2024-07-26T13:28:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.839+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556aafc680c0 con 0x556aaf7f31c0 2024-07-26T13:28:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.840+0000 7fcf6aa00640 1 -- 172.21.15.40:0/4010839883 <== mon.1 v2:172.21.15.146:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf6c02b070 con 0x556aaf7f31c0 2024-07-26T13:28:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.840+0000 7fcf6aa00640 1 -- 172.21.15.40:0/4010839883 <== mon.1 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fcf700c6070 con 0x556aaf7f31c0 2024-07-26T13:28:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf8e3cf740 10 client.27481 fetch_fsmap finished waiting for FSMap version 37 2024-07-26T13:28:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf8e3cf740 10 client.27481 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:28:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf8e3cf740 20 client.27481 populate_metadata read hostname 'smithi040' 2024-07-26T13:28:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf834840 0x556aafc6a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf8e3cf740 4 client.27481 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}] 2024-07-26T13:28:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}) -- 0x556aafb4d530 con 0x556aaf834840 2024-07-26T13:28:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.841+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf834840 0x556aafc6a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.843+0000 7fcf7fe00640 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf834840 0x556aafc6a800 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fdd74cc48c92d6c server_cookie=3208cce3f7649c87 in_seq=0 out_seq=0 2024-07-26T13:28:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:26.843+0000 7fcf6aa00640 10 client.27481 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.128+0000 7fcf6aa00640 1 -- 172.21.15.40:0/4010839883 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x556aafb4d530 con 0x556aaf834840 2024-07-26T13:28:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.128+0000 7fcf6aa00640 10 client.27481 handle_command_reply: tid=0 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 client.27481 shutdown 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf7f31c0 msgr2=0x556aafbf1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf7f31c0 0x556aafbf1980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf700e2620 tx=0x7fcf700e24f0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 shutdown_connections 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556aaf813b60 0x556aafbf5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556aaf834840 0x556aafc6a800 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556aaf80b980 0x556aafbf1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 --2- 172.21.15.40:0/4010839883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556aaf7f31c0 0x556aafbf1980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 >> 172.21.15.40:0/4010839883 conn(0x556aaf828990 msgr2=0x556aafbe76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.129+0000 7fcf6aa00640 0 client.27481 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.130+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 shutdown_connections 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.130+0000 7fcf8e3cf740 1 -- 172.21.15.40:0/4010839883 wait complete. 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.130+0000 7fcf8e3cf740 20 client.27481 trim_cache size 0 max 16384 2024-07-26T13:28:27.132 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 37, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 222, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "f3e1af89": { 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 222, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:28:27.133 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.6, 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:27.134 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.131+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c80 msgr2=0x7fcf640b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.131+0000 7fcf87800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c80 0x7fcf640b6190 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf801058b0 tx=0x7fcf6c012040 comp rx=0 tx=0).stop 2024-07-26T13:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.131+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 msgr2=0x7fcf80199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.131+0000 7fcf87800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 0x7fcf80199da0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c920 tx=0x7fcf7000cde0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 shutdown_connections 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf80109840 0x7fcf8019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcf640b3c80 0x7fcf640b6190 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf80108ef0 0x7fcf8019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 --2- 172.21.15.40:0/3437993036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf801035b0 0x7fcf80199da0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 >> 172.21.15.40:0/3437993036 conn(0x7fcf800ff000 msgr2=0x7fcf80101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 shutdown_connections 2024-07-26T13:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:27.132+0000 7fcf87800640 1 -- 172.21.15.40:0/3437993036 wait complete. 2024-07-26T13:28:27.423 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:27 smithi040 ceph-mon[32397]: pgmap v2485: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-07-26T13:28:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:27 smithi146 ceph-mon[35807]: pgmap v2485: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-07-26T13:28:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:27 smithi076 ceph-mon[35401]: pgmap v2485: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-07-26T13:28:28.064 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f3e1af89', quiesce took 15.0 seconds. Will release after: 11.600000000000001 2024-07-26T13:28:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:29 smithi040 ceph-mon[32397]: pgmap v2486: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.71k op/s 2024-07-26T13:28:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:29 smithi146 ceph-mon[35807]: pgmap v2486: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.71k op/s 2024-07-26T13:28:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:29 smithi076 ceph-mon[35401]: pgmap v2486: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.71k op/s 2024-07-26T13:28:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:31 smithi040 ceph-mon[32397]: pgmap v2487: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-07-26T13:28:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:31 smithi146 ceph-mon[35807]: pgmap v2487: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-07-26T13:28:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:31 smithi076 ceph-mon[35401]: pgmap v2487: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 3.83k op/s 2024-07-26T13:28:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:33 smithi040 ceph-mon[32397]: pgmap v2488: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 3.57k op/s 2024-07-26T13:28:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:33 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:33 smithi146 ceph-mon[35807]: pgmap v2488: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 3.57k op/s 2024-07-26T13:28:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:33 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:33 smithi076 ceph-mon[35401]: pgmap v2488: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 3.57k op/s 2024-07-26T13:28:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:33 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:28:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:35 smithi040 ceph-mon[32397]: pgmap v2489: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.02k op/s 2024-07-26T13:28:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:35 smithi146 ceph-mon[35807]: pgmap v2489: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.02k op/s 2024-07-26T13:28:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:35 smithi076 ceph-mon[35401]: pgmap v2489: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.02k op/s 2024-07-26T13:28:37.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:37 smithi076 ceph-mon[35401]: pgmap v2490: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 1.92k op/s 2024-07-26T13:28:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:37 smithi040 ceph-mon[32397]: pgmap v2490: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 1.92k op/s 2024-07-26T13:28:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:37 smithi146 ceph-mon[35807]: pgmap v2490: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 1.92k op/s 2024-07-26T13:28:39.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:28:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:39 smithi040 ceph-mon[32397]: pgmap v2491: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.0 MiB/s wr, 1.30k op/s 2024-07-26T13:28:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:39 smithi146 ceph-mon[35807]: pgmap v2491: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.0 MiB/s wr, 1.30k op/s 2024-07-26T13:28:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:39 smithi076 ceph-mon[35401]: pgmap v2491: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.0 MiB/s wr, 1.30k op/s 2024-07-26T13:28:40.164 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:28:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:41 smithi040 ceph-mon[32397]: pgmap v2492: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.5 MiB/s wr, 400 op/s 2024-07-26T13:28:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:41 smithi146 ceph-mon[35807]: pgmap v2492: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.5 MiB/s wr, 400 op/s 2024-07-26T13:28:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:41 smithi076 ceph-mon[35401]: pgmap v2492: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.5 MiB/s wr, 400 op/s 2024-07-26T13:28:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.335+0000 7f5841000640 1 -- 172.21.15.40:0/3078564209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 msgr2=0x7f583c10d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.335+0000 7f5841000640 1 --2- 172.21.15.40:0/3078564209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c10d360 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5828009900 tx=0x7f582802a3f0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 -- 172.21.15.40:0/3078564209 shutdown_connections 2024-07-26T13:28:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 --2- 172.21.15.40:0/3078564209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 0x7f583c10fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 --2- 172.21.15.40:0/3078564209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c10d360 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 --2- 172.21.15.40:0/3078564209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f583c1042f0 0x7f583c104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 -- 172.21.15.40:0/3078564209 >> 172.21.15.40:0/3078564209 conn(0x7f583c079190 msgr2=0x7f583c0795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 -- 172.21.15.40:0/3078564209 shutdown_connections 2024-07-26T13:28:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.336+0000 7f5841000640 1 -- 172.21.15.40:0/3078564209 wait complete. 2024-07-26T13:28:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.337+0000 7f5841000640 1 Processor -- start 2024-07-26T13:28:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.337+0000 7f5841000640 1 -- start start 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5841000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f583c1042f0 0x7f583c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5841000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5841000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 0x7f583c19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5841000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f583c113350 con 0x7f583c104cd0 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5841000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f583c1131d0 con 0x7f583c1042f0 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5841000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f583c1134d0 con 0x7f583c10d8a0 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5839400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:42.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5839400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45860/0 (socket says 172.21.15.40:45860) 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5839400640 1 -- 172.21.15.40:0/1611268487 learned_addr learned my addr 172.21.15.40:0/1611268487 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f5839e00640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f583c1042f0 0x7f583c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.338+0000 7f583a800640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 0x7f583c19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f5839400640 1 -- 172.21.15.40:0/1611268487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 msgr2=0x7f583c19f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f5839400640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 0x7f583c19f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f5839400640 1 -- 172.21.15.40:0/1611268487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f583c1042f0 msgr2=0x7f583c199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f5839400640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f583c1042f0 0x7f583c199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f5839400640 1 -- 172.21.15.40:0/1611268487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583c19fcf0 con 0x7f583c104cd0 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f583a800640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 0x7f583c19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.339+0000 7f5839400640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c19a3e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5828005940 tx=0x7f58280040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.340+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582803f030 con 0x7f583c104cd0 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.340+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5828003a80 con 0x7f583c104cd0 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.340+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583c19ff80 con 0x7f583c104cd0 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.340+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828035070 con 0x7f583c104cd0 2024-07-26T13:28:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.340+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f583c1a0460 con 0x7f583c104cd0 2024-07-26T13:28:42.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.341+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583c104700 con 0x7f583c104cd0 2024-07-26T13:28:42.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.344+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5828042030 con 0x7f583c104cd0 2024-07-26T13:28:42.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.346+0000 7f5832a00640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58200b3c00 0x7f58200b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:42.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.346+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5828104570 con 0x7f583c104cd0 2024-07-26T13:28:42.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.346+0000 7f5839e00640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58200b3c00 0x7f58200b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:42.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.347+0000 7f5839e00640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58200b3c00 0x7f58200b6110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f583c06c260 tx=0x7f582c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:42.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.348+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f58280cbb80 con 0x7f583c104cd0 2024-07-26T13:28:42.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.594+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f583c19af70 con 0x7f583c104cd0 2024-07-26T13:28:42.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.595+0000 7f5832a00640 1 -- 172.21.15.40:0/1611268487 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11983 (secure 0 0 0) 0x7f58280cb480 con 0x7f583c104cd0 2024-07-26T13:28:42.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:28:42.598 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":38,"btime":"2024-07-26T13:28:32:352713+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:28:31.454649+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[24592,24610,34547,34592,34631]},"id":1}]} 2024-07-26T13:28:42.598 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 38 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58200b3c00 msgr2=0x7f58200b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58200b3c00 0x7f58200b6110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f583c06c260 tx=0x7f582c00b390 comp rx=0 tx=0).stop 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 msgr2=0x7f583c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c19a3e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5828005940 tx=0x7f58280040e0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 shutdown_connections 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f58200b3c00 0x7f58200b6110 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583c10d8a0 0x7f583c19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f583c104cd0 0x7f583c19a3e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 --2- 172.21.15.40:0/1611268487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f583c1042f0 0x7f583c199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 >> 172.21.15.40:0/1611268487 conn(0x7f583c079190 msgr2=0x7f583c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 shutdown_connections 2024-07-26T13:28:42.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:42.599+0000 7f5841000640 1 -- 172.21.15.40:0/1611268487 wait complete. 2024-07-26T13:28:43.448 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id f3e1af89 --release --await' 2024-07-26T13:28:43.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id f3e1af89 --release --await 2024-07-26T13:28:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:43 smithi040 ceph-mon[32397]: pgmap v2493: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 578 KiB/s wr, 153 op/s 2024-07-26T13:28:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:43 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1611268487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:28:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:43 smithi146 ceph-mon[35807]: pgmap v2493: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 578 KiB/s wr, 153 op/s 2024-07-26T13:28:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:43 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1611268487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:28:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:43 smithi076 ceph-mon[35401]: pgmap v2493: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 578 KiB/s wr, 153 op/s 2024-07-26T13:28:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:43 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1611268487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:28:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:28:45.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:45 smithi040 ceph-mon[32397]: pgmap v2494: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 83 KiB/s wr, 32 op/s 2024-07-26T13:28:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:45 smithi146 ceph-mon[35807]: pgmap v2494: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 83 KiB/s wr, 32 op/s 2024-07-26T13:28:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:45 smithi076 ceph-mon[35401]: pgmap v2494: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 83 KiB/s wr, 32 op/s 2024-07-26T13:28:46.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 -- 172.21.15.40:0/3405839636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc10b120 msgr2=0x7fe0dc10b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3405839636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc10b120 0x7fe0dc10b530 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009900 tx=0x7fe0c802a400 comp rx=0 tx=0).stop 2024-07-26T13:28:46.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 -- 172.21.15.40:0/3405839636 shutdown_connections 2024-07-26T13:28:46.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3405839636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc10ba70 0x7fe0dc1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3405839636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc10b120 0x7fe0dc10b530 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3405839636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 -- 172.21.15.40:0/3405839636 >> 172.21.15.40:0/3405839636 conn(0x7fe0dc1011f0 msgr2=0x7fe0dc103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:46.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 -- 172.21.15.40:0/3405839636 shutdown_connections 2024-07-26T13:28:46.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.278+0000 7fe0e1200640 1 -- 172.21.15.40:0/3405839636 wait complete. 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.280+0000 7fe0e1200640 1 Processor -- start 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.280+0000 7fe0e1200640 1 -- start start 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.280+0000 7fe0e1200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0e1200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc10b120 0x7fe0dc19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0e1200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc10ba70 0x7fe0dc1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0e1200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc115600 con 0x7fe0dc1057e0 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0e1200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc115480 con 0x7fe0dc10ba70 2024-07-26T13:28:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0e1200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc115780 con 0x7fe0dc10b120 2024-07-26T13:28:46.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37684/0 (socket says 172.21.15.40:37684) 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0d9e00640 1 -- 172.21.15.40:0/3086214951 learned_addr learned my addr 172.21.15.40:0/3086214951 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0d9400640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc10b120 0x7fe0dc19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0da800640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc10ba70 0x7fe0dc1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.281+0000 7fe0d9e00640 1 -- 172.21.15.40:0/3086214951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc10b120 msgr2=0x7fe0dc19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc10b120 0x7fe0dc19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d9e00640 1 -- 172.21.15.40:0/3086214951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc10ba70 msgr2=0x7fe0dc1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc10ba70 0x7fe0dc1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d9e00640 1 -- 172.21.15.40:0/3086214951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1a1f80 con 0x7fe0dc1057e0 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc19c0d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c920 tx=0x7fe0cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d2a00640 1 -- 172.21.15.40:0/3086214951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc007c70 con 0x7fe0dc1057e0 2024-07-26T13:28:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1a2270 con 0x7fe0dc1057e0 2024-07-26T13:28:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d2a00640 1 -- 172.21.15.40:0/3086214951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0cc007e10 con 0x7fe0dc1057e0 2024-07-26T13:28:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.282+0000 7fe0d2a00640 1 -- 172.21.15.40:0/3086214951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0186f0 con 0x7fe0dc1057e0 2024-07-26T13:28:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.283+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a8a90 con 0x7fe0dc1057e0 2024-07-26T13:28:46.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.287+0000 7fe0d2a00640 1 -- 172.21.15.40:0/3086214951 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe0cc00f450 con 0x7fe0dc1057e0 2024-07-26T13:28:46.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.287+0000 7fe0e7e93740 1 Processor -- start 2024-07-26T13:28:46.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.287+0000 7fe0e7e93740 1 -- start start 2024-07-26T13:28:46.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3841fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3842500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 0x556af3842a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556af37b8f30 con 0x556af347c840 2024-07-26T13:28:46.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556af37a8430 con 0x556af3474660 2024-07-26T13:28:46.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556af37ac470 con 0x556af349d520 2024-07-26T13:28:46.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 0x556af3842a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 0x556af3842a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37690/0 (socket says 172.21.15.40:37690) 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0d9400640 1 -- 172.21.15.40:0/3182307003 learned_addr learned my addr 172.21.15.40:0/3182307003 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0d2a00640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c00 0x7fe0c00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3842500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.288+0000 7fe0da800640 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3841fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0d2a00640 1 -- 172.21.15.40:0/3086214951 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0cc0e3ef0 con 0x7fe0dc1057e0 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0da800640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c00 0x7fe0c00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0d9400640 1 -- 172.21.15.40:0/3182307003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 msgr2=0x556af3841fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0d9400640 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3841fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0d9400640 1 -- 172.21.15.40:0/3182307003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 msgr2=0x556af3842500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0d9400640 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3842500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.289+0000 7fe0d9400640 1 -- 172.21.15.40:0/3182307003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af3508b00 con 0x556af347c840 2024-07-26T13:28:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.290+0000 7fe0d9400640 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 0x556af3842a40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000c00 tx=0x7fe0c8031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939c7652bbc90ff3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.290+0000 7fe0da800640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c00 0x7fe0c00b6110 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009fd0 tx=0x7fe0d4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.290+0000 7fe0c7400640 1 -- 172.21.15.40:0/3182307003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8035030 con 0x556af347c840 2024-07-26T13:28:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.290+0000 7fe0c7400640 1 -- 172.21.15.40:0/3182307003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0c80044c0 con 0x556af347c840 2024-07-26T13:28:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.290+0000 7fe0c7400640 1 -- 172.21.15.40:0/3182307003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8003b50 con 0x556af347c840 2024-07-26T13:28:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 -- 172.21.15.40:0/3182307003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 msgr2=0x556af3842a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 0x556af3842a40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000c00 tx=0x7fe0c8031dc0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 -- 172.21.15.40:0/3182307003 shutdown_connections 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af347c840 0x556af3842a40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3842500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/3182307003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3841fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 -- 172.21.15.40:0/3182307003 >> 172.21.15.40:0/3182307003 conn(0x556af3491910 msgr2=0x556af383feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.291+0000 7fe0e7e93740 1 -- 172.21.15.40:0/3182307003 shutdown_connections 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.292+0000 7fe0e7e93740 1 -- 172.21.15.40:0/3182307003 wait complete. 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.292+0000 7fe0e7e93740 1 -- start start 2024-07-26T13:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.292+0000 7fe0e7e93740 1 Processor -- start 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af3474660 0x556af38566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3856cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556af360bbb0 con 0x556af349d520 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556af3744910 con 0x556af347c840 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556af3850740 con 0x556af3474660 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0e7e93740 10 client.0 _ll_register_callbacks cb 0x556af34b4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0da800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0da800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37702/0 (socket says 172.21.15.40:37702) 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.293+0000 7fe0da800640 1 -- 172.21.15.40:0/2176833373 learned_addr learned my addr 172.21.15.40:0/2176833373 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af3474660 0x556af38566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0d9400640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3856cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0da800640 1 -- 172.21.15.40:0/2176833373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af3474660 msgr2=0x556af38566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0da800640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af3474660 0x556af38566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0da800640 1 -- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 msgr2=0x556af3856cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0da800640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3856cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0da800640 1 -- 172.21.15.40:0/2176833373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af357f960 con 0x556af349d520 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0d9400640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3856cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0da800640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385bcd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400f040 tx=0x7fe0d4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c29223db070261 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.294+0000 7fe0bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.295+0000 7fe0bbe00640 1 -- 172.21.15.40:0/2176833373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4020070 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.295+0000 7fe0bbe00640 1 -- 172.21.15.40:0/2176833373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0d4025660 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.295+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556af37bae80 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.295+0000 7fe0bbe00640 1 -- 172.21.15.40:0/2176833373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe0d4015050 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.295+0000 7fe0e7e93740 10 client.18135 fetch_fsmap learned FSMap version 38 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.295+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556af3864cd0 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0bbe00640 1 -- 172.21.15.40:0/2176833373 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556af37bae80 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0bbe00640 1 -- 172.21.15.40:0/2176833373 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 38) ==== 8382+0+0 (secure 0 0 0) 0x7fe0d401a390 con 0x556af349d520 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0e7e93740 10 client.18135 fetch_fsmap finished waiting for FSMap version 38 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0e7e93740 10 client.18135 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0e7e93740 20 client.18135 populate_metadata read hostname 'smithi040' 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af345bea0 0x556af38682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0e7e93740 4 client.18135 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.296+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556af37b6920 con 0x556af345bea0 2024-07-26T13:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.297+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af345bea0 0x556af38682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.298+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af345bea0 0x556af38682c0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7647e492fac10d10 server_cookie=347a3c71b84718a in_seq=0 out_seq=0 2024-07-26T13:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.298+0000 7fe0bbe00640 10 client.18135 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:46.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0bbe00640 1 -- 172.21.15.40:0/2176833373 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556af37b6920 con 0x556af345bea0 2024-07-26T13:28:46.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0bbe00640 10 client.18135 handle_command_reply: tid=0 2024-07-26T13:28:46.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 client.18135 shutdown 2024-07-26T13:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 msgr2=0x556af385bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385bcd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400f040 tx=0x7fe0d4004b50 comp rx=0 tx=0).stop 2024-07-26T13:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 shutdown_connections 2024-07-26T13:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af345bea0 0x556af38682c0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385bcd0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3856cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/2176833373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af3474660 0x556af38566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0bbe00640 0 client.18135 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:46.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 >> 172.21.15.40:0/2176833373 conn(0x556af3491910 msgr2=0x556af3845150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:46.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 shutdown_connections 2024-07-26T13:28:46.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.300+0000 7fe0e7e93740 1 -- 172.21.15.40:0/2176833373 wait complete. 2024-07-26T13:28:46.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.301+0000 7fe0e7e93740 20 client.18135 trim_cache size 0 max 16384 2024-07-26T13:28:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 Processor -- start 2024-07-26T13:28:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 -- start start 2024-07-26T13:28:46.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 0x556af383ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3862ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3851960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1acaf0 con 0x556af3474660 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ae720 con 0x556af347c840 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.320+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ad1c0 con 0x556af349d520 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 0x556af383ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 0x556af383ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37710/0 (socket says 172.21.15.40:37710) 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 -- 172.21.15.40:0/268916851 learned_addr learned my addr 172.21.15.40:0/268916851 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9400640 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3862ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0da800640 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3851960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 -- 172.21.15.40:0/268916851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 msgr2=0x556af3851960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3851960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 -- 172.21.15.40:0/268916851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 msgr2=0x556af3862ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3862ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.321+0000 7fe0d9e00640 1 -- 172.21.15.40:0/268916851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af3844850 con 0x556af3474660 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.322+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 0x556af383ecb0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0aad90 tx=0x7fe0cc092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f038f34f94fbcc06 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.322+0000 7fe0c6a00640 1 -- 172.21.15.40:0/268916851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0c4020 con 0x556af3474660 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.322+0000 7fe0c6a00640 1 -- 172.21.15.40:0/268916851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0cc0af400 con 0x556af3474660 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.322+0000 7fe0c6a00640 1 -- 172.21.15.40:0/268916851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0bbe80 con 0x556af3474660 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 -- 172.21.15.40:0/268916851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 msgr2=0x556af383ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 0x556af383ecb0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0aad90 tx=0x7fe0cc092040 comp rx=0 tx=0).stop 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 -- 172.21.15.40:0/268916851 shutdown_connections 2024-07-26T13:28:46.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af349d520 0x556af3851960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af347c840 0x556af3862ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/268916851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af3474660 0x556af383ecb0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 -- 172.21.15.40:0/268916851 >> 172.21.15.40:0/268916851 conn(0x556af3491910 msgr2=0x556af38450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 -- 172.21.15.40:0/268916851 shutdown_connections 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.323+0000 7fe0e7e93740 1 -- 172.21.15.40:0/268916851 wait complete. 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 -- start start 2024-07-26T13:28:46.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 Processor -- start 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3862750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af347c840 0x556af385ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ae020 con 0x556af349d520 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ad890 con 0x556af3474660 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.324+0000 7fe0e7e93740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1aaab0 con 0x556af347c840 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0e7e93740 10 client.0 _ll_register_callbacks cb 0x7fe0d400c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37726/0 (socket says 172.21.15.40:37726) 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 -- 172.21.15.40:0/92515409 learned_addr learned my addr 172.21.15.40:0/92515409 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3862750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0d9400640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af347c840 0x556af385ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 -- 172.21.15.40:0/92515409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af347c840 msgr2=0x556af385ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af347c840 0x556af385ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 -- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 msgr2=0x556af3862750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3862750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.325+0000 7fe0da800640 1 -- 172.21.15.40:0/92515409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af385f790 con 0x556af349d520 2024-07-26T13:28:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.326+0000 7fe0da800640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385f1a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f80 tx=0x7fe0d401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a013fbc77fa04de9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.326+0000 7fe0bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.326+0000 7fe0bbe00640 1 -- 172.21.15.40:0/92515409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4020070 con 0x556af349d520 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.326+0000 7fe0bbe00640 1 -- 172.21.15.40:0/92515409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0d4025460 con 0x556af349d520 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.326+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0cc0af400 con 0x556af349d520 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0bbe00640 1 -- 172.21.15.40:0/92515409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe0d4025660 con 0x556af349d520 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 10 client.18141 fetch_fsmap learned FSMap version 38 2024-07-26T13:28:46.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556af38d1820 con 0x556af349d520 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0bbe00640 1 -- 172.21.15.40:0/92515409 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0cc0af400 con 0x556af349d520 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0bbe00640 1 -- 172.21.15.40:0/92515409 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 38) ==== 8382+0+0 (secure 0 0 0) 0x7fe0d4037070 con 0x556af349d520 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 10 client.18141 fetch_fsmap finished waiting for FSMap version 38 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 10 client.18141 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 20 client.18141 populate_metadata read hostname 'smithi040' 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af3431250 0x556af38d4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:28:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 4 client.18141 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f3e1af89", "release": true, "await": true}] 2024-07-26T13:28:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.327+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f3e1af89", "release": true, "await": true}) -- 0x556af383f280 con 0x556af3431250 2024-07-26T13:28:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.328+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af3431250 0x556af38d4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:28:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.329+0000 7fe0d9e00640 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af3431250 0x556af38d4010 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04bcee1a0c9e34c server_cookie=cfdacdc48c8e6dff in_seq=0 out_seq=0 2024-07-26T13:28:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.329+0000 7fe0bbe00640 10 client.18141 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:46.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.402+0000 7fe0bbe00640 1 -- 172.21.15.40:0/92515409 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x556af383f280 con 0x556af3431250 2024-07-26T13:28:46.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.402+0000 7fe0bbe00640 10 client.18141 handle_command_reply: tid=0 2024-07-26T13:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.402+0000 7fe0e7e93740 1 client.18141 shutdown 2024-07-26T13:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 msgr2=0x556af385f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385f1a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f80 tx=0x7fe0d401aca0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 shutdown_connections 2024-07-26T13:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x556af3431250 0x556af38d4010 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556af349d520 0x556af385f1a0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556af347c840 0x556af385ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 --2- 172.21.15.40:0/92515409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556af3474660 0x556af3862750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0bbe00640 0 client.18141 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.404+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 >> 172.21.15.40:0/92515409 conn(0x556af3491910 msgr2=0x556af383ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.405+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 shutdown_connections 2024-07-26T13:28:46.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.405+0000 7fe0e7e93740 1 -- 172.21.15.40:0/92515409 wait complete. 2024-07-26T13:28:46.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.405+0000 7fe0e7e93740 20 client.18141 trim_cache size 0 max 16384 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 38, 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 224, 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "f3e1af89": { 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 224, 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:28:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 146.6, 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:28:46.411 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:28:46.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:46.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:46.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:46.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:46.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:28:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c00 msgr2=0x7fe0c00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c00 0x7fe0c00b6110 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009fd0 tx=0x7fe0d4004a40 comp rx=0 tx=0).stop 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 msgr2=0x7fe0dc19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc19c0d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c920 tx=0x7fe0cc00cde0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 shutdown_connections 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc10ba70 0x7fe0dc1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c00 0x7fe0c00b6110 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc10b120 0x7fe0dc19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 --2- 172.21.15.40:0/3086214951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1057e0 0x7fe0dc19c0d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:28:46.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.409+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 >> 172.21.15.40:0/3086214951 conn(0x7fe0dc1011f0 msgr2=0x7fe0dc109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:28:46.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.410+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 shutdown_connections 2024-07-26T13:28:46.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:28:46.411+0000 7fe0e1200640 1 -- 172.21.15.40:0/3086214951 wait complete. 2024-07-26T13:28:47.426 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f3e1af89', total seconds elapsed: 34.3 2024-07-26T13:28:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:47 smithi040 ceph-mon[32397]: pgmap v2495: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 83 KiB/s wr, 31 op/s 2024-07-26T13:28:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:47 smithi146 ceph-mon[35807]: pgmap v2495: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 83 KiB/s wr, 31 op/s 2024-07-26T13:28:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:47 smithi076 ceph-mon[35401]: pgmap v2495: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 83 KiB/s wr, 31 op/s 2024-07-26T13:28:49.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:49 smithi040 ceph-mon[32397]: pgmap v2496: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 963 KiB/s wr, 250 op/s 2024-07-26T13:28:49.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:49 smithi146 ceph-mon[35807]: pgmap v2496: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 963 KiB/s wr, 250 op/s 2024-07-26T13:28:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:49 smithi076 ceph-mon[35401]: pgmap v2496: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 963 KiB/s wr, 250 op/s 2024-07-26T13:28:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:51 smithi040 ceph-mon[32397]: pgmap v2497: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 MiB/s wr, 442 op/s 2024-07-26T13:28:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:51 smithi146 ceph-mon[35807]: pgmap v2497: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 MiB/s wr, 442 op/s 2024-07-26T13:28:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:51 smithi076 ceph-mon[35401]: pgmap v2497: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 MiB/s wr, 442 op/s 2024-07-26T13:28:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:53 smithi040 ceph-mon[32397]: pgmap v2498: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 919 op/s 2024-07-26T13:28:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:53 smithi146 ceph-mon[35807]: pgmap v2498: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 919 op/s 2024-07-26T13:28:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:53 smithi076 ceph-mon[35401]: pgmap v2498: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 919 op/s 2024-07-26T13:28:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:55 smithi040 ceph-mon[32397]: pgmap v2499: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 2.14k op/s 2024-07-26T13:28:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:55 smithi146 ceph-mon[35807]: pgmap v2499: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 2.14k op/s 2024-07-26T13:28:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:55 smithi076 ceph-mon[35401]: pgmap v2499: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 2.14k op/s 2024-07-26T13:28:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:56 smithi040 ceph-mon[32397]: pgmap v2500: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-07-26T13:28:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:56 smithi146 ceph-mon[35807]: pgmap v2500: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-07-26T13:28:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:56 smithi076 ceph-mon[35401]: pgmap v2500: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-07-26T13:28:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:28:59 smithi040 ceph-mon[32397]: pgmap v2501: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-07-26T13:28:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:28:59 smithi146 ceph-mon[35807]: pgmap v2501: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-07-26T13:28:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:28:59 smithi076 ceph-mon[35401]: pgmap v2501: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-07-26T13:29:01.446 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:01 smithi040 ceph-mon[32397]: pgmap v2502: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.04k op/s 2024-07-26T13:29:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:01 smithi146 ceph-mon[35807]: pgmap v2502: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.04k op/s 2024-07-26T13:29:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:01 smithi076 ceph-mon[35401]: pgmap v2502: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.04k op/s 2024-07-26T13:29:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:03 smithi040 ceph-mon[32397]: pgmap v2503: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-07-26T13:29:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:03 smithi146 ceph-mon[35807]: pgmap v2503: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-07-26T13:29:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:03 smithi076 ceph-mon[35401]: pgmap v2503: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-07-26T13:29:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:05 smithi040 ceph-mon[32397]: pgmap v2504: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 5.20k op/s 2024-07-26T13:29:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:05 smithi146 ceph-mon[35807]: pgmap v2504: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 5.20k op/s 2024-07-26T13:29:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:05 smithi076 ceph-mon[35401]: pgmap v2504: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 5.20k op/s 2024-07-26T13:29:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:07 smithi040 ceph-mon[32397]: pgmap v2505: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.55k op/s 2024-07-26T13:29:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:07 smithi146 ceph-mon[35807]: pgmap v2505: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.55k op/s 2024-07-26T13:29:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:07 smithi076 ceph-mon[35401]: pgmap v2505: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.55k op/s 2024-07-26T13:29:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:08 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:29:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:08 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:29:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:08 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:29:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:09 smithi040 ceph-mon[32397]: pgmap v2506: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:29:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:09 smithi146 ceph-mon[35807]: pgmap v2506: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:29:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:09 smithi076 ceph-mon[35401]: pgmap v2506: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:29:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:11 smithi146 ceph-mon[35807]: pgmap v2507: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-07-26T13:29:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:11 smithi076 ceph-mon[35401]: pgmap v2507: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-07-26T13:29:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:11 smithi040 ceph-mon[32397]: pgmap v2507: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-07-26T13:29:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:13 smithi146 ceph-mon[35807]: pgmap v2508: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-07-26T13:29:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:13 smithi076 ceph-mon[35401]: pgmap v2508: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-07-26T13:29:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:13 smithi040 ceph-mon[32397]: pgmap v2508: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.43k op/s 2024-07-26T13:29:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:15 smithi146 ceph-mon[35807]: pgmap v2509: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 5.03k op/s 2024-07-26T13:29:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:15 smithi076 ceph-mon[35401]: pgmap v2509: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 5.03k op/s 2024-07-26T13:29:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:15 smithi040 ceph-mon[32397]: pgmap v2509: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 5.03k op/s 2024-07-26T13:29:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:17 smithi146 ceph-mon[35807]: pgmap v2510: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2024-07-26T13:29:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:17 smithi076 ceph-mon[35401]: pgmap v2510: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2024-07-26T13:29:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:17 smithi040 ceph-mon[32397]: pgmap v2510: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2024-07-26T13:29:19.534 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:19 smithi040 ceph-mon[32397]: pgmap v2511: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.88k op/s 2024-07-26T13:29:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:19 smithi146 ceph-mon[35807]: pgmap v2511: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.88k op/s 2024-07-26T13:29:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:19 smithi076 ceph-mon[35401]: pgmap v2511: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.88k op/s 2024-07-26T13:29:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:21 smithi146 ceph-mon[35807]: pgmap v2512: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:29:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:29:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:21 smithi076 ceph-mon[35401]: pgmap v2512: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:29:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:29:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:21 smithi040 ceph-mon[32397]: pgmap v2512: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:29:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:29:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: pgmap v2513: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.47k op/s 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:29:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:29:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:29:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:29:23.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:29:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:29:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:29:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: pgmap v2513: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.47k op/s 2024-07-26T13:29:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:29:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:29:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:29:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:29:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: pgmap v2513: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.47k op/s 2024-07-26T13:29:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:29:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:29:25.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:25 smithi040 ceph-mon[32397]: pgmap v2514: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2024-07-26T13:29:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:25 smithi146 ceph-mon[35807]: pgmap v2514: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2024-07-26T13:29:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:25 smithi076 ceph-mon[35401]: pgmap v2514: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2024-07-26T13:29:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:27 smithi040 ceph-mon[32397]: pgmap v2515: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-07-26T13:29:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:27 smithi146 ceph-mon[35807]: pgmap v2515: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-07-26T13:29:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:27 smithi076 ceph-mon[35401]: pgmap v2515: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2024-07-26T13:29:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:29 smithi040 ceph-mon[32397]: pgmap v2516: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.87k op/s 2024-07-26T13:29:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:29 smithi146 ceph-mon[35807]: pgmap v2516: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.87k op/s 2024-07-26T13:29:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:29 smithi076 ceph-mon[35401]: pgmap v2516: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.87k op/s 2024-07-26T13:29:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:31 smithi040 ceph-mon[32397]: pgmap v2517: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.22k op/s 2024-07-26T13:29:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:31 smithi146 ceph-mon[35807]: pgmap v2517: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.22k op/s 2024-07-26T13:29:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:31 smithi076 ceph-mon[35401]: pgmap v2517: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.22k op/s 2024-07-26T13:29:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:33 smithi040 ceph-mon[32397]: pgmap v2518: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2024-07-26T13:29:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:33 smithi146 ceph-mon[35807]: pgmap v2518: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2024-07-26T13:29:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:33 smithi076 ceph-mon[35401]: pgmap v2518: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2024-07-26T13:29:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:35 smithi040 ceph-mon[32397]: pgmap v2519: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.02k op/s 2024-07-26T13:29:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:35 smithi146 ceph-mon[35807]: pgmap v2519: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.02k op/s 2024-07-26T13:29:35.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:35 smithi076 ceph-mon[35401]: pgmap v2519: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.02k op/s 2024-07-26T13:29:36.826 INFO:tasks.quiescer.fs.[cephfs]:Total duration (36.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:29:36.827 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.05 2024-07-26T13:29:36.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:29:37.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:37 smithi040 ceph-mon[32397]: pgmap v2520: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-07-26T13:29:37.634 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:29:37.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:37 smithi076 ceph-mon[35401]: pgmap v2520: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-07-26T13:29:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:37 smithi146 ceph-mon[35807]: pgmap v2520: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2024-07-26T13:29:39.661 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:39 smithi040 ceph-mon[32397]: pgmap v2521: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2024-07-26T13:29:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:39 smithi146 ceph-mon[35807]: pgmap v2521: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2024-07-26T13:29:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:39 smithi076 ceph-mon[35401]: pgmap v2521: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2024-07-26T13:29:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:41 smithi040 ceph-mon[32397]: pgmap v2522: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-07-26T13:29:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:41 smithi146 ceph-mon[35807]: pgmap v2522: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-07-26T13:29:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:41 smithi076 ceph-mon[35401]: pgmap v2522: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2024-07-26T13:29:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.005+0000 7fe3c6a00640 1 -- 172.21.15.40:0/3320678449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c01057e0 msgr2=0x7fe3c0105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.005+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/3320678449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c01057e0 0x7fe3c0105bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009900 tx=0x7fe3b002a420 comp rx=0 tx=0).stop 2024-07-26T13:29:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.006+0000 7fe3c6a00640 1 -- 172.21.15.40:0/3320678449 shutdown_connections 2024-07-26T13:29:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.006+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/3320678449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c010ba70 0x7fe3c01122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.006+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/3320678449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3c010b120 0x7fe3c010b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.006+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/3320678449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c01057e0 0x7fe3c0105bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.006+0000 7fe3c6a00640 1 -- 172.21.15.40:0/3320678449 >> 172.21.15.40:0/3320678449 conn(0x7fe3c01011f0 msgr2=0x7fe3c0103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.008+0000 7fe3c6a00640 1 -- 172.21.15.40:0/3320678449 shutdown_connections 2024-07-26T13:29:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.008+0000 7fe3c6a00640 1 -- 172.21.15.40:0/3320678449 wait complete. 2024-07-26T13:29:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.010+0000 7fe3c6a00640 1 Processor -- start 2024-07-26T13:29:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.010+0000 7fe3c6a00640 1 -- start start 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.011+0000 7fe3c6a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 0x7fe3c00748f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.011+0000 7fe3c6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c010b120 0x7fe3c006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.011+0000 7fe3c6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3c010ba70 0x7fe3c006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.011+0000 7fe3c6a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0115620 con 0x7fe3c010ba70 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.011+0000 7fe3c6a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01154a0 con 0x7fe3c01057e0 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.011+0000 7fe3c6a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c01157a0 con 0x7fe3c010b120 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.012+0000 7fe3bf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c010b120 0x7fe3c006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.012+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 0x7fe3c00748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.012+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 0x7fe3c00748f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:51938/0 (socket says 172.21.15.40:51938) 2024-07-26T13:29:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.012+0000 7fe3bfe00640 1 -- 172.21.15.40:0/157863585 learned_addr learned my addr 172.21.15.40:0/157863585 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.012+0000 7fe3bf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c010b120 0x7fe3c006dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:52856/0 (socket says 172.21.15.40:52856) 2024-07-26T13:29:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.013+0000 7fe3bfe00640 1 -- 172.21.15.40:0/157863585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c010b120 msgr2=0x7fe3c006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.013+0000 7fe3bfe00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c010b120 0x7fe3c006dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.013+0000 7fe3bfe00640 1 -- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3c010ba70 msgr2=0x7fe3c006e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.013+0000 7fe3bfe00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3c010ba70 0x7fe3c006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.013+0000 7fe3bfe00640 1 -- 172.21.15.40:0/157863585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c006e9d0 con 0x7fe3c01057e0 2024-07-26T13:29:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.014+0000 7fe3bfe00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 0x7fe3c00748f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0006010 tx=0x7fe3b0004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.014+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0040070 con 0x7fe3c01057e0 2024-07-26T13:29:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.015+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3b0004d70 con 0x7fe3c01057e0 2024-07-26T13:29:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.015+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c0073620 con 0x7fe3c01057e0 2024-07-26T13:29:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.015+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c0073b30 con 0x7fe3c01057e0 2024-07-26T13:29:43.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.018+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00316a0 con 0x7fe3c01057e0 2024-07-26T13:29:43.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.018+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a00052c0 con 0x7fe3c01057e0 2024-07-26T13:29:43.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.024+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe3b0043070 con 0x7fe3c01057e0 2024-07-26T13:29:43.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.027+0000 7fe3bcc00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3a40b3bd0 0x7fe3a40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:43.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.027+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3b0104750 con 0x7fe3c01057e0 2024-07-26T13:29:43.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.028+0000 7fe3bf400640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3a40b3bd0 0x7fe3a40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:43.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.029+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe3b00cbd60 con 0x7fe3c01057e0 2024-07-26T13:29:43.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.034+0000 7fe3bf400640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3a40b3bd0 0x7fe3a40b60e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0104a80 tx=0x7fe3ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.430+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3a00055b0 con 0x7fe3c01057e0 2024-07-26T13:29:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.432+0000 7fe3bcc00640 1 -- 172.21.15.40:0/157863585 <== mon.2 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11989 (secure 0 0 0) 0x7fe3b00cb660 con 0x7fe3c01057e0 2024-07-26T13:29:43.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:29:43.436 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"btime":"2024-07-26T13:29:07:203990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:29:06.454427+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3a40b3bd0 msgr2=0x7fe3a40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3a40b3bd0 0x7fe3a40b60e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0104a80 tx=0x7fe3ac005f90 comp rx=0 tx=0).stop 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 msgr2=0x7fe3c00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 0x7fe3c00748f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0006010 tx=0x7fe3b0004970 comp rx=0 tx=0).stop 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 shutdown_connections 2024-07-26T13:29:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3c010ba70 0x7fe3c006e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe3a40b3bd0 0x7fe3a40b60e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3c010b120 0x7fe3c006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 --2- 172.21.15.40:0/157863585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c01057e0 0x7fe3c00748f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.435+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 >> 172.21.15.40:0/157863585 conn(0x7fe3c01011f0 msgr2=0x7fe3c0103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.436+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 shutdown_connections 2024-07-26T13:29:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:43.437+0000 7fe3c6a00640 1 -- 172.21.15.40:0/157863585 wait complete. 2024-07-26T13:29:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:43 smithi040 ceph-mon[32397]: pgmap v2523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:29:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:43 smithi146 ceph-mon[35807]: pgmap v2523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:29:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:43 smithi076 ceph-mon[35401]: pgmap v2523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2024-07-26T13:29:44.326 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 138.05 --await-for 45.0' 2024-07-26T13:29:44.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 138.05 --await-for 45.0 2024-07-26T13:29:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:44 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/157863585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:29:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:44 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/157863585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:29:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:44 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/157863585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:29:45.059 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:29:45.583 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:45 smithi040 ceph-mon[32397]: pgmap v2524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2024-07-26T13:29:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:45 smithi146 ceph-mon[35807]: pgmap v2524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2024-07-26T13:29:45.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:45 smithi076 ceph-mon[35401]: pgmap v2524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2024-07-26T13:29:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:47 smithi040 ceph-mon[32397]: pgmap v2525: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2024-07-26T13:29:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:47 smithi146 ceph-mon[35807]: pgmap v2525: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2024-07-26T13:29:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:47 smithi076 ceph-mon[35401]: pgmap v2525: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2024-07-26T13:29:49.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 -- 172.21.15.40:0/263813607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a601029f0 msgr2=0x7f4a6010f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 --2- 172.21.15.40:0/263813607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a601029f0 0x7f4a6010f710 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009900 tx=0x7f4a4c02a4d0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 -- 172.21.15.40:0/263813607 shutdown_connections 2024-07-26T13:29:49.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 --2- 172.21.15.40:0/263813607 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a6010fc50 0x7f4a60112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 --2- 172.21.15.40:0/263813607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a601029f0 0x7f4a6010f710 secure :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009900 tx=0x7f4a4c02a4d0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 --2- 172.21.15.40:0/263813607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a601020a0 0x7f4a601024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.390+0000 7f4a67800640 1 -- 172.21.15.40:0/263813607 >> 172.21.15.40:0/263813607 conn(0x7f4a60079190 msgr2=0x7f4a600795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:49.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.392+0000 7f4a67800640 1 -- 172.21.15.40:0/263813607 shutdown_connections 2024-07-26T13:29:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.392+0000 7f4a67800640 1 -- 172.21.15.40:0/263813607 wait complete. 2024-07-26T13:29:49.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.394+0000 7f4a67800640 1 Processor -- start 2024-07-26T13:29:49.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.395+0000 7f4a67800640 1 -- start start 2024-07-26T13:29:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.395+0000 7f4a67800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 0x7f4a601043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.395+0000 7f4a67800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6010fc50 0x7f4a60104910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a67800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a60104e50 0x7f4a60073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a67800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601155b0 con 0x7f4a6010fc50 2024-07-26T13:29:49.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a67800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60115430 con 0x7f4a601020a0 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a67800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60115730 con 0x7f4a60104e50 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 0x7f4a601043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 0x7f4a601043d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:51954/0 (socket says 172.21.15.40:51954) 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 -- 172.21.15.40:0/4258539404 learned_addr learned my addr 172.21.15.40:0/4258539404 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a65800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a60104e50 0x7f4a60073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 -- 172.21.15.40:0/4258539404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a60104e50 msgr2=0x7f4a60073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a60104e50 0x7f4a60073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 -- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6010fc50 msgr2=0x7f4a60104910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6010fc50 0x7f4a60104910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.396+0000 7f4a64e00640 1 -- 172.21.15.40:0/4258539404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a60074100 con 0x7f4a601020a0 2024-07-26T13:29:49.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.397+0000 7f4a64e00640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 0x7f4a601043d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400e9f0 tx=0x7f4a5400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.397+0000 7f4a5d600640 1 -- 172.21.15.40:0/4258539404 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400cd80 con 0x7f4a601020a0 2024-07-26T13:29:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.398+0000 7f4a5d600640 1 -- 172.21.15.40:0/4258539404 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a540108c0 con 0x7f4a601020a0 2024-07-26T13:29:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.398+0000 7f4a5d600640 1 -- 172.21.15.40:0/4258539404 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400cd80 con 0x7f4a601020a0 2024-07-26T13:29:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.398+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a600743f0 con 0x7f4a601020a0 2024-07-26T13:29:49.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.398+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a60074960 con 0x7f4a601020a0 2024-07-26T13:29:49.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.403+0000 7f4a5d600640 1 -- 172.21.15.40:0/4258539404 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4a54018510 con 0x7f4a601020a0 2024-07-26T13:29:49.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.404+0000 7f4a5d600640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4a480b3ed0 0x7f4a480b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.404+0000 7f4a5d600640 1 -- 172.21.15.40:0/4258539404 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4a540e4b40 con 0x7f4a601020a0 2024-07-26T13:29:49.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.405+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4a480b3ed0 0x7f4a480b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.449+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4a480b3ed0 0x7f4a480b63e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c033040 tx=0x7f4a4c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:49.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.450+0000 7f4a6e417740 1 Processor -- start 2024-07-26T13:29:49.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.450+0000 7f4a6e417740 1 -- start start 2024-07-26T13:29:49.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f86872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f86877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8687d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a6e417740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b6f85fb8a0 con 0x55b6f82e0850 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a6e417740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b6f85eada0 con 0x55b6f82b7990 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a6e417740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6f85eede0 con 0x55b6f82bfb70 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a5fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f86877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a65800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8687d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a65800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8687d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:52894/0 (socket says 172.21.15.40:52894) 2024-07-26T13:29:49.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.451+0000 7f4a65800640 1 -- 172.21.15.40:0/527911084 learned_addr learned my addr 172.21.15.40:0/527911084 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:49.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a64e00640 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f86872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a5fe00640 1 -- 172.21.15.40:0/527911084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 msgr2=0x55b6f8687d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8687d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a5fe00640 1 -- 172.21.15.40:0/527911084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 msgr2=0x55b6f86872a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f86872a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a5fe00640 1 -- 172.21.15.40:0/527911084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f857fb70 con 0x55b6f82b7990 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.452+0000 7f4a64e00640 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f86872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.453+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f86877e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c008000 tx=0x7f4a4c03b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d40bd9615bc3742 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.453+0000 7f4a52000640 1 -- 172.21.15.40:0/527911084 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c044050 con 0x55b6f82b7990 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.453+0000 7f4a52000640 1 -- 172.21.15.40:0/527911084 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a4c045040 con 0x55b6f82b7990 2024-07-26T13:29:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.453+0000 7f4a52000640 1 -- 172.21.15.40:0/527911084 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c03e8c0 con 0x55b6f82b7990 2024-07-26T13:29:49.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.454+0000 7f4a6e417740 1 -- 172.21.15.40:0/527911084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 msgr2=0x55b6f86877e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.454+0000 7f4a6e417740 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f86877e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c008000 tx=0x7f4a4c03b000 comp rx=0 tx=0).stop 2024-07-26T13:29:49.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 -- 172.21.15.40:0/527911084 shutdown_connections 2024-07-26T13:29:49.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8687d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f86877e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 --2- 172.21.15.40:0/527911084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f86872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 -- 172.21.15.40:0/527911084 >> 172.21.15.40:0/527911084 conn(0x55b6f82d4c40 msgr2=0x55b6f8685190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 -- 172.21.15.40:0/527911084 shutdown_connections 2024-07-26T13:29:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.455+0000 7f4a6e417740 1 -- 172.21.15.40:0/527911084 wait complete. 2024-07-26T13:29:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.456+0000 7f4a6e417740 1 -- start start 2024-07-26T13:29:49.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.458+0000 7f4a6e417740 1 Processor -- start 2024-07-26T13:29:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8692dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8693300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f869ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b6f844e7b0 con 0x55b6f82e0850 2024-07-26T13:29:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b6f8587380 con 0x55b6f82b7990 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6f8695a20 con 0x55b6f82bfb70 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.459+0000 7f4a6e417740 10 client.0 _ll_register_callbacks cb 0x55b6f8596830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.460+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8692dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.460+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8692dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:51984/0 (socket says 172.21.15.40:51984) 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.460+0000 7f4a64e00640 1 -- 172.21.15.40:0/2443137910 learned_addr learned my addr 172.21.15.40:0/2443137910 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.462+0000 7f4a64e00640 1 -- 172.21.15.40:0/2443137910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 msgr2=0x55b6f8693300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.462+0000 7f4a64e00640 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8693300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.462+0000 7f4a64e00640 1 -- 172.21.15.40:0/2443137910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 msgr2=0x55b6f869ed10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T13:29:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.462+0000 7f4a64e00640 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f869ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.462+0000 7f4a64e00640 1 -- 172.21.15.40:0/2443137910 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f835aba0 con 0x55b6f82b7990 2024-07-26T13:29:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.463+0000 7f4a64e00640 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8692dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a540ab750 tx=0x7f4a540a72d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5fe0db17ca226b server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.463+0000 7f4a46a00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:29:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.463+0000 7f4a46a00640 1 -- 172.21.15.40:0/2443137910 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540a7040 con 0x55b6f82b7990 2024-07-26T13:29:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.463+0000 7f4a46a00640 1 -- 172.21.15.40:0/2443137910 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4a54010a70 con 0x55b6f82b7990 2024-07-26T13:29:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.464+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a4c045040 con 0x55b6f82b7990 2024-07-26T13:29:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.465+0000 7f4a46a00640 1 -- 172.21.15.40:0/2443137910 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4a540b0050 con 0x55b6f82b7990 2024-07-26T13:29:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.465+0000 7f4a6e417740 10 client.37547 fetch_fsmap learned FSMap version 39 2024-07-26T13:29:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.465+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b6f86b2950 con 0x55b6f82b7990 2024-07-26T13:29:49.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.465+0000 7f4a46a00640 1 -- 172.21.15.40:0/2443137910 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a4c045040 con 0x55b6f82b7990 2024-07-26T13:29:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a46a00640 1 -- 172.21.15.40:0/2443137910 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4a54091b40 con 0x55b6f82b7990 2024-07-26T13:29:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a6e417740 10 client.37547 fetch_fsmap finished waiting for FSMap version 39 2024-07-26T13:29:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a6e417740 10 client.37547 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:29:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a6e417740 20 client.37547 populate_metadata read hostname 'smithi040' 2024-07-26T13:29:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a6e417740 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f829f1d0 0x55b6f86b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a6e417740 4 client.37547 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:29:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6f85fd7f0 con 0x55b6f829f1d0 2024-07-26T13:29:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.466+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f829f1d0 0x55b6f86b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.467+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f829f1d0 0x55b6f86b6050 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bd0af30d3fcee2 server_cookie=8e8603e2c6bca65b in_seq=0 out_seq=0 2024-07-26T13:29:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.467+0000 7f4a46a00640 10 client.37547 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:29:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.469+0000 7f4a46a00640 1 -- 172.21.15.40:0/2443137910 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6f85fd7f0 con 0x55b6f829f1d0 2024-07-26T13:29:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.469+0000 7f4a46a00640 10 client.37547 handle_command_reply: tid=0 2024-07-26T13:29:49.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.470+0000 7f4a6e417740 1 client.37547 shutdown 2024-07-26T13:29:49.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.471+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 msgr2=0x55b6f8692dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.471+0000 7f4a6e417740 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8692dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a540ab750 tx=0x7f4a540a72d0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 shutdown_connections 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f829f1d0 0x55b6f86b6050 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f869ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f8693300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 --2- 172.21.15.40:0/2443137910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8692dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 >> 172.21.15.40:0/2443137910 conn(0x55b6f82d4c40 msgr2=0x55b6f868a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a46a00640 0 client.37547 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:29:49.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 shutdown_connections 2024-07-26T13:29:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.472+0000 7f4a6e417740 1 -- 172.21.15.40:0/2443137910 wait complete. 2024-07-26T13:29:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.473+0000 7f4a6e417740 20 client.37547 trim_cache size 0 max 16384 2024-07-26T13:29:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.505+0000 7f4a6e417740 1 Processor -- start 2024-07-26T13:29:49.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 -- start start 2024-07-26T13:29:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8688c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f869eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f8692450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601b39f0 con 0x55b6f82e0850 2024-07-26T13:29:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601b76d0 con 0x55b6f82b7990 2024-07-26T13:29:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.506+0000 7f4a6e417740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601b40c0 con 0x55b6f82bfb70 2024-07-26T13:29:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.507+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8688c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.508+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8688c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:51994/0 (socket says 172.21.15.40:51994) 2024-07-26T13:29:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.508+0000 7f4a64e00640 1 -- 172.21.15.40:0/731844276 learned_addr learned my addr 172.21.15.40:0/731844276 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.508+0000 7f4a5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f869eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.508+0000 7f4a65800640 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f8692450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a64e00640 1 -- 172.21.15.40:0/731844276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 msgr2=0x55b6f869eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a64e00640 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f869eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a64e00640 1 -- 172.21.15.40:0/731844276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 msgr2=0x55b6f8692450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a64e00640 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f8692450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a64e00640 1 -- 172.21.15.40:0/731844276 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f8685610 con 0x55b6f82b7990 2024-07-26T13:29:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f869eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:29:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.509+0000 7f4a64e00640 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8688c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400e9c0 tx=0x7f4a5401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cae42c1f68afe56 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:49.512 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:49 smithi040 ceph-mon[32397]: pgmap v2526: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-07-26T13:29:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.510+0000 7f4a51600640 1 -- 172.21.15.40:0/731844276 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540ca070 con 0x55b6f82b7990 2024-07-26T13:29:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.510+0000 7f4a51600640 1 -- 172.21.15.40:0/731844276 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a540b4b00 con 0x55b6f82b7990 2024-07-26T13:29:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.510+0000 7f4a51600640 1 -- 172.21.15.40:0/731844276 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540a7040 con 0x55b6f82b7990 2024-07-26T13:29:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 -- 172.21.15.40:0/731844276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 msgr2=0x55b6f8688c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8688c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400e9c0 tx=0x7f4a5401f000 comp rx=0 tx=0).stop 2024-07-26T13:29:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 -- 172.21.15.40:0/731844276 shutdown_connections 2024-07-26T13:29:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82e0850 0x55b6f8692450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82bfb70 0x55b6f869eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 --2- 172.21.15.40:0/731844276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82b7990 0x55b6f8688c90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.511+0000 7f4a6e417740 1 -- 172.21.15.40:0/731844276 >> 172.21.15.40:0/731844276 conn(0x55b6f82d4c40 msgr2=0x55b6f868aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.512+0000 7f4a6e417740 1 -- 172.21.15.40:0/731844276 shutdown_connections 2024-07-26T13:29:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.512+0000 7f4a6e417740 1 -- 172.21.15.40:0/731844276 wait complete. 2024-07-26T13:29:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.513+0000 7f4a6e417740 1 -- start start 2024-07-26T13:29:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.513+0000 7f4a6e417740 1 Processor -- start 2024-07-26T13:29:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 0x55b6f869b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 0x55b6f8696500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82e0850 0x55b6f8696a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601b6f40 con 0x55b6f82b7990 2024-07-26T13:29:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601b67b0 con 0x55b6f82bfb70 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601b19b0 con 0x55b6f82e0850 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.514+0000 7f4a6e417740 10 client.0 _ll_register_callbacks cb 0x7f4a540ab230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.515+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 0x55b6f869b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.515+0000 7f4a64e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 0x55b6f869b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47402/0 (socket says 172.21.15.40:47402) 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.515+0000 7f4a5fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 0x55b6f8696500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.515+0000 7f4a5fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 0x55b6f8696500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:52000/0 (socket says 172.21.15.40:52000) 2024-07-26T13:29:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.515+0000 7f4a5fe00640 1 -- 172.21.15.40:0/3118919736 learned_addr learned my addr 172.21.15.40:0/3118919736 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.515+0000 7f4a65800640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82e0850 0x55b6f8696a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.516+0000 7f4a64e00640 1 -- 172.21.15.40:0/3118919736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82e0850 msgr2=0x55b6f8696a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.516+0000 7f4a64e00640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82e0850 0x55b6f8696a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.516+0000 7f4a64e00640 1 -- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 msgr2=0x55b6f8696500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.516+0000 7f4a64e00640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 0x55b6f8696500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.516+0000 7f4a64e00640 1 -- 172.21.15.40:0/3118919736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f8696f80 con 0x55b6f82b7990 2024-07-26T13:29:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.516+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 0x55b6f8696500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:29:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.517+0000 7f4a64e00640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 0x55b6f869b050 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400e9c0 tx=0x7f4a540ac1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5348224e7c697237 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.517+0000 7f4a46a00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:29:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.517+0000 7f4a46a00640 1 -- 172.21.15.40:0/3118919736 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540ca070 con 0x55b6f82b7990 2024-07-26T13:29:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.517+0000 7f4a46a00640 1 -- 172.21.15.40:0/3118919736 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4a54010430 con 0x55b6f82b7990 2024-07-26T13:29:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.518+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a540b4b00 con 0x55b6f82b7990 2024-07-26T13:29:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.518+0000 7f4a46a00640 1 -- 172.21.15.40:0/3118919736 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4a5408c050 con 0x55b6f82b7990 2024-07-26T13:29:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.518+0000 7f4a6e417740 10 client.18156 fetch_fsmap learned FSMap version 39 2024-07-26T13:29:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.518+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b6f871e400 con 0x55b6f82b7990 2024-07-26T13:29:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.519+0000 7f4a46a00640 1 -- 172.21.15.40:0/3118919736 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a540b4b00 con 0x55b6f82b7990 2024-07-26T13:29:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.519+0000 7f4a46a00640 1 -- 172.21.15.40:0/3118919736 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4a54085ce0 con 0x55b6f82b7990 2024-07-26T13:29:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a6e417740 10 client.18156 fetch_fsmap finished waiting for FSMap version 39 2024-07-26T13:29:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a6e417740 10 client.18156 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:29:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a6e417740 20 client.18156 populate_metadata read hostname 'smithi040' 2024-07-26T13:29:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a6e417740 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f8274580 0x55b6f87209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a6e417740 4 client.18156 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.05, "await_for": 45.0}] 2024-07-26T13:29:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.05, "await_for": 45.0}) -- 0x55b6f85f9290 con 0x55b6f8274580 2024-07-26T13:29:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.520+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f8274580 0x55b6f87209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.522+0000 7f4a46a00640 10 client.18156 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:29:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.522+0000 7f4a5fe00640 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f8274580 0x55b6f87209d0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3c9609d64e4fb5 server_cookie=3faeb35dce49b7cb in_seq=0 out_seq=0 2024-07-26T13:29:49.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.742+0000 7f4a46a00640 1 -- 172.21.15.40:0/3118919736 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55b6f85f9290 con 0x55b6f8274580 2024-07-26T13:29:49.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.742+0000 7f4a46a00640 10 client.18156 handle_command_reply: tid=0 2024-07-26T13:29:49.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.742+0000 7f4a6e417740 1 client.18156 shutdown 2024-07-26T13:29:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.742+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 msgr2=0x55b6f869b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.742+0000 7f4a6e417740 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 0x55b6f869b050 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400e9c0 tx=0x7f4a540ac1d0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 shutdown_connections 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6f82e0850 0x55b6f8696a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6f82bfb70 0x55b6f8696500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6f8274580 0x55b6f87209d0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 --2- 172.21.15.40:0/3118919736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6f82b7990 0x55b6f869b050 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 >> 172.21.15.40:0/3118919736 conn(0x55b6f82d4c40 msgr2=0x55b6f868aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a46a00640 0 client.18156 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 shutdown_connections 2024-07-26T13:29:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 1 -- 172.21.15.40:0/3118919736 wait complete. 2024-07-26T13:29:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.743+0000 7f4a6e417740 20 client.18156 trim_cache size 0 max 16384 2024-07-26T13:29:49.747 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:29:49.747 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 39, 2024-07-26T13:29:49.747 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:29:49.747 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 226, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "b1077a8f": { 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 226, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.1, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:29:49.748 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:29:49.749 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.744+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4a480b3ed0 msgr2=0x7f4a480b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.744+0000 7f4a67800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4a480b3ed0 0x7f4a480b63e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c033040 tx=0x7f4a4c000bc0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.744+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 msgr2=0x7f4a601043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.744+0000 7f4a67800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 0x7f4a601043d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400e9f0 tx=0x7f4a5400eeb0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 shutdown_connections 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4a480b3ed0 0x7f4a480b63e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a60104e50 0x7f4a60073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6010fc50 0x7f4a60104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 --2- 172.21.15.40:0/4258539404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a601020a0 0x7f4a601043d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 >> 172.21.15.40:0/4258539404 conn(0x7f4a60079190 msgr2=0x7f4a60111280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 shutdown_connections 2024-07-26T13:29:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:49.745+0000 7f4a67800640 1 -- 172.21.15.40:0/4258539404 wait complete. 2024-07-26T13:29:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:49 smithi146 ceph-mon[35807]: pgmap v2526: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-07-26T13:29:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:49 smithi076 ceph-mon[35401]: pgmap v2526: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-07-26T13:29:50.757 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b1077a8f', quiesce took 13.9 seconds. Will release after: 4.15 2024-07-26T13:29:51.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:51 smithi040 ceph-mon[32397]: pgmap v2527: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-07-26T13:29:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:51 smithi146 ceph-mon[35807]: pgmap v2527: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-07-26T13:29:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:51 smithi076 ceph-mon[35401]: pgmap v2527: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-07-26T13:29:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:53 smithi040 ceph-mon[32397]: pgmap v2528: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-07-26T13:29:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:53 smithi146 ceph-mon[35807]: pgmap v2528: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-07-26T13:29:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:53 smithi076 ceph-mon[35401]: pgmap v2528: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-07-26T13:29:54.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:29:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:29:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:55 smithi040 ceph-mon[32397]: pgmap v2529: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 3.95k op/s 2024-07-26T13:29:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:55 smithi146 ceph-mon[35807]: pgmap v2529: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 3.95k op/s 2024-07-26T13:29:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:55 smithi076 ceph-mon[35401]: pgmap v2529: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 3.95k op/s 2024-07-26T13:29:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:57 smithi040 ceph-mon[32397]: pgmap v2530: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-07-26T13:29:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:57 smithi146 ceph-mon[35807]: pgmap v2530: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 -- 172.21.15.40:0/1240389205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c109670 msgr2=0x7fab6c10fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 --2- 172.21.15.40:0/1240389205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c109670 0x7fab6c10fea0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fab64009ca0 tx=0x7fab6402a8c0 comp rx=0 tx=0).stop 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 -- 172.21.15.40:0/1240389205 shutdown_connections 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 --2- 172.21.15.40:0/1240389205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c109670 0x7fab6c10fea0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 --2- 172.21.15.40:0/1240389205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 0x7fab6c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 --2- 172.21.15.40:0/1240389205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c1033e0 0x7fab6c1037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 -- 172.21.15.40:0/1240389205 >> 172.21.15.40:0/1240389205 conn(0x7fab6c0fee30 msgr2=0x7fab6c101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 -- 172.21.15.40:0/1240389205 shutdown_connections 2024-07-26T13:29:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.830+0000 7fab72400640 1 -- 172.21.15.40:0/1240389205 wait complete. 2024-07-26T13:29:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:57 smithi076 ceph-mon[35401]: pgmap v2530: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.831+0000 7fab72400640 1 Processor -- start 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 -- start start 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 0x7fab6c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 0x7fab6c19c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c109670 0x7fab6c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c113220 con 0x7fab6c1033e0 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1130a0 con 0x7fab6c109670 2024-07-26T13:29:57.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.832+0000 7fab72400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c1133a0 con 0x7fab6c108d20 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 0x7fab6c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 0x7fab6c19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36388/0 (socket says 172.21.15.40:36388) 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 -- 172.21.15.40:0/671714875 learned_addr learned my addr 172.21.15.40:0/671714875 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab6be00640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 0x7fab6c19c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71a00640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c109670 0x7fab6c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 -- 172.21.15.40:0/671714875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 msgr2=0x7fab6c19c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 0x7fab6c19c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 -- 172.21.15.40:0/671714875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c109670 msgr2=0x7fab6c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c109670 0x7fab6c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71000640 1 -- 172.21.15.40:0/671714875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c1a1d60 con 0x7fab6c1033e0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab6be00640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 0x7fab6c19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.833+0000 7fab71a00640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c109670 0x7fab6c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.834+0000 7fab71000640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 0x7fab6c19bdf0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fab6000d950 tx=0x7fab6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.834+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60017070 con 0x7fab6c1033e0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.834+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab60009c30 con 0x7fab6c1033e0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.834+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c1a2050 con 0x7fab6c1033e0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.834+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6000f620 con 0x7fab6c1033e0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.834+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c1a87b0 con 0x7fab6c1033e0 2024-07-26T13:29:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.836+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c1037f0 con 0x7fab6c1033e0 2024-07-26T13:29:57.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.838+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fab60005030 con 0x7fab6c1033e0 2024-07-26T13:29:57.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.840+0000 7fab69600640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab540b3bd0 0x7fab540b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:29:57.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.840+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab600e38b0 con 0x7fab6c1033e0 2024-07-26T13:29:57.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.840+0000 7fab6be00640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab540b3bd0 0x7fab540b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:29:57.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.841+0000 7fab6be00640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab540b3bd0 0x7fab540b60e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fab580058c0 tx=0x7fab58005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:29:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:57.842+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fab600aaec0 con 0x7fab6c1033e0 2024-07-26T13:29:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.090+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab6c19cf20 con 0x7fab6c1033e0 2024-07-26T13:29:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.091+0000 7fab69600640 1 -- 172.21.15.40:0/671714875 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11989 (secure 0 0 0) 0x7fab60009de0 con 0x7fab6c1033e0 2024-07-26T13:29:58.094 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:29:58.094 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2024-07-26T13:29:58.094 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"btime":"2024-07-26T13:29:07:203990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:29:06.454427+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:29:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.094+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab540b3bd0 msgr2=0x7fab540b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.094+0000 7fab72400640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab540b3bd0 0x7fab540b60e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fab580058c0 tx=0x7fab58005850 comp rx=0 tx=0).stop 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.094+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 msgr2=0x7fab6c19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.094+0000 7fab72400640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 0x7fab6c19bdf0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fab6000d950 tx=0x7fab6000de10 comp rx=0 tx=0).stop 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 shutdown_connections 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fab6c109670 0x7fab6c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fab540b3bd0 0x7fab540b60e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6c108d20 0x7fab6c19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 --2- 172.21.15.40:0/671714875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab6c1033e0 0x7fab6c19bdf0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 >> 172.21.15.40:0/671714875 conn(0x7fab6c0fee30 msgr2=0x7fab6c10e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 shutdown_connections 2024-07-26T13:29:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:29:58.095+0000 7fab72400640 1 -- 172.21.15.40:0/671714875 wait complete. 2024-07-26T13:29:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:58 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/671714875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:29:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:58 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/671714875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:29:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:58 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/671714875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:29:58.917 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id b1077a8f --release --await' 2024-07-26T13:29:58.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id b1077a8f --release --await 2024-07-26T13:29:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:29:59.729 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:29:59 smithi040 ceph-mon[32397]: pgmap v2531: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.8 MiB/s wr, 2.27k op/s 2024-07-26T13:29:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:29:59 smithi146 ceph-mon[35807]: pgmap v2531: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.8 MiB/s wr, 2.27k op/s 2024-07-26T13:29:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:29:59 smithi076 ceph-mon[35401]: pgmap v2531: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.8 MiB/s wr, 2.27k op/s 2024-07-26T13:30:00.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:00 smithi040 ceph-mon[32397]: overall HEALTH_OK 2024-07-26T13:30:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:00 smithi146 ceph-mon[35807]: overall HEALTH_OK 2024-07-26T13:30:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:00 smithi076 ceph-mon[35401]: overall HEALTH_OK 2024-07-26T13:30:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:01 smithi146 ceph-mon[35807]: pgmap v2532: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 1.23k op/s 2024-07-26T13:30:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:01 smithi076 ceph-mon[35401]: pgmap v2532: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 1.23k op/s 2024-07-26T13:30:01.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 -- 172.21.15.40:0/2016424979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc076db0 msgr2=0x7faafc0751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:01.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 --2- 172.21.15.40:0/2016424979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc076db0 0x7faafc0751e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7faaec009ca0 tx=0x7faaec02a8c0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:01 smithi040 ceph-mon[32397]: pgmap v2532: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 1.23k op/s 2024-07-26T13:30:01.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 -- 172.21.15.40:0/2016424979 shutdown_connections 2024-07-26T13:30:01.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 --2- 172.21.15.40:0/2016424979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faafc113c90 0x7faafc116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 --2- 172.21.15.40:0/2016424979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc075800 0x7faafc075c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 --2- 172.21.15.40:0/2016424979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc076db0 0x7faafc0751e0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.920+0000 7faafbe00640 1 -- 172.21.15.40:0/2016424979 >> 172.21.15.40:0/2016424979 conn(0x7faafc0fee10 msgr2=0x7faafc101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:01.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.921+0000 7faafbe00640 1 -- 172.21.15.40:0/2016424979 shutdown_connections 2024-07-26T13:30:01.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.921+0000 7faafbe00640 1 -- 172.21.15.40:0/2016424979 wait complete. 2024-07-26T13:30:01.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.922+0000 7faafbe00640 1 Processor -- start 2024-07-26T13:30:01.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 -- start start 2024-07-26T13:30:01.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faafc075800 0x7faafc1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc076db0 0x7faafc1a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 0x7faafc1a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faafc1197d0 con 0x7faafc113c90 2024-07-26T13:30:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faafc119650 con 0x7faafc075800 2024-07-26T13:30:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faafc119950 con 0x7faafc076db0 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 0x7faafc1a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.923+0000 7faafb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 0x7faafc1a5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36400/0 (socket says 172.21.15.40:36400) 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafb400640 1 -- 172.21.15.40:0/3018881364 learned_addr learned my addr 172.21.15.40:0/3018881364 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafaa00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faafc075800 0x7faafc1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafa000640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc076db0 0x7faafc1a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafb400640 1 -- 172.21.15.40:0/3018881364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc076db0 msgr2=0x7faafc1a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafb400640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc076db0 0x7faafc1a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafb400640 1 -- 172.21.15.40:0/3018881364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faafc075800 msgr2=0x7faafc1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafb400640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faafc075800 0x7faafc1a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafb400640 1 -- 172.21.15.40:0/3018881364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc1a6090 con 0x7faafc113c90 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.924+0000 7faafa000640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc076db0 0x7faafc1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.925+0000 7faafb400640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 0x7faafc1a5a20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7faaf400d750 tx=0x7faaf400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.925+0000 7faaf3400640 1 -- 172.21.15.40:0/3018881364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4017070 con 0x7faafc113c90 2024-07-26T13:30:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.925+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc1a6380 con 0x7faafc113c90 2024-07-26T13:30:01.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.925+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc1acba0 con 0x7faafc113c90 2024-07-26T13:30:01.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.925+0000 7faaf3400640 1 -- 172.21.15.40:0/3018881364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaf40054b0 con 0x7faafc113c90 2024-07-26T13:30:01.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.925+0000 7faaf3400640 1 -- 172.21.15.40:0/3018881364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4004b90 con 0x7faafc113c90 2024-07-26T13:30:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.929+0000 7fab085c5740 1 Processor -- start 2024-07-26T13:30:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.929+0000 7faaf3400640 1 -- 172.21.15.40:0/3018881364 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faaf4009bd0 con 0x7faafc113c90 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.929+0000 7fab085c5740 1 -- start start 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.929+0000 7fab085c5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7fab085c5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 0x560cac4c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7fab085c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0fc840 0x560cac4c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7fab085c5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560cac438f30 con 0x560cac0f4660 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7fab085c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560cac428430 con 0x560cac0fc840 2024-07-26T13:30:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7fab085c5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560cac42c470 con 0x560cac11d520 2024-07-26T13:30:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 0x560cac4c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 0x560cac4c26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36402/0 (socket says 172.21.15.40:36402) 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafaa00640 1 -- 172.21.15.40:0/3921631399 learned_addr learned my addr 172.21.15.40:0/3921631399 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafa000640 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafa000640 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0fc840 0x560cac4c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafaa00640 1 -- 172.21.15.40:0/3921631399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 msgr2=0x560cac4c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafaa00640 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.930+0000 7faafaa00640 1 -- 172.21.15.40:0/3921631399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0fc840 msgr2=0x560cac4c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faafaa00640 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0fc840 0x560cac4c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faafaa00640 1 -- 172.21.15.40:0/3921631399 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cac188b00 con 0x560cac0f4660 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faafa000640 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0fc840 0x560cac4c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faaf3400640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faae00b3c80 0x7faae00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faafaa00640 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 0x560cac4c26c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7faaec009ca0 tx=0x7faaec031590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87168a2e153bd168 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faaf3400640 1 -- 172.21.15.40:0/3018881364 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faaf40e3550 con 0x7faafc113c90 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faafa000640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faae00b3c80 0x7faae00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.931+0000 7faae7e00640 1 -- 172.21.15.40:0/3921631399 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec031b80 con 0x560cac0f4660 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.932+0000 7faae7e00640 1 -- 172.21.15.40:0/3921631399 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaec036040 con 0x560cac0f4660 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.932+0000 7faae7e00640 1 -- 172.21.15.40:0/3921631399 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec004540 con 0x560cac0f4660 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 -- 172.21.15.40:0/3921631399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 msgr2=0x560cac4c26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 0x560cac4c26c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7faaec009ca0 tx=0x7faaec031590 comp rx=0 tx=0).stop 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7faafa000640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faae00b3c80 0x7faae00b6190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faafc115e40 tx=0x7faae8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 -- 172.21.15.40:0/3921631399 shutdown_connections 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0fc840 0x560cac4c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0f4660 0x560cac4c26c0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 --2- 172.21.15.40:0/3921631399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 -- 172.21.15.40:0/3921631399 >> 172.21.15.40:0/3921631399 conn(0x560cac111910 msgr2=0x560cac4c0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 -- 172.21.15.40:0/3921631399 shutdown_connections 2024-07-26T13:30:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.933+0000 7fab085c5740 1 -- 172.21.15.40:0/3921631399 wait complete. 2024-07-26T13:30:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 -- start start 2024-07-26T13:30:01.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 Processor -- start 2024-07-26T13:30:01.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560cac28bbb0 con 0x560cac0fc840 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560cac3c4910 con 0x560cac0f4660 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.934+0000 7fab085c5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560cac4d0900 con 0x560cac11d520 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7fab085c5740 10 client.0 _ll_register_callbacks cb 0x560cac134d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36406/0 (socket says 172.21.15.40:36406) 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 -- 172.21.15.40:0/510933547 learned_addr learned my addr 172.21.15.40:0/510933547 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafaa00640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafb400640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 -- 172.21.15.40:0/510933547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 msgr2=0x560cac4ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 -- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 msgr2=0x560cac4cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafa000640 1 -- 172.21.15.40:0/510933547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cac1ff960 con 0x560cac0fc840 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.935+0000 7faafaa00640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.936+0000 7faafa000640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4cdd30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7faae8010e00 tx=0x7faae800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a19d43b4350fc0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.936+0000 7faae4c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.936+0000 7faae4c00640 1 -- 172.21.15.40:0/510933547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae801ce10 con 0x560cac0fc840 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.936+0000 7faae4c00640 1 -- 172.21.15.40:0/510933547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faae800b640 con 0x560cac0fc840 2024-07-26T13:30:01.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.936+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaec036040 con 0x560cac0fc840 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.936+0000 7faae4c00640 1 -- 172.21.15.40:0/510933547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7faae8004020 con 0x560cac0fc840 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 10 client.18174 fetch_fsmap learned FSMap version 39 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560cac4dc630 con 0x560cac0fc840 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7faae4c00640 1 -- 172.21.15.40:0/510933547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaec036040 con 0x560cac0fc840 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7faae4c00640 1 -- 172.21.15.40:0/510933547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7faae8018040 con 0x560cac0fc840 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 10 client.18174 fetch_fsmap finished waiting for FSMap version 39 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 10 client.18174 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 20 client.18174 populate_metadata read hostname 'smithi040' 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0dbea0 0x560cac4dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 4 client.18174 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.937+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cac43ae80 con 0x560cac0dbea0 2024-07-26T13:30:01.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.938+0000 7faafaa00640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0dbea0 0x560cac4dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.939+0000 7faafaa00640 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0dbea0 0x560cac4dfd70 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97ad815521588a58 server_cookie=e4a147ca9e5f1cb0 in_seq=0 out_seq=0 2024-07-26T13:30:01.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.939+0000 7faae4c00640 10 client.18174 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:01.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.941+0000 7faae4c00640 1 -- 172.21.15.40:0/510933547 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cac43ae80 con 0x560cac0dbea0 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.941+0000 7faae4c00640 10 client.18174 handle_command_reply: tid=0 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 client.18174 shutdown 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 msgr2=0x560cac4cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4cdd30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7faae8010e00 tx=0x7faae800b460 comp rx=0 tx=0).stop 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 shutdown_connections 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0dbea0 0x560cac4dfd70 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4cdd30 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 --2- 172.21.15.40:0/510933547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 >> 172.21.15.40:0/510933547 conn(0x560cac111910 msgr2=0x560cac4c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7faae4c00640 0 client.18174 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:01.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 shutdown_connections 2024-07-26T13:30:01.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 1 -- 172.21.15.40:0/510933547 wait complete. 2024-07-26T13:30:01.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.942+0000 7fab085c5740 20 client.18174 trim_cache size 0 max 16384 2024-07-26T13:30:01.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.961+0000 7fab085c5740 1 Processor -- start 2024-07-26T13:30:01.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.961+0000 7fab085c5740 1 -- start start 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7fab085c5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac0f4660 0x560cac4d9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7fab085c5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7fab085c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac11d520 0x560cac4bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7fab085c5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faadc00e4c0 con 0x560cac0fc840 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7fab085c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faadc010180 con 0x560cac11d520 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7fab085c5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faadc00eb90 con 0x560cac0f4660 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7faafa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7faafa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36410/0 (socket says 172.21.15.40:36410) 2024-07-26T13:30:01.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.962+0000 7faafa000640 1 -- 172.21.15.40:0/1911207856 learned_addr learned my addr 172.21.15.40:0/1911207856 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:01.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafb400640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac11d520 0x560cac4bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafa000640 1 -- 172.21.15.40:0/1911207856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac0f4660 msgr2=0x560cac4d9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafaa00640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac0f4660 0x560cac4d9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafa000640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac0f4660 0x560cac4d9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafa000640 1 -- 172.21.15.40:0/1911207856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac11d520 msgr2=0x560cac4bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafa000640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac11d520 0x560cac4bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafa000640 1 -- 172.21.15.40:0/1911207856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cac4dc460 con 0x560cac0fc840 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafb400640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac11d520 0x560cac4bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafaa00640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac0f4660 0x560cac4d9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.963+0000 7faafa000640 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d96b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7faae801afd0 tx=0x7faae800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b4fa37a25e88b6 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.964+0000 7faae7400640 1 -- 172.21.15.40:0/1911207856 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8033030 con 0x560cac0fc840 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.964+0000 7faae7400640 1 -- 172.21.15.40:0/1911207856 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae8003a60 con 0x560cac0fc840 2024-07-26T13:30:01.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.964+0000 7faae7400640 1 -- 172.21.15.40:0/1911207856 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae801abc0 con 0x560cac0fc840 2024-07-26T13:30:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 -- 172.21.15.40:0/1911207856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 msgr2=0x560cac4d96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d96b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7faae801afd0 tx=0x7faae800b7d0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 -- 172.21.15.40:0/1911207856 shutdown_connections 2024-07-26T13:30:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac11d520 0x560cac4bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d96b0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 --2- 172.21.15.40:0/1911207856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac0f4660 0x560cac4d9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 -- 172.21.15.40:0/1911207856 >> 172.21.15.40:0/1911207856 conn(0x560cac111910 msgr2=0x560cac4d8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 -- 172.21.15.40:0/1911207856 shutdown_connections 2024-07-26T13:30:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 -- 172.21.15.40:0/1911207856 wait complete. 2024-07-26T13:30:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.965+0000 7fab085c5740 1 -- start start 2024-07-26T13:30:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 Processor -- start 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faadc00f9f0 con 0x560cac0fc840 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faadc00f260 con 0x560cac0f4660 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faadc00c480 con 0x560cac11d520 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.966+0000 7fab085c5740 10 client.0 _ll_register_callbacks cb 0x7faae800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36412/0 (socket says 172.21.15.40:36412) 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 -- 172.21.15.40:0/783727393 learned_addr learned my addr 172.21.15.40:0/783727393 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafaa00640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafb400640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 -- 172.21.15.40:0/783727393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 msgr2=0x560cac4d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 -- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 msgr2=0x560cac4d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 -- 172.21.15.40:0/783727393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cac547550 con 0x560cac0fc840 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafb400640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faafa000640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d2030 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7faae8003640 tx=0x7faae8005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b630d8d9a97d8c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.967+0000 7faae4c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.968+0000 7faae4c00640 1 -- 172.21.15.40:0/783727393 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8033070 con 0x560cac0fc840 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.968+0000 7faae4c00640 1 -- 172.21.15.40:0/783727393 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faae801ad50 con 0x560cac0fc840 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.968+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae8003a60 con 0x560cac0fc840 2024-07-26T13:30:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.968+0000 7faae4c00640 1 -- 172.21.15.40:0/783727393 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7faae8040420 con 0x560cac0fc840 2024-07-26T13:30:01.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.968+0000 7fab085c5740 10 client.18180 fetch_fsmap learned FSMap version 39 2024-07-26T13:30:01.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.968+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560cac5486f0 con 0x560cac0fc840 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7faae4c00640 1 -- 172.21.15.40:0/783727393 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae8003a60 con 0x560cac0fc840 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7faae4c00640 1 -- 172.21.15.40:0/783727393 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7faae8018040 con 0x560cac0fc840 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7fab085c5740 10 client.18180 fetch_fsmap finished waiting for FSMap version 39 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7fab085c5740 10 client.18180 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7fab085c5740 20 client.18180 populate_metadata read hostname 'smithi040' 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7fab085c5740 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0b1250 0x560cac54ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7fab085c5740 4 client.18180 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b1077a8f", "release": true, "await": true}] 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.969+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b1077a8f", "release": true, "await": true}) -- 0x560cac436920 con 0x560cac0b1250 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.970+0000 7faafaa00640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0b1250 0x560cac54ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.971+0000 7faafaa00640 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0b1250 0x560cac54ae20 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae353850973638a7 server_cookie=eb66a87713e55aff in_seq=0 out_seq=0 2024-07-26T13:30:01.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:01.971+0000 7faae4c00640 10 client.18180 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.041+0000 7faae4c00640 1 -- 172.21.15.40:0/783727393 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x560cac436920 con 0x560cac0b1250 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.041+0000 7faae4c00640 10 client.18180 handle_command_reply: tid=0 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.041+0000 7fab085c5740 1 client.18180 shutdown 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 msgr2=0x560cac4d2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d2030 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7faae8003640 tx=0x7faae8005470 comp rx=0 tx=0).stop 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 shutdown_connections 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560cac11d520 0x560cac4d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x560cac0b1250 0x560cac54ae20 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x560cac0fc840 0x560cac4d2030 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 --2- 172.21.15.40:0/783727393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560cac0f4660 0x560cac4d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7faae4c00640 0 client.18180 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 >> 172.21.15.40:0/783727393 conn(0x560cac111910 msgr2=0x560cac4d9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 39, 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:30:02.045 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 228, 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "b1077a8f": { 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 228, 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.1, 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:30:02.046 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:02.047 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 shutdown_connections 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.042+0000 7fab085c5740 1 -- 172.21.15.40:0/783727393 wait complete. 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.043+0000 7fab085c5740 20 client.18180 trim_cache size 0 max 16384 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.043+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faae00b3c80 msgr2=0x7faae00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.043+0000 7faafbe00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faae00b3c80 0x7faae00b6190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faafc115e40 tx=0x7faae8005f90 comp rx=0 tx=0).stop 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.043+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 msgr2=0x7faafc1a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.043+0000 7faafbe00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 0x7faafc1a5a20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7faaf400d750 tx=0x7faaf400dc10 comp rx=0 tx=0).stop 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.045+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 shutdown_connections 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.045+0000 7faafbe00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faafc113c90 0x7faafc1a5a20 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.045+0000 7faafbe00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7faae00b3c80 0x7faae00b6190 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.045+0000 7faafbe00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faafc076db0 0x7faafc1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.045+0000 7faafbe00640 1 --2- 172.21.15.40:0/3018881364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faafc075800 0x7faafc1a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.045+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 >> 172.21.15.40:0/3018881364 conn(0x7faafc0fee10 msgr2=0x7faafc10fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.046+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 shutdown_connections 2024-07-26T13:30:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:02.046+0000 7faafbe00640 1 -- 172.21.15.40:0/3018881364 wait complete. 2024-07-26T13:30:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:02 smithi146 ceph-mon[35807]: pgmap v2533: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 852 op/s 2024-07-26T13:30:02.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:02 smithi040 ceph-mon[32397]: pgmap v2533: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 852 op/s 2024-07-26T13:30:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:02 smithi076 ceph-mon[35401]: pgmap v2533: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 852 op/s 2024-07-26T13:30:03.014 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b1077a8f', total seconds elapsed: 26.2 2024-07-26T13:30:03.014 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.05 2024-07-26T13:30:03.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:30:03.857 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:30:05.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:05 smithi040 ceph-mon[32397]: pgmap v2534: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 616 op/s 2024-07-26T13:30:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:05 smithi146 ceph-mon[35807]: pgmap v2534: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 616 op/s 2024-07-26T13:30:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:05 smithi076 ceph-mon[35401]: pgmap v2534: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 616 op/s 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.257+0000 7f6d32600640 1 -- 172.21.15.40:0/2625760325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c1055f0 msgr2=0x7f6d2c105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.257+0000 7f6d32600640 1 --2- 172.21.15.40:0/2625760325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c1055f0 0x7f6d2c105a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009900 tx=0x7f6d2002a3f0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.258+0000 7f6d32600640 1 -- 172.21.15.40:0/2625760325 shutdown_connections 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.258+0000 7f6d32600640 1 --2- 172.21.15.40:0/2625760325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10b880 0x7f6d2c1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.258+0000 7f6d32600640 1 --2- 172.21.15.40:0/2625760325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10af30 0x7f6d2c10b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.258+0000 7f6d32600640 1 --2- 172.21.15.40:0/2625760325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c1055f0 0x7f6d2c105a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.258+0000 7f6d32600640 1 -- 172.21.15.40:0/2625760325 >> 172.21.15.40:0/2625760325 conn(0x7f6d2c101060 msgr2=0x7f6d2c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.259+0000 7f6d32600640 1 -- 172.21.15.40:0/2625760325 shutdown_connections 2024-07-26T13:30:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.259+0000 7f6d32600640 1 -- 172.21.15.40:0/2625760325 wait complete. 2024-07-26T13:30:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.264+0000 7f6d32600640 1 Processor -- start 2024-07-26T13:30:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.264+0000 7f6d32600640 1 -- start start 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.265+0000 7f6d32600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10af30 0x7f6d2c10f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.265+0000 7f6d32600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 0x7f6d2c10fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.265+0000 7f6d31200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10af30 0x7f6d2c10f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.265+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 0x7f6d2c10fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.265+0000 7f6d31200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10af30 0x7f6d2c10f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:35098/0 (socket says 172.21.15.40:35098) 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.265+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 0x7f6d2c10fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52026/0 (socket says 172.21.15.40:52026) 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.266+0000 7f6d32600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c110080 0x7f6d2c1a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.266+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c115430 con 0x7f6d2c10b880 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.266+0000 7f6d31200640 1 -- 172.21.15.40:0/2291153779 learned_addr learned my addr 172.21.15.40:0/2291153779 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.266+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1152b0 con 0x7f6d2c110080 2024-07-26T13:30:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.266+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1155b0 con 0x7f6d2c10af30 2024-07-26T13:30:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d2be00640 1 -- 172.21.15.40:0/2291153779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10af30 msgr2=0x7f6d2c10f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d2be00640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10af30 0x7f6d2c10f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d2be00640 1 -- 172.21.15.40:0/2291153779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c110080 msgr2=0x7f6d2c1a1950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-26T13:30:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d2be00640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c110080 0x7f6d2c1a1950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d2be00640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c1a2050 con 0x7f6d2c10b880 2024-07-26T13:30:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d2be00640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 0x7f6d2c10fb40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06b360 tx=0x7f6d1800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.267+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800cd00 con 0x7f6d2c10b880 2024-07-26T13:30:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.268+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d180035f0 con 0x7f6d2c10b880 2024-07-26T13:30:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.268+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c1a2340 con 0x7f6d2c10b880 2024-07-26T13:30:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.268+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1a28a0 con 0x7f6d2c10b880 2024-07-26T13:30:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.268+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18010690 con 0x7f6d2c10b880 2024-07-26T13:30:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.270+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0c0052c0 con 0x7f6d2c10b880 2024-07-26T13:30:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.275+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6d18010830 con 0x7f6d2c10b880 2024-07-26T13:30:06.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.283+0000 7f6d29600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6d140b3d10 0x7f6d140b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:06.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.293+0000 7f6d31200640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6d140b3d10 0x7f6d140b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:06.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.293+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6d180e3c80 con 0x7f6d2c10b880 2024-07-26T13:30:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.295+0000 7f6d31200640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6d140b3d10 0x7f6d140b6220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6d20000c00 tx=0x7f6d20005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.299+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6d180ea080 con 0x7f6d2c10b880 2024-07-26T13:30:06.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.712+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d0c0055b0 con 0x7f6d2c10b880 2024-07-26T13:30:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.713+0000 7f6d29600640 1 -- 172.21.15.40:0/2291153779 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11989 (secure 0 0 0) 0x7f6d180ab290 con 0x7f6d2c10b880 2024-07-26T13:30:06.716 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:30:06.716 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"btime":"2024-07-26T13:29:07:203990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:29:06.454427+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:30:06.716 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2024-07-26T13:30:06.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.717+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6d140b3d10 msgr2=0x7f6d140b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:06.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.717+0000 7f6d32600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6d140b3d10 0x7f6d140b6220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6d20000c00 tx=0x7f6d20005fd0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.717+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 msgr2=0x7f6d2c10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:06.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.717+0000 7f6d32600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 0x7f6d2c10fb40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06b360 tx=0x7f6d1800ee50 comp rx=0 tx=0).stop 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 shutdown_connections 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d2c110080 0x7f6d2c1a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d2c10b880 0x7f6d2c10fb40 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f6d140b3d10 0x7f6d140b6220 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 --2- 172.21.15.40:0/2291153779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d2c10af30 0x7f6d2c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 >> 172.21.15.40:0/2291153779 conn(0x7f6d2c101060 msgr2=0x7f6d2c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 shutdown_connections 2024-07-26T13:30:06.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:06.718+0000 7f6d32600640 1 -- 172.21.15.40:0/2291153779 wait complete. 2024-07-26T13:30:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:07 smithi040 ceph-mon[32397]: pgmap v2535: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 MiB/s wr, 565 op/s 2024-07-26T13:30:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/2291153779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:30:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:07 smithi146 ceph-mon[35807]: pgmap v2535: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 MiB/s wr, 565 op/s 2024-07-26T13:30:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/2291153779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:30:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:07 smithi076 ceph-mon[35401]: pgmap v2535: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 MiB/s wr, 565 op/s 2024-07-26T13:30:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:07 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/2291153779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:30:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 138.05 --await-for 45.0' 2024-07-26T13:30:07.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 138.05 --await-for 45.0 2024-07-26T13:30:08.331 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:30:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:09 smithi040 ceph-mon[32397]: pgmap v2536: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 1.54k op/s 2024-07-26T13:30:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:09 smithi146 ceph-mon[35807]: pgmap v2536: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 1.54k op/s 2024-07-26T13:30:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:09 smithi076 ceph-mon[35401]: pgmap v2536: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 1.54k op/s 2024-07-26T13:30:11.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:11 smithi040 ceph-mon[32397]: pgmap v2537: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 7.4 MiB/s wr, 1.91k op/s 2024-07-26T13:30:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:11 smithi146 ceph-mon[35807]: pgmap v2537: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 7.4 MiB/s wr, 1.91k op/s 2024-07-26T13:30:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:11 smithi076 ceph-mon[35401]: pgmap v2537: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 7.4 MiB/s wr, 1.91k op/s 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.889+0000 7f5636000640 1 -- 172.21.15.40:0/101162888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56301057b0 msgr2=0x7f5630105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.889+0000 7f5636000640 1 --2- 172.21.15.40:0/101162888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56301057b0 0x7f5630105bc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5620009900 tx=0x7f562002a440 comp rx=0 tx=0).stop 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 -- 172.21.15.40:0/101162888 shutdown_connections 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 --2- 172.21.15.40:0/101162888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563010ba40 0x7f5630112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 --2- 172.21.15.40:0/101162888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010b0f0 0x7f563010b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 --2- 172.21.15.40:0/101162888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56301057b0 0x7f5630105bc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 -- 172.21.15.40:0/101162888 >> 172.21.15.40:0/101162888 conn(0x7f5630101200 msgr2=0x7f5630103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 -- 172.21.15.40:0/101162888 shutdown_connections 2024-07-26T13:30:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.890+0000 7f5636000640 1 -- 172.21.15.40:0/101162888 wait complete. 2024-07-26T13:30:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.892+0000 7f5636000640 1 Processor -- start 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.892+0000 7f5636000640 1 -- start start 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.893+0000 7f5636000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56301057b0 0x7f563007b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.893+0000 7f5636000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f563010b0f0 0x7f5630077350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.893+0000 7f5636000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 0x7f5630077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.893+0000 7f5636000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56301155f0 con 0x7f56301057b0 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.893+0000 7f5636000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5630115470 con 0x7f563010ba40 2024-07-26T13:30:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.893+0000 7f5636000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5630115770 con 0x7f563010b0f0 2024-07-26T13:30:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.894+0000 7f562fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 0x7f5630077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.894+0000 7f562fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 0x7f5630077a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:58110/0 (socket says 172.21.15.40:58110) 2024-07-26T13:30:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.894+0000 7f562fe00640 1 -- 172.21.15.40:0/54474872 learned_addr learned my addr 172.21.15.40:0/54474872 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.894+0000 7f562f400640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56301057b0 0x7f563007b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.894+0000 7f562fe00640 1 -- 172.21.15.40:0/54474872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f563010b0f0 msgr2=0x7f5630077350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.895+0000 7f562fe00640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f563010b0f0 0x7f5630077350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.895+0000 7f562fe00640 1 -- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56301057b0 msgr2=0x7f563007b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.895+0000 7f562fe00640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56301057b0 0x7f563007b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.895+0000 7f562fe00640 1 -- 172.21.15.40:0/54474872 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5630073ae0 con 0x7f563010ba40 2024-07-26T13:30:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.895+0000 7f562fe00640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 0x7f5630077a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5628009fd0 tx=0x7f562800b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.896+0000 7f5627e00640 1 -- 172.21.15.40:0/54474872 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628017070 con 0x7f563010ba40 2024-07-26T13:30:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.896+0000 7f5627e00640 1 -- 172.21.15.40:0/54474872 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5628003e00 con 0x7f563010ba40 2024-07-26T13:30:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.896+0000 7f5627e00640 1 -- 172.21.15.40:0/54474872 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628010460 con 0x7f563010ba40 2024-07-26T13:30:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.896+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5630073dd0 con 0x7f563010ba40 2024-07-26T13:30:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.897+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56300742c0 con 0x7f563010ba40 2024-07-26T13:30:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.904+0000 7f5627e00640 1 -- 172.21.15.40:0/54474872 <== mon.2 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5628004140 con 0x7f563010ba40 2024-07-26T13:30:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.906+0000 7f5627e00640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56140b3cd0 0x7f56140b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.906+0000 7f5627e00640 1 -- 172.21.15.40:0/54474872 <== mon.2 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f56280e39e0 con 0x7f563010ba40 2024-07-26T13:30:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.907+0000 7f562f400640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56140b3cd0 0x7f56140b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.911+0000 7f562f400640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56140b3cd0 0x7f56140b61e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f563007adc0 tx=0x7f5620005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:12.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.932+0000 7f563ce06740 1 Processor -- start 2024-07-26T13:30:12.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.933+0000 7f563ce06740 1 -- start start 2024-07-26T13:30:12.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.933+0000 7f563ce06740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d333fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.933+0000 7f563ce06740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f70990 0x55d3d3340420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.934+0000 7f563ce06740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f78b70 0x55d3d3340960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.934+0000 7f563ce06740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55d3d32b4970 con 0x55d3d2f70990 2024-07-26T13:30:12.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.934+0000 7f563ce06740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d3d32a3e70 con 0x55d3d2f78b70 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.934+0000 7f563ce06740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d3d32a7eb0 con 0x55d3d2f99850 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.934+0000 7f562f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d333fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.934+0000 7f562f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d333fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:32984/0 (socket says 172.21.15.40:32984) 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.935+0000 7f562f400640 1 -- 172.21.15.40:0/3301696232 learned_addr learned my addr 172.21.15.40:0/3301696232 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.935+0000 7f562ea00640 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f70990 0x55d3d3340420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.935+0000 7f562fe00640 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f78b70 0x55d3d3340960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.935+0000 7f562f400640 1 -- 172.21.15.40:0/3301696232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f78b70 msgr2=0x55d3d3340960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:12.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.935+0000 7f562f400640 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f78b70 0x55d3d3340960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.935+0000 7f562f400640 1 -- 172.21.15.40:0/3301696232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f70990 msgr2=0x55d3d3340420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:12.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.937+0000 7f562f400640 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f70990 0x55d3d3340420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.937+0000 7f562f400640 1 -- 172.21.15.40:0/3301696232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3d322c8e0 con 0x55d3d2f99850 2024-07-26T13:30:12.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.937+0000 7f562f400640 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d333fee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5620032000 tx=0x7f562003d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4318afab0b9c9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:12.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.938+0000 7f561be00640 1 -- 172.21.15.40:0/3301696232 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620004240 con 0x55d3d2f99850 2024-07-26T13:30:12.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.938+0000 7f561be00640 1 -- 172.21.15.40:0/3301696232 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f562004e070 con 0x55d3d2f99850 2024-07-26T13:30:12.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.938+0000 7f561be00640 1 -- 172.21.15.40:0/3301696232 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620003950 con 0x55d3d2f99850 2024-07-26T13:30:12.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 -- 172.21.15.40:0/3301696232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 msgr2=0x55d3d333fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:12.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d333fee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5620032000 tx=0x7f562003d000 comp rx=0 tx=0).stop 2024-07-26T13:30:12.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 -- 172.21.15.40:0/3301696232 shutdown_connections 2024-07-26T13:30:12.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f78b70 0x55d3d3340960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f70990 0x55d3d3340420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 --2- 172.21.15.40:0/3301696232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d333fee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.940+0000 7f563ce06740 1 -- 172.21.15.40:0/3301696232 >> 172.21.15.40:0/3301696232 conn(0x55d3d2f8dc40 msgr2=0x55d3d333ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:12.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.941+0000 7f563ce06740 1 -- 172.21.15.40:0/3301696232 shutdown_connections 2024-07-26T13:30:12.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.941+0000 7f563ce06740 1 -- 172.21.15.40:0/3301696232 wait complete. 2024-07-26T13:30:12.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.942+0000 7f563ce06740 1 -- start start 2024-07-26T13:30:12.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.942+0000 7f563ce06740 1 Processor -- start 2024-07-26T13:30:12.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.946+0000 7f563ce06740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d334ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.947+0000 7f563ce06740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d334bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.947+0000 7f562f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d334ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.947+0000 7f562f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d334ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:58118/0 (socket says 172.21.15.40:58118) 2024-07-26T13:30:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f562ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d334bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f563ce06740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d33579b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f562ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d334bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46564/0 (socket says 172.21.15.40:46564) 2024-07-26T13:30:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f563ce06740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55d3d31077b0 con 0x55d3d2f78b70 2024-07-26T13:30:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f563ce06740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d3d3240420 con 0x55d3d2f70990 2024-07-26T13:30:12.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f563ce06740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d3d334e660 con 0x55d3d2f99850 2024-07-26T13:30:12.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f563ce06740 10 client.0 _ll_register_callbacks cb 0x55d3d2fb10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:30:12.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f562fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d33579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.948+0000 7f562fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d33579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:32996/0 (socket says 172.21.15.40:32996) 2024-07-26T13:30:12.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.949+0000 7f562fe00640 1 -- 172.21.15.40:0/1892469798 learned_addr learned my addr 172.21.15.40:0/1892469798 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:12.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.950+0000 7f562f400640 1 -- 172.21.15.40:0/1892469798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 msgr2=0x55d3d33579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.950+0000 7f562f400640 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d33579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.950+0000 7f562f400640 1 -- 172.21.15.40:0/1892469798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 msgr2=0x55d3d334bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.950+0000 7f562f400640 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d334bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.950+0000 7f562f400640 1 -- 172.21.15.40:0/1892469798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3d3238c50 con 0x55d3d2f70990 2024-07-26T13:30:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.951+0000 7f562ea00640 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d334bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:30:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.952+0000 7f562f400640 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d334ba20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f562002a480 tx=0x7f56200055b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44b2cfe75c4f960 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.952+0000 7f5618c00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:30:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.953+0000 7f5618c00640 1 -- 172.21.15.40:0/1892469798 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620049890 con 0x55d3d2f70990 2024-07-26T13:30:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.954+0000 7f5618c00640 1 -- 172.21.15.40:0/1892469798 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5620049a30 con 0x55d3d2f70990 2024-07-26T13:30:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.954+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562004e070 con 0x55d3d2f70990 2024-07-26T13:30:12.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.956+0000 7f5618c00640 1 -- 172.21.15.40:0/1892469798 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5620049c30 con 0x55d3d2f70990 2024-07-26T13:30:12.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.956+0000 7f563ce06740 10 client.37586 fetch_fsmap learned FSMap version 39 2024-07-26T13:30:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.956+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d3d3013ba0 con 0x55d3d2f70990 2024-07-26T13:30:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.957+0000 7f5618c00640 1 -- 172.21.15.40:0/1892469798 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f562004e070 con 0x55d3d2f70990 2024-07-26T13:30:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.958+0000 7f5618c00640 1 -- 172.21.15.40:0/1892469798 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f5620031440 con 0x55d3d2f70990 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f563ce06740 10 client.37586 fetch_fsmap finished waiting for FSMap version 39 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f563ce06740 10 client.37586 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f563ce06740 20 client.37586 populate_metadata read hostname 'smithi040' 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f563ce06740 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f581d0 0x55d3d335d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f563ce06740 4 client.37586 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3d32b68c0 con 0x55d3d2f581d0 2024-07-26T13:30:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.959+0000 7f562ea00640 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f581d0 0x55d3d335d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.961+0000 7f562ea00640 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f581d0 0x55d3d335d790 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8096c9be550f93e server_cookie=9616c088871be674 in_seq=0 out_seq=0 2024-07-26T13:30:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.961+0000 7f5618c00640 10 client.37586 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.962+0000 7f5618c00640 1 -- 172.21.15.40:0/1892469798 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3d32b68c0 con 0x55d3d2f581d0 2024-07-26T13:30:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.962+0000 7f5618c00640 10 client.37586 handle_command_reply: tid=0 2024-07-26T13:30:12.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.962+0000 7f563ce06740 1 client.37586 shutdown 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.963+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 msgr2=0x55d3d334ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.963+0000 7f563ce06740 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d334ba20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f562002a480 tx=0x7f56200055b0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.963+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 shutdown_connections 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.963+0000 7f563ce06740 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f99850 0x55d3d33579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.963+0000 7f563ce06740 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f581d0 0x55d3d335d790 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f563ce06740 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d334bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f563ce06740 1 --2- 172.21.15.40:0/1892469798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d334ba20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f5618c00640 0 client.37586 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 >> 172.21.15.40:0/1892469798 conn(0x55d3d2f8dc40 msgr2=0x55d3d333c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 shutdown_connections 2024-07-26T13:30:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f563ce06740 1 -- 172.21.15.40:0/1892469798 wait complete. 2024-07-26T13:30:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:12.964+0000 7f563ce06740 20 client.37586 trim_cache size 0 max 16384 2024-07-26T13:30:13.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.001+0000 7f563ce06740 1 Processor -- start 2024-07-26T13:30:13.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 -- start start 2024-07-26T13:30:13.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f581d0 0x55d3d3341620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d3357920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d3357e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56301b3450 con 0x55d3d2f78b70 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f56301c8140 con 0x55d3d2f70990 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.002+0000 7f563ce06740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56301b3b20 con 0x55d3d2f581d0 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.003+0000 7f562ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d3357920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.003+0000 7f562ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d3357920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:58128/0 (socket says 172.21.15.40:58128) 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.003+0000 7f562ea00640 1 -- 172.21.15.40:0/1993997665 learned_addr learned my addr 172.21.15.40:0/1993997665 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.004+0000 7f562fe00640 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d3357e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.004+0000 7f562ea00640 1 -- 172.21.15.40:0/1993997665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f581d0 msgr2=0x55d3d3341620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.004+0000 7f562ea00640 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f581d0 0x55d3d3341620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.004+0000 7f562ea00640 1 -- 172.21.15.40:0/1993997665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 msgr2=0x55d3d3357e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:13.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.005+0000 7f562ea00640 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d3357e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.005+0000 7f562ea00640 1 -- 172.21.15.40:0/1993997665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3d334cae0 con 0x55d3d2f70990 2024-07-26T13:30:13.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.005+0000 7f562fe00640 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d3357e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:30:13.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.008+0000 7f562ea00640 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d3357920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f563006c450 tx=0x7f561c00b500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f360496b1f6ac5b5 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:13.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.009+0000 7f561b400640 1 -- 172.21.15.40:0/1993997665 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c011440 con 0x55d3d2f70990 2024-07-26T13:30:13.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.009+0000 7f561b400640 1 -- 172.21.15.40:0/1993997665 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f561c01f070 con 0x55d3d2f70990 2024-07-26T13:30:13.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.011+0000 7f563ce06740 1 -- 172.21.15.40:0/1993997665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 msgr2=0x55d3d3357920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:13.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.011+0000 7f563ce06740 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d3357920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f563006c450 tx=0x7f561c00b500 comp rx=0 tx=0).stop 2024-07-26T13:30:13.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.013+0000 7f563ce06740 1 -- 172.21.15.40:0/1993997665 shutdown_connections 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.014+0000 7f563ce06740 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d3357e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.014+0000 7f563ce06740 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f70990 0x55d3d3357920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.014+0000 7f563ce06740 1 --2- 172.21.15.40:0/1993997665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f581d0 0x55d3d3341620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.014+0000 7f563ce06740 1 -- 172.21.15.40:0/1993997665 >> 172.21.15.40:0/1993997665 conn(0x55d3d2f8dc40 msgr2=0x55d3d3340f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.014+0000 7f563ce06740 1 -- 172.21.15.40:0/1993997665 shutdown_connections 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.015+0000 7f563ce06740 1 -- 172.21.15.40:0/1993997665 wait complete. 2024-07-26T13:30:13.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.015+0000 7f563ce06740 1 -- start start 2024-07-26T13:30:13.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.016+0000 7f563ce06740 1 Processor -- start 2024-07-26T13:30:13.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.017+0000 7f563ce06740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 0x55d3d335e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.017+0000 7f563ce06740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f70990 0x55d3d335ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.017+0000 7f563ce06740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d33c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f562f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 0x55d3d335e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f562f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 0x55d3d335e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:58138/0 (socket says 172.21.15.40:58138) 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f562ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f70990 0x55d3d335ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f562ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f70990 0x55d3d335ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:33010/0 (socket says 172.21.15.40:33010) 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f562f400640 1 -- 172.21.15.40:0/1732612110 learned_addr learned my addr 172.21.15.40:0/1732612110 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56301c79b0 con 0x55d3d2f78b70 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f56301c7300 con 0x55d3d2f581d0 2024-07-26T13:30:13.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.018+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56301b1410 con 0x55d3d2f70990 2024-07-26T13:30:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.019+0000 7f563ce06740 10 client.0 _ll_register_callbacks cb 0x7f5620009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:30:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.019+0000 7f562f400640 1 -- 172.21.15.40:0/1732612110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f70990 msgr2=0x55d3d335ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.019+0000 7f562f400640 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f70990 0x55d3d335ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.019+0000 7f562f400640 1 -- 172.21.15.40:0/1732612110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 msgr2=0x55d3d33c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.019+0000 7f562f400640 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d33c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.020+0000 7f562f400640 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3d335f6a0 con 0x55d3d2f581d0 2024-07-26T13:30:13.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.020+0000 7f562f400640 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 0x55d3d335e940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5620031830 tx=0x7f5620004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f253eb16fda4b97 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:13.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.020+0000 7f5618c00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:30:13.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.022+0000 7f5618c00640 1 -- 172.21.15.40:0/1732612110 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562006b030 con 0x55d3d2f581d0 2024-07-26T13:30:13.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.022+0000 7f5618c00640 1 -- 172.21.15.40:0/1732612110 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5620031a20 con 0x55d3d2f581d0 2024-07-26T13:30:13.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.023+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f561c01f070 con 0x55d3d2f581d0 2024-07-26T13:30:13.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.024+0000 7f5618c00640 1 -- 172.21.15.40:0/1732612110 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5620040070 con 0x55d3d2f581d0 2024-07-26T13:30:13.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.025+0000 7f563ce06740 10 client.37592 fetch_fsmap learned FSMap version 39 2024-07-26T13:30:13.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.025+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d3d33c6190 con 0x55d3d2f581d0 2024-07-26T13:30:13.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.025+0000 7f5618c00640 1 -- 172.21.15.40:0/1732612110 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f561c01f070 con 0x55d3d2f581d0 2024-07-26T13:30:13.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f5618c00640 1 -- 172.21.15.40:0/1732612110 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f562005d850 con 0x55d3d2f581d0 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f563ce06740 10 client.37592 fetch_fsmap finished waiting for FSMap version 39 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f563ce06740 10 client.37592 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f563ce06740 20 client.37592 populate_metadata read hostname 'smithi040' 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f563ce06740 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f99850 0x55d3d33c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f563ce06740 4 client.37592 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.05, "await_for": 45.0}] 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.026+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.05, "await_for": 45.0}) -- 0x55d3d32b2360 con 0x55d3d2f99850 2024-07-26T13:30:13.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.027+0000 7f562ea00640 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f99850 0x55d3d33c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:13.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.028+0000 7f562ea00640 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f99850 0x55d3d33c8aa0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdf880b513b4e505 server_cookie=55f43d42d3f45d22 in_seq=0 out_seq=0 2024-07-26T13:30:13.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.028+0000 7f5618c00640 10 client.37592 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.244+0000 7f5618c00640 1 -- 172.21.15.40:0/1732612110 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55d3d32b2360 con 0x55d3d2f99850 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.244+0000 7f5618c00640 10 client.37592 handle_command_reply: tid=0 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.244+0000 7f563ce06740 1 client.37592 shutdown 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.244+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 msgr2=0x55d3d335e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.244+0000 7f563ce06740 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 0x55d3d335e940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5620031830 tx=0x7f5620004ad0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 shutdown_connections 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55d3d2f99850 0x55d3d33c8aa0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d3d2f78b70 0x55d3d33c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d3d2f70990 0x55d3d335ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 --2- 172.21.15.40:0/1732612110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d3d2f581d0 0x55d3d335e940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f5618c00640 0 client.37592 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:13.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 >> 172.21.15.40:0/1732612110 conn(0x55d3d2f8dc40 msgr2=0x55d3d33417e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 shutdown_connections 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 1 -- 172.21.15.40:0/1732612110 wait complete. 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.245+0000 7f563ce06740 20 client.37592 trim_cache size 0 max 16384 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 39, 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 230, 2024-07-26T13:30:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "e9f203d7": { 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 230, 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.1, 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:30:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:13.250 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56140b3cd0 msgr2=0x7f56140b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56140b3cd0 0x7f56140b61e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f563007adc0 tx=0x7f5620005fd0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 msgr2=0x7f5630077a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 0x7f5630077a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5628009fd0 tx=0x7f562800b260 comp rx=0 tx=0).stop 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 shutdown_connections 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f563010ba40 0x7f5630077a70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f56140b3cd0 0x7f56140b61e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f563010b0f0 0x7f5630077350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 --2- 172.21.15.40:0/54474872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56301057b0 0x7f563007b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 >> 172.21.15.40:0/54474872 conn(0x7f5630101200 msgr2=0x7f5630103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 shutdown_connections 2024-07-26T13:30:13.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:13.246+0000 7f5636000640 1 -- 172.21.15.40:0/54474872 wait complete. 2024-07-26T13:30:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:13 smithi146 ceph-mon[35807]: pgmap v2538: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.4 MiB/s wr, 2.40k op/s 2024-07-26T13:30:13.575 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:13 smithi040 ceph-mon[32397]: pgmap v2538: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.4 MiB/s wr, 2.40k op/s 2024-07-26T13:30:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:13 smithi076 ceph-mon[35401]: pgmap v2538: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 9.4 MiB/s wr, 2.40k op/s 2024-07-26T13:30:14.111 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e9f203d7', quiesce took 11.1 seconds. Will release after: 6.950000000000001 2024-07-26T13:30:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:15 smithi040 ceph-mon[32397]: pgmap v2539: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-07-26T13:30:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:15 smithi146 ceph-mon[35807]: pgmap v2539: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-07-26T13:30:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:15 smithi076 ceph-mon[35401]: pgmap v2539: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 3.50k op/s 2024-07-26T13:30:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:17 smithi146 ceph-mon[35807]: pgmap v2540: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.63k op/s 2024-07-26T13:30:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:17 smithi076 ceph-mon[35401]: pgmap v2540: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.63k op/s 2024-07-26T13:30:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:17 smithi040 ceph-mon[32397]: pgmap v2540: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 3.63k op/s 2024-07-26T13:30:19.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:19 smithi040 ceph-mon[32397]: pgmap v2541: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-07-26T13:30:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:19 smithi146 ceph-mon[35807]: pgmap v2541: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-07-26T13:30:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:19 smithi076 ceph-mon[35401]: pgmap v2541: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 3.40k op/s 2024-07-26T13:30:21.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:30:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:21 smithi040 ceph-mon[32397]: pgmap v2542: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 2.42k op/s 2024-07-26T13:30:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:21 smithi146 ceph-mon[35807]: pgmap v2542: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 2.42k op/s 2024-07-26T13:30:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:30:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:21 smithi076 ceph-mon[35401]: pgmap v2542: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 2.42k op/s 2024-07-26T13:30:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:23 smithi146 ceph-mon[35807]: pgmap v2543: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 2.05k op/s 2024-07-26T13:30:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:30:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:23 smithi076 ceph-mon[35401]: pgmap v2543: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 2.05k op/s 2024-07-26T13:30:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:30:23.590 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:23 smithi040 ceph-mon[32397]: pgmap v2543: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 2.05k op/s 2024-07-26T13:30:23.590 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:30:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 -- 172.21.15.40:0/2388096442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 msgr2=0x7fa968112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 --2- 172.21.15.40:0/2388096442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa968112030 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa960009ca0 tx=0x7fa96002a950 comp rx=0 tx=0).stop 2024-07-26T13:30:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 -- 172.21.15.40:0/2388096442 shutdown_connections 2024-07-26T13:30:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 --2- 172.21.15.40:0/2388096442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa968112030 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 --2- 172.21.15.40:0/2388096442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9681029b0 0x7fa96810f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 --2- 172.21.15.40:0/2388096442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa968102060 0x7fa968102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 -- 172.21.15.40:0/2388096442 >> 172.21.15.40:0/2388096442 conn(0x7fa968079160 msgr2=0x7fa968079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 -- 172.21.15.40:0/2388096442 shutdown_connections 2024-07-26T13:30:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.844+0000 7fa96e200640 1 -- 172.21.15.40:0/2388096442 wait complete. 2024-07-26T13:30:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 Processor -- start 2024-07-26T13:30:23.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 -- start start 2024-07-26T13:30:23.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa968102060 0x7fa96819bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:23.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9681029b0 0x7fa96819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa9681a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa968115500 con 0x7fa96810fc10 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa968115380 con 0x7fa968102060 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.846+0000 7fa96e200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa968115680 con 0x7fa9681029b0 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.847+0000 7fa967e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa9681a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.847+0000 7fa967e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa9681a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35416/0 (socket says 172.21.15.40:35416) 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.847+0000 7fa967e00640 1 -- 172.21.15.40:0/431612489 learned_addr learned my addr 172.21.15.40:0/431612489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:23.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.847+0000 7fa967400640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa968102060 0x7fa96819bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.847+0000 7fa966a00640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9681029b0 0x7fa96819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa967e00640 1 -- 172.21.15.40:0/431612489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9681029b0 msgr2=0x7fa96819c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa967e00640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9681029b0 0x7fa96819c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa967e00640 1 -- 172.21.15.40:0/431612489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa968102060 msgr2=0x7fa96819bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa967e00640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa968102060 0x7fa96819bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa967e00640 1 -- 172.21.15.40:0/431612489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681a1e00 con 0x7fa96810fc10 2024-07-26T13:30:23.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa967e00640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa9681a1790 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa96002ae70 tx=0x7fa960003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:23.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.848+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960034040 con 0x7fa96810fc10 2024-07-26T13:30:23.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.849+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa960030850 con 0x7fa96810fc10 2024-07-26T13:30:23.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.849+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960004670 con 0x7fa96810fc10 2024-07-26T13:30:23.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.849+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9681a2090 con 0x7fa96810fc10 2024-07-26T13:30:23.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.849+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9681a2520 con 0x7fa96810fc10 2024-07-26T13:30:23.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.850+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa968102470 con 0x7fa96810fc10 2024-07-26T13:30:23.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.853+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa960037020 con 0x7fa96810fc10 2024-07-26T13:30:23.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.855+0000 7fa95fe00640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa94c0b3c00 0x7fa94c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:23.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.855+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa960105250 con 0x7fa96810fc10 2024-07-26T13:30:23.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.855+0000 7fa967400640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa94c0b3c00 0x7fa94c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:23.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.856+0000 7fa967400640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa94c0b3c00 0x7fa94c0b6110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa95800bbe0 tx=0x7fa95800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:23.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:23.857+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fa96004a060 con 0x7fa96810fc10 2024-07-26T13:30:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.102+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9681a8a00 con 0x7fa96810fc10 2024-07-26T13:30:24.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.103+0000 7fa95fe00640 1 -- 172.21.15.40:0/431612489 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11989 (secure 0 0 0) 0x7fa9600cc8f0 con 0x7fa96810fc10 2024-07-26T13:30:24.197 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:30:24.198 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"btime":"2024-07-26T13:29:07:203990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:29:06.454427+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa94c0b3c00 msgr2=0x7fa94c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa94c0b3c00 0x7fa94c0b6110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa95800bbe0 tx=0x7fa95800b390 comp rx=0 tx=0).stop 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 msgr2=0x7fa9681a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa9681a1790 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa96002ae70 tx=0x7fa960003f10 comp rx=0 tx=0).stop 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 shutdown_connections 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa96810fc10 0x7fa9681a1790 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fa94c0b3c00 0x7fa94c0b6110 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9681029b0 0x7fa96819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:24.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 --2- 172.21.15.40:0/431612489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa968102060 0x7fa96819bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:24.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 >> 172.21.15.40:0/431612489 conn(0x7fa968079160 msgr2=0x7fa9681086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:24.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.107+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 shutdown_connections 2024-07-26T13:30:24.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:24.108+0000 7fa96e200640 1 -- 172.21.15.40:0/431612489 wait complete. 2024-07-26T13:30:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:30:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:30:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:30:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:24 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/431612489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:30:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:30:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:24 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/431612489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:30:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:24 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/431612489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:30:24.983 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id e9f203d7 --release --await' 2024-07-26T13:30:24.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id e9f203d7 --release --await 2024-07-26T13:30:25.479 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:30:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:25 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:30:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:25 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:30:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:25 smithi040 ceph-mon[32397]: pgmap v2544: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 1.57k op/s 2024-07-26T13:30:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:25 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:30:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:25 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:30:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:25 smithi146 ceph-mon[35807]: pgmap v2544: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 1.57k op/s 2024-07-26T13:30:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:25 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:30:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:25 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:30:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:25 smithi076 ceph-mon[35401]: pgmap v2544: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 1.57k op/s 2024-07-26T13:30:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:27 smithi040 ceph-mon[32397]: pgmap v2545: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.8 MiB/s wr, 460 op/s 2024-07-26T13:30:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:27 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:27 smithi146 ceph-mon[35807]: pgmap v2545: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.8 MiB/s wr, 460 op/s 2024-07-26T13:30:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:27 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:27 smithi076 ceph-mon[35401]: pgmap v2545: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.8 MiB/s wr, 460 op/s 2024-07-26T13:30:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:27 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:27.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 -- 172.21.15.40:0/1734070210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e410f980 msgr2=0x7fc2e4111da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 --2- 172.21.15.40:0/1734070210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e410f980 0x7fc2e4111da0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009900 tx=0x7fc2dc02a410 comp rx=0 tx=0).stop 2024-07-26T13:30:27.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 -- 172.21.15.40:0/1734070210 shutdown_connections 2024-07-26T13:30:27.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 --2- 172.21.15.40:0/1734070210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e410f980 0x7fc2e4111da0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 --2- 172.21.15.40:0/1734070210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e4075ad0 0x7fc2e410f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 --2- 172.21.15.40:0/1734070210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 0x7fc2e4075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 -- 172.21.15.40:0/1734070210 >> 172.21.15.40:0/1734070210 conn(0x7fc2e40fee10 msgr2=0x7fc2e4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:27.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 -- 172.21.15.40:0/1734070210 shutdown_connections 2024-07-26T13:30:27.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.822+0000 7fc2e9400640 1 -- 172.21.15.40:0/1734070210 wait complete. 2024-07-26T13:30:27.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.823+0000 7fc2e9400640 1 Processor -- start 2024-07-26T13:30:27.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.823+0000 7fc2e9400640 1 -- start start 2024-07-26T13:30:27.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 0x7fc2e419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 0x7fc2e419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e410f980 0x7fc2e41a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e9400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4115390 con 0x7fc2e4075ad0 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e9400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4115210 con 0x7fc2e4075180 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e9400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4115510 con 0x7fc2e410f980 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 0x7fc2e419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 0x7fc2e419c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35444/0 (socket says 172.21.15.40:35444) 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.824+0000 7fc2e3400640 1 -- 172.21.15.40:0/482428528 learned_addr learned my addr 172.21.15.40:0/482428528 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 0x7fc2e419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e410f980 0x7fc2e41a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3400640 1 -- 172.21.15.40:0/482428528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e410f980 msgr2=0x7fc2e41a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e410f980 0x7fc2e41a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3400640 1 -- 172.21.15.40:0/482428528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 msgr2=0x7fc2e419be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 0x7fc2e419be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3400640 1 -- 172.21.15.40:0/482428528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e41a1d70 con 0x7fc2e4075ad0 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 0x7fc2e419be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.825+0000 7fc2e3400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 0x7fc2e419c3a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000d740 tx=0x7fc2d000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.826+0000 7fc2e0c00640 1 -- 172.21.15.40:0/482428528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0017070 con 0x7fc2e4075ad0 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.826+0000 7fc2e0c00640 1 -- 172.21.15.40:0/482428528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d000de50 con 0x7fc2e4075ad0 2024-07-26T13:30:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.826+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e41a2060 con 0x7fc2e4075ad0 2024-07-26T13:30:27.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.826+0000 7fc2e0c00640 1 -- 172.21.15.40:0/482428528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000f620 con 0x7fc2e4075ad0 2024-07-26T13:30:27.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.826+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e41a87c0 con 0x7fc2e4075ad0 2024-07-26T13:30:27.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.829+0000 7fc2f1654740 1 Processor -- start 2024-07-26T13:30:27.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 -- start start 2024-07-26T13:30:27.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce64a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce64a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce64ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b6ce5c0f50 con 0x55b6ce27c660 2024-07-26T13:30:27.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b6ce5b0450 con 0x55b6ce284840 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2f1654740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6ce5b4490 con 0x55b6ce2a5520 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.830+0000 7fc2e0c00640 1 -- 172.21.15.40:0/482428528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc2d001a070 con 0x7fc2e4075ad0 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce64a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce64a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35446/0 (socket says 172.21.15.40:35446) 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1408357248 learned_addr learned my addr 172.21.15.40:0/1408357248 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce64a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3400640 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce64ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1408357248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 msgr2=0x55b6ce64a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce64a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1408357248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 msgr2=0x55b6ce64ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce64ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1408357248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ce310b00 con 0x55b6ce27c660 2024-07-26T13:30:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.831+0000 7fc2e3400640 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce64ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:30:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.832+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce64a6e0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40103a0 tx=0x7fc2d4010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a957ba80d811d8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.832+0000 7fc2d9200640 1 -- 172.21.15.40:0/1408357248 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4016070 con 0x55b6ce27c660 2024-07-26T13:30:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.832+0000 7fc2d9200640 1 -- 172.21.15.40:0/1408357248 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d4012ba0 con 0x55b6ce27c660 2024-07-26T13:30:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.832+0000 7fc2d9200640 1 -- 172.21.15.40:0/1408357248 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d401bbf0 con 0x55b6ce27c660 2024-07-26T13:30:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.833+0000 7fc2e0c00640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2c80b3c50 0x7fc2c80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.833+0000 7fc2e0c00640 1 -- 172.21.15.40:0/482428528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc2d00e36a0 con 0x7fc2e4075ad0 2024-07-26T13:30:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.833+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2c80b3c50 0x7fc2c80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.833+0000 7fc2f1654740 1 -- 172.21.15.40:0/1408357248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 msgr2=0x55b6ce64a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.833+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce64a6e0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40103a0 tx=0x7fc2d4010860 comp rx=0 tx=0).stop 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 -- 172.21.15.40:0/1408357248 shutdown_connections 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce64ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce64a6e0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1408357248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce64a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 -- 172.21.15.40:0/1408357248 >> 172.21.15.40:0/1408357248 conn(0x55b6ce299910 msgr2=0x55b6ce648090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 -- 172.21.15.40:0/1408357248 shutdown_connections 2024-07-26T13:30:27.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2f1654740 1 -- 172.21.15.40:0/1408357248 wait complete. 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.834+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2c80b3c50 0x7fc2c80b6160 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005940 tx=0x7fc2dc0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.835+0000 7fc2f1654740 1 -- start start 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.835+0000 7fc2f1654740 1 Processor -- start 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce655d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce656290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55b6ce413bb0 con 0x55b6ce2a5520 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b6ce54c930 con 0x55b6ce284840 2024-07-26T13:30:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b6ce658980 con 0x55b6ce27c660 2024-07-26T13:30:27.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2f1654740 10 client.0 _ll_register_callbacks cb 0x55b6ce2bcd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:30:27.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2e8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce656290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2e8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce656290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35448/0 (socket says 172.21.15.40:35448) 2024-07-26T13:30:27.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2e8a00640 1 -- 172.21.15.40:0/1876759728 learned_addr learned my addr 172.21.15.40:0/1876759728 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:27.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2e3400640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce655d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.836+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2e8a00640 1 -- 172.21.15.40:0/1876759728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 msgr2=0x55b6ce6557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2e8a00640 1 -- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 msgr2=0x55b6ce655d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce655d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2e8a00640 1 -- 172.21.15.40:0/1876759728 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ce387960 con 0x55b6ce2a5520 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce656290 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009900 tx=0x7fc2dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d22e535278e54e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2cd600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.837+0000 7fc2cd600640 1 -- 172.21.15.40:0/1876759728 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc04c030 con 0x55b6ce2a5520 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d4012ba0 con 0x55b6ce2a5520 2024-07-26T13:30:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2cd600640 1 -- 172.21.15.40:0/1876759728 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc2dc0035f0 con 0x55b6ce2a5520 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2cd600640 1 -- 172.21.15.40:0/1876759728 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc2dc035040 con 0x55b6ce2a5520 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2f1654740 10 client.18219 fetch_fsmap learned FSMap version 40 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55b6ce6645f0 con 0x55b6ce2a5520 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2cd600640 1 -- 172.21.15.40:0/1876759728 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d4012ba0 con 0x55b6ce2a5520 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.838+0000 7fc2cd600640 1 -- 172.21.15.40:0/1876759728 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 40) ==== 8390+0+0 (secure 0 0 0) 0x7fc2dc048740 con 0x55b6ce2a5520 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2f1654740 10 client.18219 fetch_fsmap finished waiting for FSMap version 40 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2f1654740 10 client.18219 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2f1654740 20 client.18219 populate_metadata read hostname 'smithi040' 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce263ea0 0x55b6ce667bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2f1654740 4 client.18219 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6ce5c2ea0 con 0x55b6ce263ea0 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.839+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce263ea0 0x55b6ce667bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.840+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce263ea0 0x55b6ce667bf0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14afb3b563c029d6 server_cookie=6277d0afc66dce7a in_seq=0 out_seq=0 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.840+0000 7fc2cd600640 10 client.18219 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.842+0000 7fc2cd600640 1 -- 172.21.15.40:0/1876759728 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6ce5c2ea0 con 0x55b6ce263ea0 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.842+0000 7fc2cd600640 10 client.18219 handle_command_reply: tid=0 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.842+0000 7fc2f1654740 1 client.18219 shutdown 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 msgr2=0x55b6ce656290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce656290 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009900 tx=0x7fc2dc009260 comp rx=0 tx=0).stop 2024-07-26T13:30:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 shutdown_connections 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce263ea0 0x55b6ce667bf0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce656290 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce655d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1876759728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 >> 172.21.15.40:0/1876759728 conn(0x55b6ce299910 msgr2=0x55b6ce64d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2cd600640 0 client.18219 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 shutdown_connections 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 1 -- 172.21.15.40:0/1876759728 wait complete. 2024-07-26T13:30:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.843+0000 7fc2f1654740 20 client.18219 trim_cache size 0 max 16384 2024-07-26T13:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 Processor -- start 2024-07-26T13:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 -- start start 2024-07-26T13:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce66d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce66d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b0e30 con 0x55b6ce2a5520 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b2ac0 con 0x55b6ce284840 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.869+0000 7fc2f1654740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b1500 con 0x55b6ce27c660 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce66d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce66d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35464/0 (socket says 172.21.15.40:35464) 2024-07-26T13:30:27.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 -- 172.21.15.40:0/911544522 learned_addr learned my addr 172.21.15.40:0/911544522 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e3400640 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce66d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 -- 172.21.15.40:0/911544522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 msgr2=0x55b6ce6576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 -- 172.21.15.40:0/911544522 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 msgr2=0x55b6ce66d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce66d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e8a00640 1 -- 172.21.15.40:0/911544522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6ce64ca30 con 0x55b6ce2a5520 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.870+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.871+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce66d930 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc048bd0 tx=0x7fc2dc03c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4f60678b482c5e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.871+0000 7fc2cfe00640 1 -- 172.21.15.40:0/911544522 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc060030 con 0x55b6ce2a5520 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.871+0000 7fc2cfe00640 1 -- 172.21.15.40:0/911544522 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2dc005020 con 0x55b6ce2a5520 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.871+0000 7fc2cfe00640 1 -- 172.21.15.40:0/911544522 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc04c070 con 0x55b6ce2a5520 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 -- 172.21.15.40:0/911544522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 msgr2=0x55b6ce66d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce66d930 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc048bd0 tx=0x7fc2dc03c4a0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 -- 172.21.15.40:0/911544522 shutdown_connections 2024-07-26T13:30:27.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce2a5520 0x55b6ce66d930 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce66d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 --2- 172.21.15.40:0/911544522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce27c660 0x55b6ce6576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.872+0000 7fc2f1654740 1 -- 172.21.15.40:0/911544522 >> 172.21.15.40:0/911544522 conn(0x55b6ce299910 msgr2=0x55b6ce656000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:27.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.873+0000 7fc2f1654740 1 -- 172.21.15.40:0/911544522 shutdown_connections 2024-07-26T13:30:27.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.873+0000 7fc2f1654740 1 -- 172.21.15.40:0/911544522 wait complete. 2024-07-26T13:30:27.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.873+0000 7fc2f1654740 1 -- start start 2024-07-26T13:30:27.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.873+0000 7fc2f1654740 1 Processor -- start 2024-07-26T13:30:27.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce659a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce659f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce65a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b2330 con 0x55b6ce27c660 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41b1bd0 con 0x55b6ce284840 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41aedf0 con 0x55b6ce2a5520 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2f1654740 10 client.0 _ll_register_callbacks cb 0x7fc2dc031870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce659a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce659a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35476/0 (socket says 172.21.15.40:35476) 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.874+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1422607079 learned_addr learned my addr 172.21.15.40:0/1422607079 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3400640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce659f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e8a00640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce65a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1422607079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 msgr2=0x55b6ce65a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce65a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 msgr2=0x55b6ce659f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce659f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3e00640 1 -- 172.21.15.40:0/1422607079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ce6d7bd0 con 0x55b6ce27c660 2024-07-26T13:30:27.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2e3e00640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce659a00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009f50 tx=0x7fc2d401b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab18ed12b687bb8a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.875+0000 7fc2cd600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2cd600640 1 -- 172.21.15.40:0/1422607079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4034060 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2cd600640 1 -- 172.21.15.40:0/1422607079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc2d4003d80 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2dc005020 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2cd600640 1 -- 172.21.15.40:0/1422607079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc2d4016040 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2f1654740 10 client.18225 fetch_fsmap learned FSMap version 40 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55b6ce6d8e50 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.876+0000 7fc2cd600640 1 -- 172.21.15.40:0/1422607079 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2dc005020 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2cd600640 1 -- 172.21.15.40:0/1422607079 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 40) ==== 8390+0+0 (secure 0 0 0) 0x7fc2d4039070 con 0x55b6ce27c660 2024-07-26T13:30:27.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2f1654740 10 client.18225 fetch_fsmap finished waiting for FSMap version 40 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2f1654740 10 client.18225 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2f1654740 20 client.18225 populate_metadata read hostname 'smithi040' 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce239250 0x55b6ce6db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2f1654740 4 client.18225 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e9f203d7", "release": true, "await": true}] 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e9f203d7", "release": true, "await": true}) -- 0x55b6ce5be940 con 0x55b6ce239250 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.877+0000 7fc2e3400640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce239250 0x55b6ce6db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:30:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.879+0000 7fc2e3400640 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce239250 0x55b6ce6db550 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd969db6e049c3a server_cookie=558f1e4977dfbc1b in_seq=0 out_seq=0 2024-07-26T13:30:27.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.879+0000 7fc2cd600640 10 client.18225 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.967+0000 7fc2cd600640 1 -- 172.21.15.40:0/1422607079 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55b6ce5be940 con 0x55b6ce239250 2024-07-26T13:30:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.967+0000 7fc2cd600640 10 client.18225 handle_command_reply: tid=0 2024-07-26T13:30:27.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.967+0000 7fc2f1654740 1 client.18225 shutdown 2024-07-26T13:30:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.967+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 msgr2=0x55b6ce659a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.967+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce659a00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009f50 tx=0x7fc2d401b5f0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 shutdown_connections 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b6ce2a5520 0x55b6ce65a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b6ce284840 0x55b6ce659f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55b6ce239250 0x55b6ce6db550 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2f1654740 1 --2- 172.21.15.40:0/1422607079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b6ce27c660 0x55b6ce659a00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 >> 172.21.15.40:0/1422607079 conn(0x55b6ce299910 msgr2=0x55b6ce656000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.968+0000 7fc2cd600640 0 client.18225 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:30:27.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.969+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 shutdown_connections 2024-07-26T13:30:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.969+0000 7fc2f1654740 1 -- 172.21.15.40:0/1422607079 wait complete. 2024-07-26T13:30:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.969+0000 7fc2f1654740 20 client.18225 trim_cache size 0 max 16384 2024-07-26T13:30:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:30:27.973 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 40, 2024-07-26T13:30:27.973 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:30:27.973 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 232, 2024-07-26T13:30:27.973 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "e9f203d7": { 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 232, 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 138.1, 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:30:27.974 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.970+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2c80b3c50 msgr2=0x7fc2c80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.970+0000 7fc2e9400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2c80b3c50 0x7fc2c80b6160 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005940 tx=0x7fc2dc0058b0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.971+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 msgr2=0x7fc2e419c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.971+0000 7fc2e9400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 0x7fc2e419c3a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000d740 tx=0x7fc2d000dc00 comp rx=0 tx=0).stop 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.972+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 shutdown_connections 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.972+0000 7fc2e9400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fc2c80b3c50 0x7fc2c80b6160 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.972+0000 7fc2e9400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e410f980 0x7fc2e41a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.972+0000 7fc2e9400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e4075ad0 0x7fc2e419c3a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.972+0000 7fc2e9400640 1 --2- 172.21.15.40:0/482428528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc2e4075180 0x7fc2e419be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:30:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.972+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 >> 172.21.15.40:0/482428528 conn(0x7fc2e40fee10 msgr2=0x7fc2e4108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:30:27.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.974+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 shutdown_connections 2024-07-26T13:30:27.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:30:27.974+0000 7fc2e9400640 1 -- 172.21.15.40:0/482428528 wait complete. 2024-07-26T13:30:28.966 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e9f203d7', total seconds elapsed: 26.0 2024-07-26T13:30:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:29 smithi146 ceph-mon[35807]: pgmap v2546: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 666 KiB/s wr, 178 op/s 2024-07-26T13:30:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:29 smithi076 ceph-mon[35401]: pgmap v2546: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 666 KiB/s wr, 178 op/s 2024-07-26T13:30:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:29 smithi040 ceph-mon[32397]: pgmap v2546: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 666 KiB/s wr, 178 op/s 2024-07-26T13:30:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:31 smithi146 ceph-mon[35807]: pgmap v2547: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 329 KiB/s wr, 94 op/s 2024-07-26T13:30:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:31 smithi076 ceph-mon[35401]: pgmap v2547: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 329 KiB/s wr, 94 op/s 2024-07-26T13:30:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:31 smithi040 ceph-mon[32397]: pgmap v2547: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 329 KiB/s wr, 94 op/s 2024-07-26T13:30:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:32 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:32 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:32 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:33 smithi076 ceph-mon[35401]: pgmap v2548: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-07-26T13:30:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:33 smithi040 ceph-mon[32397]: pgmap v2548: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-07-26T13:30:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:33 smithi146 ceph-mon[35807]: pgmap v2548: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-07-26T13:30:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:35 smithi040 ceph-mon[32397]: pgmap v2549: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.9 MiB/s wr, 1.52k op/s 2024-07-26T13:30:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:35 smithi146 ceph-mon[35807]: pgmap v2549: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.9 MiB/s wr, 1.52k op/s 2024-07-26T13:30:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:35 smithi076 ceph-mon[35401]: pgmap v2549: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.9 MiB/s wr, 1.52k op/s 2024-07-26T13:30:37.622 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:37 smithi146 ceph-mon[35807]: pgmap v2550: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.0 MiB/s wr, 2.04k op/s 2024-07-26T13:30:37.634 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:37 smithi076 ceph-mon[35401]: pgmap v2550: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.0 MiB/s wr, 2.04k op/s 2024-07-26T13:30:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:37 smithi040 ceph-mon[32397]: pgmap v2550: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.0 MiB/s wr, 2.04k op/s 2024-07-26T13:30:39.482 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:39 smithi146 ceph-mon[35807]: pgmap v2551: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 3.14k op/s 2024-07-26T13:30:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:39 smithi040 ceph-mon[32397]: pgmap v2551: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 3.14k op/s 2024-07-26T13:30:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:39 smithi076 ceph-mon[35401]: pgmap v2551: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 3.14k op/s 2024-07-26T13:30:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:41 smithi040 ceph-mon[32397]: pgmap v2552: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2024-07-26T13:30:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:41 smithi146 ceph-mon[35807]: pgmap v2552: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2024-07-26T13:30:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:41 smithi076 ceph-mon[35401]: pgmap v2552: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2024-07-26T13:30:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:42 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:42 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:42 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:43 smithi040 ceph-mon[32397]: pgmap v2553: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 3.97k op/s 2024-07-26T13:30:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:43 smithi146 ceph-mon[35807]: pgmap v2553: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 3.97k op/s 2024-07-26T13:30:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:43 smithi076 ceph-mon[35401]: pgmap v2553: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 3.97k op/s 2024-07-26T13:30:45.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:45 smithi040 ceph-mon[32397]: pgmap v2554: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.92k op/s 2024-07-26T13:30:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:45 smithi146 ceph-mon[35807]: pgmap v2554: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.92k op/s 2024-07-26T13:30:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:45 smithi076 ceph-mon[35401]: pgmap v2554: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.92k op/s 2024-07-26T13:30:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:47 smithi040 ceph-mon[32397]: pgmap v2555: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-07-26T13:30:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:47 smithi146 ceph-mon[35807]: pgmap v2555: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-07-26T13:30:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:47 smithi076 ceph-mon[35401]: pgmap v2555: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2024-07-26T13:30:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:49 smithi040 ceph-mon[32397]: pgmap v2556: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.90k op/s 2024-07-26T13:30:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:49 smithi146 ceph-mon[35807]: pgmap v2556: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.90k op/s 2024-07-26T13:30:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:49 smithi076 ceph-mon[35401]: pgmap v2556: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.90k op/s 2024-07-26T13:30:51.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:51 smithi040 ceph-mon[32397]: pgmap v2557: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:30:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:51 smithi146 ceph-mon[35807]: pgmap v2557: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:30:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:51 smithi076 ceph-mon[35401]: pgmap v2557: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:30:53.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:53 smithi040 ceph-mon[32397]: pgmap v2558: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-07-26T13:30:53.712 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:53 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:53 smithi146 ceph-mon[35807]: pgmap v2558: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-07-26T13:30:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:53 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:53 smithi076 ceph-mon[35401]: pgmap v2558: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2024-07-26T13:30:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:53 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:30:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:55 smithi040 ceph-mon[32397]: pgmap v2559: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:30:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:55 smithi146 ceph-mon[35807]: pgmap v2559: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:30:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:55 smithi076 ceph-mon[35401]: pgmap v2559: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:30:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:57 smithi040 ceph-mon[32397]: pgmap v2560: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:30:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:57 smithi146 ceph-mon[35807]: pgmap v2560: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:30:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:57 smithi076 ceph-mon[35401]: pgmap v2560: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:30:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:30:59 smithi040 ceph-mon[32397]: pgmap v2561: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.74k op/s 2024-07-26T13:30:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:30:59 smithi146 ceph-mon[35807]: pgmap v2561: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.74k op/s 2024-07-26T13:30:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:30:59 smithi076 ceph-mon[35401]: pgmap v2561: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.74k op/s 2024-07-26T13:31:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:01 smithi040 ceph-mon[32397]: pgmap v2562: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2024-07-26T13:31:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:01 smithi146 ceph-mon[35807]: pgmap v2562: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2024-07-26T13:31:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:01 smithi076 ceph-mon[35401]: pgmap v2562: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2024-07-26T13:31:03.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:03 smithi040 ceph-mon[32397]: pgmap v2563: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:31:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:03 smithi146 ceph-mon[35807]: pgmap v2563: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:31:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:03 smithi076 ceph-mon[35401]: pgmap v2563: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:31:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:05 smithi040 ceph-mon[32397]: pgmap v2564: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.97k op/s 2024-07-26T13:31:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:05 smithi146 ceph-mon[35807]: pgmap v2564: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.97k op/s 2024-07-26T13:31:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:05 smithi076 ceph-mon[35401]: pgmap v2564: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.97k op/s 2024-07-26T13:31:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:07 smithi146 ceph-mon[35807]: pgmap v2565: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:31:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:07 smithi076 ceph-mon[35401]: pgmap v2565: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:31:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:07 smithi040 ceph-mon[32397]: pgmap v2565: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2024-07-26T13:31:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:08 smithi146 ceph-mon[35807]: pgmap v2566: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-07-26T13:31:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:08 smithi076 ceph-mon[35401]: pgmap v2566: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-07-26T13:31:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:08 smithi040 ceph-mon[32397]: pgmap v2566: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-07-26T13:31:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:11 smithi146 ceph-mon[35807]: pgmap v2567: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.09k op/s 2024-07-26T13:31:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:11 smithi076 ceph-mon[35401]: pgmap v2567: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.09k op/s 2024-07-26T13:31:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:11 smithi040 ceph-mon[32397]: pgmap v2567: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.09k op/s 2024-07-26T13:31:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:13 smithi146 ceph-mon[35807]: pgmap v2568: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-07-26T13:31:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:13 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:31:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:13 smithi076 ceph-mon[35401]: pgmap v2568: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-07-26T13:31:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:13 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:31:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:13 smithi040 ceph-mon[32397]: pgmap v2568: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2024-07-26T13:31:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:13 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:31:15.569 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:15 smithi146 ceph-mon[35807]: pgmap v2569: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:31:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:15 smithi076 ceph-mon[35401]: pgmap v2569: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:31:15.743 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:15 smithi040 ceph-mon[32397]: pgmap v2569: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2024-07-26T13:31:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:17 smithi146 ceph-mon[35807]: pgmap v2570: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:31:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:17 smithi076 ceph-mon[35401]: pgmap v2570: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:31:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:17 smithi040 ceph-mon[32397]: pgmap v2570: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:31:19.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:19 smithi040 ceph-mon[32397]: pgmap v2571: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-07-26T13:31:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:19 smithi146 ceph-mon[35807]: pgmap v2571: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-07-26T13:31:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:19 smithi076 ceph-mon[35401]: pgmap v2571: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.75k op/s 2024-07-26T13:31:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:21 smithi146 ceph-mon[35807]: pgmap v2572: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-07-26T13:31:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:21 smithi076 ceph-mon[35401]: pgmap v2572: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-07-26T13:31:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:21 smithi040 ceph-mon[32397]: pgmap v2572: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2024-07-26T13:31:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:23 smithi146 ceph-mon[35807]: pgmap v2573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2024-07-26T13:31:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:23 smithi076 ceph-mon[35401]: pgmap v2573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2024-07-26T13:31:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:23 smithi040 ceph-mon[32397]: pgmap v2573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2024-07-26T13:31:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:31:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:31:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:31:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:25 smithi146 ceph-mon[35807]: pgmap v2574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-07-26T13:31:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:25 smithi076 ceph-mon[35401]: pgmap v2574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-07-26T13:31:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:25.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:25 smithi040 ceph-mon[32397]: pgmap v2574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 4.80k op/s 2024-07-26T13:31:25.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:25.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:27 smithi076 ceph-mon[35401]: pgmap v2575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:31:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:31:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:31:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:27 smithi040 ceph-mon[32397]: pgmap v2575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:31:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:31:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:31:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:27 smithi146 ceph-mon[35807]: pgmap v2575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2024-07-26T13:31:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:31:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:31:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:31:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:29 smithi076 ceph-mon[35401]: pgmap v2576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.69k op/s 2024-07-26T13:31:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:29 smithi040 ceph-mon[32397]: pgmap v2576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.69k op/s 2024-07-26T13:31:29.819 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:29 smithi146 ceph-mon[35807]: pgmap v2576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.69k op/s 2024-07-26T13:31:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:31 smithi040 ceph-mon[32397]: pgmap v2577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 3.98k op/s 2024-07-26T13:31:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:31 smithi146 ceph-mon[35807]: pgmap v2577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 3.98k op/s 2024-07-26T13:31:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:31 smithi076 ceph-mon[35401]: pgmap v2577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 3.98k op/s 2024-07-26T13:31:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:33 smithi040 ceph-mon[32397]: pgmap v2578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-07-26T13:31:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:33 smithi146 ceph-mon[35807]: pgmap v2578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-07-26T13:31:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:33 smithi076 ceph-mon[35401]: pgmap v2578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-07-26T13:31:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:35 smithi040 ceph-mon[32397]: pgmap v2579: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2024-07-26T13:31:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:35 smithi146 ceph-mon[35807]: pgmap v2579: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2024-07-26T13:31:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:35 smithi076 ceph-mon[35401]: pgmap v2579: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2024-07-26T13:31:36.010 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:31:36.010 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.85 2024-07-26T13:31:36.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:31:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:31:37.622 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:37 smithi146 ceph-mon[35807]: pgmap v2580: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-07-26T13:31:37.633 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:37 smithi076 ceph-mon[35401]: pgmap v2580: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-07-26T13:31:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:37 smithi040 ceph-mon[32397]: pgmap v2580: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-07-26T13:31:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:39 smithi040 ceph-mon[32397]: pgmap v2581: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2024-07-26T13:31:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:39 smithi146 ceph-mon[35807]: pgmap v2581: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2024-07-26T13:31:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:39 smithi076 ceph-mon[35401]: pgmap v2581: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2024-07-26T13:31:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:40 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:31:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:40 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:31:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:40 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.171+0000 7fce97c00640 1 -- 172.21.15.40:0/4058411382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 msgr2=0x7fce901044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.171+0000 7fce97c00640 1 --2- 172.21.15.40:0/4058411382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 0x7fce901044d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce88009be0 tx=0x7fce8802a6c0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.173+0000 7fce97c00640 1 -- 172.21.15.40:0/4058411382 shutdown_connections 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.173+0000 7fce97c00640 1 --2- 172.21.15.40:0/4058411382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce901022c0 0x7fce90111f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.173+0000 7fce97c00640 1 --2- 172.21.15.40:0/4058411382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901017d0 0x7fce90101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.173+0000 7fce97c00640 1 --2- 172.21.15.40:0/4058411382 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 0x7fce901044d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.173+0000 7fce97c00640 1 -- 172.21.15.40:0/4058411382 >> 172.21.15.40:0/4058411382 conn(0x7fce90077690 msgr2=0x7fce90077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:41.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.173+0000 7fce97c00640 1 -- 172.21.15.40:0/4058411382 shutdown_connections 2024-07-26T13:31:41.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.175+0000 7fce97c00640 1 -- 172.21.15.40:0/4058411382 wait complete. 2024-07-26T13:31:41.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.178+0000 7fce97c00640 1 Processor -- start 2024-07-26T13:31:41.180 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.178+0000 7fce97c00640 1 -- start start 2024-07-26T13:31:41.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.179+0000 7fce97c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce901017d0 0x7fce90112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:41.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce97c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 0x7fce90110320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:41.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce97c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 0x7fce90110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:41.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce97c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fce90105100 con 0x7fce901017d0 2024-07-26T13:31:41.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce97c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fce90104f80 con 0x7fce901040c0 2024-07-26T13:31:41.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce97c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce90105280 con 0x7fce901022c0 2024-07-26T13:31:41.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce8fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 0x7fce90110320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce8fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 0x7fce90110320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:59156/0 (socket says 172.21.15.40:59156) 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce8fe00640 1 -- 172.21.15.40:0/3927395850 learned_addr learned my addr 172.21.15.40:0/3927395850 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.180+0000 7fce95c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 0x7fce90110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.181+0000 7fce95200640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce901017d0 0x7fce90112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.181+0000 7fce8fe00640 1 -- 172.21.15.40:0/3927395850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 msgr2=0x7fce90110a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.181+0000 7fce8fe00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 0x7fce90110a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.181+0000 7fce8fe00640 1 -- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce901017d0 msgr2=0x7fce90112000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:41.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.181+0000 7fce8fe00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce901017d0 0x7fce90112000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.181+0000 7fce8fe00640 1 -- 172.21.15.40:0/3927395850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce901ac4f0 con 0x7fce901022c0 2024-07-26T13:31:41.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.182+0000 7fce8fe00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 0x7fce90110320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0058c0 tx=0x7fce7c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:41.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.182+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00cd30 con 0x7fce901022c0 2024-07-26T13:31:41.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.182+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce7c0044c0 con 0x7fce901022c0 2024-07-26T13:31:41.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.182+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c010430 con 0x7fce901022c0 2024-07-26T13:31:41.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.182+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce901ac780 con 0x7fce901022c0 2024-07-26T13:31:41.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.183+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce901acc70 con 0x7fce901022c0 2024-07-26T13:31:41.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.185+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce90101be0 con 0x7fce901022c0 2024-07-26T13:31:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.191+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fce7c003710 con 0x7fce901022c0 2024-07-26T13:31:41.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.195+0000 7fce8d600640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fce740b3cd0 0x7fce740b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:41.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.195+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fce7c0e4040 con 0x7fce901022c0 2024-07-26T13:31:41.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.195+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fce7c0ab6e0 con 0x7fce901022c0 2024-07-26T13:31:41.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.195+0000 7fce95200640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fce740b3cd0 0x7fce740b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:41.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.196+0000 7fce95200640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fce740b3cd0 0x7fce740b61e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce88006010 tx=0x7fce88000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:41 smithi040 ceph-mon[32397]: pgmap v2582: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-07-26T13:31:41.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.603+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce9002e0c0 con 0x7fce901022c0 2024-07-26T13:31:41.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.604+0000 7fce8d600640 1 -- 172.21.15.40:0/3927395850 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11976 (secure 0 0 0) 0x7fce7c0aafe0 con 0x7fce901022c0 2024-07-26T13:31:41.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:31:41.608 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":45,"btime":"2024-07-26T13:31:39:374173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:31:39.131232+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:31:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 45 2024-07-26T13:31:41.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.607+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fce740b3cd0 msgr2=0x7fce740b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:41.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.607+0000 7fce97c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fce740b3cd0 0x7fce740b61e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce88006010 tx=0x7fce88000f40 comp rx=0 tx=0).stop 2024-07-26T13:31:41.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.607+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 msgr2=0x7fce90110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:41.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.607+0000 7fce97c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 0x7fce90110320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0058c0 tx=0x7fce7c00ee50 comp rx=0 tx=0).stop 2024-07-26T13:31:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 shutdown_connections 2024-07-26T13:31:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce901040c0 0x7fce90110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fce740b3cd0 0x7fce740b61e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce901022c0 0x7fce90110320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 --2- 172.21.15.40:0/3927395850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce901017d0 0x7fce90112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 >> 172.21.15.40:0/3927395850 conn(0x7fce90077690 msgr2=0x7fce900ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 shutdown_connections 2024-07-26T13:31:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:41.609+0000 7fce97c00640 1 -- 172.21.15.40:0/3927395850 wait complete. 2024-07-26T13:31:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:41 smithi146 ceph-mon[35807]: pgmap v2582: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-07-26T13:31:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:41 smithi076 ceph-mon[35401]: pgmap v2582: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.00k op/s 2024-07-26T13:31:42.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:42 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3927395850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:31:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:42 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3927395850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:31:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:42 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3927395850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:31:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:43 smithi040 ceph-mon[32397]: pgmap v2583: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2024-07-26T13:31:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:43 smithi146 ceph-mon[35807]: pgmap v2583: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2024-07-26T13:31:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:43 smithi076 ceph-mon[35401]: pgmap v2583: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2024-07-26T13:31:44.428 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0' 2024-07-26T13:31:44.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0 2024-07-26T13:31:45.198 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:31:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:45 smithi040 ceph-mon[32397]: pgmap v2584: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-07-26T13:31:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:45 smithi146 ceph-mon[35807]: pgmap v2584: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-07-26T13:31:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:45 smithi076 ceph-mon[35401]: pgmap v2584: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.52k op/s 2024-07-26T13:31:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:47 smithi040 ceph-mon[32397]: pgmap v2585: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-07-26T13:31:47.819 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:47 smithi146 ceph-mon[35807]: pgmap v2585: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-07-26T13:31:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:47 smithi076 ceph-mon[35401]: pgmap v2585: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-07-26T13:31:49.546 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:49 smithi040 ceph-mon[32397]: pgmap v2586: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-07-26T13:31:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:49 smithi146 ceph-mon[35807]: pgmap v2586: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-07-26T13:31:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:49 smithi076 ceph-mon[35401]: pgmap v2586: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-07-26T13:31:51.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.291+0000 7fcd2c200640 1 -- 172.21.15.40:0/3691550477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 msgr2=0x7fcd2410ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.291+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3691550477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd2410ef70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009900 tx=0x7fcd1c02a400 comp rx=0 tx=0).stop 2024-07-26T13:31:51.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.292+0000 7fcd2c200640 1 -- 172.21.15.40:0/3691550477 shutdown_connections 2024-07-26T13:31:51.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.292+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3691550477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd2410ef70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.292+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3691550477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 0x7fcd24108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.292+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3691550477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd241024b0 0x7fcd241028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.292+0000 7fcd2c200640 1 -- 172.21.15.40:0/3691550477 >> 172.21.15.40:0/3691550477 conn(0x7fcd24079190 msgr2=0x7fcd240795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:51.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.293+0000 7fcd2c200640 1 -- 172.21.15.40:0/3691550477 shutdown_connections 2024-07-26T13:31:51.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.293+0000 7fcd2c200640 1 -- 172.21.15.40:0/3691550477 wait complete. 2024-07-26T13:31:51.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.295+0000 7fcd2c200640 1 Processor -- start 2024-07-26T13:31:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.296+0000 7fcd2c200640 1 -- start start 2024-07-26T13:31:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.297+0000 7fcd2c200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd241024b0 0x7fcd2410aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.297+0000 7fcd2c200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 0x7fcd2410b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.297+0000 7fcd2c200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd241a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.297+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd241a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.297+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd241a5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:40736/0 (socket says 172.21.15.40:40736) 2024-07-26T13:31:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.297+0000 7fcd2a200640 1 -- 172.21.15.40:0/3281292788 learned_addr learned my addr 172.21.15.40:0/3281292788 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:31:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.298+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24111180 con 0x7fcd241024b0 2024-07-26T13:31:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.298+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24111000 con 0x7fcd24108740 2024-07-26T13:31:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.298+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24111300 con 0x7fcd24107df0 2024-07-26T13:31:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.298+0000 7fcd28e00640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 0x7fcd2410b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.298+0000 7fcd29800640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd241024b0 0x7fcd2410aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.299+0000 7fcd28e00640 1 -- 172.21.15.40:0/3281292788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 msgr2=0x7fcd241a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.299+0000 7fcd28e00640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd241a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.299+0000 7fcd28e00640 1 -- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd241024b0 msgr2=0x7fcd2410aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.299+0000 7fcd28e00640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd241024b0 0x7fcd2410aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.299+0000 7fcd28e00640 1 -- 172.21.15.40:0/3281292788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd241a6320 con 0x7fcd24107df0 2024-07-26T13:31:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.299+0000 7fcd28e00640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 0x7fcd2410b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005fd0 tx=0x7fcd1000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.300+0000 7fcd22000640 1 -- 172.21.15.40:0/3281292788 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10009c00 con 0x7fcd24107df0 2024-07-26T13:31:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.300+0000 7fcd22000640 1 -- 172.21.15.40:0/3281292788 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd100044c0 con 0x7fcd24107df0 2024-07-26T13:31:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.300+0000 7fcd22000640 1 -- 172.21.15.40:0/3281292788 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003db0 con 0x7fcd24107df0 2024-07-26T13:31:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.300+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd241a6610 con 0x7fcd24107df0 2024-07-26T13:31:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.301+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd241acd90 con 0x7fcd24107df0 2024-07-26T13:31:51.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.307+0000 7fcd22000640 1 -- 172.21.15.40:0/3281292788 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcd10003f50 con 0x7fcd24107df0 2024-07-26T13:31:51.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.310+0000 7fcd22000640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd0c0b3c90 0x7fcd0c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.310+0000 7fcd22000640 1 -- 172.21.15.40:0/3281292788 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd100e36e0 con 0x7fcd24107df0 2024-07-26T13:31:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.310+0000 7fcd29800640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd0c0b3c90 0x7fcd0c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.314+0000 7fcd29800640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd0c0b3c90 0x7fcd0c0b61a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcd2410f4b0 tx=0x7fcd18009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.327+0000 7fcd32e28740 1 Processor -- start 2024-07-26T13:31:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.327+0000 7fcd32e28740 1 -- start start 2024-07-26T13:31:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.328+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a1b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.328+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e39564b990 0x55e395a1b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.328+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a1bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.328+0000 7fcd32e28740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e39598f8a0 con 0x55e39564b990 2024-07-26T13:31:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.328+0000 7fcd32e28740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e39597eda0 con 0x55e395674850 2024-07-26T13:31:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.328+0000 7fcd32e28740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e395982de0 con 0x55e395653b70 2024-07-26T13:31:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd28e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e39564b990 0x55e395a1b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a1bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a1bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41662/0 (socket says 172.21.15.40:41662) 2024-07-26T13:31:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 -- 172.21.15.40:0/2978886883 learned_addr learned my addr 172.21.15.40:0/2978886883 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:31:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 -- 172.21.15.40:0/2978886883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 msgr2=0x55e395a1b2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T13:31:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a1b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 -- 172.21.15.40:0/2978886883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e39564b990 msgr2=0x55e395a1b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e39564b990 0x55e395a1b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.329+0000 7fcd2a200640 1 -- 172.21.15.40:0/2978886883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e395913b70 con 0x55e395653b70 2024-07-26T13:31:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.330+0000 7fcd2a200640 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a1bd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c004260 tx=0x7fcd1c004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92513ca75d87a08c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.331+0000 7fcd16a00640 1 -- 172.21.15.40:0/2978886883 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c035030 con 0x55e395653b70 2024-07-26T13:31:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.331+0000 7fcd16a00640 1 -- 172.21.15.40:0/2978886883 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd1c0054d0 con 0x55e395653b70 2024-07-26T13:31:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.331+0000 7fcd16a00640 1 -- 172.21.15.40:0/2978886883 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0035f0 con 0x55e395653b70 2024-07-26T13:31:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 -- 172.21.15.40:0/2978886883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 msgr2=0x55e395a1bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a1bd20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c004260 tx=0x7fcd1c004290 comp rx=0 tx=0).stop 2024-07-26T13:31:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 -- 172.21.15.40:0/2978886883 shutdown_connections 2024-07-26T13:31:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a1bd20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e39564b990 0x55e395a1b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2978886883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a1b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.333+0000 7fcd32e28740 1 -- 172.21.15.40:0/2978886883 >> 172.21.15.40:0/2978886883 conn(0x55e395668c40 msgr2=0x55e395a19190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:51.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.334+0000 7fcd32e28740 1 -- 172.21.15.40:0/2978886883 shutdown_connections 2024-07-26T13:31:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.334+0000 7fcd32e28740 1 -- 172.21.15.40:0/2978886883 wait complete. 2024-07-26T13:31:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.335+0000 7fcd32e28740 1 -- start start 2024-07-26T13:31:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.336+0000 7fcd32e28740 1 Processor -- start 2024-07-26T13:31:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.336+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e39564b990 0x55e395a26e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.336+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a27350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.337+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a32d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.337+0000 7fcd28e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a27350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.337+0000 7fcd28e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a27350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59590/0 (socket says 172.21.15.40:59590) 2024-07-26T13:31:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.337+0000 7fcd32e28740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55e3957e27b0 con 0x55e395653b70 2024-07-26T13:31:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.337+0000 7fcd32e28740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e39591b380 con 0x55e395674850 2024-07-26T13:31:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.337+0000 7fcd32e28740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e395a29a20 con 0x55e39564b990 2024-07-26T13:31:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.338+0000 7fcd32e28740 10 client.0 _ll_register_callbacks cb 0x55e39592a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:31:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.338+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a32d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.338+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a32d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:40760/0 (socket says 172.21.15.40:40760) 2024-07-26T13:31:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.338+0000 7fcd2a200640 1 -- 172.21.15.40:0/4127652755 learned_addr learned my addr 172.21.15.40:0/4127652755 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:31:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.338+0000 7fcd29800640 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e39564b990 0x55e395a26e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd28e00640 1 -- 172.21.15.40:0/4127652755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e39564b990 msgr2=0x55e395a26e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd28e00640 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e39564b990 0x55e395a26e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd28e00640 1 -- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 msgr2=0x55e395a32d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd28e00640 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a32d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd28e00640 1 -- 172.21.15.40:0/4127652755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3956eeba0 con 0x55e395653b70 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd28e00640 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a27350 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcd100e11e0 tx=0x7fcd10004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25346cfc14ed1e4e server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.339+0000 7fcd0b400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:31:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.342+0000 7fcd0b400640 1 -- 172.21.15.40:0/4127652755 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10020040 con 0x55e395653b70 2024-07-26T13:31:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.342+0000 7fcd0b400640 1 -- 172.21.15.40:0/4127652755 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd100cd0b0 con 0x55e395653b70 2024-07-26T13:31:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.343+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd1c0054d0 con 0x55e395653b70 2024-07-26T13:31:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.343+0000 7fcd0b400640 1 -- 172.21.15.40:0/4127652755 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fcd100c6050 con 0x55e395653b70 2024-07-26T13:31:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.343+0000 7fcd32e28740 10 client.18237 fetch_fsmap learned FSMap version 45 2024-07-26T13:31:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.344+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55e395a359e0 con 0x55e395653b70 2024-07-26T13:31:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.345+0000 7fcd0b400640 1 -- 172.21.15.40:0/4127652755 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd1c0054d0 con 0x55e395653b70 2024-07-26T13:31:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.345+0000 7fcd0b400640 1 -- 172.21.15.40:0/4127652755 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7fcd100a9890 con 0x55e395653b70 2024-07-26T13:31:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.346+0000 7fcd32e28740 10 client.18237 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:31:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.346+0000 7fcd32e28740 10 client.18237 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:31:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.346+0000 7fcd32e28740 20 client.18237 populate_metadata read hostname 'smithi040' 2024-07-26T13:31:51.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.346+0000 7fcd32e28740 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e3956331d0 0x55e395a38f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.346+0000 7fcd32e28740 4 client.18237 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:31:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.346+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3959917f0 con 0x55e3956331d0 2024-07-26T13:31:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.347+0000 7fcd29800640 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e3956331d0 0x55e395a38f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.349+0000 7fcd29800640 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e3956331d0 0x55e395a38f50 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1797d755853d5a4 server_cookie=674a04dc3be3adc9 in_seq=0 out_seq=0 2024-07-26T13:31:51.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.349+0000 7fcd0b400640 10 client.18237 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:31:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.350+0000 7fcd0b400640 1 -- 172.21.15.40:0/4127652755 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3959917f0 con 0x55e3956331d0 2024-07-26T13:31:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.350+0000 7fcd0b400640 10 client.18237 handle_command_reply: tid=0 2024-07-26T13:31:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.350+0000 7fcd32e28740 1 client.18237 shutdown 2024-07-26T13:31:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.351+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 msgr2=0x55e395a27350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.351+0000 7fcd32e28740 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a27350 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcd100e11e0 tx=0x7fcd10004450 comp rx=0 tx=0).stop 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 shutdown_connections 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd32e28740 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e395674850 0x55e395a32d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd32e28740 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e3956331d0 0x55e395a38f50 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd32e28740 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a27350 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd32e28740 1 --2- 172.21.15.40:0/4127652755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e39564b990 0x55e395a26e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 >> 172.21.15.40:0/4127652755 conn(0x55e395668c40 msgr2=0x55e395a1e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.352+0000 7fcd0b400640 0 client.18237 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:31:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.353+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 shutdown_connections 2024-07-26T13:31:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.353+0000 7fcd32e28740 1 -- 172.21.15.40:0/4127652755 wait complete. 2024-07-26T13:31:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.353+0000 7fcd32e28740 20 client.18237 trim_cache size 0 max 16384 2024-07-26T13:31:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.381+0000 7fcd32e28740 1 Processor -- start 2024-07-26T13:31:51.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.381+0000 7fcd32e28740 1 -- start start 2024-07-26T13:31:51.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.381+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a264a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.381+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a20380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.381+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395674850 0x55e395a208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd32e28740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241b5410 con 0x55e395653b70 2024-07-26T13:31:51.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd32e28740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241b6f50 con 0x55e39564b990 2024-07-26T13:31:51.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd32e28740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241b5ae0 con 0x55e395674850 2024-07-26T13:31:51.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd28e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a20380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395674850 0x55e395a208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd29800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395674850 0x55e395a208c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41684/0 (socket says 172.21.15.40:41684) 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.382+0000 7fcd2a200640 1 -- 172.21.15.40:0/1206358161 learned_addr learned my addr 172.21.15.40:0/1206358161 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.383+0000 7fcd29800640 1 -- 172.21.15.40:0/1206358161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395674850 msgr2=0x55e395a208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.383+0000 7fcd29800640 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395674850 0x55e395a208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.383+0000 7fcd29800640 1 -- 172.21.15.40:0/1206358161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 msgr2=0x55e395a20380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.383+0000 7fcd29800640 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a20380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.383+0000 7fcd29800640 1 -- 172.21.15.40:0/1206358161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e395a14ba0 con 0x55e39564b990 2024-07-26T13:31:51.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.387+0000 7fcd29800640 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a264a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55e395a39660 tx=0x7fcd18015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf449a8b6503b2f server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:51.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.390+0000 7fcd16000640 1 -- 172.21.15.40:0/1206358161 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180205c0 con 0x55e39564b990 2024-07-26T13:31:51.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.390+0000 7fcd16000640 1 -- 172.21.15.40:0/1206358161 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd18020bf0 con 0x55e39564b990 2024-07-26T13:31:51.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.390+0000 7fcd16000640 1 -- 172.21.15.40:0/1206358161 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1801ebd0 con 0x55e39564b990 2024-07-26T13:31:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.392+0000 7fcd32e28740 1 -- 172.21.15.40:0/1206358161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 msgr2=0x55e395a264a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.392+0000 7fcd32e28740 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a264a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55e395a39660 tx=0x7fcd18015000 comp rx=0 tx=0).stop 2024-07-26T13:31:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 -- 172.21.15.40:0/1206358161 shutdown_connections 2024-07-26T13:31:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395674850 0x55e395a208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395653b70 0x55e395a20380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 --2- 172.21.15.40:0/1206358161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a264a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 -- 172.21.15.40:0/1206358161 >> 172.21.15.40:0/1206358161 conn(0x55e395668c40 msgr2=0x55e395a28130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 -- 172.21.15.40:0/1206358161 shutdown_connections 2024-07-26T13:31:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.393+0000 7fcd32e28740 1 -- 172.21.15.40:0/1206358161 wait complete. 2024-07-26T13:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.394+0000 7fcd32e28740 1 -- start start 2024-07-26T13:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.394+0000 7fcd32e28740 1 Processor -- start 2024-07-26T13:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.396+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a9efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.396+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a2ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.396+0000 7fcd32e28740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395674850 0x55e395a2f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.397+0000 7fcd32e28740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241b6880 con 0x55e395674850 2024-07-26T13:31:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.397+0000 7fcd32e28740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241b61b0 con 0x55e39564b990 2024-07-26T13:31:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.397+0000 7fcd32e28740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd241b33d0 con 0x55e395653b70 2024-07-26T13:31:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.397+0000 7fcd32e28740 10 client.0 _ll_register_callbacks cb 0x7fcd100aa460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:31:51.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.397+0000 7fcd29800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a9efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.398+0000 7fcd29800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a9efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:40770/0 (socket says 172.21.15.40:40770) 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.398+0000 7fcd29800640 1 -- 172.21.15.40:0/2463134020 learned_addr learned my addr 172.21.15.40:0/2463134020 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.397+0000 7fcd2a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395674850 0x55e395a2f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.398+0000 7fcd29800640 1 -- 172.21.15.40:0/2463134020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 msgr2=0x55e395a2ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.398+0000 7fcd28e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a2ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.399+0000 7fcd29800640 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a2ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.399+0000 7fcd29800640 1 -- 172.21.15.40:0/2463134020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395674850 msgr2=0x55e395a2f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:31:51.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.399+0000 7fcd29800640 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395674850 0x55e395a2f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.399+0000 7fcd29800640 1 -- 172.21.15.40:0/2463134020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e395a327a0 con 0x55e39564b990 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.399+0000 7fcd28e00640 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a2ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd29800640 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a9efb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd18005c40 tx=0x7fcd1801e560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e33a63a68fe2bcd8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd0b400640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd0b400640 1 -- 172.21.15.40:0/2463134020 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180205c0 con 0x55e39564b990 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd0b400640 1 -- 172.21.15.40:0/2463134020 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd18020760 con 0x55e39564b990 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd18020bf0 con 0x55e39564b990 2024-07-26T13:31:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd0b400640 1 -- 172.21.15.40:0/2463134020 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fcd18020960 con 0x55e39564b990 2024-07-26T13:31:51.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd32e28740 10 client.37634 fetch_fsmap learned FSMap version 45 2024-07-26T13:31:51.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.400+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55e395ab2850 con 0x55e39564b990 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.401+0000 7fcd0b400640 1 -- 172.21.15.40:0/2463134020 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd18020bf0 con 0x55e39564b990 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd0b400640 1 -- 172.21.15.40:0/2463134020 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7fcd1801e7d0 con 0x55e39564b990 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd32e28740 10 client.37634 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd32e28740 10 client.37634 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd32e28740 20 client.37634 populate_metadata read hostname 'smithi040' 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e395608580 0x55e395ab4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd32e28740 4 client.37634 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}] 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.402+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}) -- 0x55e39598d290 con 0x55e395608580 2024-07-26T13:31:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.403+0000 7fcd28e00640 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e395608580 0x55e395ab4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:31:51.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.403+0000 7fcd28e00640 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e395608580 0x55e395ab4f70 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37d80d8a3362861e server_cookie=21cd98f5fab5427 in_seq=0 out_seq=0 2024-07-26T13:31:51.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.403+0000 7fcd0b400640 10 client.37634 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:31:51.662 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:51 smithi040 ceph-mon[32397]: pgmap v2587: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 3.71k op/s 2024-07-26T13:31:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.660+0000 7fcd0b400640 1 -- 172.21.15.40:0/2463134020 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x55e39598d290 con 0x55e395608580 2024-07-26T13:31:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.660+0000 7fcd0b400640 10 client.37634 handle_command_reply: tid=0 2024-07-26T13:31:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.660+0000 7fcd32e28740 1 client.37634 shutdown 2024-07-26T13:31:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.660+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 msgr2=0x55e395a9efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.660+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a9efb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd18005c40 tx=0x7fcd1801e560 comp rx=0 tx=0).stop 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 shutdown_connections 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x55e395608580 0x55e395ab4f70 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e395674850 0x55e395a2f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e395653b70 0x55e395a2ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 --2- 172.21.15.40:0/2463134020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e39564b990 0x55e395a9efb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd0b400640 0 client.37634 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 >> 172.21.15.40:0/2463134020 conn(0x55e395668c40 msgr2=0x55e395a17910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 shutdown_connections 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 1 -- 172.21.15.40:0/2463134020 wait complete. 2024-07-26T13:31:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.661+0000 7fcd32e28740 20 client.37634 trim_cache size 0 max 16384 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 45, 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 234, 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "747400df": { 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 234, 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:31:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 147.8, 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:31:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.662+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd0c0b3c90 msgr2=0x7fcd0c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.662+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd0c0b3c90 0x7fcd0c0b61a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcd2410f4b0 tx=0x7fcd18009500 comp rx=0 tx=0).stop 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.662+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 msgr2=0x7fcd2410b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.662+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 0x7fcd2410b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005fd0 tx=0x7fcd1000dde0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 shutdown_connections 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd24108740 0x7fcd241a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcd0c0b3c90 0x7fcd0c0b61a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd24107df0 0x7fcd2410b420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 --2- 172.21.15.40:0/3281292788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd241024b0 0x7fcd2410aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 >> 172.21.15.40:0/3281292788 conn(0x7fcd24079190 msgr2=0x7fcd24103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 shutdown_connections 2024-07-26T13:31:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:31:51.663+0000 7fcd2c200640 1 -- 172.21.15.40:0/3281292788 wait complete. 2024-07-26T13:31:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:51 smithi146 ceph-mon[35807]: pgmap v2587: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 3.71k op/s 2024-07-26T13:31:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:51 smithi076 ceph-mon[35401]: pgmap v2587: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 3.71k op/s 2024-07-26T13:31:52.505 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '747400df', quiesce took 16.5 seconds. Will release after: 11.350000000000001 2024-07-26T13:31:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:53 smithi040 ceph-mon[32397]: pgmap v2588: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-07-26T13:31:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:53 smithi146 ceph-mon[35807]: pgmap v2588: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-07-26T13:31:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:53 smithi076 ceph-mon[35401]: pgmap v2588: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 16 MiB/s wr, 4.01k op/s 2024-07-26T13:31:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:55 smithi040 ceph-mon[32397]: pgmap v2589: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 16 MiB/s wr, 3.97k op/s 2024-07-26T13:31:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:55 smithi146 ceph-mon[35807]: pgmap v2589: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 16 MiB/s wr, 3.97k op/s 2024-07-26T13:31:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:55 smithi076 ceph-mon[35401]: pgmap v2589: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 16 MiB/s wr, 3.97k op/s 2024-07-26T13:31:57.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:57 smithi146 ceph-mon[35807]: pgmap v2590: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 3.12k op/s 2024-07-26T13:31:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:57 smithi076 ceph-mon[35401]: pgmap v2590: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 3.12k op/s 2024-07-26T13:31:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:57 smithi040 ceph-mon[32397]: pgmap v2590: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 3.12k op/s 2024-07-26T13:31:59.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:31:59 smithi040 ceph-mon[32397]: pgmap v2591: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-07-26T13:31:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:31:59 smithi146 ceph-mon[35807]: pgmap v2591: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-07-26T13:31:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:31:59 smithi076 ceph-mon[35401]: pgmap v2591: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-07-26T13:32:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:01 smithi146 ceph-mon[35807]: pgmap v2592: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 1.75k op/s 2024-07-26T13:32:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:01 smithi076 ceph-mon[35401]: pgmap v2592: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 1.75k op/s 2024-07-26T13:32:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:01 smithi040 ceph-mon[32397]: pgmap v2592: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 1.75k op/s 2024-07-26T13:32:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:02 smithi146 ceph-mon[35807]: pgmap v2593: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 1.41k op/s 2024-07-26T13:32:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:02 smithi076 ceph-mon[35401]: pgmap v2593: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 1.41k op/s 2024-07-26T13:32:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:02 smithi040 ceph-mon[32397]: pgmap v2593: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 1.41k op/s 2024-07-26T13:32:03.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:32:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:32:05.389 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:05 smithi040 ceph-mon[32397]: pgmap v2594: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 768 op/s 2024-07-26T13:32:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:05 smithi146 ceph-mon[35807]: pgmap v2594: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 768 op/s 2024-07-26T13:32:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:05 smithi076 ceph-mon[35401]: pgmap v2594: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 768 op/s 2024-07-26T13:32:06.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 -- 172.21.15.40:0/639660782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64481033c0 msgr2=0x7f64481037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:06.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 --2- 172.21.15.40:0/639660782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64481033c0 0x7f64481037d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6438009900 tx=0x7f643802a410 comp rx=0 tx=0).stop 2024-07-26T13:32:06.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 -- 172.21.15.40:0/639660782 shutdown_connections 2024-07-26T13:32:06.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 --2- 172.21.15.40:0/639660782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448109650 0x7f644810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 --2- 172.21.15.40:0/639660782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6448108d00 0x7f6448109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 --2- 172.21.15.40:0/639660782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64481033c0 0x7f64481037d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 -- 172.21.15.40:0/639660782 >> 172.21.15.40:0/639660782 conn(0x7f64480fee10 msgr2=0x7f6448101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 -- 172.21.15.40:0/639660782 shutdown_connections 2024-07-26T13:32:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.648+0000 7f6447e00640 1 -- 172.21.15.40:0/639660782 wait complete. 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.649+0000 7f6447e00640 1 Processor -- start 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.649+0000 7f6447e00640 1 -- start start 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6447e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64481033c0 0x7f6448075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6447e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 0x7f6448075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6447e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6448109650 0x7f6448075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6447e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6448113200 con 0x7f6448108d00 2024-07-26T13:32:06.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6447e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6448113080 con 0x7f6448109650 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6447e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6448113380 con 0x7f64481033c0 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6446000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 0x7f6448075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6446000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 0x7f6448075680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52472/0 (socket says 172.21.15.40:52472) 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.650+0000 7f6446000640 1 -- 172.21.15.40:0/1534120193 learned_addr learned my addr 172.21.15.40:0/1534120193 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446a00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64481033c0 0x7f6448075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6447400640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6448109650 0x7f6448075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446000640 1 -- 172.21.15.40:0/1534120193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64481033c0 msgr2=0x7f6448075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446000640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64481033c0 0x7f6448075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446000640 1 -- 172.21.15.40:0/1534120193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6448109650 msgr2=0x7f6448075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446000640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6448109650 0x7f6448075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446000640 1 -- 172.21.15.40:0/1534120193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64481a7ef0 con 0x7f6448108d00 2024-07-26T13:32:06.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.651+0000 7f6446000640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 0x7f6448075680 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f643400d950 tx=0x7f643400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:06.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.652+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434017070 con 0x7f6448108d00 2024-07-26T13:32:06.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.652+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64481a81e0 con 0x7f6448108d00 2024-07-26T13:32:06.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.652+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6434009c30 con 0x7f6448108d00 2024-07-26T13:32:06.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.652+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64340047a0 con 0x7f6448108d00 2024-07-26T13:32:06.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.652+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64481a8770 con 0x7f6448108d00 2024-07-26T13:32:06.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.653+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64481037d0 con 0x7f6448108d00 2024-07-26T13:32:06.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.657+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6434004020 con 0x7f6448108d00 2024-07-26T13:32:06.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.658+0000 7f644ca00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f642c0b3bd0 0x7f642c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:06.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.658+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f64340e3de0 con 0x7f6448108d00 2024-07-26T13:32:06.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.659+0000 7f6446a00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f642c0b3bd0 0x7f642c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:06.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.660+0000 7f6446a00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f642c0b3bd0 0x7f642c0b60e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6448076b90 tx=0x7f6438000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:06.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.660+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f6434020020 con 0x7f6448108d00 2024-07-26T13:32:06.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.905+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6448076440 con 0x7f6448108d00 2024-07-26T13:32:06.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.907+0000 7f644ca00640 1 -- 172.21.15.40:0/1534120193 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11976 (secure 0 0 0) 0x7f64340ab3f0 con 0x7f6448108d00 2024-07-26T13:32:06.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:32:06.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":45,"btime":"2024-07-26T13:31:39:374173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:31:39.131232+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:32:06.908 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 45 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.909+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f642c0b3bd0 msgr2=0x7f642c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.909+0000 7f6447e00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f642c0b3bd0 0x7f642c0b60e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6448076b90 tx=0x7f6438000bc0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.909+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 msgr2=0x7f6448075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.909+0000 7f6447e00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 0x7f6448075680 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f643400d950 tx=0x7f643400de10 comp rx=0 tx=0).stop 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 shutdown_connections 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6448109650 0x7f6448075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448108d00 0x7f6448075680 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f642c0b3bd0 0x7f642c0b60e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 --2- 172.21.15.40:0/1534120193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64481033c0 0x7f6448075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 >> 172.21.15.40:0/1534120193 conn(0x7f64480fee10 msgr2=0x7f6448101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 shutdown_connections 2024-07-26T13:32:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:06.910+0000 7f6447e00640 1 -- 172.21.15.40:0/1534120193 wait complete. 2024-07-26T13:32:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:07 smithi040 ceph-mon[32397]: pgmap v2595: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 392 KiB/s wr, 107 op/s 2024-07-26T13:32:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:07 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1534120193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:07 smithi146 ceph-mon[35807]: pgmap v2595: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 392 KiB/s wr, 107 op/s 2024-07-26T13:32:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:07 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1534120193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:07 smithi076 ceph-mon[35401]: pgmap v2595: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 392 KiB/s wr, 107 op/s 2024-07-26T13:32:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:07 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1534120193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:07.617 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id 747400df --release --await' 2024-07-26T13:32:07.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id 747400df --release --await 2024-07-26T13:32:08.119 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:32:09.309 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:09 smithi040 ceph-mon[32397]: pgmap v2596: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 86 KiB/s wr, 32 op/s 2024-07-26T13:32:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:09 smithi146 ceph-mon[35807]: pgmap v2596: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 86 KiB/s wr, 32 op/s 2024-07-26T13:32:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:09 smithi076 ceph-mon[35401]: pgmap v2596: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 86 KiB/s wr, 32 op/s 2024-07-26T13:32:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.194+0000 7fd714800640 1 -- 172.21.15.40:0/1252402823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c10fe70 msgr2=0x7fd70c1166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.194+0000 7fd714800640 1 --2- 172.21.15.40:0/1252402823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c10fe70 0x7fd70c1166a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fd708009ca0 tx=0x7fd70802a8c0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 -- 172.21.15.40:0/1252402823 shutdown_connections 2024-07-26T13:32:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 --2- 172.21.15.40:0/1252402823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c10fe70 0x7fd70c1166a0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 --2- 172.21.15.40:0/1252402823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd70c10f520 0x7fd70c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 --2- 172.21.15.40:0/1252402823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd70c109be0 0x7fd70c109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 -- 172.21.15.40:0/1252402823 >> 172.21.15.40:0/1252402823 conn(0x7fd70c077b10 msgr2=0x7fd70c107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:10.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 -- 172.21.15.40:0/1252402823 shutdown_connections 2024-07-26T13:32:10.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.195+0000 7fd714800640 1 -- 172.21.15.40:0/1252402823 wait complete. 2024-07-26T13:32:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.196+0000 7fd714800640 1 Processor -- start 2024-07-26T13:32:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.196+0000 7fd714800640 1 -- start start 2024-07-26T13:32:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd714800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 0x7fd70c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd714800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd70c10f520 0x7fd70c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd714800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd70c10fe70 0x7fd70c1a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd714800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c119a30 con 0x7fd70c109be0 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd714800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1198b0 con 0x7fd70c10fe70 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd714800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c119bb0 con 0x7fd70c10f520 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd711e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 0x7fd70c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd711e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 0x7fd70c1a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52482/0 (socket says 172.21.15.40:52482) 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.197+0000 7fd711e00640 1 -- 172.21.15.40:0/1793747677 learned_addr learned my addr 172.21.15.40:0/1793747677 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711400640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd70c10f520 0x7fd70c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd712800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd70c10fe70 0x7fd70c1a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711e00640 1 -- 172.21.15.40:0/1793747677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd70c10f520 msgr2=0x7fd70c1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711e00640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd70c10f520 0x7fd70c1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711e00640 1 -- 172.21.15.40:0/1793747677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd70c10fe70 msgr2=0x7fd70c1a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711e00640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd70c10fe70 0x7fd70c1a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711e00640 1 -- 172.21.15.40:0/1793747677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c1a6370 con 0x7fd70c109be0 2024-07-26T13:32:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd711e00640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 0x7fd70c1a0400 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d950 tx=0x7fd70000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd706a00640 1 -- 172.21.15.40:0/1793747677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700017070 con 0x7fd70c109be0 2024-07-26T13:32:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.198+0000 7fd706a00640 1 -- 172.21.15.40:0/1793747677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd700009c30 con 0x7fd70c109be0 2024-07-26T13:32:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.199+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c1a6660 con 0x7fd70c109be0 2024-07-26T13:32:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.199+0000 7fd706a00640 1 -- 172.21.15.40:0/1793747677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70000f620 con 0x7fd70c109be0 2024-07-26T13:32:10.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.199+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1acdc0 con 0x7fd70c109be0 2024-07-26T13:32:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.202+0000 7fd71b5f6740 1 Processor -- start 2024-07-26T13:32:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.202+0000 7fd71b5f6740 1 -- start start 2024-07-26T13:32:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd706a00640 1 -- 172.21.15.40:0/1793747677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd700010460 con 0x7fd70c109be0 2024-07-26T13:32:10.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cf1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb0924660 0x563bb0cf2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cf2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563bb0c68f30 con 0x563bb092c840 2024-07-26T13:32:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563bb0c58430 con 0x563bb094d520 2024-07-26T13:32:10.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563bb0c5c470 con 0x563bb0924660 2024-07-26T13:32:10.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd711400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cf2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd711400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cf2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52498/0 (socket says 172.21.15.40:52498) 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd711400640 1 -- 172.21.15.40:0/2935486037 learned_addr learned my addr 172.21.15.40:0/2935486037 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.203+0000 7fd712800640 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cf1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711e00640 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb0924660 0x563bb0cf2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711400640 1 -- 172.21.15.40:0/2935486037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb0924660 msgr2=0x563bb0cf2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711400640 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb0924660 0x563bb0cf2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711400640 1 -- 172.21.15.40:0/2935486037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 msgr2=0x563bb0cf1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711400640 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cf1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711400640 1 -- 172.21.15.40:0/2935486037 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb09b8b00 con 0x563bb092c840 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.204+0000 7fd711400640 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cf2a40 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00bc20 tx=0x7fd6fc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8c981a1c79f789 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:10.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.205+0000 7fd6fb000640 1 -- 172.21.15.40:0/2935486037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc015070 con 0x563bb092c840 2024-07-26T13:32:10.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.205+0000 7fd6fb000640 1 -- 172.21.15.40:0/2935486037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6fc01a8f0 con 0x563bb092c840 2024-07-26T13:32:10.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.205+0000 7fd6fb000640 1 -- 172.21.15.40:0/2935486037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0117c0 con 0x563bb092c840 2024-07-26T13:32:10.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.205+0000 7fd706a00640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6f40b3bd0 0x7fd6f40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.205+0000 7fd706a00640 1 -- 172.21.15.40:0/1793747677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd7000e3900 con 0x7fd70c109be0 2024-07-26T13:32:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.205+0000 7fd712800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6f40b3bd0 0x7fd6f40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 -- 172.21.15.40:0/2935486037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 msgr2=0x563bb0cf2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cf2a40 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00bc20 tx=0x7fd6fc00f730 comp rx=0 tx=0).stop 2024-07-26T13:32:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 -- 172.21.15.40:0/2935486037 shutdown_connections 2024-07-26T13:32:10.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cf2a40 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb0924660 0x563bb0cf2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/2935486037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cf1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 -- 172.21.15.40:0/2935486037 >> 172.21.15.40:0/2935486037 conn(0x563bb0941910 msgr2=0x563bb0cefeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 -- 172.21.15.40:0/2935486037 shutdown_connections 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd71b5f6740 1 -- 172.21.15.40:0/2935486037 wait complete. 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.206+0000 7fd712800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6f40b3bd0 0x7fd6f40b60e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd708006010 tx=0x7fd708031590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.207+0000 7fd71b5f6740 1 -- start start 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.207+0000 7fd71b5f6740 1 Processor -- start 2024-07-26T13:32:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb0924660 0x563bb0cfd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cfdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb094d520 0x563bb0d09ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563bb0abbbb0 con 0x563bb092c840 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563bb0bf4910 con 0x563bb0924660 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563bb0d007a0 con 0x563bb094d520 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd71b5f6740 10 client.0 _ll_register_callbacks cb 0x563bb0964d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd711400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cfdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd711400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cfdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52502/0 (socket says 172.21.15.40:52502) 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd711400640 1 -- 172.21.15.40:0/494679325 learned_addr learned my addr 172.21.15.40:0/494679325 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd711e00640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb0924660 0x563bb0cfd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd712800640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb094d520 0x563bb0d09ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.208+0000 7fd711400640 1 -- 172.21.15.40:0/494679325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb094d520 msgr2=0x563bb0d09ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd711400640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb094d520 0x563bb0d09ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd711400640 1 -- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb0924660 msgr2=0x563bb0cfd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd711400640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb0924660 0x563bb0cfd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd711400640 1 -- 172.21.15.40:0/494679325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bb0a2f960 con 0x563bb092c840 2024-07-26T13:32:10.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd712800640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb094d520 0x563bb0d09ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:32:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd711400640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cfdbe0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc01a690 tx=0x7fd6fc01a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df904ce9771b13c server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd6ef400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:32:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd6ef400640 1 -- 172.21.15.40:0/494679325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc015070 con 0x563bb092c840 2024-07-26T13:32:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd6ef400640 1 -- 172.21.15.40:0/494679325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd6fc01acb0 con 0x563bb092c840 2024-07-26T13:32:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.209+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6fc01a8f0 con 0x563bb092c840 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd6ef400640 1 -- 172.21.15.40:0/494679325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd6fc005040 con 0x563bb092c840 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd71b5f6740 10 client.18261 fetch_fsmap learned FSMap version 45 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x563bb0d0c510 con 0x563bb092c840 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd6ef400640 1 -- 172.21.15.40:0/494679325 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6fc01a8f0 con 0x563bb092c840 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd6ef400640 1 -- 172.21.15.40:0/494679325 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7fd6fc004bc0 con 0x563bb092c840 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd71b5f6740 10 client.18261 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:32:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.210+0000 7fd71b5f6740 10 client.18261 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.211+0000 7fd71b5f6740 20 client.18261 populate_metadata read hostname 'smithi040' 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.211+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb090bea0 0x563bb0d0f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.211+0000 7fd71b5f6740 4 client.18261 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.211+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bb0c6ae80 con 0x563bb090bea0 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.211+0000 7fd711e00640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb090bea0 0x563bb0d0f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.212+0000 7fd711e00640 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb090bea0 0x563bb0d0f870 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19964d8fcf237786 server_cookie=83cdffe4037ff6a6 in_seq=0 out_seq=0 2024-07-26T13:32:10.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.212+0000 7fd6ef400640 10 client.18261 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:10.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.214+0000 7fd6ef400640 1 -- 172.21.15.40:0/494679325 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bb0c6ae80 con 0x563bb090bea0 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.214+0000 7fd6ef400640 10 client.18261 handle_command_reply: tid=0 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.214+0000 7fd71b5f6740 1 client.18261 shutdown 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.214+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 msgr2=0x563bb0cfdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.214+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cfdbe0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc01a690 tx=0x7fd6fc01a6c0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 shutdown_connections 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb094d520 0x563bb0d09ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb090bea0 0x563bb0d0f870 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb092c840 0x563bb0cfdbe0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/494679325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb0924660 0x563bb0cfd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 >> 172.21.15.40:0/494679325 conn(0x563bb0941910 msgr2=0x563bb0cf5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:10.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd6ef400640 0 client.18261 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:10.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 shutdown_connections 2024-07-26T13:32:10.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 1 -- 172.21.15.40:0/494679325 wait complete. 2024-07-26T13:32:10.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.215+0000 7fd71b5f6740 20 client.18261 trim_cache size 0 max 16384 2024-07-26T13:32:10.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 Processor -- start 2024-07-26T13:32:10.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 -- start start 2024-07-26T13:32:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d09df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cfc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1b5370 con 0x563bb0924660 2024-07-26T13:32:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1b6eb0 con 0x563bb094d520 2024-07-26T13:32:10.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.235+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1b5a40 con 0x563bb092c840 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.236+0000 7fd711e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.236+0000 7fd711e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d098b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52510/0 (socket says 172.21.15.40:52510) 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.236+0000 7fd711e00640 1 -- 172.21.15.40:0/860096667 learned_addr learned my addr 172.21.15.40:0/860096667 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.236+0000 7fd712800640 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cfc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.236+0000 7fd711400640 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d09df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.236+0000 7fd711e00640 1 -- 172.21.15.40:0/860096667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 msgr2=0x563bb0d09df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd711e00640 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d09df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd711e00640 1 -- 172.21.15.40:0/860096667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 msgr2=0x563bb0cfc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd711e00640 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cfc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd711e00640 1 -- 172.21.15.40:0/860096667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb0cfe960 con 0x563bb0924660 2024-07-26T13:32:10.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd711400640 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d09df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:32:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd711e00640 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d098b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd7000aa7a0 tx=0x7fd7000cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7c4edce44c9ef3 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd6fa600640 1 -- 172.21.15.40:0/860096667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700020040 con 0x563bb0924660 2024-07-26T13:32:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd6fa600640 1 -- 172.21.15.40:0/860096667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7000aaf10 con 0x563bb0924660 2024-07-26T13:32:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.237+0000 7fd6fa600640 1 -- 172.21.15.40:0/860096667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b38c0 con 0x563bb0924660 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.238+0000 7fd71b5f6740 1 -- 172.21.15.40:0/860096667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 msgr2=0x563bb0d098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.238+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d098b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd7000aa7a0 tx=0x7fd7000cd040 comp rx=0 tx=0).stop 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 -- 172.21.15.40:0/860096667 shutdown_connections 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0cfc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d09df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/860096667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d098b0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 -- 172.21.15.40:0/860096667 >> 172.21.15.40:0/860096667 conn(0x563bb0941910 msgr2=0x563bb0cfbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 -- 172.21.15.40:0/860096667 shutdown_connections 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.239+0000 7fd71b5f6740 1 -- 172.21.15.40:0/860096667 wait complete. 2024-07-26T13:32:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 -- start start 2024-07-26T13:32:10.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 Processor -- start 2024-07-26T13:32:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d05a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d05f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0d009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1b67e0 con 0x563bb0924660 2024-07-26T13:32:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1b6110 con 0x563bb094d520 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.240+0000 7fd71b5f6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1b3330 con 0x563bb092c840 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd71b5f6740 10 client.0 _ll_register_callbacks cb 0x7fd6fc00ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d05a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d05a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52512/0 (socket says 172.21.15.40:52512) 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 -- 172.21.15.40:0/1403976005 learned_addr learned my addr 172.21.15.40:0/1403976005 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711400640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d05f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd712800640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0d009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 -- 172.21.15.40:0/1403976005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 msgr2=0x563bb0d05f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d05f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 -- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 msgr2=0x563bb0d009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0d009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.241+0000 7fd711e00640 1 -- 172.21.15.40:0/1403976005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bb0d00f20 con 0x563bb0924660 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.242+0000 7fd711400640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.242+0000 7fd711e00640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d05a30 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fd7000cd010 tx=0x7fd7000aa810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1dc0ed3855bbe9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.242+0000 7fd6ef400640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.242+0000 7fd6ef400640 1 -- 172.21.15.40:0/1403976005 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700020040 con 0x563bb0924660 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.242+0000 7fd6ef400640 1 -- 172.21.15.40:0/1403976005 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd7000cd0b0 con 0x563bb0924660 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.242+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7000aaf10 con 0x563bb0924660 2024-07-26T13:32:10.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd6ef400640 1 -- 172.21.15.40:0/1403976005 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd7000c5140 con 0x563bb0924660 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 10 client.18267 fetch_fsmap learned FSMap version 45 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x563bb0d784a0 con 0x563bb0924660 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd6ef400640 1 -- 172.21.15.40:0/1403976005 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7000aaf10 con 0x563bb0924660 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd6ef400640 1 -- 172.21.15.40:0/1403976005 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7fd7000a9be0 con 0x563bb0924660 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 10 client.18267 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 10 client.18267 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 20 client.18267 populate_metadata read hostname 'smithi040' 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb08e1250 0x563bb0d7ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 4 client.18267 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "747400df", "release": true, "await": true}] 2024-07-26T13:32:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.243+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "747400df", "release": true, "await": true}) -- 0x563bb0c66920 con 0x563bb08e1250 2024-07-26T13:32:10.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.244+0000 7fd711400640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb08e1250 0x563bb0d7ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:10.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.245+0000 7fd711400640 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb08e1250 0x563bb0d7ac00 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4ac3f8e3e76e7a server_cookie=b01291cf65fe1647 in_seq=0 out_seq=0 2024-07-26T13:32:10.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.245+0000 7fd6ef400640 10 client.18267 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.322+0000 7fd6ef400640 1 -- 172.21.15.40:0/1403976005 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x563bb0c66920 con 0x563bb08e1250 2024-07-26T13:32:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.322+0000 7fd6ef400640 10 client.18267 handle_command_reply: tid=0 2024-07-26T13:32:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.322+0000 7fd71b5f6740 1 client.18267 shutdown 2024-07-26T13:32:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.323+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 msgr2=0x563bb0d05a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.323+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d05a30 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fd7000cd010 tx=0x7fd7000aa810 comp rx=0 tx=0).stop 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 shutdown_connections 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563bb094d520 0x563bb0d009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563bb092c840 0x563bb0d05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x563bb08e1250 0x563bb0d7ac00 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 --2- 172.21.15.40:0/1403976005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563bb0924660 0x563bb0d05a30 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 >> 172.21.15.40:0/1403976005 conn(0x563bb0941910 msgr2=0x563bb0cfc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd6ef400640 0 client.18267 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 shutdown_connections 2024-07-26T13:32:10.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 1 -- 172.21.15.40:0/1403976005 wait complete. 2024-07-26T13:32:10.328 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 45, 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 236, 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "747400df": { 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 236, 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:32:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 147.8, 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:10.330 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.324+0000 7fd71b5f6740 20 client.18267 trim_cache size 0 max 16384 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6f40b3bd0 msgr2=0x7fd6f40b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6f40b3bd0 0x7fd6f40b60e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd708006010 tx=0x7fd708031590 comp rx=0 tx=0).stop 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 msgr2=0x7fd70c1a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 0x7fd70c1a0400 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d950 tx=0x7fd70000de10 comp rx=0 tx=0).stop 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 shutdown_connections 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd70c10fe70 0x7fd70c1a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd6f40b3bd0 0x7fd6f40b60e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd70c10f520 0x7fd70c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 --2- 172.21.15.40:0/1793747677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c109be0 0x7fd70c1a0400 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:10.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.326+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 >> 172.21.15.40:0/1793747677 conn(0x7fd70c077b10 msgr2=0x7fd70c0781d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:10.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.328+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 shutdown_connections 2024-07-26T13:32:10.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:10.328+0000 7fd714800640 1 -- 172.21.15.40:0/1793747677 wait complete. 2024-07-26T13:32:11.267 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '747400df', total seconds elapsed: 35.3 2024-07-26T13:32:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.85 2024-07-26T13:32:11.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:32:11.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:11 smithi040 ceph-mon[32397]: pgmap v2597: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 81 KiB/s wr, 31 op/s 2024-07-26T13:32:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:11 smithi146 ceph-mon[35807]: pgmap v2597: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 81 KiB/s wr, 31 op/s 2024-07-26T13:32:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:11 smithi076 ceph-mon[35401]: pgmap v2597: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 81 KiB/s wr, 31 op/s 2024-07-26T13:32:12.073 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:32:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:13 smithi146 ceph-mon[35807]: pgmap v2598: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 604 KiB/s wr, 159 op/s 2024-07-26T13:32:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:13 smithi076 ceph-mon[35401]: pgmap v2598: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 604 KiB/s wr, 159 op/s 2024-07-26T13:32:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:13 smithi040 ceph-mon[32397]: pgmap v2598: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 604 KiB/s wr, 159 op/s 2024-07-26T13:32:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:15 smithi040 ceph-mon[32397]: pgmap v2599: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.5 MiB/s wr, 639 op/s 2024-07-26T13:32:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:15 smithi146 ceph-mon[35807]: pgmap v2599: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.5 MiB/s wr, 639 op/s 2024-07-26T13:32:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:15 smithi076 ceph-mon[35401]: pgmap v2599: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.5 MiB/s wr, 639 op/s 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.649+0000 7fb03fe00640 1 -- 172.21.15.40:0/3189308115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb040107be0 msgr2=0x7fb040107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.649+0000 7fb03fe00640 1 --2- 172.21.15.40:0/3189308115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb040107be0 0x7fb040107ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009900 tx=0x7fb02c02a3f0 comp rx=0 tx=0).stop 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 -- 172.21.15.40:0/3189308115 shutdown_connections 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 --2- 172.21.15.40:0/3189308115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040108530 0x7fb04010ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 --2- 172.21.15.40:0/3189308115 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb040107be0 0x7fb040107ff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 --2- 172.21.15.40:0/3189308115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0401022a0 0x7fb0401026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 -- 172.21.15.40:0/3189308115 >> 172.21.15.40:0/3189308115 conn(0x7fb0400fdcf0 msgr2=0x7fb040100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 -- 172.21.15.40:0/3189308115 shutdown_connections 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.650+0000 7fb03fe00640 1 -- 172.21.15.40:0/3189308115 wait complete. 2024-07-26T13:32:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.651+0000 7fb03fe00640 1 Processor -- start 2024-07-26T13:32:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 -- start start 2024-07-26T13:32:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0401022a0 0x7fb0401a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040107be0 0x7fb0401a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 0x7fb0401a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb040110fa0 con 0x7fb040107be0 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb040110e20 con 0x7fb0401022a0 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.652+0000 7fb03fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb040111120 con 0x7fb040108530 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.653+0000 7fb03f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 0x7fb0401a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.653+0000 7fb03f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 0x7fb0401a5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:56868/0 (socket says 172.21.15.40:56868) 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.653+0000 7fb03f400640 1 -- 172.21.15.40:0/1126509433 learned_addr learned my addr 172.21.15.40:0/1126509433 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:16.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.653+0000 7fb03ea00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0401022a0 0x7fb0401a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03e000640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040107be0 0x7fb0401a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03f400640 1 -- 172.21.15.40:0/1126509433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0401022a0 msgr2=0x7fb0401a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03f400640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0401022a0 0x7fb0401a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03f400640 1 -- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040107be0 msgr2=0x7fb0401a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03f400640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040107be0 0x7fb0401a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03f400640 1 -- 172.21.15.40:0/1126509433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0401a6150 con 0x7fb040108530 2024-07-26T13:32:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03e000640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040107be0 0x7fb0401a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T13:32:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03ea00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0401022a0 0x7fb0401a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:32:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.654+0000 7fb03f400640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 0x7fb0401a5a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb03800eb10 tx=0x7fb03800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.655+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038004b20 con 0x7fb040108530 2024-07-26T13:32:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.655+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0401a6440 con 0x7fb040108530 2024-07-26T13:32:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.655+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb038004cc0 con 0x7fb040108530 2024-07-26T13:32:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.655+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038010690 con 0x7fb040108530 2024-07-26T13:32:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.655+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04006c810 con 0x7fb040108530 2024-07-26T13:32:16.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.657+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0401026b0 con 0x7fb040108530 2024-07-26T13:32:16.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.662+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb038005020 con 0x7fb040108530 2024-07-26T13:32:16.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.665+0000 7fb037400640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0240b3c30 0x7fb0240b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:16.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.666+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb0380e4330 con 0x7fb040108530 2024-07-26T13:32:16.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.666+0000 7fb03ea00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0240b3c30 0x7fb0240b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:16.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.667+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb0380ab940 con 0x7fb040108530 2024-07-26T13:32:16.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:16.668+0000 7fb03ea00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0240b3c30 0x7fb0240b6140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb030009c20 tx=0x7fb030005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:17.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.075+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0401a1310 con 0x7fb040108530 2024-07-26T13:32:17.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:32:17.083 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":45,"btime":"2024-07-26T13:31:39:374173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:31:39.131232+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:32:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.077+0000 7fb037400640 1 -- 172.21.15.40:0/1126509433 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11976 (secure 0 0 0) 0x7fb0380ab240 con 0x7fb040108530 2024-07-26T13:32:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 45 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.083+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0240b3c30 msgr2=0x7fb0240b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.083+0000 7fb03fe00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0240b3c30 0x7fb0240b6140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb030009c20 tx=0x7fb030005f90 comp rx=0 tx=0).stop 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.083+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 msgr2=0x7fb0401a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.083+0000 7fb03fe00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 0x7fb0401a5a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb03800eb10 tx=0x7fb03800c2d0 comp rx=0 tx=0).stop 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.086+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 shutdown_connections 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.086+0000 7fb03fe00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb0240b3c30 0x7fb0240b6140 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.086+0000 7fb03fe00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040108530 0x7fb0401a5a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.086+0000 7fb03fe00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb040107be0 0x7fb0401a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.086+0000 7fb03fe00640 1 --2- 172.21.15.40:0/1126509433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb0401022a0 0x7fb0401a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.086+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 >> 172.21.15.40:0/1126509433 conn(0x7fb0400fdcf0 msgr2=0x7fb040100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:17.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.087+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 shutdown_connections 2024-07-26T13:32:17.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:17.087+0000 7fb03fe00640 1 -- 172.21.15.40:0/1126509433 wait complete. 2024-07-26T13:32:17.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:17 smithi040 ceph-mon[32397]: pgmap v2600: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 1.02k op/s 2024-07-26T13:32:17.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:17 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1126509433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:17 smithi146 ceph-mon[35807]: pgmap v2600: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 1.02k op/s 2024-07-26T13:32:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:17 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1126509433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:17 smithi076 ceph-mon[35401]: pgmap v2600: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 1.02k op/s 2024-07-26T13:32:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:17 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1126509433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:17.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0' 2024-07-26T13:32:17.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0 2024-07-26T13:32:18.628 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:32:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:19 smithi040 ceph-mon[32397]: pgmap v2601: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.8 MiB/s wr, 2.00k op/s 2024-07-26T13:32:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:19 smithi076 ceph-mon[35401]: pgmap v2601: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.8 MiB/s wr, 2.00k op/s 2024-07-26T13:32:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:19 smithi146 ceph-mon[35807]: pgmap v2601: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.8 MiB/s wr, 2.00k op/s 2024-07-26T13:32:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:21 smithi040 ceph-mon[32397]: pgmap v2602: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 2.35k op/s 2024-07-26T13:32:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:21 smithi076 ceph-mon[35401]: pgmap v2602: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 2.35k op/s 2024-07-26T13:32:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:21 smithi146 ceph-mon[35807]: pgmap v2602: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 2.35k op/s 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 -- 172.21.15.40:0/3793964710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff810a740 msgr2=0x7f7ff8116a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 --2- 172.21.15.40:0/3793964710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff810a740 0x7f7ff8116a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009ca0 tx=0x7f7ff402b150 comp rx=0 tx=0).stop 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 -- 172.21.15.40:0/3793964710 shutdown_connections 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 --2- 172.21.15.40:0/3793964710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff810a740 0x7f7ff8116a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 --2- 172.21.15.40:0/3793964710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff8109df0 0x7f7ff810a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 --2- 172.21.15.40:0/3793964710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810eb90 0x7f7ff810efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.892+0000 7f8000800640 1 -- 172.21.15.40:0/3793964710 >> 172.21.15.40:0/3793964710 conn(0x7f7ff8070ce0 msgr2=0x7f7ff8073840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.894+0000 7f8000800640 1 -- 172.21.15.40:0/3793964710 shutdown_connections 2024-07-26T13:32:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.894+0000 7f8000800640 1 -- 172.21.15.40:0/3793964710 wait complete. 2024-07-26T13:32:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.896+0000 7f8000800640 1 Processor -- start 2024-07-26T13:32:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.897+0000 7f8000800640 1 -- start start 2024-07-26T13:32:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.898+0000 7f8000800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 0x7f7ff81a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.898+0000 7f8000800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 0x7f7ff81a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.898+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 0x7f7ff81a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.899+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 0x7f7ff81a6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:49414/0 (socket says 172.21.15.40:49414) 2024-07-26T13:32:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.899+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 0x7f7ff81a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.899+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 0x7f7ff81a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40508/0 (socket says 172.21.15.40:40508) 2024-07-26T13:32:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.899+0000 7f8000800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff810eb90 0x7f7ff81a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.900+0000 7f7ffde00640 1 -- 172.21.15.40:0/158300723 learned_addr learned my addr 172.21.15.40:0/158300723 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.900+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81199a0 con 0x7f7ff810a740 2024-07-26T13:32:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.900+0000 7f7ffe800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff810eb90 0x7f7ff81a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.901+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff8119820 con 0x7f7ff8109df0 2024-07-26T13:32:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.901+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff8119b20 con 0x7f7ff810eb90 2024-07-26T13:32:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.902+0000 7f7ffd400640 1 -- 172.21.15.40:0/158300723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff810eb90 msgr2=0x7f7ff81a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.902+0000 7f7ffd400640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff810eb90 0x7f7ff81a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.902+0000 7f7ffd400640 1 -- 172.21.15.40:0/158300723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 msgr2=0x7f7ff81a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.902+0000 7f7ffd400640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 0x7f7ff81a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.903+0000 7f7ffd400640 1 -- 172.21.15.40:0/158300723 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff81a0ee0 con 0x7f7ff810a740 2024-07-26T13:32:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.903+0000 7f7ffe800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff810eb90 0x7f7ff81a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:32:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.903+0000 7f7ffde00640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 0x7f7ff81a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:32:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.904+0000 7f7ffd400640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 0x7f7ff81a01b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f7ff806c0b0 tx=0x7f7fe800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.905+0000 7f7ff2a00640 1 -- 172.21.15.40:0/158300723 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8007bb0 con 0x7f7ff810a740 2024-07-26T13:32:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.905+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff81a5bb0 con 0x7f7ff810a740 2024-07-26T13:32:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.905+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff81a60c0 con 0x7f7ff810a740 2024-07-26T13:32:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.905+0000 7f7ff2a00640 1 -- 172.21.15.40:0/158300723 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fe8007d50 con 0x7f7ff810a740 2024-07-26T13:32:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.905+0000 7f7ff2a00640 1 -- 172.21.15.40:0/158300723 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8018660 con 0x7f7ff810a740 2024-07-26T13:32:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.912+0000 7f7ff2a00640 1 -- 172.21.15.40:0/158300723 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7fe8018800 con 0x7f7ff810a740 2024-07-26T13:32:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.915+0000 7f7ff2a00640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7fe00b3cc0 0x7f7fe00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.915+0000 7f7ff2a00640 1 -- 172.21.15.40:0/158300723 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7fe80e4a20 con 0x7f7ff810a740 2024-07-26T13:32:22.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.916+0000 7f7ffde00640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7fe00b3cc0 0x7f7fe00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.944+0000 7f7ffde00640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7fe00b3cc0 0x7f7fe00b61d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005fd0 tx=0x7f7fec00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.946+0000 7f80075e8740 1 Processor -- start 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.946+0000 7f80075e8740 1 -- start start 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f80075e8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f80075e8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f80075e8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f80075e8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561bff5438a0 con 0x561bff1ff990 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f80075e8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561bff532da0 con 0x561bff228850 2024-07-26T13:32:22.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f80075e8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561bff536de0 con 0x561bff207b70 2024-07-26T13:32:22.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.947+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:49428/0 (socket says 172.21.15.40:49428) 2024-07-26T13:32:22.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.948+0000 7f7ffde00640 1 -- 172.21.15.40:0/3037067279 learned_addr learned my addr 172.21.15.40:0/3037067279 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:22.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.948+0000 7f7ffde00640 1 -- 172.21.15.40:0/3037067279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 msgr2=0x561bff5cfd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-07-26T13:32:22.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.948+0000 7f7ffde00640 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5cfd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.948+0000 7f7ffde00640 1 -- 172.21.15.40:0/3037067279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 msgr2=0x561bff5cf7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T13:32:22.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.949+0000 7f7ffde00640 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.949+0000 7f7ffde00640 1 -- 172.21.15.40:0/3037067279 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bff4c7b70 con 0x561bff228850 2024-07-26T13:32:22.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.950+0000 7f7ffde00640 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5cf2a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fec011990 tx=0x7f7fec013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efe4d29f70023c4 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:22.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.950+0000 7f7fe7000640 1 -- 172.21.15.40:0/3037067279 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec01cac0 con 0x561bff228850 2024-07-26T13:32:22.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.951+0000 7f7fe7000640 1 -- 172.21.15.40:0/3037067279 <== mon.2 v2:172.21.15.76:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fec0054b0 con 0x561bff228850 2024-07-26T13:32:22.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.952+0000 7f80075e8740 1 -- 172.21.15.40:0/3037067279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 msgr2=0x561bff5cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:22.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.952+0000 7f80075e8740 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5cf2a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fec011990 tx=0x7f7fec013000 comp rx=0 tx=0).stop 2024-07-26T13:32:22.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.952+0000 7f80075e8740 1 -- 172.21.15.40:0/3037067279 shutdown_connections 2024-07-26T13:32:22.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.952+0000 7f80075e8740 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.952+0000 7f80075e8740 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.952+0000 7f80075e8740 1 --2- 172.21.15.40:0/3037067279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5cf2a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.953+0000 7f80075e8740 1 -- 172.21.15.40:0/3037067279 >> 172.21.15.40:0/3037067279 conn(0x561bff21cc40 msgr2=0x561bff5cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.955+0000 7f80075e8740 1 -- 172.21.15.40:0/3037067279 shutdown_connections 2024-07-26T13:32:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.956+0000 7f80075e8740 1 -- 172.21.15.40:0/3037067279 wait complete. 2024-07-26T13:32:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.958+0000 7f80075e8740 1 -- start start 2024-07-26T13:32:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.958+0000 7f80075e8740 1 Processor -- start 2024-07-26T13:32:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.959+0000 7f80075e8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5dada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.959+0000 7f80075e8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 0x561bff5db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.959+0000 7f80075e8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.959+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 0x561bff5db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 0x561bff5db2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:49438/0 (socket says 172.21.15.40:49438) 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5dada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40524/0 (socket says 172.21.15.40:40524) 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f7ffde00640 1 -- 172.21.15.40:0/2884405422 learned_addr learned my addr 172.21.15.40:0/2884405422 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f7ffe800640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x561bff3967b0 con 0x561bff1ff990 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561bff4cf380 con 0x561bff207b70 2024-07-26T13:32:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.960+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561bff5ddad0 con 0x561bff228850 2024-07-26T13:32:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.962+0000 7f80075e8740 10 client.0 _ll_register_callbacks cb 0x561bff4de830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:32:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.963+0000 7f7ffd400640 1 -- 172.21.15.40:0/2884405422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 msgr2=0x561bff5e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.963+0000 7f7ffd400640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.963+0000 7f7ffd400640 1 -- 172.21.15.40:0/2884405422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 msgr2=0x561bff5dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.963+0000 7f7ffd400640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.963+0000 7f7ffd400640 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bff2a2ba0 con 0x561bff207b70 2024-07-26T13:32:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.964+0000 7f7ffe800640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:32:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.964+0000 7f7ffde00640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-26T13:32:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.965+0000 7f7ffd400640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 0x561bff5db2e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x561bff5cdf20 tx=0x7f7fe80abf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72f4f8ca968c7a server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.965+0000 7f7fdb400640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:32:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.965+0000 7f7fdb400640 1 -- 172.21.15.40:0/2884405422 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80b4320 con 0x561bff207b70 2024-07-26T13:32:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.966+0000 7f7fdb400640 1 -- 172.21.15.40:0/2884405422 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7fe8018af0 con 0x561bff207b70 2024-07-26T13:32:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.966+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fec0054b0 con 0x561bff207b70 2024-07-26T13:32:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.966+0000 7f7fdb400640 1 -- 172.21.15.40:0/2884405422 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7fe80930b0 con 0x561bff207b70 2024-07-26T13:32:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.966+0000 7f80075e8740 10 client.37676 fetch_fsmap learned FSMap version 45 2024-07-26T13:32:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.966+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x561bff5e9a40 con 0x561bff207b70 2024-07-26T13:32:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.967+0000 7f7fdb400640 1 -- 172.21.15.40:0/2884405422 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fe80ab440 con 0x561bff207b70 2024-07-26T13:32:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.967+0000 7f7fdb400640 1 -- 172.21.15.40:0/2884405422 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7f7fe8020030 con 0x561bff207b70 2024-07-26T13:32:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.968+0000 7f80075e8740 10 client.37676 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:32:22.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.970+0000 7f80075e8740 10 client.37676 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:32:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.970+0000 7f80075e8740 20 client.37676 populate_metadata read hostname 'smithi040' 2024-07-26T13:32:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.970+0000 7f80075e8740 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1e71d0 0x561bff5ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.971+0000 7f80075e8740 4 client.37676 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:32:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.971+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7fec0054b0 con 0x561bff1e71d0 2024-07-26T13:32:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.971+0000 7f7ffde00640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1e71d0 0x561bff5ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.972+0000 7f7ffde00640 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1e71d0 0x561bff5ecf20 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b79e30330744e5 server_cookie=ccf2cbf07c8e67bc in_seq=0 out_seq=0 2024-07-26T13:32:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.972+0000 7f7fdb400640 10 client.37676 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.973+0000 7f7fdb400640 1 -- 172.21.15.40:0/2884405422 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7fec0054b0 con 0x561bff1e71d0 2024-07-26T13:32:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.973+0000 7f7fdb400640 10 client.37676 handle_command_reply: tid=0 2024-07-26T13:32:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.973+0000 7f80075e8740 1 client.37676 shutdown 2024-07-26T13:32:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.974+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 msgr2=0x561bff5db2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.974+0000 7f80075e8740 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 0x561bff5db2e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x561bff5cdf20 tx=0x7f7fe80abf50 comp rx=0 tx=0).stop 2024-07-26T13:32:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 shutdown_connections 2024-07-26T13:32:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f80075e8740 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f80075e8740 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff207b70 0x561bff5db2e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f80075e8740 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1e71d0 0x561bff5ecf20 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f80075e8740 1 --2- 172.21.15.40:0/2884405422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 >> 172.21.15.40:0/2884405422 conn(0x561bff21cc40 msgr2=0x561bff5cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.975+0000 7f7fdb400640 0 client.37676 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.976+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 shutdown_connections 2024-07-26T13:32:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.976+0000 7f80075e8740 1 -- 172.21.15.40:0/2884405422 wait complete. 2024-07-26T13:32:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:22.977+0000 7f80075e8740 20 client.37676 trim_cache size 0 max 16384 2024-07-26T13:32:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 Processor -- start 2024-07-26T13:32:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 -- start start 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc00e510 con 0x561bff1ff990 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc010050 con 0x561bff228850 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.008+0000 7f80075e8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc00ebe0 con 0x561bff207b70 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:49182/0 (socket says 172.21.15.40:49182) 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffd400640 1 -- 172.21.15.40:0/4122636544 learned_addr learned my addr 172.21.15.40:0/4122636544 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffe800640 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffd400640 1 -- 172.21.15.40:0/4122636544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 msgr2=0x561bff5e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffd400640 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.009+0000 7f7ffd400640 1 -- 172.21.15.40:0/4122636544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 msgr2=0x561bff5cbf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-07-26T13:32:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.010+0000 7f7ffd400640 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.011+0000 7f7ffd400640 1 -- 172.21.15.40:0/4122636544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bff5d9b00 con 0x561bff207b70 2024-07-26T13:32:23.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.013+0000 7f7ffd400640 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5d0900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80ab630 tx=0x7f7fe80ab3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd58367c9f652aab server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.014+0000 7f7fe6600640 1 -- 172.21.15.40:0/4122636544 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80b4320 con 0x561bff207b70 2024-07-26T13:32:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.014+0000 7f7fe6600640 1 -- 172.21.15.40:0/4122636544 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fe80ab440 con 0x561bff207b70 2024-07-26T13:32:23.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.014+0000 7f7fe6600640 1 -- 172.21.15.40:0/4122636544 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80b49e0 con 0x561bff207b70 2024-07-26T13:32:23.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.017+0000 7f80075e8740 1 -- 172.21.15.40:0/4122636544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 msgr2=0x561bff5d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:23.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.017+0000 7f80075e8740 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5d0900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80ab630 tx=0x7f7fe80ab3b0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.018+0000 7f80075e8740 1 -- 172.21.15.40:0/4122636544 shutdown_connections 2024-07-26T13:32:23.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.018+0000 7f80075e8740 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff228850 0x561bff5e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.018+0000 7f80075e8740 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff207b70 0x561bff5d0900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.018+0000 7f80075e8740 1 --2- 172.21.15.40:0/4122636544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff1ff990 0x561bff5cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.018+0000 7f80075e8740 1 -- 172.21.15.40:0/4122636544 >> 172.21.15.40:0/4122636544 conn(0x561bff21cc40 msgr2=0x561bff5d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:23.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.018+0000 7f80075e8740 1 -- 172.21.15.40:0/4122636544 shutdown_connections 2024-07-26T13:32:23.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.019+0000 7f80075e8740 1 -- 172.21.15.40:0/4122636544 wait complete. 2024-07-26T13:32:23.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.019+0000 7f80075e8740 1 -- start start 2024-07-26T13:32:23.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.020+0000 7f80075e8740 1 Processor -- start 2024-07-26T13:32:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.022+0000 7f80075e8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 0x561bff5e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f80075e8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff207b70 0x561bff5e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f80075e8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5de710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f80075e8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc00f980 con 0x561bff207b70 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f80075e8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc00f2b0 con 0x561bff1ff990 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f80075e8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc00c4d0 con 0x561bff228850 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f80075e8740 10 client.0 _ll_register_callbacks cb 0x7f7fe80ab770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 0x561bff5e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:23.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f7ffde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 0x561bff5e3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:49456/0 (socket says 172.21.15.40:49456) 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f7ffde00640 1 -- 172.21.15.40:0/1443027747 learned_addr learned my addr 172.21.15.40:0/1443027747 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.023+0000 7f7ffe800640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5de710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.024+0000 7f7ffd400640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff207b70 0x561bff5e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.024+0000 7f7ffde00640 1 -- 172.21.15.40:0/1443027747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 msgr2=0x561bff5de710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.024+0000 7f7ffde00640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5de710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.024+0000 7f7ffde00640 1 -- 172.21.15.40:0/1443027747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff207b70 msgr2=0x561bff5e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:23.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.024+0000 7f7ffde00640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff207b70 0x561bff5e36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.024+0000 7f7ffde00640 1 -- 172.21.15.40:0/1443027747 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bff5deea0 con 0x561bff1ff990 2024-07-26T13:32:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.025+0000 7f7ffde00640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 0x561bff5e3100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fec011fd0 tx=0x7f7fec004810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ddbaf9d2c7bc70 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.025+0000 7f7fdb400640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-07-26T13:32:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.026+0000 7f7fdb400640 1 -- 172.21.15.40:0/1443027747 <== mon.2 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec004220 con 0x561bff1ff990 2024-07-26T13:32:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.026+0000 7f7fdb400640 1 -- 172.21.15.40:0/1443027747 <== mon.2 v2:172.21.15.76:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7fec0043c0 con 0x561bff1ff990 2024-07-26T13:32:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.026+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fe80ab440 con 0x561bff1ff990 2024-07-26T13:32:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.026+0000 7f7fdb400640 1 -- 172.21.15.40:0/1443027747 <== mon.2 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7fec042050 con 0x561bff1ff990 2024-07-26T13:32:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.027+0000 7f80075e8740 10 client.37682 fetch_fsmap learned FSMap version 45 2024-07-26T13:32:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.027+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x561bff6551f0 con 0x561bff1ff990 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.028+0000 7f7fdb400640 1 -- 172.21.15.40:0/1443027747 <== mon.2 v2:172.21.15.76:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fe80ab440 con 0x561bff1ff990 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.028+0000 7f7fdb400640 1 -- 172.21.15.40:0/1443027747 <== mon.2 v2:172.21.15.76:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7f7fec004960 con 0x561bff1ff990 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.028+0000 7f80075e8740 10 client.37682 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.028+0000 7f80075e8740 10 client.37682 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.028+0000 7f80075e8740 20 client.37682 populate_metadata read hostname 'smithi040' 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.029+0000 7f80075e8740 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1bc580 0x561bff6576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.029+0000 7f80075e8740 4 client.37682 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}] 2024-07-26T13:32:23.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.029+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}) -- 0x561bff5457f0 con 0x561bff1bc580 2024-07-26T13:32:23.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.030+0000 7f7ffd400640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1bc580 0x561bff6576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:23.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.031+0000 7f7ffd400640 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1bc580 0x561bff6576f0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2935412229edb47 server_cookie=923285ef9d26a73c in_seq=0 out_seq=0 2024-07-26T13:32:23.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.031+0000 7f7fdb400640 10 client.37682 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f7fdb400640 1 -- 172.21.15.40:0/1443027747 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x561bff5457f0 con 0x561bff1bc580 2024-07-26T13:32:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f7fdb400640 10 client.37682 handle_command_reply: tid=0 2024-07-26T13:32:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 client.37682 shutdown 2024-07-26T13:32:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 msgr2=0x561bff5e3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 0x561bff5e3100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fec011fd0 tx=0x7f7fec004810 comp rx=0 tx=0).stop 2024-07-26T13:32:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 shutdown_connections 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561bff228850 0x561bff5de710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x561bff1bc580 0x561bff6576f0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561bff207b70 0x561bff5e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 --2- 172.21.15.40:0/1443027747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561bff1ff990 0x561bff5e3100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 >> 172.21.15.40:0/1443027747 conn(0x561bff21cc40 msgr2=0x561bff5cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.315+0000 7f7fdb400640 0 client.37682 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.316+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 shutdown_connections 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.316+0000 7f80075e8740 1 -- 172.21.15.40:0/1443027747 wait complete. 2024-07-26T13:32:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.316+0000 7f80075e8740 20 client.37682 trim_cache size 0 max 16384 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 45, 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 238, 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "ebe461c6": { 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 238, 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:32:23.319 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 147.8, 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:23.320 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7fe00b3cc0 msgr2=0x7f7fe00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7fe00b3cc0 0x7f7fe00b61d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005fd0 tx=0x7f7fec00b480 comp rx=0 tx=0).stop 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 msgr2=0x7f7ff81a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 0x7f7ff81a01b0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f7ff806c0b0 tx=0x7f7fe800cdd0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 shutdown_connections 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f7fe00b3cc0 0x7f7fe00b61d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ff810eb90 0x7f7ff81a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ff810a740 0x7f7ff81a01b0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 --2- 172.21.15.40:0/158300723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7ff8109df0 0x7f7ff81a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.317+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 >> 172.21.15.40:0/158300723 conn(0x7f7ff8070ce0 msgr2=0x7f7ff810ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.318+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 shutdown_connections 2024-07-26T13:32:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:23.318+0000 7f8000800640 1 -- 172.21.15.40:0/158300723 wait complete. 2024-07-26T13:32:23.724 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:23 smithi040 ceph-mon[32397]: pgmap v2603: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 3.04k op/s 2024-07-26T13:32:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:23 smithi146 ceph-mon[35807]: pgmap v2603: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 3.04k op/s 2024-07-26T13:32:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:23 smithi076 ceph-mon[35401]: pgmap v2603: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 3.04k op/s 2024-07-26T13:32:24.177 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ebe461c6', quiesce took 12.9 seconds. Will release after: 14.950000000000001 2024-07-26T13:32:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:25 smithi040 ceph-mon[32397]: pgmap v2604: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-07-26T13:32:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:25 smithi146 ceph-mon[35807]: pgmap v2604: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-07-26T13:32:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:25 smithi076 ceph-mon[35401]: pgmap v2604: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-07-26T13:32:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:27 smithi040 ceph-mon[32397]: pgmap v2605: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 3.62k op/s 2024-07-26T13:32:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:32:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:27 smithi146 ceph-mon[35807]: pgmap v2605: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 3.62k op/s 2024-07-26T13:32:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:32:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:27 smithi076 ceph-mon[35401]: pgmap v2605: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 3.62k op/s 2024-07-26T13:32:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:32:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:28 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:28 smithi146 ceph-mon[35807]: pgmap v2606: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 3.38k op/s 2024-07-26T13:32:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:28 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:28 smithi076 ceph-mon[35401]: pgmap v2606: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 3.38k op/s 2024-07-26T13:32:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:28 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:28 smithi040 ceph-mon[32397]: pgmap v2606: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 3.38k op/s 2024-07-26T13:32:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:32:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:32:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:32:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:32:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:30.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:32:30.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:32:30.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:32:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:30 smithi040 ceph-mon[32397]: pgmap v2607: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 2.39k op/s 2024-07-26T13:32:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:30 smithi146 ceph-mon[35807]: pgmap v2607: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 2.39k op/s 2024-07-26T13:32:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:30 smithi076 ceph-mon[35401]: pgmap v2607: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 2.39k op/s 2024-07-26T13:32:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:33 smithi146 ceph-mon[35807]: pgmap v2608: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 2.04k op/s 2024-07-26T13:32:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:33 smithi076 ceph-mon[35401]: pgmap v2608: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 2.04k op/s 2024-07-26T13:32:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:33 smithi040 ceph-mon[32397]: pgmap v2608: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 2.04k op/s 2024-07-26T13:32:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:35 smithi146 ceph-mon[35807]: pgmap v2609: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 1.36k op/s 2024-07-26T13:32:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:35 smithi076 ceph-mon[35401]: pgmap v2609: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 1.36k op/s 2024-07-26T13:32:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:35 smithi040 ceph-mon[32397]: pgmap v2609: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 1.36k op/s 2024-07-26T13:32:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:37 smithi146 ceph-mon[35807]: pgmap v2610: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-07-26T13:32:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:37 smithi076 ceph-mon[35401]: pgmap v2610: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-07-26T13:32:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:37 smithi040 ceph-mon[32397]: pgmap v2610: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-07-26T13:32:39.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:32:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:39 smithi040 ceph-mon[32397]: pgmap v2611: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 649 KiB/s wr, 173 op/s 2024-07-26T13:32:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:39 smithi146 ceph-mon[35807]: pgmap v2611: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 649 KiB/s wr, 173 op/s 2024-07-26T13:32:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:39 smithi076 ceph-mon[35401]: pgmap v2611: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 649 KiB/s wr, 173 op/s 2024-07-26T13:32:39.621 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:32:41.539 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:41 smithi040 ceph-mon[32397]: pgmap v2612: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 82 KiB/s wr, 31 op/s 2024-07-26T13:32:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:41 smithi146 ceph-mon[35807]: pgmap v2612: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 82 KiB/s wr, 31 op/s 2024-07-26T13:32:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:41 smithi076 ceph-mon[35401]: pgmap v2612: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 82 KiB/s wr, 31 op/s 2024-07-26T13:32:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 -- 172.21.15.40:0/311339452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f641033c0 msgr2=0x7f0f641037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 --2- 172.21.15.40:0/311339452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f641033c0 0x7f0f641037d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009900 tx=0x7f0f5402a410 comp rx=0 tx=0).stop 2024-07-26T13:32:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 -- 172.21.15.40:0/311339452 shutdown_connections 2024-07-26T13:32:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 --2- 172.21.15.40:0/311339452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f64109650 0x7f0f6410fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 --2- 172.21.15.40:0/311339452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f64108d00 0x7f0f64109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 --2- 172.21.15.40:0/311339452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f641033c0 0x7f0f641037d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 -- 172.21.15.40:0/311339452 >> 172.21.15.40:0/311339452 conn(0x7f0f640fee10 msgr2=0x7f0f64101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 -- 172.21.15.40:0/311339452 shutdown_connections 2024-07-26T13:32:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.885+0000 7f0f6a000640 1 -- 172.21.15.40:0/311339452 wait complete. 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.886+0000 7f0f6a000640 1 Processor -- start 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 -- start start 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f641033c0 0x7f0f64075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f64108d00 0x7f0f64075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 0x7f0f64075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f641131d0 con 0x7f0f64109650 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0f64113050 con 0x7f0f641033c0 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f6a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f64113350 con 0x7f0f64108d00 2024-07-26T13:32:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.887+0000 7f0f69600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 0x7f0f64075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:41.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 0x7f0f64075bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47332/0 (socket says 172.21.15.40:47332) 2024-07-26T13:32:41.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 -- 172.21.15.40:0/3069343489 learned_addr learned my addr 172.21.15.40:0/3069343489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f63e00640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f64108d00 0x7f0f64075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f68c00640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f641033c0 0x7f0f64075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 -- 172.21.15.40:0/3069343489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f64108d00 msgr2=0x7f0f64075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f64108d00 0x7f0f64075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 -- 172.21.15.40:0/3069343489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f641033c0 msgr2=0x7f0f64075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f641033c0 0x7f0f64075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 -- 172.21.15.40:0/3069343489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f641a7f00 con 0x7f0f64109650 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.888+0000 7f0f69600640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 0x7f0f64075bc0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00eaa0 tx=0x7f0f5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.889+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00cdb0 con 0x7f0f64109650 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.889+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f5c005020 con 0x7f0f64109650 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.889+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f641a81f0 con 0x7f0f64109650 2024-07-26T13:32:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.889+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0116d0 con 0x7f0f64109650 2024-07-26T13:32:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.889+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f641a8780 con 0x7f0f64109650 2024-07-26T13:32:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.890+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f641037d0 con 0x7f0f64109650 2024-07-26T13:32:41.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.893+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0f5c0051d0 con 0x7f0f64109650 2024-07-26T13:32:41.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.894+0000 7f0f61600640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0f480b3c50 0x7f0f480b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:41.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.894+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0f5c0e3d60 con 0x7f0f64109650 2024-07-26T13:32:41.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.895+0000 7f0f68c00640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0f480b3c50 0x7f0f480b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.896+0000 7f0f68c00640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0f480b3c50 0x7f0f480b6160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0f54006010 tx=0x7f0f54009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:41.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:41.899+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f0f5c016030 con 0x7f0f64109650 2024-07-26T13:32:42.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.141+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f64076440 con 0x7f0f64109650 2024-07-26T13:32:42.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.142+0000 7f0f61600640 1 -- 172.21.15.40:0/3069343489 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11976 (secure 0 0 0) 0x7f0f5c0ab370 con 0x7f0f64109650 2024-07-26T13:32:42.144 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:32:42.145 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":45,"btime":"2024-07-26T13:31:39:374173+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:31:39.131232+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34631,"mds_1":34592,"mds_2":34547,"mds_3":24610,"mds_4":24592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14673":{"gid":14673,"name":"e","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/3482143239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":3482143239},{"type":"v1","addr":"172.21.15.76:6835","nonce":3482143239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14715":{"gid":14715,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/694136309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":694136309},{"type":"v1","addr":"172.21.15.40:6839","nonce":694136309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14727":{"gid":14727,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3170726419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3170726419},{"type":"v1","addr":"172.21.15.40:6841","nonce":3170726419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/1374524390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1374524390},{"type":"v1","addr":"172.21.15.146:6835","nonce":1374524390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.146:6837/3076436166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3076436166},{"type":"v1","addr":"172.21.15.146:6837","nonce":3076436166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6839/4061759756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":4061759756},{"type":"v1","addr":"172.21.15.146:6839","nonce":4061759756}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34547":{"gid":34547,"name":"k","rank":2,"incarnation":21,"state":"up:active","state_seq":21,"addr":"172.21.15.76:6833/2744171288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":2744171288},{"type":"v1","addr":"172.21.15.76:6833","nonce":2744171288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34631":{"gid":34631,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.76:6839/3866154018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":3866154018},{"type":"v1","addr":"172.21.15.76:6839","nonce":3866154018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34631,"qdb_cluster":[34631,34592,34547,24610,24592]},"id":1}]} 2024-07-26T13:32:42.145 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 45 2024-07-26T13:32:42.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0f480b3c50 msgr2=0x7f0f480b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0f480b3c50 0x7f0f480b6160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0f54006010 tx=0x7f0f54009680 comp rx=0 tx=0).stop 2024-07-26T13:32:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 msgr2=0x7f0f64075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 0x7f0f64075bc0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00eaa0 tx=0x7f0f5c00ef60 comp rx=0 tx=0).stop 2024-07-26T13:32:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 shutdown_connections 2024-07-26T13:32:42.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f64109650 0x7f0f64075bc0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f0f480b3c50 0x7f0f480b6160 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f64108d00 0x7f0f64075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 --2- 172.21.15.40:0/3069343489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f641033c0 0x7f0f64075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.146+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 >> 172.21.15.40:0/3069343489 conn(0x7f0f640fee10 msgr2=0x7f0f64101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.147+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 shutdown_connections 2024-07-26T13:32:42.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:42.147+0000 7f0f6a000640 1 -- 172.21.15.40:0/3069343489 wait complete. 2024-07-26T13:32:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:42 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3069343489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:42 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3069343489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:42 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3069343489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:32:43.052 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34631 quiesce db --set-id ebe461c6 --release --await' 2024-07-26T13:32:43.052 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34631 quiesce db --set-id ebe461c6 --release --await 2024-07-26T13:32:43.538 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:32:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:43 smithi076 ceph-mon[35401]: pgmap v2613: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 91 KiB/s wr, 31 op/s 2024-07-26T13:32:43.659 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:43 smithi040 ceph-mon[32397]: pgmap v2613: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 91 KiB/s wr, 31 op/s 2024-07-26T13:32:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:43 smithi146 ceph-mon[35807]: pgmap v2613: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 91 KiB/s wr, 31 op/s 2024-07-26T13:32:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:45 smithi040 ceph-mon[32397]: pgmap v2614: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 101 KiB/s wr, 37 op/s 2024-07-26T13:32:45.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 -- 172.21.15.40:0/3228840346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 msgr2=0x7f17ec113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 --2- 172.21.15.40:0/3228840346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec113c30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009900 tx=0x7f17d402a3f0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 -- 172.21.15.40:0/3228840346 shutdown_connections 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 --2- 172.21.15.40:0/3228840346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 0x7f17ec116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 --2- 172.21.15.40:0/3228840346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec113c30 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 --2- 172.21.15.40:0/3228840346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17ec077370 0x7f17ec077780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.802+0000 7f17f3000640 1 -- 172.21.15.40:0/3228840346 >> 172.21.15.40:0/3228840346 conn(0x7f17ec101200 msgr2=0x7f17ec103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.803+0000 7f17f3000640 1 -- 172.21.15.40:0/3228840346 shutdown_connections 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.803+0000 7f17f3000640 1 -- 172.21.15.40:0/3228840346 wait complete. 2024-07-26T13:32:45.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.804+0000 7f17f3000640 1 Processor -- start 2024-07-26T13:32:45.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.804+0000 7f17f3000640 1 -- start start 2024-07-26T13:32:45.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17f3000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17ec077370 0x7f17ec1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17f3000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17f3000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 0x7f17ec1a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17f3000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec119980 con 0x7f17ec077cc0 2024-07-26T13:32:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17f3000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec119800 con 0x7f17ec077370 2024-07-26T13:32:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17f3000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec119b00 con 0x7f17ec114170 2024-07-26T13:32:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec1a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43924/0 (socket says 172.21.15.40:43924) 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.805+0000 7f17e3400640 1 -- 172.21.15.40:0/809983716 learned_addr learned my addr 172.21.15.40:0/809983716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17ebe00640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17ec077370 0x7f17ec1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17f1000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 0x7f17ec1a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17e3400640 1 -- 172.21.15.40:0/809983716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 msgr2=0x7f17ec1a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17e3400640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 0x7f17ec1a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17e3400640 1 -- 172.21.15.40:0/809983716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17ec077370 msgr2=0x7f17ec1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17e3400640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17ec077370 0x7f17ec1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17e3400640 1 -- 172.21.15.40:0/809983716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec1a6380 con 0x7f17ec077cc0 2024-07-26T13:32:45.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.806+0000 7f17f1000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 0x7f17ec1a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:32:45.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.807+0000 7f17e3400640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec1a09b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005940 tx=0x7f17d40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:45.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.807+0000 7f17e9600640 1 -- 172.21.15.40:0/809983716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d403f030 con 0x7f17ec077cc0 2024-07-26T13:32:45.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.807+0000 7f17e9600640 1 -- 172.21.15.40:0/809983716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17d4003a80 con 0x7f17ec077cc0 2024-07-26T13:32:45.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.807+0000 7f17e9600640 1 -- 172.21.15.40:0/809983716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4035070 con 0x7f17ec077cc0 2024-07-26T13:32:45.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.807+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec1a6610 con 0x7f17ec077cc0 2024-07-26T13:32:45.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.807+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec1acdd0 con 0x7f17ec077cc0 2024-07-26T13:32:45.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.811+0000 7f17f9dc8740 1 Processor -- start 2024-07-26T13:32:45.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.811+0000 7f17f9dc8740 1 -- start start 2024-07-26T13:32:45.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17e9600640 1 -- 172.21.15.40:0/809983716 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f17d4042030 con 0x7f17ec077cc0 2024-07-26T13:32:45.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cf3660 0x5593f50c1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 0x5593f50c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5593f5037f50 con 0x5593f4cfb840 2024-07-26T13:32:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5593f5027450 con 0x5593f4d1c520 2024-07-26T13:32:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5593f502b490 con 0x5593f4cf3660 2024-07-26T13:32:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 0x5593f50c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f1000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cf3660 0x5593f50c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 0x5593f50c1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43938/0 (socket says 172.21.15.40:43938) 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.813+0000 7f17e3400640 1 -- 172.21.15.40:0/3251417 learned_addr learned my addr 172.21.15.40:0/3251417 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.812+0000 7f17f1000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50c0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.40:52994/0 (socket says 172.21.15.40:52994) 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.813+0000 7f17e3400640 1 -- 172.21.15.40:0/3251417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cf3660 msgr2=0x5593f50c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.813+0000 7f17e3400640 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cf3660 0x5593f50c1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.813+0000 7f17e3400640 1 -- 172.21.15.40:0/3251417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 msgr2=0x5593f50c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.813+0000 7f17e3400640 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50c0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.813+0000 7f17e3400640 1 -- 172.21.15.40:0/3251417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f4d87b00 con 0x5593f4cfb840 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17e3400640 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 0x5593f50c1a60 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f17d410c290 tx=0x7f17d410c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9c3a744b15f802 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17e9600640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17d00b3c50 0x7f17d00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17e1600640 1 -- 172.21.15.40:0/3251417 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d40c7670 con 0x5593f4cfb840 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17e9600640 1 -- 172.21.15.40:0/809983716 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17d4104110 con 0x7f17ec077cc0 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17f1000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17d00b3c50 0x7f17d00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17e1600640 1 -- 172.21.15.40:0/3251417 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17d4111030 con 0x5593f4cfb840 2024-07-26T13:32:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.814+0000 7f17e1600640 1 -- 172.21.15.40:0/3251417 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d40ca790 con 0x5593f4cfb840 2024-07-26T13:32:45.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.815+0000 7f17f1000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17d00b3c50 0x7f17d00b6160 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f17e400bd60 tx=0x7f17e400b550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:45.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.815+0000 7f17f9dc8740 1 -- 172.21.15.40:0/3251417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 msgr2=0x5593f50c1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.815+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 0x5593f50c1a60 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f17d410c290 tx=0x7f17d410c380 comp rx=0 tx=0).stop 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 -- 172.21.15.40:0/3251417 shutdown_connections 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cfb840 0x5593f50c1a60 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cf3660 0x5593f50c1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/3251417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 -- 172.21.15.40:0/3251417 >> 172.21.15.40:0/3251417 conn(0x5593f4d10910 msgr2=0x5593f50beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 -- 172.21.15.40:0/3251417 shutdown_connections 2024-07-26T13:32:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.816+0000 7f17f9dc8740 1 -- 172.21.15.40:0/3251417 wait complete. 2024-07-26T13:32:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.817+0000 7f17f9dc8740 1 -- start start 2024-07-26T13:32:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.817+0000 7f17f9dc8740 1 Processor -- start 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cfb840 0x5593f50ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50d87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5593f4e8abb0 con 0x5593f4cf3660 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5593f4fc3930 con 0x5593f4d1c520 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5593f50cf580 con 0x5593f4cfb840 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f9dc8740 10 client.0 _ll_register_callbacks cb 0x5593f4d33d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43950/0 (socket says 172.21.15.40:43950) 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17ebe00640 1 -- 172.21.15.40:0/1027924764 learned_addr learned my addr 172.21.15.40:0/1027924764 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.818+0000 7f17f1000640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50d87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:45 smithi146 ceph-mon[35807]: pgmap v2614: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 101 KiB/s wr, 37 op/s 2024-07-26T13:32:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17e3400640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cfb840 0x5593f50ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17ebe00640 1 -- 172.21.15.40:0/1027924764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cfb840 msgr2=0x5593f50ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17ebe00640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cfb840 0x5593f50ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17ebe00640 1 -- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 msgr2=0x5593f50d87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17ebe00640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50d87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17ebe00640 1 -- 172.21.15.40:0/1027924764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f4dfe960 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17ebe00640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50cc650 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f17dc004070 tx=0x7f17dc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6166ea37d1d63e9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.819+0000 7f17da000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.820+0000 7f17da000640 1 -- 172.21.15.40:0/1027924764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc013c40 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.820+0000 7f17da000640 1 -- 172.21.15.40:0/1027924764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17dc013de0 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.820+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17d4111030 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.820+0000 7f17da000640 1 -- 172.21.15.40:0/1027924764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f17dc01c440 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.820+0000 7f17f9dc8740 10 client.18300 fetch_fsmap learned FSMap version 45 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.820+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5593f50db220 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17da000640 1 -- 172.21.15.40:0/1027924764 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17d4111030 con 0x5593f4cf3660 2024-07-26T13:32:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17da000640 1 -- 172.21.15.40:0/1027924764 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7f17dc01a070 con 0x5593f4cf3660 2024-07-26T13:32:45.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17f9dc8740 10 client.18300 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:32:45.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17f9dc8740 10 client.18300 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:32:45.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17f9dc8740 20 client.18300 populate_metadata read hostname 'smithi040' 2024-07-26T13:32:45.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cdaea0 0x5593f50de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17f9dc8740 4 client.18300 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:32:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.821+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593f5039ea0 con 0x5593f4cdaea0 2024-07-26T13:32:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.822+0000 7f17e3400640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cdaea0 0x5593f50de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.823+0000 7f17e3400640 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cdaea0 0x5593f50de760 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec64ecd7fa7a9c6 server_cookie=6dff7d1608de236f in_seq=0 out_seq=0 2024-07-26T13:32:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.823+0000 7f17da000640 10 client.18300 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17da000640 1 -- 172.21.15.40:0/1027924764 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593f5039ea0 con 0x5593f4cdaea0 2024-07-26T13:32:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17da000640 10 client.18300 handle_command_reply: tid=0 2024-07-26T13:32:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 client.18300 shutdown 2024-07-26T13:32:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 msgr2=0x5593f50cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50cc650 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f17dc004070 tx=0x7f17dc004530 comp rx=0 tx=0).stop 2024-07-26T13:32:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 shutdown_connections 2024-07-26T13:32:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4d1c520 0x5593f50d87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4cfb840 0x5593f50ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cdaea0 0x5593f50de760 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/1027924764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50cc650 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 >> 172.21.15.40:0/1027924764 conn(0x5593f4d10910 msgr2=0x5593f50c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:45.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17da000640 0 client.18300 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:45.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 shutdown_connections 2024-07-26T13:32:45.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.825+0000 7f17f9dc8740 1 -- 172.21.15.40:0/1027924764 wait complete. 2024-07-26T13:32:45.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.826+0000 7f17f9dc8740 20 client.18300 trim_cache size 0 max 16384 2024-07-26T13:32:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:45 smithi076 ceph-mon[35401]: pgmap v2614: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 101 KiB/s wr, 37 op/s 2024-07-26T13:32:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.845+0000 7f17f9dc8740 1 Processor -- start 2024-07-26T13:32:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.845+0000 7f17f9dc8740 1 -- start start 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1b5390 con 0x5593f4cf3660 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1b6ed0 con 0x5593f4cfb840 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1b5a60 con 0x5593f4d1c520 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43964/0 (socket says 172.21.15.40:43964) 2024-07-26T13:32:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.846+0000 7f17ebe00640 1 -- 172.21.15.40:0/392592121 learned_addr learned my addr 172.21.15.40:0/392592121 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17e3400640 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17ebe00640 1 -- 172.21.15.40:0/392592121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 msgr2=0x5593f50d85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17ebe00640 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17ebe00640 1 -- 172.21.15.40:0/392592121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 msgr2=0x5593f50c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17ebe00640 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17ebe00640 1 -- 172.21.15.40:0/392592121 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f50cab50 con 0x5593f4cf3660 2024-07-26T13:32:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.847+0000 7f17ebe00640 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50c7e20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0268d0 tx=0x7f17dc003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21998897477eca8 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.848+0000 7f17e0c00640 1 -- 172.21.15.40:0/392592121 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc013c40 con 0x5593f4cf3660 2024-07-26T13:32:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.848+0000 7f17e0c00640 1 -- 172.21.15.40:0/392592121 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17dc013de0 con 0x5593f4cf3660 2024-07-26T13:32:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.848+0000 7f17e0c00640 1 -- 172.21.15.40:0/392592121 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc01cce0 con 0x5593f4cf3660 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.848+0000 7f17f9dc8740 1 -- 172.21.15.40:0/392592121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 msgr2=0x5593f50c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.848+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50c7e20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0268d0 tx=0x7f17dc003f40 comp rx=0 tx=0).stop 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 -- 172.21.15.40:0/392592121 shutdown_connections 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50d85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/392592121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50c7e20 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 -- 172.21.15.40:0/392592121 >> 172.21.15.40:0/392592121 conn(0x5593f4d10910 msgr2=0x5593f50ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 -- 172.21.15.40:0/392592121 shutdown_connections 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 -- 172.21.15.40:0/392592121 wait complete. 2024-07-26T13:32:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 -- start start 2024-07-26T13:32:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.849+0000 7f17f9dc8740 1 Processor -- start 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1b6800 con 0x5593f4cf3660 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1b6130 con 0x5593f4cfb840 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1b3350 con 0x5593f4d1c520 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17f9dc8740 10 client.0 _ll_register_callbacks cb 0x7f17dc009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.850+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43976/0 (socket says 172.21.15.40:43976) 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 -- 172.21.15.40:0/409804170 learned_addr learned my addr 172.21.15.40:0/409804170 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17e3400640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17f1000640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 -- 172.21.15.40:0/409804170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 msgr2=0x5593f50c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 -- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 msgr2=0x5593f50c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 -- 172.21.15.40:0/409804170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f50d3be0 con 0x5593f4cf3660 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17e3400640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.851+0000 7f17ebe00640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50d4fa0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f17dc004570 tx=0x7f17dc013c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb8a5d2203c1b71 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:32:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17da000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17da000640 1 -- 172.21.15.40:0/409804170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc037060 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17dc013de0 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17da000640 1 -- 172.21.15.40:0/409804170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17dc026d10 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17da000640 1 -- 172.21.15.40:0/409804170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f17dc01c5e0 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17f9dc8740 10 client.18306 fetch_fsmap learned FSMap version 45 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.852+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5593f51470a0 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17da000640 1 -- 172.21.15.40:0/409804170 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17dc013de0 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17da000640 1 -- 172.21.15.40:0/409804170 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 45) ==== 8366+0+0 (secure 0 0 0) 0x7f17dc03c070 con 0x5593f4cf3660 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17f9dc8740 10 client.18306 fetch_fsmap finished waiting for FSMap version 45 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17f9dc8740 10 client.18306 resolve_mds: validated gid 34631 aka daemon mds.b 2024-07-26T13:32:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17f9dc8740 20 client.18306 populate_metadata read hostname 'smithi040' 2024-07-26T13:32:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cb0250 0x5593f51496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:32:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17f9dc8740 4 client.18306 mds_command: new command op to 34631 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ebe461c6", "release": true, "await": true}] 2024-07-26T13:32:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.853+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 --> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ebe461c6", "release": true, "await": true}) -- 0x5593f5035940 con 0x5593f4cb0250 2024-07-26T13:32:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.854+0000 7f17e3400640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cb0250 0x5593f51496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:32:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.855+0000 7f17e3400640 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cb0250 0x5593f51496b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd703e80d2717782 server_cookie=553e75639a21374c in_seq=0 out_seq=0 2024-07-26T13:32:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.855+0000 7f17da000640 10 client.18306 ms_handle_connect on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.923+0000 7f17da000640 1 -- 172.21.15.40:0/409804170 <== mds.0 v2:172.21.15.76:6838/3866154018 1 ==== command_reply(tid 0: 0 ) ==== 8+0+593 (crc 0 0 0) 0x5593f5035940 con 0x5593f4cb0250 2024-07-26T13:32:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.923+0000 7f17da000640 10 client.18306 handle_command_reply: tid=0 2024-07-26T13:32:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.923+0000 7f17f9dc8740 1 client.18306 shutdown 2024-07-26T13:32:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 msgr2=0x5593f50d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50d4fa0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f17dc004570 tx=0x7f17dc013c70 comp rx=0 tx=0).stop 2024-07-26T13:32:45.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 shutdown_connections 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593f4d1c520 0x5593f50c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5593f4cfb840 0x5593f50c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.76:6838/3866154018,v1:172.21.15.76:6839/3866154018] conn(0x5593f4cb0250 0x5593f51496b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 --2- 172.21.15.40:0/409804170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5593f4cf3660 0x5593f50d4fa0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 >> 172.21.15.40:0/409804170 conn(0x5593f4d10910 msgr2=0x5593f50cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.926+0000 7f17da000640 0 client.18306 ms_handle_reset on v2:172.21.15.76:6838/3866154018 2024-07-26T13:32:45.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.927+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 shutdown_connections 2024-07-26T13:32:45.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.929+0000 7f17f9dc8740 1 -- 172.21.15.40:0/409804170 wait complete. 2024-07-26T13:32:45.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.929+0000 7f17f9dc8740 20 client.18306 trim_cache size 0 max 16384 2024-07-26T13:32:45.933 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T13:32:45.933 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 45, 2024-07-26T13:32:45.933 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 34631, 2024-07-26T13:32:45.933 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 240, 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "ebe461c6": { 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 240, 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 90.0, 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 147.8, 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-07-26T13:32:45.934 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T13:32:45.935 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17d00b3c50 msgr2=0x7f17d00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17d00b3c50 0x7f17d00b6160 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f17e400bd60 tx=0x7f17e400b550 comp rx=0 tx=0).stop 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 msgr2=0x7f17ec1a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec1a09b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005940 tx=0x7f17d40040e0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 shutdown_connections 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f17d00b3c50 0x7f17d00b6160 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec114170 0x7f17ec1a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec077cc0 0x7f17ec1a09b0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 --2- 172.21.15.40:0/809983716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f17ec077370 0x7f17ec1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.930+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 >> 172.21.15.40:0/809983716 conn(0x7f17ec101200 msgr2=0x7f17ec103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:32:45.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.932+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 shutdown_connections 2024-07-26T13:32:45.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:32:45.932+0000 7f17f3000640 1 -- 172.21.15.40:0/809983716 wait complete. 2024-07-26T13:32:46.923 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ebe461c6', total seconds elapsed: 35.7 2024-07-26T13:32:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:47 smithi040 ceph-mon[32397]: pgmap v2615: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 89 KiB/s wr, 30 op/s 2024-07-26T13:32:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:47 smithi146 ceph-mon[35807]: pgmap v2615: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 89 KiB/s wr, 30 op/s 2024-07-26T13:32:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:47 smithi076 ceph-mon[35401]: pgmap v2615: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 89 KiB/s wr, 30 op/s 2024-07-26T13:32:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:49 smithi040 ceph-mon[32397]: pgmap v2616: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-07-26T13:32:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:49 smithi146 ceph-mon[35807]: pgmap v2616: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-07-26T13:32:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:49 smithi076 ceph-mon[35401]: pgmap v2616: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-07-26T13:32:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:51 smithi040 ceph-mon[32397]: pgmap v2617: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-07-26T13:32:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:51 smithi146 ceph-mon[35807]: pgmap v2617: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-07-26T13:32:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:51 smithi076 ceph-mon[35401]: pgmap v2617: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 MiB/s wr, 531 op/s 2024-07-26T13:32:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:53 smithi040 ceph-mon[32397]: pgmap v2618: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 1.21k op/s 2024-07-26T13:32:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:53 smithi146 ceph-mon[35807]: pgmap v2618: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 1.21k op/s 2024-07-26T13:32:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:53 smithi076 ceph-mon[35401]: pgmap v2618: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.7 MiB/s wr, 1.21k op/s 2024-07-26T13:32:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:55 smithi040 ceph-mon[32397]: pgmap v2619: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 2.28k op/s 2024-07-26T13:32:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:55 smithi146 ceph-mon[35807]: pgmap v2619: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 2.28k op/s 2024-07-26T13:32:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:55 smithi076 ceph-mon[35401]: pgmap v2619: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 2.28k op/s 2024-07-26T13:32:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:57 smithi040 ceph-mon[32397]: pgmap v2620: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 10 MiB/s wr, 2.68k op/s 2024-07-26T13:32:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:57 smithi146 ceph-mon[35807]: pgmap v2620: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 10 MiB/s wr, 2.68k op/s 2024-07-26T13:32:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:57 smithi076 ceph-mon[35401]: pgmap v2620: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 10 MiB/s wr, 2.68k op/s 2024-07-26T13:32:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:32:59 smithi040 ceph-mon[32397]: pgmap v2621: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 3.69k op/s 2024-07-26T13:32:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:32:59 smithi146 ceph-mon[35807]: pgmap v2621: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 3.69k op/s 2024-07-26T13:32:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:32:59 smithi076 ceph-mon[35401]: pgmap v2621: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 3.69k op/s 2024-07-26T13:33:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:01 smithi040 ceph-mon[32397]: pgmap v2622: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 3.85k op/s 2024-07-26T13:33:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:01 smithi146 ceph-mon[35807]: pgmap v2622: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 3.85k op/s 2024-07-26T13:33:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:01 smithi076 ceph-mon[35401]: pgmap v2622: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 3.85k op/s 2024-07-26T13:33:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:03 smithi040 ceph-mon[32397]: pgmap v2623: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-07-26T13:33:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:03 smithi146 ceph-mon[35807]: pgmap v2623: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-07-26T13:33:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:03 smithi076 ceph-mon[35401]: pgmap v2623: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2024-07-26T13:33:05.667 INFO:tasks.workunit.client.0.smithi040.stdout:Syncing()...6 sec 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:FFSB benchmark finished at: Fri Jul 26 13:33:05 2024 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:Results: 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:Benchmark took 310.84 sec 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:Total Results 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:=============== 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout: ======= ============ ========= ======= =========== ========== 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout: write : 966400 3109.00 100.000% 100.000% 12.1MB/sec 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:- 2024-07-26T13:33:05.668 INFO:tasks.workunit.client.0.smithi040.stdout:3109.00 Transactions per Second 2024-07-26T13:33:05.669 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.669 INFO:tasks.workunit.client.0.smithi040.stdout:Throughput Results 2024-07-26T13:33:05.669 INFO:tasks.workunit.client.0.smithi040.stdout:=================== 2024-07-26T13:33:05.669 INFO:tasks.workunit.client.0.smithi040.stdout:Write Throughput: 12.1MB/sec 2024-07-26T13:33:05.678 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout:System Call Latency statistics in millisecs 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout:===== 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: Min Avg Max Total Calls 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: ======== ======== ======== ============ 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout:[ open] 3.303000 31.869342 202.959000 755 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-07-26T13:33:05.679 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 22 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 56 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 446 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 207 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 18 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 5 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-07-26T13:33:05.680 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout:[ write] 0.180000 9.985492 22854.095703 966400 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 100 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 40 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 980 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 43202 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 168137 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 309968 2024-07-26T13:33:05.681 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 269190 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 51881 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 56984 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 65678 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 80 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout:[ lseek] 0.000000 0.002141 2.043000 966400 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-07-26T13:33:05.682 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 25 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 78 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 316 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 437 2024-07-26T13:33:05.683 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 657 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 2110 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 4959 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 957817 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout:[ close] 0.040000 2.879393 37.966999 755 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 12 2024-07-26T13:33:05.684 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 45 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 64 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 184 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 80 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 38 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 70 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 80 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 173 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 9 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.685 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.686 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-07-26T13:33:05.686 INFO:tasks.workunit.client.0.smithi040.stdout:0.7% User Time 2024-07-26T13:33:05.686 INFO:tasks.workunit.client.0.smithi040.stdout:19.4% System Time 2024-07-26T13:33:05.686 INFO:tasks.workunit.client.0.smithi040.stdout:20.1% CPU Utilization 2024-07-26T13:33:05.686 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd .. 2024-07-26T13:33:05.712 INFO:tasks.workunit.client.0.smithi040.stderr:+ rm -r tmp ffsb 2024-07-26T13:33:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:05 smithi040 ceph-mon[32397]: pgmap v2624: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-07-26T13:33:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:05 smithi146 ceph-mon[35807]: pgmap v2624: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-07-26T13:33:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:05 smithi076 ceph-mon[35401]: pgmap v2624: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 3.79k op/s 2024-07-26T13:33:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:07 smithi040 ceph-mon[32397]: pgmap v2625: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-07-26T13:33:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:07 smithi146 ceph-mon[35807]: pgmap v2625: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-07-26T13:33:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:07 smithi076 ceph-mon[35401]: pgmap v2625: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-07-26T13:33:09.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:09 smithi040 ceph-mon[32397]: pgmap v2626: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 2.31k op/s 2024-07-26T13:33:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:09 smithi146 ceph-mon[35807]: pgmap v2626: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 2.31k op/s 2024-07-26T13:33:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:09 smithi076 ceph-mon[35401]: pgmap v2626: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 2.31k op/s 2024-07-26T13:33:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:11 smithi040 ceph-mon[32397]: pgmap v2627: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 1.30k op/s 2024-07-26T13:33:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:11 smithi146 ceph-mon[35807]: pgmap v2627: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 1.30k op/s 2024-07-26T13:33:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:11 smithi076 ceph-mon[35401]: pgmap v2627: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 1.30k op/s 2024-07-26T13:33:12.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:12.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: *** Caught signal (Aborted) ** 2024-07-26T13:33:12.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: in thread 7f92ffe00640 thread_name:ms_dispatch 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f930603e6f0] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f930608b94c] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 3: raise() 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 4: abort() 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 5: /lib64/libc.so.6(+0x2871b) [0x7f930602871b] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 6: /lib64/libc.so.6(+0x37386) [0x7f9306037386] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e6886d36b9] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e68889180c] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e6887d12ca] 2024-07-26T13:33:12.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e6887a1753] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e6887a2a1b] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e688786752] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e6886d4a56] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e6886d8637] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e6886d8f5e] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e6886bc03a] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9306b9b407] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 18: (DispatchQueue::entry()+0x60f) [0x7f9306b9bcf9] 2024-07-26T13:33:12.823 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9306c785a1] 2024-07-26T13:33:12.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 20: (Thread::entry_wrapper()+0x43) [0x7f9306a25cdd] 2024-07-26T13:33:12.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9306a25cf9] 2024-07-26T13:33:12.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9306089c02] 2024-07-26T13:33:12.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f930610ec40] 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.502+0000 7f92ffe00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: in thread 7f92ffe00640 thread_name:ms_dispatch 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f930603e6f0] 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f930608b94c] 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 3: raise() 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 4: abort() 2024-07-26T13:33:12.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 5: /lib64/libc.so.6(+0x2871b) [0x7f930602871b] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 6: /lib64/libc.so.6(+0x37386) [0x7f9306037386] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e6886d36b9] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e68889180c] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e6887d12ca] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e6887a1753] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e6887a2a1b] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e688786752] 2024-07-26T13:33:12.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e6886d4a56] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e6886d8637] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e6886d8f5e] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e6886bc03a] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9306b9b407] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 18: (DispatchQueue::entry()+0x60f) [0x7f9306b9bcf9] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9306c785a1] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 20: (Thread::entry_wrapper()+0x43) [0x7f9306a25cdd] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9306a25cf9] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9306089c02] 2024-07-26T13:33:12.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f930610ec40] 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 0> 2024-07-26T13:33:12.502+0000 7f92ffe00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: in thread 7f92ffe00640 thread_name:ms_dispatch 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f930603e6f0] 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f930608b94c] 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 3: raise() 2024-07-26T13:33:12.828 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 4: abort() 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 5: /lib64/libc.so.6(+0x2871b) [0x7f930602871b] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 6: /lib64/libc.so.6(+0x37386) [0x7f9306037386] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e6886d36b9] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e68889180c] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e6887d12ca] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e6887a1753] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e6887a2a1b] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e688786752] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e6886d4a56] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e6886d8637] 2024-07-26T13:33:12.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e6886d8f5e] 2024-07-26T13:33:12.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e6886bc03a] 2024-07-26T13:33:12.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9306b9b407] 2024-07-26T13:33:12.830 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:12.830 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: *** Caught signal (Aborted) ** 2024-07-26T13:33:12.830 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: in thread 7fec02800640 thread_name:ms_dispatch 2024-07-26T13:33:12.830 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec08a3e6f0] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fec08a8b94c] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 3: raise() 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 4: abort() 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 5: /lib64/libc.so.6(+0x2871b) [0x7fec08a2871b] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 6: /lib64/libc.so.6(+0x37386) [0x7fec08a37386] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9fd8c66b9] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b9fda8480c] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9fd9c42ca] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b9fd994753] 2024-07-26T13:33:12.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b9fd995a1b] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b9fd979752] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9fd8c7a56] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9fd8cb637] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9fd8cbf5e] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9fd8af03a] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fec0959b407] 2024-07-26T13:33:12.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 18: (DispatchQueue::entry()+0x60f) [0x7fec0959bcf9] 2024-07-26T13:33:12.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fec096785a1] 2024-07-26T13:33:12.833 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 18: (DispatchQueue::entry()+0x60f) [0x7f9306b9bcf9] 2024-07-26T13:33:12.833 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9306c785a1] 2024-07-26T13:33:12.833 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 20: (Thread::entry_wrapper()+0x43) [0x7f9306a25cdd] 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9306a25cf9] 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9306089c02] 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f930610ec40] 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: -3> 2024-07-26T13:33:12.502+0000 7f92ffe00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: in thread 7f92ffe00640 thread_name:ms_dispatch 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f930603e6f0] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f930608b94c] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 3: raise() 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 4: abort() 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 5: /lib64/libc.so.6(+0x2871b) [0x7f930602871b] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 6: /lib64/libc.so.6(+0x37386) [0x7f9306037386] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e6886d36b9] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e68889180c] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e6887d12ca] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e6887a1753] 2024-07-26T13:33:12.835 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e6887a2a1b] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e688786752] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e6886d4a56] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e6886d8637] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e6886d8f5e] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e6886bc03a] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9306b9b407] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 18: (DispatchQueue::entry()+0x60f) [0x7f9306b9bcf9] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9306c785a1] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 20: (Thread::entry_wrapper()+0x43) [0x7f9306a25cdd] 2024-07-26T13:33:12.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9306a25cf9] 2024-07-26T13:33:12.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9306089c02] 2024-07-26T13:33:12.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f930610ec40] 2024-07-26T13:33:12.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[66086]: 2024-07-26T13:33:12.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:12 smithi146 podman[87292]: 2024-07-26 13:33:12.644232747 +0000 UTC m=+0.036391041 container died fe7d41be65c47b79abef0a70946e7a43ca7754d54ebe41e84ee39c67c9665342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-07-26T13:33:12.838 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 20: (Thread::entry_wrapper()+0x43) [0x7fec09425cdd] 2024-07-26T13:33:12.838 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 21: (Thread::_entry_func(void*)+0xd) [0x7fec09425cf9] 2024-07-26T13:33:12.838 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 22: /lib64/libc.so.6(+0x89c02) [0x7fec08a89c02] 2024-07-26T13:33:12.838 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fec08b0ec40] 2024-07-26T13:33:12.838 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.505+0000 7fec02800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: in thread 7fec02800640 thread_name:ms_dispatch 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec08a3e6f0] 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fec08a8b94c] 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 3: raise() 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 4: abort() 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 5: /lib64/libc.so.6(+0x2871b) [0x7fec08a2871b] 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 6: /lib64/libc.so.6(+0x37386) [0x7fec08a37386] 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9fd8c66b9] 2024-07-26T13:33:12.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b9fda8480c] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9fd9c42ca] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b9fd994753] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b9fd995a1b] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b9fd979752] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9fd8c7a56] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9fd8cb637] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9fd8cbf5e] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9fd8af03a] 2024-07-26T13:33:12.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fec0959b407] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 18: (DispatchQueue::entry()+0x60f) [0x7fec0959bcf9] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fec096785a1] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 20: (Thread::entry_wrapper()+0x43) [0x7fec09425cdd] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 21: (Thread::_entry_func(void*)+0xd) [0x7fec09425cf9] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 22: /lib64/libc.so.6(+0x89c02) [0x7fec08a89c02] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fec08b0ec40] 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 0> 2024-07-26T13:33:12.505+0000 7fec02800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: in thread 7fec02800640 thread_name:ms_dispatch 2024-07-26T13:33:12.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec08a3e6f0] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fec08a8b94c] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 3: raise() 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 4: abort() 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 5: /lib64/libc.so.6(+0x2871b) [0x7fec08a2871b] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 6: /lib64/libc.so.6(+0x37386) [0x7fec08a37386] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9fd8c66b9] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b9fda8480c] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9fd9c42ca] 2024-07-26T13:33:12.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b9fd994753] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b9fd995a1b] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b9fd979752] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9fd8c7a56] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9fd8cb637] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9fd8cbf5e] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9fd8af03a] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fec0959b407] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 18: (DispatchQueue::entry()+0x60f) [0x7fec0959bcf9] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fec096785a1] 2024-07-26T13:33:12.843 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 20: (Thread::entry_wrapper()+0x43) [0x7fec09425cdd] 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 21: (Thread::_entry_func(void*)+0xd) [0x7fec09425cf9] 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 22: /lib64/libc.so.6(+0x89c02) [0x7fec08a89c02] 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fec08b0ec40] 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: -17> 2024-07-26T13:33:12.505+0000 7fec02800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: in thread 7fec02800640 thread_name:ms_dispatch 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.844 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec08a3e6f0] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fec08a8b94c] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 3: raise() 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 4: abort() 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 5: /lib64/libc.so.6(+0x2871b) [0x7fec08a2871b] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 6: /lib64/libc.so.6(+0x37386) [0x7fec08a37386] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9fd8c66b9] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b9fda8480c] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9fd9c42ca] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b9fd994753] 2024-07-26T13:33:12.845 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b9fd995a1b] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b9fd979752] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9fd8c7a56] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9fd8cb637] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9fd8cbf5e] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9fd8af03a] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fec0959b407] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 18: (DispatchQueue::entry()+0x60f) [0x7fec0959bcf9] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fec096785a1] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 20: (Thread::entry_wrapper()+0x43) [0x7fec09425cdd] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 21: (Thread::_entry_func(void*)+0xd) [0x7fec09425cf9] 2024-07-26T13:33:12.846 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 22: /lib64/libc.so.6(+0x89c02) [0x7fec08a89c02] 2024-07-26T13:33:12.847 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fec08b0ec40] 2024-07-26T13:33:12.847 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.847 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:12 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[65789]: 2024-07-26T13:33:12.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: *** Caught signal (Aborted) ** 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: in thread 7f716e400640 thread_name:ms_dispatch 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f717463e6f0] 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f717468b94c] 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 3: raise() 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 4: abort() 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 5: /lib64/libc.so.6(+0x2871b) [0x7f717462871b] 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 6: /lib64/libc.so.6(+0x37386) [0x7f7174637386] 2024-07-26T13:33:12.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e9d730f6b9] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9d74cd80c] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e9d740d2ca] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9d73dd753] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9d73dea1b] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9d73c2752] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e9d7310a56] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e9d7314637] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e9d7314f5e] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e9d72f803a] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f717519b407] 2024-07-26T13:33:12.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 18: (DispatchQueue::entry()+0x60f) [0x7f717519bcf9] 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f71752785a1] 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: *** Caught signal (Aborted) ** 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: in thread 7fe6dde00640 thread_name:ms_dispatch 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6e403e6f0] 2024-07-26T13:33:12.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6e408b94c] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 3: raise() 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 4: abort() 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe6e402871b] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 6: /lib64/libc.so.6(+0x37386) [0x7fe6e4037386] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556d9d6686b9] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556d9d82680c] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556d9d7662ca] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556d9d736753] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556d9d737a1b] 2024-07-26T13:33:12.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556d9d71b752] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556d9d669a56] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556d9d66d637] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556d9d66df5e] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556d9d65103a] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe6e4b9b407] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 18: (DispatchQueue::entry()+0x60f) [0x7fe6e4b9bcf9] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6e4c785a1] 2024-07-26T13:33:12.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 20: (Thread::entry_wrapper()+0x43) [0x7f7175025cdd] 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 21: (Thread::_entry_func(void*)+0xd) [0x7f7175025cf9] 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 22: /lib64/libc.so.6(+0x89c02) [0x7f7174689c02] 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f717470ec40] 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.502+0000 7f716e400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: in thread 7f716e400640 thread_name:ms_dispatch 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f717463e6f0] 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f717468b94c] 2024-07-26T13:33:12.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 3: raise() 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 4: abort() 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 5: /lib64/libc.so.6(+0x2871b) [0x7f717462871b] 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 6: /lib64/libc.so.6(+0x37386) [0x7f7174637386] 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e9d730f6b9] 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9d74cd80c] 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e9d740d2ca] 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9d73dd753] 2024-07-26T13:33:12.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9d73dea1b] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9d73c2752] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e9d7310a56] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e9d7314637] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e9d7314f5e] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e9d72f803a] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f717519b407] 2024-07-26T13:33:12.858 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 18: (DispatchQueue::entry()+0x60f) [0x7f717519bcf9] 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f71752785a1] 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6e4a25cdd] 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6e4a25cf9] 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe6e4089c02] 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe6e410ec40] 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.501+0000 7fe6dde00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: in thread 7fe6dde00640 thread_name:ms_dispatch 2024-07-26T13:33:12.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6e403e6f0] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6e408b94c] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 3: raise() 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 4: abort() 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe6e402871b] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 6: /lib64/libc.so.6(+0x37386) [0x7fe6e4037386] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556d9d6686b9] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556d9d82680c] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556d9d7662ca] 2024-07-26T13:33:12.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556d9d736753] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556d9d737a1b] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556d9d71b752] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556d9d669a56] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556d9d66d637] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556d9d66df5e] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556d9d65103a] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe6e4b9b407] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 18: (DispatchQueue::entry()+0x60f) [0x7fe6e4b9bcf9] 2024-07-26T13:33:12.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6e4c785a1] 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 20: (Thread::entry_wrapper()+0x43) [0x7f7175025cdd] 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 21: (Thread::_entry_func(void*)+0xd) [0x7f7175025cf9] 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 22: /lib64/libc.so.6(+0x89c02) [0x7f7174689c02] 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f717470ec40] 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 0> 2024-07-26T13:33:12.502+0000 7f716e400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: in thread 7f716e400640 thread_name:ms_dispatch 2024-07-26T13:33:12.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f717463e6f0] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f717468b94c] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 3: raise() 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 4: abort() 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 5: /lib64/libc.so.6(+0x2871b) [0x7f717462871b] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 6: /lib64/libc.so.6(+0x37386) [0x7f7174637386] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e9d730f6b9] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9d74cd80c] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e9d740d2ca] 2024-07-26T13:33:12.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9d73dd753] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9d73dea1b] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9d73c2752] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e9d7310a56] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e9d7314637] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e9d7314f5e] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e9d72f803a] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f717519b407] 2024-07-26T13:33:12.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6e4a25cdd] 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6e4a25cf9] 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe6e4089c02] 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe6e410ec40] 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 0> 2024-07-26T13:33:12.501+0000 7fe6dde00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: in thread 7fe6dde00640 thread_name:ms_dispatch 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6e403e6f0] 2024-07-26T13:33:12.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6e408b94c] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 3: raise() 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 4: abort() 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe6e402871b] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 6: /lib64/libc.so.6(+0x37386) [0x7fe6e4037386] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556d9d6686b9] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556d9d82680c] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556d9d7662ca] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556d9d736753] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556d9d737a1b] 2024-07-26T13:33:12.866 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556d9d71b752] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556d9d669a56] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556d9d66d637] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556d9d66df5e] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556d9d65103a] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe6e4b9b407] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 18: (DispatchQueue::entry()+0x60f) [0x7f717519bcf9] 2024-07-26T13:33:12.867 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f71752785a1] 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 20: (Thread::entry_wrapper()+0x43) [0x7f7175025cdd] 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 21: (Thread::_entry_func(void*)+0xd) [0x7f7175025cf9] 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 22: /lib64/libc.so.6(+0x89c02) [0x7f7174689c02] 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f717470ec40] 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 0> 2024-07-26T13:33:12.502+0000 7f716e400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: in thread 7f716e400640 thread_name:ms_dispatch 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.868 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f717463e6f0] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f717468b94c] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 3: raise() 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 4: abort() 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 5: /lib64/libc.so.6(+0x2871b) [0x7f717462871b] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 6: /lib64/libc.so.6(+0x37386) [0x7f7174637386] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e9d730f6b9] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9d74cd80c] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e9d740d2ca] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9d73dd753] 2024-07-26T13:33:12.869 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9d73dea1b] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9d73c2752] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e9d7310a56] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e9d7314637] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e9d7314f5e] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e9d72f803a] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f717519b407] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 18: (DispatchQueue::entry()+0x60f) [0x7f717519bcf9] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f71752785a1] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 20: (Thread::entry_wrapper()+0x43) [0x7f7175025cdd] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 21: (Thread::_entry_func(void*)+0xd) [0x7f7175025cf9] 2024-07-26T13:33:12.870 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 22: /lib64/libc.so.6(+0x89c02) [0x7f7174689c02] 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f717470ec40] 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[65958]: 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 18: (DispatchQueue::entry()+0x60f) [0x7fe6e4b9bcf9] 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6e4c785a1] 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6e4a25cdd] 2024-07-26T13:33:12.871 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6e4a25cf9] 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe6e4089c02] 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe6e410ec40] 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: -8> 2024-07-26T13:33:12.501+0000 7fe6dde00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: in thread 7fe6dde00640 thread_name:ms_dispatch 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe6e403e6f0] 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe6e408b94c] 2024-07-26T13:33:12.872 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 3: raise() 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 4: abort() 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe6e402871b] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 6: /lib64/libc.so.6(+0x37386) [0x7fe6e4037386] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x556d9d6686b9] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x556d9d82680c] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x556d9d7662ca] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x556d9d736753] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x556d9d737a1b] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x556d9d71b752] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x556d9d669a56] 2024-07-26T13:33:12.873 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x556d9d66d637] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x556d9d66df5e] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x556d9d65103a] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe6e4b9b407] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 18: (DispatchQueue::entry()+0x60f) [0x7fe6e4b9bcf9] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe6e4c785a1] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 20: (Thread::entry_wrapper()+0x43) [0x7fe6e4a25cdd] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe6e4a25cf9] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe6e4089c02] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe6e410ec40] 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:12.874 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[65036]: 2024-07-26T13:33:12.875 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:12 smithi076 podman[85551]: 2024-07-26 13:33:12.625975347 +0000 UTC m=+0.034540263 container died 17f99fe3e70df02059f01e297980d43a7cc6ea4b77e43989b8abfba7354efb68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T13:33:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:13 smithi040 ceph-mon[32397]: pgmap v2628: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.4 MiB/s wr, 861 op/s 2024-07-26T13:33:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:13 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:13.799 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:13 smithi076 ceph-mon[35401]: pgmap v2628: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.4 MiB/s wr, 861 op/s 2024-07-26T13:33:13.800 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:13 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:13.800 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:13 smithi076 podman[85557]: 2024-07-26 13:33:13.473307139 +0000 UTC m=+0.865435139 container died 4122e0e03ee9133d5022eb5e40b128bf4721e9d5176dd7dbe29314eb6126c26a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:13.800 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:13 smithi076 podman[85551]: 2024-07-26 13:33:13.39214191 +0000 UTC m=+0.800706792 container remove 17f99fe3e70df02059f01e297980d43a7cc6ea4b77e43989b8abfba7354efb68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True) 2024-07-26T13:33:13.800 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:13 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:13.820 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:13 smithi146 podman[87302]: 2024-07-26 13:33:13.50543647 +0000 UTC m=+0.867806428 container died abe1a57393416d2cdd7e9ce91c8787160108fae986ce86de3590407a40ed680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:13.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:13 smithi146 podman[87292]: 2024-07-26 13:33:13.427383373 +0000 UTC m=+0.819541666 container remove fe7d41be65c47b79abef0a70946e7a43ca7754d54ebe41e84ee39c67c9665342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-07-26T13:33:13.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:13 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:13 smithi146 ceph-mon[35807]: pgmap v2628: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.4 MiB/s wr, 861 op/s 2024-07-26T13:33:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:13 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:14.416 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:14 smithi076 podman[85557]: 2024-07-26 13:33:14.163497361 +0000 UTC m=+1.555625345 container remove 4122e0e03ee9133d5022eb5e40b128bf4721e9d5176dd7dbe29314eb6126c26a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:14.416 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:14 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:14.570 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:14 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:33:14.570 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:14 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 35.557s CPU time. 2024-07-26T13:33:14.570 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:14 smithi146 podman[87302]: 2024-07-26 13:33:14.256490566 +0000 UTC m=+1.618860548 container remove abe1a57393416d2cdd7e9ce91c8787160108fae986ce86de3590407a40ed680a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:33:14.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:14 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:14.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:14 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:33:14.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:14 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1min 29.868s CPU time. 2024-07-26T13:33:14.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:14 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:33:14.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:14 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 37.046s CPU time. 2024-07-26T13:33:15.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:14 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:33:15.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:14 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 31.807s CPU time. 2024-07-26T13:33:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:15 smithi040 ceph-mon[32397]: pgmap v2629: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.5 MiB/s wr, 392 op/s 2024-07-26T13:33:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:15 smithi146 ceph-mon[35807]: pgmap v2629: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.5 MiB/s wr, 392 op/s 2024-07-26T13:33:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:15 smithi076 ceph-mon[35401]: pgmap v2629: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.5 MiB/s wr, 392 op/s 2024-07-26T13:33:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:17 smithi040 ceph-mon[32397]: pgmap v2630: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 21 op/s 2024-07-26T13:33:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:17 smithi146 ceph-mon[35807]: pgmap v2630: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 21 op/s 2024-07-26T13:33:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:17 smithi076 ceph-mon[35401]: pgmap v2630: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 21 op/s 2024-07-26T13:33:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:19 smithi040 ceph-mon[32397]: pgmap v2631: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 27 op/s 2024-07-26T13:33:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:19 smithi146 ceph-mon[35807]: pgmap v2631: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 27 op/s 2024-07-26T13:33:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:19 smithi076 ceph-mon[35401]: pgmap v2631: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 27 op/s 2024-07-26T13:33:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:21 smithi146 ceph-mon[35807]: pgmap v2632: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-07-26T13:33:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:21 smithi076 ceph-mon[35401]: pgmap v2632: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-07-26T13:33:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:21 smithi040 ceph-mon[32397]: pgmap v2632: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-07-26T13:33:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:23 smithi146 ceph-mon[35807]: pgmap v2633: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 25 op/s 2024-07-26T13:33:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:23 smithi076 ceph-mon[35401]: pgmap v2633: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 25 op/s 2024-07-26T13:33:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:23 smithi040 ceph-mon[32397]: pgmap v2633: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 25 op/s 2024-07-26T13:33:24.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:24.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: Stopped Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:24.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 35.557s CPU time. 2024-07-26T13:33:24.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: Starting Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:24 smithi146 ceph-mon[35807]: Replacing daemon mds.k as rank 2 with standby daemon mds.a 2024-07-26T13:33:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:24 smithi146 ceph-mon[35807]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T13:33:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:24 smithi146 ceph-mon[35807]: Replacing daemon mds.b as rank 0 with standby daemon mds.f 2024-07-26T13:33:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:24 smithi146 ceph-mon[35807]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T13:33:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:24 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:33:24.832 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:24.832 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: Stopped Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:24.832 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1min 29.868s CPU time. 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: Starting Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: Stopped Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 37.046s CPU time. 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:24 smithi076 systemd[1]: Starting Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:24 smithi076 ceph-mon[35401]: Replacing daemon mds.k as rank 2 with standby daemon mds.a 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:24 smithi076 ceph-mon[35401]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T13:33:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:24 smithi076 ceph-mon[35401]: Replacing daemon mds.b as rank 0 with standby daemon mds.f 2024-07-26T13:33:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:24 smithi076 ceph-mon[35401]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T13:33:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:24 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:33:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:24 smithi040 ceph-mon[32397]: Replacing daemon mds.k as rank 2 with standby daemon mds.a 2024-07-26T13:33:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:24 smithi040 ceph-mon[32397]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T13:33:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:24 smithi040 ceph-mon[32397]: Replacing daemon mds.b as rank 0 with standby daemon mds.f 2024-07-26T13:33:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:24 smithi040 ceph-mon[32397]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T13:33:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:24 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:33:25.143 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:25.144 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: Stopped Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:25.144 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 31.807s CPU time. 2024-07-26T13:33:25.144 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:24 smithi146 systemd[1]: Starting Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:25.144 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:24 smithi146 podman[87425]: 2024-07-26 13:33:24.851331811 +0000 UTC m=+0.033282748 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:25.144 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:24 smithi146 podman[87425]: 2024-07-26 13:33:24.990483468 +0000 UTC m=+0.172434413 container create 372b0dce466dd0592bc698475198d232e845f7b5a732a21ef10c95aca6613ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:25.242 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:24 smithi076 podman[85739]: 2024-07-26 13:33:24.888210096 +0000 UTC m=+0.044115155 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:25.243 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:24 smithi076 podman[85733]: 2024-07-26 13:33:24.869639973 +0000 UTC m=+0.038600600 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:25.243 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 podman[85733]: 2024-07-26 13:33:25.014902649 +0000 UTC m=+0.183863305 container create eab1d400c570928407f0066d59093b980792e9155baaac88e3535418225e4e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:25.513 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:25 smithi146 podman[87425]: 2024-07-26 13:33:25.260472226 +0000 UTC m=+0.442423165 container init 372b0dce466dd0592bc698475198d232e845f7b5a732a21ef10c95aca6613ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True) 2024-07-26T13:33:25.513 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:25 smithi146 podman[87425]: 2024-07-26 13:33:25.275401609 +0000 UTC m=+0.457352556 container start 372b0dce466dd0592bc698475198d232e845f7b5a732a21ef10c95aca6613ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:25.513 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:25 smithi146 bash[87425]: 372b0dce466dd0592bc698475198d232e845f7b5a732a21ef10c95aca6613ea3 2024-07-26T13:33:25.513 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:25 smithi146 systemd[1]: Started Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:25.513 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mds[87470]: -- 172.21.15.146:0/3688058075 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56554f4db860 con 0x56555367da80 2024-07-26T13:33:25.514 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: starting mds.i at 2024-07-26T13:33:25.514 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 podman[85739]: 2024-07-26 13:33:25.241829156 +0000 UTC m=+0.397734249 container create cd6760496d6b29145b6464a2d8daebca158cf07912fbdf45c83e91ec01ce9fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T13:33:25.514 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 podman[85733]: 2024-07-26 13:33:25.471096337 +0000 UTC m=+0.640057024 container init eab1d400c570928407f0066d59093b980792e9155baaac88e3535418225e4e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-07-26T13:33:25.514 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 podman[85733]: 2024-07-26 13:33:25.480202714 +0000 UTC m=+0.649163345 container start eab1d400c570928407f0066d59093b980792e9155baaac88e3535418225e4e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True) 2024-07-26T13:33:25.765 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 bash[85733]: eab1d400c570928407f0066d59093b980792e9155baaac88e3535418225e4e7b 2024-07-26T13:33:25.765 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 systemd[1]: Started Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:25.765 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mds[85770]: -- 172.21.15.76:0/1904721551 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba6e849c20 con 0x55ba729eb600 2024-07-26T13:33:25.765 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: starting mds.k at 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: pgmap v2634: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 20 KiB/s wr, 30 op/s 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: osdmap e83: 12 total, 12 up, 12 in 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 2 up:standby 2 up:replay 3 up:active 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: daemon mds.i restarted 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: osdmap e84: 12 total, 12 up, 12 in 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:resolve 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:resolve 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:boot 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: Standby daemon mds.g assigned to filesystem cephfs as rank 3 2024-07-26T13:33:25.766 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=f=up:resolve,1=h=up:active,2=a=up:resolve,4=c=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:33:25.767 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:33:25.767 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 3 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:33:25.820 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:25 smithi146 podman[87511]: 2024-07-26 13:33:25.486363548 +0000 UTC m=+0.034976701 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:25.820 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:25 smithi146 podman[87511]: 2024-07-26 13:33:25.602466693 +0000 UTC m=+0.151079881 container create 48ae700d9ede724689dcac012c429fa69f8eccb3b460321445c22d645b46646a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-07-26T13:33:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: pgmap v2634: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 20 KiB/s wr, 30 op/s 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: osdmap e83: 12 total, 12 up, 12 in 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 2 up:standby 2 up:replay 3 up:active 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: daemon mds.i restarted 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: osdmap e84: 12 total, 12 up, 12 in 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:resolve 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:resolve 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:boot 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: Standby daemon mds.g assigned to filesystem cephfs as rank 3 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=f=up:resolve,1=h=up:active,2=a=up:resolve,4=c=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:33:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:25 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 3 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: pgmap v2634: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 20 KiB/s wr, 30 op/s 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: osdmap e83: 12 total, 12 up, 12 in 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 2 up:standby 2 up:replay 3 up:active 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: daemon mds.i restarted 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: osdmap e84: 12 total, 12 up, 12 in 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:resolve 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:resolve 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:boot 2024-07-26T13:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: Standby daemon mds.g assigned to filesystem cephfs as rank 3 2024-07-26T13:33:25.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=f=up:resolve,1=h=up:active,2=a=up:resolve,4=c=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:33:25.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:33:25.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:25 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 3 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:33:26.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 podman[85739]: 2024-07-26 13:33:25.763885893 +0000 UTC m=+0.919791033 container init cd6760496d6b29145b6464a2d8daebca158cf07912fbdf45c83e91ec01ce9fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-07-26T13:33:26.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 podman[85739]: 2024-07-26 13:33:25.773865042 +0000 UTC m=+0.929770100 container start cd6760496d6b29145b6464a2d8daebca158cf07912fbdf45c83e91ec01ce9fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:26.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 bash[85739]: cd6760496d6b29145b6464a2d8daebca158cf07912fbdf45c83e91ec01ce9fc2 2024-07-26T13:33:26.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 systemd[1]: Started Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:26.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-mds[85790]: -- 172.21.15.76:0/2164774414 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559970659c20 con 0x5599747fba80 2024-07-26T13:33:26.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:25 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: starting mds.b at 2024-07-26T13:33:26.320 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:25 smithi146 podman[87511]: 2024-07-26 13:33:25.872850953 +0000 UTC m=+0.421464144 container init 48ae700d9ede724689dcac012c429fa69f8eccb3b460321445c22d645b46646a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-26T13:33:26.321 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:25 smithi146 podman[87511]: 2024-07-26 13:33:25.883442397 +0000 UTC m=+0.432055554 container start 48ae700d9ede724689dcac012c429fa69f8eccb3b460321445c22d645b46646a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:26.321 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:25 smithi146 bash[87511]: 48ae700d9ede724689dcac012c429fa69f8eccb3b460321445c22d645b46646a 2024-07-26T13:33:26.321 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:25 smithi146 systemd[1]: Started Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:26.321 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mds[87530]: -- 172.21.15.146:0/2028070194 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650f3ff3c20 con 0x5650f8195180 2024-07-26T13:33:26.321 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: starting mds.c at 2024-07-26T13:33:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: daemon mds.c restarted 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: osdmap e85: 12 total, 12 up, 12 in 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:boot 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:boot 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:boot 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: Standby daemon mds.e assigned to filesystem cephfs as rank 4 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=f=up:resolve,1=h=up:active,2=a=up:resolve,3=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:33:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:26 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:33:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: daemon mds.c restarted 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: osdmap e85: 12 total, 12 up, 12 in 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:boot 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:boot 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:boot 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: Standby daemon mds.e assigned to filesystem cephfs as rank 4 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=f=up:resolve,1=h=up:active,2=a=up:resolve,3=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:33:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:26 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: daemon mds.c restarted 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: osdmap e85: 12 total, 12 up, 12 in 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:boot 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:boot 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:boot 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: Standby daemon mds.e assigned to filesystem cephfs as rank 4 2024-07-26T13:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=f=up:resolve,1=h=up:active,2=a=up:resolve,3=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:33:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:33:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:33:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:33:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:26 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:33:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:27 smithi146 ceph-mon[35807]: pgmap v2638: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 23 op/s 2024-07-26T13:33:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:27 smithi076 ceph-mon[35401]: pgmap v2638: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 23 op/s 2024-07-26T13:33:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:27 smithi040 ceph-mon[32397]: pgmap v2638: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 23 op/s 2024-07-26T13:33:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:28 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:resolve 2024-07-26T13:33:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:28 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:resolve 2024-07-26T13:33:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:28 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:33:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:28 smithi146 ceph-mon[35807]: pgmap v2639: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 32 op/s 2024-07-26T13:33:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:28 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:resolve 2024-07-26T13:33:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:28 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:resolve 2024-07-26T13:33:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:28 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:33:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:28 smithi076 ceph-mon[35401]: pgmap v2639: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 32 op/s 2024-07-26T13:33:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:28 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:resolve 2024-07-26T13:33:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:28 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:resolve 2024-07-26T13:33:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:28 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:33:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:28 smithi040 ceph-mon[32397]: pgmap v2639: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 32 op/s 2024-07-26T13:33:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499992 2024-07-26T13:33:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00699991 2024-07-26T13:33:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00799975 2024-07-26T13:33:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.0079999 2024-07-26T13:33:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:reconnect 2024-07-26T13:33:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:reconnect 2024-07-26T13:33:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:reconnect 2024-07-26T13:33:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:reconnect 2024-07-26T13:33:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:33:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:33:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499992 2024-07-26T13:33:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00699991 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00799975 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.0079999 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:reconnect 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:reconnect 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:reconnect 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:reconnect 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:33:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:33:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499992 2024-07-26T13:33:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00699991 2024-07-26T13:33:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00799975 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.0079999 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:reconnect 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:reconnect 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:reconnect 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:reconnect 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:33:30.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:rejoin 2024-07-26T13:33:30.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:rejoin 2024-07-26T13:33:30.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:rejoin 2024-07-26T13:33:30.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:rejoin 2024-07-26T13:33:30.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:33:30.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-07-26T13:33:30.624 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: daemon mds.g is now active in filesystem cephfs as rank 3 2024-07-26T13:33:30.624 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-07-26T13:33:30.624 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: daemon mds.f is now active in filesystem cephfs as rank 0 2024-07-26T13:33:30.624 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-mon[32397]: pgmap v2640: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 24 op/s 2024-07-26T13:33:30.624 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:30.624 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: *** Caught signal (Aborted) ** 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: in thread 7f5b4a400640 thread_name:ms_dispatch 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5063e6f0] 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5b5068b94c] 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 3: raise() 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 4: abort() 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5b5062871b] 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 6: /lib64/libc.so.6(+0x37386) [0x7f5b50637386] 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5567007d86b9] 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55670099680c] 2024-07-26T13:33:30.625 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5567008d62ca] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5567008a6753] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5567008a7a1b] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55670088b752] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5567007d9a56] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5567007dd637] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5567007ddf5e] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5567007c103a] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5b5119b407] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 18: (DispatchQueue::entry()+0x60f) [0x7f5b5119bcf9] 2024-07-26T13:33:30.626 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5b512785a1] 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: *** Caught signal (Aborted) ** 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: in thread 7fc937200640 thread_name:ms_dispatch 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc93d43e6f0] 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc93d48b94c] 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 3: raise() 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 4: abort() 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc93d42871b] 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 6: /lib64/libc.so.6(+0x37386) [0x7fc93d437386] 2024-07-26T13:33:30.627 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566e70226b9] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566e71e080c] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566e71202ca] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566e70f0753] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566e70f1a1b] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566e70d5752] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566e7023a56] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566e7027637] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566e7027f5e] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566e700b03a] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc93df9b407] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 18: (DispatchQueue::entry()+0x60f) [0x7fc93df9bcf9] 2024-07-26T13:33:30.628 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc93e0785a1] 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 20: (Thread::entry_wrapper()+0x43) [0x7f5b51025cdd] 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5b51025cf9] 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5b50689c02] 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5b5070ec40] 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:30.588+0000 7f5b4a400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: in thread 7f5b4a400640 thread_name:ms_dispatch 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.629 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5063e6f0] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5b5068b94c] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 3: raise() 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 4: abort() 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5b5062871b] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 6: /lib64/libc.so.6(+0x37386) [0x7f5b50637386] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5567007d86b9] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55670099680c] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5567008d62ca] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5567008a6753] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5567008a7a1b] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55670088b752] 2024-07-26T13:33:30.630 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5567007d9a56] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5567007dd637] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5567007ddf5e] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5567007c103a] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5b5119b407] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 18: (DispatchQueue::entry()+0x60f) [0x7f5b5119bcf9] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5b512785a1] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 20: (Thread::entry_wrapper()+0x43) [0x7f5b51025cdd] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5b51025cf9] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5b50689c02] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5b5070ec40] 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.631 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:30.632 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 20: (Thread::entry_wrapper()+0x43) [0x7fc93de25cdd] 2024-07-26T13:33:30.632 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc93de25cf9] 2024-07-26T13:33:30.632 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc93d489c02] 2024-07-26T13:33:30.633 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc93d50ec40] 2024-07-26T13:33:30.633 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.589+0000 7fc937200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.633 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: in thread 7fc937200640 thread_name:ms_dispatch 2024-07-26T13:33:30.633 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.633 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.633 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc93d43e6f0] 2024-07-26T13:33:30.634 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc93d48b94c] 2024-07-26T13:33:30.634 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 3: raise() 2024-07-26T13:33:30.634 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 4: abort() 2024-07-26T13:33:30.634 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc93d42871b] 2024-07-26T13:33:30.634 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 6: /lib64/libc.so.6(+0x37386) [0x7fc93d437386] 2024-07-26T13:33:30.635 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566e70226b9] 2024-07-26T13:33:30.635 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566e71e080c] 2024-07-26T13:33:30.635 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566e71202ca] 2024-07-26T13:33:30.635 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566e70f0753] 2024-07-26T13:33:30.635 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566e70f1a1b] 2024-07-26T13:33:30.636 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566e70d5752] 2024-07-26T13:33:30.636 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566e7023a56] 2024-07-26T13:33:30.636 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566e7027637] 2024-07-26T13:33:30.636 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566e7027f5e] 2024-07-26T13:33:30.636 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566e700b03a] 2024-07-26T13:33:30.636 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc93df9b407] 2024-07-26T13:33:30.637 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 18: (DispatchQueue::entry()+0x60f) [0x7fc93df9bcf9] 2024-07-26T13:33:30.637 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc93e0785a1] 2024-07-26T13:33:30.637 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 20: (Thread::entry_wrapper()+0x43) [0x7fc93de25cdd] 2024-07-26T13:33:30.637 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc93de25cf9] 2024-07-26T13:33:30.637 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc93d489c02] 2024-07-26T13:33:30.637 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc93d50ec40] 2024-07-26T13:33:30.638 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.638 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.638 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 0> 2024-07-26T13:33:30.589+0000 7fc937200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.638 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: in thread 7fc937200640 thread_name:ms_dispatch 2024-07-26T13:33:30.638 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.639 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.639 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc93d43e6f0] 2024-07-26T13:33:30.639 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc93d48b94c] 2024-07-26T13:33:30.639 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 3: raise() 2024-07-26T13:33:30.639 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 4: abort() 2024-07-26T13:33:30.639 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc93d42871b] 2024-07-26T13:33:30.640 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 6: /lib64/libc.so.6(+0x37386) [0x7fc93d437386] 2024-07-26T13:33:30.640 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566e70226b9] 2024-07-26T13:33:30.640 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566e71e080c] 2024-07-26T13:33:30.640 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566e71202ca] 2024-07-26T13:33:30.640 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566e70f0753] 2024-07-26T13:33:30.640 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566e70f1a1b] 2024-07-26T13:33:30.641 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566e70d5752] 2024-07-26T13:33:30.641 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566e7023a56] 2024-07-26T13:33:30.641 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566e7027637] 2024-07-26T13:33:30.641 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566e7027f5e] 2024-07-26T13:33:30.641 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566e700b03a] 2024-07-26T13:33:30.642 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc93df9b407] 2024-07-26T13:33:30.642 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 18: (DispatchQueue::entry()+0x60f) [0x7fc93df9bcf9] 2024-07-26T13:33:30.642 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc93e0785a1] 2024-07-26T13:33:30.642 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 20: (Thread::entry_wrapper()+0x43) [0x7fc93de25cdd] 2024-07-26T13:33:30.642 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc93de25cf9] 2024-07-26T13:33:30.643 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc93d489c02] 2024-07-26T13:33:30.643 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc93d50ec40] 2024-07-26T13:33:30.643 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.643 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:rejoin 2024-07-26T13:33:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:rejoin 2024-07-26T13:33:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:rejoin 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:rejoin 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: daemon mds.g is now active in filesystem cephfs as rank 3 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: daemon mds.f is now active in filesystem cephfs as rank 0 2024-07-26T13:33:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-mon[35401]: pgmap v2640: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 24 op/s 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: *** Caught signal (Aborted) ** 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: in thread 7fae36800640 thread_name:ms_dispatch 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae3ca3e6f0] 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fae3ca8b94c] 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 3: raise() 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 4: abort() 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 5: /lib64/libc.so.6(+0x2871b) [0x7fae3ca2871b] 2024-07-26T13:33:30.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 6: /lib64/libc.so.6(+0x37386) [0x7fae3ca37386] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ca6cfeb6b9] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ca6d1a980c] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ca6d0e92ca] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ca6d0b9753] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ca6d0baa1b] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ca6d09e752] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ca6cfeca56] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ca6cff0637] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ca6cff0f5e] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ca6cfd403a] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fae3d59b407] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 18: (DispatchQueue::entry()+0x60f) [0x7fae3d59bcf9] 2024-07-26T13:33:30.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fae3d6785a1] 2024-07-26T13:33:30.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 20: (Thread::entry_wrapper()+0x43) [0x7fae3d425cdd] 2024-07-26T13:33:30.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 21: (Thread::_entry_func(void*)+0xd) [0x7fae3d425cf9] 2024-07-26T13:33:30.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 22: /lib64/libc.so.6(+0x89c02) [0x7fae3ca89c02] 2024-07-26T13:33:30.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fae3cb0ec40] 2024-07-26T13:33:30.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.579+0000 7fae36800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: in thread 7fae36800640 thread_name:ms_dispatch 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae3ca3e6f0] 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fae3ca8b94c] 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 3: raise() 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 4: abort() 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 5: /lib64/libc.so.6(+0x2871b) [0x7fae3ca2871b] 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 6: /lib64/libc.so.6(+0x37386) [0x7fae3ca37386] 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ca6cfeb6b9] 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ca6d1a980c] 2024-07-26T13:33:30.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ca6d0e92ca] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ca6d0b9753] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ca6d0baa1b] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ca6d09e752] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ca6cfeca56] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ca6cff0637] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ca6cff0f5e] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ca6cfd403a] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fae3d59b407] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 18: (DispatchQueue::entry()+0x60f) [0x7fae3d59bcf9] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fae3d6785a1] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 20: (Thread::entry_wrapper()+0x43) [0x7fae3d425cdd] 2024-07-26T13:33:30.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 21: (Thread::_entry_func(void*)+0xd) [0x7fae3d425cf9] 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 22: /lib64/libc.so.6(+0x89c02) [0x7fae3ca89c02] 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fae3cb0ec40] 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 0> 2024-07-26T13:33:30.579+0000 7fae36800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: in thread 7fae36800640 thread_name:ms_dispatch 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae3ca3e6f0] 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fae3ca8b94c] 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 3: raise() 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 4: abort() 2024-07-26T13:33:30.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 5: /lib64/libc.so.6(+0x2871b) [0x7fae3ca2871b] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 6: /lib64/libc.so.6(+0x37386) [0x7fae3ca37386] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ca6cfeb6b9] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ca6d1a980c] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ca6d0e92ca] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ca6d0b9753] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ca6d0baa1b] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ca6d09e752] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ca6cfeca56] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ca6cff0637] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ca6cff0f5e] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ca6cfd403a] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fae3d59b407] 2024-07-26T13:33:30.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 18: (DispatchQueue::entry()+0x60f) [0x7fae3d59bcf9] 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fae3d6785a1] 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 20: (Thread::entry_wrapper()+0x43) [0x7fae3d425cdd] 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 21: (Thread::_entry_func(void*)+0xd) [0x7fae3d425cf9] 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 22: /lib64/libc.so.6(+0x89c02) [0x7fae3ca89c02] 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fae3cb0ec40] 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 0> 2024-07-26T13:33:30.579+0000 7fae36800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: in thread 7fae36800640 thread_name:ms_dispatch 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae3ca3e6f0] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fae3ca8b94c] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 3: raise() 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 4: abort() 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 5: /lib64/libc.so.6(+0x2871b) [0x7fae3ca2871b] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 6: /lib64/libc.so.6(+0x37386) [0x7fae3ca37386] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ca6cfeb6b9] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ca6d1a980c] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ca6d0e92ca] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ca6d0b9753] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ca6d0baa1b] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ca6d09e752] 2024-07-26T13:33:30.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ca6cfeca56] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ca6cff0637] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ca6cff0f5e] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ca6cfd403a] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fae3d59b407] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 18: (DispatchQueue::entry()+0x60f) [0x7fae3d59bcf9] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fae3d6785a1] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 20: (Thread::entry_wrapper()+0x43) [0x7fae3d425cdd] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 21: (Thread::_entry_func(void*)+0xd) [0x7fae3d425cf9] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 22: /lib64/libc.so.6(+0x89c02) [0x7fae3ca89c02] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fae3cb0ec40] 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[65336]: 2024-07-26T13:33:30.905 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:rejoin 2024-07-26T13:33:30.905 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:rejoin 2024-07-26T13:33:30.905 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:rejoin 2024-07-26T13:33:30.905 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:rejoin 2024-07-26T13:33:30.905 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:33:30.906 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-07-26T13:33:30.906 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: daemon mds.g is now active in filesystem cephfs as rank 3 2024-07-26T13:33:30.907 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-07-26T13:33:30.907 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: daemon mds.f is now active in filesystem cephfs as rank 0 2024-07-26T13:33:30.907 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-mon[35807]: pgmap v2640: 97 pgs: 97 active+clean; 11 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 170 B/s wr, 24 op/s 2024-07-26T13:33:30.909 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:30.909 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: *** Caught signal (Aborted) ** 2024-07-26T13:33:30.909 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: in thread 7f2c64a00640 thread_name:ms_dispatch 2024-07-26T13:33:30.909 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.909 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2c6ac3e6f0] 2024-07-26T13:33:30.910 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2c6ac8b94c] 2024-07-26T13:33:30.910 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 3: raise() 2024-07-26T13:33:30.910 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 4: abort() 2024-07-26T13:33:30.910 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2c6ac2871b] 2024-07-26T13:33:30.910 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 6: /lib64/libc.so.6(+0x37386) [0x7f2c6ac37386] 2024-07-26T13:33:30.911 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cc2fbb36b9] 2024-07-26T13:33:30.911 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cc2fd7180c] 2024-07-26T13:33:30.911 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cc2fcb12ca] 2024-07-26T13:33:30.911 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cc2fc81753] 2024-07-26T13:33:30.911 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cc2fc82a1b] 2024-07-26T13:33:30.912 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cc2fc66752] 2024-07-26T13:33:30.912 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cc2fbb4a56] 2024-07-26T13:33:30.912 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cc2fbb8637] 2024-07-26T13:33:30.912 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cc2fbb8f5e] 2024-07-26T13:33:30.912 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cc2fb9c03a] 2024-07-26T13:33:30.913 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2c6b79b407] 2024-07-26T13:33:30.913 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 18: (DispatchQueue::entry()+0x60f) [0x7f2c6b79bcf9] 2024-07-26T13:33:30.913 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2c6b8785a1] 2024-07-26T13:33:30.913 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 20: (Thread::entry_wrapper()+0x43) [0x7f2c6b625cdd] 2024-07-26T13:33:30.913 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2c6b625cf9] 2024-07-26T13:33:30.914 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2c6ac89c02] 2024-07-26T13:33:30.914 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2c6ad0ec40] 2024-07-26T13:33:30.914 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.590+0000 7f2c64a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.914 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: in thread 7f2c64a00640 thread_name:ms_dispatch 2024-07-26T13:33:30.914 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.915 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.915 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2c6ac3e6f0] 2024-07-26T13:33:30.915 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2c6ac8b94c] 2024-07-26T13:33:30.915 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 3: raise() 2024-07-26T13:33:30.915 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 4: abort() 2024-07-26T13:33:30.915 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2c6ac2871b] 2024-07-26T13:33:30.916 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 6: /lib64/libc.so.6(+0x37386) [0x7f2c6ac37386] 2024-07-26T13:33:30.916 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cc2fbb36b9] 2024-07-26T13:33:30.916 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cc2fd7180c] 2024-07-26T13:33:30.916 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cc2fcb12ca] 2024-07-26T13:33:30.916 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cc2fc81753] 2024-07-26T13:33:30.916 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cc2fc82a1b] 2024-07-26T13:33:30.917 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cc2fc66752] 2024-07-26T13:33:30.917 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cc2fbb4a56] 2024-07-26T13:33:30.917 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cc2fbb8637] 2024-07-26T13:33:30.917 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cc2fbb8f5e] 2024-07-26T13:33:30.917 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cc2fb9c03a] 2024-07-26T13:33:30.918 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2c6b79b407] 2024-07-26T13:33:30.918 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 18: (DispatchQueue::entry()+0x60f) [0x7f2c6b79bcf9] 2024-07-26T13:33:30.918 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2c6b8785a1] 2024-07-26T13:33:30.918 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 20: (Thread::entry_wrapper()+0x43) [0x7f2c6b625cdd] 2024-07-26T13:33:30.918 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2c6b625cf9] 2024-07-26T13:33:30.919 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2c6ac89c02] 2024-07-26T13:33:30.919 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2c6ad0ec40] 2024-07-26T13:33:30.919 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.919 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 0> 2024-07-26T13:33:30.590+0000 7f2c64a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: in thread 7f2c64a00640 thread_name:ms_dispatch 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2c6ac3e6f0] 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2c6ac8b94c] 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 3: raise() 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 4: abort() 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2c6ac2871b] 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 6: /lib64/libc.so.6(+0x37386) [0x7f2c6ac37386] 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cc2fbb36b9] 2024-07-26T13:33:30.920 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cc2fd7180c] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cc2fcb12ca] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cc2fc81753] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cc2fc82a1b] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cc2fc66752] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cc2fbb4a56] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cc2fbb8637] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cc2fbb8f5e] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cc2fb9c03a] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2c6b79b407] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 18: (DispatchQueue::entry()+0x60f) [0x7f2c6b79bcf9] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2c6b8785a1] 2024-07-26T13:33:30.921 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 20: (Thread::entry_wrapper()+0x43) [0x7f2c6b625cdd] 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2c6b625cf9] 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2c6ac89c02] 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2c6ad0ec40] 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 0> 2024-07-26T13:33:30.590+0000 7f2c64a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: in thread 7f2c64a00640 thread_name:ms_dispatch 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2c6ac3e6f0] 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2c6ac8b94c] 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 3: raise() 2024-07-26T13:33:30.922 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 4: abort() 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2c6ac2871b] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 6: /lib64/libc.so.6(+0x37386) [0x7f2c6ac37386] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55cc2fbb36b9] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55cc2fd7180c] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55cc2fcb12ca] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55cc2fc81753] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55cc2fc82a1b] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55cc2fc66752] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55cc2fbb4a56] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55cc2fbb8637] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55cc2fbb8f5e] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55cc2fb9c03a] 2024-07-26T13:33:30.923 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2c6b79b407] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 18: (DispatchQueue::entry()+0x60f) [0x7f2c6b79bcf9] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2c6b8785a1] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 20: (Thread::entry_wrapper()+0x43) [0x7f2c6b625cdd] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2c6b625cf9] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2c6ac89c02] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2c6ad0ec40] 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[65487]: 2024-07-26T13:33:30.924 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:30 smithi146 podman[87743]: 2024-07-26 13:33:30.903712179 +0000 UTC m=+0.214680462 container died f8dfca4499a6c5b7f002f37dae4aff874f27ae1631d2525cfeb52f11a80730f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-07-26T13:33:30.982 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 0> 2024-07-26T13:33:30.588+0000 7f5b4a400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: in thread 7f5b4a400640 thread_name:ms_dispatch 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5063e6f0] 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5b5068b94c] 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 3: raise() 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 4: abort() 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5b5062871b] 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 6: /lib64/libc.so.6(+0x37386) [0x7f5b50637386] 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5567007d86b9] 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55670099680c] 2024-07-26T13:33:30.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5567008d62ca] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5567008a6753] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5567008a7a1b] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55670088b752] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5567007d9a56] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5567007dd637] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5567007ddf5e] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5567007c103a] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5b5119b407] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 18: (DispatchQueue::entry()+0x60f) [0x7f5b5119bcf9] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5b512785a1] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 20: (Thread::entry_wrapper()+0x43) [0x7f5b51025cdd] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5b51025cf9] 2024-07-26T13:33:30.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5b50689c02] 2024-07-26T13:33:30.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 0> 2024-07-26T13:33:30.589+0000 7fc937200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: in thread 7fc937200640 thread_name:ms_dispatch 2024-07-26T13:33:30.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc93d43e6f0] 2024-07-26T13:33:30.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc93d48b94c] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 3: raise() 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 4: abort() 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc93d42871b] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 6: /lib64/libc.so.6(+0x37386) [0x7fc93d437386] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5566e70226b9] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5566e71e080c] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5566e71202ca] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5566e70f0753] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5566e70f1a1b] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5566e70d5752] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5566e7023a56] 2024-07-26T13:33:30.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5566e7027637] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5566e7027f5e] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5566e700b03a] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc93df9b407] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 18: (DispatchQueue::entry()+0x60f) [0x7fc93df9bcf9] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc93e0785a1] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 20: (Thread::entry_wrapper()+0x43) [0x7fc93de25cdd] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc93de25cf9] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc93d489c02] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc93d50ec40] 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[74177]: 2024-07-26T13:33:30.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:30 smithi040 podman[186264]: 2024-07-26 13:33:30.7202211 +0000 UTC m=+0.038994118 container died d6c15625d5ca30f5f66acaee7a717cafb471ecb613a07a7ddd3380da6c89a6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5b5070ec40] 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 0> 2024-07-26T13:33:30.588+0000 7f5b4a400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: in thread 7f5b4a400640 thread_name:ms_dispatch 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5063e6f0] 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5b5068b94c] 2024-07-26T13:33:30.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 3: raise() 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 4: abort() 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5b5062871b] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 6: /lib64/libc.so.6(+0x37386) [0x7f5b50637386] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5567007d86b9] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55670099680c] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5567008d62ca] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5567008a6753] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5567008a7a1b] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55670088b752] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5567007d9a56] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5567007dd637] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5567007ddf5e] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5567007c103a] 2024-07-26T13:33:30.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5b5119b407] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 18: (DispatchQueue::entry()+0x60f) [0x7f5b5119bcf9] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5b512785a1] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 20: (Thread::entry_wrapper()+0x43) [0x7f5b51025cdd] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5b51025cf9] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5b50689c02] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5b5070ec40] 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:30.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:30 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[74547]: 2024-07-26T13:33:31.217 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:30 smithi076 podman[86000]: 2024-07-26 13:33:30.886530597 +0000 UTC m=+0.216612781 container died ea4d351352afbba0bd4e133a613974469520753cf351f2898773aee1bfaec1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD) 2024-07-26T13:33:31.552 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:31 smithi040 podman[186263]: 2024-07-26 13:33:31.253356124 +0000 UTC m=+0.572750021 container died daee5aef891f8e2fe85ec43ee66bede05afc2179997e17643b0b2e3dfe858dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:31.832 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:31 smithi076 podman[86000]: 2024-07-26 13:33:31.554500969 +0000 UTC m=+0.884583172 container remove ea4d351352afbba0bd4e133a613974469520753cf351f2898773aee1bfaec1a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: Cluster is now healthy 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:active 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:active 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:active 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:active 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:33:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:31 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: Cluster is now healthy 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:active 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:active 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:active 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:active 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:31 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:32.007 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:31 smithi146 podman[87743]: 2024-07-26 13:33:31.638517946 +0000 UTC m=+0.949486266 container remove f8dfca4499a6c5b7f002f37dae4aff874f27ae1631d2525cfeb52f11a80730f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2) 2024-07-26T13:33:32.007 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:31 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: Cluster is now healthy 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3482143239,v1:172.21.15.76:6835/3482143239] up:active 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/694136309,v1:172.21.15.40:6839/694136309] up:active 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3170726419,v1:172.21.15.40:6841/3170726419] up:active 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/1374524390,v1:172.21.15.146:6835/1374524390] up:active 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:33:32.008 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:31 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:32.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:32 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:33:32.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:32 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 22.826s CPU time. 2024-07-26T13:33:32.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:33:32.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 20.285s CPU time. 2024-07-26T13:33:32.482 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:32 smithi040 podman[186263]: 2024-07-26 13:33:32.027186457 +0000 UTC m=+1.346580353 container remove daee5aef891f8e2fe85ec43ee66bede05afc2179997e17643b0b2e3dfe858dbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=) 2024-07-26T13:33:32.483 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:32 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:32.810 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:32 smithi040 ceph-mon[32397]: pgmap v2641: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 263 B/s wr, 24 op/s 2024-07-26T13:33:32.810 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:32 smithi040 podman[186264]: 2024-07-26 13:33:32.543926005 +0000 UTC m=+1.862699031 container remove d6c15625d5ca30f5f66acaee7a717cafb471ecb613a07a7ddd3380da6c89a6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:33:32.810 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:32 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:32 smithi146 ceph-mon[35807]: pgmap v2641: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 263 B/s wr, 24 op/s 2024-07-26T13:33:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:32 smithi076 ceph-mon[35401]: pgmap v2641: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 263 B/s wr, 24 op/s 2024-07-26T13:33:33.232 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:32 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:33:33.232 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:32 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 22.178s CPU time. 2024-07-26T13:33:33.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:32 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:33:33.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:32 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 22.474s CPU time. 2024-07-26T13:33:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:34 smithi040 ceph-mon[32397]: pgmap v2642: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 KiB/s wr, 36 op/s 2024-07-26T13:33:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:33:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:33:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:34 smithi146 ceph-mon[35807]: pgmap v2642: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 KiB/s wr, 36 op/s 2024-07-26T13:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:34 smithi076 ceph-mon[35401]: pgmap v2642: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 KiB/s wr, 36 op/s 2024-07-26T13:33:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:33:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:33:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:33:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:35 smithi040 ceph-mon[32397]: pgmap v2643: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 KiB/s wr, 35 op/s 2024-07-26T13:33:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:35 smithi040 ceph-mon[32397]: Health check failed: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T13:33:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:35 smithi146 ceph-mon[35807]: pgmap v2643: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 KiB/s wr, 35 op/s 2024-07-26T13:33:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:35 smithi146 ceph-mon[35807]: Health check failed: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T13:33:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:35 smithi076 ceph-mon[35401]: pgmap v2643: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 KiB/s wr, 35 op/s 2024-07-26T13:33:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:35 smithi076 ceph-mon[35401]: Health check failed: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T13:33:38.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:37 smithi076 ceph-mon[35401]: pgmap v2644: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 KiB/s wr, 31 op/s 2024-07-26T13:33:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:37 smithi040 ceph-mon[32397]: pgmap v2644: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 KiB/s wr, 31 op/s 2024-07-26T13:33:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:37 smithi146 ceph-mon[35807]: pgmap v2644: 97 pgs: 97 active+clean; 11 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 KiB/s wr, 31 op/s 2024-07-26T13:33:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:39 smithi040 ceph-mon[32397]: pgmap v2645: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 KiB/s wr, 29 op/s 2024-07-26T13:33:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:39 smithi146 ceph-mon[35807]: pgmap v2645: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 KiB/s wr, 29 op/s 2024-07-26T13:33:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:39 smithi076 ceph-mon[35401]: pgmap v2645: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 KiB/s wr, 29 op/s 2024-07-26T13:33:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:41 smithi040 ceph-mon[32397]: pgmap v2646: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 KiB/s wr, 30 op/s 2024-07-26T13:33:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:41 smithi146 ceph-mon[35807]: pgmap v2646: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 KiB/s wr, 30 op/s 2024-07-26T13:33:42.321 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:42.321 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 systemd[1]: Stopped Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:42.321 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 22.826s CPU time. 2024-07-26T13:33:42.321 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 systemd[1]: Starting Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:42.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:42.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 systemd[1]: Stopped Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:42.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 20.285s CPU time. 2024-07-26T13:33:42.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 systemd[1]: Starting Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:41 smithi076 ceph-mon[35401]: pgmap v2646: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 KiB/s wr, 30 op/s 2024-07-26T13:33:42.722 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 podman[88154]: 2024-07-26 13:33:42.371947659 +0000 UTC m=+0.031155610 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:42.722 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 podman[88154]: 2024-07-26 13:33:42.482897291 +0000 UTC m=+0.142105261 container create 972ad952d81e5f15c40b3f440a4c7d58c7774c1a6ee35ba13bbdfcdf9cfc4b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:42.722 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 podman[88154]: 2024-07-26 13:33:42.720440213 +0000 UTC m=+0.379648206 container init 972ad952d81e5f15c40b3f440a4c7d58c7774c1a6ee35ba13bbdfcdf9cfc4b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD) 2024-07-26T13:33:42.804 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 podman[86408]: 2024-07-26 13:33:42.380549404 +0000 UTC m=+0.032885271 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:42.804 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 podman[86408]: 2024-07-26 13:33:42.48859392 +0000 UTC m=+0.140929806 container create 748f7dc1e0658ab4bac8c9a32dc7ac01496adfa39947c8e3ab02482e7979f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T13:33:42.804 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 podman[86408]: 2024-07-26 13:33:42.801417402 +0000 UTC m=+0.453753343 container init 748f7dc1e0658ab4bac8c9a32dc7ac01496adfa39947c8e3ab02482e7979f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:33:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: daemon mds.f restarted 2024-07-26T13:33:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:33:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: osdmap e86: 12 total, 12 up, 12 in 2024-07-26T13:33:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:boot 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: Standby daemon mds.b assigned to filesystem cephfs as rank 0 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=a=up:active,3=g=up:active,4=e=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 podman[88154]: 2024-07-26 13:33:42.732878196 +0000 UTC m=+0.392086137 container start 972ad952d81e5f15c40b3f440a4c7d58c7774c1a6ee35ba13bbdfcdf9cfc4b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 bash[88154]: 972ad952d81e5f15c40b3f440a4c7d58c7774c1a6ee35ba13bbdfcdf9cfc4b9c 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 systemd[1]: Started Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:43.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-mds[88173]: -- 172.21.15.146:0/619931868 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5edfd5860 con 0x55a5f2177180 2024-07-26T13:33:43.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:33:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: starting mds.f at 2024-07-26T13:33:43.082 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 podman[86408]: 2024-07-26 13:33:42.815176079 +0000 UTC m=+0.467511939 container start 748f7dc1e0658ab4bac8c9a32dc7ac01496adfa39947c8e3ab02482e7979f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 bash[86408]: 748f7dc1e0658ab4bac8c9a32dc7ac01496adfa39947c8e3ab02482e7979f17d 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 systemd[1]: Started Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mds[86427]: -- 172.21.15.76:0/1023677989 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587eb5af860 con 0x5587ef751600 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: starting mds.e at 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: daemon mds.f restarted 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:33:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: osdmap e86: 12 total, 12 up, 12 in 2024-07-26T13:33:43.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:boot 2024-07-26T13:33:43.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: Standby daemon mds.b assigned to filesystem cephfs as rank 0 2024-07-26T13:33:43.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=a=up:active,3=g=up:active,4=e=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:33:43.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:42 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:33:43.232 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:43.232 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: Stopped Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 22.178s CPU time. 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:43 smithi040 systemd[1]: Starting Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 1. 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: Stopped Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 22.474s CPU time. 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:42 smithi040 systemd[1]: Starting Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:33:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: daemon mds.f restarted 2024-07-26T13:33:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:33:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: osdmap e86: 12 total, 12 up, 12 in 2024-07-26T13:33:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:boot 2024-07-26T13:33:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: Standby daemon mds.b assigned to filesystem cephfs as rank 0 2024-07-26T13:33:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=a=up:active,3=g=up:active,4=e=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:33:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:42 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:33:43.574 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:43 smithi040 podman[186797]: 2024-07-26 13:33:43.444083706 +0000 UTC m=+0.214683178 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:43.574 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:43 smithi040 podman[186773]: 2024-07-26 13:33:43.216867195 +0000 UTC m=+0.038308154 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:33:43.575 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:43 smithi040 podman[186773]: 2024-07-26 13:33:43.337048597 +0000 UTC m=+0.158489570 container create 201c5056f9967624a75e0a6c83295d6c5f77dd8200f27bb323f548b0c10019d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True) 2024-07-26T13:33:43.844 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:43 smithi040 podman[186797]: 2024-07-26 13:33:43.572923398 +0000 UTC m=+0.343522900 container create af9c12c4a6bf0d161f09b9ed257eef35358d7824174834f15302ee126d1bb2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-07-26T13:33:44.094 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:44 smithi040 podman[186797]: 2024-07-26 13:33:44.085916669 +0000 UTC m=+0.856516123 container init af9c12c4a6bf0d161f09b9ed257eef35358d7824174834f15302ee126d1bb2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: pgmap v2647: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 KiB/s wr, 31 op/s 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: daemon mds.e restarted 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: osdmap e87: 12 total, 12 up, 12 in 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:boot 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: Standby daemon mds.i assigned to filesystem cephfs as rank 4 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,2=a=up:active,3=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:33:44.095 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:43 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:33:44.096 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:43 smithi040 podman[186773]: 2024-07-26 13:33:43.843698433 +0000 UTC m=+0.665139409 container init 201c5056f9967624a75e0a6c83295d6c5f77dd8200f27bb323f548b0c10019d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:44.096 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:43 smithi040 podman[186773]: 2024-07-26 13:33:43.853259105 +0000 UTC m=+0.674700081 container start 201c5056f9967624a75e0a6c83295d6c5f77dd8200f27bb323f548b0c10019d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-07-26T13:33:44.096 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:43 smithi040 bash[186773]: 201c5056f9967624a75e0a6c83295d6c5f77dd8200f27bb323f548b0c10019d5 2024-07-26T13:33:44.096 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:43 smithi040 systemd[1]: Started Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:44.096 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mds[186823]: -- 172.21.15.40:0/2148337031 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560180d57c20 con 0x560184ef9180 2024-07-26T13:33:44.096 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: starting mds.a at 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: pgmap v2647: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 KiB/s wr, 31 op/s 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: daemon mds.e restarted 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: osdmap e87: 12 total, 12 up, 12 in 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:boot 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: Standby daemon mds.i assigned to filesystem cephfs as rank 4 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,2=a=up:active,3=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:33:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:43 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: pgmap v2647: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 KiB/s wr, 31 op/s 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: daemon mds.e restarted 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: osdmap e87: 12 total, 12 up, 12 in 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:boot 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: Standby daemon mds.i assigned to filesystem cephfs as rank 4 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,2=a=up:active,3=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:33:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:33:44.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:43 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:33:44.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:44 smithi040 podman[186797]: 2024-07-26 13:33:44.094112082 +0000 UTC m=+0.864711545 container start af9c12c4a6bf0d161f09b9ed257eef35358d7824174834f15302ee126d1bb2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.build-date=20240724, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T13:33:44.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:44 smithi040 bash[186797]: af9c12c4a6bf0d161f09b9ed257eef35358d7824174834f15302ee126d1bb2fe 2024-07-26T13:33:44.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:44 smithi040 systemd[1]: Started Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:33:44.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mds[186844]: -- 172.21.15.40:0/3078777182 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55712f1e9860 con 0x55713338b600 2024-07-26T13:33:44.484 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: starting mds.g at 2024-07-26T13:33:45.231 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:resolve 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 1 up:replay 1 up:resolve 3 up:active 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: daemon mds.a restarted 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: osdmap e88: 12 total, 12 up, 12 in 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:boot 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,3=g=up:active,4=i=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: daemon mds.g restarted 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: osdmap e89: 12 total, 12 up, 12 in 2024-07-26T13:33:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:boot 2024-07-26T13:33:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: Standby daemon mds.c assigned to filesystem cephfs as rank 3 2024-07-26T13:33:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,2=k=up:replay,4=i=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:33:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:33:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:44 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:resolve 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 1 up:replay 1 up:resolve 3 up:active 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: daemon mds.a restarted 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: osdmap e88: 12 total, 12 up, 12 in 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:boot 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-07-26T13:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,3=g=up:active,4=i=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: daemon mds.g restarted 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: osdmap e89: 12 total, 12 up, 12 in 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:boot 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: Standby daemon mds.c assigned to filesystem cephfs as rank 3 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,2=k=up:replay,4=i=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:33:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:44 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:resolve 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 1 up:replay 1 up:resolve 3 up:active 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: daemon mds.a restarted 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: osdmap e88: 12 total, 12 up, 12 in 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:boot 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,3=g=up:active,4=i=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: daemon mds.g restarted 2024-07-26T13:33:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: osdmap e89: 12 total, 12 up, 12 in 2024-07-26T13:33:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:boot 2024-07-26T13:33:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: Standby daemon mds.c assigned to filesystem cephfs as rank 3 2024-07-26T13:33:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=b=up:replay,1=h=up:active,2=k=up:replay,4=i=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:33:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:33:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:44 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:33:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:46 smithi146 ceph-mon[35807]: pgmap v2652: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 25 op/s 2024-07-26T13:33:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:46 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:resolve 2024-07-26T13:33:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:46 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:resolve 2024-07-26T13:33:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:46 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:33:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:46 smithi076 ceph-mon[35401]: pgmap v2652: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 25 op/s 2024-07-26T13:33:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:46 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:resolve 2024-07-26T13:33:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:46 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:resolve 2024-07-26T13:33:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:46 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:33:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:46 smithi040 ceph-mon[32397]: pgmap v2652: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 25 op/s 2024-07-26T13:33:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:46 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:resolve 2024-07-26T13:33:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:46 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:resolve 2024-07-26T13:33:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:46 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:33:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:48 smithi146 ceph-mon[35807]: pgmap v2653: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 15 op/s 2024-07-26T13:33:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:48 smithi076 ceph-mon[35401]: pgmap v2653: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 15 op/s 2024-07-26T13:33:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:48 smithi040 ceph-mon[32397]: pgmap v2653: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 15 op/s 2024-07-26T13:33:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:49 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:resolve 2024-07-26T13:33:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:49 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:33:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:49 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:resolve 2024-07-26T13:33:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:49 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:33:49.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:49 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:resolve 2024-07-26T13:33:49.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:49 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:33:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: pgmap v2654: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 0 B/s wr, 22 op/s 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.000999984 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00199997 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:reconnect 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:reconnect 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:reconnect 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:reconnect 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:33:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:50 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:33:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: pgmap v2654: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 0 B/s wr, 22 op/s 2024-07-26T13:33:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.000999984 2024-07-26T13:33:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00199997 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:reconnect 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:reconnect 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:reconnect 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:reconnect 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:33:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:50 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:33:50.659 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: pgmap v2654: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 0 B/s wr, 22 op/s 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.000999984 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00199997 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:reconnect 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:reconnect 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:reconnect 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:reconnect 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:33:50.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:50 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:33:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:rejoin 2024-07-26T13:33:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:rejoin 2024-07-26T13:33:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:rejoin 2024-07-26T13:33:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:rejoin 2024-07-26T13:33:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:33:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-mon[35401]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: *** Caught signal (Aborted) ** 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: in thread 7fc59ac00640 thread_name:ms_dispatch 2024-07-26T13:33:51.584 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a0e3e6f0] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc5a0e8b94c] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 3: raise() 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 4: abort() 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc5a0e2871b] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 6: /lib64/libc.so.6(+0x37386) [0x7fc5a0e37386] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ba36fe26b9] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ba371a080c] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ba370e02ca] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ba370b0753] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ba370b1a1b] 2024-07-26T13:33:51.585 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ba37095752] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ba36fe3a56] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ba36fe7637] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ba36fe7f5e] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ba36fcb03a] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc5a199b407] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 18: (DispatchQueue::entry()+0x60f) [0x7fc5a199bcf9] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc5a1a785a1] 2024-07-26T13:33:51.586 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: *** Caught signal (Aborted) ** 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: in thread 7f5461e00640 thread_name:ms_dispatch 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f546803e6f0] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f546808b94c] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 3: raise() 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 4: abort() 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 5: /lib64/libc.so.6(+0x2871b) [0x7f546802871b] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 6: /lib64/libc.so.6(+0x37386) [0x7f5468037386] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55996c15d6b9] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55996c31b80c] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55996c25b2ca] 2024-07-26T13:33:51.587 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55996c22b753] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55996c22ca1b] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55996c210752] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55996c15ea56] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55996c162637] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55996c162f5e] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55996c14603a] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5468b9b407] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 18: (DispatchQueue::entry()+0x60f) [0x7f5468b9bcf9] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5468c785a1] 2024-07-26T13:33:51.588 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 20: (Thread::entry_wrapper()+0x43) [0x7fc5a1825cdd] 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc5a1825cf9] 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc5a0e89c02] 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc5a0f0ec40] 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.326+0000 7fc59ac00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: in thread 7fc59ac00640 thread_name:ms_dispatch 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a0e3e6f0] 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc5a0e8b94c] 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 3: raise() 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 4: abort() 2024-07-26T13:33:51.589 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc5a0e2871b] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 6: /lib64/libc.so.6(+0x37386) [0x7fc5a0e37386] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ba36fe26b9] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ba371a080c] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ba370e02ca] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ba370b0753] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ba370b1a1b] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ba37095752] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ba36fe3a56] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ba36fe7637] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ba36fe7f5e] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ba36fcb03a] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc5a199b407] 2024-07-26T13:33:51.590 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 18: (DispatchQueue::entry()+0x60f) [0x7fc5a199bcf9] 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc5a1a785a1] 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 20: (Thread::entry_wrapper()+0x43) [0x7f5468a25cdd] 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5468a25cf9] 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5468089c02] 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f546810ec40] 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.334+0000 7f5461e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: in thread 7f5461e00640 thread_name:ms_dispatch 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.591 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f546803e6f0] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f546808b94c] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 3: raise() 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 4: abort() 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 5: /lib64/libc.so.6(+0x2871b) [0x7f546802871b] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 6: /lib64/libc.so.6(+0x37386) [0x7f5468037386] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55996c15d6b9] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55996c31b80c] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55996c25b2ca] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55996c22b753] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55996c22ca1b] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55996c210752] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55996c15ea56] 2024-07-26T13:33:51.592 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55996c162637] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55996c162f5e] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55996c14603a] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5468b9b407] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 18: (DispatchQueue::entry()+0x60f) [0x7f5468b9bcf9] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5468c785a1] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 20: (Thread::entry_wrapper()+0x43) [0x7fc5a1825cdd] 2024-07-26T13:33:51.593 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc5a1825cf9] 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc5a0e89c02] 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc5a0f0ec40] 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 0> 2024-07-26T13:33:51.326+0000 7fc59ac00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: in thread 7fc59ac00640 thread_name:ms_dispatch 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a0e3e6f0] 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc5a0e8b94c] 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 3: raise() 2024-07-26T13:33:51.594 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 4: abort() 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc5a0e2871b] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 6: /lib64/libc.so.6(+0x37386) [0x7fc5a0e37386] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ba36fe26b9] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ba371a080c] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ba370e02ca] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ba370b0753] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ba370b1a1b] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ba37095752] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ba36fe3a56] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ba36fe7637] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ba36fe7f5e] 2024-07-26T13:33:51.595 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ba36fcb03a] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc5a199b407] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 18: (DispatchQueue::entry()+0x60f) [0x7fc5a199bcf9] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc5a1a785a1] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 20: (Thread::entry_wrapper()+0x43) [0x7fc5a1825cdd] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc5a1825cf9] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc5a0e89c02] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc5a0f0ec40] 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 0> 2024-07-26T13:33:51.326+0000 7fc59ac00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: in thread 7fc59ac00640 thread_name:ms_dispatch 2024-07-26T13:33:51.596 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a0e3e6f0] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc5a0e8b94c] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 3: raise() 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 4: abort() 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc5a0e2871b] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 6: /lib64/libc.so.6(+0x37386) [0x7fc5a0e37386] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ba36fe26b9] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ba371a080c] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ba370e02ca] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ba370b0753] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ba370b1a1b] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ba37095752] 2024-07-26T13:33:51.597 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ba36fe3a56] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ba36fe7637] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ba36fe7f5e] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 20: (Thread::entry_wrapper()+0x43) [0x7f5468a25cdd] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5468a25cf9] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5468089c02] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f546810ec40] 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.598 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 0> 2024-07-26T13:33:51.334+0000 7f5461e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: in thread 7f5461e00640 thread_name:ms_dispatch 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f546803e6f0] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f546808b94c] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 3: raise() 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 4: abort() 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 5: /lib64/libc.so.6(+0x2871b) [0x7f546802871b] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 6: /lib64/libc.so.6(+0x37386) [0x7f5468037386] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55996c15d6b9] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55996c31b80c] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55996c25b2ca] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55996c22b753] 2024-07-26T13:33:51.599 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55996c22ca1b] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55996c210752] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55996c15ea56] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55996c162637] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55996c162f5e] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55996c14603a] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5468b9b407] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ba36fcb03a] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc5a199b407] 2024-07-26T13:33:51.600 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 18: (DispatchQueue::entry()+0x60f) [0x7fc5a199bcf9] 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc5a1a785a1] 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 20: (Thread::entry_wrapper()+0x43) [0x7fc5a1825cdd] 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc5a1825cf9] 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc5a0e89c02] 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc5a0f0ec40] 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[85761]: 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:51 smithi076 podman[86466]: 2024-07-26 13:33:51.46222319 +0000 UTC m=+0.042686553 container died eab1d400c570928407f0066d59093b980792e9155baaac88e3535418225e4e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:33:51.601 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 18: (DispatchQueue::entry()+0x60f) [0x7f5468b9bcf9] 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5468c785a1] 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 20: (Thread::entry_wrapper()+0x43) [0x7f5468a25cdd] 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5468a25cf9] 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5468089c02] 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f546810ec40] 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 0> 2024-07-26T13:33:51.334+0000 7f5461e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: in thread 7f5461e00640 thread_name:ms_dispatch 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.602 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f546803e6f0] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f546808b94c] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 3: raise() 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 4: abort() 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 5: /lib64/libc.so.6(+0x2871b) [0x7f546802871b] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 6: /lib64/libc.so.6(+0x37386) [0x7f5468037386] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55996c15d6b9] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55996c31b80c] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55996c25b2ca] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55996c22b753] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55996c22ca1b] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55996c210752] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55996c15ea56] 2024-07-26T13:33:51.603 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55996c162637] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55996c162f5e] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55996c14603a] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f5468b9b407] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 18: (DispatchQueue::entry()+0x60f) [0x7f5468b9bcf9] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f5468c785a1] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 20: (Thread::entry_wrapper()+0x43) [0x7f5468a25cdd] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5468a25cf9] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5468089c02] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f546810ec40] 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.604 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:51 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[85766]: 2024-07-26T13:33:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:rejoin 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:rejoin 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:rejoin 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:rejoin 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-07-26T13:33:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:51 smithi040 ceph-mon[32397]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-07-26T13:33:51.748 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:rejoin 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:rejoin 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:rejoin 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:rejoin 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-07-26T13:33:51.749 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-mon[35807]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: *** Caught signal (Aborted) ** 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: in thread 7f45f7400640 thread_name:ms_dispatch 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f45fd63e6f0] 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f45fd68b94c] 2024-07-26T13:33:51.751 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 3: raise() 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 4: abort() 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 5: /lib64/libc.so.6(+0x2871b) [0x7f45fd62871b] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 6: /lib64/libc.so.6(+0x37386) [0x7f45fd637386] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56551e3496b9] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56551e50780c] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56551e4472ca] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56551e417753] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56551e418a1b] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56551e3fc752] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56551e34aa56] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56551e34e637] 2024-07-26T13:33:51.752 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56551e34ef5e] 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56551e33203a] 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f45fe19b407] 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 18: (DispatchQueue::entry()+0x60f) [0x7f45fe19bcf9] 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f45fe2785a1] 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: *** Caught signal (Aborted) ** 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: in thread 7fad42000640 thread_name:ms_dispatch 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.753 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fad4823e6f0] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fad4828b94c] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 3: raise() 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 4: abort() 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 5: /lib64/libc.so.6(+0x2871b) [0x7fad4822871b] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 6: /lib64/libc.so.6(+0x37386) [0x7fad48237386] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650ce3ae6b9] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650ce56c80c] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650ce4ac2ca] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650ce47c753] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650ce47da1b] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650ce461752] 2024-07-26T13:33:51.754 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650ce3afa56] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650ce3b3637] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650ce3b3f5e] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650ce39703a] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fad48d9b407] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 18: (DispatchQueue::entry()+0x60f) [0x7fad48d9bcf9] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fad48e785a1] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 20: (Thread::entry_wrapper()+0x43) [0x7f45fe025cdd] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 21: (Thread::_entry_func(void*)+0xd) [0x7f45fe025cf9] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 22: /lib64/libc.so.6(+0x89c02) [0x7f45fd689c02] 2024-07-26T13:33:51.755 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f45fd70ec40] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.326+0000 7f45f7400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: in thread 7f45f7400640 thread_name:ms_dispatch 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f45fd63e6f0] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f45fd68b94c] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 3: raise() 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 4: abort() 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 5: /lib64/libc.so.6(+0x2871b) [0x7f45fd62871b] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 6: /lib64/libc.so.6(+0x37386) [0x7f45fd637386] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56551e3496b9] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56551e50780c] 2024-07-26T13:33:51.756 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56551e4472ca] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56551e417753] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56551e418a1b] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56551e3fc752] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56551e34aa56] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56551e34e637] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56551e34ef5e] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56551e33203a] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f45fe19b407] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 18: (DispatchQueue::entry()+0x60f) [0x7f45fe19bcf9] 2024-07-26T13:33:51.757 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f45fe2785a1] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 20: (Thread::entry_wrapper()+0x43) [0x7fad48c25cdd] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 21: (Thread::_entry_func(void*)+0xd) [0x7fad48c25cf9] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 22: /lib64/libc.so.6(+0x89c02) [0x7fad48289c02] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fad4830ec40] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.325+0000 7fad42000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: in thread 7fad42000640 thread_name:ms_dispatch 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fad4823e6f0] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fad4828b94c] 2024-07-26T13:33:51.758 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 3: raise() 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 4: abort() 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 5: /lib64/libc.so.6(+0x2871b) [0x7fad4822871b] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 6: /lib64/libc.so.6(+0x37386) [0x7fad48237386] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650ce3ae6b9] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650ce56c80c] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650ce4ac2ca] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650ce47c753] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650ce47da1b] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650ce461752] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650ce3afa56] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650ce3b3637] 2024-07-26T13:33:51.759 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650ce3b3f5e] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650ce39703a] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fad48d9b407] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 18: (DispatchQueue::entry()+0x60f) [0x7fad48d9bcf9] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fad48e785a1] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 20: (Thread::entry_wrapper()+0x43) [0x7f45fe025cdd] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 21: (Thread::_entry_func(void*)+0xd) [0x7f45fe025cf9] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 22: /lib64/libc.so.6(+0x89c02) [0x7f45fd689c02] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f45fd70ec40] 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.760 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 0> 2024-07-26T13:33:51.326+0000 7f45f7400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: in thread 7f45f7400640 thread_name:ms_dispatch 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f45fd63e6f0] 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f45fd68b94c] 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 3: raise() 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 4: abort() 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 5: /lib64/libc.so.6(+0x2871b) [0x7f45fd62871b] 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 6: /lib64/libc.so.6(+0x37386) [0x7f45fd637386] 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56551e3496b9] 2024-07-26T13:33:51.761 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56551e50780c] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56551e4472ca] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56551e417753] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56551e418a1b] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56551e3fc752] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56551e34aa56] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56551e34e637] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56551e34ef5e] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56551e33203a] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f45fe19b407] 2024-07-26T13:33:51.762 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 20: (Thread::entry_wrapper()+0x43) [0x7fad48c25cdd] 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 21: (Thread::_entry_func(void*)+0xd) [0x7fad48c25cf9] 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 22: /lib64/libc.so.6(+0x89c02) [0x7fad48289c02] 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fad4830ec40] 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 0> 2024-07-26T13:33:51.325+0000 7fad42000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: in thread 7fad42000640 thread_name:ms_dispatch 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fad4823e6f0] 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fad4828b94c] 2024-07-26T13:33:51.763 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 3: raise() 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 4: abort() 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 5: /lib64/libc.so.6(+0x2871b) [0x7fad4822871b] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 6: /lib64/libc.so.6(+0x37386) [0x7fad48237386] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650ce3ae6b9] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650ce56c80c] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650ce4ac2ca] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650ce47c753] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650ce47da1b] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650ce461752] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650ce3afa56] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650ce3b3637] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650ce3b3f5e] 2024-07-26T13:33:51.764 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650ce39703a] 2024-07-26T13:33:51.765 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fad48d9b407] 2024-07-26T13:33:51.765 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 18: (DispatchQueue::entry()+0x60f) [0x7f45fe19bcf9] 2024-07-26T13:33:51.765 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f45fe2785a1] 2024-07-26T13:33:51.765 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 20: (Thread::entry_wrapper()+0x43) [0x7f45fe025cdd] 2024-07-26T13:33:51.765 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 21: (Thread::_entry_func(void*)+0xd) [0x7f45fe025cf9] 2024-07-26T13:33:51.765 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 22: /lib64/libc.so.6(+0x89c02) [0x7f45fd689c02] 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f45fd70ec40] 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: -1> 2024-07-26T13:33:51.326+0000 7f45f7400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: in thread 7f45f7400640 thread_name:ms_dispatch 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f45fd63e6f0] 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f45fd68b94c] 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 3: raise() 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 4: abort() 2024-07-26T13:33:51.766 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 5: /lib64/libc.so.6(+0x2871b) [0x7f45fd62871b] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 6: /lib64/libc.so.6(+0x37386) [0x7f45fd637386] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56551e3496b9] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x56551e50780c] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x56551e4472ca] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x56551e417753] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x56551e418a1b] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x56551e3fc752] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56551e34aa56] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56551e34e637] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56551e34ef5e] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56551e33203a] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f45fe19b407] 2024-07-26T13:33:51.767 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 18: (DispatchQueue::entry()+0x60f) [0x7f45fe19bcf9] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f45fe2785a1] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 20: (Thread::entry_wrapper()+0x43) [0x7f45fe025cdd] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 21: (Thread::_entry_func(void*)+0xd) [0x7f45fe025cf9] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 22: /lib64/libc.so.6(+0x89c02) [0x7f45fd689c02] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f45fd70ec40] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[87455]: 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 18: (DispatchQueue::entry()+0x60f) [0x7fad48d9bcf9] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fad48e785a1] 2024-07-26T13:33:51.768 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 20: (Thread::entry_wrapper()+0x43) [0x7fad48c25cdd] 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 21: (Thread::_entry_func(void*)+0xd) [0x7fad48c25cf9] 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 22: /lib64/libc.so.6(+0x89c02) [0x7fad48289c02] 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fad4830ec40] 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: -4> 2024-07-26T13:33:51.325+0000 7fad42000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: in thread 7fad42000640 thread_name:ms_dispatch 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fad4823e6f0] 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fad4828b94c] 2024-07-26T13:33:51.769 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 3: raise() 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 4: abort() 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 5: /lib64/libc.so.6(+0x2871b) [0x7fad4822871b] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 6: /lib64/libc.so.6(+0x37386) [0x7fad48237386] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5650ce3ae6b9] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5650ce56c80c] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5650ce4ac2ca] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5650ce47c753] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5650ce47da1b] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5650ce461752] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5650ce3afa56] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5650ce3b3637] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5650ce3b3f5e] 2024-07-26T13:33:51.770 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5650ce39703a] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fad48d9b407] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 18: (DispatchQueue::entry()+0x60f) [0x7fad48d9bcf9] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fad48e785a1] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 20: (Thread::entry_wrapper()+0x43) [0x7fad48c25cdd] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 21: (Thread::_entry_func(void*)+0xd) [0x7fad48c25cf9] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 22: /lib64/libc.so.6(+0x89c02) [0x7fad48289c02] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fad4830ec40] 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[87526]: 2024-07-26T13:33:51.771 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:51 smithi146 podman[88210]: 2024-07-26 13:33:51.454725115 +0000 UTC m=+0.037766068 container died 48ae700d9ede724689dcac012c429fa69f8eccb3b460321445c22d645b46646a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:52.432 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:52 smithi146 podman[88210]: 2024-07-26 13:33:52.147584401 +0000 UTC m=+0.730625360 container remove 48ae700d9ede724689dcac012c429fa69f8eccb3b460321445c22d645b46646a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:33:52.432 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:52 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:52 smithi146 podman[88211]: 2024-07-26 13:33:52.188028224 +0000 UTC m=+0.765047397 container died 372b0dce466dd0592bc698475198d232e845f7b5a732a21ef10c95aca6613ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: pgmap v2655: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 0 B/s wr, 22 op/s 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:active 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:active 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:active 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:active 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:33:52.433 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:52 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:52.567 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:52 smithi076 podman[86472]: 2024-07-26 13:33:52.204323205 +0000 UTC m=+0.769835554 container died cd6760496d6b29145b6464a2d8daebca158cf07912fbdf45c83e91ec01ce9fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:52.567 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: pgmap v2655: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 0 B/s wr, 22 op/s 2024-07-26T13:33:52.567 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:33:52.567 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:active 2024-07-26T13:33:52.567 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:active 2024-07-26T13:33:52.567 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:active 2024-07-26T13:33:52.568 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:active 2024-07-26T13:33:52.568 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:33:52.568 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:52 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:52.568 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:52 smithi076 podman[86466]: 2024-07-26 13:33:52.146592052 +0000 UTC m=+0.727055436 container remove eab1d400c570928407f0066d59093b980792e9155baaac88e3535418225e4e7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-07-26T13:33:52.568 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:52 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: pgmap v2655: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 0 B/s wr, 22 op/s 2024-07-26T13:33:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:33:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3850522012,v1:172.21.15.146:6839/3850522012] up:active 2024-07-26T13:33:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3522272509,v1:172.21.15.146:6837/3522272509] up:active 2024-07-26T13:33:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/1983243831,v1:172.21.15.76:6833/1983243831] up:active 2024-07-26T13:33:52.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2225657026,v1:172.21.15.76:6839/2225657026] up:active 2024-07-26T13:33:52.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:33:52.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:52 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:33:53.052 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:52 smithi146 podman[88211]: 2024-07-26 13:33:52.751534826 +0000 UTC m=+1.328554027 container remove 372b0dce466dd0592bc698475198d232e845f7b5a732a21ef10c95aca6613ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T13:33:53.053 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:52 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:53.259 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:52 smithi076 podman[86472]: 2024-07-26 13:33:52.892697359 +0000 UTC m=+1.458209697 container remove cd6760496d6b29145b6464a2d8daebca158cf07912fbdf45c83e91ec01ce9fc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-07-26T13:33:53.259 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:52 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:33:53.259 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:53 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:33:53.259 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:33:53 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 1.557s CPU time. 2024-07-26T13:33:53.320 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:53 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:33:53.320 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:33:53 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.559s CPU time. 2024-07-26T13:33:53.320 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:53 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:33:53.320 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:33:53 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.478s CPU time. 2024-07-26T13:33:53.582 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:53 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:33:53.582 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:33:53 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 2.239s CPU time. 2024-07-26T13:33:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:54 smithi076 ceph-mon[35401]: pgmap v2656: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 468 B/s wr, 27 op/s 2024-07-26T13:33:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:54 smithi040 ceph-mon[32397]: pgmap v2656: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 468 B/s wr, 27 op/s 2024-07-26T13:33:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:54 smithi146 ceph-mon[35807]: pgmap v2656: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 468 B/s wr, 27 op/s 2024-07-26T13:33:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:56 smithi040 ceph-mon[32397]: pgmap v2657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 772 B/s wr, 29 op/s 2024-07-26T13:33:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:56 smithi146 ceph-mon[35807]: pgmap v2657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 772 B/s wr, 29 op/s 2024-07-26T13:33:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:56 smithi076 ceph-mon[35401]: pgmap v2657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 772 B/s wr, 29 op/s 2024-07-26T13:33:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:33:58 smithi040 ceph-mon[32397]: pgmap v2658: 97 pgs: 97 active+clean; 9.9 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 24 op/s 2024-07-26T13:33:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:33:58 smithi146 ceph-mon[35807]: pgmap v2658: 97 pgs: 97 active+clean; 9.9 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 24 op/s 2024-07-26T13:33:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:33:58 smithi076 ceph-mon[35401]: pgmap v2658: 97 pgs: 97 active+clean; 9.9 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 24 op/s 2024-07-26T13:34:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:00 smithi040 ceph-mon[32397]: pgmap v2659: 97 pgs: 97 active+clean; 9.7 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 767 B/s wr, 28 op/s 2024-07-26T13:34:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:00 smithi146 ceph-mon[35807]: pgmap v2659: 97 pgs: 97 active+clean; 9.7 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 767 B/s wr, 28 op/s 2024-07-26T13:34:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:00 smithi076 ceph-mon[35401]: pgmap v2659: 97 pgs: 97 active+clean; 9.7 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 767 B/s wr, 28 op/s 2024-07-26T13:34:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:02 smithi040 ceph-mon[32397]: pgmap v2660: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 767 B/s wr, 27 op/s 2024-07-26T13:34:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:02 smithi146 ceph-mon[35807]: pgmap v2660: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 767 B/s wr, 27 op/s 2024-07-26T13:34:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:02 smithi076 ceph-mon[35401]: pgmap v2660: 97 pgs: 97 active+clean; 9.6 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 767 B/s wr, 27 op/s 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: Stopped Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.559s CPU time. 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: Starting Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: Stopped Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:03.343 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.478s CPU time. 2024-07-26T13:34:03.677 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: Starting Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:03.678 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 podman[88347]: 2024-07-26 13:34:03.384343502 +0000 UTC m=+0.034467376 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:03.678 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 podman[88347]: 2024-07-26 13:34:03.493636425 +0000 UTC m=+0.143760347 container create 885100ced0e1cb74955fd53cc362c3ee79f266eaca3a5a55434465d74e562382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-26T13:34:03.744 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:03.744 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: Stopped Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:03.744 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 2.239s CPU time. 2024-07-26T13:34:03.744 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: Starting Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:03.745 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:03.745 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: Stopped Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:03.745 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 1.557s CPU time. 2024-07-26T13:34:03.745 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:03 smithi076 systemd[1]: Starting Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:04.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 podman[88347]: 2024-07-26 13:34:03.747997188 +0000 UTC m=+0.398121110 container init 885100ced0e1cb74955fd53cc362c3ee79f266eaca3a5a55434465d74e562382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:34:04.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 podman[88347]: 2024-07-26 13:34:03.757149094 +0000 UTC m=+0.407272967 container start 885100ced0e1cb74955fd53cc362c3ee79f266eaca3a5a55434465d74e562382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-26T13:34:04.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 bash[88347]: 885100ced0e1cb74955fd53cc362c3ee79f266eaca3a5a55434465d74e562382 2024-07-26T13:34:04.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 systemd[1]: Started Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:04.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 ceph-mds[88389]: -- 172.21.15.146:0/1166338014 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56229f86d860 con 0x5622a3a0f600 2024-07-26T13:34:04.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:03 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: starting mds.c at 2024-07-26T13:34:04.078 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:03 smithi076 podman[86661]: 2024-07-26 13:34:03.652411107 +0000 UTC m=+0.038536166 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:04.078 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:03 smithi076 podman[86661]: 2024-07-26 13:34:03.902950715 +0000 UTC m=+0.289075814 container create ff6abca46392d7d9a3e6e2d35c371dee37cc57012325e64b5ff2c603670827fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-07-26T13:34:04.078 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:03 smithi076 podman[86662]: 2024-07-26 13:34:03.650572427 +0000 UTC m=+0.035740403 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:04.079 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:03 smithi076 podman[86662]: 2024-07-26 13:34:03.793945823 +0000 UTC m=+0.179113822 container create 84635c475ca560683f38667f3b4cd78041dc26875670cc122dd327f18b932cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:34:04.320 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 podman[88430]: 2024-07-26 13:34:03.966954007 +0000 UTC m=+0.031329382 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:04.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 podman[88430]: 2024-07-26 13:34:04.08865096 +0000 UTC m=+0.153026339 container create 6b6421e872d8a985dc1a428133e31b1ebd60a8a4355238fc639a7e94bfbac6c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True) 2024-07-26T13:34:04.425 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:04 smithi076 podman[86661]: 2024-07-26 13:34:04.308750674 +0000 UTC m=+0.694875790 container init ff6abca46392d7d9a3e6e2d35c371dee37cc57012325e64b5ff2c603670827fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-07-26T13:34:04.425 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:04 smithi076 podman[86661]: 2024-07-26 13:34:04.318753351 +0000 UTC m=+0.704878403 container start ff6abca46392d7d9a3e6e2d35c371dee37cc57012325e64b5ff2c603670827fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-07-26T13:34:04.426 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:04 smithi076 podman[86662]: 2024-07-26 13:34:04.19992287 +0000 UTC m=+0.585090873 container init 84635c475ca560683f38667f3b4cd78041dc26875670cc122dd327f18b932cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-26T13:34:04.426 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:04 smithi076 podman[86662]: 2024-07-26 13:34:04.209619852 +0000 UTC m=+0.594787826 container start 84635c475ca560683f38667f3b4cd78041dc26875670cc122dd327f18b932cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-07-26T13:34:04.426 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mds[86697]: -- 172.21.15.76:0/83223394 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ce0049c20 con 0x560ce41eb600 2024-07-26T13:34:04.426 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: starting mds.b at 2024-07-26T13:34:04.426 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:04 smithi076 bash[86662]: 84635c475ca560683f38667f3b4cd78041dc26875670cc122dd327f18b932cc5 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: pgmap v2661: 97 pgs: 97 active+clean; 9.5 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 852 B/s wr, 29 op/s 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: daemon mds.c restarted 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: osdmap e90: 12 total, 12 up, 12 in 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:boot 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: Standby daemon mds.g assigned to filesystem cephfs as rank 3 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=b=up:active,1=h=up:active,2=k=up:active,4=i=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: daemon mds.b restarted 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: osdmap e91: 12 total, 12 up, 12 in 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:boot 2024-07-26T13:34:04.427 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:34:04.428 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=k=up:active,3=g=up:replay,4=i=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:04.428 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:34:04.428 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: pgmap v2661: 97 pgs: 97 active+clean; 9.5 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 852 B/s wr, 29 op/s 2024-07-26T13:34:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: daemon mds.c restarted 2024-07-26T13:34:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: osdmap e90: 12 total, 12 up, 12 in 2024-07-26T13:34:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:boot 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: Standby daemon mds.g assigned to filesystem cephfs as rank 3 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=b=up:active,1=h=up:active,2=k=up:active,4=i=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: daemon mds.b restarted 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: osdmap e91: 12 total, 12 up, 12 in 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:boot 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=k=up:active,3=g=up:replay,4=i=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:34:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:04 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:04.815 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:04 smithi076 systemd[1]: Started Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:04.815 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-mds[86707]: -- 172.21.15.76:0/2055698159 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d1fec8f860 con 0x55d202e31180 2024-07-26T13:34:04.815 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:04 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: starting mds.k at 2024-07-26T13:34:04.815 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:04 smithi076 bash[86661]: ff6abca46392d7d9a3e6e2d35c371dee37cc57012325e64b5ff2c603670827fb 2024-07-26T13:34:04.815 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:04 smithi076 systemd[1]: Started Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 podman[88430]: 2024-07-26 13:34:04.342384293 +0000 UTC m=+0.406759697 container init 6b6421e872d8a985dc1a428133e31b1ebd60a8a4355238fc639a7e94bfbac6c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 podman[88430]: 2024-07-26 13:34:04.353812832 +0000 UTC m=+0.418188219 container start 6b6421e872d8a985dc1a428133e31b1ebd60a8a4355238fc639a7e94bfbac6c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD) 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 bash[88430]: 6b6421e872d8a985dc1a428133e31b1ebd60a8a4355238fc639a7e94bfbac6c7 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 systemd[1]: Started Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: starting mds.i at 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: pgmap v2661: 97 pgs: 97 active+clean; 9.5 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 852 B/s wr, 29 op/s 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: daemon mds.c restarted 2024-07-26T13:34:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: osdmap e90: 12 total, 12 up, 12 in 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:boot 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: Standby daemon mds.g assigned to filesystem cephfs as rank 3 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=b=up:active,1=h=up:active,2=k=up:active,4=i=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: daemon mds.b restarted 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: osdmap e91: 12 total, 12 up, 12 in 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:boot 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:34:04.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=k=up:active,3=g=up:replay,4=i=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:04.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:34:04.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:04 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: daemon mds.k restarted 2024-07-26T13:34:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: osdmap e92: 12 total, 12 up, 12 in 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:boot 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=e=up:replay,1=h=up:active,3=g=up:replay,4=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 3 up:replay 2 up:active 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: daemon mds.i restarted 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: osdmap e93: 12 total, 12 up, 12 in 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:boot 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: Standby daemon mds.a assigned to filesystem cephfs as rank 4 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=e=up:replay,1=h=up:active,2=f=up:replay,3=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:34:05.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:05 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:replay 1 up:active 2024-07-26T13:34:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: daemon mds.k restarted 2024-07-26T13:34:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: osdmap e92: 12 total, 12 up, 12 in 2024-07-26T13:34:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:boot 2024-07-26T13:34:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:34:05.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=e=up:replay,1=h=up:active,3=g=up:replay,4=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:05.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:34:05.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 3 up:replay 2 up:active 2024-07-26T13:34:05.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: daemon mds.i restarted 2024-07-26T13:34:05.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: osdmap e93: 12 total, 12 up, 12 in 2024-07-26T13:34:05.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:boot 2024-07-26T13:34:05.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: Standby daemon mds.a assigned to filesystem cephfs as rank 4 2024-07-26T13:34:05.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=e=up:replay,1=h=up:active,2=f=up:replay,3=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:05.825 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:34:05.825 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:05 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:replay 1 up:active 2024-07-26T13:34:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: daemon mds.k restarted 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: osdmap e92: 12 total, 12 up, 12 in 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:boot 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=e=up:replay,1=h=up:active,3=g=up:replay,4=i=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 3 up:replay 2 up:active 2024-07-26T13:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: daemon mds.i restarted 2024-07-26T13:34:05.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: osdmap e93: 12 total, 12 up, 12 in 2024-07-26T13:34:05.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:boot 2024-07-26T13:34:05.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: Standby daemon mds.a assigned to filesystem cephfs as rank 4 2024-07-26T13:34:05.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=e=up:replay,1=h=up:active,2=f=up:replay,3=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:05.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:34:05.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:05 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:replay 1 up:active 2024-07-26T13:34:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:06 smithi146 ceph-mon[35807]: pgmap v2666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 24 op/s 2024-07-26T13:34:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:resolve 2024-07-26T13:34:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:resolve 2024-07-26T13:34:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:resolve 2024-07-26T13:34:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:06 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:06 smithi076 ceph-mon[35401]: pgmap v2666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 24 op/s 2024-07-26T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:resolve 2024-07-26T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:resolve 2024-07-26T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:resolve 2024-07-26T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:06 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:34:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:06 smithi040 ceph-mon[32397]: pgmap v2666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 24 op/s 2024-07-26T13:34:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:resolve 2024-07-26T13:34:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:resolve 2024-07-26T13:34:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:resolve 2024-07-26T13:34:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:06 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:34:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:08 smithi146 ceph-mon[35807]: pgmap v2667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-07-26T13:34:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:08 smithi076 ceph-mon[35401]: pgmap v2667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-07-26T13:34:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:08 smithi040 ceph-mon[32397]: pgmap v2667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-07-26T13:34:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:09 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:resolve 2024-07-26T13:34:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:09 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:09 smithi146 ceph-mon[35807]: pgmap v2668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-07-26T13:34:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:09 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:resolve 2024-07-26T13:34:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:09 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:09 smithi076 ceph-mon[35401]: pgmap v2668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-07-26T13:34:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:09 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:resolve 2024-07-26T13:34:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:09 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:09 smithi040 ceph-mon[32397]: pgmap v2668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299991 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:reconnect 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:reconnect 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:reconnect 2024-07-26T13:34:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:reconnect 2024-07-26T13:34:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:rejoin 2024-07-26T13:34:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:rejoin 2024-07-26T13:34:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:rejoin 2024-07-26T13:34:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:rejoin 2024-07-26T13:34:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:10 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:34:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299991 2024-07-26T13:34:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:34:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:34:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:reconnect 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:reconnect 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:reconnect 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:reconnect 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:rejoin 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:rejoin 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:rejoin 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:rejoin 2024-07-26T13:34:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:10 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:34:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299991 2024-07-26T13:34:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:34:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:34:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:reconnect 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:reconnect 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:reconnect 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:reconnect 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:rejoin 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:rejoin 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:rejoin 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:rejoin 2024-07-26T13:34:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:10 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-mon[32397]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-07-26T13:34:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-mon[32397]: daemon mds.g is now active in filesystem cephfs as rank 3 2024-07-26T13:34:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-mon[32397]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:34:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-mon[32397]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:34:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-mon[32397]: pgmap v2669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T13:34:11.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:11.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: *** Caught signal (Aborted) ** 2024-07-26T13:34:11.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: in thread 7f7578c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f757ee3e6f0] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f757ee8b94c] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 3: raise() 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 4: abort() 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 5: /lib64/libc.so.6(+0x2871b) [0x7f757ee2871b] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 6: /lib64/libc.so.6(+0x37386) [0x7f757ee37386] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560168b6a6b9] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560168d2880c] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560168c682ca] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560168c38753] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560168c39a1b] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560168c1d752] 2024-07-26T13:34:11.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560168b6ba56] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560168b6f637] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560168b6ff5e] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560168b5303a] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f757f99b407] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 18: (DispatchQueue::entry()+0x60f) [0x7f757f99bcf9] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f757fa785a1] 2024-07-26T13:34:11.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: *** Caught signal (Aborted) ** 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: in thread 7f36c4c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f36cae3e6f0] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f36cae8b94c] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 3: raise() 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 4: abort() 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 5: /lib64/libc.so.6(+0x2871b) [0x7f36cae2871b] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 6: /lib64/libc.so.6(+0x37386) [0x7f36cae37386] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5570f18526b9] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5570f1a1080c] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5570f19502ca] 2024-07-26T13:34:11.987 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5570f1920753] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5570f1921a1b] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5570f1905752] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5570f1853a56] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5570f1857637] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5570f1857f5e] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5570f183b03a] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f36cb99b407] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 18: (DispatchQueue::entry()+0x60f) [0x7f36cb99bcf9] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f36cba785a1] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 20: (Thread::entry_wrapper()+0x43) [0x7f757f825cdd] 2024-07-26T13:34:11.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 21: (Thread::_entry_func(void*)+0xd) [0x7f757f825cf9] 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 22: /lib64/libc.so.6(+0x89c02) [0x7f757ee89c02] 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f757ef0ec40] 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:11.590+0000 7f7578c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: in thread 7f7578c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f757ee3e6f0] 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f757ee8b94c] 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 3: raise() 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 4: abort() 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 5: /lib64/libc.so.6(+0x2871b) [0x7f757ee2871b] 2024-07-26T13:34:11.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 6: /lib64/libc.so.6(+0x37386) [0x7f757ee37386] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560168b6a6b9] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560168d2880c] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560168c682ca] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560168c38753] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560168c39a1b] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560168c1d752] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560168b6ba56] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560168b6f637] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560168b6ff5e] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560168b5303a] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f757f99b407] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 18: (DispatchQueue::entry()+0x60f) [0x7f757f99bcf9] 2024-07-26T13:34:11.990 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f757fa785a1] 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 20: (Thread::entry_wrapper()+0x43) [0x7f36cb825cdd] 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 21: (Thread::_entry_func(void*)+0xd) [0x7f36cb825cf9] 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 22: /lib64/libc.so.6(+0x89c02) [0x7f36cae89c02] 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f36caf0ec40] 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:11.587+0000 7f36c4c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: in thread 7f36c4c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f36cae3e6f0] 2024-07-26T13:34:11.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f36cae8b94c] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 3: raise() 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 4: abort() 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 5: /lib64/libc.so.6(+0x2871b) [0x7f36cae2871b] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 6: /lib64/libc.so.6(+0x37386) [0x7f36cae37386] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5570f18526b9] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5570f1a1080c] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5570f19502ca] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5570f1920753] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5570f1921a1b] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5570f1905752] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5570f1853a56] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5570f1857637] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5570f1857f5e] 2024-07-26T13:34:11.992 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5570f183b03a] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f36cb99b407] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 18: (DispatchQueue::entry()+0x60f) [0x7f36cb99bcf9] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f36cba785a1] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 20: (Thread::entry_wrapper()+0x43) [0x7f757f825cdd] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 21: (Thread::_entry_func(void*)+0xd) [0x7f757f825cf9] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 22: /lib64/libc.so.6(+0x89c02) [0x7f757ee89c02] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f757ef0ec40] 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:11.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 0> 2024-07-26T13:34:11.590+0000 7f7578c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: in thread 7f7578c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f757ee3e6f0] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f757ee8b94c] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 3: raise() 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 4: abort() 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 5: /lib64/libc.so.6(+0x2871b) [0x7f757ee2871b] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 6: /lib64/libc.so.6(+0x37386) [0x7f757ee37386] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560168b6a6b9] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560168d2880c] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560168c682ca] 2024-07-26T13:34:11.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560168c38753] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560168c39a1b] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560168c1d752] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560168b6ba56] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560168b6f637] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560168b6ff5e] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560168b5303a] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 20: (Thread::entry_wrapper()+0x43) [0x7f36cb825cdd] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 21: (Thread::_entry_func(void*)+0xd) [0x7f36cb825cf9] 2024-07-26T13:34:11.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 22: /lib64/libc.so.6(+0x89c02) [0x7f36cae89c02] 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f36caf0ec40] 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 0> 2024-07-26T13:34:11.587+0000 7f36c4c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: in thread 7f36c4c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f36cae3e6f0] 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f36cae8b94c] 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 3: raise() 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 4: abort() 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 5: /lib64/libc.so.6(+0x2871b) [0x7f36cae2871b] 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 6: /lib64/libc.so.6(+0x37386) [0x7f36cae37386] 2024-07-26T13:34:11.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5570f18526b9] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5570f1a1080c] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5570f19502ca] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5570f1920753] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5570f1921a1b] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5570f1905752] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5570f1853a56] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5570f1857637] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5570f1857f5e] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5570f183b03a] 2024-07-26T13:34:11.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f757f99b407] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 18: (DispatchQueue::entry()+0x60f) [0x7f757f99bcf9] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f757fa785a1] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 20: (Thread::entry_wrapper()+0x43) [0x7f757f825cdd] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 21: (Thread::_entry_func(void*)+0xd) [0x7f757f825cf9] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 22: /lib64/libc.so.6(+0x89c02) [0x7f757ee89c02] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f757ef0ec40] 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 0> 2024-07-26T13:34:11.590+0000 7f7578c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: in thread 7f7578c00640 thread_name:ms_dispatch 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:11.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f757ee3e6f0] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f757ee8b94c] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 3: raise() 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 4: abort() 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 5: /lib64/libc.so.6(+0x2871b) [0x7f757ee2871b] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 6: /lib64/libc.so.6(+0x37386) [0x7f757ee37386] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560168b6a6b9] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560168d2880c] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560168c682ca] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560168c38753] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560168c39a1b] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560168c1d752] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560168b6ba56] 2024-07-26T13:34:11.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560168b6f637] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f36cb99b407] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 18: (DispatchQueue::entry()+0x60f) [0x7f36cb99bcf9] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f36cba785a1] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 20: (Thread::entry_wrapper()+0x43) [0x7f36cb825cdd] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 21: (Thread::_entry_func(void*)+0xd) [0x7f36cb825cf9] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 22: /lib64/libc.so.6(+0x89c02) [0x7f36cae89c02] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f36caf0ec40] 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:12.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 0> 2024-07-26T13:34:11.587+0000 7f36c4c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: in thread 7f36c4c00640 thread_name:ms_dispatch 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f36cae3e6f0] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f36cae8b94c] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 3: raise() 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 4: abort() 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 5: /lib64/libc.so.6(+0x2871b) [0x7f36cae2871b] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 6: /lib64/libc.so.6(+0x37386) [0x7f36cae37386] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5570f18526b9] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5570f1a1080c] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5570f19502ca] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5570f1920753] 2024-07-26T13:34:12.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5570f1921a1b] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5570f1905752] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5570f1853a56] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5570f1857637] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560168b6ff5e] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560168b5303a] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f757f99b407] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 18: (DispatchQueue::entry()+0x60f) [0x7f757f99bcf9] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f757fa785a1] 2024-07-26T13:34:12.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 20: (Thread::entry_wrapper()+0x43) [0x7f757f825cdd] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 21: (Thread::_entry_func(void*)+0xd) [0x7f757f825cf9] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 22: /lib64/libc.so.6(+0x89c02) [0x7f757ee89c02] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f757ef0ec40] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[186814]: 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5570f1857f5e] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5570f183b03a] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f36cb99b407] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 18: (DispatchQueue::entry()+0x60f) [0x7f36cb99bcf9] 2024-07-26T13:34:12.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f36cba785a1] 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 20: (Thread::entry_wrapper()+0x43) [0x7f36cb825cdd] 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 21: (Thread::_entry_func(void*)+0xd) [0x7f36cb825cf9] 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 22: /lib64/libc.so.6(+0x89c02) [0x7f36cae89c02] 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f36caf0ec40] 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[186819]: 2024-07-26T13:34:12.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:11 smithi040 podman[186908]: 2024-07-26 13:34:11.742975776 +0000 UTC m=+0.039058626 container died af9c12c4a6bf0d161f09b9ed257eef35358d7824174834f15302ee126d1bb2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=) 2024-07-26T13:34:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-mon[35807]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-07-26T13:34:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-mon[35807]: daemon mds.g is now active in filesystem cephfs as rank 3 2024-07-26T13:34:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-mon[35807]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:34:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-mon[35807]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:34:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-mon[35807]: pgmap v2669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T13:34:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: *** Caught signal (Aborted) ** 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: in thread 7fd533400640 thread_name:ms_dispatch 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd53963e6f0] 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd53968b94c] 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 3: raise() 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 4: abort() 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd53962871b] 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 6: /lib64/libc.so.6(+0x37386) [0x7fd539637386] 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a5ad1b36b9] 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a5ad37180c] 2024-07-26T13:34:12.072 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a5ad2b12ca] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a5ad281753] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a5ad282a1b] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a5ad266752] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a5ad1b4a56] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a5ad1b8637] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a5ad1b8f5e] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a5ad19c03a] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd53a19b407] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 18: (DispatchQueue::entry()+0x60f) [0x7fd53a19bcf9] 2024-07-26T13:34:12.073 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd53a2785a1] 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 20: (Thread::entry_wrapper()+0x43) [0x7fd53a025cdd] 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd53a025cf9] 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd539689c02] 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd53970ec40] 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:11.588+0000 7fd533400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: in thread 7fd533400640 thread_name:ms_dispatch 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd53963e6f0] 2024-07-26T13:34:12.074 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd53968b94c] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 3: raise() 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 4: abort() 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd53962871b] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 6: /lib64/libc.so.6(+0x37386) [0x7fd539637386] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a5ad1b36b9] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a5ad37180c] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a5ad2b12ca] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a5ad281753] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a5ad282a1b] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a5ad266752] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a5ad1b4a56] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a5ad1b8637] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a5ad1b8f5e] 2024-07-26T13:34:12.075 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a5ad19c03a] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd53a19b407] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 18: (DispatchQueue::entry()+0x60f) [0x7fd53a19bcf9] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd53a2785a1] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 20: (Thread::entry_wrapper()+0x43) [0x7fd53a025cdd] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd53a025cf9] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd539689c02] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd53970ec40] 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.076 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 0> 2024-07-26T13:34:11.588+0000 7fd533400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: in thread 7fd533400640 thread_name:ms_dispatch 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd53963e6f0] 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd53968b94c] 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 3: raise() 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 4: abort() 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd53962871b] 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 6: /lib64/libc.so.6(+0x37386) [0x7fd539637386] 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a5ad1b36b9] 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a5ad37180c] 2024-07-26T13:34:12.077 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a5ad2b12ca] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a5ad281753] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a5ad282a1b] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a5ad266752] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a5ad1b4a56] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a5ad1b8637] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a5ad1b8f5e] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a5ad19c03a] 2024-07-26T13:34:12.078 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd53a19b407] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 18: (DispatchQueue::entry()+0x60f) [0x7fd53a19bcf9] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd53a2785a1] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 20: (Thread::entry_wrapper()+0x43) [0x7fd53a025cdd] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd53a025cf9] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd539689c02] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd53970ec40] 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 0> 2024-07-26T13:34:11.588+0000 7fd533400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: in thread 7fd533400640 thread_name:ms_dispatch 2024-07-26T13:34:12.079 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd53963e6f0] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd53968b94c] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 3: raise() 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 4: abort() 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd53962871b] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 6: /lib64/libc.so.6(+0x37386) [0x7fd539637386] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a5ad1b36b9] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a5ad37180c] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a5ad2b12ca] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a5ad281753] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a5ad282a1b] 2024-07-26T13:34:12.080 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a5ad266752] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a5ad1b4a56] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a5ad1b8637] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a5ad1b8f5e] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a5ad19c03a] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd53a19b407] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 18: (DispatchQueue::entry()+0x60f) [0x7fd53a19bcf9] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd53a2785a1] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 20: (Thread::entry_wrapper()+0x43) [0x7fd53a025cdd] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd53a025cf9] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd539689c02] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd53970ec40] 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.081 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88169]: 2024-07-26T13:34:12.082 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:11 smithi146 podman[88493]: 2024-07-26 13:34:11.732572446 +0000 UTC m=+0.031055845 container died 972ad952d81e5f15c40b3f440a4c7d58c7774c1a6ee35ba13bbdfcdf9cfc4b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-07-26T13:34:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-mon[35401]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-07-26T13:34:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-mon[35401]: daemon mds.g is now active in filesystem cephfs as rank 3 2024-07-26T13:34:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-mon[35401]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:34:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-mon[35401]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:34:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-mon[35401]: pgmap v2669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-07-26T13:34:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: *** Caught signal (Aborted) ** 2024-07-26T13:34:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: in thread 7f5917400640 thread_name:ms_dispatch 2024-07-26T13:34:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f591d63e6f0] 2024-07-26T13:34:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f591d68b94c] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 3: raise() 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 4: abort() 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 5: /lib64/libc.so.6(+0x2871b) [0x7f591d62871b] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 6: /lib64/libc.so.6(+0x37386) [0x7f591d637386] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5587e3cb06b9] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5587e3e6e80c] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5587e3dae2ca] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5587e3d7e753] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5587e3d7fa1b] 2024-07-26T13:34:12.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5587e3d63752] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5587e3cb1a56] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5587e3cb5637] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5587e3cb5f5e] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5587e3c9903a] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f591e19b407] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 18: (DispatchQueue::entry()+0x60f) [0x7f591e19bcf9] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f591e2785a1] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 20: (Thread::entry_wrapper()+0x43) [0x7f591e025cdd] 2024-07-26T13:34:12.086 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 21: (Thread::_entry_func(void*)+0xd) [0x7f591e025cf9] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 22: /lib64/libc.so.6(+0x89c02) [0x7f591d689c02] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f591d70ec40] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:11.594+0000 7f5917400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: in thread 7f5917400640 thread_name:ms_dispatch 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f591d63e6f0] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f591d68b94c] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 3: raise() 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 4: abort() 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 5: /lib64/libc.so.6(+0x2871b) [0x7f591d62871b] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 6: /lib64/libc.so.6(+0x37386) [0x7f591d637386] 2024-07-26T13:34:12.087 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5587e3cb06b9] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5587e3e6e80c] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5587e3dae2ca] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5587e3d7e753] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5587e3d7fa1b] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5587e3d63752] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5587e3cb1a56] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5587e3cb5637] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5587e3cb5f5e] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5587e3c9903a] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f591e19b407] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 18: (DispatchQueue::entry()+0x60f) [0x7f591e19bcf9] 2024-07-26T13:34:12.088 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f591e2785a1] 2024-07-26T13:34:12.089 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 20: (Thread::entry_wrapper()+0x43) [0x7f591e025cdd] 2024-07-26T13:34:12.089 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 21: (Thread::_entry_func(void*)+0xd) [0x7f591e025cf9] 2024-07-26T13:34:12.089 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 22: /lib64/libc.so.6(+0x89c02) [0x7f591d689c02] 2024-07-26T13:34:12.089 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f591d70ec40] 2024-07-26T13:34:12.089 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.089 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 0> 2024-07-26T13:34:11.594+0000 7f5917400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: in thread 7f5917400640 thread_name:ms_dispatch 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f591d63e6f0] 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f591d68b94c] 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 3: raise() 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 4: abort() 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 5: /lib64/libc.so.6(+0x2871b) [0x7f591d62871b] 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 6: /lib64/libc.so.6(+0x37386) [0x7f591d637386] 2024-07-26T13:34:12.090 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5587e3cb06b9] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5587e3e6e80c] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5587e3dae2ca] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5587e3d7e753] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5587e3d7fa1b] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5587e3d63752] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5587e3cb1a56] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5587e3cb5637] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5587e3cb5f5e] 2024-07-26T13:34:12.091 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5587e3c9903a] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f591e19b407] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 18: (DispatchQueue::entry()+0x60f) [0x7f591e19bcf9] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f591e2785a1] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 20: (Thread::entry_wrapper()+0x43) [0x7f591e025cdd] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 21: (Thread::_entry_func(void*)+0xd) [0x7f591e025cf9] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 22: /lib64/libc.so.6(+0x89c02) [0x7f591d689c02] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f591d70ec40] 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 0> 2024-07-26T13:34:11.594+0000 7f5917400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: in thread 7f5917400640 thread_name:ms_dispatch 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:12.092 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f591d63e6f0] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f591d68b94c] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 3: raise() 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 4: abort() 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 5: /lib64/libc.so.6(+0x2871b) [0x7f591d62871b] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 6: /lib64/libc.so.6(+0x37386) [0x7f591d637386] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5587e3cb06b9] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5587e3e6e80c] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5587e3dae2ca] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5587e3d7e753] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5587e3d7fa1b] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5587e3d63752] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5587e3cb1a56] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5587e3cb5637] 2024-07-26T13:34:12.093 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5587e3cb5f5e] 2024-07-26T13:34:12.094 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5587e3c9903a] 2024-07-26T13:34:12.094 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f591e19b407] 2024-07-26T13:34:12.094 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 18: (DispatchQueue::entry()+0x60f) [0x7f591e19bcf9] 2024-07-26T13:34:12.094 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f591e2785a1] 2024-07-26T13:34:12.094 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 20: (Thread::entry_wrapper()+0x43) [0x7f591e025cdd] 2024-07-26T13:34:12.094 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 21: (Thread::_entry_func(void*)+0xd) [0x7f591e025cf9] 2024-07-26T13:34:12.095 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 22: /lib64/libc.so.6(+0x89c02) [0x7f591d689c02] 2024-07-26T13:34:12.095 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f591d70ec40] 2024-07-26T13:34:12.095 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:12.095 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86423]: 2024-07-26T13:34:12.095 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:11 smithi076 podman[86766]: 2024-07-26 13:34:11.719060841 +0000 UTC m=+0.037146893 container died 748f7dc1e0658ab4bac8c9a32dc7ac01496adfa39947c8e3ab02482e7979f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:34:12.483 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:12 smithi040 podman[186909]: 2024-07-26 13:34:12.189374269 +0000 UTC m=+0.471971653 container died 201c5056f9967624a75e0a6c83295d6c5f77dd8200f27bb323f548b0c10019d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:34:12.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:12 smithi146 podman[88493]: 2024-07-26 13:34:12.436223105 +0000 UTC m=+0.734706547 container remove 972ad952d81e5f15c40b3f440a4c7d58c7774c1a6ee35ba13bbdfcdf9cfc4b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:34:12.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:12 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:active 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:active 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:active 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:active 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:34:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:12 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:active 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:active 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:active 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:active 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:34:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:12 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:12.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:12 smithi076 podman[86766]: 2024-07-26 13:34:12.42110689 +0000 UTC m=+0.739192978 container remove 748f7dc1e0658ab4bac8c9a32dc7ac01496adfa39947c8e3ab02482e7979f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True) 2024-07-26T13:34:12.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:12 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:12.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:12 smithi040 podman[186908]: 2024-07-26 13:34:12.592171807 +0000 UTC m=+0.888254683 container remove af9c12c4a6bf0d161f09b9ed257eef35358d7824174834f15302ee126d1bb2fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-07-26T13:34:12.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:12 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2583506231,v1:172.21.15.40:6839/2583506231] up:active 2024-07-26T13:34:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3575903669,v1:172.21.15.40:6841/3575903669] up:active 2024-07-26T13:34:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2502587932,v1:172.21.15.146:6835/2502587932] up:active 2024-07-26T13:34:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2461564853,v1:172.21.15.76:6835/2461564853] up:active 2024-07-26T13:34:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:34:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:12 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:13.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:12 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:34:13.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:12 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.662s CPU time. 2024-07-26T13:34:13.333 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:12 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:34:13.333 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:12 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.532s CPU time. 2024-07-26T13:34:13.732 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:13 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:34:13.732 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:13 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.753s CPU time. 2024-07-26T13:34:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:13 smithi040 ceph-mon[32397]: pgmap v2670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 488 B/s wr, 11 op/s 2024-07-26T13:34:13.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:13 smithi040 podman[186909]: 2024-07-26 13:34:13.387828597 +0000 UTC m=+1.670426009 container remove 201c5056f9967624a75e0a6c83295d6c5f77dd8200f27bb323f548b0c10019d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:34:13.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:13 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:13 smithi146 ceph-mon[35807]: pgmap v2670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 488 B/s wr, 11 op/s 2024-07-26T13:34:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:13 smithi076 ceph-mon[35401]: pgmap v2670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 488 B/s wr, 11 op/s 2024-07-26T13:34:14.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:13 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:34:14.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:13 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.702s CPU time. 2024-07-26T13:34:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:15 smithi040 ceph-mon[32397]: pgmap v2671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 792 B/s wr, 14 op/s 2024-07-26T13:34:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:15 smithi146 ceph-mon[35807]: pgmap v2671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 792 B/s wr, 14 op/s 2024-07-26T13:34:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:15 smithi076 ceph-mon[35401]: pgmap v2671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 792 B/s wr, 14 op/s 2024-07-26T13:34:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:17 smithi040 ceph-mon[32397]: pgmap v2672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:17 smithi146 ceph-mon[35807]: pgmap v2672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:17 smithi076 ceph-mon[35401]: pgmap v2672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:19 smithi040 ceph-mon[32397]: pgmap v2673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:34:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:19 smithi146 ceph-mon[35807]: pgmap v2673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:34:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:19 smithi076 ceph-mon[35401]: pgmap v2673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:34:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:21 smithi040 ceph-mon[32397]: pgmap v2674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:21 smithi146 ceph-mon[35807]: pgmap v2674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:21 smithi076 ceph-mon[35401]: pgmap v2674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:23.472 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:23.472 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 systemd[1]: Stopped Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:23.472 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.662s CPU time. 2024-07-26T13:34:23.472 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 systemd[1]: Starting Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:23.491 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:23.491 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 systemd[1]: Stopped Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:23.492 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.532s CPU time. 2024-07-26T13:34:23.492 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 systemd[1]: Starting Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:23.729 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 podman[88584]: 2024-07-26 13:34:23.375904732 +0000 UTC m=+0.034554409 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:23.729 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 podman[88584]: 2024-07-26 13:34:23.486453311 +0000 UTC m=+0.145103008 container create dfc6eda6138a0d5246caf8bf8493ece01febf9ea8a61685f9fb76393cb0f5ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:34:23.730 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 podman[88584]: 2024-07-26 13:34:23.714517751 +0000 UTC m=+0.373167452 container init dfc6eda6138a0d5246caf8bf8493ece01febf9ea8a61685f9fb76393cb0f5ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-07-26T13:34:23.776 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 podman[86856]: 2024-07-26 13:34:23.398629298 +0000 UTC m=+0.038039787 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:23.776 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 podman[86856]: 2024-07-26 13:34:23.505119108 +0000 UTC m=+0.144529585 container create 87138b63bff9647c8c47dd2d0b5fb1646a376c80cf32b1a7b6750a7298373cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724) 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 podman[88584]: 2024-07-26 13:34:23.727548972 +0000 UTC m=+0.386198648 container start dfc6eda6138a0d5246caf8bf8493ece01febf9ea8a61685f9fb76393cb0f5ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 bash[88584]: dfc6eda6138a0d5246caf8bf8493ece01febf9ea8a61685f9fb76393cb0f5ab0 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mds[88603]: -- 172.21.15.146:0/2732590413 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561700911860 con 0x561704ab3a80 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: starting mds.f at 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:23 smithi146 systemd[1]: Started Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: pgmap v2675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: daemon mds.f restarted 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: osdmap e94: 12 total, 12 up, 12 in 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:boot 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: Standby daemon mds.b assigned to filesystem cephfs as rank 2 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=e=up:active,1=h=up:active,3=g=up:active,4=a=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:24.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:23 smithi146 ceph-mon[35807]: daemon mds.e restarted 2024-07-26T13:34:24.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 podman[86856]: 2024-07-26 13:34:23.775287276 +0000 UTC m=+0.414697760 container init 87138b63bff9647c8c47dd2d0b5fb1646a376c80cf32b1a7b6750a7298373cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-07-26T13:34:24.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 podman[86856]: 2024-07-26 13:34:23.785402963 +0000 UTC m=+0.424813464 container start 87138b63bff9647c8c47dd2d0b5fb1646a376c80cf32b1a7b6750a7298373cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-07-26T13:34:24.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 bash[86856]: 87138b63bff9647c8c47dd2d0b5fb1646a376c80cf32b1a7b6750a7298373cf9 2024-07-26T13:34:24.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 systemd[1]: Started Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:24.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mds[86875]: -- 172.21.15.76:0/3790727658 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55954dc23860 con 0x559551dc5180 2024-07-26T13:34:24.085 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: starting mds.e at 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: pgmap v2675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: daemon mds.f restarted 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: osdmap e94: 12 total, 12 up, 12 in 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:boot 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: Standby daemon mds.b assigned to filesystem cephfs as rank 2 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=e=up:active,1=h=up:active,3=g=up:active,4=a=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:24.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:23 smithi076 ceph-mon[35401]: daemon mds.e restarted 2024-07-26T13:34:24.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:24.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: Stopped Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:24.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.753s CPU time. 2024-07-26T13:34:24.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: Starting Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 2. 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: Stopped Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.702s CPU time. 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:23 smithi040 systemd[1]: Starting Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: pgmap v2675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: daemon mds.f restarted 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: osdmap e94: 12 total, 12 up, 12 in 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:boot 2024-07-26T13:34:24.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: Standby daemon mds.b assigned to filesystem cephfs as rank 2 2024-07-26T13:34:24.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=e=up:active,1=h=up:active,3=g=up:active,4=a=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:24.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:34:24.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:24.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:23 smithi040 ceph-mon[32397]: daemon mds.e restarted 2024-07-26T13:34:24.482 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 podman[187064]: 2024-07-26 13:34:24.052561827 +0000 UTC m=+0.041893354 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:24.482 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 podman[187064]: 2024-07-26 13:34:24.314383107 +0000 UTC m=+0.303714647 container create e0e1b59aff1d78e10d414c714d66fec248fec8114a7a2a5edc85f487ec99e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0) 2024-07-26T13:34:24.941 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 podman[187064]: 2024-07-26 13:34:24.60165485 +0000 UTC m=+0.590986424 container init e0e1b59aff1d78e10d414c714d66fec248fec8114a7a2a5edc85f487ec99e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T13:34:24.941 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 podman[187064]: 2024-07-26 13:34:24.613558172 +0000 UTC m=+0.602889709 container start e0e1b59aff1d78e10d414c714d66fec248fec8114a7a2a5edc85f487ec99e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T13:34:24.941 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 bash[187064]: e0e1b59aff1d78e10d414c714d66fec248fec8114a7a2a5edc85f487ec99e3cc 2024-07-26T13:34:24.941 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 systemd[1]: Started Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:24.941 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mds[187096]: -- 172.21.15.40:0/3701361502 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bcb64f860 con 0x559bcf7f1600 2024-07-26T13:34:24.942 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: starting mds.g at 2024-07-26T13:34:25.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:24 smithi040 podman[187137]: 2024-07-26 13:34:24.888857994 +0000 UTC m=+0.032800604 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:25.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 podman[187137]: 2024-07-26 13:34:25.026721147 +0000 UTC m=+0.170663802 container create d52b694d3c9256faba8d98b4f80fdc13b190301775a96fec7f3e54085910ad1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724) 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: osdmap e95: 12 total, 12 up, 12 in 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:boot 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=b=up:replay,3=g=up:active,4=a=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: daemon mds.g restarted 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: osdmap e96: 12 total, 12 up, 12 in 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:resolve 2024-07-26T13:34:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:resolve 2024-07-26T13:34:25.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:boot 2024-07-26T13:34:25.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: Standby daemon mds.i assigned to filesystem cephfs as rank 3 2024-07-26T13:34:25.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,4=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:25.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:34:25.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:24 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:34:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: osdmap e95: 12 total, 12 up, 12 in 2024-07-26T13:34:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:boot 2024-07-26T13:34:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:34:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=b=up:replay,3=g=up:active,4=a=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: daemon mds.g restarted 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: osdmap e96: 12 total, 12 up, 12 in 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:resolve 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:resolve 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:boot 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: Standby daemon mds.i assigned to filesystem cephfs as rank 3 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,4=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:34:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:24 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: osdmap e95: 12 total, 12 up, 12 in 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:boot 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=b=up:replay,3=g=up:active,4=a=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: daemon mds.g restarted 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: osdmap e96: 12 total, 12 up, 12 in 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:resolve 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:resolve 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:boot 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: Standby daemon mds.i assigned to filesystem cephfs as rank 3 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,4=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:34:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:24 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:34:25.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 podman[187137]: 2024-07-26 13:34:25.405553664 +0000 UTC m=+0.549496325 container init d52b694d3c9256faba8d98b4f80fdc13b190301775a96fec7f3e54085910ad1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=) 2024-07-26T13:34:25.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 podman[187137]: 2024-07-26 13:34:25.416870442 +0000 UTC m=+0.560813090 container start d52b694d3c9256faba8d98b4f80fdc13b190301775a96fec7f3e54085910ad1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-07-26T13:34:25.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 bash[187137]: d52b694d3c9256faba8d98b4f80fdc13b190301775a96fec7f3e54085910ad1d 2024-07-26T13:34:25.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 systemd[1]: Started Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:25.734 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mds[187156]: -- 172.21.15.40:0/622160144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563633e8f520 con 0x563638027a80 2024-07-26T13:34:25.734 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mds[187156]: -- 172.21.15.40:0/622160144 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563633e85860 con 0x563638027a80 2024-07-26T13:34:25.734 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: starting mds.a at 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: pgmap v2679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 11 op/s 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: daemon mds.a restarted 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: osdmap e97: 12 total, 12 up, 12 in 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:boot 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,3=i=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:25 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:34:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: pgmap v2679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 11 op/s 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: daemon mds.a restarted 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: osdmap e97: 12 total, 12 up, 12 in 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:boot 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,3=i=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:34:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:25 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: pgmap v2679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 11 op/s 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: daemon mds.a restarted 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: osdmap e97: 12 total, 12 up, 12 in 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:boot 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,3=i=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:25 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:34:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:27 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:resolve 2024-07-26T13:34:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:27 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:resolve 2024-07-26T13:34:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:27 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:27 smithi040 ceph-mon[32397]: pgmap v2681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 9 op/s 2024-07-26T13:34:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:27 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:resolve 2024-07-26T13:34:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:27 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:resolve 2024-07-26T13:34:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:27 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:27 smithi146 ceph-mon[35807]: pgmap v2681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 9 op/s 2024-07-26T13:34:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:27 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:resolve 2024-07-26T13:34:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:27 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:resolve 2024-07-26T13:34:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:27 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:27 smithi076 ceph-mon[35401]: pgmap v2681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 9 op/s 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:reconnect 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:reconnect 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:reconnect 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:reconnect 2024-07-26T13:34:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:28 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:reconnect 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:reconnect 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:reconnect 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:reconnect 2024-07-26T13:34:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:28 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:34:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:34:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:34:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:34:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:reconnect 2024-07-26T13:34:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:reconnect 2024-07-26T13:34:29.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:reconnect 2024-07-26T13:34:29.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:reconnect 2024-07-26T13:34:29.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:28 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:rejoin 2024-07-26T13:34:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:rejoin 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:rejoin 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:rejoin 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: pgmap v2682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 205 B/s wr, 14 op/s 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:active 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:active 2024-07-26T13:34:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:active 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:active 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: *** Caught signal (Aborted) ** 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: in thread 7f4fa9e00640 thread_name:ms_dispatch 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fb003e6f0] 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4fb008b94c] 2024-07-26T13:34:29.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 3: raise() 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 4: abort() 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4fb002871b] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 6: /lib64/libc.so.6(+0x37386) [0x7f4fb0037386] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5622782326b9] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5622783f080c] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5622783302ca] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562278300753] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562278301a1b] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5622782e5752] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562278233a56] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562278237637] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562278237f5e] 2024-07-26T13:34:29.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56227821b03a] 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4fb0b9b407] 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 18: (DispatchQueue::entry()+0x60f) [0x7f4fb0b9bcf9] 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4fb0c785a1] 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: *** Caught signal (Aborted) ** 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: in thread 7f6085600640 thread_name:ms_dispatch 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f608b83e6f0] 2024-07-26T13:34:29.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f608b88b94c] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 3: raise() 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 4: abort() 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 5: /lib64/libc.so.6(+0x2871b) [0x7f608b82871b] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 6: /lib64/libc.so.6(+0x37386) [0x7f608b837386] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f07930e6b9] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f0794cc80c] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f07940c2ca] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f0793dc753] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f0793dda1b] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f0793c1752] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f07930fa56] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f079313637] 2024-07-26T13:34:29.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f079313f5e] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f0792f703a] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f608c39b407] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 18: (DispatchQueue::entry()+0x60f) [0x7f608c39bcf9] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f608c4785a1] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 20: (Thread::entry_wrapper()+0x43) [0x7f4fb0a25cdd] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4fb0a25cf9] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4fb0089c02] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4fb010ec40] 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.512+0000 7f4fa9e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: in thread 7f4fa9e00640 thread_name:ms_dispatch 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fb003e6f0] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4fb008b94c] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 3: raise() 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 4: abort() 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4fb002871b] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 6: /lib64/libc.so.6(+0x37386) [0x7f4fb0037386] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5622782326b9] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5622783f080c] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5622783302ca] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562278300753] 2024-07-26T13:34:29.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562278301a1b] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5622782e5752] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562278233a56] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562278237637] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562278237f5e] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56227821b03a] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4fb0b9b407] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 18: (DispatchQueue::entry()+0x60f) [0x7f4fb0b9bcf9] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4fb0c785a1] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 20: (Thread::entry_wrapper()+0x43) [0x7f608c225cdd] 2024-07-26T13:34:29.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 21: (Thread::_entry_func(void*)+0xd) [0x7f608c225cf9] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 22: /lib64/libc.so.6(+0x89c02) [0x7f608b889c02] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f608b90ec40] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.513+0000 7f6085600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: in thread 7f6085600640 thread_name:ms_dispatch 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f608b83e6f0] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f608b88b94c] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 3: raise() 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 4: abort() 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 5: /lib64/libc.so.6(+0x2871b) [0x7f608b82871b] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 6: /lib64/libc.so.6(+0x37386) [0x7f608b837386] 2024-07-26T13:34:29.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f07930e6b9] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f0794cc80c] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f07940c2ca] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f0793dc753] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f0793dda1b] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f0793c1752] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f07930fa56] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f079313637] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f079313f5e] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f0792f703a] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f608c39b407] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 18: (DispatchQueue::entry()+0x60f) [0x7f608c39bcf9] 2024-07-26T13:34:29.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f608c4785a1] 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 20: (Thread::entry_wrapper()+0x43) [0x7f4fb0a25cdd] 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4fb0a25cf9] 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4fb0089c02] 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4fb010ec40] 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 0> 2024-07-26T13:34:29.512+0000 7f4fa9e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: in thread 7f4fa9e00640 thread_name:ms_dispatch 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fb003e6f0] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4fb008b94c] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 3: raise() 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 4: abort() 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4fb002871b] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 6: /lib64/libc.so.6(+0x37386) [0x7f4fb0037386] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5622782326b9] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5622783f080c] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5622783302ca] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562278300753] 2024-07-26T13:34:29.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562278301a1b] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5622782e5752] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562278233a56] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562278237637] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562278237f5e] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56227821b03a] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4fb0b9b407] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 18: (DispatchQueue::entry()+0x60f) [0x7f4fb0b9bcf9] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4fb0c785a1] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 20: (Thread::entry_wrapper()+0x43) [0x7f4fb0a25cdd] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4fb0a25cf9] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4fb0089c02] 2024-07-26T13:34:29.834 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4fb010ec40] 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 0> 2024-07-26T13:34:29.512+0000 7f4fa9e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: in thread 7f4fa9e00640 thread_name:ms_dispatch 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4fb003e6f0] 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4fb008b94c] 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 3: raise() 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 4: abort() 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4fb002871b] 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 6: /lib64/libc.so.6(+0x37386) [0x7f4fb0037386] 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5622782326b9] 2024-07-26T13:34:29.835 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5622783f080c] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5622783302ca] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562278300753] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562278301a1b] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5622782e5752] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562278233a56] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562278237637] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562278237f5e] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 20: (Thread::entry_wrapper()+0x43) [0x7f608c225cdd] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 21: (Thread::_entry_func(void*)+0xd) [0x7f608c225cf9] 2024-07-26T13:34:29.836 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 22: /lib64/libc.so.6(+0x89c02) [0x7f608b889c02] 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f608b90ec40] 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 0> 2024-07-26T13:34:29.513+0000 7f6085600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: in thread 7f6085600640 thread_name:ms_dispatch 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f608b83e6f0] 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f608b88b94c] 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 3: raise() 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 4: abort() 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 5: /lib64/libc.so.6(+0x2871b) [0x7f608b82871b] 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 6: /lib64/libc.so.6(+0x37386) [0x7f608b837386] 2024-07-26T13:34:29.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f07930e6b9] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f0794cc80c] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f07940c2ca] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f0793dc753] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f0793dda1b] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f0793c1752] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f07930fa56] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f079313637] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f079313f5e] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f0792f703a] 2024-07-26T13:34:29.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f608c39b407] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56227821b03a] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4fb0b9b407] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 18: (DispatchQueue::entry()+0x60f) [0x7f4fb0b9bcf9] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4fb0c785a1] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 20: (Thread::entry_wrapper()+0x43) [0x7f4fb0a25cdd] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4fb0a25cf9] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4fb0089c02] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4fb010ec40] 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88375]: 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 18: (DispatchQueue::entry()+0x60f) [0x7f608c39bcf9] 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f608c4785a1] 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 20: (Thread::entry_wrapper()+0x43) [0x7f608c225cdd] 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 21: (Thread::_entry_func(void*)+0xd) [0x7f608c225cf9] 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 22: /lib64/libc.so.6(+0x89c02) [0x7f608b889c02] 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f608b90ec40] 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 0> 2024-07-26T13:34:29.513+0000 7f6085600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: in thread 7f6085600640 thread_name:ms_dispatch 2024-07-26T13:34:29.840 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f608b83e6f0] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f608b88b94c] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 3: raise() 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 4: abort() 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 5: /lib64/libc.so.6(+0x2871b) [0x7f608b82871b] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 6: /lib64/libc.so.6(+0x37386) [0x7f608b837386] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f07930e6b9] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f0794cc80c] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f07940c2ca] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f0793dc753] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f0793dda1b] 2024-07-26T13:34:29.841 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f0793c1752] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f07930fa56] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f079313637] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f079313f5e] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f0792f703a] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f608c39b407] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 18: (DispatchQueue::entry()+0x60f) [0x7f608c39bcf9] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f608c4785a1] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 20: (Thread::entry_wrapper()+0x43) [0x7f608c225cdd] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 21: (Thread::_entry_func(void*)+0xd) [0x7f608c225cf9] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 22: /lib64/libc.so.6(+0x89c02) [0x7f608b889c02] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f608b90ec40] 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88444]: 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:29 smithi146 podman[88641]: 2024-07-26 13:34:29.645761692 +0000 UTC m=+0.045053310 container died 6b6421e872d8a985dc1a428133e31b1ebd60a8a4355238fc639a7e94bfbac6c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:rejoin 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:rejoin 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:rejoin 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:rejoin 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:34:29.843 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: pgmap v2682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 205 B/s wr, 14 op/s 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:active 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:active 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:active 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:active 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:29.844 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: *** Caught signal (Aborted) ** 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: in thread 7f527b800640 thread_name:ms_dispatch 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5281a3e6f0] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5281a8b94c] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 3: raise() 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 4: abort() 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5281a2871b] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 6: /lib64/libc.so.6(+0x37386) [0x7f5281a37386] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560cb2e626b9] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560cb302080c] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560cb2f602ca] 2024-07-26T13:34:29.845 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560cb2f30753] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560cb2f31a1b] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560cb2f15752] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560cb2e63a56] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560cb2e67637] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560cb2e67f5e] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560cb2e4b03a] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f528259b407] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 18: (DispatchQueue::entry()+0x60f) [0x7f528259bcf9] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52826785a1] 2024-07-26T13:34:29.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: *** Caught signal (Aborted) ** 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: in thread 7f51ce400640 thread_name:ms_dispatch 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f51d463e6f0] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f51d468b94c] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 3: raise() 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 4: abort() 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 5: /lib64/libc.so.6(+0x2871b) [0x7f51d462871b] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 6: /lib64/libc.so.6(+0x37386) [0x7f51d4637386] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d1c6d896b9] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d1c6f4780c] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d1c6e872ca] 2024-07-26T13:34:29.847 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d1c6e57753] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d1c6e58a1b] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d1c6e3c752] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d1c6d8aa56] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d1c6d8e637] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d1c6d8ef5e] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d1c6d7203a] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f51d519b407] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 18: (DispatchQueue::entry()+0x60f) [0x7f51d519bcf9] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51d52785a1] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 20: (Thread::entry_wrapper()+0x43) [0x7f5282425cdd] 2024-07-26T13:34:29.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5282425cf9] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5281a89c02] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5281b0ec40] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.511+0000 7f527b800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: in thread 7f527b800640 thread_name:ms_dispatch 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5281a3e6f0] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5281a8b94c] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 3: raise() 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 4: abort() 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5281a2871b] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 6: /lib64/libc.so.6(+0x37386) [0x7f5281a37386] 2024-07-26T13:34:29.849 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560cb2e626b9] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560cb302080c] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560cb2f602ca] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560cb2f30753] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560cb2f31a1b] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560cb2f15752] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560cb2e63a56] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560cb2e67637] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560cb2e67f5e] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560cb2e4b03a] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f528259b407] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 18: (DispatchQueue::entry()+0x60f) [0x7f528259bcf9] 2024-07-26T13:34:29.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52826785a1] 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 20: (Thread::entry_wrapper()+0x43) [0x7f51d5025cdd] 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51d5025cf9] 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 22: /lib64/libc.so.6(+0x89c02) [0x7f51d4689c02] 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f51d470ec40] 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.519+0000 7f51ce400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: in thread 7f51ce400640 thread_name:ms_dispatch 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f51d463e6f0] 2024-07-26T13:34:29.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f51d468b94c] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 3: raise() 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 4: abort() 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 5: /lib64/libc.so.6(+0x2871b) [0x7f51d462871b] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 6: /lib64/libc.so.6(+0x37386) [0x7f51d4637386] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d1c6d896b9] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d1c6f4780c] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d1c6e872ca] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d1c6e57753] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d1c6e58a1b] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d1c6e3c752] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d1c6d8aa56] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d1c6d8e637] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d1c6d8ef5e] 2024-07-26T13:34:29.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d1c6d7203a] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f51d519b407] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 18: (DispatchQueue::entry()+0x60f) [0x7f51d519bcf9] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51d52785a1] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 20: (Thread::entry_wrapper()+0x43) [0x7f5282425cdd] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5282425cf9] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5281a89c02] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5281b0ec40] 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 0> 2024-07-26T13:34:29.511+0000 7f527b800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: in thread 7f527b800640 thread_name:ms_dispatch 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5281a3e6f0] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5281a8b94c] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 3: raise() 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 4: abort() 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5281a2871b] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 6: /lib64/libc.so.6(+0x37386) [0x7f5281a37386] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560cb2e626b9] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560cb302080c] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560cb2f602ca] 2024-07-26T13:34:29.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560cb2f30753] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560cb2f31a1b] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560cb2f15752] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560cb2e63a56] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560cb2e67637] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560cb2e67f5e] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560cb2e4b03a] 2024-07-26T13:34:29.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f528259b407] 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 20: (Thread::entry_wrapper()+0x43) [0x7f51d5025cdd] 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51d5025cf9] 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 22: /lib64/libc.so.6(+0x89c02) [0x7f51d4689c02] 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f51d470ec40] 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 0> 2024-07-26T13:34:29.519+0000 7f51ce400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: in thread 7f51ce400640 thread_name:ms_dispatch 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.856 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f51d463e6f0] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f51d468b94c] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 3: raise() 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 4: abort() 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 5: /lib64/libc.so.6(+0x2871b) [0x7f51d462871b] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 6: /lib64/libc.so.6(+0x37386) [0x7f51d4637386] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d1c6d896b9] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d1c6f4780c] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d1c6e872ca] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d1c6e57753] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d1c6e58a1b] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d1c6e3c752] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d1c6d8aa56] 2024-07-26T13:34:29.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d1c6d8e637] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d1c6d8ef5e] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d1c6d7203a] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f51d519b407] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 18: (DispatchQueue::entry()+0x60f) [0x7f51d519bcf9] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51d52785a1] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 20: (Thread::entry_wrapper()+0x43) [0x7f51d5025cdd] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51d5025cf9] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 22: /lib64/libc.so.6(+0x89c02) [0x7f51d4689c02] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f51d470ec40] 2024-07-26T13:34:29.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 0> 2024-07-26T13:34:29.519+0000 7f51ce400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: in thread 7f51ce400640 thread_name:ms_dispatch 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f51d463e6f0] 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f51d468b94c] 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 3: raise() 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 4: abort() 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 5: /lib64/libc.so.6(+0x2871b) [0x7f51d462871b] 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 6: /lib64/libc.so.6(+0x37386) [0x7f51d4637386] 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55d1c6d896b9] 2024-07-26T13:34:29.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55d1c6f4780c] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55d1c6e872ca] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55d1c6e57753] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55d1c6e58a1b] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55d1c6e3c752] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55d1c6d8aa56] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55d1c6d8e637] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55d1c6d8ef5e] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 18: (DispatchQueue::entry()+0x60f) [0x7f528259bcf9] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52826785a1] 2024-07-26T13:34:29.860 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 20: (Thread::entry_wrapper()+0x43) [0x7f5282425cdd] 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5282425cf9] 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5281a89c02] 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5281b0ec40] 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 0> 2024-07-26T13:34:29.511+0000 7f527b800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: in thread 7f527b800640 thread_name:ms_dispatch 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5281a3e6f0] 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f5281a8b94c] 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 3: raise() 2024-07-26T13:34:29.861 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 4: abort() 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 5: /lib64/libc.so.6(+0x2871b) [0x7f5281a2871b] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 6: /lib64/libc.so.6(+0x37386) [0x7f5281a37386] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x560cb2e626b9] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x560cb302080c] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x560cb2f602ca] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x560cb2f30753] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x560cb2f31a1b] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x560cb2f15752] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x560cb2e63a56] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x560cb2e67637] 2024-07-26T13:34:29.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x560cb2e67f5e] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55d1c6d7203a] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f51d519b407] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 18: (DispatchQueue::entry()+0x60f) [0x7f51d519bcf9] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f51d52785a1] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 20: (Thread::entry_wrapper()+0x43) [0x7f51d5025cdd] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 21: (Thread::_entry_func(void*)+0xd) [0x7f51d5025cf9] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 22: /lib64/libc.so.6(+0x89c02) [0x7f51d4689c02] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f51d470ec40] 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.863 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[86693]: 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x560cb2e4b03a] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f528259b407] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 18: (DispatchQueue::entry()+0x60f) [0x7f528259bcf9] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f52826785a1] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 20: (Thread::entry_wrapper()+0x43) [0x7f5282425cdd] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 21: (Thread::_entry_func(void*)+0xd) [0x7f5282425cf9] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 22: /lib64/libc.so.6(+0x89c02) [0x7f5281a89c02] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f5281b0ec40] 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[86688]: 2024-07-26T13:34:29.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:29 smithi076 podman[86913]: 2024-07-26 13:34:29.624829443 +0000 UTC m=+0.034566082 container died 84635c475ca560683f38667f3b4cd78041dc26875670cc122dd327f18b932cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:rejoin 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:rejoin 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:rejoin 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:rejoin 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: pgmap v2682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 205 B/s wr, 14 op/s 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3675130860,v1:172.21.15.146:6837/3675130860] up:active 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1530476337,v1:172.21.15.146:6839/1530476337] up:active 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3611914765,v1:172.21.15.76:6833/3611914765] up:active 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] up:active 2024-07-26T13:34:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:29 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:30.260 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:29 smithi146 podman[88642]: 2024-07-26 13:34:29.976457097 +0000 UTC m=+0.375760811 container died 885100ced0e1cb74955fd53cc362c3ee79f266eaca3a5a55434465d74e562382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0) 2024-07-26T13:34:30.321 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:29 smithi076 podman[86919]: 2024-07-26 13:34:29.970117503 +0000 UTC m=+0.358019071 container died ff6abca46392d7d9a3e6e2d35c371dee37cc57012325e64b5ff2c603670827fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T13:34:30.367 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-07-26T13:34:30.367 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-07-26T13:34:30.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T13:34:30.884 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:34:30.923 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:30 smithi146 podman[88642]: 2024-07-26 13:34:30.603020789 +0000 UTC m=+1.002324554 container remove 885100ced0e1cb74955fd53cc362c3ee79f266eaca3a5a55434465d74e562382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0) 2024-07-26T13:34:30.923 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:30 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:31.025 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:30 smithi076 podman[86913]: 2024-07-26 13:34:30.6471694 +0000 UTC m=+1.056906063 container remove 84635c475ca560683f38667f3b4cd78041dc26875670cc122dd327f18b932cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:34:31.025 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:30 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:31.257 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:30 smithi146 podman[88641]: 2024-07-26 13:34:30.921491838 +0000 UTC m=+1.320783498 container remove 6b6421e872d8a985dc1a428133e31b1ebd60a8a4355238fc639a7e94bfbac6c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-07-26T13:34:31.257 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:30 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:31.332 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:31 smithi076 podman[86919]: 2024-07-26 13:34:31.023839504 +0000 UTC m=+1.411741059 container remove ff6abca46392d7d9a3e6e2d35c371dee37cc57012325e64b5ff2c603670827fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-07-26T13:34:31.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:31.570 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:31 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:34:31.570 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:31 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.570s CPU time. 2024-07-26T13:34:31.570 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:31 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:34:31.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:31 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.622s CPU time. 2024-07-26T13:34:31.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:34:31.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.620s CPU time. 2024-07-26T13:34:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:34:31.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:31 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.320s CPU time. 2024-07-26T13:34:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:31 smithi040 ceph-mon[32397]: pgmap v2683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 591 B/s wr, 12 op/s 2024-07-26T13:34:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:31 smithi146 ceph-mon[35807]: pgmap v2683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 591 B/s wr, 12 op/s 2024-07-26T13:34:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:31 smithi076 ceph-mon[35401]: pgmap v2683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 591 B/s wr, 12 op/s 2024-07-26T13:34:33.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.497+0000 7fed1f000640 1 -- 172.21.15.40:0/2814681907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 msgr2=0x7fed181037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:33.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.497+0000 7fed1f000640 1 --2- 172.21.15.40:0/2814681907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed181037d0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009900 tx=0x7fed0c02a420 comp rx=0 tx=0).stop 2024-07-26T13:34:33.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 -- 172.21.15.40:0/2814681907 shutdown_connections 2024-07-26T13:34:33.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 --2- 172.21.15.40:0/2814681907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed18109650 0x7fed1810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 --2- 172.21.15.40:0/2814681907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 0x7fed18109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 --2- 172.21.15.40:0/2814681907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed181037d0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 -- 172.21.15.40:0/2814681907 >> 172.21.15.40:0/2814681907 conn(0x7fed180fee10 msgr2=0x7fed18101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 -- 172.21.15.40:0/2814681907 shutdown_connections 2024-07-26T13:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.498+0000 7fed1f000640 1 -- 172.21.15.40:0/2814681907 wait complete. 2024-07-26T13:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.499+0000 7fed1f000640 1 Processor -- start 2024-07-26T13:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.499+0000 7fed1f000640 1 -- start start 2024-07-26T13:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1f000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed1819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1f000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 0x7fed1819c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed18109650 0x7fed181a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1f000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fed181132d0 con 0x7fed181033c0 2024-07-26T13:34:33.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1f000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113150 con 0x7fed18108d00 2024-07-26T13:34:33.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113450 con 0x7fed18109650 2024-07-26T13:34:33.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed1819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:33.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed1819bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41398/0 (socket says 172.21.15.40:41398) 2024-07-26T13:34:33.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.500+0000 7fed1dc00640 1 -- 172.21.15.40:0/1940481275 learned_addr learned my addr 172.21.15.40:0/1940481275 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:34:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1d200640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 0x7fed1819c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1e600640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed18109650 0x7fed181a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1dc00640 1 -- 172.21.15.40:0/1940481275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed18109650 msgr2=0x7fed181a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1dc00640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed18109650 0x7fed181a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1dc00640 1 -- 172.21.15.40:0/1940481275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 msgr2=0x7fed1819c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1dc00640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 0x7fed1819c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1dc00640 1 -- 172.21.15.40:0/1940481275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed181a1f30 con 0x7fed181033c0 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.501+0000 7fed1d200640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 0x7fed1819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.502+0000 7fed1dc00640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed1819bfc0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fed0c02a940 tx=0x7fed0c003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.502+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c03f070 con 0x7fed181033c0 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.502+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed0c03bdc0 con 0x7fed181033c0 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.502+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c035030 con 0x7fed181033c0 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.502+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed181a21c0 con 0x7fed181033c0 2024-07-26T13:34:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.502+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed181a8980 con 0x7fed181033c0 2024-07-26T13:34:33.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.503+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed18103850 con 0x7fed181033c0 2024-07-26T13:34:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.507+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fed0c042070 con 0x7fed181033c0 2024-07-26T13:34:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.509+0000 7fed16000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fed000b3bd0 0x7fed000b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.509+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9616+0+0 (secure 0 0 0) 0x7fed0c105050 con 0x7fed181033c0 2024-07-26T13:34:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.509+0000 7fed1d200640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fed000b3bd0 0x7fed000b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.510+0000 7fed1d200640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fed000b3bd0 0x7fed000b60e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fed18105370 tx=0x7fed04008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:34:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.511+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fed0c0cc190 con 0x7fed181033c0 2024-07-26T13:34:33.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.756+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed181a8bb0 con 0x7fed181033c0 2024-07-26T13:34:33.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.757+0000 7fed16000640 1 -- 172.21.15.40:0/1940481275 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) ==== 94+0+11970 (secure 0 0 0) 0x7fed0c0c7030 con 0x7fed181033c0 2024-07-26T13:34:33.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T13:34:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 97 2024-07-26T13:34:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":97,"btime":"2024-07-26T13:34:29:499500+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14655,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":97,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:34:29.499483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":37769,"mds_1":34592,"mds_2":37763,"mds_3":27712,"mds_4":27700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_18363":{"gid":18363,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6839/26169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":26169584},{"type":"v1","addr":"172.21.15.40:6839","nonce":26169584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_18369":{"gid":18369,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.40:6841/3238351765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3238351765},{"type":"v1","addr":"172.21.15.40:6841","nonce":3238351765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27700":{"gid":27700,"name":"c","rank":4,"incarnation":93,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/3675130860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3675130860},{"type":"v1","addr":"172.21.15.146:6837","nonce":3675130860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27712":{"gid":27712,"name":"i","rank":3,"incarnation":91,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6839/1530476337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":1530476337},{"type":"v1","addr":"172.21.15.146:6839","nonce":1530476337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27718":{"gid":27718,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/900875035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":900875035},{"type":"v1","addr":"172.21.15.146:6835","nonce":900875035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_37763":{"gid":37763,"name":"b","rank":2,"incarnation":87,"state":"up:active","state_seq":10,"addr":"172.21.15.76:6833/3611914765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3611914765},{"type":"v1","addr":"172.21.15.76:6833","nonce":3611914765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_37769":{"gid":37769,"name":"k","rank":0,"incarnation":89,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6839/1025840894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":1025840894},{"type":"v1","addr":"172.21.15.76:6839","nonce":1025840894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_37784":{"gid":37784,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.76:6835/2335337936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":2335337936},{"type":"v1","addr":"172.21.15.76:6835","nonce":2335337936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":37769,"qdb_cluster":[27700,27712,34592,37763,37769]},"id":1}]} 2024-07-26T13:34:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fed000b3bd0 msgr2=0x7fed000b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fed000b3bd0 0x7fed000b60e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fed18105370 tx=0x7fed04008040 comp rx=0 tx=0).stop 2024-07-26T13:34:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 msgr2=0x7fed1819bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed1819bfc0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fed0c02a940 tx=0x7fed0c003d60 comp rx=0 tx=0).stop 2024-07-26T13:34:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 shutdown_connections 2024-07-26T13:34:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fed000b3bd0 0x7fed000b60e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed18109650 0x7fed181a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fed18108d00 0x7fed1819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 --2- 172.21.15.40:0/1940481275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed181033c0 0x7fed1819bfc0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.760+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 >> 172.21.15.40:0/1940481275 conn(0x7fed180fee10 msgr2=0x7fed18075020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:34:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.761+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 shutdown_connections 2024-07-26T13:34:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:33.761+0000 7fed1f000640 1 -- 172.21.15.40:0/1940481275 wait complete. 2024-07-26T13:34:34.203 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:33 smithi040 ceph-mon[32397]: pgmap v2684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 1012 B/s wr, 12 op/s 2024-07-26T13:34:34.203 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:33 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1940481275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:34:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:33 smithi146 ceph-mon[35807]: pgmap v2684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 1012 B/s wr, 12 op/s 2024-07-26T13:34:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:33 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1940481275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:34:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:33 smithi076 ceph-mon[35401]: pgmap v2684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 1012 B/s wr, 12 op/s 2024-07-26T13:34:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:33 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1940481275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T13:34:34.635 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.37769 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-07-26T13:34:34.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.37769 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-07-26T13:34:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T13:34:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:35 smithi040 ceph-mon[32397]: pgmap v2685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 818 B/s wr, 15 op/s 2024-07-26T13:34:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:35 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:34:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:35 smithi146 ceph-mon[35807]: pgmap v2685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 818 B/s wr, 15 op/s 2024-07-26T13:34:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:35 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:34:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:35 smithi076 ceph-mon[35401]: pgmap v2685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 818 B/s wr, 15 op/s 2024-07-26T13:34:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:35 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:34:37.209 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:34:37.209 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:34:37.209 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:36 smithi040 ceph-mon[32397]: pgmap v2686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 769 B/s wr, 14 op/s 2024-07-26T13:34:37.209 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:36 smithi040 ceph-mon[32397]: pgmap v2687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 875 B/s wr, 15 op/s 2024-07-26T13:34:37.210 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:34:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:34:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:34:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:36 smithi146 ceph-mon[35807]: pgmap v2686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 769 B/s wr, 14 op/s 2024-07-26T13:34:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:36 smithi146 ceph-mon[35807]: pgmap v2687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 875 B/s wr, 15 op/s 2024-07-26T13:34:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:36 smithi076 ceph-mon[35401]: pgmap v2686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 769 B/s wr, 14 op/s 2024-07-26T13:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:36 smithi076 ceph-mon[35401]: pgmap v2687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 875 B/s wr, 15 op/s 2024-07-26T13:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.437+0000 7f7615400640 1 -- 172.21.15.40:0/3379741469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610075800 msgr2=0x7f7610075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.437+0000 7f7615400640 1 --2- 172.21.15.40:0/3379741469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610075800 0x7f7610075c10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009900 tx=0x7f75fc02a410 comp rx=0 tx=0).stop 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.437+0000 7f7615400640 1 -- 172.21.15.40:0/3379741469 shutdown_connections 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.438+0000 7f7615400640 1 --2- 172.21.15.40:0/3379741469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7610113c90 0x7f7610116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.438+0000 7f7615400640 1 --2- 172.21.15.40:0/3379741469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610075800 0x7f7610075c10 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.438+0000 7f7615400640 1 --2- 172.21.15.40:0/3379741469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7610076db0 0x7f76100751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.438+0000 7f7615400640 1 -- 172.21.15.40:0/3379741469 >> 172.21.15.40:0/3379741469 conn(0x7f76100fee10 msgr2=0x7f7610101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:34:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.438+0000 7f7615400640 1 -- 172.21.15.40:0/3379741469 shutdown_connections 2024-07-26T13:34:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.438+0000 7f7615400640 1 -- 172.21.15.40:0/3379741469 wait complete. 2024-07-26T13:34:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.439+0000 7f7615400640 1 Processor -- start 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.439+0000 7f7615400640 1 -- start start 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.439+0000 7f7615400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7610075800 0x7f76101a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.439+0000 7f7615400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7610076db0 0x7f76101a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.439+0000 7f7615400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610113c90 0x7f76101a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.439+0000 7f7615400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7610119790 con 0x7f7610113c90 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f7615400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7610119610 con 0x7f7610076db0 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f7615400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7610119910 con 0x7f7610075800 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f7614a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610113c90 0x7f76101a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f7614a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610113c90 0x7f76101a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41412/0 (socket says 172.21.15.40:41412) 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f7614a00640 1 -- 172.21.15.40:0/709577236 learned_addr learned my addr 172.21.15.40:0/709577236 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:34:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f760fe00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7610075800 0x7f76101a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.440+0000 7f760f400640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7610076db0 0x7f76101a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7614a00640 1 -- 172.21.15.40:0/709577236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7610075800 msgr2=0x7f76101a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7614a00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7610075800 0x7f76101a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7614a00640 1 -- 172.21.15.40:0/709577236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7610076db0 msgr2=0x7f76101a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7614a00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7610076db0 0x7f76101a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7614a00640 1 -- 172.21.15.40:0/709577236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76101a61b0 con 0x7f7610113c90 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7614a00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7610113c90 0x7f76101a5a80 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f760800eaa0 tx=0x7f760800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f760cc00640 1 -- 172.21.15.40:0/709577236 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760800cdb0 con 0x7f7610113c90 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7615400640 1 -- 172.21.15.40:0/709577236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76101a64a0 con 0x7f7610113c90 2024-07-26T13:34:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f760cc00640 1 -- 172.21.15.40:0/709577236 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7608005020 con 0x7f7610113c90 2024-07-26T13:34:37.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f760cc00640 1 -- 172.21.15.40:0/709577236 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76080116d0 con 0x7f7610113c90 2024-07-26T13:34:37.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.441+0000 7f7615400640 1 -- 172.21.15.40:0/709577236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76101acc00 con 0x7f7610113c90 2024-07-26T13:34:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.445+0000 7f761d5c6740 1 Processor -- start 2024-07-26T13:34:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.445+0000 7f760cc00640 1 -- 172.21.15.40:0/709577236 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f76080051d0 con 0x7f7610113c90 2024-07-26T13:34:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.445+0000 7f761d5c6740 1 -- start start 2024-07-26T13:34:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f761d5c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e23840 0x5585751c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f761d5c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f761d5c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 0x5585751c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f761d5c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x558575193d10 con 0x558574e02b60 2024-07-26T13:34:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f761d5c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55857513eb60 con 0x558574e23840 2024-07-26T13:34:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f761d5c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55857512e060 con 0x558574dfa980 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f760f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 0x5585751c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f760f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 0x5585751c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41424/0 (socket says 172.21.15.40:41424) 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f760f400640 1 -- 172.21.15.40:0/2915905682 learned_addr learned my addr 172.21.15.40:0/2915905682 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.446+0000 7f760f400640 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e23840 0x5585751c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760fe00640 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760f400640 1 -- 172.21.15.40:0/2915905682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 msgr2=0x5585751c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760f400640 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760f400640 1 -- 172.21.15.40:0/2915905682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e23840 msgr2=0x5585751c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760f400640 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e23840 0x5585751c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760f400640 1 -- 172.21.15.40:0/2915905682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585750b5b10 con 0x558574e02b60 2024-07-26T13:34:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760cc00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75f40b3c40 0x7f75f40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.447+0000 7f760f400640 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 0x5585751c9e30 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009900 tx=0x7f75fc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886fc64fa2cc58f9 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.448+0000 7f760cc00640 1 -- 172.21.15.40:0/709577236 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9616+0+0 (secure 0 0 0) 0x7f76080e3ec0 con 0x7f7610113c90 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.448+0000 7f760fe00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75f40b3c40 0x7f75f40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.448+0000 7f7605200640 1 -- 172.21.15.40:0/2915905682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc035070 con 0x558574e02b60 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.448+0000 7f7605200640 1 -- 172.21.15.40:0/2915905682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75fc0038c0 con 0x558574e02b60 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.448+0000 7f7605200640 1 -- 172.21.15.40:0/2915905682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc004920 con 0x558574e02b60 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 -- 172.21.15.40:0/2915905682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 msgr2=0x5585751c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f760fe00640 1 --2- 172.21.15.40:0/709577236 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f75f40b3c40 0x7f75f40b6150 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x5585751c8030 tx=0x7f760000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 0x5585751c9e30 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009900 tx=0x7f75fc005fd0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 -- 172.21.15.40:0/2915905682 shutdown_connections 2024-07-26T13:34:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e02b60 0x5585751c9e30 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 --2- 172.21.15.40:0/2915905682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e23840 0x5585751c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 -- 172.21.15.40:0/2915905682 >> 172.21.15.40:0/2915905682 conn(0x558574e17990 msgr2=0x5585751c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T13:34:37.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 -- 172.21.15.40:0/2915905682 shutdown_connections 2024-07-26T13:34:37.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.449+0000 7f761d5c6740 1 -- 172.21.15.40:0/2915905682 wait complete. 2024-07-26T13:34:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.450+0000 7f761d5c6740 1 -- start start 2024-07-26T13:34:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.450+0000 7f761d5c6740 1 Processor -- start 2024-07-26T13:34:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e02b60 0x5585751d5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e23840 0x5585751e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5585750ca520 con 0x558574e23840 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5585751320a0 con 0x558574e02b60 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558574f917a0 con 0x558574dfa980 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f761d5c6740 10 client.0 _ll_register_callbacks cb 0x558575126bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f7614a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e23840 0x5585751e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f7614a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e23840 0x5585751e0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41428/0 (socket says 172.21.15.40:41428) 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f7614a00640 1 -- 172.21.15.40:0/2203918565 learned_addr learned my addr 172.21.15.40:0/2203918565 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.451+0000 7f760f400640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e02b60 0x5585751d5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f7614a00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 msgr2=0x5585751d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f7614a00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558574dfa980 0x5585751d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f7614a00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e02b60 msgr2=0x5585751d5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T13:34:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f7614a00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558574e02b60 0x5585751d5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T13:34:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f7614a00640 1 -- 172.21.15.40:0/2203918565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558574e9db90 con 0x558574e23840 2024-07-26T13:34:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f7614a00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558574e23840 0x5585751e0cd0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f76080a69e0 tx=0x7f76080aa5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c2419e91bc6178 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T13:34:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f75f9600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T13:34:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.452+0000 7f75f9600640 1 -- 172.21.15.40:0/2203918565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760801f040 con 0x558574e23840 2024-07-26T13:34:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f75f9600640 1 -- 172.21.15.40:0/2203918565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9616+0+0 (secure 0 0 0) 0x7f76080abbe0 con 0x558574e23840 2024-07-26T13:34:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f761d5c6740 1 -- 172.21.15.40:0/2203918565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75fc0038c0 con 0x558574e23840 2024-07-26T13:34:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f75f9600640 1 -- 172.21.15.40:0/2203918565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) ==== 24+0+0 (secure 0 0 0) 0x7f76080b3960 con 0x558574e23840 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f761d5c6740 10 client.18387 fetch_fsmap learned FSMap version 97 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f761d5c6740 1 -- 172.21.15.40:0/2203918565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=4+}) -- 0x5585751e3aa0 con 0x558574e23840 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f75f9600640 1 -- 172.21.15.40:0/2203918565 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75fc0038c0 con 0x558574e23840 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f75f9600640 1 -- 172.21.15.40:0/2203918565 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 97) ==== 8362+0+0 (secure 0 0 0) 0x7f7608022060 con 0x558574e23840 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f761d5c6740 10 client.18387 fetch_fsmap finished waiting for FSMap version 97 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.453+0000 7f761d5c6740 10 client.18387 resolve_mds: validated gid 37769 aka daemon mds.k 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f761d5c6740 20 client.18387 populate_metadata read hostname 'smithi040' 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f761d5c6740 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f761d5c6740 4 client.18387 mds_command: new command op to 37769 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f761d5c6740 1 -- 172.21.15.40:0/2203918565 --> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558575140ab0 con 0x558574de21c0 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.454+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-26T13:34:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.656+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.656+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-26T13:34:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:37.656+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:38.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:38.058+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:38.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:38.058+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-07-26T13:34:38.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:38.058+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:38.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:38.859+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:38.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:38.859+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-07-26T13:34:38.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:38.859+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:39 smithi146 ceph-mon[35807]: pgmap v2688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 766 B/s wr, 13 op/s 2024-07-26T13:34:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:39 smithi076 ceph-mon[35401]: pgmap v2688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 766 B/s wr, 13 op/s 2024-07-26T13:34:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:39 smithi040 ceph-mon[32397]: pgmap v2688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 766 B/s wr, 13 op/s 2024-07-26T13:34:40.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:40.461+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:40.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:40.461+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-07-26T13:34:40.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:40.461+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:34:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:41 smithi146 ceph-mon[35807]: pgmap v2689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 437 B/s wr, 14 op/s 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: Stopped Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.570s CPU time. 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: Starting Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: Stopped Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.622s CPU time. 2024-07-26T13:34:41.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:41 smithi146 systemd[1]: Starting Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:41 smithi076 ceph-mon[35401]: pgmap v2689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 437 B/s wr, 14 op/s 2024-07-26T13:34:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:41 smithi040 ceph-mon[32397]: pgmap v2689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 437 B/s wr, 14 op/s 2024-07-26T13:34:41.967 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:41 smithi146 podman[88955]: 2024-07-26 13:34:41.621378386 +0000 UTC m=+0.033809669 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:41.967 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:41 smithi146 podman[88956]: 2024-07-26 13:34:41.621283668 +0000 UTC m=+0.032832420 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:41.967 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:41 smithi146 podman[88956]: 2024-07-26 13:34:41.755523753 +0000 UTC m=+0.167072518 container create ae27b17d7eacaa5ba691c845976ee17f41219984c818bf49f7840d8d68061db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0) 2024-07-26T13:34:41.977 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: Stopped Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.620s CPU time. 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: Starting Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: Stopped Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.320s CPU time. 2024-07-26T13:34:41.978 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:41 smithi076 systemd[1]: Starting Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:34:42.262 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:41 smithi146 podman[88955]: 2024-07-26 13:34:41.966127017 +0000 UTC m=+0.378558335 container create cc61deef6bf73e11d981502be2c49725480e9e5c21157bce673808192e90ab2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True) 2024-07-26T13:34:42.333 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:41 smithi076 podman[87236]: 2024-07-26 13:34:41.88186894 +0000 UTC m=+0.034576994 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:42.333 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:42 smithi076 podman[87236]: 2024-07-26 13:34:42.010829302 +0000 UTC m=+0.163537375 container create f44a31e5196de3b2af0adb367fe7e522de8736d0999c2c4f9b9b7a4c1553d26e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS) 2024-07-26T13:34:42.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:41 smithi076 podman[87235]: 2024-07-26 13:34:41.882191816 +0000 UTC m=+0.035834656 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:34:42.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 podman[87235]: 2024-07-26 13:34:42.21913369 +0000 UTC m=+0.372776566 container create 4bef471a01405831bde96587f8b752847a5d5f77f222b181dd7283b276dee554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:42 smithi146 podman[88955]: 2024-07-26 13:34:42.470933595 +0000 UTC m=+0.883364920 container init cc61deef6bf73e11d981502be2c49725480e9e5c21157bce673808192e90ab2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:42 smithi146 podman[88955]: 2024-07-26 13:34:42.480327011 +0000 UTC m=+0.892758318 container start cc61deef6bf73e11d981502be2c49725480e9e5c21157bce673808192e90ab2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:42 smithi146 podman[88956]: 2024-07-26 13:34:42.26137743 +0000 UTC m=+0.672926202 container init ae27b17d7eacaa5ba691c845976ee17f41219984c818bf49f7840d8d68061db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:42 smithi146 podman[88956]: 2024-07-26 13:34:42.271390823 +0000 UTC m=+0.682939572 container start ae27b17d7eacaa5ba691c845976ee17f41219984c818bf49f7840d8d68061db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:42 smithi146 bash[88956]: ae27b17d7eacaa5ba691c845976ee17f41219984c818bf49f7840d8d68061db1 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:42 smithi146 systemd[1]: Started Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:42 smithi146 ceph-mds[88991]: -- 172.21.15.146:0/2547326375 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55897cd85860 con 0x558980f27600 2024-07-26T13:34:42.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:34:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: starting mds.c at 2024-07-26T13:34:42.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:42 smithi076 podman[87236]: 2024-07-26 13:34:42.481175959 +0000 UTC m=+0.633884038 container init f44a31e5196de3b2af0adb367fe7e522de8736d0999c2c4f9b9b7a4c1553d26e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T13:34:42.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:42 smithi076 podman[87236]: 2024-07-26 13:34:42.492067793 +0000 UTC m=+0.644775869 container start f44a31e5196de3b2af0adb367fe7e522de8736d0999c2c4f9b9b7a4c1553d26e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS) 2024-07-26T13:34:42.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: starting mds.b at 2024-07-26T13:34:42.834 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:42 smithi076 bash[87236]: f44a31e5196de3b2af0adb367fe7e522de8736d0999c2c4f9b9b7a4c1553d26e 2024-07-26T13:34:42.834 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:34:42 smithi076 systemd[1]: Started Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:43.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:42 smithi146 bash[88955]: cc61deef6bf73e11d981502be2c49725480e9e5c21157bce673808192e90ab2a 2024-07-26T13:34:43.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:42 smithi146 systemd[1]: Started Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:43.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:42 smithi146 ceph-mds[89012]: -- 172.21.15.146:0/661445464 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56330296f860 con 0x563306b11180 2024-07-26T13:34:43.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:34:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: starting mds.i at 2024-07-26T13:34:43.270 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 podman[87235]: 2024-07-26 13:34:42.856655202 +0000 UTC m=+1.010298085 container init 4bef471a01405831bde96587f8b752847a5d5f77f222b181dd7283b276dee554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-07-26T13:34:43.270 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 podman[87235]: 2024-07-26 13:34:42.866616507 +0000 UTC m=+1.020259386 container start 4bef471a01405831bde96587f8b752847a5d5f77f222b181dd7283b276dee554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724) 2024-07-26T13:34:43.270 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 bash[87235]: 4bef471a01405831bde96587f8b752847a5d5f77f222b181dd7283b276dee554 2024-07-26T13:34:43.270 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 systemd[1]: Started Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:34:43.270 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 ceph-mds[87295]: -- 172.21.15.76:0/153148355 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574c7fd3860 con 0x5574cc175a80 2024-07-26T13:34:43.270 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:34:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: starting mds.k at 2024-07-26T13:34:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: pgmap v2690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 op/s 2024-07-26T13:34:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: daemon mds.c restarted 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: osdmap e98: 12 total, 12 up, 12 in 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:boot 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=b=up:active,3=i=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: daemon mds.i restarted 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: osdmap e99: 12 total, 12 up, 12 in 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:boot 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:34:43.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=b=up:active,4=g=up:replay} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: daemon mds.b restarted 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: osdmap e100: 12 total, 12 up, 12 in 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:boot 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=a=up:replay,4=g=up:replay} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 3 up:replay 2 up:active 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: daemon mds.k restarted 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: osdmap e101: 12 total, 12 up, 12 in 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:resolve 2024-07-26T13:34:43.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:boot 2024-07-26T13:34:43.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:34:43.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:resolve,3=a=up:replay,4=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:43.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:34:43.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:43 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: pgmap v2690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 op/s 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: daemon mds.c restarted 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: osdmap e98: 12 total, 12 up, 12 in 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:boot 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=b=up:active,3=i=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:43.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: daemon mds.i restarted 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: osdmap e99: 12 total, 12 up, 12 in 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:boot 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=b=up:active,4=g=up:replay} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: daemon mds.b restarted 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: osdmap e100: 12 total, 12 up, 12 in 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:boot 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:34:43.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=a=up:replay,4=g=up:replay} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 3 up:replay 2 up:active 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: daemon mds.k restarted 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: osdmap e101: 12 total, 12 up, 12 in 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:resolve 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:boot 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:resolve,3=a=up:replay,4=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:34:43.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:43 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:34:43.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:43.665+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:43.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: pgmap v2690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 op/s 2024-07-26T13:34:43.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: daemon mds.c restarted 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: osdmap e98: 12 total, 12 up, 12 in 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:boot 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=b=up:active,3=i=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: daemon mds.i restarted 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: osdmap e99: 12 total, 12 up, 12 in 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:boot 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=b=up:active,4=g=up:replay} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:34:43.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: daemon mds.b restarted 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: osdmap e100: 12 total, 12 up, 12 in 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:boot 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=a=up:replay,4=g=up:replay} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 3 up:replay 2 up:active 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: daemon mds.k restarted 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: osdmap e101: 12 total, 12 up, 12 in 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:resolve 2024-07-26T13:34:43.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:boot 2024-07-26T13:34:43.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:34:43.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:resolve,3=a=up:replay,4=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:34:43.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:34:43.671 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:43 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:34:43.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:43.668+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-07-26T13:34:43.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:43.668+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-07-26T13:34:43.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:43.668+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-07-26T13:34:43.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:43.668+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-07-26T13:34:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:45 smithi146 ceph-mon[35807]: pgmap v2695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-07-26T13:34:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:45 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:resolve 2024-07-26T13:34:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:45 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:resolve 2024-07-26T13:34:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:45 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:34:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:45 smithi076 ceph-mon[35401]: pgmap v2695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-07-26T13:34:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:45 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:resolve 2024-07-26T13:34:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:45 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:resolve 2024-07-26T13:34:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:45 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:34:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:45 smithi040 ceph-mon[32397]: pgmap v2695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-07-26T13:34:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:45 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:resolve 2024-07-26T13:34:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:45 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:resolve 2024-07-26T13:34:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:45 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:34:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:47 smithi146 ceph-mon[35807]: pgmap v2696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 op/s 2024-07-26T13:34:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:47 smithi076 ceph-mon[35401]: pgmap v2696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 op/s 2024-07-26T13:34:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:47 smithi040 ceph-mon[32397]: pgmap v2696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 op/s 2024-07-26T13:34:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:48 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:resolve 2024-07-26T13:34:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:48 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:48 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:resolve 2024-07-26T13:34:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:48 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:48 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:resolve 2024-07-26T13:34:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:48 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: *** Caught signal (Aborted) ** 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: in thread 7f77d6400640 thread_name:ms_dispatch 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f77dc63e6f0] 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f77dc68b94c] 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 3: raise() 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 4: abort() 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 5: /lib64/libc.so.6(+0x2871b) [0x7f77dc62871b] 2024-07-26T13:34:49.575 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 6: /lib64/libc.so.6(+0x37386) [0x7f77dc637386] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5595350fa6b9] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5595352b880c] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5595351f82ca] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5595351c8753] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5595351c9a1b] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5595351ad752] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5595350fba56] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5595350ff637] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5595350fff5e] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5595350e303a] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f77dd19b407] 2024-07-26T13:34:49.576 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 18: (DispatchQueue::entry()+0x60f) [0x7f77dd19bcf9] 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f77dd2785a1] 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: pgmap v2697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 12 op/s 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499985 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:reconnect 2024-07-26T13:34:49.577 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:reconnect 2024-07-26T13:34:49.578 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:reconnect 2024-07-26T13:34:49.578 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:reconnect 2024-07-26T13:34:49.578 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:49.578 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 20: (Thread::entry_wrapper()+0x43) [0x7f77dd025cdd] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 21: (Thread::_entry_func(void*)+0xd) [0x7f77dd025cf9] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 22: /lib64/libc.so.6(+0x89c02) [0x7f77dc689c02] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f77dc70ec40] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.524+0000 7f77d6400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: in thread 7f77d6400640 thread_name:ms_dispatch 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f77dc63e6f0] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f77dc68b94c] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 3: raise() 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 4: abort() 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 5: /lib64/libc.so.6(+0x2871b) [0x7f77dc62871b] 2024-07-26T13:34:49.579 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 6: /lib64/libc.so.6(+0x37386) [0x7f77dc637386] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5595350fa6b9] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5595352b880c] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5595351f82ca] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5595351c8753] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5595351c9a1b] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5595351ad752] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5595350fba56] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5595350ff637] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5595350fff5e] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5595350e303a] 2024-07-26T13:34:49.580 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f77dd19b407] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 18: (DispatchQueue::entry()+0x60f) [0x7f77dd19bcf9] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f77dd2785a1] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 20: (Thread::entry_wrapper()+0x43) [0x7f77dd025cdd] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 21: (Thread::_entry_func(void*)+0xd) [0x7f77dd025cf9] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 22: /lib64/libc.so.6(+0x89c02) [0x7f77dc689c02] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f77dc70ec40] 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 0> 2024-07-26T13:34:49.524+0000 7f77d6400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: in thread 7f77d6400640 thread_name:ms_dispatch 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.581 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f77dc63e6f0] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f77dc68b94c] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 3: raise() 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 4: abort() 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 5: /lib64/libc.so.6(+0x2871b) [0x7f77dc62871b] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 6: /lib64/libc.so.6(+0x37386) [0x7f77dc637386] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5595350fa6b9] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5595352b880c] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5595351f82ca] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5595351c8753] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5595351c9a1b] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5595351ad752] 2024-07-26T13:34:49.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5595350fba56] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5595350ff637] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5595350fff5e] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5595350e303a] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f77dd19b407] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 18: (DispatchQueue::entry()+0x60f) [0x7f77dd19bcf9] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f77dd2785a1] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 20: (Thread::entry_wrapper()+0x43) [0x7f77dd025cdd] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 21: (Thread::_entry_func(void*)+0xd) [0x7f77dd025cf9] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 22: /lib64/libc.so.6(+0x89c02) [0x7f77dc689c02] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f77dc70ec40] 2024-07-26T13:34:49.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 0> 2024-07-26T13:34:49.524+0000 7f77d6400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: in thread 7f77d6400640 thread_name:ms_dispatch 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f77dc63e6f0] 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f77dc68b94c] 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 3: raise() 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 4: abort() 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 5: /lib64/libc.so.6(+0x2871b) [0x7f77dc62871b] 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 6: /lib64/libc.so.6(+0x37386) [0x7f77dc637386] 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5595350fa6b9] 2024-07-26T13:34:49.584 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5595352b880c] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5595351f82ca] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5595351c8753] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5595351c9a1b] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5595351ad752] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5595350fba56] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5595350ff637] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5595350fff5e] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5595350e303a] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f77dd19b407] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 18: (DispatchQueue::entry()+0x60f) [0x7f77dd19bcf9] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f77dd2785a1] 2024-07-26T13:34:49.585 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 20: (Thread::entry_wrapper()+0x43) [0x7f77dd025cdd] 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 21: (Thread::_entry_func(void*)+0xd) [0x7f77dd025cf9] 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 22: /lib64/libc.so.6(+0x89c02) [0x7f77dc689c02] 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f77dc70ec40] 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[86871]: 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: pgmap v2697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 12 op/s 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:34:49.586 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499985 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:reconnect 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:reconnect 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:reconnect 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:reconnect 2024-07-26T13:34:49.587 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: *** Caught signal (Aborted) ** 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: in thread 7f2389400640 thread_name:ms_dispatch 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f238f63e6f0] 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f238f68b94c] 2024-07-26T13:34:49.588 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 3: raise() 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 4: abort() 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 5: /lib64/libc.so.6(+0x2871b) [0x7f238f62871b] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 6: /lib64/libc.so.6(+0x37386) [0x7f238f637386] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5616cdae56b9] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5616cdca380c] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5616cdbe32ca] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5616cdbb3753] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5616cdbb4a1b] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5616cdb98752] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5616cdae6a56] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5616cdaea637] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5616cdaeaf5e] 2024-07-26T13:34:49.589 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5616cdace03a] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f239019b407] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 18: (DispatchQueue::entry()+0x60f) [0x7f239019bcf9] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f23902785a1] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 20: (Thread::entry_wrapper()+0x43) [0x7f2390025cdd] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2390025cf9] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 22: /lib64/libc.so.6(+0x89c02) [0x7f238f689c02] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f238f70ec40] 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.523+0000 7f2389400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: in thread 7f2389400640 thread_name:ms_dispatch 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.590 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f238f63e6f0] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f238f68b94c] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 3: raise() 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 4: abort() 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 5: /lib64/libc.so.6(+0x2871b) [0x7f238f62871b] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 6: /lib64/libc.so.6(+0x37386) [0x7f238f637386] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5616cdae56b9] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5616cdca380c] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5616cdbe32ca] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5616cdbb3753] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5616cdbb4a1b] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5616cdb98752] 2024-07-26T13:34:49.591 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5616cdae6a56] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5616cdaea637] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5616cdaeaf5e] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5616cdace03a] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f239019b407] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 18: (DispatchQueue::entry()+0x60f) [0x7f239019bcf9] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f23902785a1] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 20: (Thread::entry_wrapper()+0x43) [0x7f2390025cdd] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2390025cf9] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 22: /lib64/libc.so.6(+0x89c02) [0x7f238f689c02] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f238f70ec40] 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.592 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 0> 2024-07-26T13:34:49.523+0000 7f2389400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: in thread 7f2389400640 thread_name:ms_dispatch 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f238f63e6f0] 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f238f68b94c] 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 3: raise() 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 4: abort() 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 5: /lib64/libc.so.6(+0x2871b) [0x7f238f62871b] 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 6: /lib64/libc.so.6(+0x37386) [0x7f238f637386] 2024-07-26T13:34:49.593 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5616cdae56b9] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5616cdca380c] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5616cdbe32ca] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5616cdbb3753] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5616cdbb4a1b] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5616cdb98752] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5616cdae6a56] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5616cdaea637] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5616cdaeaf5e] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5616cdace03a] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f239019b407] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 18: (DispatchQueue::entry()+0x60f) [0x7f239019bcf9] 2024-07-26T13:34:49.594 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f23902785a1] 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 20: (Thread::entry_wrapper()+0x43) [0x7f2390025cdd] 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2390025cf9] 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 22: /lib64/libc.so.6(+0x89c02) [0x7f238f689c02] 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f238f70ec40] 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 0> 2024-07-26T13:34:49.523+0000 7f2389400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: in thread 7f2389400640 thread_name:ms_dispatch 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f238f63e6f0] 2024-07-26T13:34:49.595 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f238f68b94c] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 3: raise() 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 4: abort() 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 5: /lib64/libc.so.6(+0x2871b) [0x7f238f62871b] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 6: /lib64/libc.so.6(+0x37386) [0x7f238f637386] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5616cdae56b9] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5616cdca380c] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5616cdbe32ca] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5616cdbb3753] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5616cdbb4a1b] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5616cdb98752] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5616cdae6a56] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5616cdaea637] 2024-07-26T13:34:49.596 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5616cdaeaf5e] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5616cdace03a] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f239019b407] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 18: (DispatchQueue::entry()+0x60f) [0x7f239019bcf9] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f23902785a1] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 20: (Thread::entry_wrapper()+0x43) [0x7f2390025cdd] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2390025cf9] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 22: /lib64/libc.so.6(+0x89c02) [0x7f238f689c02] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f238f70ec40] 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.597 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[88599]: 2024-07-26T13:34:49.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: pgmap v2697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 12 op/s 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499985 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:reconnect 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:reconnect 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:reconnect 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:reconnect 2024-07-26T13:34:49.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: *** Caught signal (Aborted) ** 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: in thread 7f48b9200640 thread_name:ms_dispatch 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bf43e6f0] 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bf48b94c] 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 3: raise() 2024-07-26T13:34:49.654 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 4: abort() 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bf42871b] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bf437386] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5636059c36b9] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563605b8180c] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563605ac12ca] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563605a91753] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563605a92a1b] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563605a76752] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5636059c4a56] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5636059c8637] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5636059c8f5e] 2024-07-26T13:34:49.655 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5636059ac03a] 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bff9b407] 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bff9bcf9] 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48c00785a1] 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: *** Caught signal (Aborted) ** 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: in thread 7fd8ad200640 thread_name:ms_dispatch 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8b343e6f0] 2024-07-26T13:34:49.656 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd8b348b94c] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 3: raise() 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 4: abort() 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8b342871b] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8b3437386] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559bb35ce6b9] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559bb378c80c] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559bb36cc2ca] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559bb369c753] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559bb369da1b] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559bb3681752] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559bb35cfa56] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559bb35d3637] 2024-07-26T13:34:49.657 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559bb35d3f5e] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559bb35b703a] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8b3f9b407] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8b3f9bcf9] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd8b40785a1] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bfe25cdd] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bfe25cf9] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bf489c02] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48bf50ec40] 2024-07-26T13:34:49.658 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.522+0000 7f48b9200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: in thread 7f48b9200640 thread_name:ms_dispatch 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bf43e6f0] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bf48b94c] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 3: raise() 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 4: abort() 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bf42871b] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bf437386] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5636059c36b9] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563605b8180c] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563605ac12ca] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563605a91753] 2024-07-26T13:34:49.659 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563605a92a1b] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563605a76752] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5636059c4a56] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5636059c8637] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5636059c8f5e] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5636059ac03a] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bff9b407] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bff9bcf9] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48c00785a1] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 20: (Thread::entry_wrapper()+0x43) [0x7fd8b3e25cdd] 2024-07-26T13:34:49.660 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd8b3e25cf9] 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd8b3489c02] 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8b350ec40] 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.523+0000 7fd8ad200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: in thread 7fd8ad200640 thread_name:ms_dispatch 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8b343e6f0] 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd8b348b94c] 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 3: raise() 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 4: abort() 2024-07-26T13:34:49.661 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8b342871b] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8b3437386] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559bb35ce6b9] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559bb378c80c] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559bb36cc2ca] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559bb369c753] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559bb369da1b] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559bb3681752] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559bb35cfa56] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559bb35d3637] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559bb35d3f5e] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559bb35b703a] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8b3f9b407] 2024-07-26T13:34:49.662 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8b3f9bcf9] 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd8b40785a1] 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bfe25cdd] 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bfe25cf9] 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bf489c02] 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48bf50ec40] 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.663 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 0> 2024-07-26T13:34:49.522+0000 7f48b9200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: in thread 7f48b9200640 thread_name:ms_dispatch 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bf43e6f0] 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bf48b94c] 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 3: raise() 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 4: abort() 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bf42871b] 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bf437386] 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5636059c36b9] 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563605b8180c] 2024-07-26T13:34:49.664 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563605ac12ca] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563605a91753] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563605a92a1b] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563605a76752] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5636059c4a56] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5636059c8637] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5636059c8f5e] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5636059ac03a] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 20: (Thread::entry_wrapper()+0x43) [0x7fd8b3e25cdd] 2024-07-26T13:34:49.665 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd8b3e25cf9] 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd8b3489c02] 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8b350ec40] 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 0> 2024-07-26T13:34:49.523+0000 7fd8ad200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: in thread 7fd8ad200640 thread_name:ms_dispatch 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8b343e6f0] 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd8b348b94c] 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 3: raise() 2024-07-26T13:34:49.666 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 4: abort() 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8b342871b] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8b3437386] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559bb35ce6b9] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559bb378c80c] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559bb36cc2ca] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559bb369c753] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559bb369da1b] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559bb3681752] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559bb35cfa56] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559bb35d3637] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559bb35d3f5e] 2024-07-26T13:34:49.667 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559bb35b703a] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bff9b407] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bff9bcf9] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48c00785a1] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bfe25cdd] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bfe25cf9] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bf489c02] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48bf50ec40] 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.668 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: -3> 2024-07-26T13:34:49.522+0000 7f48b9200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: in thread 7f48b9200640 thread_name:ms_dispatch 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bf43e6f0] 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bf48b94c] 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 3: raise() 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 4: abort() 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bf42871b] 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bf437386] 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5636059c36b9] 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x563605b8180c] 2024-07-26T13:34:49.669 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x563605ac12ca] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x563605a91753] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x563605a92a1b] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x563605a76752] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5636059c4a56] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5636059c8637] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8b3f9b407] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8b3f9bcf9] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd8b40785a1] 2024-07-26T13:34:49.670 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 20: (Thread::entry_wrapper()+0x43) [0x7fd8b3e25cdd] 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd8b3e25cf9] 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd8b3489c02] 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8b350ec40] 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 0> 2024-07-26T13:34:49.523+0000 7fd8ad200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: in thread 7fd8ad200640 thread_name:ms_dispatch 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd8b343e6f0] 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd8b348b94c] 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 3: raise() 2024-07-26T13:34:49.671 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 4: abort() 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd8b342871b] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 6: /lib64/libc.so.6(+0x37386) [0x7fd8b3437386] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x559bb35ce6b9] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x559bb378c80c] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x559bb36cc2ca] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x559bb369c753] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x559bb369da1b] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x559bb3681752] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x559bb35cfa56] 2024-07-26T13:34:49.672 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x559bb35d3637] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5636059c8f5e] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5636059ac03a] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bff9b407] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bff9bcf9] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48c00785a1] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bfe25cdd] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bfe25cf9] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bf489c02] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48bf50ec40] 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.673 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187152]: 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x559bb35d3f5e] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x559bb35b703a] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd8b3f9b407] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 18: (DispatchQueue::entry()+0x60f) [0x7fd8b3f9bcf9] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd8b40785a1] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 20: (Thread::entry_wrapper()+0x43) [0x7fd8b3e25cdd] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd8b3e25cf9] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd8b3489c02] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd8b350ec40] 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:34:49.674 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187092]: 2024-07-26T13:34:49.675 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:49 smithi040 podman[187643]: 2024-07-26 13:34:49.651634592 +0000 UTC m=+0.039719175 container died e0e1b59aff1d78e10d414c714d66fec248fec8114a7a2a5edc85f487ec99e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-07-26T13:34:49.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:49 smithi076 podman[87341]: 2024-07-26 13:34:49.647089939 +0000 UTC m=+0.032646840 container died 87138b63bff9647c8c47dd2d0b5fb1646a376c80cf32b1a7b6750a7298373cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:34:49.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:49 smithi040 podman[187644]: 2024-07-26 13:34:49.886983323 +0000 UTC m=+0.271860110 container died d52b694d3c9256faba8d98b4f80fdc13b190301775a96fec7f3e54085910ad1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724) 2024-07-26T13:34:49.986 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:49 smithi146 podman[89057]: 2024-07-26 13:34:49.649614188 +0000 UTC m=+0.032164147 container died dfc6eda6138a0d5246caf8bf8493ece01febf9ea8a61685f9fb76393cb0f5ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-07-26T13:34:50.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:50.075+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:34:50.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:50.077+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-07-26T13:34:50.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:50.077+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-07-26T13:34:50.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:50.077+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-07-26T13:34:50.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:34:50.077+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-07-26T13:34:50.570 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:50 smithi146 podman[89057]: 2024-07-26 13:34:50.281311055 +0000 UTC m=+0.663861047 container remove dfc6eda6138a0d5246caf8bf8493ece01febf9ea8a61685f9fb76393cb0f5ab0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:34:50.570 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:rejoin 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:rejoin 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:rejoin 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:rejoin 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:active 2024-07-26T13:34:50.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:active 2024-07-26T13:34:50.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:active 2024-07-26T13:34:50.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:active 2024-07-26T13:34:50.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:50 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:50.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:50 smithi076 podman[87341]: 2024-07-26 13:34:50.301234585 +0000 UTC m=+0.686791517 container remove 87138b63bff9647c8c47dd2d0b5fb1646a376c80cf32b1a7b6750a7298373cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:34:50.582 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:rejoin 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:rejoin 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:rejoin 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:rejoin 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:active 2024-07-26T13:34:50.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:active 2024-07-26T13:34:50.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:active 2024-07-26T13:34:50.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:active 2024-07-26T13:34:50.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:50 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:50.592 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:50 smithi040 podman[187643]: 2024-07-26 13:34:50.580379697 +0000 UTC m=+0.968464310 container remove e0e1b59aff1d78e10d414c714d66fec248fec8114a7a2a5edc85f487ec99e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-26T13:34:50.592 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:rejoin 2024-07-26T13:34:50.592 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:rejoin 2024-07-26T13:34:50.592 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:rejoin 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:rejoin 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/3238351765,v1:172.21.15.40:6841/3238351765] up:active 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/26169584,v1:172.21.15.40:6839/26169584] up:active 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/900875035,v1:172.21.15.146:6835/900875035] up:active 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/2335337936,v1:172.21.15.76:6835/2335337936] up:active 2024-07-26T13:34:50.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:50 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:34:50.892 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:51.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:34:51.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:34:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.721s CPU time. 2024-07-26T13:34:51.082 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:34:51.082 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:34:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.447s CPU time. 2024-07-26T13:34:51.232 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:51 smithi040 podman[187644]: 2024-07-26 13:34:51.041465892 +0000 UTC m=+1.426342680 container remove d52b694d3c9256faba8d98b4f80fdc13b190301775a96fec7f3e54085910ad1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-07-26T13:34:51.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:51 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:34:51.523 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:51 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:34:51.523 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:34:51 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.740s CPU time. 2024-07-26T13:34:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:51 smithi076 ceph-mon[35401]: pgmap v2698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 op/s 2024-07-26T13:34:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:51 smithi146 ceph-mon[35807]: pgmap v2698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 op/s 2024-07-26T13:34:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:51 smithi040 ceph-mon[32397]: pgmap v2698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 11 op/s 2024-07-26T13:34:51.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:51 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:34:51.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:34:51 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.756s CPU time. 2024-07-26T13:34:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:53 smithi040 ceph-mon[32397]: pgmap v2699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 op/s 2024-07-26T13:34:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:53 smithi146 ceph-mon[35807]: pgmap v2699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 op/s 2024-07-26T13:34:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:53 smithi076 ceph-mon[35401]: pgmap v2699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 op/s 2024-07-26T13:34:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:55 smithi146 ceph-mon[35807]: pgmap v2700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 457 B/s wr, 12 op/s 2024-07-26T13:34:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:55 smithi076 ceph-mon[35401]: pgmap v2700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 457 B/s wr, 12 op/s 2024-07-26T13:34:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:55 smithi040 ceph-mon[32397]: pgmap v2700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 457 B/s wr, 12 op/s 2024-07-26T13:34:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:56 smithi040 ceph-mon[32397]: pgmap v2701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:56 smithi146 ceph-mon[35807]: pgmap v2701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:56 smithi076 ceph-mon[35401]: pgmap v2701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:34:59 smithi146 ceph-mon[35807]: pgmap v2702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:34:59 smithi076 ceph-mon[35401]: pgmap v2702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:34:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:34:59 smithi040 ceph-mon[32397]: pgmap v2702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 12 op/s 2024-07-26T13:35:01.217 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:00 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:35:01.217 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:00 smithi146 systemd[1]: Stopped Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:01.217 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:00 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.721s CPU time. 2024-07-26T13:35:01.217 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:00 smithi146 systemd[1]: Starting Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:01.221 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:00 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:35:01.221 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:00 smithi076 systemd[1]: Stopped Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:01.221 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:00 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.447s CPU time. 2024-07-26T13:35:01.222 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:00 smithi076 systemd[1]: Starting Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:01.490 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 podman[87434]: 2024-07-26 13:35:01.124985345 +0000 UTC m=+0.034136779 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:01.490 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 podman[87434]: 2024-07-26 13:35:01.235579914 +0000 UTC m=+0.144731366 container create f9a01dfb6cdf7febdf8874be28f1f4569e5c9a8db1a11d214d8c3adc23700297 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-07-26T13:35:01.490 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:01 smithi076 ceph-mon[35401]: pgmap v2703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:01.510 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:01 smithi146 ceph-mon[35807]: pgmap v2703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:01.511 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 podman[89149]: 2024-07-26 13:35:01.120170176 +0000 UTC m=+0.033099530 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:01.511 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 podman[89149]: 2024-07-26 13:35:01.242252299 +0000 UTC m=+0.155181687 container create 4072518d7514979620fbb49a94434b67a80f0246b4da7ba088a42b6a65421569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T13:35:01.511 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 podman[89149]: 2024-07-26 13:35:01.509913268 +0000 UTC m=+0.422842662 container init 4072518d7514979620fbb49a94434b67a80f0246b4da7ba088a42b6a65421569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:35:01.522 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:01 smithi040 ceph-mon[32397]: pgmap v2703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:01.523 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:35:01.523 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: Stopped Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:01.523 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.740s CPU time. 2024-07-26T13:35:01.523 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: Starting Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:01.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 podman[89149]: 2024-07-26 13:35:01.520695065 +0000 UTC m=+0.433624456 container start 4072518d7514979620fbb49a94434b67a80f0246b4da7ba088a42b6a65421569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T13:35:01.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 bash[89149]: 4072518d7514979620fbb49a94434b67a80f0246b4da7ba088a42b6a65421569 2024-07-26T13:35:01.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 systemd[1]: Started Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:01.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:01 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: starting mds.f at 2024-07-26T13:35:01.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 podman[87434]: 2024-07-26 13:35:01.488909917 +0000 UTC m=+0.398061375 container init f9a01dfb6cdf7febdf8874be28f1f4569e5c9a8db1a11d214d8c3adc23700297 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:35:01.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 podman[87434]: 2024-07-26 13:35:01.500730059 +0000 UTC m=+0.409881487 container start f9a01dfb6cdf7febdf8874be28f1f4569e5c9a8db1a11d214d8c3adc23700297 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-07-26T13:35:01.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 bash[87434]: f9a01dfb6cdf7febdf8874be28f1f4569e5c9a8db1a11d214d8c3adc23700297 2024-07-26T13:35:01.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 ceph-mds[87454]: -- 172.21.15.76:0/1757190843 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e98fa01860 con 0x55e993ba3180 2024-07-26T13:35:01.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: starting mds.e at 2024-07-26T13:35:01.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:01 smithi076 systemd[1]: Started Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:01.902 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:01 smithi040 podman[187811]: 2024-07-26 13:35:01.788647827 +0000 UTC m=+0.033227615 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:01.902 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 3. 2024-07-26T13:35:01.903 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: Stopped Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:01.903 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.756s CPU time. 2024-07-26T13:35:01.903 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:01 smithi040 systemd[1]: Starting Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:02.156 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:01 smithi040 podman[187811]: 2024-07-26 13:35:01.901173847 +0000 UTC m=+0.145753669 container create e629fb0f0264bc2a1a57aa975b85a6c7373be69970ddbf77d9ff5db22f44d2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:35:02.431 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 podman[187855]: 2024-07-26 13:35:02.302107943 +0000 UTC m=+0.114047486 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:02.431 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 podman[187855]: 2024-07-26 13:35:02.429703868 +0000 UTC m=+0.241643433 container create c72c5767baa3b438022a11997a261cdf9ef326f72b9f68481cd952070c992f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-07-26T13:35:02.431 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:02 smithi040 podman[187811]: 2024-07-26 13:35:02.154945355 +0000 UTC m=+0.399525190 container init e629fb0f0264bc2a1a57aa975b85a6c7373be69970ddbf77d9ff5db22f44d2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T13:35:02.431 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:02 smithi040 podman[187811]: 2024-07-26 13:35:02.166646954 +0000 UTC m=+0.411226748 container start e629fb0f0264bc2a1a57aa975b85a6c7373be69970ddbf77d9ff5db22f44d2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=) 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:02 smithi040 bash[187811]: e629fb0f0264bc2a1a57aa975b85a6c7373be69970ddbf77d9ff5db22f44d2a2 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:02 smithi040 systemd[1]: Started Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mds[187854]: -- 172.21.15.40:0/3379647284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c5b589c20 con 0x562c5f72ba80 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: starting mds.g at 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: daemon mds.e restarted 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: osdmap e102: 12 total, 12 up, 12 in 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:boot 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:35:02.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: daemon mds.f restarted 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: osdmap e103: 12 total, 12 up, 12 in 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:boot 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: Standby daemon mds.b assigned to filesystem cephfs as rank 2 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:replay,1=h=up:active,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:35:02.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: daemon mds.e restarted 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: osdmap e102: 12 total, 12 up, 12 in 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:boot 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: daemon mds.f restarted 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: osdmap e103: 12 total, 12 up, 12 in 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:boot 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: Standby daemon mds.b assigned to filesystem cephfs as rank 2 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:replay,1=h=up:active,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:35:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:02 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: daemon mds.e restarted 2024-07-26T13:35:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: osdmap e102: 12 total, 12 up, 12 in 2024-07-26T13:35:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:boot 2024-07-26T13:35:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:35:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: daemon mds.f restarted 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: osdmap e103: 12 total, 12 up, 12 in 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:boot 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: Standby daemon mds.b assigned to filesystem cephfs as rank 2 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:replay,1=h=up:active,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:35:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:02 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:02.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:02.890+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:35:02.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:02.892+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-07-26T13:35:02.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:02.892+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-07-26T13:35:02.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:02.892+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-07-26T13:35:02.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:02.892+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-07-26T13:35:02.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 podman[187855]: 2024-07-26 13:35:02.683496042 +0000 UTC m=+0.495435611 container init c72c5767baa3b438022a11997a261cdf9ef326f72b9f68481cd952070c992f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:02.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 podman[187855]: 2024-07-26 13:35:02.693892544 +0000 UTC m=+0.505832078 container start c72c5767baa3b438022a11997a261cdf9ef326f72b9f68481cd952070c992f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.build-date=20240724, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T13:35:02.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 bash[187855]: c72c5767baa3b438022a11997a261cdf9ef326f72b9f68481cd952070c992f16 2024-07-26T13:35:02.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 systemd[1]: Started Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:02.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-mds[187893]: -- 172.21.15.40:0/3302685498 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dcbae3f860 con 0x55dcbefe1180 2024-07-26T13:35:02.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:02 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: starting mds.a at 2024-07-26T13:35:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: pgmap v2706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 383 B/s wr, 10 op/s 2024-07-26T13:35:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: daemon mds.g restarted 2024-07-26T13:35:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: osdmap e104: 12 total, 12 up, 12 in 2024-07-26T13:35:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:resolve 2024-07-26T13:35:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:boot 2024-07-26T13:35:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:replay,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: daemon mds.a restarted 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: osdmap e105: 12 total, 12 up, 12 in 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:resolve 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:resolve 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:boot 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: Standby daemon mds.i assigned to filesystem cephfs as rank 3 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,4=c=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:35:03.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:03 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:35:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: pgmap v2706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 383 B/s wr, 10 op/s 2024-07-26T13:35:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: daemon mds.g restarted 2024-07-26T13:35:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: osdmap e104: 12 total, 12 up, 12 in 2024-07-26T13:35:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:resolve 2024-07-26T13:35:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:boot 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:replay,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: daemon mds.a restarted 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: osdmap e105: 12 total, 12 up, 12 in 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:resolve 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:resolve 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:boot 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: Standby daemon mds.i assigned to filesystem cephfs as rank 3 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,4=c=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:35:03.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:03 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:35:03.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: pgmap v2706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 383 B/s wr, 10 op/s 2024-07-26T13:35:03.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: daemon mds.g restarted 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: osdmap e104: 12 total, 12 up, 12 in 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:resolve 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:boot 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:replay,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: daemon mds.a restarted 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: osdmap e105: 12 total, 12 up, 12 in 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:resolve 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:resolve 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:boot 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: Standby daemon mds.i assigned to filesystem cephfs as rank 3 2024-07-26T13:35:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=b=up:resolve,4=c=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:03.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:35:03.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:03 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 1 up:replay 3 up:resolve 1 up:active 2024-07-26T13:35:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:05 smithi146 ceph-mon[35807]: pgmap v2709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-07-26T13:35:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:05 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:resolve 2024-07-26T13:35:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:05 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:05.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:05 smithi076 ceph-mon[35401]: pgmap v2709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-07-26T13:35:05.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:05 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:resolve 2024-07-26T13:35:05.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:05 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:05 smithi040 ceph-mon[32397]: pgmap v2709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-07-26T13:35:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:05 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:resolve 2024-07-26T13:35:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:05 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:35:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:35:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:reconnect 2024-07-26T13:35:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:reconnect 2024-07-26T13:35:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:reconnect 2024-07-26T13:35:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:reconnect 2024-07-26T13:35:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:06 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:reconnect 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:reconnect 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:reconnect 2024-07-26T13:35:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:reconnect 2024-07-26T13:35:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:06 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399993 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:reconnect 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:reconnect 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:reconnect 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:reconnect 2024-07-26T13:35:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:06 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: pgmap v2710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 op/s 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:rejoin 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:rejoin 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:rejoin 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:rejoin 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T13:35:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:35:07.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-07-26T13:35:07.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:07 smithi040 ceph-mon[32397]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: pgmap v2710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 op/s 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:rejoin 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:rejoin 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:rejoin 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:rejoin 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:35:07.787 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-mon[35807]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: *** Caught signal (Aborted) ** 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: in thread 7fb2eb400640 thread_name:ms_dispatch 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb2f163e6f0] 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb2f168b94c] 2024-07-26T13:35:07.788 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 3: raise() 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 4: abort() 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb2f162871b] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 6: /lib64/libc.so.6(+0x37386) [0x7fb2f1637386] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896d6bd6b9] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896d87b80c] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896d7bb2ca] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896d78b753] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896d78ca1b] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896d770752] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896d6bea56] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896d6c2637] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896d6c2f5e] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896d6a603a] 2024-07-26T13:35:07.789 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb2f219b407] 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 18: (DispatchQueue::entry()+0x60f) [0x7fb2f219bcf9] 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb2f22785a1] 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: *** Caught signal (Aborted) ** 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: in thread 7f9ecba00640 thread_name:ms_dispatch 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.790 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9ed1c3e6f0] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f9ed1c8b94c] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 3: raise() 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 4: abort() 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 5: /lib64/libc.so.6(+0x2871b) [0x7f9ed1c2871b] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 6: /lib64/libc.so.6(+0x37386) [0x7f9ed1c37386] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5632e04256b9] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5632e05e380c] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5632e05232ca] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5632e04f3753] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5632e04f4a1b] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5632e04d8752] 2024-07-26T13:35:07.791 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5632e0426a56] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5632e042a637] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5632e042af5e] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5632e040e03a] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9ed279b407] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 18: (DispatchQueue::entry()+0x60f) [0x7f9ed279bcf9] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9ed28785a1] 2024-07-26T13:35:07.792 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 20: (Thread::entry_wrapper()+0x43) [0x7fb2f2025cdd] 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb2f2025cf9] 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb2f1689c02] 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb2f170ec40] 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.337+0000 7fb2eb400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: in thread 7fb2eb400640 thread_name:ms_dispatch 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb2f163e6f0] 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb2f168b94c] 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 3: raise() 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 4: abort() 2024-07-26T13:35:07.793 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb2f162871b] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 6: /lib64/libc.so.6(+0x37386) [0x7fb2f1637386] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896d6bd6b9] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896d87b80c] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896d7bb2ca] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896d78b753] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896d78ca1b] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896d770752] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896d6bea56] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896d6c2637] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896d6c2f5e] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896d6a603a] 2024-07-26T13:35:07.794 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb2f219b407] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 18: (DispatchQueue::entry()+0x60f) [0x7fb2f219bcf9] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb2f22785a1] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 20: (Thread::entry_wrapper()+0x43) [0x7f9ed2625cdd] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9ed2625cf9] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9ed1c89c02] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f9ed1d0ec40] 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.337+0000 7f9ecba00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: in thread 7f9ecba00640 thread_name:ms_dispatch 2024-07-26T13:35:07.795 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9ed1c3e6f0] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f9ed1c8b94c] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 3: raise() 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 4: abort() 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 5: /lib64/libc.so.6(+0x2871b) [0x7f9ed1c2871b] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 6: /lib64/libc.so.6(+0x37386) [0x7f9ed1c37386] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5632e04256b9] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5632e05e380c] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5632e05232ca] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5632e04f3753] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5632e04f4a1b] 2024-07-26T13:35:07.796 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5632e04d8752] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5632e0426a56] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5632e042a637] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5632e042af5e] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5632e040e03a] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9ed279b407] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 18: (DispatchQueue::entry()+0x60f) [0x7f9ed279bcf9] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9ed28785a1] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 20: (Thread::entry_wrapper()+0x43) [0x7fb2f2025cdd] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb2f2025cf9] 2024-07-26T13:35:07.797 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb2f1689c02] 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb2f170ec40] 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 0> 2024-07-26T13:35:07.337+0000 7fb2eb400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: in thread 7fb2eb400640 thread_name:ms_dispatch 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb2f163e6f0] 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb2f168b94c] 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 3: raise() 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 4: abort() 2024-07-26T13:35:07.798 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb2f162871b] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 6: /lib64/libc.so.6(+0x37386) [0x7fb2f1637386] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896d6bd6b9] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896d87b80c] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896d7bb2ca] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896d78b753] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896d78ca1b] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896d770752] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896d6bea56] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896d6c2637] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896d6c2f5e] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896d6a603a] 2024-07-26T13:35:07.799 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb2f219b407] 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 20: (Thread::entry_wrapper()+0x43) [0x7f9ed2625cdd] 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9ed2625cf9] 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9ed1c89c02] 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f9ed1d0ec40] 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 0> 2024-07-26T13:35:07.337+0000 7f9ecba00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: in thread 7f9ecba00640 thread_name:ms_dispatch 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.800 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9ed1c3e6f0] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f9ed1c8b94c] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 3: raise() 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 4: abort() 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 5: /lib64/libc.so.6(+0x2871b) [0x7f9ed1c2871b] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 6: /lib64/libc.so.6(+0x37386) [0x7f9ed1c37386] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5632e04256b9] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5632e05e380c] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5632e05232ca] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5632e04f3753] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5632e04f4a1b] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5632e04d8752] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5632e0426a56] 2024-07-26T13:35:07.801 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5632e042a637] 2024-07-26T13:35:07.802 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5632e042af5e] 2024-07-26T13:35:07.802 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5632e040e03a] 2024-07-26T13:35:07.802 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9ed279b407] 2024-07-26T13:35:07.802 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 18: (DispatchQueue::entry()+0x60f) [0x7fb2f219bcf9] 2024-07-26T13:35:07.802 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb2f22785a1] 2024-07-26T13:35:07.802 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 20: (Thread::entry_wrapper()+0x43) [0x7fb2f2025cdd] 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb2f2025cf9] 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb2f1689c02] 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb2f170ec40] 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 0> 2024-07-26T13:35:07.337+0000 7fb2eb400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: in thread 7fb2eb400640 thread_name:ms_dispatch 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb2f163e6f0] 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb2f168b94c] 2024-07-26T13:35:07.803 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 3: raise() 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 4: abort() 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb2f162871b] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 6: /lib64/libc.so.6(+0x37386) [0x7fb2f1637386] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55896d6bd6b9] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55896d87b80c] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55896d7bb2ca] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55896d78b753] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55896d78ca1b] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55896d770752] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55896d6bea56] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55896d6c2637] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55896d6c2f5e] 2024-07-26T13:35:07.804 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55896d6a603a] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb2f219b407] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 18: (DispatchQueue::entry()+0x60f) [0x7fb2f219bcf9] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb2f22785a1] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 20: (Thread::entry_wrapper()+0x43) [0x7fb2f2025cdd] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb2f2025cf9] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb2f1689c02] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb2f170ec40] 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[88983]: 2024-07-26T13:35:07.805 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:07 smithi146 podman[89205]: 2024-07-26 13:35:07.474335268 +0000 UTC m=+0.032755146 container died ae27b17d7eacaa5ba691c845976ee17f41219984c818bf49f7840d8d68061db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 18: (DispatchQueue::entry()+0x60f) [0x7f9ed279bcf9] 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9ed28785a1] 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 20: (Thread::entry_wrapper()+0x43) [0x7f9ed2625cdd] 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9ed2625cf9] 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9ed1c89c02] 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f9ed1d0ec40] 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: -2> 2024-07-26T13:35:07.337+0000 7f9ecba00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: in thread 7f9ecba00640 thread_name:ms_dispatch 2024-07-26T13:35:07.806 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9ed1c3e6f0] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f9ed1c8b94c] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 3: raise() 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 4: abort() 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 5: /lib64/libc.so.6(+0x2871b) [0x7f9ed1c2871b] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 6: /lib64/libc.so.6(+0x37386) [0x7f9ed1c37386] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5632e04256b9] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5632e05e380c] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5632e05232ca] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5632e04f3753] 2024-07-26T13:35:07.807 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5632e04f4a1b] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5632e04d8752] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5632e0426a56] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5632e042a637] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5632e042af5e] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x5632e040e03a] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f9ed279b407] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 18: (DispatchQueue::entry()+0x60f) [0x7f9ed279bcf9] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f9ed28785a1] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 20: (Thread::entry_wrapper()+0x43) [0x7f9ed2625cdd] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 21: (Thread::_entry_func(void*)+0xd) [0x7f9ed2625cf9] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 22: /lib64/libc.so.6(+0x89c02) [0x7f9ed1c89c02] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f9ed1d0ec40] 2024-07-26T13:35:07.808 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.809 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[88987]: 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: pgmap v2710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 op/s 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:rejoin 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:rejoin 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:rejoin 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:rejoin 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-07-26T13:35:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-mon[35401]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:35:07.834 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:07.834 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: *** Caught signal (Aborted) ** 2024-07-26T13:35:07.834 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: in thread 7fd48de00640 thread_name:ms_dispatch 2024-07-26T13:35:07.834 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.834 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd49403e6f0] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd49408b94c] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 3: raise() 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 4: abort() 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd49402871b] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 6: /lib64/libc.so.6(+0x37386) [0x7fd494037386] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557488a6f6b9] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557488c2d80c] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557488b6d2ca] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557488b3d753] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557488b3ea1b] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557488b22752] 2024-07-26T13:35:07.835 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557488a70a56] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557488a74637] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557488a74f5e] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557488a5803a] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd494b9b407] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 18: (DispatchQueue::entry()+0x60f) [0x7fd494b9bcf9] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd494c785a1] 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:07.836 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: *** Caught signal (Aborted) ** 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: in thread 7fa574000640 thread_name:ms_dispatch 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa57a23e6f0] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa57a28b94c] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 3: raise() 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 4: abort() 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa57a22871b] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 6: /lib64/libc.so.6(+0x37386) [0x7fa57a237386] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x555c632d36b9] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x555c6349180c] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x555c633d12ca] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x555c633a1753] 2024-07-26T13:35:07.837 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x555c633a2a1b] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555c63386752] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x555c632d4a56] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x555c632d8637] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x555c632d8f5e] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x555c632bc03a] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa57ad9b407] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 18: (DispatchQueue::entry()+0x60f) [0x7fa57ad9bcf9] 2024-07-26T13:35:07.838 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa57ae785a1] 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 20: (Thread::entry_wrapper()+0x43) [0x7fd494a25cdd] 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd494a25cf9] 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd494089c02] 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd49410ec40] 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.340+0000 7fd48de00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: in thread 7fd48de00640 thread_name:ms_dispatch 2024-07-26T13:35:07.839 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd49403e6f0] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd49408b94c] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 3: raise() 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 4: abort() 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd49402871b] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 6: /lib64/libc.so.6(+0x37386) [0x7fd494037386] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557488a6f6b9] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557488c2d80c] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557488b6d2ca] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557488b3d753] 2024-07-26T13:35:07.840 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557488b3ea1b] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557488b22752] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557488a70a56] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557488a74637] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557488a74f5e] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557488a5803a] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd494b9b407] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 18: (DispatchQueue::entry()+0x60f) [0x7fd494b9bcf9] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd494c785a1] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 20: (Thread::entry_wrapper()+0x43) [0x7fa57ac25cdd] 2024-07-26T13:35:07.841 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa57ac25cf9] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa57a289c02] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa57a30ec40] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.336+0000 7fa574000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: in thread 7fa574000640 thread_name:ms_dispatch 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa57a23e6f0] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa57a28b94c] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 3: raise() 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 4: abort() 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa57a22871b] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 6: /lib64/libc.so.6(+0x37386) [0x7fa57a237386] 2024-07-26T13:35:07.842 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x555c632d36b9] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x555c6349180c] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x555c633d12ca] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x555c633a1753] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x555c633a2a1b] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555c63386752] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x555c632d4a56] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x555c632d8637] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x555c632d8f5e] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x555c632bc03a] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa57ad9b407] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 18: (DispatchQueue::entry()+0x60f) [0x7fa57ad9bcf9] 2024-07-26T13:35:07.843 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa57ae785a1] 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 20: (Thread::entry_wrapper()+0x43) [0x7fd494a25cdd] 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd494a25cf9] 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd494089c02] 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd49410ec40] 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 0> 2024-07-26T13:35:07.340+0000 7fd48de00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: in thread 7fd48de00640 thread_name:ms_dispatch 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.844 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd49403e6f0] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd49408b94c] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 3: raise() 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 4: abort() 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd49402871b] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 6: /lib64/libc.so.6(+0x37386) [0x7fd494037386] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557488a6f6b9] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557488c2d80c] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557488b6d2ca] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557488b3d753] 2024-07-26T13:35:07.845 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557488b3ea1b] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557488b22752] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557488a70a56] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557488a74637] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557488a74f5e] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557488a5803a] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd494b9b407] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 20: (Thread::entry_wrapper()+0x43) [0x7fa57ac25cdd] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa57ac25cf9] 2024-07-26T13:35:07.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa57a289c02] 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa57a30ec40] 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 0> 2024-07-26T13:35:07.336+0000 7fa574000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: in thread 7fa574000640 thread_name:ms_dispatch 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa57a23e6f0] 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa57a28b94c] 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 3: raise() 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 4: abort() 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa57a22871b] 2024-07-26T13:35:07.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 6: /lib64/libc.so.6(+0x37386) [0x7fa57a237386] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x555c632d36b9] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x555c6349180c] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x555c633d12ca] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x555c633a1753] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x555c633a2a1b] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555c63386752] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x555c632d4a56] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x555c632d8637] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x555c632d8f5e] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x555c632bc03a] 2024-07-26T13:35:07.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa57ad9b407] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 18: (DispatchQueue::entry()+0x60f) [0x7fd494b9bcf9] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd494c785a1] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 20: (Thread::entry_wrapper()+0x43) [0x7fd494a25cdd] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd494a25cf9] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd494089c02] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd49410ec40] 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 0> 2024-07-26T13:35:07.340+0000 7fd48de00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: in thread 7fd48de00640 thread_name:ms_dispatch 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd49403e6f0] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd49408b94c] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 3: raise() 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 4: abort() 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd49402871b] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 6: /lib64/libc.so.6(+0x37386) [0x7fd494037386] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x557488a6f6b9] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x557488c2d80c] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x557488b6d2ca] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x557488b3d753] 2024-07-26T13:35:07.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x557488b3ea1b] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x557488b22752] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x557488a70a56] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x557488a74637] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x557488a74f5e] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x557488a5803a] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd494b9b407] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 18: (DispatchQueue::entry()+0x60f) [0x7fd494b9bcf9] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd494c785a1] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 20: (Thread::entry_wrapper()+0x43) [0x7fd494a25cdd] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd494a25cf9] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd494089c02] 2024-07-26T13:35:07.851 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd49410ec40] 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87270]: 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:07 smithi076 podman[87493]: 2024-07-26 13:35:07.46610572 +0000 UTC m=+0.037494183 container died 4bef471a01405831bde96587f8b752847a5d5f77f222b181dd7283b276dee554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 18: (DispatchQueue::entry()+0x60f) [0x7fa57ad9bcf9] 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa57ae785a1] 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 20: (Thread::entry_wrapper()+0x43) [0x7fa57ac25cdd] 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa57ac25cf9] 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa57a289c02] 2024-07-26T13:35:07.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa57a30ec40] 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 0> 2024-07-26T13:35:07.336+0000 7fa574000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: in thread 7fa574000640 thread_name:ms_dispatch 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa57a23e6f0] 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa57a28b94c] 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 3: raise() 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 4: abort() 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa57a22871b] 2024-07-26T13:35:07.853 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 6: /lib64/libc.so.6(+0x37386) [0x7fa57a237386] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x555c632d36b9] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x555c6349180c] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x555c633d12ca] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x555c633a1753] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x555c633a2a1b] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555c63386752] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x555c632d4a56] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x555c632d8637] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x555c632d8f5e] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x555c632bc03a] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa57ad9b407] 2024-07-26T13:35:07.854 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 18: (DispatchQueue::entry()+0x60f) [0x7fa57ad9bcf9] 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa57ae785a1] 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 20: (Thread::entry_wrapper()+0x43) [0x7fa57ac25cdd] 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa57ac25cf9] 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa57a289c02] 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa57a30ec40] 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87263]: 2024-07-26T13:35:07.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:07 smithi076 podman[87492]: 2024-07-26 13:35:07.46587266 +0000 UTC m=+0.037292106 container died f44a31e5196de3b2af0adb367fe7e522de8736d0999c2c4f9b9b7a4c1553d26e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-07-26T13:35:08.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:07 smithi146 podman[89206]: 2024-07-26 13:35:07.800729425 +0000 UTC m=+0.351163183 container died cc61deef6bf73e11d981502be2c49725480e9e5c21157bce673808192e90ab2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:active 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:active 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:active 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:active 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:35:08.504 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:08 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:08.524 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:08.524 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:active 2024-07-26T13:35:08.524 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:active 2024-07-26T13:35:08.524 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:active 2024-07-26T13:35:08.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:active 2024-07-26T13:35:08.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:35:08.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:08 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/2352244306,v1:172.21.15.146:6839/2352244306] up:active 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/2160631599,v1:172.21.15.146:6837/2160631599] up:active 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/3090209485,v1:172.21.15.76:6833/3090209485] up:active 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2937347475,v1:172.21.15.76:6839/2937347475] up:active 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:35:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:08 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:08.809 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:08 smithi146 podman[89206]: 2024-07-26 13:35:08.523014134 +0000 UTC m=+1.073447892 container remove cc61deef6bf73e11d981502be2c49725480e9e5c21157bce673808192e90ab2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:08.809 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:08 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:08.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:08 smithi076 podman[87493]: 2024-07-26 13:35:08.50261896 +0000 UTC m=+1.074007453 container remove 4bef471a01405831bde96587f8b752847a5d5f77f222b181dd7283b276dee554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:08.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:08 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:09.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:08 smithi146 podman[89205]: 2024-07-26 13:35:08.808000097 +0000 UTC m=+1.366420013 container remove ae27b17d7eacaa5ba691c845976ee17f41219984c818bf49f7840d8d68061db1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:09.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:08 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:09.187 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:08 smithi076 podman[87492]: 2024-07-26 13:35:08.837756503 +0000 UTC m=+1.409175984 container remove f44a31e5196de3b2af0adb367fe7e522de8736d0999c2c4f9b9b7a4c1553d26e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:09.188 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:08 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:09.363 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:09 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:35:09.363 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:09 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.527s CPU time. 2024-07-26T13:35:09.364 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:09 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:35:09.364 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:09 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.578s CPU time. 2024-07-26T13:35:09.583 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:09 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:35:09.583 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:09 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.587s CPU time. 2024-07-26T13:35:09.583 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:09 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:35:09.584 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:09 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.209s CPU time. 2024-07-26T13:35:09.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:09 smithi076 ceph-mon[35401]: pgmap v2711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 624 B/s wr, 14 op/s 2024-07-26T13:35:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:09 smithi040 ceph-mon[32397]: pgmap v2711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 624 B/s wr, 14 op/s 2024-07-26T13:35:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:09 smithi146 ceph-mon[35807]: pgmap v2711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 624 B/s wr, 14 op/s 2024-07-26T13:35:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:11 smithi040 ceph-mon[32397]: pgmap v2712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1023 B/s wr, 17 op/s 2024-07-26T13:35:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:11 smithi146 ceph-mon[35807]: pgmap v2712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1023 B/s wr, 17 op/s 2024-07-26T13:35:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:11 smithi076 ceph-mon[35401]: pgmap v2712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1023 B/s wr, 17 op/s 2024-07-26T13:35:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:13 smithi040 ceph-mon[32397]: pgmap v2713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 B/s wr, 14 op/s 2024-07-26T13:35:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:13 smithi146 ceph-mon[35807]: pgmap v2713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 B/s wr, 14 op/s 2024-07-26T13:35:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:13 smithi076 ceph-mon[35401]: pgmap v2713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 B/s wr, 14 op/s 2024-07-26T13:35:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:15 smithi040 ceph-mon[32397]: pgmap v2714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 719 B/s wr, 13 op/s 2024-07-26T13:35:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:15 smithi146 ceph-mon[35807]: pgmap v2714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 719 B/s wr, 13 op/s 2024-07-26T13:35:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:15 smithi076 ceph-mon[35401]: pgmap v2714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 719 B/s wr, 13 op/s 2024-07-26T13:35:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:17 smithi040 ceph-mon[32397]: pgmap v2715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:17 smithi146 ceph-mon[35807]: pgmap v2715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:17 smithi076 ceph-mon[35401]: pgmap v2715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:17.898+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:35:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:17.898+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-07-26T13:35:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:17.898+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:35:19.716 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:19 smithi146 ceph-mon[35807]: pgmap v2716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:19.717 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:19.717 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: Stopped Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:19.717 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.527s CPU time. 2024-07-26T13:35:19.717 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: Starting Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:19.717 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:19.717 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: Stopped Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:19.718 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.578s CPU time. 2024-07-26T13:35:19.718 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:19 smithi146 systemd[1]: Starting Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:19 smithi040 ceph-mon[32397]: pgmap v2716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:19.749 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:19 smithi076 ceph-mon[35401]: pgmap v2716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:19.749 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:19.749 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: Stopped Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:19.749 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.587s CPU time. 2024-07-26T13:35:19.750 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: Starting Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:19.750 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:19.750 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: Stopped Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:19.750 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.209s CPU time. 2024-07-26T13:35:19.750 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:19 smithi076 systemd[1]: Starting Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:20.037 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:19 smithi146 podman[89391]: 2024-07-26 13:35:19.630754659 +0000 UTC m=+0.034649801 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:20.037 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:19 smithi146 podman[89388]: 2024-07-26 13:35:19.620472878 +0000 UTC m=+0.032508628 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:20.037 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:19 smithi146 podman[89388]: 2024-07-26 13:35:19.758906071 +0000 UTC m=+0.170941857 container create c9056e1adf0c7bd71b48331e5c5bd038f3b3ddcdb6d31aecab01bdac0d6bfa76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:35:20.083 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:19 smithi076 podman[87676]: 2024-07-26 13:35:19.653211956 +0000 UTC m=+0.043223342 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:20.083 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:19 smithi076 podman[87676]: 2024-07-26 13:35:19.974622991 +0000 UTC m=+0.364634402 container create 2bf8fea1fe71653c2078f424565fdc0a8dd6c4b7480bea403fc944299f4dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-07-26T13:35:20.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:19 smithi076 podman[87677]: 2024-07-26 13:35:19.652219448 +0000 UTC m=+0.040087748 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:20.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:19 smithi076 podman[87677]: 2024-07-26 13:35:19.764006229 +0000 UTC m=+0.151874558 container create 662423c6ea7dd245e97e0244001c2df6208010c5701288b366b007d563b97eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:20.320 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 podman[89391]: 2024-07-26 13:35:20.03634527 +0000 UTC m=+0.440240446 container create ad9e1490eed4981798e8b951751ac0f4ff15ca42e1e12599feaf21eb48ba40de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-07-26T13:35:20.320 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:20 smithi146 podman[89388]: 2024-07-26 13:35:20.138207371 +0000 UTC m=+0.550243200 container init c9056e1adf0c7bd71b48331e5c5bd038f3b3ddcdb6d31aecab01bdac0d6bfa76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:20.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:20 smithi146 podman[89388]: 2024-07-26 13:35:20.14867124 +0000 UTC m=+0.560707033 container start c9056e1adf0c7bd71b48331e5c5bd038f3b3ddcdb6d31aecab01bdac0d6bfa76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:35:20.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mds[89423]: -- 172.21.15.146:0/1915286675 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad4d7a5860 con 0x55ad51947a80 2024-07-26T13:35:20.321 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: starting mds.i at 2024-07-26T13:35:20.402 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:20 smithi076 podman[87677]: 2024-07-26 13:35:20.12700668 +0000 UTC m=+0.514875074 container init 662423c6ea7dd245e97e0244001c2df6208010c5701288b366b007d563b97eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-07-26T13:35:20.402 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:20 smithi076 podman[87677]: 2024-07-26 13:35:20.138048529 +0000 UTC m=+0.525916836 container start 662423c6ea7dd245e97e0244001c2df6208010c5701288b366b007d563b97eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-26T13:35:20.402 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:20 smithi076 bash[87677]: 662423c6ea7dd245e97e0244001c2df6208010c5701288b366b007d563b97eb6 2024-07-26T13:35:20.402 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:20 smithi076 systemd[1]: Started Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:20.403 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mds[87709]: -- 172.21.15.76:0/414478988 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559290a55860 con 0x559294bf7a80 2024-07-26T13:35:20.403 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: starting mds.b at 2024-07-26T13:35:20.674 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: daemon mds.b restarted 2024-07-26T13:35:20.674 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:20.674 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: osdmap e106: 12 total, 12 up, 12 in 2024-07-26T13:35:20.674 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:boot 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=i=up:active,4=c=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: daemon mds.i restarted 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: osdmap e107: 12 total, 12 up, 12 in 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:boot 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=f=up:replay,4=c=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:35:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:20 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:20.696 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:20 smithi076 podman[87676]: 2024-07-26 13:35:20.579607509 +0000 UTC m=+0.969618966 container init 2bf8fea1fe71653c2078f424565fdc0a8dd6c4b7480bea403fc944299f4dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-07-26T13:35:20.696 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:20 smithi076 podman[87676]: 2024-07-26 13:35:20.588831779 +0000 UTC m=+0.978843158 container start 2bf8fea1fe71653c2078f424565fdc0a8dd6c4b7480bea403fc944299f4dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=) 2024-07-26T13:35:20.696 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: daemon mds.b restarted 2024-07-26T13:35:20.696 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: osdmap e106: 12 total, 12 up, 12 in 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:boot 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=i=up:active,4=c=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: daemon mds.i restarted 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: osdmap e107: 12 total, 12 up, 12 in 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:boot 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=f=up:replay,4=c=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:35:20.697 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:20.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:20 smithi146 bash[89388]: c9056e1adf0c7bd71b48331e5c5bd038f3b3ddcdb6d31aecab01bdac0d6bfa76 2024-07-26T13:35:20.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:20 smithi146 systemd[1]: Started Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: daemon mds.b restarted 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: osdmap e106: 12 total, 12 up, 12 in 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:boot 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=i=up:active,4=c=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: daemon mds.i restarted 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: osdmap e107: 12 total, 12 up, 12 in 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:boot 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:35:20.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=f=up:replay,4=c=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 podman[89391]: 2024-07-26 13:35:20.407905744 +0000 UTC m=+0.811800923 container init ad9e1490eed4981798e8b951751ac0f4ff15ca42e1e12599feaf21eb48ba40de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 podman[89391]: 2024-07-26 13:35:20.417321298 +0000 UTC m=+0.821216497 container start ad9e1490eed4981798e8b951751ac0f4ff15ca42e1e12599feaf21eb48ba40de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0) 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 bash[89391]: ad9e1490eed4981798e8b951751ac0f4ff15ca42e1e12599feaf21eb48ba40de 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 systemd[1]: Started Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-mds[89448]: -- 172.21.15.146:0/1741303698 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555575185c20 con 0x555579327a80 2024-07-26T13:35:20.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:20 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: starting mds.c at 2024-07-26T13:35:21.083 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:20 smithi076 bash[87676]: 2bf8fea1fe71653c2078f424565fdc0a8dd6c4b7480bea403fc944299f4dae4e 2024-07-26T13:35:21.083 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-mds[87735]: -- 172.21.15.76:0/460957478 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c413755860 con 0x55c4178f7180 2024-07-26T13:35:21.083 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:20 smithi076 systemd[1]: Started Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:21.083 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:20 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: starting mds.k at 2024-07-26T13:35:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: pgmap v2717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 341 B/s wr, 13 op/s 2024-07-26T13:35:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: daemon mds.c restarted 2024-07-26T13:35:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: osdmap e108: 12 total, 12 up, 12 in 2024-07-26T13:35:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:resolve 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:resolve 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:boot 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=f=up:resolve,3=a=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: daemon mds.k restarted 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: osdmap e109: 12 total, 12 up, 12 in 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:boot 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:resolve,3=a=up:resolve,4=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:35:21.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:21 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:35:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: pgmap v2717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 341 B/s wr, 13 op/s 2024-07-26T13:35:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: daemon mds.c restarted 2024-07-26T13:35:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: osdmap e108: 12 total, 12 up, 12 in 2024-07-26T13:35:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:resolve 2024-07-26T13:35:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:resolve 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:boot 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=f=up:resolve,3=a=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: daemon mds.k restarted 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: osdmap e109: 12 total, 12 up, 12 in 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:boot 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:resolve,3=a=up:resolve,4=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:35:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:21 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:35:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: pgmap v2717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 341 B/s wr, 13 op/s 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: daemon mds.c restarted 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: osdmap e108: 12 total, 12 up, 12 in 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:resolve 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:resolve 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:boot 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=f=up:resolve,3=a=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: daemon mds.k restarted 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: osdmap e109: 12 total, 12 up, 12 in 2024-07-26T13:35:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:boot 2024-07-26T13:35:21.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:35:21.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:resolve,3=a=up:resolve,4=g=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:21.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:35:21.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:21 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:35:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:22 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:resolve 2024-07-26T13:35:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:22 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:resolve 2024-07-26T13:35:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:22 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:22 smithi146 ceph-mon[35807]: pgmap v2722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 9 op/s 2024-07-26T13:35:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:22 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:resolve 2024-07-26T13:35:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:22 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:resolve 2024-07-26T13:35:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:22 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:22 smithi076 ceph-mon[35401]: pgmap v2722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 9 op/s 2024-07-26T13:35:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:22 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:resolve 2024-07-26T13:35:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:22 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:resolve 2024-07-26T13:35:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:22 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:22 smithi040 ceph-mon[32397]: pgmap v2722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 9 op/s 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:reconnect 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:reconnect 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:reconnect 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:reconnect 2024-07-26T13:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:23 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:reconnect 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:reconnect 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:reconnect 2024-07-26T13:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:reconnect 2024-07-26T13:35:24.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:23 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:reconnect 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:reconnect 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:reconnect 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:reconnect 2024-07-26T13:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:23 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:24.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:rejoin 2024-07-26T13:35:24.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:rejoin 2024-07-26T13:35:24.791 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:rejoin 2024-07-26T13:35:24.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:rejoin 2024-07-26T13:35:24.792 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:24.793 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:rejoin 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:rejoin 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:rejoin 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:rejoin 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: pgmap v2723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:active 2024-07-26T13:35:24.794 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:active 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:active 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:active 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: *** Caught signal (Aborted) ** 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: in thread 7f255e000640 thread_name:ms_dispatch 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f256423e6f0] 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f256428b94c] 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 3: raise() 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 4: abort() 2024-07-26T13:35:24.795 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 5: /lib64/libc.so.6(+0x2871b) [0x7f256422871b] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 6: /lib64/libc.so.6(+0x37386) [0x7f2564237386] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55dc9fb426b9] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55dc9fd0080c] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55dc9fc402ca] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55dc9fc10753] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55dc9fc11a1b] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55dc9fbf5752] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55dc9fb43a56] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55dc9fb47637] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55dc9fb47f5e] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55dc9fb2b03a] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2564d9b407] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 18: (DispatchQueue::entry()+0x60f) [0x7f2564d9bcf9] 2024-07-26T13:35:24.796 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2564e785a1] 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: *** Caught signal (Aborted) ** 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: in thread 7f0799c00640 thread_name:ms_dispatch 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f079fe3e6f0] 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f079fe8b94c] 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 3: raise() 2024-07-26T13:35:24.797 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 4: abort() 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 5: /lib64/libc.so.6(+0x2871b) [0x7f079fe2871b] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 6: /lib64/libc.so.6(+0x37386) [0x7f079fe37386] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562c203966b9] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562c2055480c] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562c204942ca] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562c20464753] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562c20465a1b] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562c20449752] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562c20397a56] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562c2039b637] 2024-07-26T13:35:24.798 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562c2039bf5e] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562c2037f03a] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f07a099b407] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 18: (DispatchQueue::entry()+0x60f) [0x7f07a099bcf9] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f07a0a785a1] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 20: (Thread::entry_wrapper()+0x43) [0x7f2564c25cdd] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2564c25cf9] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2564289c02] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f256430ec40] 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.540+0000 7f255e000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.799 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: in thread 7f255e000640 thread_name:ms_dispatch 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f256423e6f0] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f256428b94c] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 3: raise() 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 4: abort() 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 5: /lib64/libc.so.6(+0x2871b) [0x7f256422871b] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 6: /lib64/libc.so.6(+0x37386) [0x7f2564237386] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55dc9fb426b9] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55dc9fd0080c] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55dc9fc402ca] 2024-07-26T13:35:24.800 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55dc9fc10753] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55dc9fc11a1b] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55dc9fbf5752] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55dc9fb43a56] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55dc9fb47637] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55dc9fb47f5e] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55dc9fb2b03a] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2564d9b407] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 18: (DispatchQueue::entry()+0x60f) [0x7f2564d9bcf9] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2564e785a1] 2024-07-26T13:35:24.801 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 20: (Thread::entry_wrapper()+0x43) [0x7f07a0825cdd] 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 21: (Thread::_entry_func(void*)+0xd) [0x7f07a0825cf9] 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 22: /lib64/libc.so.6(+0x89c02) [0x7f079fe89c02] 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f079ff0ec40] 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.541+0000 7f0799c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: in thread 7f0799c00640 thread_name:ms_dispatch 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f079fe3e6f0] 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f079fe8b94c] 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 3: raise() 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 4: abort() 2024-07-26T13:35:24.802 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 5: /lib64/libc.so.6(+0x2871b) [0x7f079fe2871b] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 6: /lib64/libc.so.6(+0x37386) [0x7f079fe37386] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562c203966b9] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562c2055480c] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562c204942ca] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562c20464753] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562c20465a1b] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562c20449752] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562c20397a56] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562c2039b637] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562c2039bf5e] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562c2037f03a] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f07a099b407] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 18: (DispatchQueue::entry()+0x60f) [0x7f07a099bcf9] 2024-07-26T13:35:24.803 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f07a0a785a1] 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 20: (Thread::entry_wrapper()+0x43) [0x7f2564c25cdd] 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2564c25cf9] 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2564289c02] 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f256430ec40] 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 0> 2024-07-26T13:35:24.540+0000 7f255e000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: in thread 7f255e000640 thread_name:ms_dispatch 2024-07-26T13:35:24.804 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f256423e6f0] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f256428b94c] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 3: raise() 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 4: abort() 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 5: /lib64/libc.so.6(+0x2871b) [0x7f256422871b] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 6: /lib64/libc.so.6(+0x37386) [0x7f2564237386] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55dc9fb426b9] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55dc9fd0080c] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55dc9fc402ca] 2024-07-26T13:35:24.805 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55dc9fc10753] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55dc9fc11a1b] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55dc9fbf5752] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55dc9fb43a56] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55dc9fb47637] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55dc9fb47f5e] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55dc9fb2b03a] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 20: (Thread::entry_wrapper()+0x43) [0x7f07a0825cdd] 2024-07-26T13:35:24.806 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 21: (Thread::_entry_func(void*)+0xd) [0x7f07a0825cf9] 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 22: /lib64/libc.so.6(+0x89c02) [0x7f079fe89c02] 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f079ff0ec40] 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 0> 2024-07-26T13:35:24.541+0000 7f0799c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: in thread 7f0799c00640 thread_name:ms_dispatch 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f079fe3e6f0] 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f079fe8b94c] 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 3: raise() 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 4: abort() 2024-07-26T13:35:24.807 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 5: /lib64/libc.so.6(+0x2871b) [0x7f079fe2871b] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 6: /lib64/libc.so.6(+0x37386) [0x7f079fe37386] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562c203966b9] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562c2055480c] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562c204942ca] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562c20464753] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562c20465a1b] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562c20449752] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562c20397a56] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562c2039b637] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562c2039bf5e] 2024-07-26T13:35:24.808 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562c2037f03a] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2564d9b407] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 18: (DispatchQueue::entry()+0x60f) [0x7f2564d9bcf9] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2564e785a1] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 20: (Thread::entry_wrapper()+0x43) [0x7f2564c25cdd] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2564c25cf9] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2564289c02] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f256430ec40] 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.809 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 0> 2024-07-26T13:35:24.540+0000 7f255e000640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: in thread 7f255e000640 thread_name:ms_dispatch 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f256423e6f0] 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f256428b94c] 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 3: raise() 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 4: abort() 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 5: /lib64/libc.so.6(+0x2871b) [0x7f256422871b] 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 6: /lib64/libc.so.6(+0x37386) [0x7f2564237386] 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55dc9fb426b9] 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55dc9fd0080c] 2024-07-26T13:35:24.810 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55dc9fc402ca] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55dc9fc10753] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55dc9fc11a1b] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55dc9fbf5752] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55dc9fb43a56] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55dc9fb47637] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55dc9fb47f5e] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55dc9fb2b03a] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2564d9b407] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 18: (DispatchQueue::entry()+0x60f) [0x7f2564d9bcf9] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2564e785a1] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 20: (Thread::entry_wrapper()+0x43) [0x7f2564c25cdd] 2024-07-26T13:35:24.811 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2564c25cf9] 2024-07-26T13:35:24.812 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2564289c02] 2024-07-26T13:35:24.812 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f256430ec40] 2024-07-26T13:35:24.813 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.813 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[187889]: 2024-07-26T13:35:24.813 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:24 smithi040 podman[187956]: 2024-07-26 13:35:24.660870081 +0000 UTC m=+0.033097887 container died c72c5767baa3b438022a11997a261cdf9ef326f72b9f68481cd952070c992f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-26T13:35:24.814 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f07a099b407] 2024-07-26T13:35:24.814 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 18: (DispatchQueue::entry()+0x60f) [0x7f07a099bcf9] 2024-07-26T13:35:24.814 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f07a0a785a1] 2024-07-26T13:35:24.814 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 20: (Thread::entry_wrapper()+0x43) [0x7f07a0825cdd] 2024-07-26T13:35:24.814 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 21: (Thread::_entry_func(void*)+0xd) [0x7f07a0825cf9] 2024-07-26T13:35:24.814 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 22: /lib64/libc.so.6(+0x89c02) [0x7f079fe89c02] 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f079ff0ec40] 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 0> 2024-07-26T13:35:24.541+0000 7f0799c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: in thread 7f0799c00640 thread_name:ms_dispatch 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f079fe3e6f0] 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f079fe8b94c] 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 3: raise() 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 4: abort() 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 5: /lib64/libc.so.6(+0x2871b) [0x7f079fe2871b] 2024-07-26T13:35:24.815 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 6: /lib64/libc.so.6(+0x37386) [0x7f079fe37386] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562c203966b9] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562c2055480c] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562c204942ca] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562c20464753] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562c20465a1b] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562c20449752] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562c20397a56] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562c2039b637] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562c2039bf5e] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562c2037f03a] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f07a099b407] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 18: (DispatchQueue::entry()+0x60f) [0x7f07a099bcf9] 2024-07-26T13:35:24.816 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f07a0a785a1] 2024-07-26T13:35:24.817 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 20: (Thread::entry_wrapper()+0x43) [0x7f07a0825cdd] 2024-07-26T13:35:24.817 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 21: (Thread::_entry_func(void*)+0xd) [0x7f07a0825cf9] 2024-07-26T13:35:24.817 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 22: /lib64/libc.so.6(+0x89c02) [0x7f079fe89c02] 2024-07-26T13:35:24.817 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f079ff0ec40] 2024-07-26T13:35:24.817 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.817 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[187839]: 2024-07-26T13:35:24.818 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:24.818 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: *** Caught signal (Aborted) ** 2024-07-26T13:35:24.818 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: in thread 7f2daf800640 thread_name:ms_dispatch 2024-07-26T13:35:24.818 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.818 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2db5a3e6f0] 2024-07-26T13:35:24.818 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2db5a8b94c] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 3: raise() 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 4: abort() 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2db5a2871b] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 6: /lib64/libc.so.6(+0x37386) [0x7f2db5a37386] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558e8f6f66b9] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558e8f8b480c] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558e8f7f42ca] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558e8f7c4753] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558e8f7c5a1b] 2024-07-26T13:35:24.819 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558e8f7a9752] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558e8f6f7a56] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558e8f6fb637] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558e8f6fbf5e] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558e8f6df03a] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2db659b407] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 18: (DispatchQueue::entry()+0x60f) [0x7f2db659bcf9] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2db66785a1] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 20: (Thread::entry_wrapper()+0x43) [0x7f2db6425cdd] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2db6425cf9] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2db5a89c02] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2db5b0ec40] 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.542+0000 7f2daf800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: in thread 7f2daf800640 thread_name:ms_dispatch 2024-07-26T13:35:24.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2db5a3e6f0] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2db5a8b94c] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 3: raise() 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 4: abort() 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2db5a2871b] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 6: /lib64/libc.so.6(+0x37386) [0x7f2db5a37386] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558e8f6f66b9] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558e8f8b480c] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558e8f7f42ca] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558e8f7c4753] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558e8f7c5a1b] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558e8f7a9752] 2024-07-26T13:35:24.821 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558e8f6f7a56] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558e8f6fb637] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558e8f6fbf5e] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558e8f6df03a] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2db659b407] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 18: (DispatchQueue::entry()+0x60f) [0x7f2db659bcf9] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2db66785a1] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 20: (Thread::entry_wrapper()+0x43) [0x7f2db6425cdd] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2db6425cf9] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2db5a89c02] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2db5b0ec40] 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 0> 2024-07-26T13:35:24.542+0000 7f2daf800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: in thread 7f2daf800640 thread_name:ms_dispatch 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2db5a3e6f0] 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2db5a8b94c] 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 3: raise() 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 4: abort() 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2db5a2871b] 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 6: /lib64/libc.so.6(+0x37386) [0x7f2db5a37386] 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558e8f6f66b9] 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558e8f8b480c] 2024-07-26T13:35:24.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558e8f7f42ca] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558e8f7c4753] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558e8f7c5a1b] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558e8f7a9752] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558e8f6f7a56] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558e8f6fb637] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558e8f6fbf5e] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558e8f6df03a] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2db659b407] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 18: (DispatchQueue::entry()+0x60f) [0x7f2db659bcf9] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2db66785a1] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 20: (Thread::entry_wrapper()+0x43) [0x7f2db6425cdd] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2db6425cf9] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2db5a89c02] 2024-07-26T13:35:24.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2db5b0ec40] 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 0> 2024-07-26T13:35:24.542+0000 7f2daf800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: in thread 7f2daf800640 thread_name:ms_dispatch 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2db5a3e6f0] 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2db5a8b94c] 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 3: raise() 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 4: abort() 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2db5a2871b] 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 6: /lib64/libc.so.6(+0x37386) [0x7f2db5a37386] 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x558e8f6f66b9] 2024-07-26T13:35:24.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x558e8f8b480c] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x558e8f7f42ca] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558e8f7c4753] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558e8f7c5a1b] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558e8f7a9752] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558e8f6f7a56] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x558e8f6fb637] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x558e8f6fbf5e] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x558e8f6df03a] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2db659b407] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 18: (DispatchQueue::entry()+0x60f) [0x7f2db659bcf9] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2db66785a1] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 20: (Thread::entry_wrapper()+0x43) [0x7f2db6425cdd] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2db6425cf9] 2024-07-26T13:35:24.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2db5a89c02] 2024-07-26T13:35:24.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2db5b0ec40] 2024-07-26T13:35:24.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89164]: 2024-07-26T13:35:24.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:24 smithi146 podman[89493]: 2024-07-26 13:35:24.663083024 +0000 UTC m=+0.032217646 container died 4072518d7514979620fbb49a94434b67a80f0246b4da7ba088a42b6a65421569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:rejoin 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:rejoin 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:rejoin 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:rejoin 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:35:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: pgmap v2723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:active 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:active 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:active 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:active 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:24.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: *** Caught signal (Aborted) ** 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: in thread 7f4ad4800640 thread_name:ms_dispatch 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4adaa3e6f0] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4adaa8b94c] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 3: raise() 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 4: abort() 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4adaa2871b] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 6: /lib64/libc.so.6(+0x37386) [0x7f4adaa37386] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e961f4d6b9] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e96210b80c] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e96204b2ca] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e96201b753] 2024-07-26T13:35:24.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e96201ca1b] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e962000752] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e961f4ea56] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e961f52637] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e961f52f5e] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e961f3603a] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4adb59b407] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 18: (DispatchQueue::entry()+0x60f) [0x7f4adb59bcf9] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4adb6785a1] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 20: (Thread::entry_wrapper()+0x43) [0x7f4adb425cdd] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4adb425cf9] 2024-07-26T13:35:24.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4adaa89c02] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4adab0ec40] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.550+0000 7f4ad4800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: in thread 7f4ad4800640 thread_name:ms_dispatch 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4adaa3e6f0] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4adaa8b94c] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 3: raise() 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 4: abort() 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4adaa2871b] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 6: /lib64/libc.so.6(+0x37386) [0x7f4adaa37386] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e961f4d6b9] 2024-07-26T13:35:24.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e96210b80c] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e96204b2ca] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e96201b753] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e96201ca1b] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e962000752] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e961f4ea56] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e961f52637] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e961f52f5e] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e961f3603a] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4adb59b407] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 18: (DispatchQueue::entry()+0x60f) [0x7f4adb59bcf9] 2024-07-26T13:35:24.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4adb6785a1] 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 20: (Thread::entry_wrapper()+0x43) [0x7f4adb425cdd] 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4adb425cf9] 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4adaa89c02] 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4adab0ec40] 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 0> 2024-07-26T13:35:24.550+0000 7f4ad4800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: in thread 7f4ad4800640 thread_name:ms_dispatch 2024-07-26T13:35:24.839 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4adaa3e6f0] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4adaa8b94c] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 3: raise() 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 4: abort() 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4adaa2871b] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 6: /lib64/libc.so.6(+0x37386) [0x7f4adaa37386] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e961f4d6b9] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e96210b80c] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e96204b2ca] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e96201b753] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e96201ca1b] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e962000752] 2024-07-26T13:35:24.840 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e961f4ea56] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e961f52637] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e961f52f5e] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e961f3603a] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4adb59b407] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 18: (DispatchQueue::entry()+0x60f) [0x7f4adb59bcf9] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4adb6785a1] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 20: (Thread::entry_wrapper()+0x43) [0x7f4adb425cdd] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4adb425cf9] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4adaa89c02] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4adab0ec40] 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: -13> 2024-07-26T13:35:24.550+0000 7f4ad4800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: in thread 7f4ad4800640 thread_name:ms_dispatch 2024-07-26T13:35:24.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4adaa3e6f0] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f4adaa8b94c] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 3: raise() 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 4: abort() 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 5: /lib64/libc.so.6(+0x2871b) [0x7f4adaa2871b] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 6: /lib64/libc.so.6(+0x37386) [0x7f4adaa37386] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e961f4d6b9] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e96210b80c] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e96204b2ca] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e96201b753] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e96201ca1b] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e962000752] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e961f4ea56] 2024-07-26T13:35:24.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e961f52637] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e961f52f5e] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e961f3603a] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f4adb59b407] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 18: (DispatchQueue::entry()+0x60f) [0x7f4adb59bcf9] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f4adb6785a1] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 20: (Thread::entry_wrapper()+0x43) [0x7f4adb425cdd] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 21: (Thread::_entry_func(void*)+0xd) [0x7f4adb425cf9] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 22: /lib64/libc.so.6(+0x89c02) [0x7f4adaa89c02] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f4adab0ec40] 2024-07-26T13:35:24.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:24.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87450]: 2024-07-26T13:35:24.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:24 smithi076 podman[87781]: 2024-07-26 13:35:24.6856117 +0000 UTC m=+0.036950295 container died f9a01dfb6cdf7febdf8874be28f1f4569e5c9a8db1a11d214d8c3adc23700297 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-07-26T13:35:25.078 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:35:25.078 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:35:25.079 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:35:25.079 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:35:25.079 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: pgmap v2723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-07-26T13:35:25.079 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:25.079 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1429307143,v1:172.21.15.40:6839/1429307143] up:active 2024-07-26T13:35:25.079 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2725372682,v1:172.21.15.40:6841/2725372682] up:active 2024-07-26T13:35:25.080 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3915774179,v1:172.21.15.146:6835/3915774179] up:active 2024-07-26T13:35:25.080 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/3279473452,v1:172.21.15.76:6835/3279473452] up:active 2024-07-26T13:35:25.080 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:24 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:25.431 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:25 smithi040 podman[187957]: 2024-07-26 13:35:25.103728619 +0000 UTC m=+0.468243467 container died e629fb0f0264bc2a1a57aa975b85a6c7373be69970ddbf77d9ff5db22f44d2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-07-26T13:35:25.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:25 smithi146 podman[89493]: 2024-07-26 13:35:25.369228916 +0000 UTC m=+0.738363572 container remove 4072518d7514979620fbb49a94434b67a80f0246b4da7ba088a42b6a65421569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-07-26T13:35:25.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:25 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:25.832 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:25 smithi076 podman[87781]: 2024-07-26 13:35:25.431948655 +0000 UTC m=+0.783287274 container remove f9a01dfb6cdf7febdf8874be28f1f4569e5c9a8db1a11d214d8c3adc23700297 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-07-26T13:35:25.832 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:25 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:26.186 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:25 smithi040 podman[187956]: 2024-07-26 13:35:25.849239477 +0000 UTC m=+1.221467324 container remove c72c5767baa3b438022a11997a261cdf9ef326f72b9f68481cd952070c992f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:35:26.186 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:25 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:26.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:25 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:35:26.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:25 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.730s CPU time. 2024-07-26T13:35:26.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:25 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:35:26.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:25 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.426s CPU time. 2024-07-26T13:35:26.482 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:26 smithi040 podman[187957]: 2024-07-26 13:35:26.184494577 +0000 UTC m=+1.549009418 container remove e629fb0f0264bc2a1a57aa975b85a6c7373be69970ddbf77d9ff5db22f44d2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-07-26T13:35:26.482 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:26 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:26.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:26 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:35:26.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:26 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.620s CPU time. 2024-07-26T13:35:26.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:26 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:35:26.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:26 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.689s CPU time. 2024-07-26T13:35:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:27 smithi146 ceph-mon[35807]: pgmap v2724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 688 B/s wr, 11 op/s 2024-07-26T13:35:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:27 smithi076 ceph-mon[35401]: pgmap v2724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 688 B/s wr, 11 op/s 2024-07-26T13:35:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:27 smithi040 ceph-mon[32397]: pgmap v2724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 688 B/s wr, 11 op/s 2024-07-26T13:35:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:29 smithi146 ceph-mon[35807]: pgmap v2725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 1.0 KiB/s wr, 14 op/s 2024-07-26T13:35:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:29 smithi076 ceph-mon[35401]: pgmap v2725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 1.0 KiB/s wr, 14 op/s 2024-07-26T13:35:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:29 smithi040 ceph-mon[32397]: pgmap v2725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 1.0 KiB/s wr, 14 op/s 2024-07-26T13:35:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:31 smithi146 ceph-mon[35807]: pgmap v2726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 847 B/s wr, 17 op/s 2024-07-26T13:35:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:31 smithi076 ceph-mon[35401]: pgmap v2726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 847 B/s wr, 17 op/s 2024-07-26T13:35:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:31 smithi040 ceph-mon[32397]: pgmap v2726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 847 B/s wr, 17 op/s 2024-07-26T13:35:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:32.903+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:35:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:32.905+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-07-26T13:35:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:32.905+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-07-26T13:35:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:32.905+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-07-26T13:35:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:32.905+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-07-26T13:35:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:33 smithi146 ceph-mon[35807]: pgmap v2727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 712 B/s wr, 14 op/s 2024-07-26T13:35:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:33 smithi076 ceph-mon[35401]: pgmap v2727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 712 B/s wr, 14 op/s 2024-07-26T13:35:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:33 smithi040 ceph-mon[32397]: pgmap v2727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 712 B/s wr, 14 op/s 2024-07-26T13:35:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:35 smithi146 ceph-mon[35807]: pgmap v2728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:35:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:35 smithi076 ceph-mon[35401]: pgmap v2728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:35:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:35 smithi040 ceph-mon[32397]: pgmap v2728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:35:36.474 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:36.475 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 systemd[1]: Stopped Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:36.475 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.730s CPU time. 2024-07-26T13:35:36.475 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 systemd[1]: Starting Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:36.482 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:36.483 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 systemd[1]: Stopped Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:36.483 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.426s CPU time. 2024-07-26T13:35:36.483 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 systemd[1]: Starting Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:36.764 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 podman[89581]: 2024-07-26 13:35:36.380403713 +0000 UTC m=+0.035420807 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:36.764 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 podman[89581]: 2024-07-26 13:35:36.519739919 +0000 UTC m=+0.174757072 container create 04482a281cf897ba59fb9f81b2cef243ab21111aa9f18240c0276063a2517eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-07-26T13:35:36.785 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 podman[87874]: 2024-07-26 13:35:36.38660314 +0000 UTC m=+0.032465948 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:36.785 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 podman[87874]: 2024-07-26 13:35:36.516036026 +0000 UTC m=+0.161898868 container create afd47399be315509b4f5bcfc5eb1b653232133c74c429346ac88eb2b63f1703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-07-26T13:35:37.070 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 podman[89581]: 2024-07-26 13:35:36.763978826 +0000 UTC m=+0.418995925 container init 04482a281cf897ba59fb9f81b2cef243ab21111aa9f18240c0276063a2517eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:35:37.070 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 podman[89581]: 2024-07-26 13:35:36.772355579 +0000 UTC m=+0.427372689 container start 04482a281cf897ba59fb9f81b2cef243ab21111aa9f18240c0276063a2517eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-07-26T13:35:37.070 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 bash[89581]: 04482a281cf897ba59fb9f81b2cef243ab21111aa9f18240c0276063a2517eb4 2024-07-26T13:35:37.070 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 systemd[1]: Started Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:37.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 ceph-mds[89650]: -- 172.21.15.146:0/3771741591 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56307ac51860 con 0x56307edf3180 2024-07-26T13:35:37.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:36 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: starting mds.f at 2024-07-26T13:35:37.082 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 podman[87874]: 2024-07-26 13:35:36.785178955 +0000 UTC m=+0.431041767 container init afd47399be315509b4f5bcfc5eb1b653232133c74c429346ac88eb2b63f1703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:35:37.082 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 podman[87874]: 2024-07-26 13:35:36.793437526 +0000 UTC m=+0.439300346 container start afd47399be315509b4f5bcfc5eb1b653232133c74c429346ac88eb2b63f1703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:35:37.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 bash[87874]: afd47399be315509b4f5bcfc5eb1b653232133c74c429346ac88eb2b63f1703f 2024-07-26T13:35:37.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 systemd[1]: Started Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:37.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 ceph-mds[87950]: --2- 172.21.15.76:0/3097721128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557397bf7180 0x5573987e8000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557397b376b0 tx=0x557397b30a80 comp rx=0 tx=0).write_message sending message m=0x557397aae1c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-07-26T13:35:37.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:36 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: starting mds.e at 2024-07-26T13:35:37.144 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:37.144 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: Stopped Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:37.144 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.689s CPU time. 2024-07-26T13:35:37.144 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: Starting Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:37.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 4. 2024-07-26T13:35:37.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: Stopped Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:37.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.620s CPU time. 2024-07-26T13:35:37.145 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:36 smithi040 systemd[1]: Starting Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:37.397 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188199]: 2024-07-26 13:35:37.06649079 +0000 UTC m=+0.039739522 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188193]: 2024-07-26 13:35:37.051084635 +0000 UTC m=+0.044421681 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188193]: 2024-07-26 13:35:37.194536275 +0000 UTC m=+0.187873336 container create b66ff5665f3c1a98dd58fda68f5e66912f9d1df121f34b77c5968e9982024333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: pgmap v2729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 596 B/s wr, 13 op/s 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: daemon mds.f restarted 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:37.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: osdmap e110: 12 total, 12 up, 12 in 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:boot 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=e=up:active,1=h=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: daemon mds.e restarted 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: osdmap e111: 12 total, 12 up, 12 in 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:boot 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=i=up:replay,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:35:37.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: pgmap v2729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 596 B/s wr, 13 op/s 2024-07-26T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: daemon mds.f restarted 2024-07-26T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: osdmap e110: 12 total, 12 up, 12 in 2024-07-26T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:boot 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=e=up:active,1=h=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: daemon mds.e restarted 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: osdmap e111: 12 total, 12 up, 12 in 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:boot 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=i=up:replay,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:37 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: pgmap v2729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 596 B/s wr, 13 op/s 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: daemon mds.f restarted 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: osdmap e110: 12 total, 12 up, 12 in 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:boot 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=e=up:active,1=h=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: daemon mds.e restarted 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: osdmap e111: 12 total, 12 up, 12 in 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:boot 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=i=up:replay,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:35:37.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:37 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:35:37.732 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188193]: 2024-07-26 13:35:37.610179954 +0000 UTC m=+0.603517070 container init b66ff5665f3c1a98dd58fda68f5e66912f9d1df121f34b77c5968e9982024333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-07-26T13:35:37.733 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188193]: 2024-07-26 13:35:37.618539977 +0000 UTC m=+0.611877049 container start b66ff5665f3c1a98dd58fda68f5e66912f9d1df121f34b77c5968e9982024333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:35:37.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188199]: 2024-07-26 13:35:37.396505125 +0000 UTC m=+0.369753921 container create 2dad782ebc375269e05e2a86519e9c863e97b33bf17b801ad1c627b56a9ce4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-07-26T13:35:38.085 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mds[188239]: -- 172.21.15.40:0/3412641588 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561da1f59860 con 0x561da60fb600 2024-07-26T13:35:38.085 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: starting mds.g at 2024-07-26T13:35:38.085 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188199]: 2024-07-26 13:35:37.73427026 +0000 UTC m=+0.707518988 container init 2dad782ebc375269e05e2a86519e9c863e97b33bf17b801ad1c627b56a9ce4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-26T13:35:38.086 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 podman[188199]: 2024-07-26 13:35:37.741660361 +0000 UTC m=+0.714909096 container start 2dad782ebc375269e05e2a86519e9c863e97b33bf17b801ad1c627b56a9ce4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-07-26T13:35:38.086 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 bash[188199]: 2dad782ebc375269e05e2a86519e9c863e97b33bf17b801ad1c627b56a9ce4e0 2024-07-26T13:35:38.086 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 systemd[1]: Started Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:38.086 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-mds[188259]: -- 172.21.15.40:0/496264638 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f7cc11860 con 0x561f80db3600 2024-07-26T13:35:38.086 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:37 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: starting mds.a at 2024-07-26T13:35:38.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:38 smithi040 bash[188193]: b66ff5665f3c1a98dd58fda68f5e66912f9d1df121f34b77c5968e9982024333 2024-07-26T13:35:38.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:38 smithi040 systemd[1]: Started Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: daemon mds.g restarted 2024-07-26T13:35:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: osdmap e112: 12 total, 12 up, 12 in 2024-07-26T13:35:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:resolve 2024-07-26T13:35:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:resolve 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:boot 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: daemon mds.a restarted 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: osdmap e113: 12 total, 12 up, 12 in 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:boot 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: Standby daemon mds.b assigned to filesystem cephfs as rank 3 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,4=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:35:38.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:35:38.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:35:38.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:35:38.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: daemon mds.g restarted 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: osdmap e112: 12 total, 12 up, 12 in 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:resolve 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:resolve 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:boot 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: daemon mds.a restarted 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: osdmap e113: 12 total, 12 up, 12 in 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:boot 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: Standby daemon mds.b assigned to filesystem cephfs as rank 3 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,4=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:35:38.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:35:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: daemon mds.g restarted 2024-07-26T13:35:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: osdmap e112: 12 total, 12 up, 12 in 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:resolve 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:resolve 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:boot 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:35:38.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: daemon mds.a restarted 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: osdmap e113: 12 total, 12 up, 12 in 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:boot 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: Standby daemon mds.b assigned to filesystem cephfs as rank 3 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,4=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:35:38.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:35:38.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:35:38.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:35:38.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:35:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:39 smithi076 ceph-mon[35401]: pgmap v2734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 12 op/s 2024-07-26T13:35:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:39 smithi040 ceph-mon[32397]: pgmap v2734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 12 op/s 2024-07-26T13:35:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:39 smithi146 ceph-mon[35807]: pgmap v2734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 12 op/s 2024-07-26T13:35:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:40 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:resolve 2024-07-26T13:35:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:40 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:resolve 2024-07-26T13:35:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:40 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:40 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:resolve 2024-07-26T13:35:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:40 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:resolve 2024-07-26T13:35:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:40 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:40 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:resolve 2024-07-26T13:35:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:40 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:resolve 2024-07-26T13:35:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:40 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: pgmap v2735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 16 op/s 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:reconnect 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:reconnect 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:reconnect 2024-07-26T13:35:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:reconnect 2024-07-26T13:35:41.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:41 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: pgmap v2735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 16 op/s 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:reconnect 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:reconnect 2024-07-26T13:35:41.832 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:reconnect 2024-07-26T13:35:41.833 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:reconnect 2024-07-26T13:35:41.833 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:41 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: pgmap v2735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 16 op/s 2024-07-26T13:35:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:reconnect 2024-07-26T13:35:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:reconnect 2024-07-26T13:35:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:reconnect 2024-07-26T13:35:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:reconnect 2024-07-26T13:35:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:41 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:rejoin 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:rejoin 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:rejoin 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:rejoin 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:35:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-07-26T13:35:42.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T13:35:42.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:42 smithi040 ceph-mon[32397]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:rejoin 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:rejoin 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:rejoin 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:rejoin 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T13:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-mon[35807]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: *** Caught signal (Aborted) ** 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: in thread 7fc827e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc82e03e6f0] 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc82e08b94c] 2024-07-26T13:35:42.822 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 3: raise() 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 4: abort() 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc82e02871b] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 6: /lib64/libc.so.6(+0x37386) [0x7fc82e037386] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5555613af6b9] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55556156d80c] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5555614ad2ca] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55556147d753] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55556147ea1b] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555561462752] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5555613b0a56] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5555613b4637] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5555613b4f5e] 2024-07-26T13:35:42.823 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55556139803a] 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc82eb9b407] 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 18: (DispatchQueue::entry()+0x60f) [0x7fc82eb9bcf9] 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc82ec785a1] 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: *** Caught signal (Aborted) ** 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: in thread 7ff615600640 thread_name:ms_dispatch 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.824 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff61b83e6f0] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff61b88b94c] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 3: raise() 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 4: abort() 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff61b82871b] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 6: /lib64/libc.so.6(+0x37386) [0x7ff61b837386] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ad32f556b9] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ad3311380c] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ad330532ca] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ad33023753] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ad33024a1b] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ad33008752] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ad32f56a56] 2024-07-26T13:35:42.825 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ad32f5a637] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ad32f5af5e] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ad32f3e03a] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff61c39b407] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 18: (DispatchQueue::entry()+0x60f) [0x7ff61c39bcf9] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff61c4785a1] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 20: (Thread::entry_wrapper()+0x43) [0x7fc82ea25cdd] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc82ea25cf9] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc82e089c02] 2024-07-26T13:35:42.826 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc82e10ec40] 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.390+0000 7fc827e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: in thread 7fc827e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc82e03e6f0] 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc82e08b94c] 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 3: raise() 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 4: abort() 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc82e02871b] 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 6: /lib64/libc.so.6(+0x37386) [0x7fc82e037386] 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5555613af6b9] 2024-07-26T13:35:42.827 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55556156d80c] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5555614ad2ca] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55556147d753] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55556147ea1b] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555561462752] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5555613b0a56] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5555613b4637] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5555613b4f5e] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55556139803a] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc82eb9b407] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 18: (DispatchQueue::entry()+0x60f) [0x7fc82eb9bcf9] 2024-07-26T13:35:42.828 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc82ec785a1] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 20: (Thread::entry_wrapper()+0x43) [0x7ff61c225cdd] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff61c225cf9] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff61b889c02] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff61b90ec40] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.391+0000 7ff615600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: in thread 7ff615600640 thread_name:ms_dispatch 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff61b83e6f0] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff61b88b94c] 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 3: raise() 2024-07-26T13:35:42.829 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 4: abort() 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff61b82871b] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 6: /lib64/libc.so.6(+0x37386) [0x7ff61b837386] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ad32f556b9] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ad3311380c] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ad330532ca] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ad33023753] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ad33024a1b] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ad33008752] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ad32f56a56] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ad32f5a637] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ad32f5af5e] 2024-07-26T13:35:42.830 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ad32f3e03a] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff61c39b407] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 18: (DispatchQueue::entry()+0x60f) [0x7ff61c39bcf9] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff61c4785a1] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 20: (Thread::entry_wrapper()+0x43) [0x7fc82ea25cdd] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc82ea25cf9] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc82e089c02] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc82e10ec40] 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.831 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 0> 2024-07-26T13:35:42.390+0000 7fc827e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: in thread 7fc827e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc82e03e6f0] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc82e08b94c] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 3: raise() 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 4: abort() 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc82e02871b] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 6: /lib64/libc.so.6(+0x37386) [0x7fc82e037386] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5555613af6b9] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55556156d80c] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5555614ad2ca] 2024-07-26T13:35:42.832 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55556147d753] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55556147ea1b] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555561462752] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5555613b0a56] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5555613b4637] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5555613b4f5e] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55556139803a] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc82eb9b407] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 20: (Thread::entry_wrapper()+0x43) [0x7ff61c225cdd] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff61c225cf9] 2024-07-26T13:35:42.833 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff61b889c02] 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff61b90ec40] 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 0> 2024-07-26T13:35:42.391+0000 7ff615600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: in thread 7ff615600640 thread_name:ms_dispatch 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff61b83e6f0] 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff61b88b94c] 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 3: raise() 2024-07-26T13:35:42.834 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 4: abort() 2024-07-26T13:35:42.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff61b82871b] 2024-07-26T13:35:42.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 6: /lib64/libc.so.6(+0x37386) [0x7ff61b837386] 2024-07-26T13:35:42.837 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ad32f556b9] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ad3311380c] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ad330532ca] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ad33023753] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ad33024a1b] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ad33008752] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ad32f56a56] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ad32f5a637] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ad32f5af5e] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ad32f3e03a] 2024-07-26T13:35:42.838 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff61c39b407] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 18: (DispatchQueue::entry()+0x60f) [0x7fc82eb9bcf9] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc82ec785a1] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 20: (Thread::entry_wrapper()+0x43) [0x7fc82ea25cdd] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc82ea25cf9] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc82e089c02] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc82e10ec40] 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 0> 2024-07-26T13:35:42.390+0000 7fc827e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.839 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: in thread 7fc827e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc82e03e6f0] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fc82e08b94c] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 3: raise() 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 4: abort() 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 5: /lib64/libc.so.6(+0x2871b) [0x7fc82e02871b] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 6: /lib64/libc.so.6(+0x37386) [0x7fc82e037386] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5555613af6b9] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55556156d80c] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5555614ad2ca] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55556147d753] 2024-07-26T13:35:42.840 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55556147ea1b] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x555561462752] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x5555613b0a56] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x5555613b4637] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x5555613b4f5e] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55556139803a] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fc82eb9b407] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 18: (DispatchQueue::entry()+0x60f) [0x7fc82eb9bcf9] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fc82ec785a1] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 20: (Thread::entry_wrapper()+0x43) [0x7fc82ea25cdd] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 21: (Thread::_entry_func(void*)+0xd) [0x7fc82ea25cf9] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 22: /lib64/libc.so.6(+0x89c02) [0x7fc82e089c02] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fc82e10ec40] 2024-07-26T13:35:42.841 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89425]: 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 18: (DispatchQueue::entry()+0x60f) [0x7ff61c39bcf9] 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff61c4785a1] 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 20: (Thread::entry_wrapper()+0x43) [0x7ff61c225cdd] 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff61c225cf9] 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff61b889c02] 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff61b90ec40] 2024-07-26T13:35:42.842 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 0> 2024-07-26T13:35:42.391+0000 7ff615600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: in thread 7ff615600640 thread_name:ms_dispatch 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff61b83e6f0] 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff61b88b94c] 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 3: raise() 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 4: abort() 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff61b82871b] 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 6: /lib64/libc.so.6(+0x37386) [0x7ff61b837386] 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55ad32f556b9] 2024-07-26T13:35:42.843 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55ad3311380c] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55ad330532ca] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55ad33023753] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55ad33024a1b] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55ad33008752] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55ad32f56a56] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55ad32f5a637] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55ad32f5af5e] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55ad32f3e03a] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff61c39b407] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 18: (DispatchQueue::entry()+0x60f) [0x7ff61c39bcf9] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff61c4785a1] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 20: (Thread::entry_wrapper()+0x43) [0x7ff61c225cdd] 2024-07-26T13:35:42.844 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff61c225cf9] 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff61b889c02] 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff61b90ec40] 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89419]: 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:42 smithi146 podman[89765]: 2024-07-26 13:35:42.514258796 +0000 UTC m=+0.033209612 container died c9056e1adf0c7bd71b48331e5c5bd038f3b3ddcdb6d31aecab01bdac0d6bfa76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:rejoin 2024-07-26T13:35:42.845 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:rejoin 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:rejoin 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:rejoin 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-mon[35401]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:42.846 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: *** Caught signal (Aborted) ** 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: in thread 7fe1b8800640 thread_name:ms_dispatch 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1bea3e6f0] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1bea8b94c] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 3: raise() 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 4: abort() 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1bea2871b] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1bea37386] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55927e77a6b9] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55927e93880c] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55927e8782ca] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55927e848753] 2024-07-26T13:35:42.847 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55927e849a1b] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55927e82d752] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55927e77ba56] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55927e77f637] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55927e77ff5e] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55927e76303a] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1bf59b407] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1bf59bcf9] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1bf6785a1] 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: *** Caught signal (Aborted) ** 2024-07-26T13:35:42.848 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: in thread 7fb3e3e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb3ea03e6f0] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb3ea08b94c] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 3: raise() 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 4: abort() 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb3ea02871b] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 6: /lib64/libc.so.6(+0x37386) [0x7fb3ea037386] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c3da22c6b9] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c3da3ea80c] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c3da32a2ca] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c3da2fa753] 2024-07-26T13:35:42.849 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c3da2fba1b] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c3da2df752] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c3da22da56] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c3da231637] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c3da231f5e] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c3da21503a] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb3eab9b407] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 18: (DispatchQueue::entry()+0x60f) [0x7fb3eab9bcf9] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb3eac785a1] 2024-07-26T13:35:42.850 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1bf425cdd] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1bf425cf9] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1bea89c02] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1beb0ec40] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.390+0000 7fe1b8800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: in thread 7fe1b8800640 thread_name:ms_dispatch 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1bea3e6f0] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1bea8b94c] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 3: raise() 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 4: abort() 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1bea2871b] 2024-07-26T13:35:42.851 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1bea37386] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55927e77a6b9] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55927e93880c] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55927e8782ca] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55927e848753] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55927e849a1b] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55927e82d752] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55927e77ba56] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55927e77f637] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55927e77ff5e] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55927e76303a] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1bf59b407] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1bf59bcf9] 2024-07-26T13:35:42.852 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1bf6785a1] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 20: (Thread::entry_wrapper()+0x43) [0x7fb3eaa25cdd] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb3eaa25cf9] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb3ea089c02] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb3ea10ec40] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.394+0000 7fb3e3e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: in thread 7fb3e3e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb3ea03e6f0] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb3ea08b94c] 2024-07-26T13:35:42.853 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 3: raise() 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 4: abort() 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb3ea02871b] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 6: /lib64/libc.so.6(+0x37386) [0x7fb3ea037386] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c3da22c6b9] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c3da3ea80c] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c3da32a2ca] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c3da2fa753] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c3da2fba1b] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c3da2df752] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c3da22da56] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c3da231637] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c3da231f5e] 2024-07-26T13:35:42.854 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c3da21503a] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb3eab9b407] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 18: (DispatchQueue::entry()+0x60f) [0x7fb3eab9bcf9] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb3eac785a1] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1bf425cdd] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1bf425cf9] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1bea89c02] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1beb0ec40] 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.855 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 0> 2024-07-26T13:35:42.390+0000 7fe1b8800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: in thread 7fe1b8800640 thread_name:ms_dispatch 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1bea3e6f0] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1bea8b94c] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 3: raise() 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 4: abort() 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1bea2871b] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1bea37386] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55927e77a6b9] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55927e93880c] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55927e8782ca] 2024-07-26T13:35:42.856 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55927e848753] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55927e849a1b] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55927e82d752] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55927e77ba56] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55927e77f637] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55927e77ff5e] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55927e76303a] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1bf59b407] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 20: (Thread::entry_wrapper()+0x43) [0x7fb3eaa25cdd] 2024-07-26T13:35:42.857 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb3eaa25cf9] 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb3ea089c02] 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb3ea10ec40] 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 0> 2024-07-26T13:35:42.394+0000 7fb3e3e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: in thread 7fb3e3e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb3ea03e6f0] 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb3ea08b94c] 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 3: raise() 2024-07-26T13:35:42.858 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 4: abort() 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb3ea02871b] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 6: /lib64/libc.so.6(+0x37386) [0x7fb3ea037386] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c3da22c6b9] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c3da3ea80c] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c3da32a2ca] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c3da2fa753] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c3da2fba1b] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c3da2df752] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c3da22da56] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c3da231637] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c3da231f5e] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c3da21503a] 2024-07-26T13:35:42.859 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb3eab9b407] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 18: (DispatchQueue::entry()+0x60f) [0x7fb3eab9bcf9] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb3eac785a1] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 20: (Thread::entry_wrapper()+0x43) [0x7fb3eaa25cdd] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb3eaa25cf9] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb3ea089c02] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb3ea10ec40] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 0> 2024-07-26T13:35:42.394+0000 7fb3e3e00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: in thread 7fb3e3e00640 thread_name:ms_dispatch 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb3ea03e6f0] 2024-07-26T13:35:42.860 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fb3ea08b94c] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 3: raise() 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 4: abort() 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 5: /lib64/libc.so.6(+0x2871b) [0x7fb3ea02871b] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 6: /lib64/libc.so.6(+0x37386) [0x7fb3ea037386] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55c3da22c6b9] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55c3da3ea80c] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55c3da32a2ca] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55c3da2fa753] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55c3da2fba1b] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55c3da2df752] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55c3da22da56] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55c3da231637] 2024-07-26T13:35:42.861 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55c3da231f5e] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1bf59bcf9] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1bf6785a1] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1bf425cdd] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1bf425cf9] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1bea89c02] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1beb0ec40] 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 0> 2024-07-26T13:35:42.390+0000 7fe1b8800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:42.862 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: in thread 7fe1b8800640 thread_name:ms_dispatch 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe1bea3e6f0] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fe1bea8b94c] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 3: raise() 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 4: abort() 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 5: /lib64/libc.so.6(+0x2871b) [0x7fe1bea2871b] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 6: /lib64/libc.so.6(+0x37386) [0x7fe1bea37386] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55927e77a6b9] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55927e93880c] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55927e8782ca] 2024-07-26T13:35:42.863 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55927e848753] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55927e849a1b] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55927e82d752] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55927e77ba56] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55927e77f637] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55927e77ff5e] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55c3da21503a] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fb3eab9b407] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 18: (DispatchQueue::entry()+0x60f) [0x7fb3eab9bcf9] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fb3eac785a1] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 20: (Thread::entry_wrapper()+0x43) [0x7fb3eaa25cdd] 2024-07-26T13:35:42.864 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 21: (Thread::_entry_func(void*)+0xd) [0x7fb3eaa25cf9] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 22: /lib64/libc.so.6(+0x89c02) [0x7fb3ea089c02] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fb3ea10ec40] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[87731]: 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55927e76303a] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fe1bf59b407] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 18: (DispatchQueue::entry()+0x60f) [0x7fe1bf59bcf9] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fe1bf6785a1] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 20: (Thread::entry_wrapper()+0x43) [0x7fe1bf425cdd] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 21: (Thread::_entry_func(void*)+0xd) [0x7fe1bf425cf9] 2024-07-26T13:35:42.865 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 22: /lib64/libc.so.6(+0x89c02) [0x7fe1bea89c02] 2024-07-26T13:35:42.866 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fe1beb0ec40] 2024-07-26T13:35:42.866 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:42.866 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[87705]: 2024-07-26T13:35:42.866 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:42 smithi076 podman[88060]: 2024-07-26 13:35:42.516644857 +0000 UTC m=+0.038579994 container died 662423c6ea7dd245e97e0244001c2df6208010c5701288b366b007d563b97eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724) 2024-07-26T13:35:43.493 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:43 smithi146 podman[89771]: 2024-07-26 13:35:43.236773667 +0000 UTC m=+0.742200077 container died ad9e1490eed4981798e8b951751ac0f4ff15ca42e1e12599feaf21eb48ba40de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-26T13:35:43.494 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:43 smithi146 podman[89765]: 2024-07-26 13:35:43.168149657 +0000 UTC m=+0.687100472 container remove c9056e1adf0c7bd71b48331e5c5bd038f3b3ddcdb6d31aecab01bdac0d6bfa76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-07-26T13:35:43.494 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:43 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:43.494 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: pgmap v2736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 op/s 2024-07-26T13:35:43.494 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:43.495 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:active 2024-07-26T13:35:43.495 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:active 2024-07-26T13:35:43.495 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:active 2024-07-26T13:35:43.495 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:active 2024-07-26T13:35:43.495 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:35:43.495 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:43 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: pgmap v2736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 op/s 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:active 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:active 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:active 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:active 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:35:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:43 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:43.782 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:43 smithi076 podman[88060]: 2024-07-26 13:35:43.398536056 +0000 UTC m=+0.920471224 container remove 662423c6ea7dd245e97e0244001c2df6208010c5701288b366b007d563b97eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0) 2024-07-26T13:35:43.782 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:43 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:43 smithi076 podman[88066]: 2024-07-26 13:35:43.470187678 +0000 UTC m=+0.976937362 container died 2bf8fea1fe71653c2078f424565fdc0a8dd6c4b7480bea403fc944299f4dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: pgmap v2736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 op/s 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/3220961055,v1:172.21.15.146:6839/3220961055] up:active 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/961948387,v1:172.21.15.76:6833/961948387] up:active 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3919477759,v1:172.21.15.146:6837/3919477759] up:active 2024-07-26T13:35:43.783 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/2701751672,v1:172.21.15.76:6839/2701751672] up:active 2024-07-26T13:35:43.784 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:35:43.784 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:43 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:35:44.203 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:43 smithi146 podman[89771]: 2024-07-26 13:35:43.838610464 +0000 UTC m=+1.344036915 container remove ad9e1490eed4981798e8b951751ac0f4ff15ca42e1e12599feaf21eb48ba40de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T13:35:44.203 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:43 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:44.398 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:44 smithi076 podman[88066]: 2024-07-26 13:35:44.110177173 +0000 UTC m=+1.616926857 container remove 2bf8fea1fe71653c2078f424565fdc0a8dd6c4b7480bea403fc944299f4dae4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:44.399 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:44 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:35:44.570 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:44 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:35:44.571 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:44 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.542s CPU time. 2024-07-26T13:35:44.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:44 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:35:44.571 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:44 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.566s CPU time. 2024-07-26T13:35:44.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:44 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:35:44.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:44 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.711s CPU time. 2024-07-26T13:35:44.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:44 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:35:44.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:44 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.313s CPU time. 2024-07-26T13:35:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:45 smithi040 ceph-mon[32397]: pgmap v2737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 702 B/s wr, 16 op/s 2024-07-26T13:35:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:45 smithi146 ceph-mon[35807]: pgmap v2737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 702 B/s wr, 16 op/s 2024-07-26T13:35:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:45 smithi076 ceph-mon[35401]: pgmap v2737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 702 B/s wr, 16 op/s 2024-07-26T13:35:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:47 smithi040 ceph-mon[32397]: pgmap v2738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 967 B/s wr, 14 op/s 2024-07-26T13:35:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:47 smithi146 ceph-mon[35807]: pgmap v2738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 967 B/s wr, 14 op/s 2024-07-26T13:35:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:47 smithi076 ceph-mon[35401]: pgmap v2738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 967 B/s wr, 14 op/s 2024-07-26T13:35:47.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:47.921+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:35:47.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:47.921+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:35:47.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:35:47.921+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-07-26T13:35:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:49 smithi040 ceph-mon[32397]: pgmap v2739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 791 B/s wr, 14 op/s 2024-07-26T13:35:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:49 smithi146 ceph-mon[35807]: pgmap v2739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 791 B/s wr, 14 op/s 2024-07-26T13:35:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:49 smithi076 ceph-mon[35401]: pgmap v2739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 791 B/s wr, 14 op/s 2024-07-26T13:35:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:51 smithi040 ceph-mon[32397]: pgmap v2740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 14 op/s 2024-07-26T13:35:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:51 smithi146 ceph-mon[35807]: pgmap v2740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 14 op/s 2024-07-26T13:35:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:51 smithi076 ceph-mon[35401]: pgmap v2740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 14 op/s 2024-07-26T13:35:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:53 smithi040 ceph-mon[32397]: pgmap v2741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T13:35:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:53 smithi146 ceph-mon[35807]: pgmap v2741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T13:35:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:53 smithi076 ceph-mon[35401]: pgmap v2741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 11 op/s 2024-07-26T13:35:54.720 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:35:54.720 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: Stopped Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:54.720 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.542s CPU time. 2024-07-26T13:35:54.720 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: Starting Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:54.721 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:35:54.721 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: Stopped Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:54.721 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.566s CPU time. 2024-07-26T13:35:54.721 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:54 smithi146 systemd[1]: Starting Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:54.976 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:54 smithi146 podman[89946]: 2024-07-26 13:35:54.624497713 +0000 UTC m=+0.035096175 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:54.976 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:54 smithi146 podman[89945]: 2024-07-26 13:35:54.623411603 +0000 UTC m=+0.034434337 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:54.976 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:54 smithi146 podman[89945]: 2024-07-26 13:35:54.751070887 +0000 UTC m=+0.162093643 container create aba3d6f66d6448d0a2075f7b163955f31c7d070216ed8c86158c2bb3f181a308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=) 2024-07-26T13:35:54.989 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:35:54.989 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: Stopped Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:54.989 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.313s CPU time. 2024-07-26T13:35:54.990 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: Starting Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:54.990 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:35:54.990 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: Stopped Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:54.990 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.711s CPU time. 2024-07-26T13:35:54.990 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:54 smithi076 systemd[1]: Starting Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:35:55.256 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:54 smithi076 podman[88240]: 2024-07-26 13:35:54.898839873 +0000 UTC m=+0.034972992 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:55.257 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:54 smithi076 podman[88239]: 2024-07-26 13:35:54.896691982 +0000 UTC m=+0.036448387 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:35:55.257 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 podman[88239]: 2024-07-26 13:35:55.036766805 +0000 UTC m=+0.176523221 container create 5e6a767702464b646a652b45343770c7c994d05f569dce21463d403b91d342db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-07-26T13:35:55.294 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:54 smithi146 podman[89946]: 2024-07-26 13:35:54.974751365 +0000 UTC m=+0.385349848 container create 624f8f7a4b9634184f5fba6dc4c71475772cd50de517ec97ffff325c143d0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS) 2024-07-26T13:35:55.295 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:55 smithi146 podman[89945]: 2024-07-26 13:35:55.20367463 +0000 UTC m=+0.614697419 container init aba3d6f66d6448d0a2075f7b163955f31c7d070216ed8c86158c2bb3f181a308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-07-26T13:35:55.295 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:55 smithi146 podman[89945]: 2024-07-26 13:35:55.214148722 +0000 UTC m=+0.625171508 container start aba3d6f66d6448d0a2075f7b163955f31c7d070216ed8c86158c2bb3f181a308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:35:55.516 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 podman[88239]: 2024-07-26 13:35:55.399752566 +0000 UTC m=+0.539508999 container init 5e6a767702464b646a652b45343770c7c994d05f569dce21463d403b91d342db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-07-26T13:35:55.516 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 podman[88239]: 2024-07-26 13:35:55.4093537 +0000 UTC m=+0.549110122 container start 5e6a767702464b646a652b45343770c7c994d05f569dce21463d403b91d342db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:35:55.516 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 podman[88240]: 2024-07-26 13:35:55.255355865 +0000 UTC m=+0.391489009 container create 169b5d2ac5734729a0066054cc92628cc0abab027d8838437d6762733e10a20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: pgmap v2742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: daemon mds.c restarted 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: osdmap e114: 12 total, 12 up, 12 in 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:boot 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=i=up:active,3=b=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:35:55.517 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:55.557 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:55 smithi146 bash[89945]: aba3d6f66d6448d0a2075f7b163955f31c7d070216ed8c86158c2bb3f181a308 2024-07-26T13:35:55.558 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:55 smithi146 systemd[1]: Started Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:55.558 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mds[89982]: -- 172.21.15.146:0/3105726613 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e33b7f860 con 0x562e37d21600 2024-07-26T13:35:55.558 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: starting mds.c at 2024-07-26T13:35:55.558 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:55 smithi146 podman[89946]: 2024-07-26 13:35:55.420868153 +0000 UTC m=+0.831466639 container init 624f8f7a4b9634184f5fba6dc4c71475772cd50de517ec97ffff325c143d0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-07-26T13:35:55.558 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:55 smithi146 podman[89946]: 2024-07-26 13:35:55.439630389 +0000 UTC m=+0.850228836 container start 624f8f7a4b9634184f5fba6dc4c71475772cd50de517ec97ffff325c143d0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-07-26T13:35:55.558 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: pgmap v2742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: daemon mds.c restarted 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: osdmap e114: 12 total, 12 up, 12 in 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:boot 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=i=up:active,3=b=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:35:55.559 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: pgmap v2742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:35:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: daemon mds.c restarted 2024-07-26T13:35:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:35:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: osdmap e114: 12 total, 12 up, 12 in 2024-07-26T13:35:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:boot 2024-07-26T13:35:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: Standby daemon mds.g assigned to filesystem cephfs as rank 4 2024-07-26T13:35:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=i=up:active,3=b=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:35:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-07-26T13:35:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:55 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:35:55.782 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 bash[88239]: 5e6a767702464b646a652b45343770c7c994d05f569dce21463d403b91d342db 2024-07-26T13:35:55.782 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 systemd[1]: Started Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:55.782 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mds[88268]: -- 172.21.15.76:0/3060012595 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4f8b09860 con 0x55a4fccab600 2024-07-26T13:35:55.782 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: starting mds.b at 2024-07-26T13:35:55.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-mds[90003]: -- 172.21.15.146:0/423023842 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f69ecd7860 con 0x55f6a2e79180 2024-07-26T13:35:55.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:55 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: starting mds.i at 2024-07-26T13:35:55.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:55 smithi146 bash[89946]: 624f8f7a4b9634184f5fba6dc4c71475772cd50de517ec97ffff325c143d0f6b 2024-07-26T13:35:55.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:35:55 smithi146 systemd[1]: Started Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:56.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 podman[88240]: 2024-07-26 13:35:55.868795912 +0000 UTC m=+1.004929102 container init 169b5d2ac5734729a0066054cc92628cc0abab027d8838437d6762733e10a20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:35:56.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 podman[88240]: 2024-07-26 13:35:55.879155856 +0000 UTC m=+1.015288997 container start 169b5d2ac5734729a0066054cc92628cc0abab027d8838437d6762733e10a20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-07-26T13:35:56.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 bash[88240]: 169b5d2ac5734729a0066054cc92628cc0abab027d8838437d6762733e10a20b 2024-07-26T13:35:56.333 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 systemd[1]: Started Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:35:56.334 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-mds[88295]: -- 172.21.15.76:0/437501441 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3980fd860 con 0x55b39c29fa80 2024-07-26T13:35:56.334 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:35:55 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: starting mds.k at 2024-07-26T13:35:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: daemon mds.b restarted 2024-07-26T13:35:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: osdmap e115: 12 total, 12 up, 12 in 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:resolve 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:boot 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=i=up:active,4=g=up:resolve} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 1 up:replay 1 up:resolve 3 up:active 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: daemon mds.i restarted 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: osdmap e116: 12 total, 12 up, 12 in 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:boot 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:35:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=a=up:replay,4=g=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: daemon mds.k restarted 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: osdmap e117: 12 total, 12 up, 12 in 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:boot 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:replay,3=a=up:replay,4=g=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:35:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:56 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:35:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: daemon mds.b restarted 2024-07-26T13:35:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: osdmap e115: 12 total, 12 up, 12 in 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:resolve 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:boot 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=i=up:active,4=g=up:resolve} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 1 up:replay 1 up:resolve 3 up:active 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: daemon mds.i restarted 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: osdmap e116: 12 total, 12 up, 12 in 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:boot 2024-07-26T13:35:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=a=up:replay,4=g=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: daemon mds.k restarted 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: osdmap e117: 12 total, 12 up, 12 in 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:boot 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:replay,3=a=up:replay,4=g=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:35:56.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:56 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: daemon mds.b restarted 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: osdmap e115: 12 total, 12 up, 12 in 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:resolve 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:boot 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: Standby daemon mds.a assigned to filesystem cephfs as rank 3 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,2=i=up:active,4=g=up:resolve} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:35:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 1 up:replay 1 up:resolve 3 up:active 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: daemon mds.i restarted 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: osdmap e116: 12 total, 12 up, 12 in 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:boot 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:active,1=h=up:active,3=a=up:replay,4=g=up:resolve} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 2 up:replay 1 up:resolve 2 up:active 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: daemon mds.k restarted 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: osdmap e117: 12 total, 12 up, 12 in 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:boot 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: Standby daemon mds.e assigned to filesystem cephfs as rank 0 2024-07-26T13:35:56.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:replay,3=a=up:replay,4=g=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:35:56.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-07-26T13:35:56.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:56 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 3 up:replay 1 up:resolve 1 up:active 2024-07-26T13:35:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:57 smithi040 ceph-mon[32397]: pgmap v2747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-07-26T13:35:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:57 smithi146 ceph-mon[35807]: pgmap v2747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-07-26T13:35:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:57 smithi076 ceph-mon[35401]: pgmap v2747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-07-26T13:35:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:58 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:resolve 2024-07-26T13:35:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:58 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:resolve 2024-07-26T13:35:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:58 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:resolve 2024-07-26T13:35:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:58 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:58 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:resolve 2024-07-26T13:35:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:58 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:resolve 2024-07-26T13:35:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:58 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:resolve 2024-07-26T13:35:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:58 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:58 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:resolve 2024-07-26T13:35:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:58 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:resolve 2024-07-26T13:35:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:58 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:resolve 2024-07-26T13:35:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:58 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:35:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: pgmap v2748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 op/s 2024-07-26T13:35:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:35:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:35:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:reconnect 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:reconnect 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:reconnect 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:reconnect 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:59.822 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: *** Caught signal (Aborted) ** 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: in thread 7f6db6a00640 thread_name:ms_dispatch 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6dbcc3e6f0] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6dbcc8b94c] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 3: raise() 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 4: abort() 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6dbcc2871b] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 6: /lib64/libc.so.6(+0x37386) [0x7f6dbcc37386] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56307621a6b9] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5630763d880c] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5630763182ca] 2024-07-26T13:35:59.823 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5630762e8753] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5630762e9a1b] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5630762cd752] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56307621ba56] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56307621f637] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56307621ff5e] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56307620303a] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6dbd79b407] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 18: (DispatchQueue::entry()+0x60f) [0x7f6dbd79bcf9] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6dbd8785a1] 2024-07-26T13:35:59.824 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 20: (Thread::entry_wrapper()+0x43) [0x7f6dbd625cdd] 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6dbd625cf9] 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6dbcc89c02] 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6dbcd0ec40] 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.558+0000 7f6db6a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: in thread 7f6db6a00640 thread_name:ms_dispatch 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6dbcc3e6f0] 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6dbcc8b94c] 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 3: raise() 2024-07-26T13:35:59.825 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 4: abort() 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6dbcc2871b] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 6: /lib64/libc.so.6(+0x37386) [0x7f6dbcc37386] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56307621a6b9] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5630763d880c] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5630763182ca] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5630762e8753] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5630762e9a1b] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5630762cd752] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56307621ba56] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56307621f637] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56307621ff5e] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56307620303a] 2024-07-26T13:35:59.826 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6dbd79b407] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 18: (DispatchQueue::entry()+0x60f) [0x7f6dbd79bcf9] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6dbd8785a1] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 20: (Thread::entry_wrapper()+0x43) [0x7f6dbd625cdd] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6dbd625cf9] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6dbcc89c02] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6dbcd0ec40] 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.827 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 0> 2024-07-26T13:35:59.558+0000 7f6db6a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: in thread 7f6db6a00640 thread_name:ms_dispatch 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6dbcc3e6f0] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6dbcc8b94c] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 3: raise() 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 4: abort() 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6dbcc2871b] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 6: /lib64/libc.so.6(+0x37386) [0x7f6dbcc37386] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56307621a6b9] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5630763d880c] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5630763182ca] 2024-07-26T13:35:59.828 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5630762e8753] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5630762e9a1b] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5630762cd752] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56307621ba56] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56307621f637] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56307621ff5e] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56307620303a] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6dbd79b407] 2024-07-26T13:35:59.829 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 18: (DispatchQueue::entry()+0x60f) [0x7f6dbd79bcf9] 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6dbd8785a1] 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 20: (Thread::entry_wrapper()+0x43) [0x7f6dbd625cdd] 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6dbd625cf9] 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6dbcc89c02] 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6dbcd0ec40] 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 0> 2024-07-26T13:35:59.558+0000 7f6db6a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: in thread 7f6db6a00640 thread_name:ms_dispatch 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.830 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6dbcc3e6f0] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f6dbcc8b94c] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 3: raise() 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 4: abort() 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 5: /lib64/libc.so.6(+0x2871b) [0x7f6dbcc2871b] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 6: /lib64/libc.so.6(+0x37386) [0x7f6dbcc37386] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x56307621a6b9] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x5630763d880c] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5630763182ca] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x5630762e8753] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x5630762e9a1b] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x5630762cd752] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x56307621ba56] 2024-07-26T13:35:59.831 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x56307621f637] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x56307621ff5e] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x56307620303a] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f6dbd79b407] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 18: (DispatchQueue::entry()+0x60f) [0x7f6dbd79bcf9] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f6dbd8785a1] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 20: (Thread::entry_wrapper()+0x43) [0x7f6dbd625cdd] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 21: (Thread::_entry_func(void*)+0xd) [0x7f6dbd625cf9] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 22: /lib64/libc.so.6(+0x89c02) [0x7f6dbcc89c02] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f6dbcd0ec40] 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[89611]: 2024-07-26T13:35:59.832 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:35:59 smithi146 podman[90048]: 2024-07-26 13:35:59.681050014 +0000 UTC m=+0.031640463 container died 04482a281cf897ba59fb9f81b2cef243ab21111aa9f18240c0276063a2517eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: pgmap v2748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 op/s 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:reconnect 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:reconnect 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:reconnect 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:reconnect 2024-07-26T13:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: *** Caught signal (Aborted) ** 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: in thread 7fbe97800640 thread_name:ms_dispatch 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe9da3e6f0] 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fbe9da8b94c] 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 3: raise() 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 4: abort() 2024-07-26T13:35:59.834 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 5: /lib64/libc.so.6(+0x2871b) [0x7fbe9da2871b] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 6: /lib64/libc.so.6(+0x37386) [0x7fbe9da37386] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55735eb6e6b9] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55735ed2c80c] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55735ec6c2ca] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55735ec3c753] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55735ec3da1b] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55735ec21752] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55735eb6fa56] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55735eb73637] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55735eb73f5e] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55735eb5703a] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fbe9e59b407] 2024-07-26T13:35:59.835 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 18: (DispatchQueue::entry()+0x60f) [0x7fbe9e59bcf9] 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fbe9e6785a1] 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 20: (Thread::entry_wrapper()+0x43) [0x7fbe9e425cdd] 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 21: (Thread::_entry_func(void*)+0xd) [0x7fbe9e425cf9] 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 22: /lib64/libc.so.6(+0x89c02) [0x7fbe9da89c02] 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fbe9db0ec40] 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.563+0000 7fbe97800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.836 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: in thread 7fbe97800640 thread_name:ms_dispatch 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe9da3e6f0] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fbe9da8b94c] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 3: raise() 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 4: abort() 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 5: /lib64/libc.so.6(+0x2871b) [0x7fbe9da2871b] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 6: /lib64/libc.so.6(+0x37386) [0x7fbe9da37386] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55735eb6e6b9] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55735ed2c80c] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55735ec6c2ca] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55735ec3c753] 2024-07-26T13:35:59.837 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55735ec3da1b] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55735ec21752] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55735eb6fa56] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55735eb73637] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55735eb73f5e] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55735eb5703a] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fbe9e59b407] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 18: (DispatchQueue::entry()+0x60f) [0x7fbe9e59bcf9] 2024-07-26T13:35:59.838 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fbe9e6785a1] 2024-07-26T13:35:59.841 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 20: (Thread::entry_wrapper()+0x43) [0x7fbe9e425cdd] 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 21: (Thread::_entry_func(void*)+0xd) [0x7fbe9e425cf9] 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 22: /lib64/libc.so.6(+0x89c02) [0x7fbe9da89c02] 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fbe9db0ec40] 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 0> 2024-07-26T13:35:59.563+0000 7fbe97800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: in thread 7fbe97800640 thread_name:ms_dispatch 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.842 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe9da3e6f0] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fbe9da8b94c] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 3: raise() 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 4: abort() 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 5: /lib64/libc.so.6(+0x2871b) [0x7fbe9da2871b] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 6: /lib64/libc.so.6(+0x37386) [0x7fbe9da37386] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55735eb6e6b9] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55735ed2c80c] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55735ec6c2ca] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55735ec3c753] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55735ec3da1b] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55735ec21752] 2024-07-26T13:35:59.843 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55735eb6fa56] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55735eb73637] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55735eb73f5e] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55735eb5703a] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fbe9e59b407] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 18: (DispatchQueue::entry()+0x60f) [0x7fbe9e59bcf9] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fbe9e6785a1] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 20: (Thread::entry_wrapper()+0x43) [0x7fbe9e425cdd] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 21: (Thread::_entry_func(void*)+0xd) [0x7fbe9e425cf9] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 22: /lib64/libc.so.6(+0x89c02) [0x7fbe9da89c02] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fbe9db0ec40] 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.844 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: -13> 2024-07-26T13:35:59.563+0000 7fbe97800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: in thread 7fbe97800640 thread_name:ms_dispatch 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe9da3e6f0] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fbe9da8b94c] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 3: raise() 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 4: abort() 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 5: /lib64/libc.so.6(+0x2871b) [0x7fbe9da2871b] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 6: /lib64/libc.so.6(+0x37386) [0x7fbe9da37386] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55735eb6e6b9] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55735ed2c80c] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55735ec6c2ca] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55735ec3c753] 2024-07-26T13:35:59.845 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55735ec3da1b] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55735ec21752] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55735eb6fa56] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55735eb73637] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55735eb73f5e] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55735eb5703a] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fbe9e59b407] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 18: (DispatchQueue::entry()+0x60f) [0x7fbe9e59bcf9] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fbe9e6785a1] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 20: (Thread::entry_wrapper()+0x43) [0x7fbe9e425cdd] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 21: (Thread::_entry_func(void*)+0xd) [0x7fbe9e425cf9] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 22: /lib64/libc.so.6(+0x89c02) [0x7fbe9da89c02] 2024-07-26T13:35:59.846 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fbe9db0ec40] 2024-07-26T13:35:59.847 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.847 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[87904]: 2024-07-26T13:35:59.847 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:35:59 smithi076 podman[88341]: 2024-07-26 13:35:59.682938091 +0000 UTC m=+0.037569585 container died afd47399be315509b4f5bcfc5eb1b653232133c74c429346ac88eb2b63f1703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724) 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: pgmap v2748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 op/s 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399995 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399988 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00399994 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:reconnect 2024-07-26T13:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:reconnect 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:reconnect 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:reconnect 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: *** Caught signal (Aborted) ** 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: in thread 7fa463800640 thread_name:ms_dispatch 2024-07-26T13:35:59.984 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa469a3e6f0] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa469a8b94c] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 3: raise() 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 4: abort() 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa469a2871b] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 6: /lib64/libc.so.6(+0x37386) [0x7fa469a37386] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561d83fa56b9] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561d8416380c] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561d840a32ca] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561d84073753] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561d84074a1b] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561d84058752] 2024-07-26T13:35:59.985 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561d83fa6a56] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561d83faa637] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561d83faaf5e] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561d83f8e03a] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa46a59b407] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 18: (DispatchQueue::entry()+0x60f) [0x7fa46a59bcf9] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa46a6785a1] 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:35:59.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: *** Caught signal (Aborted) ** 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: in thread 7fa600c00640 thread_name:ms_dispatch 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa606e3e6f0] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa606e8b94c] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 3: raise() 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 4: abort() 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa606e2871b] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 6: /lib64/libc.so.6(+0x37386) [0x7fa606e37386] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f597d06b9] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f5998e80c] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f598ce2ca] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f5989e753] 2024-07-26T13:35:59.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f5989fa1b] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f59883752] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f597d1a56] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f597d5637] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f597d5f5e] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f597b903a] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa60799b407] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 18: (DispatchQueue::entry()+0x60f) [0x7fa60799bcf9] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa607a785a1] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 20: (Thread::entry_wrapper()+0x43) [0x7fa46a425cdd] 2024-07-26T13:35:59.988 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa46a425cf9] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa469a89c02] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa469b0ec40] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:35:59.559+0000 7fa463800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: in thread 7fa463800640 thread_name:ms_dispatch 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa469a3e6f0] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa469a8b94c] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 3: raise() 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 4: abort() 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa469a2871b] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 6: /lib64/libc.so.6(+0x37386) [0x7fa469a37386] 2024-07-26T13:35:59.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561d83fa56b9] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561d8416380c] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561d840a32ca] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561d84073753] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561d84074a1b] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561d84058752] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561d83fa6a56] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561d83faa637] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561d83faaf5e] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561d83f8e03a] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa46a59b407] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 18: (DispatchQueue::entry()+0x60f) [0x7fa46a59bcf9] 2024-07-26T13:35:59.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa46a6785a1] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 20: (Thread::entry_wrapper()+0x43) [0x7fa607825cdd] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa607825cf9] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa606e89c02] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa606f0ec40] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:35:59.562+0000 7fa600c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: in thread 7fa600c00640 thread_name:ms_dispatch 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa606e3e6f0] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa606e8b94c] 2024-07-26T13:35:59.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 3: raise() 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 4: abort() 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa606e2871b] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 6: /lib64/libc.so.6(+0x37386) [0x7fa606e37386] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f597d06b9] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f5998e80c] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f598ce2ca] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f5989e753] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f5989fa1b] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f59883752] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f597d1a56] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f597d5637] 2024-07-26T13:35:59.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f597d5f5e] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f597b903a] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa60799b407] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 18: (DispatchQueue::entry()+0x60f) [0x7fa60799bcf9] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa607a785a1] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 20: (Thread::entry_wrapper()+0x43) [0x7fa46a425cdd] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa46a425cf9] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa469a89c02] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa469b0ec40] 2024-07-26T13:35:59.993 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 0> 2024-07-26T13:35:59.559+0000 7fa463800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: in thread 7fa463800640 thread_name:ms_dispatch 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa469a3e6f0] 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa469a8b94c] 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 3: raise() 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 4: abort() 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa469a2871b] 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 6: /lib64/libc.so.6(+0x37386) [0x7fa469a37386] 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561d83fa56b9] 2024-07-26T13:35:59.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561d8416380c] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561d840a32ca] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561d84073753] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561d84074a1b] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561d84058752] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561d83fa6a56] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561d83faa637] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561d83faaf5e] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561d83f8e03a] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 20: (Thread::entry_wrapper()+0x43) [0x7fa607825cdd] 2024-07-26T13:35:59.995 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa607825cf9] 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa606e89c02] 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa606f0ec40] 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 0> 2024-07-26T13:35:59.562+0000 7fa600c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: in thread 7fa600c00640 thread_name:ms_dispatch 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa606e3e6f0] 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa606e8b94c] 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 3: raise() 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 4: abort() 2024-07-26T13:35:59.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa606e2871b] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 6: /lib64/libc.so.6(+0x37386) [0x7fa606e37386] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f597d06b9] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f5998e80c] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f598ce2ca] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f5989e753] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f5989fa1b] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f59883752] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f597d1a56] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f597d5637] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f597d5f5e] 2024-07-26T13:35:59.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f597b903a] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa46a59b407] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 18: (DispatchQueue::entry()+0x60f) [0x7fa46a59bcf9] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa46a6785a1] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 20: (Thread::entry_wrapper()+0x43) [0x7fa46a425cdd] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa46a425cf9] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa469a89c02] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa469b0ec40] 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:35:59.998 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 0> 2024-07-26T13:35:59.559+0000 7fa463800640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: in thread 7fa463800640 thread_name:ms_dispatch 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa469a3e6f0] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa469a8b94c] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 3: raise() 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 4: abort() 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa469a2871b] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 6: /lib64/libc.so.6(+0x37386) [0x7fa469a37386] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561d83fa56b9] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561d8416380c] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561d840a32ca] 2024-07-26T13:35:59.999 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561d84073753] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561d84074a1b] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561d84058752] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561d83fa6a56] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561d83faa637] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561d83faaf5e] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561d83f8e03a] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa46a59b407] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 18: (DispatchQueue::entry()+0x60f) [0x7fa46a59bcf9] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa46a6785a1] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 20: (Thread::entry_wrapper()+0x43) [0x7fa46a425cdd] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa46a425cf9] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa469a89c02] 2024-07-26T13:36:00.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa469b0ec40] 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188230]: 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:35:59 smithi040 podman[188364]: 2024-07-26 13:35:59.684836162 +0000 UTC m=+0.038237552 container died b66ff5665f3c1a98dd58fda68f5e66912f9d1df121f34b77c5968e9982024333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa60799b407] 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 18: (DispatchQueue::entry()+0x60f) [0x7fa60799bcf9] 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa607a785a1] 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 20: (Thread::entry_wrapper()+0x43) [0x7fa607825cdd] 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa607825cf9] 2024-07-26T13:36:00.001 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa606e89c02] 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa606f0ec40] 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 0> 2024-07-26T13:35:59.562+0000 7fa600c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: in thread 7fa600c00640 thread_name:ms_dispatch 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa606e3e6f0] 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa606e8b94c] 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 3: raise() 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 4: abort() 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 5: /lib64/libc.so.6(+0x2871b) [0x7fa606e2871b] 2024-07-26T13:36:00.002 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 6: /lib64/libc.so.6(+0x37386) [0x7fa606e37386] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f597d06b9] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f5998e80c] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f598ce2ca] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f5989e753] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f5989fa1b] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f59883752] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f597d1a56] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f597d5637] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f597d5f5e] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f597b903a] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fa60799b407] 2024-07-26T13:36:00.003 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 18: (DispatchQueue::entry()+0x60f) [0x7fa60799bcf9] 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fa607a785a1] 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 20: (Thread::entry_wrapper()+0x43) [0x7fa607825cdd] 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 21: (Thread::_entry_func(void*)+0xd) [0x7fa607825cf9] 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 22: /lib64/libc.so.6(+0x89c02) [0x7fa606e89c02] 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fa606f0ec40] 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:00.004 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:35:59 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188235]: 2024-07-26T13:36:00.483 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:00 smithi040 podman[188373]: 2024-07-26 13:36:00.051318268 +0000 UTC m=+0.373260624 container died 2dad782ebc375269e05e2a86519e9c863e97b33bf17b801ad1c627b56a9ce4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-07-26T13:36:00.818 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:rejoin 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:rejoin 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:rejoin 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:rejoin 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:active 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:active 2024-07-26T13:36:00.819 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:active 2024-07-26T13:36:00.820 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:active 2024-07-26T13:36:00.820 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:00 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:00.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:00 smithi146 podman[90048]: 2024-07-26 13:36:00.357473081 +0000 UTC m=+0.708063560 container remove 04482a281cf897ba59fb9f81b2cef243ab21111aa9f18240c0276063a2517eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-07-26T13:36:00.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:00 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:rejoin 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:rejoin 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:rejoin 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:rejoin 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:active 2024-07-26T13:36:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:active 2024-07-26T13:36:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:active 2024-07-26T13:36:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:active 2024-07-26T13:36:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:00 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:00.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:00 smithi076 podman[88341]: 2024-07-26 13:36:00.388172793 +0000 UTC m=+0.742804324 container remove afd47399be315509b4f5bcfc5eb1b653232133c74c429346ac88eb2b63f1703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:36:00.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:00 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:rejoin 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:rejoin 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:rejoin 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:rejoin 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/1223305424,v1:172.21.15.40:6839/1223305424] up:active 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/2226292800,v1:172.21.15.146:6835/2226292800] up:active 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/2006579107,v1:172.21.15.40:6841/2006579107] up:active 2024-07-26T13:36:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1229078272,v1:172.21.15.76:6835/1229078272] up:active 2024-07-26T13:36:00.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:00 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:01.232 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:00 smithi040 podman[188364]: 2024-07-26 13:36:00.816753939 +0000 UTC m=+1.170155354 container remove b66ff5665f3c1a98dd58fda68f5e66912f9d1df121f34b77c5968e9982024333 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-26T13:36:01.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:00 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:01.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:00 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:36:01.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:00 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.708s CPU time. 2024-07-26T13:36:01.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:00 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:36:01.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:00 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.450s CPU time. 2024-07-26T13:36:01.525 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:01 smithi040 ceph-mon[32397]: pgmap v2749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 op/s 2024-07-26T13:36:01.525 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:01 smithi040 podman[188373]: 2024-07-26 13:36:01.269467372 +0000 UTC m=+1.591409665 container remove 2dad782ebc375269e05e2a86519e9c863e97b33bf17b801ad1c627b56a9ce4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-07-26T13:36:01.525 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:01 smithi146 ceph-mon[35807]: pgmap v2749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 op/s 2024-07-26T13:36:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:01 smithi076 ceph-mon[35401]: pgmap v2749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 op/s 2024-07-26T13:36:01.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:36:01.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.783s CPU time. 2024-07-26T13:36:01.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:36:01.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:01 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.742s CPU time. 2024-07-26T13:36:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:02.938+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T13:36:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:02.940+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-07-26T13:36:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:02.940+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-07-26T13:36:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:02.940+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-07-26T13:36:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:02.940+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-07-26T13:36:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:03 smithi146 ceph-mon[35807]: pgmap v2750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 12 op/s 2024-07-26T13:36:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:03 smithi076 ceph-mon[35401]: pgmap v2750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 12 op/s 2024-07-26T13:36:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:03 smithi040 ceph-mon[32397]: pgmap v2750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 12 op/s 2024-07-26T13:36:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:05 smithi146 ceph-mon[35807]: pgmap v2751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 592 B/s wr, 16 op/s 2024-07-26T13:36:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:05 smithi076 ceph-mon[35401]: pgmap v2751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 592 B/s wr, 16 op/s 2024-07-26T13:36:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:05 smithi040 ceph-mon[32397]: pgmap v2751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 592 B/s wr, 16 op/s 2024-07-26T13:36:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:07 smithi146 ceph-mon[35807]: pgmap v2752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 801 B/s wr, 16 op/s 2024-07-26T13:36:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:07 smithi076 ceph-mon[35401]: pgmap v2752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 801 B/s wr, 16 op/s 2024-07-26T13:36:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:07 smithi040 ceph-mon[32397]: pgmap v2752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 801 B/s wr, 16 op/s 2024-07-26T13:36:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:09 smithi146 ceph-mon[35807]: pgmap v2753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:36:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:09 smithi076 ceph-mon[35401]: pgmap v2753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:36:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:09 smithi040 ceph-mon[32397]: pgmap v2753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:36:11.459 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:36:11.460 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 systemd[1]: Stopped Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:11.460 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.450s CPU time. 2024-07-26T13:36:11.460 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 systemd[1]: Starting Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:36:11.476 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:36:11.476 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 systemd[1]: Stopped Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:11.477 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.708s CPU time. 2024-07-26T13:36:11.477 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 systemd[1]: Starting Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:36:11.736 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:11 smithi076 ceph-mon[35401]: pgmap v2754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:36:11.736 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 podman[88444]: 2024-07-26 13:36:11.361910329 +0000 UTC m=+0.033920761 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:36:11.736 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 podman[88444]: 2024-07-26 13:36:11.464106681 +0000 UTC m=+0.136117146 container create b7faa194987797422fa564b59745bb7664dcfe1f709cd4361001fbfd5bbd2dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-07-26T13:36:11.778 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 podman[90139]: 2024-07-26 13:36:11.380440099 +0000 UTC m=+0.035213461 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:36:11.779 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 podman[90139]: 2024-07-26 13:36:11.507831533 +0000 UTC m=+0.162604920 container create b4adffd833a0810209f8b48160e41e33889e177738fe627b1d1a32a992cb3aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb) 2024-07-26T13:36:11.779 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:11 smithi146 ceph-mon[35807]: pgmap v2754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:36:11.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:11 smithi040 ceph-mon[32397]: pgmap v2754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 682 B/s wr, 15 op/s 2024-07-26T13:36:11.780 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:36:11.780 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: Stopped Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:11.780 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.783s CPU time. 2024-07-26T13:36:11.780 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: Starting Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:36:11.780 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 5. 2024-07-26T13:36:11.781 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: Stopped Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:11.781 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.742s CPU time. 2024-07-26T13:36:11.781 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:11 smithi040 systemd[1]: Starting Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968... 2024-07-26T13:36:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 podman[90139]: 2024-07-26 13:36:11.77798966 +0000 UTC m=+0.432763051 container init b4adffd833a0810209f8b48160e41e33889e177738fe627b1d1a32a992cb3aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2) 2024-07-26T13:36:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 podman[90139]: 2024-07-26 13:36:11.790414571 +0000 UTC m=+0.445187929 container start b4adffd833a0810209f8b48160e41e33889e177738fe627b1d1a32a992cb3aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T13:36:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 bash[90139]: b4adffd833a0810209f8b48160e41e33889e177738fe627b1d1a32a992cb3aab 2024-07-26T13:36:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 systemd[1]: Started Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 ceph-mds[90158]: -- 172.21.15.146:0/2230545562 <== mon.1 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b952f67c20 con 0x55b957109a80 2024-07-26T13:36:12.071 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:11 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: starting mds.f at 2024-07-26T13:36:12.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 podman[88444]: 2024-07-26 13:36:11.734694899 +0000 UTC m=+0.406705417 container init b7faa194987797422fa564b59745bb7664dcfe1f709cd4361001fbfd5bbd2dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-07-26T13:36:12.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 podman[88444]: 2024-07-26 13:36:11.745216198 +0000 UTC m=+0.417226635 container start b7faa194987797422fa564b59745bb7664dcfe1f709cd4361001fbfd5bbd2dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-07-26T13:36:12.083 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 bash[88444]: b7faa194987797422fa564b59745bb7664dcfe1f709cd4361001fbfd5bbd2dc6 2024-07-26T13:36:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 systemd[1]: Started Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 ceph-mds[88462]: --2- 172.21.15.76:0/3858821964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561fa2c09a80 0x561fa37fab00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561fa2b496b0 tx=0x561fa2b42a80 comp rx=0 tx=0).write_message sending message m=0x561fa2ac01c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-07-26T13:36:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 ceph-mds[88462]: -- 172.21.15.76:0/3858821964 <== mon.2 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f9ea67860 con 0x561fa2c09a80 2024-07-26T13:36:12.084 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:11 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: starting mds.e at 2024-07-26T13:36:12.443 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188546]: 2024-07-26 13:36:12.079118303 +0000 UTC m=+0.040166893 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:36:12.443 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188539]: 2024-07-26 13:36:12.064405095 +0000 UTC m=+0.038367065 image pull ae51f432d4fa82622bc253ca9e2da7666c617e096e99d43d0a0e4fdaca8865f8 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 2024-07-26T13:36:12.443 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188539]: 2024-07-26 13:36:12.203672684 +0000 UTC m=+0.177634714 container create 827e3ad3ff2ccd19123dcde421af96094ac9a8bfb64575287cc454b075f286ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, ceph=True) 2024-07-26T13:36:12.733 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188539]: 2024-07-26 13:36:12.679629084 +0000 UTC m=+0.653591097 container init 827e3ad3ff2ccd19123dcde421af96094ac9a8bfb64575287cc454b075f286ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-07-26T13:36:12.733 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188539]: 2024-07-26 13:36:12.690092279 +0000 UTC m=+0.664054289 container start 827e3ad3ff2ccd19123dcde421af96094ac9a8bfb64575287cc454b075f286ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-07-26T13:36:12.733 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188546]: 2024-07-26 13:36:12.441680029 +0000 UTC m=+0.402728658 container create f314930c0d837e062d49dd5e229fb65742360221c34a13883dc40e8afbc337dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-07-26T13:36:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: daemon mds.e restarted 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: osdmap e118: 12 total, 12 up, 12 in 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:boot 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: daemon mds.f restarted 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: osdmap e119: 12 total, 12 up, 12 in 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:boot 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:replay,1=h=up:active,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:36:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:36:12.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:36:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: daemon mds.e restarted 2024-07-26T13:36:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: osdmap e118: 12 total, 12 up, 12 in 2024-07-26T13:36:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:boot 2024-07-26T13:36:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:36:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: daemon mds.f restarted 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: osdmap e119: 12 total, 12 up, 12 in 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:boot 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:replay,1=h=up:active,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:36:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:12 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:36:12.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: daemon mds.e restarted 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: osdmap e118: 12 total, 12 up, 12 in 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:boot 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: Standby daemon mds.k assigned to filesystem cephfs as rank 0 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {1=h=up:active,2=f=up:active,3=a=up:active,4=g=up:active} 5 up:standby-replay 3 up:standby, 1 failed 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 4 up:standby-replay 3 up:standby 1 up:replay 4 up:active 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: daemon mds.f restarted 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: osdmap e119: 12 total, 12 up, 12 in 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:boot 2024-07-26T13:36:12.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-07-26T13:36:12.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:replay,1=h=up:active,3=a=up:active,4=g=up:active} 4 up:standby-replay 4 up:standby, 1 failed 2024-07-26T13:36:12.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-07-26T13:36:12.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:12 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 3 up:standby-replay 4 up:standby 2 up:replay 3 up:active 2024-07-26T13:36:13.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mds[188576]: -- 172.21.15.40:0/4233274864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581a1323c20 con 0x5581a54c5600 2024-07-26T13:36:13.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: starting mds.g at 2024-07-26T13:36:13.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:13 smithi040 bash[188539]: 827e3ad3ff2ccd19123dcde421af96094ac9a8bfb64575287cc454b075f286ea 2024-07-26T13:36:13.233 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:13 smithi040 systemd[1]: Started Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:13.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188546]: 2024-07-26 13:36:12.804547847 +0000 UTC m=+0.765596454 container init f314930c0d837e062d49dd5e229fb65742360221c34a13883dc40e8afbc337dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-07-26T13:36:13.234 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 podman[188546]: 2024-07-26 13:36:12.812557642 +0000 UTC m=+0.773606232 container start f314930c0d837e062d49dd5e229fb65742360221c34a13883dc40e8afbc337dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-07-26T13:36:13.234 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 bash[188546]: f314930c0d837e062d49dd5e229fb65742360221c34a13883dc40e8afbc337dc 2024-07-26T13:36:13.234 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 systemd[1]: Started Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:13.234 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-mds[188588]: -- 172.21.15.40:0/1477528108 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e96505dc20 con 0x55e9691ffa80 2024-07-26T13:36:13.234 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:12 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: starting mds.a at 2024-07-26T13:36:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: pgmap v2757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 383 B/s wr, 10 op/s 2024-07-26T13:36:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: daemon mds.g restarted 2024-07-26T13:36:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: osdmap e120: 12 total, 12 up, 12 in 2024-07-26T13:36:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:resolve 2024-07-26T13:36:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:resolve 2024-07-26T13:36:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:boot 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: daemon mds.a restarted 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: osdmap e121: 12 total, 12 up, 12 in 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:boot 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: Standby daemon mds.b assigned to filesystem cephfs as rank 3 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,4=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:36:13.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:13 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:36:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: pgmap v2757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 383 B/s wr, 10 op/s 2024-07-26T13:36:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: daemon mds.g restarted 2024-07-26T13:36:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: osdmap e120: 12 total, 12 up, 12 in 2024-07-26T13:36:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:resolve 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:resolve 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:boot 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: daemon mds.a restarted 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: osdmap e121: 12 total, 12 up, 12 in 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:boot 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: Standby daemon mds.b assigned to filesystem cephfs as rank 3 2024-07-26T13:36:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,4=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:36:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:36:13.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:13 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:36:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: pgmap v2757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 383 B/s wr, 10 op/s 2024-07-26T13:36:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: daemon mds.g restarted 2024-07-26T13:36:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: osdmap e120: 12 total, 12 up, 12 in 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:resolve 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:resolve 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:boot 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: Standby daemon mds.c assigned to filesystem cephfs as rank 4 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,3=a=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 2 up:standby-replay 5 up:standby 1 up:replay 2 up:resolve 2 up:active 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: daemon mds.a restarted 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: osdmap e121: 12 total, 12 up, 12 in 2024-07-26T13:36:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:boot 2024-07-26T13:36:13.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: Standby daemon mds.b assigned to filesystem cephfs as rank 3 2024-07-26T13:36:13.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: fsmap cephfs:4/5 {0=k=up:resolve,1=h=up:active,2=i=up:resolve,4=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-07-26T13:36:13.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-07-26T13:36:13.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:13 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 2 up:replay 2 up:resolve 1 up:active 2024-07-26T13:36:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:15 smithi146 ceph-mon[35807]: pgmap v2760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-07-26T13:36:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:15 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:resolve 2024-07-26T13:36:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:15 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:resolve 2024-07-26T13:36:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:15 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:36:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:15 smithi076 ceph-mon[35401]: pgmap v2760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-07-26T13:36:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:15 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:resolve 2024-07-26T13:36:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:15 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:resolve 2024-07-26T13:36:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:15 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:15 smithi040 ceph-mon[32397]: pgmap v2760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-07-26T13:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:15 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:resolve 2024-07-26T13:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:15 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:resolve 2024-07-26T13:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:15 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:resolve 1 up:active 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 182.969305 secs 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: slow request 182.969305 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00199994 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299991 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:reconnect 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:reconnect 2024-07-26T13:36:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:reconnect 2024-07-26T13:36:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:reconnect 2024-07-26T13:36:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:36:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:16 smithi040 ceph-mon[32397]: pgmap v2761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 op/s 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 182.969305 secs 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: slow request 182.969305 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00199994 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299991 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:reconnect 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:reconnect 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:reconnect 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:reconnect 2024-07-26T13:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:36:17.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:16 smithi146 ceph-mon[35807]: pgmap v2761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 op/s 2024-07-26T13:36:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 182.969305 secs 2024-07-26T13:36:17.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: slow request 182.969305 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:36:17.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:36:17.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00199994 2024-07-26T13:36:17.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299991 2024-07-26T13:36:17.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:reconnect 2024-07-26T13:36:17.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:reconnect 2024-07-26T13:36:17.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:reconnect 2024-07-26T13:36:17.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:reconnect 2024-07-26T13:36:17.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:36:17.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:16 smithi076 ceph-mon[35401]: pgmap v2761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 op/s 2024-07-26T13:36:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:17.948+0000 7f760fe00640 1 -- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 msgr2=0x5585751e6f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:6838/1025840894 2024-07-26T13:36:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:17.948+0000 7f760fe00640 1 --2- 172.21.15.40:0/2203918565 >> [v2:172.21.15.76:6838/1025840894,v1:172.21.15.76:6839/1025840894] conn(0x558574de21c0 0x5585751e6f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-07-26T13:36:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T13:36:17.948+0000 7f75f9600640 1 client.18387 ms_handle_refused on v2:172.21.15.76:6838/1025840894 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:rejoin 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:rejoin 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:rejoin 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:rejoin 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:active 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:36:17.950 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-07-26T13:36:17.951 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T13:36:17.951 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:17 smithi040 ceph-mon[32397]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:36:17.951 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:36:17.951 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T13:36:17.951 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:rejoin 2024-07-26T13:36:17.951 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:rejoin 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:rejoin 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:rejoin 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:active 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-mon[35401]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:36:17.952 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: *** Caught signal (Aborted) ** 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: in thread 7f2ee6a00640 thread_name:ms_dispatch 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2eecc3e6f0] 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2eecc8b94c] 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 3: raise() 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 4: abort() 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2eecc2871b] 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 6: /lib64/libc.so.6(+0x37386) [0x7f2eecc37386] 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a4c16556b9] 2024-07-26T13:36:17.953 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a4c181380c] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a4c17532ca] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a4c1723753] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a4c1724a1b] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a4c1708752] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a4c1656a56] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a4c165a637] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a4c165af5e] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a4c163e03a] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2eed79b407] 2024-07-26T13:36:17.954 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 18: (DispatchQueue::entry()+0x60f) [0x7f2eed79bcf9] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2eed8785a1] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 20: (Thread::entry_wrapper()+0x43) [0x7f2eed625cdd] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2eed625cf9] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2eecc89c02] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2eecd0ec40] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.615+0000 7f2ee6a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: in thread 7f2ee6a00640 thread_name:ms_dispatch 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2eecc3e6f0] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2eecc8b94c] 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 3: raise() 2024-07-26T13:36:17.955 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 4: abort() 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2eecc2871b] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 6: /lib64/libc.so.6(+0x37386) [0x7f2eecc37386] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a4c16556b9] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a4c181380c] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a4c17532ca] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a4c1723753] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a4c1724a1b] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a4c1708752] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a4c1656a56] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a4c165a637] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a4c165af5e] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a4c163e03a] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2eed79b407] 2024-07-26T13:36:17.956 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 18: (DispatchQueue::entry()+0x60f) [0x7f2eed79bcf9] 2024-07-26T13:36:17.957 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2eed8785a1] 2024-07-26T13:36:17.957 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:17.957 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: *** Caught signal (Aborted) ** 2024-07-26T13:36:17.957 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: in thread 7f2f09200640 thread_name:ms_dispatch 2024-07-26T13:36:17.957 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.957 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f0f63e6f0] 2024-07-26T13:36:17.958 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f0f68b94c] 2024-07-26T13:36:17.958 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 3: raise() 2024-07-26T13:36:17.958 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 4: abort() 2024-07-26T13:36:17.958 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f0f62871b] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f0f637386] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b38af456b9] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b38b10380c] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b38b0432ca] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b38b013753] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b38b014a1b] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b38aff8752] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b38af46a56] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b38af4a637] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b38af4af5e] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b38af2e03a] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f1019b407] 2024-07-26T13:36:17.959 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f1019bcf9] 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f102785a1] 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 20: (Thread::entry_wrapper()+0x43) [0x7f2eed625cdd] 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2eed625cf9] 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2eecc89c02] 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2eecd0ec40] 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 0> 2024-07-26T13:36:17.615+0000 7f2ee6a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: in thread 7f2ee6a00640 thread_name:ms_dispatch 2024-07-26T13:36:17.960 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2eecc3e6f0] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2eecc8b94c] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 3: raise() 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 4: abort() 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2eecc2871b] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 6: /lib64/libc.so.6(+0x37386) [0x7f2eecc37386] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a4c16556b9] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a4c181380c] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a4c17532ca] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a4c1723753] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a4c1724a1b] 2024-07-26T13:36:17.961 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a4c1708752] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a4c1656a56] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a4c165a637] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a4c165af5e] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a4c163e03a] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2eed79b407] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f10025cdd] 2024-07-26T13:36:17.962 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f10025cf9] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f0f689c02] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f0f70ec40] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.621+0000 7f2f09200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: in thread 7f2f09200640 thread_name:ms_dispatch 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f0f63e6f0] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f0f68b94c] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 3: raise() 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 4: abort() 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f0f62871b] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f0f637386] 2024-07-26T13:36:17.963 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b38af456b9] 2024-07-26T13:36:17.964 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b38b10380c] 2024-07-26T13:36:17.964 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b38b0432ca] 2024-07-26T13:36:17.964 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b38b013753] 2024-07-26T13:36:17.964 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b38b014a1b] 2024-07-26T13:36:17.964 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b38aff8752] 2024-07-26T13:36:17.964 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b38af46a56] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b38af4a637] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b38af4af5e] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b38af2e03a] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f1019b407] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f1019bcf9] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f102785a1] 2024-07-26T13:36:17.965 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 18: (DispatchQueue::entry()+0x60f) [0x7f2eed79bcf9] 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2eed8785a1] 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 20: (Thread::entry_wrapper()+0x43) [0x7f2eed625cdd] 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2eed625cf9] 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2eecc89c02] 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2eecd0ec40] 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 0> 2024-07-26T13:36:17.615+0000 7f2ee6a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: in thread 7f2ee6a00640 thread_name:ms_dispatch 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.966 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2eecc3e6f0] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2eecc8b94c] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 3: raise() 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 4: abort() 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2eecc2871b] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 6: /lib64/libc.so.6(+0x37386) [0x7f2eecc37386] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55a4c16556b9] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55a4c181380c] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55a4c17532ca] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55a4c1723753] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55a4c1724a1b] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55a4c1708752] 2024-07-26T13:36:17.967 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55a4c1656a56] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55a4c165a637] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55a4c165af5e] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55a4c163e03a] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2eed79b407] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 18: (DispatchQueue::entry()+0x60f) [0x7f2eed79bcf9] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2eed8785a1] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 20: (Thread::entry_wrapper()+0x43) [0x7f2eed625cdd] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2eed625cf9] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2eecc89c02] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2eecd0ec40] 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b[88264]: 2024-07-26T13:36:17.968 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:17 smithi076 podman[88506]: 2024-07-26 13:36:17.946672873 +0000 UTC m=+0.228380425 container died 5e6a767702464b646a652b45343770c7c994d05f569dce21463d403b91d342db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f10025cdd] 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f10025cf9] 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f0f689c02] 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f0f70ec40] 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 0> 2024-07-26T13:36:17.621+0000 7f2f09200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: in thread 7f2f09200640 thread_name:ms_dispatch 2024-07-26T13:36:17.970 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f0f63e6f0] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f0f68b94c] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 3: raise() 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 4: abort() 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f0f62871b] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f0f637386] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b38af456b9] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b38b10380c] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b38b0432ca] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b38b013753] 2024-07-26T13:36:17.971 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b38b014a1b] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b38aff8752] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b38af46a56] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b38af4a637] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b38af4af5e] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b38af2e03a] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f1019b407] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f1019bcf9] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f102785a1] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f10025cdd] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f10025cf9] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f0f689c02] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f0f70ec40] 2024-07-26T13:36:17.972 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 0> 2024-07-26T13:36:17.621+0000 7f2f09200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: in thread 7f2f09200640 thread_name:ms_dispatch 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2f0f63e6f0] 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f2f0f68b94c] 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 3: raise() 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 4: abort() 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 5: /lib64/libc.so.6(+0x2871b) [0x7f2f0f62871b] 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 6: /lib64/libc.so.6(+0x37386) [0x7f2f0f637386] 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b38af456b9] 2024-07-26T13:36:17.973 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b38b10380c] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b38b0432ca] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b38b013753] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b38b014a1b] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b38aff8752] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b38af46a56] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b38af4a637] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b38af4af5e] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b38af2e03a] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f2f1019b407] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 18: (DispatchQueue::entry()+0x60f) [0x7f2f1019bcf9] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f2f102785a1] 2024-07-26T13:36:17.974 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 20: (Thread::entry_wrapper()+0x43) [0x7f2f10025cdd] 2024-07-26T13:36:17.975 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 21: (Thread::_entry_func(void*)+0xd) [0x7f2f10025cf9] 2024-07-26T13:36:17.975 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 22: /lib64/libc.so.6(+0x89c02) [0x7f2f0f689c02] 2024-07-26T13:36:17.975 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f2f0f70ec40] 2024-07-26T13:36:17.975 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:17.975 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k[88291]: 2024-07-26T13:36:17.975 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:17 smithi076 podman[88500]: 2024-07-26 13:36:17.741650444 +0000 UTC m=+0.037476871 container died 169b5d2ac5734729a0066054cc92628cc0abab027d8838437d6762733e10a20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-07-26T13:36:18.054 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:18.054 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: *** Caught signal (Aborted) ** 2024-07-26T13:36:18.054 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: in thread 7f48b4c00640 thread_name:ms_dispatch 2024-07-26T13:36:18.054 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.054 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bae3e6f0] 2024-07-26T13:36:18.054 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bae8b94c] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 3: raise() 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 4: abort() 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bae2871b] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bae37386] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562e184816b9] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562e1863f80c] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562e1857f2ca] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562e1854f753] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562e18550a1b] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562e18534752] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562e18482a56] 2024-07-26T13:36:18.055 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562e18486637] 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562e18486f5e] 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562e1846a03a] 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bb99b407] 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bb99bcf9] 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48bba785a1] 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00299995 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:rejoin 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:rejoin 2024-07-26T13:36:18.056 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:rejoin 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:rejoin 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] up:active 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 6 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-mon[35807]: daemon mds.k is now active in filesystem cephfs as rank 0 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:18.057 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: *** Caught signal (Aborted) ** 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: in thread 7ff877400640 thread_name:ms_dispatch 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff87d63e6f0] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff87d68b94c] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 3: raise() 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 4: abort() 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff87d62871b] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 6: /lib64/libc.so.6(+0x37386) [0x7ff87d637386] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f6791d96b9] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f67939780c] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f6792d72ca] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f6792a7753] 2024-07-26T13:36:18.058 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f6792a8a1b] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f67928c752] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f6791daa56] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f6791de637] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f6791def5e] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f6791c203a] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff87e19b407] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 18: (DispatchQueue::entry()+0x60f) [0x7ff87e19bcf9] 2024-07-26T13:36:18.059 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff87e2785a1] 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bb825cdd] 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bb825cf9] 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bae89c02] 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48baf0ec40] 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:17.611+0000 7f48b4c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: in thread 7f48b4c00640 thread_name:ms_dispatch 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:18.063 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bae3e6f0] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bae8b94c] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 3: raise() 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 4: abort() 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bae2871b] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bae37386] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562e184816b9] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562e1863f80c] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562e1857f2ca] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562e1854f753] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562e18550a1b] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562e18534752] 2024-07-26T13:36:18.064 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562e18482a56] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562e18486637] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562e18486f5e] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562e1846a03a] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bb99b407] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bb99bcf9] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48bba785a1] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bb825cdd] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bb825cf9] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bae89c02] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48baf0ec40] 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:18.065 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 0> 2024-07-26T13:36:17.611+0000 7f48b4c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: in thread 7f48b4c00640 thread_name:ms_dispatch 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bae3e6f0] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bae8b94c] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 3: raise() 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 4: abort() 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bae2871b] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bae37386] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562e184816b9] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562e1863f80c] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562e1857f2ca] 2024-07-26T13:36:18.066 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562e1854f753] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562e18550a1b] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562e18534752] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562e18482a56] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562e18486637] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562e18486f5e] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562e1846a03a] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bb99b407] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bb99bcf9] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48bba785a1] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bb825cdd] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bb825cf9] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bae89c02] 2024-07-26T13:36:18.067 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48baf0ec40] 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 0> 2024-07-26T13:36:17.611+0000 7f48b4c00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: in thread 7f48b4c00640 thread_name:ms_dispatch 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f48bae3e6f0] 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f48bae8b94c] 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 3: raise() 2024-07-26T13:36:18.068 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 4: abort() 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 5: /lib64/libc.so.6(+0x2871b) [0x7f48bae2871b] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 6: /lib64/libc.so.6(+0x37386) [0x7f48bae37386] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x562e184816b9] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x562e1863f80c] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x562e1857f2ca] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x562e1854f753] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x562e18550a1b] 2024-07-26T13:36:18.069 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x562e18534752] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x562e18482a56] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x562e18486637] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x562e18486f5e] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 20: (Thread::entry_wrapper()+0x43) [0x7ff87e025cdd] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff87e025cf9] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff87d689c02] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff87d70ec40] 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:17.611+0000 7ff877400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:18.070 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: in thread 7ff877400640 thread_name:ms_dispatch 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff87d63e6f0] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff87d68b94c] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 3: raise() 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 4: abort() 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff87d62871b] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 6: /lib64/libc.so.6(+0x37386) [0x7ff87d637386] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f6791d96b9] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f67939780c] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f6792d72ca] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f6792a7753] 2024-07-26T13:36:18.071 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f6792a8a1b] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f67928c752] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f6791daa56] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f6791de637] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f6791def5e] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f6791c203a] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff87e19b407] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 18: (DispatchQueue::entry()+0x60f) [0x7ff87e19bcf9] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff87e2785a1] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x562e1846a03a] 2024-07-26T13:36:18.072 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f48bb99b407] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 18: (DispatchQueue::entry()+0x60f) [0x7f48bb99bcf9] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f48bba785a1] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 20: (Thread::entry_wrapper()+0x43) [0x7f48bb825cdd] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 21: (Thread::_entry_func(void*)+0xd) [0x7f48bb825cf9] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 22: /lib64/libc.so.6(+0x89c02) [0x7f48bae89c02] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f48baf0ec40] 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c[89972]: 2024-07-26T13:36:18.073 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:17 smithi146 podman[90195]: 2024-07-26 13:36:17.722789504 +0000 UTC m=+0.032043926 container died aba3d6f66d6448d0a2075f7b163955f31c7d070216ed8c86158c2bb3f181a308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True) 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 20: (Thread::entry_wrapper()+0x43) [0x7ff87e025cdd] 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff87e025cf9] 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff87d689c02] 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff87d70ec40] 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 0> 2024-07-26T13:36:17.611+0000 7ff877400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: in thread 7ff877400640 thread_name:ms_dispatch 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.074 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff87d63e6f0] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff87d68b94c] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 3: raise() 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 4: abort() 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff87d62871b] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 6: /lib64/libc.so.6(+0x37386) [0x7ff87d637386] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f6791d96b9] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f67939780c] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f6792d72ca] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f6792a7753] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f6792a8a1b] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f67928c752] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f6791daa56] 2024-07-26T13:36:18.075 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f6791de637] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f6791def5e] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f6791c203a] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff87e19b407] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 18: (DispatchQueue::entry()+0x60f) [0x7ff87e19bcf9] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff87e2785a1] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 20: (Thread::entry_wrapper()+0x43) [0x7ff87e025cdd] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff87e025cf9] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff87d689c02] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff87d70ec40] 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 0> 2024-07-26T13:36:17.611+0000 7ff877400640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:18.076 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: in thread 7ff877400640 thread_name:ms_dispatch 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff87d63e6f0] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2: /lib64/libc.so.6(+0x8b94c) [0x7ff87d68b94c] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 3: raise() 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 4: abort() 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 5: /lib64/libc.so.6(+0x2871b) [0x7ff87d62871b] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 6: /lib64/libc.so.6(+0x37386) [0x7ff87d637386] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55f6791d96b9] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55f67939780c] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55f6792d72ca] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55f6792a7753] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55f6792a8a1b] 2024-07-26T13:36:18.077 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55f67928c752] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55f6791daa56] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55f6791de637] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55f6791def5e] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55f6791c203a] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7ff87e19b407] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 18: (DispatchQueue::entry()+0x60f) [0x7ff87e19bcf9] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7ff87e2785a1] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 20: (Thread::entry_wrapper()+0x43) [0x7ff87e025cdd] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 21: (Thread::_entry_func(void*)+0xd) [0x7ff87e025cf9] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 22: /lib64/libc.so.6(+0x89c02) [0x7ff87d689c02] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 23: /lib64/libc.so.6(+0x10ec40) [0x7ff87d70ec40] 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:18.078 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:17 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i[89978]: 2024-07-26T13:36:18.320 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:18 smithi146 podman[90202]: 2024-07-26 13:36:18.062372506 +0000 UTC m=+0.350530882 container died 624f8f7a4b9634184f5fba6dc4c71475772cd50de517ec97ffff325c143d0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.build-date=20240724, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-07-26T13:36:18.734 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:active 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:active 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:active 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:active 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:18.735 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:18 smithi146 ceph-mon[35807]: pgmap v2762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 648 B/s wr, 14 op/s 2024-07-26T13:36:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:active 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:active 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:active 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:active 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:18.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:18 smithi076 ceph-mon[35401]: pgmap v2762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 648 B/s wr, 14 op/s 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6836/3809538576,v1:172.21.15.146:6837/3809538576] up:active 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6832/975335928,v1:172.21.15.76:6833/975335928] up:active 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6838/1974353927,v1:172.21.15.146:6839/1974353927] up:active 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6838/3814759196,v1:172.21.15.76:6839/3814759196] up:active 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 6 up:standby 5 up:active 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:18 smithi040 ceph-mon[32397]: pgmap v2762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 648 B/s wr, 14 op/s 2024-07-26T13:36:19.070 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:18 smithi146 podman[90195]: 2024-07-26 13:36:18.732908493 +0000 UTC m=+1.042162896 container remove aba3d6f66d6448d0a2075f7b163955f31c7d070216ed8c86158c2bb3f181a308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240724) 2024-07-26T13:36:19.071 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:18 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:19.160 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:19 smithi076 podman[88500]: 2024-07-26 13:36:19.02507047 +0000 UTC m=+1.320896922 container remove 169b5d2ac5734729a0066054cc92628cc0abab027d8838437d6762733e10a20b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, ceph=True, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:36:19.161 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:19.407 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:19 smithi146 podman[90202]: 2024-07-26 13:36:19.076478487 +0000 UTC m=+1.364636884 container remove 624f8f7a4b9634184f5fba6dc4c71475772cd50de517ec97ffff325c143d0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-i, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-07-26T13:36:19.407 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:19.527 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:19 smithi076 podman[88506]: 2024-07-26 13:36:19.158879309 +0000 UTC m=+1.440586865 container remove 5e6a767702464b646a652b45343770c7c994d05f569dce21463d403b91d342db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-07-26T13:36:19.528 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:19.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:36:19.820 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.557s CPU time. 2024-07-26T13:36:19.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:36:19.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:19 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.518s CPU time. 2024-07-26T13:36:19.832 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:36:19.833 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.616s CPU time. 2024-07-26T13:36:19.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:36:19.833 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:19 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.306s CPU time. 2024-07-26T13:36:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:21 smithi146 ceph-mon[35807]: pgmap v2763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1023 B/s wr, 17 op/s 2024-07-26T13:36:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 187.969445 secs 2024-07-26T13:36:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:21 smithi076 ceph-mon[35401]: pgmap v2763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1023 B/s wr, 17 op/s 2024-07-26T13:36:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 187.969445 secs 2024-07-26T13:36:21.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:21 smithi040 ceph-mon[32397]: pgmap v2763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1023 B/s wr, 17 op/s 2024-07-26T13:36:21.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 187.969445 secs 2024-07-26T13:36:23.196 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-07-26T13:36:23.197 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't parse response with error Expecting value: line 1 column 1 (char 0); rc: 124 (EMEDIUMTYPE); stdout: 2024-07-26T13:36:23.197 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/quiescer.py", line 294, in do_quiesce response = json.loads(stdout) File "/usr/lib/python3.10/json/__init__.py", line 346, in loads return _default_decoder.decode(s) File "/usr/lib/python3.10/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/quiescer.py", line 357, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/quiescer.py", line 298, in do_quiesce raise RuntimeError(f"Error parsing quiesce response: {e}") RuntimeError: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-07-26T13:36:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:23 smithi146 ceph-mon[35807]: pgmap v2764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 870 B/s wr, 13 op/s 2024-07-26T13:36:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:23 smithi076 ceph-mon[35401]: pgmap v2764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 870 B/s wr, 13 op/s 2024-07-26T13:36:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:23 smithi040 ceph-mon[32397]: pgmap v2764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 870 B/s wr, 13 op/s 2024-07-26T13:36:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:25 smithi146 ceph-mon[35807]: pgmap v2765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 725 B/s wr, 13 op/s 2024-07-26T13:36:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:25 smithi076 ceph-mon[35401]: pgmap v2765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 725 B/s wr, 13 op/s 2024-07-26T13:36:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:25 smithi040 ceph-mon[32397]: pgmap v2765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 725 B/s wr, 13 op/s 2024-07-26T13:36:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 192.969588 secs 2024-07-26T13:36:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 192.969588 secs 2024-07-26T13:36:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 192.969588 secs 2024-07-26T13:36:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:27 smithi076 ceph-mon[35401]: pgmap v2766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:36:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:27 smithi040 ceph-mon[32397]: pgmap v2766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:36:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:27 smithi146 ceph-mon[35807]: pgmap v2766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:36:29.586 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:29.586 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:29.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:29 smithi076 ceph-mon[35401]: pgmap v2767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:36:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:29 smithi040 ceph-mon[32397]: pgmap v2767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:36:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:29 smithi146 ceph-mon[35807]: pgmap v2767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 682 B/s wr, 13 op/s 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: Stopped Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Consumed 1.518s CPU time. 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Start request repeated too quickly. 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.c.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: Failed to start Ceph mds.c for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:29.821 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:29.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: Stopped Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:29.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Consumed 1.557s CPU time. 2024-07-26T13:36:29.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Start request repeated too quickly. 2024-07-26T13:36:29.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-07-26T13:36:29.822 INFO:journalctl@ceph.mds.i.smithi146.stdout:Jul 26 13:36:29 smithi146 systemd[1]: Failed to start Ceph mds.i for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:30.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: Stopped Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:30.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Consumed 1.616s CPU time. 2024-07-26T13:36:30.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Start request repeated too quickly. 2024-07-26T13:36:30.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.b.service: Failed with result 'exit-code'. 2024-07-26T13:36:30.083 INFO:journalctl@ceph.mds.b.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: Failed to start Ceph mds.b for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:30.084 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: Stopped Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:30.084 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Consumed 2.306s CPU time. 2024-07-26T13:36:30.084 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Start request repeated too quickly. 2024-07-26T13:36:30.084 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-07-26T13:36:30.084 INFO:journalctl@ceph.mds.k.smithi076.stdout:Jul 26 13:36:29 smithi076 systemd[1]: Failed to start Ceph mds.k for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:31 smithi040 ceph-mon[32397]: pgmap v2768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 341 B/s wr, 13 op/s 2024-07-26T13:36:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 197.969736 secs 2024-07-26T13:36:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:31 smithi146 ceph-mon[35807]: pgmap v2768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 341 B/s wr, 13 op/s 2024-07-26T13:36:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 197.969736 secs 2024-07-26T13:36:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:31 smithi076 ceph-mon[35401]: pgmap v2768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 341 B/s wr, 13 op/s 2024-07-26T13:36:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 197.969736 secs 2024-07-26T13:36:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:33 smithi040 ceph-mon[32397]: pgmap v2769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 9 op/s 2024-07-26T13:36:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:33 smithi146 ceph-mon[35807]: pgmap v2769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 9 op/s 2024-07-26T13:36:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:33 smithi076 ceph-mon[35401]: pgmap v2769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 9 op/s 2024-07-26T13:36:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: pgmap v2770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 11 op/s 2024-07-26T13:36:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: Replacing daemon mds.c as rank 4 with standby daemon mds.g 2024-07-26T13:36:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: Replacing daemon mds.b as rank 3 with standby daemon mds.a 2024-07-26T13:36:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: Replacing daemon mds.i as rank 2 with standby daemon mds.f 2024-07-26T13:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: Replacing daemon mds.k as rank 0 with standby daemon mds.e 2024-07-26T13:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: osdmap e122: 12 total, 12 up, 12 in 2024-07-26T13:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:35 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:replay 1 up:active 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: pgmap v2770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 11 op/s 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: Replacing daemon mds.c as rank 4 with standby daemon mds.g 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: Replacing daemon mds.b as rank 3 with standby daemon mds.a 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: Replacing daemon mds.i as rank 2 with standby daemon mds.f 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: Replacing daemon mds.k as rank 0 with standby daemon mds.e 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:35.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: osdmap e122: 12 total, 12 up, 12 in 2024-07-26T13:36:35.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:35 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:replay 1 up:active 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: pgmap v2770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 11 op/s 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: Replacing daemon mds.c as rank 4 with standby daemon mds.g 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: Replacing daemon mds.b as rank 3 with standby daemon mds.a 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: MDS daemon mds.b is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: Replacing daemon mds.i as rank 2 with standby daemon mds.f 2024-07-26T13:36:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: Replacing daemon mds.k as rank 0 with standby daemon mds.e 2024-07-26T13:36:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: osdmap e122: 12 total, 12 up, 12 in 2024-07-26T13:36:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:35 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:replay 1 up:active 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 202.969915 secs 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:resolve 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:resolve 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:resolve 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:resolve 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:resolve 1 up:active 2024-07-26T13:36:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:36 smithi040 ceph-mon[32397]: pgmap v2772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:36:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 202.969915 secs 2024-07-26T13:36:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:resolve 2024-07-26T13:36:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:resolve 2024-07-26T13:36:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:resolve 2024-07-26T13:36:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:resolve 2024-07-26T13:36:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:resolve 1 up:active 2024-07-26T13:36:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:36 smithi146 ceph-mon[35807]: pgmap v2772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 202.969915 secs 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:resolve 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:resolve 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:resolve 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:resolve 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:resolve 1 up:active 2024-07-26T13:36:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:36 smithi076 ceph-mon[35401]: pgmap v2772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499985 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00599993 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499992 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:reconnect 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:reconnect 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:reconnect 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:reconnect 2024-07-26T13:36:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:37 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499985 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00599993 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499992 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:reconnect 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:reconnect 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:reconnect 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:reconnect 2024-07-26T13:36:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:37 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499994 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499985 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00599993 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: reconnect by client.15327 192.168.0.1:0/242569578 after 0.00499992 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:reconnect 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:reconnect 2024-07-26T13:36:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:reconnect 2024-07-26T13:36:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:reconnect 2024-07-26T13:36:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:37 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:reconnect 1 up:active 2024-07-26T13:36:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:rejoin 2024-07-26T13:36:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:rejoin 2024-07-26T13:36:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:rejoin 2024-07-26T13:36:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:rejoin 2024-07-26T13:36:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: pgmap v2773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:36:38.984 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: *** Caught signal (Aborted) ** 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: in thread 7f46ad600640 thread_name:ms_dispatch 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46b383e6f0] 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f46b388b94c] 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 3: raise() 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 4: abort() 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 5: /lib64/libc.so.6(+0x2871b) [0x7f46b382871b] 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 6: /lib64/libc.so.6(+0x37386) [0x7f46b3837386] 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e94121e6b9] 2024-07-26T13:36:38.985 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9413dc80c] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e94131c2ca] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9412ec753] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9412eda1b] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9412d1752] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e94121fa56] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e941223637] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e941223f5e] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e94120703a] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f46b439b407] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 18: (DispatchQueue::entry()+0x60f) [0x7f46b439bcf9] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f46b44785a1] 2024-07-26T13:36:38.986 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 20: (Thread::entry_wrapper()+0x43) [0x7f46b4225cdd] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 21: (Thread::_entry_func(void*)+0xd) [0x7f46b4225cf9] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 22: /lib64/libc.so.6(+0x89c02) [0x7f46b3889c02] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f46b390ec40] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.627+0000 7f46ad600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: in thread 7f46ad600640 thread_name:ms_dispatch 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46b383e6f0] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f46b388b94c] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 3: raise() 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 4: abort() 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 5: /lib64/libc.so.6(+0x2871b) [0x7f46b382871b] 2024-07-26T13:36:38.987 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 6: /lib64/libc.so.6(+0x37386) [0x7f46b3837386] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e94121e6b9] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9413dc80c] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e94131c2ca] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9412ec753] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9412eda1b] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9412d1752] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e94121fa56] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e941223637] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e941223f5e] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e94120703a] 2024-07-26T13:36:38.988 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f46b439b407] 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 18: (DispatchQueue::entry()+0x60f) [0x7f46b439bcf9] 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f46b44785a1] 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: *** Caught signal (Aborted) ** 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: in thread 7f7428200640 thread_name:ms_dispatch 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f742e43e6f0] 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f742e48b94c] 2024-07-26T13:36:38.989 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 3: raise() 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 4: abort() 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 5: /lib64/libc.so.6(+0x2871b) [0x7f742e42871b] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 6: /lib64/libc.so.6(+0x37386) [0x7f742e437386] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5581762856b9] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55817644380c] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5581763832ca] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558176353753] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558176354a1b] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558176338752] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558176286a56] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55817628a637] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55817628af5e] 2024-07-26T13:36:38.990 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55817626e03a] 2024-07-26T13:36:38.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f742ef9b407] 2024-07-26T13:36:38.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 18: (DispatchQueue::entry()+0x60f) [0x7f742ef9bcf9] 2024-07-26T13:36:38.991 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f742f0785a1] 2024-07-26T13:36:38.991 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 20: (Thread::entry_wrapper()+0x43) [0x7f46b4225cdd] 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 21: (Thread::_entry_func(void*)+0xd) [0x7f46b4225cf9] 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 22: /lib64/libc.so.6(+0x89c02) [0x7f46b3889c02] 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f46b390ec40] 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 0> 2024-07-26T13:36:38.627+0000 7f46ad600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: in thread 7f46ad600640 thread_name:ms_dispatch 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46b383e6f0] 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f46b388b94c] 2024-07-26T13:36:38.992 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 3: raise() 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 4: abort() 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 5: /lib64/libc.so.6(+0x2871b) [0x7f46b382871b] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 6: /lib64/libc.so.6(+0x37386) [0x7f46b3837386] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e94121e6b9] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9413dc80c] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e94131c2ca] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9412ec753] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9412eda1b] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9412d1752] 2024-07-26T13:36:38.993 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e94121fa56] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e941223637] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e941223f5e] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e94120703a] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 20: (Thread::entry_wrapper()+0x43) [0x7f742ee25cdd] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 21: (Thread::_entry_func(void*)+0xd) [0x7f742ee25cf9] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 22: /lib64/libc.so.6(+0x89c02) [0x7f742e489c02] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f742e50ec40] 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:38.630+0000 7f7428200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: in thread 7f7428200640 thread_name:ms_dispatch 2024-07-26T13:36:38.994 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f742e43e6f0] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f742e48b94c] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 3: raise() 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 4: abort() 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 5: /lib64/libc.so.6(+0x2871b) [0x7f742e42871b] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 6: /lib64/libc.so.6(+0x37386) [0x7f742e437386] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5581762856b9] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55817644380c] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5581763832ca] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558176353753] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558176354a1b] 2024-07-26T13:36:38.995 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558176338752] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558176286a56] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55817628a637] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55817628af5e] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55817626e03a] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f742ef9b407] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 18: (DispatchQueue::entry()+0x60f) [0x7f742ef9bcf9] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f742f0785a1] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f46b439b407] 2024-07-26T13:36:38.996 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 18: (DispatchQueue::entry()+0x60f) [0x7f46b439bcf9] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f46b44785a1] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 20: (Thread::entry_wrapper()+0x43) [0x7f46b4225cdd] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 21: (Thread::_entry_func(void*)+0xd) [0x7f46b4225cf9] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 22: /lib64/libc.so.6(+0x89c02) [0x7f46b3889c02] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f46b390ec40] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 0> 2024-07-26T13:36:38.627+0000 7f46ad600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: in thread 7f46ad600640 thread_name:ms_dispatch 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46b383e6f0] 2024-07-26T13:36:38.997 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f46b388b94c] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 3: raise() 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 4: abort() 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 5: /lib64/libc.so.6(+0x2871b) [0x7f46b382871b] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 6: /lib64/libc.so.6(+0x37386) [0x7f46b3837386] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55e94121e6b9] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55e9413dc80c] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55e94131c2ca] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55e9412ec753] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55e9412eda1b] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55e9412d1752] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55e94121fa56] 2024-07-26T13:36:38.998 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55e941223637] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55e941223f5e] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55e94120703a] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f46b439b407] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 18: (DispatchQueue::entry()+0x60f) [0x7f46b439bcf9] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f46b44785a1] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 20: (Thread::entry_wrapper()+0x43) [0x7f46b4225cdd] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 21: (Thread::_entry_func(void*)+0xd) [0x7f46b4225cf9] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 22: /lib64/libc.so.6(+0x89c02) [0x7f46b3889c02] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f46b390ec40] 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a[188572]: 2024-07-26T13:36:38.999 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:38 smithi040 podman[188726]: 2024-07-26 13:36:38.780473911 +0000 UTC m=+0.044404445 container died f314930c0d837e062d49dd5e229fb65742360221c34a13883dc40e8afbc337dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724) 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 20: (Thread::entry_wrapper()+0x43) [0x7f742ee25cdd] 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 21: (Thread::_entry_func(void*)+0xd) [0x7f742ee25cf9] 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 22: /lib64/libc.so.6(+0x89c02) [0x7f742e489c02] 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f742e50ec40] 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 0> 2024-07-26T13:36:38.630+0000 7f7428200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: in thread 7f7428200640 thread_name:ms_dispatch 2024-07-26T13:36:39.000 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f742e43e6f0] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f742e48b94c] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 3: raise() 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 4: abort() 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 5: /lib64/libc.so.6(+0x2871b) [0x7f742e42871b] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 6: /lib64/libc.so.6(+0x37386) [0x7f742e437386] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5581762856b9] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55817644380c] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5581763832ca] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558176353753] 2024-07-26T13:36:39.001 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558176354a1b] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558176338752] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558176286a56] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55817628a637] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55817628af5e] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55817626e03a] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f742ef9b407] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 18: (DispatchQueue::entry()+0x60f) [0x7f742ef9bcf9] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f742f0785a1] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 20: (Thread::entry_wrapper()+0x43) [0x7f742ee25cdd] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 21: (Thread::_entry_func(void*)+0xd) [0x7f742ee25cf9] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 22: /lib64/libc.so.6(+0x89c02) [0x7f742e489c02] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f742e50ec40] 2024-07-26T13:36:39.002 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 0> 2024-07-26T13:36:38.630+0000 7f7428200640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: in thread 7f7428200640 thread_name:ms_dispatch 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f742e43e6f0] 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f742e48b94c] 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 3: raise() 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 4: abort() 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 5: /lib64/libc.so.6(+0x2871b) [0x7f742e42871b] 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 6: /lib64/libc.so.6(+0x37386) [0x7f742e437386] 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x5581762856b9] 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55817644380c] 2024-07-26T13:36:39.003 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x5581763832ca] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x558176353753] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x558176354a1b] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x558176338752] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x558176286a56] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55817628a637] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55817628af5e] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55817626e03a] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f742ef9b407] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 18: (DispatchQueue::entry()+0x60f) [0x7f742ef9bcf9] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f742f0785a1] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 20: (Thread::entry_wrapper()+0x43) [0x7f742ee25cdd] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 21: (Thread::_entry_func(void*)+0xd) [0x7f742ee25cf9] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 22: /lib64/libc.so.6(+0x89c02) [0x7f742e489c02] 2024-07-26T13:36:39.004 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f742e50ec40] 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:38 smithi040 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g[188567]: 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: *** Caught signal (Aborted) ** 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: in thread 7f6957a00640 thread_name:ms_dispatch 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f695dc3e6f0] 2024-07-26T13:36:39.005 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f695dc8b94c] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 3: raise() 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 4: abort() 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 5: /lib64/libc.so.6(+0x2871b) [0x7f695dc2871b] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 6: /lib64/libc.so.6(+0x37386) [0x7f695dc37386] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f60e5e6b9] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f6101c80c] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f60f5c2ca] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f60f2c753] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f60f2da1b] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f60f11752] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f60e5fa56] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f60e63637] 2024-07-26T13:36:39.006 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f60e63f5e] 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f60e4703a] 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f695e79b407] 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 18: (DispatchQueue::entry()+0x60f) [0x7f695e79bcf9] 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f695e8785a1] 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:rejoin 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:rejoin 2024-07-26T13:36:39.007 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:rejoin 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:rejoin 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: pgmap v2773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T13:36:39.008 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 20: (Thread::entry_wrapper()+0x43) [0x7f695e625cdd] 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 21: (Thread::_entry_func(void*)+0xd) [0x7f695e625cf9] 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 22: /lib64/libc.so.6(+0x89c02) [0x7f695dc89c02] 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f695dd0ec40] 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:38.637+0000 7f6957a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: in thread 7f6957a00640 thread_name:ms_dispatch 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.009 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f695dc3e6f0] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f695dc8b94c] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 3: raise() 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 4: abort() 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 5: /lib64/libc.so.6(+0x2871b) [0x7f695dc2871b] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 6: /lib64/libc.so.6(+0x37386) [0x7f695dc37386] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f60e5e6b9] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f6101c80c] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f60f5c2ca] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f60f2c753] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f60f2da1b] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f60f11752] 2024-07-26T13:36:39.010 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f60e5fa56] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f60e63637] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f60e63f5e] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f60e4703a] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f695e79b407] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 18: (DispatchQueue::entry()+0x60f) [0x7f695e79bcf9] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f695e8785a1] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 20: (Thread::entry_wrapper()+0x43) [0x7f695e625cdd] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 21: (Thread::_entry_func(void*)+0xd) [0x7f695e625cf9] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 22: /lib64/libc.so.6(+0x89c02) [0x7f695dc89c02] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f695dd0ec40] 2024-07-26T13:36:39.011 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 0> 2024-07-26T13:36:38.637+0000 7f6957a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: in thread 7f6957a00640 thread_name:ms_dispatch 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f695dc3e6f0] 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f695dc8b94c] 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 3: raise() 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 4: abort() 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 5: /lib64/libc.so.6(+0x2871b) [0x7f695dc2871b] 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 6: /lib64/libc.so.6(+0x37386) [0x7f695dc37386] 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f60e5e6b9] 2024-07-26T13:36:39.012 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f6101c80c] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f60f5c2ca] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f60f2c753] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f60f2da1b] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f60f11752] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f60e5fa56] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f60e63637] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f60e63f5e] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f60e4703a] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f695e79b407] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 18: (DispatchQueue::entry()+0x60f) [0x7f695e79bcf9] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f695e8785a1] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 20: (Thread::entry_wrapper()+0x43) [0x7f695e625cdd] 2024-07-26T13:36:39.013 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 21: (Thread::_entry_func(void*)+0xd) [0x7f695e625cf9] 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 22: /lib64/libc.so.6(+0x89c02) [0x7f695dc89c02] 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f695dd0ec40] 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: -1> 2024-07-26T13:36:38.637+0000 7f6957a00640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: in thread 7f6957a00640 thread_name:ms_dispatch 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f695dc3e6f0] 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2: /lib64/libc.so.6(+0x8b94c) [0x7f695dc8b94c] 2024-07-26T13:36:39.014 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 3: raise() 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 4: abort() 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 5: /lib64/libc.so.6(+0x2871b) [0x7f695dc2871b] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 6: /lib64/libc.so.6(+0x37386) [0x7f695dc37386] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x561f60e5e6b9] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x561f6101c80c] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x561f60f5c2ca] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x561f60f2c753] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x561f60f2da1b] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x561f60f11752] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x561f60e5fa56] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x561f60e63637] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x561f60e63f5e] 2024-07-26T13:36:39.015 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x561f60e4703a] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7f695e79b407] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 18: (DispatchQueue::entry()+0x60f) [0x7f695e79bcf9] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7f695e8785a1] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 20: (Thread::entry_wrapper()+0x43) [0x7f695e625cdd] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 21: (Thread::_entry_func(void*)+0xd) [0x7f695e625cf9] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 22: /lib64/libc.so.6(+0x89c02) [0x7f695dc89c02] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 23: /lib64/libc.so.6(+0x10ec40) [0x7f695dd0ec40] 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e[88458]: 2024-07-26T13:36:39.016 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:38 smithi076 podman[88622]: 2024-07-26 13:36:38.76621895 +0000 UTC m=+0.031578543 container died b7faa194987797422fa564b59745bb7664dcfe1f709cd4361001fbfd5bbd2dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:rejoin 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:rejoin 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:rejoin 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:rejoin 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 2 up:standby 4 up:rejoin 1 up:active 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: daemon mds.a is now active in filesystem cephfs as rank 3 2024-07-26T13:36:39.019 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: daemon mds.g is now active in filesystem cephfs as rank 4 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: daemon mds.e is now active in filesystem cephfs as rank 0 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: pgmap v2773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 204 B/s wr, 11 op/s 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: ceph-mds: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-5320-ge8f88bb1/rpm/el9/BUILD/ceph-19.0.0-5320-ge8f88bb1/redhat-linux-build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:201: T* boost::intrusive_ptr::operator->() const [with T = const Message]: Assertion `px != 0' failed. 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: *** Caught signal (Aborted) ** 2024-07-26T13:36:39.020 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: in thread 7fd2b1600640 thread_name:ms_dispatch 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd2b783e6f0] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd2b788b94c] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 3: raise() 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 4: abort() 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd2b782871b] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 6: /lib64/libc.so.6(+0x37386) [0x7fd2b7837386] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9338be6b9] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b933a7c80c] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9339bc2ca] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b93398c753] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b93398da1b] 2024-07-26T13:36:39.021 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b933971752] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9338bfa56] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9338c3637] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9338c3f5e] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9338a703a] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd2b839b407] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 18: (DispatchQueue::entry()+0x60f) [0x7fd2b839bcf9] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2b84785a1] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2b8225cdd] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2b8225cf9] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd2b7889c02] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd2b790ec40] 2024-07-26T13:36:39.022 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:38.627+0000 7fd2b1600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: in thread 7fd2b1600640 thread_name:ms_dispatch 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd2b783e6f0] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd2b788b94c] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 3: raise() 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 4: abort() 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd2b782871b] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 6: /lib64/libc.so.6(+0x37386) [0x7fd2b7837386] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9338be6b9] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b933a7c80c] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9339bc2ca] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b93398c753] 2024-07-26T13:36:39.023 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b93398da1b] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b933971752] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9338bfa56] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9338c3637] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9338c3f5e] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9338a703a] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd2b839b407] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 18: (DispatchQueue::entry()+0x60f) [0x7fd2b839bcf9] 2024-07-26T13:36:39.024 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2b84785a1] 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2b8225cdd] 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2b8225cf9] 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd2b7889c02] 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd2b790ec40] 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 0> 2024-07-26T13:36:38.627+0000 7fd2b1600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: in thread 7fd2b1600640 thread_name:ms_dispatch 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd2b783e6f0] 2024-07-26T13:36:39.025 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd2b788b94c] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 3: raise() 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 4: abort() 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd2b782871b] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 6: /lib64/libc.so.6(+0x37386) [0x7fd2b7837386] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9338be6b9] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b933a7c80c] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9339bc2ca] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b93398c753] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b93398da1b] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b933971752] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9338bfa56] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9338c3637] 2024-07-26T13:36:39.026 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9338c3f5e] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9338a703a] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd2b839b407] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 18: (DispatchQueue::entry()+0x60f) [0x7fd2b839bcf9] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2b84785a1] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2b8225cdd] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2b8225cf9] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd2b7889c02] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd2b790ec40] 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 0> 2024-07-26T13:36:38.627+0000 7fd2b1600640 -1 *** Caught signal (Aborted) ** 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: in thread 7fd2b1600640 thread_name:ms_dispatch 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: ceph version 19.0.0-5320-ge8f88bb1 (e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528) squid (dev) 2024-07-26T13:36:39.027 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd2b783e6f0] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2: /lib64/libc.so.6(+0x8b94c) [0x7fd2b788b94c] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 3: raise() 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 4: abort() 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 5: /lib64/libc.so.6(+0x2871b) [0x7fd2b782871b] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 6: /lib64/libc.so.6(+0x37386) [0x7fd2b7837386] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 7: (MDSRank::get_session(boost::intrusive_ptr const&)+0x89) [0x55b9338be6b9] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 8: (MDCache::path_traverse(boost::intrusive_ptr const&, ContextFactory&, filepath const&, int, std::vector >*, CInode**, CDir**)+0x58e) [0x55b933a7c80c] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 9: (Server::handle_peer_rmdir_prep(boost::intrusive_ptr const&)+0x32a) [0x55b9339bc2ca] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 10: (Server::dispatch_peer_request(boost::intrusive_ptr const&)+0x923) [0x55b93398c753] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 11: (Server::handle_peer_request(boost::intrusive_ptr const&)+0x10c3) [0x55b93398da1b] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 12: (Server::dispatch(boost::intrusive_ptr const&)+0x9ba) [0x55b933971752] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 13: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x81a) [0x55b9338bfa56] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 14: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x28f) [0x55b9338c3637] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 15: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x94) [0x55b9338c3f5e] 2024-07-26T13:36:39.028 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 16: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x3f0) [0x55b9338a703a] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 17: /usr/lib64/ceph/libceph-common.so.2(+0x39b407) [0x7fd2b839b407] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 18: (DispatchQueue::entry()+0x60f) [0x7fd2b839bcf9] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 19: /usr/lib64/ceph/libceph-common.so.2(+0x4785a1) [0x7fd2b84785a1] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 20: (Thread::entry_wrapper()+0x43) [0x7fd2b8225cdd] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 21: (Thread::_entry_func(void*)+0xd) [0x7fd2b8225cf9] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 22: /lib64/libc.so.6(+0x89c02) [0x7fd2b7889c02] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 23: /lib64/libc.so.6(+0x10ec40) [0x7fd2b790ec40] 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f[90154]: 2024-07-26T13:36:39.029 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:38 smithi146 podman[90314]: 2024-07-26 13:36:38.754957599 +0000 UTC m=+0.032509102 container died b4adffd833a0810209f8b48160e41e33889e177738fe627b1d1a32a992cb3aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-07-26T13:36:39.626 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:39 smithi040 podman[188724]: 2024-07-26 13:36:39.317017239 +0000 UTC m=+0.580586480 container died 827e3ad3ff2ccd19123dcde421af96094ac9a8bfb64575287cc454b075f286ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-07-26T13:36:39.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:39 smithi146 podman[90314]: 2024-07-26 13:36:39.437339951 +0000 UTC m=+0.714891492 container remove b4adffd833a0810209f8b48160e41e33889e177738fe627b1d1a32a992cb3aab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-07-26T13:36:39.820 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:39 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:active 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:active 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:active 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:active 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: fsmap cephfs:5 1 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:39 smithi146 ceph-mon[35807]: fsmap cephfs:5 3 up:standby-replay 5 up:active 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:39 smithi076 podman[88622]: 2024-07-26 13:36:39.4123268 +0000 UTC m=+0.677686455 container remove b7faa194987797422fa564b59745bb7664dcfe1f709cd4361001fbfd5bbd2dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, org.label-schema.build-date=20240724, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:39 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:active 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:active 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:active 2024-07-26T13:36:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:active 2024-07-26T13:36:39.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: fsmap cephfs:5 1 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:39.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:39 smithi076 ceph-mon[35401]: fsmap cephfs:5 3 up:standby-replay 5 up:active 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6840/1735855275,v1:172.21.15.40:6841/1735855275] up:active 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6838/2617300752,v1:172.21.15.40:6839/2617300752] up:active 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.146:6834/3675700947,v1:172.21.15.146:6835/3675700947] up:active 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.76:6834/1213846876,v1:172.21.15.76:6835/1213846876] up:active 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: fsmap cephfs:5 1 up:standby-replay 2 up:standby 5 up:active 2024-07-26T13:36:39.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:39 smithi040 ceph-mon[32397]: fsmap cephfs:5 3 up:standby-replay 5 up:active 2024-07-26T13:36:40.232 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:39 smithi040 podman[188726]: 2024-07-26 13:36:39.917200616 +0000 UTC m=+1.181131162 container remove f314930c0d837e062d49dd5e229fb65742360221c34a13883dc40e8afbc337dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724) 2024-07-26T13:36:40.233 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:39 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:40.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:39 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:36:40.320 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:39 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.648s CPU time. 2024-07-26T13:36:40.332 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:39 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:36:40.333 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:39 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.336s CPU time. 2024-07-26T13:36:40.685 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:40 smithi040 podman[188724]: 2024-07-26 13:36:40.395522602 +0000 UTC m=+1.659091823 container remove 827e3ad3ff2ccd19123dcde421af96094ac9a8bfb64575287cc454b075f286ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2, name=ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240725.121331-debug-e8f88bb, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:40 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:40 smithi040 ceph-mon[32397]: pgmap v2774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 614 B/s wr, 12 op/s 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:40 smithi040 ceph-mon[32397]: pgmap v2775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 750 B/s wr, 15 op/s 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:40 smithi040 ceph-mon[32397]: pgmap v2776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 992 B/s wr, 15 op/s 2024-07-26T13:36:40.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:36:40.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:40 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:36:40.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:40 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.666s CPU time. 2024-07-26T13:36:40.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:40 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:36:40.983 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:40 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.652s CPU time. 2024-07-26T13:36:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:40 smithi146 ceph-mon[35807]: pgmap v2774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 614 B/s wr, 12 op/s 2024-07-26T13:36:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:36:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:36:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:40 smithi146 ceph-mon[35807]: pgmap v2775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 750 B/s wr, 15 op/s 2024-07-26T13:36:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:40 smithi146 ceph-mon[35807]: pgmap v2776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 992 B/s wr, 15 op/s 2024-07-26T13:36:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:36:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:40 smithi076 ceph-mon[35401]: pgmap v2774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 614 B/s wr, 12 op/s 2024-07-26T13:36:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:36:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:36:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:40 smithi076 ceph-mon[35401]: pgmap v2775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 750 B/s wr, 15 op/s 2024-07-26T13:36:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:40 smithi076 ceph-mon[35401]: pgmap v2776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 992 B/s wr, 15 op/s 2024-07-26T13:36:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:36:41.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 207.970050 secs 2024-07-26T13:36:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 207.970050 secs 2024-07-26T13:36:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 207.970050 secs 2024-07-26T13:36:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:42 smithi040 ceph-mon[32397]: pgmap v2777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-07-26T13:36:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:42 smithi146 ceph-mon[35807]: pgmap v2777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-07-26T13:36:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:42 smithi076 ceph-mon[35401]: pgmap v2777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-07-26T13:36:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:45 smithi146 ceph-mon[35807]: pgmap v2778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 KiB/s wr, 16 op/s 2024-07-26T13:36:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:45 smithi076 ceph-mon[35401]: pgmap v2778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 KiB/s wr, 16 op/s 2024-07-26T13:36:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:45 smithi040 ceph-mon[32397]: pgmap v2778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 KiB/s wr, 16 op/s 2024-07-26T13:36:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 212.970225 secs 2024-07-26T13:36:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 212.970225 secs 2024-07-26T13:36:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 212.970225 secs 2024-07-26T13:36:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:47 smithi146 ceph-mon[35807]: pgmap v2779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 875 B/s wr, 12 op/s 2024-07-26T13:36:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:47 smithi076 ceph-mon[35401]: pgmap v2779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 875 B/s wr, 12 op/s 2024-07-26T13:36:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:47 smithi040 ceph-mon[32397]: pgmap v2779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 875 B/s wr, 12 op/s 2024-07-26T13:36:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:49 smithi146 ceph-mon[35807]: pgmap v2780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 375 B/s wr, 8 op/s 2024-07-26T13:36:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:49 smithi076 ceph-mon[35401]: pgmap v2780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 375 B/s wr, 8 op/s 2024-07-26T13:36:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:49 smithi040 ceph-mon[32397]: pgmap v2780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 375 B/s wr, 8 op/s 2024-07-26T13:36:50.571 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:50.571 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:50 smithi146 systemd[1]: Stopped Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:50.571 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Consumed 1.648s CPU time. 2024-07-26T13:36:50.571 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Start request repeated too quickly. 2024-07-26T13:36:50.571 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:50 smithi146 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-07-26T13:36:50.571 INFO:journalctl@ceph.mds.f.smithi146.stdout:Jul 26 13:36:50 smithi146 systemd[1]: Failed to start Ceph mds.f for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:50.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:50.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:50 smithi076 systemd[1]: Stopped Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:50.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Consumed 2.336s CPU time. 2024-07-26T13:36:50.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Start request repeated too quickly. 2024-07-26T13:36:50.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:50 smithi076 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-07-26T13:36:50.583 INFO:journalctl@ceph.mds.e.smithi076.stdout:Jul 26 13:36:50 smithi076 systemd[1]: Failed to start Ceph mds.e for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:50 smithi040 ceph-mon[32397]: pgmap v2781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 307 B/s wr, 8 op/s 2024-07-26T13:36:50.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:50.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: Stopped Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:50.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Consumed 1.666s CPU time. 2024-07-26T13:36:50.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Start request repeated too quickly. 2024-07-26T13:36:50.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-07-26T13:36:50.983 INFO:journalctl@ceph.mds.a.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: Failed to start Ceph mds.a for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:50 smithi146 ceph-mon[35807]: pgmap v2781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 307 B/s wr, 8 op/s 2024-07-26T13:36:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:50 smithi076 ceph-mon[35401]: pgmap v2781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 307 B/s wr, 8 op/s 2024-07-26T13:36:51.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 6. 2024-07-26T13:36:51.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: Stopped Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:51.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Consumed 1.652s CPU time. 2024-07-26T13:36:51.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Start request repeated too quickly. 2024-07-26T13:36:51.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: ceph-5cbb9f42-4b47-11ef-bcb7-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-07-26T13:36:51.483 INFO:journalctl@ceph.mds.g.smithi040.stdout:Jul 26 13:36:50 smithi040 systemd[1]: Failed to start Ceph mds.g for 5cbb9f42-4b47-11ef-bcb7-c7b262605968. 2024-07-26T13:36:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 217.970407 secs 2024-07-26T13:36:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 217.970407 secs 2024-07-26T13:36:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 217.970407 secs 2024-07-26T13:36:52.946 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:52 smithi040 ceph-mon[32397]: pgmap v2782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 255 B/s wr, 7 op/s 2024-07-26T13:36:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:52 smithi146 ceph-mon[35807]: pgmap v2782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 255 B/s wr, 7 op/s 2024-07-26T13:36:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:52 smithi076 ceph-mon[35401]: pgmap v2782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 255 B/s wr, 7 op/s 2024-07-26T13:36:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: pgmap v2783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 7 op/s 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: Replacing daemon mds.f as rank 2 with standby daemon mds.j 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: Replacing daemon mds.e as rank 0 with standby daemon mds.d 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: osdmap e123: 12 total, 12 up, 12 in 2024-07-26T13:36:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:55 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 2 up:replay 3 up:active 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: pgmap v2783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 7 op/s 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: Replacing daemon mds.f as rank 2 with standby daemon mds.j 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: Replacing daemon mds.e as rank 0 with standby daemon mds.d 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: osdmap e123: 12 total, 12 up, 12 in 2024-07-26T13:36:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:55 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 2 up:replay 3 up:active 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: pgmap v2783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 7 op/s 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: Replacing daemon mds.f as rank 2 with standby daemon mds.j 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: Replacing daemon mds.e as rank 0 with standby daemon mds.d 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: osdmap e123: 12 total, 12 up, 12 in 2024-07-26T13:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:55 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 2 up:replay 3 up:active 2024-07-26T13:36:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 222.970548 secs 2024-07-26T13:36:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] up:resolve 2024-07-26T13:36:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:56 smithi040 ceph-mon[32397]: mds.? [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] up:resolve 2024-07-26T13:36:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:56 smithi040 ceph-mon[32397]: fsmap cephfs:5/5 1 up:standby-replay 2 up:resolve 3 up:active 2024-07-26T13:36:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:56 smithi040 ceph-mon[32397]: pgmap v2785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T13:36:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 222.970548 secs 2024-07-26T13:36:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] up:resolve 2024-07-26T13:36:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:56 smithi146 ceph-mon[35807]: mds.? [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] up:resolve 2024-07-26T13:36:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:56 smithi146 ceph-mon[35807]: fsmap cephfs:5/5 1 up:standby-replay 2 up:resolve 3 up:active 2024-07-26T13:36:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:56 smithi146 ceph-mon[35807]: pgmap v2785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T13:36:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 222.970548 secs 2024-07-26T13:36:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6834/1198126944,v1:172.21.15.40:6835/1198126944] up:resolve 2024-07-26T13:36:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:56 smithi076 ceph-mon[35401]: mds.? [v2:172.21.15.40:6836/3554375029,v1:172.21.15.40:6837/3554375029] up:resolve 2024-07-26T13:36:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:56 smithi076 ceph-mon[35401]: fsmap cephfs:5/5 1 up:standby-replay 2 up:resolve 3 up:active 2024-07-26T13:36:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:56 smithi076 ceph-mon[35401]: pgmap v2785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-07-26T13:36:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:36:59 smithi146 ceph-mon[35807]: pgmap v2786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-07-26T13:36:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:36:59 smithi076 ceph-mon[35401]: pgmap v2786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-07-26T13:36:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:36:59 smithi040 ceph-mon[32397]: pgmap v2786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-07-26T13:37:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 227.970691 secs 2024-07-26T13:37:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:01 smithi146 ceph-mon[35807]: pgmap v2787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-07-26T13:37:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 227.970691 secs 2024-07-26T13:37:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:01 smithi076 ceph-mon[35401]: pgmap v2787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-07-26T13:37:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 227.970691 secs 2024-07-26T13:37:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:01 smithi040 ceph-mon[32397]: pgmap v2787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-07-26T13:37:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:03 smithi146 ceph-mon[35807]: pgmap v2788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-07-26T13:37:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:03 smithi076 ceph-mon[35401]: pgmap v2788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-07-26T13:37:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:03 smithi040 ceph-mon[32397]: pgmap v2788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-07-26T13:37:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:05 smithi146 ceph-mon[35807]: pgmap v2789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T13:37:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:05 smithi076 ceph-mon[35401]: pgmap v2789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T13:37:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:05 smithi040 ceph-mon[32397]: pgmap v2789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-07-26T13:37:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 232.970840 secs 2024-07-26T13:37:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 232.970840 secs 2024-07-26T13:37:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 232.970840 secs 2024-07-26T13:37:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:07 smithi146 ceph-mon[35807]: pgmap v2790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T13:37:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:07 smithi076 ceph-mon[35401]: pgmap v2790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T13:37:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:07 smithi040 ceph-mon[32397]: pgmap v2790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T13:37:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:09 smithi146 ceph-mon[35807]: pgmap v2791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T13:37:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:09 smithi076 ceph-mon[35401]: pgmap v2791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T13:37:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:09 smithi040 ceph-mon[32397]: pgmap v2791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-07-26T13:37:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 237.970978 secs 2024-07-26T13:37:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:11 smithi146 ceph-mon[35807]: pgmap v2792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T13:37:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 237.970978 secs 2024-07-26T13:37:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:11 smithi076 ceph-mon[35401]: pgmap v2792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T13:37:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 237.970978 secs 2024-07-26T13:37:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:11 smithi040 ceph-mon[32397]: pgmap v2792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T13:37:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:13 smithi146 ceph-mon[35807]: pgmap v2793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:13 smithi076 ceph-mon[35401]: pgmap v2793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:13 smithi040 ceph-mon[32397]: pgmap v2793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:15 smithi146 ceph-mon[35807]: pgmap v2794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:15 smithi076 ceph-mon[35401]: pgmap v2794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:15 smithi040 ceph-mon[32397]: pgmap v2794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 242.971119 secs 2024-07-26T13:37:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 242.971119 secs 2024-07-26T13:37:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 242.971119 secs 2024-07-26T13:37:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:17 smithi040 ceph-mon[32397]: pgmap v2795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:17 smithi146 ceph-mon[35807]: pgmap v2795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:17 smithi076 ceph-mon[35401]: pgmap v2795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:18 smithi040 ceph-mon[32397]: pgmap v2796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:18 smithi146 ceph-mon[35807]: pgmap v2796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:18 smithi076 ceph-mon[35401]: pgmap v2796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 247.971256 secs 2024-07-26T13:37:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:21 smithi146 ceph-mon[35807]: pgmap v2797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 247.971256 secs 2024-07-26T13:37:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:21 smithi076 ceph-mon[35401]: pgmap v2797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 247.971256 secs 2024-07-26T13:37:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:21 smithi040 ceph-mon[32397]: pgmap v2797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:23 smithi146 ceph-mon[35807]: pgmap v2798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:23 smithi076 ceph-mon[35401]: pgmap v2798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:23 smithi040 ceph-mon[32397]: pgmap v2798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:25 smithi146 ceph-mon[35807]: pgmap v2799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:25 smithi076 ceph-mon[35401]: pgmap v2799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:25 smithi040 ceph-mon[32397]: pgmap v2799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 252.971370 secs 2024-07-26T13:37:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 252.971370 secs 2024-07-26T13:37:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 252.971370 secs 2024-07-26T13:37:27.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:27 smithi146 ceph-mon[35807]: pgmap v2800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:27 smithi076 ceph-mon[35401]: pgmap v2800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:27 smithi040 ceph-mon[32397]: pgmap v2800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:29 smithi146 ceph-mon[35807]: pgmap v2801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:29 smithi076 ceph-mon[35401]: pgmap v2801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:29 smithi040 ceph-mon[32397]: pgmap v2801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 257.971504 secs 2024-07-26T13:37:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:31 smithi146 ceph-mon[35807]: pgmap v2802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 257.971504 secs 2024-07-26T13:37:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:31 smithi076 ceph-mon[35401]: pgmap v2802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 257.971504 secs 2024-07-26T13:37:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:31 smithi040 ceph-mon[32397]: pgmap v2802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:33 smithi146 ceph-mon[35807]: pgmap v2803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:33 smithi076 ceph-mon[35401]: pgmap v2803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:33 smithi040 ceph-mon[32397]: pgmap v2803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:35 smithi076 ceph-mon[35401]: pgmap v2804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:35 smithi040 ceph-mon[32397]: pgmap v2804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:35 smithi146 ceph-mon[35807]: pgmap v2804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 262.971619 secs 2024-07-26T13:37:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 262.971619 secs 2024-07-26T13:37:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 262.971619 secs 2024-07-26T13:37:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:37 smithi040 ceph-mon[32397]: pgmap v2805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:37 smithi146 ceph-mon[35807]: pgmap v2805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:37 smithi076 ceph-mon[35401]: pgmap v2805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:38 smithi040 ceph-mon[32397]: pgmap v2806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:38 smithi146 ceph-mon[35807]: pgmap v2806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:38 smithi076 ceph-mon[35401]: pgmap v2806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:41.786 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 267.971766 secs 2024-07-26T13:37:41.787 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:41 smithi076 ceph-mon[35401]: pgmap v2807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:41.787 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:37:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 267.971766 secs 2024-07-26T13:37:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:41 smithi146 ceph-mon[35807]: pgmap v2807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:37:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 267.971766 secs 2024-07-26T13:37:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:41 smithi040 ceph-mon[32397]: pgmap v2807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:37:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:42 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:37:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:42 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:37:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:42 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:37:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:42 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:37:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:42 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:37:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:42 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:37:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:42 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:37:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:42 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:37:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:42 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:37:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:43 smithi146 ceph-mon[35807]: pgmap v2808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 896 B/s rd, 1 op/s 2024-07-26T13:37:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:43 smithi146 ceph-mon[35807]: pgmap v2809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:43 smithi076 ceph-mon[35401]: pgmap v2808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 896 B/s rd, 1 op/s 2024-07-26T13:37:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:43 smithi076 ceph-mon[35401]: pgmap v2809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:43 smithi040 ceph-mon[32397]: pgmap v2808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 896 B/s rd, 1 op/s 2024-07-26T13:37:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:43 smithi040 ceph-mon[32397]: pgmap v2809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:45 smithi146 ceph-mon[35807]: pgmap v2810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-07-26T13:37:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:45 smithi076 ceph-mon[35401]: pgmap v2810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-07-26T13:37:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:45 smithi040 ceph-mon[32397]: pgmap v2810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-07-26T13:37:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 272.971850 secs 2024-07-26T13:37:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 272.971850 secs 2024-07-26T13:37:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 272.971850 secs 2024-07-26T13:37:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:47 smithi076 ceph-mon[35401]: pgmap v2811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:47 smithi040 ceph-mon[32397]: pgmap v2811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:47 smithi146 ceph-mon[35807]: pgmap v2811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:49 smithi076 ceph-mon[35401]: pgmap v2812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:37:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:49 smithi040 ceph-mon[32397]: pgmap v2812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:37:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:49 smithi146 ceph-mon[35807]: pgmap v2812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:37:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:50 smithi040 ceph-mon[32397]: pgmap v2813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:50 smithi146 ceph-mon[35807]: pgmap v2813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:50 smithi076 ceph-mon[35401]: pgmap v2813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:37:51.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 277.971995 secs 2024-07-26T13:37:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 277.971995 secs 2024-07-26T13:37:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 277.971995 secs 2024-07-26T13:37:52.858 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:52 smithi076 ceph-mon[35401]: pgmap v2814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:37:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:52 smithi040 ceph-mon[32397]: pgmap v2814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:37:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:52 smithi146 ceph-mon[35807]: pgmap v2814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:37:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:54 smithi040 ceph-mon[32397]: pgmap v2815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:54 smithi146 ceph-mon[35807]: pgmap v2815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:55.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:54 smithi076 ceph-mon[35401]: pgmap v2815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:37:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 282.972145 secs 2024-07-26T13:37:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:56 smithi040 ceph-mon[32397]: pgmap v2816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 282.972145 secs 2024-07-26T13:37:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:56 smithi146 ceph-mon[35807]: pgmap v2816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 282.972145 secs 2024-07-26T13:37:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:56 smithi076 ceph-mon[35401]: pgmap v2816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:37:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:37:58 smithi040 ceph-mon[32397]: pgmap v2817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:37:58 smithi146 ceph-mon[35807]: pgmap v2817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:37:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:37:58 smithi076 ceph-mon[35401]: pgmap v2817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:00 smithi040 ceph-mon[32397]: pgmap v2818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:00 smithi146 ceph-mon[35807]: pgmap v2818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:00 smithi076 ceph-mon[35401]: pgmap v2818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 287.972326 secs 2024-07-26T13:38:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 287.972326 secs 2024-07-26T13:38:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 287.972326 secs 2024-07-26T13:38:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:02 smithi146 ceph-mon[35807]: pgmap v2819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:02 smithi076 ceph-mon[35401]: pgmap v2819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:02 smithi040 ceph-mon[32397]: pgmap v2819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:04 smithi146 ceph-mon[35807]: pgmap v2820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:04 smithi076 ceph-mon[35401]: pgmap v2820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:04 smithi040 ceph-mon[32397]: pgmap v2820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 292.972436 secs 2024-07-26T13:38:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:06 smithi146 ceph-mon[35807]: pgmap v2821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 292.972436 secs 2024-07-26T13:38:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:06 smithi076 ceph-mon[35401]: pgmap v2821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 292.972436 secs 2024-07-26T13:38:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:06 smithi040 ceph-mon[32397]: pgmap v2821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:09 smithi146 ceph-mon[35807]: pgmap v2822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:09 smithi076 ceph-mon[35401]: pgmap v2822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:09 smithi040 ceph-mon[32397]: pgmap v2822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:11 smithi146 ceph-mon[35807]: pgmap v2823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:11 smithi076 ceph-mon[35401]: pgmap v2823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:11 smithi040 ceph-mon[32397]: pgmap v2823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 297.972502 secs 2024-07-26T13:38:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 297.972502 secs 2024-07-26T13:38:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 297.972502 secs 2024-07-26T13:38:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:13 smithi146 ceph-mon[35807]: pgmap v2824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:13 smithi076 ceph-mon[35401]: pgmap v2824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:13 smithi040 ceph-mon[32397]: pgmap v2824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:15 smithi146 ceph-mon[35807]: pgmap v2825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:15 smithi076 ceph-mon[35401]: pgmap v2825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:15 smithi040 ceph-mon[32397]: pgmap v2825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 302.972665 secs 2024-07-26T13:38:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 302.972665 secs 2024-07-26T13:38:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 302.972665 secs 2024-07-26T13:38:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:17 smithi146 ceph-mon[35807]: pgmap v2826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:17 smithi076 ceph-mon[35401]: pgmap v2826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:17 smithi040 ceph-mon[32397]: pgmap v2826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:19 smithi146 ceph-mon[35807]: pgmap v2827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:19 smithi076 ceph-mon[35401]: pgmap v2827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:19 smithi040 ceph-mon[32397]: pgmap v2827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:21 smithi146 ceph-mon[35807]: pgmap v2828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 307.972824 secs 2024-07-26T13:38:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:21 smithi076 ceph-mon[35401]: pgmap v2828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 307.972824 secs 2024-07-26T13:38:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:21 smithi040 ceph-mon[32397]: pgmap v2828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 307.972824 secs 2024-07-26T13:38:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:23 smithi076 ceph-mon[35401]: pgmap v2829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:23 smithi040 ceph-mon[32397]: pgmap v2829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:23 smithi146 ceph-mon[35807]: pgmap v2829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:25 smithi076 ceph-mon[35401]: pgmap v2830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:25 smithi040 ceph-mon[32397]: pgmap v2830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:25 smithi146 ceph-mon[35807]: pgmap v2830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 312.972971 secs 2024-07-26T13:38:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 312.972971 secs 2024-07-26T13:38:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 312.972971 secs 2024-07-26T13:38:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:27 smithi040 ceph-mon[32397]: pgmap v2831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:27 smithi146 ceph-mon[35807]: pgmap v2831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:27 smithi076 ceph-mon[35401]: pgmap v2831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:29 smithi040 ceph-mon[32397]: pgmap v2832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:29 smithi146 ceph-mon[35807]: pgmap v2832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:29 smithi076 ceph-mon[35401]: pgmap v2832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:31 smithi040 ceph-mon[32397]: pgmap v2833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 317.973108 secs 2024-07-26T13:38:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:31 smithi146 ceph-mon[35807]: pgmap v2833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 317.973108 secs 2024-07-26T13:38:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:31 smithi076 ceph-mon[35401]: pgmap v2833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 317.973108 secs 2024-07-26T13:38:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:33 smithi040 ceph-mon[32397]: pgmap v2834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:33 smithi146 ceph-mon[35807]: pgmap v2834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:33 smithi076 ceph-mon[35401]: pgmap v2834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:35 smithi040 ceph-mon[32397]: pgmap v2835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:35 smithi146 ceph-mon[35807]: pgmap v2835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:35 smithi076 ceph-mon[35401]: pgmap v2835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 322.973202 secs 2024-07-26T13:38:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 322.973202 secs 2024-07-26T13:38:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 322.973202 secs 2024-07-26T13:38:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:37 smithi040 ceph-mon[32397]: pgmap v2836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:37 smithi146 ceph-mon[35807]: pgmap v2836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:37 smithi076 ceph-mon[35401]: pgmap v2836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:39 smithi040 ceph-mon[32397]: pgmap v2837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:39 smithi146 ceph-mon[35807]: pgmap v2837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:39 smithi076 ceph-mon[35401]: pgmap v2837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:41 smithi040 ceph-mon[32397]: pgmap v2838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 327.973330 secs 2024-07-26T13:38:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:41 smithi146 ceph-mon[35807]: pgmap v2838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 327.973330 secs 2024-07-26T13:38:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:41 smithi076 ceph-mon[35401]: pgmap v2838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 327.973330 secs 2024-07-26T13:38:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:43 smithi040 ceph-mon[32397]: pgmap v2839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:43 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:38:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:43 smithi146 ceph-mon[35807]: pgmap v2839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:43 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:38:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:43 smithi076 ceph-mon[35401]: pgmap v2839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:43 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:38:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: pgmap v2840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:38:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:38:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: pgmap v2841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 B/s rd, 1 op/s 2024-07-26T13:38:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: pgmap v2842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:38:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: pgmap v2840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:38:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:38:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: pgmap v2841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 B/s rd, 1 op/s 2024-07-26T13:38:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: pgmap v2842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:38:45.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: pgmap v2840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:38:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:38:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:38:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: pgmap v2841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 B/s rd, 1 op/s 2024-07-26T13:38:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: pgmap v2842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:38:45.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:38:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 332.973470 secs 2024-07-26T13:38:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 332.973470 secs 2024-07-26T13:38:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 332.973470 secs 2024-07-26T13:38:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:47 smithi040 ceph-mon[32397]: pgmap v2843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:47 smithi146 ceph-mon[35807]: pgmap v2843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:47 smithi076 ceph-mon[35401]: pgmap v2843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:49 smithi040 ceph-mon[32397]: pgmap v2844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:38:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:49 smithi146 ceph-mon[35807]: pgmap v2844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:38:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:49 smithi076 ceph-mon[35401]: pgmap v2844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:38:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:51 smithi040 ceph-mon[32397]: pgmap v2845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 337.973611 secs 2024-07-26T13:38:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:51 smithi146 ceph-mon[35807]: pgmap v2845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 337.973611 secs 2024-07-26T13:38:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:51 smithi076 ceph-mon[35401]: pgmap v2845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 337.973611 secs 2024-07-26T13:38:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:53 smithi040 ceph-mon[32397]: pgmap v2846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:38:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:53 smithi146 ceph-mon[35807]: pgmap v2846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:38:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:53 smithi076 ceph-mon[35401]: pgmap v2846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:38:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:55 smithi040 ceph-mon[32397]: pgmap v2847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:38:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:55 smithi146 ceph-mon[35807]: pgmap v2847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:38:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:55 smithi076 ceph-mon[35401]: pgmap v2847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:38:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 342.973702 secs 2024-07-26T13:38:56.679 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 342.973702 secs 2024-07-26T13:38:56.679 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 342.973702 secs 2024-07-26T13:38:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:57 smithi040 ceph-mon[32397]: pgmap v2848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:57 smithi146 ceph-mon[35807]: pgmap v2848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:57 smithi076 ceph-mon[35401]: pgmap v2848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:38:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:38:59 smithi040 ceph-mon[32397]: pgmap v2849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:38:59 smithi146 ceph-mon[35807]: pgmap v2849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:38:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:38:59 smithi076 ceph-mon[35401]: pgmap v2849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:01 smithi040 ceph-mon[32397]: pgmap v2850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 347.973845 secs 2024-07-26T13:39:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:01 smithi146 ceph-mon[35807]: pgmap v2850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 347.973845 secs 2024-07-26T13:39:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:01 smithi076 ceph-mon[35401]: pgmap v2850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 347.973845 secs 2024-07-26T13:39:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:03 smithi040 ceph-mon[32397]: pgmap v2851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:03 smithi146 ceph-mon[35807]: pgmap v2851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:03 smithi076 ceph-mon[35401]: pgmap v2851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:05 smithi040 ceph-mon[32397]: pgmap v2852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:05 smithi146 ceph-mon[35807]: pgmap v2852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:05 smithi076 ceph-mon[35401]: pgmap v2852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 352.974013 secs 2024-07-26T13:39:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 352.974013 secs 2024-07-26T13:39:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 352.974013 secs 2024-07-26T13:39:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:07 smithi040 ceph-mon[32397]: pgmap v2853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:07 smithi146 ceph-mon[35807]: pgmap v2853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:07 smithi076 ceph-mon[35401]: pgmap v2853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:09 smithi040 ceph-mon[32397]: pgmap v2854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:09 smithi146 ceph-mon[35807]: pgmap v2854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:09 smithi076 ceph-mon[35401]: pgmap v2854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:11 smithi040 ceph-mon[32397]: pgmap v2855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 357.974155 secs 2024-07-26T13:39:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:11 smithi146 ceph-mon[35807]: pgmap v2855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 357.974155 secs 2024-07-26T13:39:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:11 smithi076 ceph-mon[35401]: pgmap v2855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 357.974155 secs 2024-07-26T13:39:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:13 smithi040 ceph-mon[32397]: pgmap v2856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:13 smithi146 ceph-mon[35807]: pgmap v2856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:13 smithi076 ceph-mon[35401]: pgmap v2856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:15 smithi040 ceph-mon[32397]: pgmap v2857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:15 smithi146 ceph-mon[35807]: pgmap v2857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:15 smithi076 ceph-mon[35401]: pgmap v2857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 362.974335 secs 2024-07-26T13:39:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:16 smithi040 ceph-mon[32397]: slow request 362.974334 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:39:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 362.974335 secs 2024-07-26T13:39:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:16 smithi146 ceph-mon[35807]: slow request 362.974334 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:39:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 362.974335 secs 2024-07-26T13:39:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:16 smithi076 ceph-mon[35401]: slow request 362.974334 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:39:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:17 smithi040 ceph-mon[32397]: pgmap v2858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:17 smithi146 ceph-mon[35807]: pgmap v2858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:17 smithi076 ceph-mon[35401]: pgmap v2858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:19 smithi040 ceph-mon[32397]: pgmap v2859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:19 smithi146 ceph-mon[35807]: pgmap v2859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:19 smithi076 ceph-mon[35401]: pgmap v2859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:21 smithi040 ceph-mon[32397]: pgmap v2860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 367.974496 secs 2024-07-26T13:39:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:21 smithi146 ceph-mon[35807]: pgmap v2860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 367.974496 secs 2024-07-26T13:39:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:21 smithi076 ceph-mon[35401]: pgmap v2860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 367.974496 secs 2024-07-26T13:39:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:23 smithi146 ceph-mon[35807]: pgmap v2861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:23 smithi076 ceph-mon[35401]: pgmap v2861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:23 smithi040 ceph-mon[32397]: pgmap v2861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:25 smithi146 ceph-mon[35807]: pgmap v2862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:25 smithi076 ceph-mon[35401]: pgmap v2862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:25 smithi040 ceph-mon[32397]: pgmap v2862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 372.974640 secs 2024-07-26T13:39:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 372.974640 secs 2024-07-26T13:39:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 372.974640 secs 2024-07-26T13:39:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:27 smithi146 ceph-mon[35807]: pgmap v2863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:27 smithi076 ceph-mon[35401]: pgmap v2863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:27 smithi040 ceph-mon[32397]: pgmap v2863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:29 smithi146 ceph-mon[35807]: pgmap v2864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:29 smithi076 ceph-mon[35401]: pgmap v2864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:29 smithi040 ceph-mon[32397]: pgmap v2864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:31 smithi146 ceph-mon[35807]: pgmap v2865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 377.974784 secs 2024-07-26T13:39:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:31 smithi076 ceph-mon[35401]: pgmap v2865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 377.974784 secs 2024-07-26T13:39:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:31 smithi040 ceph-mon[32397]: pgmap v2865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 377.974784 secs 2024-07-26T13:39:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:33 smithi146 ceph-mon[35807]: pgmap v2866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:33 smithi076 ceph-mon[35401]: pgmap v2866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:33 smithi040 ceph-mon[32397]: pgmap v2866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:35 smithi146 ceph-mon[35807]: pgmap v2867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:35 smithi076 ceph-mon[35401]: pgmap v2867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:35 smithi040 ceph-mon[32397]: pgmap v2867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:39:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 382.974923 secs 2024-07-26T13:39:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 382.974923 secs 2024-07-26T13:39:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 382.974923 secs 2024-07-26T13:39:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:37 smithi146 ceph-mon[35807]: pgmap v2868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:37 smithi076 ceph-mon[35401]: pgmap v2868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:37 smithi040 ceph-mon[32397]: pgmap v2868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:39 smithi146 ceph-mon[35807]: pgmap v2869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:39 smithi076 ceph-mon[35401]: pgmap v2869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:39 smithi040 ceph-mon[32397]: pgmap v2869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:41 smithi146 ceph-mon[35807]: pgmap v2870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 387.975066 secs 2024-07-26T13:39:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:41 smithi076 ceph-mon[35401]: pgmap v2870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 387.975066 secs 2024-07-26T13:39:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:41 smithi040 ceph-mon[32397]: pgmap v2870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 387.975066 secs 2024-07-26T13:39:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:43 smithi076 ceph-mon[35401]: pgmap v2871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:39:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:43 smithi040 ceph-mon[32397]: pgmap v2871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:39:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:43 smithi146 ceph-mon[35807]: pgmap v2871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:39:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:45 smithi076 ceph-mon[35401]: pgmap v2872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:39:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:39:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:45 smithi040 ceph-mon[32397]: pgmap v2872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:39:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:39:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:45 smithi146 ceph-mon[35807]: pgmap v2872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:39:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:39:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 392.975194 secs 2024-07-26T13:39:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:39:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:39:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 392.975194 secs 2024-07-26T13:39:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:39:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 392.975194 secs 2024-07-26T13:39:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:39:46.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:39:46.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:39:46.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:39:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:47 smithi040 ceph-mon[32397]: pgmap v2873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:39:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:47 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:39:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:47 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:39:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:47 smithi040 ceph-mon[32397]: pgmap v2874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 911 B/s rd, 1 op/s 2024-07-26T13:39:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:47 smithi040 ceph-mon[32397]: pgmap v2875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:39:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:47 smithi146 ceph-mon[35807]: pgmap v2873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:39:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:47 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:39:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:47 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:39:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:47 smithi146 ceph-mon[35807]: pgmap v2874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 911 B/s rd, 1 op/s 2024-07-26T13:39:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:47 smithi146 ceph-mon[35807]: pgmap v2875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:39:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:47 smithi076 ceph-mon[35401]: pgmap v2873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:39:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:47 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T13:39:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:47 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:39:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:47 smithi076 ceph-mon[35401]: pgmap v2874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 911 B/s rd, 1 op/s 2024-07-26T13:39:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:47 smithi076 ceph-mon[35401]: pgmap v2875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:39:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:49 smithi040 ceph-mon[32397]: pgmap v2876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 B/s rd, 1 op/s 2024-07-26T13:39:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:49 smithi146 ceph-mon[35807]: pgmap v2876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 B/s rd, 1 op/s 2024-07-26T13:39:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:49 smithi076 ceph-mon[35401]: pgmap v2876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 B/s rd, 1 op/s 2024-07-26T13:39:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:51 smithi040 ceph-mon[32397]: pgmap v2877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 397.975340 secs 2024-07-26T13:39:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:51 smithi146 ceph-mon[35807]: pgmap v2877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 397.975340 secs 2024-07-26T13:39:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:51 smithi076 ceph-mon[35401]: pgmap v2877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:39:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 397.975340 secs 2024-07-26T13:39:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:53 smithi040 ceph-mon[32397]: pgmap v2878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:39:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:53 smithi146 ceph-mon[35807]: pgmap v2878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:39:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:53 smithi076 ceph-mon[35401]: pgmap v2878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:39:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:55 smithi040 ceph-mon[32397]: pgmap v2879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 B/s rd, 1 op/s 2024-07-26T13:39:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:55 smithi146 ceph-mon[35807]: pgmap v2879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 B/s rd, 1 op/s 2024-07-26T13:39:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:55 smithi076 ceph-mon[35401]: pgmap v2879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 B/s rd, 1 op/s 2024-07-26T13:39:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 402.975439 secs 2024-07-26T13:39:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 402.975439 secs 2024-07-26T13:39:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 402.975439 secs 2024-07-26T13:39:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:57 smithi040 ceph-mon[32397]: pgmap v2880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:39:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:57 smithi146 ceph-mon[35807]: pgmap v2880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:39:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:57 smithi076 ceph-mon[35401]: pgmap v2880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:39:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:39:59 smithi040 ceph-mon[32397]: pgmap v2881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:39:59 smithi146 ceph-mon[35807]: pgmap v2881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:39:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:39:59 smithi076 ceph-mon[35401]: pgmap v2881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: Health detail: HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: [WRN] CEPHADM_FAILED_DAEMON: 4 failed cephadm daemon(s) 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: daemon mds.g on smithi040 is in unknown state 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: daemon mds.a on smithi040 is in unknown state 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: daemon mds.e on smithi076 is in unknown state 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: daemon mds.f on smithi146 is in unknown state 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: fs cephfs is degraded 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T13:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:00 smithi040 ceph-mon[32397]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: Health detail: HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: [WRN] CEPHADM_FAILED_DAEMON: 4 failed cephadm daemon(s) 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: daemon mds.g on smithi040 is in unknown state 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: daemon mds.a on smithi040 is in unknown state 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: daemon mds.e on smithi076 is in unknown state 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: daemon mds.f on smithi146 is in unknown state 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T13:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: fs cephfs is degraded 2024-07-26T13:40:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T13:40:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:00 smithi146 ceph-mon[35807]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T13:40:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: Health detail: HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: [WRN] CEPHADM_FAILED_DAEMON: 4 failed cephadm daemon(s) 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: daemon mds.g on smithi040 is in unknown state 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: daemon mds.a on smithi040 is in unknown state 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: daemon mds.e on smithi076 is in unknown state 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: daemon mds.f on smithi146 is in unknown state 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: fs cephfs is degraded 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T13:40:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:00 smithi076 ceph-mon[35401]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T13:40:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:01 smithi040 ceph-mon[32397]: pgmap v2882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 407.975575 secs 2024-07-26T13:40:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:01 smithi146 ceph-mon[35807]: pgmap v2882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 407.975575 secs 2024-07-26T13:40:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:01 smithi076 ceph-mon[35401]: pgmap v2882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 407.975575 secs 2024-07-26T13:40:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:03 smithi040 ceph-mon[32397]: pgmap v2883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:03.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:03 smithi146 ceph-mon[35807]: pgmap v2883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:03 smithi076 ceph-mon[35401]: pgmap v2883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:05 smithi040 ceph-mon[32397]: pgmap v2884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:05 smithi146 ceph-mon[35807]: pgmap v2884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:05 smithi076 ceph-mon[35401]: pgmap v2884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 412.975734 secs 2024-07-26T13:40:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 412.975734 secs 2024-07-26T13:40:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 412.975734 secs 2024-07-26T13:40:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:07 smithi040 ceph-mon[32397]: pgmap v2885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:07 smithi146 ceph-mon[35807]: pgmap v2885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:07 smithi076 ceph-mon[35401]: pgmap v2885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:09 smithi040 ceph-mon[32397]: pgmap v2886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:09 smithi146 ceph-mon[35807]: pgmap v2886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:09 smithi076 ceph-mon[35401]: pgmap v2886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:11 smithi040 ceph-mon[32397]: pgmap v2887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 417.975877 secs 2024-07-26T13:40:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:11 smithi146 ceph-mon[35807]: pgmap v2887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 417.975877 secs 2024-07-26T13:40:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:11 smithi076 ceph-mon[35401]: pgmap v2887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 417.975877 secs 2024-07-26T13:40:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:13 smithi040 ceph-mon[32397]: pgmap v2888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:13 smithi146 ceph-mon[35807]: pgmap v2888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:13 smithi076 ceph-mon[35401]: pgmap v2888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:15 smithi040 ceph-mon[32397]: pgmap v2889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:15 smithi146 ceph-mon[35807]: pgmap v2889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:15 smithi076 ceph-mon[35401]: pgmap v2889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 422.975964 secs 2024-07-26T13:40:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 422.975964 secs 2024-07-26T13:40:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 422.975964 secs 2024-07-26T13:40:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:17 smithi146 ceph-mon[35807]: pgmap v2890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:17 smithi076 ceph-mon[35401]: pgmap v2890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:17 smithi040 ceph-mon[32397]: pgmap v2890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:19 smithi146 ceph-mon[35807]: pgmap v2891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:19 smithi076 ceph-mon[35401]: pgmap v2891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:19 smithi040 ceph-mon[32397]: pgmap v2891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:20 smithi040 ceph-mon[32397]: pgmap v2892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:20 smithi146 ceph-mon[35807]: pgmap v2892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:20 smithi076 ceph-mon[35401]: pgmap v2892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 427.976104 secs 2024-07-26T13:40:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 427.976104 secs 2024-07-26T13:40:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 427.976104 secs 2024-07-26T13:40:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:22 smithi040 ceph-mon[32397]: pgmap v2893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:22 smithi146 ceph-mon[35807]: pgmap v2893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:22 smithi076 ceph-mon[35401]: pgmap v2893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:25 smithi040 ceph-mon[32397]: pgmap v2894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:25 smithi146 ceph-mon[35807]: pgmap v2894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:25 smithi076 ceph-mon[35401]: pgmap v2894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 432.976306 secs 2024-07-26T13:40:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 432.976306 secs 2024-07-26T13:40:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 432.976306 secs 2024-07-26T13:40:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:27 smithi146 ceph-mon[35807]: pgmap v2895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:40:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:27 smithi076 ceph-mon[35401]: pgmap v2895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:40:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:27 smithi040 ceph-mon[32397]: pgmap v2895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:40:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:29 smithi146 ceph-mon[35807]: pgmap v2896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:29 smithi076 ceph-mon[35401]: pgmap v2896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:29 smithi040 ceph-mon[32397]: pgmap v2896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:31 smithi146 ceph-mon[35807]: pgmap v2897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 437.976451 secs 2024-07-26T13:40:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:31 smithi076 ceph-mon[35401]: pgmap v2897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 437.976451 secs 2024-07-26T13:40:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:31 smithi040 ceph-mon[32397]: pgmap v2897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 437.976451 secs 2024-07-26T13:40:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:33 smithi146 ceph-mon[35807]: pgmap v2898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:33 smithi076 ceph-mon[35401]: pgmap v2898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:33 smithi040 ceph-mon[32397]: pgmap v2898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:35 smithi146 ceph-mon[35807]: pgmap v2899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:35 smithi076 ceph-mon[35401]: pgmap v2899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:35 smithi040 ceph-mon[32397]: pgmap v2899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 442.976558 secs 2024-07-26T13:40:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 442.976558 secs 2024-07-26T13:40:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 442.976558 secs 2024-07-26T13:40:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:37 smithi146 ceph-mon[35807]: pgmap v2900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:37 smithi076 ceph-mon[35401]: pgmap v2900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:37 smithi040 ceph-mon[32397]: pgmap v2900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:39 smithi146 ceph-mon[35807]: pgmap v2901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:39 smithi076 ceph-mon[35401]: pgmap v2901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:39 smithi040 ceph-mon[32397]: pgmap v2901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:41 smithi146 ceph-mon[35807]: pgmap v2902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 447.976699 secs 2024-07-26T13:40:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:41 smithi076 ceph-mon[35401]: pgmap v2902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 447.976699 secs 2024-07-26T13:40:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:41 smithi040 ceph-mon[32397]: pgmap v2902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 447.976699 secs 2024-07-26T13:40:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:43 smithi146 ceph-mon[35807]: pgmap v2903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:43 smithi076 ceph-mon[35401]: pgmap v2903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:43 smithi040 ceph-mon[32397]: pgmap v2903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:40:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:45 smithi076 ceph-mon[35401]: pgmap v2904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:45 smithi040 ceph-mon[32397]: pgmap v2904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:45 smithi146 ceph-mon[35807]: pgmap v2904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:40:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 452.976845 secs 2024-07-26T13:40:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 452.976845 secs 2024-07-26T13:40:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 452.976845 secs 2024-07-26T13:40:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:47 smithi040 ceph-mon[32397]: pgmap v2905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:40:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:47 smithi146 ceph-mon[35807]: pgmap v2905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:40:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:47 smithi076 ceph-mon[35401]: pgmap v2905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:40:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:40:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:40:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:40:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:40:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:40:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:49 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:40:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:49 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:40:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:49 smithi040 ceph-mon[32397]: pgmap v2906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-07-26T13:40:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:49 smithi040 ceph-mon[32397]: pgmap v2907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:49 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:40:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:49 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:40:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:49 smithi146 ceph-mon[35807]: pgmap v2906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-07-26T13:40:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:49 smithi146 ceph-mon[35807]: pgmap v2907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:49 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T13:40:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:49 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T13:40:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:49 smithi076 ceph-mon[35401]: pgmap v2906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-07-26T13:40:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:49 smithi076 ceph-mon[35401]: pgmap v2907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:51 smithi040 ceph-mon[32397]: pgmap v2908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 457.976990 secs 2024-07-26T13:40:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:51 smithi146 ceph-mon[35807]: pgmap v2908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 457.976990 secs 2024-07-26T13:40:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:51 smithi076 ceph-mon[35401]: pgmap v2908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 457.976990 secs 2024-07-26T13:40:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:53 smithi040 ceph-mon[32397]: pgmap v2909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:53 smithi146 ceph-mon[35807]: pgmap v2909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:53 smithi076 ceph-mon[35401]: pgmap v2909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:55 smithi040 ceph-mon[32397]: pgmap v2910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:55 smithi146 ceph-mon[35807]: pgmap v2910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:55 smithi076 ceph-mon[35401]: pgmap v2910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 462.977123 secs 2024-07-26T13:40:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 462.977123 secs 2024-07-26T13:40:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 462.977123 secs 2024-07-26T13:40:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:57 smithi040 ceph-mon[32397]: pgmap v2911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:57 smithi146 ceph-mon[35807]: pgmap v2911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:57 smithi076 ceph-mon[35401]: pgmap v2911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:40:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:40:59 smithi040 ceph-mon[32397]: pgmap v2912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:40:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:40:59 smithi146 ceph-mon[35807]: pgmap v2912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:40:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:40:59 smithi076 ceph-mon[35401]: pgmap v2912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:41:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:01 smithi040 ceph-mon[32397]: pgmap v2913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 467.977317 secs 2024-07-26T13:41:01.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:01 smithi146 ceph-mon[35807]: pgmap v2913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:01.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 467.977317 secs 2024-07-26T13:41:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:01 smithi076 ceph-mon[35401]: pgmap v2913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 467.977317 secs 2024-07-26T13:41:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:03 smithi040 ceph-mon[32397]: pgmap v2914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:03 smithi146 ceph-mon[35807]: pgmap v2914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:03 smithi076 ceph-mon[35401]: pgmap v2914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:05 smithi040 ceph-mon[32397]: pgmap v2915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:05 smithi146 ceph-mon[35807]: pgmap v2915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:05 smithi076 ceph-mon[35401]: pgmap v2915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 472.977450 secs 2024-07-26T13:41:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 472.977450 secs 2024-07-26T13:41:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 472.977450 secs 2024-07-26T13:41:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:07 smithi040 ceph-mon[32397]: pgmap v2916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:07 smithi146 ceph-mon[35807]: pgmap v2916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:07 smithi076 ceph-mon[35401]: pgmap v2916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:09 smithi040 ceph-mon[32397]: pgmap v2917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:09 smithi146 ceph-mon[35807]: pgmap v2917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:09 smithi076 ceph-mon[35401]: pgmap v2917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:11 smithi040 ceph-mon[32397]: pgmap v2918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 477.977549 secs 2024-07-26T13:41:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:11 smithi146 ceph-mon[35807]: pgmap v2918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 477.977549 secs 2024-07-26T13:41:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:11 smithi076 ceph-mon[35401]: pgmap v2918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 477.977549 secs 2024-07-26T13:41:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:13 smithi040 ceph-mon[32397]: pgmap v2919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:13 smithi146 ceph-mon[35807]: pgmap v2919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:13 smithi076 ceph-mon[35401]: pgmap v2919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:15 smithi040 ceph-mon[32397]: pgmap v2920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:15 smithi146 ceph-mon[35807]: pgmap v2920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:15 smithi076 ceph-mon[35401]: pgmap v2920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 482.977644 secs 2024-07-26T13:41:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 482.977644 secs 2024-07-26T13:41:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 482.977644 secs 2024-07-26T13:41:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:17 smithi146 ceph-mon[35807]: pgmap v2921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:17 smithi076 ceph-mon[35401]: pgmap v2921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:17 smithi040 ceph-mon[32397]: pgmap v2921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:19 smithi146 ceph-mon[35807]: pgmap v2922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:19 smithi076 ceph-mon[35401]: pgmap v2922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:19 smithi040 ceph-mon[32397]: pgmap v2922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:21.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:21 smithi040 ceph-mon[32397]: pgmap v2923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:21.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 487.977803 secs 2024-07-26T13:41:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:21 smithi146 ceph-mon[35807]: pgmap v2923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 487.977803 secs 2024-07-26T13:41:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:21 smithi076 ceph-mon[35401]: pgmap v2923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 487.977803 secs 2024-07-26T13:41:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:23 smithi146 ceph-mon[35807]: pgmap v2924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:23 smithi076 ceph-mon[35401]: pgmap v2924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:23 smithi040 ceph-mon[32397]: pgmap v2924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:25 smithi146 ceph-mon[35807]: pgmap v2925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:25 smithi076 ceph-mon[35401]: pgmap v2925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:25 smithi040 ceph-mon[32397]: pgmap v2925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 492.977904 secs 2024-07-26T13:41:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 492.977904 secs 2024-07-26T13:41:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 492.977904 secs 2024-07-26T13:41:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:27 smithi146 ceph-mon[35807]: pgmap v2926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:27 smithi076 ceph-mon[35401]: pgmap v2926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:27 smithi040 ceph-mon[32397]: pgmap v2926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:29 smithi146 ceph-mon[35807]: pgmap v2927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:29 smithi076 ceph-mon[35401]: pgmap v2927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:29 smithi040 ceph-mon[32397]: pgmap v2927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:31 smithi146 ceph-mon[35807]: pgmap v2928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 497.978047 secs 2024-07-26T13:41:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:31 smithi076 ceph-mon[35401]: pgmap v2928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 497.978047 secs 2024-07-26T13:41:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:31 smithi040 ceph-mon[32397]: pgmap v2928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 497.978047 secs 2024-07-26T13:41:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:33 smithi146 ceph-mon[35807]: pgmap v2929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:33 smithi076 ceph-mon[35401]: pgmap v2929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:33 smithi040 ceph-mon[32397]: pgmap v2929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:35 smithi146 ceph-mon[35807]: pgmap v2930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:35 smithi076 ceph-mon[35401]: pgmap v2930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:35 smithi040 ceph-mon[32397]: pgmap v2930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 502.978190 secs 2024-07-26T13:41:36.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 502.978190 secs 2024-07-26T13:41:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 502.978190 secs 2024-07-26T13:41:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:37 smithi146 ceph-mon[35807]: pgmap v2931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:37 smithi076 ceph-mon[35401]: pgmap v2931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:37 smithi040 ceph-mon[32397]: pgmap v2931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:39 smithi076 ceph-mon[35401]: pgmap v2932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:39 smithi040 ceph-mon[32397]: pgmap v2932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:39 smithi146 ceph-mon[35807]: pgmap v2932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:41.875 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:41 smithi146 ceph-mon[35807]: pgmap v2933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:41.875 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 507.978357 secs 2024-07-26T13:41:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:41 smithi040 ceph-mon[32397]: pgmap v2933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 507.978357 secs 2024-07-26T13:41:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:41 smithi076 ceph-mon[35401]: pgmap v2933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 507.978357 secs 2024-07-26T13:41:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:43 smithi040 ceph-mon[32397]: pgmap v2934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:43 smithi146 ceph-mon[35807]: pgmap v2934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:43 smithi076 ceph-mon[35401]: pgmap v2934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:45 smithi040 ceph-mon[32397]: pgmap v2935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:45 smithi146 ceph-mon[35807]: pgmap v2935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:45 smithi076 ceph-mon[35401]: pgmap v2935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:41:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 512.978452 secs 2024-07-26T13:41:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 512.978452 secs 2024-07-26T13:41:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 512.978452 secs 2024-07-26T13:41:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:47 smithi040 ceph-mon[32397]: pgmap v2936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:47 smithi146 ceph-mon[35807]: pgmap v2936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:47 smithi076 ceph-mon[35401]: pgmap v2936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:41:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:41:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:41:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:49 smithi040 ceph-mon[32397]: pgmap v2937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:49 smithi146 ceph-mon[35807]: pgmap v2937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:49 smithi076 ceph-mon[35401]: pgmap v2937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:41:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:50 smithi040 ceph-mon[32397]: pgmap v2938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:41:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:41:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:50 smithi040 ceph-mon[32397]: pgmap v2939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 B/s rd, 1 op/s 2024-07-26T13:41:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:50 smithi040 ceph-mon[32397]: pgmap v2940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:50 smithi146 ceph-mon[35807]: pgmap v2938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:41:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:41:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:50 smithi146 ceph-mon[35807]: pgmap v2939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 B/s rd, 1 op/s 2024-07-26T13:41:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:50 smithi146 ceph-mon[35807]: pgmap v2940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:50 smithi076 ceph-mon[35401]: pgmap v2938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:50 smithi076 ceph-mon[35401]: pgmap v2939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 B/s rd, 1 op/s 2024-07-26T13:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:50 smithi076 ceph-mon[35401]: pgmap v2940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:41:51.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 517.978579 secs 2024-07-26T13:41:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 517.978579 secs 2024-07-26T13:41:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 517.978579 secs 2024-07-26T13:41:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:52 smithi040 ceph-mon[32397]: pgmap v2941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:41:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:52 smithi146 ceph-mon[35807]: pgmap v2941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:41:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:52 smithi076 ceph-mon[35401]: pgmap v2941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:41:55.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:54 smithi040 ceph-mon[32397]: pgmap v2942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:41:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:54 smithi146 ceph-mon[35807]: pgmap v2942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:41:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:54 smithi076 ceph-mon[35401]: pgmap v2942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:41:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 522.978673 secs 2024-07-26T13:41:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:56 smithi040 ceph-mon[32397]: pgmap v2943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 522.978673 secs 2024-07-26T13:41:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:56 smithi146 ceph-mon[35807]: pgmap v2943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 522.978673 secs 2024-07-26T13:41:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:56 smithi076 ceph-mon[35401]: pgmap v2943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:41:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:41:58 smithi040 ceph-mon[32397]: pgmap v2944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:41:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:41:58 smithi146 ceph-mon[35807]: pgmap v2944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:41:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:41:58 smithi076 ceph-mon[35401]: pgmap v2944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s rd, 1 op/s 2024-07-26T13:42:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:00 smithi040 ceph-mon[32397]: pgmap v2945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:42:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:00 smithi146 ceph-mon[35807]: pgmap v2945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:42:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:00 smithi076 ceph-mon[35401]: pgmap v2945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:42:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 527.978784 secs 2024-07-26T13:42:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 527.978784 secs 2024-07-26T13:42:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 527.978784 secs 2024-07-26T13:42:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:02 smithi040 ceph-mon[32397]: pgmap v2946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:02 smithi146 ceph-mon[35807]: pgmap v2946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:02 smithi076 ceph-mon[35401]: pgmap v2946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:04 smithi040 ceph-mon[32397]: pgmap v2947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:04 smithi146 ceph-mon[35807]: pgmap v2947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:04 smithi076 ceph-mon[35401]: pgmap v2947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 532.978925 secs 2024-07-26T13:42:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:06 smithi040 ceph-mon[32397]: pgmap v2948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 532.978925 secs 2024-07-26T13:42:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:06 smithi146 ceph-mon[35807]: pgmap v2948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 532.978925 secs 2024-07-26T13:42:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:06 smithi076 ceph-mon[35401]: pgmap v2948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:08 smithi040 ceph-mon[32397]: pgmap v2949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:08 smithi146 ceph-mon[35807]: pgmap v2949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:08 smithi076 ceph-mon[35401]: pgmap v2949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:10 smithi040 ceph-mon[32397]: pgmap v2950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:10 smithi146 ceph-mon[35807]: pgmap v2950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:10 smithi076 ceph-mon[35401]: pgmap v2950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 537.979067 secs 2024-07-26T13:42:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 537.979067 secs 2024-07-26T13:42:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 537.979067 secs 2024-07-26T13:42:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:12 smithi040 ceph-mon[32397]: pgmap v2951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:12 smithi146 ceph-mon[35807]: pgmap v2951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:12 smithi076 ceph-mon[35401]: pgmap v2951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:14 smithi040 ceph-mon[32397]: pgmap v2952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:14 smithi146 ceph-mon[35807]: pgmap v2952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:14 smithi076 ceph-mon[35401]: pgmap v2952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 542.979209 secs 2024-07-26T13:42:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:16 smithi040 ceph-mon[32397]: pgmap v2953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 542.979209 secs 2024-07-26T13:42:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:16 smithi146 ceph-mon[35807]: pgmap v2953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 542.979209 secs 2024-07-26T13:42:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:16 smithi076 ceph-mon[35401]: pgmap v2953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:18 smithi040 ceph-mon[32397]: pgmap v2954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:18 smithi146 ceph-mon[35807]: pgmap v2954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:18 smithi076 ceph-mon[35401]: pgmap v2954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:20 smithi040 ceph-mon[32397]: pgmap v2955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:20 smithi146 ceph-mon[35807]: pgmap v2955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:20 smithi076 ceph-mon[35401]: pgmap v2955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 547.979360 secs 2024-07-26T13:42:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 547.979360 secs 2024-07-26T13:42:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 547.979360 secs 2024-07-26T13:42:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:22 smithi040 ceph-mon[32397]: pgmap v2956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:22 smithi146 ceph-mon[35807]: pgmap v2956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:22 smithi076 ceph-mon[35401]: pgmap v2956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:24 smithi040 ceph-mon[32397]: pgmap v2957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:24 smithi146 ceph-mon[35807]: pgmap v2957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:24 smithi076 ceph-mon[35401]: pgmap v2957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 552.979492 secs 2024-07-26T13:42:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:26 smithi040 ceph-mon[32397]: pgmap v2958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 552.979492 secs 2024-07-26T13:42:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:26 smithi146 ceph-mon[35807]: pgmap v2958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 552.979492 secs 2024-07-26T13:42:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:26 smithi076 ceph-mon[35401]: pgmap v2958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:28 smithi146 ceph-mon[35807]: pgmap v2959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:28 smithi076 ceph-mon[35401]: pgmap v2959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:28 smithi040 ceph-mon[32397]: pgmap v2959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:30 smithi146 ceph-mon[35807]: pgmap v2960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:30 smithi076 ceph-mon[35401]: pgmap v2960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:30 smithi040 ceph-mon[32397]: pgmap v2960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 557.979633 secs 2024-07-26T13:42:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 557.979633 secs 2024-07-26T13:42:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 557.979633 secs 2024-07-26T13:42:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:33 smithi146 ceph-mon[35807]: pgmap v2961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:33 smithi076 ceph-mon[35401]: pgmap v2961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:33 smithi040 ceph-mon[32397]: pgmap v2961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:35 smithi146 ceph-mon[35807]: pgmap v2962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:35 smithi076 ceph-mon[35401]: pgmap v2962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:35 smithi040 ceph-mon[32397]: pgmap v2962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 562.979786 secs 2024-07-26T13:42:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:37 smithi146 ceph-mon[35807]: pgmap v2963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 562.979786 secs 2024-07-26T13:42:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:37 smithi076 ceph-mon[35401]: pgmap v2963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 562.979786 secs 2024-07-26T13:42:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:37 smithi040 ceph-mon[32397]: pgmap v2963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:39 smithi146 ceph-mon[35807]: pgmap v2964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:39 smithi076 ceph-mon[35401]: pgmap v2964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:39 smithi040 ceph-mon[32397]: pgmap v2964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:41 smithi146 ceph-mon[35807]: pgmap v2965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:41 smithi076 ceph-mon[35401]: pgmap v2965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:41 smithi040 ceph-mon[32397]: pgmap v2965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 567.979925 secs 2024-07-26T13:42:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 567.979925 secs 2024-07-26T13:42:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 567.979925 secs 2024-07-26T13:42:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:43 smithi146 ceph-mon[35807]: pgmap v2966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:43 smithi076 ceph-mon[35401]: pgmap v2966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:43 smithi040 ceph-mon[32397]: pgmap v2966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:45 smithi146 ceph-mon[35807]: pgmap v2967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:45 smithi076 ceph-mon[35401]: pgmap v2967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:45 smithi040 ceph-mon[32397]: pgmap v2967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:42:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 572.980031 secs 2024-07-26T13:42:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:47 smithi146 ceph-mon[35807]: pgmap v2968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 572.980031 secs 2024-07-26T13:42:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:47 smithi076 ceph-mon[35401]: pgmap v2968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 572.980031 secs 2024-07-26T13:42:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:47 smithi040 ceph-mon[32397]: pgmap v2968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:49 smithi146 ceph-mon[35807]: pgmap v2969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:49 smithi076 ceph-mon[35401]: pgmap v2969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:49 smithi040 ceph-mon[32397]: pgmap v2969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:42:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:50 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:42:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:50 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:42:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:50 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:42:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:51 smithi146 ceph-mon[35807]: pgmap v2970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 577.980151 secs 2024-07-26T13:42:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:51 smithi076 ceph-mon[35401]: pgmap v2970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 577.980151 secs 2024-07-26T13:42:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:51 smithi040 ceph-mon[32397]: pgmap v2970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:42:51.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 577.980151 secs 2024-07-26T13:42:51.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:51.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:42:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:42:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:42:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:42:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:42:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:42:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:42:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:53 smithi076 ceph-mon[35401]: pgmap v2971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-26T13:42:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:53 smithi076 ceph-mon[35401]: pgmap v2972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:53 smithi040 ceph-mon[32397]: pgmap v2971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-26T13:42:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:53 smithi040 ceph-mon[32397]: pgmap v2972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:53 smithi146 ceph-mon[35807]: pgmap v2971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-07-26T13:42:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:53 smithi146 ceph-mon[35807]: pgmap v2972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:55 smithi040 ceph-mon[32397]: pgmap v2973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:55 smithi146 ceph-mon[35807]: pgmap v2973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:55 smithi076 ceph-mon[35401]: pgmap v2973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 582.980315 secs 2024-07-26T13:42:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 582.980315 secs 2024-07-26T13:42:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 582.980315 secs 2024-07-26T13:42:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:57 smithi040 ceph-mon[32397]: pgmap v2974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:57 smithi146 ceph-mon[35807]: pgmap v2974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:57 smithi076 ceph-mon[35401]: pgmap v2974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:42:59 smithi040 ceph-mon[32397]: pgmap v2975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:42:59 smithi146 ceph-mon[35807]: pgmap v2975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:42:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:42:59 smithi076 ceph-mon[35401]: pgmap v2975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:43:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:01 smithi040 ceph-mon[32397]: pgmap v2976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:43:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 587.980453 secs 2024-07-26T13:43:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:01 smithi146 ceph-mon[35807]: pgmap v2976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:43:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 587.980453 secs 2024-07-26T13:43:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:01 smithi076 ceph-mon[35401]: pgmap v2976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 2 op/s 2024-07-26T13:43:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 587.980453 secs 2024-07-26T13:43:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:03 smithi040 ceph-mon[32397]: pgmap v2977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:43:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:03 smithi146 ceph-mon[35807]: pgmap v2977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:43:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:03 smithi076 ceph-mon[35401]: pgmap v2977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:43:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:05 smithi040 ceph-mon[32397]: pgmap v2978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:05 smithi146 ceph-mon[35807]: pgmap v2978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:05 smithi076 ceph-mon[35401]: pgmap v2978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 592.980558 secs 2024-07-26T13:43:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 592.980558 secs 2024-07-26T13:43:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 592.980558 secs 2024-07-26T13:43:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:07 smithi040 ceph-mon[32397]: pgmap v2979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:07 smithi146 ceph-mon[35807]: pgmap v2979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:07 smithi076 ceph-mon[35401]: pgmap v2979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:09 smithi040 ceph-mon[32397]: pgmap v2980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:09 smithi146 ceph-mon[35807]: pgmap v2980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:09 smithi076 ceph-mon[35401]: pgmap v2980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:11 smithi040 ceph-mon[32397]: pgmap v2981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 597.980701 secs 2024-07-26T13:43:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:11 smithi146 ceph-mon[35807]: pgmap v2981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 597.980701 secs 2024-07-26T13:43:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:11 smithi076 ceph-mon[35401]: pgmap v2981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 597.980701 secs 2024-07-26T13:43:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:13 smithi040 ceph-mon[32397]: pgmap v2982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:13 smithi146 ceph-mon[35807]: pgmap v2982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:13 smithi076 ceph-mon[35401]: pgmap v2982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:15 smithi040 ceph-mon[32397]: pgmap v2983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:15 smithi146 ceph-mon[35807]: pgmap v2983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:15 smithi076 ceph-mon[35401]: pgmap v2983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 602.980839 secs 2024-07-26T13:43:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 602.980839 secs 2024-07-26T13:43:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 602.980839 secs 2024-07-26T13:43:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:17 smithi040 ceph-mon[32397]: pgmap v2984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:17 smithi146 ceph-mon[35807]: pgmap v2984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:17 smithi076 ceph-mon[35401]: pgmap v2984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:19 smithi040 ceph-mon[32397]: pgmap v2985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:19 smithi146 ceph-mon[35807]: pgmap v2985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:19 smithi076 ceph-mon[35401]: pgmap v2985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:21 smithi040 ceph-mon[32397]: pgmap v2986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 607.980997 secs 2024-07-26T13:43:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:21 smithi146 ceph-mon[35807]: pgmap v2986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 607.980997 secs 2024-07-26T13:43:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:21 smithi076 ceph-mon[35401]: pgmap v2986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 607.980997 secs 2024-07-26T13:43:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:23 smithi040 ceph-mon[32397]: pgmap v2987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:23 smithi146 ceph-mon[35807]: pgmap v2987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:23 smithi076 ceph-mon[35401]: pgmap v2987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:25 smithi040 ceph-mon[32397]: pgmap v2988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:25 smithi146 ceph-mon[35807]: pgmap v2988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:25 smithi076 ceph-mon[35401]: pgmap v2988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 612.981138 secs 2024-07-26T13:43:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 612.981138 secs 2024-07-26T13:43:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 612.981138 secs 2024-07-26T13:43:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:27 smithi146 ceph-mon[35807]: pgmap v2989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:27 smithi076 ceph-mon[35401]: pgmap v2989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:27 smithi040 ceph-mon[32397]: pgmap v2989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:29 smithi146 ceph-mon[35807]: pgmap v2990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:29 smithi076 ceph-mon[35401]: pgmap v2990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:29 smithi040 ceph-mon[32397]: pgmap v2990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:31 smithi146 ceph-mon[35807]: pgmap v2991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 617.981305 secs 2024-07-26T13:43:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:31 smithi076 ceph-mon[35401]: pgmap v2991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 617.981305 secs 2024-07-26T13:43:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:31 smithi040 ceph-mon[32397]: pgmap v2991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 617.981305 secs 2024-07-26T13:43:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:33 smithi146 ceph-mon[35807]: pgmap v2992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:33 smithi076 ceph-mon[35401]: pgmap v2992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:33 smithi040 ceph-mon[32397]: pgmap v2992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:35 smithi146 ceph-mon[35807]: pgmap v2993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:35 smithi076 ceph-mon[35401]: pgmap v2993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:35 smithi040 ceph-mon[32397]: pgmap v2993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:43:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 622.981449 secs 2024-07-26T13:43:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 622.981449 secs 2024-07-26T13:43:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 622.981449 secs 2024-07-26T13:43:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:37 smithi146 ceph-mon[35807]: pgmap v2994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:37 smithi076 ceph-mon[35401]: pgmap v2994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:37 smithi040 ceph-mon[32397]: pgmap v2994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:39 smithi146 ceph-mon[35807]: pgmap v2995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:39 smithi076 ceph-mon[35401]: pgmap v2995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:39 smithi040 ceph-mon[32397]: pgmap v2995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:41 smithi146 ceph-mon[35807]: pgmap v2996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 627.981580 secs 2024-07-26T13:43:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:41 smithi076 ceph-mon[35401]: pgmap v2996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 627.981580 secs 2024-07-26T13:43:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:41 smithi040 ceph-mon[32397]: pgmap v2996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 627.981580 secs 2024-07-26T13:43:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:43 smithi146 ceph-mon[35807]: pgmap v2997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:43 smithi076 ceph-mon[35401]: pgmap v2997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:43 smithi040 ceph-mon[32397]: pgmap v2997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:45 smithi146 ceph-mon[35807]: pgmap v2998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:45 smithi076 ceph-mon[35401]: pgmap v2998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:45 smithi040 ceph-mon[32397]: pgmap v2998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 632.981738 secs 2024-07-26T13:43:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 632.981738 secs 2024-07-26T13:43:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 632.981738 secs 2024-07-26T13:43:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:47 smithi076 ceph-mon[35401]: pgmap v2999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:43:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:47 smithi040 ceph-mon[32397]: pgmap v2999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:43:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:47 smithi146 ceph-mon[35807]: pgmap v2999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:43:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:49 smithi076 ceph-mon[35401]: pgmap v3000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:49 smithi040 ceph-mon[32397]: pgmap v3000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:49 smithi146 ceph-mon[35807]: pgmap v3000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:51 smithi040 ceph-mon[32397]: pgmap v3001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 637.981834 secs 2024-07-26T13:43:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:51 smithi146 ceph-mon[35807]: pgmap v3001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 637.981834 secs 2024-07-26T13:43:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:51 smithi076 ceph-mon[35401]: pgmap v3001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 637.981834 secs 2024-07-26T13:43:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:43:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:43:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:43:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:53 smithi040 ceph-mon[32397]: pgmap v3002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:53 smithi146 ceph-mon[35807]: pgmap v3002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:53 smithi076 ceph-mon[35401]: pgmap v3002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:55 smithi040 ceph-mon[32397]: pgmap v3003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:55 smithi146 ceph-mon[35807]: pgmap v3003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:55 smithi076 ceph-mon[35401]: pgmap v3003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:43:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 642.981939 secs 2024-07-26T13:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 642.981939 secs 2024-07-26T13:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 642.981939 secs 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:57 smithi040 ceph-mon[32397]: pgmap v3004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:43:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:43:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:57 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:57 smithi146 ceph-mon[35807]: pgmap v3004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:57 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:43:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:57 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:43:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:57 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:57 smithi076 ceph-mon[35401]: pgmap v3004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:43:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:57 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:43:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:57 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:43:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:57 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:43:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:58 smithi040 ceph-mon[32397]: pgmap v3005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 914 B/s rd, 1 op/s 2024-07-26T13:43:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:58 smithi040 ceph-mon[32397]: pgmap v3006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:43:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:43:58 smithi040 ceph-mon[32397]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T13:43:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:58 smithi146 ceph-mon[35807]: pgmap v3005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 914 B/s rd, 1 op/s 2024-07-26T13:43:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:58 smithi146 ceph-mon[35807]: pgmap v3006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:43:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:43:58 smithi146 ceph-mon[35807]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T13:43:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:58 smithi076 ceph-mon[35401]: pgmap v3005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 914 B/s rd, 1 op/s 2024-07-26T13:43:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:58 smithi076 ceph-mon[35401]: pgmap v3006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:43:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:43:58 smithi076 ceph-mon[35401]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-07-26T13:44:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:00 smithi040 ceph-mon[32397]: pgmap v3007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 556 B/s rd, 1 op/s 2024-07-26T13:44:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:00 smithi146 ceph-mon[35807]: pgmap v3007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 556 B/s rd, 1 op/s 2024-07-26T13:44:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:00 smithi076 ceph-mon[35401]: pgmap v3007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 556 B/s rd, 1 op/s 2024-07-26T13:44:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 647.982094 secs 2024-07-26T13:44:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:01 smithi040 ceph-mon[32397]: pgmap v3008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 647.982094 secs 2024-07-26T13:44:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:01 smithi146 ceph-mon[35807]: pgmap v3008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 647.982094 secs 2024-07-26T13:44:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:01 smithi076 ceph-mon[35401]: pgmap v3008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:04 smithi040 ceph-mon[32397]: pgmap v3009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:44:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:04 smithi146 ceph-mon[35807]: pgmap v3009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:44:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:04 smithi076 ceph-mon[35401]: pgmap v3009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:44:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:06 smithi040 ceph-mon[32397]: pgmap v3010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 652.982252 secs 2024-07-26T13:44:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:06 smithi146 ceph-mon[35807]: pgmap v3010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 652.982252 secs 2024-07-26T13:44:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:06 smithi076 ceph-mon[35401]: pgmap v3010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 652.982252 secs 2024-07-26T13:44:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:08 smithi040 ceph-mon[32397]: pgmap v3011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:44:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:08 smithi146 ceph-mon[35807]: pgmap v3011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:44:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:08 smithi076 ceph-mon[35401]: pgmap v3011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:44:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:10 smithi040 ceph-mon[32397]: pgmap v3012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:10 smithi146 ceph-mon[35807]: pgmap v3012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:10 smithi076 ceph-mon[35401]: pgmap v3012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:11.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 657.982396 secs 2024-07-26T13:44:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 657.982396 secs 2024-07-26T13:44:11.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 657.982396 secs 2024-07-26T13:44:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:12 smithi040 ceph-mon[32397]: pgmap v3013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:12 smithi146 ceph-mon[35807]: pgmap v3013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:12 smithi076 ceph-mon[35401]: pgmap v3013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:14 smithi040 ceph-mon[32397]: pgmap v3014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:14 smithi146 ceph-mon[35807]: pgmap v3014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:14.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:14 smithi076 ceph-mon[35401]: pgmap v3014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:16 smithi040 ceph-mon[32397]: pgmap v3015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 662.982534 secs 2024-07-26T13:44:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:16 smithi146 ceph-mon[35807]: pgmap v3015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 662.982534 secs 2024-07-26T13:44:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:16 smithi076 ceph-mon[35401]: pgmap v3015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 662.982534 secs 2024-07-26T13:44:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:18 smithi040 ceph-mon[32397]: pgmap v3016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:18 smithi146 ceph-mon[35807]: pgmap v3016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:18 smithi076 ceph-mon[35401]: pgmap v3016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:20 smithi040 ceph-mon[32397]: pgmap v3017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:20 smithi146 ceph-mon[35807]: pgmap v3017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:20 smithi076 ceph-mon[35401]: pgmap v3017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 667.982676 secs 2024-07-26T13:44:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 667.982676 secs 2024-07-26T13:44:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 667.982676 secs 2024-07-26T13:44:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:22 smithi040 ceph-mon[32397]: pgmap v3018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:22.511 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:22 smithi146 ceph-mon[35807]: pgmap v3018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:22.549 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:22 smithi076 ceph-mon[35401]: pgmap v3018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:24 smithi040 ceph-mon[32397]: pgmap v3019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:24 smithi146 ceph-mon[35807]: pgmap v3019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:24 smithi076 ceph-mon[35401]: pgmap v3019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:26 smithi040 ceph-mon[32397]: pgmap v3020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 672.982818 secs 2024-07-26T13:44:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:26 smithi146 ceph-mon[35807]: pgmap v3020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 672.982818 secs 2024-07-26T13:44:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:26 smithi076 ceph-mon[35401]: pgmap v3020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 672.982818 secs 2024-07-26T13:44:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:28 smithi040 ceph-mon[32397]: pgmap v3021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:28 smithi146 ceph-mon[35807]: pgmap v3021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:28 smithi076 ceph-mon[35401]: pgmap v3021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:30 smithi040 ceph-mon[32397]: pgmap v3022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:30 smithi146 ceph-mon[35807]: pgmap v3022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:30 smithi076 ceph-mon[35401]: pgmap v3022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 677.982987 secs 2024-07-26T13:44:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 677.982987 secs 2024-07-26T13:44:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 677.982987 secs 2024-07-26T13:44:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:32 smithi040 ceph-mon[32397]: pgmap v3023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:32 smithi146 ceph-mon[35807]: pgmap v3023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:32 smithi076 ceph-mon[35401]: pgmap v3023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:34 smithi040 ceph-mon[32397]: pgmap v3024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:34 smithi146 ceph-mon[35807]: pgmap v3024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:34 smithi076 ceph-mon[35401]: pgmap v3024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:36 smithi146 ceph-mon[35807]: pgmap v3025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 682.983128 secs 2024-07-26T13:44:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:36 smithi076 ceph-mon[35401]: pgmap v3025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 682.983128 secs 2024-07-26T13:44:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:36 smithi040 ceph-mon[32397]: pgmap v3025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 682.983128 secs 2024-07-26T13:44:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:38 smithi146 ceph-mon[35807]: pgmap v3026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:38 smithi076 ceph-mon[35401]: pgmap v3026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:38 smithi040 ceph-mon[32397]: pgmap v3026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:40 smithi146 ceph-mon[35807]: pgmap v3027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:40 smithi076 ceph-mon[35401]: pgmap v3027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:40 smithi040 ceph-mon[32397]: pgmap v3027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 687.983301 secs 2024-07-26T13:44:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 687.983301 secs 2024-07-26T13:44:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 687.983301 secs 2024-07-26T13:44:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:42 smithi146 ceph-mon[35807]: pgmap v3028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:42 smithi076 ceph-mon[35401]: pgmap v3028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:42 smithi040 ceph-mon[32397]: pgmap v3028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:44 smithi146 ceph-mon[35807]: pgmap v3029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:44 smithi076 ceph-mon[35401]: pgmap v3029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:44 smithi040 ceph-mon[32397]: pgmap v3029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:46 smithi146 ceph-mon[35807]: pgmap v3030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 692.983440 secs 2024-07-26T13:44:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:46 smithi076 ceph-mon[35401]: pgmap v3030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 692.983440 secs 2024-07-26T13:44:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:46 smithi040 ceph-mon[32397]: pgmap v3030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 692.983440 secs 2024-07-26T13:44:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:48 smithi146 ceph-mon[35807]: pgmap v3031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:48 smithi076 ceph-mon[35401]: pgmap v3031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:48 smithi040 ceph-mon[32397]: pgmap v3031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:50 smithi146 ceph-mon[35807]: pgmap v3032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:50 smithi076 ceph-mon[35401]: pgmap v3032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:50 smithi040 ceph-mon[32397]: pgmap v3032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:44:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 697.983538 secs 2024-07-26T13:44:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 697.983538 secs 2024-07-26T13:44:51.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 697.983538 secs 2024-07-26T13:44:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:52 smithi146 ceph-mon[35807]: pgmap v3033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:52 smithi076 ceph-mon[35401]: pgmap v3033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:52 smithi040 ceph-mon[32397]: pgmap v3033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:54 smithi146 ceph-mon[35807]: pgmap v3034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:54 smithi076 ceph-mon[35401]: pgmap v3034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:54 smithi040 ceph-mon[32397]: pgmap v3034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:56 smithi076 ceph-mon[35401]: pgmap v3035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 702.983681 secs 2024-07-26T13:44:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:56 smithi040 ceph-mon[32397]: pgmap v3035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 702.983681 secs 2024-07-26T13:44:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:56 smithi146 ceph-mon[35807]: pgmap v3035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:44:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 702.983681 secs 2024-07-26T13:44:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:58 smithi076 ceph-mon[35401]: pgmap v3036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:58 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:44:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:58 smithi040 ceph-mon[32397]: pgmap v3036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:58 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:44:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:58 smithi146 ceph-mon[35807]: pgmap v3036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:44:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:58 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:44:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:44:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:44:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:59 smithi040 ceph-mon[32397]: pgmap v3037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 2 op/s 2024-07-26T13:44:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:59 smithi040 ceph-mon[32397]: pgmap v3038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:44:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:44:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:44:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:44:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:59 smithi146 ceph-mon[35807]: pgmap v3037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 2 op/s 2024-07-26T13:44:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:59 smithi146 ceph-mon[35807]: pgmap v3038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:44:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:44:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:44:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:44:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:59 smithi076 ceph-mon[35401]: pgmap v3037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 2 op/s 2024-07-26T13:44:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:59 smithi076 ceph-mon[35401]: pgmap v3038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:44:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:44:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:45:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 707.983838 secs 2024-07-26T13:45:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:01 smithi146 ceph-mon[35807]: pgmap v3039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 707.983838 secs 2024-07-26T13:45:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:01 smithi076 ceph-mon[35401]: pgmap v3039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 707.983838 secs 2024-07-26T13:45:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:01 smithi040 ceph-mon[32397]: pgmap v3039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:03 smithi076 ceph-mon[35401]: pgmap v3040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:03 smithi040 ceph-mon[32397]: pgmap v3040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:03 smithi146 ceph-mon[35807]: pgmap v3040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:05 smithi040 ceph-mon[32397]: pgmap v3041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:05 smithi146 ceph-mon[35807]: pgmap v3041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:05 smithi076 ceph-mon[35401]: pgmap v3041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 712.983972 secs 2024-07-26T13:45:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 712.983972 secs 2024-07-26T13:45:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 712.983972 secs 2024-07-26T13:45:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:07 smithi040 ceph-mon[32397]: pgmap v3042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:07 smithi146 ceph-mon[35807]: pgmap v3042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:07 smithi076 ceph-mon[35401]: pgmap v3042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 2 op/s 2024-07-26T13:45:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:09 smithi040 ceph-mon[32397]: pgmap v3043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T13:45:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:09 smithi146 ceph-mon[35807]: pgmap v3043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T13:45:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:09 smithi076 ceph-mon[35401]: pgmap v3043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T13:45:11.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 717.984110 secs 2024-07-26T13:45:11.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:11 smithi146 ceph-mon[35807]: pgmap v3044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:45:11.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 717.984110 secs 2024-07-26T13:45:11.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:11 smithi076 ceph-mon[35401]: pgmap v3044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:45:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 717.984110 secs 2024-07-26T13:45:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:11 smithi040 ceph-mon[32397]: pgmap v3044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:45:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:13 smithi040 ceph-mon[32397]: pgmap v3045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:13 smithi146 ceph-mon[35807]: pgmap v3045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:13 smithi076 ceph-mon[35401]: pgmap v3045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:15 smithi040 ceph-mon[32397]: pgmap v3046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:15 smithi146 ceph-mon[35807]: pgmap v3046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:15 smithi076 ceph-mon[35401]: pgmap v3046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 722.984314 secs 2024-07-26T13:45:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:16 smithi040 ceph-mon[32397]: slow request 722.984313 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:45:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 722.984314 secs 2024-07-26T13:45:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:16 smithi146 ceph-mon[35807]: slow request 722.984313 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:45:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 722.984314 secs 2024-07-26T13:45:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:16 smithi076 ceph-mon[35401]: slow request 722.984313 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:45:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:17 smithi040 ceph-mon[32397]: pgmap v3047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:17 smithi146 ceph-mon[35807]: pgmap v3047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:17 smithi076 ceph-mon[35401]: pgmap v3047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:19 smithi040 ceph-mon[32397]: pgmap v3048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:19 smithi146 ceph-mon[35807]: pgmap v3048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:19 smithi076 ceph-mon[35401]: pgmap v3048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 727.984471 secs 2024-07-26T13:45:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:21 smithi040 ceph-mon[32397]: pgmap v3049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 727.984471 secs 2024-07-26T13:45:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:21 smithi146 ceph-mon[35807]: pgmap v3049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 727.984471 secs 2024-07-26T13:45:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:21 smithi076 ceph-mon[35401]: pgmap v3049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:23 smithi040 ceph-mon[32397]: pgmap v3050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:23 smithi146 ceph-mon[35807]: pgmap v3050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:23 smithi076 ceph-mon[35401]: pgmap v3050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:25 smithi040 ceph-mon[32397]: pgmap v3051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:25 smithi146 ceph-mon[35807]: pgmap v3051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:25 smithi076 ceph-mon[35401]: pgmap v3051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 732.984565 secs 2024-07-26T13:45:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:26 smithi040 ceph-mon[32397]: pgmap v3052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 732.984565 secs 2024-07-26T13:45:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:26 smithi146 ceph-mon[35807]: pgmap v3052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 732.984565 secs 2024-07-26T13:45:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:26 smithi076 ceph-mon[35401]: pgmap v3052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:29 smithi040 ceph-mon[32397]: pgmap v3053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:29 smithi146 ceph-mon[35807]: pgmap v3053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:29 smithi076 ceph-mon[35401]: pgmap v3053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 737.984711 secs 2024-07-26T13:45:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:31 smithi040 ceph-mon[32397]: pgmap v3054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 737.984711 secs 2024-07-26T13:45:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:31 smithi146 ceph-mon[35807]: pgmap v3054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 737.984711 secs 2024-07-26T13:45:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:31 smithi076 ceph-mon[35401]: pgmap v3054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:33 smithi040 ceph-mon[32397]: pgmap v3055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:33 smithi146 ceph-mon[35807]: pgmap v3055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:33 smithi076 ceph-mon[35401]: pgmap v3055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:35 smithi040 ceph-mon[32397]: pgmap v3056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:35 smithi146 ceph-mon[35807]: pgmap v3056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:35 smithi076 ceph-mon[35401]: pgmap v3056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 742.984875 secs 2024-07-26T13:45:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 742.984875 secs 2024-07-26T13:45:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 742.984875 secs 2024-07-26T13:45:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:37 smithi040 ceph-mon[32397]: pgmap v3057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:37 smithi146 ceph-mon[35807]: pgmap v3057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:37 smithi076 ceph-mon[35401]: pgmap v3057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:39 smithi040 ceph-mon[32397]: pgmap v3058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:39 smithi146 ceph-mon[35807]: pgmap v3058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:39 smithi076 ceph-mon[35401]: pgmap v3058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:41.888 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 747.985024 secs 2024-07-26T13:45:41.888 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:41 smithi076 ceph-mon[35401]: pgmap v3059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 747.985024 secs 2024-07-26T13:45:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:41 smithi040 ceph-mon[32397]: pgmap v3059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 747.985024 secs 2024-07-26T13:45:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:41 smithi146 ceph-mon[35807]: pgmap v3059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:43 smithi040 ceph-mon[32397]: pgmap v3060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:43 smithi146 ceph-mon[35807]: pgmap v3060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:43 smithi076 ceph-mon[35401]: pgmap v3060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:45 smithi040 ceph-mon[32397]: pgmap v3061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:45 smithi146 ceph-mon[35807]: pgmap v3061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:45 smithi076 ceph-mon[35401]: pgmap v3061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 752.985173 secs 2024-07-26T13:45:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 752.985173 secs 2024-07-26T13:45:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 752.985173 secs 2024-07-26T13:45:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:47 smithi040 ceph-mon[32397]: pgmap v3062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:47 smithi146 ceph-mon[35807]: pgmap v3062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:47 smithi076 ceph-mon[35401]: pgmap v3062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:49 smithi040 ceph-mon[32397]: pgmap v3063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:49 smithi146 ceph-mon[35807]: pgmap v3063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:49 smithi076 ceph-mon[35401]: pgmap v3063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:50 smithi040 ceph-mon[32397]: pgmap v3064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:50 smithi146 ceph-mon[35807]: pgmap v3064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:50 smithi076 ceph-mon[35401]: pgmap v3064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 757.985321 secs 2024-07-26T13:45:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 757.985321 secs 2024-07-26T13:45:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 757.985321 secs 2024-07-26T13:45:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:52 smithi146 ceph-mon[35807]: pgmap v3065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:52 smithi076 ceph-mon[35401]: pgmap v3065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:52 smithi040 ceph-mon[32397]: pgmap v3065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:55 smithi040 ceph-mon[32397]: pgmap v3066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:55 smithi146 ceph-mon[35807]: pgmap v3066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:55 smithi076 ceph-mon[35401]: pgmap v3066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:45:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 762.985468 secs 2024-07-26T13:45:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 762.985468 secs 2024-07-26T13:45:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 762.985468 secs 2024-07-26T13:45:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:57 smithi040 ceph-mon[32397]: pgmap v3067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:57 smithi146 ceph-mon[35807]: pgmap v3067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:57 smithi076 ceph-mon[35401]: pgmap v3067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:45:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:59 smithi040 ceph-mon[32397]: pgmap v3068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:45:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:45:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:46:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:59 smithi146 ceph-mon[35807]: pgmap v3068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:45:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:46:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:59 smithi076 ceph-mon[35401]: pgmap v3068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:45:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:46:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:46:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:46:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:46:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:46:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:46:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:46:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T13:46:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T13:46:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T13:46:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:01 smithi040 ceph-mon[32397]: pgmap v3069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-26T13:46:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:01 smithi040 ceph-mon[32397]: pgmap v3070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 767.985605 secs 2024-07-26T13:46:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:01 smithi146 ceph-mon[35807]: pgmap v3069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-26T13:46:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:01 smithi146 ceph-mon[35807]: pgmap v3070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 767.985605 secs 2024-07-26T13:46:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:01 smithi076 ceph-mon[35401]: pgmap v3069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-26T13:46:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:01 smithi076 ceph-mon[35401]: pgmap v3070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 767.985605 secs 2024-07-26T13:46:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:03 smithi040 ceph-mon[32397]: pgmap v3071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:03 smithi146 ceph-mon[35807]: pgmap v3071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:03 smithi076 ceph-mon[35401]: pgmap v3071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:05 smithi040 ceph-mon[32397]: pgmap v3072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-07-26T13:46:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:05 smithi146 ceph-mon[35807]: pgmap v3072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-07-26T13:46:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:05 smithi076 ceph-mon[35401]: pgmap v3072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-07-26T13:46:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 772.985763 secs 2024-07-26T13:46:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 772.985763 secs 2024-07-26T13:46:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 772.985763 secs 2024-07-26T13:46:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:07 smithi040 ceph-mon[32397]: pgmap v3073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:07 smithi146 ceph-mon[35807]: pgmap v3073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:07 smithi076 ceph-mon[35401]: pgmap v3073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T13:46:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:09 smithi040 ceph-mon[32397]: pgmap v3074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:46:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:09 smithi146 ceph-mon[35807]: pgmap v3074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:46:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:09 smithi076 ceph-mon[35401]: pgmap v3074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T13:46:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:10 smithi146 ceph-mon[35807]: pgmap v3075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:46:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:10 smithi076 ceph-mon[35401]: pgmap v3075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:46:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:10 smithi040 ceph-mon[32397]: pgmap v3075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T13:46:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 777.985897 secs 2024-07-26T13:46:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 777.985897 secs 2024-07-26T13:46:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 777.985897 secs 2024-07-26T13:46:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:12 smithi146 ceph-mon[35807]: pgmap v3076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:12 smithi076 ceph-mon[35401]: pgmap v3076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:12 smithi040 ceph-mon[32397]: pgmap v3076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:15 smithi146 ceph-mon[35807]: pgmap v3077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:15 smithi076 ceph-mon[35401]: pgmap v3077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:15 smithi040 ceph-mon[32397]: pgmap v3077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 782.986034 secs 2024-07-26T13:46:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:17 smithi146 ceph-mon[35807]: pgmap v3078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 782.986034 secs 2024-07-26T13:46:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:17 smithi076 ceph-mon[35401]: pgmap v3078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 782.986034 secs 2024-07-26T13:46:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:17 smithi040 ceph-mon[32397]: pgmap v3078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:19 smithi146 ceph-mon[35807]: pgmap v3079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:19 smithi076 ceph-mon[35401]: pgmap v3079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:19 smithi040 ceph-mon[32397]: pgmap v3079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:21 smithi076 ceph-mon[35401]: pgmap v3080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:21 smithi040 ceph-mon[32397]: pgmap v3080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:21 smithi146 ceph-mon[35807]: pgmap v3080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 787.986169 secs 2024-07-26T13:46:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 787.986169 secs 2024-07-26T13:46:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 787.986169 secs 2024-07-26T13:46:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:23 smithi040 ceph-mon[32397]: pgmap v3081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:23 smithi146 ceph-mon[35807]: pgmap v3081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:23 smithi076 ceph-mon[35401]: pgmap v3081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:25 smithi040 ceph-mon[32397]: pgmap v3082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:25 smithi146 ceph-mon[35807]: pgmap v3082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:25 smithi076 ceph-mon[35401]: pgmap v3082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 792.986318 secs 2024-07-26T13:46:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:27 smithi040 ceph-mon[32397]: pgmap v3083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 792.986318 secs 2024-07-26T13:46:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:27 smithi146 ceph-mon[35807]: pgmap v3083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 792.986318 secs 2024-07-26T13:46:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:27 smithi076 ceph-mon[35401]: pgmap v3083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:29 smithi040 ceph-mon[32397]: pgmap v3084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:29 smithi146 ceph-mon[35807]: pgmap v3084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:29 smithi076 ceph-mon[35401]: pgmap v3084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:31 smithi040 ceph-mon[32397]: pgmap v3085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 797.986419 secs 2024-07-26T13:46:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:31 smithi146 ceph-mon[35807]: pgmap v3085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 797.986419 secs 2024-07-26T13:46:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:31 smithi076 ceph-mon[35401]: pgmap v3085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 797.986419 secs 2024-07-26T13:46:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:33 smithi040 ceph-mon[32397]: pgmap v3086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:33 smithi146 ceph-mon[35807]: pgmap v3086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:33 smithi076 ceph-mon[35401]: pgmap v3086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:35 smithi040 ceph-mon[32397]: pgmap v3087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:35 smithi146 ceph-mon[35807]: pgmap v3087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:35 smithi076 ceph-mon[35401]: pgmap v3087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 802.986516 secs 2024-07-26T13:46:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 802.986516 secs 2024-07-26T13:46:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 802.986516 secs 2024-07-26T13:46:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:37 smithi040 ceph-mon[32397]: pgmap v3088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:37 smithi146 ceph-mon[35807]: pgmap v3088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:37 smithi076 ceph-mon[35401]: pgmap v3088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:39 smithi040 ceph-mon[32397]: pgmap v3089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:39 smithi146 ceph-mon[35807]: pgmap v3089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:39 smithi076 ceph-mon[35401]: pgmap v3089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:41 smithi040 ceph-mon[32397]: pgmap v3090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 807.986668 secs 2024-07-26T13:46:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:41 smithi146 ceph-mon[35807]: pgmap v3090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 807.986668 secs 2024-07-26T13:46:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:41 smithi076 ceph-mon[35401]: pgmap v3090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 807.986668 secs 2024-07-26T13:46:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:43 smithi040 ceph-mon[32397]: pgmap v3091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:43 smithi146 ceph-mon[35807]: pgmap v3091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:43 smithi076 ceph-mon[35401]: pgmap v3091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:45 smithi040 ceph-mon[32397]: pgmap v3092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:45 smithi146 ceph-mon[35807]: pgmap v3092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:45 smithi076 ceph-mon[35401]: pgmap v3092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 812.986814 secs 2024-07-26T13:46:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 812.986814 secs 2024-07-26T13:46:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 812.986814 secs 2024-07-26T13:46:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:47 smithi040 ceph-mon[32397]: pgmap v3093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:47 smithi146 ceph-mon[35807]: pgmap v3093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:47 smithi076 ceph-mon[35401]: pgmap v3093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:49 smithi040 ceph-mon[32397]: pgmap v3094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:49 smithi146 ceph-mon[35807]: pgmap v3094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:49 smithi076 ceph-mon[35401]: pgmap v3094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:51 smithi040 ceph-mon[32397]: pgmap v3095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 817.986992 secs 2024-07-26T13:46:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:51 smithi146 ceph-mon[35807]: pgmap v3095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 817.986992 secs 2024-07-26T13:46:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:51 smithi076 ceph-mon[35401]: pgmap v3095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 817.986992 secs 2024-07-26T13:46:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:53 smithi040 ceph-mon[32397]: pgmap v3096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:53 smithi146 ceph-mon[35807]: pgmap v3096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:53 smithi076 ceph-mon[35401]: pgmap v3096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:55 smithi040 ceph-mon[32397]: pgmap v3097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:55 smithi146 ceph-mon[35807]: pgmap v3097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:55 smithi076 ceph-mon[35401]: pgmap v3097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:46:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 822.987142 secs 2024-07-26T13:46:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 822.987142 secs 2024-07-26T13:46:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 822.987142 secs 2024-07-26T13:46:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:57 smithi146 ceph-mon[35807]: pgmap v3098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:57 smithi076 ceph-mon[35401]: pgmap v3098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:57 smithi040 ceph-mon[32397]: pgmap v3098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:46:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:46:59 smithi146 ceph-mon[35807]: pgmap v3099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:46:59 smithi076 ceph-mon[35401]: pgmap v3099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:46:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:46:59 smithi040 ceph-mon[32397]: pgmap v3099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:01 smithi146 ceph-mon[35807]: pgmap v3100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:47:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 827.987315 secs 2024-07-26T13:47:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:01 smithi076 ceph-mon[35401]: pgmap v3100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:47:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 827.987315 secs 2024-07-26T13:47:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:01 smithi040 ceph-mon[32397]: pgmap v3100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T13:47:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 827.987315 secs 2024-07-26T13:47:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:03 smithi040 ceph-mon[32397]: pgmap v3101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:03 smithi146 ceph-mon[35807]: pgmap v3101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:03 smithi076 ceph-mon[35401]: pgmap v3101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:05 smithi146 ceph-mon[35807]: pgmap v3102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:05 smithi076 ceph-mon[35401]: pgmap v3102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:05 smithi040 ceph-mon[32397]: pgmap v3102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 832.987456 secs 2024-07-26T13:47:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 832.987456 secs 2024-07-26T13:47:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 832.987456 secs 2024-07-26T13:47:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:07 smithi146 ceph-mon[35807]: pgmap v3103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:07 smithi076 ceph-mon[35401]: pgmap v3103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:07 smithi040 ceph-mon[32397]: pgmap v3103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:09 smithi146 ceph-mon[35807]: pgmap v3104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:09 smithi076 ceph-mon[35401]: pgmap v3104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:09 smithi040 ceph-mon[32397]: pgmap v3104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:11 smithi146 ceph-mon[35807]: pgmap v3105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 837.987598 secs 2024-07-26T13:47:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:11 smithi076 ceph-mon[35401]: pgmap v3105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 837.987598 secs 2024-07-26T13:47:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:11 smithi040 ceph-mon[32397]: pgmap v3105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 837.987598 secs 2024-07-26T13:47:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:13 smithi146 ceph-mon[35807]: pgmap v3106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:13 smithi076 ceph-mon[35401]: pgmap v3106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:13 smithi040 ceph-mon[32397]: pgmap v3106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:15 smithi146 ceph-mon[35807]: pgmap v3107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:15 smithi076 ceph-mon[35401]: pgmap v3107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:15 smithi040 ceph-mon[32397]: pgmap v3107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 842.987744 secs 2024-07-26T13:47:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 842.987744 secs 2024-07-26T13:47:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 842.987744 secs 2024-07-26T13:47:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:17 smithi076 ceph-mon[35401]: pgmap v3108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:17 smithi040 ceph-mon[32397]: pgmap v3108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:17 smithi146 ceph-mon[35807]: pgmap v3108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:19 smithi076 ceph-mon[35401]: pgmap v3109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:19 smithi040 ceph-mon[32397]: pgmap v3109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:19 smithi146 ceph-mon[35807]: pgmap v3109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:21 smithi040 ceph-mon[32397]: pgmap v3110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 847.987906 secs 2024-07-26T13:47:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:21 smithi146 ceph-mon[35807]: pgmap v3110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 847.987906 secs 2024-07-26T13:47:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:21 smithi076 ceph-mon[35401]: pgmap v3110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 847.987906 secs 2024-07-26T13:47:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:23 smithi040 ceph-mon[32397]: pgmap v3111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:23 smithi146 ceph-mon[35807]: pgmap v3111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:23 smithi076 ceph-mon[35401]: pgmap v3111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:25 smithi040 ceph-mon[32397]: pgmap v3112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:25 smithi146 ceph-mon[35807]: pgmap v3112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:25 smithi076 ceph-mon[35401]: pgmap v3112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:47:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 852.988050 secs 2024-07-26T13:47:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 852.988050 secs 2024-07-26T13:47:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 852.988050 secs 2024-07-26T13:47:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:27 smithi040 ceph-mon[32397]: pgmap v3113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:27 smithi146 ceph-mon[35807]: pgmap v3113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:27 smithi076 ceph-mon[35401]: pgmap v3113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:29 smithi040 ceph-mon[32397]: pgmap v3114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:29 smithi146 ceph-mon[35807]: pgmap v3114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:29 smithi076 ceph-mon[35401]: pgmap v3114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:31 smithi040 ceph-mon[32397]: pgmap v3115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 857.988193 secs 2024-07-26T13:47:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:31 smithi146 ceph-mon[35807]: pgmap v3115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 857.988193 secs 2024-07-26T13:47:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:31 smithi076 ceph-mon[35401]: pgmap v3115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 857.988193 secs 2024-07-26T13:47:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:33 smithi040 ceph-mon[32397]: pgmap v3116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:33 smithi146 ceph-mon[35807]: pgmap v3116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:33 smithi076 ceph-mon[35401]: pgmap v3116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:35 smithi040 ceph-mon[32397]: pgmap v3117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:35 smithi146 ceph-mon[35807]: pgmap v3117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:35 smithi076 ceph-mon[35401]: pgmap v3117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 862.988338 secs 2024-07-26T13:47:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 862.988338 secs 2024-07-26T13:47:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 862.988338 secs 2024-07-26T13:47:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:37 smithi040 ceph-mon[32397]: pgmap v3118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:37 smithi146 ceph-mon[35807]: pgmap v3118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:37 smithi076 ceph-mon[35401]: pgmap v3118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:39 smithi040 ceph-mon[32397]: pgmap v3119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:39 smithi146 ceph-mon[35807]: pgmap v3119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:39 smithi076 ceph-mon[35401]: pgmap v3119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:41 smithi040 ceph-mon[32397]: pgmap v3120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 867.988500 secs 2024-07-26T13:47:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:41 smithi146 ceph-mon[35807]: pgmap v3120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 867.988500 secs 2024-07-26T13:47:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:41 smithi076 ceph-mon[35401]: pgmap v3120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 867.988500 secs 2024-07-26T13:47:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:43 smithi040 ceph-mon[32397]: pgmap v3121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:43 smithi146 ceph-mon[35807]: pgmap v3121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:43 smithi076 ceph-mon[35401]: pgmap v3121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:45 smithi040 ceph-mon[32397]: pgmap v3122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:45 smithi146 ceph-mon[35807]: pgmap v3122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:45 smithi076 ceph-mon[35401]: pgmap v3122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 872.988643 secs 2024-07-26T13:47:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 872.988643 secs 2024-07-26T13:47:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 872.988643 secs 2024-07-26T13:47:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:47 smithi040 ceph-mon[32397]: pgmap v3123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:47 smithi146 ceph-mon[35807]: pgmap v3123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:47 smithi076 ceph-mon[35401]: pgmap v3123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:49 smithi040 ceph-mon[32397]: pgmap v3124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:49 smithi146 ceph-mon[35807]: pgmap v3124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:49 smithi076 ceph-mon[35401]: pgmap v3124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:51 smithi040 ceph-mon[32397]: pgmap v3125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 877.988783 secs 2024-07-26T13:47:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:51 smithi146 ceph-mon[35807]: pgmap v3125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 877.988783 secs 2024-07-26T13:47:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:51 smithi076 ceph-mon[35401]: pgmap v3125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 877.988783 secs 2024-07-26T13:47:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:53 smithi040 ceph-mon[32397]: pgmap v3126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:53 smithi146 ceph-mon[35807]: pgmap v3126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:53 smithi076 ceph-mon[35401]: pgmap v3126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:55 smithi146 ceph-mon[35807]: pgmap v3127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:55 smithi076 ceph-mon[35401]: pgmap v3127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:55 smithi040 ceph-mon[32397]: pgmap v3127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:47:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 882.988918 secs 2024-07-26T13:47:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 882.988918 secs 2024-07-26T13:47:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 882.988918 secs 2024-07-26T13:47:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:57 smithi146 ceph-mon[35807]: pgmap v3128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:57 smithi076 ceph-mon[35401]: pgmap v3128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:57 smithi040 ceph-mon[32397]: pgmap v3128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:47:59 smithi146 ceph-mon[35807]: pgmap v3129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:47:59 smithi076 ceph-mon[35401]: pgmap v3129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:47:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:47:59 smithi040 ceph-mon[32397]: pgmap v3129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:01 smithi146 ceph-mon[35807]: pgmap v3130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 887.989050 secs 2024-07-26T13:48:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:01 smithi076 ceph-mon[35401]: pgmap v3130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 887.989050 secs 2024-07-26T13:48:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:01 smithi040 ceph-mon[32397]: pgmap v3130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 887.989050 secs 2024-07-26T13:48:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:03 smithi146 ceph-mon[35807]: pgmap v3131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:03 smithi076 ceph-mon[35401]: pgmap v3131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:03 smithi040 ceph-mon[32397]: pgmap v3131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:05 smithi146 ceph-mon[35807]: pgmap v3132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:05 smithi076 ceph-mon[35401]: pgmap v3132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:05 smithi040 ceph-mon[32397]: pgmap v3132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 892.989210 secs 2024-07-26T13:48:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 892.989210 secs 2024-07-26T13:48:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 892.989210 secs 2024-07-26T13:48:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:07 smithi146 ceph-mon[35807]: pgmap v3133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:07 smithi076 ceph-mon[35401]: pgmap v3133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:07 smithi040 ceph-mon[32397]: pgmap v3133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:09 smithi146 ceph-mon[35807]: pgmap v3134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:09 smithi076 ceph-mon[35401]: pgmap v3134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:09 smithi040 ceph-mon[32397]: pgmap v3134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:11 smithi146 ceph-mon[35807]: pgmap v3135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 897.989357 secs 2024-07-26T13:48:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:11 smithi076 ceph-mon[35401]: pgmap v3135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 897.989357 secs 2024-07-26T13:48:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:11 smithi040 ceph-mon[32397]: pgmap v3135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 897.989357 secs 2024-07-26T13:48:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:13 smithi146 ceph-mon[35807]: pgmap v3136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:13 smithi076 ceph-mon[35401]: pgmap v3136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:13 smithi040 ceph-mon[32397]: pgmap v3136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:15 smithi076 ceph-mon[35401]: pgmap v3137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:15 smithi040 ceph-mon[32397]: pgmap v3137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:15 smithi146 ceph-mon[35807]: pgmap v3137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 902.989517 secs 2024-07-26T13:48:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 902.989517 secs 2024-07-26T13:48:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 902.989517 secs 2024-07-26T13:48:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:17 smithi040 ceph-mon[32397]: pgmap v3138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:17 smithi146 ceph-mon[35807]: pgmap v3138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:17 smithi076 ceph-mon[35401]: pgmap v3138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:19 smithi040 ceph-mon[32397]: pgmap v3139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:19 smithi146 ceph-mon[35807]: pgmap v3139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:19 smithi076 ceph-mon[35401]: pgmap v3139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:21 smithi040 ceph-mon[32397]: pgmap v3140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 907.989659 secs 2024-07-26T13:48:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:21 smithi146 ceph-mon[35807]: pgmap v3140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 907.989659 secs 2024-07-26T13:48:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:21 smithi076 ceph-mon[35401]: pgmap v3140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 907.989659 secs 2024-07-26T13:48:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:23 smithi040 ceph-mon[32397]: pgmap v3141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:23 smithi146 ceph-mon[35807]: pgmap v3141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:23 smithi076 ceph-mon[35401]: pgmap v3141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:25 smithi040 ceph-mon[32397]: pgmap v3142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:25 smithi146 ceph-mon[35807]: pgmap v3142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:25 smithi076 ceph-mon[35401]: pgmap v3142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 912.989822 secs 2024-07-26T13:48:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 912.989822 secs 2024-07-26T13:48:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 912.989822 secs 2024-07-26T13:48:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:27 smithi040 ceph-mon[32397]: pgmap v3143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:27 smithi146 ceph-mon[35807]: pgmap v3143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:27 smithi076 ceph-mon[35401]: pgmap v3143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:29 smithi040 ceph-mon[32397]: pgmap v3144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:29 smithi146 ceph-mon[35807]: pgmap v3144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:29 smithi076 ceph-mon[35401]: pgmap v3144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:31 smithi040 ceph-mon[32397]: pgmap v3145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 917.989957 secs 2024-07-26T13:48:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:31 smithi146 ceph-mon[35807]: pgmap v3145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 917.989957 secs 2024-07-26T13:48:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:31 smithi076 ceph-mon[35401]: pgmap v3145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 917.989957 secs 2024-07-26T13:48:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:33 smithi040 ceph-mon[32397]: pgmap v3146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:33 smithi146 ceph-mon[35807]: pgmap v3146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:33 smithi076 ceph-mon[35401]: pgmap v3146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:35 smithi040 ceph-mon[32397]: pgmap v3147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:35 smithi146 ceph-mon[35807]: pgmap v3147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:35 smithi076 ceph-mon[35401]: pgmap v3147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 922.990113 secs 2024-07-26T13:48:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 922.990113 secs 2024-07-26T13:48:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 922.990113 secs 2024-07-26T13:48:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:37 smithi040 ceph-mon[32397]: pgmap v3148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:37 smithi146 ceph-mon[35807]: pgmap v3148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:37 smithi076 ceph-mon[35401]: pgmap v3148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:39 smithi040 ceph-mon[32397]: pgmap v3149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:39 smithi146 ceph-mon[35807]: pgmap v3149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:39 smithi076 ceph-mon[35401]: pgmap v3149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:48:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:40 smithi040 ceph-mon[32397]: pgmap v3150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:40 smithi146 ceph-mon[35807]: pgmap v3150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:40 smithi076 ceph-mon[35401]: pgmap v3150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:42.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 927.990256 secs 2024-07-26T13:48:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 927.990256 secs 2024-07-26T13:48:42.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 927.990256 secs 2024-07-26T13:48:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:42 smithi040 ceph-mon[32397]: pgmap v3151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:42 smithi146 ceph-mon[35807]: pgmap v3151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:42 smithi076 ceph-mon[35401]: pgmap v3151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:45 smithi040 ceph-mon[32397]: pgmap v3152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:45 smithi146 ceph-mon[35807]: pgmap v3152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:45 smithi076 ceph-mon[35401]: pgmap v3152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 932.990402 secs 2024-07-26T13:48:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:47 smithi040 ceph-mon[32397]: pgmap v3153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 932.990402 secs 2024-07-26T13:48:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:47 smithi146 ceph-mon[35807]: pgmap v3153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 932.990402 secs 2024-07-26T13:48:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:47 smithi076 ceph-mon[35401]: pgmap v3153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:49 smithi040 ceph-mon[32397]: pgmap v3154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:49 smithi146 ceph-mon[35807]: pgmap v3154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:49 smithi076 ceph-mon[35401]: pgmap v3154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:51 smithi040 ceph-mon[32397]: pgmap v3155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 937.990545 secs 2024-07-26T13:48:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:51 smithi146 ceph-mon[35807]: pgmap v3155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 937.990545 secs 2024-07-26T13:48:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:51 smithi076 ceph-mon[35401]: pgmap v3155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 937.990545 secs 2024-07-26T13:48:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:53 smithi040 ceph-mon[32397]: pgmap v3156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:53 smithi146 ceph-mon[35807]: pgmap v3156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:53 smithi076 ceph-mon[35401]: pgmap v3156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:55 smithi040 ceph-mon[32397]: pgmap v3157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:55 smithi146 ceph-mon[35807]: pgmap v3157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:55 smithi076 ceph-mon[35401]: pgmap v3157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:48:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 942.990701 secs 2024-07-26T13:48:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 942.990701 secs 2024-07-26T13:48:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 942.990701 secs 2024-07-26T13:48:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:57 smithi040 ceph-mon[32397]: pgmap v3158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:57 smithi146 ceph-mon[35807]: pgmap v3158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:57 smithi076 ceph-mon[35401]: pgmap v3158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:48:59 smithi040 ceph-mon[32397]: pgmap v3159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:48:59 smithi146 ceph-mon[35807]: pgmap v3159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:48:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:48:59 smithi076 ceph-mon[35401]: pgmap v3159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:01 smithi040 ceph-mon[32397]: pgmap v3160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 947.990846 secs 2024-07-26T13:49:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:01 smithi146 ceph-mon[35807]: pgmap v3160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 947.990846 secs 2024-07-26T13:49:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:01 smithi076 ceph-mon[35401]: pgmap v3160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 947.990846 secs 2024-07-26T13:49:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:03 smithi040 ceph-mon[32397]: pgmap v3161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:03 smithi146 ceph-mon[35807]: pgmap v3161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:03 smithi076 ceph-mon[35401]: pgmap v3161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:05 smithi040 ceph-mon[32397]: pgmap v3162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:05 smithi146 ceph-mon[35807]: pgmap v3162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:05 smithi076 ceph-mon[35401]: pgmap v3162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 952.991005 secs 2024-07-26T13:49:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 952.991005 secs 2024-07-26T13:49:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 952.991005 secs 2024-07-26T13:49:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:07 smithi040 ceph-mon[32397]: pgmap v3163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:07 smithi146 ceph-mon[35807]: pgmap v3163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:07 smithi076 ceph-mon[35401]: pgmap v3163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:09 smithi146 ceph-mon[35807]: pgmap v3164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:09 smithi076 ceph-mon[35401]: pgmap v3164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:09 smithi040 ceph-mon[32397]: pgmap v3164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:11 smithi146 ceph-mon[35807]: pgmap v3165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 957.991154 secs 2024-07-26T13:49:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:11 smithi076 ceph-mon[35401]: pgmap v3165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 957.991154 secs 2024-07-26T13:49:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:11 smithi040 ceph-mon[32397]: pgmap v3165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 957.991154 secs 2024-07-26T13:49:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:13 smithi146 ceph-mon[35807]: pgmap v3166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:13 smithi076 ceph-mon[35401]: pgmap v3166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:13 smithi040 ceph-mon[32397]: pgmap v3166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:15 smithi146 ceph-mon[35807]: pgmap v3167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:15 smithi076 ceph-mon[35401]: pgmap v3167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:15 smithi040 ceph-mon[32397]: pgmap v3167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 962.991320 secs 2024-07-26T13:49:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 962.991320 secs 2024-07-26T13:49:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 962.991320 secs 2024-07-26T13:49:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:17 smithi146 ceph-mon[35807]: pgmap v3168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:17 smithi076 ceph-mon[35401]: pgmap v3168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:17 smithi040 ceph-mon[32397]: pgmap v3168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:19 smithi146 ceph-mon[35807]: pgmap v3169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:19 smithi076 ceph-mon[35401]: pgmap v3169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:19 smithi040 ceph-mon[32397]: pgmap v3169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:21.567 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:21 smithi040 ceph-mon[32397]: pgmap v3170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:21.567 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 967.991466 secs 2024-07-26T13:49:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:21 smithi146 ceph-mon[35807]: pgmap v3170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 967.991466 secs 2024-07-26T13:49:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:21 smithi076 ceph-mon[35401]: pgmap v3170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 967.991466 secs 2024-07-26T13:49:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:23 smithi040 ceph-mon[32397]: pgmap v3171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:23 smithi146 ceph-mon[35807]: pgmap v3171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:23 smithi076 ceph-mon[35401]: pgmap v3171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:25 smithi146 ceph-mon[35807]: pgmap v3172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:25 smithi076 ceph-mon[35401]: pgmap v3172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:25 smithi040 ceph-mon[32397]: pgmap v3172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 972.991648 secs 2024-07-26T13:49:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 972.991648 secs 2024-07-26T13:49:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 972.991648 secs 2024-07-26T13:49:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:27 smithi146 ceph-mon[35807]: pgmap v3173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:27 smithi076 ceph-mon[35401]: pgmap v3173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:27 smithi040 ceph-mon[32397]: pgmap v3173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:29.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:29 smithi076 ceph-mon[35401]: pgmap v3174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:29 smithi040 ceph-mon[32397]: pgmap v3174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:29 smithi146 ceph-mon[35807]: pgmap v3174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:31 smithi040 ceph-mon[32397]: pgmap v3175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 977.991815 secs 2024-07-26T13:49:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:31 smithi146 ceph-mon[35807]: pgmap v3175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 977.991815 secs 2024-07-26T13:49:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:31 smithi076 ceph-mon[35401]: pgmap v3175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 977.991815 secs 2024-07-26T13:49:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:33 smithi040 ceph-mon[32397]: pgmap v3176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:33 smithi146 ceph-mon[35807]: pgmap v3176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:33 smithi076 ceph-mon[35401]: pgmap v3176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:35 smithi040 ceph-mon[32397]: pgmap v3177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:35 smithi146 ceph-mon[35807]: pgmap v3177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:35 smithi076 ceph-mon[35401]: pgmap v3177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 982.991966 secs 2024-07-26T13:49:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 982.991966 secs 2024-07-26T13:49:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 982.991966 secs 2024-07-26T13:49:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:37 smithi040 ceph-mon[32397]: pgmap v3178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:37 smithi146 ceph-mon[35807]: pgmap v3178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:37 smithi076 ceph-mon[35401]: pgmap v3178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:39 smithi040 ceph-mon[32397]: pgmap v3179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:39 smithi146 ceph-mon[35807]: pgmap v3179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:39 smithi076 ceph-mon[35401]: pgmap v3179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:41 smithi040 ceph-mon[32397]: pgmap v3180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 987.992110 secs 2024-07-26T13:49:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:41 smithi146 ceph-mon[35807]: pgmap v3180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 987.992110 secs 2024-07-26T13:49:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:41 smithi076 ceph-mon[35401]: pgmap v3180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 987.992110 secs 2024-07-26T13:49:43.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:43 smithi076 ceph-mon[35401]: pgmap v3181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:43 smithi040 ceph-mon[32397]: pgmap v3181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:43 smithi146 ceph-mon[35807]: pgmap v3181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:45 smithi040 ceph-mon[32397]: pgmap v3182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:45 smithi146 ceph-mon[35807]: pgmap v3182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:45 smithi076 ceph-mon[35401]: pgmap v3182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 992.992324 secs 2024-07-26T13:49:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 992.992324 secs 2024-07-26T13:49:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 992.992324 secs 2024-07-26T13:49:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:47 smithi040 ceph-mon[32397]: pgmap v3183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:47 smithi146 ceph-mon[35807]: pgmap v3183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:47 smithi076 ceph-mon[35401]: pgmap v3183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:49 smithi040 ceph-mon[32397]: pgmap v3184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:49 smithi146 ceph-mon[35807]: pgmap v3184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:49 smithi076 ceph-mon[35401]: pgmap v3184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:51 smithi040 ceph-mon[32397]: pgmap v3185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 997.992455 secs 2024-07-26T13:49:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:51 smithi146 ceph-mon[35807]: pgmap v3185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 997.992455 secs 2024-07-26T13:49:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:51 smithi076 ceph-mon[35401]: pgmap v3185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 997.992455 secs 2024-07-26T13:49:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:53 smithi040 ceph-mon[32397]: pgmap v3186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:53 smithi146 ceph-mon[35807]: pgmap v3186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:53 smithi076 ceph-mon[35401]: pgmap v3186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:55 smithi040 ceph-mon[32397]: pgmap v3187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:55 smithi146 ceph-mon[35807]: pgmap v3187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:55 smithi076 ceph-mon[35401]: pgmap v3187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:49:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1002.992601 secs 2024-07-26T13:49:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1002.992601 secs 2024-07-26T13:49:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1002.992601 secs 2024-07-26T13:49:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:57 smithi040 ceph-mon[32397]: pgmap v3188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:57 smithi146 ceph-mon[35807]: pgmap v3188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:57 smithi076 ceph-mon[35401]: pgmap v3188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:49:59 smithi040 ceph-mon[32397]: pgmap v3189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:49:59 smithi146 ceph-mon[35807]: pgmap v3189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:49:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:49:59 smithi076 ceph-mon[35401]: pgmap v3189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.g on smithi040 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.a on smithi040 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.k on smithi076 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.e on smithi076 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.b on smithi076 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.f on smithi146 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.c on smithi146 is in error state 2024-07-26T13:50:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: daemon mds.i on smithi146 is in error state 2024-07-26T13:50:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T13:50:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: fs cephfs is degraded 2024-07-26T13:50:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T13:50:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:00 smithi040 ceph-mon[32397]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.g on smithi040 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.a on smithi040 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.k on smithi076 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.e on smithi076 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.b on smithi076 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.f on smithi146 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.c on smithi146 is in error state 2024-07-26T13:50:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: daemon mds.i on smithi146 is in error state 2024-07-26T13:50:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T13:50:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: fs cephfs is degraded 2024-07-26T13:50:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T13:50:00.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:00 smithi146 ceph-mon[35807]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.g on smithi040 is in error state 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.a on smithi040 is in error state 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.k on smithi076 is in error state 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.e on smithi076 is in error state 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.b on smithi076 is in error state 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.f on smithi146 is in error state 2024-07-26T13:50:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.c on smithi146 is in error state 2024-07-26T13:50:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: daemon mds.i on smithi146 is in error state 2024-07-26T13:50:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T13:50:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: fs cephfs is degraded 2024-07-26T13:50:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T13:50:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:00 smithi076 ceph-mon[35401]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T13:50:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:01 smithi040 ceph-mon[32397]: pgmap v3190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1007.992745 secs 2024-07-26T13:50:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:01 smithi146 ceph-mon[35807]: pgmap v3190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1007.992745 secs 2024-07-26T13:50:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:01 smithi076 ceph-mon[35401]: pgmap v3190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1007.992745 secs 2024-07-26T13:50:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:03 smithi040 ceph-mon[32397]: pgmap v3191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:03 smithi146 ceph-mon[35807]: pgmap v3191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:03 smithi076 ceph-mon[35401]: pgmap v3191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:05 smithi146 ceph-mon[35807]: pgmap v3192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:05 smithi076 ceph-mon[35401]: pgmap v3192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:05 smithi040 ceph-mon[32397]: pgmap v3192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1012.992906 secs 2024-07-26T13:50:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1012.992906 secs 2024-07-26T13:50:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1012.992906 secs 2024-07-26T13:50:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:07 smithi146 ceph-mon[35807]: pgmap v3193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:07 smithi076 ceph-mon[35401]: pgmap v3193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:07 smithi040 ceph-mon[32397]: pgmap v3193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:09 smithi146 ceph-mon[35807]: pgmap v3194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:09 smithi076 ceph-mon[35401]: pgmap v3194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:09 smithi040 ceph-mon[32397]: pgmap v3194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:11 smithi146 ceph-mon[35807]: pgmap v3195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1017.993078 secs 2024-07-26T13:50:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:11 smithi076 ceph-mon[35401]: pgmap v3195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1017.993078 secs 2024-07-26T13:50:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:11 smithi040 ceph-mon[32397]: pgmap v3195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1017.993078 secs 2024-07-26T13:50:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:13 smithi146 ceph-mon[35807]: pgmap v3196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:13 smithi076 ceph-mon[35401]: pgmap v3196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:13 smithi040 ceph-mon[32397]: pgmap v3196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:15 smithi146 ceph-mon[35807]: pgmap v3197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:15 smithi076 ceph-mon[35401]: pgmap v3197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:15 smithi040 ceph-mon[32397]: pgmap v3197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1022.993225 secs 2024-07-26T13:50:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1022.993225 secs 2024-07-26T13:50:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1022.993225 secs 2024-07-26T13:50:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:17 smithi146 ceph-mon[35807]: pgmap v3198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:17 smithi076 ceph-mon[35401]: pgmap v3198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:17 smithi040 ceph-mon[32397]: pgmap v3198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:19 smithi146 ceph-mon[35807]: pgmap v3199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:19 smithi076 ceph-mon[35401]: pgmap v3199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:19 smithi040 ceph-mon[32397]: pgmap v3199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:21 smithi146 ceph-mon[35807]: pgmap v3200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1027.993369 secs 2024-07-26T13:50:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:21 smithi076 ceph-mon[35401]: pgmap v3200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1027.993369 secs 2024-07-26T13:50:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:21 smithi040 ceph-mon[32397]: pgmap v3200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1027.993369 secs 2024-07-26T13:50:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:23 smithi146 ceph-mon[35807]: pgmap v3201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:23 smithi076 ceph-mon[35401]: pgmap v3201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:23 smithi040 ceph-mon[32397]: pgmap v3201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:25 smithi076 ceph-mon[35401]: pgmap v3202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:25 smithi040 ceph-mon[32397]: pgmap v3202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:25 smithi146 ceph-mon[35807]: pgmap v3202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1032.993508 secs 2024-07-26T13:50:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1032.993508 secs 2024-07-26T13:50:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1032.993508 secs 2024-07-26T13:50:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:27 smithi040 ceph-mon[32397]: pgmap v3203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:27 smithi146 ceph-mon[35807]: pgmap v3203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:27 smithi076 ceph-mon[35401]: pgmap v3203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:29 smithi040 ceph-mon[32397]: pgmap v3204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:29 smithi146 ceph-mon[35807]: pgmap v3204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:29 smithi076 ceph-mon[35401]: pgmap v3204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:31 smithi146 ceph-mon[35807]: pgmap v3205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:31 smithi076 ceph-mon[35401]: pgmap v3205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:31 smithi040 ceph-mon[32397]: pgmap v3205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1037.993651 secs 2024-07-26T13:50:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1037.993651 secs 2024-07-26T13:50:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1037.993651 secs 2024-07-26T13:50:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:33 smithi146 ceph-mon[35807]: pgmap v3206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:33 smithi076 ceph-mon[35401]: pgmap v3206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:33 smithi040 ceph-mon[32397]: pgmap v3206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:35 smithi040 ceph-mon[32397]: pgmap v3207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:35 smithi146 ceph-mon[35807]: pgmap v3207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:35 smithi076 ceph-mon[35401]: pgmap v3207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1042.993795 secs 2024-07-26T13:50:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1042.993795 secs 2024-07-26T13:50:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1042.993795 secs 2024-07-26T13:50:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:37 smithi040 ceph-mon[32397]: pgmap v3208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:37 smithi146 ceph-mon[35807]: pgmap v3208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:37 smithi076 ceph-mon[35401]: pgmap v3208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:39 smithi040 ceph-mon[32397]: pgmap v3209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:39 smithi146 ceph-mon[35807]: pgmap v3209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:39 smithi076 ceph-mon[35401]: pgmap v3209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:41 smithi040 ceph-mon[32397]: pgmap v3210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1047.993958 secs 2024-07-26T13:50:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:41 smithi146 ceph-mon[35807]: pgmap v3210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1047.993958 secs 2024-07-26T13:50:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:41 smithi076 ceph-mon[35401]: pgmap v3210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1047.993958 secs 2024-07-26T13:50:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:43 smithi146 ceph-mon[35807]: pgmap v3211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:43 smithi076 ceph-mon[35401]: pgmap v3211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:43 smithi040 ceph-mon[32397]: pgmap v3211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:45 smithi146 ceph-mon[35807]: pgmap v3212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:45 smithi076 ceph-mon[35401]: pgmap v3212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:45 smithi040 ceph-mon[32397]: pgmap v3212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1052.994108 secs 2024-07-26T13:50:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1052.994108 secs 2024-07-26T13:50:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1052.994108 secs 2024-07-26T13:50:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:47 smithi146 ceph-mon[35807]: pgmap v3213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:47 smithi076 ceph-mon[35401]: pgmap v3213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:47 smithi040 ceph-mon[32397]: pgmap v3213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:49 smithi146 ceph-mon[35807]: pgmap v3214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:49 smithi076 ceph-mon[35401]: pgmap v3214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:49 smithi040 ceph-mon[32397]: pgmap v3214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:51.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:51 smithi040 ceph-mon[32397]: pgmap v3215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:51.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1057.994247 secs 2024-07-26T13:50:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:51 smithi146 ceph-mon[35807]: pgmap v3215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1057.994247 secs 2024-07-26T13:50:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:51 smithi076 ceph-mon[35401]: pgmap v3215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1057.994247 secs 2024-07-26T13:50:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:53 smithi146 ceph-mon[35807]: pgmap v3216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:53 smithi076 ceph-mon[35401]: pgmap v3216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:53 smithi040 ceph-mon[32397]: pgmap v3216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:55 smithi146 ceph-mon[35807]: pgmap v3217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:55 smithi076 ceph-mon[35401]: pgmap v3217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:55 smithi040 ceph-mon[32397]: pgmap v3217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:50:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1062.994393 secs 2024-07-26T13:50:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1062.994393 secs 2024-07-26T13:50:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1062.994393 secs 2024-07-26T13:50:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:57 smithi146 ceph-mon[35807]: pgmap v3218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:57 smithi076 ceph-mon[35401]: pgmap v3218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:57 smithi040 ceph-mon[32397]: pgmap v3218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:50:59 smithi146 ceph-mon[35807]: pgmap v3219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:50:59 smithi076 ceph-mon[35401]: pgmap v3219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:50:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:50:59 smithi040 ceph-mon[32397]: pgmap v3219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:01 smithi146 ceph-mon[35807]: pgmap v3220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1067.994535 secs 2024-07-26T13:51:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:01 smithi076 ceph-mon[35401]: pgmap v3220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1067.994535 secs 2024-07-26T13:51:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:01 smithi040 ceph-mon[32397]: pgmap v3220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1067.994535 secs 2024-07-26T13:51:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:03 smithi076 ceph-mon[35401]: pgmap v3221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:03 smithi040 ceph-mon[32397]: pgmap v3221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:03 smithi146 ceph-mon[35807]: pgmap v3221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:05 smithi040 ceph-mon[32397]: pgmap v3222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:05 smithi146 ceph-mon[35807]: pgmap v3222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:05 smithi076 ceph-mon[35401]: pgmap v3222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1072.994681 secs 2024-07-26T13:51:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1072.994681 secs 2024-07-26T13:51:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1072.994681 secs 2024-07-26T13:51:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:07 smithi040 ceph-mon[32397]: pgmap v3223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:07 smithi146 ceph-mon[35807]: pgmap v3223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:07 smithi076 ceph-mon[35401]: pgmap v3223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:09 smithi040 ceph-mon[32397]: pgmap v3224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:09 smithi146 ceph-mon[35807]: pgmap v3224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:09 smithi076 ceph-mon[35401]: pgmap v3224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:11 smithi040 ceph-mon[32397]: pgmap v3225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1077.994781 secs 2024-07-26T13:51:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:11 smithi146 ceph-mon[35807]: pgmap v3225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1077.994781 secs 2024-07-26T13:51:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:11 smithi076 ceph-mon[35401]: pgmap v3225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1077.994781 secs 2024-07-26T13:51:13.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:13 smithi146 ceph-mon[35807]: pgmap v3226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:13.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:13 smithi076 ceph-mon[35401]: pgmap v3226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:13 smithi040 ceph-mon[32397]: pgmap v3226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:15 smithi040 ceph-mon[32397]: pgmap v3227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:15 smithi146 ceph-mon[35807]: pgmap v3227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:15 smithi076 ceph-mon[35401]: pgmap v3227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1082.994927 secs 2024-07-26T13:51:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1082.994927 secs 2024-07-26T13:51:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1082.994927 secs 2024-07-26T13:51:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:17 smithi040 ceph-mon[32397]: pgmap v3228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:17 smithi146 ceph-mon[35807]: pgmap v3228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:17 smithi076 ceph-mon[35401]: pgmap v3228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:19 smithi040 ceph-mon[32397]: pgmap v3229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:19 smithi146 ceph-mon[35807]: pgmap v3229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:19 smithi076 ceph-mon[35401]: pgmap v3229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:21 smithi040 ceph-mon[32397]: pgmap v3230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1087.995079 secs 2024-07-26T13:51:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:21 smithi146 ceph-mon[35807]: pgmap v3230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1087.995079 secs 2024-07-26T13:51:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:21 smithi076 ceph-mon[35401]: pgmap v3230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1087.995079 secs 2024-07-26T13:51:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:23 smithi040 ceph-mon[32397]: pgmap v3231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:23 smithi146 ceph-mon[35807]: pgmap v3231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:23 smithi076 ceph-mon[35401]: pgmap v3231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:25 smithi040 ceph-mon[32397]: pgmap v3232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:25 smithi146 ceph-mon[35807]: pgmap v3232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:25 smithi076 ceph-mon[35401]: pgmap v3232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1092.995228 secs 2024-07-26T13:51:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1092.995228 secs 2024-07-26T13:51:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1092.995228 secs 2024-07-26T13:51:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:27 smithi040 ceph-mon[32397]: pgmap v3233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:27 smithi146 ceph-mon[35807]: pgmap v3233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:27 smithi076 ceph-mon[35401]: pgmap v3233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:29 smithi040 ceph-mon[32397]: pgmap v3234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:29 smithi146 ceph-mon[35807]: pgmap v3234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:29 smithi076 ceph-mon[35401]: pgmap v3234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:31 smithi040 ceph-mon[32397]: pgmap v3235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1097.995369 secs 2024-07-26T13:51:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:31 smithi146 ceph-mon[35807]: pgmap v3235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1097.995369 secs 2024-07-26T13:51:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:31 smithi076 ceph-mon[35401]: pgmap v3235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1097.995369 secs 2024-07-26T13:51:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:33 smithi040 ceph-mon[32397]: pgmap v3236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:33 smithi146 ceph-mon[35807]: pgmap v3236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:33 smithi076 ceph-mon[35401]: pgmap v3236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:35 smithi040 ceph-mon[32397]: pgmap v3237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:35 smithi146 ceph-mon[35807]: pgmap v3237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:35 smithi076 ceph-mon[35401]: pgmap v3237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1102.995508 secs 2024-07-26T13:51:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1102.995508 secs 2024-07-26T13:51:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1102.995508 secs 2024-07-26T13:51:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:37 smithi146 ceph-mon[35807]: pgmap v3238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:37 smithi076 ceph-mon[35401]: pgmap v3238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:37 smithi040 ceph-mon[32397]: pgmap v3238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:39 smithi146 ceph-mon[35807]: pgmap v3239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:39 smithi076 ceph-mon[35401]: pgmap v3239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:39 smithi040 ceph-mon[32397]: pgmap v3239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:41 smithi146 ceph-mon[35807]: pgmap v3240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1107.995648 secs 2024-07-26T13:51:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:41 smithi076 ceph-mon[35401]: pgmap v3240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1107.995648 secs 2024-07-26T13:51:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:41 smithi040 ceph-mon[32397]: pgmap v3240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1107.995648 secs 2024-07-26T13:51:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:43 smithi146 ceph-mon[35807]: pgmap v3241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:43 smithi076 ceph-mon[35401]: pgmap v3241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:43 smithi040 ceph-mon[32397]: pgmap v3241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:45 smithi146 ceph-mon[35807]: pgmap v3242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:45 smithi076 ceph-mon[35401]: pgmap v3242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:45 smithi040 ceph-mon[32397]: pgmap v3242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1112.995788 secs 2024-07-26T13:51:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1112.995788 secs 2024-07-26T13:51:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1112.995788 secs 2024-07-26T13:51:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:47 smithi146 ceph-mon[35807]: pgmap v3243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:47 smithi076 ceph-mon[35401]: pgmap v3243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:47 smithi040 ceph-mon[32397]: pgmap v3243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:49 smithi146 ceph-mon[35807]: pgmap v3244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:49 smithi076 ceph-mon[35401]: pgmap v3244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:49 smithi040 ceph-mon[32397]: pgmap v3244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:51 smithi146 ceph-mon[35807]: pgmap v3245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1117.995943 secs 2024-07-26T13:51:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:51 smithi076 ceph-mon[35401]: pgmap v3245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1117.995943 secs 2024-07-26T13:51:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:51 smithi040 ceph-mon[32397]: pgmap v3245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1117.995943 secs 2024-07-26T13:51:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:53 smithi146 ceph-mon[35807]: pgmap v3246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:53 smithi076 ceph-mon[35401]: pgmap v3246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:53 smithi040 ceph-mon[32397]: pgmap v3246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:55 smithi146 ceph-mon[35807]: pgmap v3247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:55 smithi076 ceph-mon[35401]: pgmap v3247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:55 smithi040 ceph-mon[32397]: pgmap v3247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:51:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1122.996081 secs 2024-07-26T13:51:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1122.996081 secs 2024-07-26T13:51:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1122.996081 secs 2024-07-26T13:51:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:57 smithi040 ceph-mon[32397]: pgmap v3248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:57 smithi146 ceph-mon[35807]: pgmap v3248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:57 smithi076 ceph-mon[35401]: pgmap v3248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:51:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:51:59 smithi040 ceph-mon[32397]: pgmap v3249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:51:59 smithi146 ceph-mon[35807]: pgmap v3249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:51:59 smithi076 ceph-mon[35401]: pgmap v3249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:01 smithi040 ceph-mon[32397]: pgmap v3250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1127.996183 secs 2024-07-26T13:52:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:01 smithi146 ceph-mon[35807]: pgmap v3250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1127.996183 secs 2024-07-26T13:52:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:01 smithi076 ceph-mon[35401]: pgmap v3250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1127.996183 secs 2024-07-26T13:52:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:03 smithi040 ceph-mon[32397]: pgmap v3251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:03 smithi146 ceph-mon[35807]: pgmap v3251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:03 smithi076 ceph-mon[35401]: pgmap v3251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:05 smithi040 ceph-mon[32397]: pgmap v3252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:05 smithi146 ceph-mon[35807]: pgmap v3252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:05 smithi076 ceph-mon[35401]: pgmap v3252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1132.996353 secs 2024-07-26T13:52:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1132.996353 secs 2024-07-26T13:52:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1132.996353 secs 2024-07-26T13:52:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:07 smithi040 ceph-mon[32397]: pgmap v3253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:07 smithi146 ceph-mon[35807]: pgmap v3253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:07 smithi076 ceph-mon[35401]: pgmap v3253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:09 smithi040 ceph-mon[32397]: pgmap v3254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:09 smithi146 ceph-mon[35807]: pgmap v3254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:09 smithi076 ceph-mon[35401]: pgmap v3254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:11 smithi040 ceph-mon[32397]: pgmap v3255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1137.996497 secs 2024-07-26T13:52:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:11 smithi146 ceph-mon[35807]: pgmap v3255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1137.996497 secs 2024-07-26T13:52:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:11 smithi076 ceph-mon[35401]: pgmap v3255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1137.996497 secs 2024-07-26T13:52:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:13 smithi040 ceph-mon[32397]: pgmap v3256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:13 smithi146 ceph-mon[35807]: pgmap v3256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:13 smithi076 ceph-mon[35401]: pgmap v3256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:15 smithi040 ceph-mon[32397]: pgmap v3257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:15 smithi146 ceph-mon[35807]: pgmap v3257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:15 smithi076 ceph-mon[35401]: pgmap v3257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1142.996596 secs 2024-07-26T13:52:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1142.996596 secs 2024-07-26T13:52:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1142.996596 secs 2024-07-26T13:52:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:17 smithi040 ceph-mon[32397]: pgmap v3258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:17 smithi146 ceph-mon[35807]: pgmap v3258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:17 smithi076 ceph-mon[35401]: pgmap v3258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:19 smithi040 ceph-mon[32397]: pgmap v3259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:19 smithi146 ceph-mon[35807]: pgmap v3259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:19 smithi076 ceph-mon[35401]: pgmap v3259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:21 smithi040 ceph-mon[32397]: pgmap v3260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1147.996759 secs 2024-07-26T13:52:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:21 smithi146 ceph-mon[35807]: pgmap v3260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1147.996759 secs 2024-07-26T13:52:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:21 smithi076 ceph-mon[35401]: pgmap v3260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1147.996759 secs 2024-07-26T13:52:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:23 smithi040 ceph-mon[32397]: pgmap v3261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:23 smithi146 ceph-mon[35807]: pgmap v3261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:23 smithi076 ceph-mon[35401]: pgmap v3261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:25 smithi040 ceph-mon[32397]: pgmap v3262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:25 smithi146 ceph-mon[35807]: pgmap v3262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:25 smithi076 ceph-mon[35401]: pgmap v3262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1152.996900 secs 2024-07-26T13:52:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1152.996900 secs 2024-07-26T13:52:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1152.996900 secs 2024-07-26T13:52:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:27 smithi040 ceph-mon[32397]: pgmap v3263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:27 smithi146 ceph-mon[35807]: pgmap v3263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:27 smithi076 ceph-mon[35401]: pgmap v3263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:29 smithi040 ceph-mon[32397]: pgmap v3264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:29 smithi146 ceph-mon[35807]: pgmap v3264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:29 smithi076 ceph-mon[35401]: pgmap v3264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:31 smithi040 ceph-mon[32397]: pgmap v3265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1157.997040 secs 2024-07-26T13:52:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:31 smithi146 ceph-mon[35807]: pgmap v3265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1157.997040 secs 2024-07-26T13:52:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:31 smithi076 ceph-mon[35401]: pgmap v3265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1157.997040 secs 2024-07-26T13:52:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:33 smithi146 ceph-mon[35807]: pgmap v3266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:33 smithi076 ceph-mon[35401]: pgmap v3266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:33 smithi040 ceph-mon[32397]: pgmap v3266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:35 smithi146 ceph-mon[35807]: pgmap v3267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:35 smithi076 ceph-mon[35401]: pgmap v3267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:35 smithi040 ceph-mon[32397]: pgmap v3267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1162.997181 secs 2024-07-26T13:52:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1162.997181 secs 2024-07-26T13:52:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1162.997181 secs 2024-07-26T13:52:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:37 smithi146 ceph-mon[35807]: pgmap v3268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:37 smithi076 ceph-mon[35401]: pgmap v3268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:37 smithi040 ceph-mon[32397]: pgmap v3268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:38 smithi146 ceph-mon[35807]: pgmap v3269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:38 smithi076 ceph-mon[35401]: pgmap v3269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:38 smithi040 ceph-mon[32397]: pgmap v3269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:41 smithi146 ceph-mon[35807]: pgmap v3270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1167.997344 secs 2024-07-26T13:52:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:41 smithi076 ceph-mon[35401]: pgmap v3270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1167.997344 secs 2024-07-26T13:52:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:41 smithi040 ceph-mon[32397]: pgmap v3270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1167.997344 secs 2024-07-26T13:52:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:43 smithi146 ceph-mon[35807]: pgmap v3271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:43 smithi076 ceph-mon[35401]: pgmap v3271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:43 smithi040 ceph-mon[32397]: pgmap v3271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:45 smithi146 ceph-mon[35807]: pgmap v3272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:45 smithi076 ceph-mon[35401]: pgmap v3272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:45 smithi040 ceph-mon[32397]: pgmap v3272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1172.997493 secs 2024-07-26T13:52:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1172.997493 secs 2024-07-26T13:52:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1172.997493 secs 2024-07-26T13:52:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:47 smithi146 ceph-mon[35807]: pgmap v3273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:47 smithi076 ceph-mon[35401]: pgmap v3273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:47 smithi040 ceph-mon[32397]: pgmap v3273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:49 smithi146 ceph-mon[35807]: pgmap v3274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:52:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:49 smithi076 ceph-mon[35401]: pgmap v3274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:52:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:49 smithi040 ceph-mon[32397]: pgmap v3274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:52:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:51 smithi146 ceph-mon[35807]: pgmap v3275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1177.997640 secs 2024-07-26T13:52:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:51 smithi076 ceph-mon[35401]: pgmap v3275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1177.997640 secs 2024-07-26T13:52:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:51 smithi040 ceph-mon[32397]: pgmap v3275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1177.997640 secs 2024-07-26T13:52:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:53 smithi076 ceph-mon[35401]: pgmap v3276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:53 smithi040 ceph-mon[32397]: pgmap v3276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:53 smithi146 ceph-mon[35807]: pgmap v3276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:55 smithi076 ceph-mon[35401]: pgmap v3277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:55 smithi040 ceph-mon[32397]: pgmap v3277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:55 smithi146 ceph-mon[35807]: pgmap v3277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:52:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1182.997786 secs 2024-07-26T13:52:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1182.997786 secs 2024-07-26T13:52:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1182.997786 secs 2024-07-26T13:52:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:57 smithi040 ceph-mon[32397]: pgmap v3278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:57 smithi146 ceph-mon[35807]: pgmap v3278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:57 smithi076 ceph-mon[35401]: pgmap v3278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:52:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:52:59 smithi040 ceph-mon[32397]: pgmap v3279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:52:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:52:59 smithi146 ceph-mon[35807]: pgmap v3279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:52:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:52:59 smithi076 ceph-mon[35401]: pgmap v3279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:01 smithi040 ceph-mon[32397]: pgmap v3280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1187.997929 secs 2024-07-26T13:53:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:01 smithi146 ceph-mon[35807]: pgmap v3280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1187.997929 secs 2024-07-26T13:53:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:01 smithi076 ceph-mon[35401]: pgmap v3280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1187.997929 secs 2024-07-26T13:53:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:03 smithi040 ceph-mon[32397]: pgmap v3281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:03 smithi146 ceph-mon[35807]: pgmap v3281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:03 smithi076 ceph-mon[35401]: pgmap v3281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:05 smithi040 ceph-mon[32397]: pgmap v3282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:05 smithi146 ceph-mon[35807]: pgmap v3282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:05 smithi076 ceph-mon[35401]: pgmap v3282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1192.998076 secs 2024-07-26T13:53:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1192.998076 secs 2024-07-26T13:53:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1192.998076 secs 2024-07-26T13:53:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:07 smithi040 ceph-mon[32397]: pgmap v3283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:07 smithi146 ceph-mon[35807]: pgmap v3283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:07 smithi076 ceph-mon[35401]: pgmap v3283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:09 smithi040 ceph-mon[32397]: pgmap v3284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:09 smithi146 ceph-mon[35807]: pgmap v3284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:09 smithi076 ceph-mon[35401]: pgmap v3284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:11 smithi040 ceph-mon[32397]: pgmap v3285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1197.998184 secs 2024-07-26T13:53:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:11 smithi146 ceph-mon[35807]: pgmap v3285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1197.998184 secs 2024-07-26T13:53:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:11 smithi076 ceph-mon[35401]: pgmap v3285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1197.998184 secs 2024-07-26T13:53:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:13 smithi040 ceph-mon[32397]: pgmap v3286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:13 smithi146 ceph-mon[35807]: pgmap v3286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:13 smithi076 ceph-mon[35401]: pgmap v3286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:15 smithi040 ceph-mon[32397]: pgmap v3287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:15 smithi146 ceph-mon[35807]: pgmap v3287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:15 smithi076 ceph-mon[35401]: pgmap v3287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1202.998326 secs 2024-07-26T13:53:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1202.998326 secs 2024-07-26T13:53:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1202.998326 secs 2024-07-26T13:53:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:17 smithi040 ceph-mon[32397]: pgmap v3288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:17 smithi146 ceph-mon[35807]: pgmap v3288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:17 smithi076 ceph-mon[35401]: pgmap v3288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:19 smithi040 ceph-mon[32397]: pgmap v3289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:19 smithi146 ceph-mon[35807]: pgmap v3289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:19 smithi076 ceph-mon[35401]: pgmap v3289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:21 smithi040 ceph-mon[32397]: pgmap v3290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1207.998503 secs 2024-07-26T13:53:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:21 smithi146 ceph-mon[35807]: pgmap v3290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1207.998503 secs 2024-07-26T13:53:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:21 smithi076 ceph-mon[35401]: pgmap v3290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1207.998503 secs 2024-07-26T13:53:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:23 smithi040 ceph-mon[32397]: pgmap v3291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:23 smithi146 ceph-mon[35807]: pgmap v3291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:23 smithi076 ceph-mon[35401]: pgmap v3291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:25 smithi040 ceph-mon[32397]: pgmap v3292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:25 smithi146 ceph-mon[35807]: pgmap v3292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:25 smithi076 ceph-mon[35401]: pgmap v3292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1212.998641 secs 2024-07-26T13:53:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1212.998641 secs 2024-07-26T13:53:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1212.998641 secs 2024-07-26T13:53:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:27 smithi040 ceph-mon[32397]: pgmap v3293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:27 smithi146 ceph-mon[35807]: pgmap v3293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:27 smithi076 ceph-mon[35401]: pgmap v3293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:29 smithi146 ceph-mon[35807]: pgmap v3294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:29 smithi076 ceph-mon[35401]: pgmap v3294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:29 smithi040 ceph-mon[32397]: pgmap v3294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:31 smithi146 ceph-mon[35807]: pgmap v3295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1217.998802 secs 2024-07-26T13:53:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:31 smithi076 ceph-mon[35401]: pgmap v3295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1217.998802 secs 2024-07-26T13:53:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:31 smithi040 ceph-mon[32397]: pgmap v3295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1217.998802 secs 2024-07-26T13:53:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:33 smithi146 ceph-mon[35807]: pgmap v3296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:33 smithi076 ceph-mon[35401]: pgmap v3296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:33 smithi040 ceph-mon[32397]: pgmap v3296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:35 smithi146 ceph-mon[35807]: pgmap v3297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:35 smithi076 ceph-mon[35401]: pgmap v3297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:35 smithi040 ceph-mon[32397]: pgmap v3297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1222.998942 secs 2024-07-26T13:53:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1222.998942 secs 2024-07-26T13:53:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1222.998942 secs 2024-07-26T13:53:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:37 smithi146 ceph-mon[35807]: pgmap v3298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:37 smithi076 ceph-mon[35401]: pgmap v3298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:37 smithi040 ceph-mon[32397]: pgmap v3298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:39 smithi146 ceph-mon[35807]: pgmap v3299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:39 smithi076 ceph-mon[35401]: pgmap v3299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:39 smithi040 ceph-mon[32397]: pgmap v3299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:41 smithi146 ceph-mon[35807]: pgmap v3300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1227.999088 secs 2024-07-26T13:53:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:41 smithi076 ceph-mon[35401]: pgmap v3300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1227.999088 secs 2024-07-26T13:53:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:41 smithi040 ceph-mon[32397]: pgmap v3300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1227.999088 secs 2024-07-26T13:53:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:43 smithi146 ceph-mon[35807]: pgmap v3301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:43 smithi076 ceph-mon[35401]: pgmap v3301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:43 smithi040 ceph-mon[32397]: pgmap v3301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:45 smithi146 ceph-mon[35807]: pgmap v3302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:45 smithi076 ceph-mon[35401]: pgmap v3302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:45 smithi040 ceph-mon[32397]: pgmap v3302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1232.999241 secs 2024-07-26T13:53:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1232.999241 secs 2024-07-26T13:53:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1232.999241 secs 2024-07-26T13:53:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:47 smithi146 ceph-mon[35807]: pgmap v3303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:47 smithi076 ceph-mon[35401]: pgmap v3303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:47 smithi040 ceph-mon[32397]: pgmap v3303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:53:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:49 smithi076 ceph-mon[35401]: pgmap v3304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:49 smithi040 ceph-mon[32397]: pgmap v3304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:49 smithi146 ceph-mon[35807]: pgmap v3304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:53:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:51 smithi076 ceph-mon[35401]: pgmap v3305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:53:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1237.999388 secs 2024-07-26T13:53:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:51 smithi040 ceph-mon[32397]: pgmap v3305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:53:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1237.999388 secs 2024-07-26T13:53:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:51 smithi146 ceph-mon[35807]: pgmap v3305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:53:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1237.999388 secs 2024-07-26T13:53:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:53 smithi040 ceph-mon[32397]: pgmap v3306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:53:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:53 smithi146 ceph-mon[35807]: pgmap v3306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:53:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:53 smithi076 ceph-mon[35401]: pgmap v3306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:53:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:55 smithi040 ceph-mon[32397]: pgmap v3307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:55 smithi146 ceph-mon[35807]: pgmap v3307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:55 smithi076 ceph-mon[35401]: pgmap v3307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:53:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1242.999530 secs 2024-07-26T13:53:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1242.999530 secs 2024-07-26T13:53:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1242.999530 secs 2024-07-26T13:53:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:57 smithi040 ceph-mon[32397]: pgmap v3308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:53:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:57 smithi146 ceph-mon[35807]: pgmap v3308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:53:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:57 smithi076 ceph-mon[35401]: pgmap v3308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:53:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:53:59 smithi040 ceph-mon[32397]: pgmap v3309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:54:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:53:59 smithi146 ceph-mon[35807]: pgmap v3309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:54:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:53:59 smithi076 ceph-mon[35401]: pgmap v3309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:54:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:01 smithi040 ceph-mon[32397]: pgmap v3310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:54:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1247.999672 secs 2024-07-26T13:54:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:01 smithi146 ceph-mon[35807]: pgmap v3310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:54:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1247.999672 secs 2024-07-26T13:54:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:01 smithi076 ceph-mon[35401]: pgmap v3310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:54:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1247.999672 secs 2024-07-26T13:54:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:03 smithi040 ceph-mon[32397]: pgmap v3311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:03 smithi146 ceph-mon[35807]: pgmap v3311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:03 smithi076 ceph-mon[35401]: pgmap v3311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:05 smithi040 ceph-mon[32397]: pgmap v3312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:05 smithi146 ceph-mon[35807]: pgmap v3312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:05 smithi076 ceph-mon[35401]: pgmap v3312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1252.999766 secs 2024-07-26T13:54:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1252.999766 secs 2024-07-26T13:54:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1252.999766 secs 2024-07-26T13:54:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:07 smithi040 ceph-mon[32397]: pgmap v3313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:07 smithi146 ceph-mon[35807]: pgmap v3313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:07 smithi076 ceph-mon[35401]: pgmap v3313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:09 smithi040 ceph-mon[32397]: pgmap v3314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:09 smithi146 ceph-mon[35807]: pgmap v3314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:09 smithi076 ceph-mon[35401]: pgmap v3314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:11 smithi040 ceph-mon[32397]: pgmap v3315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1257.999911 secs 2024-07-26T13:54:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:11 smithi146 ceph-mon[35807]: pgmap v3315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1257.999911 secs 2024-07-26T13:54:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:11 smithi076 ceph-mon[35401]: pgmap v3315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1257.999911 secs 2024-07-26T13:54:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:13 smithi040 ceph-mon[32397]: pgmap v3316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:13 smithi146 ceph-mon[35807]: pgmap v3316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:13 smithi076 ceph-mon[35401]: pgmap v3316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:15 smithi040 ceph-mon[32397]: pgmap v3317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:15 smithi146 ceph-mon[35807]: pgmap v3317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:15 smithi076 ceph-mon[35401]: pgmap v3317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1263.000056 secs 2024-07-26T13:54:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1263.000056 secs 2024-07-26T13:54:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1263.000056 secs 2024-07-26T13:54:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:17 smithi040 ceph-mon[32397]: pgmap v3318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:17 smithi146 ceph-mon[35807]: pgmap v3318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:17 smithi076 ceph-mon[35401]: pgmap v3318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:19 smithi040 ceph-mon[32397]: pgmap v3319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:19 smithi146 ceph-mon[35807]: pgmap v3319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:19 smithi076 ceph-mon[35401]: pgmap v3319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:21 smithi040 ceph-mon[32397]: pgmap v3320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1268.000141 secs 2024-07-26T13:54:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:21 smithi146 ceph-mon[35807]: pgmap v3320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1268.000141 secs 2024-07-26T13:54:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:21 smithi076 ceph-mon[35401]: pgmap v3320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1268.000141 secs 2024-07-26T13:54:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:23 smithi040 ceph-mon[32397]: pgmap v3321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:23 smithi146 ceph-mon[35807]: pgmap v3321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:23 smithi076 ceph-mon[35401]: pgmap v3321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:25 smithi040 ceph-mon[32397]: pgmap v3322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:25 smithi146 ceph-mon[35807]: pgmap v3322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:25 smithi076 ceph-mon[35401]: pgmap v3322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1273.000302 secs 2024-07-26T13:54:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1273.000302 secs 2024-07-26T13:54:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1273.000302 secs 2024-07-26T13:54:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:27 smithi146 ceph-mon[35807]: pgmap v3323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:27 smithi076 ceph-mon[35401]: pgmap v3323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:28.168 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:27 smithi040 ceph-mon[32397]: pgmap v3323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:29 smithi146 ceph-mon[35807]: pgmap v3324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:29 smithi076 ceph-mon[35401]: pgmap v3324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:29 smithi040 ceph-mon[32397]: pgmap v3324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:31 smithi146 ceph-mon[35807]: pgmap v3325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:54:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1278.000439 secs 2024-07-26T13:54:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:31 smithi076 ceph-mon[35401]: pgmap v3325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:54:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1278.000439 secs 2024-07-26T13:54:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:31 smithi040 ceph-mon[32397]: pgmap v3325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:54:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1278.000439 secs 2024-07-26T13:54:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:33 smithi146 ceph-mon[35807]: pgmap v3326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:33 smithi076 ceph-mon[35401]: pgmap v3326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:33 smithi040 ceph-mon[32397]: pgmap v3326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:35 smithi146 ceph-mon[35807]: pgmap v3327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:35 smithi076 ceph-mon[35401]: pgmap v3327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:35 smithi040 ceph-mon[32397]: pgmap v3327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1283.000534 secs 2024-07-26T13:54:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1283.000534 secs 2024-07-26T13:54:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1283.000534 secs 2024-07-26T13:54:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:37 smithi146 ceph-mon[35807]: pgmap v3328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:37 smithi076 ceph-mon[35401]: pgmap v3328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:37 smithi040 ceph-mon[32397]: pgmap v3328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:38 smithi040 ceph-mon[32397]: pgmap v3329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:38 smithi146 ceph-mon[35807]: pgmap v3329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:38 smithi076 ceph-mon[35401]: pgmap v3329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:41 smithi040 ceph-mon[32397]: pgmap v3330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1288.000675 secs 2024-07-26T13:54:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:41 smithi146 ceph-mon[35807]: pgmap v3330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1288.000675 secs 2024-07-26T13:54:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:41 smithi076 ceph-mon[35401]: pgmap v3330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1288.000675 secs 2024-07-26T13:54:43.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:43 smithi146 ceph-mon[35807]: pgmap v3331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:43.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:43 smithi076 ceph-mon[35401]: pgmap v3331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:43 smithi040 ceph-mon[32397]: pgmap v3331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:45 smithi040 ceph-mon[32397]: pgmap v3332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:45 smithi146 ceph-mon[35807]: pgmap v3332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:45 smithi076 ceph-mon[35401]: pgmap v3332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1293.000821 secs 2024-07-26T13:54:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1293.000821 secs 2024-07-26T13:54:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1293.000821 secs 2024-07-26T13:54:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:47 smithi040 ceph-mon[32397]: pgmap v3333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:47 smithi146 ceph-mon[35807]: pgmap v3333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:47 smithi076 ceph-mon[35401]: pgmap v3333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:49 smithi040 ceph-mon[32397]: pgmap v3334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:49 smithi146 ceph-mon[35807]: pgmap v3334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:49 smithi076 ceph-mon[35401]: pgmap v3334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:51 smithi040 ceph-mon[32397]: pgmap v3335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1298.000966 secs 2024-07-26T13:54:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:51 smithi146 ceph-mon[35807]: pgmap v3335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1298.000966 secs 2024-07-26T13:54:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:51 smithi076 ceph-mon[35401]: pgmap v3335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1298.000966 secs 2024-07-26T13:54:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:53 smithi040 ceph-mon[32397]: pgmap v3336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:53 smithi146 ceph-mon[35807]: pgmap v3336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:53 smithi076 ceph-mon[35401]: pgmap v3336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:55 smithi040 ceph-mon[32397]: pgmap v3337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:55 smithi146 ceph-mon[35807]: pgmap v3337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:55 smithi076 ceph-mon[35401]: pgmap v3337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:54:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1303.001127 secs 2024-07-26T13:54:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1303.001127 secs 2024-07-26T13:54:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1303.001127 secs 2024-07-26T13:54:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:57 smithi040 ceph-mon[32397]: pgmap v3338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:57 smithi146 ceph-mon[35807]: pgmap v3338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:57 smithi076 ceph-mon[35401]: pgmap v3338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:54:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:54:59 smithi040 ceph-mon[32397]: pgmap v3339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:54:59 smithi146 ceph-mon[35807]: pgmap v3339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:54:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:54:59 smithi076 ceph-mon[35401]: pgmap v3339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:01 smithi040 ceph-mon[32397]: pgmap v3340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1308.001213 secs 2024-07-26T13:55:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:01 smithi146 ceph-mon[35807]: pgmap v3340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1308.001213 secs 2024-07-26T13:55:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:01 smithi076 ceph-mon[35401]: pgmap v3340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1308.001213 secs 2024-07-26T13:55:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:03 smithi040 ceph-mon[32397]: pgmap v3341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:03 smithi146 ceph-mon[35807]: pgmap v3341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:03 smithi076 ceph-mon[35401]: pgmap v3341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:05 smithi040 ceph-mon[32397]: pgmap v3342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:05 smithi146 ceph-mon[35807]: pgmap v3342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:05 smithi076 ceph-mon[35401]: pgmap v3342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1313.001354 secs 2024-07-26T13:55:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1313.001354 secs 2024-07-26T13:55:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1313.001354 secs 2024-07-26T13:55:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:07 smithi040 ceph-mon[32397]: pgmap v3343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:07 smithi146 ceph-mon[35807]: pgmap v3343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:07 smithi076 ceph-mon[35401]: pgmap v3343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:09 smithi040 ceph-mon[32397]: pgmap v3344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:09 smithi146 ceph-mon[35807]: pgmap v3344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:09 smithi076 ceph-mon[35401]: pgmap v3344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:11 smithi040 ceph-mon[32397]: pgmap v3345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1318.001497 secs 2024-07-26T13:55:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:11 smithi146 ceph-mon[35807]: pgmap v3345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1318.001497 secs 2024-07-26T13:55:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:11 smithi076 ceph-mon[35401]: pgmap v3345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1318.001497 secs 2024-07-26T13:55:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:13 smithi040 ceph-mon[32397]: pgmap v3346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:13 smithi146 ceph-mon[35807]: pgmap v3346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:13 smithi076 ceph-mon[35401]: pgmap v3346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:15 smithi146 ceph-mon[35807]: pgmap v3347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:15 smithi076 ceph-mon[35401]: pgmap v3347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:15 smithi040 ceph-mon[32397]: pgmap v3347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1323.001642 secs 2024-07-26T13:55:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1323.001642 secs 2024-07-26T13:55:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1323.001642 secs 2024-07-26T13:55:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:17 smithi146 ceph-mon[35807]: pgmap v3348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:17 smithi076 ceph-mon[35401]: pgmap v3348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:17 smithi040 ceph-mon[32397]: pgmap v3348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:19 smithi146 ceph-mon[35807]: pgmap v3349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:19 smithi076 ceph-mon[35401]: pgmap v3349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:19 smithi040 ceph-mon[32397]: pgmap v3349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:21.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:21 smithi040 ceph-mon[32397]: pgmap v3350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:21.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1328.001738 secs 2024-07-26T13:55:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:21 smithi146 ceph-mon[35807]: pgmap v3350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1328.001738 secs 2024-07-26T13:55:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:21 smithi076 ceph-mon[35401]: pgmap v3350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1328.001738 secs 2024-07-26T13:55:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:23 smithi146 ceph-mon[35807]: pgmap v3351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:23 smithi076 ceph-mon[35401]: pgmap v3351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:23 smithi040 ceph-mon[32397]: pgmap v3351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:25 smithi146 ceph-mon[35807]: pgmap v3352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:25 smithi076 ceph-mon[35401]: pgmap v3352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:25 smithi040 ceph-mon[32397]: pgmap v3352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1333.001893 secs 2024-07-26T13:55:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1333.001893 secs 2024-07-26T13:55:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1333.001893 secs 2024-07-26T13:55:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:27 smithi146 ceph-mon[35807]: pgmap v3353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:27 smithi076 ceph-mon[35401]: pgmap v3353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:27 smithi040 ceph-mon[32397]: pgmap v3353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:29 smithi146 ceph-mon[35807]: pgmap v3354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:29 smithi076 ceph-mon[35401]: pgmap v3354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:29 smithi040 ceph-mon[32397]: pgmap v3354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:31 smithi146 ceph-mon[35807]: pgmap v3355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1338.002030 secs 2024-07-26T13:55:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:31 smithi076 ceph-mon[35401]: pgmap v3355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1338.002030 secs 2024-07-26T13:55:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:31 smithi040 ceph-mon[32397]: pgmap v3355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1338.002030 secs 2024-07-26T13:55:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:33 smithi146 ceph-mon[35807]: pgmap v3356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:33 smithi076 ceph-mon[35401]: pgmap v3356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:33 smithi040 ceph-mon[32397]: pgmap v3356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:35 smithi076 ceph-mon[35401]: pgmap v3357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:35 smithi040 ceph-mon[32397]: pgmap v3357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:35 smithi146 ceph-mon[35807]: pgmap v3357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1343.002170 secs 2024-07-26T13:55:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1343.002170 secs 2024-07-26T13:55:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1343.002170 secs 2024-07-26T13:55:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:37 smithi040 ceph-mon[32397]: pgmap v3358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:37 smithi146 ceph-mon[35807]: pgmap v3358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:37 smithi076 ceph-mon[35401]: pgmap v3358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:39 smithi040 ceph-mon[32397]: pgmap v3359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:39 smithi146 ceph-mon[35807]: pgmap v3359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:39 smithi076 ceph-mon[35401]: pgmap v3359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:41 smithi040 ceph-mon[32397]: pgmap v3360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1348.002303 secs 2024-07-26T13:55:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:41 smithi146 ceph-mon[35807]: pgmap v3360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1348.002303 secs 2024-07-26T13:55:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:41 smithi076 ceph-mon[35401]: pgmap v3360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1348.002303 secs 2024-07-26T13:55:43.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:43 smithi146 ceph-mon[35807]: pgmap v3361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:43.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:43 smithi076 ceph-mon[35401]: pgmap v3361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:43 smithi040 ceph-mon[32397]: pgmap v3361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:45 smithi040 ceph-mon[32397]: pgmap v3362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:45 smithi146 ceph-mon[35807]: pgmap v3362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:45 smithi076 ceph-mon[35401]: pgmap v3362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1353.002436 secs 2024-07-26T13:55:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1353.002436 secs 2024-07-26T13:55:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1353.002436 secs 2024-07-26T13:55:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:47 smithi040 ceph-mon[32397]: pgmap v3363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:47 smithi146 ceph-mon[35807]: pgmap v3363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:47 smithi076 ceph-mon[35401]: pgmap v3363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:49 smithi040 ceph-mon[32397]: pgmap v3364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:49 smithi146 ceph-mon[35807]: pgmap v3364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:49 smithi076 ceph-mon[35401]: pgmap v3364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:55:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:51 smithi040 ceph-mon[32397]: pgmap v3365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1358.002584 secs 2024-07-26T13:55:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:51 smithi146 ceph-mon[35807]: pgmap v3365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1358.002584 secs 2024-07-26T13:55:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:51 smithi076 ceph-mon[35401]: pgmap v3365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1358.002584 secs 2024-07-26T13:55:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:53 smithi040 ceph-mon[32397]: pgmap v3366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:53 smithi146 ceph-mon[35807]: pgmap v3366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:53 smithi076 ceph-mon[35401]: pgmap v3366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:55 smithi040 ceph-mon[32397]: pgmap v3367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:55 smithi146 ceph-mon[35807]: pgmap v3367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:55 smithi076 ceph-mon[35401]: pgmap v3367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:55:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1363.002723 secs 2024-07-26T13:55:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1363.002723 secs 2024-07-26T13:55:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1363.002723 secs 2024-07-26T13:55:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:57 smithi040 ceph-mon[32397]: pgmap v3368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:57 smithi146 ceph-mon[35807]: pgmap v3368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:57 smithi076 ceph-mon[35401]: pgmap v3368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:55:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:55:59 smithi040 ceph-mon[32397]: pgmap v3369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:55:59 smithi146 ceph-mon[35807]: pgmap v3369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:55:59 smithi076 ceph-mon[35401]: pgmap v3369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:01 smithi040 ceph-mon[32397]: pgmap v3370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1368.002869 secs 2024-07-26T13:56:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:01 smithi146 ceph-mon[35807]: pgmap v3370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1368.002869 secs 2024-07-26T13:56:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:01 smithi076 ceph-mon[35401]: pgmap v3370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1368.002869 secs 2024-07-26T13:56:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:03 smithi040 ceph-mon[32397]: pgmap v3371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:03 smithi146 ceph-mon[35807]: pgmap v3371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:03 smithi076 ceph-mon[35401]: pgmap v3371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:05 smithi040 ceph-mon[32397]: pgmap v3372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:05 smithi146 ceph-mon[35807]: pgmap v3372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:05 smithi076 ceph-mon[35401]: pgmap v3372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1373.002955 secs 2024-07-26T13:56:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1373.002955 secs 2024-07-26T13:56:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1373.002955 secs 2024-07-26T13:56:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:07 smithi040 ceph-mon[32397]: pgmap v3373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:07 smithi146 ceph-mon[35807]: pgmap v3373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:07 smithi076 ceph-mon[35401]: pgmap v3373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:09 smithi040 ceph-mon[32397]: pgmap v3374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:09 smithi146 ceph-mon[35807]: pgmap v3374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:09 smithi076 ceph-mon[35401]: pgmap v3374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:11 smithi146 ceph-mon[35807]: pgmap v3375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1378.003097 secs 2024-07-26T13:56:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:11 smithi076 ceph-mon[35401]: pgmap v3375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1378.003097 secs 2024-07-26T13:56:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:11 smithi040 ceph-mon[32397]: pgmap v3375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1378.003097 secs 2024-07-26T13:56:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:13 smithi146 ceph-mon[35807]: pgmap v3376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:13 smithi076 ceph-mon[35401]: pgmap v3376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:13 smithi040 ceph-mon[32397]: pgmap v3376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:15 smithi146 ceph-mon[35807]: pgmap v3377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:15 smithi076 ceph-mon[35401]: pgmap v3377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:15 smithi040 ceph-mon[32397]: pgmap v3377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1383.003256 secs 2024-07-26T13:56:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1383.003256 secs 2024-07-26T13:56:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1383.003256 secs 2024-07-26T13:56:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:17 smithi146 ceph-mon[35807]: pgmap v3378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:18.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:17 smithi076 ceph-mon[35401]: pgmap v3378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:17 smithi040 ceph-mon[32397]: pgmap v3378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:19 smithi146 ceph-mon[35807]: pgmap v3379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:19 smithi076 ceph-mon[35401]: pgmap v3379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:19 smithi040 ceph-mon[32397]: pgmap v3379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:22.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:21 smithi040 ceph-mon[32397]: pgmap v3380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:22.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1388.003397 secs 2024-07-26T13:56:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:21 smithi146 ceph-mon[35807]: pgmap v3380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1388.003397 secs 2024-07-26T13:56:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:21 smithi076 ceph-mon[35401]: pgmap v3380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1388.003397 secs 2024-07-26T13:56:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:23 smithi146 ceph-mon[35807]: pgmap v3381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:23 smithi076 ceph-mon[35401]: pgmap v3381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:23 smithi040 ceph-mon[32397]: pgmap v3381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:25 smithi146 ceph-mon[35807]: pgmap v3382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:25 smithi076 ceph-mon[35401]: pgmap v3382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:25 smithi040 ceph-mon[32397]: pgmap v3382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1393.003536 secs 2024-07-26T13:56:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1393.003536 secs 2024-07-26T13:56:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1393.003536 secs 2024-07-26T13:56:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:27 smithi146 ceph-mon[35807]: pgmap v3383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:27 smithi076 ceph-mon[35401]: pgmap v3383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:27 smithi040 ceph-mon[32397]: pgmap v3383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:28 smithi040 ceph-mon[32397]: pgmap v3384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:28 smithi146 ceph-mon[35807]: pgmap v3384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:28 smithi076 ceph-mon[35401]: pgmap v3384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:31 smithi040 ceph-mon[32397]: pgmap v3385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1398.003681 secs 2024-07-26T13:56:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:31 smithi146 ceph-mon[35807]: pgmap v3385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1398.003681 secs 2024-07-26T13:56:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:31 smithi076 ceph-mon[35401]: pgmap v3385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1398.003681 secs 2024-07-26T13:56:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:33 smithi040 ceph-mon[32397]: pgmap v3386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:33 smithi146 ceph-mon[35807]: pgmap v3386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:33 smithi076 ceph-mon[35401]: pgmap v3386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:35 smithi040 ceph-mon[32397]: pgmap v3387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:35 smithi146 ceph-mon[35807]: pgmap v3387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:35 smithi076 ceph-mon[35401]: pgmap v3387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1403.003770 secs 2024-07-26T13:56:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1403.003770 secs 2024-07-26T13:56:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1403.003770 secs 2024-07-26T13:56:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:37 smithi040 ceph-mon[32397]: pgmap v3388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:37 smithi146 ceph-mon[35807]: pgmap v3388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:37 smithi076 ceph-mon[35401]: pgmap v3388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:39 smithi040 ceph-mon[32397]: pgmap v3389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:39 smithi146 ceph-mon[35807]: pgmap v3389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:39 smithi076 ceph-mon[35401]: pgmap v3389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:41 smithi040 ceph-mon[32397]: pgmap v3390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1408.003910 secs 2024-07-26T13:56:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:41 smithi146 ceph-mon[35807]: pgmap v3390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1408.003910 secs 2024-07-26T13:56:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:41 smithi076 ceph-mon[35401]: pgmap v3390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1408.003910 secs 2024-07-26T13:56:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:43 smithi040 ceph-mon[32397]: pgmap v3391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:43 smithi146 ceph-mon[35807]: pgmap v3391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:43 smithi076 ceph-mon[35401]: pgmap v3391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:45 smithi040 ceph-mon[32397]: pgmap v3392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:45 smithi146 ceph-mon[35807]: pgmap v3392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:45 smithi076 ceph-mon[35401]: pgmap v3392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1413.004066 secs 2024-07-26T13:56:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1413.004066 secs 2024-07-26T13:56:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1413.004066 secs 2024-07-26T13:56:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:47 smithi040 ceph-mon[32397]: pgmap v3393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:47 smithi146 ceph-mon[35807]: pgmap v3393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:47 smithi076 ceph-mon[35401]: pgmap v3393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:49 smithi040 ceph-mon[32397]: pgmap v3394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:49 smithi146 ceph-mon[35807]: pgmap v3394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:49 smithi076 ceph-mon[35401]: pgmap v3394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:51 smithi146 ceph-mon[35807]: pgmap v3395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1418.004224 secs 2024-07-26T13:56:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:51 smithi076 ceph-mon[35401]: pgmap v3395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1418.004224 secs 2024-07-26T13:56:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:51 smithi040 ceph-mon[32397]: pgmap v3395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1418.004224 secs 2024-07-26T13:56:53.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:53 smithi040 ceph-mon[32397]: pgmap v3396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:53 smithi146 ceph-mon[35807]: pgmap v3396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:53 smithi076 ceph-mon[35401]: pgmap v3396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:55 smithi146 ceph-mon[35807]: pgmap v3397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:55 smithi076 ceph-mon[35401]: pgmap v3397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:55 smithi040 ceph-mon[32397]: pgmap v3397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:56:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1423.004366 secs 2024-07-26T13:56:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1423.004366 secs 2024-07-26T13:56:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1423.004366 secs 2024-07-26T13:56:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:57 smithi146 ceph-mon[35807]: pgmap v3398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:57 smithi076 ceph-mon[35401]: pgmap v3398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:57 smithi040 ceph-mon[32397]: pgmap v3398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:56:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:56:59 smithi146 ceph-mon[35807]: pgmap v3399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:56:59 smithi076 ceph-mon[35401]: pgmap v3399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:56:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:56:59 smithi040 ceph-mon[32397]: pgmap v3399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:01 smithi040 ceph-mon[32397]: pgmap v3400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:01 smithi146 ceph-mon[35807]: pgmap v3400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:01 smithi076 ceph-mon[35401]: pgmap v3400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1428.004509 secs 2024-07-26T13:57:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1428.004509 secs 2024-07-26T13:57:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1428.004509 secs 2024-07-26T13:57:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:03 smithi040 ceph-mon[32397]: pgmap v3401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:03 smithi146 ceph-mon[35807]: pgmap v3401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:03 smithi076 ceph-mon[35401]: pgmap v3401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:05 smithi040 ceph-mon[32397]: pgmap v3402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:05 smithi146 ceph-mon[35807]: pgmap v3402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:05 smithi076 ceph-mon[35401]: pgmap v3402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1433.004605 secs 2024-07-26T13:57:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1433.004605 secs 2024-07-26T13:57:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1433.004605 secs 2024-07-26T13:57:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:07 smithi040 ceph-mon[32397]: pgmap v3403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:07 smithi146 ceph-mon[35807]: pgmap v3403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:07 smithi076 ceph-mon[35401]: pgmap v3403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:09 smithi040 ceph-mon[32397]: pgmap v3404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:09 smithi146 ceph-mon[35807]: pgmap v3404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:09 smithi076 ceph-mon[35401]: pgmap v3404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:11 smithi040 ceph-mon[32397]: pgmap v3405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1438.004773 secs 2024-07-26T13:57:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:11 smithi146 ceph-mon[35807]: pgmap v3405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1438.004773 secs 2024-07-26T13:57:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:11 smithi076 ceph-mon[35401]: pgmap v3405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1438.004773 secs 2024-07-26T13:57:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:13 smithi040 ceph-mon[32397]: pgmap v3406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:13 smithi146 ceph-mon[35807]: pgmap v3406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:13 smithi076 ceph-mon[35401]: pgmap v3406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:15 smithi040 ceph-mon[32397]: pgmap v3407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:15.891 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:15 smithi076 ceph-mon[35401]: pgmap v3407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:15.891 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:15 smithi146 ceph-mon[35807]: pgmap v3407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 1443.004918 secs 2024-07-26T13:57:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:16 smithi040 ceph-mon[32397]: slow request 1443.004917 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:57:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 1443.004918 secs 2024-07-26T13:57:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:16 smithi146 ceph-mon[35807]: slow request 1443.004917 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:57:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 1443.004918 secs 2024-07-26T13:57:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:16 smithi076 ceph-mon[35401]: slow request 1443.004917 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T13:57:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:17 smithi040 ceph-mon[32397]: pgmap v3408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:17 smithi146 ceph-mon[35807]: pgmap v3408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:17 smithi076 ceph-mon[35401]: pgmap v3408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:19 smithi040 ceph-mon[32397]: pgmap v3409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:19 smithi146 ceph-mon[35807]: pgmap v3409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:19 smithi076 ceph-mon[35401]: pgmap v3409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:21 smithi146 ceph-mon[35807]: pgmap v3410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1448.005059 secs 2024-07-26T13:57:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:21 smithi076 ceph-mon[35401]: pgmap v3410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1448.005059 secs 2024-07-26T13:57:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:21 smithi040 ceph-mon[32397]: pgmap v3410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1448.005059 secs 2024-07-26T13:57:23.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:23 smithi040 ceph-mon[32397]: pgmap v3411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:23 smithi146 ceph-mon[35807]: pgmap v3411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:23 smithi076 ceph-mon[35401]: pgmap v3411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:25 smithi146 ceph-mon[35807]: pgmap v3412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:25 smithi076 ceph-mon[35401]: pgmap v3412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:25 smithi040 ceph-mon[32397]: pgmap v3412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1453.005203 secs 2024-07-26T13:57:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1453.005203 secs 2024-07-26T13:57:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1453.005203 secs 2024-07-26T13:57:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:27 smithi146 ceph-mon[35807]: pgmap v3413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:27 smithi076 ceph-mon[35401]: pgmap v3413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:27 smithi040 ceph-mon[32397]: pgmap v3413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:29 smithi146 ceph-mon[35807]: pgmap v3414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:29 smithi076 ceph-mon[35401]: pgmap v3414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:29 smithi040 ceph-mon[32397]: pgmap v3414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:31 smithi146 ceph-mon[35807]: pgmap v3415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1458.005353 secs 2024-07-26T13:57:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:31 smithi076 ceph-mon[35401]: pgmap v3415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1458.005353 secs 2024-07-26T13:57:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:31 smithi040 ceph-mon[32397]: pgmap v3415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1458.005353 secs 2024-07-26T13:57:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:33 smithi146 ceph-mon[35807]: pgmap v3416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:33 smithi076 ceph-mon[35401]: pgmap v3416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:33 smithi040 ceph-mon[32397]: pgmap v3416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:35 smithi146 ceph-mon[35807]: pgmap v3417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:35.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:35 smithi076 ceph-mon[35401]: pgmap v3417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:35 smithi040 ceph-mon[32397]: pgmap v3417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1463.005489 secs 2024-07-26T13:57:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1463.005489 secs 2024-07-26T13:57:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1463.005489 secs 2024-07-26T13:57:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:37 smithi146 ceph-mon[35807]: pgmap v3418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:37 smithi076 ceph-mon[35401]: pgmap v3418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:37 smithi040 ceph-mon[32397]: pgmap v3418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:39 smithi076 ceph-mon[35401]: pgmap v3419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:39 smithi040 ceph-mon[32397]: pgmap v3419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:39 smithi146 ceph-mon[35807]: pgmap v3419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:41 smithi076 ceph-mon[35401]: pgmap v3420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1468.005639 secs 2024-07-26T13:57:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:41 smithi040 ceph-mon[32397]: pgmap v3420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1468.005639 secs 2024-07-26T13:57:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:41 smithi146 ceph-mon[35807]: pgmap v3420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1468.005639 secs 2024-07-26T13:57:43.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:43 smithi146 ceph-mon[35807]: pgmap v3421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:43 smithi040 ceph-mon[32397]: pgmap v3421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:43 smithi076 ceph-mon[35401]: pgmap v3421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:45 smithi040 ceph-mon[32397]: pgmap v3422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:45 smithi146 ceph-mon[35807]: pgmap v3422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:45 smithi076 ceph-mon[35401]: pgmap v3422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1473.005773 secs 2024-07-26T13:57:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1473.005773 secs 2024-07-26T13:57:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1473.005773 secs 2024-07-26T13:57:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:47 smithi040 ceph-mon[32397]: pgmap v3423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:47 smithi146 ceph-mon[35807]: pgmap v3423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:47 smithi076 ceph-mon[35401]: pgmap v3423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:49 smithi040 ceph-mon[32397]: pgmap v3424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:49 smithi146 ceph-mon[35807]: pgmap v3424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:49 smithi076 ceph-mon[35401]: pgmap v3424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:57:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:51 smithi040 ceph-mon[32397]: pgmap v3425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1478.005914 secs 2024-07-26T13:57:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:51 smithi146 ceph-mon[35807]: pgmap v3425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1478.005914 secs 2024-07-26T13:57:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:51 smithi076 ceph-mon[35401]: pgmap v3425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1478.005914 secs 2024-07-26T13:57:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:53 smithi040 ceph-mon[32397]: pgmap v3426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:53 smithi146 ceph-mon[35807]: pgmap v3426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:53 smithi076 ceph-mon[35401]: pgmap v3426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:55 smithi040 ceph-mon[32397]: pgmap v3427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:55 smithi146 ceph-mon[35807]: pgmap v3427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:55 smithi076 ceph-mon[35401]: pgmap v3427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:57:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1483.006053 secs 2024-07-26T13:57:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1483.006053 secs 2024-07-26T13:57:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1483.006053 secs 2024-07-26T13:57:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:57 smithi040 ceph-mon[32397]: pgmap v3428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:57 smithi146 ceph-mon[35807]: pgmap v3428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:57 smithi076 ceph-mon[35401]: pgmap v3428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:57:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:57:59 smithi040 ceph-mon[32397]: pgmap v3429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:57:59 smithi146 ceph-mon[35807]: pgmap v3429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:57:59 smithi076 ceph-mon[35401]: pgmap v3429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:01 smithi040 ceph-mon[32397]: pgmap v3430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1488.006156 secs 2024-07-26T13:58:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:01 smithi146 ceph-mon[35807]: pgmap v3430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1488.006156 secs 2024-07-26T13:58:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:01 smithi076 ceph-mon[35401]: pgmap v3430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1488.006156 secs 2024-07-26T13:58:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:03 smithi040 ceph-mon[32397]: pgmap v3431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:03 smithi146 ceph-mon[35807]: pgmap v3431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:03 smithi076 ceph-mon[35401]: pgmap v3431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:05 smithi040 ceph-mon[32397]: pgmap v3432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:05 smithi146 ceph-mon[35807]: pgmap v3432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:05 smithi076 ceph-mon[35401]: pgmap v3432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1493.006302 secs 2024-07-26T13:58:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1493.006302 secs 2024-07-26T13:58:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1493.006302 secs 2024-07-26T13:58:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:07 smithi040 ceph-mon[32397]: pgmap v3433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:07 smithi146 ceph-mon[35807]: pgmap v3433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:07 smithi076 ceph-mon[35401]: pgmap v3433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:09 smithi040 ceph-mon[32397]: pgmap v3434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:09 smithi146 ceph-mon[35807]: pgmap v3434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:09 smithi076 ceph-mon[35401]: pgmap v3434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:11 smithi040 ceph-mon[32397]: pgmap v3435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1498.006448 secs 2024-07-26T13:58:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:11 smithi146 ceph-mon[35807]: pgmap v3435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1498.006448 secs 2024-07-26T13:58:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:11 smithi076 ceph-mon[35401]: pgmap v3435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1498.006448 secs 2024-07-26T13:58:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:13 smithi040 ceph-mon[32397]: pgmap v3436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:13 smithi146 ceph-mon[35807]: pgmap v3436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:13 smithi076 ceph-mon[35401]: pgmap v3436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:15 smithi040 ceph-mon[32397]: pgmap v3437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:15 smithi146 ceph-mon[35807]: pgmap v3437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:15 smithi076 ceph-mon[35401]: pgmap v3437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1503.006589 secs 2024-07-26T13:58:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1503.006589 secs 2024-07-26T13:58:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1503.006589 secs 2024-07-26T13:58:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:17 smithi146 ceph-mon[35807]: pgmap v3438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:17 smithi076 ceph-mon[35401]: pgmap v3438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:17 smithi040 ceph-mon[32397]: pgmap v3438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:19 smithi146 ceph-mon[35807]: pgmap v3439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:19 smithi076 ceph-mon[35401]: pgmap v3439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:19 smithi040 ceph-mon[32397]: pgmap v3439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:21 smithi146 ceph-mon[35807]: pgmap v3440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1508.006738 secs 2024-07-26T13:58:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:21 smithi076 ceph-mon[35401]: pgmap v3440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1508.006738 secs 2024-07-26T13:58:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:21 smithi040 ceph-mon[32397]: pgmap v3440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1508.006738 secs 2024-07-26T13:58:24.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:23 smithi040 ceph-mon[32397]: pgmap v3441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:23 smithi146 ceph-mon[35807]: pgmap v3441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:23 smithi076 ceph-mon[35401]: pgmap v3441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:25 smithi146 ceph-mon[35807]: pgmap v3442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:25 smithi076 ceph-mon[35401]: pgmap v3442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:25 smithi040 ceph-mon[32397]: pgmap v3442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1513.006876 secs 2024-07-26T13:58:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1513.006876 secs 2024-07-26T13:58:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1513.006876 secs 2024-07-26T13:58:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:27 smithi146 ceph-mon[35807]: pgmap v3443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:27 smithi076 ceph-mon[35401]: pgmap v3443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:27 smithi040 ceph-mon[32397]: pgmap v3443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:29 smithi146 ceph-mon[35807]: pgmap v3444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:29 smithi076 ceph-mon[35401]: pgmap v3444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:29 smithi040 ceph-mon[32397]: pgmap v3444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:31 smithi146 ceph-mon[35807]: pgmap v3445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1518.007028 secs 2024-07-26T13:58:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:31 smithi076 ceph-mon[35401]: pgmap v3445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1518.007028 secs 2024-07-26T13:58:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:31 smithi040 ceph-mon[32397]: pgmap v3445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1518.007028 secs 2024-07-26T13:58:34.059 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:33 smithi040 ceph-mon[32397]: pgmap v3446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:33 smithi146 ceph-mon[35807]: pgmap v3446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:33 smithi076 ceph-mon[35401]: pgmap v3446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:35 smithi146 ceph-mon[35807]: pgmap v3447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:35 smithi076 ceph-mon[35401]: pgmap v3447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:35 smithi040 ceph-mon[32397]: pgmap v3447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1523.007151 secs 2024-07-26T13:58:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1523.007151 secs 2024-07-26T13:58:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1523.007151 secs 2024-07-26T13:58:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:37 smithi076 ceph-mon[35401]: pgmap v3448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:37 smithi040 ceph-mon[32397]: pgmap v3448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:37 smithi146 ceph-mon[35807]: pgmap v3448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:39 smithi040 ceph-mon[32397]: pgmap v3449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:39 smithi146 ceph-mon[35807]: pgmap v3449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:39 smithi076 ceph-mon[35401]: pgmap v3449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:41 smithi040 ceph-mon[32397]: pgmap v3450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1528.007332 secs 2024-07-26T13:58:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:41 smithi146 ceph-mon[35807]: pgmap v3450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1528.007332 secs 2024-07-26T13:58:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:41 smithi076 ceph-mon[35401]: pgmap v3450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1528.007332 secs 2024-07-26T13:58:43.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:42 smithi146 ceph-mon[35807]: pgmap v3451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:42 smithi040 ceph-mon[32397]: pgmap v3451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:43.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:42 smithi076 ceph-mon[35401]: pgmap v3451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:45 smithi040 ceph-mon[32397]: pgmap v3452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:45 smithi146 ceph-mon[35807]: pgmap v3452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:45 smithi076 ceph-mon[35401]: pgmap v3452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1533.007473 secs 2024-07-26T13:58:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1533.007473 secs 2024-07-26T13:58:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1533.007473 secs 2024-07-26T13:58:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:47 smithi146 ceph-mon[35807]: pgmap v3453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:47 smithi076 ceph-mon[35401]: pgmap v3453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:47 smithi040 ceph-mon[32397]: pgmap v3453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:49 smithi146 ceph-mon[35807]: pgmap v3454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:49 smithi076 ceph-mon[35401]: pgmap v3454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:49 smithi040 ceph-mon[32397]: pgmap v3454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:51 smithi146 ceph-mon[35807]: pgmap v3455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1538.007615 secs 2024-07-26T13:58:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:51 smithi076 ceph-mon[35401]: pgmap v3455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1538.007615 secs 2024-07-26T13:58:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:51 smithi040 ceph-mon[32397]: pgmap v3455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1538.007615 secs 2024-07-26T13:58:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:53 smithi146 ceph-mon[35807]: pgmap v3456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:53 smithi076 ceph-mon[35401]: pgmap v3456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:53 smithi040 ceph-mon[32397]: pgmap v3456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:55.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:55 smithi040 ceph-mon[32397]: pgmap v3457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:55 smithi146 ceph-mon[35807]: pgmap v3457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:55 smithi076 ceph-mon[35401]: pgmap v3457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:58:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1543.007758 secs 2024-07-26T13:58:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1543.007758 secs 2024-07-26T13:58:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1543.007758 secs 2024-07-26T13:58:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:57 smithi146 ceph-mon[35807]: pgmap v3458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:57 smithi076 ceph-mon[35401]: pgmap v3458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:57 smithi040 ceph-mon[32397]: pgmap v3458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:58:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:58:59 smithi146 ceph-mon[35807]: pgmap v3459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:58:59 smithi076 ceph-mon[35401]: pgmap v3459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:58:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:58:59 smithi040 ceph-mon[32397]: pgmap v3459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1548.007922 secs 2024-07-26T13:59:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:01 smithi146 ceph-mon[35807]: pgmap v3460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1548.007922 secs 2024-07-26T13:59:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:01 smithi076 ceph-mon[35401]: pgmap v3460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1548.007922 secs 2024-07-26T13:59:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:01 smithi040 ceph-mon[32397]: pgmap v3460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:03 smithi146 ceph-mon[35807]: pgmap v3461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:03 smithi076 ceph-mon[35401]: pgmap v3461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:03 smithi040 ceph-mon[32397]: pgmap v3461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:05 smithi076 ceph-mon[35401]: pgmap v3462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:05 smithi040 ceph-mon[32397]: pgmap v3462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:05 smithi146 ceph-mon[35807]: pgmap v3462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1553.008091 secs 2024-07-26T13:59:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1553.008091 secs 2024-07-26T13:59:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1553.008091 secs 2024-07-26T13:59:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:07 smithi040 ceph-mon[32397]: pgmap v3463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:07 smithi146 ceph-mon[35807]: pgmap v3463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:07 smithi076 ceph-mon[35401]: pgmap v3463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:09 smithi040 ceph-mon[32397]: pgmap v3464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:09 smithi146 ceph-mon[35807]: pgmap v3464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:09 smithi076 ceph-mon[35401]: pgmap v3464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1558.008240 secs 2024-07-26T13:59:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:11 smithi040 ceph-mon[32397]: pgmap v3465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:59:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1558.008240 secs 2024-07-26T13:59:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:11 smithi146 ceph-mon[35807]: pgmap v3465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:59:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1558.008240 secs 2024-07-26T13:59:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:11 smithi076 ceph-mon[35401]: pgmap v3465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:59:13.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:13 smithi146 ceph-mon[35807]: pgmap v3466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:13.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:13 smithi076 ceph-mon[35401]: pgmap v3466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:13 smithi040 ceph-mon[32397]: pgmap v3466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T13:59:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:15 smithi040 ceph-mon[32397]: pgmap v3467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:15 smithi146 ceph-mon[35807]: pgmap v3467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:15 smithi076 ceph-mon[35401]: pgmap v3467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1563.008385 secs 2024-07-26T13:59:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1563.008385 secs 2024-07-26T13:59:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1563.008385 secs 2024-07-26T13:59:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:17 smithi040 ceph-mon[32397]: pgmap v3468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:17 smithi146 ceph-mon[35807]: pgmap v3468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:17 smithi076 ceph-mon[35401]: pgmap v3468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:19 smithi040 ceph-mon[32397]: pgmap v3469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:19 smithi146 ceph-mon[35807]: pgmap v3469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:19 smithi076 ceph-mon[35401]: pgmap v3469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1568.008523 secs 2024-07-26T13:59:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:21 smithi040 ceph-mon[32397]: pgmap v3470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1568.008523 secs 2024-07-26T13:59:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:21 smithi146 ceph-mon[35807]: pgmap v3470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1568.008523 secs 2024-07-26T13:59:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:21 smithi076 ceph-mon[35401]: pgmap v3470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:23 smithi040 ceph-mon[32397]: pgmap v3471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:24.180 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:23 smithi076 ceph-mon[35401]: pgmap v3471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:24.180 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:23 smithi146 ceph-mon[35807]: pgmap v3471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:25 smithi040 ceph-mon[32397]: pgmap v3472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:25 smithi146 ceph-mon[35807]: pgmap v3472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:25 smithi076 ceph-mon[35401]: pgmap v3472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1573.008659 secs 2024-07-26T13:59:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1573.008659 secs 2024-07-26T13:59:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1573.008659 secs 2024-07-26T13:59:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:27 smithi040 ceph-mon[32397]: pgmap v3473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:27 smithi146 ceph-mon[35807]: pgmap v3473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:27 smithi076 ceph-mon[35401]: pgmap v3473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:29 smithi040 ceph-mon[32397]: pgmap v3474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:29 smithi146 ceph-mon[35807]: pgmap v3474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:29 smithi076 ceph-mon[35401]: pgmap v3474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1578.008806 secs 2024-07-26T13:59:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:31 smithi040 ceph-mon[32397]: pgmap v3475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1578.008806 secs 2024-07-26T13:59:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:31 smithi146 ceph-mon[35807]: pgmap v3475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1578.008806 secs 2024-07-26T13:59:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:31 smithi076 ceph-mon[35401]: pgmap v3475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:33 smithi040 ceph-mon[32397]: pgmap v3476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:33 smithi146 ceph-mon[35807]: pgmap v3476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:33 smithi076 ceph-mon[35401]: pgmap v3476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:35 smithi040 ceph-mon[32397]: pgmap v3477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:35 smithi146 ceph-mon[35807]: pgmap v3477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:35 smithi076 ceph-mon[35401]: pgmap v3477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1583.008942 secs 2024-07-26T13:59:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1583.008942 secs 2024-07-26T13:59:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1583.008942 secs 2024-07-26T13:59:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:37 smithi040 ceph-mon[32397]: pgmap v3478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:37 smithi146 ceph-mon[35807]: pgmap v3478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:37 smithi076 ceph-mon[35401]: pgmap v3478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:39 smithi040 ceph-mon[32397]: pgmap v3479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:39 smithi146 ceph-mon[35807]: pgmap v3479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:39 smithi076 ceph-mon[35401]: pgmap v3479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T13:59:41.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1588.009087 secs 2024-07-26T13:59:41.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:41 smithi040 ceph-mon[32397]: pgmap v3480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1588.009087 secs 2024-07-26T13:59:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:41 smithi146 ceph-mon[35807]: pgmap v3480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1588.009087 secs 2024-07-26T13:59:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:41 smithi076 ceph-mon[35401]: pgmap v3480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:43 smithi146 ceph-mon[35807]: pgmap v3481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:43 smithi076 ceph-mon[35401]: pgmap v3481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:43 smithi040 ceph-mon[32397]: pgmap v3481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:45 smithi146 ceph-mon[35807]: pgmap v3482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:45 smithi076 ceph-mon[35401]: pgmap v3482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:45 smithi040 ceph-mon[32397]: pgmap v3482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1593.009231 secs 2024-07-26T13:59:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1593.009231 secs 2024-07-26T13:59:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1593.009231 secs 2024-07-26T13:59:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:47 smithi146 ceph-mon[35807]: pgmap v3483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:47 smithi076 ceph-mon[35401]: pgmap v3483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:47 smithi040 ceph-mon[32397]: pgmap v3483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:49 smithi146 ceph-mon[35807]: pgmap v3484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:49 smithi076 ceph-mon[35401]: pgmap v3484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:49 smithi040 ceph-mon[32397]: pgmap v3484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1598.009375 secs 2024-07-26T13:59:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:51 smithi146 ceph-mon[35807]: pgmap v3485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:59:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1598.009375 secs 2024-07-26T13:59:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:51 smithi076 ceph-mon[35401]: pgmap v3485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:59:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1598.009375 secs 2024-07-26T13:59:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:51 smithi040 ceph-mon[32397]: pgmap v3485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T13:59:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:53 smithi146 ceph-mon[35807]: pgmap v3486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:53 smithi076 ceph-mon[35401]: pgmap v3486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:53 smithi040 ceph-mon[32397]: pgmap v3486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:56.037 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:55 smithi040 ceph-mon[32397]: pgmap v3487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:55 smithi146 ceph-mon[35807]: pgmap v3487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:55 smithi076 ceph-mon[35401]: pgmap v3487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T13:59:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1603.009520 secs 2024-07-26T13:59:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1603.009520 secs 2024-07-26T13:59:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1603.009520 secs 2024-07-26T13:59:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:57 smithi146 ceph-mon[35807]: pgmap v3488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:57 smithi076 ceph-mon[35401]: pgmap v3488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T13:59:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:57 smithi040 ceph-mon[32397]: pgmap v3488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 13:59:59 smithi146 ceph-mon[35807]: pgmap v3489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 13:59:59 smithi076 ceph-mon[35401]: pgmap v3489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 13:59:59 smithi040 ceph-mon[32397]: pgmap v3489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:00:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:00:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:00:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1608.009664 secs 2024-07-26T14:00:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:01 smithi076 ceph-mon[35401]: pgmap v3490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1608.009664 secs 2024-07-26T14:00:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:01 smithi040 ceph-mon[32397]: pgmap v3490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1608.009664 secs 2024-07-26T14:00:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:01 smithi146 ceph-mon[35807]: pgmap v3490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:03 smithi040 ceph-mon[32397]: pgmap v3491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:03 smithi146 ceph-mon[35807]: pgmap v3491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:03 smithi076 ceph-mon[35401]: pgmap v3491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:05 smithi040 ceph-mon[32397]: pgmap v3492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:05 smithi146 ceph-mon[35807]: pgmap v3492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:05 smithi076 ceph-mon[35401]: pgmap v3492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1613.009809 secs 2024-07-26T14:00:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1613.009809 secs 2024-07-26T14:00:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1613.009809 secs 2024-07-26T14:00:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:07 smithi040 ceph-mon[32397]: pgmap v3493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:07 smithi146 ceph-mon[35807]: pgmap v3493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:07 smithi076 ceph-mon[35401]: pgmap v3493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:08 smithi040 ceph-mon[32397]: pgmap v3494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:08 smithi146 ceph-mon[35807]: pgmap v3494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:08 smithi076 ceph-mon[35401]: pgmap v3494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1618.009958 secs 2024-07-26T14:00:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:11 smithi146 ceph-mon[35807]: pgmap v3495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1618.009958 secs 2024-07-26T14:00:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:11 smithi076 ceph-mon[35401]: pgmap v3495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1618.009958 secs 2024-07-26T14:00:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:11 smithi040 ceph-mon[32397]: pgmap v3495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:13 smithi146 ceph-mon[35807]: pgmap v3496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:13 smithi076 ceph-mon[35401]: pgmap v3496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:13 smithi040 ceph-mon[32397]: pgmap v3496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:15 smithi146 ceph-mon[35807]: pgmap v3497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:15 smithi076 ceph-mon[35401]: pgmap v3497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:15 smithi040 ceph-mon[32397]: pgmap v3497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1623.010087 secs 2024-07-26T14:00:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1623.010087 secs 2024-07-26T14:00:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1623.010087 secs 2024-07-26T14:00:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:17 smithi146 ceph-mon[35807]: pgmap v3498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:17 smithi076 ceph-mon[35401]: pgmap v3498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:17 smithi040 ceph-mon[32397]: pgmap v3498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:19 smithi146 ceph-mon[35807]: pgmap v3499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:19 smithi076 ceph-mon[35401]: pgmap v3499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:19 smithi040 ceph-mon[32397]: pgmap v3499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1628.010258 secs 2024-07-26T14:00:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:21 smithi146 ceph-mon[35807]: pgmap v3500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1628.010258 secs 2024-07-26T14:00:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:21 smithi076 ceph-mon[35401]: pgmap v3500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1628.010258 secs 2024-07-26T14:00:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:21 smithi040 ceph-mon[32397]: pgmap v3500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:23 smithi076 ceph-mon[35401]: pgmap v3501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:23 smithi040 ceph-mon[32397]: pgmap v3501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:23 smithi146 ceph-mon[35807]: pgmap v3501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:25 smithi076 ceph-mon[35401]: pgmap v3502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:25 smithi040 ceph-mon[32397]: pgmap v3502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:25 smithi146 ceph-mon[35807]: pgmap v3502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:26.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1633.010400 secs 2024-07-26T14:00:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1633.010400 secs 2024-07-26T14:00:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1633.010400 secs 2024-07-26T14:00:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:27 smithi040 ceph-mon[32397]: pgmap v3503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:27 smithi146 ceph-mon[35807]: pgmap v3503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:27 smithi076 ceph-mon[35401]: pgmap v3503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:29 smithi040 ceph-mon[32397]: pgmap v3504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:29 smithi146 ceph-mon[35807]: pgmap v3504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:29 smithi076 ceph-mon[35401]: pgmap v3504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1638.010545 secs 2024-07-26T14:00:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:31 smithi040 ceph-mon[32397]: pgmap v3505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1638.010545 secs 2024-07-26T14:00:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:31 smithi146 ceph-mon[35807]: pgmap v3505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1638.010545 secs 2024-07-26T14:00:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:31 smithi076 ceph-mon[35401]: pgmap v3505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:33 smithi040 ceph-mon[32397]: pgmap v3506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:33 smithi146 ceph-mon[35807]: pgmap v3506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:33 smithi076 ceph-mon[35401]: pgmap v3506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:35 smithi040 ceph-mon[32397]: pgmap v3507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:35 smithi146 ceph-mon[35807]: pgmap v3507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:35 smithi076 ceph-mon[35401]: pgmap v3507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:36.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1643.010696 secs 2024-07-26T14:00:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1643.010696 secs 2024-07-26T14:00:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1643.010696 secs 2024-07-26T14:00:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:37 smithi040 ceph-mon[32397]: pgmap v3508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:37 smithi146 ceph-mon[35807]: pgmap v3508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:37 smithi076 ceph-mon[35401]: pgmap v3508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:39 smithi040 ceph-mon[32397]: pgmap v3509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:39 smithi146 ceph-mon[35807]: pgmap v3509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:39 smithi076 ceph-mon[35401]: pgmap v3509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1648.010838 secs 2024-07-26T14:00:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:41 smithi040 ceph-mon[32397]: pgmap v3510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1648.010838 secs 2024-07-26T14:00:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:41 smithi146 ceph-mon[35807]: pgmap v3510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1648.010838 secs 2024-07-26T14:00:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:41 smithi076 ceph-mon[35401]: pgmap v3510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:43 smithi040 ceph-mon[32397]: pgmap v3511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:43 smithi146 ceph-mon[35807]: pgmap v3511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:43 smithi076 ceph-mon[35401]: pgmap v3511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:45 smithi040 ceph-mon[32397]: pgmap v3512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:45 smithi146 ceph-mon[35807]: pgmap v3512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:45 smithi076 ceph-mon[35401]: pgmap v3512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1653.010986 secs 2024-07-26T14:00:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1653.010986 secs 2024-07-26T14:00:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1653.010986 secs 2024-07-26T14:00:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:47 smithi040 ceph-mon[32397]: pgmap v3513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:47 smithi146 ceph-mon[35807]: pgmap v3513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:47 smithi076 ceph-mon[35401]: pgmap v3513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:49 smithi040 ceph-mon[32397]: pgmap v3514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:49 smithi146 ceph-mon[35807]: pgmap v3514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:49 smithi076 ceph-mon[35401]: pgmap v3514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:00:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1658.011127 secs 2024-07-26T14:00:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:51 smithi040 ceph-mon[32397]: pgmap v3515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1658.011127 secs 2024-07-26T14:00:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:51 smithi146 ceph-mon[35807]: pgmap v3515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1658.011127 secs 2024-07-26T14:00:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:51 smithi076 ceph-mon[35401]: pgmap v3515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:53 smithi040 ceph-mon[32397]: pgmap v3516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:53 smithi146 ceph-mon[35807]: pgmap v3516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:53 smithi076 ceph-mon[35401]: pgmap v3516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:55 smithi040 ceph-mon[32397]: pgmap v3517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:55 smithi146 ceph-mon[35807]: pgmap v3517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:55 smithi076 ceph-mon[35401]: pgmap v3517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:00:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1663.011324 secs 2024-07-26T14:00:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1663.011324 secs 2024-07-26T14:00:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1663.011324 secs 2024-07-26T14:00:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:57 smithi040 ceph-mon[32397]: pgmap v3518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:57 smithi146 ceph-mon[35807]: pgmap v3518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:00:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:57 smithi076 ceph-mon[35401]: pgmap v3518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:00:59 smithi146 ceph-mon[35807]: pgmap v3519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:00:59 smithi076 ceph-mon[35401]: pgmap v3519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:00:59 smithi040 ceph-mon[32397]: pgmap v3519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:02.006 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1668.011473 secs 2024-07-26T14:01:02.007 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:01 smithi040 ceph-mon[32397]: pgmap v3520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1668.011473 secs 2024-07-26T14:01:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:01 smithi146 ceph-mon[35807]: pgmap v3520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1668.011473 secs 2024-07-26T14:01:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:01 smithi076 ceph-mon[35401]: pgmap v3520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:03 smithi146 ceph-mon[35807]: pgmap v3521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:03 smithi076 ceph-mon[35401]: pgmap v3521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:03 smithi040 ceph-mon[32397]: pgmap v3521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:05 smithi146 ceph-mon[35807]: pgmap v3522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:05 smithi076 ceph-mon[35401]: pgmap v3522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:05 smithi040 ceph-mon[32397]: pgmap v3522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1673.011603 secs 2024-07-26T14:01:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1673.011603 secs 2024-07-26T14:01:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1673.011603 secs 2024-07-26T14:01:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:07 smithi146 ceph-mon[35807]: pgmap v3523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:07 smithi076 ceph-mon[35401]: pgmap v3523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:07 smithi040 ceph-mon[32397]: pgmap v3523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:09 smithi146 ceph-mon[35807]: pgmap v3524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:09 smithi076 ceph-mon[35401]: pgmap v3524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:09 smithi040 ceph-mon[32397]: pgmap v3524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1678.011745 secs 2024-07-26T14:01:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:11 smithi146 ceph-mon[35807]: pgmap v3525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1678.011745 secs 2024-07-26T14:01:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:11 smithi076 ceph-mon[35401]: pgmap v3525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1678.011745 secs 2024-07-26T14:01:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:11 smithi040 ceph-mon[32397]: pgmap v3525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:13 smithi146 ceph-mon[35807]: pgmap v3526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:13 smithi076 ceph-mon[35401]: pgmap v3526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:13 smithi040 ceph-mon[32397]: pgmap v3526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:15 smithi146 ceph-mon[35807]: pgmap v3527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:15 smithi076 ceph-mon[35401]: pgmap v3527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:15 smithi040 ceph-mon[32397]: pgmap v3527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1683.011898 secs 2024-07-26T14:01:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1683.011898 secs 2024-07-26T14:01:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1683.011898 secs 2024-07-26T14:01:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:17 smithi146 ceph-mon[35807]: pgmap v3528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:17 smithi076 ceph-mon[35401]: pgmap v3528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:17 smithi040 ceph-mon[32397]: pgmap v3528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:19 smithi076 ceph-mon[35401]: pgmap v3529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:19 smithi040 ceph-mon[32397]: pgmap v3529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:19 smithi146 ceph-mon[35807]: pgmap v3529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1688.012067 secs 2024-07-26T14:01:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:21 smithi076 ceph-mon[35401]: pgmap v3530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1688.012067 secs 2024-07-26T14:01:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:21 smithi040 ceph-mon[32397]: pgmap v3530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1688.012067 secs 2024-07-26T14:01:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:21 smithi146 ceph-mon[35807]: pgmap v3530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:23 smithi040 ceph-mon[32397]: pgmap v3531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:23 smithi146 ceph-mon[35807]: pgmap v3531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:23 smithi076 ceph-mon[35401]: pgmap v3531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:25 smithi040 ceph-mon[32397]: pgmap v3532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:25 smithi146 ceph-mon[35807]: pgmap v3532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:25 smithi076 ceph-mon[35401]: pgmap v3532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1693.012225 secs 2024-07-26T14:01:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1693.012225 secs 2024-07-26T14:01:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1693.012225 secs 2024-07-26T14:01:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:27 smithi040 ceph-mon[32397]: pgmap v3533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:27 smithi146 ceph-mon[35807]: pgmap v3533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:27 smithi076 ceph-mon[35401]: pgmap v3533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:29 smithi040 ceph-mon[32397]: pgmap v3534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:29 smithi146 ceph-mon[35807]: pgmap v3534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:29 smithi076 ceph-mon[35401]: pgmap v3534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1698.012365 secs 2024-07-26T14:01:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:31 smithi040 ceph-mon[32397]: pgmap v3535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1698.012365 secs 2024-07-26T14:01:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:31 smithi146 ceph-mon[35807]: pgmap v3535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1698.012365 secs 2024-07-26T14:01:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:31 smithi076 ceph-mon[35401]: pgmap v3535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:32 smithi040 ceph-mon[32397]: pgmap v3536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:32 smithi146 ceph-mon[35807]: pgmap v3536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:32 smithi076 ceph-mon[35401]: pgmap v3536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:35 smithi146 ceph-mon[35807]: pgmap v3537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:35 smithi076 ceph-mon[35401]: pgmap v3537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:35 smithi040 ceph-mon[32397]: pgmap v3537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1703.012465 secs 2024-07-26T14:01:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1703.012465 secs 2024-07-26T14:01:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1703.012465 secs 2024-07-26T14:01:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:37 smithi040 ceph-mon[32397]: pgmap v3538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:37 smithi146 ceph-mon[35807]: pgmap v3538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:37 smithi076 ceph-mon[35401]: pgmap v3538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:39 smithi040 ceph-mon[32397]: pgmap v3539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:39 smithi146 ceph-mon[35807]: pgmap v3539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:39 smithi076 ceph-mon[35401]: pgmap v3539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1708.012607 secs 2024-07-26T14:01:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:41 smithi040 ceph-mon[32397]: pgmap v3540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1708.012607 secs 2024-07-26T14:01:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:41 smithi146 ceph-mon[35807]: pgmap v3540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1708.012607 secs 2024-07-26T14:01:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:41 smithi076 ceph-mon[35401]: pgmap v3540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:43.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:43 smithi146 ceph-mon[35807]: pgmap v3541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:43.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:43 smithi076 ceph-mon[35401]: pgmap v3541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:43 smithi040 ceph-mon[32397]: pgmap v3541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:45 smithi040 ceph-mon[32397]: pgmap v3542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:45 smithi146 ceph-mon[35807]: pgmap v3542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:45 smithi076 ceph-mon[35401]: pgmap v3542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1713.012752 secs 2024-07-26T14:01:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1713.012752 secs 2024-07-26T14:01:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1713.012752 secs 2024-07-26T14:01:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:47 smithi040 ceph-mon[32397]: pgmap v3543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:47 smithi146 ceph-mon[35807]: pgmap v3543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:47 smithi076 ceph-mon[35401]: pgmap v3543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:49 smithi040 ceph-mon[32397]: pgmap v3544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:49 smithi146 ceph-mon[35807]: pgmap v3544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:49 smithi076 ceph-mon[35401]: pgmap v3544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1718.012911 secs 2024-07-26T14:01:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:51 smithi040 ceph-mon[32397]: pgmap v3545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1718.012911 secs 2024-07-26T14:01:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:51 smithi146 ceph-mon[35807]: pgmap v3545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1718.012911 secs 2024-07-26T14:01:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:51 smithi076 ceph-mon[35401]: pgmap v3545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:53 smithi040 ceph-mon[32397]: pgmap v3546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:53 smithi146 ceph-mon[35807]: pgmap v3546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:53 smithi076 ceph-mon[35401]: pgmap v3546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:55 smithi040 ceph-mon[32397]: pgmap v3547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:55 smithi146 ceph-mon[35807]: pgmap v3547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:55 smithi076 ceph-mon[35401]: pgmap v3547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:01:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1723.013057 secs 2024-07-26T14:01:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1723.013057 secs 2024-07-26T14:01:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1723.013057 secs 2024-07-26T14:01:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:57 smithi040 ceph-mon[32397]: pgmap v3548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:57 smithi146 ceph-mon[35807]: pgmap v3548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:57 smithi076 ceph-mon[35401]: pgmap v3548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: pgmap v3549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:01:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:01:59.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:01:59.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:01:59.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:01:59 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:02:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: pgmap v3549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:02:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:01:59 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: pgmap v3549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:02:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:01:59 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:02:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:00 smithi040 ceph-mon[32397]: pgmap v3550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-07-26T14:02:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:00 smithi040 ceph-mon[32397]: pgmap v3551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-07-26T14:02:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:00 smithi040 ceph-mon[32397]: pgmap v3552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 2 op/s 2024-07-26T14:02:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:00 smithi040 ceph-mon[32397]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-07-26T14:02:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:00 smithi146 ceph-mon[35807]: pgmap v3550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-07-26T14:02:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:00 smithi146 ceph-mon[35807]: pgmap v3551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-07-26T14:02:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:00 smithi146 ceph-mon[35807]: pgmap v3552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 2 op/s 2024-07-26T14:02:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:00 smithi146 ceph-mon[35807]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-07-26T14:02:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:00 smithi076 ceph-mon[35401]: pgmap v3550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-07-26T14:02:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:00 smithi076 ceph-mon[35401]: pgmap v3551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-07-26T14:02:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:00 smithi076 ceph-mon[35401]: pgmap v3552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 2 op/s 2024-07-26T14:02:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:00 smithi076 ceph-mon[35401]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-07-26T14:02:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1728.013160 secs 2024-07-26T14:02:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1728.013160 secs 2024-07-26T14:02:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1728.013160 secs 2024-07-26T14:02:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:02 smithi040 ceph-mon[32397]: pgmap v3553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 1 op/s 2024-07-26T14:02:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:02 smithi146 ceph-mon[35807]: pgmap v3553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 1 op/s 2024-07-26T14:02:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:02 smithi076 ceph-mon[35401]: pgmap v3553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 1 op/s 2024-07-26T14:02:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:04 smithi040 ceph-mon[32397]: pgmap v3554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 1 op/s 2024-07-26T14:02:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:04 smithi146 ceph-mon[35807]: pgmap v3554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 1 op/s 2024-07-26T14:02:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:04 smithi076 ceph-mon[35401]: pgmap v3554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 804 B/s rd, 1 op/s 2024-07-26T14:02:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:06 smithi040 ceph-mon[32397]: pgmap v3555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-07-26T14:02:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1733.013311 secs 2024-07-26T14:02:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:06 smithi146 ceph-mon[35807]: pgmap v3555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-07-26T14:02:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1733.013311 secs 2024-07-26T14:02:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:06 smithi076 ceph-mon[35401]: pgmap v3555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-07-26T14:02:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1733.013311 secs 2024-07-26T14:02:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:08 smithi040 ceph-mon[32397]: pgmap v3556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:02:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:08 smithi146 ceph-mon[35807]: pgmap v3556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:02:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:08 smithi076 ceph-mon[35401]: pgmap v3556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:02:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:10 smithi146 ceph-mon[35807]: pgmap v3557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:02:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:10 smithi076 ceph-mon[35401]: pgmap v3557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:02:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:10 smithi040 ceph-mon[32397]: pgmap v3557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:02:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1738.013446 secs 2024-07-26T14:02:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1738.013446 secs 2024-07-26T14:02:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1738.013446 secs 2024-07-26T14:02:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:12 smithi146 ceph-mon[35807]: pgmap v3558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:12 smithi076 ceph-mon[35401]: pgmap v3558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:12 smithi040 ceph-mon[32397]: pgmap v3558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:14 smithi146 ceph-mon[35807]: pgmap v3559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:14 smithi076 ceph-mon[35401]: pgmap v3559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:14 smithi040 ceph-mon[32397]: pgmap v3559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:16 smithi146 ceph-mon[35807]: pgmap v3560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1743.013574 secs 2024-07-26T14:02:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:16 smithi076 ceph-mon[35401]: pgmap v3560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1743.013574 secs 2024-07-26T14:02:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:16 smithi040 ceph-mon[32397]: pgmap v3560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1743.013574 secs 2024-07-26T14:02:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:18 smithi146 ceph-mon[35807]: pgmap v3561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:18 smithi076 ceph-mon[35401]: pgmap v3561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:18 smithi040 ceph-mon[32397]: pgmap v3561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:20 smithi146 ceph-mon[35807]: pgmap v3562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:20 smithi076 ceph-mon[35401]: pgmap v3562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:20 smithi040 ceph-mon[32397]: pgmap v3562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1748.013754 secs 2024-07-26T14:02:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1748.013754 secs 2024-07-26T14:02:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1748.013754 secs 2024-07-26T14:02:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:22 smithi146 ceph-mon[35807]: pgmap v3563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:22 smithi076 ceph-mon[35401]: pgmap v3563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:22 smithi040 ceph-mon[32397]: pgmap v3563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:24 smithi146 ceph-mon[35807]: pgmap v3564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:24 smithi076 ceph-mon[35401]: pgmap v3564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:24 smithi040 ceph-mon[32397]: pgmap v3564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:26 smithi146 ceph-mon[35807]: pgmap v3565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1753.013901 secs 2024-07-26T14:02:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:26 smithi076 ceph-mon[35401]: pgmap v3565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1753.013901 secs 2024-07-26T14:02:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:26 smithi040 ceph-mon[32397]: pgmap v3565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1753.013901 secs 2024-07-26T14:02:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:28 smithi076 ceph-mon[35401]: pgmap v3566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:28 smithi040 ceph-mon[32397]: pgmap v3566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:28 smithi146 ceph-mon[35807]: pgmap v3566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:30 smithi076 ceph-mon[35401]: pgmap v3567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:30 smithi040 ceph-mon[32397]: pgmap v3567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:30 smithi146 ceph-mon[35807]: pgmap v3567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1758.014049 secs 2024-07-26T14:02:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1758.014049 secs 2024-07-26T14:02:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1758.014049 secs 2024-07-26T14:02:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:32 smithi040 ceph-mon[32397]: pgmap v3568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:32 smithi146 ceph-mon[35807]: pgmap v3568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:32 smithi076 ceph-mon[35401]: pgmap v3568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:34 smithi040 ceph-mon[32397]: pgmap v3569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:34 smithi146 ceph-mon[35807]: pgmap v3569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:34 smithi076 ceph-mon[35401]: pgmap v3569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:36 smithi040 ceph-mon[32397]: pgmap v3570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1763.014188 secs 2024-07-26T14:02:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:36 smithi146 ceph-mon[35807]: pgmap v3570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1763.014188 secs 2024-07-26T14:02:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:36 smithi076 ceph-mon[35401]: pgmap v3570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1763.014188 secs 2024-07-26T14:02:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:38 smithi040 ceph-mon[32397]: pgmap v3571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:38 smithi146 ceph-mon[35807]: pgmap v3571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:38 smithi076 ceph-mon[35401]: pgmap v3571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:40 smithi040 ceph-mon[32397]: pgmap v3572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:40 smithi146 ceph-mon[35807]: pgmap v3572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:40 smithi076 ceph-mon[35401]: pgmap v3572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1768.014327 secs 2024-07-26T14:02:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1768.014327 secs 2024-07-26T14:02:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1768.014327 secs 2024-07-26T14:02:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:42 smithi040 ceph-mon[32397]: pgmap v3573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:42 smithi146 ceph-mon[35807]: pgmap v3573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:42 smithi076 ceph-mon[35401]: pgmap v3573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:44.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:43 smithi146 ceph-mon[35807]: pgmap v3574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:43 smithi040 ceph-mon[32397]: pgmap v3574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:44.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:43 smithi076 ceph-mon[35401]: pgmap v3574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:45 smithi040 ceph-mon[32397]: pgmap v3575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:45 smithi146 ceph-mon[35807]: pgmap v3575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:45 smithi076 ceph-mon[35401]: pgmap v3575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1773.014431 secs 2024-07-26T14:02:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1773.014431 secs 2024-07-26T14:02:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1773.014431 secs 2024-07-26T14:02:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:47 smithi040 ceph-mon[32397]: pgmap v3576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:47 smithi146 ceph-mon[35807]: pgmap v3576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:47 smithi076 ceph-mon[35401]: pgmap v3576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:49 smithi040 ceph-mon[32397]: pgmap v3577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:49 smithi146 ceph-mon[35807]: pgmap v3577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:49 smithi076 ceph-mon[35401]: pgmap v3577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:02:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1778.014532 secs 2024-07-26T14:02:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:51 smithi040 ceph-mon[32397]: pgmap v3578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1778.014532 secs 2024-07-26T14:02:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:51 smithi146 ceph-mon[35807]: pgmap v3578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1778.014532 secs 2024-07-26T14:02:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:51 smithi076 ceph-mon[35401]: pgmap v3578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:53 smithi040 ceph-mon[32397]: pgmap v3579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:53 smithi146 ceph-mon[35807]: pgmap v3579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:53 smithi076 ceph-mon[35401]: pgmap v3579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:55 smithi040 ceph-mon[32397]: pgmap v3580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:55 smithi146 ceph-mon[35807]: pgmap v3580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:55 smithi076 ceph-mon[35401]: pgmap v3580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:02:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1783.014656 secs 2024-07-26T14:02:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1783.014656 secs 2024-07-26T14:02:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1783.014656 secs 2024-07-26T14:02:58.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:02:57 smithi146 ceph-mon[35807]: pgmap v3581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:02:57 smithi076 ceph-mon[35401]: pgmap v3581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:02:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:02:57 smithi040 ceph-mon[32397]: pgmap v3581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:00 smithi146 ceph-mon[35807]: pgmap v3582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:03:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:00 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:00 smithi076 ceph-mon[35401]: pgmap v3582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:03:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:00 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:00 smithi040 ceph-mon[32397]: pgmap v3582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:03:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:00 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:01.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:01.304 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:01 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:01 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:01 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1788.014762 secs 2024-07-26T14:03:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:02 smithi146 ceph-mon[35807]: pgmap v3583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1788.014762 secs 2024-07-26T14:03:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:02 smithi076 ceph-mon[35401]: pgmap v3583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1788.014762 secs 2024-07-26T14:03:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:02 smithi040 ceph-mon[32397]: pgmap v3583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: pgmap v3584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: pgmap v3584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: pgmap v3584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:06 smithi040 ceph-mon[32397]: pgmap v3585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1793.014845 secs 2024-07-26T14:03:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:06 smithi076 ceph-mon[35401]: pgmap v3585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1793.014845 secs 2024-07-26T14:03:07.007 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:06 smithi146 ceph-mon[35807]: pgmap v3585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:07.007 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1793.014845 secs 2024-07-26T14:03:08.980 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:08 smithi076 ceph-mon[35401]: pgmap v3586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:08 smithi040 ceph-mon[32397]: pgmap v3586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:08.995 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:08 smithi146 ceph-mon[35807]: pgmap v3586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: pgmap v3587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:03:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:10 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:03:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: pgmap v3587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:03:10.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:10 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: pgmap v3587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:03:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:03:10.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:10 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:03:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1798.014983 secs 2024-07-26T14:03:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1798.014983 secs 2024-07-26T14:03:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1798.014983 secs 2024-07-26T14:03:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:12 smithi040 ceph-mon[32397]: pgmap v3588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:12 smithi146 ceph-mon[35807]: pgmap v3588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:12 smithi076 ceph-mon[35401]: pgmap v3588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:14 smithi040 ceph-mon[32397]: pgmap v3589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:14 smithi146 ceph-mon[35807]: pgmap v3589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:14 smithi076 ceph-mon[35401]: pgmap v3589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:16 smithi040 ceph-mon[32397]: pgmap v3590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1803.015123 secs 2024-07-26T14:03:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:16 smithi146 ceph-mon[35807]: pgmap v3590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1803.015123 secs 2024-07-26T14:03:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:16 smithi076 ceph-mon[35401]: pgmap v3590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1803.015123 secs 2024-07-26T14:03:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:18 smithi040 ceph-mon[32397]: pgmap v3591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:18 smithi146 ceph-mon[35807]: pgmap v3591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:18 smithi076 ceph-mon[35401]: pgmap v3591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:20 smithi040 ceph-mon[32397]: pgmap v3592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:20 smithi146 ceph-mon[35807]: pgmap v3592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:20 smithi076 ceph-mon[35401]: pgmap v3592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1808.015258 secs 2024-07-26T14:03:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1808.015258 secs 2024-07-26T14:03:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1808.015258 secs 2024-07-26T14:03:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:22 smithi040 ceph-mon[32397]: pgmap v3593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:22 smithi146 ceph-mon[35807]: pgmap v3593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:22 smithi076 ceph-mon[35401]: pgmap v3593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:24.781 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:24 smithi146 ceph-mon[35807]: pgmap v3594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:24.808 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:24 smithi076 ceph-mon[35401]: pgmap v3594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:24 smithi040 ceph-mon[32397]: pgmap v3594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:26 smithi146 ceph-mon[35807]: pgmap v3595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1813.015398 secs 2024-07-26T14:03:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:26 smithi076 ceph-mon[35401]: pgmap v3595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1813.015398 secs 2024-07-26T14:03:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:26 smithi040 ceph-mon[32397]: pgmap v3595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1813.015398 secs 2024-07-26T14:03:28.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:28 smithi040 ceph-mon[32397]: pgmap v3596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:28 smithi146 ceph-mon[35807]: pgmap v3596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:28 smithi076 ceph-mon[35401]: pgmap v3596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:30 smithi040 ceph-mon[32397]: pgmap v3597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:30 smithi146 ceph-mon[35807]: pgmap v3597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:30 smithi076 ceph-mon[35401]: pgmap v3597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1818.015540 secs 2024-07-26T14:03:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1818.015540 secs 2024-07-26T14:03:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1818.015540 secs 2024-07-26T14:03:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:32 smithi146 ceph-mon[35807]: pgmap v3598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:32 smithi076 ceph-mon[35401]: pgmap v3598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:32 smithi040 ceph-mon[32397]: pgmap v3598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:34 smithi146 ceph-mon[35807]: pgmap v3599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:34 smithi076 ceph-mon[35401]: pgmap v3599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:34 smithi040 ceph-mon[32397]: pgmap v3599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:36 smithi146 ceph-mon[35807]: pgmap v3600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1823.015707 secs 2024-07-26T14:03:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:36 smithi076 ceph-mon[35401]: pgmap v3600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1823.015707 secs 2024-07-26T14:03:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:36 smithi040 ceph-mon[32397]: pgmap v3600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1823.015707 secs 2024-07-26T14:03:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:38 smithi146 ceph-mon[35807]: pgmap v3601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:38 smithi076 ceph-mon[35401]: pgmap v3601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:38 smithi040 ceph-mon[32397]: pgmap v3601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:40 smithi146 ceph-mon[35807]: pgmap v3602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:40 smithi076 ceph-mon[35401]: pgmap v3602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:40 smithi040 ceph-mon[32397]: pgmap v3602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1828.015867 secs 2024-07-26T14:03:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1828.015867 secs 2024-07-26T14:03:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1828.015867 secs 2024-07-26T14:03:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:42 smithi146 ceph-mon[35807]: pgmap v3603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:42 smithi076 ceph-mon[35401]: pgmap v3603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:42 smithi040 ceph-mon[32397]: pgmap v3603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:44 smithi076 ceph-mon[35401]: pgmap v3604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:44 smithi040 ceph-mon[32397]: pgmap v3604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:44 smithi146 ceph-mon[35807]: pgmap v3604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:46 smithi040 ceph-mon[32397]: pgmap v3605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1833.016005 secs 2024-07-26T14:03:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:46 smithi146 ceph-mon[35807]: pgmap v3605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1833.016005 secs 2024-07-26T14:03:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:46 smithi076 ceph-mon[35401]: pgmap v3605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1833.016005 secs 2024-07-26T14:03:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:48 smithi040 ceph-mon[32397]: pgmap v3606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:48 smithi146 ceph-mon[35807]: pgmap v3606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:48 smithi076 ceph-mon[35401]: pgmap v3606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:50 smithi040 ceph-mon[32397]: pgmap v3607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:50 smithi146 ceph-mon[35807]: pgmap v3607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:50 smithi076 ceph-mon[35401]: pgmap v3607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:03:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1838.016154 secs 2024-07-26T14:03:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1838.016154 secs 2024-07-26T14:03:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1838.016154 secs 2024-07-26T14:03:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:52 smithi040 ceph-mon[32397]: pgmap v3608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:52 smithi146 ceph-mon[35807]: pgmap v3608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:52 smithi076 ceph-mon[35401]: pgmap v3608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:54 smithi040 ceph-mon[32397]: pgmap v3609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:54 smithi146 ceph-mon[35807]: pgmap v3609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:54 smithi076 ceph-mon[35401]: pgmap v3609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:56 smithi040 ceph-mon[32397]: pgmap v3610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1843.016319 secs 2024-07-26T14:03:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:56 smithi146 ceph-mon[35807]: pgmap v3610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1843.016319 secs 2024-07-26T14:03:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:56 smithi076 ceph-mon[35401]: pgmap v3610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:03:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1843.016319 secs 2024-07-26T14:03:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:03:58 smithi040 ceph-mon[32397]: pgmap v3611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:03:58 smithi146 ceph-mon[35807]: pgmap v3611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:03:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:03:58 smithi076 ceph-mon[35401]: pgmap v3611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:00 smithi040 ceph-mon[32397]: pgmap v3612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:00 smithi146 ceph-mon[35807]: pgmap v3612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:00 smithi076 ceph-mon[35401]: pgmap v3612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1848.016437 secs 2024-07-26T14:04:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1848.016437 secs 2024-07-26T14:04:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1848.016437 secs 2024-07-26T14:04:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:02 smithi040 ceph-mon[32397]: pgmap v3613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:02 smithi146 ceph-mon[35807]: pgmap v3613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:02 smithi076 ceph-mon[35401]: pgmap v3613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:04 smithi040 ceph-mon[32397]: pgmap v3614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:04 smithi146 ceph-mon[35807]: pgmap v3614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:04 smithi076 ceph-mon[35401]: pgmap v3614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:06 smithi040 ceph-mon[32397]: pgmap v3615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1853.016568 secs 2024-07-26T14:04:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:06 smithi146 ceph-mon[35807]: pgmap v3615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1853.016568 secs 2024-07-26T14:04:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:06 smithi076 ceph-mon[35401]: pgmap v3615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1853.016568 secs 2024-07-26T14:04:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:08 smithi040 ceph-mon[32397]: pgmap v3616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:08 smithi146 ceph-mon[35807]: pgmap v3616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:08 smithi076 ceph-mon[35401]: pgmap v3616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:10 smithi040 ceph-mon[32397]: pgmap v3617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:10 smithi146 ceph-mon[35807]: pgmap v3617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:10 smithi076 ceph-mon[35401]: pgmap v3617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1858.016710 secs 2024-07-26T14:04:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1858.016710 secs 2024-07-26T14:04:12.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1858.016710 secs 2024-07-26T14:04:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:12 smithi040 ceph-mon[32397]: pgmap v3618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:12 smithi146 ceph-mon[35807]: pgmap v3618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:12 smithi076 ceph-mon[35401]: pgmap v3618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:14 smithi040 ceph-mon[32397]: pgmap v3619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:14 smithi146 ceph-mon[35807]: pgmap v3619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:14 smithi076 ceph-mon[35401]: pgmap v3619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:16 smithi040 ceph-mon[32397]: pgmap v3620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1863.016853 secs 2024-07-26T14:04:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:16 smithi146 ceph-mon[35807]: pgmap v3620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1863.016853 secs 2024-07-26T14:04:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:16 smithi076 ceph-mon[35401]: pgmap v3620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1863.016853 secs 2024-07-26T14:04:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:18 smithi040 ceph-mon[32397]: pgmap v3621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:18 smithi146 ceph-mon[35807]: pgmap v3621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:18 smithi076 ceph-mon[35401]: pgmap v3621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:20 smithi040 ceph-mon[32397]: pgmap v3622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:20 smithi146 ceph-mon[35807]: pgmap v3622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:20 smithi076 ceph-mon[35401]: pgmap v3622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1868.016989 secs 2024-07-26T14:04:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1868.016989 secs 2024-07-26T14:04:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1868.016989 secs 2024-07-26T14:04:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:22 smithi146 ceph-mon[35807]: pgmap v3623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:22 smithi076 ceph-mon[35401]: pgmap v3623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:22 smithi040 ceph-mon[32397]: pgmap v3623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:24 smithi146 ceph-mon[35807]: pgmap v3624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:24 smithi076 ceph-mon[35401]: pgmap v3624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:24 smithi040 ceph-mon[32397]: pgmap v3624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:26 smithi146 ceph-mon[35807]: pgmap v3625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1873.017130 secs 2024-07-26T14:04:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:26 smithi076 ceph-mon[35401]: pgmap v3625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1873.017130 secs 2024-07-26T14:04:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:26 smithi040 ceph-mon[32397]: pgmap v3625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1873.017130 secs 2024-07-26T14:04:29.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:28 smithi040 ceph-mon[32397]: pgmap v3626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:28 smithi146 ceph-mon[35807]: pgmap v3626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:28 smithi076 ceph-mon[35401]: pgmap v3626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:30 smithi146 ceph-mon[35807]: pgmap v3627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:30 smithi076 ceph-mon[35401]: pgmap v3627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:30 smithi040 ceph-mon[32397]: pgmap v3627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1878.017312 secs 2024-07-26T14:04:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1878.017312 secs 2024-07-26T14:04:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1878.017312 secs 2024-07-26T14:04:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:32 smithi146 ceph-mon[35807]: pgmap v3628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:04:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:32 smithi076 ceph-mon[35401]: pgmap v3628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:04:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:32 smithi040 ceph-mon[32397]: pgmap v3628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:04:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:34 smithi146 ceph-mon[35807]: pgmap v3629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:34 smithi076 ceph-mon[35401]: pgmap v3629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:34 smithi040 ceph-mon[32397]: pgmap v3629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:04:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:36 smithi146 ceph-mon[35807]: pgmap v3630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1883.017453 secs 2024-07-26T14:04:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:36 smithi076 ceph-mon[35401]: pgmap v3630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1883.017453 secs 2024-07-26T14:04:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:36 smithi040 ceph-mon[32397]: pgmap v3630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1883.017453 secs 2024-07-26T14:04:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:38 smithi146 ceph-mon[35807]: pgmap v3631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:38 smithi076 ceph-mon[35401]: pgmap v3631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:38 smithi040 ceph-mon[32397]: pgmap v3631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:40 smithi076 ceph-mon[35401]: pgmap v3632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:40 smithi040 ceph-mon[32397]: pgmap v3632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:40 smithi146 ceph-mon[35807]: pgmap v3632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1888.017585 secs 2024-07-26T14:04:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1888.017585 secs 2024-07-26T14:04:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1888.017585 secs 2024-07-26T14:04:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:42 smithi040 ceph-mon[32397]: pgmap v3633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:42 smithi146 ceph-mon[35807]: pgmap v3633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:42 smithi076 ceph-mon[35401]: pgmap v3633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:45.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:44 smithi146 ceph-mon[35807]: pgmap v3634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:45.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:44 smithi076 ceph-mon[35401]: pgmap v3634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:44 smithi040 ceph-mon[32397]: pgmap v3634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:46 smithi040 ceph-mon[32397]: pgmap v3635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1893.017725 secs 2024-07-26T14:04:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:46 smithi146 ceph-mon[35807]: pgmap v3635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1893.017725 secs 2024-07-26T14:04:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:46 smithi076 ceph-mon[35401]: pgmap v3635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1893.017725 secs 2024-07-26T14:04:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:48 smithi040 ceph-mon[32397]: pgmap v3636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:48 smithi146 ceph-mon[35807]: pgmap v3636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:48 smithi076 ceph-mon[35401]: pgmap v3636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:50 smithi040 ceph-mon[32397]: pgmap v3637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:50 smithi146 ceph-mon[35807]: pgmap v3637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:50 smithi076 ceph-mon[35401]: pgmap v3637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:04:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1898.017856 secs 2024-07-26T14:04:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1898.017856 secs 2024-07-26T14:04:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1898.017856 secs 2024-07-26T14:04:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:52 smithi040 ceph-mon[32397]: pgmap v3638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:52 smithi146 ceph-mon[35807]: pgmap v3638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:52 smithi076 ceph-mon[35401]: pgmap v3638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:54 smithi040 ceph-mon[32397]: pgmap v3639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:54 smithi146 ceph-mon[35807]: pgmap v3639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:54 smithi076 ceph-mon[35401]: pgmap v3639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:56 smithi040 ceph-mon[32397]: pgmap v3640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1903.017998 secs 2024-07-26T14:04:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:56 smithi146 ceph-mon[35807]: pgmap v3640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1903.017998 secs 2024-07-26T14:04:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:56 smithi076 ceph-mon[35401]: pgmap v3640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:04:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1903.017998 secs 2024-07-26T14:04:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:04:58 smithi040 ceph-mon[32397]: pgmap v3641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:04:58 smithi146 ceph-mon[35807]: pgmap v3641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:04:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:04:58 smithi076 ceph-mon[35401]: pgmap v3641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:00 smithi040 ceph-mon[32397]: pgmap v3642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:00 smithi146 ceph-mon[35807]: pgmap v3642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:00 smithi076 ceph-mon[35401]: pgmap v3642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1908.018138 secs 2024-07-26T14:05:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1908.018138 secs 2024-07-26T14:05:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1908.018138 secs 2024-07-26T14:05:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:02 smithi040 ceph-mon[32397]: pgmap v3643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:02 smithi146 ceph-mon[35807]: pgmap v3643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:02 smithi076 ceph-mon[35401]: pgmap v3643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:03 smithi040 ceph-mon[32397]: pgmap v3644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:03 smithi146 ceph-mon[35807]: pgmap v3644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:03 smithi076 ceph-mon[35401]: pgmap v3644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:06 smithi146 ceph-mon[35807]: pgmap v3645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:06 smithi076 ceph-mon[35401]: pgmap v3645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:06 smithi040 ceph-mon[32397]: pgmap v3645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1913.018320 secs 2024-07-26T14:05:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1913.018320 secs 2024-07-26T14:05:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1913.018320 secs 2024-07-26T14:05:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:08 smithi040 ceph-mon[32397]: pgmap v3646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:08 smithi146 ceph-mon[35807]: pgmap v3646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:08 smithi076 ceph-mon[35401]: pgmap v3646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:10 smithi040 ceph-mon[32397]: pgmap v3647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:10 smithi146 ceph-mon[35807]: pgmap v3647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:10 smithi076 ceph-mon[35401]: pgmap v3647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1918.018459 secs 2024-07-26T14:05:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:12 smithi040 ceph-mon[32397]: pgmap v3648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:05:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1918.018459 secs 2024-07-26T14:05:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:12 smithi146 ceph-mon[35807]: pgmap v3648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:05:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1918.018459 secs 2024-07-26T14:05:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:12 smithi076 ceph-mon[35401]: pgmap v3648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:05:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:14 smithi040 ceph-mon[32397]: pgmap v3649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:14 smithi146 ceph-mon[35807]: pgmap v3649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:14.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:14 smithi076 ceph-mon[35401]: pgmap v3649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:16.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:16 smithi146 ceph-mon[35807]: pgmap v3650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:16.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:16 smithi076 ceph-mon[35401]: pgmap v3650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:16 smithi040 ceph-mon[32397]: pgmap v3650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1923.018565 secs 2024-07-26T14:05:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1923.018565 secs 2024-07-26T14:05:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1923.018565 secs 2024-07-26T14:05:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:18 smithi040 ceph-mon[32397]: pgmap v3651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:18 smithi146 ceph-mon[35807]: pgmap v3651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:18 smithi076 ceph-mon[35401]: pgmap v3651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:20 smithi040 ceph-mon[32397]: pgmap v3652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:20 smithi146 ceph-mon[35807]: pgmap v3652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:20 smithi076 ceph-mon[35401]: pgmap v3652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1928.018715 secs 2024-07-26T14:05:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1928.018715 secs 2024-07-26T14:05:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1928.018715 secs 2024-07-26T14:05:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:22 smithi040 ceph-mon[32397]: pgmap v3653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:22 smithi146 ceph-mon[35807]: pgmap v3653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:22 smithi076 ceph-mon[35401]: pgmap v3653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:24 smithi040 ceph-mon[32397]: pgmap v3654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:24 smithi146 ceph-mon[35807]: pgmap v3654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:24 smithi076 ceph-mon[35401]: pgmap v3654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:26 smithi040 ceph-mon[32397]: pgmap v3655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1933.018853 secs 2024-07-26T14:05:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:26 smithi146 ceph-mon[35807]: pgmap v3655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1933.018853 secs 2024-07-26T14:05:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:26 smithi076 ceph-mon[35401]: pgmap v3655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1933.018853 secs 2024-07-26T14:05:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:28 smithi040 ceph-mon[32397]: pgmap v3656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:28 smithi146 ceph-mon[35807]: pgmap v3656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:28 smithi076 ceph-mon[35401]: pgmap v3656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:30 smithi040 ceph-mon[32397]: pgmap v3657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:30 smithi146 ceph-mon[35807]: pgmap v3657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:30 smithi076 ceph-mon[35401]: pgmap v3657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1938.019009 secs 2024-07-26T14:05:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1938.019009 secs 2024-07-26T14:05:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1938.019009 secs 2024-07-26T14:05:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:32 smithi040 ceph-mon[32397]: pgmap v3658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:32 smithi146 ceph-mon[35807]: pgmap v3658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:32 smithi076 ceph-mon[35401]: pgmap v3658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:34 smithi040 ceph-mon[32397]: pgmap v3659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:34 smithi146 ceph-mon[35807]: pgmap v3659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:34 smithi076 ceph-mon[35401]: pgmap v3659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:36 smithi040 ceph-mon[32397]: pgmap v3660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1943.019180 secs 2024-07-26T14:05:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:36 smithi146 ceph-mon[35807]: pgmap v3660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1943.019180 secs 2024-07-26T14:05:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:36 smithi076 ceph-mon[35401]: pgmap v3660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1943.019180 secs 2024-07-26T14:05:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:38 smithi146 ceph-mon[35807]: pgmap v3661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:38 smithi076 ceph-mon[35401]: pgmap v3661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:38 smithi040 ceph-mon[32397]: pgmap v3661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:40 smithi146 ceph-mon[35807]: pgmap v3662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:40 smithi076 ceph-mon[35401]: pgmap v3662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:40 smithi040 ceph-mon[32397]: pgmap v3662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1948.019325 secs 2024-07-26T14:05:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1948.019325 secs 2024-07-26T14:05:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1948.019325 secs 2024-07-26T14:05:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:42 smithi146 ceph-mon[35807]: pgmap v3663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:42 smithi076 ceph-mon[35401]: pgmap v3663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:42 smithi040 ceph-mon[32397]: pgmap v3663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:44 smithi146 ceph-mon[35807]: pgmap v3664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:44 smithi076 ceph-mon[35401]: pgmap v3664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:44 smithi040 ceph-mon[32397]: pgmap v3664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:46 smithi146 ceph-mon[35807]: pgmap v3665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1953.019422 secs 2024-07-26T14:05:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:46 smithi076 ceph-mon[35401]: pgmap v3665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1953.019422 secs 2024-07-26T14:05:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:46 smithi040 ceph-mon[32397]: pgmap v3665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1953.019422 secs 2024-07-26T14:05:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:48 smithi146 ceph-mon[35807]: pgmap v3666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:48 smithi076 ceph-mon[35401]: pgmap v3666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:48 smithi040 ceph-mon[32397]: pgmap v3666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:50 smithi146 ceph-mon[35807]: pgmap v3667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:50 smithi076 ceph-mon[35401]: pgmap v3667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:50 smithi040 ceph-mon[32397]: pgmap v3667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:05:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1958.019585 secs 2024-07-26T14:05:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1958.019585 secs 2024-07-26T14:05:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1958.019585 secs 2024-07-26T14:05:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:52 smithi146 ceph-mon[35807]: pgmap v3668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:52 smithi076 ceph-mon[35401]: pgmap v3668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:52 smithi040 ceph-mon[32397]: pgmap v3668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:54 smithi146 ceph-mon[35807]: pgmap v3669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:54 smithi076 ceph-mon[35401]: pgmap v3669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:54 smithi040 ceph-mon[32397]: pgmap v3669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:56 smithi076 ceph-mon[35401]: pgmap v3670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1963.019749 secs 2024-07-26T14:05:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:56 smithi040 ceph-mon[32397]: pgmap v3670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1963.019749 secs 2024-07-26T14:05:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:56 smithi146 ceph-mon[35807]: pgmap v3670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:05:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1963.019749 secs 2024-07-26T14:05:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:05:58 smithi076 ceph-mon[35401]: pgmap v3671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:05:58 smithi040 ceph-mon[32397]: pgmap v3671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:05:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:05:58 smithi146 ceph-mon[35807]: pgmap v3671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:00 smithi040 ceph-mon[32397]: pgmap v3672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:00 smithi146 ceph-mon[35807]: pgmap v3672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:00 smithi076 ceph-mon[35401]: pgmap v3672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1968.019897 secs 2024-07-26T14:06:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1968.019897 secs 2024-07-26T14:06:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1968.019897 secs 2024-07-26T14:06:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:02 smithi040 ceph-mon[32397]: pgmap v3673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:02 smithi146 ceph-mon[35807]: pgmap v3673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:02 smithi076 ceph-mon[35401]: pgmap v3673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:04 smithi040 ceph-mon[32397]: pgmap v3674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:04 smithi146 ceph-mon[35807]: pgmap v3674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:04 smithi076 ceph-mon[35401]: pgmap v3674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:06 smithi040 ceph-mon[32397]: pgmap v3675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1973.020037 secs 2024-07-26T14:06:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:06 smithi146 ceph-mon[35807]: pgmap v3675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1973.020037 secs 2024-07-26T14:06:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:06 smithi076 ceph-mon[35401]: pgmap v3675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1973.020037 secs 2024-07-26T14:06:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:08 smithi040 ceph-mon[32397]: pgmap v3676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:08 smithi146 ceph-mon[35807]: pgmap v3676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:08 smithi076 ceph-mon[35401]: pgmap v3676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:10 smithi040 ceph-mon[32397]: pgmap v3677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:10 smithi146 ceph-mon[35807]: pgmap v3677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:10 smithi076 ceph-mon[35401]: pgmap v3677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1978.020178 secs 2024-07-26T14:06:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1978.020178 secs 2024-07-26T14:06:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1978.020178 secs 2024-07-26T14:06:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:12 smithi040 ceph-mon[32397]: pgmap v3678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:12 smithi146 ceph-mon[35807]: pgmap v3678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:12 smithi076 ceph-mon[35401]: pgmap v3678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:14 smithi040 ceph-mon[32397]: pgmap v3679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:14 smithi146 ceph-mon[35807]: pgmap v3679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:14 smithi076 ceph-mon[35401]: pgmap v3679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:16 smithi040 ceph-mon[32397]: pgmap v3680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1983.020321 secs 2024-07-26T14:06:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:16 smithi146 ceph-mon[35807]: pgmap v3680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1983.020321 secs 2024-07-26T14:06:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:16 smithi076 ceph-mon[35401]: pgmap v3680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1983.020321 secs 2024-07-26T14:06:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:18 smithi040 ceph-mon[32397]: pgmap v3681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:18 smithi146 ceph-mon[35807]: pgmap v3681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:18 smithi076 ceph-mon[35401]: pgmap v3681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:20 smithi040 ceph-mon[32397]: pgmap v3682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:20 smithi146 ceph-mon[35807]: pgmap v3682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:20 smithi076 ceph-mon[35401]: pgmap v3682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1988.020463 secs 2024-07-26T14:06:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1988.020463 secs 2024-07-26T14:06:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1988.020463 secs 2024-07-26T14:06:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:22 smithi040 ceph-mon[32397]: pgmap v3683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:22 smithi146 ceph-mon[35807]: pgmap v3683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:22 smithi076 ceph-mon[35401]: pgmap v3683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:24 smithi040 ceph-mon[32397]: pgmap v3684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:24 smithi146 ceph-mon[35807]: pgmap v3684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:24 smithi076 ceph-mon[35401]: pgmap v3684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:26 smithi040 ceph-mon[32397]: pgmap v3685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1993.020566 secs 2024-07-26T14:06:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:26 smithi146 ceph-mon[35807]: pgmap v3685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1993.020566 secs 2024-07-26T14:06:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:26 smithi076 ceph-mon[35401]: pgmap v3685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1993.020566 secs 2024-07-26T14:06:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:28 smithi040 ceph-mon[32397]: pgmap v3686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:28 smithi146 ceph-mon[35807]: pgmap v3686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:28 smithi076 ceph-mon[35401]: pgmap v3686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:30 smithi040 ceph-mon[32397]: pgmap v3687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:30 smithi146 ceph-mon[35807]: pgmap v3687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:30 smithi076 ceph-mon[35401]: pgmap v3687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 1998.020707 secs 2024-07-26T14:06:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 1998.020707 secs 2024-07-26T14:06:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 1998.020707 secs 2024-07-26T14:06:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:32 smithi146 ceph-mon[35807]: pgmap v3688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:32 smithi076 ceph-mon[35401]: pgmap v3688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:32 smithi040 ceph-mon[32397]: pgmap v3688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:34 smithi146 ceph-mon[35807]: pgmap v3689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:34 smithi076 ceph-mon[35401]: pgmap v3689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:34 smithi040 ceph-mon[32397]: pgmap v3689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:36 smithi146 ceph-mon[35807]: pgmap v3690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2003.020834 secs 2024-07-26T14:06:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:36 smithi076 ceph-mon[35401]: pgmap v3690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2003.020834 secs 2024-07-26T14:06:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:36 smithi040 ceph-mon[32397]: pgmap v3690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2003.020834 secs 2024-07-26T14:06:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:38 smithi146 ceph-mon[35807]: pgmap v3691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:38 smithi076 ceph-mon[35401]: pgmap v3691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:38 smithi040 ceph-mon[32397]: pgmap v3691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:40 smithi146 ceph-mon[35807]: pgmap v3692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:40 smithi076 ceph-mon[35401]: pgmap v3692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:40 smithi040 ceph-mon[32397]: pgmap v3692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2008.020989 secs 2024-07-26T14:06:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2008.020989 secs 2024-07-26T14:06:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2008.020989 secs 2024-07-26T14:06:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:42 smithi146 ceph-mon[35807]: pgmap v3693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:42 smithi076 ceph-mon[35401]: pgmap v3693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:42 smithi040 ceph-mon[32397]: pgmap v3693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:44 smithi146 ceph-mon[35807]: pgmap v3694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:44 smithi076 ceph-mon[35401]: pgmap v3694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:44 smithi040 ceph-mon[32397]: pgmap v3694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:46 smithi146 ceph-mon[35807]: pgmap v3695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2013.021135 secs 2024-07-26T14:06:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:46 smithi076 ceph-mon[35401]: pgmap v3695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2013.021135 secs 2024-07-26T14:06:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:46 smithi040 ceph-mon[32397]: pgmap v3695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2013.021135 secs 2024-07-26T14:06:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:48 smithi146 ceph-mon[35807]: pgmap v3696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:48 smithi076 ceph-mon[35401]: pgmap v3696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:48 smithi040 ceph-mon[32397]: pgmap v3696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:50 smithi146 ceph-mon[35807]: pgmap v3697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:50 smithi076 ceph-mon[35401]: pgmap v3697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:50 smithi040 ceph-mon[32397]: pgmap v3697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:06:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2018.021313 secs 2024-07-26T14:06:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2018.021313 secs 2024-07-26T14:06:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2018.021313 secs 2024-07-26T14:06:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:52 smithi040 ceph-mon[32397]: pgmap v3698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:52 smithi146 ceph-mon[35807]: pgmap v3698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:52 smithi076 ceph-mon[35401]: pgmap v3698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:54 smithi040 ceph-mon[32397]: pgmap v3699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:54 smithi146 ceph-mon[35807]: pgmap v3699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:55.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:54 smithi076 ceph-mon[35401]: pgmap v3699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:56 smithi040 ceph-mon[32397]: pgmap v3700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2023.021410 secs 2024-07-26T14:06:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:56 smithi146 ceph-mon[35807]: pgmap v3700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2023.021410 secs 2024-07-26T14:06:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:56 smithi076 ceph-mon[35401]: pgmap v3700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:06:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2023.021410 secs 2024-07-26T14:06:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:06:58 smithi040 ceph-mon[32397]: pgmap v3701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:06:58 smithi146 ceph-mon[35807]: pgmap v3701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:06:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:06:58 smithi076 ceph-mon[35401]: pgmap v3701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:00 smithi040 ceph-mon[32397]: pgmap v3702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:00 smithi146 ceph-mon[35807]: pgmap v3702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:00 smithi076 ceph-mon[35401]: pgmap v3702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2028.021554 secs 2024-07-26T14:07:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2028.021554 secs 2024-07-26T14:07:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2028.021554 secs 2024-07-26T14:07:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:02 smithi040 ceph-mon[32397]: pgmap v3703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:02 smithi146 ceph-mon[35807]: pgmap v3703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:02 smithi076 ceph-mon[35401]: pgmap v3703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:04 smithi040 ceph-mon[32397]: pgmap v3704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:04 smithi146 ceph-mon[35807]: pgmap v3704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:04 smithi076 ceph-mon[35401]: pgmap v3704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:06 smithi040 ceph-mon[32397]: pgmap v3705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2033.021695 secs 2024-07-26T14:07:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:06 smithi146 ceph-mon[35807]: pgmap v3705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2033.021695 secs 2024-07-26T14:07:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:06 smithi076 ceph-mon[35401]: pgmap v3705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2033.021695 secs 2024-07-26T14:07:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:08 smithi040 ceph-mon[32397]: pgmap v3706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:08 smithi146 ceph-mon[35807]: pgmap v3706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:08 smithi076 ceph-mon[35401]: pgmap v3706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:10 smithi040 ceph-mon[32397]: pgmap v3707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:10 smithi146 ceph-mon[35807]: pgmap v3707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:10 smithi076 ceph-mon[35401]: pgmap v3707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2038.021838 secs 2024-07-26T14:07:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2038.021838 secs 2024-07-26T14:07:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2038.021838 secs 2024-07-26T14:07:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:12 smithi040 ceph-mon[32397]: pgmap v3708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:12 smithi146 ceph-mon[35807]: pgmap v3708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:12 smithi076 ceph-mon[35401]: pgmap v3708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:14 smithi040 ceph-mon[32397]: pgmap v3709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:14 smithi146 ceph-mon[35807]: pgmap v3709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:14 smithi076 ceph-mon[35401]: pgmap v3709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:16 smithi040 ceph-mon[32397]: pgmap v3710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2043.021980 secs 2024-07-26T14:07:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:16 smithi146 ceph-mon[35807]: pgmap v3710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2043.021980 secs 2024-07-26T14:07:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:16 smithi076 ceph-mon[35401]: pgmap v3710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2043.021980 secs 2024-07-26T14:07:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:18 smithi040 ceph-mon[32397]: pgmap v3711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:18 smithi146 ceph-mon[35807]: pgmap v3711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:18 smithi076 ceph-mon[35401]: pgmap v3711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:20 smithi040 ceph-mon[32397]: pgmap v3712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:20 smithi146 ceph-mon[35807]: pgmap v3712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:20 smithi076 ceph-mon[35401]: pgmap v3712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2048.022120 secs 2024-07-26T14:07:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2048.022120 secs 2024-07-26T14:07:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2048.022120 secs 2024-07-26T14:07:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:22 smithi040 ceph-mon[32397]: pgmap v3713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:22 smithi146 ceph-mon[35807]: pgmap v3713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:22 smithi076 ceph-mon[35401]: pgmap v3713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:23 smithi146 ceph-mon[35807]: pgmap v3714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:23 smithi076 ceph-mon[35401]: pgmap v3714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:23 smithi040 ceph-mon[32397]: pgmap v3714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:26 smithi040 ceph-mon[32397]: pgmap v3715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:26 smithi146 ceph-mon[35807]: pgmap v3715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:26 smithi076 ceph-mon[35401]: pgmap v3715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2053.022302 secs 2024-07-26T14:07:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2053.022302 secs 2024-07-26T14:07:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2053.022302 secs 2024-07-26T14:07:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:28 smithi040 ceph-mon[32397]: pgmap v3716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:28 smithi146 ceph-mon[35807]: pgmap v3716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:28 smithi076 ceph-mon[35401]: pgmap v3716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:30 smithi040 ceph-mon[32397]: pgmap v3717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:30 smithi146 ceph-mon[35807]: pgmap v3717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:30 smithi076 ceph-mon[35401]: pgmap v3717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2058.022451 secs 2024-07-26T14:07:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:32 smithi040 ceph-mon[32397]: pgmap v3718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2058.022451 secs 2024-07-26T14:07:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:32 smithi146 ceph-mon[35807]: pgmap v3718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2058.022451 secs 2024-07-26T14:07:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:32 smithi076 ceph-mon[35401]: pgmap v3718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:34 smithi040 ceph-mon[32397]: pgmap v3719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:34 smithi146 ceph-mon[35807]: pgmap v3719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:34 smithi076 ceph-mon[35401]: pgmap v3719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:36 smithi040 ceph-mon[32397]: pgmap v3720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:36 smithi146 ceph-mon[35807]: pgmap v3720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:36 smithi076 ceph-mon[35401]: pgmap v3720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2063.022626 secs 2024-07-26T14:07:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2063.022626 secs 2024-07-26T14:07:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2063.022626 secs 2024-07-26T14:07:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:38 smithi040 ceph-mon[32397]: pgmap v3721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:38 smithi146 ceph-mon[35807]: pgmap v3721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:38 smithi076 ceph-mon[35401]: pgmap v3721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:40 smithi040 ceph-mon[32397]: pgmap v3722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:40 smithi146 ceph-mon[35807]: pgmap v3722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:40 smithi076 ceph-mon[35401]: pgmap v3722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2068.022789 secs 2024-07-26T14:07:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:42 smithi146 ceph-mon[35807]: pgmap v3723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2068.022789 secs 2024-07-26T14:07:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:42 smithi076 ceph-mon[35401]: pgmap v3723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2068.022789 secs 2024-07-26T14:07:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:42 smithi040 ceph-mon[32397]: pgmap v3723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:44 smithi146 ceph-mon[35807]: pgmap v3724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:44 smithi076 ceph-mon[35401]: pgmap v3724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:44 smithi040 ceph-mon[32397]: pgmap v3724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:46 smithi146 ceph-mon[35807]: pgmap v3725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:46 smithi076 ceph-mon[35401]: pgmap v3725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:46 smithi040 ceph-mon[32397]: pgmap v3725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2073.022930 secs 2024-07-26T14:07:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2073.022930 secs 2024-07-26T14:07:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2073.022930 secs 2024-07-26T14:07:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:48 smithi146 ceph-mon[35807]: pgmap v3726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:48 smithi076 ceph-mon[35401]: pgmap v3726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:48 smithi040 ceph-mon[32397]: pgmap v3726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:50 smithi146 ceph-mon[35807]: pgmap v3727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:50 smithi076 ceph-mon[35401]: pgmap v3727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:50 smithi040 ceph-mon[32397]: pgmap v3727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:07:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2078.023090 secs 2024-07-26T14:07:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:52 smithi146 ceph-mon[35807]: pgmap v3728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2078.023090 secs 2024-07-26T14:07:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:52 smithi076 ceph-mon[35401]: pgmap v3728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2078.023090 secs 2024-07-26T14:07:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:52 smithi040 ceph-mon[32397]: pgmap v3728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:54 smithi146 ceph-mon[35807]: pgmap v3729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:54 smithi076 ceph-mon[35401]: pgmap v3729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:54 smithi040 ceph-mon[32397]: pgmap v3729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:56 smithi146 ceph-mon[35807]: pgmap v3730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:56 smithi076 ceph-mon[35401]: pgmap v3730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:56 smithi040 ceph-mon[32397]: pgmap v3730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:07:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2083.023239 secs 2024-07-26T14:07:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2083.023239 secs 2024-07-26T14:07:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2083.023239 secs 2024-07-26T14:07:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:07:58 smithi146 ceph-mon[35807]: pgmap v3731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:07:58 smithi076 ceph-mon[35401]: pgmap v3731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:07:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:07:58 smithi040 ceph-mon[32397]: pgmap v3731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:00 smithi146 ceph-mon[35807]: pgmap v3732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:00 smithi076 ceph-mon[35401]: pgmap v3732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:00 smithi040 ceph-mon[32397]: pgmap v3732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:02.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2088.023382 secs 2024-07-26T14:08:02.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:02 smithi076 ceph-mon[35401]: pgmap v3733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2088.023382 secs 2024-07-26T14:08:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:02 smithi040 ceph-mon[32397]: pgmap v3733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2088.023382 secs 2024-07-26T14:08:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:02 smithi146 ceph-mon[35807]: pgmap v3733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:04 smithi076 ceph-mon[35401]: pgmap v3734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:04 smithi040 ceph-mon[32397]: pgmap v3734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:04 smithi146 ceph-mon[35807]: pgmap v3734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:06 smithi146 ceph-mon[35807]: pgmap v3735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2093.023519 secs 2024-07-26T14:08:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:06 smithi076 ceph-mon[35401]: pgmap v3735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2093.023519 secs 2024-07-26T14:08:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:06 smithi040 ceph-mon[32397]: pgmap v3735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2093.023519 secs 2024-07-26T14:08:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:08 smithi146 ceph-mon[35807]: pgmap v3736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:08 smithi076 ceph-mon[35401]: pgmap v3736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:08 smithi040 ceph-mon[32397]: pgmap v3736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:10 smithi146 ceph-mon[35807]: pgmap v3737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:10 smithi076 ceph-mon[35401]: pgmap v3737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:10 smithi040 ceph-mon[32397]: pgmap v3737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2098.023682 secs 2024-07-26T14:08:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2098.023682 secs 2024-07-26T14:08:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2098.023682 secs 2024-07-26T14:08:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:12 smithi146 ceph-mon[35807]: pgmap v3738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:12 smithi076 ceph-mon[35401]: pgmap v3738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:12 smithi040 ceph-mon[32397]: pgmap v3738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:14 smithi146 ceph-mon[35807]: pgmap v3739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:14 smithi076 ceph-mon[35401]: pgmap v3739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:14 smithi040 ceph-mon[32397]: pgmap v3739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:16 smithi146 ceph-mon[35807]: pgmap v3740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2103.023826 secs 2024-07-26T14:08:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:16 smithi076 ceph-mon[35401]: pgmap v3740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2103.023826 secs 2024-07-26T14:08:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:16 smithi040 ceph-mon[32397]: pgmap v3740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2103.023826 secs 2024-07-26T14:08:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:18 smithi146 ceph-mon[35807]: pgmap v3741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:18 smithi076 ceph-mon[35401]: pgmap v3741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:18 smithi040 ceph-mon[32397]: pgmap v3741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:20 smithi146 ceph-mon[35807]: pgmap v3742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:20 smithi076 ceph-mon[35401]: pgmap v3742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:20 smithi040 ceph-mon[32397]: pgmap v3742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2108.023969 secs 2024-07-26T14:08:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2108.023969 secs 2024-07-26T14:08:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2108.023969 secs 2024-07-26T14:08:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:22 smithi146 ceph-mon[35807]: pgmap v3743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:22 smithi076 ceph-mon[35401]: pgmap v3743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:22 smithi040 ceph-mon[32397]: pgmap v3743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:24 smithi076 ceph-mon[35401]: pgmap v3744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:24 smithi040 ceph-mon[32397]: pgmap v3744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:24 smithi146 ceph-mon[35807]: pgmap v3744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:26 smithi076 ceph-mon[35401]: pgmap v3745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2113.024113 secs 2024-07-26T14:08:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:26 smithi040 ceph-mon[32397]: pgmap v3745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2113.024113 secs 2024-07-26T14:08:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:26 smithi146 ceph-mon[35807]: pgmap v3745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2113.024113 secs 2024-07-26T14:08:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:28 smithi040 ceph-mon[32397]: pgmap v3746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:28 smithi146 ceph-mon[35807]: pgmap v3746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:28 smithi076 ceph-mon[35401]: pgmap v3746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:30 smithi040 ceph-mon[32397]: pgmap v3747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:30 smithi146 ceph-mon[35807]: pgmap v3747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:30 smithi076 ceph-mon[35401]: pgmap v3747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2118.024314 secs 2024-07-26T14:08:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2118.024314 secs 2024-07-26T14:08:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2118.024314 secs 2024-07-26T14:08:32.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:32 smithi040 ceph-mon[32397]: pgmap v3748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:32 smithi146 ceph-mon[35807]: pgmap v3748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:32 smithi076 ceph-mon[35401]: pgmap v3748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:34 smithi040 ceph-mon[32397]: pgmap v3749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:34 smithi146 ceph-mon[35807]: pgmap v3749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:34 smithi076 ceph-mon[35401]: pgmap v3749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:36 smithi040 ceph-mon[32397]: pgmap v3750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2123.024450 secs 2024-07-26T14:08:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:36 smithi146 ceph-mon[35807]: pgmap v3750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2123.024450 secs 2024-07-26T14:08:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:36 smithi076 ceph-mon[35401]: pgmap v3750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2123.024450 secs 2024-07-26T14:08:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:38 smithi040 ceph-mon[32397]: pgmap v3751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:38 smithi146 ceph-mon[35807]: pgmap v3751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:38 smithi076 ceph-mon[35401]: pgmap v3751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:40 smithi040 ceph-mon[32397]: pgmap v3752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:40 smithi146 ceph-mon[35807]: pgmap v3752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:40 smithi076 ceph-mon[35401]: pgmap v3752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2128.024589 secs 2024-07-26T14:08:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2128.024589 secs 2024-07-26T14:08:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2128.024589 secs 2024-07-26T14:08:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:42 smithi040 ceph-mon[32397]: pgmap v3753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:42 smithi146 ceph-mon[35807]: pgmap v3753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:42 smithi076 ceph-mon[35401]: pgmap v3753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:44 smithi040 ceph-mon[32397]: pgmap v3754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:44 smithi146 ceph-mon[35807]: pgmap v3754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:44 smithi076 ceph-mon[35401]: pgmap v3754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:46 smithi040 ceph-mon[32397]: pgmap v3755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2133.024722 secs 2024-07-26T14:08:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:46 smithi146 ceph-mon[35807]: pgmap v3755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2133.024722 secs 2024-07-26T14:08:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:46 smithi076 ceph-mon[35401]: pgmap v3755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2133.024722 secs 2024-07-26T14:08:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:48 smithi040 ceph-mon[32397]: pgmap v3756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:48 smithi146 ceph-mon[35807]: pgmap v3756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:48 smithi076 ceph-mon[35401]: pgmap v3756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:50 smithi040 ceph-mon[32397]: pgmap v3757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:50 smithi146 ceph-mon[35807]: pgmap v3757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:50 smithi076 ceph-mon[35401]: pgmap v3757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:08:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2138.024855 secs 2024-07-26T14:08:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2138.024855 secs 2024-07-26T14:08:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2138.024855 secs 2024-07-26T14:08:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:52 smithi040 ceph-mon[32397]: pgmap v3758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:52 smithi146 ceph-mon[35807]: pgmap v3758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:52 smithi076 ceph-mon[35401]: pgmap v3758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:54 smithi040 ceph-mon[32397]: pgmap v3759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:54 smithi146 ceph-mon[35807]: pgmap v3759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:54 smithi076 ceph-mon[35401]: pgmap v3759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:56 smithi040 ceph-mon[32397]: pgmap v3760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2143.024993 secs 2024-07-26T14:08:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:56 smithi146 ceph-mon[35807]: pgmap v3760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2143.024993 secs 2024-07-26T14:08:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:56 smithi076 ceph-mon[35401]: pgmap v3760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:08:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2143.024993 secs 2024-07-26T14:08:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:08:58 smithi040 ceph-mon[32397]: pgmap v3761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:08:58 smithi146 ceph-mon[35807]: pgmap v3761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:08:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:08:58 smithi076 ceph-mon[35401]: pgmap v3761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:00 smithi040 ceph-mon[32397]: pgmap v3762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:00 smithi146 ceph-mon[35807]: pgmap v3762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:00 smithi076 ceph-mon[35401]: pgmap v3762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2148.025132 secs 2024-07-26T14:09:02.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2148.025132 secs 2024-07-26T14:09:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2148.025132 secs 2024-07-26T14:09:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:02 smithi146 ceph-mon[35807]: pgmap v3763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:02 smithi076 ceph-mon[35401]: pgmap v3763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:03.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:02 smithi040 ceph-mon[32397]: pgmap v3763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:04 smithi146 ceph-mon[35807]: pgmap v3764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:04 smithi076 ceph-mon[35401]: pgmap v3764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:04 smithi040 ceph-mon[32397]: pgmap v3764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:06 smithi146 ceph-mon[35807]: pgmap v3765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2153.025304 secs 2024-07-26T14:09:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:06 smithi076 ceph-mon[35401]: pgmap v3765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2153.025304 secs 2024-07-26T14:09:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:06 smithi040 ceph-mon[32397]: pgmap v3765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2153.025304 secs 2024-07-26T14:09:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:08 smithi146 ceph-mon[35807]: pgmap v3766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:08 smithi076 ceph-mon[35401]: pgmap v3766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:08 smithi040 ceph-mon[32397]: pgmap v3766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:10 smithi146 ceph-mon[35807]: pgmap v3767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:10 smithi076 ceph-mon[35401]: pgmap v3767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:10 smithi040 ceph-mon[32397]: pgmap v3767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2158.025446 secs 2024-07-26T14:09:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2158.025446 secs 2024-07-26T14:09:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2158.025446 secs 2024-07-26T14:09:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:12 smithi146 ceph-mon[35807]: pgmap v3768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:12 smithi076 ceph-mon[35401]: pgmap v3768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:12 smithi040 ceph-mon[32397]: pgmap v3768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:14 smithi146 ceph-mon[35807]: pgmap v3769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:14 smithi076 ceph-mon[35401]: pgmap v3769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:14 smithi040 ceph-mon[32397]: pgmap v3769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:16 smithi146 ceph-mon[35807]: pgmap v3770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2163.025586 secs 2024-07-26T14:09:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:16 smithi076 ceph-mon[35401]: pgmap v3770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2163.025586 secs 2024-07-26T14:09:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:16 smithi040 ceph-mon[32397]: pgmap v3770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2163.025586 secs 2024-07-26T14:09:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:18 smithi146 ceph-mon[35807]: pgmap v3771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:18 smithi076 ceph-mon[35401]: pgmap v3771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:18 smithi040 ceph-mon[32397]: pgmap v3771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:20 smithi076 ceph-mon[35401]: pgmap v3772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:20 smithi040 ceph-mon[32397]: pgmap v3772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:20 smithi146 ceph-mon[35807]: pgmap v3772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2168.025742 secs 2024-07-26T14:09:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2168.025742 secs 2024-07-26T14:09:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2168.025742 secs 2024-07-26T14:09:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:22 smithi040 ceph-mon[32397]: pgmap v3773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:22 smithi146 ceph-mon[35807]: pgmap v3773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:22 smithi076 ceph-mon[35401]: pgmap v3773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:24 smithi040 ceph-mon[32397]: pgmap v3774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:24 smithi146 ceph-mon[35807]: pgmap v3774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:24 smithi076 ceph-mon[35401]: pgmap v3774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:26 smithi040 ceph-mon[32397]: pgmap v3775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2173.025888 secs 2024-07-26T14:09:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:26 smithi146 ceph-mon[35807]: pgmap v3775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2173.025888 secs 2024-07-26T14:09:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:26 smithi076 ceph-mon[35401]: pgmap v3775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2173.025888 secs 2024-07-26T14:09:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:28 smithi040 ceph-mon[32397]: pgmap v3776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:28 smithi146 ceph-mon[35807]: pgmap v3776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:28 smithi076 ceph-mon[35401]: pgmap v3776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:30 smithi040 ceph-mon[32397]: pgmap v3777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:30 smithi146 ceph-mon[35807]: pgmap v3777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:30 smithi076 ceph-mon[35401]: pgmap v3777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2178.026049 secs 2024-07-26T14:09:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2178.026049 secs 2024-07-26T14:09:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2178.026049 secs 2024-07-26T14:09:33.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:32 smithi040 ceph-mon[32397]: pgmap v3778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:32 smithi146 ceph-mon[35807]: pgmap v3778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:33.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:32 smithi076 ceph-mon[35401]: pgmap v3778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:34 smithi040 ceph-mon[32397]: pgmap v3779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:34 smithi146 ceph-mon[35807]: pgmap v3779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:34 smithi076 ceph-mon[35401]: pgmap v3779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:36 smithi040 ceph-mon[32397]: pgmap v3780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2183.026181 secs 2024-07-26T14:09:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:36 smithi146 ceph-mon[35807]: pgmap v3780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2183.026181 secs 2024-07-26T14:09:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:36 smithi076 ceph-mon[35401]: pgmap v3780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2183.026181 secs 2024-07-26T14:09:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:38 smithi040 ceph-mon[32397]: pgmap v3781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:38 smithi146 ceph-mon[35807]: pgmap v3781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:38 smithi076 ceph-mon[35401]: pgmap v3781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:40 smithi040 ceph-mon[32397]: pgmap v3782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:40 smithi146 ceph-mon[35807]: pgmap v3782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:40 smithi076 ceph-mon[35401]: pgmap v3782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:09:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2188.026356 secs 2024-07-26T14:09:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2188.026356 secs 2024-07-26T14:09:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2188.026356 secs 2024-07-26T14:09:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:42 smithi040 ceph-mon[32397]: pgmap v3783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:42 smithi146 ceph-mon[35807]: pgmap v3783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:42 smithi076 ceph-mon[35401]: pgmap v3783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:44 smithi040 ceph-mon[32397]: pgmap v3784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:44 smithi146 ceph-mon[35807]: pgmap v3784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:44 smithi076 ceph-mon[35401]: pgmap v3784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:46 smithi040 ceph-mon[32397]: pgmap v3785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2193.026473 secs 2024-07-26T14:09:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:46 smithi146 ceph-mon[35807]: pgmap v3785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2193.026473 secs 2024-07-26T14:09:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:46 smithi076 ceph-mon[35401]: pgmap v3785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2193.026473 secs 2024-07-26T14:09:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:48 smithi040 ceph-mon[32397]: pgmap v3786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:48 smithi146 ceph-mon[35807]: pgmap v3786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:48 smithi076 ceph-mon[35401]: pgmap v3786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:50 smithi040 ceph-mon[32397]: pgmap v3787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:50 smithi146 ceph-mon[35807]: pgmap v3787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:50 smithi076 ceph-mon[35401]: pgmap v3787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2198.026615 secs 2024-07-26T14:09:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2198.026615 secs 2024-07-26T14:09:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2198.026615 secs 2024-07-26T14:09:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:52 smithi146 ceph-mon[35807]: pgmap v3788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:09:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:52 smithi076 ceph-mon[35401]: pgmap v3788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:09:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:52 smithi040 ceph-mon[32397]: pgmap v3788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:09:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:53 smithi146 ceph-mon[35807]: pgmap v3789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:53 smithi076 ceph-mon[35401]: pgmap v3789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:53 smithi040 ceph-mon[32397]: pgmap v3789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:09:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:56 smithi146 ceph-mon[35807]: pgmap v3790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:56 smithi076 ceph-mon[35401]: pgmap v3790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:56 smithi040 ceph-mon[32397]: pgmap v3790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:09:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2203.026752 secs 2024-07-26T14:09:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2203.026752 secs 2024-07-26T14:09:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2203.026752 secs 2024-07-26T14:09:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:09:58 smithi146 ceph-mon[35807]: pgmap v3791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:09:58 smithi076 ceph-mon[35401]: pgmap v3791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:09:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:09:58 smithi040 ceph-mon[32397]: pgmap v3791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:00.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: pgmap v3792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:00.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.g on smithi040 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.a on smithi040 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.k on smithi076 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.e on smithi076 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.b on smithi076 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.f on smithi146 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.c on smithi146 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: daemon mds.i on smithi146 is in error state 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-07-26T14:10:00.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: host smithi040 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: /usr/bin/podman: timeout after 895 seconds 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 -e NODE_NAME=smithi040 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/run/ceph:z -v /var/log/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp9okdbfs4:/etc/ceph/ceph.conf:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 inventory --format=json-pretty --filter-for-batch 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: Traceback (most recent call last): 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: return _run_code(code, main_globals, None, 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: exec(code, run_globals) 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 5590, in 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 5578, in main 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 411, in _infer_config 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 326, in _infer_fsid 2024-07-26T14:10:00.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 439, in _infer_image 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 313, in _validate_fsid 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 3320, in command_ceph_volume 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: File "/tmp/tmpn8q0pct9.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 -e NODE_NAME=smithi040 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/run/ceph:z -v /var/log/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp9okdbfs4:/etc/ceph/ceph.conf:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 inventory --format=json-pretty --filter-for-batch 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: fs cephfs is degraded 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T14:10:00.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:00 smithi146 ceph-mon[35807]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: pgmap v3792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.g on smithi040 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.a on smithi040 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.k on smithi076 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.e on smithi076 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.b on smithi076 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.f on smithi146 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.c on smithi146 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: daemon mds.i on smithi146 is in error state 2024-07-26T14:10:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: host smithi040 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: /usr/bin/podman: timeout after 895 seconds 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 -e NODE_NAME=smithi040 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/run/ceph:z -v /var/log/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp9okdbfs4:/etc/ceph/ceph.conf:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 inventory --format=json-pretty --filter-for-batch 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: Traceback (most recent call last): 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: return _run_code(code, main_globals, None, 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: exec(code, run_globals) 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 5590, in 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 5578, in main 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 411, in _infer_config 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 326, in _infer_fsid 2024-07-26T14:10:00.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 439, in _infer_image 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 313, in _validate_fsid 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 3320, in command_ceph_volume 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: File "/tmp/tmpn8q0pct9.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 -e NODE_NAME=smithi040 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/run/ceph:z -v /var/log/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp9okdbfs4:/etc/ceph/ceph.conf:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 inventory --format=json-pretty --filter-for-batch 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: fs cephfs is degraded 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T14:10:00.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:00 smithi076 ceph-mon[35401]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: pgmap v3792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.g on smithi040 is in error state 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.a on smithi040 is in error state 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.k on smithi076 is in error state 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.e on smithi076 is in error state 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.b on smithi076 is in error state 2024-07-26T14:10:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.f on smithi146 is in error state 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.c on smithi146 is in error state 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: daemon mds.i on smithi146 is in error state 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: host smithi040 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: /usr/bin/podman: timeout after 895 seconds 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 -e NODE_NAME=smithi040 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/run/ceph:z -v /var/log/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp9okdbfs4:/etc/ceph/ceph.conf:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 inventory --format=json-pretty --filter-for-batch 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: Traceback (most recent call last): 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: return _run_code(code, main_globals, None, 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-07-26T14:10:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: exec(code, run_globals) 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 5590, in 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 5578, in main 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 411, in _infer_config 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 326, in _infer_fsid 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 439, in _infer_image 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 313, in _validate_fsid 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/__main__.py", line 3320, in command_ceph_volume 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: File "/tmp/tmpn8q0pct9.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 -e NODE_NAME=smithi040 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/run/ceph:z -v /var/log/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp9okdbfs4:/etc/ceph/ceph.conf:z quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54b7054dea190fddefae31e8872b94a8bc32a70716ff596bdd9c7ee47e62e2d2 inventory --format=json-pretty --filter-for-batch 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-07-26T14:10:00.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: fs cephfs is degraded 2024-07-26T14:10:00.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-07-26T14:10:00.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:00 smithi040 ceph-mon[32397]: mds.h(mds.1): 1 slow requests are blocked > 180 secs 2024-07-26T14:10:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2208.026908 secs 2024-07-26T14:10:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:02 smithi146 ceph-mon[35807]: pgmap v3793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2208.026908 secs 2024-07-26T14:10:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:02 smithi076 ceph-mon[35401]: pgmap v3793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2208.026908 secs 2024-07-26T14:10:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:02 smithi040 ceph-mon[32397]: pgmap v3793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:04 smithi146 ceph-mon[35807]: pgmap v3794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:04 smithi076 ceph-mon[35401]: pgmap v3794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:04 smithi040 ceph-mon[32397]: pgmap v3794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:06 smithi146 ceph-mon[35807]: pgmap v3795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:06 smithi076 ceph-mon[35401]: pgmap v3795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:06 smithi040 ceph-mon[32397]: pgmap v3795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2213.027041 secs 2024-07-26T14:10:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2213.027041 secs 2024-07-26T14:10:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2213.027041 secs 2024-07-26T14:10:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:08 smithi076 ceph-mon[35401]: pgmap v3796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:08 smithi040 ceph-mon[32397]: pgmap v3796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:08 smithi146 ceph-mon[35807]: pgmap v3796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:10 smithi076 ceph-mon[35401]: pgmap v3797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:10 smithi040 ceph-mon[32397]: pgmap v3797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:10 smithi146 ceph-mon[35807]: pgmap v3797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2218.027179 secs 2024-07-26T14:10:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:12 smithi040 ceph-mon[32397]: pgmap v3798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2218.027179 secs 2024-07-26T14:10:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:12 smithi146 ceph-mon[35807]: pgmap v3798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2218.027179 secs 2024-07-26T14:10:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:12 smithi076 ceph-mon[35401]: pgmap v3798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:14 smithi040 ceph-mon[32397]: pgmap v3799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:14.741 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:14 smithi076 ceph-mon[35401]: pgmap v3799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:14 smithi146 ceph-mon[35807]: pgmap v3799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:16 smithi040 ceph-mon[32397]: pgmap v3800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:16 smithi146 ceph-mon[35807]: pgmap v3800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:16 smithi076 ceph-mon[35401]: pgmap v3800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2223.027322 secs 2024-07-26T14:10:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2223.027322 secs 2024-07-26T14:10:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2223.027322 secs 2024-07-26T14:10:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:18 smithi040 ceph-mon[32397]: pgmap v3801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:18 smithi146 ceph-mon[35807]: pgmap v3801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:18 smithi076 ceph-mon[35401]: pgmap v3801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:20.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:20 smithi146 ceph-mon[35807]: pgmap v3802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:20.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:20 smithi076 ceph-mon[35401]: pgmap v3802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:20 smithi040 ceph-mon[32397]: pgmap v3802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2228.027465 secs 2024-07-26T14:10:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:22 smithi040 ceph-mon[32397]: pgmap v3803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2228.027465 secs 2024-07-26T14:10:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:22 smithi146 ceph-mon[35807]: pgmap v3803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2228.027465 secs 2024-07-26T14:10:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:22 smithi076 ceph-mon[35401]: pgmap v3803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:24 smithi040 ceph-mon[32397]: pgmap v3804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:24 smithi146 ceph-mon[35807]: pgmap v3804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:24 smithi076 ceph-mon[35401]: pgmap v3804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:26 smithi040 ceph-mon[32397]: pgmap v3805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:26 smithi146 ceph-mon[35807]: pgmap v3805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:26 smithi076 ceph-mon[35401]: pgmap v3805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2233.027605 secs 2024-07-26T14:10:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2233.027605 secs 2024-07-26T14:10:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2233.027605 secs 2024-07-26T14:10:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:28 smithi040 ceph-mon[32397]: pgmap v3806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:28 smithi146 ceph-mon[35807]: pgmap v3806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:28.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:28 smithi076 ceph-mon[35401]: pgmap v3806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:30 smithi040 ceph-mon[32397]: pgmap v3807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:30 smithi146 ceph-mon[35807]: pgmap v3807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:30 smithi076 ceph-mon[35401]: pgmap v3807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2238.027692 secs 2024-07-26T14:10:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2238.027692 secs 2024-07-26T14:10:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2238.027692 secs 2024-07-26T14:10:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:32 smithi040 ceph-mon[32397]: pgmap v3808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:10:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:32 smithi146 ceph-mon[35807]: pgmap v3808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:10:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:32 smithi076 ceph-mon[35401]: pgmap v3808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:10:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:34 smithi040 ceph-mon[32397]: pgmap v3809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:34 smithi146 ceph-mon[35807]: pgmap v3809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:34 smithi076 ceph-mon[35401]: pgmap v3809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:36 smithi040 ceph-mon[32397]: pgmap v3810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2243.027830 secs 2024-07-26T14:10:36.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:36 smithi146 ceph-mon[35807]: pgmap v3810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:36.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2243.027830 secs 2024-07-26T14:10:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:36 smithi076 ceph-mon[35401]: pgmap v3810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2243.027830 secs 2024-07-26T14:10:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:38 smithi040 ceph-mon[32397]: pgmap v3811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:38 smithi146 ceph-mon[35807]: pgmap v3811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:38 smithi076 ceph-mon[35401]: pgmap v3811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:40 smithi040 ceph-mon[32397]: pgmap v3812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:40 smithi146 ceph-mon[35807]: pgmap v3812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:40 smithi076 ceph-mon[35401]: pgmap v3812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2248.027988 secs 2024-07-26T14:10:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2248.027988 secs 2024-07-26T14:10:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2248.027988 secs 2024-07-26T14:10:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:42 smithi040 ceph-mon[32397]: pgmap v3813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:42 smithi146 ceph-mon[35807]: pgmap v3813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:42 smithi076 ceph-mon[35401]: pgmap v3813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:44 smithi146 ceph-mon[35807]: pgmap v3814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:44 smithi076 ceph-mon[35401]: pgmap v3814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:44 smithi040 ceph-mon[32397]: pgmap v3814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:46 smithi146 ceph-mon[35807]: pgmap v3815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2253.028153 secs 2024-07-26T14:10:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:46 smithi076 ceph-mon[35401]: pgmap v3815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2253.028153 secs 2024-07-26T14:10:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:46 smithi040 ceph-mon[32397]: pgmap v3815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2253.028153 secs 2024-07-26T14:10:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:48 smithi146 ceph-mon[35807]: pgmap v3816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:48 smithi076 ceph-mon[35401]: pgmap v3816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:48 smithi040 ceph-mon[32397]: pgmap v3816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:50 smithi146 ceph-mon[35807]: pgmap v3817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:50 smithi076 ceph-mon[35401]: pgmap v3817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:50 smithi040 ceph-mon[32397]: pgmap v3817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:10:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2258.028318 secs 2024-07-26T14:10:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2258.028318 secs 2024-07-26T14:10:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2258.028318 secs 2024-07-26T14:10:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:52 smithi146 ceph-mon[35807]: pgmap v3818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:52 smithi076 ceph-mon[35401]: pgmap v3818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:52 smithi040 ceph-mon[32397]: pgmap v3818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:54 smithi146 ceph-mon[35807]: pgmap v3819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:54 smithi076 ceph-mon[35401]: pgmap v3819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:54 smithi040 ceph-mon[32397]: pgmap v3819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:56 smithi146 ceph-mon[35807]: pgmap v3820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2263.028462 secs 2024-07-26T14:10:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:56 smithi076 ceph-mon[35401]: pgmap v3820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2263.028462 secs 2024-07-26T14:10:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:56 smithi040 ceph-mon[32397]: pgmap v3820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:10:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2263.028462 secs 2024-07-26T14:10:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:10:58 smithi146 ceph-mon[35807]: pgmap v3821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:10:58 smithi076 ceph-mon[35401]: pgmap v3821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:10:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:10:58 smithi040 ceph-mon[32397]: pgmap v3821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:00 smithi146 ceph-mon[35807]: pgmap v3822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:00 smithi076 ceph-mon[35401]: pgmap v3822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:00 smithi040 ceph-mon[32397]: pgmap v3822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2268.028597 secs 2024-07-26T14:11:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2268.028597 secs 2024-07-26T14:11:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2268.028597 secs 2024-07-26T14:11:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:02 smithi076 ceph-mon[35401]: pgmap v3823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:02 smithi040 ceph-mon[32397]: pgmap v3823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:02 smithi146 ceph-mon[35807]: pgmap v3823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:04 smithi076 ceph-mon[35401]: pgmap v3824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:04 smithi040 ceph-mon[32397]: pgmap v3824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:04 smithi146 ceph-mon[35807]: pgmap v3824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:06 smithi040 ceph-mon[32397]: pgmap v3825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2273.028736 secs 2024-07-26T14:11:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:06 smithi146 ceph-mon[35807]: pgmap v3825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2273.028736 secs 2024-07-26T14:11:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:06 smithi076 ceph-mon[35401]: pgmap v3825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2273.028736 secs 2024-07-26T14:11:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:08 smithi040 ceph-mon[32397]: pgmap v3826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:08 smithi146 ceph-mon[35807]: pgmap v3826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:08 smithi076 ceph-mon[35401]: pgmap v3826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:10 smithi040 ceph-mon[32397]: pgmap v3827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:10 smithi146 ceph-mon[35807]: pgmap v3827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:10 smithi076 ceph-mon[35401]: pgmap v3827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2278.028893 secs 2024-07-26T14:11:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2278.028893 secs 2024-07-26T14:11:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2278.028893 secs 2024-07-26T14:11:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:12 smithi040 ceph-mon[32397]: pgmap v3828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:12 smithi146 ceph-mon[35807]: pgmap v3828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:12 smithi076 ceph-mon[35401]: pgmap v3828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:14 smithi040 ceph-mon[32397]: pgmap v3829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:14 smithi146 ceph-mon[35807]: pgmap v3829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:14 smithi076 ceph-mon[35401]: pgmap v3829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:16 smithi040 ceph-mon[32397]: pgmap v3830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2283.029047 secs 2024-07-26T14:11:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:16 smithi146 ceph-mon[35807]: pgmap v3830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2283.029047 secs 2024-07-26T14:11:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:16 smithi076 ceph-mon[35401]: pgmap v3830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2283.029047 secs 2024-07-26T14:11:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:18 smithi040 ceph-mon[32397]: pgmap v3831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:18 smithi146 ceph-mon[35807]: pgmap v3831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:18 smithi076 ceph-mon[35401]: pgmap v3831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:20 smithi040 ceph-mon[32397]: pgmap v3832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:20 smithi146 ceph-mon[35807]: pgmap v3832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:20 smithi076 ceph-mon[35401]: pgmap v3832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2288.029185 secs 2024-07-26T14:11:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2288.029185 secs 2024-07-26T14:11:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2288.029185 secs 2024-07-26T14:11:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:22 smithi040 ceph-mon[32397]: pgmap v3833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:22 smithi146 ceph-mon[35807]: pgmap v3833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:22 smithi076 ceph-mon[35401]: pgmap v3833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:24 smithi040 ceph-mon[32397]: pgmap v3834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:24 smithi146 ceph-mon[35807]: pgmap v3834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:24 smithi076 ceph-mon[35401]: pgmap v3834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:26 smithi040 ceph-mon[32397]: pgmap v3835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2293.029355 secs 2024-07-26T14:11:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:26 smithi146 ceph-mon[35807]: pgmap v3835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2293.029355 secs 2024-07-26T14:11:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:26 smithi076 ceph-mon[35401]: pgmap v3835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2293.029355 secs 2024-07-26T14:11:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:28 smithi040 ceph-mon[32397]: pgmap v3836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:28 smithi146 ceph-mon[35807]: pgmap v3836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:28 smithi076 ceph-mon[35401]: pgmap v3836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:30 smithi040 ceph-mon[32397]: pgmap v3837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:30 smithi146 ceph-mon[35807]: pgmap v3837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:30 smithi076 ceph-mon[35401]: pgmap v3837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2298.029492 secs 2024-07-26T14:11:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2298.029492 secs 2024-07-26T14:11:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2298.029492 secs 2024-07-26T14:11:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:32 smithi040 ceph-mon[32397]: pgmap v3838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:32 smithi146 ceph-mon[35807]: pgmap v3838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:32 smithi076 ceph-mon[35401]: pgmap v3838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:34 smithi040 ceph-mon[32397]: pgmap v3839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:34 smithi146 ceph-mon[35807]: pgmap v3839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:34 smithi076 ceph-mon[35401]: pgmap v3839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:36 smithi040 ceph-mon[32397]: pgmap v3840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2303.029662 secs 2024-07-26T14:11:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:36 smithi146 ceph-mon[35807]: pgmap v3840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2303.029662 secs 2024-07-26T14:11:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:36 smithi076 ceph-mon[35401]: pgmap v3840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2303.029662 secs 2024-07-26T14:11:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:38 smithi040 ceph-mon[32397]: pgmap v3841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:38 smithi146 ceph-mon[35807]: pgmap v3841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:38 smithi076 ceph-mon[35401]: pgmap v3841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:40 smithi040 ceph-mon[32397]: pgmap v3842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:40 smithi146 ceph-mon[35807]: pgmap v3842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:40 smithi076 ceph-mon[35401]: pgmap v3842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2308.029801 secs 2024-07-26T14:11:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2308.029801 secs 2024-07-26T14:11:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2308.029801 secs 2024-07-26T14:11:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:42 smithi146 ceph-mon[35807]: pgmap v3843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:42 smithi076 ceph-mon[35401]: pgmap v3843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:42 smithi040 ceph-mon[32397]: pgmap v3843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:44 smithi146 ceph-mon[35807]: pgmap v3844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:44 smithi076 ceph-mon[35401]: pgmap v3844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:44 smithi040 ceph-mon[32397]: pgmap v3844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:46 smithi146 ceph-mon[35807]: pgmap v3845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2313.029960 secs 2024-07-26T14:11:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:46 smithi076 ceph-mon[35401]: pgmap v3845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2313.029960 secs 2024-07-26T14:11:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:46 smithi040 ceph-mon[32397]: pgmap v3845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2313.029960 secs 2024-07-26T14:11:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:48 smithi146 ceph-mon[35807]: pgmap v3846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:48 smithi076 ceph-mon[35401]: pgmap v3846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:48 smithi040 ceph-mon[32397]: pgmap v3846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:50 smithi146 ceph-mon[35807]: pgmap v3847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:50 smithi076 ceph-mon[35401]: pgmap v3847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:50 smithi040 ceph-mon[32397]: pgmap v3847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:11:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2318.030104 secs 2024-07-26T14:11:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2318.030104 secs 2024-07-26T14:11:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2318.030104 secs 2024-07-26T14:11:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:52 smithi146 ceph-mon[35807]: pgmap v3848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:52 smithi076 ceph-mon[35401]: pgmap v3848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:52 smithi040 ceph-mon[32397]: pgmap v3848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:54 smithi146 ceph-mon[35807]: pgmap v3849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:54 smithi076 ceph-mon[35401]: pgmap v3849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:54 smithi040 ceph-mon[32397]: pgmap v3849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:56 smithi146 ceph-mon[35807]: pgmap v3850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:57.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2323.030247 secs 2024-07-26T14:11:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:56 smithi076 ceph-mon[35401]: pgmap v3850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2323.030247 secs 2024-07-26T14:11:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:56 smithi040 ceph-mon[32397]: pgmap v3850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:11:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2323.030247 secs 2024-07-26T14:11:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:11:58 smithi146 ceph-mon[35807]: pgmap v3851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:11:58 smithi076 ceph-mon[35401]: pgmap v3851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:11:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:11:58 smithi040 ceph-mon[32397]: pgmap v3851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:00 smithi146 ceph-mon[35807]: pgmap v3852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:00 smithi076 ceph-mon[35401]: pgmap v3852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:00 smithi040 ceph-mon[32397]: pgmap v3852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2328.030389 secs 2024-07-26T14:12:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2328.030389 secs 2024-07-26T14:12:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2328.030389 secs 2024-07-26T14:12:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:02 smithi040 ceph-mon[32397]: pgmap v3853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:02 smithi146 ceph-mon[35807]: pgmap v3853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:02 smithi076 ceph-mon[35401]: pgmap v3853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:04 smithi040 ceph-mon[32397]: pgmap v3854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:04 smithi146 ceph-mon[35807]: pgmap v3854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:04 smithi076 ceph-mon[35401]: pgmap v3854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:06 smithi040 ceph-mon[32397]: pgmap v3855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2333.030550 secs 2024-07-26T14:12:07.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:06 smithi146 ceph-mon[35807]: pgmap v3855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:07.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2333.030550 secs 2024-07-26T14:12:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:06 smithi076 ceph-mon[35401]: pgmap v3855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2333.030550 secs 2024-07-26T14:12:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:08 smithi040 ceph-mon[32397]: pgmap v3856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:08 smithi146 ceph-mon[35807]: pgmap v3856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:08 smithi076 ceph-mon[35401]: pgmap v3856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:10 smithi040 ceph-mon[32397]: pgmap v3857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:10 smithi146 ceph-mon[35807]: pgmap v3857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:10 smithi076 ceph-mon[35401]: pgmap v3857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2338.030696 secs 2024-07-26T14:12:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2338.030696 secs 2024-07-26T14:12:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2338.030696 secs 2024-07-26T14:12:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:12 smithi040 ceph-mon[32397]: pgmap v3858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:12 smithi146 ceph-mon[35807]: pgmap v3858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:12 smithi076 ceph-mon[35401]: pgmap v3858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:14 smithi040 ceph-mon[32397]: pgmap v3859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:14 smithi146 ceph-mon[35807]: pgmap v3859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:14 smithi076 ceph-mon[35401]: pgmap v3859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:16 smithi040 ceph-mon[32397]: pgmap v3860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2343.030838 secs 2024-07-26T14:12:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:16 smithi146 ceph-mon[35807]: pgmap v3860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2343.030838 secs 2024-07-26T14:12:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:16 smithi076 ceph-mon[35401]: pgmap v3860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2343.030838 secs 2024-07-26T14:12:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:18 smithi040 ceph-mon[32397]: pgmap v3861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:18 smithi146 ceph-mon[35807]: pgmap v3861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:18 smithi076 ceph-mon[35401]: pgmap v3861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:20 smithi040 ceph-mon[32397]: pgmap v3862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:20 smithi146 ceph-mon[35807]: pgmap v3862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:20 smithi076 ceph-mon[35401]: pgmap v3862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2348.030974 secs 2024-07-26T14:12:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2348.030974 secs 2024-07-26T14:12:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2348.030974 secs 2024-07-26T14:12:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:22 smithi040 ceph-mon[32397]: pgmap v3863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:22 smithi146 ceph-mon[35807]: pgmap v3863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:22 smithi076 ceph-mon[35401]: pgmap v3863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:24 smithi040 ceph-mon[32397]: pgmap v3864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:24 smithi146 ceph-mon[35807]: pgmap v3864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:24 smithi076 ceph-mon[35401]: pgmap v3864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:26 smithi040 ceph-mon[32397]: pgmap v3865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2353.031114 secs 2024-07-26T14:12:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:26 smithi146 ceph-mon[35807]: pgmap v3865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2353.031114 secs 2024-07-26T14:12:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:26 smithi076 ceph-mon[35401]: pgmap v3865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2353.031114 secs 2024-07-26T14:12:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:28 smithi040 ceph-mon[32397]: pgmap v3866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:28 smithi146 ceph-mon[35807]: pgmap v3866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:28 smithi076 ceph-mon[35401]: pgmap v3866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:30 smithi040 ceph-mon[32397]: pgmap v3867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:30 smithi146 ceph-mon[35807]: pgmap v3867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:30 smithi076 ceph-mon[35401]: pgmap v3867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2358.031248 secs 2024-07-26T14:12:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2358.031248 secs 2024-07-26T14:12:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2358.031248 secs 2024-07-26T14:12:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:32 smithi040 ceph-mon[32397]: pgmap v3868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:32 smithi146 ceph-mon[35807]: pgmap v3868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:32 smithi076 ceph-mon[35401]: pgmap v3868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:34 smithi040 ceph-mon[32397]: pgmap v3869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:34 smithi146 ceph-mon[35807]: pgmap v3869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:34 smithi076 ceph-mon[35401]: pgmap v3869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:36 smithi146 ceph-mon[35807]: pgmap v3870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2363.031392 secs 2024-07-26T14:12:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:36 smithi076 ceph-mon[35401]: pgmap v3870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2363.031392 secs 2024-07-26T14:12:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:36 smithi040 ceph-mon[32397]: pgmap v3870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2363.031392 secs 2024-07-26T14:12:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:38 smithi146 ceph-mon[35807]: pgmap v3871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:38 smithi076 ceph-mon[35401]: pgmap v3871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:38 smithi040 ceph-mon[32397]: pgmap v3871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:40 smithi146 ceph-mon[35807]: pgmap v3872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:40 smithi076 ceph-mon[35401]: pgmap v3872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:40 smithi040 ceph-mon[32397]: pgmap v3872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2368.031562 secs 2024-07-26T14:12:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2368.031562 secs 2024-07-26T14:12:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2368.031562 secs 2024-07-26T14:12:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:43 smithi146 ceph-mon[35807]: pgmap v3873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:43 smithi076 ceph-mon[35401]: pgmap v3873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:43 smithi040 ceph-mon[32397]: pgmap v3873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:45 smithi146 ceph-mon[35807]: pgmap v3874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:45 smithi076 ceph-mon[35401]: pgmap v3874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:45 smithi040 ceph-mon[32397]: pgmap v3874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:46 smithi076 ceph-mon[35401]: pgmap v3875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:46 smithi040 ceph-mon[32397]: pgmap v3875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:46 smithi146 ceph-mon[35807]: pgmap v3875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2373.031712 secs 2024-07-26T14:12:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2373.031712 secs 2024-07-26T14:12:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2373.031712 secs 2024-07-26T14:12:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:48 smithi040 ceph-mon[32397]: pgmap v3876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:48 smithi146 ceph-mon[35807]: pgmap v3876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:48 smithi076 ceph-mon[35401]: pgmap v3876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:50 smithi040 ceph-mon[32397]: pgmap v3877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:50 smithi146 ceph-mon[35807]: pgmap v3877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:50 smithi076 ceph-mon[35401]: pgmap v3877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:12:52.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2378.031852 secs 2024-07-26T14:12:52.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:52 smithi076 ceph-mon[35401]: pgmap v3878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2378.031852 secs 2024-07-26T14:12:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:52 smithi040 ceph-mon[32397]: pgmap v3878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2378.031852 secs 2024-07-26T14:12:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:52 smithi146 ceph-mon[35807]: pgmap v3878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:54 smithi040 ceph-mon[32397]: pgmap v3879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:54 smithi146 ceph-mon[35807]: pgmap v3879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:54 smithi076 ceph-mon[35401]: pgmap v3879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:56 smithi040 ceph-mon[32397]: pgmap v3880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:56 smithi146 ceph-mon[35807]: pgmap v3880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:56 smithi076 ceph-mon[35401]: pgmap v3880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:12:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2383.031995 secs 2024-07-26T14:12:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2383.031995 secs 2024-07-26T14:12:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2383.031995 secs 2024-07-26T14:12:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:12:58 smithi040 ceph-mon[32397]: pgmap v3881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:12:58 smithi146 ceph-mon[35807]: pgmap v3881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:12:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:12:58 smithi076 ceph-mon[35401]: pgmap v3881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:00 smithi040 ceph-mon[32397]: pgmap v3882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:00 smithi146 ceph-mon[35807]: pgmap v3882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:00 smithi076 ceph-mon[35401]: pgmap v3882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2388.032138 secs 2024-07-26T14:13:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:02 smithi040 ceph-mon[32397]: pgmap v3883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2388.032138 secs 2024-07-26T14:13:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:02 smithi146 ceph-mon[35807]: pgmap v3883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2388.032138 secs 2024-07-26T14:13:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:02 smithi076 ceph-mon[35401]: pgmap v3883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:04 smithi040 ceph-mon[32397]: pgmap v3884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:04 smithi146 ceph-mon[35807]: pgmap v3884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:04 smithi076 ceph-mon[35401]: pgmap v3884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:06 smithi040 ceph-mon[32397]: pgmap v3885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2393.032331 secs 2024-07-26T14:13:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:06 smithi146 ceph-mon[35807]: pgmap v3885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2393.032331 secs 2024-07-26T14:13:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:06 smithi076 ceph-mon[35401]: pgmap v3885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2393.032331 secs 2024-07-26T14:13:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:08 smithi040 ceph-mon[32397]: pgmap v3886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:08 smithi146 ceph-mon[35807]: pgmap v3886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:08 smithi076 ceph-mon[35401]: pgmap v3886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:10 smithi040 ceph-mon[32397]: pgmap v3887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:10 smithi146 ceph-mon[35807]: pgmap v3887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:10 smithi076 ceph-mon[35401]: pgmap v3887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2398.032473 secs 2024-07-26T14:13:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2398.032473 secs 2024-07-26T14:13:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2398.032473 secs 2024-07-26T14:13:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:12 smithi040 ceph-mon[32397]: pgmap v3888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:12 smithi146 ceph-mon[35807]: pgmap v3888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:12 smithi076 ceph-mon[35401]: pgmap v3888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:14 smithi040 ceph-mon[32397]: pgmap v3889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:14 smithi146 ceph-mon[35807]: pgmap v3889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:14 smithi076 ceph-mon[35401]: pgmap v3889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:16 smithi146 ceph-mon[35807]: pgmap v3890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2403.032611 secs 2024-07-26T14:13:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:16 smithi076 ceph-mon[35401]: pgmap v3890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2403.032611 secs 2024-07-26T14:13:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:16 smithi040 ceph-mon[32397]: pgmap v3890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2403.032611 secs 2024-07-26T14:13:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:18 smithi146 ceph-mon[35807]: pgmap v3891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:18 smithi076 ceph-mon[35401]: pgmap v3891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:18 smithi040 ceph-mon[32397]: pgmap v3891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:20 smithi146 ceph-mon[35807]: pgmap v3892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:20 smithi076 ceph-mon[35401]: pgmap v3892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:20 smithi040 ceph-mon[32397]: pgmap v3892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:13:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2408.032757 secs 2024-07-26T14:13:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2408.032757 secs 2024-07-26T14:13:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2408.032757 secs 2024-07-26T14:13:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:22 smithi146 ceph-mon[35807]: pgmap v3893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:22 smithi076 ceph-mon[35401]: pgmap v3893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:22 smithi040 ceph-mon[32397]: pgmap v3893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:24 smithi146 ceph-mon[35807]: pgmap v3894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:24 smithi076 ceph-mon[35401]: pgmap v3894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:24 smithi040 ceph-mon[32397]: pgmap v3894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:26 smithi146 ceph-mon[35807]: pgmap v3895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2413.032887 secs 2024-07-26T14:13:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:26 smithi076 ceph-mon[35401]: pgmap v3895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2413.032887 secs 2024-07-26T14:13:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:26 smithi040 ceph-mon[32397]: pgmap v3895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2413.032887 secs 2024-07-26T14:13:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:28 smithi146 ceph-mon[35807]: pgmap v3896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:28 smithi076 ceph-mon[35401]: pgmap v3896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:28 smithi040 ceph-mon[32397]: pgmap v3896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:30 smithi146 ceph-mon[35807]: pgmap v3897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:30 smithi076 ceph-mon[35401]: pgmap v3897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:30 smithi040 ceph-mon[32397]: pgmap v3897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2418.033056 secs 2024-07-26T14:13:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2418.033056 secs 2024-07-26T14:13:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2418.033056 secs 2024-07-26T14:13:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:32 smithi076 ceph-mon[35401]: pgmap v3898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:32 smithi040 ceph-mon[32397]: pgmap v3898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:32 smithi146 ceph-mon[35807]: pgmap v3898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:34 smithi040 ceph-mon[32397]: pgmap v3899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:34 smithi146 ceph-mon[35807]: pgmap v3899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:34 smithi076 ceph-mon[35401]: pgmap v3899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:36 smithi040 ceph-mon[32397]: pgmap v3900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2423.033195 secs 2024-07-26T14:13:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:36 smithi146 ceph-mon[35807]: pgmap v3900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2423.033195 secs 2024-07-26T14:13:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:36 smithi076 ceph-mon[35401]: pgmap v3900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2423.033195 secs 2024-07-26T14:13:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:38 smithi040 ceph-mon[32397]: pgmap v3901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:38 smithi146 ceph-mon[35807]: pgmap v3901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:38 smithi076 ceph-mon[35401]: pgmap v3901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:40 smithi040 ceph-mon[32397]: pgmap v3902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:40 smithi146 ceph-mon[35807]: pgmap v3902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:40 smithi076 ceph-mon[35401]: pgmap v3902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2428.033336 secs 2024-07-26T14:13:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2428.033336 secs 2024-07-26T14:13:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2428.033336 secs 2024-07-26T14:13:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:42 smithi040 ceph-mon[32397]: pgmap v3903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:42 smithi146 ceph-mon[35807]: pgmap v3903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:42 smithi076 ceph-mon[35401]: pgmap v3903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:44 smithi040 ceph-mon[32397]: pgmap v3904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:44 smithi146 ceph-mon[35807]: pgmap v3904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:44 smithi076 ceph-mon[35401]: pgmap v3904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:46 smithi040 ceph-mon[32397]: pgmap v3905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2433.033476 secs 2024-07-26T14:13:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:46 smithi146 ceph-mon[35807]: pgmap v3905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2433.033476 secs 2024-07-26T14:13:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:46 smithi076 ceph-mon[35401]: pgmap v3905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2433.033476 secs 2024-07-26T14:13:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:48 smithi040 ceph-mon[32397]: pgmap v3906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:48 smithi146 ceph-mon[35807]: pgmap v3906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:48 smithi076 ceph-mon[35401]: pgmap v3906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:50 smithi040 ceph-mon[32397]: pgmap v3907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:50 smithi146 ceph-mon[35807]: pgmap v3907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:50 smithi076 ceph-mon[35401]: pgmap v3907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2438.033613 secs 2024-07-26T14:13:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2438.033613 secs 2024-07-26T14:13:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2438.033613 secs 2024-07-26T14:13:52.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:52 smithi146 ceph-mon[35807]: pgmap v3908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:52 smithi040 ceph-mon[32397]: pgmap v3908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:52.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:52 smithi076 ceph-mon[35401]: pgmap v3908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:54 smithi040 ceph-mon[32397]: pgmap v3909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:54 smithi146 ceph-mon[35807]: pgmap v3909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:54 smithi076 ceph-mon[35401]: pgmap v3909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:56 smithi040 ceph-mon[32397]: pgmap v3910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2443.033753 secs 2024-07-26T14:13:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:56 smithi146 ceph-mon[35807]: pgmap v3910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2443.033753 secs 2024-07-26T14:13:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:56 smithi076 ceph-mon[35401]: pgmap v3910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:13:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2443.033753 secs 2024-07-26T14:13:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:13:58 smithi040 ceph-mon[32397]: pgmap v3911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:13:58 smithi146 ceph-mon[35807]: pgmap v3911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:13:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:13:58 smithi076 ceph-mon[35401]: pgmap v3911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:00 smithi040 ceph-mon[32397]: pgmap v3912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:00 smithi146 ceph-mon[35807]: pgmap v3912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:00 smithi076 ceph-mon[35401]: pgmap v3912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2448.033891 secs 2024-07-26T14:14:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2448.033891 secs 2024-07-26T14:14:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2448.033891 secs 2024-07-26T14:14:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:02 smithi146 ceph-mon[35807]: pgmap v3913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:02 smithi076 ceph-mon[35401]: pgmap v3913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:02 smithi040 ceph-mon[32397]: pgmap v3913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:04 smithi146 ceph-mon[35807]: pgmap v3914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:04 smithi076 ceph-mon[35401]: pgmap v3914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:04 smithi040 ceph-mon[32397]: pgmap v3914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:07.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:06 smithi040 ceph-mon[32397]: pgmap v3915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:07.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2453.034045 secs 2024-07-26T14:14:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:06 smithi146 ceph-mon[35807]: pgmap v3915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2453.034045 secs 2024-07-26T14:14:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:06 smithi076 ceph-mon[35401]: pgmap v3915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2453.034045 secs 2024-07-26T14:14:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:08 smithi146 ceph-mon[35807]: pgmap v3916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:08 smithi076 ceph-mon[35401]: pgmap v3916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:08 smithi040 ceph-mon[32397]: pgmap v3916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:10 smithi146 ceph-mon[35807]: pgmap v3917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:10 smithi076 ceph-mon[35401]: pgmap v3917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:10 smithi040 ceph-mon[32397]: pgmap v3917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2458.034186 secs 2024-07-26T14:14:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2458.034186 secs 2024-07-26T14:14:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2458.034186 secs 2024-07-26T14:14:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:12 smithi146 ceph-mon[35807]: pgmap v3918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:12 smithi076 ceph-mon[35401]: pgmap v3918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:12 smithi040 ceph-mon[32397]: pgmap v3918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:14 smithi146 ceph-mon[35807]: pgmap v3919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:14 smithi076 ceph-mon[35401]: pgmap v3919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:14 smithi040 ceph-mon[32397]: pgmap v3919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:16 smithi146 ceph-mon[35807]: pgmap v3920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2463.034327 secs 2024-07-26T14:14:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:16 smithi076 ceph-mon[35401]: pgmap v3920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2463.034327 secs 2024-07-26T14:14:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:16 smithi040 ceph-mon[32397]: pgmap v3920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2463.034327 secs 2024-07-26T14:14:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:18 smithi146 ceph-mon[35807]: pgmap v3921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:18 smithi076 ceph-mon[35401]: pgmap v3921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:18 smithi040 ceph-mon[32397]: pgmap v3921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:20 smithi146 ceph-mon[35807]: pgmap v3922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:20 smithi076 ceph-mon[35401]: pgmap v3922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:20 smithi040 ceph-mon[32397]: pgmap v3922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2468.034465 secs 2024-07-26T14:14:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2468.034465 secs 2024-07-26T14:14:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2468.034465 secs 2024-07-26T14:14:23.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:22 smithi146 ceph-mon[35807]: pgmap v3923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:22 smithi040 ceph-mon[32397]: pgmap v3923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:22 smithi076 ceph-mon[35401]: pgmap v3923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:24 smithi040 ceph-mon[32397]: pgmap v3924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:24 smithi146 ceph-mon[35807]: pgmap v3924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:24 smithi076 ceph-mon[35401]: pgmap v3924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:26 smithi040 ceph-mon[32397]: pgmap v3925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2473.034563 secs 2024-07-26T14:14:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:26 smithi146 ceph-mon[35807]: pgmap v3925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2473.034563 secs 2024-07-26T14:14:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:26 smithi076 ceph-mon[35401]: pgmap v3925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2473.034563 secs 2024-07-26T14:14:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:28 smithi040 ceph-mon[32397]: pgmap v3926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:28 smithi146 ceph-mon[35807]: pgmap v3926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:28 smithi076 ceph-mon[35401]: pgmap v3926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:30 smithi040 ceph-mon[32397]: pgmap v3927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:30 smithi146 ceph-mon[35807]: pgmap v3927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:30 smithi076 ceph-mon[35401]: pgmap v3927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2478.034710 secs 2024-07-26T14:14:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2478.034710 secs 2024-07-26T14:14:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2478.034710 secs 2024-07-26T14:14:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:32 smithi040 ceph-mon[32397]: pgmap v3928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:32 smithi146 ceph-mon[35807]: pgmap v3928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:32 smithi076 ceph-mon[35401]: pgmap v3928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:34 smithi040 ceph-mon[32397]: pgmap v3929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:34 smithi146 ceph-mon[35807]: pgmap v3929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:34 smithi076 ceph-mon[35401]: pgmap v3929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:36 smithi040 ceph-mon[32397]: pgmap v3930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2483.034848 secs 2024-07-26T14:14:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:36 smithi146 ceph-mon[35807]: pgmap v3930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2483.034848 secs 2024-07-26T14:14:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:36 smithi076 ceph-mon[35401]: pgmap v3930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2483.034848 secs 2024-07-26T14:14:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:38 smithi040 ceph-mon[32397]: pgmap v3931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:38 smithi146 ceph-mon[35807]: pgmap v3931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:38 smithi076 ceph-mon[35401]: pgmap v3931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:40 smithi040 ceph-mon[32397]: pgmap v3932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:40 smithi146 ceph-mon[35807]: pgmap v3932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:40 smithi076 ceph-mon[35401]: pgmap v3932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2488.034985 secs 2024-07-26T14:14:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2488.034985 secs 2024-07-26T14:14:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2488.034985 secs 2024-07-26T14:14:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:42 smithi040 ceph-mon[32397]: pgmap v3933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:42 smithi146 ceph-mon[35807]: pgmap v3933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:42 smithi076 ceph-mon[35401]: pgmap v3933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:44 smithi040 ceph-mon[32397]: pgmap v3934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:44 smithi146 ceph-mon[35807]: pgmap v3934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:44 smithi076 ceph-mon[35401]: pgmap v3934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:46 smithi040 ceph-mon[32397]: pgmap v3935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2493.035124 secs 2024-07-26T14:14:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:46 smithi146 ceph-mon[35807]: pgmap v3935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2493.035124 secs 2024-07-26T14:14:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:46 smithi076 ceph-mon[35401]: pgmap v3935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2493.035124 secs 2024-07-26T14:14:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:48 smithi040 ceph-mon[32397]: pgmap v3936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:48 smithi146 ceph-mon[35807]: pgmap v3936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:48 smithi076 ceph-mon[35401]: pgmap v3936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:50 smithi040 ceph-mon[32397]: pgmap v3937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:51.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:50 smithi146 ceph-mon[35807]: pgmap v3937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:50 smithi076 ceph-mon[35401]: pgmap v3937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2498.035306 secs 2024-07-26T14:14:52.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2498.035306 secs 2024-07-26T14:14:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2498.035306 secs 2024-07-26T14:14:53.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:52 smithi146 ceph-mon[35807]: pgmap v3938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:52 smithi040 ceph-mon[32397]: pgmap v3938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:52 smithi076 ceph-mon[35401]: pgmap v3938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:54 smithi040 ceph-mon[32397]: pgmap v3939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:54 smithi146 ceph-mon[35807]: pgmap v3939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:54 smithi076 ceph-mon[35401]: pgmap v3939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:14:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:56 smithi146 ceph-mon[35807]: pgmap v3940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2503.035465 secs 2024-07-26T14:14:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:56 smithi076 ceph-mon[35401]: pgmap v3940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2503.035465 secs 2024-07-26T14:14:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:56 smithi040 ceph-mon[32397]: pgmap v3940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:14:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2503.035465 secs 2024-07-26T14:14:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:14:58 smithi146 ceph-mon[35807]: pgmap v3941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:14:58 smithi076 ceph-mon[35401]: pgmap v3941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:14:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:14:58 smithi040 ceph-mon[32397]: pgmap v3941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:01 smithi146 ceph-mon[35807]: pgmap v3942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:01 smithi076 ceph-mon[35401]: pgmap v3942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:00 smithi040 ceph-mon[32397]: pgmap v3942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2508.035629 secs 2024-07-26T14:15:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2508.035629 secs 2024-07-26T14:15:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2508.035629 secs 2024-07-26T14:15:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:03 smithi146 ceph-mon[35807]: pgmap v3943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:03 smithi076 ceph-mon[35401]: pgmap v3943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:03 smithi040 ceph-mon[32397]: pgmap v3943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:05 smithi146 ceph-mon[35807]: pgmap v3944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:05 smithi076 ceph-mon[35401]: pgmap v3944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:05 smithi040 ceph-mon[32397]: pgmap v3944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:07.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:07 smithi040 ceph-mon[32397]: pgmap v3945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:15:07.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2513.035783 secs 2024-07-26T14:15:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:07 smithi146 ceph-mon[35807]: pgmap v3945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:15:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2513.035783 secs 2024-07-26T14:15:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:07 smithi076 ceph-mon[35401]: pgmap v3945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:15:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2513.035783 secs 2024-07-26T14:15:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:09 smithi146 ceph-mon[35807]: pgmap v3946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:09 smithi076 ceph-mon[35401]: pgmap v3946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:09 smithi040 ceph-mon[32397]: pgmap v3946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:15:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:11 smithi146 ceph-mon[35807]: pgmap v3947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:11 smithi076 ceph-mon[35401]: pgmap v3947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:11 smithi040 ceph-mon[32397]: pgmap v3947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2518.035935 secs 2024-07-26T14:15:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2518.035935 secs 2024-07-26T14:15:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2518.035935 secs 2024-07-26T14:15:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:13 smithi146 ceph-mon[35807]: pgmap v3948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:13 smithi076 ceph-mon[35401]: pgmap v3948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:13 smithi040 ceph-mon[32397]: pgmap v3948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:14 smithi076 ceph-mon[35401]: pgmap v3949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:14 smithi040 ceph-mon[32397]: pgmap v3949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:14 smithi146 ceph-mon[35807]: pgmap v3949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:16 smithi040 ceph-mon[32397]: pgmap v3950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2523.036093 secs 2024-07-26T14:15:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:16 smithi146 ceph-mon[35807]: pgmap v3950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2523.036093 secs 2024-07-26T14:15:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:16 smithi076 ceph-mon[35401]: pgmap v3950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2523.036093 secs 2024-07-26T14:15:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:18 smithi040 ceph-mon[32397]: pgmap v3951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:18.825 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:18 smithi146 ceph-mon[35807]: pgmap v3951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:18 smithi076 ceph-mon[35401]: pgmap v3951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:20 smithi040 ceph-mon[32397]: pgmap v3952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:20 smithi146 ceph-mon[35807]: pgmap v3952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:20 smithi076 ceph-mon[35401]: pgmap v3952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2528.036226 secs 2024-07-26T14:15:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2528.036226 secs 2024-07-26T14:15:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2528.036226 secs 2024-07-26T14:15:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:22 smithi146 ceph-mon[35807]: pgmap v3953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:22 smithi076 ceph-mon[35401]: pgmap v3953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:22 smithi040 ceph-mon[32397]: pgmap v3953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:24 smithi146 ceph-mon[35807]: pgmap v3954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:24 smithi076 ceph-mon[35401]: pgmap v3954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:24 smithi040 ceph-mon[32397]: pgmap v3954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2533.036368 secs 2024-07-26T14:15:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2533.036368 secs 2024-07-26T14:15:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2533.036368 secs 2024-07-26T14:15:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:26 smithi146 ceph-mon[35807]: pgmap v3955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:26 smithi076 ceph-mon[35401]: pgmap v3955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:26 smithi040 ceph-mon[32397]: pgmap v3955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:28 smithi146 ceph-mon[35807]: pgmap v3956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:28 smithi076 ceph-mon[35401]: pgmap v3956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:28 smithi040 ceph-mon[32397]: pgmap v3956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:30 smithi146 ceph-mon[35807]: pgmap v3957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2538.036515 secs 2024-07-26T14:15:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:30 smithi076 ceph-mon[35401]: pgmap v3957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2538.036515 secs 2024-07-26T14:15:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:30 smithi040 ceph-mon[32397]: pgmap v3957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2538.036515 secs 2024-07-26T14:15:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:32 smithi146 ceph-mon[35807]: pgmap v3958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:32 smithi076 ceph-mon[35401]: pgmap v3958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:32 smithi040 ceph-mon[32397]: pgmap v3958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:34 smithi146 ceph-mon[35807]: pgmap v3959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:34 smithi076 ceph-mon[35401]: pgmap v3959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:34 smithi040 ceph-mon[32397]: pgmap v3959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2543.036661 secs 2024-07-26T14:15:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2543.036661 secs 2024-07-26T14:15:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2543.036661 secs 2024-07-26T14:15:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:36 smithi076 ceph-mon[35401]: pgmap v3960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:36 smithi040 ceph-mon[32397]: pgmap v3960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:36 smithi146 ceph-mon[35807]: pgmap v3960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:38 smithi076 ceph-mon[35401]: pgmap v3961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:38 smithi040 ceph-mon[32397]: pgmap v3961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:38 smithi146 ceph-mon[35807]: pgmap v3961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:40 smithi040 ceph-mon[32397]: pgmap v3962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2548.036804 secs 2024-07-26T14:15:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:40 smithi146 ceph-mon[35807]: pgmap v3962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2548.036804 secs 2024-07-26T14:15:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:40 smithi076 ceph-mon[35401]: pgmap v3962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2548.036804 secs 2024-07-26T14:15:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:42 smithi040 ceph-mon[32397]: pgmap v3963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:42 smithi146 ceph-mon[35807]: pgmap v3963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:42 smithi076 ceph-mon[35401]: pgmap v3963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:44 smithi040 ceph-mon[32397]: pgmap v3964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:44 smithi146 ceph-mon[35807]: pgmap v3964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:44 smithi076 ceph-mon[35401]: pgmap v3964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2553.036939 secs 2024-07-26T14:15:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2553.036939 secs 2024-07-26T14:15:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2553.036939 secs 2024-07-26T14:15:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:46 smithi040 ceph-mon[32397]: pgmap v3965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:46 smithi146 ceph-mon[35807]: pgmap v3965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:46 smithi076 ceph-mon[35401]: pgmap v3965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:48 smithi040 ceph-mon[32397]: pgmap v3966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:48 smithi146 ceph-mon[35807]: pgmap v3966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:48 smithi076 ceph-mon[35401]: pgmap v3966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:50 smithi040 ceph-mon[32397]: pgmap v3967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2558.037026 secs 2024-07-26T14:15:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:50 smithi146 ceph-mon[35807]: pgmap v3967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2558.037026 secs 2024-07-26T14:15:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:50 smithi076 ceph-mon[35401]: pgmap v3967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2558.037026 secs 2024-07-26T14:15:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:52 smithi040 ceph-mon[32397]: pgmap v3968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:52 smithi146 ceph-mon[35807]: pgmap v3968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:52 smithi076 ceph-mon[35401]: pgmap v3968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:54 smithi040 ceph-mon[32397]: pgmap v3969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:54 smithi146 ceph-mon[35807]: pgmap v3969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:54 smithi076 ceph-mon[35401]: pgmap v3969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:15:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2563.037183 secs 2024-07-26T14:15:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2563.037183 secs 2024-07-26T14:15:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2563.037183 secs 2024-07-26T14:15:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:56 smithi040 ceph-mon[32397]: pgmap v3970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:56 smithi146 ceph-mon[35807]: pgmap v3970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:56 smithi076 ceph-mon[35401]: pgmap v3970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:15:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:15:58 smithi040 ceph-mon[32397]: pgmap v3971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:15:58 smithi146 ceph-mon[35807]: pgmap v3971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:15:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:15:58 smithi076 ceph-mon[35401]: pgmap v3971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:00 smithi040 ceph-mon[32397]: pgmap v3972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2568.037326 secs 2024-07-26T14:16:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:00 smithi146 ceph-mon[35807]: pgmap v3972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2568.037326 secs 2024-07-26T14:16:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:00 smithi076 ceph-mon[35401]: pgmap v3972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2568.037326 secs 2024-07-26T14:16:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:02 smithi040 ceph-mon[32397]: pgmap v3973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:02 smithi146 ceph-mon[35807]: pgmap v3973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:02 smithi076 ceph-mon[35401]: pgmap v3973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:04 smithi040 ceph-mon[32397]: pgmap v3974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:04 smithi146 ceph-mon[35807]: pgmap v3974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:04 smithi076 ceph-mon[35401]: pgmap v3974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2573.037463 secs 2024-07-26T14:16:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2573.037463 secs 2024-07-26T14:16:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2573.037463 secs 2024-07-26T14:16:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:06 smithi040 ceph-mon[32397]: pgmap v3975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:06 smithi146 ceph-mon[35807]: pgmap v3975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:06 smithi076 ceph-mon[35401]: pgmap v3975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:08 smithi040 ceph-mon[32397]: pgmap v3976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:08 smithi146 ceph-mon[35807]: pgmap v3976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:08 smithi076 ceph-mon[35401]: pgmap v3976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:10 smithi040 ceph-mon[32397]: pgmap v3977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2578.037606 secs 2024-07-26T14:16:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:10 smithi146 ceph-mon[35807]: pgmap v3977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2578.037606 secs 2024-07-26T14:16:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:10 smithi076 ceph-mon[35401]: pgmap v3977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2578.037606 secs 2024-07-26T14:16:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:12 smithi146 ceph-mon[35807]: pgmap v3978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:12 smithi076 ceph-mon[35401]: pgmap v3978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:12 smithi040 ceph-mon[32397]: pgmap v3978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:14 smithi146 ceph-mon[35807]: pgmap v3979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:14 smithi076 ceph-mon[35401]: pgmap v3979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:14 smithi040 ceph-mon[32397]: pgmap v3979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2583.037752 secs 2024-07-26T14:16:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2583.037752 secs 2024-07-26T14:16:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2583.037752 secs 2024-07-26T14:16:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:16 smithi146 ceph-mon[35807]: pgmap v3980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:16 smithi076 ceph-mon[35401]: pgmap v3980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:16 smithi040 ceph-mon[32397]: pgmap v3980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:18 smithi146 ceph-mon[35807]: pgmap v3981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:18 smithi076 ceph-mon[35401]: pgmap v3981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:18 smithi040 ceph-mon[32397]: pgmap v3981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:20 smithi146 ceph-mon[35807]: pgmap v3982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2588.037894 secs 2024-07-26T14:16:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:20 smithi076 ceph-mon[35401]: pgmap v3982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2588.037894 secs 2024-07-26T14:16:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:20 smithi040 ceph-mon[32397]: pgmap v3982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2588.037894 secs 2024-07-26T14:16:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:22 smithi146 ceph-mon[35807]: pgmap v3983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:22 smithi076 ceph-mon[35401]: pgmap v3983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:22 smithi040 ceph-mon[32397]: pgmap v3983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:24 smithi146 ceph-mon[35807]: pgmap v3984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:24 smithi076 ceph-mon[35401]: pgmap v3984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:24 smithi040 ceph-mon[32397]: pgmap v3984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2593.038035 secs 2024-07-26T14:16:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2593.038035 secs 2024-07-26T14:16:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2593.038035 secs 2024-07-26T14:16:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:26 smithi146 ceph-mon[35807]: pgmap v3985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:26 smithi076 ceph-mon[35401]: pgmap v3985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:26 smithi040 ceph-mon[32397]: pgmap v3985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:28 smithi146 ceph-mon[35807]: pgmap v3986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:28 smithi076 ceph-mon[35401]: pgmap v3986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:28 smithi040 ceph-mon[32397]: pgmap v3986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:30 smithi146 ceph-mon[35807]: pgmap v3987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2598.038214 secs 2024-07-26T14:16:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:30 smithi076 ceph-mon[35401]: pgmap v3987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2598.038214 secs 2024-07-26T14:16:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:30 smithi040 ceph-mon[32397]: pgmap v3987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2598.038214 secs 2024-07-26T14:16:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:32 smithi076 ceph-mon[35401]: pgmap v3988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:32 smithi040 ceph-mon[32397]: pgmap v3988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:32 smithi146 ceph-mon[35807]: pgmap v3988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:34 smithi076 ceph-mon[35401]: pgmap v3989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:34 smithi040 ceph-mon[32397]: pgmap v3989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:34 smithi146 ceph-mon[35807]: pgmap v3989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2603.038380 secs 2024-07-26T14:16:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2603.038380 secs 2024-07-26T14:16:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2603.038380 secs 2024-07-26T14:16:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:36 smithi040 ceph-mon[32397]: pgmap v3990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:36 smithi146 ceph-mon[35807]: pgmap v3990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:36 smithi076 ceph-mon[35401]: pgmap v3990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:38 smithi040 ceph-mon[32397]: pgmap v3991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:38 smithi146 ceph-mon[35807]: pgmap v3991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:38 smithi076 ceph-mon[35401]: pgmap v3991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:40 smithi040 ceph-mon[32397]: pgmap v3992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2608.038520 secs 2024-07-26T14:16:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:40 smithi146 ceph-mon[35807]: pgmap v3992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2608.038520 secs 2024-07-26T14:16:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:40 smithi076 ceph-mon[35401]: pgmap v3992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2608.038520 secs 2024-07-26T14:16:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:42 smithi040 ceph-mon[32397]: pgmap v3993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:42 smithi146 ceph-mon[35807]: pgmap v3993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:42 smithi076 ceph-mon[35401]: pgmap v3993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:44 smithi040 ceph-mon[32397]: pgmap v3994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:44 smithi146 ceph-mon[35807]: pgmap v3994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:44 smithi076 ceph-mon[35401]: pgmap v3994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2613.038649 secs 2024-07-26T14:16:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2613.038649 secs 2024-07-26T14:16:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2613.038649 secs 2024-07-26T14:16:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:46 smithi040 ceph-mon[32397]: pgmap v3995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:46 smithi146 ceph-mon[35807]: pgmap v3995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:46 smithi076 ceph-mon[35401]: pgmap v3995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:48 smithi040 ceph-mon[32397]: pgmap v3996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:48 smithi146 ceph-mon[35807]: pgmap v3996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:48 smithi076 ceph-mon[35401]: pgmap v3996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:50 smithi040 ceph-mon[32397]: pgmap v3997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2618.038797 secs 2024-07-26T14:16:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:50 smithi146 ceph-mon[35807]: pgmap v3997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2618.038797 secs 2024-07-26T14:16:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:50 smithi076 ceph-mon[35401]: pgmap v3997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2618.038797 secs 2024-07-26T14:16:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:52 smithi040 ceph-mon[32397]: pgmap v3998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:52 smithi146 ceph-mon[35807]: pgmap v3998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:52 smithi076 ceph-mon[35401]: pgmap v3998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:54 smithi040 ceph-mon[32397]: pgmap v3999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:54 smithi146 ceph-mon[35807]: pgmap v3999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:54 smithi076 ceph-mon[35401]: pgmap v3999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:16:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2623.038932 secs 2024-07-26T14:16:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2623.038932 secs 2024-07-26T14:16:56.337 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2623.038932 secs 2024-07-26T14:16:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:56 smithi040 ceph-mon[32397]: pgmap v4000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:56 smithi146 ceph-mon[35807]: pgmap v4000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:56 smithi076 ceph-mon[35401]: pgmap v4000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:16:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:16:58 smithi040 ceph-mon[32397]: pgmap v4001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:16:58 smithi146 ceph-mon[35807]: pgmap v4001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:16:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:16:58 smithi076 ceph-mon[35401]: pgmap v4001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:00 smithi040 ceph-mon[32397]: pgmap v4002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2628.039076 secs 2024-07-26T14:17:01.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:00 smithi146 ceph-mon[35807]: pgmap v4002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:01.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2628.039076 secs 2024-07-26T14:17:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:00 smithi076 ceph-mon[35401]: pgmap v4002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2628.039076 secs 2024-07-26T14:17:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:02 smithi040 ceph-mon[32397]: pgmap v4003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:02 smithi146 ceph-mon[35807]: pgmap v4003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:02 smithi076 ceph-mon[35401]: pgmap v4003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:04 smithi040 ceph-mon[32397]: pgmap v4004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:04 smithi146 ceph-mon[35807]: pgmap v4004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:04 smithi076 ceph-mon[35401]: pgmap v4004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2633.039216 secs 2024-07-26T14:17:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2633.039216 secs 2024-07-26T14:17:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2633.039216 secs 2024-07-26T14:17:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:06 smithi040 ceph-mon[32397]: pgmap v4005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:06 smithi146 ceph-mon[35807]: pgmap v4005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:06 smithi076 ceph-mon[35401]: pgmap v4005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:08 smithi146 ceph-mon[35807]: pgmap v4006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:08 smithi076 ceph-mon[35401]: pgmap v4006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:08 smithi040 ceph-mon[32397]: pgmap v4006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:10 smithi146 ceph-mon[35807]: pgmap v4007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2638.039350 secs 2024-07-26T14:17:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:10 smithi076 ceph-mon[35401]: pgmap v4007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2638.039350 secs 2024-07-26T14:17:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:10 smithi040 ceph-mon[32397]: pgmap v4007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2638.039350 secs 2024-07-26T14:17:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:13 smithi146 ceph-mon[35807]: pgmap v4008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:13 smithi076 ceph-mon[35401]: pgmap v4008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:13 smithi040 ceph-mon[32397]: pgmap v4008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:15 smithi146 ceph-mon[35807]: pgmap v4009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:15 smithi076 ceph-mon[35401]: pgmap v4009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:15 smithi040 ceph-mon[32397]: pgmap v4009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2643.039500 secs 2024-07-26T14:17:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2643.039500 secs 2024-07-26T14:17:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2643.039500 secs 2024-07-26T14:17:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:17 smithi146 ceph-mon[35807]: pgmap v4010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:17 smithi076 ceph-mon[35401]: pgmap v4010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:17 smithi040 ceph-mon[32397]: pgmap v4010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:19 smithi146 ceph-mon[35807]: pgmap v4011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:19 smithi076 ceph-mon[35401]: pgmap v4011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:19 smithi040 ceph-mon[32397]: pgmap v4011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:21 smithi146 ceph-mon[35807]: pgmap v4012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2648.039630 secs 2024-07-26T14:17:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:21 smithi076 ceph-mon[35401]: pgmap v4012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2648.039630 secs 2024-07-26T14:17:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:21 smithi040 ceph-mon[32397]: pgmap v4012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2648.039630 secs 2024-07-26T14:17:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:23 smithi146 ceph-mon[35807]: pgmap v4013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:23 smithi076 ceph-mon[35401]: pgmap v4013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:23 smithi040 ceph-mon[32397]: pgmap v4013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:25 smithi076 ceph-mon[35401]: pgmap v4014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:25 smithi040 ceph-mon[32397]: pgmap v4014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:25 smithi146 ceph-mon[35807]: pgmap v4014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2653.039775 secs 2024-07-26T14:17:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2653.039775 secs 2024-07-26T14:17:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2653.039775 secs 2024-07-26T14:17:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:27 smithi040 ceph-mon[32397]: pgmap v4015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:27 smithi146 ceph-mon[35807]: pgmap v4015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:27 smithi076 ceph-mon[35401]: pgmap v4015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:28 smithi040 ceph-mon[32397]: pgmap v4016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:28 smithi146 ceph-mon[35807]: pgmap v4016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:28 smithi076 ceph-mon[35401]: pgmap v4016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:30 smithi146 ceph-mon[35807]: pgmap v4017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2658.039934 secs 2024-07-26T14:17:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:30 smithi076 ceph-mon[35401]: pgmap v4017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2658.039934 secs 2024-07-26T14:17:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:30 smithi040 ceph-mon[32397]: pgmap v4017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2658.039934 secs 2024-07-26T14:17:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:32 smithi146 ceph-mon[35807]: pgmap v4018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:32 smithi076 ceph-mon[35401]: pgmap v4018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:32 smithi040 ceph-mon[32397]: pgmap v4018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:34 smithi146 ceph-mon[35807]: pgmap v4019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:34 smithi076 ceph-mon[35401]: pgmap v4019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:34 smithi040 ceph-mon[32397]: pgmap v4019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2663.040058 secs 2024-07-26T14:17:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2663.040058 secs 2024-07-26T14:17:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2663.040058 secs 2024-07-26T14:17:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:36 smithi040 ceph-mon[32397]: pgmap v4020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:36 smithi146 ceph-mon[35807]: pgmap v4020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:36 smithi076 ceph-mon[35401]: pgmap v4020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:38 smithi040 ceph-mon[32397]: pgmap v4021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:38 smithi146 ceph-mon[35807]: pgmap v4021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:38 smithi076 ceph-mon[35401]: pgmap v4021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:40 smithi040 ceph-mon[32397]: pgmap v4022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2668.040198 secs 2024-07-26T14:17:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:40 smithi146 ceph-mon[35807]: pgmap v4022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2668.040198 secs 2024-07-26T14:17:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:40 smithi076 ceph-mon[35401]: pgmap v4022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2668.040198 secs 2024-07-26T14:17:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:42 smithi040 ceph-mon[32397]: pgmap v4023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:42 smithi146 ceph-mon[35807]: pgmap v4023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:42 smithi076 ceph-mon[35401]: pgmap v4023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:44 smithi040 ceph-mon[32397]: pgmap v4024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:44 smithi146 ceph-mon[35807]: pgmap v4024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:44 smithi076 ceph-mon[35401]: pgmap v4024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2673.040338 secs 2024-07-26T14:17:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2673.040338 secs 2024-07-26T14:17:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2673.040338 secs 2024-07-26T14:17:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:46 smithi040 ceph-mon[32397]: pgmap v4025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:46 smithi146 ceph-mon[35807]: pgmap v4025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:46 smithi076 ceph-mon[35401]: pgmap v4025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:48 smithi040 ceph-mon[32397]: pgmap v4026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:48 smithi146 ceph-mon[35807]: pgmap v4026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:48 smithi076 ceph-mon[35401]: pgmap v4026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:50 smithi040 ceph-mon[32397]: pgmap v4027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2678.040505 secs 2024-07-26T14:17:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:50 smithi146 ceph-mon[35807]: pgmap v4027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2678.040505 secs 2024-07-26T14:17:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:50 smithi076 ceph-mon[35401]: pgmap v4027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2678.040505 secs 2024-07-26T14:17:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:52 smithi040 ceph-mon[32397]: pgmap v4028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:52 smithi146 ceph-mon[35807]: pgmap v4028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:52 smithi076 ceph-mon[35401]: pgmap v4028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:54 smithi040 ceph-mon[32397]: pgmap v4029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:54 smithi146 ceph-mon[35807]: pgmap v4029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:54 smithi076 ceph-mon[35401]: pgmap v4029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:17:55.974 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2683.040664 secs 2024-07-26T14:17:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2683.040664 secs 2024-07-26T14:17:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2683.040664 secs 2024-07-26T14:17:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:56 smithi040 ceph-mon[32397]: pgmap v4030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:56 smithi146 ceph-mon[35807]: pgmap v4030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:56 smithi076 ceph-mon[35401]: pgmap v4030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:17:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:17:58 smithi040 ceph-mon[32397]: pgmap v4031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:17:58 smithi146 ceph-mon[35807]: pgmap v4031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:17:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:17:58 smithi076 ceph-mon[35401]: pgmap v4031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:00 smithi040 ceph-mon[32397]: pgmap v4032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2688.040803 secs 2024-07-26T14:18:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:00 smithi146 ceph-mon[35807]: pgmap v4032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2688.040803 secs 2024-07-26T14:18:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:00 smithi076 ceph-mon[35401]: pgmap v4032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2688.040803 secs 2024-07-26T14:18:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: pgmap v4033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:18:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:18:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:18:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: pgmap v4033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:18:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:18:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:18:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: pgmap v4033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:18:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:18:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:03 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:18:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:03 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:18:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:03 smithi040 ceph-mon[32397]: pgmap v4034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 954 B/s rd, 1 op/s 2024-07-26T14:18:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:03 smithi040 ceph-mon[32397]: pgmap v4035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T14:18:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:03 smithi040 ceph-mon[32397]: pgmap v4036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 760 B/s rd, 1 op/s 2024-07-26T14:18:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:03 smithi040 ceph-mon[32397]: pgmap v4037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:03 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:18:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:03 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:18:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:03 smithi146 ceph-mon[35807]: pgmap v4034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 954 B/s rd, 1 op/s 2024-07-26T14:18:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:03 smithi146 ceph-mon[35807]: pgmap v4035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T14:18:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:03 smithi146 ceph-mon[35807]: pgmap v4036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 760 B/s rd, 1 op/s 2024-07-26T14:18:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:03 smithi146 ceph-mon[35807]: pgmap v4037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:03 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:18:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:03 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:18:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:03 smithi076 ceph-mon[35401]: pgmap v4034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 954 B/s rd, 1 op/s 2024-07-26T14:18:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:03 smithi076 ceph-mon[35401]: pgmap v4035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T14:18:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:03 smithi076 ceph-mon[35401]: pgmap v4036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 760 B/s rd, 1 op/s 2024-07-26T14:18:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:03 smithi076 ceph-mon[35401]: pgmap v4037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:05 smithi040 ceph-mon[32397]: pgmap v4038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2693.040941 secs 2024-07-26T14:18:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:05 smithi146 ceph-mon[35807]: pgmap v4038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2693.040941 secs 2024-07-26T14:18:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:05 smithi076 ceph-mon[35401]: pgmap v4038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2693.040941 secs 2024-07-26T14:18:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:07 smithi146 ceph-mon[35807]: pgmap v4039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:07 smithi076 ceph-mon[35401]: pgmap v4039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:07 smithi040 ceph-mon[32397]: pgmap v4039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:18:10.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:09 smithi040 ceph-mon[32397]: pgmap v4040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:09 smithi146 ceph-mon[35807]: pgmap v4040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:09 smithi076 ceph-mon[35401]: pgmap v4040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2698.041096 secs 2024-07-26T14:18:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2698.041096 secs 2024-07-26T14:18:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2698.041096 secs 2024-07-26T14:18:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:11 smithi146 ceph-mon[35807]: pgmap v4041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:11 smithi076 ceph-mon[35401]: pgmap v4041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:11 smithi040 ceph-mon[32397]: pgmap v4041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:13 smithi146 ceph-mon[35807]: pgmap v4042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:18:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:13 smithi076 ceph-mon[35401]: pgmap v4042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:18:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:13 smithi040 ceph-mon[32397]: pgmap v4042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:18:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:15 smithi146 ceph-mon[35807]: pgmap v4043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2703.041200 secs 2024-07-26T14:18:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:15 smithi076 ceph-mon[35401]: pgmap v4043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2703.041200 secs 2024-07-26T14:18:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:15 smithi040 ceph-mon[32397]: pgmap v4043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2703.041200 secs 2024-07-26T14:18:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:17 smithi146 ceph-mon[35807]: pgmap v4044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:17 smithi076 ceph-mon[35401]: pgmap v4044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:17 smithi040 ceph-mon[32397]: pgmap v4044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:19 smithi076 ceph-mon[35401]: pgmap v4045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:19 smithi040 ceph-mon[32397]: pgmap v4045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:19 smithi146 ceph-mon[35807]: pgmap v4045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2708.041350 secs 2024-07-26T14:18:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2708.041350 secs 2024-07-26T14:18:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2708.041350 secs 2024-07-26T14:18:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:21 smithi040 ceph-mon[32397]: pgmap v4046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:21 smithi146 ceph-mon[35807]: pgmap v4046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:21 smithi076 ceph-mon[35401]: pgmap v4046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:24.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:23 smithi076 ceph-mon[35401]: pgmap v4047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:23 smithi040 ceph-mon[32397]: pgmap v4047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:23 smithi146 ceph-mon[35807]: pgmap v4047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:26.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:25 smithi146 ceph-mon[35807]: pgmap v4048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:26.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2713.041497 secs 2024-07-26T14:18:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:25 smithi040 ceph-mon[32397]: pgmap v4048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2713.041497 secs 2024-07-26T14:18:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:25 smithi076 ceph-mon[35401]: pgmap v4048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2713.041497 secs 2024-07-26T14:18:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:27 smithi040 ceph-mon[32397]: pgmap v4049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:27 smithi146 ceph-mon[35807]: pgmap v4049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:27 smithi076 ceph-mon[35401]: pgmap v4049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:29 smithi040 ceph-mon[32397]: pgmap v4050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:29 smithi146 ceph-mon[35807]: pgmap v4050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:29 smithi076 ceph-mon[35401]: pgmap v4050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2718.041637 secs 2024-07-26T14:18:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2718.041637 secs 2024-07-26T14:18:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2718.041637 secs 2024-07-26T14:18:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:31 smithi040 ceph-mon[32397]: pgmap v4051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:18:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:31 smithi146 ceph-mon[35807]: pgmap v4051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:18:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:31 smithi076 ceph-mon[35401]: pgmap v4051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:18:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:33 smithi040 ceph-mon[32397]: pgmap v4052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:33 smithi146 ceph-mon[35807]: pgmap v4052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:33 smithi076 ceph-mon[35401]: pgmap v4052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:35 smithi040 ceph-mon[32397]: pgmap v4053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2723.041764 secs 2024-07-26T14:18:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:35 smithi146 ceph-mon[35807]: pgmap v4053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2723.041764 secs 2024-07-26T14:18:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:35 smithi076 ceph-mon[35401]: pgmap v4053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2723.041764 secs 2024-07-26T14:18:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:37 smithi040 ceph-mon[32397]: pgmap v4054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:37 smithi146 ceph-mon[35807]: pgmap v4054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:37 smithi076 ceph-mon[35401]: pgmap v4054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:39 smithi040 ceph-mon[32397]: pgmap v4055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:39 smithi146 ceph-mon[35807]: pgmap v4055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:39 smithi076 ceph-mon[35401]: pgmap v4055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:18:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2728.041890 secs 2024-07-26T14:18:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2728.041890 secs 2024-07-26T14:18:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2728.041890 secs 2024-07-26T14:18:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:41 smithi040 ceph-mon[32397]: pgmap v4056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:18:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:41 smithi146 ceph-mon[35807]: pgmap v4056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:18:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:41 smithi076 ceph-mon[35401]: pgmap v4056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:18:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:43 smithi040 ceph-mon[32397]: pgmap v4057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:43 smithi146 ceph-mon[35807]: pgmap v4057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:43 smithi076 ceph-mon[35401]: pgmap v4057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:45 smithi040 ceph-mon[32397]: pgmap v4058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2733.042024 secs 2024-07-26T14:18:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:45 smithi146 ceph-mon[35807]: pgmap v4058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2733.042024 secs 2024-07-26T14:18:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:45 smithi076 ceph-mon[35401]: pgmap v4058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2733.042024 secs 2024-07-26T14:18:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:47 smithi040 ceph-mon[32397]: pgmap v4059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:47 smithi146 ceph-mon[35807]: pgmap v4059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:47 smithi076 ceph-mon[35401]: pgmap v4059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:49 smithi040 ceph-mon[32397]: pgmap v4060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:49 smithi146 ceph-mon[35807]: pgmap v4060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:49 smithi076 ceph-mon[35401]: pgmap v4060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:18:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2738.042190 secs 2024-07-26T14:18:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2738.042190 secs 2024-07-26T14:18:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2738.042190 secs 2024-07-26T14:18:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:51 smithi040 ceph-mon[32397]: pgmap v4061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:51 smithi146 ceph-mon[35807]: pgmap v4061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:51 smithi076 ceph-mon[35401]: pgmap v4061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:53 smithi146 ceph-mon[35807]: pgmap v4062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:53 smithi076 ceph-mon[35401]: pgmap v4062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:53 smithi040 ceph-mon[32397]: pgmap v4062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:55 smithi146 ceph-mon[35807]: pgmap v4063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2743.042347 secs 2024-07-26T14:18:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:55 smithi076 ceph-mon[35401]: pgmap v4063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2743.042347 secs 2024-07-26T14:18:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:55 smithi040 ceph-mon[32397]: pgmap v4063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:18:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2743.042347 secs 2024-07-26T14:18:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:18:57 smithi146 ceph-mon[35807]: pgmap v4064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:18:57 smithi076 ceph-mon[35401]: pgmap v4064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:18:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:18:57 smithi040 ceph-mon[32397]: pgmap v4064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:00.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:00 smithi146 ceph-mon[35807]: pgmap v4065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:00 smithi076 ceph-mon[35401]: pgmap v4065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:00 smithi040 ceph-mon[32397]: pgmap v4065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2748.042481 secs 2024-07-26T14:19:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2748.042481 secs 2024-07-26T14:19:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2748.042481 secs 2024-07-26T14:19:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:02 smithi146 ceph-mon[35807]: pgmap v4066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:02 smithi076 ceph-mon[35401]: pgmap v4066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:02 smithi040 ceph-mon[32397]: pgmap v4066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:03 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:19:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:03 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:19:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:03 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:19:04.289 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: pgmap v4067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:04.290 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.290 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.290 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.290 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.290 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.290 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:04 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: pgmap v4067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:04 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: pgmap v4067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:04.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:04.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:04 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:06 smithi146 ceph-mon[35807]: pgmap v4068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2753.042613 secs 2024-07-26T14:19:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:06 smithi076 ceph-mon[35401]: pgmap v4068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2753.042613 secs 2024-07-26T14:19:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:06 smithi040 ceph-mon[32397]: pgmap v4068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2753.042613 secs 2024-07-26T14:19:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: pgmap v4069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: pgmap v4069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: pgmap v4069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: pgmap v4070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:09.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:19:09.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:19:09.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:09 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: pgmap v4070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:19:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:09 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:19:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: pgmap v4070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:19:09.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:19:09.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:19:09.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:09 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:19:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:11 smithi040 ceph-mon[32397]: pgmap v4071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:19:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2758.042775 secs 2024-07-26T14:19:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:11 smithi146 ceph-mon[35807]: pgmap v4071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:19:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2758.042775 secs 2024-07-26T14:19:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:11 smithi076 ceph-mon[35401]: pgmap v4071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:19:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2758.042775 secs 2024-07-26T14:19:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:13 smithi040 ceph-mon[32397]: pgmap v4072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:13 smithi146 ceph-mon[35807]: pgmap v4072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:13 smithi076 ceph-mon[35401]: pgmap v4072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:15 smithi146 ceph-mon[35807]: pgmap v4073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:15 smithi076 ceph-mon[35401]: pgmap v4073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:15 smithi040 ceph-mon[32397]: pgmap v4073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2763.042916 secs 2024-07-26T14:19:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2763.042916 secs 2024-07-26T14:19:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2763.042916 secs 2024-07-26T14:19:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:17 smithi146 ceph-mon[35807]: pgmap v4074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:17 smithi076 ceph-mon[35401]: pgmap v4074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:17 smithi040 ceph-mon[32397]: pgmap v4074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:19 smithi146 ceph-mon[35807]: pgmap v4075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:19 smithi076 ceph-mon[35401]: pgmap v4075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:19 smithi040 ceph-mon[32397]: pgmap v4075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2768.043050 secs 2024-07-26T14:19:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2768.043050 secs 2024-07-26T14:19:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2768.043050 secs 2024-07-26T14:19:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:21 smithi146 ceph-mon[35807]: pgmap v4076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:21 smithi076 ceph-mon[35401]: pgmap v4076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:21 smithi040 ceph-mon[32397]: pgmap v4076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:23 smithi040 ceph-mon[32397]: pgmap v4077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:23 smithi146 ceph-mon[35807]: pgmap v4077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:23 smithi076 ceph-mon[35401]: pgmap v4077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:25 smithi146 ceph-mon[35807]: pgmap v4078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2773.043195 secs 2024-07-26T14:19:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:25 smithi076 ceph-mon[35401]: pgmap v4078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2773.043195 secs 2024-07-26T14:19:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:25 smithi040 ceph-mon[32397]: pgmap v4078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2773.043195 secs 2024-07-26T14:19:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:27 smithi146 ceph-mon[35807]: pgmap v4079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:27 smithi076 ceph-mon[35401]: pgmap v4079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:27 smithi040 ceph-mon[32397]: pgmap v4079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:29 smithi146 ceph-mon[35807]: pgmap v4080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:29 smithi076 ceph-mon[35401]: pgmap v4080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:29 smithi040 ceph-mon[32397]: pgmap v4080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2778.043339 secs 2024-07-26T14:19:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2778.043339 secs 2024-07-26T14:19:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2778.043339 secs 2024-07-26T14:19:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:31 smithi146 ceph-mon[35807]: pgmap v4081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:31 smithi076 ceph-mon[35401]: pgmap v4081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:31 smithi040 ceph-mon[32397]: pgmap v4081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:33 smithi076 ceph-mon[35401]: pgmap v4082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:33 smithi040 ceph-mon[32397]: pgmap v4082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:33 smithi146 ceph-mon[35807]: pgmap v4082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:35 smithi040 ceph-mon[32397]: pgmap v4083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2783.043498 secs 2024-07-26T14:19:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:35 smithi146 ceph-mon[35807]: pgmap v4083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2783.043498 secs 2024-07-26T14:19:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:35 smithi076 ceph-mon[35401]: pgmap v4083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2783.043498 secs 2024-07-26T14:19:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:37 smithi040 ceph-mon[32397]: pgmap v4084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:37 smithi146 ceph-mon[35807]: pgmap v4084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:37 smithi076 ceph-mon[35401]: pgmap v4084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:39 smithi040 ceph-mon[32397]: pgmap v4085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:39 smithi146 ceph-mon[35807]: pgmap v4085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:39 smithi076 ceph-mon[35401]: pgmap v4085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:40.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2788.043635 secs 2024-07-26T14:19:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2788.043635 secs 2024-07-26T14:19:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2788.043635 secs 2024-07-26T14:19:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:41 smithi040 ceph-mon[32397]: pgmap v4086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:41 smithi146 ceph-mon[35807]: pgmap v4086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:41 smithi076 ceph-mon[35401]: pgmap v4086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:43 smithi040 ceph-mon[32397]: pgmap v4087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:43 smithi146 ceph-mon[35807]: pgmap v4087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:43 smithi076 ceph-mon[35401]: pgmap v4087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:45 smithi040 ceph-mon[32397]: pgmap v4088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2793.043794 secs 2024-07-26T14:19:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:45 smithi146 ceph-mon[35807]: pgmap v4088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2793.043794 secs 2024-07-26T14:19:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:45 smithi076 ceph-mon[35401]: pgmap v4088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2793.043794 secs 2024-07-26T14:19:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:47 smithi040 ceph-mon[32397]: pgmap v4089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:47 smithi146 ceph-mon[35807]: pgmap v4089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:47 smithi076 ceph-mon[35401]: pgmap v4089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:49 smithi040 ceph-mon[32397]: pgmap v4090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:49 smithi146 ceph-mon[35807]: pgmap v4090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:49 smithi076 ceph-mon[35401]: pgmap v4090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:19:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2798.043954 secs 2024-07-26T14:19:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2798.043954 secs 2024-07-26T14:19:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2798.043954 secs 2024-07-26T14:19:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:51 smithi040 ceph-mon[32397]: pgmap v4091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:51 smithi146 ceph-mon[35807]: pgmap v4091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:51 smithi076 ceph-mon[35401]: pgmap v4091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:53 smithi040 ceph-mon[32397]: pgmap v4092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:53 smithi146 ceph-mon[35807]: pgmap v4092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:53 smithi076 ceph-mon[35401]: pgmap v4092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:55 smithi040 ceph-mon[32397]: pgmap v4093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2803.044088 secs 2024-07-26T14:19:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:55 smithi146 ceph-mon[35807]: pgmap v4093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2803.044088 secs 2024-07-26T14:19:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:55 smithi076 ceph-mon[35401]: pgmap v4093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:19:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2803.044088 secs 2024-07-26T14:19:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:57 smithi040 ceph-mon[32397]: pgmap v4094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:57 smithi146 ceph-mon[35807]: pgmap v4094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:57 smithi076 ceph-mon[35401]: pgmap v4094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:19:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:19:59 smithi040 ceph-mon[32397]: pgmap v4095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:19:59 smithi146 ceph-mon[35807]: pgmap v4095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:19:59 smithi076 ceph-mon[35401]: pgmap v4095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:20:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2808.044228 secs 2024-07-26T14:20:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:20:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2808.044228 secs 2024-07-26T14:20:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:20:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2808.044228 secs 2024-07-26T14:20:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:01 smithi040 ceph-mon[32397]: pgmap v4096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:01 smithi146 ceph-mon[35807]: pgmap v4096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:01 smithi076 ceph-mon[35401]: pgmap v4096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:03 smithi040 ceph-mon[32397]: pgmap v4097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:03 smithi146 ceph-mon[35807]: pgmap v4097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:03 smithi076 ceph-mon[35401]: pgmap v4097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:05 smithi040 ceph-mon[32397]: pgmap v4098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2813.044364 secs 2024-07-26T14:20:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:05 smithi146 ceph-mon[35807]: pgmap v4098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2813.044364 secs 2024-07-26T14:20:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:05 smithi076 ceph-mon[35401]: pgmap v4098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2813.044364 secs 2024-07-26T14:20:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:07 smithi040 ceph-mon[32397]: pgmap v4099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:07 smithi146 ceph-mon[35807]: pgmap v4099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:07 smithi076 ceph-mon[35401]: pgmap v4099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:09 smithi146 ceph-mon[35807]: pgmap v4100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:09 smithi076 ceph-mon[35401]: pgmap v4100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:09 smithi040 ceph-mon[32397]: pgmap v4100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2818.044508 secs 2024-07-26T14:20:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2818.044508 secs 2024-07-26T14:20:11.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2818.044508 secs 2024-07-26T14:20:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:11 smithi146 ceph-mon[35807]: pgmap v4101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:11 smithi076 ceph-mon[35401]: pgmap v4101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:11 smithi040 ceph-mon[32397]: pgmap v4101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:13 smithi146 ceph-mon[35807]: pgmap v4102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:13 smithi076 ceph-mon[35401]: pgmap v4102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:13 smithi040 ceph-mon[32397]: pgmap v4102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:15 smithi146 ceph-mon[35807]: pgmap v4103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2823.044594 secs 2024-07-26T14:20:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:15 smithi076 ceph-mon[35401]: pgmap v4103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2823.044594 secs 2024-07-26T14:20:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:15 smithi040 ceph-mon[32397]: pgmap v4103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2823.044594 secs 2024-07-26T14:20:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:17 smithi146 ceph-mon[35807]: pgmap v4104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:17 smithi076 ceph-mon[35401]: pgmap v4104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:17 smithi040 ceph-mon[32397]: pgmap v4104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:20.031 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:19 smithi040 ceph-mon[32397]: pgmap v4105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:19 smithi146 ceph-mon[35807]: pgmap v4105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:19 smithi076 ceph-mon[35401]: pgmap v4105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2828.044742 secs 2024-07-26T14:20:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2828.044742 secs 2024-07-26T14:20:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2828.044742 secs 2024-07-26T14:20:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:21 smithi146 ceph-mon[35807]: pgmap v4106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:21 smithi076 ceph-mon[35401]: pgmap v4106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:21 smithi040 ceph-mon[32397]: pgmap v4106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:23 smithi146 ceph-mon[35807]: pgmap v4107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:23 smithi076 ceph-mon[35401]: pgmap v4107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:23 smithi040 ceph-mon[32397]: pgmap v4107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:25 smithi146 ceph-mon[35807]: pgmap v4108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2833.044887 secs 2024-07-26T14:20:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:25 smithi076 ceph-mon[35401]: pgmap v4108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2833.044887 secs 2024-07-26T14:20:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:25 smithi040 ceph-mon[32397]: pgmap v4108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2833.044887 secs 2024-07-26T14:20:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:27 smithi146 ceph-mon[35807]: pgmap v4109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:27 smithi076 ceph-mon[35401]: pgmap v4109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:27 smithi040 ceph-mon[32397]: pgmap v4109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:29 smithi076 ceph-mon[35401]: pgmap v4110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:29 smithi040 ceph-mon[32397]: pgmap v4110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:29 smithi146 ceph-mon[35807]: pgmap v4110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2838.045034 secs 2024-07-26T14:20:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2838.045034 secs 2024-07-26T14:20:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2838.045034 secs 2024-07-26T14:20:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:31 smithi040 ceph-mon[32397]: pgmap v4111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:31 smithi146 ceph-mon[35807]: pgmap v4111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:31 smithi076 ceph-mon[35401]: pgmap v4111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:33 smithi040 ceph-mon[32397]: pgmap v4112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:33 smithi146 ceph-mon[35807]: pgmap v4112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:33 smithi076 ceph-mon[35401]: pgmap v4112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:35 smithi040 ceph-mon[32397]: pgmap v4113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2843.045182 secs 2024-07-26T14:20:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:35 smithi146 ceph-mon[35807]: pgmap v4113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2843.045182 secs 2024-07-26T14:20:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:35 smithi076 ceph-mon[35401]: pgmap v4113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2843.045182 secs 2024-07-26T14:20:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:37 smithi040 ceph-mon[32397]: pgmap v4114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:37 smithi146 ceph-mon[35807]: pgmap v4114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:37 smithi076 ceph-mon[35401]: pgmap v4114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:39 smithi040 ceph-mon[32397]: pgmap v4115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:39 smithi146 ceph-mon[35807]: pgmap v4115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:39 smithi076 ceph-mon[35401]: pgmap v4115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:41.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2848.045324 secs 2024-07-26T14:20:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2848.045324 secs 2024-07-26T14:20:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2848.045324 secs 2024-07-26T14:20:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:41 smithi040 ceph-mon[32397]: pgmap v4116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:41 smithi146 ceph-mon[35807]: pgmap v4116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:41 smithi076 ceph-mon[35401]: pgmap v4116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:43 smithi040 ceph-mon[32397]: pgmap v4117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:43 smithi146 ceph-mon[35807]: pgmap v4117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:43 smithi076 ceph-mon[35401]: pgmap v4117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:45 smithi040 ceph-mon[32397]: pgmap v4118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2853.045465 secs 2024-07-26T14:20:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:45 smithi146 ceph-mon[35807]: pgmap v4118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2853.045465 secs 2024-07-26T14:20:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:45 smithi076 ceph-mon[35401]: pgmap v4118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2853.045465 secs 2024-07-26T14:20:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:47 smithi040 ceph-mon[32397]: pgmap v4119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:47 smithi146 ceph-mon[35807]: pgmap v4119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:47 smithi076 ceph-mon[35401]: pgmap v4119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:49 smithi040 ceph-mon[32397]: pgmap v4120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:49 smithi146 ceph-mon[35807]: pgmap v4120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:49 smithi076 ceph-mon[35401]: pgmap v4120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:20:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2858.045629 secs 2024-07-26T14:20:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2858.045629 secs 2024-07-26T14:20:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2858.045629 secs 2024-07-26T14:20:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:51 smithi040 ceph-mon[32397]: pgmap v4121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:51 smithi146 ceph-mon[35807]: pgmap v4121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:51 smithi076 ceph-mon[35401]: pgmap v4121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:53 smithi040 ceph-mon[32397]: pgmap v4122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:53 smithi146 ceph-mon[35807]: pgmap v4122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:53 smithi076 ceph-mon[35401]: pgmap v4122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:55 smithi040 ceph-mon[32397]: pgmap v4123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2863.045791 secs 2024-07-26T14:20:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:55 smithi146 ceph-mon[35807]: pgmap v4123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2863.045791 secs 2024-07-26T14:20:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:55 smithi076 ceph-mon[35401]: pgmap v4123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:20:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2863.045791 secs 2024-07-26T14:20:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:57 smithi040 ceph-mon[32397]: pgmap v4124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:57 smithi146 ceph-mon[35807]: pgmap v4124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:20:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:57 smithi076 ceph-mon[35401]: pgmap v4124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:20:59 smithi040 ceph-mon[32397]: pgmap v4125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:20:59 smithi146 ceph-mon[35807]: pgmap v4125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:20:59 smithi076 ceph-mon[35401]: pgmap v4125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2868.045953 secs 2024-07-26T14:21:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2868.045953 secs 2024-07-26T14:21:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2868.045953 secs 2024-07-26T14:21:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:01 smithi146 ceph-mon[35807]: pgmap v4126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:02.358 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:01 smithi076 ceph-mon[35401]: pgmap v4126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:01 smithi040 ceph-mon[32397]: pgmap v4126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:03 smithi146 ceph-mon[35807]: pgmap v4127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:03 smithi076 ceph-mon[35401]: pgmap v4127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:03 smithi040 ceph-mon[32397]: pgmap v4127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:06 smithi146 ceph-mon[35807]: pgmap v4128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2873.046113 secs 2024-07-26T14:21:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:06 smithi076 ceph-mon[35401]: pgmap v4128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2873.046113 secs 2024-07-26T14:21:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:05 smithi040 ceph-mon[32397]: pgmap v4128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2873.046113 secs 2024-07-26T14:21:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:08 smithi146 ceph-mon[35807]: pgmap v4129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:08 smithi076 ceph-mon[35401]: pgmap v4129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:08 smithi040 ceph-mon[32397]: pgmap v4129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:10 smithi146 ceph-mon[35807]: pgmap v4130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:10 smithi076 ceph-mon[35401]: pgmap v4130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:10 smithi040 ceph-mon[32397]: pgmap v4130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2878.046255 secs 2024-07-26T14:21:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2878.046255 secs 2024-07-26T14:21:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2878.046255 secs 2024-07-26T14:21:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:12 smithi146 ceph-mon[35807]: pgmap v4131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:12 smithi076 ceph-mon[35401]: pgmap v4131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:12 smithi040 ceph-mon[32397]: pgmap v4131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:14 smithi146 ceph-mon[35807]: pgmap v4132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:14 smithi076 ceph-mon[35401]: pgmap v4132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:14 smithi040 ceph-mon[32397]: pgmap v4132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:16 smithi146 ceph-mon[35807]: pgmap v4133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 2883.046393 secs 2024-07-26T14:21:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:16 smithi146 ceph-mon[35807]: slow request 2883.046392 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T14:21:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:16 smithi076 ceph-mon[35401]: pgmap v4133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 2883.046393 secs 2024-07-26T14:21:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:16 smithi076 ceph-mon[35401]: slow request 2883.046392 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T14:21:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:16 smithi040 ceph-mon[32397]: pgmap v4133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 2883.046393 secs 2024-07-26T14:21:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:16 smithi040 ceph-mon[32397]: slow request 2883.046392 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T14:21:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:18 smithi146 ceph-mon[35807]: pgmap v4134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:18 smithi076 ceph-mon[35401]: pgmap v4134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:18 smithi040 ceph-mon[32397]: pgmap v4134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:20 smithi146 ceph-mon[35807]: pgmap v4135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:20 smithi076 ceph-mon[35401]: pgmap v4135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:20 smithi040 ceph-mon[32397]: pgmap v4135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2888.046537 secs 2024-07-26T14:21:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2888.046537 secs 2024-07-26T14:21:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2888.046537 secs 2024-07-26T14:21:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:22 smithi076 ceph-mon[35401]: pgmap v4136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:22 smithi040 ceph-mon[32397]: pgmap v4136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:22 smithi146 ceph-mon[35807]: pgmap v4136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:24 smithi040 ceph-mon[32397]: pgmap v4137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:24 smithi146 ceph-mon[35807]: pgmap v4137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:24 smithi076 ceph-mon[35401]: pgmap v4137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:26.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:26 smithi076 ceph-mon[35401]: pgmap v4138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:26.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2893.046676 secs 2024-07-26T14:21:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:26 smithi040 ceph-mon[32397]: pgmap v4138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2893.046676 secs 2024-07-26T14:21:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:26 smithi146 ceph-mon[35807]: pgmap v4138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2893.046676 secs 2024-07-26T14:21:28.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:28 smithi146 ceph-mon[35807]: pgmap v4139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:28 smithi040 ceph-mon[32397]: pgmap v4139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:28 smithi076 ceph-mon[35401]: pgmap v4139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:30 smithi040 ceph-mon[32397]: pgmap v4140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:30 smithi146 ceph-mon[35807]: pgmap v4140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:30 smithi076 ceph-mon[35401]: pgmap v4140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2898.046819 secs 2024-07-26T14:21:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2898.046819 secs 2024-07-26T14:21:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2898.046819 secs 2024-07-26T14:21:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:32 smithi040 ceph-mon[32397]: pgmap v4141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:32 smithi146 ceph-mon[35807]: pgmap v4141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:32 smithi076 ceph-mon[35401]: pgmap v4141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:34 smithi040 ceph-mon[32397]: pgmap v4142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:34 smithi146 ceph-mon[35807]: pgmap v4142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:34 smithi076 ceph-mon[35401]: pgmap v4142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:36 smithi040 ceph-mon[32397]: pgmap v4143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2903.046962 secs 2024-07-26T14:21:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:36 smithi146 ceph-mon[35807]: pgmap v4143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2903.046962 secs 2024-07-26T14:21:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:36 smithi076 ceph-mon[35401]: pgmap v4143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2903.046962 secs 2024-07-26T14:21:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:38 smithi040 ceph-mon[32397]: pgmap v4144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:38 smithi146 ceph-mon[35807]: pgmap v4144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:38 smithi076 ceph-mon[35401]: pgmap v4144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:39 smithi040 ceph-mon[32397]: pgmap v4145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:39 smithi146 ceph-mon[35807]: pgmap v4145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:39 smithi076 ceph-mon[35401]: pgmap v4145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:41 smithi040 ceph-mon[32397]: pgmap v4146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2908.047108 secs 2024-07-26T14:21:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:41 smithi146 ceph-mon[35807]: pgmap v4146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2908.047108 secs 2024-07-26T14:21:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:41 smithi076 ceph-mon[35401]: pgmap v4146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2908.047108 secs 2024-07-26T14:21:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:43 smithi040 ceph-mon[32397]: pgmap v4147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:43 smithi146 ceph-mon[35807]: pgmap v4147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:43 smithi076 ceph-mon[35401]: pgmap v4147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:45 smithi040 ceph-mon[32397]: pgmap v4148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:45 smithi146 ceph-mon[35807]: pgmap v4148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:45 smithi076 ceph-mon[35401]: pgmap v4148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2913.047236 secs 2024-07-26T14:21:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2913.047236 secs 2024-07-26T14:21:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2913.047236 secs 2024-07-26T14:21:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:47 smithi040 ceph-mon[32397]: pgmap v4149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:47 smithi146 ceph-mon[35807]: pgmap v4149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:47 smithi076 ceph-mon[35401]: pgmap v4149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:49 smithi146 ceph-mon[35807]: pgmap v4150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:49 smithi076 ceph-mon[35401]: pgmap v4150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:49 smithi040 ceph-mon[32397]: pgmap v4150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:51 smithi146 ceph-mon[35807]: pgmap v4151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2918.047403 secs 2024-07-26T14:21:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:51 smithi076 ceph-mon[35401]: pgmap v4151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2918.047403 secs 2024-07-26T14:21:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:51 smithi040 ceph-mon[32397]: pgmap v4151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2918.047403 secs 2024-07-26T14:21:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:53 smithi146 ceph-mon[35807]: pgmap v4152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:53 smithi076 ceph-mon[35401]: pgmap v4152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:53 smithi040 ceph-mon[32397]: pgmap v4152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:55 smithi146 ceph-mon[35807]: pgmap v4153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:55 smithi076 ceph-mon[35401]: pgmap v4153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:55 smithi040 ceph-mon[32397]: pgmap v4153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:21:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2923.047539 secs 2024-07-26T14:21:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2923.047539 secs 2024-07-26T14:21:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2923.047539 secs 2024-07-26T14:21:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:57 smithi146 ceph-mon[35807]: pgmap v4154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:57 smithi076 ceph-mon[35401]: pgmap v4154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:57 smithi040 ceph-mon[32397]: pgmap v4154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:21:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:21:59 smithi146 ceph-mon[35807]: pgmap v4155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:21:59 smithi076 ceph-mon[35401]: pgmap v4155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:21:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:21:59 smithi040 ceph-mon[32397]: pgmap v4155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2928.047636 secs 2024-07-26T14:22:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2928.047636 secs 2024-07-26T14:22:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2928.047636 secs 2024-07-26T14:22:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:01 smithi040 ceph-mon[32397]: pgmap v4156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:01 smithi146 ceph-mon[35807]: pgmap v4156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:01 smithi076 ceph-mon[35401]: pgmap v4156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:03 smithi040 ceph-mon[32397]: pgmap v4157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:03 smithi146 ceph-mon[35807]: pgmap v4157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:03 smithi076 ceph-mon[35401]: pgmap v4157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:05 smithi040 ceph-mon[32397]: pgmap v4158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2933.047750 secs 2024-07-26T14:22:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:05 smithi146 ceph-mon[35807]: pgmap v4158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2933.047750 secs 2024-07-26T14:22:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:05 smithi076 ceph-mon[35401]: pgmap v4158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2933.047750 secs 2024-07-26T14:22:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:07 smithi040 ceph-mon[32397]: pgmap v4159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:07 smithi146 ceph-mon[35807]: pgmap v4159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:07 smithi076 ceph-mon[35401]: pgmap v4159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:09 smithi040 ceph-mon[32397]: pgmap v4160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:09 smithi146 ceph-mon[35807]: pgmap v4160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:09 smithi076 ceph-mon[35401]: pgmap v4160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2938.047882 secs 2024-07-26T14:22:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2938.047882 secs 2024-07-26T14:22:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2938.047882 secs 2024-07-26T14:22:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:11 smithi040 ceph-mon[32397]: pgmap v4161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:11 smithi146 ceph-mon[35807]: pgmap v4161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:11 smithi076 ceph-mon[35401]: pgmap v4161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:13 smithi040 ceph-mon[32397]: pgmap v4162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:13 smithi146 ceph-mon[35807]: pgmap v4162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:13 smithi076 ceph-mon[35401]: pgmap v4162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:15 smithi040 ceph-mon[32397]: pgmap v4163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2943.048035 secs 2024-07-26T14:22:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:15 smithi146 ceph-mon[35807]: pgmap v4163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2943.048035 secs 2024-07-26T14:22:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:15 smithi076 ceph-mon[35401]: pgmap v4163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2943.048035 secs 2024-07-26T14:22:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:17 smithi040 ceph-mon[32397]: pgmap v4164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:17 smithi146 ceph-mon[35807]: pgmap v4164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:17 smithi076 ceph-mon[35401]: pgmap v4164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:19 smithi040 ceph-mon[32397]: pgmap v4165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:19 smithi146 ceph-mon[35807]: pgmap v4165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:19 smithi076 ceph-mon[35401]: pgmap v4165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2948.048201 secs 2024-07-26T14:22:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2948.048201 secs 2024-07-26T14:22:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2948.048201 secs 2024-07-26T14:22:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:21 smithi040 ceph-mon[32397]: pgmap v4166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:21 smithi146 ceph-mon[35807]: pgmap v4166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:21 smithi076 ceph-mon[35401]: pgmap v4166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:23 smithi040 ceph-mon[32397]: pgmap v4167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:23 smithi146 ceph-mon[35807]: pgmap v4167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:23 smithi076 ceph-mon[35401]: pgmap v4167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:25 smithi040 ceph-mon[32397]: pgmap v4168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2953.048388 secs 2024-07-26T14:22:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:25 smithi146 ceph-mon[35807]: pgmap v4168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2953.048388 secs 2024-07-26T14:22:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:25 smithi076 ceph-mon[35401]: pgmap v4168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2953.048388 secs 2024-07-26T14:22:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:27 smithi146 ceph-mon[35807]: pgmap v4169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:27 smithi076 ceph-mon[35401]: pgmap v4169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:27 smithi040 ceph-mon[32397]: pgmap v4169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:29 smithi146 ceph-mon[35807]: pgmap v4170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:29 smithi076 ceph-mon[35401]: pgmap v4170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:29 smithi040 ceph-mon[32397]: pgmap v4170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2958.048533 secs 2024-07-26T14:22:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2958.048533 secs 2024-07-26T14:22:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2958.048533 secs 2024-07-26T14:22:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:32 smithi146 ceph-mon[35807]: pgmap v4171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:32 smithi076 ceph-mon[35401]: pgmap v4171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:32 smithi040 ceph-mon[32397]: pgmap v4171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:34 smithi146 ceph-mon[35807]: pgmap v4172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:34 smithi076 ceph-mon[35401]: pgmap v4172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:34 smithi040 ceph-mon[32397]: pgmap v4172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:36 smithi146 ceph-mon[35807]: pgmap v4173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2963.048667 secs 2024-07-26T14:22:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:36 smithi076 ceph-mon[35401]: pgmap v4173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2963.048667 secs 2024-07-26T14:22:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:36 smithi040 ceph-mon[32397]: pgmap v4173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2963.048667 secs 2024-07-26T14:22:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:38 smithi146 ceph-mon[35807]: pgmap v4174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:38 smithi076 ceph-mon[35401]: pgmap v4174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:38 smithi040 ceph-mon[32397]: pgmap v4174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:40 smithi146 ceph-mon[35807]: pgmap v4175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:40 smithi076 ceph-mon[35401]: pgmap v4175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:40 smithi040 ceph-mon[32397]: pgmap v4175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2968.048806 secs 2024-07-26T14:22:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2968.048806 secs 2024-07-26T14:22:41.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2968.048806 secs 2024-07-26T14:22:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:42 smithi146 ceph-mon[35807]: pgmap v4176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:42 smithi076 ceph-mon[35401]: pgmap v4176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:42 smithi040 ceph-mon[32397]: pgmap v4176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:44 smithi146 ceph-mon[35807]: pgmap v4177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:44 smithi076 ceph-mon[35401]: pgmap v4177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:44 smithi040 ceph-mon[32397]: pgmap v4177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:46 smithi146 ceph-mon[35807]: pgmap v4178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2973.048938 secs 2024-07-26T14:22:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:46 smithi076 ceph-mon[35401]: pgmap v4178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2973.048938 secs 2024-07-26T14:22:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:46 smithi040 ceph-mon[32397]: pgmap v4178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2973.048938 secs 2024-07-26T14:22:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:48 smithi076 ceph-mon[35401]: pgmap v4179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:48 smithi040 ceph-mon[32397]: pgmap v4179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:48 smithi146 ceph-mon[35807]: pgmap v4179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:50 smithi076 ceph-mon[35401]: pgmap v4180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:50 smithi040 ceph-mon[32397]: pgmap v4180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:50 smithi146 ceph-mon[35807]: pgmap v4180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:22:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2978.049073 secs 2024-07-26T14:22:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2978.049073 secs 2024-07-26T14:22:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2978.049073 secs 2024-07-26T14:22:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:52 smithi040 ceph-mon[32397]: pgmap v4181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:52 smithi146 ceph-mon[35807]: pgmap v4181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:52 smithi076 ceph-mon[35401]: pgmap v4181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:54 smithi040 ceph-mon[32397]: pgmap v4182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:54 smithi146 ceph-mon[35807]: pgmap v4182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:54 smithi076 ceph-mon[35401]: pgmap v4182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:56.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:56 smithi076 ceph-mon[35401]: pgmap v4183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:56.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2983.049228 secs 2024-07-26T14:22:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:56 smithi040 ceph-mon[32397]: pgmap v4183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2983.049228 secs 2024-07-26T14:22:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:56 smithi146 ceph-mon[35807]: pgmap v4183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:22:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2983.049228 secs 2024-07-26T14:22:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:22:58 smithi040 ceph-mon[32397]: pgmap v4184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:22:58 smithi146 ceph-mon[35807]: pgmap v4184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:22:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:22:58 smithi076 ceph-mon[35401]: pgmap v4184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:00 smithi040 ceph-mon[32397]: pgmap v4185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:00 smithi146 ceph-mon[35807]: pgmap v4185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:00 smithi076 ceph-mon[35401]: pgmap v4185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2988.049372 secs 2024-07-26T14:23:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2988.049372 secs 2024-07-26T14:23:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2988.049372 secs 2024-07-26T14:23:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:02 smithi040 ceph-mon[32397]: pgmap v4186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:02 smithi146 ceph-mon[35807]: pgmap v4186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:02 smithi076 ceph-mon[35401]: pgmap v4186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:04 smithi040 ceph-mon[32397]: pgmap v4187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:04 smithi146 ceph-mon[35807]: pgmap v4187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:04 smithi076 ceph-mon[35401]: pgmap v4187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:06 smithi040 ceph-mon[32397]: pgmap v4188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2993.049509 secs 2024-07-26T14:23:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:06 smithi146 ceph-mon[35807]: pgmap v4188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2993.049509 secs 2024-07-26T14:23:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:06 smithi076 ceph-mon[35401]: pgmap v4188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2993.049509 secs 2024-07-26T14:23:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:07 smithi040 ceph-mon[32397]: pgmap v4189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:07 smithi146 ceph-mon[35807]: pgmap v4189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:07 smithi076 ceph-mon[35401]: pgmap v4189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:09.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:09 smithi146 ceph-mon[35807]: pgmap v4190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:09 smithi076 ceph-mon[35401]: pgmap v4190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:09 smithi040 ceph-mon[32397]: pgmap v4190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:11.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:11 smithi040 ceph-mon[32397]: pgmap v4191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:11.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 2998.049652 secs 2024-07-26T14:23:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:11 smithi146 ceph-mon[35807]: pgmap v4191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 2998.049652 secs 2024-07-26T14:23:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:11 smithi076 ceph-mon[35401]: pgmap v4191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 2998.049652 secs 2024-07-26T14:23:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:13 smithi146 ceph-mon[35807]: pgmap v4192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:13 smithi076 ceph-mon[35401]: pgmap v4192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:13 smithi040 ceph-mon[32397]: pgmap v4192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:15 smithi146 ceph-mon[35807]: pgmap v4193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:15 smithi076 ceph-mon[35401]: pgmap v4193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:15 smithi040 ceph-mon[32397]: pgmap v4193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3003.049744 secs 2024-07-26T14:23:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3003.049744 secs 2024-07-26T14:23:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3003.049744 secs 2024-07-26T14:23:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:17 smithi146 ceph-mon[35807]: pgmap v4194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:17 smithi076 ceph-mon[35401]: pgmap v4194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:17 smithi040 ceph-mon[32397]: pgmap v4194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:19 smithi146 ceph-mon[35807]: pgmap v4195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:19 smithi076 ceph-mon[35401]: pgmap v4195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:19 smithi040 ceph-mon[32397]: pgmap v4195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3008.049891 secs 2024-07-26T14:23:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3008.049891 secs 2024-07-26T14:23:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3008.049891 secs 2024-07-26T14:23:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:21 smithi146 ceph-mon[35807]: pgmap v4196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:21 smithi076 ceph-mon[35401]: pgmap v4196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:21 smithi040 ceph-mon[32397]: pgmap v4196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:23 smithi076 ceph-mon[35401]: pgmap v4197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:23 smithi040 ceph-mon[32397]: pgmap v4197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:23 smithi146 ceph-mon[35807]: pgmap v4197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:25 smithi076 ceph-mon[35401]: pgmap v4198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3013.050029 secs 2024-07-26T14:23:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:25 smithi040 ceph-mon[32397]: pgmap v4198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3013.050029 secs 2024-07-26T14:23:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:25 smithi146 ceph-mon[35807]: pgmap v4198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3013.050029 secs 2024-07-26T14:23:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:27 smithi040 ceph-mon[32397]: pgmap v4199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:27 smithi146 ceph-mon[35807]: pgmap v4199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:27 smithi076 ceph-mon[35401]: pgmap v4199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:29 smithi040 ceph-mon[32397]: pgmap v4200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:29 smithi146 ceph-mon[35807]: pgmap v4200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:29 smithi076 ceph-mon[35401]: pgmap v4200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:30.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3018.050207 secs 2024-07-26T14:23:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3018.050207 secs 2024-07-26T14:23:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3018.050207 secs 2024-07-26T14:23:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:31 smithi040 ceph-mon[32397]: pgmap v4201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:31 smithi146 ceph-mon[35807]: pgmap v4201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:31 smithi076 ceph-mon[35401]: pgmap v4201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:33 smithi040 ceph-mon[32397]: pgmap v4202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:33 smithi146 ceph-mon[35807]: pgmap v4202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:33 smithi076 ceph-mon[35401]: pgmap v4202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:35 smithi040 ceph-mon[32397]: pgmap v4203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:35.995 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3023.050345 secs 2024-07-26T14:23:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:35 smithi146 ceph-mon[35807]: pgmap v4203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3023.050345 secs 2024-07-26T14:23:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:35 smithi076 ceph-mon[35401]: pgmap v4203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3023.050345 secs 2024-07-26T14:23:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:37 smithi040 ceph-mon[32397]: pgmap v4204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:37 smithi146 ceph-mon[35807]: pgmap v4204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:37 smithi076 ceph-mon[35401]: pgmap v4204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:39 smithi040 ceph-mon[32397]: pgmap v4205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:39 smithi146 ceph-mon[35807]: pgmap v4205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:39 smithi076 ceph-mon[35401]: pgmap v4205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3028.050487 secs 2024-07-26T14:23:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3028.050487 secs 2024-07-26T14:23:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3028.050487 secs 2024-07-26T14:23:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:41 smithi040 ceph-mon[32397]: pgmap v4206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:41 smithi146 ceph-mon[35807]: pgmap v4206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:41 smithi076 ceph-mon[35401]: pgmap v4206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:43 smithi040 ceph-mon[32397]: pgmap v4207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:43 smithi146 ceph-mon[35807]: pgmap v4207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:43 smithi076 ceph-mon[35401]: pgmap v4207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:45 smithi040 ceph-mon[32397]: pgmap v4208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3033.050625 secs 2024-07-26T14:23:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:45 smithi146 ceph-mon[35807]: pgmap v4208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3033.050625 secs 2024-07-26T14:23:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:45 smithi076 ceph-mon[35401]: pgmap v4208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3033.050625 secs 2024-07-26T14:23:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:47 smithi040 ceph-mon[32397]: pgmap v4209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:47 smithi146 ceph-mon[35807]: pgmap v4209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:47 smithi076 ceph-mon[35401]: pgmap v4209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:23:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:49 smithi040 ceph-mon[32397]: pgmap v4210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:49 smithi146 ceph-mon[35807]: pgmap v4210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:49 smithi076 ceph-mon[35401]: pgmap v4210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:23:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3038.050821 secs 2024-07-26T14:23:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3038.050821 secs 2024-07-26T14:23:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3038.050821 secs 2024-07-26T14:23:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:51 smithi040 ceph-mon[32397]: pgmap v4211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:23:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:51 smithi146 ceph-mon[35807]: pgmap v4211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:23:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:51 smithi076 ceph-mon[35401]: pgmap v4211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:23:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:53 smithi040 ceph-mon[32397]: pgmap v4212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:23:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:53 smithi146 ceph-mon[35807]: pgmap v4212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:23:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:53 smithi076 ceph-mon[35401]: pgmap v4212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:23:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:55 smithi040 ceph-mon[32397]: pgmap v4213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3043.050959 secs 2024-07-26T14:23:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:55 smithi146 ceph-mon[35807]: pgmap v4213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3043.050959 secs 2024-07-26T14:23:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:55 smithi076 ceph-mon[35401]: pgmap v4213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:23:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3043.050959 secs 2024-07-26T14:23:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:57 smithi040 ceph-mon[32397]: pgmap v4214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:23:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:57 smithi146 ceph-mon[35807]: pgmap v4214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:23:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:57 smithi076 ceph-mon[35401]: pgmap v4214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:23:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:23:59 smithi040 ceph-mon[32397]: pgmap v4215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:24:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:23:59 smithi146 ceph-mon[35807]: pgmap v4215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:24:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:23:59 smithi076 ceph-mon[35401]: pgmap v4215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:24:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3048.051137 secs 2024-07-26T14:24:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3048.051137 secs 2024-07-26T14:24:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3048.051137 secs 2024-07-26T14:24:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:01 smithi146 ceph-mon[35807]: pgmap v4216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:24:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:01 smithi076 ceph-mon[35401]: pgmap v4216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:24:02.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:01 smithi040 ceph-mon[32397]: pgmap v4216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:24:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:03 smithi146 ceph-mon[35807]: pgmap v4217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:03 smithi076 ceph-mon[35401]: pgmap v4217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:03 smithi040 ceph-mon[32397]: pgmap v4217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:05 smithi146 ceph-mon[35807]: pgmap v4218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3053.051315 secs 2024-07-26T14:24:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:05 smithi076 ceph-mon[35401]: pgmap v4218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3053.051315 secs 2024-07-26T14:24:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:05 smithi040 ceph-mon[32397]: pgmap v4218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3053.051315 secs 2024-07-26T14:24:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:07 smithi146 ceph-mon[35807]: pgmap v4219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:07 smithi076 ceph-mon[35401]: pgmap v4219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:07 smithi040 ceph-mon[32397]: pgmap v4219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:09 smithi146 ceph-mon[35807]: pgmap v4220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:09 smithi076 ceph-mon[35401]: pgmap v4220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:09 smithi040 ceph-mon[32397]: pgmap v4220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3058.051458 secs 2024-07-26T14:24:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3058.051458 secs 2024-07-26T14:24:11.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3058.051458 secs 2024-07-26T14:24:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:11 smithi146 ceph-mon[35807]: pgmap v4221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:11 smithi076 ceph-mon[35401]: pgmap v4221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:11 smithi040 ceph-mon[32397]: pgmap v4221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:13 smithi146 ceph-mon[35807]: pgmap v4222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:13 smithi076 ceph-mon[35401]: pgmap v4222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:13 smithi040 ceph-mon[32397]: pgmap v4222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:15 smithi146 ceph-mon[35807]: pgmap v4223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3063.051597 secs 2024-07-26T14:24:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:15 smithi076 ceph-mon[35401]: pgmap v4223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3063.051597 secs 2024-07-26T14:24:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:15 smithi040 ceph-mon[32397]: pgmap v4223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3063.051597 secs 2024-07-26T14:24:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:17 smithi146 ceph-mon[35807]: pgmap v4224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:17 smithi076 ceph-mon[35401]: pgmap v4224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:17 smithi040 ceph-mon[32397]: pgmap v4224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:19 smithi146 ceph-mon[35807]: pgmap v4225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:19 smithi076 ceph-mon[35401]: pgmap v4225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:19 smithi040 ceph-mon[32397]: pgmap v4225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3068.051737 secs 2024-07-26T14:24:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3068.051737 secs 2024-07-26T14:24:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3068.051737 secs 2024-07-26T14:24:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:21 smithi040 ceph-mon[32397]: pgmap v4226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:21 smithi146 ceph-mon[35807]: pgmap v4226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:21 smithi076 ceph-mon[35401]: pgmap v4226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:23 smithi040 ceph-mon[32397]: pgmap v4227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:23 smithi146 ceph-mon[35807]: pgmap v4227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:23 smithi076 ceph-mon[35401]: pgmap v4227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:25 smithi040 ceph-mon[32397]: pgmap v4228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3073.051890 secs 2024-07-26T14:24:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:25 smithi146 ceph-mon[35807]: pgmap v4228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3073.051890 secs 2024-07-26T14:24:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:25 smithi076 ceph-mon[35401]: pgmap v4228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3073.051890 secs 2024-07-26T14:24:28.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:27 smithi076 ceph-mon[35401]: pgmap v4229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:27 smithi040 ceph-mon[32397]: pgmap v4229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:27 smithi146 ceph-mon[35807]: pgmap v4229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:30.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:29 smithi146 ceph-mon[35807]: pgmap v4230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:29 smithi040 ceph-mon[32397]: pgmap v4230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:29 smithi076 ceph-mon[35401]: pgmap v4230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3078.051983 secs 2024-07-26T14:24:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3078.051983 secs 2024-07-26T14:24:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3078.051983 secs 2024-07-26T14:24:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:31 smithi040 ceph-mon[32397]: pgmap v4231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:24:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:31 smithi146 ceph-mon[35807]: pgmap v4231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:24:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:31 smithi076 ceph-mon[35401]: pgmap v4231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:24:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:33 smithi040 ceph-mon[32397]: pgmap v4232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:33 smithi146 ceph-mon[35807]: pgmap v4232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:33 smithi076 ceph-mon[35401]: pgmap v4232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:35 smithi040 ceph-mon[32397]: pgmap v4233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3083.052121 secs 2024-07-26T14:24:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:35 smithi146 ceph-mon[35807]: pgmap v4233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3083.052121 secs 2024-07-26T14:24:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:35 smithi076 ceph-mon[35401]: pgmap v4233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3083.052121 secs 2024-07-26T14:24:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:37 smithi040 ceph-mon[32397]: pgmap v4234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:37 smithi146 ceph-mon[35807]: pgmap v4234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:37 smithi076 ceph-mon[35401]: pgmap v4234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:39 smithi040 ceph-mon[32397]: pgmap v4235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:39 smithi146 ceph-mon[35807]: pgmap v4235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:39 smithi076 ceph-mon[35401]: pgmap v4235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3088.052294 secs 2024-07-26T14:24:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3088.052294 secs 2024-07-26T14:24:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3088.052294 secs 2024-07-26T14:24:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:41 smithi040 ceph-mon[32397]: pgmap v4236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:41 smithi146 ceph-mon[35807]: pgmap v4236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:41 smithi076 ceph-mon[35401]: pgmap v4236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:43 smithi040 ceph-mon[32397]: pgmap v4237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:43 smithi146 ceph-mon[35807]: pgmap v4237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:43 smithi076 ceph-mon[35401]: pgmap v4237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:45 smithi040 ceph-mon[32397]: pgmap v4238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3093.052436 secs 2024-07-26T14:24:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:45 smithi146 ceph-mon[35807]: pgmap v4238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3093.052436 secs 2024-07-26T14:24:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:45 smithi076 ceph-mon[35401]: pgmap v4238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3093.052436 secs 2024-07-26T14:24:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:47 smithi040 ceph-mon[32397]: pgmap v4239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:47 smithi146 ceph-mon[35807]: pgmap v4239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:47 smithi076 ceph-mon[35401]: pgmap v4239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:49 smithi040 ceph-mon[32397]: pgmap v4240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:49 smithi146 ceph-mon[35807]: pgmap v4240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:49 smithi076 ceph-mon[35401]: pgmap v4240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:24:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3098.052582 secs 2024-07-26T14:24:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3098.052582 secs 2024-07-26T14:24:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3098.052582 secs 2024-07-26T14:24:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:51 smithi146 ceph-mon[35807]: pgmap v4241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:51 smithi076 ceph-mon[35401]: pgmap v4241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:51 smithi040 ceph-mon[32397]: pgmap v4241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:53 smithi146 ceph-mon[35807]: pgmap v4242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:53 smithi076 ceph-mon[35401]: pgmap v4242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:53 smithi040 ceph-mon[32397]: pgmap v4242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:56 smithi146 ceph-mon[35807]: pgmap v4243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3103.052717 secs 2024-07-26T14:24:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:56 smithi076 ceph-mon[35401]: pgmap v4243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3103.052717 secs 2024-07-26T14:24:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:56 smithi040 ceph-mon[32397]: pgmap v4243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:24:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3103.052717 secs 2024-07-26T14:24:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:24:58 smithi146 ceph-mon[35807]: pgmap v4244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:24:58 smithi076 ceph-mon[35401]: pgmap v4244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:24:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:24:58 smithi040 ceph-mon[32397]: pgmap v4244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:00 smithi146 ceph-mon[35807]: pgmap v4245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:00 smithi076 ceph-mon[35401]: pgmap v4245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:00 smithi040 ceph-mon[32397]: pgmap v4245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3108.052859 secs 2024-07-26T14:25:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3108.052859 secs 2024-07-26T14:25:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3108.052859 secs 2024-07-26T14:25:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:02 smithi146 ceph-mon[35807]: pgmap v4246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:02 smithi076 ceph-mon[35401]: pgmap v4246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:02 smithi040 ceph-mon[32397]: pgmap v4246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:04 smithi146 ceph-mon[35807]: pgmap v4247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:04 smithi076 ceph-mon[35401]: pgmap v4247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:04 smithi040 ceph-mon[32397]: pgmap v4247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:06 smithi146 ceph-mon[35807]: pgmap v4248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3113.053007 secs 2024-07-26T14:25:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:06 smithi076 ceph-mon[35401]: pgmap v4248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3113.053007 secs 2024-07-26T14:25:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:06 smithi040 ceph-mon[32397]: pgmap v4248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3113.053007 secs 2024-07-26T14:25:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:08 smithi146 ceph-mon[35807]: pgmap v4249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:08.346 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:08 smithi076 ceph-mon[35401]: pgmap v4249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:08 smithi040 ceph-mon[32397]: pgmap v4249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:10 smithi146 ceph-mon[35807]: pgmap v4250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:10 smithi076 ceph-mon[35401]: pgmap v4250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:10 smithi040 ceph-mon[32397]: pgmap v4250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3118.053148 secs 2024-07-26T14:25:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3118.053148 secs 2024-07-26T14:25:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3118.053148 secs 2024-07-26T14:25:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:12 smithi076 ceph-mon[35401]: pgmap v4251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:12 smithi040 ceph-mon[32397]: pgmap v4251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:12 smithi146 ceph-mon[35807]: pgmap v4251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:14 smithi040 ceph-mon[32397]: pgmap v4252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:14 smithi146 ceph-mon[35807]: pgmap v4252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:14.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:14 smithi076 ceph-mon[35401]: pgmap v4252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:16 smithi040 ceph-mon[32397]: pgmap v4253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3123.053320 secs 2024-07-26T14:25:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:16 smithi146 ceph-mon[35807]: pgmap v4253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3123.053320 secs 2024-07-26T14:25:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:16 smithi076 ceph-mon[35401]: pgmap v4253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3123.053320 secs 2024-07-26T14:25:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:18 smithi040 ceph-mon[32397]: pgmap v4254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:18 smithi146 ceph-mon[35807]: pgmap v4254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:18 smithi076 ceph-mon[35401]: pgmap v4254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:20 smithi040 ceph-mon[32397]: pgmap v4255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:20 smithi146 ceph-mon[35807]: pgmap v4255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:20 smithi076 ceph-mon[35401]: pgmap v4255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3128.053417 secs 2024-07-26T14:25:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3128.053417 secs 2024-07-26T14:25:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3128.053417 secs 2024-07-26T14:25:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:22 smithi040 ceph-mon[32397]: pgmap v4256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:22 smithi146 ceph-mon[35807]: pgmap v4256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:22 smithi076 ceph-mon[35401]: pgmap v4256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:24 smithi040 ceph-mon[32397]: pgmap v4257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:24 smithi146 ceph-mon[35807]: pgmap v4257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:24 smithi076 ceph-mon[35401]: pgmap v4257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:26 smithi040 ceph-mon[32397]: pgmap v4258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3133.053520 secs 2024-07-26T14:25:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:26 smithi146 ceph-mon[35807]: pgmap v4258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3133.053520 secs 2024-07-26T14:25:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:26 smithi076 ceph-mon[35401]: pgmap v4258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3133.053520 secs 2024-07-26T14:25:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:28 smithi040 ceph-mon[32397]: pgmap v4259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:28 smithi146 ceph-mon[35807]: pgmap v4259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:28 smithi076 ceph-mon[35401]: pgmap v4259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:30.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:30 smithi040 ceph-mon[32397]: pgmap v4260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:30 smithi146 ceph-mon[35807]: pgmap v4260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:30 smithi076 ceph-mon[35401]: pgmap v4260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3138.053669 secs 2024-07-26T14:25:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3138.053669 secs 2024-07-26T14:25:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3138.053669 secs 2024-07-26T14:25:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:32 smithi040 ceph-mon[32397]: pgmap v4261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:32 smithi146 ceph-mon[35807]: pgmap v4261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:32 smithi076 ceph-mon[35401]: pgmap v4261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:34 smithi040 ceph-mon[32397]: pgmap v4262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:34 smithi146 ceph-mon[35807]: pgmap v4262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:34 smithi076 ceph-mon[35401]: pgmap v4262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:36 smithi040 ceph-mon[32397]: pgmap v4263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3143.053804 secs 2024-07-26T14:25:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:36 smithi146 ceph-mon[35807]: pgmap v4263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3143.053804 secs 2024-07-26T14:25:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:36 smithi076 ceph-mon[35401]: pgmap v4263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3143.053804 secs 2024-07-26T14:25:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:38 smithi040 ceph-mon[32397]: pgmap v4264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:38 smithi146 ceph-mon[35807]: pgmap v4264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:38 smithi076 ceph-mon[35401]: pgmap v4264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:40 smithi040 ceph-mon[32397]: pgmap v4265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:40 smithi146 ceph-mon[35807]: pgmap v4265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:40 smithi076 ceph-mon[35401]: pgmap v4265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3148.053964 secs 2024-07-26T14:25:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3148.053964 secs 2024-07-26T14:25:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3148.053964 secs 2024-07-26T14:25:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:42 smithi040 ceph-mon[32397]: pgmap v4266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:42 smithi146 ceph-mon[35807]: pgmap v4266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:42 smithi076 ceph-mon[35401]: pgmap v4266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:43 smithi040 ceph-mon[32397]: pgmap v4267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:43 smithi146 ceph-mon[35807]: pgmap v4267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:43 smithi076 ceph-mon[35401]: pgmap v4267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:45 smithi040 ceph-mon[32397]: pgmap v4268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3153.054045 secs 2024-07-26T14:25:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:45 smithi146 ceph-mon[35807]: pgmap v4268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3153.054045 secs 2024-07-26T14:25:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:45 smithi076 ceph-mon[35401]: pgmap v4268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3153.054045 secs 2024-07-26T14:25:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:47 smithi040 ceph-mon[32397]: pgmap v4269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:47 smithi146 ceph-mon[35807]: pgmap v4269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:47 smithi076 ceph-mon[35401]: pgmap v4269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:49 smithi040 ceph-mon[32397]: pgmap v4270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:49 smithi146 ceph-mon[35807]: pgmap v4270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:49 smithi076 ceph-mon[35401]: pgmap v4270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:25:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3158.054201 secs 2024-07-26T14:25:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3158.054201 secs 2024-07-26T14:25:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3158.054201 secs 2024-07-26T14:25:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:51 smithi040 ceph-mon[32397]: pgmap v4271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:51 smithi146 ceph-mon[35807]: pgmap v4271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:51 smithi076 ceph-mon[35401]: pgmap v4271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:53 smithi040 ceph-mon[32397]: pgmap v4272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:53 smithi146 ceph-mon[35807]: pgmap v4272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:53 smithi076 ceph-mon[35401]: pgmap v4272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:55 smithi040 ceph-mon[32397]: pgmap v4273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3163.054365 secs 2024-07-26T14:25:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:55 smithi146 ceph-mon[35807]: pgmap v4273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3163.054365 secs 2024-07-26T14:25:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:55 smithi076 ceph-mon[35401]: pgmap v4273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:25:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3163.054365 secs 2024-07-26T14:25:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:57 smithi040 ceph-mon[32397]: pgmap v4274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:57 smithi146 ceph-mon[35807]: pgmap v4274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:57 smithi076 ceph-mon[35401]: pgmap v4274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:25:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:25:59 smithi040 ceph-mon[32397]: pgmap v4275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:25:59 smithi146 ceph-mon[35807]: pgmap v4275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:25:59 smithi076 ceph-mon[35401]: pgmap v4275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:00.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3168.054465 secs 2024-07-26T14:26:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3168.054465 secs 2024-07-26T14:26:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3168.054465 secs 2024-07-26T14:26:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:01 smithi040 ceph-mon[32397]: pgmap v4276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:01 smithi146 ceph-mon[35807]: pgmap v4276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:01 smithi076 ceph-mon[35401]: pgmap v4276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:03 smithi040 ceph-mon[32397]: pgmap v4277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:03 smithi146 ceph-mon[35807]: pgmap v4277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:03 smithi076 ceph-mon[35401]: pgmap v4277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:05 smithi040 ceph-mon[32397]: pgmap v4278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3173.054556 secs 2024-07-26T14:26:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:05 smithi146 ceph-mon[35807]: pgmap v4278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3173.054556 secs 2024-07-26T14:26:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:05 smithi076 ceph-mon[35401]: pgmap v4278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3173.054556 secs 2024-07-26T14:26:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:07 smithi040 ceph-mon[32397]: pgmap v4279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:07 smithi146 ceph-mon[35807]: pgmap v4279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:07 smithi076 ceph-mon[35401]: pgmap v4279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:09 smithi040 ceph-mon[32397]: pgmap v4280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:09 smithi146 ceph-mon[35807]: pgmap v4280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:09 smithi076 ceph-mon[35401]: pgmap v4280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3178.054656 secs 2024-07-26T14:26:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3178.054656 secs 2024-07-26T14:26:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3178.054656 secs 2024-07-26T14:26:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:11 smithi040 ceph-mon[32397]: pgmap v4281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:11 smithi146 ceph-mon[35807]: pgmap v4281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:11 smithi076 ceph-mon[35401]: pgmap v4281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:13 smithi146 ceph-mon[35807]: pgmap v4282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:13 smithi076 ceph-mon[35401]: pgmap v4282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:13 smithi040 ceph-mon[32397]: pgmap v4282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:15 smithi146 ceph-mon[35807]: pgmap v4283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3183.054797 secs 2024-07-26T14:26:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:15 smithi076 ceph-mon[35401]: pgmap v4283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3183.054797 secs 2024-07-26T14:26:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:15 smithi040 ceph-mon[32397]: pgmap v4283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3183.054797 secs 2024-07-26T14:26:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:17 smithi146 ceph-mon[35807]: pgmap v4284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:17 smithi076 ceph-mon[35401]: pgmap v4284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:17 smithi040 ceph-mon[32397]: pgmap v4284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:19 smithi146 ceph-mon[35807]: pgmap v4285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:19 smithi076 ceph-mon[35401]: pgmap v4285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:19 smithi040 ceph-mon[32397]: pgmap v4285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3188.054952 secs 2024-07-26T14:26:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3188.054952 secs 2024-07-26T14:26:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3188.054952 secs 2024-07-26T14:26:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:21 smithi146 ceph-mon[35807]: pgmap v4286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:21 smithi076 ceph-mon[35401]: pgmap v4286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:21 smithi040 ceph-mon[32397]: pgmap v4286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:23 smithi146 ceph-mon[35807]: pgmap v4287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:23 smithi076 ceph-mon[35401]: pgmap v4287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:23 smithi040 ceph-mon[32397]: pgmap v4287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:25 smithi146 ceph-mon[35807]: pgmap v4288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3193.055113 secs 2024-07-26T14:26:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:25 smithi076 ceph-mon[35401]: pgmap v4288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3193.055113 secs 2024-07-26T14:26:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:25 smithi040 ceph-mon[32397]: pgmap v4288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3193.055113 secs 2024-07-26T14:26:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:27 smithi146 ceph-mon[35807]: pgmap v4289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:27 smithi076 ceph-mon[35401]: pgmap v4289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:27 smithi040 ceph-mon[32397]: pgmap v4289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:29 smithi146 ceph-mon[35807]: pgmap v4290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:29 smithi076 ceph-mon[35401]: pgmap v4290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:29 smithi040 ceph-mon[32397]: pgmap v4290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3198.055299 secs 2024-07-26T14:26:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3198.055299 secs 2024-07-26T14:26:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3198.055299 secs 2024-07-26T14:26:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:31 smithi076 ceph-mon[35401]: pgmap v4291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:31 smithi040 ceph-mon[32397]: pgmap v4291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:31 smithi146 ceph-mon[35807]: pgmap v4291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:33 smithi076 ceph-mon[35401]: pgmap v4292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:33 smithi040 ceph-mon[32397]: pgmap v4292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:33 smithi146 ceph-mon[35807]: pgmap v4292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:35 smithi040 ceph-mon[32397]: pgmap v4293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3203.055398 secs 2024-07-26T14:26:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:35 smithi146 ceph-mon[35807]: pgmap v4293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3203.055398 secs 2024-07-26T14:26:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:35 smithi076 ceph-mon[35401]: pgmap v4293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3203.055398 secs 2024-07-26T14:26:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:37 smithi040 ceph-mon[32397]: pgmap v4294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:37 smithi146 ceph-mon[35807]: pgmap v4294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:37 smithi076 ceph-mon[35401]: pgmap v4294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:39 smithi040 ceph-mon[32397]: pgmap v4295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:39 smithi146 ceph-mon[35807]: pgmap v4295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:39 smithi076 ceph-mon[35401]: pgmap v4295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:41.133 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3208.055535 secs 2024-07-26T14:26:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3208.055535 secs 2024-07-26T14:26:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3208.055535 secs 2024-07-26T14:26:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:41 smithi040 ceph-mon[32397]: pgmap v4296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:41 smithi146 ceph-mon[35807]: pgmap v4296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:41 smithi076 ceph-mon[35401]: pgmap v4296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:43 smithi040 ceph-mon[32397]: pgmap v4297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:43 smithi146 ceph-mon[35807]: pgmap v4297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:43 smithi076 ceph-mon[35401]: pgmap v4297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:45 smithi040 ceph-mon[32397]: pgmap v4298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3213.055677 secs 2024-07-26T14:26:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:45 smithi146 ceph-mon[35807]: pgmap v4298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3213.055677 secs 2024-07-26T14:26:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:45 smithi076 ceph-mon[35401]: pgmap v4298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3213.055677 secs 2024-07-26T14:26:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:47 smithi040 ceph-mon[32397]: pgmap v4299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:47 smithi146 ceph-mon[35807]: pgmap v4299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:47 smithi076 ceph-mon[35401]: pgmap v4299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:49 smithi040 ceph-mon[32397]: pgmap v4300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:49 smithi146 ceph-mon[35807]: pgmap v4300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:49 smithi076 ceph-mon[35401]: pgmap v4300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:26:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3218.055817 secs 2024-07-26T14:26:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3218.055817 secs 2024-07-26T14:26:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3218.055817 secs 2024-07-26T14:26:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:51 smithi040 ceph-mon[32397]: pgmap v4301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:51 smithi146 ceph-mon[35807]: pgmap v4301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:51 smithi076 ceph-mon[35401]: pgmap v4301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:53 smithi040 ceph-mon[32397]: pgmap v4302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:53 smithi146 ceph-mon[35807]: pgmap v4302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:53 smithi076 ceph-mon[35401]: pgmap v4302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:55 smithi040 ceph-mon[32397]: pgmap v4303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3223.055957 secs 2024-07-26T14:26:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:55 smithi146 ceph-mon[35807]: pgmap v4303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3223.055957 secs 2024-07-26T14:26:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:55 smithi076 ceph-mon[35401]: pgmap v4303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:26:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3223.055957 secs 2024-07-26T14:26:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:57 smithi040 ceph-mon[32397]: pgmap v4304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:57 smithi146 ceph-mon[35807]: pgmap v4304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:26:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:57 smithi076 ceph-mon[35401]: pgmap v4304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:26:59 smithi040 ceph-mon[32397]: pgmap v4305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:26:59 smithi146 ceph-mon[35807]: pgmap v4305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:26:59 smithi076 ceph-mon[35401]: pgmap v4305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3228.056099 secs 2024-07-26T14:27:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3228.056099 secs 2024-07-26T14:27:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3228.056099 secs 2024-07-26T14:27:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:01 smithi040 ceph-mon[32397]: pgmap v4306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:01 smithi146 ceph-mon[35807]: pgmap v4306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:01 smithi076 ceph-mon[35401]: pgmap v4306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:03 smithi040 ceph-mon[32397]: pgmap v4307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:03 smithi146 ceph-mon[35807]: pgmap v4307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:03 smithi076 ceph-mon[35401]: pgmap v4307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:05 smithi040 ceph-mon[32397]: pgmap v4308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3233.056248 secs 2024-07-26T14:27:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:05 smithi146 ceph-mon[35807]: pgmap v4308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3233.056248 secs 2024-07-26T14:27:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:05 smithi076 ceph-mon[35401]: pgmap v4308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3233.056248 secs 2024-07-26T14:27:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:08 smithi146 ceph-mon[35807]: pgmap v4309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:08 smithi076 ceph-mon[35401]: pgmap v4309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:08 smithi040 ceph-mon[32397]: pgmap v4309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:10 smithi146 ceph-mon[35807]: pgmap v4310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:10 smithi076 ceph-mon[35401]: pgmap v4310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:10 smithi040 ceph-mon[32397]: pgmap v4310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3238.056410 secs 2024-07-26T14:27:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3238.056410 secs 2024-07-26T14:27:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3238.056410 secs 2024-07-26T14:27:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:12 smithi146 ceph-mon[35807]: pgmap v4311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:12 smithi076 ceph-mon[35401]: pgmap v4311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:12 smithi040 ceph-mon[32397]: pgmap v4311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:14 smithi146 ceph-mon[35807]: pgmap v4312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:14 smithi076 ceph-mon[35401]: pgmap v4312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:14 smithi040 ceph-mon[32397]: pgmap v4312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:16 smithi146 ceph-mon[35807]: pgmap v4313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3243.056549 secs 2024-07-26T14:27:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:16 smithi076 ceph-mon[35401]: pgmap v4313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3243.056549 secs 2024-07-26T14:27:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:16 smithi040 ceph-mon[32397]: pgmap v4313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3243.056549 secs 2024-07-26T14:27:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:18 smithi076 ceph-mon[35401]: pgmap v4314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:18 smithi040 ceph-mon[32397]: pgmap v4314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:18 smithi146 ceph-mon[35807]: pgmap v4314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:20 smithi076 ceph-mon[35401]: pgmap v4315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:20 smithi040 ceph-mon[32397]: pgmap v4315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:20 smithi146 ceph-mon[35807]: pgmap v4315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3248.056696 secs 2024-07-26T14:27:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3248.056696 secs 2024-07-26T14:27:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3248.056696 secs 2024-07-26T14:27:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:22 smithi040 ceph-mon[32397]: pgmap v4316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:22 smithi146 ceph-mon[35807]: pgmap v4316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:22 smithi076 ceph-mon[35401]: pgmap v4316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:24 smithi040 ceph-mon[32397]: pgmap v4317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:24 smithi146 ceph-mon[35807]: pgmap v4317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:24 smithi076 ceph-mon[35401]: pgmap v4317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:26 smithi040 ceph-mon[32397]: pgmap v4318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3253.056836 secs 2024-07-26T14:27:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:26 smithi146 ceph-mon[35807]: pgmap v4318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3253.056836 secs 2024-07-26T14:27:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:26 smithi076 ceph-mon[35401]: pgmap v4318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3253.056836 secs 2024-07-26T14:27:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:28 smithi040 ceph-mon[32397]: pgmap v4319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:28 smithi146 ceph-mon[35807]: pgmap v4319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:28 smithi076 ceph-mon[35401]: pgmap v4319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:30.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:30 smithi146 ceph-mon[35807]: pgmap v4320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:30.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:30 smithi076 ceph-mon[35401]: pgmap v4320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:30 smithi040 ceph-mon[32397]: pgmap v4320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3258.056980 secs 2024-07-26T14:27:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3258.056980 secs 2024-07-26T14:27:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3258.056980 secs 2024-07-26T14:27:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:32 smithi040 ceph-mon[32397]: pgmap v4321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:32 smithi146 ceph-mon[35807]: pgmap v4321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:32 smithi076 ceph-mon[35401]: pgmap v4321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:34 smithi040 ceph-mon[32397]: pgmap v4322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:34 smithi146 ceph-mon[35807]: pgmap v4322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:34 smithi076 ceph-mon[35401]: pgmap v4322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:36 smithi040 ceph-mon[32397]: pgmap v4323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3263.057122 secs 2024-07-26T14:27:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:36 smithi146 ceph-mon[35807]: pgmap v4323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3263.057122 secs 2024-07-26T14:27:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:36 smithi076 ceph-mon[35401]: pgmap v4323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3263.057122 secs 2024-07-26T14:27:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:38 smithi040 ceph-mon[32397]: pgmap v4324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:38 smithi146 ceph-mon[35807]: pgmap v4324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:38 smithi076 ceph-mon[35401]: pgmap v4324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:40 smithi040 ceph-mon[32397]: pgmap v4325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:40 smithi146 ceph-mon[35807]: pgmap v4325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:40 smithi076 ceph-mon[35401]: pgmap v4325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3268.057304 secs 2024-07-26T14:27:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3268.057304 secs 2024-07-26T14:27:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3268.057304 secs 2024-07-26T14:27:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:42 smithi040 ceph-mon[32397]: pgmap v4326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:42 smithi146 ceph-mon[35807]: pgmap v4326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:42 smithi076 ceph-mon[35401]: pgmap v4326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:44 smithi040 ceph-mon[32397]: pgmap v4327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:44 smithi146 ceph-mon[35807]: pgmap v4327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:44 smithi076 ceph-mon[35401]: pgmap v4327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:46 smithi040 ceph-mon[32397]: pgmap v4328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3273.057402 secs 2024-07-26T14:27:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:46 smithi146 ceph-mon[35807]: pgmap v4328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3273.057402 secs 2024-07-26T14:27:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:46 smithi076 ceph-mon[35401]: pgmap v4328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3273.057402 secs 2024-07-26T14:27:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:48 smithi040 ceph-mon[32397]: pgmap v4329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:48 smithi146 ceph-mon[35807]: pgmap v4329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:48 smithi076 ceph-mon[35401]: pgmap v4329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:50 smithi040 ceph-mon[32397]: pgmap v4330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:50 smithi146 ceph-mon[35807]: pgmap v4330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:50 smithi076 ceph-mon[35401]: pgmap v4330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:27:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3278.057543 secs 2024-07-26T14:27:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3278.057543 secs 2024-07-26T14:27:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3278.057543 secs 2024-07-26T14:27:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:52 smithi040 ceph-mon[32397]: pgmap v4331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:52 smithi146 ceph-mon[35807]: pgmap v4331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:52 smithi076 ceph-mon[35401]: pgmap v4331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:53 smithi146 ceph-mon[35807]: pgmap v4332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:53 smithi076 ceph-mon[35401]: pgmap v4332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:53 smithi040 ceph-mon[32397]: pgmap v4332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:55 smithi040 ceph-mon[32397]: pgmap v4333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3283.057645 secs 2024-07-26T14:27:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:55 smithi146 ceph-mon[35807]: pgmap v4333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3283.057645 secs 2024-07-26T14:27:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:55 smithi076 ceph-mon[35401]: pgmap v4333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:27:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3283.057645 secs 2024-07-26T14:27:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:57 smithi040 ceph-mon[32397]: pgmap v4334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:57 smithi146 ceph-mon[35807]: pgmap v4334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:57 smithi076 ceph-mon[35401]: pgmap v4334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:27:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:27:59 smithi040 ceph-mon[32397]: pgmap v4335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:27:59 smithi146 ceph-mon[35807]: pgmap v4335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:27:59 smithi076 ceph-mon[35401]: pgmap v4335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:00.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3288.057786 secs 2024-07-26T14:28:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3288.057786 secs 2024-07-26T14:28:00.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3288.057786 secs 2024-07-26T14:28:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:01 smithi040 ceph-mon[32397]: pgmap v4336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:01 smithi146 ceph-mon[35807]: pgmap v4336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:01 smithi076 ceph-mon[35401]: pgmap v4336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:03 smithi040 ceph-mon[32397]: pgmap v4337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:03 smithi146 ceph-mon[35807]: pgmap v4337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:03 smithi076 ceph-mon[35401]: pgmap v4337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:05 smithi146 ceph-mon[35807]: pgmap v4338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3293.057925 secs 2024-07-26T14:28:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:05 smithi076 ceph-mon[35401]: pgmap v4338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3293.057925 secs 2024-07-26T14:28:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:05 smithi040 ceph-mon[32397]: pgmap v4338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3293.057925 secs 2024-07-26T14:28:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:07 smithi146 ceph-mon[35807]: pgmap v4339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:07 smithi076 ceph-mon[35401]: pgmap v4339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:07 smithi040 ceph-mon[32397]: pgmap v4339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:09 smithi146 ceph-mon[35807]: pgmap v4340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:09 smithi076 ceph-mon[35401]: pgmap v4340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:09 smithi040 ceph-mon[32397]: pgmap v4340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3298.058067 secs 2024-07-26T14:28:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3298.058067 secs 2024-07-26T14:28:11.133 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3298.058067 secs 2024-07-26T14:28:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:11 smithi146 ceph-mon[35807]: pgmap v4341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:11 smithi076 ceph-mon[35401]: pgmap v4341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:11 smithi040 ceph-mon[32397]: pgmap v4341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:13 smithi146 ceph-mon[35807]: pgmap v4342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:13 smithi076 ceph-mon[35401]: pgmap v4342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:13 smithi040 ceph-mon[32397]: pgmap v4342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:15 smithi146 ceph-mon[35807]: pgmap v4343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3303.058203 secs 2024-07-26T14:28:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:15 smithi076 ceph-mon[35401]: pgmap v4343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3303.058203 secs 2024-07-26T14:28:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:15 smithi040 ceph-mon[32397]: pgmap v4343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3303.058203 secs 2024-07-26T14:28:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:17 smithi146 ceph-mon[35807]: pgmap v4344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:17 smithi076 ceph-mon[35401]: pgmap v4344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:17 smithi040 ceph-mon[32397]: pgmap v4344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:19 smithi146 ceph-mon[35807]: pgmap v4345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:19 smithi076 ceph-mon[35401]: pgmap v4345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:19 smithi040 ceph-mon[32397]: pgmap v4345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3308.058345 secs 2024-07-26T14:28:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3308.058345 secs 2024-07-26T14:28:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3308.058345 secs 2024-07-26T14:28:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:21 smithi076 ceph-mon[35401]: pgmap v4346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:21 smithi040 ceph-mon[32397]: pgmap v4346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:21 smithi146 ceph-mon[35807]: pgmap v4346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:23 smithi076 ceph-mon[35401]: pgmap v4347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:23 smithi040 ceph-mon[32397]: pgmap v4347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:23 smithi146 ceph-mon[35807]: pgmap v4347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:25 smithi040 ceph-mon[32397]: pgmap v4348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3313.058483 secs 2024-07-26T14:28:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:25 smithi146 ceph-mon[35807]: pgmap v4348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3313.058483 secs 2024-07-26T14:28:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:25 smithi076 ceph-mon[35401]: pgmap v4348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3313.058483 secs 2024-07-26T14:28:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:27 smithi040 ceph-mon[32397]: pgmap v4349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:27 smithi146 ceph-mon[35807]: pgmap v4349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:27 smithi076 ceph-mon[35401]: pgmap v4349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:30.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:29 smithi146 ceph-mon[35807]: pgmap v4350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:30.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:29 smithi076 ceph-mon[35401]: pgmap v4350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:29 smithi040 ceph-mon[32397]: pgmap v4350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3318.058623 secs 2024-07-26T14:28:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3318.058623 secs 2024-07-26T14:28:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3318.058623 secs 2024-07-26T14:28:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:31 smithi040 ceph-mon[32397]: pgmap v4351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:31 smithi146 ceph-mon[35807]: pgmap v4351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:31 smithi076 ceph-mon[35401]: pgmap v4351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:33 smithi040 ceph-mon[32397]: pgmap v4352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:33 smithi146 ceph-mon[35807]: pgmap v4352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:33 smithi076 ceph-mon[35401]: pgmap v4352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:35 smithi040 ceph-mon[32397]: pgmap v4353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3323.058778 secs 2024-07-26T14:28:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:35 smithi146 ceph-mon[35807]: pgmap v4353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3323.058778 secs 2024-07-26T14:28:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:35 smithi076 ceph-mon[35401]: pgmap v4353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3323.058778 secs 2024-07-26T14:28:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:37 smithi040 ceph-mon[32397]: pgmap v4354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:37 smithi146 ceph-mon[35807]: pgmap v4354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:37 smithi076 ceph-mon[35401]: pgmap v4354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:39 smithi040 ceph-mon[32397]: pgmap v4355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:39 smithi146 ceph-mon[35807]: pgmap v4355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:39 smithi076 ceph-mon[35401]: pgmap v4355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3328.058941 secs 2024-07-26T14:28:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3328.058941 secs 2024-07-26T14:28:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3328.058941 secs 2024-07-26T14:28:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:41 smithi040 ceph-mon[32397]: pgmap v4356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:41 smithi146 ceph-mon[35807]: pgmap v4356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:41 smithi076 ceph-mon[35401]: pgmap v4356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:43 smithi040 ceph-mon[32397]: pgmap v4357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:43 smithi146 ceph-mon[35807]: pgmap v4357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:43 smithi076 ceph-mon[35401]: pgmap v4357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:45 smithi040 ceph-mon[32397]: pgmap v4358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3333.059089 secs 2024-07-26T14:28:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:45 smithi146 ceph-mon[35807]: pgmap v4358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3333.059089 secs 2024-07-26T14:28:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:45 smithi076 ceph-mon[35401]: pgmap v4358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3333.059089 secs 2024-07-26T14:28:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:47 smithi040 ceph-mon[32397]: pgmap v4359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:47 smithi146 ceph-mon[35807]: pgmap v4359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:48.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:47 smithi076 ceph-mon[35401]: pgmap v4359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:49 smithi040 ceph-mon[32397]: pgmap v4360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:49 smithi146 ceph-mon[35807]: pgmap v4360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:49 smithi076 ceph-mon[35401]: pgmap v4360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:28:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3338.059228 secs 2024-07-26T14:28:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3338.059228 secs 2024-07-26T14:28:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3338.059228 secs 2024-07-26T14:28:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:51 smithi040 ceph-mon[32397]: pgmap v4361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:51 smithi146 ceph-mon[35807]: pgmap v4361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:51 smithi076 ceph-mon[35401]: pgmap v4361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:53 smithi040 ceph-mon[32397]: pgmap v4362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:53 smithi146 ceph-mon[35807]: pgmap v4362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:53 smithi076 ceph-mon[35401]: pgmap v4362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:55 smithi040 ceph-mon[32397]: pgmap v4363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3343.059363 secs 2024-07-26T14:28:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:55 smithi146 ceph-mon[35807]: pgmap v4363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3343.059363 secs 2024-07-26T14:28:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:55 smithi076 ceph-mon[35401]: pgmap v4363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:28:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3343.059363 secs 2024-07-26T14:28:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:57 smithi040 ceph-mon[32397]: pgmap v4364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:57 smithi146 ceph-mon[35807]: pgmap v4364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:28:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:57 smithi076 ceph-mon[35401]: pgmap v4364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:28:59 smithi146 ceph-mon[35807]: pgmap v4365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:28:59 smithi076 ceph-mon[35401]: pgmap v4365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:28:59 smithi040 ceph-mon[32397]: pgmap v4365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3348.059516 secs 2024-07-26T14:29:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3348.059516 secs 2024-07-26T14:29:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3348.059516 secs 2024-07-26T14:29:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:02 smithi146 ceph-mon[35807]: pgmap v4366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:02 smithi076 ceph-mon[35401]: pgmap v4366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:02 smithi040 ceph-mon[32397]: pgmap v4366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:04 smithi146 ceph-mon[35807]: pgmap v4367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:04 smithi076 ceph-mon[35401]: pgmap v4367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:04 smithi040 ceph-mon[32397]: pgmap v4367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:06 smithi146 ceph-mon[35807]: pgmap v4368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3353.059656 secs 2024-07-26T14:29:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:06 smithi076 ceph-mon[35401]: pgmap v4368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3353.059656 secs 2024-07-26T14:29:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:06 smithi040 ceph-mon[32397]: pgmap v4368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3353.059656 secs 2024-07-26T14:29:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:08 smithi146 ceph-mon[35807]: pgmap v4369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:08 smithi076 ceph-mon[35401]: pgmap v4369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:08 smithi040 ceph-mon[32397]: pgmap v4369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:10 smithi146 ceph-mon[35807]: pgmap v4370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:10 smithi076 ceph-mon[35401]: pgmap v4370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:10 smithi040 ceph-mon[32397]: pgmap v4370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3358.059799 secs 2024-07-26T14:29:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3358.059799 secs 2024-07-26T14:29:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3358.059799 secs 2024-07-26T14:29:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:12 smithi146 ceph-mon[35807]: pgmap v4371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:12 smithi076 ceph-mon[35401]: pgmap v4371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:12 smithi040 ceph-mon[32397]: pgmap v4371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:14 smithi146 ceph-mon[35807]: pgmap v4372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:14 smithi076 ceph-mon[35401]: pgmap v4372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:14 smithi040 ceph-mon[32397]: pgmap v4372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:16 smithi146 ceph-mon[35807]: pgmap v4373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3363.059950 secs 2024-07-26T14:29:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:16 smithi076 ceph-mon[35401]: pgmap v4373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3363.059950 secs 2024-07-26T14:29:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:16 smithi040 ceph-mon[32397]: pgmap v4373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3363.059950 secs 2024-07-26T14:29:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:18 smithi146 ceph-mon[35807]: pgmap v4374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:18 smithi076 ceph-mon[35401]: pgmap v4374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:18 smithi040 ceph-mon[32397]: pgmap v4374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:20 smithi076 ceph-mon[35401]: pgmap v4375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:20 smithi040 ceph-mon[32397]: pgmap v4375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:20 smithi146 ceph-mon[35807]: pgmap v4375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:29:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3368.060081 secs 2024-07-26T14:29:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3368.060081 secs 2024-07-26T14:29:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3368.060081 secs 2024-07-26T14:29:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:22 smithi040 ceph-mon[32397]: pgmap v4376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:22 smithi146 ceph-mon[35807]: pgmap v4376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:22 smithi076 ceph-mon[35401]: pgmap v4376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:24 smithi040 ceph-mon[32397]: pgmap v4377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:24 smithi146 ceph-mon[35807]: pgmap v4377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:24 smithi076 ceph-mon[35401]: pgmap v4377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:26 smithi040 ceph-mon[32397]: pgmap v4378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3373.060247 secs 2024-07-26T14:29:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:26 smithi146 ceph-mon[35807]: pgmap v4378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3373.060247 secs 2024-07-26T14:29:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:26 smithi076 ceph-mon[35401]: pgmap v4378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3373.060247 secs 2024-07-26T14:29:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:28 smithi040 ceph-mon[32397]: pgmap v4379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:28 smithi146 ceph-mon[35807]: pgmap v4379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:28 smithi076 ceph-mon[35401]: pgmap v4379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:30.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:30 smithi146 ceph-mon[35807]: pgmap v4380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:30.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:30 smithi076 ceph-mon[35401]: pgmap v4380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:30 smithi040 ceph-mon[32397]: pgmap v4380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3378.060386 secs 2024-07-26T14:29:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3378.060386 secs 2024-07-26T14:29:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3378.060386 secs 2024-07-26T14:29:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:32 smithi040 ceph-mon[32397]: pgmap v4381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:32 smithi146 ceph-mon[35807]: pgmap v4381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:32 smithi076 ceph-mon[35401]: pgmap v4381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:34 smithi040 ceph-mon[32397]: pgmap v4382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:34 smithi146 ceph-mon[35807]: pgmap v4382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:34 smithi076 ceph-mon[35401]: pgmap v4382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:36 smithi040 ceph-mon[32397]: pgmap v4383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3383.060536 secs 2024-07-26T14:29:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:36 smithi146 ceph-mon[35807]: pgmap v4383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3383.060536 secs 2024-07-26T14:29:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:36 smithi076 ceph-mon[35401]: pgmap v4383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3383.060536 secs 2024-07-26T14:29:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:38 smithi040 ceph-mon[32397]: pgmap v4384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:38 smithi146 ceph-mon[35807]: pgmap v4384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:38 smithi076 ceph-mon[35401]: pgmap v4384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:40 smithi040 ceph-mon[32397]: pgmap v4385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:40 smithi146 ceph-mon[35807]: pgmap v4385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:40 smithi076 ceph-mon[35401]: pgmap v4385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:29:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3388.060684 secs 2024-07-26T14:29:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3388.060684 secs 2024-07-26T14:29:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3388.060684 secs 2024-07-26T14:29:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:42 smithi040 ceph-mon[32397]: pgmap v4386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:42 smithi146 ceph-mon[35807]: pgmap v4386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:42 smithi076 ceph-mon[35401]: pgmap v4386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:44 smithi040 ceph-mon[32397]: pgmap v4387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:44 smithi146 ceph-mon[35807]: pgmap v4387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:44 smithi076 ceph-mon[35401]: pgmap v4387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:46 smithi040 ceph-mon[32397]: pgmap v4388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3393.060821 secs 2024-07-26T14:29:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:46 smithi146 ceph-mon[35807]: pgmap v4388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3393.060821 secs 2024-07-26T14:29:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:46 smithi076 ceph-mon[35401]: pgmap v4388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3393.060821 secs 2024-07-26T14:29:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:48 smithi040 ceph-mon[32397]: pgmap v4389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:48 smithi146 ceph-mon[35807]: pgmap v4389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:48 smithi076 ceph-mon[35401]: pgmap v4389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:50 smithi040 ceph-mon[32397]: pgmap v4390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:50 smithi146 ceph-mon[35807]: pgmap v4390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:50 smithi076 ceph-mon[35401]: pgmap v4390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3398.060970 secs 2024-07-26T14:29:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3398.060970 secs 2024-07-26T14:29:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3398.060970 secs 2024-07-26T14:29:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:52 smithi040 ceph-mon[32397]: pgmap v4391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:52 smithi146 ceph-mon[35807]: pgmap v4391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:52 smithi076 ceph-mon[35401]: pgmap v4391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:29:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:54 smithi146 ceph-mon[35807]: pgmap v4392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:54 smithi076 ceph-mon[35401]: pgmap v4392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:54 smithi040 ceph-mon[32397]: pgmap v4392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:56 smithi146 ceph-mon[35807]: pgmap v4393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3403.061113 secs 2024-07-26T14:29:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:56 smithi076 ceph-mon[35401]: pgmap v4393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3403.061113 secs 2024-07-26T14:29:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:56 smithi040 ceph-mon[32397]: pgmap v4393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:29:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3403.061113 secs 2024-07-26T14:29:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:58 smithi146 ceph-mon[35807]: pgmap v4394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:58 smithi076 ceph-mon[35401]: pgmap v4394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:58 smithi040 ceph-mon[32397]: pgmap v4394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:29:59 smithi146 ceph-mon[35807]: pgmap v4395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:29:59 smithi076 ceph-mon[35401]: pgmap v4395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:29:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:29:59 smithi040 ceph-mon[32397]: pgmap v4395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:30:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:30:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:30:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3408.061253 secs 2024-07-26T14:30:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:01 smithi076 ceph-mon[35401]: pgmap v4396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3408.061253 secs 2024-07-26T14:30:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:01 smithi040 ceph-mon[32397]: pgmap v4396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3408.061253 secs 2024-07-26T14:30:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:01 smithi146 ceph-mon[35807]: pgmap v4396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:03 smithi146 ceph-mon[35807]: pgmap v4397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:03 smithi076 ceph-mon[35401]: pgmap v4397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:03 smithi040 ceph-mon[32397]: pgmap v4397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:05 smithi146 ceph-mon[35807]: pgmap v4398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3413.061394 secs 2024-07-26T14:30:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:05 smithi076 ceph-mon[35401]: pgmap v4398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3413.061394 secs 2024-07-26T14:30:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:05 smithi040 ceph-mon[32397]: pgmap v4398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3413.061394 secs 2024-07-26T14:30:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:08 smithi040 ceph-mon[32397]: pgmap v4399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:08 smithi146 ceph-mon[35807]: pgmap v4399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:08 smithi076 ceph-mon[35401]: pgmap v4399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:10 smithi040 ceph-mon[32397]: pgmap v4400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:10 smithi146 ceph-mon[35807]: pgmap v4400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:10 smithi076 ceph-mon[35401]: pgmap v4400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3418.061532 secs 2024-07-26T14:30:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3418.061532 secs 2024-07-26T14:30:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3418.061532 secs 2024-07-26T14:30:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:12 smithi040 ceph-mon[32397]: pgmap v4401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:12 smithi146 ceph-mon[35807]: pgmap v4401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:12 smithi076 ceph-mon[35401]: pgmap v4401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:14 smithi146 ceph-mon[35807]: pgmap v4402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:14 smithi040 ceph-mon[32397]: pgmap v4402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:14.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:14 smithi076 ceph-mon[35401]: pgmap v4402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:16 smithi040 ceph-mon[32397]: pgmap v4403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3423.061671 secs 2024-07-26T14:30:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:16 smithi146 ceph-mon[35807]: pgmap v4403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3423.061671 secs 2024-07-26T14:30:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:16 smithi076 ceph-mon[35401]: pgmap v4403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3423.061671 secs 2024-07-26T14:30:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:18 smithi040 ceph-mon[32397]: pgmap v4404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:18 smithi146 ceph-mon[35807]: pgmap v4404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:18 smithi076 ceph-mon[35401]: pgmap v4404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:20 smithi040 ceph-mon[32397]: pgmap v4405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:20 smithi146 ceph-mon[35807]: pgmap v4405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:20 smithi076 ceph-mon[35401]: pgmap v4405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3428.061818 secs 2024-07-26T14:30:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3428.061818 secs 2024-07-26T14:30:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3428.061818 secs 2024-07-26T14:30:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:22 smithi040 ceph-mon[32397]: pgmap v4406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:22 smithi146 ceph-mon[35807]: pgmap v4406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:22 smithi076 ceph-mon[35401]: pgmap v4406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:24 smithi040 ceph-mon[32397]: pgmap v4407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:24 smithi146 ceph-mon[35807]: pgmap v4407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:24 smithi076 ceph-mon[35401]: pgmap v4407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:26 smithi040 ceph-mon[32397]: pgmap v4408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3433.061965 secs 2024-07-26T14:30:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:26 smithi146 ceph-mon[35807]: pgmap v4408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3433.061965 secs 2024-07-26T14:30:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:26 smithi076 ceph-mon[35401]: pgmap v4408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3433.061965 secs 2024-07-26T14:30:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:28 smithi040 ceph-mon[32397]: pgmap v4409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:28 smithi146 ceph-mon[35807]: pgmap v4409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:28 smithi076 ceph-mon[35401]: pgmap v4409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:30 smithi040 ceph-mon[32397]: pgmap v4410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:30 smithi146 ceph-mon[35807]: pgmap v4410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:30 smithi076 ceph-mon[35401]: pgmap v4410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3438.062111 secs 2024-07-26T14:30:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3438.062111 secs 2024-07-26T14:30:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3438.062111 secs 2024-07-26T14:30:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:32 smithi040 ceph-mon[32397]: pgmap v4411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:32 smithi146 ceph-mon[35807]: pgmap v4411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:32.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:32 smithi076 ceph-mon[35401]: pgmap v4411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:34 smithi040 ceph-mon[32397]: pgmap v4412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:34 smithi146 ceph-mon[35807]: pgmap v4412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:34 smithi076 ceph-mon[35401]: pgmap v4412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:36 smithi146 ceph-mon[35807]: pgmap v4413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3443.062305 secs 2024-07-26T14:30:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:36 smithi076 ceph-mon[35401]: pgmap v4413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3443.062305 secs 2024-07-26T14:30:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:36 smithi040 ceph-mon[32397]: pgmap v4413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3443.062305 secs 2024-07-26T14:30:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:38 smithi146 ceph-mon[35807]: pgmap v4414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:38 smithi076 ceph-mon[35401]: pgmap v4414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:38 smithi040 ceph-mon[32397]: pgmap v4414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:40 smithi146 ceph-mon[35807]: pgmap v4415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:40 smithi076 ceph-mon[35401]: pgmap v4415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:40 smithi040 ceph-mon[32397]: pgmap v4415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3448.062448 secs 2024-07-26T14:30:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3448.062448 secs 2024-07-26T14:30:41.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3448.062448 secs 2024-07-26T14:30:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:42 smithi146 ceph-mon[35807]: pgmap v4416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:42 smithi076 ceph-mon[35401]: pgmap v4416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:42 smithi040 ceph-mon[32397]: pgmap v4416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:43 smithi146 ceph-mon[35807]: pgmap v4417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:43 smithi076 ceph-mon[35401]: pgmap v4417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:43 smithi040 ceph-mon[32397]: pgmap v4417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:45 smithi146 ceph-mon[35807]: pgmap v4418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3453.062588 secs 2024-07-26T14:30:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:45 smithi076 ceph-mon[35401]: pgmap v4418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3453.062588 secs 2024-07-26T14:30:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:45 smithi040 ceph-mon[32397]: pgmap v4418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3453.062588 secs 2024-07-26T14:30:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:47 smithi146 ceph-mon[35807]: pgmap v4419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:47 smithi076 ceph-mon[35401]: pgmap v4419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:47 smithi040 ceph-mon[32397]: pgmap v4419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:49 smithi146 ceph-mon[35807]: pgmap v4420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:49 smithi076 ceph-mon[35401]: pgmap v4420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:49 smithi040 ceph-mon[32397]: pgmap v4420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:30:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3458.062747 secs 2024-07-26T14:30:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3458.062747 secs 2024-07-26T14:30:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3458.062747 secs 2024-07-26T14:30:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:51 smithi040 ceph-mon[32397]: pgmap v4421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:51 smithi146 ceph-mon[35807]: pgmap v4421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:51 smithi076 ceph-mon[35401]: pgmap v4421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:53 smithi040 ceph-mon[32397]: pgmap v4422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:53 smithi146 ceph-mon[35807]: pgmap v4422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:53 smithi076 ceph-mon[35401]: pgmap v4422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:55 smithi040 ceph-mon[32397]: pgmap v4423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3463.062907 secs 2024-07-26T14:30:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:55 smithi146 ceph-mon[35807]: pgmap v4423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3463.062907 secs 2024-07-26T14:30:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:55 smithi076 ceph-mon[35401]: pgmap v4423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:30:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3463.062907 secs 2024-07-26T14:30:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:57 smithi040 ceph-mon[32397]: pgmap v4424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:57 smithi146 ceph-mon[35807]: pgmap v4424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:30:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:57 smithi076 ceph-mon[35401]: pgmap v4424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:00.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:30:59 smithi146 ceph-mon[35807]: pgmap v4425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:00.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:30:59 smithi076 ceph-mon[35401]: pgmap v4425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:30:59 smithi040 ceph-mon[32397]: pgmap v4425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3468.063073 secs 2024-07-26T14:31:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3468.063073 secs 2024-07-26T14:31:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3468.063073 secs 2024-07-26T14:31:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:01 smithi040 ceph-mon[32397]: pgmap v4426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:01 smithi146 ceph-mon[35807]: pgmap v4426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:01 smithi076 ceph-mon[35401]: pgmap v4426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:03 smithi040 ceph-mon[32397]: pgmap v4427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:03 smithi146 ceph-mon[35807]: pgmap v4427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:03 smithi076 ceph-mon[35401]: pgmap v4427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:05 smithi040 ceph-mon[32397]: pgmap v4428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3473.063209 secs 2024-07-26T14:31:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:05 smithi146 ceph-mon[35807]: pgmap v4428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3473.063209 secs 2024-07-26T14:31:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:05 smithi076 ceph-mon[35401]: pgmap v4428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3473.063209 secs 2024-07-26T14:31:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:08 smithi040 ceph-mon[32397]: pgmap v4429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:08 smithi146 ceph-mon[35807]: pgmap v4429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:08 smithi076 ceph-mon[35401]: pgmap v4429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:10 smithi040 ceph-mon[32397]: pgmap v4430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:10 smithi146 ceph-mon[35807]: pgmap v4430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:10 smithi076 ceph-mon[35401]: pgmap v4430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3478.063352 secs 2024-07-26T14:31:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3478.063352 secs 2024-07-26T14:31:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3478.063352 secs 2024-07-26T14:31:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:12 smithi040 ceph-mon[32397]: pgmap v4431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:12 smithi146 ceph-mon[35807]: pgmap v4431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:12 smithi076 ceph-mon[35401]: pgmap v4431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:14 smithi040 ceph-mon[32397]: pgmap v4432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:14 smithi146 ceph-mon[35807]: pgmap v4432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:14.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:14 smithi076 ceph-mon[35401]: pgmap v4432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:16 smithi040 ceph-mon[32397]: pgmap v4433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3483.063524 secs 2024-07-26T14:31:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:16 smithi146 ceph-mon[35807]: pgmap v4433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3483.063524 secs 2024-07-26T14:31:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:16 smithi076 ceph-mon[35401]: pgmap v4433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3483.063524 secs 2024-07-26T14:31:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:18 smithi040 ceph-mon[32397]: pgmap v4434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:18 smithi146 ceph-mon[35807]: pgmap v4434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:18 smithi076 ceph-mon[35401]: pgmap v4434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:20 smithi040 ceph-mon[32397]: pgmap v4435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:20 smithi146 ceph-mon[35807]: pgmap v4435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:20 smithi076 ceph-mon[35401]: pgmap v4435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3488.063662 secs 2024-07-26T14:31:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3488.063662 secs 2024-07-26T14:31:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3488.063662 secs 2024-07-26T14:31:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:22 smithi040 ceph-mon[32397]: pgmap v4436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:22 smithi146 ceph-mon[35807]: pgmap v4436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:22 smithi076 ceph-mon[35401]: pgmap v4436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:24 smithi040 ceph-mon[32397]: pgmap v4437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:24 smithi146 ceph-mon[35807]: pgmap v4437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:24 smithi076 ceph-mon[35401]: pgmap v4437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:26 smithi040 ceph-mon[32397]: pgmap v4438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3493.063802 secs 2024-07-26T14:31:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:26 smithi146 ceph-mon[35807]: pgmap v4438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3493.063802 secs 2024-07-26T14:31:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:26 smithi076 ceph-mon[35401]: pgmap v4438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3493.063802 secs 2024-07-26T14:31:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:28 smithi040 ceph-mon[32397]: pgmap v4439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:28 smithi146 ceph-mon[35807]: pgmap v4439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:28 smithi076 ceph-mon[35401]: pgmap v4439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:30 smithi146 ceph-mon[35807]: pgmap v4440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:30 smithi076 ceph-mon[35401]: pgmap v4440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:30 smithi040 ceph-mon[32397]: pgmap v4440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3498.063946 secs 2024-07-26T14:31:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3498.063946 secs 2024-07-26T14:31:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3498.063946 secs 2024-07-26T14:31:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:32 smithi146 ceph-mon[35807]: pgmap v4441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:32 smithi076 ceph-mon[35401]: pgmap v4441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:32 smithi040 ceph-mon[32397]: pgmap v4441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:34 smithi146 ceph-mon[35807]: pgmap v4442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:34 smithi076 ceph-mon[35401]: pgmap v4442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:34 smithi040 ceph-mon[32397]: pgmap v4442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:36 smithi146 ceph-mon[35807]: pgmap v4443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3503.064086 secs 2024-07-26T14:31:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:36 smithi076 ceph-mon[35401]: pgmap v4443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3503.064086 secs 2024-07-26T14:31:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:36 smithi040 ceph-mon[32397]: pgmap v4443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3503.064086 secs 2024-07-26T14:31:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:37 smithi076 ceph-mon[35401]: pgmap v4444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:37 smithi040 ceph-mon[32397]: pgmap v4444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:37 smithi146 ceph-mon[35807]: pgmap v4444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:39 smithi040 ceph-mon[32397]: pgmap v4445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:39 smithi146 ceph-mon[35807]: pgmap v4445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:39 smithi076 ceph-mon[35401]: pgmap v4445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:41.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3508.064230 secs 2024-07-26T14:31:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3508.064230 secs 2024-07-26T14:31:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3508.064230 secs 2024-07-26T14:31:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:41 smithi040 ceph-mon[32397]: pgmap v4446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:41 smithi146 ceph-mon[35807]: pgmap v4446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:41 smithi076 ceph-mon[35401]: pgmap v4446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:44.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:43 smithi040 ceph-mon[32397]: pgmap v4447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:43 smithi146 ceph-mon[35807]: pgmap v4447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:43 smithi076 ceph-mon[35401]: pgmap v4447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:45 smithi040 ceph-mon[32397]: pgmap v4448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3513.064373 secs 2024-07-26T14:31:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:45 smithi146 ceph-mon[35807]: pgmap v4448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3513.064373 secs 2024-07-26T14:31:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:45 smithi076 ceph-mon[35401]: pgmap v4448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3513.064373 secs 2024-07-26T14:31:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:47 smithi040 ceph-mon[32397]: pgmap v4449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:47 smithi146 ceph-mon[35807]: pgmap v4449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:47 smithi076 ceph-mon[35401]: pgmap v4449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:49 smithi040 ceph-mon[32397]: pgmap v4450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:49 smithi146 ceph-mon[35807]: pgmap v4450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:49 smithi076 ceph-mon[35401]: pgmap v4450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:31:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3518.064540 secs 2024-07-26T14:31:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3518.064540 secs 2024-07-26T14:31:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3518.064540 secs 2024-07-26T14:31:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:51 smithi040 ceph-mon[32397]: pgmap v4451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:51 smithi146 ceph-mon[35807]: pgmap v4451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:51 smithi076 ceph-mon[35401]: pgmap v4451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:53 smithi040 ceph-mon[32397]: pgmap v4452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:53 smithi146 ceph-mon[35807]: pgmap v4452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:53 smithi076 ceph-mon[35401]: pgmap v4452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:55 smithi040 ceph-mon[32397]: pgmap v4453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3523.064679 secs 2024-07-26T14:31:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:55 smithi146 ceph-mon[35807]: pgmap v4453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3523.064679 secs 2024-07-26T14:31:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:55 smithi076 ceph-mon[35401]: pgmap v4453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:31:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3523.064679 secs 2024-07-26T14:31:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:57 smithi040 ceph-mon[32397]: pgmap v4454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:57 smithi146 ceph-mon[35807]: pgmap v4454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:31:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:57 smithi076 ceph-mon[35401]: pgmap v4454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:31:59 smithi040 ceph-mon[32397]: pgmap v4455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:31:59 smithi146 ceph-mon[35807]: pgmap v4455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:31:59 smithi076 ceph-mon[35401]: pgmap v4455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3528.064837 secs 2024-07-26T14:32:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3528.064837 secs 2024-07-26T14:32:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3528.064837 secs 2024-07-26T14:32:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:02 smithi040 ceph-mon[32397]: pgmap v4456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:02 smithi146 ceph-mon[35807]: pgmap v4456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:02 smithi076 ceph-mon[35401]: pgmap v4456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:04 smithi040 ceph-mon[32397]: pgmap v4457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:04 smithi146 ceph-mon[35807]: pgmap v4457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:04 smithi076 ceph-mon[35401]: pgmap v4457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:06 smithi040 ceph-mon[32397]: pgmap v4458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3533.064973 secs 2024-07-26T14:32:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:06 smithi146 ceph-mon[35807]: pgmap v4458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3533.064973 secs 2024-07-26T14:32:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:06 smithi076 ceph-mon[35401]: pgmap v4458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3533.064973 secs 2024-07-26T14:32:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:08 smithi040 ceph-mon[32397]: pgmap v4459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:08 smithi146 ceph-mon[35807]: pgmap v4459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:08 smithi076 ceph-mon[35401]: pgmap v4459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:10 smithi040 ceph-mon[32397]: pgmap v4460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:10 smithi146 ceph-mon[35807]: pgmap v4460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:10 smithi076 ceph-mon[35401]: pgmap v4460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3538.065115 secs 2024-07-26T14:32:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3538.065115 secs 2024-07-26T14:32:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3538.065115 secs 2024-07-26T14:32:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:12 smithi040 ceph-mon[32397]: pgmap v4461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:12 smithi146 ceph-mon[35807]: pgmap v4461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:12 smithi076 ceph-mon[35401]: pgmap v4461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:14 smithi040 ceph-mon[32397]: pgmap v4462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:14 smithi146 ceph-mon[35807]: pgmap v4462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:14.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:14 smithi076 ceph-mon[35401]: pgmap v4462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:16 smithi040 ceph-mon[32397]: pgmap v4463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3543.065256 secs 2024-07-26T14:32:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:16 smithi146 ceph-mon[35807]: pgmap v4463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3543.065256 secs 2024-07-26T14:32:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:16 smithi076 ceph-mon[35401]: pgmap v4463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3543.065256 secs 2024-07-26T14:32:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:18 smithi040 ceph-mon[32397]: pgmap v4464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:18 smithi146 ceph-mon[35807]: pgmap v4464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:18 smithi076 ceph-mon[35401]: pgmap v4464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:20 smithi146 ceph-mon[35807]: pgmap v4465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:20 smithi076 ceph-mon[35401]: pgmap v4465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:20 smithi040 ceph-mon[32397]: pgmap v4465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3548.065403 secs 2024-07-26T14:32:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3548.065403 secs 2024-07-26T14:32:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3548.065403 secs 2024-07-26T14:32:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:22 smithi146 ceph-mon[35807]: pgmap v4466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:22 smithi076 ceph-mon[35401]: pgmap v4466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:22 smithi040 ceph-mon[32397]: pgmap v4466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:24 smithi146 ceph-mon[35807]: pgmap v4467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:24 smithi076 ceph-mon[35401]: pgmap v4467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:24 smithi040 ceph-mon[32397]: pgmap v4467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:26 smithi146 ceph-mon[35807]: pgmap v4468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3553.065542 secs 2024-07-26T14:32:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:26 smithi076 ceph-mon[35401]: pgmap v4468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3553.065542 secs 2024-07-26T14:32:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:26 smithi040 ceph-mon[32397]: pgmap v4468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3553.065542 secs 2024-07-26T14:32:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:28 smithi146 ceph-mon[35807]: pgmap v4469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:28 smithi076 ceph-mon[35401]: pgmap v4469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:28 smithi040 ceph-mon[32397]: pgmap v4469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:30 smithi146 ceph-mon[35807]: pgmap v4470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:30 smithi076 ceph-mon[35401]: pgmap v4470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:30 smithi040 ceph-mon[32397]: pgmap v4470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3558.065686 secs 2024-07-26T14:32:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3558.065686 secs 2024-07-26T14:32:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3558.065686 secs 2024-07-26T14:32:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:32 smithi146 ceph-mon[35807]: pgmap v4471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:32 smithi076 ceph-mon[35401]: pgmap v4471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:32 smithi040 ceph-mon[32397]: pgmap v4471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:33 smithi146 ceph-mon[35807]: pgmap v4472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:33 smithi076 ceph-mon[35401]: pgmap v4472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:33 smithi040 ceph-mon[32397]: pgmap v4472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:35 smithi040 ceph-mon[32397]: pgmap v4473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3563.065843 secs 2024-07-26T14:32:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:35 smithi146 ceph-mon[35807]: pgmap v4473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3563.065843 secs 2024-07-26T14:32:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:35 smithi076 ceph-mon[35401]: pgmap v4473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3563.065843 secs 2024-07-26T14:32:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:37 smithi040 ceph-mon[32397]: pgmap v4474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:37 smithi146 ceph-mon[35807]: pgmap v4474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:37 smithi076 ceph-mon[35401]: pgmap v4474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:39 smithi040 ceph-mon[32397]: pgmap v4475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:39 smithi146 ceph-mon[35807]: pgmap v4475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:39 smithi076 ceph-mon[35401]: pgmap v4475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3568.065989 secs 2024-07-26T14:32:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3568.065989 secs 2024-07-26T14:32:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3568.065989 secs 2024-07-26T14:32:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:41 smithi040 ceph-mon[32397]: pgmap v4476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:41 smithi146 ceph-mon[35807]: pgmap v4476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:41 smithi076 ceph-mon[35401]: pgmap v4476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:43 smithi040 ceph-mon[32397]: pgmap v4477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:43 smithi146 ceph-mon[35807]: pgmap v4477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:43 smithi076 ceph-mon[35401]: pgmap v4477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:45 smithi040 ceph-mon[32397]: pgmap v4478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3573.066122 secs 2024-07-26T14:32:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:45 smithi146 ceph-mon[35807]: pgmap v4478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3573.066122 secs 2024-07-26T14:32:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:45 smithi076 ceph-mon[35401]: pgmap v4478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3573.066122 secs 2024-07-26T14:32:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:47 smithi040 ceph-mon[32397]: pgmap v4479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:47 smithi146 ceph-mon[35807]: pgmap v4479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:47 smithi076 ceph-mon[35401]: pgmap v4479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:49 smithi040 ceph-mon[32397]: pgmap v4480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:49 smithi146 ceph-mon[35807]: pgmap v4480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:49 smithi076 ceph-mon[35401]: pgmap v4480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:32:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3578.066250 secs 2024-07-26T14:32:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3578.066250 secs 2024-07-26T14:32:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3578.066250 secs 2024-07-26T14:32:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:51 smithi040 ceph-mon[32397]: pgmap v4481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:51 smithi146 ceph-mon[35807]: pgmap v4481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:51 smithi076 ceph-mon[35401]: pgmap v4481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:53 smithi040 ceph-mon[32397]: pgmap v4482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:53 smithi146 ceph-mon[35807]: pgmap v4482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:53 smithi076 ceph-mon[35401]: pgmap v4482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:55 smithi040 ceph-mon[32397]: pgmap v4483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3583.066397 secs 2024-07-26T14:32:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:55 smithi146 ceph-mon[35807]: pgmap v4483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3583.066397 secs 2024-07-26T14:32:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:55 smithi076 ceph-mon[35401]: pgmap v4483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:32:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3583.066397 secs 2024-07-26T14:32:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:57 smithi040 ceph-mon[32397]: pgmap v4484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:57 smithi146 ceph-mon[35807]: pgmap v4484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:32:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:57 smithi076 ceph-mon[35401]: pgmap v4484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:32:59 smithi040 ceph-mon[32397]: pgmap v4485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:32:59 smithi146 ceph-mon[35807]: pgmap v4485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:32:59 smithi076 ceph-mon[35401]: pgmap v4485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3588.066543 secs 2024-07-26T14:33:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3588.066543 secs 2024-07-26T14:33:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3588.066543 secs 2024-07-26T14:33:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:01 smithi146 ceph-mon[35807]: pgmap v4486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:01 smithi076 ceph-mon[35401]: pgmap v4486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:01 smithi040 ceph-mon[32397]: pgmap v4486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:04 smithi146 ceph-mon[35807]: pgmap v4487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:04 smithi076 ceph-mon[35401]: pgmap v4487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:04 smithi040 ceph-mon[32397]: pgmap v4487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:06 smithi146 ceph-mon[35807]: pgmap v4488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3593.066685 secs 2024-07-26T14:33:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:06 smithi076 ceph-mon[35401]: pgmap v4488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3593.066685 secs 2024-07-26T14:33:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:06 smithi040 ceph-mon[32397]: pgmap v4488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3593.066685 secs 2024-07-26T14:33:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:08 smithi146 ceph-mon[35807]: pgmap v4489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:08 smithi076 ceph-mon[35401]: pgmap v4489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:08 smithi040 ceph-mon[32397]: pgmap v4489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:10 smithi146 ceph-mon[35807]: pgmap v4490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:10 smithi076 ceph-mon[35401]: pgmap v4490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:10 smithi040 ceph-mon[32397]: pgmap v4490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3598.066851 secs 2024-07-26T14:33:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3598.066851 secs 2024-07-26T14:33:11.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3598.066851 secs 2024-07-26T14:33:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:12 smithi146 ceph-mon[35807]: pgmap v4491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:12 smithi076 ceph-mon[35401]: pgmap v4491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:12 smithi040 ceph-mon[32397]: pgmap v4491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:14 smithi146 ceph-mon[35807]: pgmap v4492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:14 smithi076 ceph-mon[35401]: pgmap v4492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:14 smithi040 ceph-mon[32397]: pgmap v4492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:16 smithi146 ceph-mon[35807]: pgmap v4493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3603.066996 secs 2024-07-26T14:33:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:16 smithi076 ceph-mon[35401]: pgmap v4493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3603.066996 secs 2024-07-26T14:33:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:16 smithi040 ceph-mon[32397]: pgmap v4493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3603.066996 secs 2024-07-26T14:33:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:18 smithi146 ceph-mon[35807]: pgmap v4494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:18 smithi076 ceph-mon[35401]: pgmap v4494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:18 smithi040 ceph-mon[32397]: pgmap v4494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:20 smithi146 ceph-mon[35807]: pgmap v4495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:20 smithi076 ceph-mon[35401]: pgmap v4495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:20 smithi040 ceph-mon[32397]: pgmap v4495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3608.067154 secs 2024-07-26T14:33:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3608.067154 secs 2024-07-26T14:33:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3608.067154 secs 2024-07-26T14:33:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:22 smithi040 ceph-mon[32397]: pgmap v4496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:22 smithi146 ceph-mon[35807]: pgmap v4496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:22 smithi076 ceph-mon[35401]: pgmap v4496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:24 smithi040 ceph-mon[32397]: pgmap v4497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:24 smithi146 ceph-mon[35807]: pgmap v4497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:24 smithi076 ceph-mon[35401]: pgmap v4497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:26 smithi040 ceph-mon[32397]: pgmap v4498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3613.067321 secs 2024-07-26T14:33:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:26 smithi146 ceph-mon[35807]: pgmap v4498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3613.067321 secs 2024-07-26T14:33:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:26 smithi076 ceph-mon[35401]: pgmap v4498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3613.067321 secs 2024-07-26T14:33:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:28 smithi040 ceph-mon[32397]: pgmap v4499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:28 smithi146 ceph-mon[35807]: pgmap v4499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:28 smithi076 ceph-mon[35401]: pgmap v4499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:30.373 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:30 smithi146 ceph-mon[35807]: pgmap v4500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:30.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:30 smithi076 ceph-mon[35401]: pgmap v4500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:30 smithi040 ceph-mon[32397]: pgmap v4500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3618.067456 secs 2024-07-26T14:33:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3618.067456 secs 2024-07-26T14:33:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3618.067456 secs 2024-07-26T14:33:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:32 smithi040 ceph-mon[32397]: pgmap v4501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:32 smithi146 ceph-mon[35807]: pgmap v4501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:32 smithi076 ceph-mon[35401]: pgmap v4501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:34 smithi040 ceph-mon[32397]: pgmap v4502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:34 smithi146 ceph-mon[35807]: pgmap v4502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:34 smithi076 ceph-mon[35401]: pgmap v4502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:36 smithi040 ceph-mon[32397]: pgmap v4503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3623.067620 secs 2024-07-26T14:33:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:36 smithi146 ceph-mon[35807]: pgmap v4503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3623.067620 secs 2024-07-26T14:33:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:36 smithi076 ceph-mon[35401]: pgmap v4503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3623.067620 secs 2024-07-26T14:33:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:38 smithi040 ceph-mon[32397]: pgmap v4504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:38 smithi146 ceph-mon[35807]: pgmap v4504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:38 smithi076 ceph-mon[35401]: pgmap v4504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:40 smithi040 ceph-mon[32397]: pgmap v4505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:40 smithi146 ceph-mon[35807]: pgmap v4505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:40 smithi076 ceph-mon[35401]: pgmap v4505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3628.067719 secs 2024-07-26T14:33:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3628.067719 secs 2024-07-26T14:33:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3628.067719 secs 2024-07-26T14:33:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:42 smithi040 ceph-mon[32397]: pgmap v4506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:42 smithi146 ceph-mon[35807]: pgmap v4506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:42 smithi076 ceph-mon[35401]: pgmap v4506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:44 smithi040 ceph-mon[32397]: pgmap v4507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:44 smithi146 ceph-mon[35807]: pgmap v4507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:44 smithi076 ceph-mon[35401]: pgmap v4507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:46 smithi040 ceph-mon[32397]: pgmap v4508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3633.067874 secs 2024-07-26T14:33:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:46 smithi146 ceph-mon[35807]: pgmap v4508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3633.067874 secs 2024-07-26T14:33:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:46 smithi076 ceph-mon[35401]: pgmap v4508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3633.067874 secs 2024-07-26T14:33:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:48 smithi040 ceph-mon[32397]: pgmap v4509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:48 smithi146 ceph-mon[35807]: pgmap v4509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:48 smithi076 ceph-mon[35401]: pgmap v4509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:50 smithi040 ceph-mon[32397]: pgmap v4510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:50 smithi146 ceph-mon[35807]: pgmap v4510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:50 smithi076 ceph-mon[35401]: pgmap v4510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:33:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3638.068017 secs 2024-07-26T14:33:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3638.068017 secs 2024-07-26T14:33:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3638.068017 secs 2024-07-26T14:33:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:52 smithi040 ceph-mon[32397]: pgmap v4511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:52 smithi146 ceph-mon[35807]: pgmap v4511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:52 smithi076 ceph-mon[35401]: pgmap v4511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:54 smithi040 ceph-mon[32397]: pgmap v4512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:54 smithi146 ceph-mon[35807]: pgmap v4512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:54 smithi076 ceph-mon[35401]: pgmap v4512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:56 smithi146 ceph-mon[35807]: pgmap v4513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3643.068187 secs 2024-07-26T14:33:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:56 smithi076 ceph-mon[35401]: pgmap v4513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3643.068187 secs 2024-07-26T14:33:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:56 smithi040 ceph-mon[32397]: pgmap v4513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:33:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3643.068187 secs 2024-07-26T14:33:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:33:58 smithi146 ceph-mon[35807]: pgmap v4514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:33:58 smithi076 ceph-mon[35401]: pgmap v4514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:33:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:33:58 smithi040 ceph-mon[32397]: pgmap v4514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:00 smithi146 ceph-mon[35807]: pgmap v4515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:00 smithi076 ceph-mon[35401]: pgmap v4515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:00 smithi040 ceph-mon[32397]: pgmap v4515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3648.068334 secs 2024-07-26T14:34:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3648.068334 secs 2024-07-26T14:34:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3648.068334 secs 2024-07-26T14:34:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:02 smithi146 ceph-mon[35807]: pgmap v4516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:02 smithi076 ceph-mon[35401]: pgmap v4516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:02 smithi040 ceph-mon[32397]: pgmap v4516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:04 smithi146 ceph-mon[35807]: pgmap v4517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:04 smithi076 ceph-mon[35401]: pgmap v4517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:04 smithi040 ceph-mon[32397]: pgmap v4517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: pgmap v4518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3653.068484 secs 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:34:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:06 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: pgmap v4518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3653.068484 secs 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:34:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:06 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:34:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: pgmap v4518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3653.068484 secs 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:34:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:06 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:34:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:07 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:34:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:07 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:34:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:07 smithi146 ceph-mon[35807]: pgmap v4519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 908 B/s rd, 1 op/s 2024-07-26T14:34:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:07 smithi146 ceph-mon[35807]: pgmap v4520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:34:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:07 smithi146 ceph-mon[35807]: pgmap v4521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T14:34:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:07 smithi146 ceph-mon[35807]: pgmap v4522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:07 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:34:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:07 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:34:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:07 smithi076 ceph-mon[35401]: pgmap v4519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 908 B/s rd, 1 op/s 2024-07-26T14:34:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:07 smithi076 ceph-mon[35401]: pgmap v4520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:34:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:07 smithi076 ceph-mon[35401]: pgmap v4521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T14:34:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:07 smithi076 ceph-mon[35401]: pgmap v4522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:07 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:34:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:07 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:34:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:07 smithi040 ceph-mon[32397]: pgmap v4519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 908 B/s rd, 1 op/s 2024-07-26T14:34:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:07 smithi040 ceph-mon[32397]: pgmap v4520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:34:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:07 smithi040 ceph-mon[32397]: pgmap v4521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T14:34:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:07 smithi040 ceph-mon[32397]: pgmap v4522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:09 smithi146 ceph-mon[35807]: pgmap v4523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:09 smithi076 ceph-mon[35401]: pgmap v4523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:09 smithi040 ceph-mon[32397]: pgmap v4523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:10 smithi040 ceph-mon[32397]: pgmap v4524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:10 smithi146 ceph-mon[35807]: pgmap v4524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:10 smithi076 ceph-mon[35401]: pgmap v4524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 972 B/s rd, 1 op/s 2024-07-26T14:34:11.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3658.068628 secs 2024-07-26T14:34:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3658.068628 secs 2024-07-26T14:34:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3658.068628 secs 2024-07-26T14:34:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:12 smithi040 ceph-mon[32397]: pgmap v4525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:12 smithi146 ceph-mon[35807]: pgmap v4525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:12 smithi076 ceph-mon[35401]: pgmap v4525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:15 smithi040 ceph-mon[32397]: pgmap v4526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T14:34:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:15 smithi146 ceph-mon[35807]: pgmap v4526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T14:34:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:15 smithi076 ceph-mon[35401]: pgmap v4526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T14:34:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3663.068728 secs 2024-07-26T14:34:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3663.068728 secs 2024-07-26T14:34:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3663.068728 secs 2024-07-26T14:34:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:17 smithi040 ceph-mon[32397]: pgmap v4527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:34:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:17 smithi146 ceph-mon[35807]: pgmap v4527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:34:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:17 smithi076 ceph-mon[35401]: pgmap v4527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:34:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:19 smithi040 ceph-mon[32397]: pgmap v4528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:19 smithi146 ceph-mon[35807]: pgmap v4528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:19 smithi076 ceph-mon[35401]: pgmap v4528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:21 smithi146 ceph-mon[35807]: pgmap v4529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3668.068840 secs 2024-07-26T14:34:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:21 smithi076 ceph-mon[35401]: pgmap v4529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3668.068840 secs 2024-07-26T14:34:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:21 smithi040 ceph-mon[32397]: pgmap v4529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3668.068840 secs 2024-07-26T14:34:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:23 smithi146 ceph-mon[35807]: pgmap v4530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:23 smithi076 ceph-mon[35401]: pgmap v4530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:23 smithi040 ceph-mon[32397]: pgmap v4530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:25 smithi146 ceph-mon[35807]: pgmap v4531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:25 smithi076 ceph-mon[35401]: pgmap v4531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:25 smithi040 ceph-mon[32397]: pgmap v4531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3673.068982 secs 2024-07-26T14:34:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3673.068982 secs 2024-07-26T14:34:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3673.068982 secs 2024-07-26T14:34:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:27 smithi146 ceph-mon[35807]: pgmap v4532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:34:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:27 smithi076 ceph-mon[35401]: pgmap v4532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:34:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:27 smithi040 ceph-mon[32397]: pgmap v4532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:34:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:29 smithi146 ceph-mon[35807]: pgmap v4533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:29 smithi076 ceph-mon[35401]: pgmap v4533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:29 smithi040 ceph-mon[32397]: pgmap v4533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:31 smithi146 ceph-mon[35807]: pgmap v4534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3678.069141 secs 2024-07-26T14:34:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:31 smithi076 ceph-mon[35401]: pgmap v4534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3678.069141 secs 2024-07-26T14:34:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:31 smithi040 ceph-mon[32397]: pgmap v4534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3678.069141 secs 2024-07-26T14:34:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:33 smithi146 ceph-mon[35807]: pgmap v4535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:33 smithi076 ceph-mon[35401]: pgmap v4535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:33 smithi040 ceph-mon[32397]: pgmap v4535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:35 smithi146 ceph-mon[35807]: pgmap v4536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:35 smithi076 ceph-mon[35401]: pgmap v4536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:35 smithi040 ceph-mon[32397]: pgmap v4536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:34:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3683.069307 secs 2024-07-26T14:34:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3683.069307 secs 2024-07-26T14:34:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3683.069307 secs 2024-07-26T14:34:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:37 smithi146 ceph-mon[35807]: pgmap v4537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:34:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:37 smithi076 ceph-mon[35401]: pgmap v4537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:34:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:37 smithi040 ceph-mon[32397]: pgmap v4537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:34:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:38 smithi040 ceph-mon[32397]: pgmap v4538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:38 smithi146 ceph-mon[35807]: pgmap v4538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:38 smithi076 ceph-mon[35401]: pgmap v4538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:41 smithi040 ceph-mon[32397]: pgmap v4539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3688.069444 secs 2024-07-26T14:34:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:41 smithi146 ceph-mon[35807]: pgmap v4539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3688.069444 secs 2024-07-26T14:34:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:41 smithi076 ceph-mon[35401]: pgmap v4539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3688.069444 secs 2024-07-26T14:34:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:43 smithi040 ceph-mon[32397]: pgmap v4540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:43 smithi146 ceph-mon[35807]: pgmap v4540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:43 smithi076 ceph-mon[35401]: pgmap v4540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:45 smithi146 ceph-mon[35807]: pgmap v4541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:45 smithi076 ceph-mon[35401]: pgmap v4541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:45 smithi040 ceph-mon[32397]: pgmap v4541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3693.069583 secs 2024-07-26T14:34:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3693.069583 secs 2024-07-26T14:34:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3693.069583 secs 2024-07-26T14:34:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:47 smithi146 ceph-mon[35807]: pgmap v4542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:47 smithi076 ceph-mon[35401]: pgmap v4542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:47 smithi040 ceph-mon[32397]: pgmap v4542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:49 smithi146 ceph-mon[35807]: pgmap v4543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:49 smithi076 ceph-mon[35401]: pgmap v4543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:49 smithi040 ceph-mon[32397]: pgmap v4543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:51 smithi146 ceph-mon[35807]: pgmap v4544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3698.069726 secs 2024-07-26T14:34:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:51 smithi076 ceph-mon[35401]: pgmap v4544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3698.069726 secs 2024-07-26T14:34:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:51 smithi040 ceph-mon[32397]: pgmap v4544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3698.069726 secs 2024-07-26T14:34:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:53 smithi146 ceph-mon[35807]: pgmap v4545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:53 smithi076 ceph-mon[35401]: pgmap v4545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:53 smithi040 ceph-mon[32397]: pgmap v4545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:55 smithi146 ceph-mon[35807]: pgmap v4546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:55 smithi076 ceph-mon[35401]: pgmap v4546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:55 smithi040 ceph-mon[32397]: pgmap v4546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:34:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3703.069871 secs 2024-07-26T14:34:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3703.069871 secs 2024-07-26T14:34:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3703.069871 secs 2024-07-26T14:34:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:57 smithi146 ceph-mon[35807]: pgmap v4547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:57 smithi076 ceph-mon[35401]: pgmap v4547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:57 smithi040 ceph-mon[32397]: pgmap v4547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:34:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:34:59 smithi146 ceph-mon[35807]: pgmap v4548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:34:59 smithi076 ceph-mon[35401]: pgmap v4548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:34:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:34:59 smithi040 ceph-mon[32397]: pgmap v4548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:01 smithi146 ceph-mon[35807]: pgmap v4549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3708.070018 secs 2024-07-26T14:35:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:01 smithi076 ceph-mon[35401]: pgmap v4549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3708.070018 secs 2024-07-26T14:35:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:01 smithi040 ceph-mon[32397]: pgmap v4549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3708.070018 secs 2024-07-26T14:35:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:03 smithi146 ceph-mon[35807]: pgmap v4550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:03 smithi076 ceph-mon[35401]: pgmap v4550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:03 smithi040 ceph-mon[32397]: pgmap v4550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:04 smithi040 ceph-mon[32397]: pgmap v4551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:04 smithi146 ceph-mon[35807]: pgmap v4551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:04 smithi076 ceph-mon[35401]: pgmap v4551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3713.070177 secs 2024-07-26T14:35:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3713.070177 secs 2024-07-26T14:35:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3713.070177 secs 2024-07-26T14:35:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: pgmap v4552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:35:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:07 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: pgmap v4552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:07 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: pgmap v4552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:07 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:09 smithi146 ceph-mon[35807]: pgmap v4553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:09 smithi076 ceph-mon[35401]: pgmap v4553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:09 smithi040 ceph-mon[32397]: pgmap v4553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:11.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: pgmap v4554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:11.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3718.070294 secs 2024-07-26T14:35:11.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: pgmap v4554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3718.070294 secs 2024-07-26T14:35:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: pgmap v4554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3718.070294 secs 2024-07-26T14:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:13 smithi040 ceph-mon[32397]: pgmap v4555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:13.516 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:13 smithi076 ceph-mon[35401]: pgmap v4555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:13.533 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:13 smithi146 ceph-mon[35807]: pgmap v4555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:15 smithi146 ceph-mon[35807]: pgmap v4556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:15 smithi076 ceph-mon[35401]: pgmap v4556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:15.598 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:15 smithi040 ceph-mon[32397]: pgmap v4556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:16.487 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3723.070373 secs 2024-07-26T14:35:16.522 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3723.070373 secs 2024-07-26T14:35:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3723.070373 secs 2024-07-26T14:35:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: pgmap v4557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: pgmap v4557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:35:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: pgmap v4557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:35:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:18 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:35:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:18 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:35:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:18 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:35:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:18 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:35:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:18 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:35:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:18 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:35:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:18 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:35:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:18 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:35:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:18 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:35:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:18 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:35:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:18 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:35:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:18 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:35:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:19 smithi146 ceph-mon[35807]: pgmap v4558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:19 smithi076 ceph-mon[35401]: pgmap v4558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:19 smithi040 ceph-mon[32397]: pgmap v4558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:21 smithi146 ceph-mon[35807]: pgmap v4559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3728.070520 secs 2024-07-26T14:35:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:21 smithi076 ceph-mon[35401]: pgmap v4559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3728.070520 secs 2024-07-26T14:35:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:21 smithi040 ceph-mon[32397]: pgmap v4559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3728.070520 secs 2024-07-26T14:35:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:23 smithi146 ceph-mon[35807]: pgmap v4560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:23 smithi076 ceph-mon[35401]: pgmap v4560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:23 smithi040 ceph-mon[32397]: pgmap v4560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:24 smithi040 ceph-mon[32397]: pgmap v4561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:24 smithi146 ceph-mon[35807]: pgmap v4561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:24 smithi076 ceph-mon[35401]: pgmap v4561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3733.070678 secs 2024-07-26T14:35:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3733.070678 secs 2024-07-26T14:35:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3733.070678 secs 2024-07-26T14:35:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:26 smithi146 ceph-mon[35807]: pgmap v4562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:26 smithi040 ceph-mon[32397]: pgmap v4562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:26 smithi076 ceph-mon[35401]: pgmap v4562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:29 smithi146 ceph-mon[35807]: pgmap v4563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:29 smithi076 ceph-mon[35401]: pgmap v4563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:29 smithi040 ceph-mon[32397]: pgmap v4563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:31 smithi146 ceph-mon[35807]: pgmap v4564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3738.070768 secs 2024-07-26T14:35:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:31 smithi076 ceph-mon[35401]: pgmap v4564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3738.070768 secs 2024-07-26T14:35:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:31 smithi040 ceph-mon[32397]: pgmap v4564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3738.070768 secs 2024-07-26T14:35:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:33 smithi146 ceph-mon[35807]: pgmap v4565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:33 smithi076 ceph-mon[35401]: pgmap v4565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:33 smithi040 ceph-mon[32397]: pgmap v4565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:35 smithi146 ceph-mon[35807]: pgmap v4566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:35 smithi076 ceph-mon[35401]: pgmap v4566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:35 smithi040 ceph-mon[32397]: pgmap v4566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3743.070909 secs 2024-07-26T14:35:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3743.070909 secs 2024-07-26T14:35:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3743.070909 secs 2024-07-26T14:35:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:37 smithi146 ceph-mon[35807]: pgmap v4567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:37 smithi076 ceph-mon[35401]: pgmap v4567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:37 smithi040 ceph-mon[32397]: pgmap v4567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:39 smithi146 ceph-mon[35807]: pgmap v4568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:39 smithi076 ceph-mon[35401]: pgmap v4568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:39 smithi040 ceph-mon[32397]: pgmap v4568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:41 smithi146 ceph-mon[35807]: pgmap v4569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3748.071051 secs 2024-07-26T14:35:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:41 smithi076 ceph-mon[35401]: pgmap v4569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3748.071051 secs 2024-07-26T14:35:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:41 smithi040 ceph-mon[32397]: pgmap v4569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3748.071051 secs 2024-07-26T14:35:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:43 smithi076 ceph-mon[35401]: pgmap v4570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:43 smithi146 ceph-mon[35807]: pgmap v4570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:43 smithi040 ceph-mon[32397]: pgmap v4570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:45 smithi146 ceph-mon[35807]: pgmap v4571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:45 smithi076 ceph-mon[35401]: pgmap v4571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:45 smithi040 ceph-mon[32397]: pgmap v4571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3753.071195 secs 2024-07-26T14:35:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3753.071195 secs 2024-07-26T14:35:46.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3753.071195 secs 2024-07-26T14:35:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:47 smithi040 ceph-mon[32397]: pgmap v4572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:47 smithi146 ceph-mon[35807]: pgmap v4572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:47 smithi076 ceph-mon[35401]: pgmap v4572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:48 smithi040 ceph-mon[32397]: pgmap v4573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:48 smithi146 ceph-mon[35807]: pgmap v4573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:48 smithi076 ceph-mon[35401]: pgmap v4573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:51 smithi146 ceph-mon[35807]: pgmap v4574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3758.071338 secs 2024-07-26T14:35:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:51 smithi076 ceph-mon[35401]: pgmap v4574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3758.071338 secs 2024-07-26T14:35:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:51 smithi040 ceph-mon[32397]: pgmap v4574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3758.071338 secs 2024-07-26T14:35:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:53 smithi146 ceph-mon[35807]: pgmap v4575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:53 smithi076 ceph-mon[35401]: pgmap v4575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:53 smithi040 ceph-mon[32397]: pgmap v4575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:55 smithi146 ceph-mon[35807]: pgmap v4576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:55 smithi076 ceph-mon[35401]: pgmap v4576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:55 smithi040 ceph-mon[32397]: pgmap v4576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:35:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3763.071482 secs 2024-07-26T14:35:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3763.071482 secs 2024-07-26T14:35:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3763.071482 secs 2024-07-26T14:35:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:57 smithi146 ceph-mon[35807]: pgmap v4577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:57 smithi076 ceph-mon[35401]: pgmap v4577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:57 smithi040 ceph-mon[32397]: pgmap v4577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:35:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:35:59 smithi146 ceph-mon[35807]: pgmap v4578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:35:59 smithi076 ceph-mon[35401]: pgmap v4578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:35:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:35:59 smithi040 ceph-mon[32397]: pgmap v4578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:01 smithi146 ceph-mon[35807]: pgmap v4579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3768.071616 secs 2024-07-26T14:36:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:01 smithi076 ceph-mon[35401]: pgmap v4579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3768.071616 secs 2024-07-26T14:36:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:01 smithi040 ceph-mon[32397]: pgmap v4579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3768.071616 secs 2024-07-26T14:36:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:03 smithi146 ceph-mon[35807]: pgmap v4580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:03 smithi076 ceph-mon[35401]: pgmap v4580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:03 smithi040 ceph-mon[32397]: pgmap v4580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:05 smithi076 ceph-mon[35401]: pgmap v4581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:05 smithi040 ceph-mon[32397]: pgmap v4581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:05 smithi146 ceph-mon[35807]: pgmap v4581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3773.071761 secs 2024-07-26T14:36:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3773.071761 secs 2024-07-26T14:36:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3773.071761 secs 2024-07-26T14:36:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:07 smithi040 ceph-mon[32397]: pgmap v4582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:07 smithi146 ceph-mon[35807]: pgmap v4582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:07 smithi076 ceph-mon[35401]: pgmap v4582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:08 smithi040 ceph-mon[32397]: pgmap v4583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:08 smithi146 ceph-mon[35807]: pgmap v4583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:08 smithi076 ceph-mon[35401]: pgmap v4583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:11 smithi146 ceph-mon[35807]: pgmap v4584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3778.071897 secs 2024-07-26T14:36:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:11 smithi076 ceph-mon[35401]: pgmap v4584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3778.071897 secs 2024-07-26T14:36:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:11 smithi040 ceph-mon[32397]: pgmap v4584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3778.071897 secs 2024-07-26T14:36:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:13 smithi040 ceph-mon[32397]: pgmap v4585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:13 smithi146 ceph-mon[35807]: pgmap v4585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:13 smithi076 ceph-mon[35401]: pgmap v4585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:15 smithi146 ceph-mon[35807]: pgmap v4586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:15 smithi076 ceph-mon[35401]: pgmap v4586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:15 smithi040 ceph-mon[32397]: pgmap v4586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3783.072038 secs 2024-07-26T14:36:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3783.072038 secs 2024-07-26T14:36:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3783.072038 secs 2024-07-26T14:36:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:17 smithi146 ceph-mon[35807]: pgmap v4587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:17 smithi076 ceph-mon[35401]: pgmap v4587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:17 smithi040 ceph-mon[32397]: pgmap v4587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:19 smithi146 ceph-mon[35807]: pgmap v4588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:19 smithi076 ceph-mon[35401]: pgmap v4588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:19 smithi040 ceph-mon[32397]: pgmap v4588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:21 smithi076 ceph-mon[35401]: pgmap v4589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3788.072196 secs 2024-07-26T14:36:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:21 smithi040 ceph-mon[32397]: pgmap v4589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3788.072196 secs 2024-07-26T14:36:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:21 smithi146 ceph-mon[35807]: pgmap v4589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3788.072196 secs 2024-07-26T14:36:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:23 smithi076 ceph-mon[35401]: pgmap v4590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:23 smithi040 ceph-mon[32397]: pgmap v4590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:23 smithi146 ceph-mon[35807]: pgmap v4590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:24 smithi040 ceph-mon[32397]: pgmap v4591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:24 smithi146 ceph-mon[35807]: pgmap v4591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:24 smithi076 ceph-mon[35401]: pgmap v4591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3793.072327 secs 2024-07-26T14:36:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3793.072327 secs 2024-07-26T14:36:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3793.072327 secs 2024-07-26T14:36:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:26 smithi146 ceph-mon[35807]: pgmap v4592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:26 smithi076 ceph-mon[35401]: pgmap v4592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:26 smithi040 ceph-mon[32397]: pgmap v4592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:29 smithi146 ceph-mon[35807]: pgmap v4593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:29 smithi076 ceph-mon[35401]: pgmap v4593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:29 smithi040 ceph-mon[32397]: pgmap v4593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:31 smithi146 ceph-mon[35807]: pgmap v4594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3798.072491 secs 2024-07-26T14:36:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:31 smithi076 ceph-mon[35401]: pgmap v4594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3798.072491 secs 2024-07-26T14:36:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:31 smithi040 ceph-mon[32397]: pgmap v4594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3798.072491 secs 2024-07-26T14:36:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:33 smithi146 ceph-mon[35807]: pgmap v4595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:33 smithi076 ceph-mon[35401]: pgmap v4595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:33 smithi040 ceph-mon[32397]: pgmap v4595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:35 smithi146 ceph-mon[35807]: pgmap v4596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:35 smithi076 ceph-mon[35401]: pgmap v4596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:35.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:35 smithi040 ceph-mon[32397]: pgmap v4596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3803.072630 secs 2024-07-26T14:36:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3803.072630 secs 2024-07-26T14:36:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3803.072630 secs 2024-07-26T14:36:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:37 smithi076 ceph-mon[35401]: pgmap v4597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:37 smithi040 ceph-mon[32397]: pgmap v4597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:37 smithi146 ceph-mon[35807]: pgmap v4597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:39 smithi040 ceph-mon[32397]: pgmap v4598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:39 smithi146 ceph-mon[35807]: pgmap v4598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:39 smithi076 ceph-mon[35401]: pgmap v4598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:40 smithi040 ceph-mon[32397]: pgmap v4599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:40 smithi146 ceph-mon[35807]: pgmap v4599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:40 smithi076 ceph-mon[35401]: pgmap v4599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3808.072777 secs 2024-07-26T14:36:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3808.072777 secs 2024-07-26T14:36:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3808.072777 secs 2024-07-26T14:36:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:42 smithi040 ceph-mon[32397]: pgmap v4600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:42 smithi146 ceph-mon[35807]: pgmap v4600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:42 smithi076 ceph-mon[35401]: pgmap v4600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:45 smithi146 ceph-mon[35807]: pgmap v4601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:45 smithi076 ceph-mon[35401]: pgmap v4601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:45 smithi040 ceph-mon[32397]: pgmap v4601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3813.072916 secs 2024-07-26T14:36:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3813.072916 secs 2024-07-26T14:36:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3813.072916 secs 2024-07-26T14:36:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:47 smithi146 ceph-mon[35807]: pgmap v4602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:47 smithi076 ceph-mon[35401]: pgmap v4602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:47 smithi040 ceph-mon[32397]: pgmap v4602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:49 smithi076 ceph-mon[35401]: pgmap v4603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:49 smithi040 ceph-mon[32397]: pgmap v4603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:49 smithi146 ceph-mon[35807]: pgmap v4603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:51 smithi076 ceph-mon[35401]: pgmap v4604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3818.073060 secs 2024-07-26T14:36:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:51 smithi040 ceph-mon[32397]: pgmap v4604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3818.073060 secs 2024-07-26T14:36:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:51 smithi146 ceph-mon[35807]: pgmap v4604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3818.073060 secs 2024-07-26T14:36:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:53 smithi040 ceph-mon[32397]: pgmap v4605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:53 smithi146 ceph-mon[35807]: pgmap v4605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:53 smithi076 ceph-mon[35401]: pgmap v4605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:54 smithi040 ceph-mon[32397]: pgmap v4606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:54 smithi146 ceph-mon[35807]: pgmap v4606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:54 smithi076 ceph-mon[35401]: pgmap v4606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:36:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3823.073201 secs 2024-07-26T14:36:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3823.073201 secs 2024-07-26T14:36:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3823.073201 secs 2024-07-26T14:36:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:56 smithi146 ceph-mon[35807]: pgmap v4607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:56 smithi076 ceph-mon[35401]: pgmap v4607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:56 smithi040 ceph-mon[32397]: pgmap v4607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:36:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:36:59 smithi146 ceph-mon[35807]: pgmap v4608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:36:59 smithi076 ceph-mon[35401]: pgmap v4608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:36:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:36:59 smithi040 ceph-mon[32397]: pgmap v4608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:01 smithi146 ceph-mon[35807]: pgmap v4609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3828.073361 secs 2024-07-26T14:37:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:01 smithi076 ceph-mon[35401]: pgmap v4609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3828.073361 secs 2024-07-26T14:37:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:01 smithi040 ceph-mon[32397]: pgmap v4609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3828.073361 secs 2024-07-26T14:37:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:03 smithi076 ceph-mon[35401]: pgmap v4610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:03 smithi040 ceph-mon[32397]: pgmap v4610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:03 smithi146 ceph-mon[35807]: pgmap v4610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:05 smithi076 ceph-mon[35401]: pgmap v4611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:05 smithi040 ceph-mon[32397]: pgmap v4611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:05 smithi146 ceph-mon[35807]: pgmap v4611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3833.073461 secs 2024-07-26T14:37:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3833.073461 secs 2024-07-26T14:37:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3833.073461 secs 2024-07-26T14:37:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:07 smithi040 ceph-mon[32397]: pgmap v4612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:07 smithi146 ceph-mon[35807]: pgmap v4612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:07 smithi076 ceph-mon[35401]: pgmap v4612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:08 smithi040 ceph-mon[32397]: pgmap v4613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:08 smithi146 ceph-mon[35807]: pgmap v4613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:08 smithi076 ceph-mon[35401]: pgmap v4613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:11 smithi146 ceph-mon[35807]: pgmap v4614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3838.073603 secs 2024-07-26T14:37:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:11 smithi076 ceph-mon[35401]: pgmap v4614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3838.073603 secs 2024-07-26T14:37:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:11 smithi040 ceph-mon[32397]: pgmap v4614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3838.073603 secs 2024-07-26T14:37:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:13 smithi076 ceph-mon[35401]: pgmap v4615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:13 smithi040 ceph-mon[32397]: pgmap v4615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:13 smithi146 ceph-mon[35807]: pgmap v4615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:15.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:15 smithi076 ceph-mon[35401]: pgmap v4616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:15 smithi040 ceph-mon[32397]: pgmap v4616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:15 smithi146 ceph-mon[35807]: pgmap v4616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3843.073745 secs 2024-07-26T14:37:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3843.073745 secs 2024-07-26T14:37:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3843.073745 secs 2024-07-26T14:37:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:17 smithi040 ceph-mon[32397]: pgmap v4617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:17 smithi146 ceph-mon[35807]: pgmap v4617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:17 smithi076 ceph-mon[35401]: pgmap v4617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:18 smithi040 ceph-mon[32397]: pgmap v4618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:18 smithi146 ceph-mon[35807]: pgmap v4618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:18 smithi076 ceph-mon[35401]: pgmap v4618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:21 smithi076 ceph-mon[35401]: pgmap v4619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3848.073886 secs 2024-07-26T14:37:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:21 smithi040 ceph-mon[32397]: pgmap v4619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3848.073886 secs 2024-07-26T14:37:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:21 smithi146 ceph-mon[35807]: pgmap v4619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3848.073886 secs 2024-07-26T14:37:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:23 smithi076 ceph-mon[35401]: pgmap v4620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:23 smithi040 ceph-mon[32397]: pgmap v4620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:23 smithi146 ceph-mon[35807]: pgmap v4620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:25 smithi040 ceph-mon[32397]: pgmap v4621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:25 smithi146 ceph-mon[35807]: pgmap v4621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:25 smithi076 ceph-mon[35401]: pgmap v4621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3853.074030 secs 2024-07-26T14:37:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3853.074030 secs 2024-07-26T14:37:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3853.074030 secs 2024-07-26T14:37:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:27 smithi040 ceph-mon[32397]: pgmap v4622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:27 smithi146 ceph-mon[35807]: pgmap v4622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:27 smithi076 ceph-mon[35401]: pgmap v4622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:28 smithi040 ceph-mon[32397]: pgmap v4623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:28 smithi146 ceph-mon[35807]: pgmap v4623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:28 smithi076 ceph-mon[35401]: pgmap v4623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:31 smithi076 ceph-mon[35401]: pgmap v4624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3858.074171 secs 2024-07-26T14:37:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:31 smithi040 ceph-mon[32397]: pgmap v4624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3858.074171 secs 2024-07-26T14:37:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:31 smithi146 ceph-mon[35807]: pgmap v4624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3858.074171 secs 2024-07-26T14:37:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:33 smithi040 ceph-mon[32397]: pgmap v4625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:33 smithi146 ceph-mon[35807]: pgmap v4625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:33 smithi076 ceph-mon[35401]: pgmap v4625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:35 smithi040 ceph-mon[32397]: pgmap v4626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:35 smithi146 ceph-mon[35807]: pgmap v4626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:35 smithi076 ceph-mon[35401]: pgmap v4626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3863.074326 secs 2024-07-26T14:37:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3863.074326 secs 2024-07-26T14:37:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3863.074326 secs 2024-07-26T14:37:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:37 smithi040 ceph-mon[32397]: pgmap v4627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:37 smithi146 ceph-mon[35807]: pgmap v4627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:37 smithi076 ceph-mon[35401]: pgmap v4627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:38 smithi040 ceph-mon[32397]: pgmap v4628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:38 smithi146 ceph-mon[35807]: pgmap v4628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:38 smithi076 ceph-mon[35401]: pgmap v4628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:41 smithi040 ceph-mon[32397]: pgmap v4629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3868.074461 secs 2024-07-26T14:37:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:41 smithi146 ceph-mon[35807]: pgmap v4629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3868.074461 secs 2024-07-26T14:37:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:41 smithi076 ceph-mon[35401]: pgmap v4629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3868.074461 secs 2024-07-26T14:37:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:43 smithi040 ceph-mon[32397]: pgmap v4630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:43 smithi146 ceph-mon[35807]: pgmap v4630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:43 smithi076 ceph-mon[35401]: pgmap v4630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:45 smithi040 ceph-mon[32397]: pgmap v4631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:45 smithi146 ceph-mon[35807]: pgmap v4631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:45 smithi076 ceph-mon[35401]: pgmap v4631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:37:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3873.074617 secs 2024-07-26T14:37:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3873.074617 secs 2024-07-26T14:37:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3873.074617 secs 2024-07-26T14:37:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:47 smithi040 ceph-mon[32397]: pgmap v4632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:47 smithi146 ceph-mon[35807]: pgmap v4632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:47 smithi076 ceph-mon[35401]: pgmap v4632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:48 smithi040 ceph-mon[32397]: pgmap v4633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:48 smithi146 ceph-mon[35807]: pgmap v4633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:48 smithi076 ceph-mon[35401]: pgmap v4633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:51 smithi040 ceph-mon[32397]: pgmap v4634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3878.074784 secs 2024-07-26T14:37:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:51 smithi146 ceph-mon[35807]: pgmap v4634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3878.074784 secs 2024-07-26T14:37:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:51 smithi076 ceph-mon[35401]: pgmap v4634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3878.074784 secs 2024-07-26T14:37:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:53 smithi040 ceph-mon[32397]: pgmap v4635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:53 smithi146 ceph-mon[35807]: pgmap v4635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:53 smithi076 ceph-mon[35401]: pgmap v4635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:55 smithi040 ceph-mon[32397]: pgmap v4636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:55 smithi146 ceph-mon[35807]: pgmap v4636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:55 smithi076 ceph-mon[35401]: pgmap v4636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3883.074922 secs 2024-07-26T14:37:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:56 smithi040 ceph-mon[32397]: pgmap v4637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3883.074922 secs 2024-07-26T14:37:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:56 smithi146 ceph-mon[35807]: pgmap v4637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3883.074922 secs 2024-07-26T14:37:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:56 smithi076 ceph-mon[35401]: pgmap v4637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:37:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:37:59 smithi040 ceph-mon[32397]: pgmap v4638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:37:59 smithi146 ceph-mon[35807]: pgmap v4638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:37:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:37:59 smithi076 ceph-mon[35401]: pgmap v4638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:01.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:01 smithi146 ceph-mon[35807]: pgmap v4639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:01.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3888.075064 secs 2024-07-26T14:38:01.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:01 smithi076 ceph-mon[35401]: pgmap v4639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:01.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3888.075064 secs 2024-07-26T14:38:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:01 smithi040 ceph-mon[32397]: pgmap v4639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3888.075064 secs 2024-07-26T14:38:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:02 smithi040 ceph-mon[32397]: pgmap v4640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:02 smithi146 ceph-mon[35807]: pgmap v4640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:02 smithi076 ceph-mon[35401]: pgmap v4640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:05 smithi040 ceph-mon[32397]: pgmap v4641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:05 smithi146 ceph-mon[35807]: pgmap v4641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:05 smithi076 ceph-mon[35401]: pgmap v4641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3893.075209 secs 2024-07-26T14:38:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3893.075209 secs 2024-07-26T14:38:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3893.075209 secs 2024-07-26T14:38:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:07 smithi040 ceph-mon[32397]: pgmap v4642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:07 smithi146 ceph-mon[35807]: pgmap v4642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:07 smithi076 ceph-mon[35401]: pgmap v4642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:08 smithi040 ceph-mon[32397]: pgmap v4643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:08 smithi146 ceph-mon[35807]: pgmap v4643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:08 smithi076 ceph-mon[35401]: pgmap v4643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:11 smithi040 ceph-mon[32397]: pgmap v4644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3898.075353 secs 2024-07-26T14:38:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:11 smithi146 ceph-mon[35807]: pgmap v4644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3898.075353 secs 2024-07-26T14:38:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:11 smithi076 ceph-mon[35401]: pgmap v4644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3898.075353 secs 2024-07-26T14:38:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:13 smithi040 ceph-mon[32397]: pgmap v4645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:13 smithi146 ceph-mon[35807]: pgmap v4645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:13 smithi076 ceph-mon[35401]: pgmap v4645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:14 smithi040 ceph-mon[32397]: pgmap v4646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:14 smithi146 ceph-mon[35807]: pgmap v4646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:14 smithi076 ceph-mon[35401]: pgmap v4646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3903.075492 secs 2024-07-26T14:38:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3903.075492 secs 2024-07-26T14:38:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3903.075492 secs 2024-07-26T14:38:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:16 smithi146 ceph-mon[35807]: pgmap v4647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:16 smithi076 ceph-mon[35401]: pgmap v4647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:16 smithi040 ceph-mon[32397]: pgmap v4647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:19 smithi040 ceph-mon[32397]: pgmap v4648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:19 smithi146 ceph-mon[35807]: pgmap v4648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:19 smithi076 ceph-mon[35401]: pgmap v4648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:20 smithi040 ceph-mon[32397]: pgmap v4649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:20 smithi146 ceph-mon[35807]: pgmap v4649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:20 smithi076 ceph-mon[35401]: pgmap v4649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3908.075587 secs 2024-07-26T14:38:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3908.075587 secs 2024-07-26T14:38:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3908.075587 secs 2024-07-26T14:38:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:22 smithi040 ceph-mon[32397]: pgmap v4650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:22 smithi146 ceph-mon[35807]: pgmap v4650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:22 smithi076 ceph-mon[35401]: pgmap v4650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:25 smithi040 ceph-mon[32397]: pgmap v4651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:25 smithi146 ceph-mon[35807]: pgmap v4651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:25 smithi076 ceph-mon[35401]: pgmap v4651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3913.075728 secs 2024-07-26T14:38:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:26 smithi040 ceph-mon[32397]: pgmap v4652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3913.075728 secs 2024-07-26T14:38:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:26 smithi146 ceph-mon[35807]: pgmap v4652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3913.075728 secs 2024-07-26T14:38:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:26 smithi076 ceph-mon[35401]: pgmap v4652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:28 smithi040 ceph-mon[32397]: pgmap v4653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:28 smithi146 ceph-mon[35807]: pgmap v4653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:28 smithi076 ceph-mon[35401]: pgmap v4653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:30 smithi040 ceph-mon[32397]: pgmap v4654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:30 smithi146 ceph-mon[35807]: pgmap v4654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:30 smithi076 ceph-mon[35401]: pgmap v4654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:31.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3918.075870 secs 2024-07-26T14:38:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3918.075870 secs 2024-07-26T14:38:31.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3918.075870 secs 2024-07-26T14:38:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:32 smithi040 ceph-mon[32397]: pgmap v4655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:32 smithi146 ceph-mon[35807]: pgmap v4655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:32 smithi076 ceph-mon[35401]: pgmap v4655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:34 smithi040 ceph-mon[32397]: pgmap v4656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:34 smithi146 ceph-mon[35807]: pgmap v4656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:34 smithi076 ceph-mon[35401]: pgmap v4656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3923.076017 secs 2024-07-26T14:38:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3923.076017 secs 2024-07-26T14:38:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3923.076017 secs 2024-07-26T14:38:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:36 smithi146 ceph-mon[35807]: pgmap v4657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:36 smithi076 ceph-mon[35401]: pgmap v4657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:36 smithi040 ceph-mon[32397]: pgmap v4657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:38 smithi040 ceph-mon[32397]: pgmap v4658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:38 smithi146 ceph-mon[35807]: pgmap v4658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:38 smithi076 ceph-mon[35401]: pgmap v4658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:40 smithi040 ceph-mon[32397]: pgmap v4659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:40 smithi146 ceph-mon[35807]: pgmap v4659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:40 smithi076 ceph-mon[35401]: pgmap v4659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3928.076157 secs 2024-07-26T14:38:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3928.076157 secs 2024-07-26T14:38:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3928.076157 secs 2024-07-26T14:38:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:42 smithi040 ceph-mon[32397]: pgmap v4660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:42 smithi146 ceph-mon[35807]: pgmap v4660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:42 smithi076 ceph-mon[35401]: pgmap v4660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:44 smithi040 ceph-mon[32397]: pgmap v4661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:44 smithi146 ceph-mon[35807]: pgmap v4661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:44 smithi076 ceph-mon[35401]: pgmap v4661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3933.076322 secs 2024-07-26T14:38:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3933.076322 secs 2024-07-26T14:38:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3933.076322 secs 2024-07-26T14:38:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:47 smithi040 ceph-mon[32397]: pgmap v4662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:47 smithi146 ceph-mon[35807]: pgmap v4662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:47 smithi076 ceph-mon[35401]: pgmap v4662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:49 smithi040 ceph-mon[32397]: pgmap v4663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:49 smithi146 ceph-mon[35807]: pgmap v4663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:49 smithi076 ceph-mon[35401]: pgmap v4663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:50 smithi040 ceph-mon[32397]: pgmap v4664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:50 smithi146 ceph-mon[35807]: pgmap v4664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:50 smithi076 ceph-mon[35401]: pgmap v4664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3938.076461 secs 2024-07-26T14:38:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3938.076461 secs 2024-07-26T14:38:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3938.076461 secs 2024-07-26T14:38:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:52 smithi040 ceph-mon[32397]: pgmap v4665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:52 smithi146 ceph-mon[35807]: pgmap v4665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:52 smithi076 ceph-mon[35401]: pgmap v4665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:54 smithi040 ceph-mon[32397]: pgmap v4666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:54 smithi146 ceph-mon[35807]: pgmap v4666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:54 smithi076 ceph-mon[35401]: pgmap v4666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:38:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3943.076603 secs 2024-07-26T14:38:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3943.076603 secs 2024-07-26T14:38:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3943.076603 secs 2024-07-26T14:38:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:56 smithi146 ceph-mon[35807]: pgmap v4667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:56 smithi076 ceph-mon[35401]: pgmap v4667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:56 smithi040 ceph-mon[32397]: pgmap v4667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:38:58 smithi040 ceph-mon[32397]: pgmap v4668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:38:58 smithi146 ceph-mon[35807]: pgmap v4668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:38:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:38:58 smithi076 ceph-mon[35401]: pgmap v4668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:00 smithi040 ceph-mon[32397]: pgmap v4669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:00 smithi146 ceph-mon[35807]: pgmap v4669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:00 smithi076 ceph-mon[35401]: pgmap v4669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:01.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3948.076746 secs 2024-07-26T14:39:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3948.076746 secs 2024-07-26T14:39:01.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3948.076746 secs 2024-07-26T14:39:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:02 smithi040 ceph-mon[32397]: pgmap v4670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:02 smithi146 ceph-mon[35807]: pgmap v4670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:02 smithi076 ceph-mon[35401]: pgmap v4670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:04 smithi040 ceph-mon[32397]: pgmap v4671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:04 smithi146 ceph-mon[35807]: pgmap v4671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:04 smithi076 ceph-mon[35401]: pgmap v4671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3953.076885 secs 2024-07-26T14:39:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3953.076885 secs 2024-07-26T14:39:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3953.076885 secs 2024-07-26T14:39:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:06 smithi146 ceph-mon[35807]: pgmap v4672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:06 smithi076 ceph-mon[35401]: pgmap v4672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:06 smithi040 ceph-mon[32397]: pgmap v4672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:08 smithi040 ceph-mon[32397]: pgmap v4673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:08 smithi146 ceph-mon[35807]: pgmap v4673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:08 smithi076 ceph-mon[35401]: pgmap v4673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:10 smithi040 ceph-mon[32397]: pgmap v4674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:10 smithi146 ceph-mon[35807]: pgmap v4674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:10 smithi076 ceph-mon[35401]: pgmap v4674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3958.077045 secs 2024-07-26T14:39:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3958.077045 secs 2024-07-26T14:39:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3958.077045 secs 2024-07-26T14:39:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:12 smithi040 ceph-mon[32397]: pgmap v4675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:12 smithi146 ceph-mon[35807]: pgmap v4675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:12 smithi076 ceph-mon[35401]: pgmap v4675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:14 smithi040 ceph-mon[32397]: pgmap v4676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:14 smithi146 ceph-mon[35807]: pgmap v4676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:14 smithi076 ceph-mon[35401]: pgmap v4676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3963.077204 secs 2024-07-26T14:39:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3963.077204 secs 2024-07-26T14:39:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3963.077204 secs 2024-07-26T14:39:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:16 smithi146 ceph-mon[35807]: pgmap v4677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:16 smithi076 ceph-mon[35401]: pgmap v4677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:16 smithi040 ceph-mon[32397]: pgmap v4677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:18 smithi040 ceph-mon[32397]: pgmap v4678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:18 smithi146 ceph-mon[35807]: pgmap v4678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:18 smithi076 ceph-mon[35401]: pgmap v4678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:20 smithi040 ceph-mon[32397]: pgmap v4679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:20 smithi146 ceph-mon[35807]: pgmap v4679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:20 smithi076 ceph-mon[35401]: pgmap v4679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3968.077376 secs 2024-07-26T14:39:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3968.077376 secs 2024-07-26T14:39:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3968.077376 secs 2024-07-26T14:39:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:22 smithi040 ceph-mon[32397]: pgmap v4680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:22 smithi146 ceph-mon[35807]: pgmap v4680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:22 smithi076 ceph-mon[35401]: pgmap v4680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:24 smithi040 ceph-mon[32397]: pgmap v4681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:24 smithi146 ceph-mon[35807]: pgmap v4681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:24 smithi076 ceph-mon[35401]: pgmap v4681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3973.077513 secs 2024-07-26T14:39:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3973.077513 secs 2024-07-26T14:39:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3973.077513 secs 2024-07-26T14:39:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:26 smithi146 ceph-mon[35807]: pgmap v4682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:26 smithi076 ceph-mon[35401]: pgmap v4682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:26 smithi040 ceph-mon[32397]: pgmap v4682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:28 smithi040 ceph-mon[32397]: pgmap v4683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:28 smithi146 ceph-mon[35807]: pgmap v4683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:28 smithi076 ceph-mon[35401]: pgmap v4683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:30 smithi040 ceph-mon[32397]: pgmap v4684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:30 smithi146 ceph-mon[35807]: pgmap v4684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:30 smithi076 ceph-mon[35401]: pgmap v4684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:31.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3978.077656 secs 2024-07-26T14:39:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3978.077656 secs 2024-07-26T14:39:31.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3978.077656 secs 2024-07-26T14:39:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:32 smithi040 ceph-mon[32397]: pgmap v4685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:32 smithi146 ceph-mon[35807]: pgmap v4685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:32 smithi076 ceph-mon[35401]: pgmap v4685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:34 smithi040 ceph-mon[32397]: pgmap v4686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:34 smithi146 ceph-mon[35807]: pgmap v4686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:34 smithi076 ceph-mon[35401]: pgmap v4686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3983.077811 secs 2024-07-26T14:39:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3983.077811 secs 2024-07-26T14:39:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3983.077811 secs 2024-07-26T14:39:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:36 smithi146 ceph-mon[35807]: pgmap v4687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:36 smithi076 ceph-mon[35401]: pgmap v4687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:36 smithi040 ceph-mon[32397]: pgmap v4687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:38 smithi040 ceph-mon[32397]: pgmap v4688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:38 smithi146 ceph-mon[35807]: pgmap v4688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:38 smithi076 ceph-mon[35401]: pgmap v4688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:40 smithi040 ceph-mon[32397]: pgmap v4689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:40 smithi146 ceph-mon[35807]: pgmap v4689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:40 smithi076 ceph-mon[35401]: pgmap v4689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3988.077956 secs 2024-07-26T14:39:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3988.077956 secs 2024-07-26T14:39:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3988.077956 secs 2024-07-26T14:39:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:42 smithi040 ceph-mon[32397]: pgmap v4690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:42 smithi146 ceph-mon[35807]: pgmap v4690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:42 smithi076 ceph-mon[35401]: pgmap v4690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:44 smithi040 ceph-mon[32397]: pgmap v4691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:44 smithi146 ceph-mon[35807]: pgmap v4691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:44 smithi076 ceph-mon[35401]: pgmap v4691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3993.078109 secs 2024-07-26T14:39:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3993.078109 secs 2024-07-26T14:39:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3993.078109 secs 2024-07-26T14:39:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:46 smithi146 ceph-mon[35807]: pgmap v4692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:46 smithi076 ceph-mon[35401]: pgmap v4692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:46 smithi040 ceph-mon[32397]: pgmap v4692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:48 smithi040 ceph-mon[32397]: pgmap v4693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:48 smithi146 ceph-mon[35807]: pgmap v4693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:48 smithi076 ceph-mon[35401]: pgmap v4693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:39:50.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:50 smithi040 ceph-mon[32397]: pgmap v4694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:50 smithi146 ceph-mon[35807]: pgmap v4694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:50 smithi076 ceph-mon[35401]: pgmap v4694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 3998.078256 secs 2024-07-26T14:39:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 3998.078256 secs 2024-07-26T14:39:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 3998.078256 secs 2024-07-26T14:39:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:52 smithi040 ceph-mon[32397]: pgmap v4695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:52 smithi146 ceph-mon[35807]: pgmap v4695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:52.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:52 smithi076 ceph-mon[35401]: pgmap v4695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:54 smithi040 ceph-mon[32397]: pgmap v4696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:54 smithi146 ceph-mon[35807]: pgmap v4696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:54 smithi076 ceph-mon[35401]: pgmap v4696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:39:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4003.078397 secs 2024-07-26T14:39:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4003.078397 secs 2024-07-26T14:39:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4003.078397 secs 2024-07-26T14:39:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:56 smithi146 ceph-mon[35807]: pgmap v4697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:56 smithi076 ceph-mon[35401]: pgmap v4697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:56 smithi040 ceph-mon[32397]: pgmap v4697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:39:58 smithi040 ceph-mon[32397]: pgmap v4698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:39:58 smithi146 ceph-mon[35807]: pgmap v4698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:39:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:39:58 smithi076 ceph-mon[35401]: pgmap v4698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:40:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:40:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:40:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:40:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:01 smithi146 ceph-mon[35807]: pgmap v4699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4008.078558 secs 2024-07-26T14:40:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:01 smithi076 ceph-mon[35401]: pgmap v4699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4008.078558 secs 2024-07-26T14:40:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:01 smithi040 ceph-mon[32397]: pgmap v4699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4008.078558 secs 2024-07-26T14:40:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:02 smithi040 ceph-mon[32397]: pgmap v4700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:02 smithi146 ceph-mon[35807]: pgmap v4700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:02 smithi076 ceph-mon[35401]: pgmap v4700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:04 smithi040 ceph-mon[32397]: pgmap v4701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:04 smithi146 ceph-mon[35807]: pgmap v4701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:04 smithi076 ceph-mon[35401]: pgmap v4701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4013.078732 secs 2024-07-26T14:40:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4013.078732 secs 2024-07-26T14:40:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4013.078732 secs 2024-07-26T14:40:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:06 smithi146 ceph-mon[35807]: pgmap v4702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:06 smithi076 ceph-mon[35401]: pgmap v4702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:06 smithi040 ceph-mon[32397]: pgmap v4702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:08 smithi040 ceph-mon[32397]: pgmap v4703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:08 smithi146 ceph-mon[35807]: pgmap v4703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:08.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:08 smithi076 ceph-mon[35401]: pgmap v4703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:10 smithi040 ceph-mon[32397]: pgmap v4704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:10 smithi146 ceph-mon[35807]: pgmap v4704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:10 smithi076 ceph-mon[35401]: pgmap v4704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4018.078878 secs 2024-07-26T14:40:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4018.078878 secs 2024-07-26T14:40:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4018.078878 secs 2024-07-26T14:40:12.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:12 smithi040 ceph-mon[32397]: pgmap v4705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:12 smithi146 ceph-mon[35807]: pgmap v4705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:12 smithi076 ceph-mon[35401]: pgmap v4705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:14 smithi040 ceph-mon[32397]: pgmap v4706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:14.738 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:14 smithi076 ceph-mon[35401]: pgmap v4706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:14 smithi146 ceph-mon[35807]: pgmap v4706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4023.079014 secs 2024-07-26T14:40:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4023.079014 secs 2024-07-26T14:40:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4023.079014 secs 2024-07-26T14:40:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:16 smithi146 ceph-mon[35807]: pgmap v4707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:16 smithi076 ceph-mon[35401]: pgmap v4707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:16 smithi040 ceph-mon[32397]: pgmap v4707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:18 smithi040 ceph-mon[32397]: pgmap v4708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:18 smithi146 ceph-mon[35807]: pgmap v4708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:18 smithi076 ceph-mon[35401]: pgmap v4708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:20 smithi040 ceph-mon[32397]: pgmap v4709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:20 smithi146 ceph-mon[35807]: pgmap v4709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:20 smithi076 ceph-mon[35401]: pgmap v4709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4028.079147 secs 2024-07-26T14:40:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4028.079147 secs 2024-07-26T14:40:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4028.079147 secs 2024-07-26T14:40:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:22 smithi040 ceph-mon[32397]: pgmap v4710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:22 smithi146 ceph-mon[35807]: pgmap v4710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:22 smithi076 ceph-mon[35401]: pgmap v4710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:24 smithi040 ceph-mon[32397]: pgmap v4711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:24 smithi146 ceph-mon[35807]: pgmap v4711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:24 smithi076 ceph-mon[35401]: pgmap v4711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4033.079320 secs 2024-07-26T14:40:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4033.079320 secs 2024-07-26T14:40:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4033.079320 secs 2024-07-26T14:40:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:26 smithi146 ceph-mon[35807]: pgmap v4712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:26 smithi076 ceph-mon[35401]: pgmap v4712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:26 smithi040 ceph-mon[32397]: pgmap v4712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:28 smithi040 ceph-mon[32397]: pgmap v4713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:28 smithi146 ceph-mon[35807]: pgmap v4713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:28 smithi076 ceph-mon[35401]: pgmap v4713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:30 smithi040 ceph-mon[32397]: pgmap v4714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:30 smithi146 ceph-mon[35807]: pgmap v4714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:30 smithi076 ceph-mon[35401]: pgmap v4714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:31.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4038.079409 secs 2024-07-26T14:40:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4038.079409 secs 2024-07-26T14:40:31.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4038.079409 secs 2024-07-26T14:40:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:32 smithi040 ceph-mon[32397]: pgmap v4715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:32 smithi146 ceph-mon[35807]: pgmap v4715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:32 smithi076 ceph-mon[35401]: pgmap v4715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:34 smithi040 ceph-mon[32397]: pgmap v4716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:34 smithi146 ceph-mon[35807]: pgmap v4716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:34 smithi076 ceph-mon[35401]: pgmap v4716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4043.079557 secs 2024-07-26T14:40:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4043.079557 secs 2024-07-26T14:40:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4043.079557 secs 2024-07-26T14:40:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:36 smithi146 ceph-mon[35807]: pgmap v4717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:36 smithi076 ceph-mon[35401]: pgmap v4717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:36 smithi040 ceph-mon[32397]: pgmap v4717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:38 smithi040 ceph-mon[32397]: pgmap v4718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:38 smithi146 ceph-mon[35807]: pgmap v4718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:38 smithi076 ceph-mon[35401]: pgmap v4718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:40 smithi040 ceph-mon[32397]: pgmap v4719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:40 smithi146 ceph-mon[35807]: pgmap v4719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:40 smithi076 ceph-mon[35401]: pgmap v4719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4048.079706 secs 2024-07-26T14:40:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4048.079706 secs 2024-07-26T14:40:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4048.079706 secs 2024-07-26T14:40:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:43 smithi040 ceph-mon[32397]: pgmap v4720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:43 smithi146 ceph-mon[35807]: pgmap v4720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:43 smithi076 ceph-mon[35401]: pgmap v4720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:45 smithi040 ceph-mon[32397]: pgmap v4721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:45 smithi146 ceph-mon[35807]: pgmap v4721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:45 smithi076 ceph-mon[35401]: pgmap v4721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4053.079876 secs 2024-07-26T14:40:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4053.079876 secs 2024-07-26T14:40:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4053.079876 secs 2024-07-26T14:40:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:47 smithi146 ceph-mon[35807]: pgmap v4722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:47 smithi076 ceph-mon[35401]: pgmap v4722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:47 smithi040 ceph-mon[32397]: pgmap v4722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:49 smithi146 ceph-mon[35807]: pgmap v4723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:49 smithi076 ceph-mon[35401]: pgmap v4723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:49 smithi040 ceph-mon[32397]: pgmap v4723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:51 smithi146 ceph-mon[35807]: pgmap v4724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4058.080034 secs 2024-07-26T14:40:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:51 smithi076 ceph-mon[35401]: pgmap v4724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4058.080034 secs 2024-07-26T14:40:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:51 smithi040 ceph-mon[32397]: pgmap v4724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4058.080034 secs 2024-07-26T14:40:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:53 smithi146 ceph-mon[35807]: pgmap v4725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:53 smithi076 ceph-mon[35401]: pgmap v4725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:53 smithi040 ceph-mon[32397]: pgmap v4725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:55 smithi146 ceph-mon[35807]: pgmap v4726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:55 smithi076 ceph-mon[35401]: pgmap v4726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:55 smithi040 ceph-mon[32397]: pgmap v4726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:40:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4063.080126 secs 2024-07-26T14:40:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4063.080126 secs 2024-07-26T14:40:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4063.080126 secs 2024-07-26T14:40:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:57 smithi146 ceph-mon[35807]: pgmap v4727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:57 smithi076 ceph-mon[35401]: pgmap v4727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:57 smithi040 ceph-mon[32397]: pgmap v4727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:40:59 smithi146 ceph-mon[35807]: pgmap v4728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:40:59 smithi076 ceph-mon[35401]: pgmap v4728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:40:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:40:59 smithi040 ceph-mon[32397]: pgmap v4728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:01 smithi146 ceph-mon[35807]: pgmap v4729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4068.080305 secs 2024-07-26T14:41:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:01 smithi076 ceph-mon[35401]: pgmap v4729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4068.080305 secs 2024-07-26T14:41:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:01 smithi040 ceph-mon[32397]: pgmap v4729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4068.080305 secs 2024-07-26T14:41:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:03 smithi146 ceph-mon[35807]: pgmap v4730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:03 smithi076 ceph-mon[35401]: pgmap v4730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:03 smithi040 ceph-mon[32397]: pgmap v4730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:05 smithi146 ceph-mon[35807]: pgmap v4731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:05 smithi076 ceph-mon[35401]: pgmap v4731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:05 smithi040 ceph-mon[32397]: pgmap v4731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4073.080447 secs 2024-07-26T14:41:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4073.080447 secs 2024-07-26T14:41:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4073.080447 secs 2024-07-26T14:41:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:07 smithi076 ceph-mon[35401]: pgmap v4732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:07 smithi040 ceph-mon[32397]: pgmap v4732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:07 smithi146 ceph-mon[35807]: pgmap v4732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:09 smithi040 ceph-mon[32397]: pgmap v4733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:09 smithi146 ceph-mon[35807]: pgmap v4733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:09 smithi076 ceph-mon[35401]: pgmap v4733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:11 smithi040 ceph-mon[32397]: pgmap v4734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4078.080544 secs 2024-07-26T14:41:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:11 smithi146 ceph-mon[35807]: pgmap v4734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4078.080544 secs 2024-07-26T14:41:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:11 smithi076 ceph-mon[35401]: pgmap v4734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4078.080544 secs 2024-07-26T14:41:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:13 smithi040 ceph-mon[32397]: pgmap v4735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:13 smithi146 ceph-mon[35807]: pgmap v4735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:13 smithi076 ceph-mon[35401]: pgmap v4735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:15.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:15 smithi040 ceph-mon[32397]: pgmap v4736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:15 smithi146 ceph-mon[35807]: pgmap v4736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:15 smithi076 ceph-mon[35401]: pgmap v4736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4083.080639 secs 2024-07-26T14:41:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4083.080639 secs 2024-07-26T14:41:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4083.080639 secs 2024-07-26T14:41:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:17 smithi040 ceph-mon[32397]: pgmap v4737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:17 smithi146 ceph-mon[35807]: pgmap v4737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:17 smithi076 ceph-mon[35401]: pgmap v4737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:19 smithi040 ceph-mon[32397]: pgmap v4738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:19 smithi146 ceph-mon[35807]: pgmap v4738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:19 smithi076 ceph-mon[35401]: pgmap v4738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:21 smithi040 ceph-mon[32397]: pgmap v4739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4088.080801 secs 2024-07-26T14:41:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:21 smithi146 ceph-mon[35807]: pgmap v4739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4088.080801 secs 2024-07-26T14:41:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:21 smithi076 ceph-mon[35401]: pgmap v4739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4088.080801 secs 2024-07-26T14:41:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:23 smithi040 ceph-mon[32397]: pgmap v4740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:23 smithi146 ceph-mon[35807]: pgmap v4740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:23 smithi076 ceph-mon[35401]: pgmap v4740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:25 smithi040 ceph-mon[32397]: pgmap v4741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:25 smithi146 ceph-mon[35807]: pgmap v4741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:25 smithi076 ceph-mon[35401]: pgmap v4741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4093.080944 secs 2024-07-26T14:41:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4093.080944 secs 2024-07-26T14:41:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4093.080944 secs 2024-07-26T14:41:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:27 smithi040 ceph-mon[32397]: pgmap v4742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:27 smithi146 ceph-mon[35807]: pgmap v4742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:27 smithi076 ceph-mon[35401]: pgmap v4742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:29 smithi040 ceph-mon[32397]: pgmap v4743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:29 smithi146 ceph-mon[35807]: pgmap v4743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:29 smithi076 ceph-mon[35401]: pgmap v4743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:31 smithi040 ceph-mon[32397]: pgmap v4744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4098.081108 secs 2024-07-26T14:41:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:31 smithi146 ceph-mon[35807]: pgmap v4744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4098.081108 secs 2024-07-26T14:41:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:31 smithi076 ceph-mon[35401]: pgmap v4744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4098.081108 secs 2024-07-26T14:41:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:33 smithi040 ceph-mon[32397]: pgmap v4745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:33 smithi146 ceph-mon[35807]: pgmap v4745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:33 smithi076 ceph-mon[35401]: pgmap v4745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:35 smithi040 ceph-mon[32397]: pgmap v4746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:35 smithi146 ceph-mon[35807]: pgmap v4746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:35 smithi076 ceph-mon[35401]: pgmap v4746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4103.081321 secs 2024-07-26T14:41:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4103.081321 secs 2024-07-26T14:41:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4103.081321 secs 2024-07-26T14:41:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:37 smithi040 ceph-mon[32397]: pgmap v4747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:37 smithi146 ceph-mon[35807]: pgmap v4747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:37 smithi076 ceph-mon[35401]: pgmap v4747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:39 smithi040 ceph-mon[32397]: pgmap v4748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:39 smithi146 ceph-mon[35807]: pgmap v4748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:39 smithi076 ceph-mon[35401]: pgmap v4748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:41 smithi040 ceph-mon[32397]: pgmap v4749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4108.081414 secs 2024-07-26T14:41:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:41 smithi146 ceph-mon[35807]: pgmap v4749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4108.081414 secs 2024-07-26T14:41:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:41 smithi076 ceph-mon[35401]: pgmap v4749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4108.081414 secs 2024-07-26T14:41:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:43 smithi040 ceph-mon[32397]: pgmap v4750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:43 smithi146 ceph-mon[35807]: pgmap v4750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:43 smithi076 ceph-mon[35401]: pgmap v4750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:45 smithi146 ceph-mon[35807]: pgmap v4751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:45 smithi076 ceph-mon[35401]: pgmap v4751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:45 smithi040 ceph-mon[32397]: pgmap v4751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4113.081577 secs 2024-07-26T14:41:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4113.081577 secs 2024-07-26T14:41:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4113.081577 secs 2024-07-26T14:41:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:47 smithi146 ceph-mon[35807]: pgmap v4752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:47 smithi076 ceph-mon[35401]: pgmap v4752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:47 smithi040 ceph-mon[32397]: pgmap v4752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:49 smithi146 ceph-mon[35807]: pgmap v4753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:49 smithi076 ceph-mon[35401]: pgmap v4753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:49 smithi040 ceph-mon[32397]: pgmap v4753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4118.081676 secs 2024-07-26T14:41:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4118.081676 secs 2024-07-26T14:41:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4118.081676 secs 2024-07-26T14:41:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:51 smithi146 ceph-mon[35807]: pgmap v4754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:51 smithi076 ceph-mon[35401]: pgmap v4754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:51 smithi040 ceph-mon[32397]: pgmap v4754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:53 smithi146 ceph-mon[35807]: pgmap v4755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:53 smithi076 ceph-mon[35401]: pgmap v4755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:53 smithi040 ceph-mon[32397]: pgmap v4755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:55 smithi146 ceph-mon[35807]: pgmap v4756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4123.081835 secs 2024-07-26T14:41:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:55 smithi076 ceph-mon[35401]: pgmap v4756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4123.081835 secs 2024-07-26T14:41:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:55 smithi040 ceph-mon[32397]: pgmap v4756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:41:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4123.081835 secs 2024-07-26T14:41:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:57 smithi146 ceph-mon[35807]: pgmap v4757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:57 smithi076 ceph-mon[35401]: pgmap v4757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:41:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:57 smithi040 ceph-mon[32397]: pgmap v4757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:41:59 smithi146 ceph-mon[35807]: pgmap v4758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:41:59 smithi076 ceph-mon[35401]: pgmap v4758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:41:59 smithi040 ceph-mon[32397]: pgmap v4758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4128.081996 secs 2024-07-26T14:42:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4128.081996 secs 2024-07-26T14:42:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4128.081996 secs 2024-07-26T14:42:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:01 smithi076 ceph-mon[35401]: pgmap v4759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:02.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:01 smithi146 ceph-mon[35807]: pgmap v4759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:01 smithi040 ceph-mon[32397]: pgmap v4759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:03 smithi040 ceph-mon[32397]: pgmap v4760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:03 smithi146 ceph-mon[35807]: pgmap v4760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:03 smithi076 ceph-mon[35401]: pgmap v4760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:05 smithi040 ceph-mon[32397]: pgmap v4761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4133.082131 secs 2024-07-26T14:42:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:05 smithi146 ceph-mon[35807]: pgmap v4761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4133.082131 secs 2024-07-26T14:42:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:05 smithi076 ceph-mon[35401]: pgmap v4761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4133.082131 secs 2024-07-26T14:42:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:07 smithi040 ceph-mon[32397]: pgmap v4762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:07 smithi146 ceph-mon[35807]: pgmap v4762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:07 smithi076 ceph-mon[35401]: pgmap v4762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:09 smithi040 ceph-mon[32397]: pgmap v4763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:09 smithi146 ceph-mon[35807]: pgmap v4763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:09 smithi076 ceph-mon[35401]: pgmap v4763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:11.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4138.082228 secs 2024-07-26T14:42:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4138.082228 secs 2024-07-26T14:42:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4138.082228 secs 2024-07-26T14:42:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:11 smithi040 ceph-mon[32397]: pgmap v4764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:11 smithi146 ceph-mon[35807]: pgmap v4764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:11 smithi076 ceph-mon[35401]: pgmap v4764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:13 smithi040 ceph-mon[32397]: pgmap v4765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:13 smithi146 ceph-mon[35807]: pgmap v4765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:13 smithi076 ceph-mon[35401]: pgmap v4765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:15 smithi040 ceph-mon[32397]: pgmap v4766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4143.082348 secs 2024-07-26T14:42:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:15 smithi146 ceph-mon[35807]: pgmap v4766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4143.082348 secs 2024-07-26T14:42:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:15 smithi076 ceph-mon[35401]: pgmap v4766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4143.082348 secs 2024-07-26T14:42:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:17 smithi040 ceph-mon[32397]: pgmap v4767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:17 smithi146 ceph-mon[35807]: pgmap v4767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:17 smithi076 ceph-mon[35401]: pgmap v4767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:19 smithi040 ceph-mon[32397]: pgmap v4768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:19 smithi146 ceph-mon[35807]: pgmap v4768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:19 smithi076 ceph-mon[35401]: pgmap v4768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4148.082480 secs 2024-07-26T14:42:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4148.082480 secs 2024-07-26T14:42:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4148.082480 secs 2024-07-26T14:42:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:21 smithi040 ceph-mon[32397]: pgmap v4769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:21 smithi146 ceph-mon[35807]: pgmap v4769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:21 smithi076 ceph-mon[35401]: pgmap v4769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:23 smithi040 ceph-mon[32397]: pgmap v4770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:23 smithi146 ceph-mon[35807]: pgmap v4770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:23 smithi076 ceph-mon[35401]: pgmap v4770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:25 smithi040 ceph-mon[32397]: pgmap v4771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4153.082622 secs 2024-07-26T14:42:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:25 smithi146 ceph-mon[35807]: pgmap v4771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4153.082622 secs 2024-07-26T14:42:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:25 smithi076 ceph-mon[35401]: pgmap v4771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4153.082622 secs 2024-07-26T14:42:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:27 smithi040 ceph-mon[32397]: pgmap v4772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:27 smithi146 ceph-mon[35807]: pgmap v4772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:27 smithi076 ceph-mon[35401]: pgmap v4772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:29 smithi040 ceph-mon[32397]: pgmap v4773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:29 smithi146 ceph-mon[35807]: pgmap v4773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:29 smithi076 ceph-mon[35401]: pgmap v4773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4158.082721 secs 2024-07-26T14:42:31.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4158.082721 secs 2024-07-26T14:42:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4158.082721 secs 2024-07-26T14:42:32.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:31 smithi146 ceph-mon[35807]: pgmap v4774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:31 smithi040 ceph-mon[32397]: pgmap v4774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:31 smithi076 ceph-mon[35401]: pgmap v4774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:33 smithi040 ceph-mon[32397]: pgmap v4775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:33 smithi146 ceph-mon[35807]: pgmap v4775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:33 smithi076 ceph-mon[35401]: pgmap v4775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:35 smithi040 ceph-mon[32397]: pgmap v4776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4163.082861 secs 2024-07-26T14:42:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:35 smithi146 ceph-mon[35807]: pgmap v4776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4163.082861 secs 2024-07-26T14:42:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:35 smithi076 ceph-mon[35401]: pgmap v4776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4163.082861 secs 2024-07-26T14:42:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:37 smithi146 ceph-mon[35807]: pgmap v4777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:37 smithi076 ceph-mon[35401]: pgmap v4777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:37 smithi040 ceph-mon[32397]: pgmap v4777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:39 smithi146 ceph-mon[35807]: pgmap v4778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:39 smithi076 ceph-mon[35401]: pgmap v4778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:39 smithi040 ceph-mon[32397]: pgmap v4778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4168.083026 secs 2024-07-26T14:42:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4168.083026 secs 2024-07-26T14:42:41.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4168.083026 secs 2024-07-26T14:42:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:42 smithi146 ceph-mon[35807]: pgmap v4779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:42 smithi076 ceph-mon[35401]: pgmap v4779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:42 smithi040 ceph-mon[32397]: pgmap v4779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:44 smithi146 ceph-mon[35807]: pgmap v4780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:44 smithi076 ceph-mon[35401]: pgmap v4780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:44 smithi040 ceph-mon[32397]: pgmap v4780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:46 smithi146 ceph-mon[35807]: pgmap v4781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4173.083191 secs 2024-07-26T14:42:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:46 smithi076 ceph-mon[35401]: pgmap v4781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4173.083191 secs 2024-07-26T14:42:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:46 smithi040 ceph-mon[32397]: pgmap v4781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4173.083191 secs 2024-07-26T14:42:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:48 smithi146 ceph-mon[35807]: pgmap v4782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:48 smithi076 ceph-mon[35401]: pgmap v4782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:48 smithi040 ceph-mon[32397]: pgmap v4782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:50 smithi146 ceph-mon[35807]: pgmap v4783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:42:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:50 smithi076 ceph-mon[35401]: pgmap v4783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:42:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:50 smithi040 ceph-mon[32397]: pgmap v4783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:42:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4178.083333 secs 2024-07-26T14:42:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4178.083333 secs 2024-07-26T14:42:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4178.083333 secs 2024-07-26T14:42:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:52 smithi076 ceph-mon[35401]: pgmap v4784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:52 smithi040 ceph-mon[32397]: pgmap v4784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:52 smithi146 ceph-mon[35807]: pgmap v4784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:54 smithi076 ceph-mon[35401]: pgmap v4785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:54.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:54 smithi040 ceph-mon[32397]: pgmap v4785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:54 smithi146 ceph-mon[35807]: pgmap v4785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:56 smithi040 ceph-mon[32397]: pgmap v4786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4183.083432 secs 2024-07-26T14:42:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:56 smithi146 ceph-mon[35807]: pgmap v4786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4183.083432 secs 2024-07-26T14:42:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:56 smithi076 ceph-mon[35401]: pgmap v4786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:42:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4183.083432 secs 2024-07-26T14:42:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:42:58 smithi040 ceph-mon[32397]: pgmap v4787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:42:58 smithi146 ceph-mon[35807]: pgmap v4787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:42:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:42:58 smithi076 ceph-mon[35401]: pgmap v4787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:00 smithi040 ceph-mon[32397]: pgmap v4788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:00 smithi146 ceph-mon[35807]: pgmap v4788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:00 smithi076 ceph-mon[35401]: pgmap v4788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4188.083575 secs 2024-07-26T14:43:01.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4188.083575 secs 2024-07-26T14:43:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4188.083575 secs 2024-07-26T14:43:02.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:02 smithi146 ceph-mon[35807]: pgmap v4789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:02 smithi040 ceph-mon[32397]: pgmap v4789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:02 smithi076 ceph-mon[35401]: pgmap v4789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:04 smithi040 ceph-mon[32397]: pgmap v4790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:04 smithi146 ceph-mon[35807]: pgmap v4790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:04 smithi076 ceph-mon[35401]: pgmap v4790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:06 smithi040 ceph-mon[32397]: pgmap v4791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4193.083709 secs 2024-07-26T14:43:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:06 smithi146 ceph-mon[35807]: pgmap v4791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4193.083709 secs 2024-07-26T14:43:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:06 smithi076 ceph-mon[35401]: pgmap v4791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4193.083709 secs 2024-07-26T14:43:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:07 smithi146 ceph-mon[35807]: pgmap v4792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:07 smithi076 ceph-mon[35401]: pgmap v4792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:07 smithi040 ceph-mon[32397]: pgmap v4792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:09 smithi146 ceph-mon[35807]: pgmap v4793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:09 smithi076 ceph-mon[35401]: pgmap v4793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:09 smithi040 ceph-mon[32397]: pgmap v4793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:11.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:11 smithi040 ceph-mon[32397]: pgmap v4794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:11.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4198.083850 secs 2024-07-26T14:43:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:11 smithi146 ceph-mon[35807]: pgmap v4794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4198.083850 secs 2024-07-26T14:43:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:11 smithi076 ceph-mon[35401]: pgmap v4794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4198.083850 secs 2024-07-26T14:43:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:13 smithi146 ceph-mon[35807]: pgmap v4795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:13 smithi076 ceph-mon[35401]: pgmap v4795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:13 smithi040 ceph-mon[32397]: pgmap v4795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:15 smithi146 ceph-mon[35807]: pgmap v4796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:15 smithi076 ceph-mon[35401]: pgmap v4796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:15 smithi040 ceph-mon[32397]: pgmap v4796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4203.084010 secs 2024-07-26T14:43:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4203.084010 secs 2024-07-26T14:43:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4203.084010 secs 2024-07-26T14:43:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:17 smithi146 ceph-mon[35807]: pgmap v4797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:17 smithi076 ceph-mon[35401]: pgmap v4797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:17 smithi040 ceph-mon[32397]: pgmap v4797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:19 smithi146 ceph-mon[35807]: pgmap v4798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:19 smithi076 ceph-mon[35401]: pgmap v4798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:19 smithi040 ceph-mon[32397]: pgmap v4798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:21 smithi146 ceph-mon[35807]: pgmap v4799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4208.084153 secs 2024-07-26T14:43:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:21 smithi076 ceph-mon[35401]: pgmap v4799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4208.084153 secs 2024-07-26T14:43:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:21 smithi040 ceph-mon[32397]: pgmap v4799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4208.084153 secs 2024-07-26T14:43:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:23 smithi146 ceph-mon[35807]: pgmap v4800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:23 smithi076 ceph-mon[35401]: pgmap v4800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:23 smithi040 ceph-mon[32397]: pgmap v4800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:25 smithi146 ceph-mon[35807]: pgmap v4801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:25 smithi076 ceph-mon[35401]: pgmap v4801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:25 smithi040 ceph-mon[32397]: pgmap v4801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4213.084304 secs 2024-07-26T14:43:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4213.084304 secs 2024-07-26T14:43:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4213.084304 secs 2024-07-26T14:43:27.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:27 smithi076 ceph-mon[35401]: pgmap v4802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:27 smithi040 ceph-mon[32397]: pgmap v4802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:27 smithi146 ceph-mon[35807]: pgmap v4802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:29 smithi040 ceph-mon[32397]: pgmap v4803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:29 smithi146 ceph-mon[35807]: pgmap v4803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:29 smithi076 ceph-mon[35401]: pgmap v4803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:31.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:31 smithi076 ceph-mon[35401]: pgmap v4804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:31.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4218.084391 secs 2024-07-26T14:43:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:31 smithi040 ceph-mon[32397]: pgmap v4804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4218.084391 secs 2024-07-26T14:43:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:31 smithi146 ceph-mon[35807]: pgmap v4804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4218.084391 secs 2024-07-26T14:43:33.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:33 smithi146 ceph-mon[35807]: pgmap v4805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:33 smithi040 ceph-mon[32397]: pgmap v4805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:33 smithi076 ceph-mon[35401]: pgmap v4805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:35 smithi040 ceph-mon[32397]: pgmap v4806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:35 smithi146 ceph-mon[35807]: pgmap v4806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:35 smithi076 ceph-mon[35401]: pgmap v4806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4223.084535 secs 2024-07-26T14:43:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4223.084535 secs 2024-07-26T14:43:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4223.084535 secs 2024-07-26T14:43:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:37 smithi040 ceph-mon[32397]: pgmap v4807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:37 smithi146 ceph-mon[35807]: pgmap v4807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:37 smithi076 ceph-mon[35401]: pgmap v4807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:39 smithi040 ceph-mon[32397]: pgmap v4808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:39 smithi146 ceph-mon[35807]: pgmap v4808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:39 smithi076 ceph-mon[35401]: pgmap v4808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4228.084676 secs 2024-07-26T14:43:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:41 smithi040 ceph-mon[32397]: pgmap v4809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4228.084676 secs 2024-07-26T14:43:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:41 smithi146 ceph-mon[35807]: pgmap v4809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4228.084676 secs 2024-07-26T14:43:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:41 smithi076 ceph-mon[35401]: pgmap v4809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:43 smithi040 ceph-mon[32397]: pgmap v4810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:43 smithi146 ceph-mon[35807]: pgmap v4810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:43 smithi076 ceph-mon[35401]: pgmap v4810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:45 smithi040 ceph-mon[32397]: pgmap v4811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:45 smithi146 ceph-mon[35807]: pgmap v4811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:45 smithi076 ceph-mon[35401]: pgmap v4811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4233.084770 secs 2024-07-26T14:43:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4233.084770 secs 2024-07-26T14:43:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4233.084770 secs 2024-07-26T14:43:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:47 smithi040 ceph-mon[32397]: pgmap v4812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:47 smithi146 ceph-mon[35807]: pgmap v4812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:47 smithi076 ceph-mon[35401]: pgmap v4812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:49 smithi040 ceph-mon[32397]: pgmap v4813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:49 smithi146 ceph-mon[35807]: pgmap v4813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:49 smithi076 ceph-mon[35401]: pgmap v4813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:43:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4238.084916 secs 2024-07-26T14:43:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:51 smithi040 ceph-mon[32397]: pgmap v4814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4238.084916 secs 2024-07-26T14:43:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:51 smithi146 ceph-mon[35807]: pgmap v4814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4238.084916 secs 2024-07-26T14:43:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:51 smithi076 ceph-mon[35401]: pgmap v4814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:53 smithi040 ceph-mon[32397]: pgmap v4815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:53 smithi146 ceph-mon[35807]: pgmap v4815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:53 smithi076 ceph-mon[35401]: pgmap v4815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:55 smithi040 ceph-mon[32397]: pgmap v4816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:55 smithi146 ceph-mon[35807]: pgmap v4816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:55 smithi076 ceph-mon[35401]: pgmap v4816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:43:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4243.085059 secs 2024-07-26T14:43:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4243.085059 secs 2024-07-26T14:43:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4243.085059 secs 2024-07-26T14:43:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:57 smithi040 ceph-mon[32397]: pgmap v4817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:57 smithi146 ceph-mon[35807]: pgmap v4817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:57 smithi076 ceph-mon[35401]: pgmap v4817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:43:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:43:59 smithi040 ceph-mon[32397]: pgmap v4818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:43:59 smithi146 ceph-mon[35807]: pgmap v4818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:43:59 smithi076 ceph-mon[35401]: pgmap v4818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4248.085201 secs 2024-07-26T14:44:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:01 smithi040 ceph-mon[32397]: pgmap v4819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:44:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4248.085201 secs 2024-07-26T14:44:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:01 smithi146 ceph-mon[35807]: pgmap v4819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:44:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4248.085201 secs 2024-07-26T14:44:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:01 smithi076 ceph-mon[35401]: pgmap v4819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:44:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:03 smithi146 ceph-mon[35807]: pgmap v4820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:03 smithi076 ceph-mon[35401]: pgmap v4820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:03 smithi040 ceph-mon[32397]: pgmap v4820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:05 smithi146 ceph-mon[35807]: pgmap v4821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:05 smithi076 ceph-mon[35401]: pgmap v4821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:05 smithi040 ceph-mon[32397]: pgmap v4821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4253.085347 secs 2024-07-26T14:44:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4253.085347 secs 2024-07-26T14:44:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4253.085347 secs 2024-07-26T14:44:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:07 smithi146 ceph-mon[35807]: pgmap v4822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:07 smithi076 ceph-mon[35401]: pgmap v4822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:07 smithi040 ceph-mon[32397]: pgmap v4822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:09 smithi146 ceph-mon[35807]: pgmap v4823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:09 smithi076 ceph-mon[35401]: pgmap v4823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:09 smithi040 ceph-mon[32397]: pgmap v4823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:12.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4258.085513 secs 2024-07-26T14:44:12.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:11 smithi040 ceph-mon[32397]: pgmap v4824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4258.085513 secs 2024-07-26T14:44:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:11 smithi146 ceph-mon[35807]: pgmap v4824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:12.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4258.085513 secs 2024-07-26T14:44:12.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:11 smithi076 ceph-mon[35401]: pgmap v4824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:13 smithi146 ceph-mon[35807]: pgmap v4825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:13 smithi076 ceph-mon[35401]: pgmap v4825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:13 smithi040 ceph-mon[32397]: pgmap v4825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:15 smithi146 ceph-mon[35807]: pgmap v4826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:15 smithi076 ceph-mon[35401]: pgmap v4826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:15 smithi040 ceph-mon[32397]: pgmap v4826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4263.085649 secs 2024-07-26T14:44:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4263.085649 secs 2024-07-26T14:44:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4263.085649 secs 2024-07-26T14:44:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:17 smithi146 ceph-mon[35807]: pgmap v4827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:17 smithi076 ceph-mon[35401]: pgmap v4827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:17 smithi040 ceph-mon[32397]: pgmap v4827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:19 smithi146 ceph-mon[35807]: pgmap v4828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:19 smithi076 ceph-mon[35401]: pgmap v4828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:19 smithi040 ceph-mon[32397]: pgmap v4828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4268.085782 secs 2024-07-26T14:44:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4268.085782 secs 2024-07-26T14:44:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4268.085782 secs 2024-07-26T14:44:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:21 smithi076 ceph-mon[35401]: pgmap v4829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:21 smithi040 ceph-mon[32397]: pgmap v4829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:21 smithi146 ceph-mon[35807]: pgmap v4829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:23 smithi040 ceph-mon[32397]: pgmap v4830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:23 smithi146 ceph-mon[35807]: pgmap v4830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:23 smithi076 ceph-mon[35401]: pgmap v4830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:25 smithi040 ceph-mon[32397]: pgmap v4831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4273.085935 secs 2024-07-26T14:44:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:25 smithi146 ceph-mon[35807]: pgmap v4831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4273.085935 secs 2024-07-26T14:44:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:25 smithi076 ceph-mon[35401]: pgmap v4831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4273.085935 secs 2024-07-26T14:44:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:27 smithi040 ceph-mon[32397]: pgmap v4832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:27 smithi146 ceph-mon[35807]: pgmap v4832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:27 smithi076 ceph-mon[35401]: pgmap v4832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:29 smithi040 ceph-mon[32397]: pgmap v4833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:29 smithi146 ceph-mon[35807]: pgmap v4833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:29 smithi076 ceph-mon[35401]: pgmap v4833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4278.086077 secs 2024-07-26T14:44:31.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4278.086077 secs 2024-07-26T14:44:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4278.086077 secs 2024-07-26T14:44:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:31 smithi040 ceph-mon[32397]: pgmap v4834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:31 smithi146 ceph-mon[35807]: pgmap v4834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:31 smithi076 ceph-mon[35401]: pgmap v4834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:33 smithi040 ceph-mon[32397]: pgmap v4835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:33 smithi146 ceph-mon[35807]: pgmap v4835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:33 smithi076 ceph-mon[35401]: pgmap v4835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:35 smithi040 ceph-mon[32397]: pgmap v4836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4283.086253 secs 2024-07-26T14:44:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:35 smithi146 ceph-mon[35807]: pgmap v4836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4283.086253 secs 2024-07-26T14:44:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:35 smithi076 ceph-mon[35401]: pgmap v4836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4283.086253 secs 2024-07-26T14:44:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:37 smithi040 ceph-mon[32397]: pgmap v4837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:37 smithi146 ceph-mon[35807]: pgmap v4837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:37 smithi076 ceph-mon[35401]: pgmap v4837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:39 smithi040 ceph-mon[32397]: pgmap v4838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:39 smithi146 ceph-mon[35807]: pgmap v4838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:39 smithi076 ceph-mon[35401]: pgmap v4838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4288.086421 secs 2024-07-26T14:44:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4288.086421 secs 2024-07-26T14:44:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4288.086421 secs 2024-07-26T14:44:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:41 smithi040 ceph-mon[32397]: pgmap v4839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:41 smithi146 ceph-mon[35807]: pgmap v4839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:41 smithi076 ceph-mon[35401]: pgmap v4839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:43 smithi040 ceph-mon[32397]: pgmap v4840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:43 smithi146 ceph-mon[35807]: pgmap v4840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:43 smithi076 ceph-mon[35401]: pgmap v4840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:45 smithi040 ceph-mon[32397]: pgmap v4841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4293.086556 secs 2024-07-26T14:44:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:45 smithi146 ceph-mon[35807]: pgmap v4841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4293.086556 secs 2024-07-26T14:44:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:45 smithi076 ceph-mon[35401]: pgmap v4841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4293.086556 secs 2024-07-26T14:44:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:47 smithi040 ceph-mon[32397]: pgmap v4842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:47 smithi146 ceph-mon[35807]: pgmap v4842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:47 smithi076 ceph-mon[35401]: pgmap v4842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:49 smithi040 ceph-mon[32397]: pgmap v4843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:49 smithi146 ceph-mon[35807]: pgmap v4843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:49 smithi076 ceph-mon[35401]: pgmap v4843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:44:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4298.086708 secs 2024-07-26T14:44:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4298.086708 secs 2024-07-26T14:44:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4298.086708 secs 2024-07-26T14:44:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:51 smithi040 ceph-mon[32397]: pgmap v4844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:51 smithi146 ceph-mon[35807]: pgmap v4844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:51 smithi076 ceph-mon[35401]: pgmap v4844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:53 smithi040 ceph-mon[32397]: pgmap v4845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:53 smithi146 ceph-mon[35807]: pgmap v4845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:53 smithi076 ceph-mon[35401]: pgmap v4845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:55 smithi040 ceph-mon[32397]: pgmap v4846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4303.086795 secs 2024-07-26T14:44:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:55 smithi146 ceph-mon[35807]: pgmap v4846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4303.086795 secs 2024-07-26T14:44:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:55 smithi076 ceph-mon[35401]: pgmap v4846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:44:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4303.086795 secs 2024-07-26T14:44:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:57 smithi146 ceph-mon[35807]: pgmap v4847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:57 smithi076 ceph-mon[35401]: pgmap v4847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:44:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:57 smithi040 ceph-mon[32397]: pgmap v4847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:44:59 smithi146 ceph-mon[35807]: pgmap v4848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:44:59 smithi076 ceph-mon[35401]: pgmap v4848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:44:59 smithi040 ceph-mon[32397]: pgmap v4848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4308.086932 secs 2024-07-26T14:45:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4308.086932 secs 2024-07-26T14:45:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4308.086932 secs 2024-07-26T14:45:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:02 smithi146 ceph-mon[35807]: pgmap v4849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:02 smithi076 ceph-mon[35401]: pgmap v4849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:02 smithi040 ceph-mon[32397]: pgmap v4849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:04 smithi146 ceph-mon[35807]: pgmap v4850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:04 smithi076 ceph-mon[35401]: pgmap v4850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:04 smithi040 ceph-mon[32397]: pgmap v4850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:06 smithi146 ceph-mon[35807]: pgmap v4851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4313.087072 secs 2024-07-26T14:45:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:06 smithi076 ceph-mon[35401]: pgmap v4851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4313.087072 secs 2024-07-26T14:45:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:06 smithi040 ceph-mon[32397]: pgmap v4851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4313.087072 secs 2024-07-26T14:45:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:08 smithi146 ceph-mon[35807]: pgmap v4852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:08 smithi076 ceph-mon[35401]: pgmap v4852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:08 smithi040 ceph-mon[32397]: pgmap v4852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:10 smithi146 ceph-mon[35807]: pgmap v4853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:10 smithi076 ceph-mon[35401]: pgmap v4853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:10 smithi040 ceph-mon[32397]: pgmap v4853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4318.087251 secs 2024-07-26T14:45:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4318.087251 secs 2024-07-26T14:45:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4318.087251 secs 2024-07-26T14:45:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:12 smithi146 ceph-mon[35807]: pgmap v4854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:45:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:12 smithi076 ceph-mon[35401]: pgmap v4854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:45:12.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:12 smithi040 ceph-mon[32397]: pgmap v4854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:45:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:14 smithi146 ceph-mon[35807]: pgmap v4855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:14 smithi076 ceph-mon[35401]: pgmap v4855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:14 smithi040 ceph-mon[32397]: pgmap v4855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:16 smithi146 ceph-mon[35807]: pgmap v4856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4323.087423 secs 2024-07-26T14:45:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:16 smithi076 ceph-mon[35401]: pgmap v4856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4323.087423 secs 2024-07-26T14:45:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:16 smithi040 ceph-mon[32397]: pgmap v4856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4323.087423 secs 2024-07-26T14:45:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:18 smithi076 ceph-mon[35401]: pgmap v4857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:18 smithi040 ceph-mon[32397]: pgmap v4857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:18 smithi146 ceph-mon[35807]: pgmap v4857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:20 smithi040 ceph-mon[32397]: pgmap v4858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:20 smithi146 ceph-mon[35807]: pgmap v4858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:20 smithi076 ceph-mon[35401]: pgmap v4858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:45:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4328.087509 secs 2024-07-26T14:45:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4328.087509 secs 2024-07-26T14:45:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4328.087509 secs 2024-07-26T14:45:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:22 smithi040 ceph-mon[32397]: pgmap v4859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:45:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:22 smithi146 ceph-mon[35807]: pgmap v4859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:45:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:22 smithi076 ceph-mon[35401]: pgmap v4859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:45:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:24 smithi040 ceph-mon[32397]: pgmap v4860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:24 smithi146 ceph-mon[35807]: pgmap v4860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:24 smithi076 ceph-mon[35401]: pgmap v4860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:26 smithi040 ceph-mon[32397]: pgmap v4861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4333.087646 secs 2024-07-26T14:45:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:26 smithi146 ceph-mon[35807]: pgmap v4861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4333.087646 secs 2024-07-26T14:45:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:26 smithi076 ceph-mon[35401]: pgmap v4861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4333.087646 secs 2024-07-26T14:45:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:28 smithi040 ceph-mon[32397]: pgmap v4862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:28 smithi146 ceph-mon[35807]: pgmap v4862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:28 smithi076 ceph-mon[35401]: pgmap v4862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:30 smithi040 ceph-mon[32397]: pgmap v4863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:30 smithi146 ceph-mon[35807]: pgmap v4863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:30 smithi076 ceph-mon[35401]: pgmap v4863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4338.087790 secs 2024-07-26T14:45:31.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4338.087790 secs 2024-07-26T14:45:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4338.087790 secs 2024-07-26T14:45:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:32 smithi040 ceph-mon[32397]: pgmap v4864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:32 smithi146 ceph-mon[35807]: pgmap v4864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:32 smithi076 ceph-mon[35401]: pgmap v4864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:34 smithi040 ceph-mon[32397]: pgmap v4865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:34 smithi146 ceph-mon[35807]: pgmap v4865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:34 smithi076 ceph-mon[35401]: pgmap v4865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:36 smithi040 ceph-mon[32397]: pgmap v4866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4343.087934 secs 2024-07-26T14:45:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:36 smithi146 ceph-mon[35807]: pgmap v4866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4343.087934 secs 2024-07-26T14:45:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:36 smithi076 ceph-mon[35401]: pgmap v4866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4343.087934 secs 2024-07-26T14:45:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:38 smithi040 ceph-mon[32397]: pgmap v4867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:38 smithi146 ceph-mon[35807]: pgmap v4867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:38 smithi076 ceph-mon[35401]: pgmap v4867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:40 smithi040 ceph-mon[32397]: pgmap v4868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:40 smithi146 ceph-mon[35807]: pgmap v4868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:40 smithi076 ceph-mon[35401]: pgmap v4868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4348.088094 secs 2024-07-26T14:45:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4348.088094 secs 2024-07-26T14:45:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4348.088094 secs 2024-07-26T14:45:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:42 smithi040 ceph-mon[32397]: pgmap v4869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:42 smithi146 ceph-mon[35807]: pgmap v4869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:42 smithi076 ceph-mon[35401]: pgmap v4869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:44 smithi040 ceph-mon[32397]: pgmap v4870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:44 smithi146 ceph-mon[35807]: pgmap v4870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:44 smithi076 ceph-mon[35401]: pgmap v4870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:46 smithi040 ceph-mon[32397]: pgmap v4871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4353.088239 secs 2024-07-26T14:45:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:46 smithi146 ceph-mon[35807]: pgmap v4871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4353.088239 secs 2024-07-26T14:45:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:46 smithi076 ceph-mon[35401]: pgmap v4871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4353.088239 secs 2024-07-26T14:45:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:48 smithi040 ceph-mon[32397]: pgmap v4872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:48 smithi146 ceph-mon[35807]: pgmap v4872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:48 smithi076 ceph-mon[35401]: pgmap v4872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:50 smithi040 ceph-mon[32397]: pgmap v4873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:50 smithi146 ceph-mon[35807]: pgmap v4873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:50 smithi076 ceph-mon[35401]: pgmap v4873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:45:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4358.088389 secs 2024-07-26T14:45:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4358.088389 secs 2024-07-26T14:45:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4358.088389 secs 2024-07-26T14:45:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:52 smithi146 ceph-mon[35807]: pgmap v4874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:52 smithi076 ceph-mon[35401]: pgmap v4874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:52 smithi040 ceph-mon[32397]: pgmap v4874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:54 smithi146 ceph-mon[35807]: pgmap v4875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:54 smithi076 ceph-mon[35401]: pgmap v4875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:54 smithi040 ceph-mon[32397]: pgmap v4875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:56 smithi146 ceph-mon[35807]: pgmap v4876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4363.088533 secs 2024-07-26T14:45:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:56 smithi076 ceph-mon[35401]: pgmap v4876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4363.088533 secs 2024-07-26T14:45:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:56 smithi040 ceph-mon[32397]: pgmap v4876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:45:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4363.088533 secs 2024-07-26T14:45:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:45:58 smithi146 ceph-mon[35807]: pgmap v4877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:45:58 smithi076 ceph-mon[35401]: pgmap v4877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:45:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:45:58 smithi040 ceph-mon[32397]: pgmap v4877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:00 smithi146 ceph-mon[35807]: pgmap v4878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:00 smithi076 ceph-mon[35401]: pgmap v4878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:00 smithi040 ceph-mon[32397]: pgmap v4878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4368.088673 secs 2024-07-26T14:46:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4368.088673 secs 2024-07-26T14:46:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4368.088673 secs 2024-07-26T14:46:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:02 smithi146 ceph-mon[35807]: pgmap v4879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:02 smithi076 ceph-mon[35401]: pgmap v4879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:02 smithi040 ceph-mon[32397]: pgmap v4879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:04 smithi146 ceph-mon[35807]: pgmap v4880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:04 smithi076 ceph-mon[35401]: pgmap v4880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:04 smithi040 ceph-mon[32397]: pgmap v4880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:06 smithi146 ceph-mon[35807]: pgmap v4881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4373.088833 secs 2024-07-26T14:46:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:06 smithi076 ceph-mon[35401]: pgmap v4881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4373.088833 secs 2024-07-26T14:46:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:06 smithi040 ceph-mon[32397]: pgmap v4881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4373.088833 secs 2024-07-26T14:46:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:08 smithi146 ceph-mon[35807]: pgmap v4882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:08 smithi076 ceph-mon[35401]: pgmap v4882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:08 smithi040 ceph-mon[32397]: pgmap v4882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:10 smithi146 ceph-mon[35807]: pgmap v4883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:10 smithi076 ceph-mon[35401]: pgmap v4883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:10 smithi040 ceph-mon[32397]: pgmap v4883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4378.088976 secs 2024-07-26T14:46:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4378.088976 secs 2024-07-26T14:46:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4378.088976 secs 2024-07-26T14:46:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:12 smithi076 ceph-mon[35401]: pgmap v4884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:12.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:12 smithi040 ceph-mon[32397]: pgmap v4884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:12 smithi146 ceph-mon[35807]: pgmap v4884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:14 smithi040 ceph-mon[32397]: pgmap v4885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:14 smithi146 ceph-mon[35807]: pgmap v4885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:14 smithi076 ceph-mon[35401]: pgmap v4885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:16 smithi040 ceph-mon[32397]: pgmap v4886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4383.089122 secs 2024-07-26T14:46:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:16 smithi146 ceph-mon[35807]: pgmap v4886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4383.089122 secs 2024-07-26T14:46:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:16 smithi076 ceph-mon[35401]: pgmap v4886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4383.089122 secs 2024-07-26T14:46:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:18 smithi040 ceph-mon[32397]: pgmap v4887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:18 smithi146 ceph-mon[35807]: pgmap v4887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:18 smithi076 ceph-mon[35401]: pgmap v4887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:20 smithi040 ceph-mon[32397]: pgmap v4888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:20 smithi146 ceph-mon[35807]: pgmap v4888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:20 smithi076 ceph-mon[35401]: pgmap v4888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4388.089321 secs 2024-07-26T14:46:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4388.089321 secs 2024-07-26T14:46:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4388.089321 secs 2024-07-26T14:46:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:22 smithi040 ceph-mon[32397]: pgmap v4889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:22 smithi146 ceph-mon[35807]: pgmap v4889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:22 smithi076 ceph-mon[35401]: pgmap v4889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:24 smithi040 ceph-mon[32397]: pgmap v4890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:24 smithi146 ceph-mon[35807]: pgmap v4890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:24 smithi076 ceph-mon[35401]: pgmap v4890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:26 smithi040 ceph-mon[32397]: pgmap v4891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4393.089464 secs 2024-07-26T14:46:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:26 smithi146 ceph-mon[35807]: pgmap v4891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4393.089464 secs 2024-07-26T14:46:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:26 smithi076 ceph-mon[35401]: pgmap v4891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4393.089464 secs 2024-07-26T14:46:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:28 smithi040 ceph-mon[32397]: pgmap v4892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:28 smithi146 ceph-mon[35807]: pgmap v4892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:28 smithi076 ceph-mon[35401]: pgmap v4892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:30 smithi040 ceph-mon[32397]: pgmap v4893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:30 smithi146 ceph-mon[35807]: pgmap v4893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:30 smithi076 ceph-mon[35401]: pgmap v4893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4398.089562 secs 2024-07-26T14:46:31.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4398.089562 secs 2024-07-26T14:46:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4398.089562 secs 2024-07-26T14:46:32.739 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:32 smithi040 ceph-mon[32397]: pgmap v4894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:32 smithi146 ceph-mon[35807]: pgmap v4894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:32 smithi076 ceph-mon[35401]: pgmap v4894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:34 smithi040 ceph-mon[32397]: pgmap v4895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:34 smithi146 ceph-mon[35807]: pgmap v4895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:34 smithi076 ceph-mon[35401]: pgmap v4895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:36 smithi040 ceph-mon[32397]: pgmap v4896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4403.089657 secs 2024-07-26T14:46:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:36 smithi146 ceph-mon[35807]: pgmap v4896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4403.089657 secs 2024-07-26T14:46:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:36 smithi076 ceph-mon[35401]: pgmap v4896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4403.089657 secs 2024-07-26T14:46:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:38 smithi040 ceph-mon[32397]: pgmap v4897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:38 smithi146 ceph-mon[35807]: pgmap v4897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:38 smithi076 ceph-mon[35401]: pgmap v4897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:40 smithi040 ceph-mon[32397]: pgmap v4898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:40 smithi146 ceph-mon[35807]: pgmap v4898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:40 smithi076 ceph-mon[35401]: pgmap v4898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4408.089759 secs 2024-07-26T14:46:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4408.089759 secs 2024-07-26T14:46:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4408.089759 secs 2024-07-26T14:46:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:42 smithi040 ceph-mon[32397]: pgmap v4899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:42 smithi146 ceph-mon[35807]: pgmap v4899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:42 smithi076 ceph-mon[35401]: pgmap v4899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:43 smithi146 ceph-mon[35807]: pgmap v4900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:43 smithi076 ceph-mon[35401]: pgmap v4900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:43 smithi040 ceph-mon[32397]: pgmap v4900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:45 smithi040 ceph-mon[32397]: pgmap v4901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:45 smithi146 ceph-mon[35807]: pgmap v4901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:45 smithi076 ceph-mon[35401]: pgmap v4901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4413.089901 secs 2024-07-26T14:46:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4413.089901 secs 2024-07-26T14:46:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4413.089901 secs 2024-07-26T14:46:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:47 smithi040 ceph-mon[32397]: pgmap v4902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:47 smithi146 ceph-mon[35807]: pgmap v4902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:47 smithi076 ceph-mon[35401]: pgmap v4902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:49 smithi040 ceph-mon[32397]: pgmap v4903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:49 smithi146 ceph-mon[35807]: pgmap v4903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:49 smithi076 ceph-mon[35401]: pgmap v4903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:46:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4418.090037 secs 2024-07-26T14:46:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:51 smithi040 ceph-mon[32397]: pgmap v4904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4418.090037 secs 2024-07-26T14:46:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:51 smithi146 ceph-mon[35807]: pgmap v4904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4418.090037 secs 2024-07-26T14:46:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:51 smithi076 ceph-mon[35401]: pgmap v4904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:53 smithi040 ceph-mon[32397]: pgmap v4905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:53 smithi146 ceph-mon[35807]: pgmap v4905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:53 smithi076 ceph-mon[35401]: pgmap v4905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:55 smithi040 ceph-mon[32397]: pgmap v4906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:55 smithi146 ceph-mon[35807]: pgmap v4906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:55 smithi076 ceph-mon[35401]: pgmap v4906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:46:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4423.090189 secs 2024-07-26T14:46:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4423.090189 secs 2024-07-26T14:46:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4423.090189 secs 2024-07-26T14:46:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:57 smithi146 ceph-mon[35807]: pgmap v4907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:57 smithi076 ceph-mon[35401]: pgmap v4907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:46:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:57 smithi040 ceph-mon[32397]: pgmap v4907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:46:59 smithi146 ceph-mon[35807]: pgmap v4908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:46:59 smithi076 ceph-mon[35401]: pgmap v4908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:46:59 smithi040 ceph-mon[32397]: pgmap v4908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4428.090348 secs 2024-07-26T14:47:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:01 smithi146 ceph-mon[35807]: pgmap v4909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4428.090348 secs 2024-07-26T14:47:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:01 smithi076 ceph-mon[35401]: pgmap v4909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4428.090348 secs 2024-07-26T14:47:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:01 smithi040 ceph-mon[32397]: pgmap v4909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:03 smithi146 ceph-mon[35807]: pgmap v4910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:03 smithi076 ceph-mon[35401]: pgmap v4910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:03 smithi040 ceph-mon[32397]: pgmap v4910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:05 smithi146 ceph-mon[35807]: pgmap v4911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:05 smithi076 ceph-mon[35401]: pgmap v4911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:06.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:05 smithi040 ceph-mon[32397]: pgmap v4911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4433.090440 secs 2024-07-26T14:47:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4433.090440 secs 2024-07-26T14:47:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4433.090440 secs 2024-07-26T14:47:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:07 smithi146 ceph-mon[35807]: pgmap v4912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:07 smithi076 ceph-mon[35401]: pgmap v4912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:07 smithi040 ceph-mon[32397]: pgmap v4912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:09 smithi146 ceph-mon[35807]: pgmap v4913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:09 smithi076 ceph-mon[35401]: pgmap v4913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:09 smithi040 ceph-mon[32397]: pgmap v4913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4438.090581 secs 2024-07-26T14:47:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:11 smithi146 ceph-mon[35807]: pgmap v4914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4438.090581 secs 2024-07-26T14:47:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:11 smithi076 ceph-mon[35401]: pgmap v4914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4438.090581 secs 2024-07-26T14:47:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:11 smithi040 ceph-mon[32397]: pgmap v4914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:13 smithi146 ceph-mon[35807]: pgmap v4915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:13 smithi076 ceph-mon[35401]: pgmap v4915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:13 smithi040 ceph-mon[32397]: pgmap v4915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:15 smithi146 ceph-mon[35807]: pgmap v4916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:15 smithi076 ceph-mon[35401]: pgmap v4916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:15 smithi040 ceph-mon[32397]: pgmap v4916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4443.090754 secs 2024-07-26T14:47:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4443.090754 secs 2024-07-26T14:47:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4443.090754 secs 2024-07-26T14:47:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:17 smithi076 ceph-mon[35401]: pgmap v4917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:17 smithi040 ceph-mon[32397]: pgmap v4917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:17 smithi146 ceph-mon[35807]: pgmap v4917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:19 smithi076 ceph-mon[35401]: pgmap v4918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:19 smithi040 ceph-mon[32397]: pgmap v4918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:19 smithi146 ceph-mon[35807]: pgmap v4918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4448.090893 secs 2024-07-26T14:47:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4448.090893 secs 2024-07-26T14:47:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4448.090893 secs 2024-07-26T14:47:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:21 smithi040 ceph-mon[32397]: pgmap v4919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:21 smithi146 ceph-mon[35807]: pgmap v4919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:21 smithi076 ceph-mon[35401]: pgmap v4919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:23 smithi040 ceph-mon[32397]: pgmap v4920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:23 smithi146 ceph-mon[35807]: pgmap v4920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:23 smithi076 ceph-mon[35401]: pgmap v4920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:25 smithi040 ceph-mon[32397]: pgmap v4921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4453.091034 secs 2024-07-26T14:47:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:25 smithi146 ceph-mon[35807]: pgmap v4921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4453.091034 secs 2024-07-26T14:47:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:25 smithi076 ceph-mon[35401]: pgmap v4921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4453.091034 secs 2024-07-26T14:47:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:27 smithi040 ceph-mon[32397]: pgmap v4922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:27 smithi146 ceph-mon[35807]: pgmap v4922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:28.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:27 smithi076 ceph-mon[35401]: pgmap v4922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:29 smithi040 ceph-mon[32397]: pgmap v4923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:29 smithi146 ceph-mon[35807]: pgmap v4923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:29 smithi076 ceph-mon[35401]: pgmap v4923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4458.091172 secs 2024-07-26T14:47:31.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4458.091172 secs 2024-07-26T14:47:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4458.091172 secs 2024-07-26T14:47:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:31 smithi040 ceph-mon[32397]: pgmap v4924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:31 smithi146 ceph-mon[35807]: pgmap v4924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:31 smithi076 ceph-mon[35401]: pgmap v4924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:33 smithi040 ceph-mon[32397]: pgmap v4925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:33 smithi146 ceph-mon[35807]: pgmap v4925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:34.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:33 smithi076 ceph-mon[35401]: pgmap v4925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:35 smithi040 ceph-mon[32397]: pgmap v4926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4463.091314 secs 2024-07-26T14:47:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:35 smithi146 ceph-mon[35807]: pgmap v4926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4463.091314 secs 2024-07-26T14:47:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:35 smithi076 ceph-mon[35401]: pgmap v4926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4463.091314 secs 2024-07-26T14:47:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:37 smithi040 ceph-mon[32397]: pgmap v4927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:37 smithi146 ceph-mon[35807]: pgmap v4927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:37 smithi076 ceph-mon[35401]: pgmap v4927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:39 smithi040 ceph-mon[32397]: pgmap v4928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:39 smithi146 ceph-mon[35807]: pgmap v4928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:39 smithi076 ceph-mon[35401]: pgmap v4928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4468.091450 secs 2024-07-26T14:47:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4468.091450 secs 2024-07-26T14:47:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4468.091450 secs 2024-07-26T14:47:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:41 smithi040 ceph-mon[32397]: pgmap v4929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:41 smithi146 ceph-mon[35807]: pgmap v4929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:41 smithi076 ceph-mon[35401]: pgmap v4929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:43 smithi040 ceph-mon[32397]: pgmap v4930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:43 smithi146 ceph-mon[35807]: pgmap v4930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:43 smithi076 ceph-mon[35401]: pgmap v4930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:45 smithi040 ceph-mon[32397]: pgmap v4931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4473.091553 secs 2024-07-26T14:47:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:45 smithi146 ceph-mon[35807]: pgmap v4931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4473.091553 secs 2024-07-26T14:47:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:45 smithi076 ceph-mon[35401]: pgmap v4931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4473.091553 secs 2024-07-26T14:47:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:47 smithi040 ceph-mon[32397]: pgmap v4932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:47 smithi146 ceph-mon[35807]: pgmap v4932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:47 smithi076 ceph-mon[35401]: pgmap v4932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:49 smithi040 ceph-mon[32397]: pgmap v4933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:49 smithi146 ceph-mon[35807]: pgmap v4933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:49 smithi076 ceph-mon[35401]: pgmap v4933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:47:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4478.091696 secs 2024-07-26T14:47:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4478.091696 secs 2024-07-26T14:47:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4478.091696 secs 2024-07-26T14:47:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:51 smithi040 ceph-mon[32397]: pgmap v4934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:51 smithi146 ceph-mon[35807]: pgmap v4934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:51 smithi076 ceph-mon[35401]: pgmap v4934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:53 smithi040 ceph-mon[32397]: pgmap v4935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:53 smithi146 ceph-mon[35807]: pgmap v4935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:53 smithi076 ceph-mon[35401]: pgmap v4935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:55 smithi146 ceph-mon[35807]: pgmap v4936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4483.091835 secs 2024-07-26T14:47:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:55 smithi076 ceph-mon[35401]: pgmap v4936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4483.091835 secs 2024-07-26T14:47:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:55 smithi040 ceph-mon[32397]: pgmap v4936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:47:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4483.091835 secs 2024-07-26T14:47:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:47:57 smithi146 ceph-mon[35807]: pgmap v4937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:47:57 smithi076 ceph-mon[35401]: pgmap v4937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:47:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:47:57 smithi040 ceph-mon[32397]: pgmap v4937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:00 smithi146 ceph-mon[35807]: pgmap v4938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:00 smithi076 ceph-mon[35401]: pgmap v4938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:00.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:00 smithi040 ceph-mon[32397]: pgmap v4938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4488.091978 secs 2024-07-26T14:48:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4488.091978 secs 2024-07-26T14:48:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4488.091978 secs 2024-07-26T14:48:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:02 smithi146 ceph-mon[35807]: pgmap v4939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:02 smithi076 ceph-mon[35401]: pgmap v4939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:02 smithi040 ceph-mon[32397]: pgmap v4939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:04 smithi146 ceph-mon[35807]: pgmap v4940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:04 smithi076 ceph-mon[35401]: pgmap v4940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:04.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:04 smithi040 ceph-mon[32397]: pgmap v4940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:06 smithi146 ceph-mon[35807]: pgmap v4941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4493.092116 secs 2024-07-26T14:48:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:06 smithi076 ceph-mon[35401]: pgmap v4941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4493.092116 secs 2024-07-26T14:48:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:06 smithi040 ceph-mon[32397]: pgmap v4941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4493.092116 secs 2024-07-26T14:48:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:08 smithi146 ceph-mon[35807]: pgmap v4942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:08 smithi076 ceph-mon[35401]: pgmap v4942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:08 smithi040 ceph-mon[32397]: pgmap v4942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:10 smithi146 ceph-mon[35807]: pgmap v4943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:10 smithi076 ceph-mon[35401]: pgmap v4943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:10.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:10 smithi040 ceph-mon[32397]: pgmap v4943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4498.092256 secs 2024-07-26T14:48:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4498.092256 secs 2024-07-26T14:48:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4498.092256 secs 2024-07-26T14:48:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:12 smithi146 ceph-mon[35807]: pgmap v4944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:12 smithi076 ceph-mon[35401]: pgmap v4944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:12.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:12 smithi040 ceph-mon[32397]: pgmap v4944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:14 smithi076 ceph-mon[35401]: pgmap v4945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:14.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:14 smithi040 ceph-mon[32397]: pgmap v4945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:14 smithi146 ceph-mon[35807]: pgmap v4945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:16 smithi076 ceph-mon[35401]: pgmap v4946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4503.092398 secs 2024-07-26T14:48:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:16 smithi040 ceph-mon[32397]: pgmap v4946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4503.092398 secs 2024-07-26T14:48:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:16 smithi146 ceph-mon[35807]: pgmap v4946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4503.092398 secs 2024-07-26T14:48:18.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:18 smithi040 ceph-mon[32397]: pgmap v4947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:18.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:18 smithi146 ceph-mon[35807]: pgmap v4947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:18.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:18 smithi076 ceph-mon[35401]: pgmap v4947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:20.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:20 smithi040 ceph-mon[32397]: pgmap v4948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:20.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:20 smithi146 ceph-mon[35807]: pgmap v4948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:20.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:20 smithi076 ceph-mon[35401]: pgmap v4948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4508.092539 secs 2024-07-26T14:48:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4508.092539 secs 2024-07-26T14:48:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4508.092539 secs 2024-07-26T14:48:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:22 smithi040 ceph-mon[32397]: pgmap v4949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:22 smithi146 ceph-mon[35807]: pgmap v4949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:22 smithi076 ceph-mon[35401]: pgmap v4949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:24.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:24 smithi040 ceph-mon[32397]: pgmap v4950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:24.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:24 smithi146 ceph-mon[35807]: pgmap v4950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:24.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:24 smithi076 ceph-mon[35401]: pgmap v4950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:26 smithi040 ceph-mon[32397]: pgmap v4951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4513.092665 secs 2024-07-26T14:48:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:26 smithi146 ceph-mon[35807]: pgmap v4951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4513.092665 secs 2024-07-26T14:48:26.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:26 smithi076 ceph-mon[35401]: pgmap v4951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:26.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4513.092665 secs 2024-07-26T14:48:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:28 smithi040 ceph-mon[32397]: pgmap v4952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:28 smithi146 ceph-mon[35807]: pgmap v4952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:28.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:28 smithi076 ceph-mon[35401]: pgmap v4952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:30 smithi040 ceph-mon[32397]: pgmap v4953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:30 smithi146 ceph-mon[35807]: pgmap v4953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:30.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:30 smithi076 ceph-mon[35401]: pgmap v4953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4518.092812 secs 2024-07-26T14:48:31.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4518.092812 secs 2024-07-26T14:48:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4518.092812 secs 2024-07-26T14:48:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:32 smithi040 ceph-mon[32397]: pgmap v4954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:32 smithi146 ceph-mon[35807]: pgmap v4954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:32 smithi076 ceph-mon[35401]: pgmap v4954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:34 smithi040 ceph-mon[32397]: pgmap v4955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:34 smithi146 ceph-mon[35807]: pgmap v4955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:34.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:34 smithi076 ceph-mon[35401]: pgmap v4955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:36 smithi040 ceph-mon[32397]: pgmap v4956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4523.092972 secs 2024-07-26T14:48:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:36 smithi146 ceph-mon[35807]: pgmap v4956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4523.092972 secs 2024-07-26T14:48:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:36 smithi076 ceph-mon[35401]: pgmap v4956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4523.092972 secs 2024-07-26T14:48:38.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:38 smithi040 ceph-mon[32397]: pgmap v4957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:38 smithi146 ceph-mon[35807]: pgmap v4957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:38.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:38 smithi076 ceph-mon[35401]: pgmap v4957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:40 smithi040 ceph-mon[32397]: pgmap v4958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:40 smithi146 ceph-mon[35807]: pgmap v4958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:40.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:40 smithi076 ceph-mon[35401]: pgmap v4958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4528.093105 secs 2024-07-26T14:48:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4528.093105 secs 2024-07-26T14:48:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4528.093105 secs 2024-07-26T14:48:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:42 smithi040 ceph-mon[32397]: pgmap v4959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:48:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:42 smithi146 ceph-mon[35807]: pgmap v4959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:48:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:42 smithi076 ceph-mon[35401]: pgmap v4959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:48:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:44 smithi040 ceph-mon[32397]: pgmap v4960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:44 smithi146 ceph-mon[35807]: pgmap v4960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:44.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:44 smithi076 ceph-mon[35401]: pgmap v4960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:48:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:46 smithi040 ceph-mon[32397]: pgmap v4961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4533.093189 secs 2024-07-26T14:48:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:46 smithi146 ceph-mon[35807]: pgmap v4961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4533.093189 secs 2024-07-26T14:48:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:46 smithi076 ceph-mon[35401]: pgmap v4961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4533.093189 secs 2024-07-26T14:48:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:48 smithi040 ceph-mon[32397]: pgmap v4962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:48.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:48 smithi146 ceph-mon[35807]: pgmap v4962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:48.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:48 smithi076 ceph-mon[35401]: pgmap v4962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:50.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:50 smithi040 ceph-mon[32397]: pgmap v4963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:50.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:50 smithi146 ceph-mon[35807]: pgmap v4963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:50.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:50 smithi076 ceph-mon[35401]: pgmap v4963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:48:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4538.093332 secs 2024-07-26T14:48:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4538.093332 secs 2024-07-26T14:48:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4538.093332 secs 2024-07-26T14:48:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:52 smithi146 ceph-mon[35807]: pgmap v4964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:52 smithi076 ceph-mon[35401]: pgmap v4964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:52.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:52 smithi040 ceph-mon[32397]: pgmap v4964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:54 smithi146 ceph-mon[35807]: pgmap v4965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:54.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:54 smithi076 ceph-mon[35401]: pgmap v4965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:54 smithi040 ceph-mon[32397]: pgmap v4965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:56 smithi146 ceph-mon[35807]: pgmap v4966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4543.093473 secs 2024-07-26T14:48:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:56 smithi076 ceph-mon[35401]: pgmap v4966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4543.093473 secs 2024-07-26T14:48:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:56 smithi040 ceph-mon[32397]: pgmap v4966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:48:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4543.093473 secs 2024-07-26T14:48:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:48:58 smithi146 ceph-mon[35807]: pgmap v4967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:58.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:48:58 smithi076 ceph-mon[35401]: pgmap v4967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:48:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:48:58 smithi040 ceph-mon[32397]: pgmap v4967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:00 smithi146 ceph-mon[35807]: pgmap v4968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:00.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:00 smithi076 ceph-mon[35401]: pgmap v4968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:00 smithi040 ceph-mon[32397]: pgmap v4968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4548.093617 secs 2024-07-26T14:49:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4548.093617 secs 2024-07-26T14:49:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4548.093617 secs 2024-07-26T14:49:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:02 smithi146 ceph-mon[35807]: pgmap v4969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:02 smithi076 ceph-mon[35401]: pgmap v4969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:02.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:02 smithi040 ceph-mon[32397]: pgmap v4969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:04.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:04 smithi146 ceph-mon[35807]: pgmap v4970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:04.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:04 smithi076 ceph-mon[35401]: pgmap v4970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:04 smithi040 ceph-mon[32397]: pgmap v4970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:06 smithi146 ceph-mon[35807]: pgmap v4971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4553.093760 secs 2024-07-26T14:49:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:06 smithi076 ceph-mon[35401]: pgmap v4971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4553.093760 secs 2024-07-26T14:49:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:06 smithi040 ceph-mon[32397]: pgmap v4971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4553.093760 secs 2024-07-26T14:49:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:08 smithi146 ceph-mon[35807]: pgmap v4972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:08 smithi076 ceph-mon[35401]: pgmap v4972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:08 smithi040 ceph-mon[32397]: pgmap v4972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:10.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:10 smithi146 ceph-mon[35807]: pgmap v4973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:10.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:10 smithi076 ceph-mon[35401]: pgmap v4973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:10 smithi040 ceph-mon[32397]: pgmap v4973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4558.093902 secs 2024-07-26T14:49:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4558.093902 secs 2024-07-26T14:49:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4558.093902 secs 2024-07-26T14:49:12.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:12 smithi040 ceph-mon[32397]: pgmap v4974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:12 smithi146 ceph-mon[35807]: pgmap v4974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:12 smithi076 ceph-mon[35401]: pgmap v4974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:14 smithi040 ceph-mon[32397]: pgmap v4975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:14 smithi146 ceph-mon[35807]: pgmap v4975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:14 smithi076 ceph-mon[35401]: pgmap v4975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:16 smithi040 ceph-mon[32397]: pgmap v4976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4563.094065 secs 2024-07-26T14:49:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:16 smithi146 ceph-mon[35807]: pgmap v4976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4563.094065 secs 2024-07-26T14:49:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:16 smithi076 ceph-mon[35401]: pgmap v4976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4563.094065 secs 2024-07-26T14:49:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:18 smithi040 ceph-mon[32397]: pgmap v4977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:18 smithi146 ceph-mon[35807]: pgmap v4977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:18 smithi076 ceph-mon[35401]: pgmap v4977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:20 smithi040 ceph-mon[32397]: pgmap v4978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:20 smithi146 ceph-mon[35807]: pgmap v4978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:20 smithi076 ceph-mon[35401]: pgmap v4978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4568.094203 secs 2024-07-26T14:49:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4568.094203 secs 2024-07-26T14:49:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4568.094203 secs 2024-07-26T14:49:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:22 smithi040 ceph-mon[32397]: pgmap v4979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:49:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:22 smithi146 ceph-mon[35807]: pgmap v4979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:49:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:22 smithi076 ceph-mon[35401]: pgmap v4979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:49:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:24 smithi040 ceph-mon[32397]: pgmap v4980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:24 smithi146 ceph-mon[35807]: pgmap v4980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:24 smithi076 ceph-mon[35401]: pgmap v4980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:26 smithi040 ceph-mon[32397]: pgmap v4981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4573.094344 secs 2024-07-26T14:49:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:26 smithi146 ceph-mon[35807]: pgmap v4981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4573.094344 secs 2024-07-26T14:49:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:26 smithi076 ceph-mon[35401]: pgmap v4981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4573.094344 secs 2024-07-26T14:49:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:28 smithi040 ceph-mon[32397]: pgmap v4982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:28 smithi146 ceph-mon[35807]: pgmap v4982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:28 smithi076 ceph-mon[35401]: pgmap v4982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:30.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:30 smithi040 ceph-mon[32397]: pgmap v4983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:30 smithi146 ceph-mon[35807]: pgmap v4983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:30 smithi076 ceph-mon[35401]: pgmap v4983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4578.094485 secs 2024-07-26T14:49:31.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4578.094485 secs 2024-07-26T14:49:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4578.094485 secs 2024-07-26T14:49:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:32 smithi040 ceph-mon[32397]: pgmap v4984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:32 smithi146 ceph-mon[35807]: pgmap v4984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:32 smithi076 ceph-mon[35401]: pgmap v4984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:34.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:34 smithi040 ceph-mon[32397]: pgmap v4985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:34 smithi146 ceph-mon[35807]: pgmap v4985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:34 smithi076 ceph-mon[35401]: pgmap v4985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:36 smithi040 ceph-mon[32397]: pgmap v4986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4583.094620 secs 2024-07-26T14:49:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:36 smithi146 ceph-mon[35807]: pgmap v4986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4583.094620 secs 2024-07-26T14:49:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:36 smithi076 ceph-mon[35401]: pgmap v4986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4583.094620 secs 2024-07-26T14:49:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:38 smithi040 ceph-mon[32397]: pgmap v4987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:38 smithi146 ceph-mon[35807]: pgmap v4987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:38 smithi076 ceph-mon[35401]: pgmap v4987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:40 smithi040 ceph-mon[32397]: pgmap v4988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:40 smithi146 ceph-mon[35807]: pgmap v4988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:40 smithi076 ceph-mon[35401]: pgmap v4988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4588.094762 secs 2024-07-26T14:49:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4588.094762 secs 2024-07-26T14:49:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4588.094762 secs 2024-07-26T14:49:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:42 smithi040 ceph-mon[32397]: pgmap v4989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:42 smithi146 ceph-mon[35807]: pgmap v4989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:42 smithi076 ceph-mon[35401]: pgmap v4989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:44 smithi040 ceph-mon[32397]: pgmap v4990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:44 smithi146 ceph-mon[35807]: pgmap v4990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:44 smithi076 ceph-mon[35401]: pgmap v4990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:46 smithi146 ceph-mon[35807]: pgmap v4991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4593.094929 secs 2024-07-26T14:49:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:46 smithi076 ceph-mon[35401]: pgmap v4991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4593.094929 secs 2024-07-26T14:49:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:46 smithi040 ceph-mon[32397]: pgmap v4991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4593.094929 secs 2024-07-26T14:49:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:48 smithi146 ceph-mon[35807]: pgmap v4992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:48 smithi076 ceph-mon[35401]: pgmap v4992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:48 smithi040 ceph-mon[32397]: pgmap v4992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:50 smithi146 ceph-mon[35807]: pgmap v4993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:50 smithi076 ceph-mon[35401]: pgmap v4993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:50 smithi040 ceph-mon[32397]: pgmap v4993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:49:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4598.095045 secs 2024-07-26T14:49:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4598.095045 secs 2024-07-26T14:49:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4598.095045 secs 2024-07-26T14:49:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:52 smithi146 ceph-mon[35807]: pgmap v4994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:52 smithi076 ceph-mon[35401]: pgmap v4994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:52 smithi040 ceph-mon[32397]: pgmap v4994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:53 smithi146 ceph-mon[35807]: pgmap v4995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:53 smithi076 ceph-mon[35401]: pgmap v4995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:53 smithi040 ceph-mon[32397]: pgmap v4995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:55 smithi146 ceph-mon[35807]: pgmap v4996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:55 smithi076 ceph-mon[35401]: pgmap v4996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:55 smithi040 ceph-mon[32397]: pgmap v4996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:49:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4603.095187 secs 2024-07-26T14:49:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4603.095187 secs 2024-07-26T14:49:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4603.095187 secs 2024-07-26T14:49:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:57 smithi076 ceph-mon[35401]: pgmap v4997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:57 smithi040 ceph-mon[32397]: pgmap v4997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:49:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:57 smithi146 ceph-mon[35807]: pgmap v4997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:49:59 smithi076 ceph-mon[35401]: pgmap v4998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:49:59 smithi040 ceph-mon[32397]: pgmap v4998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:49:59 smithi146 ceph-mon[35807]: pgmap v4998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:50:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:50:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T14:50:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4608.095334 secs 2024-07-26T14:50:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:01 smithi040 ceph-mon[32397]: pgmap v4999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:02.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4608.095334 secs 2024-07-26T14:50:02.234 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:01 smithi076 ceph-mon[35401]: pgmap v4999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4608.095334 secs 2024-07-26T14:50:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:01 smithi146 ceph-mon[35807]: pgmap v4999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:03 smithi040 ceph-mon[32397]: pgmap v5000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:03 smithi146 ceph-mon[35807]: pgmap v5000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:03 smithi076 ceph-mon[35401]: pgmap v5000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:06.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:05 smithi146 ceph-mon[35807]: pgmap v5001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:06.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4613.095472 secs 2024-07-26T14:50:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:05 smithi040 ceph-mon[32397]: pgmap v5001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4613.095472 secs 2024-07-26T14:50:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:05 smithi076 ceph-mon[35401]: pgmap v5001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4613.095472 secs 2024-07-26T14:50:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:07 smithi040 ceph-mon[32397]: pgmap v5002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:07 smithi146 ceph-mon[35807]: pgmap v5002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:07 smithi076 ceph-mon[35401]: pgmap v5002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: pgmap v5003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:50:10.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: pgmap v5004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T14:50:10.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: pgmap v5005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:10.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: pgmap v5006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T14:50:10.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: pgmap v5007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:10.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:09 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:50:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: pgmap v5003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: pgmap v5004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T14:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: pgmap v5005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:10.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: pgmap v5006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T14:50:10.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: pgmap v5007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:10.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:09 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: pgmap v5003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T14:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T14:50:10.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T14:50:10.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: pgmap v5004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T14:50:10.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: pgmap v5005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:10.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: pgmap v5006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-07-26T14:50:10.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: pgmap v5007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:10.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:09 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:50:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4618.095610 secs 2024-07-26T14:50:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4618.095610 secs 2024-07-26T14:50:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4618.095610 secs 2024-07-26T14:50:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:11 smithi040 ceph-mon[32397]: pgmap v5008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:11 smithi146 ceph-mon[35807]: pgmap v5008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:11 smithi076 ceph-mon[35401]: pgmap v5008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:14 smithi040 ceph-mon[32397]: pgmap v5009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:14.739 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:14 smithi076 ceph-mon[35401]: pgmap v5009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:14 smithi146 ceph-mon[35807]: pgmap v5009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T14:50:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:16 smithi040 ceph-mon[32397]: pgmap v5010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4623.095767 secs 2024-07-26T14:50:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:16 smithi146 ceph-mon[35807]: pgmap v5010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4623.095767 secs 2024-07-26T14:50:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:16 smithi076 ceph-mon[35401]: pgmap v5010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4623.095767 secs 2024-07-26T14:50:18.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:18 smithi040 ceph-mon[32397]: pgmap v5011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T14:50:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:18 smithi146 ceph-mon[35807]: pgmap v5011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T14:50:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:18 smithi076 ceph-mon[35401]: pgmap v5011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T14:50:20.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:20 smithi040 ceph-mon[32397]: pgmap v5012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:50:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:20 smithi146 ceph-mon[35807]: pgmap v5012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:50:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:20 smithi076 ceph-mon[35401]: pgmap v5012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T14:50:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4628.095924 secs 2024-07-26T14:50:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4628.095924 secs 2024-07-26T14:50:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4628.095924 secs 2024-07-26T14:50:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:22 smithi040 ceph-mon[32397]: pgmap v5013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:22 smithi146 ceph-mon[35807]: pgmap v5013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:22 smithi076 ceph-mon[35401]: pgmap v5013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:24 smithi040 ceph-mon[32397]: pgmap v5014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:24 smithi146 ceph-mon[35807]: pgmap v5014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:24 smithi076 ceph-mon[35401]: pgmap v5014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:26 smithi146 ceph-mon[35807]: pgmap v5015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4633.096070 secs 2024-07-26T14:50:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:26 smithi076 ceph-mon[35401]: pgmap v5015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4633.096070 secs 2024-07-26T14:50:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:26 smithi040 ceph-mon[32397]: pgmap v5015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4633.096070 secs 2024-07-26T14:50:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:28 smithi146 ceph-mon[35807]: pgmap v5016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:28.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:28 smithi076 ceph-mon[35401]: pgmap v5016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:28 smithi040 ceph-mon[32397]: pgmap v5016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:30 smithi146 ceph-mon[35807]: pgmap v5017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:30 smithi076 ceph-mon[35401]: pgmap v5017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:30 smithi040 ceph-mon[32397]: pgmap v5017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4638.096170 secs 2024-07-26T14:50:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4638.096170 secs 2024-07-26T14:50:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4638.096170 secs 2024-07-26T14:50:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:32 smithi146 ceph-mon[35807]: pgmap v5018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:32 smithi076 ceph-mon[35401]: pgmap v5018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:32 smithi040 ceph-mon[32397]: pgmap v5018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:34 smithi146 ceph-mon[35807]: pgmap v5019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:34 smithi076 ceph-mon[35401]: pgmap v5019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:34 smithi040 ceph-mon[32397]: pgmap v5019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:35 smithi076 ceph-mon[35401]: pgmap v5020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:35 smithi040 ceph-mon[32397]: pgmap v5020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:35 smithi146 ceph-mon[35807]: pgmap v5020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4643.096334 secs 2024-07-26T14:50:36.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4643.096334 secs 2024-07-26T14:50:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4643.096334 secs 2024-07-26T14:50:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:37 smithi040 ceph-mon[32397]: pgmap v5021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:37 smithi146 ceph-mon[35807]: pgmap v5021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:37 smithi076 ceph-mon[35401]: pgmap v5021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:40 smithi040 ceph-mon[32397]: pgmap v5022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:40 smithi146 ceph-mon[35807]: pgmap v5022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:40 smithi076 ceph-mon[35401]: pgmap v5022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4648.096483 secs 2024-07-26T14:50:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4648.096483 secs 2024-07-26T14:50:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4648.096483 secs 2024-07-26T14:50:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:42 smithi040 ceph-mon[32397]: pgmap v5023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:42 smithi146 ceph-mon[35807]: pgmap v5023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:42 smithi076 ceph-mon[35401]: pgmap v5023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:44.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:44 smithi040 ceph-mon[32397]: pgmap v5024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:44 smithi146 ceph-mon[35807]: pgmap v5024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:44.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:44 smithi076 ceph-mon[35401]: pgmap v5024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:46 smithi040 ceph-mon[32397]: pgmap v5025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4653.096621 secs 2024-07-26T14:50:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:46 smithi146 ceph-mon[35807]: pgmap v5025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4653.096621 secs 2024-07-26T14:50:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:46 smithi076 ceph-mon[35401]: pgmap v5025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4653.096621 secs 2024-07-26T14:50:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:48 smithi146 ceph-mon[35807]: pgmap v5026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:48 smithi076 ceph-mon[35401]: pgmap v5026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:48 smithi040 ceph-mon[32397]: pgmap v5026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:50 smithi146 ceph-mon[35807]: pgmap v5027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:50 smithi076 ceph-mon[35401]: pgmap v5027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:50 smithi040 ceph-mon[32397]: pgmap v5027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4658.096772 secs 2024-07-26T14:50:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4658.096772 secs 2024-07-26T14:50:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4658.096772 secs 2024-07-26T14:50:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:52 smithi146 ceph-mon[35807]: pgmap v5028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:52 smithi076 ceph-mon[35401]: pgmap v5028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:52 smithi040 ceph-mon[32397]: pgmap v5028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:54 smithi146 ceph-mon[35807]: pgmap v5029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:54 smithi076 ceph-mon[35401]: pgmap v5029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:54 smithi040 ceph-mon[32397]: pgmap v5029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:50:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:56 smithi146 ceph-mon[35807]: pgmap v5030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4663.096858 secs 2024-07-26T14:50:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:56 smithi076 ceph-mon[35401]: pgmap v5030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4663.096858 secs 2024-07-26T14:50:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:56 smithi040 ceph-mon[32397]: pgmap v5030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:50:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4663.096858 secs 2024-07-26T14:50:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:50:57 smithi076 ceph-mon[35401]: pgmap v5031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:50:57 smithi040 ceph-mon[32397]: pgmap v5031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:50:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:50:57 smithi146 ceph-mon[35807]: pgmap v5031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:00 smithi040 ceph-mon[32397]: pgmap v5032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:00 smithi146 ceph-mon[35807]: pgmap v5032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:00 smithi076 ceph-mon[35401]: pgmap v5032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4668.097003 secs 2024-07-26T14:51:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4668.097003 secs 2024-07-26T14:51:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4668.097003 secs 2024-07-26T14:51:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:02 smithi040 ceph-mon[32397]: pgmap v5033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:02.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:02 smithi076 ceph-mon[35401]: pgmap v5033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:02 smithi146 ceph-mon[35807]: pgmap v5033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:04 smithi040 ceph-mon[32397]: pgmap v5034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:04 smithi146 ceph-mon[35807]: pgmap v5034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:04 smithi076 ceph-mon[35401]: pgmap v5034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:06 smithi146 ceph-mon[35807]: pgmap v5035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4673.097163 secs 2024-07-26T14:51:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:06 smithi076 ceph-mon[35401]: pgmap v5035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4673.097163 secs 2024-07-26T14:51:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:06 smithi040 ceph-mon[32397]: pgmap v5035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4673.097163 secs 2024-07-26T14:51:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:07 smithi040 ceph-mon[32397]: pgmap v5036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:07 smithi146 ceph-mon[35807]: pgmap v5036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:07 smithi076 ceph-mon[35401]: pgmap v5036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:10 smithi040 ceph-mon[32397]: pgmap v5037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:51:10.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:10 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:10 smithi146 ceph-mon[35807]: pgmap v5037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:51:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:10 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:10 smithi076 ceph-mon[35401]: pgmap v5037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T14:51:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:10 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:11 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4678.097287 secs 2024-07-26T14:51:11.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:11 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4678.097287 secs 2024-07-26T14:51:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:11 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4678.097287 secs 2024-07-26T14:51:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:12 smithi146 ceph-mon[35807]: pgmap v5038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:12 smithi076 ceph-mon[35401]: pgmap v5038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:12 smithi040 ceph-mon[32397]: pgmap v5038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: pgmap v5039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: pgmap v5039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: pgmap v5039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: pgmap v5040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4683.097381 secs 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:16 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: pgmap v5040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4683.097381 secs 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:16 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: pgmap v5040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4683.097381 secs 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T14:51:16.874 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.874 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.874 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:16.874 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:16 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T14:51:17.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:17 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:51:17.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:17 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:51:17.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:17 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:51:17.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:17 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:51:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:17 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:51:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:17 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:51:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:17 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:51:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:17 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:51:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:17 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T14:51:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:17 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T14:51:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:17 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:51:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:17 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T14:51:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:18 smithi146 ceph-mon[35807]: pgmap v5041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:18 smithi076 ceph-mon[35401]: pgmap v5041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:18.886 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:18 smithi040 ceph-mon[32397]: pgmap v5041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:20 smithi040 ceph-mon[32397]: pgmap v5042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:20 smithi146 ceph-mon[35807]: pgmap v5042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:20 smithi076 ceph-mon[35401]: pgmap v5042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4688.097520 secs 2024-07-26T14:51:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4688.097520 secs 2024-07-26T14:51:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4688.097520 secs 2024-07-26T14:51:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:22 smithi146 ceph-mon[35807]: pgmap v5043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:22 smithi076 ceph-mon[35401]: pgmap v5043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:22 smithi040 ceph-mon[32397]: pgmap v5043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:23 smithi146 ceph-mon[35807]: pgmap v5044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:23 smithi076 ceph-mon[35401]: pgmap v5044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:23 smithi040 ceph-mon[32397]: pgmap v5044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:26 smithi040 ceph-mon[32397]: pgmap v5045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4693.097615 secs 2024-07-26T14:51:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:26 smithi146 ceph-mon[35807]: pgmap v5045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4693.097615 secs 2024-07-26T14:51:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:26 smithi076 ceph-mon[35401]: pgmap v5045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4693.097615 secs 2024-07-26T14:51:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:28 smithi146 ceph-mon[35807]: pgmap v5046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:28 smithi076 ceph-mon[35401]: pgmap v5046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:28 smithi040 ceph-mon[32397]: pgmap v5046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:30 smithi146 ceph-mon[35807]: pgmap v5047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:30 smithi076 ceph-mon[35401]: pgmap v5047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:30.854 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:30 smithi040 ceph-mon[32397]: pgmap v5047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4698.097780 secs 2024-07-26T14:51:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4698.097780 secs 2024-07-26T14:51:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4698.097780 secs 2024-07-26T14:51:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:32 smithi146 ceph-mon[35807]: pgmap v5048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:32 smithi076 ceph-mon[35401]: pgmap v5048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:32 smithi040 ceph-mon[32397]: pgmap v5048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:34 smithi146 ceph-mon[35807]: pgmap v5049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:34 smithi076 ceph-mon[35401]: pgmap v5049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:34 smithi040 ceph-mon[32397]: pgmap v5049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:36 smithi146 ceph-mon[35807]: pgmap v5050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4703.097939 secs 2024-07-26T14:51:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:36 smithi076 ceph-mon[35401]: pgmap v5050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4703.097939 secs 2024-07-26T14:51:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:36 smithi040 ceph-mon[32397]: pgmap v5050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4703.097939 secs 2024-07-26T14:51:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:38 smithi146 ceph-mon[35807]: pgmap v5051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:38 smithi076 ceph-mon[35401]: pgmap v5051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:38 smithi040 ceph-mon[32397]: pgmap v5051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:39 smithi040 ceph-mon[32397]: pgmap v5052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:39 smithi146 ceph-mon[35807]: pgmap v5052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:39 smithi076 ceph-mon[35401]: pgmap v5052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4708.098080 secs 2024-07-26T14:51:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4708.098080 secs 2024-07-26T14:51:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4708.098080 secs 2024-07-26T14:51:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:41 smithi040 ceph-mon[32397]: pgmap v5053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:41 smithi146 ceph-mon[35807]: pgmap v5053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:41 smithi076 ceph-mon[35401]: pgmap v5053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:44.772 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:44 smithi076 ceph-mon[35401]: pgmap v5054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:44 smithi146 ceph-mon[35807]: pgmap v5054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:44 smithi040 ceph-mon[32397]: pgmap v5054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:46 smithi146 ceph-mon[35807]: pgmap v5055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4713.098219 secs 2024-07-26T14:51:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:46 smithi076 ceph-mon[35401]: pgmap v5055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4713.098219 secs 2024-07-26T14:51:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:46 smithi040 ceph-mon[32397]: pgmap v5055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4713.098219 secs 2024-07-26T14:51:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:48 smithi146 ceph-mon[35807]: pgmap v5056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:48 smithi076 ceph-mon[35401]: pgmap v5056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:48 smithi040 ceph-mon[32397]: pgmap v5056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:50 smithi146 ceph-mon[35807]: pgmap v5057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:50 smithi076 ceph-mon[35401]: pgmap v5057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:50 smithi040 ceph-mon[32397]: pgmap v5057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4718.098364 secs 2024-07-26T14:51:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4718.098364 secs 2024-07-26T14:51:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4718.098364 secs 2024-07-26T14:51:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:52 smithi146 ceph-mon[35807]: pgmap v5058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:52 smithi076 ceph-mon[35401]: pgmap v5058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:52 smithi040 ceph-mon[32397]: pgmap v5058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:54 smithi146 ceph-mon[35807]: pgmap v5059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:54.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:54 smithi076 ceph-mon[35401]: pgmap v5059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:54 smithi040 ceph-mon[32397]: pgmap v5059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:51:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:55 smithi040 ceph-mon[32397]: pgmap v5060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:55 smithi146 ceph-mon[35807]: pgmap v5060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:55 smithi076 ceph-mon[35401]: pgmap v5060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:51:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4723.098503 secs 2024-07-26T14:51:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4723.098503 secs 2024-07-26T14:51:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4723.098503 secs 2024-07-26T14:51:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:51:57 smithi040 ceph-mon[32397]: pgmap v5061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:51:57 smithi146 ceph-mon[35807]: pgmap v5061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:51:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:51:57 smithi076 ceph-mon[35401]: pgmap v5061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:00 smithi146 ceph-mon[35807]: pgmap v5062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:00 smithi076 ceph-mon[35401]: pgmap v5062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:00 smithi040 ceph-mon[32397]: pgmap v5062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4728.098605 secs 2024-07-26T14:52:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4728.098605 secs 2024-07-26T14:52:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4728.098605 secs 2024-07-26T14:52:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:02 smithi146 ceph-mon[35807]: pgmap v5063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:02.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:02 smithi076 ceph-mon[35401]: pgmap v5063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:02 smithi040 ceph-mon[32397]: pgmap v5063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:04 smithi146 ceph-mon[35807]: pgmap v5064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:04 smithi076 ceph-mon[35401]: pgmap v5064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:04 smithi040 ceph-mon[32397]: pgmap v5064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:06 smithi146 ceph-mon[35807]: pgmap v5065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4733.098746 secs 2024-07-26T14:52:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:06 smithi076 ceph-mon[35401]: pgmap v5065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4733.098746 secs 2024-07-26T14:52:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:06 smithi040 ceph-mon[32397]: pgmap v5065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4733.098746 secs 2024-07-26T14:52:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:07 smithi040 ceph-mon[32397]: pgmap v5066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:07 smithi146 ceph-mon[35807]: pgmap v5066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:07 smithi076 ceph-mon[35401]: pgmap v5066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:10 smithi146 ceph-mon[35807]: pgmap v5067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:10 smithi076 ceph-mon[35401]: pgmap v5067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:10 smithi040 ceph-mon[32397]: pgmap v5067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4738.098841 secs 2024-07-26T14:52:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4738.098841 secs 2024-07-26T14:52:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4738.098841 secs 2024-07-26T14:52:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:12 smithi146 ceph-mon[35807]: pgmap v5068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:12 smithi076 ceph-mon[35401]: pgmap v5068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:12.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:12 smithi040 ceph-mon[32397]: pgmap v5068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:14 smithi146 ceph-mon[35807]: pgmap v5069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:14.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:14 smithi076 ceph-mon[35401]: pgmap v5069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:14 smithi040 ceph-mon[32397]: pgmap v5069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:16 smithi146 ceph-mon[35807]: pgmap v5070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4743.098974 secs 2024-07-26T14:52:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:16 smithi076 ceph-mon[35401]: pgmap v5070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4743.098974 secs 2024-07-26T14:52:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:16 smithi040 ceph-mon[32397]: pgmap v5070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4743.098974 secs 2024-07-26T14:52:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:17 smithi040 ceph-mon[32397]: pgmap v5071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:17 smithi146 ceph-mon[35807]: pgmap v5071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:17 smithi076 ceph-mon[35401]: pgmap v5071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:20 smithi146 ceph-mon[35807]: pgmap v5072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:20 smithi076 ceph-mon[35401]: pgmap v5072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:20 smithi040 ceph-mon[32397]: pgmap v5072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4748.099064 secs 2024-07-26T14:52:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4748.099064 secs 2024-07-26T14:52:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4748.099064 secs 2024-07-26T14:52:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:22 smithi146 ceph-mon[35807]: pgmap v5073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:22.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:22 smithi076 ceph-mon[35401]: pgmap v5073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:22 smithi040 ceph-mon[32397]: pgmap v5073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:24 smithi146 ceph-mon[35807]: pgmap v5074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:24 smithi076 ceph-mon[35401]: pgmap v5074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:24 smithi040 ceph-mon[32397]: pgmap v5074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:25 smithi040 ceph-mon[32397]: pgmap v5075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:25 smithi146 ceph-mon[35807]: pgmap v5075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:25 smithi076 ceph-mon[35401]: pgmap v5075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4753.099203 secs 2024-07-26T14:52:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4753.099203 secs 2024-07-26T14:52:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4753.099203 secs 2024-07-26T14:52:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:27 smithi040 ceph-mon[32397]: pgmap v5076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:27 smithi146 ceph-mon[35807]: pgmap v5076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:27 smithi076 ceph-mon[35401]: pgmap v5076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:30 smithi146 ceph-mon[35807]: pgmap v5077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:30 smithi076 ceph-mon[35401]: pgmap v5077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:30 smithi040 ceph-mon[32397]: pgmap v5077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4758.099348 secs 2024-07-26T14:52:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4758.099348 secs 2024-07-26T14:52:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4758.099348 secs 2024-07-26T14:52:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:32 smithi146 ceph-mon[35807]: pgmap v5078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:32.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:32 smithi076 ceph-mon[35401]: pgmap v5078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:32 smithi040 ceph-mon[32397]: pgmap v5078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:34 smithi146 ceph-mon[35807]: pgmap v5079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:34 smithi076 ceph-mon[35401]: pgmap v5079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:34 smithi040 ceph-mon[32397]: pgmap v5079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:35 smithi040 ceph-mon[32397]: pgmap v5080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:35 smithi146 ceph-mon[35807]: pgmap v5080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:35 smithi076 ceph-mon[35401]: pgmap v5080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:36.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4763.099474 secs 2024-07-26T14:52:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4763.099474 secs 2024-07-26T14:52:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4763.099474 secs 2024-07-26T14:52:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:37 smithi040 ceph-mon[32397]: pgmap v5081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:37 smithi146 ceph-mon[35807]: pgmap v5081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:37 smithi076 ceph-mon[35401]: pgmap v5081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:40 smithi146 ceph-mon[35807]: pgmap v5082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:40 smithi076 ceph-mon[35401]: pgmap v5082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:40 smithi040 ceph-mon[32397]: pgmap v5082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4768.099613 secs 2024-07-26T14:52:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4768.099613 secs 2024-07-26T14:52:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4768.099613 secs 2024-07-26T14:52:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:42 smithi146 ceph-mon[35807]: pgmap v5083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:42.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:42 smithi076 ceph-mon[35401]: pgmap v5083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:42.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:42 smithi040 ceph-mon[32397]: pgmap v5083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:43 smithi040 ceph-mon[32397]: pgmap v5084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:43 smithi146 ceph-mon[35807]: pgmap v5084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:43 smithi076 ceph-mon[35401]: pgmap v5084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:46 smithi146 ceph-mon[35807]: pgmap v5085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4773.099749 secs 2024-07-26T14:52:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:46 smithi076 ceph-mon[35401]: pgmap v5085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4773.099749 secs 2024-07-26T14:52:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:46 smithi040 ceph-mon[32397]: pgmap v5085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4773.099749 secs 2024-07-26T14:52:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:48 smithi146 ceph-mon[35807]: pgmap v5086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:48.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:48 smithi076 ceph-mon[35401]: pgmap v5086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:48 smithi040 ceph-mon[32397]: pgmap v5086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:50 smithi146 ceph-mon[35807]: pgmap v5087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:50.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:50 smithi076 ceph-mon[35401]: pgmap v5087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:50 smithi040 ceph-mon[32397]: pgmap v5087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4778.099886 secs 2024-07-26T14:52:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4778.099886 secs 2024-07-26T14:52:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4778.099886 secs 2024-07-26T14:52:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:52 smithi146 ceph-mon[35807]: pgmap v5088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:52.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:52 smithi076 ceph-mon[35401]: pgmap v5088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:52 smithi040 ceph-mon[32397]: pgmap v5088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:53 smithi076 ceph-mon[35401]: pgmap v5089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:53 smithi040 ceph-mon[32397]: pgmap v5089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:53 smithi146 ceph-mon[35807]: pgmap v5089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:52:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:56 smithi146 ceph-mon[35807]: pgmap v5090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4783.100045 secs 2024-07-26T14:52:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:56 smithi076 ceph-mon[35401]: pgmap v5090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4783.100045 secs 2024-07-26T14:52:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:56 smithi040 ceph-mon[32397]: pgmap v5090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:52:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4783.100045 secs 2024-07-26T14:52:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:52:58 smithi146 ceph-mon[35807]: pgmap v5091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:58.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:52:58 smithi076 ceph-mon[35401]: pgmap v5091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:52:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:52:58 smithi040 ceph-mon[32397]: pgmap v5091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:00 smithi146 ceph-mon[35807]: pgmap v5092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:00 smithi076 ceph-mon[35401]: pgmap v5092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:00 smithi040 ceph-mon[32397]: pgmap v5092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4788.100207 secs 2024-07-26T14:53:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:01 smithi146 ceph-mon[35807]: pgmap v5093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4788.100207 secs 2024-07-26T14:53:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:01 smithi076 ceph-mon[35401]: pgmap v5093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4788.100207 secs 2024-07-26T14:53:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:01 smithi040 ceph-mon[32397]: pgmap v5093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:04 smithi146 ceph-mon[35807]: pgmap v5094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:04 smithi076 ceph-mon[35401]: pgmap v5094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:04 smithi040 ceph-mon[32397]: pgmap v5094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:06 smithi146 ceph-mon[35807]: pgmap v5095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4793.100348 secs 2024-07-26T14:53:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:06 smithi076 ceph-mon[35401]: pgmap v5095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4793.100348 secs 2024-07-26T14:53:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:06 smithi040 ceph-mon[32397]: pgmap v5095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4793.100348 secs 2024-07-26T14:53:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:07 smithi040 ceph-mon[32397]: pgmap v5096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:07 smithi146 ceph-mon[35807]: pgmap v5096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:07 smithi076 ceph-mon[35401]: pgmap v5096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:10.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:10 smithi146 ceph-mon[35807]: pgmap v5097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:10.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:10 smithi076 ceph-mon[35401]: pgmap v5097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:10 smithi040 ceph-mon[32397]: pgmap v5097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4798.100490 secs 2024-07-26T14:53:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4798.100490 secs 2024-07-26T14:53:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4798.100490 secs 2024-07-26T14:53:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:12 smithi146 ceph-mon[35807]: pgmap v5098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:12.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:12 smithi076 ceph-mon[35401]: pgmap v5098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:12.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:12 smithi040 ceph-mon[32397]: pgmap v5098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:13 smithi076 ceph-mon[35401]: pgmap v5099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:13 smithi040 ceph-mon[32397]: pgmap v5099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:13 smithi146 ceph-mon[35807]: pgmap v5099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:16 smithi146 ceph-mon[35807]: pgmap v5100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4803.100611 secs 2024-07-26T14:53:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:16 smithi076 ceph-mon[35401]: pgmap v5100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4803.100611 secs 2024-07-26T14:53:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:16 smithi040 ceph-mon[32397]: pgmap v5100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4803.100611 secs 2024-07-26T14:53:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:18 smithi146 ceph-mon[35807]: pgmap v5101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:18.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:18 smithi076 ceph-mon[35401]: pgmap v5101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:18 smithi040 ceph-mon[32397]: pgmap v5101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:19 smithi146 ceph-mon[35807]: pgmap v5102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:19 smithi076 ceph-mon[35401]: pgmap v5102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:19 smithi040 ceph-mon[32397]: pgmap v5102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4808.100749 secs 2024-07-26T14:53:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4808.100749 secs 2024-07-26T14:53:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4808.100749 secs 2024-07-26T14:53:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:21 smithi040 ceph-mon[32397]: pgmap v5103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:21 smithi146 ceph-mon[35807]: pgmap v5103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:21 smithi076 ceph-mon[35401]: pgmap v5103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:24 smithi146 ceph-mon[35807]: pgmap v5104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:24 smithi076 ceph-mon[35401]: pgmap v5104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:24 smithi040 ceph-mon[32397]: pgmap v5104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:25 smithi040 ceph-mon[32397]: pgmap v5105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:25 smithi146 ceph-mon[35807]: pgmap v5105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:25 smithi076 ceph-mon[35401]: pgmap v5105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4813.100833 secs 2024-07-26T14:53:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4813.100833 secs 2024-07-26T14:53:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4813.100833 secs 2024-07-26T14:53:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:27 smithi040 ceph-mon[32397]: pgmap v5106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:27 smithi146 ceph-mon[35807]: pgmap v5106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:27 smithi076 ceph-mon[35401]: pgmap v5106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:30 smithi146 ceph-mon[35807]: pgmap v5107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:30 smithi076 ceph-mon[35401]: pgmap v5107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:30 smithi040 ceph-mon[32397]: pgmap v5107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4818.100972 secs 2024-07-26T14:53:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:31 smithi076 ceph-mon[35401]: pgmap v5108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4818.100972 secs 2024-07-26T14:53:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:31 smithi040 ceph-mon[32397]: pgmap v5108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4818.100972 secs 2024-07-26T14:53:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:31 smithi146 ceph-mon[35807]: pgmap v5108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:33 smithi040 ceph-mon[32397]: pgmap v5109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:33 smithi146 ceph-mon[35807]: pgmap v5109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:33 smithi076 ceph-mon[35401]: pgmap v5109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:35.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:35 smithi076 ceph-mon[35401]: pgmap v5110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:35 smithi040 ceph-mon[32397]: pgmap v5110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:35 smithi146 ceph-mon[35807]: pgmap v5110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:36.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4823.101106 secs 2024-07-26T14:53:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4823.101106 secs 2024-07-26T14:53:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4823.101106 secs 2024-07-26T14:53:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:37 smithi040 ceph-mon[32397]: pgmap v5111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:37 smithi146 ceph-mon[35807]: pgmap v5111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:37 smithi076 ceph-mon[35401]: pgmap v5111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:39 smithi040 ceph-mon[32397]: pgmap v5112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:39 smithi146 ceph-mon[35807]: pgmap v5112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:39 smithi076 ceph-mon[35401]: pgmap v5112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4828.101244 secs 2024-07-26T14:53:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4828.101244 secs 2024-07-26T14:53:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4828.101244 secs 2024-07-26T14:53:42.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:41 smithi040 ceph-mon[32397]: pgmap v5113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:41 smithi146 ceph-mon[35807]: pgmap v5113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:41 smithi076 ceph-mon[35401]: pgmap v5113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:43 smithi040 ceph-mon[32397]: pgmap v5114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:43 smithi146 ceph-mon[35807]: pgmap v5114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:43 smithi076 ceph-mon[35401]: pgmap v5114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:45 smithi040 ceph-mon[32397]: pgmap v5115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:45 smithi146 ceph-mon[35807]: pgmap v5115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:45 smithi076 ceph-mon[35401]: pgmap v5115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4833.101393 secs 2024-07-26T14:53:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4833.101393 secs 2024-07-26T14:53:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4833.101393 secs 2024-07-26T14:53:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:47 smithi040 ceph-mon[32397]: pgmap v5116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:47 smithi146 ceph-mon[35807]: pgmap v5116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:47 smithi076 ceph-mon[35401]: pgmap v5116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:49 smithi040 ceph-mon[32397]: pgmap v5117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:49 smithi146 ceph-mon[35807]: pgmap v5117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:49 smithi076 ceph-mon[35401]: pgmap v5117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:53:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4838.101563 secs 2024-07-26T14:53:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4838.101563 secs 2024-07-26T14:53:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4838.101563 secs 2024-07-26T14:53:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:51 smithi040 ceph-mon[32397]: pgmap v5118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:51 smithi146 ceph-mon[35807]: pgmap v5118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:51 smithi076 ceph-mon[35401]: pgmap v5118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:53:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:53 smithi040 ceph-mon[32397]: pgmap v5119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:53 smithi146 ceph-mon[35807]: pgmap v5119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:53 smithi076 ceph-mon[35401]: pgmap v5119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:53:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:55 smithi040 ceph-mon[32397]: pgmap v5120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:53:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:55 smithi146 ceph-mon[35807]: pgmap v5120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:53:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:55 smithi076 ceph-mon[35401]: pgmap v5120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:53:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4843.101718 secs 2024-07-26T14:53:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4843.101718 secs 2024-07-26T14:53:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4843.101718 secs 2024-07-26T14:53:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:57 smithi040 ceph-mon[32397]: pgmap v5121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:53:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:57 smithi146 ceph-mon[35807]: pgmap v5121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:53:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:57 smithi076 ceph-mon[35401]: pgmap v5121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:53:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:53:59 smithi040 ceph-mon[32397]: pgmap v5122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:53:59 smithi146 ceph-mon[35807]: pgmap v5122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:53:59 smithi076 ceph-mon[35401]: pgmap v5122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4848.101855 secs 2024-07-26T14:54:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4848.101855 secs 2024-07-26T14:54:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4848.101855 secs 2024-07-26T14:54:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:01 smithi040 ceph-mon[32397]: pgmap v5123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:54:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:01 smithi146 ceph-mon[35807]: pgmap v5123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:54:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:01 smithi076 ceph-mon[35401]: pgmap v5123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:54:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:03 smithi040 ceph-mon[32397]: pgmap v5124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:54:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:03 smithi146 ceph-mon[35807]: pgmap v5124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:54:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:03 smithi076 ceph-mon[35401]: pgmap v5124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:54:05.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:05 smithi076 ceph-mon[35401]: pgmap v5125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:54:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:05 smithi040 ceph-mon[32397]: pgmap v5125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:54:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:05 smithi146 ceph-mon[35807]: pgmap v5125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:54:06.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4853.101994 secs 2024-07-26T14:54:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4853.101994 secs 2024-07-26T14:54:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4853.101994 secs 2024-07-26T14:54:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:07 smithi040 ceph-mon[32397]: pgmap v5126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:07 smithi146 ceph-mon[35807]: pgmap v5126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:07 smithi076 ceph-mon[35401]: pgmap v5126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:09 smithi040 ceph-mon[32397]: pgmap v5127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:09 smithi146 ceph-mon[35807]: pgmap v5127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:09 smithi076 ceph-mon[35401]: pgmap v5127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4858.102136 secs 2024-07-26T14:54:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4858.102136 secs 2024-07-26T14:54:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4858.102136 secs 2024-07-26T14:54:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:11 smithi040 ceph-mon[32397]: pgmap v5128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:11 smithi146 ceph-mon[35807]: pgmap v5128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:11 smithi076 ceph-mon[35401]: pgmap v5128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:13 smithi040 ceph-mon[32397]: pgmap v5129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:13 smithi146 ceph-mon[35807]: pgmap v5129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:13 smithi076 ceph-mon[35401]: pgmap v5129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:15 smithi040 ceph-mon[32397]: pgmap v5130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:15 smithi146 ceph-mon[35807]: pgmap v5130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:15 smithi076 ceph-mon[35401]: pgmap v5130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4863.102319 secs 2024-07-26T14:54:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4863.102319 secs 2024-07-26T14:54:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4863.102319 secs 2024-07-26T14:54:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:17 smithi040 ceph-mon[32397]: pgmap v5131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:17 smithi146 ceph-mon[35807]: pgmap v5131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:17 smithi076 ceph-mon[35401]: pgmap v5131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:19 smithi040 ceph-mon[32397]: pgmap v5132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:19 smithi146 ceph-mon[35807]: pgmap v5132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:19 smithi076 ceph-mon[35401]: pgmap v5132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4868.102453 secs 2024-07-26T14:54:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4868.102453 secs 2024-07-26T14:54:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4868.102453 secs 2024-07-26T14:54:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:21 smithi040 ceph-mon[32397]: pgmap v5133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:21 smithi146 ceph-mon[35807]: pgmap v5133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:21 smithi076 ceph-mon[35401]: pgmap v5133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:23 smithi040 ceph-mon[32397]: pgmap v5134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:23 smithi146 ceph-mon[35807]: pgmap v5134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:23 smithi076 ceph-mon[35401]: pgmap v5134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:25 smithi040 ceph-mon[32397]: pgmap v5135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:25 smithi146 ceph-mon[35807]: pgmap v5135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:25 smithi076 ceph-mon[35401]: pgmap v5135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4873.102589 secs 2024-07-26T14:54:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4873.102589 secs 2024-07-26T14:54:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4873.102589 secs 2024-07-26T14:54:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:27 smithi040 ceph-mon[32397]: pgmap v5136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:27 smithi146 ceph-mon[35807]: pgmap v5136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:27 smithi076 ceph-mon[35401]: pgmap v5136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:29 smithi040 ceph-mon[32397]: pgmap v5137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:29 smithi146 ceph-mon[35807]: pgmap v5137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:29 smithi076 ceph-mon[35401]: pgmap v5137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4878.102682 secs 2024-07-26T14:54:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4878.102682 secs 2024-07-26T14:54:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4878.102682 secs 2024-07-26T14:54:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:31 smithi040 ceph-mon[32397]: pgmap v5138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:31 smithi146 ceph-mon[35807]: pgmap v5138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:31 smithi076 ceph-mon[35401]: pgmap v5138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:33 smithi040 ceph-mon[32397]: pgmap v5139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:33 smithi146 ceph-mon[35807]: pgmap v5139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:33 smithi076 ceph-mon[35401]: pgmap v5139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:35.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:35 smithi076 ceph-mon[35401]: pgmap v5140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:54:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:35 smithi040 ceph-mon[32397]: pgmap v5140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:54:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:35 smithi146 ceph-mon[35807]: pgmap v5140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:54:36.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4883.102831 secs 2024-07-26T14:54:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4883.102831 secs 2024-07-26T14:54:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4883.102831 secs 2024-07-26T14:54:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:37 smithi040 ceph-mon[32397]: pgmap v5141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:37 smithi146 ceph-mon[35807]: pgmap v5141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:37 smithi076 ceph-mon[35401]: pgmap v5141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:39 smithi040 ceph-mon[32397]: pgmap v5142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:39 smithi146 ceph-mon[35807]: pgmap v5142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:39 smithi076 ceph-mon[35401]: pgmap v5142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4888.102972 secs 2024-07-26T14:54:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4888.102972 secs 2024-07-26T14:54:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4888.102972 secs 2024-07-26T14:54:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:41 smithi040 ceph-mon[32397]: pgmap v5143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:41 smithi146 ceph-mon[35807]: pgmap v5143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:41 smithi076 ceph-mon[35401]: pgmap v5143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:43 smithi040 ceph-mon[32397]: pgmap v5144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:43 smithi146 ceph-mon[35807]: pgmap v5144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:43 smithi076 ceph-mon[35401]: pgmap v5144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:45 smithi040 ceph-mon[32397]: pgmap v5145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:45 smithi146 ceph-mon[35807]: pgmap v5145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:45 smithi076 ceph-mon[35401]: pgmap v5145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4893.103125 secs 2024-07-26T14:54:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4893.103125 secs 2024-07-26T14:54:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4893.103125 secs 2024-07-26T14:54:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:47 smithi040 ceph-mon[32397]: pgmap v5146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:47 smithi146 ceph-mon[35807]: pgmap v5146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:47 smithi076 ceph-mon[35401]: pgmap v5146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:49 smithi040 ceph-mon[32397]: pgmap v5147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:49 smithi146 ceph-mon[35807]: pgmap v5147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:49 smithi076 ceph-mon[35401]: pgmap v5147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4898.103310 secs 2024-07-26T14:54:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4898.103310 secs 2024-07-26T14:54:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4898.103310 secs 2024-07-26T14:54:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:51 smithi040 ceph-mon[32397]: pgmap v5148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:51 smithi146 ceph-mon[35807]: pgmap v5148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:51 smithi076 ceph-mon[35401]: pgmap v5148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:53 smithi040 ceph-mon[32397]: pgmap v5149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:53 smithi146 ceph-mon[35807]: pgmap v5149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:53 smithi076 ceph-mon[35401]: pgmap v5149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:54:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:55 smithi040 ceph-mon[32397]: pgmap v5150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:55 smithi146 ceph-mon[35807]: pgmap v5150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:55 smithi076 ceph-mon[35401]: pgmap v5150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:54:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4903.103407 secs 2024-07-26T14:54:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4903.103407 secs 2024-07-26T14:54:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4903.103407 secs 2024-07-26T14:54:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:57 smithi040 ceph-mon[32397]: pgmap v5151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:57 smithi146 ceph-mon[35807]: pgmap v5151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:57 smithi076 ceph-mon[35401]: pgmap v5151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:54:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:54:59 smithi040 ceph-mon[32397]: pgmap v5152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:54:59 smithi146 ceph-mon[35807]: pgmap v5152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:54:59 smithi076 ceph-mon[35401]: pgmap v5152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4908.103549 secs 2024-07-26T14:55:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4908.103549 secs 2024-07-26T14:55:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4908.103549 secs 2024-07-26T14:55:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:01 smithi040 ceph-mon[32397]: pgmap v5153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:01 smithi146 ceph-mon[35807]: pgmap v5153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:01 smithi076 ceph-mon[35401]: pgmap v5153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:03 smithi040 ceph-mon[32397]: pgmap v5154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:03 smithi146 ceph-mon[35807]: pgmap v5154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:03 smithi076 ceph-mon[35401]: pgmap v5154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:05.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:05 smithi076 ceph-mon[35401]: pgmap v5155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:05 smithi040 ceph-mon[32397]: pgmap v5155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:05 smithi146 ceph-mon[35807]: pgmap v5155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:06.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4913.103698 secs 2024-07-26T14:55:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4913.103698 secs 2024-07-26T14:55:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4913.103698 secs 2024-07-26T14:55:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:07 smithi076 ceph-mon[35401]: pgmap v5156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:07 smithi040 ceph-mon[32397]: pgmap v5156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:07 smithi146 ceph-mon[35807]: pgmap v5156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:09 smithi040 ceph-mon[32397]: pgmap v5157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:09 smithi146 ceph-mon[35807]: pgmap v5157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:09 smithi076 ceph-mon[35401]: pgmap v5157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4918.103841 secs 2024-07-26T14:55:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4918.103841 secs 2024-07-26T14:55:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4918.103841 secs 2024-07-26T14:55:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:11 smithi040 ceph-mon[32397]: pgmap v5158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:11 smithi146 ceph-mon[35807]: pgmap v5158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:11 smithi076 ceph-mon[35401]: pgmap v5158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:13 smithi040 ceph-mon[32397]: pgmap v5159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:13 smithi146 ceph-mon[35807]: pgmap v5159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:13 smithi076 ceph-mon[35401]: pgmap v5159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:15 smithi040 ceph-mon[32397]: pgmap v5160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:15 smithi146 ceph-mon[35807]: pgmap v5160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:15 smithi076 ceph-mon[35401]: pgmap v5160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4923.103978 secs 2024-07-26T14:55:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4923.103978 secs 2024-07-26T14:55:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4923.103978 secs 2024-07-26T14:55:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:17 smithi040 ceph-mon[32397]: pgmap v5161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:17 smithi146 ceph-mon[35807]: pgmap v5161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:17 smithi076 ceph-mon[35401]: pgmap v5161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:19 smithi040 ceph-mon[32397]: pgmap v5162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:19 smithi146 ceph-mon[35807]: pgmap v5162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:20.114 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:19 smithi076 ceph-mon[35401]: pgmap v5162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4928.104128 secs 2024-07-26T14:55:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4928.104128 secs 2024-07-26T14:55:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4928.104128 secs 2024-07-26T14:55:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:21 smithi040 ceph-mon[32397]: pgmap v5163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:21 smithi146 ceph-mon[35807]: pgmap v5163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:21 smithi076 ceph-mon[35401]: pgmap v5163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:23 smithi040 ceph-mon[32397]: pgmap v5164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:23 smithi146 ceph-mon[35807]: pgmap v5164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:23 smithi076 ceph-mon[35401]: pgmap v5164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:25 smithi040 ceph-mon[32397]: pgmap v5165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:25 smithi146 ceph-mon[35807]: pgmap v5165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:25 smithi076 ceph-mon[35401]: pgmap v5165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4933.104305 secs 2024-07-26T14:55:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4933.104305 secs 2024-07-26T14:55:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4933.104305 secs 2024-07-26T14:55:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:27 smithi040 ceph-mon[32397]: pgmap v5166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:27 smithi146 ceph-mon[35807]: pgmap v5166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:27 smithi076 ceph-mon[35401]: pgmap v5166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:29 smithi040 ceph-mon[32397]: pgmap v5167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:29 smithi146 ceph-mon[35807]: pgmap v5167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:29 smithi076 ceph-mon[35401]: pgmap v5167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4938.104452 secs 2024-07-26T14:55:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4938.104452 secs 2024-07-26T14:55:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4938.104452 secs 2024-07-26T14:55:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:31 smithi040 ceph-mon[32397]: pgmap v5168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:31 smithi146 ceph-mon[35807]: pgmap v5168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:31 smithi076 ceph-mon[35401]: pgmap v5168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:33 smithi040 ceph-mon[32397]: pgmap v5169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:33 smithi146 ceph-mon[35807]: pgmap v5169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:33 smithi076 ceph-mon[35401]: pgmap v5169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4943.104585 secs 2024-07-26T14:55:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:36 smithi040 ceph-mon[32397]: pgmap v5170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4943.104585 secs 2024-07-26T14:55:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:36 smithi146 ceph-mon[35807]: pgmap v5170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4943.104585 secs 2024-07-26T14:55:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:36 smithi076 ceph-mon[35401]: pgmap v5170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:38 smithi040 ceph-mon[32397]: pgmap v5171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:38 smithi146 ceph-mon[35807]: pgmap v5171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:38 smithi076 ceph-mon[35401]: pgmap v5171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:40 smithi040 ceph-mon[32397]: pgmap v5172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:40 smithi146 ceph-mon[35807]: pgmap v5172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:40 smithi076 ceph-mon[35401]: pgmap v5172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4948.104734 secs 2024-07-26T14:55:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4948.104734 secs 2024-07-26T14:55:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4948.104734 secs 2024-07-26T14:55:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:42 smithi040 ceph-mon[32397]: pgmap v5173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:42 smithi146 ceph-mon[35807]: pgmap v5173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:42 smithi076 ceph-mon[35401]: pgmap v5173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:44 smithi040 ceph-mon[32397]: pgmap v5174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:44 smithi146 ceph-mon[35807]: pgmap v5174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:44 smithi076 ceph-mon[35401]: pgmap v5174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4953.104875 secs 2024-07-26T14:55:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:46 smithi040 ceph-mon[32397]: pgmap v5175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4953.104875 secs 2024-07-26T14:55:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:46 smithi146 ceph-mon[35807]: pgmap v5175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4953.104875 secs 2024-07-26T14:55:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:46 smithi076 ceph-mon[35401]: pgmap v5175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:48 smithi040 ceph-mon[32397]: pgmap v5176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:48 smithi146 ceph-mon[35807]: pgmap v5176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:48 smithi076 ceph-mon[35401]: pgmap v5176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:50 smithi040 ceph-mon[32397]: pgmap v5177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:50 smithi146 ceph-mon[35807]: pgmap v5177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:50 smithi076 ceph-mon[35401]: pgmap v5177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4958.105020 secs 2024-07-26T14:55:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4958.105020 secs 2024-07-26T14:55:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4958.105020 secs 2024-07-26T14:55:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:52 smithi040 ceph-mon[32397]: pgmap v5178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:52 smithi146 ceph-mon[35807]: pgmap v5178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:52 smithi076 ceph-mon[35401]: pgmap v5178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:54 smithi040 ceph-mon[32397]: pgmap v5179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:54 smithi146 ceph-mon[35807]: pgmap v5179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:54 smithi076 ceph-mon[35401]: pgmap v5179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:55:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4963.105159 secs 2024-07-26T14:55:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:56 smithi040 ceph-mon[32397]: pgmap v5180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4963.105159 secs 2024-07-26T14:55:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:56 smithi146 ceph-mon[35807]: pgmap v5180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4963.105159 secs 2024-07-26T14:55:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:56 smithi076 ceph-mon[35401]: pgmap v5180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:55:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:55:58 smithi146 ceph-mon[35807]: pgmap v5181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:55:58 smithi076 ceph-mon[35401]: pgmap v5181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:55:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:55:58 smithi040 ceph-mon[32397]: pgmap v5181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:00 smithi146 ceph-mon[35807]: pgmap v5182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:00 smithi076 ceph-mon[35401]: pgmap v5182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:00 smithi040 ceph-mon[32397]: pgmap v5182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4968.105304 secs 2024-07-26T14:56:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4968.105304 secs 2024-07-26T14:56:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4968.105304 secs 2024-07-26T14:56:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:02 smithi146 ceph-mon[35807]: pgmap v5183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:02 smithi076 ceph-mon[35401]: pgmap v5183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:02 smithi040 ceph-mon[32397]: pgmap v5183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:04 smithi146 ceph-mon[35807]: pgmap v5184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:04 smithi076 ceph-mon[35401]: pgmap v5184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:04 smithi040 ceph-mon[32397]: pgmap v5184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4973.105464 secs 2024-07-26T14:56:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:06 smithi146 ceph-mon[35807]: pgmap v5185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4973.105464 secs 2024-07-26T14:56:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:06 smithi076 ceph-mon[35401]: pgmap v5185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4973.105464 secs 2024-07-26T14:56:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:06 smithi040 ceph-mon[32397]: pgmap v5185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:08 smithi146 ceph-mon[35807]: pgmap v5186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:08 smithi076 ceph-mon[35401]: pgmap v5186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:08 smithi040 ceph-mon[32397]: pgmap v5186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:10 smithi146 ceph-mon[35807]: pgmap v5187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:10 smithi076 ceph-mon[35401]: pgmap v5187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:10 smithi040 ceph-mon[32397]: pgmap v5187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4978.105620 secs 2024-07-26T14:56:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4978.105620 secs 2024-07-26T14:56:12.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4978.105620 secs 2024-07-26T14:56:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:12 smithi146 ceph-mon[35807]: pgmap v5188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:12 smithi076 ceph-mon[35401]: pgmap v5188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:12 smithi040 ceph-mon[32397]: pgmap v5188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:14 smithi146 ceph-mon[35807]: pgmap v5189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:14 smithi076 ceph-mon[35401]: pgmap v5189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:14 smithi040 ceph-mon[32397]: pgmap v5189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4983.105762 secs 2024-07-26T14:56:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:16 smithi076 ceph-mon[35401]: pgmap v5190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4983.105762 secs 2024-07-26T14:56:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:16 smithi040 ceph-mon[32397]: pgmap v5190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4983.105762 secs 2024-07-26T14:56:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:16 smithi146 ceph-mon[35807]: pgmap v5190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:18 smithi076 ceph-mon[35401]: pgmap v5191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:18 smithi040 ceph-mon[32397]: pgmap v5191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:18 smithi146 ceph-mon[35807]: pgmap v5191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:20 smithi040 ceph-mon[32397]: pgmap v5192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:20 smithi146 ceph-mon[35807]: pgmap v5192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:20 smithi076 ceph-mon[35401]: pgmap v5192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4988.105905 secs 2024-07-26T14:56:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4988.105905 secs 2024-07-26T14:56:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4988.105905 secs 2024-07-26T14:56:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:22 smithi040 ceph-mon[32397]: pgmap v5193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:22 smithi146 ceph-mon[35807]: pgmap v5193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:22 smithi076 ceph-mon[35401]: pgmap v5193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:24 smithi040 ceph-mon[32397]: pgmap v5194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:24 smithi146 ceph-mon[35807]: pgmap v5194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:24 smithi076 ceph-mon[35401]: pgmap v5194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4993.106048 secs 2024-07-26T14:56:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:26 smithi040 ceph-mon[32397]: pgmap v5195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4993.106048 secs 2024-07-26T14:56:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:26 smithi146 ceph-mon[35807]: pgmap v5195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4993.106048 secs 2024-07-26T14:56:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:26 smithi076 ceph-mon[35401]: pgmap v5195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:28 smithi040 ceph-mon[32397]: pgmap v5196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:28 smithi146 ceph-mon[35807]: pgmap v5196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:28 smithi076 ceph-mon[35401]: pgmap v5196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:30 smithi040 ceph-mon[32397]: pgmap v5197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:30 smithi146 ceph-mon[35807]: pgmap v5197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:30 smithi076 ceph-mon[35401]: pgmap v5197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 4998.106194 secs 2024-07-26T14:56:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 4998.106194 secs 2024-07-26T14:56:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 4998.106194 secs 2024-07-26T14:56:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:32 smithi040 ceph-mon[32397]: pgmap v5198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:32 smithi146 ceph-mon[35807]: pgmap v5198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:32 smithi076 ceph-mon[35401]: pgmap v5198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:34 smithi040 ceph-mon[32397]: pgmap v5199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:34 smithi146 ceph-mon[35807]: pgmap v5199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:34 smithi076 ceph-mon[35401]: pgmap v5199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:37.154 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5003.106365 secs 2024-07-26T14:56:37.154 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:36 smithi076 ceph-mon[35401]: pgmap v5200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5003.106365 secs 2024-07-26T14:56:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:36 smithi040 ceph-mon[32397]: pgmap v5200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5003.106365 secs 2024-07-26T14:56:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:36 smithi146 ceph-mon[35807]: pgmap v5200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:38 smithi040 ceph-mon[32397]: pgmap v5201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:38 smithi146 ceph-mon[35807]: pgmap v5201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:38 smithi076 ceph-mon[35401]: pgmap v5201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:40 smithi040 ceph-mon[32397]: pgmap v5202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:40 smithi146 ceph-mon[35807]: pgmap v5202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:40 smithi076 ceph-mon[35401]: pgmap v5202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5008.106496 secs 2024-07-26T14:56:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5008.106496 secs 2024-07-26T14:56:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5008.106496 secs 2024-07-26T14:56:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:42 smithi040 ceph-mon[32397]: pgmap v5203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:42 smithi146 ceph-mon[35807]: pgmap v5203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:42 smithi076 ceph-mon[35401]: pgmap v5203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:44 smithi040 ceph-mon[32397]: pgmap v5204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:44 smithi146 ceph-mon[35807]: pgmap v5204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:44 smithi076 ceph-mon[35401]: pgmap v5204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5013.106661 secs 2024-07-26T14:56:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5013.106661 secs 2024-07-26T14:56:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5013.106661 secs 2024-07-26T14:56:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:46 smithi040 ceph-mon[32397]: pgmap v5205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:46 smithi146 ceph-mon[35807]: pgmap v5205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:46 smithi076 ceph-mon[35401]: pgmap v5205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:48 smithi040 ceph-mon[32397]: pgmap v5206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:48 smithi146 ceph-mon[35807]: pgmap v5206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:48 smithi076 ceph-mon[35401]: pgmap v5206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:50 smithi040 ceph-mon[32397]: pgmap v5207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5018.106809 secs 2024-07-26T14:56:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:50 smithi146 ceph-mon[35807]: pgmap v5207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5018.106809 secs 2024-07-26T14:56:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:50 smithi076 ceph-mon[35401]: pgmap v5207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5018.106809 secs 2024-07-26T14:56:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:52 smithi146 ceph-mon[35807]: pgmap v5208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:52 smithi076 ceph-mon[35401]: pgmap v5208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:52 smithi040 ceph-mon[32397]: pgmap v5208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:54 smithi146 ceph-mon[35807]: pgmap v5209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:54 smithi076 ceph-mon[35401]: pgmap v5209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:54 smithi040 ceph-mon[32397]: pgmap v5209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:56:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5023.106954 secs 2024-07-26T14:56:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5023.106954 secs 2024-07-26T14:56:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5023.106954 secs 2024-07-26T14:56:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:57 smithi146 ceph-mon[35807]: pgmap v5210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:57.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:57 smithi076 ceph-mon[35401]: pgmap v5210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:57 smithi040 ceph-mon[32397]: pgmap v5210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:56:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:56:59 smithi146 ceph-mon[35807]: pgmap v5211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:56:59 smithi076 ceph-mon[35401]: pgmap v5211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:56:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:56:59 smithi040 ceph-mon[32397]: pgmap v5211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:01 smithi146 ceph-mon[35807]: pgmap v5212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5028.107094 secs 2024-07-26T14:57:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:01 smithi076 ceph-mon[35401]: pgmap v5212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5028.107094 secs 2024-07-26T14:57:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:01 smithi040 ceph-mon[32397]: pgmap v5212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5028.107094 secs 2024-07-26T14:57:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:03 smithi146 ceph-mon[35807]: pgmap v5213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:03 smithi076 ceph-mon[35401]: pgmap v5213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:03 smithi040 ceph-mon[32397]: pgmap v5213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:05 smithi146 ceph-mon[35807]: pgmap v5214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:05 smithi076 ceph-mon[35401]: pgmap v5214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:05 smithi040 ceph-mon[32397]: pgmap v5214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5033.107236 secs 2024-07-26T14:57:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5033.107236 secs 2024-07-26T14:57:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5033.107236 secs 2024-07-26T14:57:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:07 smithi146 ceph-mon[35807]: pgmap v5215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:07 smithi076 ceph-mon[35401]: pgmap v5215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:07 smithi040 ceph-mon[32397]: pgmap v5215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:09 smithi146 ceph-mon[35807]: pgmap v5216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:09 smithi076 ceph-mon[35401]: pgmap v5216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:09 smithi040 ceph-mon[32397]: pgmap v5216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:11 smithi146 ceph-mon[35807]: pgmap v5217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5038.107420 secs 2024-07-26T14:57:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:11 smithi076 ceph-mon[35401]: pgmap v5217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5038.107420 secs 2024-07-26T14:57:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:11 smithi040 ceph-mon[32397]: pgmap v5217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5038.107420 secs 2024-07-26T14:57:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:13 smithi076 ceph-mon[35401]: pgmap v5218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:13 smithi040 ceph-mon[32397]: pgmap v5218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:13 smithi146 ceph-mon[35807]: pgmap v5218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:15 smithi040 ceph-mon[32397]: pgmap v5219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:15 smithi146 ceph-mon[35807]: pgmap v5219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:15 smithi076 ceph-mon[35401]: pgmap v5219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5043.107563 secs 2024-07-26T14:57:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5043.107563 secs 2024-07-26T14:57:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5043.107563 secs 2024-07-26T14:57:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:17 smithi040 ceph-mon[32397]: pgmap v5220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:17 smithi146 ceph-mon[35807]: pgmap v5220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:17 smithi076 ceph-mon[35401]: pgmap v5220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:19 smithi040 ceph-mon[32397]: pgmap v5221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:19 smithi146 ceph-mon[35807]: pgmap v5221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:19 smithi076 ceph-mon[35401]: pgmap v5221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:21 smithi040 ceph-mon[32397]: pgmap v5222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5048.107706 secs 2024-07-26T14:57:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:21 smithi146 ceph-mon[35807]: pgmap v5222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5048.107706 secs 2024-07-26T14:57:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:21 smithi076 ceph-mon[35401]: pgmap v5222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5048.107706 secs 2024-07-26T14:57:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:23 smithi040 ceph-mon[32397]: pgmap v5223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:23 smithi146 ceph-mon[35807]: pgmap v5223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:23 smithi076 ceph-mon[35401]: pgmap v5223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:25 smithi040 ceph-mon[32397]: pgmap v5224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:25 smithi146 ceph-mon[35807]: pgmap v5224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:25 smithi076 ceph-mon[35401]: pgmap v5224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5053.107791 secs 2024-07-26T14:57:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5053.107791 secs 2024-07-26T14:57:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5053.107791 secs 2024-07-26T14:57:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:27 smithi040 ceph-mon[32397]: pgmap v5225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:27 smithi146 ceph-mon[35807]: pgmap v5225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:27 smithi076 ceph-mon[35401]: pgmap v5225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:29 smithi040 ceph-mon[32397]: pgmap v5226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:29 smithi146 ceph-mon[35807]: pgmap v5226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:29 smithi076 ceph-mon[35401]: pgmap v5226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:31 smithi040 ceph-mon[32397]: pgmap v5227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5058.107927 secs 2024-07-26T14:57:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:31 smithi146 ceph-mon[35807]: pgmap v5227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5058.107927 secs 2024-07-26T14:57:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:31 smithi076 ceph-mon[35401]: pgmap v5227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5058.107927 secs 2024-07-26T14:57:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:33 smithi040 ceph-mon[32397]: pgmap v5228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:33 smithi146 ceph-mon[35807]: pgmap v5228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:33 smithi076 ceph-mon[35401]: pgmap v5228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:35 smithi040 ceph-mon[32397]: pgmap v5229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:35 smithi146 ceph-mon[35807]: pgmap v5229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:35 smithi076 ceph-mon[35401]: pgmap v5229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5063.108065 secs 2024-07-26T14:57:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5063.108065 secs 2024-07-26T14:57:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5063.108065 secs 2024-07-26T14:57:37.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:37 smithi146 ceph-mon[35807]: pgmap v5230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:37 smithi040 ceph-mon[32397]: pgmap v5230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:37.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:37 smithi076 ceph-mon[35401]: pgmap v5230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:39 smithi040 ceph-mon[32397]: pgmap v5231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:39 smithi146 ceph-mon[35807]: pgmap v5231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:39 smithi076 ceph-mon[35401]: pgmap v5231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:41 smithi040 ceph-mon[32397]: pgmap v5232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5068.108204 secs 2024-07-26T14:57:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:41 smithi146 ceph-mon[35807]: pgmap v5232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5068.108204 secs 2024-07-26T14:57:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:41 smithi076 ceph-mon[35401]: pgmap v5232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5068.108204 secs 2024-07-26T14:57:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:43 smithi040 ceph-mon[32397]: pgmap v5233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:43 smithi146 ceph-mon[35807]: pgmap v5233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:43 smithi076 ceph-mon[35401]: pgmap v5233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:45 smithi040 ceph-mon[32397]: pgmap v5234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:45 smithi146 ceph-mon[35807]: pgmap v5234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:45 smithi076 ceph-mon[35401]: pgmap v5234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5073.108360 secs 2024-07-26T14:57:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5073.108360 secs 2024-07-26T14:57:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5073.108360 secs 2024-07-26T14:57:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:47 smithi146 ceph-mon[35807]: pgmap v5235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:47 smithi076 ceph-mon[35401]: pgmap v5235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:47 smithi040 ceph-mon[32397]: pgmap v5235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:49 smithi146 ceph-mon[35807]: pgmap v5236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:49 smithi076 ceph-mon[35401]: pgmap v5236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:49 smithi040 ceph-mon[32397]: pgmap v5236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:51 smithi146 ceph-mon[35807]: pgmap v5237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5078.108505 secs 2024-07-26T14:57:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:51 smithi076 ceph-mon[35401]: pgmap v5237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5078.108505 secs 2024-07-26T14:57:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:51 smithi040 ceph-mon[32397]: pgmap v5237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5078.108505 secs 2024-07-26T14:57:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:53 smithi146 ceph-mon[35807]: pgmap v5238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:53 smithi076 ceph-mon[35401]: pgmap v5238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:53 smithi040 ceph-mon[32397]: pgmap v5238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:55 smithi146 ceph-mon[35807]: pgmap v5239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:55 smithi076 ceph-mon[35401]: pgmap v5239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:55 smithi040 ceph-mon[32397]: pgmap v5239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:57:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5083.108640 secs 2024-07-26T14:57:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5083.108640 secs 2024-07-26T14:57:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5083.108640 secs 2024-07-26T14:57:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:57 smithi146 ceph-mon[35807]: pgmap v5240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:57 smithi076 ceph-mon[35401]: pgmap v5240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:57 smithi040 ceph-mon[32397]: pgmap v5240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:57:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:57:59 smithi146 ceph-mon[35807]: pgmap v5241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:57:59 smithi076 ceph-mon[35401]: pgmap v5241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:57:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:57:59 smithi040 ceph-mon[32397]: pgmap v5241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:01 smithi146 ceph-mon[35807]: pgmap v5242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5088.108784 secs 2024-07-26T14:58:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:01 smithi076 ceph-mon[35401]: pgmap v5242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5088.108784 secs 2024-07-26T14:58:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:01 smithi040 ceph-mon[32397]: pgmap v5242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5088.108784 secs 2024-07-26T14:58:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:03 smithi146 ceph-mon[35807]: pgmap v5243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:03 smithi076 ceph-mon[35401]: pgmap v5243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:03 smithi040 ceph-mon[32397]: pgmap v5243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:05 smithi076 ceph-mon[35401]: pgmap v5244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:05 smithi040 ceph-mon[32397]: pgmap v5244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:05 smithi146 ceph-mon[35807]: pgmap v5244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5093.108953 secs 2024-07-26T14:58:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5093.108953 secs 2024-07-26T14:58:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5093.108953 secs 2024-07-26T14:58:07.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:07 smithi146 ceph-mon[35807]: pgmap v5245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:07 smithi040 ceph-mon[32397]: pgmap v5245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:07.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:07 smithi076 ceph-mon[35401]: pgmap v5245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:09 smithi040 ceph-mon[32397]: pgmap v5246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:09 smithi146 ceph-mon[35807]: pgmap v5246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:09 smithi076 ceph-mon[35401]: pgmap v5246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:11 smithi040 ceph-mon[32397]: pgmap v5247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5098.109094 secs 2024-07-26T14:58:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:11 smithi146 ceph-mon[35807]: pgmap v5247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5098.109094 secs 2024-07-26T14:58:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:11 smithi076 ceph-mon[35401]: pgmap v5247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5098.109094 secs 2024-07-26T14:58:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:13 smithi040 ceph-mon[32397]: pgmap v5248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:13 smithi146 ceph-mon[35807]: pgmap v5248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:13 smithi076 ceph-mon[35401]: pgmap v5248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:15 smithi040 ceph-mon[32397]: pgmap v5249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:15 smithi146 ceph-mon[35807]: pgmap v5249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:15 smithi076 ceph-mon[35401]: pgmap v5249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5103.109230 secs 2024-07-26T14:58:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5103.109230 secs 2024-07-26T14:58:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5103.109230 secs 2024-07-26T14:58:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:17 smithi040 ceph-mon[32397]: pgmap v5250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:17 smithi146 ceph-mon[35807]: pgmap v5250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:17 smithi076 ceph-mon[35401]: pgmap v5250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:19 smithi040 ceph-mon[32397]: pgmap v5251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:19 smithi146 ceph-mon[35807]: pgmap v5251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:19 smithi076 ceph-mon[35401]: pgmap v5251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:21 smithi040 ceph-mon[32397]: pgmap v5252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5108.109397 secs 2024-07-26T14:58:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:21 smithi146 ceph-mon[35807]: pgmap v5252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5108.109397 secs 2024-07-26T14:58:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:21 smithi076 ceph-mon[35401]: pgmap v5252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5108.109397 secs 2024-07-26T14:58:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:23 smithi040 ceph-mon[32397]: pgmap v5253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:23 smithi146 ceph-mon[35807]: pgmap v5253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:23 smithi076 ceph-mon[35401]: pgmap v5253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:25 smithi040 ceph-mon[32397]: pgmap v5254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:25 smithi146 ceph-mon[35807]: pgmap v5254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:25 smithi076 ceph-mon[35401]: pgmap v5254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5113.109481 secs 2024-07-26T14:58:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5113.109481 secs 2024-07-26T14:58:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5113.109481 secs 2024-07-26T14:58:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:27 smithi040 ceph-mon[32397]: pgmap v5255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:27 smithi146 ceph-mon[35807]: pgmap v5255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:27 smithi076 ceph-mon[35401]: pgmap v5255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:29 smithi040 ceph-mon[32397]: pgmap v5256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:29 smithi146 ceph-mon[35807]: pgmap v5256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:29 smithi076 ceph-mon[35401]: pgmap v5256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:31 smithi040 ceph-mon[32397]: pgmap v5257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5118.109584 secs 2024-07-26T14:58:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:31 smithi146 ceph-mon[35807]: pgmap v5257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5118.109584 secs 2024-07-26T14:58:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:31 smithi076 ceph-mon[35401]: pgmap v5257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5118.109584 secs 2024-07-26T14:58:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:33 smithi040 ceph-mon[32397]: pgmap v5258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:33 smithi146 ceph-mon[35807]: pgmap v5258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:33 smithi076 ceph-mon[35401]: pgmap v5258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:35 smithi040 ceph-mon[32397]: pgmap v5259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:35 smithi146 ceph-mon[35807]: pgmap v5259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:35 smithi076 ceph-mon[35401]: pgmap v5259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5123.109710 secs 2024-07-26T14:58:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5123.109710 secs 2024-07-26T14:58:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5123.109710 secs 2024-07-26T14:58:37.723 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:37 smithi146 ceph-mon[35807]: pgmap v5260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:37 smithi040 ceph-mon[32397]: pgmap v5260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:37.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:37 smithi076 ceph-mon[35401]: pgmap v5260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:39 smithi040 ceph-mon[32397]: pgmap v5261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:39 smithi146 ceph-mon[35807]: pgmap v5261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:39 smithi076 ceph-mon[35401]: pgmap v5261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:41 smithi146 ceph-mon[35807]: pgmap v5262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5128.109850 secs 2024-07-26T14:58:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:41 smithi076 ceph-mon[35401]: pgmap v5262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5128.109850 secs 2024-07-26T14:58:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:41 smithi040 ceph-mon[32397]: pgmap v5262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5128.109850 secs 2024-07-26T14:58:43.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:43 smithi040 ceph-mon[32397]: pgmap v5263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:43 smithi146 ceph-mon[35807]: pgmap v5263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:43 smithi076 ceph-mon[35401]: pgmap v5263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:45 smithi146 ceph-mon[35807]: pgmap v5264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:45 smithi076 ceph-mon[35401]: pgmap v5264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:45 smithi040 ceph-mon[32397]: pgmap v5264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5133.109996 secs 2024-07-26T14:58:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5133.109996 secs 2024-07-26T14:58:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5133.109996 secs 2024-07-26T14:58:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:47 smithi146 ceph-mon[35807]: pgmap v5265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:47 smithi076 ceph-mon[35401]: pgmap v5265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:47 smithi040 ceph-mon[32397]: pgmap v5265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:49 smithi146 ceph-mon[35807]: pgmap v5266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:49 smithi076 ceph-mon[35401]: pgmap v5266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:49 smithi040 ceph-mon[32397]: pgmap v5266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:51 smithi146 ceph-mon[35807]: pgmap v5267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5138.110127 secs 2024-07-26T14:58:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:51 smithi076 ceph-mon[35401]: pgmap v5267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5138.110127 secs 2024-07-26T14:58:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:51 smithi040 ceph-mon[32397]: pgmap v5267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5138.110127 secs 2024-07-26T14:58:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:53 smithi146 ceph-mon[35807]: pgmap v5268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:53 smithi076 ceph-mon[35401]: pgmap v5268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:53 smithi040 ceph-mon[32397]: pgmap v5268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:55 smithi146 ceph-mon[35807]: pgmap v5269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:55 smithi076 ceph-mon[35401]: pgmap v5269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:55 smithi040 ceph-mon[32397]: pgmap v5269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:58:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5143.110258 secs 2024-07-26T14:58:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5143.110258 secs 2024-07-26T14:58:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5143.110258 secs 2024-07-26T14:58:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:57 smithi146 ceph-mon[35807]: pgmap v5270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:57 smithi076 ceph-mon[35401]: pgmap v5270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:57 smithi040 ceph-mon[32397]: pgmap v5270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:58:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:58:59 smithi076 ceph-mon[35401]: pgmap v5271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:58:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:58:59 smithi040 ceph-mon[32397]: pgmap v5271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:58:59 smithi146 ceph-mon[35807]: pgmap v5271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:01 smithi076 ceph-mon[35401]: pgmap v5272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5148.110398 secs 2024-07-26T14:59:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:01 smithi040 ceph-mon[32397]: pgmap v5272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5148.110398 secs 2024-07-26T14:59:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:01 smithi146 ceph-mon[35807]: pgmap v5272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5148.110398 secs 2024-07-26T14:59:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:03 smithi040 ceph-mon[32397]: pgmap v5273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:03 smithi146 ceph-mon[35807]: pgmap v5273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:03 smithi076 ceph-mon[35401]: pgmap v5273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:05 smithi040 ceph-mon[32397]: pgmap v5274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:05 smithi146 ceph-mon[35807]: pgmap v5274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:05 smithi076 ceph-mon[35401]: pgmap v5274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5153.110534 secs 2024-07-26T14:59:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5153.110534 secs 2024-07-26T14:59:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5153.110534 secs 2024-07-26T14:59:07.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:07 smithi146 ceph-mon[35807]: pgmap v5275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:07 smithi040 ceph-mon[32397]: pgmap v5275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:07.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:07 smithi076 ceph-mon[35401]: pgmap v5275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:09 smithi040 ceph-mon[32397]: pgmap v5276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:09 smithi146 ceph-mon[35807]: pgmap v5276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:09 smithi076 ceph-mon[35401]: pgmap v5276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:11 smithi040 ceph-mon[32397]: pgmap v5277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5158.110625 secs 2024-07-26T14:59:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:11 smithi146 ceph-mon[35807]: pgmap v5277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5158.110625 secs 2024-07-26T14:59:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:11 smithi076 ceph-mon[35401]: pgmap v5277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5158.110625 secs 2024-07-26T14:59:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:13 smithi040 ceph-mon[32397]: pgmap v5278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:13 smithi146 ceph-mon[35807]: pgmap v5278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:13 smithi076 ceph-mon[35401]: pgmap v5278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:14 smithi040 ceph-mon[32397]: pgmap v5279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:14 smithi146 ceph-mon[35807]: pgmap v5279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:14 smithi076 ceph-mon[35401]: pgmap v5279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5163.110710 secs 2024-07-26T14:59:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:16 smithi146 ceph-mon[35807]: pgmap v5280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5163.110710 secs 2024-07-26T14:59:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:16 smithi076 ceph-mon[35401]: pgmap v5280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5163.110710 secs 2024-07-26T14:59:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:16 smithi040 ceph-mon[32397]: pgmap v5280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:18 smithi146 ceph-mon[35807]: pgmap v5281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:18 smithi076 ceph-mon[35401]: pgmap v5281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:18 smithi040 ceph-mon[32397]: pgmap v5281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:20 smithi146 ceph-mon[35807]: pgmap v5282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:20 smithi076 ceph-mon[35401]: pgmap v5282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:20 smithi040 ceph-mon[32397]: pgmap v5282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5168.110874 secs 2024-07-26T14:59:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5168.110874 secs 2024-07-26T14:59:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5168.110874 secs 2024-07-26T14:59:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:22 smithi146 ceph-mon[35807]: pgmap v5283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:22 smithi076 ceph-mon[35401]: pgmap v5283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:22 smithi040 ceph-mon[32397]: pgmap v5283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:24 smithi146 ceph-mon[35807]: pgmap v5284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:24 smithi076 ceph-mon[35401]: pgmap v5284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:24 smithi040 ceph-mon[32397]: pgmap v5284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T14:59:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5173.111013 secs 2024-07-26T14:59:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:26 smithi076 ceph-mon[35401]: pgmap v5285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5173.111013 secs 2024-07-26T14:59:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:26 smithi040 ceph-mon[32397]: pgmap v5285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5173.111013 secs 2024-07-26T14:59:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:26 smithi146 ceph-mon[35807]: pgmap v5285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:28 smithi040 ceph-mon[32397]: pgmap v5286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:28 smithi146 ceph-mon[35807]: pgmap v5286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:28 smithi076 ceph-mon[35401]: pgmap v5286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:30 smithi040 ceph-mon[32397]: pgmap v5287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:30 smithi146 ceph-mon[35807]: pgmap v5287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:31.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:30 smithi076 ceph-mon[35401]: pgmap v5287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5178.111177 secs 2024-07-26T14:59:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5178.111177 secs 2024-07-26T14:59:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5178.111177 secs 2024-07-26T14:59:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:32 smithi040 ceph-mon[32397]: pgmap v5288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:32 smithi146 ceph-mon[35807]: pgmap v5288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:32 smithi076 ceph-mon[35401]: pgmap v5288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:34 smithi040 ceph-mon[32397]: pgmap v5289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:34 smithi146 ceph-mon[35807]: pgmap v5289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:34 smithi076 ceph-mon[35401]: pgmap v5289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:37.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5183.111344 secs 2024-07-26T14:59:37.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:36 smithi146 ceph-mon[35807]: pgmap v5290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:37.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5183.111344 secs 2024-07-26T14:59:37.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:36 smithi076 ceph-mon[35401]: pgmap v5290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5183.111344 secs 2024-07-26T14:59:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:36 smithi040 ceph-mon[32397]: pgmap v5290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:38 smithi040 ceph-mon[32397]: pgmap v5291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:38 smithi146 ceph-mon[35807]: pgmap v5291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:38 smithi076 ceph-mon[35401]: pgmap v5291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:40 smithi040 ceph-mon[32397]: pgmap v5292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:40 smithi146 ceph-mon[35807]: pgmap v5292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:40 smithi076 ceph-mon[35401]: pgmap v5292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5188.111477 secs 2024-07-26T14:59:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5188.111477 secs 2024-07-26T14:59:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5188.111477 secs 2024-07-26T14:59:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:42 smithi040 ceph-mon[32397]: pgmap v5293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:42 smithi146 ceph-mon[35807]: pgmap v5293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:42 smithi076 ceph-mon[35401]: pgmap v5293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:44 smithi040 ceph-mon[32397]: pgmap v5294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:44 smithi146 ceph-mon[35807]: pgmap v5294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:44 smithi076 ceph-mon[35401]: pgmap v5294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T14:59:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5193.111618 secs 2024-07-26T14:59:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:46 smithi040 ceph-mon[32397]: pgmap v5295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5193.111618 secs 2024-07-26T14:59:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:46 smithi146 ceph-mon[35807]: pgmap v5295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:47.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5193.111618 secs 2024-07-26T14:59:47.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:46 smithi076 ceph-mon[35401]: pgmap v5295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:48 smithi040 ceph-mon[32397]: pgmap v5296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:48 smithi146 ceph-mon[35807]: pgmap v5296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:48 smithi076 ceph-mon[35401]: pgmap v5296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:50 smithi040 ceph-mon[32397]: pgmap v5297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:50 smithi146 ceph-mon[35807]: pgmap v5297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:50 smithi076 ceph-mon[35401]: pgmap v5297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T14:59:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5198.111750 secs 2024-07-26T14:59:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5198.111750 secs 2024-07-26T14:59:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5198.111750 secs 2024-07-26T14:59:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:52 smithi040 ceph-mon[32397]: pgmap v5298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:52 smithi146 ceph-mon[35807]: pgmap v5298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:52 smithi076 ceph-mon[35401]: pgmap v5298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:54 smithi040 ceph-mon[32397]: pgmap v5299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:54 smithi146 ceph-mon[35807]: pgmap v5299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:54 smithi076 ceph-mon[35401]: pgmap v5299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5203.111904 secs 2024-07-26T14:59:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:56 smithi040 ceph-mon[32397]: pgmap v5300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5203.111904 secs 2024-07-26T14:59:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:56 smithi146 ceph-mon[35807]: pgmap v5300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5203.111904 secs 2024-07-26T14:59:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:56 smithi076 ceph-mon[35401]: pgmap v5300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T14:59:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 14:59:58 smithi040 ceph-mon[32397]: pgmap v5301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 14:59:58 smithi146 ceph-mon[35807]: pgmap v5301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T14:59:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 14:59:58 smithi076 ceph-mon[35401]: pgmap v5301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:00 smithi040 ceph-mon[32397]: pgmap v5302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:00:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5208.112037 secs 2024-07-26T15:00:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:00 smithi146 ceph-mon[35807]: pgmap v5302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:00:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5208.112037 secs 2024-07-26T15:00:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:00 smithi076 ceph-mon[35401]: pgmap v5302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:00:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5208.112037 secs 2024-07-26T15:00:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:02 smithi146 ceph-mon[35807]: pgmap v5303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:02 smithi076 ceph-mon[35401]: pgmap v5303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:02 smithi040 ceph-mon[32397]: pgmap v5303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:04 smithi146 ceph-mon[35807]: pgmap v5304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:04 smithi076 ceph-mon[35401]: pgmap v5304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:04 smithi040 ceph-mon[32397]: pgmap v5304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5213.112172 secs 2024-07-26T15:00:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5213.112172 secs 2024-07-26T15:00:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5213.112172 secs 2024-07-26T15:00:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:07 smithi146 ceph-mon[35807]: pgmap v5305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:07 smithi076 ceph-mon[35401]: pgmap v5305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:07 smithi040 ceph-mon[32397]: pgmap v5305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:09 smithi146 ceph-mon[35807]: pgmap v5306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:09 smithi076 ceph-mon[35401]: pgmap v5306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:09 smithi040 ceph-mon[32397]: pgmap v5306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:11 smithi146 ceph-mon[35807]: pgmap v5307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5218.112312 secs 2024-07-26T15:00:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:11 smithi076 ceph-mon[35401]: pgmap v5307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5218.112312 secs 2024-07-26T15:00:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:11 smithi040 ceph-mon[32397]: pgmap v5307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5218.112312 secs 2024-07-26T15:00:13.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:13 smithi040 ceph-mon[32397]: pgmap v5308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:13 smithi146 ceph-mon[35807]: pgmap v5308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:13 smithi076 ceph-mon[35401]: pgmap v5308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:15 smithi146 ceph-mon[35807]: pgmap v5309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:15 smithi076 ceph-mon[35401]: pgmap v5309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:15 smithi040 ceph-mon[32397]: pgmap v5309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5223.112455 secs 2024-07-26T15:00:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5223.112455 secs 2024-07-26T15:00:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5223.112455 secs 2024-07-26T15:00:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:17 smithi146 ceph-mon[35807]: pgmap v5310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:17 smithi076 ceph-mon[35401]: pgmap v5310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:17 smithi040 ceph-mon[32397]: pgmap v5310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:19 smithi146 ceph-mon[35807]: pgmap v5311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:19 smithi076 ceph-mon[35401]: pgmap v5311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:19 smithi040 ceph-mon[32397]: pgmap v5311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:21 smithi146 ceph-mon[35807]: pgmap v5312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5228.112556 secs 2024-07-26T15:00:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:21 smithi076 ceph-mon[35401]: pgmap v5312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5228.112556 secs 2024-07-26T15:00:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:21 smithi040 ceph-mon[32397]: pgmap v5312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5228.112556 secs 2024-07-26T15:00:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:23 smithi076 ceph-mon[35401]: pgmap v5313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:23 smithi040 ceph-mon[32397]: pgmap v5313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:23 smithi146 ceph-mon[35807]: pgmap v5313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:25 smithi040 ceph-mon[32397]: pgmap v5314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:25 smithi146 ceph-mon[35807]: pgmap v5314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:25 smithi076 ceph-mon[35401]: pgmap v5314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5233.112654 secs 2024-07-26T15:00:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5233.112654 secs 2024-07-26T15:00:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5233.112654 secs 2024-07-26T15:00:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:27 smithi040 ceph-mon[32397]: pgmap v5315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:27 smithi146 ceph-mon[35807]: pgmap v5315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:27 smithi076 ceph-mon[35401]: pgmap v5315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:29 smithi040 ceph-mon[32397]: pgmap v5316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:29 smithi146 ceph-mon[35807]: pgmap v5316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:29 smithi076 ceph-mon[35401]: pgmap v5316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:31 smithi040 ceph-mon[32397]: pgmap v5317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5238.112823 secs 2024-07-26T15:00:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:31 smithi146 ceph-mon[35807]: pgmap v5317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5238.112823 secs 2024-07-26T15:00:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:31 smithi076 ceph-mon[35401]: pgmap v5317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5238.112823 secs 2024-07-26T15:00:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:33 smithi040 ceph-mon[32397]: pgmap v5318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:33 smithi146 ceph-mon[35807]: pgmap v5318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:33 smithi076 ceph-mon[35401]: pgmap v5318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:35 smithi040 ceph-mon[32397]: pgmap v5319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:35 smithi146 ceph-mon[35807]: pgmap v5319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:35 smithi076 ceph-mon[35401]: pgmap v5319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5243.112967 secs 2024-07-26T15:00:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5243.112967 secs 2024-07-26T15:00:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5243.112967 secs 2024-07-26T15:00:37.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:37 smithi146 ceph-mon[35807]: pgmap v5320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:37 smithi040 ceph-mon[32397]: pgmap v5320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:37.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:37 smithi076 ceph-mon[35401]: pgmap v5320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:39 smithi040 ceph-mon[32397]: pgmap v5321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:39 smithi146 ceph-mon[35807]: pgmap v5321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:39 smithi076 ceph-mon[35401]: pgmap v5321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:41 smithi040 ceph-mon[32397]: pgmap v5322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5248.113110 secs 2024-07-26T15:00:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:41 smithi146 ceph-mon[35807]: pgmap v5322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5248.113110 secs 2024-07-26T15:00:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:41 smithi076 ceph-mon[35401]: pgmap v5322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5248.113110 secs 2024-07-26T15:00:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:43 smithi040 ceph-mon[32397]: pgmap v5323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:43 smithi146 ceph-mon[35807]: pgmap v5323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:43 smithi076 ceph-mon[35401]: pgmap v5323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:45 smithi040 ceph-mon[32397]: pgmap v5324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:45 smithi146 ceph-mon[35807]: pgmap v5324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:45 smithi076 ceph-mon[35401]: pgmap v5324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5253.113305 secs 2024-07-26T15:00:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5253.113305 secs 2024-07-26T15:00:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5253.113305 secs 2024-07-26T15:00:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:47 smithi040 ceph-mon[32397]: pgmap v5325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:47 smithi146 ceph-mon[35807]: pgmap v5325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:47 smithi076 ceph-mon[35401]: pgmap v5325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:49 smithi040 ceph-mon[32397]: pgmap v5326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:49 smithi146 ceph-mon[35807]: pgmap v5326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:49 smithi076 ceph-mon[35401]: pgmap v5326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:51 smithi040 ceph-mon[32397]: pgmap v5327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5258.113432 secs 2024-07-26T15:00:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:51 smithi146 ceph-mon[35807]: pgmap v5327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5258.113432 secs 2024-07-26T15:00:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:51 smithi076 ceph-mon[35401]: pgmap v5327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5258.113432 secs 2024-07-26T15:00:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:53 smithi040 ceph-mon[32397]: pgmap v5328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:53 smithi146 ceph-mon[35807]: pgmap v5328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:53 smithi076 ceph-mon[35401]: pgmap v5328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:55 smithi040 ceph-mon[32397]: pgmap v5329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:55 smithi146 ceph-mon[35807]: pgmap v5329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:55 smithi076 ceph-mon[35401]: pgmap v5329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:00:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5263.113523 secs 2024-07-26T15:00:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5263.113523 secs 2024-07-26T15:00:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5263.113523 secs 2024-07-26T15:00:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:57 smithi146 ceph-mon[35807]: pgmap v5330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:57 smithi076 ceph-mon[35401]: pgmap v5330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:57 smithi040 ceph-mon[32397]: pgmap v5330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:00:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:00:59 smithi146 ceph-mon[35807]: pgmap v5331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:00:59 smithi076 ceph-mon[35401]: pgmap v5331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:00:59.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:00:59 smithi040 ceph-mon[32397]: pgmap v5331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:01 smithi040 ceph-mon[32397]: pgmap v5332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5268.113629 secs 2024-07-26T15:01:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:01 smithi146 ceph-mon[35807]: pgmap v5332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5268.113629 secs 2024-07-26T15:01:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:01 smithi076 ceph-mon[35401]: pgmap v5332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5268.113629 secs 2024-07-26T15:01:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:03 smithi146 ceph-mon[35807]: pgmap v5333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:03 smithi076 ceph-mon[35401]: pgmap v5333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:03 smithi040 ceph-mon[32397]: pgmap v5333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:05 smithi146 ceph-mon[35807]: pgmap v5334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:05 smithi076 ceph-mon[35401]: pgmap v5334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:05 smithi040 ceph-mon[32397]: pgmap v5334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5273.113801 secs 2024-07-26T15:01:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5273.113801 secs 2024-07-26T15:01:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5273.113801 secs 2024-07-26T15:01:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:07 smithi146 ceph-mon[35807]: pgmap v5335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:07 smithi076 ceph-mon[35401]: pgmap v5335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:07 smithi040 ceph-mon[32397]: pgmap v5335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:09 smithi146 ceph-mon[35807]: pgmap v5336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:09 smithi076 ceph-mon[35401]: pgmap v5336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:09 smithi040 ceph-mon[32397]: pgmap v5336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:11 smithi146 ceph-mon[35807]: pgmap v5337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5278.113959 secs 2024-07-26T15:01:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:11 smithi076 ceph-mon[35401]: pgmap v5337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5278.113959 secs 2024-07-26T15:01:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:11 smithi040 ceph-mon[32397]: pgmap v5337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5278.113959 secs 2024-07-26T15:01:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:13 smithi146 ceph-mon[35807]: pgmap v5338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:13 smithi076 ceph-mon[35401]: pgmap v5338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:13 smithi040 ceph-mon[32397]: pgmap v5338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:15 smithi076 ceph-mon[35401]: pgmap v5339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:15 smithi040 ceph-mon[32397]: pgmap v5339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:15 smithi146 ceph-mon[35807]: pgmap v5339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5283.114114 secs 2024-07-26T15:01:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5283.114114 secs 2024-07-26T15:01:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5283.114114 secs 2024-07-26T15:01:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:17 smithi040 ceph-mon[32397]: pgmap v5340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:17 smithi146 ceph-mon[35807]: pgmap v5340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:17 smithi076 ceph-mon[35401]: pgmap v5340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:19 smithi040 ceph-mon[32397]: pgmap v5341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:19 smithi146 ceph-mon[35807]: pgmap v5341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:19 smithi076 ceph-mon[35401]: pgmap v5341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:21 smithi040 ceph-mon[32397]: pgmap v5342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5288.114237 secs 2024-07-26T15:01:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:21 smithi146 ceph-mon[35807]: pgmap v5342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5288.114237 secs 2024-07-26T15:01:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:21 smithi076 ceph-mon[35401]: pgmap v5342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5288.114237 secs 2024-07-26T15:01:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:23 smithi040 ceph-mon[32397]: pgmap v5343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:23 smithi146 ceph-mon[35807]: pgmap v5343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:23 smithi076 ceph-mon[35401]: pgmap v5343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:25 smithi040 ceph-mon[32397]: pgmap v5344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:25 smithi146 ceph-mon[35807]: pgmap v5344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:25 smithi076 ceph-mon[35401]: pgmap v5344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5293.114375 secs 2024-07-26T15:01:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5293.114375 secs 2024-07-26T15:01:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5293.114375 secs 2024-07-26T15:01:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:27 smithi040 ceph-mon[32397]: pgmap v5345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:27 smithi146 ceph-mon[35807]: pgmap v5345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:27 smithi076 ceph-mon[35401]: pgmap v5345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:29 smithi040 ceph-mon[32397]: pgmap v5346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:29 smithi146 ceph-mon[35807]: pgmap v5346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:29 smithi076 ceph-mon[35401]: pgmap v5346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:31 smithi040 ceph-mon[32397]: pgmap v5347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5298.114496 secs 2024-07-26T15:01:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:31 smithi146 ceph-mon[35807]: pgmap v5347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5298.114496 secs 2024-07-26T15:01:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:31 smithi076 ceph-mon[35401]: pgmap v5347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5298.114496 secs 2024-07-26T15:01:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:33 smithi040 ceph-mon[32397]: pgmap v5348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:33 smithi146 ceph-mon[35807]: pgmap v5348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:33 smithi076 ceph-mon[35401]: pgmap v5348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:35 smithi040 ceph-mon[32397]: pgmap v5349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:35 smithi146 ceph-mon[35807]: pgmap v5349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:35 smithi076 ceph-mon[35401]: pgmap v5349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5303.114629 secs 2024-07-26T15:01:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5303.114629 secs 2024-07-26T15:01:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5303.114629 secs 2024-07-26T15:01:37.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:37 smithi146 ceph-mon[35807]: pgmap v5350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:37 smithi040 ceph-mon[32397]: pgmap v5350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:37.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:37 smithi076 ceph-mon[35401]: pgmap v5350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:39 smithi040 ceph-mon[32397]: pgmap v5351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:39 smithi146 ceph-mon[35807]: pgmap v5351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:39 smithi076 ceph-mon[35401]: pgmap v5351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:41 smithi040 ceph-mon[32397]: pgmap v5352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5308.114770 secs 2024-07-26T15:01:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:41 smithi146 ceph-mon[35807]: pgmap v5352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5308.114770 secs 2024-07-26T15:01:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:41 smithi076 ceph-mon[35401]: pgmap v5352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5308.114770 secs 2024-07-26T15:01:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:43 smithi040 ceph-mon[32397]: pgmap v5353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:43 smithi146 ceph-mon[35807]: pgmap v5353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:43 smithi076 ceph-mon[35401]: pgmap v5353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:45 smithi040 ceph-mon[32397]: pgmap v5354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:45 smithi146 ceph-mon[35807]: pgmap v5354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:45 smithi076 ceph-mon[35401]: pgmap v5354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5313.114928 secs 2024-07-26T15:01:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5313.114928 secs 2024-07-26T15:01:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5313.114928 secs 2024-07-26T15:01:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:47 smithi040 ceph-mon[32397]: pgmap v5355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:47 smithi146 ceph-mon[35807]: pgmap v5355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:47 smithi076 ceph-mon[35401]: pgmap v5355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:49 smithi040 ceph-mon[32397]: pgmap v5356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:49 smithi146 ceph-mon[35807]: pgmap v5356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:49 smithi076 ceph-mon[35401]: pgmap v5356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:51 smithi146 ceph-mon[35807]: pgmap v5357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5318.115066 secs 2024-07-26T15:01:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:51 smithi076 ceph-mon[35401]: pgmap v5357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5318.115066 secs 2024-07-26T15:01:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:51 smithi040 ceph-mon[32397]: pgmap v5357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5318.115066 secs 2024-07-26T15:01:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:53 smithi146 ceph-mon[35807]: pgmap v5358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:53 smithi076 ceph-mon[35401]: pgmap v5358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:53 smithi040 ceph-mon[32397]: pgmap v5358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:55 smithi146 ceph-mon[35807]: pgmap v5359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:55 smithi076 ceph-mon[35401]: pgmap v5359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:55 smithi040 ceph-mon[32397]: pgmap v5359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:01:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5323.115208 secs 2024-07-26T15:01:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5323.115208 secs 2024-07-26T15:01:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5323.115208 secs 2024-07-26T15:01:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:57 smithi146 ceph-mon[35807]: pgmap v5360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:57 smithi076 ceph-mon[35401]: pgmap v5360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:57 smithi040 ceph-mon[32397]: pgmap v5360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:01:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:01:59 smithi146 ceph-mon[35807]: pgmap v5361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:01:59 smithi076 ceph-mon[35401]: pgmap v5361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:01:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:01:59 smithi040 ceph-mon[32397]: pgmap v5361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:01 smithi146 ceph-mon[35807]: pgmap v5362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5328.115332 secs 2024-07-26T15:02:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:01 smithi076 ceph-mon[35401]: pgmap v5362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5328.115332 secs 2024-07-26T15:02:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:01 smithi040 ceph-mon[32397]: pgmap v5362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5328.115332 secs 2024-07-26T15:02:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:03 smithi146 ceph-mon[35807]: pgmap v5363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:03 smithi076 ceph-mon[35401]: pgmap v5363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:03 smithi040 ceph-mon[32397]: pgmap v5363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:05 smithi146 ceph-mon[35807]: pgmap v5364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:05 smithi076 ceph-mon[35401]: pgmap v5364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:05 smithi040 ceph-mon[32397]: pgmap v5364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5333.115465 secs 2024-07-26T15:02:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5333.115465 secs 2024-07-26T15:02:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5333.115465 secs 2024-07-26T15:02:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:07 smithi146 ceph-mon[35807]: pgmap v5365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:07.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:07 smithi076 ceph-mon[35401]: pgmap v5365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:07 smithi040 ceph-mon[32397]: pgmap v5365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:09 smithi076 ceph-mon[35401]: pgmap v5366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:09 smithi040 ceph-mon[32397]: pgmap v5366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:09 smithi146 ceph-mon[35807]: pgmap v5366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:11 smithi076 ceph-mon[35401]: pgmap v5367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5338.115615 secs 2024-07-26T15:02:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:11 smithi040 ceph-mon[32397]: pgmap v5367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5338.115615 secs 2024-07-26T15:02:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:11 smithi146 ceph-mon[35807]: pgmap v5367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5338.115615 secs 2024-07-26T15:02:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:13 smithi040 ceph-mon[32397]: pgmap v5368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:13 smithi146 ceph-mon[35807]: pgmap v5368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:13 smithi076 ceph-mon[35401]: pgmap v5368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:15 smithi040 ceph-mon[32397]: pgmap v5369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:15 smithi146 ceph-mon[35807]: pgmap v5369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:15 smithi076 ceph-mon[35401]: pgmap v5369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5343.115747 secs 2024-07-26T15:02:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5343.115747 secs 2024-07-26T15:02:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5343.115747 secs 2024-07-26T15:02:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:17 smithi040 ceph-mon[32397]: pgmap v5370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:17 smithi146 ceph-mon[35807]: pgmap v5370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:17 smithi076 ceph-mon[35401]: pgmap v5370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:19 smithi040 ceph-mon[32397]: pgmap v5371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:19 smithi146 ceph-mon[35807]: pgmap v5371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:19 smithi076 ceph-mon[35401]: pgmap v5371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:21 smithi040 ceph-mon[32397]: pgmap v5372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5348.115886 secs 2024-07-26T15:02:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:21 smithi146 ceph-mon[35807]: pgmap v5372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5348.115886 secs 2024-07-26T15:02:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:21 smithi076 ceph-mon[35401]: pgmap v5372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5348.115886 secs 2024-07-26T15:02:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:23 smithi040 ceph-mon[32397]: pgmap v5373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:23 smithi146 ceph-mon[35807]: pgmap v5373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:23 smithi076 ceph-mon[35401]: pgmap v5373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:25 smithi040 ceph-mon[32397]: pgmap v5374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:25 smithi146 ceph-mon[35807]: pgmap v5374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:25 smithi076 ceph-mon[35401]: pgmap v5374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5353.116026 secs 2024-07-26T15:02:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5353.116026 secs 2024-07-26T15:02:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5353.116026 secs 2024-07-26T15:02:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:27 smithi040 ceph-mon[32397]: pgmap v5375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:27 smithi146 ceph-mon[35807]: pgmap v5375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:27 smithi076 ceph-mon[35401]: pgmap v5375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:29 smithi040 ceph-mon[32397]: pgmap v5376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:29 smithi146 ceph-mon[35807]: pgmap v5376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:29 smithi076 ceph-mon[35401]: pgmap v5376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:30 smithi040 ceph-mon[32397]: pgmap v5377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:30 smithi146 ceph-mon[35807]: pgmap v5377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:30 smithi076 ceph-mon[35401]: pgmap v5377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5358.116192 secs 2024-07-26T15:02:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5358.116192 secs 2024-07-26T15:02:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5358.116192 secs 2024-07-26T15:02:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:32 smithi146 ceph-mon[35807]: pgmap v5378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:32 smithi076 ceph-mon[35401]: pgmap v5378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:32 smithi040 ceph-mon[32397]: pgmap v5378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:34 smithi040 ceph-mon[32397]: pgmap v5379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:34 smithi146 ceph-mon[35807]: pgmap v5379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:34 smithi076 ceph-mon[35401]: pgmap v5379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5363.116333 secs 2024-07-26T15:02:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:36 smithi040 ceph-mon[32397]: pgmap v5380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5363.116333 secs 2024-07-26T15:02:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:36 smithi146 ceph-mon[35807]: pgmap v5380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5363.116333 secs 2024-07-26T15:02:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:36 smithi076 ceph-mon[35401]: pgmap v5380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:38 smithi040 ceph-mon[32397]: pgmap v5381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:38 smithi146 ceph-mon[35807]: pgmap v5381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:39.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:38 smithi076 ceph-mon[35401]: pgmap v5381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:40 smithi040 ceph-mon[32397]: pgmap v5382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:41.332 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:40 smithi146 ceph-mon[35807]: pgmap v5382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:40 smithi076 ceph-mon[35401]: pgmap v5382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5368.116475 secs 2024-07-26T15:02:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5368.116475 secs 2024-07-26T15:02:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5368.116475 secs 2024-07-26T15:02:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:42 smithi040 ceph-mon[32397]: pgmap v5383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:42 smithi146 ceph-mon[35807]: pgmap v5383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:42 smithi076 ceph-mon[35401]: pgmap v5383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:44 smithi040 ceph-mon[32397]: pgmap v5384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:44 smithi146 ceph-mon[35807]: pgmap v5384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:44 smithi076 ceph-mon[35401]: pgmap v5384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5373.116617 secs 2024-07-26T15:02:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:46 smithi040 ceph-mon[32397]: pgmap v5385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5373.116617 secs 2024-07-26T15:02:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:46 smithi146 ceph-mon[35807]: pgmap v5385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5373.116617 secs 2024-07-26T15:02:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:46 smithi076 ceph-mon[35401]: pgmap v5385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:48 smithi040 ceph-mon[32397]: pgmap v5386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:48 smithi146 ceph-mon[35807]: pgmap v5386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:49.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:48 smithi076 ceph-mon[35401]: pgmap v5386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:50 smithi040 ceph-mon[32397]: pgmap v5387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:50 smithi146 ceph-mon[35807]: pgmap v5387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:50 smithi076 ceph-mon[35401]: pgmap v5387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5378.116761 secs 2024-07-26T15:02:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5378.116761 secs 2024-07-26T15:02:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5378.116761 secs 2024-07-26T15:02:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:52 smithi146 ceph-mon[35807]: pgmap v5388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:52 smithi076 ceph-mon[35401]: pgmap v5388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:52 smithi040 ceph-mon[32397]: pgmap v5388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:55 smithi146 ceph-mon[35807]: pgmap v5389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:55 smithi076 ceph-mon[35401]: pgmap v5389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:55 smithi040 ceph-mon[32397]: pgmap v5389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:02:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5383.116857 secs 2024-07-26T15:02:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5383.116857 secs 2024-07-26T15:02:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5383.116857 secs 2024-07-26T15:02:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:57 smithi146 ceph-mon[35807]: pgmap v5390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:57 smithi076 ceph-mon[35401]: pgmap v5390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:57 smithi040 ceph-mon[32397]: pgmap v5390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:02:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:02:59 smithi146 ceph-mon[35807]: pgmap v5391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:02:59 smithi076 ceph-mon[35401]: pgmap v5391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:02:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:02:59 smithi040 ceph-mon[32397]: pgmap v5391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:01 smithi146 ceph-mon[35807]: pgmap v5392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5388.116992 secs 2024-07-26T15:03:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:01 smithi076 ceph-mon[35401]: pgmap v5392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5388.116992 secs 2024-07-26T15:03:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:01 smithi040 ceph-mon[32397]: pgmap v5392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5388.116992 secs 2024-07-26T15:03:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:03 smithi146 ceph-mon[35807]: pgmap v5393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:03 smithi076 ceph-mon[35401]: pgmap v5393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:03 smithi040 ceph-mon[32397]: pgmap v5393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:05 smithi146 ceph-mon[35807]: pgmap v5394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:05 smithi076 ceph-mon[35401]: pgmap v5394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:05 smithi040 ceph-mon[32397]: pgmap v5394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5393.117153 secs 2024-07-26T15:03:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5393.117153 secs 2024-07-26T15:03:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5393.117153 secs 2024-07-26T15:03:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:07 smithi146 ceph-mon[35807]: pgmap v5395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:07 smithi076 ceph-mon[35401]: pgmap v5395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:07 smithi040 ceph-mon[32397]: pgmap v5395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:09 smithi076 ceph-mon[35401]: pgmap v5396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:09 smithi040 ceph-mon[32397]: pgmap v5396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:09 smithi146 ceph-mon[35807]: pgmap v5396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:11 smithi076 ceph-mon[35401]: pgmap v5397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5398.117317 secs 2024-07-26T15:03:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:11 smithi040 ceph-mon[32397]: pgmap v5397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5398.117317 secs 2024-07-26T15:03:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:11 smithi146 ceph-mon[35807]: pgmap v5397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5398.117317 secs 2024-07-26T15:03:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:13 smithi040 ceph-mon[32397]: pgmap v5398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:13 smithi146 ceph-mon[35807]: pgmap v5398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:13 smithi076 ceph-mon[35401]: pgmap v5398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:15 smithi040 ceph-mon[32397]: pgmap v5399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:15 smithi146 ceph-mon[35807]: pgmap v5399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:15 smithi076 ceph-mon[35401]: pgmap v5399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:16.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5403.117412 secs 2024-07-26T15:03:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5403.117412 secs 2024-07-26T15:03:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5403.117412 secs 2024-07-26T15:03:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:17 smithi040 ceph-mon[32397]: pgmap v5400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:17 smithi146 ceph-mon[35807]: pgmap v5400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:17 smithi076 ceph-mon[35401]: pgmap v5400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:19 smithi040 ceph-mon[32397]: pgmap v5401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:19 smithi146 ceph-mon[35807]: pgmap v5401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:19 smithi076 ceph-mon[35401]: pgmap v5401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:21 smithi040 ceph-mon[32397]: pgmap v5402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5408.117514 secs 2024-07-26T15:03:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:21 smithi146 ceph-mon[35807]: pgmap v5402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5408.117514 secs 2024-07-26T15:03:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:21 smithi076 ceph-mon[35401]: pgmap v5402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5408.117514 secs 2024-07-26T15:03:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:23 smithi040 ceph-mon[32397]: pgmap v5403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:23 smithi146 ceph-mon[35807]: pgmap v5403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:23.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:23 smithi076 ceph-mon[35401]: pgmap v5403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:25 smithi040 ceph-mon[32397]: pgmap v5404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:25 smithi146 ceph-mon[35807]: pgmap v5404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:25 smithi076 ceph-mon[35401]: pgmap v5404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:26.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5413.117658 secs 2024-07-26T15:03:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5413.117658 secs 2024-07-26T15:03:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5413.117658 secs 2024-07-26T15:03:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:27 smithi040 ceph-mon[32397]: pgmap v5405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:27 smithi146 ceph-mon[35807]: pgmap v5405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:27 smithi076 ceph-mon[35401]: pgmap v5405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:29 smithi040 ceph-mon[32397]: pgmap v5406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:29 smithi146 ceph-mon[35807]: pgmap v5406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:29 smithi076 ceph-mon[35401]: pgmap v5406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:31 smithi040 ceph-mon[32397]: pgmap v5407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5418.117813 secs 2024-07-26T15:03:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:31 smithi146 ceph-mon[35807]: pgmap v5407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5418.117813 secs 2024-07-26T15:03:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:31 smithi076 ceph-mon[35401]: pgmap v5407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5418.117813 secs 2024-07-26T15:03:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:33 smithi040 ceph-mon[32397]: pgmap v5408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:33 smithi146 ceph-mon[35807]: pgmap v5408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:33 smithi076 ceph-mon[35401]: pgmap v5408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:35 smithi040 ceph-mon[32397]: pgmap v5409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:35 smithi146 ceph-mon[35807]: pgmap v5409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:35.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:35 smithi076 ceph-mon[35401]: pgmap v5409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5423.117952 secs 2024-07-26T15:03:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5423.117952 secs 2024-07-26T15:03:36.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5423.117952 secs 2024-07-26T15:03:37.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:37 smithi146 ceph-mon[35807]: pgmap v5410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:37 smithi040 ceph-mon[32397]: pgmap v5410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:37.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:37 smithi076 ceph-mon[35401]: pgmap v5410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:39 smithi040 ceph-mon[32397]: pgmap v5411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:39 smithi146 ceph-mon[35807]: pgmap v5411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:39 smithi076 ceph-mon[35401]: pgmap v5411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:41 smithi040 ceph-mon[32397]: pgmap v5412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5428.118102 secs 2024-07-26T15:03:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:41 smithi146 ceph-mon[35807]: pgmap v5412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5428.118102 secs 2024-07-26T15:03:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:41 smithi076 ceph-mon[35401]: pgmap v5412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5428.118102 secs 2024-07-26T15:03:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:43 smithi040 ceph-mon[32397]: pgmap v5413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:43 smithi146 ceph-mon[35807]: pgmap v5413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:43 smithi076 ceph-mon[35401]: pgmap v5413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:45 smithi040 ceph-mon[32397]: pgmap v5414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:45 smithi146 ceph-mon[35807]: pgmap v5414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:45 smithi076 ceph-mon[35401]: pgmap v5414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5433.118312 secs 2024-07-26T15:03:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5433.118312 secs 2024-07-26T15:03:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5433.118312 secs 2024-07-26T15:03:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:47 smithi146 ceph-mon[35807]: pgmap v5415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:47.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:47 smithi076 ceph-mon[35401]: pgmap v5415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:47 smithi040 ceph-mon[32397]: pgmap v5415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:49 smithi146 ceph-mon[35807]: pgmap v5416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:49 smithi076 ceph-mon[35401]: pgmap v5416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:49 smithi040 ceph-mon[32397]: pgmap v5416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:51 smithi146 ceph-mon[35807]: pgmap v5417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5438.118398 secs 2024-07-26T15:03:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:51 smithi076 ceph-mon[35401]: pgmap v5417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5438.118398 secs 2024-07-26T15:03:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:51 smithi040 ceph-mon[32397]: pgmap v5417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5438.118398 secs 2024-07-26T15:03:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:53 smithi146 ceph-mon[35807]: pgmap v5418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:53 smithi076 ceph-mon[35401]: pgmap v5418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:53 smithi040 ceph-mon[32397]: pgmap v5418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:55 smithi146 ceph-mon[35807]: pgmap v5419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:55 smithi076 ceph-mon[35401]: pgmap v5419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:55 smithi040 ceph-mon[32397]: pgmap v5419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:03:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5443.118541 secs 2024-07-26T15:03:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5443.118541 secs 2024-07-26T15:03:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5443.118541 secs 2024-07-26T15:03:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:57 smithi146 ceph-mon[35807]: pgmap v5420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:57 smithi076 ceph-mon[35401]: pgmap v5420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:57 smithi040 ceph-mon[32397]: pgmap v5420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:03:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:03:59 smithi146 ceph-mon[35807]: pgmap v5421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:03:59 smithi076 ceph-mon[35401]: pgmap v5421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:03:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:03:59 smithi040 ceph-mon[32397]: pgmap v5421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:01 smithi146 ceph-mon[35807]: pgmap v5422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5448.118683 secs 2024-07-26T15:04:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:01 smithi076 ceph-mon[35401]: pgmap v5422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5448.118683 secs 2024-07-26T15:04:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:01 smithi040 ceph-mon[32397]: pgmap v5422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5448.118683 secs 2024-07-26T15:04:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:03 smithi146 ceph-mon[35807]: pgmap v5423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:03 smithi076 ceph-mon[35401]: pgmap v5423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:03 smithi040 ceph-mon[32397]: pgmap v5423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:05 smithi146 ceph-mon[35807]: pgmap v5424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:05 smithi076 ceph-mon[35401]: pgmap v5424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:05 smithi040 ceph-mon[32397]: pgmap v5424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5453.118824 secs 2024-07-26T15:04:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5453.118824 secs 2024-07-26T15:04:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5453.118824 secs 2024-07-26T15:04:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:07 smithi076 ceph-mon[35401]: pgmap v5425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:07.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:07 smithi146 ceph-mon[35807]: pgmap v5425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:07 smithi040 ceph-mon[32397]: pgmap v5425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:09 smithi040 ceph-mon[32397]: pgmap v5426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:09 smithi146 ceph-mon[35807]: pgmap v5426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:09 smithi076 ceph-mon[35401]: pgmap v5426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:11 smithi040 ceph-mon[32397]: pgmap v5427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5458.118988 secs 2024-07-26T15:04:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:11 smithi146 ceph-mon[35807]: pgmap v5427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5458.118988 secs 2024-07-26T15:04:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:11 smithi076 ceph-mon[35401]: pgmap v5427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5458.118988 secs 2024-07-26T15:04:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:13 smithi040 ceph-mon[32397]: pgmap v5428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:13 smithi146 ceph-mon[35807]: pgmap v5428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:13 smithi076 ceph-mon[35401]: pgmap v5428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:15 smithi040 ceph-mon[32397]: pgmap v5429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:15 smithi146 ceph-mon[35807]: pgmap v5429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:15 smithi076 ceph-mon[35401]: pgmap v5429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5463.119132 secs 2024-07-26T15:04:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5463.119132 secs 2024-07-26T15:04:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5463.119132 secs 2024-07-26T15:04:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:17 smithi040 ceph-mon[32397]: pgmap v5430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:17 smithi146 ceph-mon[35807]: pgmap v5430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:17 smithi076 ceph-mon[35401]: pgmap v5430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:19 smithi040 ceph-mon[32397]: pgmap v5431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:19 smithi146 ceph-mon[35807]: pgmap v5431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:19 smithi076 ceph-mon[35401]: pgmap v5431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:21 smithi040 ceph-mon[32397]: pgmap v5432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5468.119217 secs 2024-07-26T15:04:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:21 smithi146 ceph-mon[35807]: pgmap v5432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5468.119217 secs 2024-07-26T15:04:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:21 smithi076 ceph-mon[35401]: pgmap v5432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5468.119217 secs 2024-07-26T15:04:23.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:23 smithi040 ceph-mon[32397]: pgmap v5433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:23 smithi146 ceph-mon[35807]: pgmap v5433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:23 smithi076 ceph-mon[35401]: pgmap v5433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:25 smithi040 ceph-mon[32397]: pgmap v5434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:25 smithi146 ceph-mon[35807]: pgmap v5434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:25 smithi076 ceph-mon[35401]: pgmap v5434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5473.119358 secs 2024-07-26T15:04:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5473.119358 secs 2024-07-26T15:04:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5473.119358 secs 2024-07-26T15:04:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:27 smithi040 ceph-mon[32397]: pgmap v5435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:27 smithi146 ceph-mon[35807]: pgmap v5435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:27 smithi076 ceph-mon[35401]: pgmap v5435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:29 smithi040 ceph-mon[32397]: pgmap v5436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:29 smithi146 ceph-mon[35807]: pgmap v5436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:29 smithi076 ceph-mon[35401]: pgmap v5436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:31 smithi040 ceph-mon[32397]: pgmap v5437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5478.119496 secs 2024-07-26T15:04:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:31 smithi146 ceph-mon[35807]: pgmap v5437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5478.119496 secs 2024-07-26T15:04:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:31 smithi076 ceph-mon[35401]: pgmap v5437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5478.119496 secs 2024-07-26T15:04:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:33 smithi040 ceph-mon[32397]: pgmap v5438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:33 smithi146 ceph-mon[35807]: pgmap v5438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:33 smithi076 ceph-mon[35401]: pgmap v5438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:35 smithi040 ceph-mon[32397]: pgmap v5439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:35 smithi146 ceph-mon[35807]: pgmap v5439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:35 smithi076 ceph-mon[35401]: pgmap v5439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5483.119640 secs 2024-07-26T15:04:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5483.119640 secs 2024-07-26T15:04:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5483.119640 secs 2024-07-26T15:04:37.722 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:37 smithi146 ceph-mon[35807]: pgmap v5440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:04:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:37 smithi040 ceph-mon[32397]: pgmap v5440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:04:37.733 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:37 smithi076 ceph-mon[35401]: pgmap v5440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:04:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:39 smithi040 ceph-mon[32397]: pgmap v5441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:39 smithi146 ceph-mon[35807]: pgmap v5441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:39 smithi076 ceph-mon[35401]: pgmap v5441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:41 smithi040 ceph-mon[32397]: pgmap v5442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5488.119787 secs 2024-07-26T15:04:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:41 smithi146 ceph-mon[35807]: pgmap v5442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5488.119787 secs 2024-07-26T15:04:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:41 smithi076 ceph-mon[35401]: pgmap v5442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5488.119787 secs 2024-07-26T15:04:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:43 smithi146 ceph-mon[35807]: pgmap v5443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:43 smithi076 ceph-mon[35401]: pgmap v5443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:43 smithi040 ceph-mon[32397]: pgmap v5443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:45 smithi146 ceph-mon[35807]: pgmap v5444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:45 smithi076 ceph-mon[35401]: pgmap v5444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:45 smithi040 ceph-mon[32397]: pgmap v5444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:04:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5493.119885 secs 2024-07-26T15:04:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5493.119885 secs 2024-07-26T15:04:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5493.119885 secs 2024-07-26T15:04:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:47 smithi146 ceph-mon[35807]: pgmap v5445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:04:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:47 smithi076 ceph-mon[35401]: pgmap v5445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:04:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:47 smithi040 ceph-mon[32397]: pgmap v5445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:04:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:49 smithi146 ceph-mon[35807]: pgmap v5446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:49 smithi076 ceph-mon[35401]: pgmap v5446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:49 smithi040 ceph-mon[32397]: pgmap v5446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:51 smithi146 ceph-mon[35807]: pgmap v5447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5498.119997 secs 2024-07-26T15:04:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:51 smithi076 ceph-mon[35401]: pgmap v5447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5498.119997 secs 2024-07-26T15:04:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:51 smithi040 ceph-mon[32397]: pgmap v5447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5498.119997 secs 2024-07-26T15:04:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:53 smithi146 ceph-mon[35807]: pgmap v5448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:53 smithi076 ceph-mon[35401]: pgmap v5448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:53 smithi040 ceph-mon[32397]: pgmap v5448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:55 smithi146 ceph-mon[35807]: pgmap v5449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:55 smithi076 ceph-mon[35401]: pgmap v5449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:55 smithi040 ceph-mon[32397]: pgmap v5449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:04:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5503.120169 secs 2024-07-26T15:04:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5503.120169 secs 2024-07-26T15:04:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5503.120169 secs 2024-07-26T15:04:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:57 smithi146 ceph-mon[35807]: pgmap v5450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:57 smithi076 ceph-mon[35401]: pgmap v5450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:57 smithi040 ceph-mon[32397]: pgmap v5450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:04:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:04:59 smithi076 ceph-mon[35401]: pgmap v5451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:04:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:04:59 smithi040 ceph-mon[32397]: pgmap v5451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:04:59 smithi146 ceph-mon[35807]: pgmap v5451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:01 smithi076 ceph-mon[35401]: pgmap v5452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5508.120321 secs 2024-07-26T15:05:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:01 smithi040 ceph-mon[32397]: pgmap v5452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5508.120321 secs 2024-07-26T15:05:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:01 smithi146 ceph-mon[35807]: pgmap v5452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5508.120321 secs 2024-07-26T15:05:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:03 smithi040 ceph-mon[32397]: pgmap v5453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:03 smithi146 ceph-mon[35807]: pgmap v5453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:03 smithi076 ceph-mon[35401]: pgmap v5453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:05 smithi040 ceph-mon[32397]: pgmap v5454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:05 smithi146 ceph-mon[35807]: pgmap v5454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:05 smithi076 ceph-mon[35401]: pgmap v5454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5513.120462 secs 2024-07-26T15:05:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5513.120462 secs 2024-07-26T15:05:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5513.120462 secs 2024-07-26T15:05:07.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:07 smithi146 ceph-mon[35807]: pgmap v5455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:07 smithi040 ceph-mon[32397]: pgmap v5455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:07.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:07 smithi076 ceph-mon[35401]: pgmap v5455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:09 smithi040 ceph-mon[32397]: pgmap v5456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:09 smithi146 ceph-mon[35807]: pgmap v5456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:09 smithi076 ceph-mon[35401]: pgmap v5456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:11 smithi040 ceph-mon[32397]: pgmap v5457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5518.120606 secs 2024-07-26T15:05:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:11 smithi146 ceph-mon[35807]: pgmap v5457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5518.120606 secs 2024-07-26T15:05:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:11 smithi076 ceph-mon[35401]: pgmap v5457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5518.120606 secs 2024-07-26T15:05:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:13 smithi040 ceph-mon[32397]: pgmap v5458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:13 smithi146 ceph-mon[35807]: pgmap v5458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:13 smithi076 ceph-mon[35401]: pgmap v5458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:15 smithi040 ceph-mon[32397]: pgmap v5459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:15 smithi146 ceph-mon[35807]: pgmap v5459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:15 smithi076 ceph-mon[35401]: pgmap v5459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5523.120748 secs 2024-07-26T15:05:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5523.120748 secs 2024-07-26T15:05:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5523.120748 secs 2024-07-26T15:05:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:17 smithi040 ceph-mon[32397]: pgmap v5460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:05:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:17 smithi146 ceph-mon[35807]: pgmap v5460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:05:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:17 smithi076 ceph-mon[35401]: pgmap v5460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:05:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:19 smithi040 ceph-mon[32397]: pgmap v5461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:19 smithi146 ceph-mon[35807]: pgmap v5461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:19 smithi076 ceph-mon[35401]: pgmap v5461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:21 smithi040 ceph-mon[32397]: pgmap v5462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5528.120906 secs 2024-07-26T15:05:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:21 smithi146 ceph-mon[35807]: pgmap v5462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5528.120906 secs 2024-07-26T15:05:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:21 smithi076 ceph-mon[35401]: pgmap v5462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5528.120906 secs 2024-07-26T15:05:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:23 smithi040 ceph-mon[32397]: pgmap v5463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:23 smithi146 ceph-mon[35807]: pgmap v5463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:23 smithi076 ceph-mon[35401]: pgmap v5463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:25 smithi040 ceph-mon[32397]: pgmap v5464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:25 smithi146 ceph-mon[35807]: pgmap v5464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:25 smithi076 ceph-mon[35401]: pgmap v5464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5533.121059 secs 2024-07-26T15:05:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5533.121059 secs 2024-07-26T15:05:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5533.121059 secs 2024-07-26T15:05:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:27 smithi040 ceph-mon[32397]: pgmap v5465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:27 smithi146 ceph-mon[35807]: pgmap v5465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:27 smithi076 ceph-mon[35401]: pgmap v5465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:29 smithi040 ceph-mon[32397]: pgmap v5466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:29 smithi146 ceph-mon[35807]: pgmap v5466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:29 smithi076 ceph-mon[35401]: pgmap v5466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:30 smithi146 ceph-mon[35807]: pgmap v5467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:30 smithi076 ceph-mon[35401]: pgmap v5467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:30 smithi040 ceph-mon[32397]: pgmap v5467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5538.121197 secs 2024-07-26T15:05:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5538.121197 secs 2024-07-26T15:05:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5538.121197 secs 2024-07-26T15:05:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:32 smithi146 ceph-mon[35807]: pgmap v5468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:32 smithi076 ceph-mon[35401]: pgmap v5468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:32 smithi040 ceph-mon[32397]: pgmap v5468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:35 smithi146 ceph-mon[35807]: pgmap v5469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:35.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:35 smithi076 ceph-mon[35401]: pgmap v5469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:35.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:35 smithi040 ceph-mon[32397]: pgmap v5469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5543.121362 secs 2024-07-26T15:05:36.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5543.121362 secs 2024-07-26T15:05:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5543.121362 secs 2024-07-26T15:05:37.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:37 smithi146 ceph-mon[35807]: pgmap v5470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:37 smithi040 ceph-mon[32397]: pgmap v5470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:37 smithi076 ceph-mon[35401]: pgmap v5470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:39 smithi040 ceph-mon[32397]: pgmap v5471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:39 smithi146 ceph-mon[35807]: pgmap v5471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:39 smithi076 ceph-mon[35401]: pgmap v5471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:41 smithi040 ceph-mon[32397]: pgmap v5472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5548.121504 secs 2024-07-26T15:05:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:41 smithi146 ceph-mon[35807]: pgmap v5472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5548.121504 secs 2024-07-26T15:05:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:41 smithi076 ceph-mon[35401]: pgmap v5472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5548.121504 secs 2024-07-26T15:05:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:43 smithi040 ceph-mon[32397]: pgmap v5473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:43 smithi146 ceph-mon[35807]: pgmap v5473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:43 smithi076 ceph-mon[35401]: pgmap v5473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:45 smithi040 ceph-mon[32397]: pgmap v5474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:45 smithi146 ceph-mon[35807]: pgmap v5474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:45 smithi076 ceph-mon[35401]: pgmap v5474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5553.121624 secs 2024-07-26T15:05:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5553.121624 secs 2024-07-26T15:05:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5553.121624 secs 2024-07-26T15:05:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:47 smithi040 ceph-mon[32397]: pgmap v5475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:47 smithi146 ceph-mon[35807]: pgmap v5475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:47 smithi076 ceph-mon[35401]: pgmap v5475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:49 smithi040 ceph-mon[32397]: pgmap v5476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:49 smithi146 ceph-mon[35807]: pgmap v5476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:49 smithi076 ceph-mon[35401]: pgmap v5476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:51 smithi040 ceph-mon[32397]: pgmap v5477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5558.121765 secs 2024-07-26T15:05:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:51 smithi146 ceph-mon[35807]: pgmap v5477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5558.121765 secs 2024-07-26T15:05:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:51 smithi076 ceph-mon[35401]: pgmap v5477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5558.121765 secs 2024-07-26T15:05:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:53 smithi040 ceph-mon[32397]: pgmap v5478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:53 smithi146 ceph-mon[35807]: pgmap v5478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:53 smithi076 ceph-mon[35401]: pgmap v5478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:55 smithi040 ceph-mon[32397]: pgmap v5479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:55 smithi146 ceph-mon[35807]: pgmap v5479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:55 smithi076 ceph-mon[35401]: pgmap v5479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:05:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5563.121925 secs 2024-07-26T15:05:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5563.121925 secs 2024-07-26T15:05:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5563.121925 secs 2024-07-26T15:05:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:57 smithi040 ceph-mon[32397]: pgmap v5480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:57 smithi146 ceph-mon[35807]: pgmap v5480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:57 smithi076 ceph-mon[35401]: pgmap v5480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:05:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:05:59 smithi040 ceph-mon[32397]: pgmap v5481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:05:59 smithi146 ceph-mon[35807]: pgmap v5481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:05:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:05:59 smithi076 ceph-mon[35401]: pgmap v5481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:01 smithi040 ceph-mon[32397]: pgmap v5482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5568.122059 secs 2024-07-26T15:06:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:01 smithi146 ceph-mon[35807]: pgmap v5482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5568.122059 secs 2024-07-26T15:06:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:01 smithi076 ceph-mon[35401]: pgmap v5482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5568.122059 secs 2024-07-26T15:06:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:03 smithi040 ceph-mon[32397]: pgmap v5483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:03 smithi146 ceph-mon[35807]: pgmap v5483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:03 smithi076 ceph-mon[35401]: pgmap v5483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:05 smithi040 ceph-mon[32397]: pgmap v5484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:05 smithi146 ceph-mon[35807]: pgmap v5484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:05 smithi076 ceph-mon[35401]: pgmap v5484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5573.122194 secs 2024-07-26T15:06:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5573.122194 secs 2024-07-26T15:06:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5573.122194 secs 2024-07-26T15:06:07.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:07 smithi146 ceph-mon[35807]: pgmap v5485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:07 smithi040 ceph-mon[32397]: pgmap v5485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:07.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:07 smithi076 ceph-mon[35401]: pgmap v5485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:09 smithi040 ceph-mon[32397]: pgmap v5486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:09 smithi146 ceph-mon[35807]: pgmap v5486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:09 smithi076 ceph-mon[35401]: pgmap v5486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:11 smithi040 ceph-mon[32397]: pgmap v5487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5578.122361 secs 2024-07-26T15:06:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:11 smithi146 ceph-mon[35807]: pgmap v5487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5578.122361 secs 2024-07-26T15:06:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:11 smithi076 ceph-mon[35401]: pgmap v5487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5578.122361 secs 2024-07-26T15:06:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:13 smithi146 ceph-mon[35807]: pgmap v5488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:13 smithi076 ceph-mon[35401]: pgmap v5488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:13 smithi040 ceph-mon[32397]: pgmap v5488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: pgmap v5489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 2 op/s 2024-07-26T15:06:14.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: pgmap v5490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:06:14.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: pgmap v5491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 679 B/s rd, 1 op/s 2024-07-26T15:06:14.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: pgmap v5492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 2 op/s 2024-07-26T15:06:14.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: pgmap v5489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 2 op/s 2024-07-26T15:06:14.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: pgmap v5490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:06:14.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: pgmap v5491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 679 B/s rd, 1 op/s 2024-07-26T15:06:14.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: pgmap v5492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 2 op/s 2024-07-26T15:06:14.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: pgmap v5489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 2 op/s 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: pgmap v5490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: pgmap v5491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 679 B/s rd, 1 op/s 2024-07-26T15:06:14.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: pgmap v5492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 2 op/s 2024-07-26T15:06:14.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:06:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:16 smithi076 ceph-mon[35401]: pgmap v5493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-07-26T15:06:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5583.122492 secs 2024-07-26T15:06:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:16 smithi040 ceph-mon[32397]: pgmap v5493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-07-26T15:06:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5583.122492 secs 2024-07-26T15:06:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:16 smithi146 ceph-mon[35807]: pgmap v5493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-07-26T15:06:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5583.122492 secs 2024-07-26T15:06:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:18 smithi040 ceph-mon[32397]: pgmap v5494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-07-26T15:06:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:18 smithi146 ceph-mon[35807]: pgmap v5494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-07-26T15:06:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:18 smithi076 ceph-mon[35401]: pgmap v5494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-07-26T15:06:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:20 smithi040 ceph-mon[32397]: pgmap v5495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T15:06:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:20 smithi146 ceph-mon[35807]: pgmap v5495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T15:06:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:20 smithi076 ceph-mon[35401]: pgmap v5495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T15:06:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5588.122638 secs 2024-07-26T15:06:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5588.122638 secs 2024-07-26T15:06:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5588.122638 secs 2024-07-26T15:06:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:22 smithi040 ceph-mon[32397]: pgmap v5496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:06:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:22 smithi146 ceph-mon[35807]: pgmap v5496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:06:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:22 smithi076 ceph-mon[35401]: pgmap v5496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:06:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:24 smithi040 ceph-mon[32397]: pgmap v5497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:06:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:24 smithi146 ceph-mon[35807]: pgmap v5497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:06:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:24 smithi076 ceph-mon[35401]: pgmap v5497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:06:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:26 smithi040 ceph-mon[32397]: pgmap v5498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5593.122775 secs 2024-07-26T15:06:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:26 smithi146 ceph-mon[35807]: pgmap v5498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5593.122775 secs 2024-07-26T15:06:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:26 smithi076 ceph-mon[35401]: pgmap v5498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5593.122775 secs 2024-07-26T15:06:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:28 smithi040 ceph-mon[32397]: pgmap v5499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:28 smithi146 ceph-mon[35807]: pgmap v5499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:28 smithi076 ceph-mon[35401]: pgmap v5499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:30 smithi040 ceph-mon[32397]: pgmap v5500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:30 smithi146 ceph-mon[35807]: pgmap v5500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:30 smithi076 ceph-mon[35401]: pgmap v5500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5598.122931 secs 2024-07-26T15:06:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5598.122931 secs 2024-07-26T15:06:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5598.122931 secs 2024-07-26T15:06:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:32 smithi040 ceph-mon[32397]: pgmap v5501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:32 smithi146 ceph-mon[35807]: pgmap v5501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:32 smithi076 ceph-mon[35401]: pgmap v5501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:34 smithi040 ceph-mon[32397]: pgmap v5502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:34 smithi146 ceph-mon[35807]: pgmap v5502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:34 smithi076 ceph-mon[35401]: pgmap v5502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:36 smithi040 ceph-mon[32397]: pgmap v5503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5603.123089 secs 2024-07-26T15:06:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:36 smithi146 ceph-mon[35807]: pgmap v5503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5603.123089 secs 2024-07-26T15:06:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:36 smithi076 ceph-mon[35401]: pgmap v5503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5603.123089 secs 2024-07-26T15:06:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:38 smithi040 ceph-mon[32397]: pgmap v5504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:38 smithi146 ceph-mon[35807]: pgmap v5504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:38 smithi076 ceph-mon[35401]: pgmap v5504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:40 smithi040 ceph-mon[32397]: pgmap v5505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:40 smithi146 ceph-mon[35807]: pgmap v5505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:40 smithi076 ceph-mon[35401]: pgmap v5505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5608.123234 secs 2024-07-26T15:06:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5608.123234 secs 2024-07-26T15:06:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5608.123234 secs 2024-07-26T15:06:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:42 smithi040 ceph-mon[32397]: pgmap v5506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:42 smithi146 ceph-mon[35807]: pgmap v5506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:42 smithi076 ceph-mon[35401]: pgmap v5506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:44 smithi040 ceph-mon[32397]: pgmap v5507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:44 smithi146 ceph-mon[35807]: pgmap v5507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:44 smithi076 ceph-mon[35401]: pgmap v5507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5613.123335 secs 2024-07-26T15:06:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:46 smithi040 ceph-mon[32397]: pgmap v5508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5613.123335 secs 2024-07-26T15:06:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:46 smithi146 ceph-mon[35807]: pgmap v5508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5613.123335 secs 2024-07-26T15:06:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:46 smithi076 ceph-mon[35401]: pgmap v5508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:48 smithi040 ceph-mon[32397]: pgmap v5509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:48 smithi146 ceph-mon[35807]: pgmap v5509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:48 smithi076 ceph-mon[35401]: pgmap v5509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:50 smithi040 ceph-mon[32397]: pgmap v5510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:50 smithi146 ceph-mon[35807]: pgmap v5510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:50 smithi076 ceph-mon[35401]: pgmap v5510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5618.123471 secs 2024-07-26T15:06:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:51 smithi146 ceph-mon[35807]: pgmap v5511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5618.123471 secs 2024-07-26T15:06:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:51 smithi076 ceph-mon[35401]: pgmap v5511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5618.123471 secs 2024-07-26T15:06:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:51 smithi040 ceph-mon[32397]: pgmap v5511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:54 smithi040 ceph-mon[32397]: pgmap v5512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:54 smithi146 ceph-mon[35807]: pgmap v5512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:54 smithi076 ceph-mon[35401]: pgmap v5512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:06:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5623.123598 secs 2024-07-26T15:06:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:56 smithi040 ceph-mon[32397]: pgmap v5513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5623.123598 secs 2024-07-26T15:06:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:56 smithi146 ceph-mon[35807]: pgmap v5513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5623.123598 secs 2024-07-26T15:06:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:56 smithi076 ceph-mon[35401]: pgmap v5513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:06:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:06:58 smithi040 ceph-mon[32397]: pgmap v5514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:06:58 smithi146 ceph-mon[35807]: pgmap v5514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:06:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:06:58 smithi076 ceph-mon[35401]: pgmap v5514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:00 smithi040 ceph-mon[32397]: pgmap v5515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:00 smithi146 ceph-mon[35807]: pgmap v5515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:00 smithi076 ceph-mon[35401]: pgmap v5515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5628.123738 secs 2024-07-26T15:07:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5628.123738 secs 2024-07-26T15:07:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5628.123738 secs 2024-07-26T15:07:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:02 smithi040 ceph-mon[32397]: pgmap v5516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:02 smithi146 ceph-mon[35807]: pgmap v5516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:02 smithi076 ceph-mon[35401]: pgmap v5516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:04 smithi040 ceph-mon[32397]: pgmap v5517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:04 smithi146 ceph-mon[35807]: pgmap v5517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:04 smithi076 ceph-mon[35401]: pgmap v5517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5633.123894 secs 2024-07-26T15:07:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:06 smithi040 ceph-mon[32397]: pgmap v5518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5633.123894 secs 2024-07-26T15:07:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:06 smithi146 ceph-mon[35807]: pgmap v5518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5633.123894 secs 2024-07-26T15:07:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:06 smithi076 ceph-mon[35401]: pgmap v5518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:08.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:08 smithi040 ceph-mon[32397]: pgmap v5519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:08 smithi146 ceph-mon[35807]: pgmap v5519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:08 smithi076 ceph-mon[35401]: pgmap v5519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:10 smithi040 ceph-mon[32397]: pgmap v5520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:10 smithi146 ceph-mon[35807]: pgmap v5520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:10 smithi076 ceph-mon[35401]: pgmap v5520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5638.124050 secs 2024-07-26T15:07:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5638.124050 secs 2024-07-26T15:07:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5638.124050 secs 2024-07-26T15:07:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:12 smithi040 ceph-mon[32397]: pgmap v5521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:12 smithi146 ceph-mon[35807]: pgmap v5521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:12 smithi076 ceph-mon[35401]: pgmap v5521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:14 smithi040 ceph-mon[32397]: pgmap v5522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:07:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:14 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:14 smithi146 ceph-mon[35807]: pgmap v5522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:07:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:14 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:14 smithi076 ceph-mon[35401]: pgmap v5522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:07:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:14 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:15 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:15 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:15 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5643.124196 secs 2024-07-26T15:07:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:16 smithi040 ceph-mon[32397]: pgmap v5523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5643.124196 secs 2024-07-26T15:07:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:16 smithi146 ceph-mon[35807]: pgmap v5523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5643.124196 secs 2024-07-26T15:07:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:16 smithi076 ceph-mon[35401]: pgmap v5523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: pgmap v5524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: pgmap v5524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: pgmap v5524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:20 smithi146 ceph-mon[35807]: pgmap v5525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:20.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:20 smithi076 ceph-mon[35401]: pgmap v5525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:20.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:20 smithi040 ceph-mon[32397]: pgmap v5525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:21.768 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5648.124340 secs 2024-07-26T15:07:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5648.124340 secs 2024-07-26T15:07:22.016 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5648.124340 secs 2024-07-26T15:07:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:22 smithi040 ceph-mon[32397]: pgmap v5526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:23.023 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:22 smithi076 ceph-mon[35401]: pgmap v5526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:22 smithi146 ceph-mon[35807]: pgmap v5526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: pgmap v5527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: pgmap v5527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: pgmap v5527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:07:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:25 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:07:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:25 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:07:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:25 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:07:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:25 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:07:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:25 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:07:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:25 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:07:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:25 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:07:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:25 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:07:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:25 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:07:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:25 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:07:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:25 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:07:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:25 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:07:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5653.124472 secs 2024-07-26T15:07:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:26 smithi040 ceph-mon[32397]: pgmap v5528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5653.124472 secs 2024-07-26T15:07:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:26 smithi146 ceph-mon[35807]: pgmap v5528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5653.124472 secs 2024-07-26T15:07:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:26 smithi076 ceph-mon[35401]: pgmap v5528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:28 smithi146 ceph-mon[35807]: pgmap v5529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:28 smithi076 ceph-mon[35401]: pgmap v5529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:28 smithi040 ceph-mon[32397]: pgmap v5529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:29 smithi146 ceph-mon[35807]: pgmap v5530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:29 smithi076 ceph-mon[35401]: pgmap v5530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:29 smithi040 ceph-mon[32397]: pgmap v5530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5658.124611 secs 2024-07-26T15:07:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5658.124611 secs 2024-07-26T15:07:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5658.124611 secs 2024-07-26T15:07:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:32 smithi040 ceph-mon[32397]: pgmap v5531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:32 smithi146 ceph-mon[35807]: pgmap v5531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:32 smithi076 ceph-mon[35401]: pgmap v5531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:34 smithi040 ceph-mon[32397]: pgmap v5532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:34 smithi146 ceph-mon[35807]: pgmap v5532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:34 smithi076 ceph-mon[35401]: pgmap v5532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5663.124755 secs 2024-07-26T15:07:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:36 smithi040 ceph-mon[32397]: pgmap v5533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5663.124755 secs 2024-07-26T15:07:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:36 smithi146 ceph-mon[35807]: pgmap v5533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5663.124755 secs 2024-07-26T15:07:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:36 smithi076 ceph-mon[35401]: pgmap v5533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:38 smithi040 ceph-mon[32397]: pgmap v5534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:38 smithi146 ceph-mon[35807]: pgmap v5534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:38 smithi076 ceph-mon[35401]: pgmap v5534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:40 smithi040 ceph-mon[32397]: pgmap v5535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:40 smithi146 ceph-mon[35807]: pgmap v5535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:40 smithi076 ceph-mon[35401]: pgmap v5535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5668.124892 secs 2024-07-26T15:07:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5668.124892 secs 2024-07-26T15:07:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5668.124892 secs 2024-07-26T15:07:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:42 smithi040 ceph-mon[32397]: pgmap v5536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:42 smithi146 ceph-mon[35807]: pgmap v5536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:42 smithi076 ceph-mon[35401]: pgmap v5536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:44 smithi040 ceph-mon[32397]: pgmap v5537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:44 smithi146 ceph-mon[35807]: pgmap v5537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:44 smithi076 ceph-mon[35401]: pgmap v5537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5673.125032 secs 2024-07-26T15:07:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:46 smithi040 ceph-mon[32397]: pgmap v5538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5673.125032 secs 2024-07-26T15:07:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:46 smithi146 ceph-mon[35807]: pgmap v5538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5673.125032 secs 2024-07-26T15:07:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:46 smithi076 ceph-mon[35401]: pgmap v5538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:48 smithi040 ceph-mon[32397]: pgmap v5539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:48 smithi146 ceph-mon[35807]: pgmap v5539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:48 smithi076 ceph-mon[35401]: pgmap v5539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:50.957 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:50 smithi076 ceph-mon[35401]: pgmap v5540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:50 smithi040 ceph-mon[32397]: pgmap v5540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:50 smithi146 ceph-mon[35807]: pgmap v5540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5678.125173 secs 2024-07-26T15:07:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5678.125173 secs 2024-07-26T15:07:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5678.125173 secs 2024-07-26T15:07:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:52 smithi040 ceph-mon[32397]: pgmap v5541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:52 smithi146 ceph-mon[35807]: pgmap v5541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:52 smithi076 ceph-mon[35401]: pgmap v5541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:54 smithi040 ceph-mon[32397]: pgmap v5542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:54 smithi146 ceph-mon[35807]: pgmap v5542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:54 smithi076 ceph-mon[35401]: pgmap v5542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:07:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5683.125314 secs 2024-07-26T15:07:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:56 smithi040 ceph-mon[32397]: pgmap v5543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5683.125314 secs 2024-07-26T15:07:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:56 smithi146 ceph-mon[35807]: pgmap v5543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5683.125314 secs 2024-07-26T15:07:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:56 smithi076 ceph-mon[35401]: pgmap v5543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:07:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:58 smithi146 ceph-mon[35807]: pgmap v5544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:58 smithi076 ceph-mon[35401]: pgmap v5544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:07:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:58 smithi040 ceph-mon[32397]: pgmap v5544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:07:59 smithi146 ceph-mon[35807]: pgmap v5545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:07:59 smithi076 ceph-mon[35401]: pgmap v5545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:07:59 smithi040 ceph-mon[32397]: pgmap v5545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5688.125463 secs 2024-07-26T15:08:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5688.125463 secs 2024-07-26T15:08:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5688.125463 secs 2024-07-26T15:08:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:02 smithi040 ceph-mon[32397]: pgmap v5546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:02 smithi146 ceph-mon[35807]: pgmap v5546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:02 smithi076 ceph-mon[35401]: pgmap v5546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:04 smithi040 ceph-mon[32397]: pgmap v5547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:04 smithi146 ceph-mon[35807]: pgmap v5547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:04 smithi076 ceph-mon[35401]: pgmap v5547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5693.125605 secs 2024-07-26T15:08:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:06 smithi040 ceph-mon[32397]: pgmap v5548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5693.125605 secs 2024-07-26T15:08:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:06 smithi146 ceph-mon[35807]: pgmap v5548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5693.125605 secs 2024-07-26T15:08:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:06 smithi076 ceph-mon[35401]: pgmap v5548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:08 smithi040 ceph-mon[32397]: pgmap v5549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:08 smithi146 ceph-mon[35807]: pgmap v5549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:08 smithi076 ceph-mon[35401]: pgmap v5549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:10 smithi040 ceph-mon[32397]: pgmap v5550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:10 smithi146 ceph-mon[35807]: pgmap v5550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:10 smithi076 ceph-mon[35401]: pgmap v5550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5698.125747 secs 2024-07-26T15:08:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5698.125747 secs 2024-07-26T15:08:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5698.125747 secs 2024-07-26T15:08:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:12 smithi040 ceph-mon[32397]: pgmap v5551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:12 smithi146 ceph-mon[35807]: pgmap v5551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:12 smithi076 ceph-mon[35401]: pgmap v5551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:14 smithi040 ceph-mon[32397]: pgmap v5552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:14 smithi146 ceph-mon[35807]: pgmap v5552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:14 smithi076 ceph-mon[35401]: pgmap v5552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5703.125892 secs 2024-07-26T15:08:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:16 smithi040 ceph-mon[32397]: pgmap v5553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5703.125892 secs 2024-07-26T15:08:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:16 smithi146 ceph-mon[35807]: pgmap v5553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5703.125892 secs 2024-07-26T15:08:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:16 smithi076 ceph-mon[35401]: pgmap v5553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:18 smithi040 ceph-mon[32397]: pgmap v5554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:18 smithi146 ceph-mon[35807]: pgmap v5554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:18 smithi076 ceph-mon[35401]: pgmap v5554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:20 smithi040 ceph-mon[32397]: pgmap v5555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:20 smithi146 ceph-mon[35807]: pgmap v5555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:20 smithi076 ceph-mon[35401]: pgmap v5555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5708.126041 secs 2024-07-26T15:08:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5708.126041 secs 2024-07-26T15:08:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5708.126041 secs 2024-07-26T15:08:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:22 smithi146 ceph-mon[35807]: pgmap v5556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:22 smithi076 ceph-mon[35401]: pgmap v5556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:22 smithi040 ceph-mon[32397]: pgmap v5556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:23 smithi146 ceph-mon[35807]: pgmap v5557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:23 smithi076 ceph-mon[35401]: pgmap v5557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:23 smithi040 ceph-mon[32397]: pgmap v5557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5713.126207 secs 2024-07-26T15:08:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:26 smithi040 ceph-mon[32397]: pgmap v5558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5713.126207 secs 2024-07-26T15:08:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:26 smithi146 ceph-mon[35807]: pgmap v5558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5713.126207 secs 2024-07-26T15:08:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:26 smithi076 ceph-mon[35401]: pgmap v5558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:28 smithi040 ceph-mon[32397]: pgmap v5559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:28 smithi146 ceph-mon[35807]: pgmap v5559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:28 smithi076 ceph-mon[35401]: pgmap v5559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:30 smithi040 ceph-mon[32397]: pgmap v5560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:30 smithi146 ceph-mon[35807]: pgmap v5560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:30 smithi076 ceph-mon[35401]: pgmap v5560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5718.126351 secs 2024-07-26T15:08:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5718.126351 secs 2024-07-26T15:08:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5718.126351 secs 2024-07-26T15:08:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:32 smithi040 ceph-mon[32397]: pgmap v5561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:32 smithi146 ceph-mon[35807]: pgmap v5561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:32 smithi076 ceph-mon[35401]: pgmap v5561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:34 smithi040 ceph-mon[32397]: pgmap v5562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:34 smithi146 ceph-mon[35807]: pgmap v5562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:34 smithi076 ceph-mon[35401]: pgmap v5562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5723.126452 secs 2024-07-26T15:08:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:36 smithi040 ceph-mon[32397]: pgmap v5563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5723.126452 secs 2024-07-26T15:08:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:36 smithi146 ceph-mon[35807]: pgmap v5563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5723.126452 secs 2024-07-26T15:08:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:36 smithi076 ceph-mon[35401]: pgmap v5563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:38 smithi040 ceph-mon[32397]: pgmap v5564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:38 smithi146 ceph-mon[35807]: pgmap v5564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:38 smithi076 ceph-mon[35401]: pgmap v5564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:40 smithi040 ceph-mon[32397]: pgmap v5565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:40 smithi146 ceph-mon[35807]: pgmap v5565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:40 smithi076 ceph-mon[35401]: pgmap v5565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5728.126590 secs 2024-07-26T15:08:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5728.126590 secs 2024-07-26T15:08:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5728.126590 secs 2024-07-26T15:08:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:42 smithi146 ceph-mon[35807]: pgmap v5566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:42 smithi076 ceph-mon[35401]: pgmap v5566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:42 smithi040 ceph-mon[32397]: pgmap v5566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:45.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:44 smithi040 ceph-mon[32397]: pgmap v5567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:44 smithi146 ceph-mon[35807]: pgmap v5567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:45.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:44 smithi076 ceph-mon[35401]: pgmap v5567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:45 smithi146 ceph-mon[35807]: pgmap v5568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:45 smithi076 ceph-mon[35401]: pgmap v5568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:45 smithi040 ceph-mon[32397]: pgmap v5568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5733.126759 secs 2024-07-26T15:08:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5733.126759 secs 2024-07-26T15:08:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5733.126759 secs 2024-07-26T15:08:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:47 smithi146 ceph-mon[35807]: pgmap v5569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:47 smithi076 ceph-mon[35401]: pgmap v5569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:47 smithi040 ceph-mon[32397]: pgmap v5569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:50 smithi040 ceph-mon[32397]: pgmap v5570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:50 smithi146 ceph-mon[35807]: pgmap v5570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:50 smithi076 ceph-mon[35401]: pgmap v5570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5738.126903 secs 2024-07-26T15:08:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5738.126903 secs 2024-07-26T15:08:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5738.126903 secs 2024-07-26T15:08:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:52 smithi040 ceph-mon[32397]: pgmap v5571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:52 smithi146 ceph-mon[35807]: pgmap v5571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:52 smithi076 ceph-mon[35401]: pgmap v5571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:54 smithi040 ceph-mon[32397]: pgmap v5572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:54 smithi146 ceph-mon[35807]: pgmap v5572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:54 smithi076 ceph-mon[35401]: pgmap v5572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:08:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5743.126986 secs 2024-07-26T15:08:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:56 smithi040 ceph-mon[32397]: pgmap v5573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5743.126986 secs 2024-07-26T15:08:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:56 smithi146 ceph-mon[35807]: pgmap v5573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5743.126986 secs 2024-07-26T15:08:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:56 smithi076 ceph-mon[35401]: pgmap v5573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:08:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:08:58 smithi040 ceph-mon[32397]: pgmap v5574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:08:58 smithi146 ceph-mon[35807]: pgmap v5574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:08:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:08:58 smithi076 ceph-mon[35401]: pgmap v5574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:00 smithi040 ceph-mon[32397]: pgmap v5575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:00 smithi146 ceph-mon[35807]: pgmap v5575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:00 smithi076 ceph-mon[35401]: pgmap v5575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5748.127123 secs 2024-07-26T15:09:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5748.127123 secs 2024-07-26T15:09:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5748.127123 secs 2024-07-26T15:09:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:02 smithi146 ceph-mon[35807]: pgmap v5576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:02 smithi076 ceph-mon[35401]: pgmap v5576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:02 smithi040 ceph-mon[32397]: pgmap v5576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:04 smithi146 ceph-mon[35807]: pgmap v5577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:04 smithi076 ceph-mon[35401]: pgmap v5577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:04 smithi040 ceph-mon[32397]: pgmap v5577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5753.127312 secs 2024-07-26T15:09:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:06 smithi146 ceph-mon[35807]: pgmap v5578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5753.127312 secs 2024-07-26T15:09:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:06 smithi076 ceph-mon[35401]: pgmap v5578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5753.127312 secs 2024-07-26T15:09:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:06 smithi040 ceph-mon[32397]: pgmap v5578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:07 smithi146 ceph-mon[35807]: pgmap v5579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:07 smithi076 ceph-mon[35401]: pgmap v5579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:07 smithi040 ceph-mon[32397]: pgmap v5579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:10 smithi040 ceph-mon[32397]: pgmap v5580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:10 smithi146 ceph-mon[35807]: pgmap v5580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:10 smithi076 ceph-mon[35401]: pgmap v5580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5758.127447 secs 2024-07-26T15:09:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5758.127447 secs 2024-07-26T15:09:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5758.127447 secs 2024-07-26T15:09:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:12 smithi040 ceph-mon[32397]: pgmap v5581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:12 smithi146 ceph-mon[35807]: pgmap v5581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:12 smithi076 ceph-mon[35401]: pgmap v5581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:14 smithi040 ceph-mon[32397]: pgmap v5582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:14 smithi146 ceph-mon[35807]: pgmap v5582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:14 smithi076 ceph-mon[35401]: pgmap v5582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 5763.127549 secs 2024-07-26T15:09:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:16 smithi040 ceph-mon[32397]: slow request 5763.127548 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T15:09:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:16 smithi040 ceph-mon[32397]: pgmap v5583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 5763.127549 secs 2024-07-26T15:09:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:16 smithi146 ceph-mon[35807]: slow request 5763.127548 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T15:09:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:16 smithi146 ceph-mon[35807]: pgmap v5583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 5763.127549 secs 2024-07-26T15:09:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:16 smithi076 ceph-mon[35401]: slow request 5763.127548 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T15:09:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:16 smithi076 ceph-mon[35401]: pgmap v5583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:18 smithi040 ceph-mon[32397]: pgmap v5584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:18 smithi146 ceph-mon[35807]: pgmap v5584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:18 smithi076 ceph-mon[35401]: pgmap v5584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:20 smithi146 ceph-mon[35807]: pgmap v5585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:20 smithi076 ceph-mon[35401]: pgmap v5585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:20 smithi040 ceph-mon[32397]: pgmap v5585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5768.127694 secs 2024-07-26T15:09:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5768.127694 secs 2024-07-26T15:09:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5768.127694 secs 2024-07-26T15:09:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:22 smithi146 ceph-mon[35807]: pgmap v5586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:22 smithi076 ceph-mon[35401]: pgmap v5586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:22 smithi040 ceph-mon[32397]: pgmap v5586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:24 smithi146 ceph-mon[35807]: pgmap v5587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:24 smithi076 ceph-mon[35401]: pgmap v5587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:24 smithi040 ceph-mon[32397]: pgmap v5587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:25 smithi146 ceph-mon[35807]: pgmap v5588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:25 smithi076 ceph-mon[35401]: pgmap v5588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:25 smithi040 ceph-mon[32397]: pgmap v5588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5773.127827 secs 2024-07-26T15:09:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5773.127827 secs 2024-07-26T15:09:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5773.127827 secs 2024-07-26T15:09:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:27 smithi146 ceph-mon[35807]: pgmap v5589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:27 smithi076 ceph-mon[35401]: pgmap v5589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:27 smithi040 ceph-mon[32397]: pgmap v5589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:30 smithi040 ceph-mon[32397]: pgmap v5590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:30 smithi146 ceph-mon[35807]: pgmap v5590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:30 smithi076 ceph-mon[35401]: pgmap v5590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5778.127970 secs 2024-07-26T15:09:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5778.127970 secs 2024-07-26T15:09:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5778.127970 secs 2024-07-26T15:09:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:32 smithi040 ceph-mon[32397]: pgmap v5591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:32 smithi146 ceph-mon[35807]: pgmap v5591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:32 smithi076 ceph-mon[35401]: pgmap v5591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:34 smithi040 ceph-mon[32397]: pgmap v5592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:34 smithi146 ceph-mon[35807]: pgmap v5592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:34 smithi076 ceph-mon[35401]: pgmap v5592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5783.128103 secs 2024-07-26T15:09:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:36 smithi146 ceph-mon[35807]: pgmap v5593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5783.128103 secs 2024-07-26T15:09:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:36 smithi076 ceph-mon[35401]: pgmap v5593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5783.128103 secs 2024-07-26T15:09:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:36 smithi040 ceph-mon[32397]: pgmap v5593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:38 smithi146 ceph-mon[35807]: pgmap v5594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:38 smithi076 ceph-mon[35401]: pgmap v5594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:38 smithi040 ceph-mon[32397]: pgmap v5594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:40 smithi146 ceph-mon[35807]: pgmap v5595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:40 smithi076 ceph-mon[35401]: pgmap v5595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:40 smithi040 ceph-mon[32397]: pgmap v5595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5788.128257 secs 2024-07-26T15:09:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5788.128257 secs 2024-07-26T15:09:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5788.128257 secs 2024-07-26T15:09:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:42 smithi146 ceph-mon[35807]: pgmap v5596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:42 smithi076 ceph-mon[35401]: pgmap v5596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:42 smithi040 ceph-mon[32397]: pgmap v5596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:43 smithi146 ceph-mon[35807]: pgmap v5597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:43 smithi076 ceph-mon[35401]: pgmap v5597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:43 smithi040 ceph-mon[32397]: pgmap v5597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5793.128404 secs 2024-07-26T15:09:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:46 smithi040 ceph-mon[32397]: pgmap v5598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5793.128404 secs 2024-07-26T15:09:47.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:46 smithi146 ceph-mon[35807]: pgmap v5598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5793.128404 secs 2024-07-26T15:09:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:46 smithi076 ceph-mon[35401]: pgmap v5598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:48 smithi040 ceph-mon[32397]: pgmap v5599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:48 smithi146 ceph-mon[35807]: pgmap v5599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:48 smithi076 ceph-mon[35401]: pgmap v5599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:50 smithi040 ceph-mon[32397]: pgmap v5600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:50 smithi146 ceph-mon[35807]: pgmap v5600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:50 smithi076 ceph-mon[35401]: pgmap v5600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:09:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5798.128553 secs 2024-07-26T15:09:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5798.128553 secs 2024-07-26T15:09:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5798.128553 secs 2024-07-26T15:09:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:52 smithi146 ceph-mon[35807]: pgmap v5601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:52 smithi076 ceph-mon[35401]: pgmap v5601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:52 smithi040 ceph-mon[32397]: pgmap v5601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:09:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:54 smithi146 ceph-mon[35807]: pgmap v5602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:54 smithi076 ceph-mon[35401]: pgmap v5602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:54 smithi040 ceph-mon[32397]: pgmap v5602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:09:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5803.128705 secs 2024-07-26T15:09:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:56 smithi146 ceph-mon[35807]: pgmap v5603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:09:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5803.128705 secs 2024-07-26T15:09:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:56 smithi076 ceph-mon[35401]: pgmap v5603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:09:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5803.128705 secs 2024-07-26T15:09:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:56 smithi040 ceph-mon[32397]: pgmap v5603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:09:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:09:57 smithi146 ceph-mon[35807]: pgmap v5604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:09:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:09:57 smithi076 ceph-mon[35401]: pgmap v5604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:09:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:09:57 smithi040 ceph-mon[32397]: pgmap v5604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:00 smithi040 ceph-mon[32397]: pgmap v5605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:10:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:00 smithi146 ceph-mon[35807]: pgmap v5605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:10:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:00 smithi076 ceph-mon[35401]: pgmap v5605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:10:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5808.128852 secs 2024-07-26T15:10:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5808.128852 secs 2024-07-26T15:10:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5808.128852 secs 2024-07-26T15:10:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:02 smithi146 ceph-mon[35807]: pgmap v5606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:02 smithi076 ceph-mon[35401]: pgmap v5606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:02 smithi040 ceph-mon[32397]: pgmap v5606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:04 smithi146 ceph-mon[35807]: pgmap v5607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:04 smithi076 ceph-mon[35401]: pgmap v5607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:04 smithi040 ceph-mon[32397]: pgmap v5607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:10:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5813.128937 secs 2024-07-26T15:10:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:06 smithi146 ceph-mon[35807]: pgmap v5608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:10:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5813.128937 secs 2024-07-26T15:10:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:06 smithi076 ceph-mon[35401]: pgmap v5608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:10:07.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5813.128937 secs 2024-07-26T15:10:07.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:06 smithi040 ceph-mon[32397]: pgmap v5608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:10:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:08 smithi146 ceph-mon[35807]: pgmap v5609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:08 smithi076 ceph-mon[35401]: pgmap v5609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:08 smithi040 ceph-mon[32397]: pgmap v5609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:09 smithi076 ceph-mon[35401]: pgmap v5610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:09 smithi040 ceph-mon[32397]: pgmap v5610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:09 smithi146 ceph-mon[35807]: pgmap v5610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5818.129078 secs 2024-07-26T15:10:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5818.129078 secs 2024-07-26T15:10:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5818.129078 secs 2024-07-26T15:10:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:12 smithi040 ceph-mon[32397]: pgmap v5611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:12 smithi146 ceph-mon[35807]: pgmap v5611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:12 smithi076 ceph-mon[35401]: pgmap v5611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:14 smithi146 ceph-mon[35807]: pgmap v5612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:14 smithi076 ceph-mon[35401]: pgmap v5612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:14 smithi040 ceph-mon[32397]: pgmap v5612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:17.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5823.129216 secs 2024-07-26T15:10:17.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:16 smithi040 ceph-mon[32397]: pgmap v5613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5823.129216 secs 2024-07-26T15:10:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:16 smithi146 ceph-mon[35807]: pgmap v5613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5823.129216 secs 2024-07-26T15:10:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:16 smithi076 ceph-mon[35401]: pgmap v5613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:18 smithi146 ceph-mon[35807]: pgmap v5614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:18 smithi076 ceph-mon[35401]: pgmap v5614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:18 smithi040 ceph-mon[32397]: pgmap v5614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:20 smithi146 ceph-mon[35807]: pgmap v5615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:20 smithi076 ceph-mon[35401]: pgmap v5615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:20 smithi040 ceph-mon[32397]: pgmap v5615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5828.129377 secs 2024-07-26T15:10:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5828.129377 secs 2024-07-26T15:10:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5828.129377 secs 2024-07-26T15:10:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:22 smithi146 ceph-mon[35807]: pgmap v5616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:22 smithi076 ceph-mon[35401]: pgmap v5616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:22 smithi040 ceph-mon[32397]: pgmap v5616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:23 smithi146 ceph-mon[35807]: pgmap v5617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:23 smithi076 ceph-mon[35401]: pgmap v5617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:23 smithi040 ceph-mon[32397]: pgmap v5617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5833.129506 secs 2024-07-26T15:10:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:26 smithi146 ceph-mon[35807]: pgmap v5618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5833.129506 secs 2024-07-26T15:10:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:26 smithi076 ceph-mon[35401]: pgmap v5618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5833.129506 secs 2024-07-26T15:10:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:26 smithi040 ceph-mon[32397]: pgmap v5618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:28 smithi146 ceph-mon[35807]: pgmap v5619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:29.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:28 smithi076 ceph-mon[35401]: pgmap v5619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:28 smithi040 ceph-mon[32397]: pgmap v5619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:30 smithi146 ceph-mon[35807]: pgmap v5620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:30 smithi076 ceph-mon[35401]: pgmap v5620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:30 smithi040 ceph-mon[32397]: pgmap v5620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5838.129669 secs 2024-07-26T15:10:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5838.129669 secs 2024-07-26T15:10:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5838.129669 secs 2024-07-26T15:10:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:32 smithi146 ceph-mon[35807]: pgmap v5621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:32 smithi076 ceph-mon[35401]: pgmap v5621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:32 smithi040 ceph-mon[32397]: pgmap v5621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:33 smithi146 ceph-mon[35807]: pgmap v5622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:33 smithi076 ceph-mon[35401]: pgmap v5622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:33 smithi040 ceph-mon[32397]: pgmap v5622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5843.129765 secs 2024-07-26T15:10:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:36 smithi146 ceph-mon[35807]: pgmap v5623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:10:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5843.129765 secs 2024-07-26T15:10:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:36 smithi076 ceph-mon[35401]: pgmap v5623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:10:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5843.129765 secs 2024-07-26T15:10:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:36 smithi040 ceph-mon[32397]: pgmap v5623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:10:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:38 smithi146 ceph-mon[35807]: pgmap v5624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:38 smithi076 ceph-mon[35401]: pgmap v5624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:38 smithi040 ceph-mon[32397]: pgmap v5624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:40 smithi146 ceph-mon[35807]: pgmap v5625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:40 smithi076 ceph-mon[35401]: pgmap v5625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:40 smithi040 ceph-mon[32397]: pgmap v5625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5848.129903 secs 2024-07-26T15:10:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5848.129903 secs 2024-07-26T15:10:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5848.129903 secs 2024-07-26T15:10:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:42 smithi146 ceph-mon[35807]: pgmap v5626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:42 smithi076 ceph-mon[35401]: pgmap v5626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:42 smithi040 ceph-mon[32397]: pgmap v5626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:43 smithi146 ceph-mon[35807]: pgmap v5627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:43 smithi076 ceph-mon[35401]: pgmap v5627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:43 smithi040 ceph-mon[32397]: pgmap v5627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5853.130046 secs 2024-07-26T15:10:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:46 smithi146 ceph-mon[35807]: pgmap v5628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5853.130046 secs 2024-07-26T15:10:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:46 smithi076 ceph-mon[35401]: pgmap v5628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5853.130046 secs 2024-07-26T15:10:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:46 smithi040 ceph-mon[32397]: pgmap v5628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:49.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:48 smithi040 ceph-mon[32397]: pgmap v5629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:48 smithi146 ceph-mon[35807]: pgmap v5629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:48 smithi076 ceph-mon[35401]: pgmap v5629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:50 smithi146 ceph-mon[35807]: pgmap v5630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:50 smithi076 ceph-mon[35401]: pgmap v5630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:50 smithi040 ceph-mon[32397]: pgmap v5630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5858.130191 secs 2024-07-26T15:10:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5858.130191 secs 2024-07-26T15:10:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5858.130191 secs 2024-07-26T15:10:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:52 smithi146 ceph-mon[35807]: pgmap v5631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:52 smithi076 ceph-mon[35401]: pgmap v5631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:52 smithi040 ceph-mon[32397]: pgmap v5631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:53 smithi146 ceph-mon[35807]: pgmap v5632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:53 smithi076 ceph-mon[35401]: pgmap v5632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:53 smithi040 ceph-mon[32397]: pgmap v5632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:10:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5863.130329 secs 2024-07-26T15:10:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:56 smithi146 ceph-mon[35807]: pgmap v5633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5863.130329 secs 2024-07-26T15:10:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:56 smithi076 ceph-mon[35401]: pgmap v5633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5863.130329 secs 2024-07-26T15:10:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:56 smithi040 ceph-mon[32397]: pgmap v5633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:10:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:10:58 smithi146 ceph-mon[35807]: pgmap v5634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:10:58 smithi076 ceph-mon[35401]: pgmap v5634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:10:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:10:58 smithi040 ceph-mon[32397]: pgmap v5634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:00 smithi146 ceph-mon[35807]: pgmap v5635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:00 smithi076 ceph-mon[35401]: pgmap v5635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:00 smithi040 ceph-mon[32397]: pgmap v5635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5868.130465 secs 2024-07-26T15:11:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5868.130465 secs 2024-07-26T15:11:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5868.130465 secs 2024-07-26T15:11:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:02 smithi146 ceph-mon[35807]: pgmap v5636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:02 smithi076 ceph-mon[35401]: pgmap v5636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:02 smithi040 ceph-mon[32397]: pgmap v5636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:03 smithi146 ceph-mon[35807]: pgmap v5637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:03 smithi076 ceph-mon[35401]: pgmap v5637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:03 smithi040 ceph-mon[32397]: pgmap v5637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5873.130640 secs 2024-07-26T15:11:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:06 smithi146 ceph-mon[35807]: pgmap v5638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5873.130640 secs 2024-07-26T15:11:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:06 smithi076 ceph-mon[35401]: pgmap v5638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5873.130640 secs 2024-07-26T15:11:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:06 smithi040 ceph-mon[32397]: pgmap v5638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:08 smithi146 ceph-mon[35807]: pgmap v5639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:08 smithi076 ceph-mon[35401]: pgmap v5639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:08 smithi040 ceph-mon[32397]: pgmap v5639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:10 smithi146 ceph-mon[35807]: pgmap v5640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:10 smithi076 ceph-mon[35401]: pgmap v5640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:10 smithi040 ceph-mon[32397]: pgmap v5640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5878.130790 secs 2024-07-26T15:11:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5878.130790 secs 2024-07-26T15:11:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5878.130790 secs 2024-07-26T15:11:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:12 smithi146 ceph-mon[35807]: pgmap v5641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:12 smithi076 ceph-mon[35401]: pgmap v5641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:12 smithi040 ceph-mon[32397]: pgmap v5641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:13 smithi040 ceph-mon[32397]: pgmap v5642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:13 smithi146 ceph-mon[35807]: pgmap v5642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:13 smithi076 ceph-mon[35401]: pgmap v5642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5883.130911 secs 2024-07-26T15:11:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:16 smithi146 ceph-mon[35807]: pgmap v5643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5883.130911 secs 2024-07-26T15:11:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:16 smithi076 ceph-mon[35401]: pgmap v5643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5883.130911 secs 2024-07-26T15:11:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:16 smithi040 ceph-mon[32397]: pgmap v5643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:19.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:18 smithi040 ceph-mon[32397]: pgmap v5644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:18 smithi146 ceph-mon[35807]: pgmap v5644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:18 smithi076 ceph-mon[35401]: pgmap v5644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:19 smithi146 ceph-mon[35807]: pgmap v5645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:19 smithi076 ceph-mon[35401]: pgmap v5645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:19 smithi040 ceph-mon[32397]: pgmap v5645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5888.131057 secs 2024-07-26T15:11:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5888.131057 secs 2024-07-26T15:11:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5888.131057 secs 2024-07-26T15:11:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:22 smithi040 ceph-mon[32397]: pgmap v5646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:22 smithi146 ceph-mon[35807]: pgmap v5646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:22 smithi076 ceph-mon[35401]: pgmap v5646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:24 smithi146 ceph-mon[35807]: pgmap v5647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:24 smithi076 ceph-mon[35401]: pgmap v5647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:24 smithi040 ceph-mon[32397]: pgmap v5647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:25 smithi040 ceph-mon[32397]: pgmap v5648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:25 smithi146 ceph-mon[35807]: pgmap v5648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:25 smithi076 ceph-mon[35401]: pgmap v5648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5893.131171 secs 2024-07-26T15:11:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5893.131171 secs 2024-07-26T15:11:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5893.131171 secs 2024-07-26T15:11:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:27 smithi040 ceph-mon[32397]: pgmap v5649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:27 smithi146 ceph-mon[35807]: pgmap v5649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:27 smithi076 ceph-mon[35401]: pgmap v5649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:30 smithi146 ceph-mon[35807]: pgmap v5650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:30 smithi076 ceph-mon[35401]: pgmap v5650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:30 smithi040 ceph-mon[32397]: pgmap v5650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5898.131358 secs 2024-07-26T15:11:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5898.131358 secs 2024-07-26T15:11:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5898.131358 secs 2024-07-26T15:11:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:32 smithi146 ceph-mon[35807]: pgmap v5651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:32 smithi076 ceph-mon[35401]: pgmap v5651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:32 smithi040 ceph-mon[32397]: pgmap v5651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:33 smithi146 ceph-mon[35807]: pgmap v5652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:33 smithi076 ceph-mon[35401]: pgmap v5652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:33 smithi040 ceph-mon[32397]: pgmap v5652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5903.131501 secs 2024-07-26T15:11:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:36 smithi146 ceph-mon[35807]: pgmap v5653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5903.131501 secs 2024-07-26T15:11:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:36 smithi076 ceph-mon[35401]: pgmap v5653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5903.131501 secs 2024-07-26T15:11:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:36 smithi040 ceph-mon[32397]: pgmap v5653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:37 smithi146 ceph-mon[35807]: pgmap v5654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:37 smithi076 ceph-mon[35401]: pgmap v5654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:37 smithi040 ceph-mon[32397]: pgmap v5654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:39 smithi040 ceph-mon[32397]: pgmap v5655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:39 smithi146 ceph-mon[35807]: pgmap v5655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:39 smithi076 ceph-mon[35401]: pgmap v5655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5908.131642 secs 2024-07-26T15:11:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5908.131642 secs 2024-07-26T15:11:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5908.131642 secs 2024-07-26T15:11:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:42 smithi040 ceph-mon[32397]: pgmap v5656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:42 smithi146 ceph-mon[35807]: pgmap v5656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:42 smithi076 ceph-mon[35401]: pgmap v5656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:43 smithi040 ceph-mon[32397]: pgmap v5657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:43 smithi146 ceph-mon[35807]: pgmap v5657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:43 smithi076 ceph-mon[35401]: pgmap v5657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:45 smithi040 ceph-mon[32397]: pgmap v5658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:45 smithi146 ceph-mon[35807]: pgmap v5658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:46.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:45 smithi076 ceph-mon[35401]: pgmap v5658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5913.131805 secs 2024-07-26T15:11:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5913.131805 secs 2024-07-26T15:11:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5913.131805 secs 2024-07-26T15:11:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:47 smithi040 ceph-mon[32397]: pgmap v5659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:47 smithi146 ceph-mon[35807]: pgmap v5659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:47 smithi076 ceph-mon[35401]: pgmap v5659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:49 smithi040 ceph-mon[32397]: pgmap v5660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:49 smithi146 ceph-mon[35807]: pgmap v5660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:49 smithi076 ceph-mon[35401]: pgmap v5660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5918.131903 secs 2024-07-26T15:11:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5918.131903 secs 2024-07-26T15:11:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5918.131903 secs 2024-07-26T15:11:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:52 smithi040 ceph-mon[32397]: pgmap v5661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:52 smithi146 ceph-mon[35807]: pgmap v5661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:52 smithi076 ceph-mon[35401]: pgmap v5661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:53 smithi040 ceph-mon[32397]: pgmap v5662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:53 smithi146 ceph-mon[35807]: pgmap v5662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:53 smithi076 ceph-mon[35401]: pgmap v5662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:11:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:55 smithi040 ceph-mon[32397]: pgmap v5663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:55 smithi146 ceph-mon[35807]: pgmap v5663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:55 smithi076 ceph-mon[35401]: pgmap v5663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:11:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5923.132042 secs 2024-07-26T15:11:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5923.132042 secs 2024-07-26T15:11:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5923.132042 secs 2024-07-26T15:11:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:57 smithi040 ceph-mon[32397]: pgmap v5664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:57 smithi146 ceph-mon[35807]: pgmap v5664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:11:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:57 smithi076 ceph-mon[35401]: pgmap v5664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:11:59 smithi040 ceph-mon[32397]: pgmap v5665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:11:59 smithi146 ceph-mon[35807]: pgmap v5665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:11:59 smithi076 ceph-mon[35401]: pgmap v5665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5928.132215 secs 2024-07-26T15:12:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5928.132215 secs 2024-07-26T15:12:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5928.132215 secs 2024-07-26T15:12:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:02 smithi040 ceph-mon[32397]: pgmap v5666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:02 smithi146 ceph-mon[35807]: pgmap v5666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:02 smithi076 ceph-mon[35401]: pgmap v5666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:03 smithi040 ceph-mon[32397]: pgmap v5667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:03 smithi146 ceph-mon[35807]: pgmap v5667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:03 smithi076 ceph-mon[35401]: pgmap v5667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:05 smithi040 ceph-mon[32397]: pgmap v5668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:05 smithi146 ceph-mon[35807]: pgmap v5668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:05 smithi076 ceph-mon[35401]: pgmap v5668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5933.132357 secs 2024-07-26T15:12:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5933.132357 secs 2024-07-26T15:12:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5933.132357 secs 2024-07-26T15:12:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:08 smithi146 ceph-mon[35807]: pgmap v5669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:08.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:08 smithi076 ceph-mon[35401]: pgmap v5669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:08.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:08 smithi040 ceph-mon[32397]: pgmap v5669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:09 smithi040 ceph-mon[32397]: pgmap v5670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:09 smithi146 ceph-mon[35807]: pgmap v5670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:09 smithi076 ceph-mon[35401]: pgmap v5670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5938.132526 secs 2024-07-26T15:12:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5938.132526 secs 2024-07-26T15:12:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5938.132526 secs 2024-07-26T15:12:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:12 smithi040 ceph-mon[32397]: pgmap v5671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:12 smithi146 ceph-mon[35807]: pgmap v5671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:12 smithi076 ceph-mon[35401]: pgmap v5671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:13 smithi040 ceph-mon[32397]: pgmap v5672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:13 smithi146 ceph-mon[35807]: pgmap v5672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:13 smithi076 ceph-mon[35401]: pgmap v5672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:15 smithi040 ceph-mon[32397]: pgmap v5673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:15 smithi146 ceph-mon[35807]: pgmap v5673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:15 smithi076 ceph-mon[35401]: pgmap v5673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5943.132662 secs 2024-07-26T15:12:17.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5943.132662 secs 2024-07-26T15:12:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5943.132662 secs 2024-07-26T15:12:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:17 smithi040 ceph-mon[32397]: pgmap v5674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:17 smithi146 ceph-mon[35807]: pgmap v5674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:17 smithi076 ceph-mon[35401]: pgmap v5674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:19 smithi040 ceph-mon[32397]: pgmap v5675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:19 smithi146 ceph-mon[35807]: pgmap v5675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:19 smithi076 ceph-mon[35401]: pgmap v5675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5948.132819 secs 2024-07-26T15:12:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5948.132819 secs 2024-07-26T15:12:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5948.132819 secs 2024-07-26T15:12:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:22 smithi040 ceph-mon[32397]: pgmap v5676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:22 smithi146 ceph-mon[35807]: pgmap v5676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:22.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:22 smithi076 ceph-mon[35401]: pgmap v5676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:23 smithi040 ceph-mon[32397]: pgmap v5677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:23 smithi146 ceph-mon[35807]: pgmap v5677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:23 smithi076 ceph-mon[35401]: pgmap v5677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:25 smithi040 ceph-mon[32397]: pgmap v5678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:25 smithi146 ceph-mon[35807]: pgmap v5678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:25 smithi076 ceph-mon[35401]: pgmap v5678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5953.132907 secs 2024-07-26T15:12:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5953.132907 secs 2024-07-26T15:12:27.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5953.132907 secs 2024-07-26T15:12:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:27 smithi040 ceph-mon[32397]: pgmap v5679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:27 smithi146 ceph-mon[35807]: pgmap v5679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:27 smithi076 ceph-mon[35401]: pgmap v5679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:29 smithi040 ceph-mon[32397]: pgmap v5680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:29 smithi146 ceph-mon[35807]: pgmap v5680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:29 smithi076 ceph-mon[35401]: pgmap v5680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5958.133047 secs 2024-07-26T15:12:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5958.133047 secs 2024-07-26T15:12:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5958.133047 secs 2024-07-26T15:12:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:32 smithi040 ceph-mon[32397]: pgmap v5681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:32 smithi146 ceph-mon[35807]: pgmap v5681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:32 smithi076 ceph-mon[35401]: pgmap v5681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:33 smithi040 ceph-mon[32397]: pgmap v5682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:33 smithi146 ceph-mon[35807]: pgmap v5682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:33 smithi076 ceph-mon[35401]: pgmap v5682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:35 smithi040 ceph-mon[32397]: pgmap v5683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:35 smithi146 ceph-mon[35807]: pgmap v5683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:35 smithi076 ceph-mon[35401]: pgmap v5683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5963.133195 secs 2024-07-26T15:12:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5963.133195 secs 2024-07-26T15:12:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5963.133195 secs 2024-07-26T15:12:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:37 smithi040 ceph-mon[32397]: pgmap v5684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:37 smithi146 ceph-mon[35807]: pgmap v5684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:37 smithi076 ceph-mon[35401]: pgmap v5684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:39 smithi040 ceph-mon[32397]: pgmap v5685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:39 smithi146 ceph-mon[35807]: pgmap v5685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:40.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:39 smithi076 ceph-mon[35401]: pgmap v5685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5968.133341 secs 2024-07-26T15:12:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5968.133341 secs 2024-07-26T15:12:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5968.133341 secs 2024-07-26T15:12:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:42 smithi040 ceph-mon[32397]: pgmap v5686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:42 smithi146 ceph-mon[35807]: pgmap v5686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:42 smithi076 ceph-mon[35401]: pgmap v5686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:43 smithi040 ceph-mon[32397]: pgmap v5687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:43 smithi146 ceph-mon[35807]: pgmap v5687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:44.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:43 smithi076 ceph-mon[35401]: pgmap v5687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:45 smithi040 ceph-mon[32397]: pgmap v5688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:45 smithi146 ceph-mon[35807]: pgmap v5688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:45 smithi076 ceph-mon[35401]: pgmap v5688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5973.133475 secs 2024-07-26T15:12:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5973.133475 secs 2024-07-26T15:12:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5973.133475 secs 2024-07-26T15:12:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:47 smithi040 ceph-mon[32397]: pgmap v5689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:47 smithi146 ceph-mon[35807]: pgmap v5689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:48.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:47 smithi076 ceph-mon[35401]: pgmap v5689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:49 smithi040 ceph-mon[32397]: pgmap v5690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:49 smithi146 ceph-mon[35807]: pgmap v5690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:49 smithi076 ceph-mon[35401]: pgmap v5690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5978.133614 secs 2024-07-26T15:12:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5978.133614 secs 2024-07-26T15:12:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5978.133614 secs 2024-07-26T15:12:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:52 smithi040 ceph-mon[32397]: pgmap v5691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:52 smithi146 ceph-mon[35807]: pgmap v5691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:52.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:52 smithi076 ceph-mon[35401]: pgmap v5691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:53 smithi040 ceph-mon[32397]: pgmap v5692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:53 smithi146 ceph-mon[35807]: pgmap v5692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:53 smithi076 ceph-mon[35401]: pgmap v5692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:12:56.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:55 smithi040 ceph-mon[32397]: pgmap v5693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:55 smithi146 ceph-mon[35807]: pgmap v5693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:55 smithi076 ceph-mon[35401]: pgmap v5693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:12:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5983.133755 secs 2024-07-26T15:12:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5983.133755 secs 2024-07-26T15:12:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5983.133755 secs 2024-07-26T15:12:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:57 smithi040 ceph-mon[32397]: pgmap v5694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:57 smithi146 ceph-mon[35807]: pgmap v5694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:12:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:57 smithi076 ceph-mon[35401]: pgmap v5694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:12:59 smithi040 ceph-mon[32397]: pgmap v5695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:12:59 smithi146 ceph-mon[35807]: pgmap v5695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:00.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:12:59 smithi076 ceph-mon[35401]: pgmap v5695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5988.133901 secs 2024-07-26T15:13:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5988.133901 secs 2024-07-26T15:13:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5988.133901 secs 2024-07-26T15:13:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:02 smithi040 ceph-mon[32397]: pgmap v5696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:02 smithi146 ceph-mon[35807]: pgmap v5696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:02 smithi076 ceph-mon[35401]: pgmap v5696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:03 smithi040 ceph-mon[32397]: pgmap v5697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:03 smithi146 ceph-mon[35807]: pgmap v5697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:04.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:03 smithi076 ceph-mon[35401]: pgmap v5697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:05 smithi040 ceph-mon[32397]: pgmap v5698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:05 smithi146 ceph-mon[35807]: pgmap v5698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:06.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:05 smithi076 ceph-mon[35401]: pgmap v5698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5993.134044 secs 2024-07-26T15:13:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5993.134044 secs 2024-07-26T15:13:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5993.134044 secs 2024-07-26T15:13:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:07 smithi040 ceph-mon[32397]: pgmap v5699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:07 smithi146 ceph-mon[35807]: pgmap v5699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:08.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:07 smithi076 ceph-mon[35401]: pgmap v5699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:09 smithi040 ceph-mon[32397]: pgmap v5700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:09 smithi146 ceph-mon[35807]: pgmap v5700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:09 smithi076 ceph-mon[35401]: pgmap v5700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 5998.134190 secs 2024-07-26T15:13:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 5998.134190 secs 2024-07-26T15:13:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 5998.134190 secs 2024-07-26T15:13:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:12 smithi040 ceph-mon[32397]: pgmap v5701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:12 smithi146 ceph-mon[35807]: pgmap v5701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:12.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:12 smithi076 ceph-mon[35401]: pgmap v5701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:13 smithi040 ceph-mon[32397]: pgmap v5702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:13 smithi146 ceph-mon[35807]: pgmap v5702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:13 smithi076 ceph-mon[35401]: pgmap v5702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:15 smithi040 ceph-mon[32397]: pgmap v5703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:15 smithi146 ceph-mon[35807]: pgmap v5703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:15 smithi076 ceph-mon[35401]: pgmap v5703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6003.134332 secs 2024-07-26T15:13:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6003.134332 secs 2024-07-26T15:13:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6003.134332 secs 2024-07-26T15:13:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:17 smithi040 ceph-mon[32397]: pgmap v5704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:17 smithi146 ceph-mon[35807]: pgmap v5704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:17 smithi076 ceph-mon[35401]: pgmap v5704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:19 smithi040 ceph-mon[32397]: pgmap v5705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:19 smithi146 ceph-mon[35807]: pgmap v5705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:19 smithi076 ceph-mon[35401]: pgmap v5705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6008.134472 secs 2024-07-26T15:13:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6008.134472 secs 2024-07-26T15:13:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6008.134472 secs 2024-07-26T15:13:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:22 smithi040 ceph-mon[32397]: pgmap v5706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:22 smithi146 ceph-mon[35807]: pgmap v5706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:22 smithi076 ceph-mon[35401]: pgmap v5706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:23 smithi040 ceph-mon[32397]: pgmap v5707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:23 smithi146 ceph-mon[35807]: pgmap v5707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:24.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:23 smithi076 ceph-mon[35401]: pgmap v5707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:25 smithi040 ceph-mon[32397]: pgmap v5708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:25 smithi146 ceph-mon[35807]: pgmap v5708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:26.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:25 smithi076 ceph-mon[35401]: pgmap v5708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6013.134565 secs 2024-07-26T15:13:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6013.134565 secs 2024-07-26T15:13:27.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6013.134565 secs 2024-07-26T15:13:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:27 smithi040 ceph-mon[32397]: pgmap v5709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:27 smithi146 ceph-mon[35807]: pgmap v5709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:28.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:27 smithi076 ceph-mon[35401]: pgmap v5709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:29 smithi040 ceph-mon[32397]: pgmap v5710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:29 smithi146 ceph-mon[35807]: pgmap v5710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:30.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:29 smithi076 ceph-mon[35401]: pgmap v5710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6018.134709 secs 2024-07-26T15:13:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6018.134709 secs 2024-07-26T15:13:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6018.134709 secs 2024-07-26T15:13:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:32 smithi040 ceph-mon[32397]: pgmap v5711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:32 smithi146 ceph-mon[35807]: pgmap v5711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:32 smithi076 ceph-mon[35401]: pgmap v5711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:33 smithi040 ceph-mon[32397]: pgmap v5712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:33 smithi146 ceph-mon[35807]: pgmap v5712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:33 smithi076 ceph-mon[35401]: pgmap v5712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:35 smithi040 ceph-mon[32397]: pgmap v5713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:35 smithi146 ceph-mon[35807]: pgmap v5713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:35 smithi076 ceph-mon[35401]: pgmap v5713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6023.134873 secs 2024-07-26T15:13:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6023.134873 secs 2024-07-26T15:13:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6023.134873 secs 2024-07-26T15:13:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:37 smithi040 ceph-mon[32397]: pgmap v5714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:37 smithi146 ceph-mon[35807]: pgmap v5714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:37 smithi076 ceph-mon[35401]: pgmap v5714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:40 smithi040 ceph-mon[32397]: pgmap v5715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:40 smithi146 ceph-mon[35807]: pgmap v5715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:40 smithi076 ceph-mon[35401]: pgmap v5715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6028.134969 secs 2024-07-26T15:13:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6028.134969 secs 2024-07-26T15:13:42.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6028.134969 secs 2024-07-26T15:13:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:42 smithi040 ceph-mon[32397]: pgmap v5716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:42 smithi146 ceph-mon[35807]: pgmap v5716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:43.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:42 smithi076 ceph-mon[35401]: pgmap v5716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:44 smithi040 ceph-mon[32397]: pgmap v5717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:44 smithi146 ceph-mon[35807]: pgmap v5717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:45.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:44 smithi076 ceph-mon[35401]: pgmap v5717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6033.135063 secs 2024-07-26T15:13:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:46 smithi040 ceph-mon[32397]: pgmap v5718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6033.135063 secs 2024-07-26T15:13:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:46 smithi146 ceph-mon[35807]: pgmap v5718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6033.135063 secs 2024-07-26T15:13:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:46 smithi076 ceph-mon[35401]: pgmap v5718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:48 smithi040 ceph-mon[32397]: pgmap v5719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:48 smithi146 ceph-mon[35807]: pgmap v5719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:49.368 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:48 smithi076 ceph-mon[35401]: pgmap v5719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:50 smithi040 ceph-mon[32397]: pgmap v5720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:50 smithi146 ceph-mon[35807]: pgmap v5720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:50 smithi076 ceph-mon[35401]: pgmap v5720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6038.135242 secs 2024-07-26T15:13:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6038.135242 secs 2024-07-26T15:13:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6038.135242 secs 2024-07-26T15:13:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:52 smithi040 ceph-mon[32397]: pgmap v5721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:52 smithi146 ceph-mon[35807]: pgmap v5721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:52 smithi076 ceph-mon[35401]: pgmap v5721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:54 smithi040 ceph-mon[32397]: pgmap v5722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:54 smithi146 ceph-mon[35807]: pgmap v5722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:54 smithi076 ceph-mon[35401]: pgmap v5722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:13:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6043.135385 secs 2024-07-26T15:13:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:56 smithi040 ceph-mon[32397]: pgmap v5723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6043.135385 secs 2024-07-26T15:13:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:56 smithi146 ceph-mon[35807]: pgmap v5723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6043.135385 secs 2024-07-26T15:13:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:56 smithi076 ceph-mon[35401]: pgmap v5723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:13:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:13:58 smithi040 ceph-mon[32397]: pgmap v5724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:13:58 smithi146 ceph-mon[35807]: pgmap v5724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:13:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:13:58 smithi076 ceph-mon[35401]: pgmap v5724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:00 smithi040 ceph-mon[32397]: pgmap v5725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:00 smithi146 ceph-mon[35807]: pgmap v5725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:00 smithi076 ceph-mon[35401]: pgmap v5725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6048.135496 secs 2024-07-26T15:14:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6048.135496 secs 2024-07-26T15:14:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6048.135496 secs 2024-07-26T15:14:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:02 smithi040 ceph-mon[32397]: pgmap v5726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:02 smithi146 ceph-mon[35807]: pgmap v5726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:02 smithi076 ceph-mon[35401]: pgmap v5726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:04 smithi146 ceph-mon[35807]: pgmap v5727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:04 smithi076 ceph-mon[35401]: pgmap v5727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:04 smithi040 ceph-mon[32397]: pgmap v5727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6053.135626 secs 2024-07-26T15:14:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:06 smithi146 ceph-mon[35807]: pgmap v5728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:14:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6053.135626 secs 2024-07-26T15:14:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:06 smithi076 ceph-mon[35401]: pgmap v5728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:14:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6053.135626 secs 2024-07-26T15:14:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:06 smithi040 ceph-mon[32397]: pgmap v5728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:14:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:09 smithi040 ceph-mon[32397]: pgmap v5729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:09 smithi146 ceph-mon[35807]: pgmap v5729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:09 smithi076 ceph-mon[35401]: pgmap v5729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:11.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:11 smithi146 ceph-mon[35807]: pgmap v5730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:11.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6058.135767 secs 2024-07-26T15:14:11.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:11 smithi076 ceph-mon[35401]: pgmap v5730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:11.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6058.135767 secs 2024-07-26T15:14:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:11 smithi040 ceph-mon[32397]: pgmap v5730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6058.135767 secs 2024-07-26T15:14:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:13 smithi040 ceph-mon[32397]: pgmap v5731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:13 smithi146 ceph-mon[35807]: pgmap v5731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:13 smithi076 ceph-mon[35401]: pgmap v5731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:15 smithi040 ceph-mon[32397]: pgmap v5732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:15 smithi146 ceph-mon[35807]: pgmap v5732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:15.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:15 smithi076 ceph-mon[35401]: pgmap v5732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6063.135890 secs 2024-07-26T15:14:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6063.135890 secs 2024-07-26T15:14:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6063.135890 secs 2024-07-26T15:14:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:17 smithi040 ceph-mon[32397]: pgmap v5733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:17 smithi146 ceph-mon[35807]: pgmap v5733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:17.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:17 smithi076 ceph-mon[35401]: pgmap v5733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:19 smithi040 ceph-mon[32397]: pgmap v5734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:19 smithi146 ceph-mon[35807]: pgmap v5734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:19.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:19 smithi076 ceph-mon[35401]: pgmap v5734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:21 smithi040 ceph-mon[32397]: pgmap v5735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6068.136070 secs 2024-07-26T15:14:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:21 smithi146 ceph-mon[35807]: pgmap v5735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6068.136070 secs 2024-07-26T15:14:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:21 smithi076 ceph-mon[35401]: pgmap v5735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6068.136070 secs 2024-07-26T15:14:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:23 smithi040 ceph-mon[32397]: pgmap v5736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:23 smithi146 ceph-mon[35807]: pgmap v5736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:23 smithi076 ceph-mon[35401]: pgmap v5736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:25 smithi040 ceph-mon[32397]: pgmap v5737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:25 smithi146 ceph-mon[35807]: pgmap v5737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:25 smithi076 ceph-mon[35401]: pgmap v5737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6073.136214 secs 2024-07-26T15:14:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6073.136214 secs 2024-07-26T15:14:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6073.136214 secs 2024-07-26T15:14:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:27 smithi040 ceph-mon[32397]: pgmap v5738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:27 smithi146 ceph-mon[35807]: pgmap v5738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:27 smithi076 ceph-mon[35401]: pgmap v5738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:29 smithi040 ceph-mon[32397]: pgmap v5739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:29 smithi146 ceph-mon[35807]: pgmap v5739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:29 smithi076 ceph-mon[35401]: pgmap v5739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:31 smithi040 ceph-mon[32397]: pgmap v5740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6078.136375 secs 2024-07-26T15:14:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:31 smithi146 ceph-mon[35807]: pgmap v5740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6078.136375 secs 2024-07-26T15:14:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:31 smithi076 ceph-mon[35401]: pgmap v5740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6078.136375 secs 2024-07-26T15:14:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:33 smithi040 ceph-mon[32397]: pgmap v5741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:33 smithi146 ceph-mon[35807]: pgmap v5741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:33 smithi076 ceph-mon[35401]: pgmap v5741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:35 smithi040 ceph-mon[32397]: pgmap v5742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:35 smithi146 ceph-mon[35807]: pgmap v5742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:35 smithi076 ceph-mon[35401]: pgmap v5742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6083.136536 secs 2024-07-26T15:14:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6083.136536 secs 2024-07-26T15:14:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6083.136536 secs 2024-07-26T15:14:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:37 smithi146 ceph-mon[35807]: pgmap v5743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:37 smithi076 ceph-mon[35401]: pgmap v5743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:37 smithi040 ceph-mon[32397]: pgmap v5743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:39 smithi146 ceph-mon[35807]: pgmap v5744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:39 smithi076 ceph-mon[35401]: pgmap v5744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:39 smithi040 ceph-mon[32397]: pgmap v5744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:41 smithi146 ceph-mon[35807]: pgmap v5745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6088.136634 secs 2024-07-26T15:14:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:41 smithi076 ceph-mon[35401]: pgmap v5745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6088.136634 secs 2024-07-26T15:14:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:41 smithi040 ceph-mon[32397]: pgmap v5745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6088.136634 secs 2024-07-26T15:14:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:43 smithi146 ceph-mon[35807]: pgmap v5746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:43 smithi076 ceph-mon[35401]: pgmap v5746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:43 smithi040 ceph-mon[32397]: pgmap v5746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:45 smithi146 ceph-mon[35807]: pgmap v5747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:45 smithi076 ceph-mon[35401]: pgmap v5747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:45 smithi040 ceph-mon[32397]: pgmap v5747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6093.136771 secs 2024-07-26T15:14:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6093.136771 secs 2024-07-26T15:14:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6093.136771 secs 2024-07-26T15:14:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:47 smithi146 ceph-mon[35807]: pgmap v5748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:47 smithi076 ceph-mon[35401]: pgmap v5748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:47 smithi040 ceph-mon[32397]: pgmap v5748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:49 smithi146 ceph-mon[35807]: pgmap v5749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:49 smithi076 ceph-mon[35401]: pgmap v5749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:49 smithi040 ceph-mon[32397]: pgmap v5749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:51 smithi146 ceph-mon[35807]: pgmap v5750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6098.136910 secs 2024-07-26T15:14:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:51 smithi076 ceph-mon[35401]: pgmap v5750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6098.136910 secs 2024-07-26T15:14:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:51 smithi040 ceph-mon[32397]: pgmap v5750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6098.136910 secs 2024-07-26T15:14:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:53 smithi146 ceph-mon[35807]: pgmap v5751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:53 smithi076 ceph-mon[35401]: pgmap v5751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:53 smithi040 ceph-mon[32397]: pgmap v5751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:14:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:55 smithi146 ceph-mon[35807]: pgmap v5752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:55 smithi076 ceph-mon[35401]: pgmap v5752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:55 smithi040 ceph-mon[32397]: pgmap v5752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:14:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6103.137046 secs 2024-07-26T15:14:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6103.137046 secs 2024-07-26T15:14:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6103.137046 secs 2024-07-26T15:14:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:57 smithi076 ceph-mon[35401]: pgmap v5753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:57 smithi040 ceph-mon[32397]: pgmap v5753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:57 smithi146 ceph-mon[35807]: pgmap v5753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:14:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:14:59 smithi040 ceph-mon[32397]: pgmap v5754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:14:59 smithi146 ceph-mon[35807]: pgmap v5754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:14:59 smithi076 ceph-mon[35401]: pgmap v5754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:01 smithi040 ceph-mon[32397]: pgmap v5755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6108.137176 secs 2024-07-26T15:15:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:01 smithi146 ceph-mon[35807]: pgmap v5755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6108.137176 secs 2024-07-26T15:15:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:01 smithi076 ceph-mon[35401]: pgmap v5755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6108.137176 secs 2024-07-26T15:15:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:03 smithi040 ceph-mon[32397]: pgmap v5756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:03 smithi146 ceph-mon[35807]: pgmap v5756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:03 smithi076 ceph-mon[35401]: pgmap v5756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:05 smithi040 ceph-mon[32397]: pgmap v5757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:05 smithi146 ceph-mon[35807]: pgmap v5757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:05 smithi076 ceph-mon[35401]: pgmap v5757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6113.137321 secs 2024-07-26T15:15:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6113.137321 secs 2024-07-26T15:15:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6113.137321 secs 2024-07-26T15:15:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:07 smithi040 ceph-mon[32397]: pgmap v5758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:07 smithi146 ceph-mon[35807]: pgmap v5758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:07 smithi076 ceph-mon[35401]: pgmap v5758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:09 smithi040 ceph-mon[32397]: pgmap v5759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:09 smithi146 ceph-mon[35807]: pgmap v5759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:10.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:09 smithi076 ceph-mon[35401]: pgmap v5759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:11.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:11 smithi076 ceph-mon[35401]: pgmap v5760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:11.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6118.137459 secs 2024-07-26T15:15:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:11 smithi040 ceph-mon[32397]: pgmap v5760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6118.137459 secs 2024-07-26T15:15:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:11 smithi146 ceph-mon[35807]: pgmap v5760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6118.137459 secs 2024-07-26T15:15:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:13 smithi040 ceph-mon[32397]: pgmap v5761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:13 smithi146 ceph-mon[35807]: pgmap v5761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:14.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:13 smithi076 ceph-mon[35401]: pgmap v5761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:15 smithi040 ceph-mon[32397]: pgmap v5762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:15 smithi146 ceph-mon[35807]: pgmap v5762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:15 smithi076 ceph-mon[35401]: pgmap v5762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6123.137597 secs 2024-07-26T15:15:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6123.137597 secs 2024-07-26T15:15:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6123.137597 secs 2024-07-26T15:15:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:17 smithi040 ceph-mon[32397]: pgmap v5763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:15:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:17 smithi146 ceph-mon[35807]: pgmap v5763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:15:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:17 smithi076 ceph-mon[35401]: pgmap v5763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:15:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:19 smithi040 ceph-mon[32397]: pgmap v5764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:19 smithi146 ceph-mon[35807]: pgmap v5764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:19 smithi076 ceph-mon[35401]: pgmap v5764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:15:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:21 smithi040 ceph-mon[32397]: pgmap v5765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6128.137731 secs 2024-07-26T15:15:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:21 smithi146 ceph-mon[35807]: pgmap v5765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6128.137731 secs 2024-07-26T15:15:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:21 smithi076 ceph-mon[35401]: pgmap v5765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6128.137731 secs 2024-07-26T15:15:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:23 smithi040 ceph-mon[32397]: pgmap v5766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:23 smithi146 ceph-mon[35807]: pgmap v5766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:23 smithi076 ceph-mon[35401]: pgmap v5766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:25 smithi040 ceph-mon[32397]: pgmap v5767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:25 smithi146 ceph-mon[35807]: pgmap v5767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:25 smithi076 ceph-mon[35401]: pgmap v5767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6133.137816 secs 2024-07-26T15:15:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6133.137816 secs 2024-07-26T15:15:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6133.137816 secs 2024-07-26T15:15:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:27 smithi040 ceph-mon[32397]: pgmap v5768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:27 smithi146 ceph-mon[35807]: pgmap v5768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:27 smithi076 ceph-mon[35401]: pgmap v5768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:29 smithi040 ceph-mon[32397]: pgmap v5769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:29 smithi146 ceph-mon[35807]: pgmap v5769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:29 smithi076 ceph-mon[35401]: pgmap v5769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:31 smithi146 ceph-mon[35807]: pgmap v5770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6138.137976 secs 2024-07-26T15:15:32.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:31 smithi076 ceph-mon[35401]: pgmap v5770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6138.137976 secs 2024-07-26T15:15:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:31 smithi040 ceph-mon[32397]: pgmap v5770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6138.137976 secs 2024-07-26T15:15:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:33 smithi146 ceph-mon[35807]: pgmap v5771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:33 smithi076 ceph-mon[35401]: pgmap v5771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:33 smithi040 ceph-mon[32397]: pgmap v5771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:35 smithi146 ceph-mon[35807]: pgmap v5772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:35 smithi076 ceph-mon[35401]: pgmap v5772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:35 smithi040 ceph-mon[32397]: pgmap v5772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6143.138083 secs 2024-07-26T15:15:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6143.138083 secs 2024-07-26T15:15:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6143.138083 secs 2024-07-26T15:15:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:37 smithi146 ceph-mon[35807]: pgmap v5773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:38.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:37 smithi076 ceph-mon[35401]: pgmap v5773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:37 smithi040 ceph-mon[32397]: pgmap v5773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:39 smithi146 ceph-mon[35807]: pgmap v5774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:39 smithi076 ceph-mon[35401]: pgmap v5774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:39 smithi040 ceph-mon[32397]: pgmap v5774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:41 smithi146 ceph-mon[35807]: pgmap v5775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6148.138225 secs 2024-07-26T15:15:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:41 smithi076 ceph-mon[35401]: pgmap v5775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6148.138225 secs 2024-07-26T15:15:42.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:41 smithi040 ceph-mon[32397]: pgmap v5775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:42.248 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6148.138225 secs 2024-07-26T15:15:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:43 smithi146 ceph-mon[35807]: pgmap v5776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:43 smithi076 ceph-mon[35401]: pgmap v5776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:43 smithi040 ceph-mon[32397]: pgmap v5776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:45 smithi146 ceph-mon[35807]: pgmap v5777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:45 smithi076 ceph-mon[35401]: pgmap v5777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:46.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:45 smithi040 ceph-mon[32397]: pgmap v5777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6153.138340 secs 2024-07-26T15:15:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6153.138340 secs 2024-07-26T15:15:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6153.138340 secs 2024-07-26T15:15:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:47 smithi146 ceph-mon[35807]: pgmap v5778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:47 smithi076 ceph-mon[35401]: pgmap v5778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:47 smithi040 ceph-mon[32397]: pgmap v5778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:49 smithi076 ceph-mon[35401]: pgmap v5779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:49 smithi040 ceph-mon[32397]: pgmap v5779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:49 smithi146 ceph-mon[35807]: pgmap v5779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:51 smithi076 ceph-mon[35401]: pgmap v5780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6158.138494 secs 2024-07-26T15:15:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:51 smithi040 ceph-mon[32397]: pgmap v5780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6158.138494 secs 2024-07-26T15:15:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:51 smithi146 ceph-mon[35807]: pgmap v5780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6158.138494 secs 2024-07-26T15:15:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:53 smithi040 ceph-mon[32397]: pgmap v5781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:53 smithi146 ceph-mon[35807]: pgmap v5781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:54.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:53 smithi076 ceph-mon[35401]: pgmap v5781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:55 smithi040 ceph-mon[32397]: pgmap v5782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:55 smithi146 ceph-mon[35807]: pgmap v5782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:56.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:55 smithi076 ceph-mon[35401]: pgmap v5782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:15:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6163.138625 secs 2024-07-26T15:15:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:56 smithi040 ceph-mon[32397]: pgmap v5783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6163.138625 secs 2024-07-26T15:15:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:56 smithi146 ceph-mon[35807]: pgmap v5783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6163.138625 secs 2024-07-26T15:15:57.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:56 smithi076 ceph-mon[35401]: pgmap v5783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:15:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:15:58 smithi040 ceph-mon[32397]: pgmap v5784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:15:58 smithi146 ceph-mon[35807]: pgmap v5784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:15:59.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:15:58 smithi076 ceph-mon[35401]: pgmap v5784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:00 smithi040 ceph-mon[32397]: pgmap v5785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:00 smithi146 ceph-mon[35807]: pgmap v5785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:01.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:00 smithi076 ceph-mon[35401]: pgmap v5785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6168.138772 secs 2024-07-26T15:16:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6168.138772 secs 2024-07-26T15:16:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6168.138772 secs 2024-07-26T15:16:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:02 smithi146 ceph-mon[35807]: pgmap v5786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:03.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:02 smithi076 ceph-mon[35401]: pgmap v5786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:02 smithi040 ceph-mon[32397]: pgmap v5786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:04 smithi146 ceph-mon[35807]: pgmap v5787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:04 smithi076 ceph-mon[35401]: pgmap v5787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:04 smithi040 ceph-mon[32397]: pgmap v5787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6173.138936 secs 2024-07-26T15:16:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:06 smithi146 ceph-mon[35807]: pgmap v5788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6173.138936 secs 2024-07-26T15:16:07.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:06 smithi076 ceph-mon[35401]: pgmap v5788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6173.138936 secs 2024-07-26T15:16:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:06 smithi040 ceph-mon[32397]: pgmap v5788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:09 smithi146 ceph-mon[35807]: pgmap v5789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:09.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:09 smithi076 ceph-mon[35401]: pgmap v5789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:09 smithi040 ceph-mon[32397]: pgmap v5789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:11 smithi146 ceph-mon[35807]: pgmap v5790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:11.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:11 smithi076 ceph-mon[35401]: pgmap v5790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:11 smithi040 ceph-mon[32397]: pgmap v5790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6178.139080 secs 2024-07-26T15:16:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6178.139080 secs 2024-07-26T15:16:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6178.139080 secs 2024-07-26T15:16:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:13 smithi146 ceph-mon[35807]: pgmap v5791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:13.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:13 smithi076 ceph-mon[35401]: pgmap v5791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:13 smithi040 ceph-mon[32397]: pgmap v5791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:15 smithi146 ceph-mon[35807]: pgmap v5792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:15 smithi076 ceph-mon[35401]: pgmap v5792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:15 smithi040 ceph-mon[32397]: pgmap v5792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6183.139253 secs 2024-07-26T15:16:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:17 smithi146 ceph-mon[35807]: pgmap v5793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6183.139253 secs 2024-07-26T15:16:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:17 smithi076 ceph-mon[35401]: pgmap v5793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6183.139253 secs 2024-07-26T15:16:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:17 smithi040 ceph-mon[32397]: pgmap v5793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:19 smithi146 ceph-mon[35807]: pgmap v5794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:19 smithi076 ceph-mon[35401]: pgmap v5794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:19 smithi040 ceph-mon[32397]: pgmap v5794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:21 smithi146 ceph-mon[35807]: pgmap v5795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:21 smithi076 ceph-mon[35401]: pgmap v5795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:21 smithi040 ceph-mon[32397]: pgmap v5795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6188.139382 secs 2024-07-26T15:16:22.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6188.139382 secs 2024-07-26T15:16:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6188.139382 secs 2024-07-26T15:16:23.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:23 smithi076 ceph-mon[35401]: pgmap v5796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:23 smithi040 ceph-mon[32397]: pgmap v5796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:23 smithi146 ceph-mon[35807]: pgmap v5796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:25.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:25 smithi076 ceph-mon[35401]: pgmap v5797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:25 smithi040 ceph-mon[32397]: pgmap v5797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:25 smithi146 ceph-mon[35807]: pgmap v5797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6193.139525 secs 2024-07-26T15:16:27.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:27 smithi040 ceph-mon[32397]: pgmap v5798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6193.139525 secs 2024-07-26T15:16:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:27 smithi146 ceph-mon[35807]: pgmap v5798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6193.139525 secs 2024-07-26T15:16:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:27 smithi076 ceph-mon[35401]: pgmap v5798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:29 smithi040 ceph-mon[32397]: pgmap v5799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:29 smithi146 ceph-mon[35807]: pgmap v5799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:29 smithi076 ceph-mon[35401]: pgmap v5799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:31 smithi040 ceph-mon[32397]: pgmap v5800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:31 smithi146 ceph-mon[35807]: pgmap v5800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:31 smithi076 ceph-mon[35401]: pgmap v5800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6198.139659 secs 2024-07-26T15:16:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6198.139659 secs 2024-07-26T15:16:32.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6198.139659 secs 2024-07-26T15:16:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:33 smithi040 ceph-mon[32397]: pgmap v5801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:33 smithi146 ceph-mon[35807]: pgmap v5801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:33 smithi076 ceph-mon[35401]: pgmap v5801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:35 smithi040 ceph-mon[32397]: pgmap v5802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:35 smithi146 ceph-mon[35807]: pgmap v5802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:35 smithi076 ceph-mon[35401]: pgmap v5802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6203.139803 secs 2024-07-26T15:16:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:37 smithi040 ceph-mon[32397]: pgmap v5803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6203.139803 secs 2024-07-26T15:16:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:37 smithi146 ceph-mon[35807]: pgmap v5803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6203.139803 secs 2024-07-26T15:16:37.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:37 smithi076 ceph-mon[35401]: pgmap v5803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:39 smithi040 ceph-mon[32397]: pgmap v5804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:39 smithi146 ceph-mon[35807]: pgmap v5804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:39.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:39 smithi076 ceph-mon[35401]: pgmap v5804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:41 smithi040 ceph-mon[32397]: pgmap v5805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:41 smithi146 ceph-mon[35807]: pgmap v5805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:41.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:41 smithi076 ceph-mon[35401]: pgmap v5805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6208.139938 secs 2024-07-26T15:16:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6208.139938 secs 2024-07-26T15:16:42.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6208.139938 secs 2024-07-26T15:16:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:43 smithi040 ceph-mon[32397]: pgmap v5806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:43 smithi146 ceph-mon[35807]: pgmap v5806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:43.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:43 smithi076 ceph-mon[35401]: pgmap v5806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:45 smithi040 ceph-mon[32397]: pgmap v5807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:45 smithi146 ceph-mon[35807]: pgmap v5807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:45.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:45 smithi076 ceph-mon[35401]: pgmap v5807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6213.140073 secs 2024-07-26T15:16:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6213.140073 secs 2024-07-26T15:16:46.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6213.140073 secs 2024-07-26T15:16:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:47 smithi040 ceph-mon[32397]: pgmap v5808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:47 smithi146 ceph-mon[35807]: pgmap v5808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:47 smithi076 ceph-mon[35401]: pgmap v5808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:49.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:49 smithi040 ceph-mon[32397]: pgmap v5809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:49 smithi146 ceph-mon[35807]: pgmap v5809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:49.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:49 smithi076 ceph-mon[35401]: pgmap v5809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:51 smithi040 ceph-mon[32397]: pgmap v5810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6218.140206 secs 2024-07-26T15:16:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:51 smithi146 ceph-mon[35807]: pgmap v5810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6218.140206 secs 2024-07-26T15:16:51.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:51 smithi076 ceph-mon[35401]: pgmap v5810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6218.140206 secs 2024-07-26T15:16:53.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:53 smithi040 ceph-mon[32397]: pgmap v5811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:53 smithi146 ceph-mon[35807]: pgmap v5811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:53.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:53 smithi076 ceph-mon[35401]: pgmap v5811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:55 smithi040 ceph-mon[32397]: pgmap v5812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:55 smithi146 ceph-mon[35807]: pgmap v5812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:55 smithi076 ceph-mon[35401]: pgmap v5812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:16:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6223.140365 secs 2024-07-26T15:16:56.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6223.140365 secs 2024-07-26T15:16:56.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6223.140365 secs 2024-07-26T15:16:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:57 smithi146 ceph-mon[35807]: pgmap v5813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:57 smithi076 ceph-mon[35401]: pgmap v5813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:57 smithi040 ceph-mon[32397]: pgmap v5813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:16:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:16:59 smithi146 ceph-mon[35807]: pgmap v5814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:16:59 smithi076 ceph-mon[35401]: pgmap v5814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:16:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:16:59 smithi040 ceph-mon[32397]: pgmap v5814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:01 smithi146 ceph-mon[35807]: pgmap v5815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6228.140527 secs 2024-07-26T15:17:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:01 smithi076 ceph-mon[35401]: pgmap v5815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6228.140527 secs 2024-07-26T15:17:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:01 smithi040 ceph-mon[32397]: pgmap v5815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6228.140527 secs 2024-07-26T15:17:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:03 smithi146 ceph-mon[35807]: pgmap v5816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:03.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:03 smithi076 ceph-mon[35401]: pgmap v5816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:03 smithi040 ceph-mon[32397]: pgmap v5816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:05 smithi146 ceph-mon[35807]: pgmap v5817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:05 smithi076 ceph-mon[35401]: pgmap v5817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:05 smithi040 ceph-mon[32397]: pgmap v5817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6233.140668 secs 2024-07-26T15:17:06.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6233.140668 secs 2024-07-26T15:17:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6233.140668 secs 2024-07-26T15:17:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:07 smithi146 ceph-mon[35807]: pgmap v5818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:07.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:07 smithi076 ceph-mon[35401]: pgmap v5818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:07 smithi040 ceph-mon[32397]: pgmap v5818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:09 smithi146 ceph-mon[35807]: pgmap v5819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:09.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:09 smithi076 ceph-mon[35401]: pgmap v5819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:09 smithi040 ceph-mon[32397]: pgmap v5819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:11 smithi146 ceph-mon[35807]: pgmap v5820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6238.140812 secs 2024-07-26T15:17:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:11 smithi076 ceph-mon[35401]: pgmap v5820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6238.140812 secs 2024-07-26T15:17:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:11 smithi040 ceph-mon[32397]: pgmap v5820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:11.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6238.140812 secs 2024-07-26T15:17:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:13 smithi146 ceph-mon[35807]: pgmap v5821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:13.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:13 smithi076 ceph-mon[35401]: pgmap v5821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:13.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:13 smithi040 ceph-mon[32397]: pgmap v5821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:15 smithi146 ceph-mon[35807]: pgmap v5822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:15 smithi076 ceph-mon[35401]: pgmap v5822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:15.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:15 smithi040 ceph-mon[32397]: pgmap v5822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6243.140962 secs 2024-07-26T15:17:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6243.140962 secs 2024-07-26T15:17:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6243.140962 secs 2024-07-26T15:17:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:17 smithi076 ceph-mon[35401]: pgmap v5823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:17 smithi040 ceph-mon[32397]: pgmap v5823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:17 smithi146 ceph-mon[35807]: pgmap v5823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:19 smithi040 ceph-mon[32397]: pgmap v5824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:19 smithi146 ceph-mon[35807]: pgmap v5824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:19.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:19 smithi076 ceph-mon[35401]: pgmap v5824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:21 smithi040 ceph-mon[32397]: pgmap v5825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6248.141096 secs 2024-07-26T15:17:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:21 smithi146 ceph-mon[35807]: pgmap v5825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6248.141096 secs 2024-07-26T15:17:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:21 smithi076 ceph-mon[35401]: pgmap v5825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6248.141096 secs 2024-07-26T15:17:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:23 smithi040 ceph-mon[32397]: pgmap v5826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:23 smithi146 ceph-mon[35807]: pgmap v5826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:23 smithi076 ceph-mon[35401]: pgmap v5826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:25 smithi040 ceph-mon[32397]: pgmap v5827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:25 smithi146 ceph-mon[35807]: pgmap v5827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:25.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:25 smithi076 ceph-mon[35401]: pgmap v5827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6253.141237 secs 2024-07-26T15:17:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6253.141237 secs 2024-07-26T15:17:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6253.141237 secs 2024-07-26T15:17:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:27 smithi040 ceph-mon[32397]: pgmap v5828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:27 smithi146 ceph-mon[35807]: pgmap v5828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:27 smithi076 ceph-mon[35401]: pgmap v5828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:29 smithi040 ceph-mon[32397]: pgmap v5829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:29 smithi146 ceph-mon[35807]: pgmap v5829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:29 smithi076 ceph-mon[35401]: pgmap v5829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:31 smithi040 ceph-mon[32397]: pgmap v5830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6258.141380 secs 2024-07-26T15:17:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:31 smithi146 ceph-mon[35807]: pgmap v5830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6258.141380 secs 2024-07-26T15:17:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:31 smithi076 ceph-mon[35401]: pgmap v5830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6258.141380 secs 2024-07-26T15:17:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:33 smithi040 ceph-mon[32397]: pgmap v5831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:33 smithi146 ceph-mon[35807]: pgmap v5831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:33 smithi076 ceph-mon[35401]: pgmap v5831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:35 smithi040 ceph-mon[32397]: pgmap v5832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:35 smithi146 ceph-mon[35807]: pgmap v5832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:35 smithi076 ceph-mon[35401]: pgmap v5832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6263.141539 secs 2024-07-26T15:17:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6263.141539 secs 2024-07-26T15:17:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6263.141539 secs 2024-07-26T15:17:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:37 smithi040 ceph-mon[32397]: pgmap v5833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:37 smithi146 ceph-mon[35807]: pgmap v5833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:37 smithi076 ceph-mon[35401]: pgmap v5833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:39 smithi040 ceph-mon[32397]: pgmap v5834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:39 smithi146 ceph-mon[35807]: pgmap v5834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:39 smithi076 ceph-mon[35401]: pgmap v5834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:41 smithi040 ceph-mon[32397]: pgmap v5835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6268.141688 secs 2024-07-26T15:17:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:41 smithi146 ceph-mon[35807]: pgmap v5835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6268.141688 secs 2024-07-26T15:17:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:41 smithi076 ceph-mon[35401]: pgmap v5835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6268.141688 secs 2024-07-26T15:17:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:43 smithi040 ceph-mon[32397]: pgmap v5836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:43 smithi146 ceph-mon[35807]: pgmap v5836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:43 smithi076 ceph-mon[35401]: pgmap v5836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:45 smithi040 ceph-mon[32397]: pgmap v5837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:45.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:45 smithi146 ceph-mon[35807]: pgmap v5837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:45.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:45 smithi076 ceph-mon[35401]: pgmap v5837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6273.141822 secs 2024-07-26T15:17:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6273.141822 secs 2024-07-26T15:17:46.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6273.141822 secs 2024-07-26T15:17:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:47 smithi040 ceph-mon[32397]: pgmap v5838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:47 smithi146 ceph-mon[35807]: pgmap v5838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:47 smithi076 ceph-mon[35401]: pgmap v5838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:49 smithi040 ceph-mon[32397]: pgmap v5839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:49 smithi146 ceph-mon[35807]: pgmap v5839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:49.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:49 smithi076 ceph-mon[35401]: pgmap v5839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:51 smithi040 ceph-mon[32397]: pgmap v5840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6278.141981 secs 2024-07-26T15:17:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:51 smithi146 ceph-mon[35807]: pgmap v5840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6278.141981 secs 2024-07-26T15:17:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:51 smithi076 ceph-mon[35401]: pgmap v5840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6278.141981 secs 2024-07-26T15:17:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:53 smithi146 ceph-mon[35807]: pgmap v5841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:53 smithi076 ceph-mon[35401]: pgmap v5841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:53 smithi040 ceph-mon[32397]: pgmap v5841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:55 smithi146 ceph-mon[35807]: pgmap v5842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:55 smithi076 ceph-mon[35401]: pgmap v5842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:55 smithi040 ceph-mon[32397]: pgmap v5842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:17:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6283.142075 secs 2024-07-26T15:17:56.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6283.142075 secs 2024-07-26T15:17:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6283.142075 secs 2024-07-26T15:17:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:57 smithi146 ceph-mon[35807]: pgmap v5843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:57 smithi076 ceph-mon[35401]: pgmap v5843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:57 smithi040 ceph-mon[32397]: pgmap v5843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:17:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:17:59 smithi146 ceph-mon[35807]: pgmap v5844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:17:59 smithi076 ceph-mon[35401]: pgmap v5844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:17:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:17:59 smithi040 ceph-mon[32397]: pgmap v5844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:01 smithi146 ceph-mon[35807]: pgmap v5845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6288.142220 secs 2024-07-26T15:18:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:01 smithi076 ceph-mon[35401]: pgmap v5845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6288.142220 secs 2024-07-26T15:18:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:01 smithi040 ceph-mon[32397]: pgmap v5845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6288.142220 secs 2024-07-26T15:18:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:03 smithi146 ceph-mon[35807]: pgmap v5846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:03 smithi076 ceph-mon[35401]: pgmap v5846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:03 smithi040 ceph-mon[32397]: pgmap v5846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:05 smithi146 ceph-mon[35807]: pgmap v5847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:05 smithi076 ceph-mon[35401]: pgmap v5847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:05 smithi040 ceph-mon[32397]: pgmap v5847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6293.142363 secs 2024-07-26T15:18:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6293.142363 secs 2024-07-26T15:18:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6293.142363 secs 2024-07-26T15:18:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:07 smithi146 ceph-mon[35807]: pgmap v5848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:07 smithi076 ceph-mon[35401]: pgmap v5848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:07 smithi040 ceph-mon[32397]: pgmap v5848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:09 smithi146 ceph-mon[35807]: pgmap v5849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:09 smithi076 ceph-mon[35401]: pgmap v5849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:09 smithi040 ceph-mon[32397]: pgmap v5849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:11 smithi076 ceph-mon[35401]: pgmap v5850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6298.142500 secs 2024-07-26T15:18:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:11 smithi040 ceph-mon[32397]: pgmap v5850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6298.142500 secs 2024-07-26T15:18:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:11 smithi146 ceph-mon[35807]: pgmap v5850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6298.142500 secs 2024-07-26T15:18:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:13 smithi076 ceph-mon[35401]: pgmap v5851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:13 smithi040 ceph-mon[32397]: pgmap v5851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:13 smithi146 ceph-mon[35807]: pgmap v5851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:15 smithi040 ceph-mon[32397]: pgmap v5852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:15 smithi146 ceph-mon[35807]: pgmap v5852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:15 smithi076 ceph-mon[35401]: pgmap v5852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6303.142637 secs 2024-07-26T15:18:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6303.142637 secs 2024-07-26T15:18:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6303.142637 secs 2024-07-26T15:18:17.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:17 smithi040 ceph-mon[32397]: pgmap v5853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:17 smithi146 ceph-mon[35807]: pgmap v5853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:17 smithi076 ceph-mon[35401]: pgmap v5853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:19.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:19 smithi040 ceph-mon[32397]: pgmap v5854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:19 smithi146 ceph-mon[35807]: pgmap v5854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:19 smithi076 ceph-mon[35401]: pgmap v5854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:21 smithi040 ceph-mon[32397]: pgmap v5855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6308.142783 secs 2024-07-26T15:18:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:21 smithi146 ceph-mon[35807]: pgmap v5855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6308.142783 secs 2024-07-26T15:18:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:21 smithi076 ceph-mon[35401]: pgmap v5855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6308.142783 secs 2024-07-26T15:18:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:23 smithi040 ceph-mon[32397]: pgmap v5856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:23 smithi146 ceph-mon[35807]: pgmap v5856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:24.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:23 smithi076 ceph-mon[35401]: pgmap v5856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:25.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:25 smithi040 ceph-mon[32397]: pgmap v5857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:25 smithi146 ceph-mon[35807]: pgmap v5857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:25 smithi076 ceph-mon[35401]: pgmap v5857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6313.142918 secs 2024-07-26T15:18:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6313.142918 secs 2024-07-26T15:18:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6313.142918 secs 2024-07-26T15:18:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:27 smithi040 ceph-mon[32397]: pgmap v5858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:27 smithi146 ceph-mon[35807]: pgmap v5858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:28.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:27 smithi076 ceph-mon[35401]: pgmap v5858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:29 smithi040 ceph-mon[32397]: pgmap v5859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:29 smithi146 ceph-mon[35807]: pgmap v5859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:29 smithi076 ceph-mon[35401]: pgmap v5859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:31 smithi040 ceph-mon[32397]: pgmap v5860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6318.143063 secs 2024-07-26T15:18:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:31 smithi146 ceph-mon[35807]: pgmap v5860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6318.143063 secs 2024-07-26T15:18:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:31 smithi076 ceph-mon[35401]: pgmap v5860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6318.143063 secs 2024-07-26T15:18:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:33 smithi040 ceph-mon[32397]: pgmap v5861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:33 smithi146 ceph-mon[35807]: pgmap v5861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:34.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:33 smithi076 ceph-mon[35401]: pgmap v5861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:35 smithi040 ceph-mon[32397]: pgmap v5862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:35 smithi146 ceph-mon[35807]: pgmap v5862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:36.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:35 smithi076 ceph-mon[35401]: pgmap v5862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6323.143207 secs 2024-07-26T15:18:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6323.143207 secs 2024-07-26T15:18:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6323.143207 secs 2024-07-26T15:18:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:37 smithi040 ceph-mon[32397]: pgmap v5863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:37 smithi146 ceph-mon[35807]: pgmap v5863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:37 smithi076 ceph-mon[35401]: pgmap v5863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:39 smithi040 ceph-mon[32397]: pgmap v5864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:39 smithi146 ceph-mon[35807]: pgmap v5864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:40.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:39 smithi076 ceph-mon[35401]: pgmap v5864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:41 smithi040 ceph-mon[32397]: pgmap v5865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6328.143363 secs 2024-07-26T15:18:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:41 smithi146 ceph-mon[35807]: pgmap v5865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6328.143363 secs 2024-07-26T15:18:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:41 smithi076 ceph-mon[35401]: pgmap v5865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6328.143363 secs 2024-07-26T15:18:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:43 smithi040 ceph-mon[32397]: pgmap v5866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:43 smithi146 ceph-mon[35807]: pgmap v5866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:44.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:43 smithi076 ceph-mon[35401]: pgmap v5866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:45 smithi040 ceph-mon[32397]: pgmap v5867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:45 smithi146 ceph-mon[35807]: pgmap v5867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:45 smithi076 ceph-mon[35401]: pgmap v5867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6333.143500 secs 2024-07-26T15:18:47.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6333.143500 secs 2024-07-26T15:18:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6333.143500 secs 2024-07-26T15:18:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:47 smithi146 ceph-mon[35807]: pgmap v5868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:18:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:47 smithi076 ceph-mon[35401]: pgmap v5868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:18:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:47 smithi040 ceph-mon[32397]: pgmap v5868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:18:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:49 smithi146 ceph-mon[35807]: pgmap v5869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:49 smithi076 ceph-mon[35401]: pgmap v5869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:49 smithi040 ceph-mon[32397]: pgmap v5869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:18:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:51 smithi146 ceph-mon[35807]: pgmap v5870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6338.143646 secs 2024-07-26T15:18:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:51 smithi076 ceph-mon[35401]: pgmap v5870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6338.143646 secs 2024-07-26T15:18:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:51 smithi040 ceph-mon[32397]: pgmap v5870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6338.143646 secs 2024-07-26T15:18:54.034 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:53 smithi040 ceph-mon[32397]: pgmap v5871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:53 smithi146 ceph-mon[35807]: pgmap v5871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:53 smithi076 ceph-mon[35401]: pgmap v5871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:18:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:55 smithi146 ceph-mon[35807]: pgmap v5872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:55 smithi076 ceph-mon[35401]: pgmap v5872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:55 smithi040 ceph-mon[32397]: pgmap v5872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:18:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6343.143791 secs 2024-07-26T15:18:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6343.143791 secs 2024-07-26T15:18:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6343.143791 secs 2024-07-26T15:18:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:57 smithi146 ceph-mon[35807]: pgmap v5873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:57 smithi076 ceph-mon[35401]: pgmap v5873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:18:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:57 smithi040 ceph-mon[32397]: pgmap v5873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:18:59 smithi146 ceph-mon[35807]: pgmap v5874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:18:59 smithi076 ceph-mon[35401]: pgmap v5874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:18:59 smithi040 ceph-mon[32397]: pgmap v5874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:01 smithi146 ceph-mon[35807]: pgmap v5875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6348.143936 secs 2024-07-26T15:19:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:01 smithi076 ceph-mon[35401]: pgmap v5875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6348.143936 secs 2024-07-26T15:19:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:01 smithi040 ceph-mon[32397]: pgmap v5875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6348.143936 secs 2024-07-26T15:19:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:03 smithi146 ceph-mon[35807]: pgmap v5876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:03 smithi076 ceph-mon[35401]: pgmap v5876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:04.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:03 smithi040 ceph-mon[32397]: pgmap v5876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:05 smithi146 ceph-mon[35807]: pgmap v5877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:05 smithi076 ceph-mon[35401]: pgmap v5877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:05 smithi040 ceph-mon[32397]: pgmap v5877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6353.144076 secs 2024-07-26T15:19:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6353.144076 secs 2024-07-26T15:19:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6353.144076 secs 2024-07-26T15:19:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:07 smithi076 ceph-mon[35401]: pgmap v5878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:07 smithi040 ceph-mon[32397]: pgmap v5878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:07 smithi146 ceph-mon[35807]: pgmap v5878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:09 smithi040 ceph-mon[32397]: pgmap v5879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:09 smithi146 ceph-mon[35807]: pgmap v5879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:09 smithi076 ceph-mon[35401]: pgmap v5879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:12.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:11 smithi146 ceph-mon[35807]: pgmap v5880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:12.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6358.144242 secs 2024-07-26T15:19:12.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:11 smithi076 ceph-mon[35401]: pgmap v5880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:12.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6358.144242 secs 2024-07-26T15:19:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:11 smithi040 ceph-mon[32397]: pgmap v5880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6358.144242 secs 2024-07-26T15:19:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:13 smithi040 ceph-mon[32397]: pgmap v5881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:13 smithi146 ceph-mon[35807]: pgmap v5881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:14.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:13 smithi076 ceph-mon[35401]: pgmap v5881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:15 smithi040 ceph-mon[32397]: pgmap v5882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:15 smithi146 ceph-mon[35807]: pgmap v5882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:16.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:15 smithi076 ceph-mon[35401]: pgmap v5882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6363.144360 secs 2024-07-26T15:19:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6363.144360 secs 2024-07-26T15:19:17.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6363.144360 secs 2024-07-26T15:19:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:17 smithi040 ceph-mon[32397]: pgmap v5883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:19:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:17 smithi146 ceph-mon[35807]: pgmap v5883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:19:18.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:17 smithi076 ceph-mon[35401]: pgmap v5883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:19:20.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:19 smithi040 ceph-mon[32397]: pgmap v5884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:19 smithi146 ceph-mon[35807]: pgmap v5884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:20.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:19 smithi076 ceph-mon[35401]: pgmap v5884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:20 smithi040 ceph-mon[32397]: pgmap v5885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:20 smithi146 ceph-mon[35807]: pgmap v5885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:21.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:20 smithi076 ceph-mon[35401]: pgmap v5885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6368.144452 secs 2024-07-26T15:19:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6368.144452 secs 2024-07-26T15:19:22.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6368.144452 secs 2024-07-26T15:19:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:23 smithi146 ceph-mon[35807]: pgmap v5886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:23.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:23 smithi076 ceph-mon[35401]: pgmap v5886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:23 smithi040 ceph-mon[32397]: pgmap v5886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:25.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:25 smithi040 ceph-mon[32397]: pgmap v5887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:25 smithi146 ceph-mon[35807]: pgmap v5887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:25 smithi076 ceph-mon[35401]: pgmap v5887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6373.144597 secs 2024-07-26T15:19:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6373.144597 secs 2024-07-26T15:19:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6373.144597 secs 2024-07-26T15:19:27.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:27 smithi146 ceph-mon[35807]: pgmap v5888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:27.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:27 smithi076 ceph-mon[35401]: pgmap v5888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:27 smithi040 ceph-mon[32397]: pgmap v5888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:29 smithi146 ceph-mon[35807]: pgmap v5889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:29.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:29 smithi076 ceph-mon[35401]: pgmap v5889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:29.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:29 smithi040 ceph-mon[32397]: pgmap v5889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:31 smithi146 ceph-mon[35807]: pgmap v5890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6378.144761 secs 2024-07-26T15:19:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:31 smithi076 ceph-mon[35401]: pgmap v5890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6378.144761 secs 2024-07-26T15:19:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:31 smithi040 ceph-mon[32397]: pgmap v5890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6378.144761 secs 2024-07-26T15:19:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:33 smithi146 ceph-mon[35807]: pgmap v5891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:33.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:33 smithi076 ceph-mon[35401]: pgmap v5891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:33.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:33 smithi040 ceph-mon[32397]: pgmap v5891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:35 smithi146 ceph-mon[35807]: pgmap v5892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:35.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:35 smithi076 ceph-mon[35401]: pgmap v5892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:35.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:35 smithi040 ceph-mon[32397]: pgmap v5892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6383.144891 secs 2024-07-26T15:19:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6383.144891 secs 2024-07-26T15:19:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6383.144891 secs 2024-07-26T15:19:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:37 smithi146 ceph-mon[35807]: pgmap v5893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:37 smithi076 ceph-mon[35401]: pgmap v5893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:37 smithi040 ceph-mon[32397]: pgmap v5893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:39 smithi076 ceph-mon[35401]: pgmap v5894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:39.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:39 smithi040 ceph-mon[32397]: pgmap v5894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:39 smithi146 ceph-mon[35807]: pgmap v5894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:41 smithi040 ceph-mon[32397]: pgmap v5895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6388.145034 secs 2024-07-26T15:19:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:41 smithi146 ceph-mon[35807]: pgmap v5895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6388.145034 secs 2024-07-26T15:19:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:41 smithi076 ceph-mon[35401]: pgmap v5895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6388.145034 secs 2024-07-26T15:19:43.873 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:43 smithi146 ceph-mon[35807]: pgmap v5896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:43.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:43 smithi076 ceph-mon[35401]: pgmap v5896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:43.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:43 smithi040 ceph-mon[32397]: pgmap v5896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:45.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:45 smithi040 ceph-mon[32397]: pgmap v5897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:45 smithi146 ceph-mon[35807]: pgmap v5897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:46.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:45 smithi076 ceph-mon[35401]: pgmap v5897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6393.145173 secs 2024-07-26T15:19:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6393.145173 secs 2024-07-26T15:19:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6393.145173 secs 2024-07-26T15:19:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:47 smithi040 ceph-mon[32397]: pgmap v5898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:47 smithi146 ceph-mon[35807]: pgmap v5898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:48.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:47 smithi076 ceph-mon[35401]: pgmap v5898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:49 smithi040 ceph-mon[32397]: pgmap v5899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:49 smithi146 ceph-mon[35807]: pgmap v5899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:50.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:49 smithi076 ceph-mon[35401]: pgmap v5899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:51 smithi040 ceph-mon[32397]: pgmap v5900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6398.145321 secs 2024-07-26T15:19:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:51 smithi146 ceph-mon[35807]: pgmap v5900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6398.145321 secs 2024-07-26T15:19:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:51 smithi076 ceph-mon[35401]: pgmap v5900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6398.145321 secs 2024-07-26T15:19:53.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:53 smithi040 ceph-mon[32397]: pgmap v5901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:53 smithi146 ceph-mon[35807]: pgmap v5901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:54.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:53 smithi076 ceph-mon[35401]: pgmap v5901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:19:55.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:55 smithi040 ceph-mon[32397]: pgmap v5902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:55 smithi146 ceph-mon[35807]: pgmap v5902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:56.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:55 smithi076 ceph-mon[35401]: pgmap v5902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:19:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6403.145467 secs 2024-07-26T15:19:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6403.145467 secs 2024-07-26T15:19:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6403.145467 secs 2024-07-26T15:19:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:57 smithi040 ceph-mon[32397]: pgmap v5903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:57 smithi146 ceph-mon[35807]: pgmap v5903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:58.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:57 smithi076 ceph-mon[35401]: pgmap v5903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:19:59.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:19:59 smithi040 ceph-mon[32397]: pgmap v5904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:19:59 smithi146 ceph-mon[35807]: pgmap v5904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:00.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:19:59 smithi076 ceph-mon[35401]: pgmap v5904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:20:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:20:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:20:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:01 smithi040 ceph-mon[32397]: pgmap v5905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6408.145557 secs 2024-07-26T15:20:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:01 smithi146 ceph-mon[35807]: pgmap v5905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6408.145557 secs 2024-07-26T15:20:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:01 smithi076 ceph-mon[35401]: pgmap v5905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6408.145557 secs 2024-07-26T15:20:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:03 smithi040 ceph-mon[32397]: pgmap v5906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:04.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:03 smithi146 ceph-mon[35807]: pgmap v5906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:04.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:03 smithi076 ceph-mon[35401]: pgmap v5906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:05.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:05 smithi040 ceph-mon[32397]: pgmap v5907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:05 smithi146 ceph-mon[35807]: pgmap v5907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:06.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:05 smithi076 ceph-mon[35401]: pgmap v5907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6413.145653 secs 2024-07-26T15:20:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6413.145653 secs 2024-07-26T15:20:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6413.145653 secs 2024-07-26T15:20:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:07 smithi040 ceph-mon[32397]: pgmap v5908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:07 smithi146 ceph-mon[35807]: pgmap v5908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:08.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:07 smithi076 ceph-mon[35401]: pgmap v5908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:09.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:09 smithi040 ceph-mon[32397]: pgmap v5909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:09 smithi146 ceph-mon[35807]: pgmap v5909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:09 smithi076 ceph-mon[35401]: pgmap v5909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:11 smithi040 ceph-mon[32397]: pgmap v5910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6418.145749 secs 2024-07-26T15:20:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:11 smithi146 ceph-mon[35807]: pgmap v5910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6418.145749 secs 2024-07-26T15:20:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:11 smithi076 ceph-mon[35401]: pgmap v5910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6418.145749 secs 2024-07-26T15:20:13.988 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:13 smithi146 ceph-mon[35807]: pgmap v5911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:13 smithi076 ceph-mon[35401]: pgmap v5911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:14.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:13 smithi040 ceph-mon[32397]: pgmap v5911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:15 smithi146 ceph-mon[35807]: pgmap v5912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:16.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:15 smithi076 ceph-mon[35401]: pgmap v5912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:15 smithi040 ceph-mon[32397]: pgmap v5912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6423.145886 secs 2024-07-26T15:20:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6423.145886 secs 2024-07-26T15:20:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6423.145886 secs 2024-07-26T15:20:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:17 smithi146 ceph-mon[35807]: pgmap v5913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:17 smithi076 ceph-mon[35401]: pgmap v5913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:17 smithi040 ceph-mon[32397]: pgmap v5913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:20.027 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:19 smithi040 ceph-mon[32397]: pgmap v5914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:19 smithi146 ceph-mon[35807]: pgmap v5914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:20.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:19 smithi076 ceph-mon[35401]: pgmap v5914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:21 smithi146 ceph-mon[35807]: pgmap v5915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6428.146027 secs 2024-07-26T15:20:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:21 smithi076 ceph-mon[35401]: pgmap v5915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6428.146027 secs 2024-07-26T15:20:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:21 smithi040 ceph-mon[32397]: pgmap v5915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6428.146027 secs 2024-07-26T15:20:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:23 smithi146 ceph-mon[35807]: pgmap v5916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:23 smithi076 ceph-mon[35401]: pgmap v5916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:23 smithi040 ceph-mon[32397]: pgmap v5916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:25 smithi146 ceph-mon[35807]: pgmap v5917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:26.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:25 smithi076 ceph-mon[35401]: pgmap v5917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:25 smithi040 ceph-mon[32397]: pgmap v5917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6433.146160 secs 2024-07-26T15:20:27.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6433.146160 secs 2024-07-26T15:20:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6433.146160 secs 2024-07-26T15:20:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:27 smithi146 ceph-mon[35807]: pgmap v5918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:27 smithi076 ceph-mon[35401]: pgmap v5918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:27 smithi040 ceph-mon[32397]: pgmap v5918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:29 smithi146 ceph-mon[35807]: pgmap v5919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:30.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:29 smithi076 ceph-mon[35401]: pgmap v5919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:29 smithi040 ceph-mon[32397]: pgmap v5919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:31 smithi076 ceph-mon[35401]: pgmap v5920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6438.146305 secs 2024-07-26T15:20:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:31 smithi040 ceph-mon[32397]: pgmap v5920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6438.146305 secs 2024-07-26T15:20:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:31 smithi146 ceph-mon[35807]: pgmap v5920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6438.146305 secs 2024-07-26T15:20:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:33 smithi076 ceph-mon[35401]: pgmap v5921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:34.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:33 smithi040 ceph-mon[32397]: pgmap v5921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:33 smithi146 ceph-mon[35807]: pgmap v5921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:36.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:35 smithi040 ceph-mon[32397]: pgmap v5922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:35 smithi146 ceph-mon[35807]: pgmap v5922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:36.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:35 smithi076 ceph-mon[35401]: pgmap v5922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:20:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6443.146443 secs 2024-07-26T15:20:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6443.146443 secs 2024-07-26T15:20:37.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6443.146443 secs 2024-07-26T15:20:38.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:37 smithi040 ceph-mon[32397]: pgmap v5923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:37 smithi146 ceph-mon[35807]: pgmap v5923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:38.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:37 smithi076 ceph-mon[35401]: pgmap v5923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:40.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:39 smithi040 ceph-mon[32397]: pgmap v5924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:39 smithi146 ceph-mon[35807]: pgmap v5924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:39 smithi076 ceph-mon[35401]: pgmap v5924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:41 smithi040 ceph-mon[32397]: pgmap v5925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6448.146582 secs 2024-07-26T15:20:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:41 smithi146 ceph-mon[35807]: pgmap v5925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6448.146582 secs 2024-07-26T15:20:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:41 smithi076 ceph-mon[35401]: pgmap v5925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6448.146582 secs 2024-07-26T15:20:44.126 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:43 smithi146 ceph-mon[35807]: pgmap v5926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:44.135 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:43 smithi076 ceph-mon[35401]: pgmap v5926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:44.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:43 smithi040 ceph-mon[32397]: pgmap v5926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:46.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:45 smithi040 ceph-mon[32397]: pgmap v5927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:45 smithi146 ceph-mon[35807]: pgmap v5927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:45 smithi076 ceph-mon[35401]: pgmap v5927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6453.146668 secs 2024-07-26T15:20:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6453.146668 secs 2024-07-26T15:20:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6453.146668 secs 2024-07-26T15:20:48.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:47 smithi040 ceph-mon[32397]: pgmap v5928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:47 smithi146 ceph-mon[35807]: pgmap v5928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:47 smithi076 ceph-mon[35401]: pgmap v5928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:50.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:49 smithi040 ceph-mon[32397]: pgmap v5929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:49 smithi146 ceph-mon[35807]: pgmap v5929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:50.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:49 smithi076 ceph-mon[35401]: pgmap v5929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:50 smithi040 ceph-mon[32397]: pgmap v5930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:50 smithi146 ceph-mon[35807]: pgmap v5930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:50 smithi076 ceph-mon[35401]: pgmap v5930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6458.146836 secs 2024-07-26T15:20:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6458.146836 secs 2024-07-26T15:20:52.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6458.146836 secs 2024-07-26T15:20:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:52 smithi040 ceph-mon[32397]: pgmap v5931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:52 smithi146 ceph-mon[35807]: pgmap v5931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:53.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:52 smithi076 ceph-mon[35401]: pgmap v5931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:55.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:55 smithi040 ceph-mon[32397]: pgmap v5932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:55 smithi146 ceph-mon[35807]: pgmap v5932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:55.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:55 smithi076 ceph-mon[35401]: pgmap v5932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:20:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6463.146931 secs 2024-07-26T15:20:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:57 smithi040 ceph-mon[32397]: pgmap v5933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6463.146931 secs 2024-07-26T15:20:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:57 smithi146 ceph-mon[35807]: pgmap v5933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:57.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6463.146931 secs 2024-07-26T15:20:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:57 smithi076 ceph-mon[35401]: pgmap v5933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:20:59 smithi040 ceph-mon[32397]: pgmap v5934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:20:59 smithi146 ceph-mon[35807]: pgmap v5934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:20:59.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:20:59 smithi076 ceph-mon[35401]: pgmap v5934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:01 smithi040 ceph-mon[32397]: pgmap v5935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:01 smithi146 ceph-mon[35807]: pgmap v5935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:01.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:01 smithi076 ceph-mon[35401]: pgmap v5935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6468.147090 secs 2024-07-26T15:21:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6468.147090 secs 2024-07-26T15:21:02.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6468.147090 secs 2024-07-26T15:21:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:03 smithi040 ceph-mon[32397]: pgmap v5936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:03 smithi146 ceph-mon[35807]: pgmap v5936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:03 smithi076 ceph-mon[35401]: pgmap v5936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:05 smithi040 ceph-mon[32397]: pgmap v5937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:05 smithi146 ceph-mon[35807]: pgmap v5937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:05.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:05 smithi076 ceph-mon[35401]: pgmap v5937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6473.147231 secs 2024-07-26T15:21:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:07 smithi040 ceph-mon[32397]: pgmap v5938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6473.147231 secs 2024-07-26T15:21:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:07 smithi146 ceph-mon[35807]: pgmap v5938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6473.147231 secs 2024-07-26T15:21:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:07 smithi076 ceph-mon[35401]: pgmap v5938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:09 smithi040 ceph-mon[32397]: pgmap v5939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:09 smithi146 ceph-mon[35807]: pgmap v5939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:09 smithi076 ceph-mon[35401]: pgmap v5939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:11 smithi040 ceph-mon[32397]: pgmap v5940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6478.147378 secs 2024-07-26T15:21:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:11 smithi146 ceph-mon[35807]: pgmap v5940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6478.147378 secs 2024-07-26T15:21:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:11 smithi076 ceph-mon[35401]: pgmap v5940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:11.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6478.147378 secs 2024-07-26T15:21:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:13 smithi040 ceph-mon[32397]: pgmap v5941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:13 smithi146 ceph-mon[35807]: pgmap v5941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:13 smithi076 ceph-mon[35401]: pgmap v5941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:15 smithi040 ceph-mon[32397]: pgmap v5942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:15 smithi146 ceph-mon[35807]: pgmap v5942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:15.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:15 smithi076 ceph-mon[35401]: pgmap v5942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:16.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6483.147517 secs 2024-07-26T15:21:16.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6483.147517 secs 2024-07-26T15:21:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6483.147517 secs 2024-07-26T15:21:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:17 smithi146 ceph-mon[35807]: pgmap v5943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:17.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:17 smithi076 ceph-mon[35401]: pgmap v5943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:17 smithi040 ceph-mon[32397]: pgmap v5943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:19 smithi146 ceph-mon[35807]: pgmap v5944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:19.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:19 smithi076 ceph-mon[35401]: pgmap v5944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:19.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:19 smithi040 ceph-mon[32397]: pgmap v5944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:21 smithi146 ceph-mon[35807]: pgmap v5945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6488.147662 secs 2024-07-26T15:21:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:21 smithi076 ceph-mon[35401]: pgmap v5945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:21.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6488.147662 secs 2024-07-26T15:21:21.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:21 smithi040 ceph-mon[32397]: pgmap v5945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6488.147662 secs 2024-07-26T15:21:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:23 smithi146 ceph-mon[35807]: pgmap v5946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:23 smithi076 ceph-mon[35401]: pgmap v5946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:23.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:23 smithi040 ceph-mon[32397]: pgmap v5946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:25 smithi146 ceph-mon[35807]: pgmap v5947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:25 smithi076 ceph-mon[35401]: pgmap v5947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:25 smithi040 ceph-mon[32397]: pgmap v5947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:26.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6493.147804 secs 2024-07-26T15:21:26.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6493.147804 secs 2024-07-26T15:21:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6493.147804 secs 2024-07-26T15:21:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:27 smithi146 ceph-mon[35807]: pgmap v5948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:27.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:27 smithi076 ceph-mon[35401]: pgmap v5948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:27.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:27 smithi040 ceph-mon[32397]: pgmap v5948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:29 smithi146 ceph-mon[35807]: pgmap v5949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:29.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:29 smithi076 ceph-mon[35401]: pgmap v5949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:29 smithi040 ceph-mon[32397]: pgmap v5949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:31 smithi146 ceph-mon[35807]: pgmap v5950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6498.147892 secs 2024-07-26T15:21:31.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:31 smithi076 ceph-mon[35401]: pgmap v5950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6498.147892 secs 2024-07-26T15:21:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:31 smithi040 ceph-mon[32397]: pgmap v5950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:31.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6498.147892 secs 2024-07-26T15:21:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:33 smithi146 ceph-mon[35807]: pgmap v5951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:33.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:33 smithi076 ceph-mon[35401]: pgmap v5951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:33.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:33 smithi040 ceph-mon[32397]: pgmap v5951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:35 smithi076 ceph-mon[35401]: pgmap v5952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:35 smithi040 ceph-mon[32397]: pgmap v5952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:35 smithi146 ceph-mon[35807]: pgmap v5952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:36.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6503.148012 secs 2024-07-26T15:21:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6503.148012 secs 2024-07-26T15:21:36.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6503.148012 secs 2024-07-26T15:21:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:37 smithi040 ceph-mon[32397]: pgmap v5953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:37 smithi146 ceph-mon[35807]: pgmap v5953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:37.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:37 smithi076 ceph-mon[35401]: pgmap v5953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:39.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:39 smithi040 ceph-mon[32397]: pgmap v5954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:39 smithi146 ceph-mon[35807]: pgmap v5954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:39.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:39 smithi076 ceph-mon[35401]: pgmap v5954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:41 smithi040 ceph-mon[32397]: pgmap v5955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6508.148149 secs 2024-07-26T15:21:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:41 smithi146 ceph-mon[35807]: pgmap v5955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6508.148149 secs 2024-07-26T15:21:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:41 smithi076 ceph-mon[35401]: pgmap v5955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6508.148149 secs 2024-07-26T15:21:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:43 smithi040 ceph-mon[32397]: pgmap v5956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:43 smithi146 ceph-mon[35807]: pgmap v5956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:43.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:43 smithi076 ceph-mon[35401]: pgmap v5956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:45.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:45 smithi146 ceph-mon[35807]: pgmap v5957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:45.635 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:45 smithi076 ceph-mon[35401]: pgmap v5957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:45.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:45 smithi040 ceph-mon[32397]: pgmap v5957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:46.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6513.148332 secs 2024-07-26T15:21:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6513.148332 secs 2024-07-26T15:21:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6513.148332 secs 2024-07-26T15:21:47.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:47 smithi040 ceph-mon[32397]: pgmap v5958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:47 smithi146 ceph-mon[35807]: pgmap v5958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:47.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:47 smithi076 ceph-mon[35401]: pgmap v5958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:49.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:49 smithi040 ceph-mon[32397]: pgmap v5959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:49 smithi146 ceph-mon[35807]: pgmap v5959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:49 smithi076 ceph-mon[35401]: pgmap v5959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:51 smithi040 ceph-mon[32397]: pgmap v5960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6518.148468 secs 2024-07-26T15:21:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:51 smithi146 ceph-mon[35807]: pgmap v5960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6518.148468 secs 2024-07-26T15:21:51.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:51 smithi076 ceph-mon[35401]: pgmap v5960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6518.148468 secs 2024-07-26T15:21:53.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:53 smithi040 ceph-mon[32397]: pgmap v5961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:53 smithi146 ceph-mon[35807]: pgmap v5961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:53.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:53 smithi076 ceph-mon[35401]: pgmap v5961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:55.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:55 smithi040 ceph-mon[32397]: pgmap v5962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:55 smithi146 ceph-mon[35807]: pgmap v5962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:55.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:55 smithi076 ceph-mon[35401]: pgmap v5962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:21:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6523.148606 secs 2024-07-26T15:21:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6523.148606 secs 2024-07-26T15:21:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6523.148606 secs 2024-07-26T15:21:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:57 smithi040 ceph-mon[32397]: pgmap v5963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:57 smithi146 ceph-mon[35807]: pgmap v5963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:57.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:57 smithi076 ceph-mon[35401]: pgmap v5963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:59.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:21:59 smithi040 ceph-mon[32397]: pgmap v5964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:59.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:21:59 smithi146 ceph-mon[35807]: pgmap v5964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:21:59.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:21:59 smithi076 ceph-mon[35401]: pgmap v5964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:01 smithi040 ceph-mon[32397]: pgmap v5965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6528.148747 secs 2024-07-26T15:22:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:01 smithi146 ceph-mon[35807]: pgmap v5965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6528.148747 secs 2024-07-26T15:22:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:01 smithi076 ceph-mon[35401]: pgmap v5965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6528.148747 secs 2024-07-26T15:22:03.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:03 smithi040 ceph-mon[32397]: pgmap v5966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:03 smithi146 ceph-mon[35807]: pgmap v5966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:03.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:03 smithi076 ceph-mon[35401]: pgmap v5966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:05.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:05 smithi040 ceph-mon[32397]: pgmap v5967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:05 smithi146 ceph-mon[35807]: pgmap v5967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:05.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:05 smithi076 ceph-mon[35401]: pgmap v5967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6533.148887 secs 2024-07-26T15:22:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6533.148887 secs 2024-07-26T15:22:06.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6533.148887 secs 2024-07-26T15:22:07.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:07 smithi040 ceph-mon[32397]: pgmap v5968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:07 smithi146 ceph-mon[35807]: pgmap v5968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:07.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:07 smithi076 ceph-mon[35401]: pgmap v5968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:09 smithi040 ceph-mon[32397]: pgmap v5969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:09 smithi146 ceph-mon[35807]: pgmap v5969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:09.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:09 smithi076 ceph-mon[35401]: pgmap v5969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:11 smithi146 ceph-mon[35807]: pgmap v5970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6538.149046 secs 2024-07-26T15:22:11.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:11 smithi076 ceph-mon[35401]: pgmap v5970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6538.149046 secs 2024-07-26T15:22:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:11 smithi040 ceph-mon[32397]: pgmap v5970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6538.149046 secs 2024-07-26T15:22:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:13 smithi146 ceph-mon[35807]: pgmap v5971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:13.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:13 smithi076 ceph-mon[35401]: pgmap v5971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:13.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:13 smithi040 ceph-mon[32397]: pgmap v5971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:15 smithi146 ceph-mon[35807]: pgmap v5972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:15 smithi076 ceph-mon[35401]: pgmap v5972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:15.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:15 smithi040 ceph-mon[32397]: pgmap v5972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6543.149201 secs 2024-07-26T15:22:16.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6543.149201 secs 2024-07-26T15:22:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6543.149201 secs 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: pgmap v5973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: pgmap v5973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: pgmap v5973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:22:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:22:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:18 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:22:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:18 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:22:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:18 smithi146 ceph-mon[35807]: pgmap v5974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 928 B/s rd, 1 op/s 2024-07-26T15:22:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:18 smithi146 ceph-mon[35807]: pgmap v5975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:22:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:18 smithi146 ceph-mon[35807]: pgmap v5976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 728 B/s rd, 1 op/s 2024-07-26T15:22:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:18 smithi146 ceph-mon[35807]: pgmap v5977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:18 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:22:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:18 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:22:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:18 smithi076 ceph-mon[35401]: pgmap v5974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 928 B/s rd, 1 op/s 2024-07-26T15:22:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:18 smithi076 ceph-mon[35401]: pgmap v5975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:22:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:18 smithi076 ceph-mon[35401]: pgmap v5976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 728 B/s rd, 1 op/s 2024-07-26T15:22:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:18 smithi076 ceph-mon[35401]: pgmap v5977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:18 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:22:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:18 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:22:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:18 smithi040 ceph-mon[32397]: pgmap v5974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 928 B/s rd, 1 op/s 2024-07-26T15:22:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:18 smithi040 ceph-mon[32397]: pgmap v5975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:22:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:18 smithi040 ceph-mon[32397]: pgmap v5976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 728 B/s rd, 1 op/s 2024-07-26T15:22:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:18 smithi040 ceph-mon[32397]: pgmap v5977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:20 smithi146 ceph-mon[35807]: pgmap v5978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:20 smithi076 ceph-mon[35401]: pgmap v5978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:20 smithi040 ceph-mon[32397]: pgmap v5978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6548.149342 secs 2024-07-26T15:22:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6548.149342 secs 2024-07-26T15:22:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6548.149342 secs 2024-07-26T15:22:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:22 smithi146 ceph-mon[35807]: pgmap v5979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:22 smithi076 ceph-mon[35401]: pgmap v5979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:22 smithi040 ceph-mon[32397]: pgmap v5979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1 op/s 2024-07-26T15:22:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:24 smithi146 ceph-mon[35807]: pgmap v5980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:24.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:24 smithi076 ceph-mon[35401]: pgmap v5980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:24 smithi040 ceph-mon[32397]: pgmap v5980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:26 smithi146 ceph-mon[35807]: pgmap v5981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6553.149436 secs 2024-07-26T15:22:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:26 smithi076 ceph-mon[35401]: pgmap v5981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6553.149436 secs 2024-07-26T15:22:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:26 smithi040 ceph-mon[32397]: pgmap v5981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6553.149436 secs 2024-07-26T15:22:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:28 smithi076 ceph-mon[35401]: pgmap v5982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:22:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:28 smithi040 ceph-mon[32397]: pgmap v5982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:22:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:28 smithi146 ceph-mon[35807]: pgmap v5982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:22:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:30 smithi076 ceph-mon[35401]: pgmap v5983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:30 smithi040 ceph-mon[32397]: pgmap v5983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:30 smithi146 ceph-mon[35807]: pgmap v5983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6558.149571 secs 2024-07-26T15:22:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6558.149571 secs 2024-07-26T15:22:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6558.149571 secs 2024-07-26T15:22:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:32 smithi040 ceph-mon[32397]: pgmap v5984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:32 smithi146 ceph-mon[35807]: pgmap v5984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:32 smithi076 ceph-mon[35401]: pgmap v5984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:34 smithi040 ceph-mon[32397]: pgmap v5985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:34 smithi146 ceph-mon[35807]: pgmap v5985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:35.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:34 smithi076 ceph-mon[35401]: pgmap v5985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:36 smithi040 ceph-mon[32397]: pgmap v5986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6563.149714 secs 2024-07-26T15:22:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:36 smithi146 ceph-mon[35807]: pgmap v5986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6563.149714 secs 2024-07-26T15:22:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:36 smithi076 ceph-mon[35401]: pgmap v5986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6563.149714 secs 2024-07-26T15:22:38.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:38 smithi040 ceph-mon[32397]: pgmap v5987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:38 smithi146 ceph-mon[35807]: pgmap v5987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:39.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:38 smithi076 ceph-mon[35401]: pgmap v5987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:40 smithi040 ceph-mon[32397]: pgmap v5988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:40 smithi146 ceph-mon[35807]: pgmap v5988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:40 smithi076 ceph-mon[35401]: pgmap v5988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6568.149856 secs 2024-07-26T15:22:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6568.149856 secs 2024-07-26T15:22:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6568.149856 secs 2024-07-26T15:22:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:42 smithi040 ceph-mon[32397]: pgmap v5989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:42 smithi146 ceph-mon[35807]: pgmap v5989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:42 smithi076 ceph-mon[35401]: pgmap v5989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:44 smithi040 ceph-mon[32397]: pgmap v5990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:44 smithi146 ceph-mon[35807]: pgmap v5990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:44 smithi076 ceph-mon[35401]: pgmap v5990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:46 smithi040 ceph-mon[32397]: pgmap v5991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6573.149991 secs 2024-07-26T15:22:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:46 smithi146 ceph-mon[35807]: pgmap v5991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6573.149991 secs 2024-07-26T15:22:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:46 smithi076 ceph-mon[35401]: pgmap v5991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6573.149991 secs 2024-07-26T15:22:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:48 smithi040 ceph-mon[32397]: pgmap v5992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:48 smithi146 ceph-mon[35807]: pgmap v5992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:49.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:48 smithi076 ceph-mon[35401]: pgmap v5992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:50 smithi040 ceph-mon[32397]: pgmap v5993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:50 smithi146 ceph-mon[35807]: pgmap v5993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:51.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:50 smithi076 ceph-mon[35401]: pgmap v5993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6578.150138 secs 2024-07-26T15:22:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6578.150138 secs 2024-07-26T15:22:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6578.150138 secs 2024-07-26T15:22:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:52 smithi040 ceph-mon[32397]: pgmap v5994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:52 smithi146 ceph-mon[35807]: pgmap v5994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:53.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:52 smithi076 ceph-mon[35401]: pgmap v5994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:54 smithi040 ceph-mon[32397]: pgmap v5995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:54 smithi146 ceph-mon[35807]: pgmap v5995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:54 smithi076 ceph-mon[35401]: pgmap v5995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:56 smithi040 ceph-mon[32397]: pgmap v5996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6583.150316 secs 2024-07-26T15:22:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:56 smithi146 ceph-mon[35807]: pgmap v5996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6583.150316 secs 2024-07-26T15:22:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:56 smithi076 ceph-mon[35401]: pgmap v5996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:22:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6583.150316 secs 2024-07-26T15:22:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:22:58 smithi040 ceph-mon[32397]: pgmap v5997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:22:58 smithi146 ceph-mon[35807]: pgmap v5997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:22:59.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:22:58 smithi076 ceph-mon[35401]: pgmap v5997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:00 smithi040 ceph-mon[32397]: pgmap v5998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:00 smithi146 ceph-mon[35807]: pgmap v5998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:00 smithi076 ceph-mon[35401]: pgmap v5998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6588.150478 secs 2024-07-26T15:23:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6588.150478 secs 2024-07-26T15:23:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6588.150478 secs 2024-07-26T15:23:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:02 smithi146 ceph-mon[35807]: pgmap v5999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:03.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:02 smithi076 ceph-mon[35401]: pgmap v5999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:02 smithi040 ceph-mon[32397]: pgmap v5999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:04 smithi146 ceph-mon[35807]: pgmap v6000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:04 smithi076 ceph-mon[35401]: pgmap v6000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:04 smithi040 ceph-mon[32397]: pgmap v6000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:06 smithi146 ceph-mon[35807]: pgmap v6001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6593.150610 secs 2024-07-26T15:23:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:06 smithi076 ceph-mon[35401]: pgmap v6001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6593.150610 secs 2024-07-26T15:23:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:06 smithi040 ceph-mon[32397]: pgmap v6001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6593.150610 secs 2024-07-26T15:23:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:08 smithi146 ceph-mon[35807]: pgmap v6002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:08 smithi076 ceph-mon[35401]: pgmap v6002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:08 smithi040 ceph-mon[32397]: pgmap v6002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:10 smithi146 ceph-mon[35807]: pgmap v6003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:10 smithi076 ceph-mon[35401]: pgmap v6003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:10 smithi040 ceph-mon[32397]: pgmap v6003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6598.150759 secs 2024-07-26T15:23:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6598.150759 secs 2024-07-26T15:23:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6598.150759 secs 2024-07-26T15:23:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:12 smithi146 ceph-mon[35807]: pgmap v6004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:12 smithi076 ceph-mon[35401]: pgmap v6004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:12 smithi040 ceph-mon[32397]: pgmap v6004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:14 smithi146 ceph-mon[35807]: pgmap v6005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:14 smithi076 ceph-mon[35401]: pgmap v6005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:14 smithi040 ceph-mon[32397]: pgmap v6005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:16 smithi146 ceph-mon[35807]: pgmap v6006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6603.150897 secs 2024-07-26T15:23:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:16 smithi076 ceph-mon[35401]: pgmap v6006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6603.150897 secs 2024-07-26T15:23:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:16 smithi040 ceph-mon[32397]: pgmap v6006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6603.150897 secs 2024-07-26T15:23:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:17 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:23:18.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:17 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:23:18.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:17 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: pgmap v6007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:18 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: pgmap v6007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:18 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: pgmap v6007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:18 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:20 smithi076 ceph-mon[35401]: pgmap v6008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:20 smithi040 ceph-mon[32397]: pgmap v6008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:20 smithi146 ceph-mon[35807]: pgmap v6008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6608.150988 secs 2024-07-26T15:23:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6608.150988 secs 2024-07-26T15:23:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6608.150988 secs 2024-07-26T15:23:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: pgmap v6009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: pgmap v6009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: pgmap v6009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:23.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: pgmap v6010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:23:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:24 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:23:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: pgmap v6010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:23:24.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:24 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:23:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: pgmap v6010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:23:24.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:23:24.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:23:24.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:24 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:23:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:26 smithi146 ceph-mon[35807]: pgmap v6011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6613.151133 secs 2024-07-26T15:23:26.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:26 smithi076 ceph-mon[35401]: pgmap v6011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6613.151133 secs 2024-07-26T15:23:26.842 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:26 smithi040 ceph-mon[32397]: pgmap v6011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:26.842 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6613.151133 secs 2024-07-26T15:23:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:28 smithi040 ceph-mon[32397]: pgmap v6012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:28 smithi146 ceph-mon[35807]: pgmap v6012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:28 smithi076 ceph-mon[35401]: pgmap v6012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:30 smithi146 ceph-mon[35807]: pgmap v6013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:30.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:30 smithi076 ceph-mon[35401]: pgmap v6013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:30 smithi040 ceph-mon[32397]: pgmap v6013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6618.151315 secs 2024-07-26T15:23:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6618.151315 secs 2024-07-26T15:23:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6618.151315 secs 2024-07-26T15:23:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:32 smithi040 ceph-mon[32397]: pgmap v6014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:32 smithi146 ceph-mon[35807]: pgmap v6014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:33.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:32 smithi076 ceph-mon[35401]: pgmap v6014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:34 smithi040 ceph-mon[32397]: pgmap v6015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:34 smithi146 ceph-mon[35807]: pgmap v6015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:34 smithi076 ceph-mon[35401]: pgmap v6015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:36 smithi040 ceph-mon[32397]: pgmap v6016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6623.151453 secs 2024-07-26T15:23:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:36 smithi146 ceph-mon[35807]: pgmap v6016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6623.151453 secs 2024-07-26T15:23:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:36 smithi076 ceph-mon[35401]: pgmap v6016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6623.151453 secs 2024-07-26T15:23:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:38 smithi040 ceph-mon[32397]: pgmap v6017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:38 smithi146 ceph-mon[35807]: pgmap v6017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:38 smithi076 ceph-mon[35401]: pgmap v6017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:40 smithi040 ceph-mon[32397]: pgmap v6018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:40 smithi146 ceph-mon[35807]: pgmap v6018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:40 smithi076 ceph-mon[35401]: pgmap v6018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6628.151587 secs 2024-07-26T15:23:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6628.151587 secs 2024-07-26T15:23:42.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6628.151587 secs 2024-07-26T15:23:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:42 smithi040 ceph-mon[32397]: pgmap v6019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:42 smithi146 ceph-mon[35807]: pgmap v6019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:43.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:42 smithi076 ceph-mon[35401]: pgmap v6019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:44 smithi040 ceph-mon[32397]: pgmap v6020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:44 smithi146 ceph-mon[35807]: pgmap v6020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:44 smithi076 ceph-mon[35401]: pgmap v6020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:46.913 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:46 smithi076 ceph-mon[35401]: pgmap v6021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:46.914 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6633.151748 secs 2024-07-26T15:23:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:46 smithi040 ceph-mon[32397]: pgmap v6021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6633.151748 secs 2024-07-26T15:23:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:46 smithi146 ceph-mon[35807]: pgmap v6021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6633.151748 secs 2024-07-26T15:23:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:48 smithi076 ceph-mon[35401]: pgmap v6022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:48 smithi040 ceph-mon[32397]: pgmap v6022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:48 smithi146 ceph-mon[35807]: pgmap v6022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:50 smithi040 ceph-mon[32397]: pgmap v6023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:50 smithi146 ceph-mon[35807]: pgmap v6023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:50 smithi076 ceph-mon[35401]: pgmap v6023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6638.151911 secs 2024-07-26T15:23:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6638.151911 secs 2024-07-26T15:23:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6638.151911 secs 2024-07-26T15:23:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:52 smithi040 ceph-mon[32397]: pgmap v6024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:52 smithi146 ceph-mon[35807]: pgmap v6024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:52 smithi076 ceph-mon[35401]: pgmap v6024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:54 smithi040 ceph-mon[32397]: pgmap v6025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:54 smithi146 ceph-mon[35807]: pgmap v6025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:55.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:54 smithi076 ceph-mon[35401]: pgmap v6025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:23:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:56 smithi040 ceph-mon[32397]: pgmap v6026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6643.152069 secs 2024-07-26T15:23:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:56 smithi146 ceph-mon[35807]: pgmap v6026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6643.152069 secs 2024-07-26T15:23:57.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:56 smithi076 ceph-mon[35401]: pgmap v6026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:23:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6643.152069 secs 2024-07-26T15:23:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:23:58 smithi076 ceph-mon[35401]: pgmap v6027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:23:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:23:58 smithi040 ceph-mon[32397]: pgmap v6027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:23:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:23:58 smithi146 ceph-mon[35807]: pgmap v6027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:00.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:00 smithi040 ceph-mon[32397]: pgmap v6028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:00 smithi146 ceph-mon[35807]: pgmap v6028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:01.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:00 smithi076 ceph-mon[35401]: pgmap v6028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6648.152212 secs 2024-07-26T15:24:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6648.152212 secs 2024-07-26T15:24:02.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6648.152212 secs 2024-07-26T15:24:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:02 smithi040 ceph-mon[32397]: pgmap v6029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:02 smithi146 ceph-mon[35807]: pgmap v6029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:02 smithi076 ceph-mon[35401]: pgmap v6029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:04 smithi040 ceph-mon[32397]: pgmap v6030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:04 smithi146 ceph-mon[35807]: pgmap v6030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:04 smithi076 ceph-mon[35401]: pgmap v6030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:24:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:06 smithi146 ceph-mon[35807]: pgmap v6031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6653.152347 secs 2024-07-26T15:24:07.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:06 smithi076 ceph-mon[35401]: pgmap v6031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6653.152347 secs 2024-07-26T15:24:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:06 smithi040 ceph-mon[32397]: pgmap v6031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6653.152347 secs 2024-07-26T15:24:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:08 smithi146 ceph-mon[35807]: pgmap v6032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:08 smithi076 ceph-mon[35401]: pgmap v6032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:08 smithi040 ceph-mon[32397]: pgmap v6032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:10 smithi040 ceph-mon[32397]: pgmap v6033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:10 smithi146 ceph-mon[35807]: pgmap v6033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:10 smithi076 ceph-mon[35401]: pgmap v6033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6658.152493 secs 2024-07-26T15:24:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6658.152493 secs 2024-07-26T15:24:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6658.152493 secs 2024-07-26T15:24:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:12 smithi146 ceph-mon[35807]: pgmap v6034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:12 smithi076 ceph-mon[35401]: pgmap v6034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:12 smithi040 ceph-mon[32397]: pgmap v6034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:14 smithi146 ceph-mon[35807]: pgmap v6035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:14 smithi076 ceph-mon[35401]: pgmap v6035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:14 smithi040 ceph-mon[32397]: pgmap v6035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:15.719 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-07-26T15:24:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:16 smithi146 ceph-mon[35807]: pgmap v6036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6663.152629 secs 2024-07-26T15:24:17.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:16 smithi076 ceph-mon[35401]: pgmap v6036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6663.152629 secs 2024-07-26T15:24:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:16 smithi040 ceph-mon[32397]: pgmap v6036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6663.152629 secs 2024-07-26T15:24:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:18 smithi146 ceph-mon[35807]: pgmap v6037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:18 smithi076 ceph-mon[35401]: pgmap v6037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:18 smithi040 ceph-mon[32397]: pgmap v6037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:20 smithi146 ceph-mon[35807]: pgmap v6038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:21.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:20 smithi076 ceph-mon[35401]: pgmap v6038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:20 smithi040 ceph-mon[32397]: pgmap v6038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6668.152770 secs 2024-07-26T15:24:22.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6668.152770 secs 2024-07-26T15:24:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6668.152770 secs 2024-07-26T15:24:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:22 smithi146 ceph-mon[35807]: pgmap v6039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:23.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:22 smithi076 ceph-mon[35401]: pgmap v6039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:22 smithi040 ceph-mon[32397]: pgmap v6039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:24 smithi146 ceph-mon[35807]: pgmap v6040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:24 smithi076 ceph-mon[35401]: pgmap v6040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:24 smithi040 ceph-mon[32397]: pgmap v6040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:26 smithi076 ceph-mon[35401]: pgmap v6041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6673.152857 secs 2024-07-26T15:24:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:26 smithi040 ceph-mon[32397]: pgmap v6041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6673.152857 secs 2024-07-26T15:24:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:26 smithi146 ceph-mon[35807]: pgmap v6041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6673.152857 secs 2024-07-26T15:24:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:28 smithi076 ceph-mon[35401]: pgmap v6042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:28 smithi040 ceph-mon[32397]: pgmap v6042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:28 smithi146 ceph-mon[35807]: pgmap v6042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:30 smithi040 ceph-mon[32397]: pgmap v6043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:30 smithi146 ceph-mon[35807]: pgmap v6043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:30 smithi076 ceph-mon[35401]: pgmap v6043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6678.153003 secs 2024-07-26T15:24:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6678.153003 secs 2024-07-26T15:24:32.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6678.153003 secs 2024-07-26T15:24:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:32 smithi040 ceph-mon[32397]: pgmap v6044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:32 smithi146 ceph-mon[35807]: pgmap v6044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:33.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:32 smithi076 ceph-mon[35401]: pgmap v6044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:34 smithi040 ceph-mon[32397]: pgmap v6045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:34 smithi146 ceph-mon[35807]: pgmap v6045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:34 smithi076 ceph-mon[35401]: pgmap v6045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:36 smithi040 ceph-mon[32397]: pgmap v6046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:24:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6683.153178 secs 2024-07-26T15:24:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:36 smithi146 ceph-mon[35807]: pgmap v6046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:24:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6683.153178 secs 2024-07-26T15:24:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:36 smithi076 ceph-mon[35401]: pgmap v6046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:24:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6683.153178 secs 2024-07-26T15:24:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:38 smithi040 ceph-mon[32397]: pgmap v6047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:38 smithi146 ceph-mon[35807]: pgmap v6047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:38 smithi076 ceph-mon[35401]: pgmap v6047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:40 smithi040 ceph-mon[32397]: pgmap v6048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:40 smithi146 ceph-mon[35807]: pgmap v6048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:41.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:40 smithi076 ceph-mon[35401]: pgmap v6048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6688.153316 secs 2024-07-26T15:24:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6688.153316 secs 2024-07-26T15:24:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6688.153316 secs 2024-07-26T15:24:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:42 smithi040 ceph-mon[32397]: pgmap v6049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:42 smithi146 ceph-mon[35807]: pgmap v6049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:42 smithi076 ceph-mon[35401]: pgmap v6049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:45.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:44 smithi040 ceph-mon[32397]: pgmap v6050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:44 smithi146 ceph-mon[35807]: pgmap v6050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:45.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:44 smithi076 ceph-mon[35401]: pgmap v6050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:46 smithi040 ceph-mon[32397]: pgmap v6051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6693.153412 secs 2024-07-26T15:24:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:46 smithi146 ceph-mon[35807]: pgmap v6051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6693.153412 secs 2024-07-26T15:24:47.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:46 smithi076 ceph-mon[35401]: pgmap v6051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6693.153412 secs 2024-07-26T15:24:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:48 smithi040 ceph-mon[32397]: pgmap v6052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:48 smithi146 ceph-mon[35807]: pgmap v6052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:48 smithi076 ceph-mon[35401]: pgmap v6052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:50 smithi040 ceph-mon[32397]: pgmap v6053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:50 smithi146 ceph-mon[35807]: pgmap v6053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:50 smithi076 ceph-mon[35401]: pgmap v6053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6698.153552 secs 2024-07-26T15:24:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6698.153552 secs 2024-07-26T15:24:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6698.153552 secs 2024-07-26T15:24:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:52 smithi040 ceph-mon[32397]: pgmap v6054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:52 smithi146 ceph-mon[35807]: pgmap v6054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:52 smithi076 ceph-mon[35401]: pgmap v6054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:54 smithi040 ceph-mon[32397]: pgmap v6055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:54 smithi146 ceph-mon[35807]: pgmap v6055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:54 smithi076 ceph-mon[35401]: pgmap v6055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:24:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:56 smithi040 ceph-mon[32397]: pgmap v6056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6703.153684 secs 2024-07-26T15:24:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:56 smithi146 ceph-mon[35807]: pgmap v6056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6703.153684 secs 2024-07-26T15:24:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:56 smithi076 ceph-mon[35401]: pgmap v6056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:24:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6703.153684 secs 2024-07-26T15:24:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:24:58 smithi146 ceph-mon[35807]: pgmap v6057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:58.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:24:58 smithi076 ceph-mon[35401]: pgmap v6057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:24:58.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:24:58 smithi040 ceph-mon[32397]: pgmap v6057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:00 smithi040 ceph-mon[32397]: pgmap v6058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:00 smithi146 ceph-mon[35807]: pgmap v6058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:00 smithi076 ceph-mon[35401]: pgmap v6058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:01.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6708.153833 secs 2024-07-26T15:25:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6708.153833 secs 2024-07-26T15:25:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6708.153833 secs 2024-07-26T15:25:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:02 smithi040 ceph-mon[32397]: pgmap v6059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:02 smithi146 ceph-mon[35807]: pgmap v6059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:02 smithi076 ceph-mon[35401]: pgmap v6059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:04 smithi040 ceph-mon[32397]: pgmap v6060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:04 smithi146 ceph-mon[35807]: pgmap v6060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:04.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:04 smithi076 ceph-mon[35401]: pgmap v6060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:06 smithi040 ceph-mon[32397]: pgmap v6061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6713.153992 secs 2024-07-26T15:25:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:06 smithi146 ceph-mon[35807]: pgmap v6061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6713.153992 secs 2024-07-26T15:25:06.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:06 smithi076 ceph-mon[35401]: pgmap v6061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:06.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6713.153992 secs 2024-07-26T15:25:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:08 smithi040 ceph-mon[32397]: pgmap v6062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:08 smithi146 ceph-mon[35807]: pgmap v6062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:09.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:08 smithi076 ceph-mon[35401]: pgmap v6062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:10 smithi040 ceph-mon[32397]: pgmap v6063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:10 smithi146 ceph-mon[35807]: pgmap v6063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:10 smithi076 ceph-mon[35401]: pgmap v6063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6718.154131 secs 2024-07-26T15:25:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6718.154131 secs 2024-07-26T15:25:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6718.154131 secs 2024-07-26T15:25:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:12 smithi040 ceph-mon[32397]: pgmap v6064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:12 smithi146 ceph-mon[35807]: pgmap v6064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:12 smithi076 ceph-mon[35401]: pgmap v6064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:14 smithi040 ceph-mon[32397]: pgmap v6065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:14 smithi146 ceph-mon[35807]: pgmap v6065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:15.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:14 smithi076 ceph-mon[35401]: pgmap v6065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:15.721 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-07-26T15:25:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:16 smithi040 ceph-mon[32397]: pgmap v6066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6723.154220 secs 2024-07-26T15:25:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:16 smithi146 ceph-mon[35807]: pgmap v6066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6723.154220 secs 2024-07-26T15:25:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:16 smithi076 ceph-mon[35401]: pgmap v6066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6723.154220 secs 2024-07-26T15:25:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:18 smithi040 ceph-mon[32397]: pgmap v6067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:18 smithi146 ceph-mon[35807]: pgmap v6067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:18 smithi076 ceph-mon[35401]: pgmap v6067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:20 smithi040 ceph-mon[32397]: pgmap v6068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:20 smithi146 ceph-mon[35807]: pgmap v6068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:20 smithi076 ceph-mon[35401]: pgmap v6068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6728.154383 secs 2024-07-26T15:25:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6728.154383 secs 2024-07-26T15:25:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6728.154383 secs 2024-07-26T15:25:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:22 smithi040 ceph-mon[32397]: pgmap v6069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:22 smithi146 ceph-mon[35807]: pgmap v6069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:22 smithi076 ceph-mon[35401]: pgmap v6069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:24 smithi146 ceph-mon[35807]: pgmap v6070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:25.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:24 smithi076 ceph-mon[35401]: pgmap v6070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:24 smithi040 ceph-mon[32397]: pgmap v6070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:26 smithi146 ceph-mon[35807]: pgmap v6071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6733.154515 secs 2024-07-26T15:25:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:26 smithi076 ceph-mon[35401]: pgmap v6071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6733.154515 secs 2024-07-26T15:25:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:26 smithi040 ceph-mon[32397]: pgmap v6071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6733.154515 secs 2024-07-26T15:25:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:28 smithi146 ceph-mon[35807]: pgmap v6072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:28 smithi076 ceph-mon[35401]: pgmap v6072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:28 smithi040 ceph-mon[32397]: pgmap v6072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:31.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:30 smithi040 ceph-mon[32397]: pgmap v6073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:30 smithi146 ceph-mon[35807]: pgmap v6073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:31.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:30 smithi076 ceph-mon[35401]: pgmap v6073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6738.154661 secs 2024-07-26T15:25:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6738.154661 secs 2024-07-26T15:25:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6738.154661 secs 2024-07-26T15:25:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:32 smithi146 ceph-mon[35807]: pgmap v6074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:32 smithi076 ceph-mon[35401]: pgmap v6074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:32 smithi040 ceph-mon[32397]: pgmap v6074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:34 smithi146 ceph-mon[35807]: pgmap v6075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:35.226 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:34 smithi076 ceph-mon[35401]: pgmap v6075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:35.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:34 smithi040 ceph-mon[32397]: pgmap v6075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:36 smithi146 ceph-mon[35807]: pgmap v6076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6743.154804 secs 2024-07-26T15:25:37.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:36 smithi076 ceph-mon[35401]: pgmap v6076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6743.154804 secs 2024-07-26T15:25:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:36 smithi040 ceph-mon[32397]: pgmap v6076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6743.154804 secs 2024-07-26T15:25:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:38 smithi146 ceph-mon[35807]: pgmap v6077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:38 smithi076 ceph-mon[35401]: pgmap v6077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:38 smithi040 ceph-mon[32397]: pgmap v6077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:40 smithi146 ceph-mon[35807]: pgmap v6078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:41.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:40 smithi076 ceph-mon[35401]: pgmap v6078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:40 smithi040 ceph-mon[32397]: pgmap v6078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6748.154945 secs 2024-07-26T15:25:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6748.154945 secs 2024-07-26T15:25:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6748.154945 secs 2024-07-26T15:25:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:42 smithi076 ceph-mon[35401]: pgmap v6079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:42 smithi040 ceph-mon[32397]: pgmap v6079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:42 smithi146 ceph-mon[35807]: pgmap v6079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:44 smithi076 ceph-mon[35401]: pgmap v6080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:44 smithi040 ceph-mon[32397]: pgmap v6080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:44 smithi146 ceph-mon[35807]: pgmap v6080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:46 smithi040 ceph-mon[32397]: pgmap v6081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6753.155083 secs 2024-07-26T15:25:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:46 smithi146 ceph-mon[35807]: pgmap v6081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6753.155083 secs 2024-07-26T15:25:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:46 smithi076 ceph-mon[35401]: pgmap v6081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6753.155083 secs 2024-07-26T15:25:49.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:48 smithi146 ceph-mon[35807]: pgmap v6082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:49.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:48 smithi076 ceph-mon[35401]: pgmap v6082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:49.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:48 smithi040 ceph-mon[32397]: pgmap v6082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:50 smithi040 ceph-mon[32397]: pgmap v6083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:50 smithi146 ceph-mon[35807]: pgmap v6083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:51.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:50 smithi076 ceph-mon[35401]: pgmap v6083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6758.155245 secs 2024-07-26T15:25:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6758.155245 secs 2024-07-26T15:25:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6758.155245 secs 2024-07-26T15:25:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:52 smithi040 ceph-mon[32397]: pgmap v6084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:52 smithi146 ceph-mon[35807]: pgmap v6084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:52 smithi076 ceph-mon[35401]: pgmap v6084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:54 smithi040 ceph-mon[32397]: pgmap v6085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:54 smithi146 ceph-mon[35807]: pgmap v6085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:54 smithi076 ceph-mon[35401]: pgmap v6085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:25:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:56 smithi040 ceph-mon[32397]: pgmap v6086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6763.155387 secs 2024-07-26T15:25:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:56 smithi146 ceph-mon[35807]: pgmap v6086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6763.155387 secs 2024-07-26T15:25:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:56 smithi076 ceph-mon[35401]: pgmap v6086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:25:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6763.155387 secs 2024-07-26T15:25:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:25:58 smithi040 ceph-mon[32397]: pgmap v6087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:25:58 smithi146 ceph-mon[35807]: pgmap v6087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:25:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:25:58 smithi076 ceph-mon[35401]: pgmap v6087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:00 smithi040 ceph-mon[32397]: pgmap v6088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:00 smithi146 ceph-mon[35807]: pgmap v6088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:00 smithi076 ceph-mon[35401]: pgmap v6088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6768.155534 secs 2024-07-26T15:26:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6768.155534 secs 2024-07-26T15:26:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6768.155534 secs 2024-07-26T15:26:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:02 smithi040 ceph-mon[32397]: pgmap v6089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:03.404 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:02 smithi076 ceph-mon[35401]: pgmap v6089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:03.405 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:02 smithi146 ceph-mon[35807]: pgmap v6089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:04 smithi040 ceph-mon[32397]: pgmap v6090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:04 smithi146 ceph-mon[35807]: pgmap v6090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:05.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:04 smithi076 ceph-mon[35401]: pgmap v6090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:06 smithi040 ceph-mon[32397]: pgmap v6091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6773.155692 secs 2024-07-26T15:26:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:06 smithi146 ceph-mon[35807]: pgmap v6091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6773.155692 secs 2024-07-26T15:26:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:06 smithi076 ceph-mon[35401]: pgmap v6091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6773.155692 secs 2024-07-26T15:26:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:08 smithi040 ceph-mon[32397]: pgmap v6092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:08 smithi146 ceph-mon[35807]: pgmap v6092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:08 smithi076 ceph-mon[35401]: pgmap v6092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:10 smithi040 ceph-mon[32397]: pgmap v6093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:10 smithi146 ceph-mon[35807]: pgmap v6093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:10 smithi076 ceph-mon[35401]: pgmap v6093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6778.155857 secs 2024-07-26T15:26:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6778.155857 secs 2024-07-26T15:26:12.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6778.155857 secs 2024-07-26T15:26:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:12 smithi040 ceph-mon[32397]: pgmap v6094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:12 smithi146 ceph-mon[35807]: pgmap v6094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:12 smithi076 ceph-mon[35401]: pgmap v6094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:14 smithi040 ceph-mon[32397]: pgmap v6095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:14 smithi146 ceph-mon[35807]: pgmap v6095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:15.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:14 smithi076 ceph-mon[35401]: pgmap v6095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:15.722 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-07-26T15:26:15.722 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-07-26T15:26:15.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-07-26T15:26:16.752 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/ffsb.sh) on smithi040 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-07-26T15:26:17.081 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=968e88dc79414fd9b907d529317d4057 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/ffsb.sh) on smithi040 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2024-07-26T15:26:17.083 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-07-26T15:26:17.096 INFO:tasks.quiescer:joining Quiescers 2024-07-26T15:26:17.096 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-07-26T15:26:17.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph fs dump --format=json 2024-07-26T15:26:17.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:16 smithi040 ceph-mon[32397]: pgmap v6096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:17.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6783.155992 secs 2024-07-26T15:26:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:16 smithi146 ceph-mon[35807]: pgmap v6096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6783.155992 secs 2024-07-26T15:26:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:16 smithi076 ceph-mon[35401]: pgmap v6096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6783.155992 secs 2024-07-26T15:26:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T15:26:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:18 smithi040 ceph-mon[32397]: pgmap v6097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:18 smithi146 ceph-mon[35807]: pgmap v6097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:19.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:18 smithi076 ceph-mon[35401]: pgmap v6097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:19.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 -- 172.21.15.40:0/3219052611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c1055d0 msgr2=0x7f701c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:19.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 --2- 172.21.15.40:0/3219052611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c1055d0 0x7f701c1059e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f700c009900 tx=0x7f700c02a410 comp rx=0 tx=0).stop 2024-07-26T15:26:19.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 -- 172.21.15.40:0/3219052611 shutdown_connections 2024-07-26T15:26:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 --2- 172.21.15.40:0/3219052611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f701c10b860 0x7f701c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 --2- 172.21.15.40:0/3219052611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 0x7f701c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 --2- 172.21.15.40:0/3219052611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c1055d0 0x7f701c1059e0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 -- 172.21.15.40:0/3219052611 >> 172.21.15.40:0/3219052611 conn(0x7f701c101040 msgr2=0x7f701c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:26:19.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 -- 172.21.15.40:0/3219052611 shutdown_connections 2024-07-26T15:26:19.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.810+0000 7f701b200640 1 -- 172.21.15.40:0/3219052611 wait complete. 2024-07-26T15:26:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.811+0000 7f701b200640 1 Processor -- start 2024-07-26T15:26:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.811+0000 7f701b200640 1 -- start start 2024-07-26T15:26:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f701c1055d0 0x7f701c19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 0x7f701c19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 0x7f701c1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f701c115410 con 0x7f701c10b860 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f701c115290 con 0x7f701c10af10 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f701c115590 con 0x7f701c1055d0 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 0x7f701c1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 0x7f701c1a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39346/0 (socket says 172.21.15.40:39346) 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.812+0000 7f701a800640 1 -- 172.21.15.40:0/104364499 learned_addr learned my addr 172.21.15.40:0/104364499 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f7011400640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 0x7f701c19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f7019e00640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f701c1055d0 0x7f701c19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f701a800640 1 -- 172.21.15.40:0/104364499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f701c1055d0 msgr2=0x7f701c19be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f701a800640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f701c1055d0 0x7f701c19be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f701a800640 1 -- 172.21.15.40:0/104364499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 msgr2=0x7f701c19c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f701a800640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 0x7f701c19c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f701a800640 1 -- 172.21.15.40:0/104364499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701c1a1df0 con 0x7f701c10b860 2024-07-26T15:26:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f7011400640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 0x7f701c19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:26:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.813+0000 7f701a800640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 0x7f701c1a16c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f701400eaa0 tx=0x7f701400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.814+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701400cdb0 con 0x7f701c10b860 2024-07-26T15:26:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.814+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7014005020 con 0x7f701c10b860 2024-07-26T15:26:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.814+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140116d0 con 0x7f701c10b860 2024-07-26T15:26:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.814+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701c1a20e0 con 0x7f701c10b860 2024-07-26T15:26:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.814+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701c1a8840 con 0x7f701c10b860 2024-07-26T15:26:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.815+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701c1059e0 con 0x7f701c10b860 2024-07-26T15:26:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.818+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f70140051d0 con 0x7f701c10b860 2024-07-26T15:26:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.819+0000 7f7013400640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70000b3c50 0x7f70000b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.819+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7f70140e51d0 con 0x7f701c10b860 2024-07-26T15:26:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.819+0000 7f7019e00640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70000b3c50 0x7f70000b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:19.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.820+0000 7f7019e00640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70000b3c50 0x7f70000b6160 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f700c006010 tx=0x7f700c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:19.821+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f7014016030 con 0x7f701c10b860 2024-07-26T15:26:20.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.065+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f701c19cfb0 con 0x7f701c10b860 2024-07-26T15:26:20.067 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:20 smithi040 ceph-mon[32397]: pgmap v6098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:20.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.066+0000 7f7013400640 1 -- 172.21.15.40:0/104364499 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 181 v181) ==== 95+0+7089 (secure 0 0 0) 0x7f701c19cfb0 con 0x7f701c10b860 2024-07-26T15:26:20.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T15:26:20.068 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":181,"btime":"2024-07-26T13:36:55:593205+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":181,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-07-26T12:18:32.339754+0000","modified":"2024-07-26T13:36:55.133390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":14661,"mds_1":34592,"mds_2":14655,"mds_3":18480,"mds_4":18474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14655":{"gid":14655,"name":"j","rank":2,"incarnation":180,"state":"up:resolve","state_seq":1191,"addr":"172.21.15.40:6835/1198126944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1198126944},{"type":"v1","addr":"172.21.15.40:6835","nonce":1198126944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14661":{"gid":14661,"name":"d","rank":0,"incarnation":180,"state":"up:resolve","state_seq":1190,"addr":"172.21.15.40:6837/3554375029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3554375029},{"type":"v1","addr":"172.21.15.40:6837","nonce":3554375029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_18474":{"gid":18474,"name":"g","rank":4,"incarnation":174,"state":"up:active","state_seq":10,"addr":"172.21.15.40:6839/2617300752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":2617300752},{"type":"v1","addr":"172.21.15.40:6839","nonce":2617300752}]},"join_fscid":-1,"laggy_since":"2024-07-26T13:36:54.588121+0000","export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_18480":{"gid":18480,"name":"a","rank":3,"incarnation":174,"state":"up:active","state_seq":10,"addr":"172.21.15.40:6841/1735855275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":1735855275},{"type":"v1","addr":"172.21.15.40:6841","nonce":1735855275}]},"join_fscid":-1,"laggy_since":"2024-07-26T13:36:54.588133+0000","export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24547":{"gid":24547,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/1448706156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1448706156},{"type":"v1","addr":"172.21.15.146:6833","nonce":1448706156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34592":{"gid":34592,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":1177,"addr":"172.21.15.76:6837/3327676602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3327676602},{"type":"v1","addr":"172.21.15.76:6837","nonce":3327676602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34592,"qdb_cluster":[34592,18480,18474]},"id":1}]} 2024-07-26T15:26:20.069 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 181 2024-07-26T15:26:20.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70000b3c50 msgr2=0x7f70000b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:20.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70000b3c50 0x7f70000b6160 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f700c006010 tx=0x7f700c000bc0 comp rx=0 tx=0).stop 2024-07-26T15:26:20.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 msgr2=0x7f701c1a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:20.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 0x7f701c1a16c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f701400eaa0 tx=0x7f701400ef60 comp rx=0 tx=0).stop 2024-07-26T15:26:20.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 shutdown_connections 2024-07-26T15:26:20.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701c10b860 0x7f701c1a16c0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:20.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f701c10af10 0x7f701c19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:20.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f70000b3c50 0x7f70000b6160 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:20.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 --2- 172.21.15.40:0/104364499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f701c1055d0 0x7f701c19be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:20.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.069+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 >> 172.21.15.40:0/104364499 conn(0x7f701c101040 msgr2=0x7f701c103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:26:20.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.070+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 shutdown_connections 2024-07-26T15:26:20.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:20.070+0000 7f701b200640 1 -- 172.21.15.40:0/104364499 wait complete. 2024-07-26T15:26:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:20 smithi146 ceph-mon[35807]: pgmap v6098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:20 smithi076 ceph-mon[35401]: pgmap v6098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:20.777 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34592 quiesce db --cancel --all' 2024-07-26T15:26:20.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- timeout 105 ceph tell mds.34592 quiesce db --cancel --all 2024-07-26T15:26:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T15:26:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:21 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/104364499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T15:26:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:21 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/104364499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T15:26:21.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:21 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/104364499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-07-26T15:26:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6788.156141 secs 2024-07-26T15:26:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:22 smithi146 ceph-mon[35807]: pgmap v6099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6788.156141 secs 2024-07-26T15:26:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:22 smithi076 ceph-mon[35401]: pgmap v6099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:22.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6788.156141 secs 2024-07-26T15:26:22.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:22 smithi040 ceph-mon[32397]: pgmap v6099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:23.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.357+0000 7f4db9400640 1 -- 172.21.15.40:0/2037635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 msgr2=0x7f4db4109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.357+0000 7f4db9400640 1 --2- 172.21.15.40:0/2037635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 0x7f4db4109e00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009900 tx=0x7f4da402a3f0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 -- 172.21.15.40:0/2037635878 shutdown_connections 2024-07-26T15:26:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 --2- 172.21.15.40:0/2037635878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db410fc80 0x7f4db41164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 --2- 172.21.15.40:0/2037635878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4db410f330 0x7f4db410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 --2- 172.21.15.40:0/2037635878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 0x7f4db4109e00 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 -- 172.21.15.40:0/2037635878 >> 172.21.15.40:0/2037635878 conn(0x7f4db4078ff0 msgr2=0x7f4db4107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:26:23.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 -- 172.21.15.40:0/2037635878 shutdown_connections 2024-07-26T15:26:23.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.358+0000 7f4db9400640 1 -- 172.21.15.40:0/2037635878 wait complete. 2024-07-26T15:26:23.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.359+0000 7f4db9400640 1 Processor -- start 2024-07-26T15:26:23.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 -- start start 2024-07-26T15:26:23.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 0x7f4db41a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db410f330 0x7f4db41a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4db410fc80 0x7f4db41a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4119840 con 0x7f4db41099f0 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41196c0 con 0x7f4db410fc80 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.360+0000 7f4db9400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41199c0 con 0x7f4db410f330 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 0x7f4db41a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 0x7f4db41a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41164/0 (socket says 172.21.15.40:41164) 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 -- 172.21.15.40:0/3293971292 learned_addr learned my addr 172.21.15.40:0/3293971292 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3400640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db410f330 0x7f4db41a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db8a00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4db410fc80 0x7f4db41a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 -- 172.21.15.40:0/3293971292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db410f330 msgr2=0x7f4db41a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db410f330 0x7f4db41a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 -- 172.21.15.40:0/3293971292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4db410fc80 msgr2=0x7f4db41a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4db410fc80 0x7f4db41a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3e00640 1 -- 172.21.15.40:0/3293971292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db41a6140 con 0x7f4db41099f0 2024-07-26T15:26:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.361+0000 7f4db3400640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db410f330 0x7f4db41a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:26:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.362+0000 7f4db3e00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db41099f0 0x7f4db41a0290 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f4da402a910 tx=0x7f4da4003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.362+0000 7f4db0c00640 1 -- 172.21.15.40:0/3293971292 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da403f070 con 0x7f4db41099f0 2024-07-26T15:26:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.362+0000 7f4db9400640 1 -- 172.21.15.40:0/3293971292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db41a63d0 con 0x7f4db41099f0 2024-07-26T15:26:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.362+0000 7f4db0c00640 1 -- 172.21.15.40:0/3293971292 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4da403bdc0 con 0x7f4db41099f0 2024-07-26T15:26:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.362+0000 7f4db0c00640 1 -- 172.21.15.40:0/3293971292 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4035030 con 0x7f4db41099f0 2024-07-26T15:26:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.362+0000 7f4db9400640 1 -- 172.21.15.40:0/3293971292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db41a6900 con 0x7f4db41099f0 2024-07-26T15:26:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.366+0000 7f4dc17be740 1 Processor -- start 2024-07-26T15:26:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.366+0000 7f4dc17be740 1 -- start start 2024-07-26T15:26:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.366+0000 7f4db0c00640 1 -- 172.21.15.40:0/3293971292 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4da4042070 con 0x7f4db41099f0 2024-07-26T15:26:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183a73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4dc17be740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55661831cb30 con 0x556617fe05f0 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4dc17be740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55661830c030 con 0x556617fd8410 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4dc17be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556618310070 con 0x5566180012d0 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4db3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183a73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4db3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183a73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41172/0 (socket says 172.21.15.40:41172) 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4db3400640 1 -- 172.21.15.40:0/4260082299 learned_addr learned my addr 172.21.15.40:0/4260082299 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4db8a00640 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.367+0000 7f4db3e00640 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db3400640 1 -- 172.21.15.40:0/4260082299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 msgr2=0x5566183a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db3400640 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db3400640 1 -- 172.21.15.40:0/4260082299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 msgr2=0x5566183a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db3400640 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183a6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db3400640 1 -- 172.21.15.40:0/4260082299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661806c8b0 con 0x556617fe05f0 2024-07-26T15:26:23.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db3400640 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183a73a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4da000cc00 tx=0x7f4da000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3198159028ffa1cb server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.368+0000 7f4db0c00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d980b3c80 0x7f4d980b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.369+0000 7f4da9200640 1 -- 172.21.15.40:0/4260082299 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0005220 con 0x556617fe05f0 2024-07-26T15:26:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.369+0000 7f4db0c00640 1 -- 172.21.15.40:0/3293971292 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7f4da4105600 con 0x7f4db41099f0 2024-07-26T15:26:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.369+0000 7f4db8a00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d980b3c80 0x7f4d980b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.369+0000 7f4da9200640 1 -- 172.21.15.40:0/4260082299 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4da0004c30 con 0x556617fe05f0 2024-07-26T15:26:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.369+0000 7f4da9200640 1 -- 172.21.15.40:0/4260082299 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0010690 con 0x556617fe05f0 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 -- 172.21.15.40:0/4260082299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 msgr2=0x5566183a73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183a73a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4da000cc00 tx=0x7f4da000e720 comp rx=0 tx=0).stop 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4db8a00640 1 --2- 172.21.15.40:0/3293971292 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f4d980b3c80 0x7f4d980b6190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4dac007ed0 tx=0x7f4dac007680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 -- 172.21.15.40:0/4260082299 shutdown_connections 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183a73a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 --2- 172.21.15.40:0/4260082299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 -- 172.21.15.40:0/4260082299 >> 172.21.15.40:0/4260082299 conn(0x556617ff56c0 msgr2=0x5566183a4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:26:23.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 -- 172.21.15.40:0/4260082299 shutdown_connections 2024-07-26T15:26:23.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.370+0000 7f4dc17be740 1 -- 172.21.15.40:0/4260082299 wait complete. 2024-07-26T15:26:23.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.371+0000 7f4dc17be740 1 -- start start 2024-07-26T15:26:23.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.371+0000 7f4dc17be740 1 Processor -- start 2024-07-26T15:26:23.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55661816f810 con 0x556617fe05f0 2024-07-26T15:26:23.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5566182a85f0 con 0x556617fd8410 2024-07-26T15:26:23.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5566183b5100 con 0x5566180012d0 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4dc17be740 10 client.0 _ll_register_callbacks cb 0x556618018b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4db3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4db3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41176/0 (socket says 172.21.15.40:41176) 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.372+0000 7f4db3400640 1 -- 172.21.15.40:0/3820745020 learned_addr learned my addr 172.21.15.40:0/3820745020 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3e00640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db8a00640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3400640 1 -- 172.21.15.40:0/3820745020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 msgr2=0x5566183be3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3400640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183be3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3400640 1 -- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 msgr2=0x5566183b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3400640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3400640 1 -- 172.21.15.40:0/3820745020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566183bea30 con 0x556617fe05f0 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4db3400640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183b2af0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4da0000c00 tx=0x7f4da000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9703fdfeb24d1be server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.373+0000 7f4d9d600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.374+0000 7f4d9d600640 1 -- 172.21.15.40:0/3820745020 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da002a060 con 0x556617fe05f0 2024-07-26T15:26:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.374+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da0004c30 con 0x556617fe05f0 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.374+0000 7f4d9d600640 1 -- 172.21.15.40:0/3820745020 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7f4da0004ff0 con 0x556617fe05f0 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.374+0000 7f4d9d600640 1 -- 172.21.15.40:0/3820745020 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=181) ==== 24+0+0 (secure 0 0 0) 0x7f4da00051f0 con 0x556617fe05f0 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.374+0000 7f4dc17be740 10 client.18498 fetch_fsmap learned FSMap version 181 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.374+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=181,monmap=4+}) -- 0x5566183c1360 con 0x556617fe05f0 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4d9d600640 1 -- 172.21.15.40:0/3820745020 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4da0004c30 con 0x556617fe05f0 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4d9d600640 1 -- 172.21.15.40:0/3820745020 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 181) ==== 4764+0+0 (secure 0 0 0) 0x7f4da0026710 con 0x556617fe05f0 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4dc17be740 10 client.18498 fetch_fsmap finished waiting for FSMap version 181 2024-07-26T15:26:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4dc17be740 10 client.18498 resolve_mds: validated gid 34592 aka daemon mds.h 2024-07-26T15:26:23.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4dc17be740 20 client.18498 populate_metadata read hostname 'smithi040' 2024-07-26T15:26:23.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4dc17be740 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617fbfc50 0x5566183c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4dc17be740 4 client.18498 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-26T15:26:23.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.375+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55661831ea80 con 0x556617fbfc50 2024-07-26T15:26:23.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.376+0000 7f4db3e00640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617fbfc50 0x5566183c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.377+0000 7f4db3e00640 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617fbfc50 0x5566183c4bb0 crc :-1 s=READY pgs=1204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d4fa5115a7e5d56 server_cookie=c473c5e407be39e8 in_seq=0 out_seq=0 2024-07-26T15:26:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.377+0000 7f4d9d600640 10 client.18498 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4d9d600640 1 -- 172.21.15.40:0/3820745020 <== mds.1 v2:172.21.15.76:6836/3327676602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55661831ea80 con 0x556617fbfc50 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4d9d600640 10 client.18498 handle_command_reply: tid=0 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 client.18498 shutdown 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 msgr2=0x5566183b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183b2af0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4da0000c00 tx=0x7f4da000c940 comp rx=0 tx=0).stop 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 shutdown_connections 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617fbfc50 0x5566183c4bb0 crc :-1 s=READY pgs=1204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183be3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fe05f0 0x5566183b2af0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 --2- 172.21.15.40:0/3820745020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fd8410 0x5566183b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4d9d600640 0 client.18498 ms_handle_reset on v2:172.21.15.76:6836/3327676602 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.379+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 >> 172.21.15.40:0/3820745020 conn(0x556617ff56c0 msgr2=0x5566183a9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.380+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 shutdown_connections 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.380+0000 7f4dc17be740 1 -- 172.21.15.40:0/3820745020 wait complete. 2024-07-26T15:26:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.380+0000 7f4dc17be740 20 client.18498 trim_cache size 0 max 16384 2024-07-26T15:26:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.399+0000 7f4dc17be740 1 Processor -- start 2024-07-26T15:26:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.399+0000 7f4dc17be740 1 -- start start 2024-07-26T15:26:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556617fd8410 0x5566183be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 0x5566183abf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4dc17be740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41b8050 con 0x5566180012d0 2024-07-26T15:26:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4dc17be740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41b5e40 con 0x556617fe05f0 2024-07-26T15:26:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4dc17be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41b7980 con 0x556617fd8410 2024-07-26T15:26:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4db8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 0x5566183abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4db8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 0x5566183abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41184/0 (socket says 172.21.15.40:41184) 2024-07-26T15:26:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.400+0000 7f4db8a00640 1 -- 172.21.15.40:0/1278510211 learned_addr learned my addr 172.21.15.40:0/1278510211 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:26:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db3400640 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db3e00640 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556617fd8410 0x5566183be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db8a00640 1 -- 172.21.15.40:0/1278510211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556617fd8410 msgr2=0x5566183be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db8a00640 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556617fd8410 0x5566183be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db8a00640 1 -- 172.21.15.40:0/1278510211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 msgr2=0x5566183aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db8a00640 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db8a00640 1 -- 172.21.15.40:0/1278510211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566183adb70 con 0x5566180012d0 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db3400640 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:26:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.401+0000 7f4db8a00640 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 0x5566183abf70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4dac01e5e0 tx=0x7f4dac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec93e44410c3041 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.402+0000 7f4d9fe00640 1 -- 172.21.15.40:0/1278510211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac02b070 con 0x5566180012d0 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.402+0000 7f4d9fe00640 1 -- 172.21.15.40:0/1278510211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dac01ccd0 con 0x5566180012d0 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.402+0000 7f4d9fe00640 1 -- 172.21.15.40:0/1278510211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac026d40 con 0x5566180012d0 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 -- 172.21.15.40:0/1278510211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 msgr2=0x5566183abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 0x5566183abf70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4dac01e5e0 tx=0x7f4dac014000 comp rx=0 tx=0).stop 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 -- 172.21.15.40:0/1278510211 shutdown_connections 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566180012d0 0x5566183abf70 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 --2- 172.21.15.40:0/1278510211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556617fd8410 0x5566183be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 -- 172.21.15.40:0/1278510211 >> 172.21.15.40:0/1278510211 conn(0x556617ff56c0 msgr2=0x5566183b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:26:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 -- 172.21.15.40:0/1278510211 shutdown_connections 2024-07-26T15:26:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.403+0000 7f4dc17be740 1 -- 172.21.15.40:0/1278510211 wait complete. 2024-07-26T15:26:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.404+0000 7f4dc17be740 1 -- start start 2024-07-26T15:26:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.404+0000 7f4dc17be740 1 Processor -- start 2024-07-26T15:26:23.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fd8410 0x5566183bac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41b6be0 con 0x556617fd8410 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41b6510 con 0x556617fe05f0 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41b72b0 con 0x5566180012d0 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4dc17be740 10 client.0 _ll_register_callbacks cb 0x7f4da0014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4db3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fd8410 0x5566183bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4db3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fd8410 0x5566183bac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41186/0 (socket says 172.21.15.40:41186) 2024-07-26T15:26:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4db3e00640 1 -- 172.21.15.40:0/2339523934 learned_addr learned my addr 172.21.15.40:0/2339523934 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4db3400640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.405+0000 7f4db8a00640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3e00640 1 -- 172.21.15.40:0/2339523934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 msgr2=0x5566183b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3e00640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5566180012d0 0x5566183b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3e00640 1 -- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 msgr2=0x5566183b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3e00640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3e00640 1 -- 172.21.15.40:0/2339523934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661842c380 con 0x556617fd8410 2024-07-26T15:26:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3400640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556617fe05f0 0x5566183b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4db3e00640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556617fd8410 0x5566183bac30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f4da40314b0 tx=0x7f4da402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272590bd09ed3916 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4d9d600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4d9d600640 1 -- 172.21.15.40:0/2339523934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4049040 con 0x556617fd8410 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4d9d600640 1 -- 172.21.15.40:0/2339523934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7f4da4108d10 con 0x556617fd8410 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.406+0000 7f4dc17be740 1 -- 172.21.15.40:0/2339523934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dac01ccd0 con 0x556617fd8410 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4d9d600640 1 -- 172.21.15.40:0/2339523934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=181) ==== 24+0+0 (secure 0 0 0) 0x7f4da40cb570 con 0x556617fd8410 2024-07-26T15:26:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 10 client.18504 fetch_fsmap learned FSMap version 181 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 1 -- 172.21.15.40:0/2339523934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=181,monmap=4+}) -- 0x55661842d4f0 con 0x556617fd8410 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4d9d600640 1 -- 172.21.15.40:0/2339523934 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dac01ccd0 con 0x556617fd8410 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4d9d600640 1 -- 172.21.15.40:0/2339523934 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 181) ==== 4764+0+0 (secure 0 0 0) 0x7f4da4105170 con 0x556617fd8410 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 10 client.18504 fetch_fsmap finished waiting for FSMap version 181 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 10 client.18504 resolve_mds: validated gid 34592 aka daemon mds.h 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 20 client.18504 populate_metadata read hostname 'smithi040' 2024-07-26T15:26:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617f95000 0x55661842fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:26:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 4 client.18504 mds_command: new command op to 34592 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-07-26T15:26:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.407+0000 7f4dc17be740 1 -- 172.21.15.40:0/2339523934 --> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55661831a520 con 0x556617f95000 2024-07-26T15:26:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.408+0000 7f4db3400640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617f95000 0x55661842fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:26:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.409+0000 7f4db3400640 1 --2- 172.21.15.40:0/2339523934 >> [v2:172.21.15.76:6836/3327676602,v1:172.21.15.76:6837/3327676602] conn(0x556617f95000 0x55661842fc30 crc :-1 s=READY pgs=1205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f716ab72064cb48a server_cookie=3d1b09bcffcd499c in_seq=0 out_seq=0 2024-07-26T15:26:23.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:26:23.409+0000 7f4d9d600640 10 client.18504 ms_handle_connect on v2:172.21.15.76:6836/3327676602 2024-07-26T15:26:24.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:24 smithi040 ceph-mon[32397]: pgmap v6100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:24 smithi146 ceph-mon[35807]: pgmap v6100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:24 smithi076 ceph-mon[35401]: pgmap v6100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:26 smithi040 ceph-mon[32397]: pgmap v6101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6793.156313 secs 2024-07-26T15:26:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:26 smithi146 ceph-mon[35807]: pgmap v6101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6793.156313 secs 2024-07-26T15:26:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:26 smithi076 ceph-mon[35401]: pgmap v6101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6793.156313 secs 2024-07-26T15:26:28.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:28 smithi040 ceph-mon[32397]: pgmap v6102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:28 smithi146 ceph-mon[35807]: pgmap v6102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:28.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:28 smithi076 ceph-mon[35401]: pgmap v6102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:30 smithi040 ceph-mon[32397]: pgmap v6103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:30 smithi146 ceph-mon[35807]: pgmap v6103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:30 smithi076 ceph-mon[35401]: pgmap v6103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6798.156452 secs 2024-07-26T15:26:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6798.156452 secs 2024-07-26T15:26:31.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6798.156452 secs 2024-07-26T15:26:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:32 smithi040 ceph-mon[32397]: pgmap v6104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:32 smithi146 ceph-mon[35807]: pgmap v6104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:32 smithi076 ceph-mon[35401]: pgmap v6104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:34 smithi040 ceph-mon[32397]: pgmap v6105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:34 smithi146 ceph-mon[35807]: pgmap v6105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:34.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:34 smithi076 ceph-mon[35401]: pgmap v6105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:36 smithi040 ceph-mon[32397]: pgmap v6106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6803.156597 secs 2024-07-26T15:26:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:36 smithi146 ceph-mon[35807]: pgmap v6106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6803.156597 secs 2024-07-26T15:26:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:36 smithi076 ceph-mon[35401]: pgmap v6106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6803.156597 secs 2024-07-26T15:26:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:38 smithi040 ceph-mon[32397]: pgmap v6107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:38.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:38 smithi146 ceph-mon[35807]: pgmap v6107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:38 smithi076 ceph-mon[35401]: pgmap v6107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:40.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:40 smithi040 ceph-mon[32397]: pgmap v6108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:40 smithi146 ceph-mon[35807]: pgmap v6108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:40.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:40 smithi076 ceph-mon[35401]: pgmap v6108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:41.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6808.156737 secs 2024-07-26T15:26:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6808.156737 secs 2024-07-26T15:26:41.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6808.156737 secs 2024-07-26T15:26:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:42 smithi040 ceph-mon[32397]: pgmap v6109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:42 smithi146 ceph-mon[35807]: pgmap v6109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:42 smithi076 ceph-mon[35401]: pgmap v6109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:44 smithi146 ceph-mon[35807]: pgmap v6110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:44 smithi076 ceph-mon[35401]: pgmap v6110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:44 smithi040 ceph-mon[32397]: pgmap v6110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:46 smithi146 ceph-mon[35807]: pgmap v6111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6813.156881 secs 2024-07-26T15:26:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:46 smithi076 ceph-mon[35401]: pgmap v6111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6813.156881 secs 2024-07-26T15:26:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:46 smithi040 ceph-mon[32397]: pgmap v6111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6813.156881 secs 2024-07-26T15:26:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:48 smithi146 ceph-mon[35807]: pgmap v6112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:48 smithi076 ceph-mon[35401]: pgmap v6112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:48 smithi040 ceph-mon[32397]: pgmap v6112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:50 smithi146 ceph-mon[35807]: pgmap v6113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:50 smithi076 ceph-mon[35401]: pgmap v6113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:50 smithi040 ceph-mon[32397]: pgmap v6113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6818.157022 secs 2024-07-26T15:26:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6818.157022 secs 2024-07-26T15:26:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6818.157022 secs 2024-07-26T15:26:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:52 smithi146 ceph-mon[35807]: pgmap v6114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:52 smithi076 ceph-mon[35401]: pgmap v6114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:52 smithi040 ceph-mon[32397]: pgmap v6114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:54 smithi146 ceph-mon[35807]: pgmap v6115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:54.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:54 smithi076 ceph-mon[35401]: pgmap v6115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:54 smithi040 ceph-mon[32397]: pgmap v6115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:26:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:56 smithi146 ceph-mon[35807]: pgmap v6116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6823.157181 secs 2024-07-26T15:26:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:56 smithi076 ceph-mon[35401]: pgmap v6116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6823.157181 secs 2024-07-26T15:26:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:56 smithi040 ceph-mon[32397]: pgmap v6116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:26:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6823.157181 secs 2024-07-26T15:26:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:26:58 smithi146 ceph-mon[35807]: pgmap v6117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:26:58 smithi076 ceph-mon[35401]: pgmap v6117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:26:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:26:58 smithi040 ceph-mon[32397]: pgmap v6117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:00 smithi146 ceph-mon[35807]: pgmap v6118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:00.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:00 smithi076 ceph-mon[35401]: pgmap v6118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:00 smithi040 ceph-mon[32397]: pgmap v6118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6828.157343 secs 2024-07-26T15:27:01.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6828.157343 secs 2024-07-26T15:27:01.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6828.157343 secs 2024-07-26T15:27:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:02 smithi146 ceph-mon[35807]: pgmap v6119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:02 smithi076 ceph-mon[35401]: pgmap v6119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:02.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:02 smithi040 ceph-mon[32397]: pgmap v6119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:04 smithi076 ceph-mon[35401]: pgmap v6120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:04 smithi040 ceph-mon[32397]: pgmap v6120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:04 smithi146 ceph-mon[35807]: pgmap v6120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:06 smithi076 ceph-mon[35401]: pgmap v6121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6833.157474 secs 2024-07-26T15:27:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:06 smithi040 ceph-mon[32397]: pgmap v6121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6833.157474 secs 2024-07-26T15:27:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:06 smithi146 ceph-mon[35807]: pgmap v6121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6833.157474 secs 2024-07-26T15:27:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:08 smithi040 ceph-mon[32397]: pgmap v6122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:08 smithi146 ceph-mon[35807]: pgmap v6122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:09.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:08 smithi076 ceph-mon[35401]: pgmap v6122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:10.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:10 smithi040 ceph-mon[32397]: pgmap v6123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:10 smithi146 ceph-mon[35807]: pgmap v6123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:11.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:10 smithi076 ceph-mon[35401]: pgmap v6123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6838.157608 secs 2024-07-26T15:27:12.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6838.157608 secs 2024-07-26T15:27:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6838.157608 secs 2024-07-26T15:27:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:12 smithi146 ceph-mon[35807]: pgmap v6124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:12 smithi076 ceph-mon[35401]: pgmap v6124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:12 smithi040 ceph-mon[32397]: pgmap v6124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:14.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:14 smithi040 ceph-mon[32397]: pgmap v6125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:14 smithi146 ceph-mon[35807]: pgmap v6125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:14 smithi076 ceph-mon[35401]: pgmap v6125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:16 smithi146 ceph-mon[35807]: pgmap v6126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6843.157749 secs 2024-07-26T15:27:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:16 smithi076 ceph-mon[35401]: pgmap v6126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6843.157749 secs 2024-07-26T15:27:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:16 smithi040 ceph-mon[32397]: pgmap v6126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6843.157749 secs 2024-07-26T15:27:19.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:18 smithi146 ceph-mon[35807]: pgmap v6127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:18 smithi076 ceph-mon[35401]: pgmap v6127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:19.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:18 smithi040 ceph-mon[32397]: pgmap v6127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:20 smithi146 ceph-mon[35807]: pgmap v6128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:20 smithi076 ceph-mon[35401]: pgmap v6128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:20 smithi040 ceph-mon[32397]: pgmap v6128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6848.157892 secs 2024-07-26T15:27:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6848.157892 secs 2024-07-26T15:27:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6848.157892 secs 2024-07-26T15:27:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:22 smithi146 ceph-mon[35807]: pgmap v6129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:22 smithi076 ceph-mon[35401]: pgmap v6129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:22 smithi040 ceph-mon[32397]: pgmap v6129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:24 smithi146 ceph-mon[35807]: pgmap v6130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:24 smithi076 ceph-mon[35401]: pgmap v6130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:24 smithi040 ceph-mon[32397]: pgmap v6130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:26 smithi146 ceph-mon[35807]: pgmap v6131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6853.157977 secs 2024-07-26T15:27:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:26 smithi076 ceph-mon[35401]: pgmap v6131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6853.157977 secs 2024-07-26T15:27:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:26 smithi040 ceph-mon[32397]: pgmap v6131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6853.157977 secs 2024-07-26T15:27:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:28 smithi146 ceph-mon[35807]: pgmap v6132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:28 smithi076 ceph-mon[35401]: pgmap v6132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:28 smithi040 ceph-mon[32397]: pgmap v6132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:30 smithi146 ceph-mon[35807]: pgmap v6133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:30 smithi076 ceph-mon[35401]: pgmap v6133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:31.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:30 smithi040 ceph-mon[32397]: pgmap v6133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6858.158127 secs 2024-07-26T15:27:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6858.158127 secs 2024-07-26T15:27:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6858.158127 secs 2024-07-26T15:27:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:32 smithi076 ceph-mon[35401]: pgmap v6134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:32 smithi040 ceph-mon[32397]: pgmap v6134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:32 smithi146 ceph-mon[35807]: pgmap v6134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:34 smithi040 ceph-mon[32397]: pgmap v6135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:34 smithi146 ceph-mon[35807]: pgmap v6135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:34 smithi076 ceph-mon[35401]: pgmap v6135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:36 smithi040 ceph-mon[32397]: pgmap v6136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6863.158289 secs 2024-07-26T15:27:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:36 smithi146 ceph-mon[35807]: pgmap v6136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6863.158289 secs 2024-07-26T15:27:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:36 smithi076 ceph-mon[35401]: pgmap v6136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6863.158289 secs 2024-07-26T15:27:39.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:38 smithi040 ceph-mon[32397]: pgmap v6137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:39.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:38 smithi146 ceph-mon[35807]: pgmap v6137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:38 smithi076 ceph-mon[35401]: pgmap v6137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:40 smithi040 ceph-mon[32397]: pgmap v6138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:40 smithi146 ceph-mon[35807]: pgmap v6138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:40 smithi076 ceph-mon[35401]: pgmap v6138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6868.158392 secs 2024-07-26T15:27:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6868.158392 secs 2024-07-26T15:27:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6868.158392 secs 2024-07-26T15:27:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:42 smithi040 ceph-mon[32397]: pgmap v6139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:42 smithi146 ceph-mon[35807]: pgmap v6139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:42 smithi076 ceph-mon[35401]: pgmap v6139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:44 smithi040 ceph-mon[32397]: pgmap v6140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:44 smithi146 ceph-mon[35807]: pgmap v6140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:44 smithi076 ceph-mon[35401]: pgmap v6140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:46 smithi040 ceph-mon[32397]: pgmap v6141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6873.158531 secs 2024-07-26T15:27:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:46 smithi146 ceph-mon[35807]: pgmap v6141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6873.158531 secs 2024-07-26T15:27:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:46 smithi076 ceph-mon[35401]: pgmap v6141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6873.158531 secs 2024-07-26T15:27:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:48 smithi040 ceph-mon[32397]: pgmap v6142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:48 smithi146 ceph-mon[35807]: pgmap v6142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:48 smithi076 ceph-mon[35401]: pgmap v6142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:50 smithi040 ceph-mon[32397]: pgmap v6143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:50 smithi146 ceph-mon[35807]: pgmap v6143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:50 smithi076 ceph-mon[35401]: pgmap v6143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6878.158706 secs 2024-07-26T15:27:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6878.158706 secs 2024-07-26T15:27:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6878.158706 secs 2024-07-26T15:27:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:52 smithi040 ceph-mon[32397]: pgmap v6144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:52 smithi146 ceph-mon[35807]: pgmap v6144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:52 smithi076 ceph-mon[35401]: pgmap v6144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:54 smithi040 ceph-mon[32397]: pgmap v6145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:54 smithi146 ceph-mon[35807]: pgmap v6145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:55.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:54 smithi076 ceph-mon[35401]: pgmap v6145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:27:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:56 smithi040 ceph-mon[32397]: pgmap v6146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6883.158840 secs 2024-07-26T15:27:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:56 smithi146 ceph-mon[35807]: pgmap v6146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6883.158840 secs 2024-07-26T15:27:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:56 smithi076 ceph-mon[35401]: pgmap v6146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:27:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6883.158840 secs 2024-07-26T15:27:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:27:58 smithi040 ceph-mon[32397]: pgmap v6147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:27:58 smithi146 ceph-mon[35807]: pgmap v6147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:27:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:27:58 smithi076 ceph-mon[35401]: pgmap v6147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:00 smithi040 ceph-mon[32397]: pgmap v6148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:00 smithi146 ceph-mon[35807]: pgmap v6148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:00 smithi076 ceph-mon[35401]: pgmap v6148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6888.158974 secs 2024-07-26T15:28:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6888.158974 secs 2024-07-26T15:28:02.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6888.158974 secs 2024-07-26T15:28:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:02 smithi040 ceph-mon[32397]: pgmap v6149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:02 smithi146 ceph-mon[35807]: pgmap v6149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:02 smithi076 ceph-mon[35401]: pgmap v6149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:04 smithi040 ceph-mon[32397]: pgmap v6150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:04 smithi146 ceph-mon[35807]: pgmap v6150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:04 smithi076 ceph-mon[35401]: pgmap v6150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:06 smithi040 ceph-mon[32397]: pgmap v6151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6893.159053 secs 2024-07-26T15:28:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:06 smithi146 ceph-mon[35807]: pgmap v6151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6893.159053 secs 2024-07-26T15:28:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:06 smithi076 ceph-mon[35401]: pgmap v6151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6893.159053 secs 2024-07-26T15:28:09.019 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-07-26T15:28:09.020 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/quiescer.py", line 422, in task stop_all_quiescers(ctx.ceph[cluster_name].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/quiescer.py", line 381, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-07-26T15:28:09.026 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-07-26T15:28:09.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-26T15:28:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:08 smithi040 ceph-mon[32397]: pgmap v6152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:08 smithi146 ceph-mon[35807]: pgmap v6152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:08 smithi076 ceph-mon[35401]: pgmap v6152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.470+0000 7fe0e3600640 1 -- 172.21.15.40:0/1896185815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 msgr2=0x7fe0dc078ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:09.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.470+0000 7fe0e3600640 1 --2- 172.21.15.40:0/1896185815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc078ae0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009900 tx=0x7fe0c402a410 comp rx=0 tx=0).stop 2024-07-26T15:28:09.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 -- 172.21.15.40:0/1896185815 shutdown_connections 2024-07-26T15:28:09.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 --2- 172.21.15.40:0/1896185815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc079070 0x7fe0dc0799e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 --2- 172.21.15.40:0/1896185815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc078ae0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 --2- 172.21.15.40:0/1896185815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc077650 0x7fe0dc077ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 -- 172.21.15.40:0/1896185815 >> 172.21.15.40:0/1896185815 conn(0x7fe0dc100c20 msgr2=0x7fe0dc1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:09.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 -- 172.21.15.40:0/1896185815 shutdown_connections 2024-07-26T15:28:09.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.471+0000 7fe0e3600640 1 -- 172.21.15.40:0/1896185815 wait complete. 2024-07-26T15:28:09.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.488+0000 7fe0e3600640 1 Processor -- start 2024-07-26T15:28:09.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.488+0000 7fe0e3600640 1 -- start start 2024-07-26T15:28:09.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e3600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc077650 0x7fe0dc19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:09.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e3600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc1a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:09.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e3600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc079070 0x7fe0dc1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e3600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc115220 con 0x7fe0dc0786d0 2024-07-26T15:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e3600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1150a0 con 0x7fe0dc079070 2024-07-26T15:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e3600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1153a0 con 0x7fe0dc077650 2024-07-26T15:28:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0d3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc1a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0d3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc1a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36902/0 (socket says 172.21.15.40:36902) 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0d3e00640 1 -- 172.21.15.40:0/897456405 learned_addr learned my addr 172.21.15.40:0/897456405 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e1600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc079070 0x7fe0dc1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.489+0000 7fe0e0c00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc077650 0x7fe0dc19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0d3e00640 1 -- 172.21.15.40:0/897456405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc077650 msgr2=0x7fe0dc19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0d3e00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc077650 0x7fe0dc19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0d3e00640 1 -- 172.21.15.40:0/897456405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc079070 msgr2=0x7fe0dc1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0d3e00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc079070 0x7fe0dc1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0d3e00640 1 -- 172.21.15.40:0/897456405 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1a18b0 con 0x7fe0dc0786d0 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0e0c00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc077650 0x7fe0dc19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.490+0000 7fe0d3e00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc1a04e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009230 tx=0x7fe0c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.491+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c403f070 con 0x7fe0dc0786d0 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.491+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0c402feb0 con 0x7fe0dc0786d0 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.491+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1a1b40 con 0x7fe0dc0786d0 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.491+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4035030 con 0x7fe0dc0786d0 2024-07-26T15:28:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.491+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a8290 con 0x7fe0dc0786d0 2024-07-26T15:28:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.492+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc078ae0 con 0x7fe0dc0786d0 2024-07-26T15:28:09.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.500+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe0c4042070 con 0x7fe0dc0786d0 2024-07-26T15:28:09.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.503+0000 7fe0da000640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c50 0x7fe0c00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:09.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.503+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7fe0c4105900 con 0x7fe0dc0786d0 2024-07-26T15:28:09.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.504+0000 7fe0e0c00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c50 0x7fe0c00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:09.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.505+0000 7fe0e0c00640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c50 0x7fe0c00b6160 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009c20 tx=0x7fe0cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:09.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.509+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fe0c40cbf70 con 0x7fe0dc0786d0 2024-07-26T15:28:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.752+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0dc0639f0 con 0x7fe0dc0786d0 2024-07-26T15:28:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.756+0000 7fe0da000640 1 -- 172.21.15.40:0/897456405 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+28656 (secure 0 0 0) 0x7fe0c40cb870 con 0x7fe0dc0786d0 2024-07-26T15:28:09.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T15:28:09.759 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":123,"fsid":"5cbb9f42-4b47-11ef-bcb7-c7b262605968","created":"2024-07-26T12:07:00.241568+0000","modified":"2024-07-26T13:36:54.588491+0000","last_up_change":"2024-07-26T12:17:11.080433+0000","last_in_change":"2024-07-26T12:16:44.132961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-26T12:11:57.831053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-26T12:18:23.776958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-26T12:18:28.035745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14d626d5-0f5f-47dc-b24b-2ff59d022831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6803","nonce":336845656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6805","nonce":336845656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6809","nonce":336845656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":336845656},{"type":"v1","addr":"172.21.15.40:6807","nonce":336845656}]},"public_addr":"172.21.15.40:6803/336845656","cluster_addr":"172.21.15.40:6805/336845656","heartbeat_back_addr":"172.21.15.40:6809/336845656","heartbeat_front_addr":"172.21.15.40:6807/336845656","state":["exists","up"]},{"osd":1,"uuid":"9ed50fe4-e7fc-48ce-823b-7d210178101e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6801","nonce":1858622261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6803","nonce":1858622261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6807","nonce":1858622261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1858622261},{"type":"v1","addr":"172.21.15.76:6805","nonce":1858622261}]},"public_addr":"172.21.15.76:6801/1858622261","cluster_addr":"172.21.15.76:6803/1858622261","heartbeat_back_addr":"172.21.15.76:6807/1858622261","heartbeat_front_addr":"172.21.15.76:6805/1858622261","state":["exists","up"]},{"osd":2,"uuid":"5ffd0e80-2845-46a4-b6dd-ebeb4a3ef6c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6801","nonce":2643488432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6803","nonce":2643488432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6807","nonce":2643488432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2643488432},{"type":"v1","addr":"172.21.15.146:6805","nonce":2643488432}]},"public_addr":"172.21.15.146:6801/2643488432","cluster_addr":"172.21.15.146:6803/2643488432","heartbeat_back_addr":"172.21.15.146:6807/2643488432","heartbeat_front_addr":"172.21.15.146:6805/2643488432","state":["exists","up"]},{"osd":3,"uuid":"9c225bd9-ee30-4bd3-b280-3237a9e899d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6811","nonce":2975278630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6813","nonce":2975278630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6817","nonce":2975278630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2975278630},{"type":"v1","addr":"172.21.15.40:6815","nonce":2975278630}]},"public_addr":"172.21.15.40:6811/2975278630","cluster_addr":"172.21.15.40:6813/2975278630","heartbeat_back_addr":"172.21.15.40:6817/2975278630","heartbeat_front_addr":"172.21.15.40:6815/2975278630","state":["exists","up"]},{"osd":4,"uuid":"fa87a23c-07d3-4e8a-b6c6-5fd9faa9550e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6809","nonce":3287530832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6811","nonce":3287530832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6815","nonce":3287530832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":3287530832},{"type":"v1","addr":"172.21.15.76:6813","nonce":3287530832}]},"public_addr":"172.21.15.76:6809/3287530832","cluster_addr":"172.21.15.76:6811/3287530832","heartbeat_back_addr":"172.21.15.76:6815/3287530832","heartbeat_front_addr":"172.21.15.76:6813/3287530832","state":["exists","up"]},{"osd":5,"uuid":"80c9a4cc-0633-4e04-ace3-ed165c2d9bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6809","nonce":371932906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6811","nonce":371932906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6815","nonce":371932906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":371932906},{"type":"v1","addr":"172.21.15.146:6813","nonce":371932906}]},"public_addr":"172.21.15.146:6809/371932906","cluster_addr":"172.21.15.146:6811/371932906","heartbeat_back_addr":"172.21.15.146:6815/371932906","heartbeat_front_addr":"172.21.15.146:6813/371932906","state":["exists","up"]},{"osd":6,"uuid":"c801bf68-146c-40f3-98f0-adda7821387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6819","nonce":692210835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6821","nonce":692210835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6825","nonce":692210835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":692210835},{"type":"v1","addr":"172.21.15.40:6823","nonce":692210835}]},"public_addr":"172.21.15.40:6819/692210835","cluster_addr":"172.21.15.40:6821/692210835","heartbeat_back_addr":"172.21.15.40:6825/692210835","heartbeat_front_addr":"172.21.15.40:6823/692210835","state":["exists","up"]},{"osd":7,"uuid":"283de83d-e151-4f9f-b313-0a2e51d169e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6817","nonce":2514797564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6819","nonce":2514797564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6823","nonce":2514797564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":2514797564},{"type":"v1","addr":"172.21.15.76:6821","nonce":2514797564}]},"public_addr":"172.21.15.76:6817/2514797564","cluster_addr":"172.21.15.76:6819/2514797564","heartbeat_back_addr":"172.21.15.76:6823/2514797564","heartbeat_front_addr":"172.21.15.76:6821/2514797564","state":["exists","up"]},{"osd":8,"uuid":"f180ffe2-9657-4515-8808-52eee7840f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6817","nonce":1134579636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6819","nonce":1134579636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6823","nonce":1134579636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":1134579636},{"type":"v1","addr":"172.21.15.146:6821","nonce":1134579636}]},"public_addr":"172.21.15.146:6817/1134579636","cluster_addr":"172.21.15.146:6819/1134579636","heartbeat_back_addr":"172.21.15.146:6823/1134579636","heartbeat_front_addr":"172.21.15.146:6821/1134579636","state":["exists","up"]},{"osd":9,"uuid":"4acc2a16-b98d-4c67-83bd-c74f1f1cede0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6827","nonce":2884827145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6829","nonce":2884827145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6833","nonce":2884827145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2884827145},{"type":"v1","addr":"172.21.15.40:6831","nonce":2884827145}]},"public_addr":"172.21.15.40:6827/2884827145","cluster_addr":"172.21.15.40:6829/2884827145","heartbeat_back_addr":"172.21.15.40:6833/2884827145","heartbeat_front_addr":"172.21.15.40:6831/2884827145","state":["exists","up"]},{"osd":10,"uuid":"910c7cc4-df9b-40ed-8b38-4b7205cdeda2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6825","nonce":2195493855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6827","nonce":2195493855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6831","nonce":2195493855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":2195493855},{"type":"v1","addr":"172.21.15.76:6829","nonce":2195493855}]},"public_addr":"172.21.15.76:6825/2195493855","cluster_addr":"172.21.15.76:6827/2195493855","heartbeat_back_addr":"172.21.15.76:6831/2195493855","heartbeat_front_addr":"172.21.15.76:6829/2195493855","state":["exists","up"]},{"osd":11,"uuid":"722e9e08-a8ec-4d70-84c2-8bb189f05095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6825","nonce":2525193294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6827","nonce":2525193294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6831","nonce":2525193294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2525193294},{"type":"v1","addr":"172.21.15.146:6829","nonce":2525193294}]},"public_addr":"172.21.15.146:6825/2525193294","cluster_addr":"172.21.15.146:6827/2525193294","heartbeat_back_addr":"172.21.15.146:6831/2525193294","heartbeat_front_addr":"172.21.15.146:6829/2525193294","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:10:48.484028+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:21.409341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:11:56.043328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:12:31.329366+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:04.924724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:13:40.218426+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:15.274062+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:14:48.676799+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:23.813439+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:15:58.893797+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:16:32.734475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-26T12:17:08.269801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/3675700947":"2024-07-27T13:36:54.588237+0000","172.21.15.76:6834/1213846876":"2024-07-27T13:36:54.588399+0000","172.21.15.146:6837/3809538576":"2024-07-27T13:36:34.562953+0000","172.21.15.146:6836/3809538576":"2024-07-27T13:36:34.562953+0000","172.21.15.146:6839/1974353927":"2024-07-27T13:36:34.563144+0000","172.21.15.146:6838/1974353927":"2024-07-27T13:36:34.563144+0000","172.21.15.40:6840/2006579107":"2024-07-27T13:36:12.941293+0000","172.21.15.40:6839/1223305424":"2024-07-27T13:36:12.819061+0000","172.21.15.40:6838/1223305424":"2024-07-27T13:36:12.819061+0000","172.21.15.146:6835/2226292800":"2024-07-27T13:36:11.916238+0000","172.21.15.146:6834/2226292800":"2024-07-27T13:36:11.916238+0000","172.21.15.76:6835/1229078272":"2024-07-27T13:36:11.867962+0000","172.21.15.76:6839/2701751672":"2024-07-27T13:35:56.003717+0000","172.21.15.76:6833/961948387":"2024-07-27T13:35:55.538357+0000","172.21.15.146:6839/3220961055":"2024-07-27T13:35:55.339632+0000","172.21.15.40:6841/2725372682":"2024-07-27T13:35:37.869852+0000","172.21.15.40:6839/1429307143":"2024-07-27T13:35:37.746476+0000","172.21.15.76:6832/961948387":"2024-07-27T13:35:55.538357+0000","172.21.15.40:6838/1429307143":"2024-07-27T13:35:37.746476+0000","172.21.15.76:6832/975335928":"2024-07-27T13:36:34.563056+0000","172.21.15.40:6841/2006579107":"2024-07-27T13:36:12.941293+0000","172.21.15.76:6835/3279473452":"2024-07-27T13:35:36.921782+0000","172.21.15.146:6835/3915774179":"2024-07-27T13:35:36.892827+0000","172.21.15.146:6834/3915774179":"2024-07-27T13:35:36.892827+0000","172.21.15.146:6836/2160631599":"2024-07-27T13:35:20.551038+0000","172.21.15.146:6839/2352244306":"2024-07-27T13:35:20.290410+0000","172.21.15.146:6835/3675700947":"2024-07-27T13:36:54.588237+0000","172.21.15.40:6839/694136309":"2024-07-27T13:33:44.214919+0000","172.21.15.146:6835/900875035":"2024-07-27T13:35:01.645161+0000","172.21.15.76:6835/1213846876":"2024-07-27T13:36:54.588399+0000","172.21.15.76:6833/975335928":"2024-07-27T13:36:34.563056+0000","172.21.15.40:6838/694136309":"2024-07-27T13:33:44.214919+0000","172.21.15.146:6834/1374524390":"2024-07-27T13:33:42.864787+0000","172.21.15.146:6838/3850522012":"2024-07-27T13:34:03.880777+0000","172.21.15.146:6837/2160631599":"2024-07-27T13:35:20.551038+0000","172.21.15.76:6834/3482143239":"2024-07-27T13:33:42.946815+0000","172.21.15.76:6838/3866154018":"2024-07-27T13:33:24.471887+0000","172.21.15.76:6834/2461564853":"2024-07-27T13:34:23.910548+0000","172.21.15.76:6834/3279473452":"2024-07-27T13:35:36.921782+0000","172.21.15.146:6837/3076436166":"2024-07-27T13:33:26.012485+0000","172.21.15.40:6840/3238351765":"2024-07-27T13:35:02.818639+0000","172.21.15.146:6837/3919477759":"2024-07-27T13:35:55.573012+0000","172.21.15.40:6841/3170726419":"2024-07-27T13:33:44.073507+0000","172.21.15.76:6838/2701751672":"2024-07-27T13:35:56.003717+0000","172.21.15.146:6839/4061759756":"2024-07-27T13:33:25.413070+0000","172.21.15.40:6800/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.146:6836/3919477759":"2024-07-27T13:35:55.573012+0000","172.21.15.40:6839/2583506231":"2024-07-27T13:34:25.544135+0000","172.21.15.146:6838/4061759756":"2024-07-27T13:33:25.413070+0000","172.21.15.40:0/1334877414":"2024-07-27T12:07:57.642554+0000","172.21.15.76:6832/1983243831":"2024-07-27T13:34:04.444674+0000","172.21.15.76:6835/3482143239":"2024-07-27T13:33:42.946815+0000","172.21.15.76:6839/2937347475":"2024-07-27T13:35:20.712490+0000","172.21.15.76:6839/3866154018":"2024-07-27T13:33:24.471887+0000","172.21.15.76:6838/2937347475":"2024-07-27T13:35:20.712490+0000","172.21.15.40:0/3266304279":"2024-07-27T12:07:27.399390+0000","172.21.15.76:6839/3814759196":"2024-07-27T13:36:34.563230+0000","172.21.15.40:6801/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.40:6800/2685729470":"2024-07-27T12:07:27.399390+0000","172.21.15.146:6837/3522272509":"2024-07-27T13:34:04.486630+0000","172.21.15.40:0/1764700986":"2024-07-27T12:07:57.642554+0000","172.21.15.76:6838/2225657026":"2024-07-27T13:34:04.329275+0000","172.21.15.40:6840/3170726419":"2024-07-27T13:33:44.073507+0000","172.21.15.146:6836/3522272509":"2024-07-27T13:34:04.486630+0000","172.21.15.40:0/1883279801":"2024-07-27T12:07:27.399390+0000","172.21.15.40:0/18542135":"2024-07-27T12:07:57.642554+0000","172.21.15.76:6833/3090209485":"2024-07-27T13:35:20.260945+0000","172.21.15.76:6833/1983243831":"2024-07-27T13:34:04.444674+0000","172.21.15.40:6840/3575903669":"2024-07-27T13:34:24.743422+0000","172.21.15.146:6838/2352244306":"2024-07-27T13:35:20.290410+0000","172.21.15.146:6836/3076436166":"2024-07-27T13:33:26.012485+0000","172.21.15.146:6839/3850522012":"2024-07-27T13:34:03.880777+0000","172.21.15.76:6838/3814759196":"2024-07-27T13:36:34.563230+0000","172.21.15.40:6841/3238351765":"2024-07-27T13:35:02.818639+0000","172.21.15.76:6833/2744171288":"2024-07-27T13:33:24.471769+0000","172.21.15.76:6832/2744171288":"2024-07-27T13:33:24.471769+0000","172.21.15.146:6834/900875035":"2024-07-27T13:35:01.645161+0000","172.21.15.76:6839/2225657026":"2024-07-27T13:34:04.329275+0000","172.21.15.146:6839/1530476337":"2024-07-27T13:34:42.601747+0000","172.21.15.146:6834/2502587932":"2024-07-27T13:34:23.851165+0000","172.21.15.76:6839/1025840894":"2024-07-27T13:34:42.993852+0000","172.21.15.40:6840/2725372682":"2024-07-27T13:35:37.869852+0000","172.21.15.76:6835/2461564853":"2024-07-27T13:34:23.910548+0000","172.21.15.146:6835/1374524390":"2024-07-27T13:33:42.864787+0000","172.21.15.40:6839/26169584":"2024-07-27T13:35:02.298516+0000","172.21.15.146:6838/3220961055":"2024-07-27T13:35:55.339632+0000","172.21.15.76:6833/3611914765":"2024-07-27T13:34:42.635141+0000","172.21.15.40:6841/3575903669":"2024-07-27T13:34:24.743422+0000","172.21.15.40:6838/2583506231":"2024-07-27T13:34:25.544135+0000","172.21.15.146:6836/3675130860":"2024-07-27T13:34:42.399882+0000","172.21.15.146:6838/1530476337":"2024-07-27T13:34:42.601747+0000","172.21.15.40:0/2030256837":"2024-07-27T12:07:27.399390+0000","172.21.15.76:6834/2335337936":"2024-07-27T13:35:01.623955+0000","172.21.15.146:6835/2502587932":"2024-07-27T13:34:23.851165+0000","172.21.15.76:6832/3611914765":"2024-07-27T13:34:42.635141+0000","172.21.15.40:6801/3749083887":"2024-07-27T12:07:57.642554+0000","172.21.15.76:6835/2335337936":"2024-07-27T13:35:01.623955+0000","172.21.15.146:6837/3675130860":"2024-07-27T13:34:42.399882+0000","172.21.15.40:6838/26169584":"2024-07-27T13:35:02.298516+0000","172.21.15.76:6838/1025840894":"2024-07-27T13:34:42.993852+0000","172.21.15.76:6834/1229078272":"2024-07-27T13:36:11.867962+0000","172.21.15.76:6832/3090209485":"2024-07-27T13:35:20.260945+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-26T15:28:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.759+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c50 msgr2=0x7fe0c00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.759+0000 7fe0e3600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c50 0x7fe0c00b6160 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009c20 tx=0x7fe0cc005f90 comp rx=0 tx=0).stop 2024-07-26T15:28:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.759+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 msgr2=0x7fe0dc1a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.759+0000 7fe0e3600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc1a04e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009230 tx=0x7fe0c4004270 comp rx=0 tx=0).stop 2024-07-26T15:28:09.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.759+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 shutdown_connections 2024-07-26T15:28:09.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe0dc079070 0x7fe0dc1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0786d0 0x7fe0dc1a04e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fe0c00b3c50 0x7fe0c00b6160 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 --2- 172.21.15.40:0/897456405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0dc077650 0x7fe0dc19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:09.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 >> 172.21.15.40:0/897456405 conn(0x7fe0dc100c20 msgr2=0x7fe0dc1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:09.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 shutdown_connections 2024-07-26T15:28:09.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:09.760+0000 7fe0e3600640 1 -- 172.21.15.40:0/897456405 wait complete. 2024-07-26T15:28:09.820 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-26T12:11:57.831053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-26T12:18:23.776958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-26T12:18:28.035745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-26T15:28:09.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-26T15:28:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.105+0000 7fea85c00640 1 -- 172.21.15.40:0/2798137494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80104910 msgr2=0x7fea8010b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.105+0000 7fea85c00640 1 --2- 172.21.15.40:0/2798137494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80104910 0x7fea8010b2b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fea78009ca0 tx=0x7fea7802a8c0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.105+0000 7fea85c00640 1 -- 172.21.15.40:0/2798137494 shutdown_connections 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.105+0000 7fea85c00640 1 --2- 172.21.15.40:0/2798137494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80104910 0x7fea8010b2b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.105+0000 7fea85c00640 1 --2- 172.21.15.40:0/2798137494 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 0x7fea80104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.105+0000 7fea85c00640 1 --2- 172.21.15.40:0/2798137494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea80102ef0 0x7fea80103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.106+0000 7fea85c00640 1 -- 172.21.15.40:0/2798137494 >> 172.21.15.40:0/2798137494 conn(0x7fea800fe830 msgr2=0x7fea80100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.106+0000 7fea85c00640 1 -- 172.21.15.40:0/2798137494 shutdown_connections 2024-07-26T15:28:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.106+0000 7fea85c00640 1 -- 172.21.15.40:0/2798137494 wait complete. 2024-07-26T15:28:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 Processor -- start 2024-07-26T15:28:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 -- start start 2024-07-26T15:28:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 0x7fea80199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 0x7fea80199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea80104910 0x7fea8019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fea8010e9d0 con 0x7fea80102ef0 2024-07-26T15:28:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fea8010e850 con 0x7fea80103f70 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea85c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea8010eb50 con 0x7fea80104910 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.107+0000 7fea7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 0x7fea80199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 0x7fea80199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36910/0 (socket says 172.21.15.40:36910) 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 -- 172.21.15.40:0/785534543 learned_addr learned my addr 172.21.15.40:0/785534543 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7f400640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 0x7fea80199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 -- 172.21.15.40:0/785534543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea80104910 msgr2=0x7fea8019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea80104910 0x7fea8019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 -- 172.21.15.40:0/785534543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 msgr2=0x7fea80199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 0x7fea80199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 -- 172.21.15.40:0/785534543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8019b090 con 0x7fea80102ef0 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7f400640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 0x7fea80199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.108+0000 7fea7fe00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 0x7fea80199650 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fea7000d770 tx=0x7fea7000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.109+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70017070 con 0x7fea80102ef0 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.109+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea700054b0 con 0x7fea80102ef0 2024-07-26T15:28:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.109+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70004c60 con 0x7fea80102ef0 2024-07-26T15:28:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.109+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8019b380 con 0x7fea80102ef0 2024-07-26T15:28:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.109+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea801a1a70 con 0x7fea80102ef0 2024-07-26T15:28:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.110+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8010a0c0 con 0x7fea80102ef0 2024-07-26T15:28:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.113+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fea70004e00 con 0x7fea80102ef0 2024-07-26T15:28:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.114+0000 7fea7cc00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea640b3c50 0x7fea640b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.114+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7fea700e4610 con 0x7fea80102ef0 2024-07-26T15:28:10.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.115+0000 7fea7f400640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea640b3c50 0x7fea640b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.115+0000 7fea7f400640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea640b3c50 0x7fea640b6160 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009b40 tx=0x7fea6c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:10.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.121+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fea700aace0 con 0x7fea80102ef0 2024-07-26T15:28:10.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:09 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/897456405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T15:28:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:09 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/897456405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T15:28:10.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:09 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/897456405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-07-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.336+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea800639f0 con 0x7fea80102ef0 2024-07-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.337+0000 7fea7cc00640 1 -- 172.21.15.40:0/785534543 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) ==== 93+0+10 (secure 0 0 0) 0x7fea700aa5e0 con 0x7fea80102ef0 2024-07-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-07-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea640b3c50 msgr2=0x7fea640b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea640b3c50 0x7fea640b6160 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009b40 tx=0x7fea6c005e50 comp rx=0 tx=0).stop 2024-07-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 msgr2=0x7fea80199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 0x7fea80199650 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fea7000d770 tx=0x7fea7000dc30 comp rx=0 tx=0).stop 2024-07-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 shutdown_connections 2024-07-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fea640b3c50 0x7fea640b6160 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea80104910 0x7fea8019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea80103f70 0x7fea80199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 --2- 172.21.15.40:0/785534543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea80102ef0 0x7fea80199650 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 >> 172.21.15.40:0/785534543 conn(0x7fea800fe830 msgr2=0x7fea80107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.340+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 shutdown_connections 2024-07-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.341+0000 7fea85c00640 1 -- 172.21.15.40:0/785534543 wait complete. 2024-07-26T15:28:10.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-26T15:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 -- 172.21.15.40:0/3374004456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc102ef0 msgr2=0x7fcbfc103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3374004456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc102ef0 0x7fcbfc103360 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009900 tx=0x7fcbec02a3f0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 -- 172.21.15.40:0/3374004456 shutdown_connections 2024-07-26T15:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3374004456 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcbfc104910 0x7fcbfc10b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3374004456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 0x7fcbfc104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3374004456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc102ef0 0x7fcbfc103360 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 -- 172.21.15.40:0/3374004456 >> 172.21.15.40:0/3374004456 conn(0x7fcbfc0fe830 msgr2=0x7fcbfc100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 -- 172.21.15.40:0/3374004456 shutdown_connections 2024-07-26T15:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.642+0000 7fcc00a00640 1 -- 172.21.15.40:0/3374004456 wait complete. 2024-07-26T15:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 Processor -- start 2024-07-26T15:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 -- start start 2024-07-26T15:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcbfc102ef0 0x7fcbfc1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 0x7fcbfc199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 0x7fcbfc19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc10ea20 con 0x7fcbfc104910 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc10e8a0 con 0x7fcbfc102ef0 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.643+0000 7fcc00a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc10eba0 con 0x7fcbfc103f70 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 0x7fcbfc19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 0x7fcbfc19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36922/0 (socket says 172.21.15.40:36922) 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 -- 172.21.15.40:0/3761745534 learned_addr learned my addr 172.21.15.40:0/3761745534 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbf1e00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 0x7fcbfc199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfa800640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcbfc102ef0 0x7fcbfc1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 -- 172.21.15.40:0/3761745534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 msgr2=0x7fcbfc199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 0x7fcbfc199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 -- 172.21.15.40:0/3761745534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcbfc102ef0 msgr2=0x7fcbfc1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcbfc102ef0 0x7fcbfc1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbfb200640 1 -- 172.21.15.40:0/3761745534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc19b100 con 0x7fcbfc104910 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.644+0000 7fcbf1e00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 0x7fcbfc199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.645+0000 7fcbfb200640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 0x7fcbfc19a8e0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400eaa0 tx=0x7fcbf400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.645+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400cdb0 con 0x7fcbfc104910 2024-07-26T15:28:10.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.645+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbf4005020 con 0x7fcbfc104910 2024-07-26T15:28:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.645+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbfc19b3f0 con 0x7fcbfc104910 2024-07-26T15:28:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.645+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40116d0 con 0x7fcbfc104910 2024-07-26T15:28:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.645+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbfc1a1ae0 con 0x7fcbfc104910 2024-07-26T15:28:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.646+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbfc10a0c0 con 0x7fcbfc104910 2024-07-26T15:28:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.649+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcbf40051d0 con 0x7fcbfc104910 2024-07-26T15:28:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.650+0000 7fcbf3e00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcbe00b3c50 0x7fcbe00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.651+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7fcbf40e51c0 con 0x7fcbfc104910 2024-07-26T15:28:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.651+0000 7fcbfa800640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcbe00b3c50 0x7fcbe00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:10.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.652+0000 7fcbfa800640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcbe00b3c50 0x7fcbe00b6160 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000c00 tx=0x7fcbec005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:10.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.652+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fcbf4016030 con 0x7fcbfc104910 2024-07-26T15:28:10.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.869+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcbfc0639f0 con 0x7fcbfc104910 2024-07-26T15:28:10.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.870+0000 7fcbf3e00640 1 -- 172.21.15.40:0/3761745534 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) ==== 104+0+11 (secure 0 0 0) 0x7fcbf40ab8b0 con 0x7fcbfc104910 2024-07-26T15:28:10.872 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-07-26T15:28:10.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcbe00b3c50 msgr2=0x7fcbe00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcbe00b3c50 0x7fcbe00b6160 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000c00 tx=0x7fcbec005720 comp rx=0 tx=0).stop 2024-07-26T15:28:10.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 msgr2=0x7fcbfc19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:10.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 0x7fcbfc19a8e0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400eaa0 tx=0x7fcbf400ef60 comp rx=0 tx=0).stop 2024-07-26T15:28:10.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 shutdown_connections 2024-07-26T15:28:10.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc104910 0x7fcbfc19a8e0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fcbe00b3c50 0x7fcbe00b6160 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc103f70 0x7fcbfc199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 --2- 172.21.15.40:0/3761745534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcbfc102ef0 0x7fcbfc1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:10.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.873+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 >> 172.21.15.40:0/3761745534 conn(0x7fcbfc0fe830 msgr2=0x7fcbfc107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:10.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.874+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 shutdown_connections 2024-07-26T15:28:10.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:10.874+0000 7fcc00a00640 1 -- 172.21.15.40:0/3761745534 wait complete. 2024-07-26T15:28:10.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-26T15:28:11.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 -- 172.21.15.40:0/4121001602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb610106360 msgr2=0x7fb610106770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 --2- 172.21.15.40:0/4121001602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb610106360 0x7fb610106770 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009900 tx=0x7fb5fc02a410 comp rx=0 tx=0).stop 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 -- 172.21.15.40:0/4121001602 shutdown_connections 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 --2- 172.21.15.40:0/4121001602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 0x7fb61010d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 --2- 172.21.15.40:0/4121001602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb610106360 0x7fb610106770 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 --2- 172.21.15.40:0/4121001602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6101052e0 0x7fb610105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 -- 172.21.15.40:0/4121001602 >> 172.21.15.40:0/4121001602 conn(0x7fb610100c20 msgr2=0x7fb6101030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 -- 172.21.15.40:0/4121001602 shutdown_connections 2024-07-26T15:28:11.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.189+0000 7fb615000640 1 -- 172.21.15.40:0/4121001602 wait complete. 2024-07-26T15:28:11.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 Processor -- start 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 -- start start 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6101052e0 0x7fb61019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb610106360 0x7fb61019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 0x7fb61019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb610110e10 con 0x7fb6101052e0 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb610110c90 con 0x7fb610106360 2024-07-26T15:28:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.191+0000 7fb615000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb610110f90 con 0x7fb610106d00 2024-07-26T15:28:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6101052e0 0x7fb61019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 0x7fb61019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60d400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb610106360 0x7fb61019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 0x7fb61019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:36446/0 (socket says 172.21.15.40:36446) 2024-07-26T15:28:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60e800640 1 -- 172.21.15.40:0/1957169908 learned_addr learned my addr 172.21.15.40:0/1957169908 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:11.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60de00640 1 -- 172.21.15.40:0/1957169908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 msgr2=0x7fb61019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60de00640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 0x7fb61019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60de00640 1 -- 172.21.15.40:0/1957169908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb610106360 msgr2=0x7fb61019c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60de00640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb610106360 0x7fb61019c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.192+0000 7fb60de00640 1 -- 172.21.15.40:0/1957169908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61019d4c0 con 0x7fb6101052e0 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.193+0000 7fb60de00640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6101052e0 0x7fb61019ba80 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb60000d6d0 tx=0x7fb60000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.193+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600017070 con 0x7fb6101052e0 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.193+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb600009820 con 0x7fb6101052e0 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.193+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600004bc0 con 0x7fb6101052e0 2024-07-26T15:28:11.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.193+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61019d7b0 con 0x7fb6101052e0 2024-07-26T15:28:11.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.193+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6101a3ea0 con 0x7fb6101052e0 2024-07-26T15:28:11.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.195+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61010c4b0 con 0x7fb6101052e0 2024-07-26T15:28:11.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.197+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb600005220 con 0x7fb6101052e0 2024-07-26T15:28:11.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.199+0000 7fb606a00640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5f40b3c50 0x7fb5f40b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.199+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7fb6000e49e0 con 0x7fb6101052e0 2024-07-26T15:28:11.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.199+0000 7fb60d400640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5f40b3c50 0x7fb5f40b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.200+0000 7fb60d400640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5f40b3c50 0x7fb5f40b6160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0057c0 tx=0x7fb5fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:11.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.200+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fb6000aaa80 con 0x7fb6101052e0 2024-07-26T15:28:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:11 smithi040 ceph-mon[32397]: pgmap v6153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:11 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/785534543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T15:28:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:11 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3761745534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T15:28:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:11 smithi146 ceph-mon[35807]: pgmap v6153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:11 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/785534543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T15:28:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:11 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3761745534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T15:28:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:11 smithi076 ceph-mon[35401]: pgmap v6153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:11 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/785534543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-07-26T15:28:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:11 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3761745534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-07-26T15:28:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.418+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb6100639f0 con 0x7fb6101052e0 2024-07-26T15:28:11.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.420+0000 7fb606a00640 1 -- 172.21.15.40:0/1957169908 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) ==== 100+0+11 (secure 0 0 0) 0x7fb6000aefd0 con 0x7fb6101052e0 2024-07-26T15:28:11.422 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-07-26T15:28:11.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5f40b3c50 msgr2=0x7fb5f40b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5f40b3c50 0x7fb5f40b6160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0057c0 tx=0x7fb5fc000bc0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6101052e0 msgr2=0x7fb61019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6101052e0 0x7fb61019ba80 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb60000d6d0 tx=0x7fb60000db90 comp rx=0 tx=0).stop 2024-07-26T15:28:11.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 shutdown_connections 2024-07-26T15:28:11.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fb5f40b3c50 0x7fb5f40b6160 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb610106d00 0x7fb61019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb610106360 0x7fb61019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 --2- 172.21.15.40:0/1957169908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6101052e0 0x7fb61019ba80 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.423+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 >> 172.21.15.40:0/1957169908 conn(0x7fb610100c20 msgr2=0x7fb610109680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:11.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.424+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 shutdown_connections 2024-07-26T15:28:11.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.424+0000 7fb615000640 1 -- 172.21.15.40:0/1957169908 wait complete. 2024-07-26T15:28:11.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-07-26T15:28:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 -- 172.21.15.40:0/1884068678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d41052e0 msgr2=0x7f50d4105750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 --2- 172.21.15.40:0/1884068678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d41052e0 0x7f50d4105750 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009900 tx=0x7f50c802a410 comp rx=0 tx=0).stop 2024-07-26T15:28:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 -- 172.21.15.40:0/1884068678 shutdown_connections 2024-07-26T15:28:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 --2- 172.21.15.40:0/1884068678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d4106d00 0x7f50d410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 --2- 172.21.15.40:0/1884068678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50d4106360 0x7f50d4106770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 --2- 172.21.15.40:0/1884068678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d41052e0 0x7f50d4105750 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.738+0000 7f50dc200640 1 -- 172.21.15.40:0/1884068678 >> 172.21.15.40:0/1884068678 conn(0x7f50d4100c20 msgr2=0x7f50d41030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.739+0000 7f50dc200640 1 -- 172.21.15.40:0/1884068678 shutdown_connections 2024-07-26T15:28:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.739+0000 7f50dc200640 1 -- 172.21.15.40:0/1884068678 wait complete. 2024-07-26T15:28:11.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 Processor -- start 2024-07-26T15:28:11.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 -- start start 2024-07-26T15:28:11.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50d41052e0 0x7f50d419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d4106360 0x7f50d419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 0x7f50d419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4110e10 con 0x7f50d4106d00 2024-07-26T15:28:11.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4110c90 con 0x7f50d41052e0 2024-07-26T15:28:11.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.740+0000 7f50dc200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4110f90 con 0x7f50d4106360 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 0x7f50d419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 0x7f50d419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36956/0 (socket says 172.21.15.40:36956) 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 -- 172.21.15.40:0/404850180 learned_addr learned my addr 172.21.15.40:0/404850180 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50d8e00640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d4106360 0x7f50d419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50d9800640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50d41052e0 0x7f50d419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 -- 172.21.15.40:0/404850180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d4106360 msgr2=0x7f50d419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d4106360 0x7f50d419c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 -- 172.21.15.40:0/404850180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50d41052e0 msgr2=0x7f50d419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50d41052e0 0x7f50d419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 -- 172.21.15.40:0/404850180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d419d4c0 con 0x7f50d4106d00 2024-07-26T15:28:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.741+0000 7f50da200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 0x7f50d419cca0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00eaa0 tx=0x7f50cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.742+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00cdb0 con 0x7f50d4106d00 2024-07-26T15:28:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.742+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50cc005020 con 0x7f50d4106d00 2024-07-26T15:28:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.742+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0116d0 con 0x7f50d4106d00 2024-07-26T15:28:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.742+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d419d7b0 con 0x7f50d4106d00 2024-07-26T15:28:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.742+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d41a3ea0 con 0x7f50d4106d00 2024-07-26T15:28:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.743+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d410c4b0 con 0x7f50d4106d00 2024-07-26T15:28:11.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.746+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f50cc0051d0 con 0x7f50d4106d00 2024-07-26T15:28:11.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.747+0000 7f50d2000640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f50bc0b3bd0 0x7f50bc0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:11.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.747+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7f50cc0e51f0 con 0x7f50d4106d00 2024-07-26T15:28:11.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.748+0000 7f50d9800640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f50bc0b3bd0 0x7f50bc0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:11.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.749+0000 7f50d9800640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f50bc0b3bd0 0x7f50bc0b60e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f50c8000c00 tx=0x7f50c8005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:11.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:11.749+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7f50cc016030 con 0x7f50d4106d00 2024-07-26T15:28:12.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.030+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f50d402e240 con 0x7f50d4106d00 2024-07-26T15:28:12.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.063+0000 7f50d2000640 1 -- 172.21.15.40:0/404850180 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+821376 (secure 0 0 0) 0x7f50cc0ab860 con 0x7f50d4106d00 2024-07-26T15:28:12.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-07-26T15:28:12.082 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-07-26T15:28:12.082 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 18, 2024-07-26T15:28:12.082 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.082 INFO:teuthology.orchestra.run.smithi040.stdout: "active_gid": 14150, 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: "active_name": "x", 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: "active_addrs": { 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6800", 2024-07-26T15:28:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 4031368209 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6801", 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 4031368209 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.084 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: "active_addr": "172.21.15.40:6801/4031368209", 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: "active_change": "2024-07-26T12:07:57.642829+0000", 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: "active_mgr_features": 4540701547738038271, 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: "available": true, 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: "standbys": [ 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.085 INFO:teuthology.orchestra.run.smithi040.stdout: "gid": 24109, 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "z", 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr_features": 4540701547738038271, 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "available_modules": [ 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "alerts", 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.086 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:12.087 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How frequently to reexamine health status", 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.088 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.089 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.090 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.092 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.093 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.095 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.096 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.097 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_destination": { 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_destination", 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.098 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email address to send alerts to", 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.099 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_from_name": { 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_from_name", 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "Ceph", 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.100 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email From: name", 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_host": { 2024-07-26T15:28:12.101 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_host", 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.102 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP server", 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_password": { 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_password", 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.103 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Password to authenticate with", 2024-07-26T15:28:12.104 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_port": { 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_port", 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.105 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "465", 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP port", 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.106 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_sender": { 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_sender", 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.107 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.108 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.108 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.108 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP envelope sender", 2024-07-26T15:28:12.108 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.108 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.108 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_ssl": { 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_ssl", 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.109 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_user": { 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_user", 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.111 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "User to authenticate as", 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.112 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "balancer", 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "active": { 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "active", 2024-07-26T15:28:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically balance PGs across cluster", 2024-07-26T15:28:12.116 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_time": { 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_time", 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0000", 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "beginning time of day to automatically balance", 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T15:28:12.118 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_weekday": { 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_weekday", 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.119 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_max_iterations": { 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_max_iterations", 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "25", 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:12.121 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "250", 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_metrics": { 2024-07-26T15:28:12.122 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_metrics", 2024-07-26T15:28:12.123 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.123 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.123 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.123 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "pgs,objects,bytes", 2024-07-26T15:28:12.123 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.124 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_step": { 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_step", 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.5", 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0.001", 2024-07-26T15:28:12.125 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "0.999", 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "aggressiveness of optimization", 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "end_time": { 2024-07-26T15:28:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_time", 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2359", 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.127 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ending time of day to automatically balance", 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "end_weekday": { 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_weekday", 2024-07-26T15:28:12.128 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-26T15:28:12.129 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.130 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.131 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.132 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.133 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.134 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.135 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.136 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.137 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.138 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "min_score": { 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_score", 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.140 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "upmap", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-compat", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "none", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "read", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap", 2024-07-26T15:28:12.142 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap-read" 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Balancer mode", 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_ids": { 2024-07-26T15:28:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_ids", 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.144 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.145 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.146 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.147 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_deviation": { 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_deviation", 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.150 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_optimizations": { 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_optimizations", 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.151 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.152 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm", 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_down_multiplier": { 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_down_multiplier", 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.153 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.154 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_refresh_rate": { 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_refresh_rate", 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.155 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "20", 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.156 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_starting_port": { 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_starting_port", 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4721", 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_ptrace": { 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_ptrace", 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.159 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_interval": { 2024-07-26T15:28:12.160 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_interval", 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-26T15:28:12.162 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.162 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.162 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.162 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.162 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_memory_target_ratio": { 2024-07-26T15:28:12.162 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_memory_target_ratio", 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.7", 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.163 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm_log_destination": { 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm_log_destination", 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "file", 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "file,syslog", 2024-07-26T15:28:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: "syslog" 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.166 INFO:teuthology.orchestra.run.smithi040.stdout: "cgroups_split": { 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cgroups_split", 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.167 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "config_checks_enabled": { 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_checks_enabled", 2024-07-26T15:28:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-26T15:28:12.169 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: "config_dashboard": { 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_dashboard", 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.170 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.171 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_alertmanager": { 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_alertmanager", 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.172 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.173 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_base": { 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_base", 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.174 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Container image name, without the tag", 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_elasticsearch": { 2024-07-26T15:28:12.175 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_elasticsearch", 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.176 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.177 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "elasticsearch container image", 2024-07-26T15:28:12.177 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.177 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.177 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.177 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.177 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_grafana": { 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_grafana", 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.178 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_haproxy": { 2024-07-26T15:28:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_haproxy", 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.180 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "HAproxy container image", 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_agent": { 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_agent", 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger agent container image", 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_collector": { 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_collector", 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger collector container image", 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.184 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_query": { 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_query", 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.185 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger query container image", 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.186 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_keepalived": { 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_keepalived", 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Keepalived container image", 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_loki": { 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_loki", 2024-07-26T15:28:12.188 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Loki container image", 2024-07-26T15:28:12.189 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nginx": { 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nginx", 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.190 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nginx container image", 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_node_exporter": { 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_node_exporter", 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-26T15:28:12.192 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.193 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nvmeof": { 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nvmeof", 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.194 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nvme-of container image", 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_prometheus": { 2024-07-26T15:28:12.195 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_prometheus", 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_promtail": { 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_promtail", 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.197 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Promtail container image", 2024-07-26T15:28:12.198 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_samba": { 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_samba", 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.199 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Samba/SMB container image", 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.200 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_snmp_gateway": { 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_snmp_gateway", 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-26T15:28:12.201 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SNMP Gateway container image", 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.202 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "container_init": { 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_init", 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.203 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Run podman/docker with `--init`", 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "daemon_cache_timeout": { 2024-07-26T15:28:12.204 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "daemon_cache_timeout", 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.205 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "default_cephadm_command_timeout": { 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_cephadm_command_timeout", 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.206 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "900", 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.207 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: "default_registry": { 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_registry", 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.208 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io", 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.209 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "device_cache_timeout": { 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_cache_timeout", 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1800", 2024-07-26T15:28:12.210 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache device inventory", 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.211 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "device_enhanced_scan": { 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_enhanced_scan", 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.212 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "facts_cache_timeout": { 2024-07-26T15:28:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "facts_cache_timeout", 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.214 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache host facts data", 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "grafana_dashboards_path": { 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "grafana_dashboards_path", 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.215 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.216 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "host_check_interval": { 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "host_check_interval", 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.217 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to perform a host check", 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.218 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "hw_monitoring": { 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hw_monitoring", 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.220 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.220 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-26T15:28:12.220 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.220 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.220 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.220 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "inventory_list_all": { 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "inventory_list_all", 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.221 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.223 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.224 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "log_refresh_metadata": { 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_refresh_metadata", 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.225 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.226 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.227 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.227 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.227 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.227 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.227 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.227 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.228 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.229 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.230 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.231 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.232 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-26T15:28:12.233 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.234 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "*", 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.236 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "max_count_per_host": { 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_count_per_host", 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.237 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of daemons per service per host", 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.238 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd_draining_count": { 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_osd_draining_count", 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "migration_current": { 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "migration_current", 2024-07-26T15:28:12.240 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "internal - do not modify", 2024-07-26T15:28:12.241 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.242 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.243 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "root", 2024-07-26T15:28:12.243 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.243 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.243 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.243 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm-package", 2024-07-26T15:28:12.243 INFO:teuthology.orchestra.run.smithi040.stdout: "root" 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "mode for remote execution of cephadm", 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: "oob_default_addr": { 2024-07-26T15:28:12.244 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "oob_default_addr", 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "169.254.1.1", 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.245 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "prometheus_alerts_path": { 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus_alerts_path", 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_insecure": { 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_insecure", 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.248 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.249 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_password": { 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_password", 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.250 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.251 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.251 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.251 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.251 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-26T15:28:12.251 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.252 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.252 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.252 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.252 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_url": { 2024-07-26T15:28:12.252 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_url", 2024-07-26T15:28:12.252 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-26T15:28:12.253 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_username": { 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_username", 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.254 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.255 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.255 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.255 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.255 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.256 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-26T15:28:12.256 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.256 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.256 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.256 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "secure_monitoring_stack": { 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secure_monitoring_stack", 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.257 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "service_discovery_port": { 2024-07-26T15:28:12.258 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "service_discovery_port", 2024-07-26T15:28:12.259 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.259 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.259 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.259 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8765", 2024-07-26T15:28:12.260 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.260 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.260 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.260 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "cephadm service discovery port", 2024-07-26T15:28:12.260 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.260 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.261 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.262 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.263 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.263 INFO:teuthology.orchestra.run.smithi040.stdout: "ssh_config_file": { 2024-07-26T15:28:12.263 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssh_config_file", 2024-07-26T15:28:12.263 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.264 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: "use_agent": { 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_agent", 2024-07-26T15:28:12.265 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-26T15:28:12.266 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.267 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.267 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.267 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.267 INFO:teuthology.orchestra.run.smithi040.stdout: "use_repo_digest": { 2024-07-26T15:28:12.267 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_repo_digest", 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.268 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.269 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-26T15:28:12.269 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.269 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.269 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.269 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.269 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_failed_host_check": { 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_failed_host_check", 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.270 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.271 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if the host check fails", 2024-07-26T15:28:12.271 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.271 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.271 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.271 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_daemons": { 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_daemons", 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.272 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.273 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_hosts": { 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_hosts", 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.274 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.275 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crash", 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.276 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.278 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.279 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.280 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.281 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.282 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.283 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.284 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "retain_interval": { 2024-07-26T15:28:12.285 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retain_interval", 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "31536000", 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.286 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.287 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.288 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_recent_interval": { 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_recent_interval", 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.289 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1209600", 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.290 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dashboard", 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.292 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.293 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.293 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.293 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.293 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.293 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.293 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_HOST": { 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.294 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.295 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.296 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_ENABLED": { 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_ENABLED", 2024-07-26T15:28:12.297 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.299 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.300 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "ENABLE_BROWSABLE_API": { 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.301 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.302 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.303 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.304 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.304 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.304 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.304 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.305 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.306 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.307 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.308 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.309 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.310 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.311 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-26T15:28:12.312 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.313 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.314 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.315 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.316 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.317 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_PASSWORD": { 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.318 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.319 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.319 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.319 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.319 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.320 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.321 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_URL": { 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_URL", 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.322 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.323 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_USERNAME": { 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.324 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-26T15:28:12.325 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.326 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-26T15:28:12.327 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.328 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.330 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.331 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.332 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "[]", 2024-07-26T15:28:12.333 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.334 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "MULTICLUSTER_CONFIG": { 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "{}", 2024-07-26T15:28:12.335 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.336 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_HOST": { 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.337 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-26T15:28:12.338 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.340 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.341 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.342 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.343 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.344 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.345 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.346 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.347 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.348 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-26T15:28:12.349 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.350 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.351 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.352 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_ENABLED": { 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.354 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.355 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-26T15:28:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.357 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-26T15:28:12.358 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8", 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.359 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.360 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "45", 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.361 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ACCESS_KEY": { 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.362 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.363 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.364 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SECRET_KEY": { 2024-07-26T15:28:12.365 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.366 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SSL_VERIFY": { 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-26T15:28:12.367 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.368 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "UNSAFE_TLS_v1_2": { 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.369 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.370 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.374 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.375 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "cross_origin_url": { 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cross_origin_url", 2024-07-26T15:28:12.376 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "crt_file": { 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crt_file", 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: "debug": { 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "debug", 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.380 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable/disable debug options", 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.381 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "jwt_token_ttl": { 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "jwt_token_ttl", 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "28800", 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.382 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.383 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.384 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.385 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.386 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.387 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.390 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.391 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.392 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.393 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "motd": { 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "motd", 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.394 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "The message of the day", 2024-07-26T15:28:12.395 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_resolve_ip_addr": { 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "redirect_resolve_ip_addr", 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.397 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.398 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.399 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8080", 2024-07-26T15:28:12.400 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.401 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-07-26T15:28:12.403 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.404 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl_server_port": { 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl_server_port", 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.405 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8443", 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.406 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "redirect", 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect" 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.408 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.409 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.410 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "url_prefix": { 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url_prefix", 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.411 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.413 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_monitoring": { 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_monitoring", 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.414 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "monitor device health metrics", 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.415 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.417 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.418 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.419 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.420 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.421 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.422 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.423 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.424 INFO:teuthology.orchestra.run.smithi040.stdout: "mark_out_threshold": { 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mark_out_threshold", 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2419200", 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": { 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_name", 2024-07-26T15:28:12.426 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "device_health_metrics", 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-26T15:28:12.427 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "retention_period": { 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retention_period", 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.428 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15552000", 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain device health metrics", 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.429 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_frequency": { 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_frequency", 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.430 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.431 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "self_heal": { 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "self_heal", 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.432 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:12.433 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and check device health", 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.435 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.436 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_threshold": { 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_threshold", 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.437 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7257600", 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.438 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "diskprediction_local", 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.439 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.440 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.442 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.443 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.445 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.446 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.448 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "predict_interval": { 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predict_interval", 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.449 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.450 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "predictor_model": { 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predictor_model", 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "prophetstor", 2024-07-26T15:28:12.451 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.452 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.453 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.454 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.455 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.456 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "influx", 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": false, 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "influxdb python module not found", 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "batch_size": { 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "batch_size", 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.457 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5000", 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.458 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "database": { 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "database", 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "ceph", 2024-07-26T15:28:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.460 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": { 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hostname", 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.461 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server hostname", 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:12.462 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "30", 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "5", 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.464 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.465 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.466 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.467 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.468 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.469 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.470 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.471 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.472 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "password": { 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "password", 2024-07-26T15:28:12.473 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "password of InfluxDB server user", 2024-07-26T15:28:12.474 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "port": { 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "port", 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.475 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8086", 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server port", 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.476 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.477 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "false", 2024-07-26T15:28:12.479 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: "threads": { 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threads", 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "32", 2024-07-26T15:28:12.481 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: "username": { 2024-07-26T15:28:12.482 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "username", 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "username of InfluxDB server user", 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "verify_ssl": { 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "verify_ssl", 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "true", 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "insights", 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.487 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.488 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.489 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.490 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.491 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.492 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.493 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.494 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.496 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "iostat", 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.498 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.499 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.500 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.501 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.502 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.503 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.504 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.506 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.507 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.508 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.509 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "k8sevents", 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_event_retention_days": { 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ceph_event_retention_days", 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.511 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.511 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7", 2024-07-26T15:28:12.539 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.539 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.540 INFO:teuthology.orchestra.run.smithi040.stdout: "config_check_secs": { 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_check_secs", 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "10", 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.541 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.542 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.543 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.544 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.545 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.545 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.545 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.545 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.545 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.546 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.546 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.546 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.546 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.546 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.546 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.548 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.549 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.550 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.551 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.552 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.553 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "localpool", 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.554 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "failure_domain": { 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "failure_domain", 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.555 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "host", 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "failure domain for any created local pool", 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.556 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.557 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.558 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.559 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.560 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.562 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.563 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.565 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": { 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_size", 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.566 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default min_size for any created local pool", 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.567 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "num_rep": { 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "num_rep", 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3", 2024-07-26T15:28:12.568 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default replica count for any created local pool", 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.569 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": { 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_num", 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "128", 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.570 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default pg_num for any created local pool", 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "prefix": { 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prefix", 2024-07-26T15:28:12.571 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.572 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name prefix for any created local pool", 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.573 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.574 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "subtree": { 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "subtree", 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.575 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "rack", 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.576 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mds_autoscaler", 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.577 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.579 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.580 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.581 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.582 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.583 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.584 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.585 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.586 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.587 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.588 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirroring", 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.589 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.590 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.591 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.593 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.594 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.595 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.596 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.600 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "nfs", 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.602 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.603 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.604 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.605 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.606 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.608 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.611 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-07-26T15:28:12.612 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.613 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.613 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.613 INFO:teuthology.orchestra.run.smithi040.stdout: "fail_fs": { 2024-07-26T15:28:12.613 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "fail_fs", 2024-07-26T15:28:12.613 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.614 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.615 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.616 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.617 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.618 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.619 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.621 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.623 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator": { 2024-07-26T15:28:12.624 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-07-26T15:28:12.625 INFO:teuthology.orchestra.run.smithi040.stdout: "rook", 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: "test_orchestrator" 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Orchestrator backend", 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.626 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.627 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.628 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_perf_query", 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.629 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.630 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.631 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.632 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.633 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.634 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.635 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.636 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.636 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.636 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.636 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.636 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.637 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.638 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.639 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.640 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_support", 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.641 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.643 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.645 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.646 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.647 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.648 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.649 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.650 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.651 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_autoscaler", 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.655 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.656 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.657 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.658 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.659 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.660 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.661 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.662 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.663 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.664 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.665 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "threshold": { 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threshold", 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1.0", 2024-07-26T15:28:12.667 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "scaling threshold", 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.668 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "progress", 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_pg_recovery_event": { 2024-07-26T15:28:12.669 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_pg_recovery_event", 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.670 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-07-26T15:28:12.671 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.672 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.673 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.674 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.675 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.676 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.677 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.678 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.679 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.680 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.681 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: "max_completed_events": { 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_completed_events", 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.682 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "50", 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "number of past completed events to remember", 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.683 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:12.684 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long the module is going to sleep", 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.685 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.686 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.687 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus", 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "cache": { 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cache", 2024-07-26T15:28:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.690 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.690 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: "exclude_perf_counters": { 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "exclude_perf_counters", 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.691 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.692 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.692 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.692 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.692 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-26T15:28:12.692 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-26T15:28:12.692 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.693 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.694 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.695 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.696 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.698 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.699 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools": { 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools", 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.703 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.704 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "300", 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.705 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_interval": { 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_interval", 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15.0", 2024-07-26T15:28:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.707 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.708 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:12.709 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "9283", 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.712 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: "stale_cache_strategy": { 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stale_cache_strategy", 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.713 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "log", 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "default", 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.715 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "default", 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "error" 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.716 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.717 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.718 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.719 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.720 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.721 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.724 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.725 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.726 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_snap_create": { 2024-07-26T15:28:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_snap_create", 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.729 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: "mirror_snapshot_schedule": { 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirror_snapshot_schedule", 2024-07-26T15:28:12.730 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.731 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.732 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.733 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "trash_purge_schedule": { 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "trash_purge_schedule", 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.734 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.735 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "restful", 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.736 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_auth": { 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_auth", 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.737 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-07-26T15:28:12.738 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.739 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.741 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.743 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.744 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.745 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.746 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.747 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.748 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.749 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.750 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.751 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.752 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.753 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.754 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rgw", 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.755 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.756 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.757 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.758 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.759 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.761 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.763 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "secondary_zone_period_retry_limit": { 2024-07-26T15:28:12.764 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.765 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.766 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.767 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.768 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rook", 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.770 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.771 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.772 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.773 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.774 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.776 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_class": { 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "storage_class", 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.780 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "local", 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "selftest", 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.784 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.785 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.786 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.787 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.788 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.789 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.790 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.791 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: "roption1": { 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption1", 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.792 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.793 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: "roption2": { 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption2", 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "xyz", 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.795 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption1": { 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption1", 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.796 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption2": { 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption2", 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.798 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption3": { 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption3", 2024-07-26T15:28:12.799 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.800 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption4": { 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption4", 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.801 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption5": { 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption5", 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.803 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.804 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption6": { 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption6", 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.805 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.806 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption7": { 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption7", 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:12.807 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "42", 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "testkey": { 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testkey", 2024-07-26T15:28:12.810 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.811 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "testlkey": { 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testlkey", 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.812 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.813 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: "testnewline": { 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testnewline", 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.814 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.815 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smb", 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "internal_store_backend": { 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "internal_store_backend", 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.817 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.818 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.819 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.820 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.821 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.822 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.824 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.825 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.826 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.827 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.828 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "update_orchestration": { 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "update_orchestration", 2024-07-26T15:28:12.829 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-26T15:28:12.830 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.831 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snap_schedule", 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_m_granularity": { 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_m_granularity", 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.832 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow minute scheduled snapshots", 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.833 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "dump_on_update": { 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dump_on_update", 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.834 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "dump database to debug log on update", 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.835 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.836 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.837 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.838 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.839 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.840 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.841 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.842 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.842 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.842 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.842 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.842 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.842 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.843 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.844 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.845 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.846 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stats", 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.847 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.848 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.849 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.850 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.851 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.852 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.853 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.854 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.855 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.856 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.858 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "status", 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.860 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.861 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.863 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.868 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.869 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.870 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telegraf", 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "address": { 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "address", 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.871 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.872 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.873 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.873 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:12.873 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:12.873 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.874 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.874 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.874 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15", 2024-07-26T15:28:12.874 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.877 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.878 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.878 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.878 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.878 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.879 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.879 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.879 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.879 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.881 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.882 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.883 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.883 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.883 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.883 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.883 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.884 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.884 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.884 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.884 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.884 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.886 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.887 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telemetry", 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.888 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_basic": { 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_basic", 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.890 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_crash": { 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_crash", 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.891 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.892 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_device": { 2024-07-26T15:28:12.894 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_device", 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.895 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_ident": { 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_ident", 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.897 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.897 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.897 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.897 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.897 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.897 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_perf": { 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_perf", 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.898 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.899 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "contact": { 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "contact", 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.900 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.901 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "description": { 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "description", 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.902 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.903 INFO:teuthology.orchestra.run.smithi040.stdout: "device_url": { 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_url", 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.904 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-07-26T15:28:12.905 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.906 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.907 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "24", 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "8", 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.908 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "last_opt_revision": { 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "last_opt_revision", 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1", 2024-07-26T15:28:12.909 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard": { 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard", 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard_description": { 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard_description", 2024-07-26T15:28:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.914 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.915 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.916 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.918 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.919 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.920 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.921 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.922 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "organization": { 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "organization", 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.923 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.924 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "proxy": { 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "proxy", 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.925 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.926 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.927 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "url": { 2024-07-26T15:28:12.928 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url", 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.929 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.930 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "test_orchestrator", 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.931 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.933 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.934 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.935 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.936 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.937 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.938 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.939 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.940 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.942 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.944 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.945 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.946 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.949 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.950 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_clones": { 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_clones", 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4", 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "periodic_async_work": { 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "periodic_async_work", 2024-07-26T15:28:12.953 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Periodically check for async work", 2024-07-26T15:28:12.954 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_delay": { 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_delay", 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.955 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.956 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_no_wait": { 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_no_wait", 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.957 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.958 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.959 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.960 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix", 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: "discovery_interval": { 2024-07-26T15:28:12.961 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "discovery_interval", 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "100", 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.962 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "identifier": { 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "identifier", 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.963 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.964 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.966 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.967 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.968 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.970 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.971 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.972 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.974 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.975 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.976 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.977 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_host": { 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_host", 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.978 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.979 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_port": { 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_port", 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10051", 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.980 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_sender": { 2024-07-26T15:28:12.981 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_sender", 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.982 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:12.983 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: "gid": 34109, 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "y", 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr_features": 4540701547738038271, 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: "available_modules": [ 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "alerts", 2024-07-26T15:28:12.984 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.985 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How frequently to reexamine health status", 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.986 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.988 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:12.989 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.990 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:12.991 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:12.992 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.993 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.994 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_destination": { 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_destination", 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.996 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email address to send alerts to", 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.997 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_from_name": { 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_from_name", 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "Ceph", 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:12.998 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email From: name", 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_host": { 2024-07-26T15:28:12.999 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_host", 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.000 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP server", 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_password": { 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_password", 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.001 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Password to authenticate with", 2024-07-26T15:28:13.002 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_port": { 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_port", 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.003 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "465", 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP port", 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.004 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_sender": { 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_sender", 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP envelope sender", 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_ssl": { 2024-07-26T15:28:13.006 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_ssl", 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_user": { 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_user", 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.008 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "User to authenticate as", 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.009 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.010 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.011 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "balancer", 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.012 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "active": { 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "active", 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.013 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically balance PGs across cluster", 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_time": { 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_time", 2024-07-26T15:28:13.014 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0000", 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "beginning time of day to automatically balance", 2024-07-26T15:28:13.015 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_weekday": { 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_weekday", 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.016 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.017 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_max_iterations": { 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_max_iterations", 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "25", 2024-07-26T15:28:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "250", 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.019 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_metrics": { 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_metrics", 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "pgs,objects,bytes", 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.020 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_step": { 2024-07-26T15:28:13.021 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_step", 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.5", 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0.001", 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "0.999", 2024-07-26T15:28:13.022 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "aggressiveness of optimization", 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: "end_time": { 2024-07-26T15:28:13.023 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_time", 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2359", 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.024 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ending time of day to automatically balance", 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "end_weekday": { 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_weekday", 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.025 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T15:28:13.026 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.027 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.028 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.031 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.033 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.034 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.035 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "min_score": { 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_score", 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-07-26T15:28:13.037 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "upmap", 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.038 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-compat", 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "none", 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "read", 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap", 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap-read" 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Balancer mode", 2024-07-26T15:28:13.039 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_ids": { 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_ids", 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.041 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.042 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.044 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.045 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_deviation": { 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_deviation", 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.046 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_optimizations": { 2024-07-26T15:28:13.047 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_optimizations", 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.048 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.049 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm", 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_down_multiplier": { 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_down_multiplier", 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.051 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_refresh_rate": { 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_refresh_rate", 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.052 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "20", 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.053 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_starting_port": { 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_starting_port", 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4721", 2024-07-26T15:28:13.054 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.055 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_ptrace": { 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_ptrace", 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.056 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_interval": { 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_interval", 2024-07-26T15:28:13.057 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.058 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_memory_target_ratio": { 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_memory_target_ratio", 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.059 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.7", 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.060 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm_log_destination": { 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm_log_destination", 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "file", 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "file,syslog", 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: "syslog" 2024-07-26T15:28:13.062 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "cgroups_split": { 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cgroups_split", 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.063 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.064 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.064 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.064 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.064 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.064 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.064 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "config_checks_enabled": { 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_checks_enabled", 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.065 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.066 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "config_dashboard": { 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_dashboard", 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.067 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_alertmanager": { 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_alertmanager", 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.069 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.070 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_base": { 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_base", 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.071 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Container image name, without the tag", 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_elasticsearch": { 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_elasticsearch", 2024-07-26T15:28:13.072 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "elasticsearch container image", 2024-07-26T15:28:13.073 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_grafana": { 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_grafana", 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.075 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_haproxy": { 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_haproxy", 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.076 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "HAproxy container image", 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_agent": { 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_agent", 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger agent container image", 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_collector": { 2024-07-26T15:28:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_collector", 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.080 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger collector container image", 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_query": { 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_query", 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger query container image", 2024-07-26T15:28:13.082 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_keepalived": { 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_keepalived", 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.083 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Keepalived container image", 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.084 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_loki": { 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_loki", 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.085 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Loki container image", 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.086 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nginx": { 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nginx", 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.087 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nginx container image", 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_node_exporter": { 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_node_exporter", 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nvmeof": { 2024-07-26T15:28:13.090 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nvmeof", 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.091 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nvme-of container image", 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_prometheus": { 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_prometheus", 2024-07-26T15:28:13.092 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_promtail": { 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_promtail", 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Promtail container image", 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.095 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.096 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.096 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.096 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_samba": { 2024-07-26T15:28:13.096 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_samba", 2024-07-26T15:28:13.096 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.098 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Samba/SMB container image", 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_snmp_gateway": { 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_snmp_gateway", 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.099 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SNMP Gateway container image", 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.100 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "container_init": { 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_init", 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.101 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Run podman/docker with `--init`", 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.102 INFO:teuthology.orchestra.run.smithi040.stdout: "daemon_cache_timeout": { 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "daemon_cache_timeout", 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.103 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "default_cephadm_command_timeout": { 2024-07-26T15:28:13.104 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_cephadm_command_timeout", 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "900", 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.105 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: "default_registry": { 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_registry", 2024-07-26T15:28:13.106 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io", 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-26T15:28:13.107 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "device_cache_timeout": { 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_cache_timeout", 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1800", 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache device inventory", 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.109 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "device_enhanced_scan": { 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_enhanced_scan", 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.110 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.111 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "facts_cache_timeout": { 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "facts_cache_timeout", 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.112 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache host facts data", 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.113 INFO:teuthology.orchestra.run.smithi040.stdout: "grafana_dashboards_path": { 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "grafana_dashboards_path", 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.114 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "host_check_interval": { 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "host_check_interval", 2024-07-26T15:28:13.115 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to perform a host check", 2024-07-26T15:28:13.116 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "hw_monitoring": { 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hw_monitoring", 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.117 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.118 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "inventory_list_all": { 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "inventory_list_all", 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.120 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.121 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.122 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "log_refresh_metadata": { 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_refresh_metadata", 2024-07-26T15:28:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-26T15:28:13.124 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.125 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.126 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.127 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.128 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.129 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.130 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.131 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.132 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-26T15:28:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "*", 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-26T15:28:13.134 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "max_count_per_host": { 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_count_per_host", 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.135 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of daemons per service per host", 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.136 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd_draining_count": { 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_osd_draining_count", 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.137 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "migration_current": { 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "migration_current", 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.139 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "internal - do not modify", 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-07-26T15:28:13.140 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "root", 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.141 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm-package", 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: "root" 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "mode for remote execution of cephadm", 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.142 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "oob_default_addr": { 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "oob_default_addr", 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "169.254.1.1", 2024-07-26T15:28:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "prometheus_alerts_path": { 2024-07-26T15:28:13.144 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus_alerts_path", 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.145 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_insecure": { 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_insecure", 2024-07-26T15:28:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.147 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_password": { 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_password", 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.149 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_url": { 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_url", 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.150 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_username": { 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_username", 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.153 INFO:teuthology.orchestra.run.smithi040.stdout: "secure_monitoring_stack": { 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secure_monitoring_stack", 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "service_discovery_port": { 2024-07-26T15:28:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "service_discovery_port", 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8765", 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.156 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "cephadm service discovery port", 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.157 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.158 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: "ssh_config_file": { 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssh_config_file", 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.159 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: "use_agent": { 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_agent", 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.162 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "use_repo_digest": { 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_repo_digest", 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.163 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.164 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_failed_host_check": { 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_failed_host_check", 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.165 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if the host check fails", 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_daemons": { 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_daemons", 2024-07-26T15:28:13.166 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-26T15:28:13.167 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_hosts": { 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_hosts", 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.168 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.169 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crash", 2024-07-26T15:28:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.171 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.172 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.173 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.174 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.175 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.176 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.178 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.179 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "retain_interval": { 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retain_interval", 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.180 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "31536000", 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.181 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.182 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_recent_interval": { 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_recent_interval", 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1209600", 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.184 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.185 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dashboard", 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-26T15:28:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.187 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_HOST": { 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.188 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.189 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.190 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_ENABLED": { 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_ENABLED", 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.192 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.193 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.194 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.195 INFO:teuthology.orchestra.run.smithi040.stdout: "ENABLE_BROWSABLE_API": { 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.196 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-26T15:28:13.197 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.198 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.199 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.200 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.201 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.205 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-26T15:28:13.206 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.207 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.208 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.209 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.210 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.211 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_PASSWORD": { 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_URL": { 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_URL", 2024-07-26T15:28:13.215 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.216 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_USERNAME": { 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.217 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.218 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.219 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.220 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.221 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-26T15:28:13.222 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.224 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "[]", 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.227 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "MULTICLUSTER_CONFIG": { 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "{}", 2024-07-26T15:28:13.228 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.229 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.229 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.229 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.229 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.229 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.229 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_HOST": { 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.230 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.231 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.232 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-26T15:28:13.233 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.234 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-26T15:28:13.235 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.236 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.238 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.240 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.241 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.242 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.243 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-26T15:28:13.244 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.245 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_ENABLED": { 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-26T15:28:13.246 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.247 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.248 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.249 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.250 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.251 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.252 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8", 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.253 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "45", 2024-07-26T15:28:13.254 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.255 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ACCESS_KEY": { 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.256 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-26T15:28:13.257 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.258 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SECRET_KEY": { 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.259 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.260 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SSL_VERIFY": { 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.261 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "UNSAFE_TLS_v1_2": { 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.263 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.265 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-26T15:28:13.266 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.267 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.269 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: "cross_origin_url": { 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cross_origin_url", 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.270 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.271 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "crt_file": { 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crt_file", 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.272 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.273 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "debug": { 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "debug", 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.274 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable/disable debug options", 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "jwt_token_ttl": { 2024-07-26T15:28:13.275 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "jwt_token_ttl", 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "28800", 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.276 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.278 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.279 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.280 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.281 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.282 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.283 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.284 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.285 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.286 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.287 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: "motd": { 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "motd", 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.288 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "The message of the day", 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.289 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_resolve_ip_addr": { 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "redirect_resolve_ip_addr", 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.290 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.292 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.293 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8080", 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.294 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.295 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.296 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.298 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.299 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.299 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.302 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl_server_port": { 2024-07-26T15:28:13.302 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl_server_port", 2024-07-26T15:28:13.302 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.302 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8443", 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "redirect", 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect" 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.307 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "url_prefix": { 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url_prefix", 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.308 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_monitoring": { 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_monitoring", 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.311 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "monitor device health metrics", 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.312 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.313 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.314 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.315 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.316 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.317 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.318 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.319 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.320 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "mark_out_threshold": { 2024-07-26T15:28:13.321 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mark_out_threshold", 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2419200", 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.322 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": { 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_name", 2024-07-26T15:28:13.323 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "device_health_metrics", 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-26T15:28:13.324 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.325 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.325 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.325 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.325 INFO:teuthology.orchestra.run.smithi040.stdout: "retention_period": { 2024-07-26T15:28:13.325 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retention_period", 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15552000", 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.326 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain device health metrics", 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_frequency": { 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_frequency", 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.327 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.328 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "self_heal": { 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "self_heal", 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.329 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.330 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.331 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and check device health", 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.333 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_threshold": { 2024-07-26T15:28:13.334 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_threshold", 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7257600", 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.336 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "diskprediction_local", 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.337 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.340 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.342 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.344 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.345 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "predict_interval": { 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predict_interval", 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.346 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.347 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "predictor_model": { 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predictor_model", 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "prophetstor", 2024-07-26T15:28:13.348 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.349 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.349 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.349 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.349 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.349 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.349 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.350 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.351 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.352 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.353 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "influx", 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": false, 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "influxdb python module not found", 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "batch_size": { 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "batch_size", 2024-07-26T15:28:13.354 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5000", 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-26T15:28:13.355 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "database": { 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "database", 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.356 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "ceph", 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": { 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hostname", 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server hostname", 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.359 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "30", 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "5", 2024-07-26T15:28:13.360 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.361 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.363 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.364 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.365 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.366 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.367 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.368 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.369 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.370 INFO:teuthology.orchestra.run.smithi040.stdout: "password": { 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "password", 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.371 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "password of InfluxDB server user", 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: "port": { 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "port", 2024-07-26T15:28:13.372 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8086", 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.373 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server port", 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.374 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.375 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.376 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "false", 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.377 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "threads": { 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threads", 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:13.378 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "32", 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.379 INFO:teuthology.orchestra.run.smithi040.stdout: "username": { 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "username", 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.380 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "username of InfluxDB server user", 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "verify_ssl": { 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "verify_ssl", 2024-07-26T15:28:13.381 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "true", 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.382 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.383 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "insights", 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.386 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.387 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.388 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.390 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.391 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.392 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.393 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.394 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "iostat", 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.396 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.398 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.398 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.398 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.398 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.398 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.398 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.399 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.400 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.402 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.403 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.404 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.405 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.406 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "k8sevents", 2024-07-26T15:28:13.407 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_event_retention_days": { 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ceph_event_retention_days", 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.408 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7", 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.409 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "config_check_secs": { 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_check_secs", 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "10", 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.411 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.412 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.413 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.415 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.416 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.417 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.417 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.417 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.417 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.417 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.417 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.418 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.420 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.421 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.422 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "localpool", 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: "failure_domain": { 2024-07-26T15:28:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "failure_domain", 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "host", 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "failure domain for any created local pool", 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.425 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.426 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.427 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.428 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.429 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.431 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.432 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.433 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": { 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_size", 2024-07-26T15:28:13.434 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default min_size for any created local pool", 2024-07-26T15:28:13.435 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "num_rep": { 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "num_rep", 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.436 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3", 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default replica count for any created local pool", 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.437 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": { 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_num", 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.438 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "128", 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default pg_num for any created local pool", 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.439 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "prefix": { 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prefix", 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.440 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name prefix for any created local pool", 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.441 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.442 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "subtree": { 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "subtree", 2024-07-26T15:28:13.443 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "rack", 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-26T15:28:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mds_autoscaler", 2024-07-26T15:28:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.447 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.448 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.449 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.452 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.453 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.454 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.455 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.456 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirroring", 2024-07-26T15:28:13.457 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.458 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.459 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.462 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.463 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.464 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.465 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.466 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.468 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "nfs", 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.469 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.470 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.471 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.472 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.473 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.474 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.475 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.476 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.477 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.478 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.479 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.480 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: "fail_fs": { 2024-07-26T15:28:13.481 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "fail_fs", 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.482 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.484 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.485 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.486 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.489 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.491 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.492 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator": { 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.493 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: "rook", 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: "test_orchestrator" 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Orchestrator backend", 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.494 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.495 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.496 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_perf_query", 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.497 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.498 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.499 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.500 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.501 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.503 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.504 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.505 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.507 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.508 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_support", 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.510 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.511 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.513 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.514 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.516 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.517 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.518 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.519 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.520 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_autoscaler", 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.522 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.523 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.524 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.525 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.526 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.528 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.529 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:13.530 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.531 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.532 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.533 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "threshold": { 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threshold", 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.534 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1.0", 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "scaling threshold", 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.535 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "progress", 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.536 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_pg_recovery_event": { 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_pg_recovery_event", 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.537 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.538 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: "max_completed_events": { 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_completed_events", 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "50", 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "number of past completed events to remember", 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.552 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long the module is going to sleep", 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.554 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus", 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "cache": { 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cache", 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.556 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.557 INFO:teuthology.orchestra.run.smithi040.stdout: "exclude_perf_counters": { 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "exclude_perf_counters", 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.558 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.559 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.560 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.562 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.563 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.564 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.565 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.566 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.567 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools": { 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools", 2024-07-26T15:28:13.568 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.569 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.570 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "300", 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.571 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_interval": { 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_interval", 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.572 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15.0", 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.573 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.574 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:13.575 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "9283", 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.576 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.577 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "stale_cache_strategy": { 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stale_cache_strategy", 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.579 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "log", 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.580 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "default", 2024-07-26T15:28:13.581 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "default", 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "error" 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.582 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.583 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.584 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.585 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.586 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.587 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.589 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.590 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.591 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.592 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.594 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_snap_create": { 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_snap_create", 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.595 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "mirror_snapshot_schedule": { 2024-07-26T15:28:13.596 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirror_snapshot_schedule", 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.597 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.598 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.599 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "trash_purge_schedule": { 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "trash_purge_schedule", 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.600 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.601 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "restful", 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.602 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_auth": { 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_auth", 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.604 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.607 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.608 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.610 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.611 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.612 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.614 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:13.615 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.616 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.617 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.618 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.619 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.620 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rgw", 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.621 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.622 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.623 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.624 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.625 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.626 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.627 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.628 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.629 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.630 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "secondary_zone_period_retry_limit": { 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:13.631 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.633 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.634 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rook", 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.642 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.643 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.644 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_class": { 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "storage_class", 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "local", 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "selftest", 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.654 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.655 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.656 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.657 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: "roption1": { 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption1", 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.658 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.659 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: "roption2": { 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption2", 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.660 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "xyz", 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption1": { 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption1", 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.663 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption2": { 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption2", 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.664 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption3": { 2024-07-26T15:28:13.665 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption3", 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.666 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption4": { 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption4", 2024-07-26T15:28:13.667 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.668 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption5": { 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption5", 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.670 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption6": { 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption6", 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.671 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption7": { 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption7", 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.673 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "42", 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.674 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.675 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.676 INFO:teuthology.orchestra.run.smithi040.stdout: "testkey": { 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testkey", 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "testlkey": { 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testlkey", 2024-07-26T15:28:13.678 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.679 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: "testnewline": { 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testnewline", 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.680 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.681 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smb", 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.682 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "internal_store_backend": { 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "internal_store_backend", 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.683 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.684 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.691 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.692 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.693 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.694 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "update_orchestration": { 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "update_orchestration", 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.696 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.697 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snap_schedule", 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.698 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_m_granularity": { 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_m_granularity", 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.699 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow minute scheduled snapshots", 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "dump_on_update": { 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dump_on_update", 2024-07-26T15:28:13.700 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "dump database to debug log on update", 2024-07-26T15:28:13.701 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.702 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.703 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.705 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.706 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.707 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.707 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.707 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.707 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.707 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.710 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.710 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.710 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.712 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.713 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.714 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.715 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stats", 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.716 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.721 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.722 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.723 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.724 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.725 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.726 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.727 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "status", 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.728 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.733 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.734 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.735 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.736 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.737 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.738 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.739 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telegraf", 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "address": { 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "address", 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.740 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.742 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15", 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.743 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.747 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.748 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.749 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.751 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.752 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.754 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telemetry", 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_basic": { 2024-07-26T15:28:13.755 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_basic", 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.756 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_crash": { 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_crash", 2024-07-26T15:28:13.757 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-26T15:28:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_device": { 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_device", 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.759 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_ident": { 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_ident", 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.761 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_perf": { 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_perf", 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.763 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "contact": { 2024-07-26T15:28:13.764 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "contact", 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.765 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: "description": { 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "description", 2024-07-26T15:28:13.766 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "device_url": { 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_url", 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.768 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.769 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.770 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.771 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "24", 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "8", 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.772 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "last_opt_revision": { 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "last_opt_revision", 2024-07-26T15:28:13.773 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1", 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.774 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard": { 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard", 2024-07-26T15:28:13.775 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.776 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard_description": { 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard_description", 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.777 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.778 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.779 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.780 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.782 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.783 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.784 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.785 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.786 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.787 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "organization": { 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "organization", 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.788 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "proxy": { 2024-07-26T15:28:13.789 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "proxy", 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.790 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.792 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "url": { 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url", 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.793 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.794 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "test_orchestrator", 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.795 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.796 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.797 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.798 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.799 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.800 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.801 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.802 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.803 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.804 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.805 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.811 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.812 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.813 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.815 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_clones": { 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_clones", 2024-07-26T15:28:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4", 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.817 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "periodic_async_work": { 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "periodic_async_work", 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.818 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Periodically check for async work", 2024-07-26T15:28:13.819 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_delay": { 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_delay", 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_no_wait": { 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_no_wait", 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.822 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.823 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.824 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.825 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix", 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.826 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "discovery_interval": { 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "discovery_interval", 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "100", 2024-07-26T15:28:13.827 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.828 INFO:teuthology.orchestra.run.smithi040.stdout: "identifier": { 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "identifier", 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.829 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:13.830 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.831 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.832 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.833 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.835 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.838 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.839 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.840 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.841 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.842 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_host": { 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_host", 2024-07-26T15:28:13.843 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.844 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_port": { 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_port", 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.845 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10051", 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.846 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_sender": { 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_sender", 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.847 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.848 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: "modules": [ 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-07-26T15:28:13.849 INFO:teuthology.orchestra.run.smithi040.stdout: "dashboard", 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: "iostat", 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: "nfs", 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: "restful" 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: "available_modules": [ 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.850 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "alerts", 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How frequently to reexamine health status", 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.852 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.853 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.854 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.855 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.858 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.858 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.858 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.858 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.859 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.860 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.861 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.862 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.864 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_destination": { 2024-07-26T15:28:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_destination", 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.866 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email address to send alerts to", 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_from_name": { 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_from_name", 2024-07-26T15:28:13.867 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "Ceph", 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email From: name", 2024-07-26T15:28:13.868 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_host": { 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_host", 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.869 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP server", 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.870 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_password": { 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_password", 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.871 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Password to authenticate with", 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_port": { 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_port", 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "465", 2024-07-26T15:28:13.873 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP port", 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.874 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_sender": { 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_sender", 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.875 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP envelope sender", 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_ssl": { 2024-07-26T15:28:13.876 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_ssl", 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.877 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use SSL to connect to SMTP server", 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_user": { 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_user", 2024-07-26T15:28:13.878 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "User to authenticate as", 2024-07-26T15:28:13.879 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.880 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.881 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "balancer", 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.882 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "active": { 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "active", 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.883 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically balance PGs across cluster", 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_time": { 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_time", 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0000", 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.885 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "beginning time of day to automatically balance", 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_weekday": { 2024-07-26T15:28:13.886 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_weekday", 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-07-26T15:28:13.887 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_max_iterations": { 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_max_iterations", 2024-07-26T15:28:13.888 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "25", 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "250", 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.889 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_metrics": { 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_metrics", 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.890 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "pgs,objects,bytes", 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-07-26T15:28:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_step": { 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_step", 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.5", 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0.001", 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "0.999", 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "aggressiveness of optimization", 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: "end_time": { 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_time", 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.894 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2359", 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ending time of day to automatically balance", 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.895 INFO:teuthology.orchestra.run.smithi040.stdout: "end_weekday": { 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_weekday", 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-07-26T15:28:13.896 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.898 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.899 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.900 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.901 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.902 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.903 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.904 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.905 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.906 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "min_score": { 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_score", 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-07-26T15:28:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "upmap", 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.909 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-compat", 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "none", 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "read", 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap", 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap-read" 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Balancer mode", 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.910 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_ids": { 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_ids", 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.911 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.912 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.913 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.914 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_deviation": { 2024-07-26T15:28:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_deviation", 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "deviation below which no optimization is attempted", 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_optimizations": { 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_optimizations", 2024-07-26T15:28:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-07-26T15:28:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:13.920 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm", 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_down_multiplier": { 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_down_multiplier", 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.921 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_refresh_rate": { 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_refresh_rate", 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "20", 2024-07-26T15:28:13.923 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_starting_port": { 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_starting_port", 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4721", 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.925 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_ptrace": { 2024-07-26T15:28:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_ptrace", 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_interval": { 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_interval", 2024-07-26T15:28:13.928 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to autotune daemon memory", 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_memory_target_ratio": { 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_memory_target_ratio", 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:13.930 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.7", 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.931 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm_log_destination": { 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm_log_destination", 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.932 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "file", 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "file,syslog", 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: "syslog" 2024-07-26T15:28:13.933 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: "cgroups_split": { 2024-07-26T15:28:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cgroups_split", 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.935 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: "config_checks_enabled": { 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_checks_enabled", 2024-07-26T15:28:13.936 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-07-26T15:28:13.937 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: "config_dashboard": { 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_dashboard", 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.939 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_alertmanager": { 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_alertmanager", 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.940 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.941 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_base": { 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_base", 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.942 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/ceph", 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Container image name, without the tag", 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.943 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_elasticsearch": { 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_elasticsearch", 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-07-26T15:28:13.944 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "elasticsearch container image", 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.945 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_grafana": { 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_grafana", 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.946 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_haproxy": { 2024-07-26T15:28:13.947 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_haproxy", 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.948 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "HAproxy container image", 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_agent": { 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_agent", 2024-07-26T15:28:13.949 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger agent container image", 2024-07-26T15:28:13.950 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_collector": { 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_collector", 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.951 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger collector container image", 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_query": { 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_query", 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.953 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger query container image", 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.954 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_keepalived": { 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_keepalived", 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-07-26T15:28:13.955 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Keepalived container image", 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.956 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_loki": { 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_loki", 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.957 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Loki container image", 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nginx": { 2024-07-26T15:28:13.958 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nginx", 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nginx container image", 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_node_exporter": { 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_node_exporter", 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.961 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nvmeof": { 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nvmeof", 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nvme-of container image", 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.963 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_prometheus": { 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_prometheus", 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-07-26T15:28:13.964 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.965 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_promtail": { 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_promtail", 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-07-26T15:28:13.966 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Promtail container image", 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_samba": { 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_samba", 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.968 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Samba/SMB container image", 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_snmp_gateway": { 2024-07-26T15:28:13.969 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_snmp_gateway", 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.970 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SNMP Gateway container image", 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "container_init": { 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_init", 2024-07-26T15:28:13.971 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Run podman/docker with `--init`", 2024-07-26T15:28:13.972 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: "daemon_cache_timeout": { 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "daemon_cache_timeout", 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.973 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.974 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: "default_cephadm_command_timeout": { 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_cephadm_command_timeout", 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.975 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "900", 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.976 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "default_registry": { 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_registry", 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io", 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.977 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.978 INFO:teuthology.orchestra.run.smithi040.stdout: "device_cache_timeout": { 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_cache_timeout", 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1800", 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.979 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache device inventory", 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "device_enhanced_scan": { 2024-07-26T15:28:13.980 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_enhanced_scan", 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use libstoragemgmt during device scans", 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: "facts_cache_timeout": { 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "facts_cache_timeout", 2024-07-26T15:28:13.982 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache host facts data", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.983 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "grafana_dashboards_path": { 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "grafana_dashboards_path", 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-07-26T15:28:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.985 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "host_check_interval": { 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "host_check_interval", 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.986 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to perform a host check", 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "hw_monitoring": { 2024-07-26T15:28:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hw_monitoring", 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.988 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: "inventory_list_all": { 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "inventory_list_all", 2024-07-26T15:28:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-07-26T15:28:13.990 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.991 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.992 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:13.993 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: "log_refresh_metadata": { 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_refresh_metadata", 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.994 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.995 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:13.996 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:13.997 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.000 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.001 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf": { 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.003 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.004 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "*", 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.005 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "max_count_per_host": { 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_count_per_host", 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of daemons per service per host", 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.007 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd_draining_count": { 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_osd_draining_count", 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "migration_current": { 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "migration_current", 2024-07-26T15:28:14.009 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "internal - do not modify", 2024-07-26T15:28:14.010 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.011 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "root", 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm-package", 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "root" 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "mode for remote execution of cephadm", 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: "oob_default_addr": { 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "oob_default_addr", 2024-07-26T15:28:14.013 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "169.254.1.1", 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.014 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default address for RedFish API (oob management).", 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "prometheus_alerts_path": { 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus_alerts_path", 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.015 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-07-26T15:28:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_insecure": { 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_insecure", 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.017 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.018 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_password": { 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_password", 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.019 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.020 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_url": { 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_url", 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_username": { 2024-07-26T15:28:14.022 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_username", 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.023 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: "secure_monitoring_stack": { 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secure_monitoring_stack", 2024-07-26T15:28:14.024 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-07-26T15:28:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "service_discovery_port": { 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "service_discovery_port", 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8765", 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "cephadm service discovery port", 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.027 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.028 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.029 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "ssh_config_file": { 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssh_config_file", 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.030 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "use_agent": { 2024-07-26T15:28:14.031 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_agent", 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.032 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "use_repo_digest": { 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_repo_digest", 2024-07-26T15:28:14.033 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-07-26T15:28:14.034 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_failed_host_check": { 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_failed_host_check", 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if the host check fails", 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.036 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_daemons": { 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_daemons", 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.037 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.038 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_hosts": { 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_hosts", 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.039 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crash", 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.042 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.043 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.044 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.049 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.050 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: "retain_interval": { 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retain_interval", 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "31536000", 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain crashes before pruning them", 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.052 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.053 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_recent_interval": { 2024-07-26T15:28:14.054 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_recent_interval", 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1209600", 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.055 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "time interval in which to warn about recent crashes", 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.056 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dashboard", 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.057 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.058 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_HOST": { 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_HOST", 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.059 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.061 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_ENABLED": { 2024-07-26T15:28:14.062 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_ENABLED", 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.063 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.064 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.065 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: "ENABLE_BROWSABLE_API": { 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ENABLE_BROWSABLE_API", 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.066 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.070 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-07-26T15:28:14.071 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.072 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-07-26T15:28:14.073 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.074 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_NFS": { 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.075 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.076 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RBD": { 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.077 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RGW": { 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.079 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.080 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.081 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_PASSWORD": { 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_PASSWORD", 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.082 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.083 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_URL": { 2024-07-26T15:28:14.085 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_URL", 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.086 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_USERNAME": { 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_USERNAME", 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.087 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.088 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.089 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-07-26T15:28:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.093 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: "ISSUE_TRACKER_API_KEY": { 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.095 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "MANAGED_BY_CLUSTERS": { 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "[]", 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.096 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.097 INFO:teuthology.orchestra.run.smithi040.stdout: "MULTICLUSTER_CONFIG": { 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "MULTICLUSTER_CONFIG", 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "{}", 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.098 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_HOST": { 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_HOST", 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.099 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.100 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.101 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.103 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-07-26T15:28:14.104 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.105 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-07-26T15:28:14.106 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.107 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.109 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.110 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-07-26T15:28:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.112 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.113 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_ENABLED": { 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_ENABLED", 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.115 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.116 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.117 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-07-26T15:28:14.118 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.119 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.120 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8", 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.121 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: "REST_REQUESTS_TIMEOUT": { 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.122 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "45", 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.123 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ACCESS_KEY": { 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ACCESS_KEY", 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.124 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.125 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.126 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SECRET_KEY": { 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SECRET_KEY", 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.127 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.128 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SSL_VERIFY": { 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SSL_VERIFY", 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.129 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "UNSAFE_TLS_v1_2": { 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "UNSAFE_TLS_v1_2", 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.130 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.131 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.132 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.134 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-07-26T15:28:14.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.136 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "cross_origin_url": { 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cross_origin_url", 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.137 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.138 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "crt_file": { 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crt_file", 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.139 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.140 INFO:teuthology.orchestra.run.smithi040.stdout: "debug": { 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "debug", 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable/disable debug options", 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: "jwt_token_ttl": { 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "jwt_token_ttl", 2024-07-26T15:28:14.142 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "28800", 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.143 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.144 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.146 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.147 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.148 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.149 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.150 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.152 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.153 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.154 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "motd": { 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "motd", 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "The message of the day", 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.156 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_resolve_ip_addr": { 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "redirect_resolve_ip_addr", 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.157 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:14.158 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.159 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.160 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8080", 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.161 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.162 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.163 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.164 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.165 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl_server_port": { 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl_server_port", 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8443", 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.166 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-07-26T15:28:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "redirect", 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.168 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect" 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-07-26T15:28:14.169 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.170 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: "url_prefix": { 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url_prefix", 2024-07-26T15:28:14.171 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.172 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-07-26T15:28:14.173 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_monitoring": { 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_monitoring", 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.174 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "monitor device health metrics", 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.175 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.178 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.179 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.180 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.183 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.184 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: "mark_out_threshold": { 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mark_out_threshold", 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2419200", 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.186 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": { 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_name", 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "device_health_metrics", 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.187 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name of pool in which to store device health metrics", 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.188 INFO:teuthology.orchestra.run.smithi040.stdout: "retention_period": { 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retention_period", 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15552000", 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.189 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain device health metrics", 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_frequency": { 2024-07-26T15:28:14.190 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_frequency", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to scrape device health metrics", 2024-07-26T15:28:14.191 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: "self_heal": { 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "self_heal", 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.193 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and check device health", 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.195 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.196 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_threshold": { 2024-07-26T15:28:14.197 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_threshold", 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7257600", 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.198 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.199 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "diskprediction_local", 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.200 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.202 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.203 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.207 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.208 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "predict_interval": { 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predict_interval", 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-07-26T15:28:14.209 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.210 INFO:teuthology.orchestra.run.smithi040.stdout: "predictor_model": { 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predictor_model", 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "prophetstor", 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.211 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.212 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.213 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.214 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.215 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "influx", 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": false, 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "influxdb python module not found", 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: "batch_size": { 2024-07-26T15:28:14.216 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "batch_size", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5000", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-07-26T15:28:14.217 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "database": { 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "database", 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.218 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "ceph", 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.219 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": { 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hostname", 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.220 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server hostname", 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.221 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "30", 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "5", 2024-07-26T15:28:14.222 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.223 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.224 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.225 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.226 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.227 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.228 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.230 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.231 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.231 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.231 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.231 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.231 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.231 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.232 INFO:teuthology.orchestra.run.smithi040.stdout: "password": { 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "password", 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.233 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "password of InfluxDB server user", 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: "port": { 2024-07-26T15:28:14.234 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "port", 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8086", 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.235 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server port", 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.236 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.237 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.238 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "false", 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "threads": { 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threads", 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "32", 2024-07-26T15:28:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "username": { 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "username", 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.241 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "username of InfluxDB server user", 2024-07-26T15:28:14.242 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "verify_ssl": { 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "verify_ssl", 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "true", 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.244 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "insights", 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.245 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.246 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.247 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.248 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.249 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.250 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.252 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.254 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.255 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.256 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "iostat", 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.257 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.259 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.260 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.262 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.263 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.264 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.265 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.266 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.268 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "k8sevents", 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_event_retention_days": { 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ceph_event_retention_days", 2024-07-26T15:28:14.269 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7", 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Days to hold ceph event information within local cache", 2024-07-26T15:28:14.270 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "config_check_secs": { 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_check_secs", 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.271 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "10", 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.272 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.273 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.274 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.275 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.277 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.278 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.279 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.280 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.281 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.282 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "localpool", 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "failure_domain": { 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "failure_domain", 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "host", 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.285 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "failure domain for any created local pool", 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.286 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.287 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.288 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.289 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.290 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.291 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.293 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.294 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": { 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_size", 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.295 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default min_size for any created local pool", 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-07-26T15:28:14.296 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "num_rep": { 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "num_rep", 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.297 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3", 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default replica count for any created local pool", 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.298 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": { 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_num", 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "128", 2024-07-26T15:28:14.299 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default pg_num for any created local pool", 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.300 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "prefix": { 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prefix", 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.301 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name prefix for any created local pool", 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.303 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "subtree": { 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "subtree", 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.304 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "rack", 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "CRUSH level for which to create a local pool", 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-07-26T15:28:14.305 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mds_autoscaler", 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.306 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.307 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.308 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.309 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.310 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.313 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.314 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.315 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.316 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirroring", 2024-07-26T15:28:14.317 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.318 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.319 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.320 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.321 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.322 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.323 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.324 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.325 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.326 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.327 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "nfs", 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.329 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.331 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.333 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.334 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.335 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.336 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.337 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.338 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.339 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.340 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "fail_fs": { 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "fail_fs", 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.341 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.342 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.343 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.344 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.345 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.346 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.347 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.348 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.350 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.351 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.351 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.351 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.351 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.352 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.352 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.353 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator": { 2024-07-26T15:28:14.353 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-07-26T15:28:14.353 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.353 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.354 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.354 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.354 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.354 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.354 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.355 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-07-26T15:28:14.355 INFO:teuthology.orchestra.run.smithi040.stdout: "rook", 2024-07-26T15:28:14.355 INFO:teuthology.orchestra.run.smithi040.stdout: "test_orchestrator" 2024-07-26T15:28:14.355 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.355 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Orchestrator backend", 2024-07-26T15:28:14.356 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.356 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.356 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.357 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.357 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.357 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.357 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.357 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.358 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.358 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.358 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.358 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.358 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.359 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.359 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.359 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.359 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.359 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.360 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.360 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.360 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_perf_query", 2024-07-26T15:28:14.360 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.361 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.364 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.365 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.368 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.369 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.370 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.371 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.372 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_support", 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.375 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.376 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.378 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.379 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.380 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.381 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.382 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.383 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.384 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_autoscaler", 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.385 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.390 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.392 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.393 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.395 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.396 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: "threshold": { 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threshold", 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.398 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1.0", 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "scaling threshold", 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.399 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "progress", 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.400 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_pg_recovery_event": { 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_pg_recovery_event", 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.401 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow the module to show pg recovery progress", 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-07-26T15:28:14.402 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.404 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.405 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.406 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.406 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.406 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.406 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.406 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.407 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.407 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.407 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.407 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.407 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.408 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.408 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.408 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.408 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.408 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.409 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.409 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.409 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.409 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.409 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.409 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.410 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.410 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.410 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.410 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.411 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.411 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.411 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.411 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.411 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.412 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.412 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.412 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.412 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.413 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.413 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.413 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.413 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.414 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.414 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.414 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.414 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.414 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.415 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.415 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.415 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.415 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.416 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.416 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.416 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.416 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: "max_completed_events": { 2024-07-26T15:28:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_completed_events", 2024-07-26T15:28:14.418 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.418 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.418 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.418 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "50", 2024-07-26T15:28:14.418 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.418 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "number of past completed events to remember", 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.419 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.420 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long the module is going to sleep", 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.421 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.423 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus", 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "cache": { 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cache", 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.424 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.425 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "exclude_perf_counters": { 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "exclude_perf_counters", 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.426 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.427 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.428 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.429 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.429 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.429 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.429 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.429 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.430 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.430 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.430 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.430 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.430 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.431 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.431 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.431 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.431 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.432 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.432 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.432 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.432 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.432 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.433 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.433 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.433 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.433 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.434 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.434 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.434 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.434 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.435 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.435 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.435 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.435 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.435 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.436 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.436 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.436 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.436 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.437 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.438 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.439 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.439 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.439 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.439 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.439 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.439 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools": { 2024-07-26T15:28:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools", 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.441 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools_refresh_interval": { 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-07-26T15:28:14.442 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "300", 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.443 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_interval": { 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_interval", 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:14.444 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15.0", 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.447 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.448 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "9283", 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.449 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "stale_cache_strategy": { 2024-07-26T15:28:14.451 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stale_cache_strategy", 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "log", 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.452 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.453 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "default", 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "default", 2024-07-26T15:28:14.454 INFO:teuthology.orchestra.run.smithi040.stdout: "error" 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-07-26T15:28:14.455 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.456 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.458 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.459 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.460 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.461 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.462 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.463 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.464 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.465 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_snap_create": { 2024-07-26T15:28:14.467 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_snap_create", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.468 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "mirror_snapshot_schedule": { 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirror_snapshot_schedule", 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.469 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.471 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "trash_purge_schedule": { 2024-07-26T15:28:14.472 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "trash_purge_schedule", 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.473 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.474 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "restful", 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_auth": { 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_auth", 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.475 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.476 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.477 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.478 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.479 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.480 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.481 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.482 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.483 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.484 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.485 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.488 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-07-26T15:28:14.489 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.490 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.491 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.492 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rgw", 2024-07-26T15:28:14.493 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.494 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.497 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.498 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.499 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.500 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.501 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "secondary_zone_period_retry_limit": { 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secondary_zone_period_retry_limit", 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.504 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.506 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rook", 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.508 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.509 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.510 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.511 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.512 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.513 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.514 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.515 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.516 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.518 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_class": { 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "storage_class", 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "local", 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.519 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.520 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "selftest", 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.521 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.522 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.523 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.524 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.526 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.526 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.526 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.526 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.527 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.529 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.530 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.531 INFO:teuthology.orchestra.run.smithi040.stdout: "roption1": { 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption1", 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.532 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "roption2": { 2024-07-26T15:28:14.533 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption2", 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "xyz", 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.534 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption1": { 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption1", 2024-07-26T15:28:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.536 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption2": { 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption2", 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.537 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.538 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption3": { 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption3", 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.539 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.540 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption4": { 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption4", 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.541 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption5": { 2024-07-26T15:28:14.542 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption5", 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.543 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption6": { 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption6", 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.544 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.545 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.546 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.546 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.546 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.546 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption7": { 2024-07-26T15:28:14.546 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption7", 2024-07-26T15:28:14.546 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.547 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.547 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.547 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.547 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-07-26T15:28:14.547 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "42", 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "testkey": { 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testkey", 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.550 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.551 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "testlkey": { 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testlkey", 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: "testnewline": { 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testnewline", 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.554 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.555 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smb", 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "internal_store_backend": { 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "internal_store_backend", 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.556 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.557 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.558 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.559 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.560 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.561 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.562 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.564 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.565 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.566 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.567 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "update_orchestration": { 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "update_orchestration", 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.569 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.570 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snap_schedule", 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_m_granularity": { 2024-07-26T15:28:14.571 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_m_granularity", 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.572 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow minute scheduled snapshots", 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: "dump_on_update": { 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dump_on_update", 2024-07-26T15:28:14.573 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "dump database to debug log on update", 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.576 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.577 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.579 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.580 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.581 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.582 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.583 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.584 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.585 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stats", 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.587 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.588 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.589 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.590 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.591 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.592 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.594 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.595 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.596 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.597 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "status", 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.598 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.599 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.600 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.601 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.602 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.603 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.604 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.605 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.606 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.608 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.609 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telegraf", 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.610 INFO:teuthology.orchestra.run.smithi040.stdout: "address": { 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "address", 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:14.612 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15", 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.613 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.614 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.615 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.616 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.617 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.618 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.619 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.621 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.622 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.623 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.624 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telemetry", 2024-07-26T15:28:14.625 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_basic": { 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_basic", 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.626 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share basic cluster information (size, version)", 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.627 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_crash": { 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_crash", 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.628 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_device": { 2024-07-26T15:28:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_device", 2024-07-26T15:28:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-07-26T15:28:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_ident": { 2024-07-26T15:28:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_ident", 2024-07-26T15:28:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-07-26T15:28:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.636 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.636 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_perf": { 2024-07-26T15:28:14.636 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_perf", 2024-07-26T15:28:14.636 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.636 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.637 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.637 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.637 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.637 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.637 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.638 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share various performance metrics of a cluster", 2024-07-26T15:28:14.638 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.638 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.638 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.639 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.639 INFO:teuthology.orchestra.run.smithi040.stdout: "contact": { 2024-07-26T15:28:14.639 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "contact", 2024-07-26T15:28:14.639 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.639 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.640 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.640 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.640 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.640 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.641 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.641 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.641 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.641 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.642 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.642 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.642 INFO:teuthology.orchestra.run.smithi040.stdout: "description": { 2024-07-26T15:28:14.642 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "description", 2024-07-26T15:28:14.642 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.643 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: "device_url": { 2024-07-26T15:28:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_url", 2024-07-26T15:28:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.645 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.645 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.645 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-07-26T15:28:14.645 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.645 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.645 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-07-26T15:28:14.646 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.648 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "24", 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "8", 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.649 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: "last_opt_revision": { 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "last_opt_revision", 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.650 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1", 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.651 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard": { 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard", 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.652 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.653 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard_description": { 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard_description", 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.654 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.655 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.656 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.658 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.659 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.660 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.661 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.662 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.663 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.664 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "organization": { 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "organization", 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.666 INFO:teuthology.orchestra.run.smithi040.stdout: "proxy": { 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "proxy", 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.667 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.668 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: "url": { 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url", 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.670 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.671 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "test_orchestrator", 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.672 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.674 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.675 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.676 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.677 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.678 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.679 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.680 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.681 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.682 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.683 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.684 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.685 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.686 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.687 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.688 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.689 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.690 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.691 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.692 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.693 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_clones": { 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_clones", 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4", 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.694 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Number of asynchronous cloner threads", 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "periodic_async_work": { 2024-07-26T15:28:14.695 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "periodic_async_work", 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.696 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Periodically check for async work", 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_delay": { 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_delay", 2024-07-26T15:28:14.697 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.698 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_no_wait": { 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_no_wait", 2024-07-26T15:28:14.699 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.700 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.701 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.702 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix", 2024-07-26T15:28:14.703 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "discovery_interval": { 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "discovery_interval", 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.704 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "100", 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.705 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "identifier": { 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "identifier", 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.706 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.707 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.708 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-07-26T15:28:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.710 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.711 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.712 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.714 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-07-26T15:28:14.715 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.716 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-07-26T15:28:14.717 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.718 INFO:teuthology.orchestra.run.smithi040.stdout: "sqlite3_killpoint": { 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sqlite3_killpoint", 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "dev", 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_host": { 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_host", 2024-07-26T15:28:14.720 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_port": { 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_port", 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.722 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10051", 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.723 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_sender": { 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_sender", 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-07-26T15:28:14.724 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: "services": { 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: "dashboard": "https://172.21.15.40:8443/" 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: "always_on_modules": { 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: "octopus": [ 2024-07-26T15:28:14.726 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-07-26T15:28:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-07-26T15:28:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-07-26T15:28:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-07-26T15:28:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-07-26T15:28:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-07-26T15:28:14.730 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-07-26T15:28:14.730 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-07-26T15:28:14.730 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-07-26T15:28:14.730 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-07-26T15:28:14.730 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "pacific": [ 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-07-26T15:28:14.731 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: "quincy": [ 2024-07-26T15:28:14.732 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-07-26T15:28:14.733 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "reef": [ 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-07-26T15:28:14.734 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-07-26T15:28:14.735 INFO:teuthology.orchestra.run.smithi040.stdout: "squid": [ 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-07-26T15:28:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: "last_failure_osd_epoch": 3, 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: "active_clients": [ 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.737 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 633036960 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.738 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "libcephsqlite", 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-07-26T15:28:14.739 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 91641818 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.740 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2157419407 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-07-26T15:28:14.741 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3921483967 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-07-26T15:28:14.742 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-07-26T15:28:14.743 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-07-26T15:28:14.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.075+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f50bc0b3bd0 msgr2=0x7f50bc0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:14.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.075+0000 7f50dc200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f50bc0b3bd0 0x7f50bc0b60e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f50c8000c00 tx=0x7f50c8005720 comp rx=0 tx=0).stop 2024-07-26T15:28:14.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 msgr2=0x7f50d419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:14.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 0x7f50d419cca0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00eaa0 tx=0x7f50cc00ef60 comp rx=0 tx=0).stop 2024-07-26T15:28:14.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 shutdown_connections 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d4106d00 0x7f50d419cca0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7f50bc0b3bd0 0x7f50bc0b60e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d4106360 0x7f50d419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 --2- 172.21.15.40:0/404850180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50d41052e0 0x7f50d419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 >> 172.21.15.40:0/404850180 conn(0x7f50d4100c20 msgr2=0x7f50d4109680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 shutdown_connections 2024-07-26T15:28:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:12.076+0000 7f50dc200640 1 -- 172.21.15.40:0/404850180 wait complete. 2024-07-26T15:28:14.747 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6898.159203 secs 2024-07-26T15:28:14.747 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:12 smithi076 ceph-mon[35401]: pgmap v6154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:14.747 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:12 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/1957169908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T15:28:14.747 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:13 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/404850180' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-26T15:28:14.747 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:14 smithi076 ceph-mon[35401]: pgmap v6155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:14.748 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6898.159203 secs 2024-07-26T15:28:14.748 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:12 smithi146 ceph-mon[35807]: pgmap v6154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:14.748 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:12 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/1957169908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T15:28:14.748 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:13 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/404850180' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-26T15:28:14.748 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:14 smithi146 ceph-mon[35807]: pgmap v6155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:14.756 DEBUG:tasks.check_counter:Getting stats from a 2024-07-26T15:28:14.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph daemon mds.a perf dump 2024-07-26T15:28:14.757 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6898.159203 secs 2024-07-26T15:28:14.757 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:12 smithi040 ceph-mon[32397]: pgmap v6154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:14.757 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:12 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/1957169908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-07-26T15:28:14.757 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:13 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/404850180' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-07-26T15:28:14.758 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:14 smithi040 ceph-mon[32397]: pgmap v6155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:15.245 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T15:28:16.542 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:16 smithi040 ceph-mon[32397]: pgmap v6156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:16.543 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6903.159347 secs 2024-07-26T15:28:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:16 smithi146 ceph-mon[35807]: pgmap v6156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6903.159347 secs 2024-07-26T15:28:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:16 smithi076 ceph-mon[35401]: pgmap v6156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6903.159347 secs 2024-07-26T15:28:17.573 INFO:teuthology.orchestra.run.smithi040.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-07-26T15:28:18.366 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-07-26T15:28:18.367 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/check_counter.py", line 84, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/ceph_manager.py", line 1921, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph daemon mds.a perf dump' 2024-07-26T15:28:18.376 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-07-26T15:28:18.389 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-07-26T15:28:18.389 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T15:28:18.389 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T15:28:18.508 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T15:28:18.508 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T15:28:18.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd blocklist ls 2024-07-26T15:28:18.647 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:18 smithi040 ceph-mon[32397]: pgmap v6157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:18.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:18 smithi146 ceph-mon[35807]: pgmap v6157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:18 smithi076 ceph-mon[35401]: pgmap v6157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:19.058 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T15:28:20.722 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:20 smithi040 ceph-mon[32397]: pgmap v6158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:20.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:20 smithi146 ceph-mon[35807]: pgmap v6158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:20 smithi076 ceph-mon[35401]: pgmap v6158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.429+0000 7ffab7c00640 1 -- 172.21.15.40:0/4272922159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab0108ee0 msgr2=0x7ffab01092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.429+0000 7ffab7c00640 1 --2- 172.21.15.40:0/4272922159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab0108ee0 0x7ffab01092f0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009900 tx=0x7ffa9802a3f0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 -- 172.21.15.40:0/4272922159 shutdown_connections 2024-07-26T15:28:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 --2- 172.21.15.40:0/4272922159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0109830 0x7ffab0110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 --2- 172.21.15.40:0/4272922159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab0108ee0 0x7ffab01092f0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 --2- 172.21.15.40:0/4272922159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab01035a0 0x7ffab01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 -- 172.21.15.40:0/4272922159 >> 172.21.15.40:0/4272922159 conn(0x7ffab00ff010 msgr2=0x7ffab0101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 -- 172.21.15.40:0/4272922159 shutdown_connections 2024-07-26T15:28:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.430+0000 7ffab7c00640 1 -- 172.21.15.40:0/4272922159 wait complete. 2024-07-26T15:28:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.431+0000 7ffab7c00640 1 Processor -- start 2024-07-26T15:28:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.431+0000 7ffab7c00640 1 -- start start 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.431+0000 7ffab7c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 0x7ffab0075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab7c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0108ee0 0x7ffab0075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab7c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab0109830 0x7ffab0075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab7c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113350 con 0x7ffab01035a0 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab7c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01131d0 con 0x7ffab0109830 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab7c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01134d0 con 0x7ffab0108ee0 2024-07-26T15:28:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 0x7ffab0075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 0x7ffab0075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55116/0 (socket says 172.21.15.40:55116) 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab5200640 1 -- 172.21.15.40:0/3003633907 learned_addr learned my addr 172.21.15.40:0/3003633907 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab5c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab0109830 0x7ffab0075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffaa7e00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0108ee0 0x7ffab0075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.432+0000 7ffab5200640 1 -- 172.21.15.40:0/3003633907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0108ee0 msgr2=0x7ffab0075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab5200640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0108ee0 0x7ffab0075680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab5200640 1 -- 172.21.15.40:0/3003633907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab0109830 msgr2=0x7ffab0075bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab5200640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab0109830 0x7ffab0075bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab5200640 1 -- 172.21.15.40:0/3003633907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01a80c0 con 0x7ffab01035a0 2024-07-26T15:28:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab5c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab0109830 0x7ffab0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-26T15:28:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab5200640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 0x7ffab0075140 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d950 tx=0x7ffaa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0017070 con 0x7ffab01035a0 2024-07-26T15:28:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaa0009c30 con 0x7ffab01035a0 2024-07-26T15:28:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab01a83b0 con 0x7ffab01035a0 2024-07-26T15:28:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000f620 con 0x7ffab01035a0 2024-07-26T15:28:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.433+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab01a88c0 con 0x7ffab01035a0 2024-07-26T15:28:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.435+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab01039b0 con 0x7ffab01035a0 2024-07-26T15:28:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.437+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffaa0010460 con 0x7ffab01035a0 2024-07-26T15:28:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.439+0000 7ffaae000640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa940b3bd0 0x7ffa940b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.439+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7ffaa00e48a0 con 0x7ffab01035a0 2024-07-26T15:28:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.439+0000 7ffaa7e00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa940b3bd0 0x7ffa940b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.440+0000 7ffaa7e00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa940b3bd0 0x7ffa940b60e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffa980057c0 tx=0x7ffa98000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.443+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7ffaa00aaf10 con 0x7ffab01035a0 2024-07-26T15:28:21.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.662+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffab002e0c0 con 0x7ffab01035a0 2024-07-26T15:28:21.665 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6908.159510 secs 2024-07-26T15:28:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.663+0000 7ffaae000640 1 -- 172.21.15.40:0/3003633907 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 102 entries v123) ==== 82+0+6226 (secure 0 0 0) 0x7ffaa0009de0 con 0x7ffab01035a0 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/3675700947 2024-07-27T13:36:54.588237+0000 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/1213846876 2024-07-27T13:36:54.588399+0000 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3809538576 2024-07-27T13:36:34.562953+0000 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3809538576 2024-07-27T13:36:34.562953+0000 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/1974353927 2024-07-27T13:36:34.563144+0000 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/1974353927 2024-07-27T13:36:34.563144+0000 2024-07-26T15:28:21.667 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/2006579107 2024-07-27T13:36:12.941293+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/1223305424 2024-07-27T13:36:12.819061+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/1223305424 2024-07-27T13:36:12.819061+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/2226292800 2024-07-27T13:36:11.916238+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/2226292800 2024-07-27T13:36:11.916238+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/1229078272 2024-07-27T13:36:11.867962+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/2701751672 2024-07-27T13:35:56.003717+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/961948387 2024-07-27T13:35:55.538357+0000 2024-07-26T15:28:21.668 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/3220961055 2024-07-27T13:35:55.339632+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/2725372682 2024-07-27T13:35:37.869852+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/1429307143 2024-07-27T13:35:37.746476+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/961948387 2024-07-27T13:35:55.538357+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/1429307143 2024-07-27T13:35:37.746476+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/975335928 2024-07-27T13:36:34.563056+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/2006579107 2024-07-27T13:36:12.941293+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/3279473452 2024-07-27T13:35:36.921782+0000 2024-07-26T15:28:21.669 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/3915774179 2024-07-27T13:35:36.892827+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/3915774179 2024-07-27T13:35:36.892827+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/2160631599 2024-07-27T13:35:20.551038+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/2352244306 2024-07-27T13:35:20.290410+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/3675700947 2024-07-27T13:36:54.588237+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/694136309 2024-07-27T13:33:44.214919+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/900875035 2024-07-27T13:35:01.645161+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/1213846876 2024-07-27T13:36:54.588399+0000 2024-07-26T15:28:21.670 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/975335928 2024-07-27T13:36:34.563056+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/694136309 2024-07-27T13:33:44.214919+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/1374524390 2024-07-27T13:33:42.864787+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/3850522012 2024-07-27T13:34:03.880777+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/2160631599 2024-07-27T13:35:20.551038+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/3482143239 2024-07-27T13:33:42.946815+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/3866154018 2024-07-27T13:33:24.471887+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/2461564853 2024-07-27T13:34:23.910548+0000 2024-07-26T15:28:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/3279473452 2024-07-27T13:35:36.921782+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3076436166 2024-07-27T13:33:26.012485+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/3238351765 2024-07-27T13:35:02.818639+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3919477759 2024-07-27T13:35:55.573012+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/3170726419 2024-07-27T13:33:44.073507+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/2701751672 2024-07-27T13:35:56.003717+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/4061759756 2024-07-27T13:33:25.413070+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/3749083887 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3919477759 2024-07-27T13:35:55.573012+0000 2024-07-26T15:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/2583506231 2024-07-27T13:34:25.544135+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/4061759756 2024-07-27T13:33:25.413070+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1334877414 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/1983243831 2024-07-27T13:34:04.444674+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/3482143239 2024-07-27T13:33:42.946815+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/2937347475 2024-07-27T13:35:20.712490+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/3866154018 2024-07-27T13:33:24.471887+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/2937347475 2024-07-27T13:35:20.712490+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3266304279 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:21.673 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/3814759196 2024-07-27T13:36:34.563230+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2685729470 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2685729470 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3522272509 2024-07-27T13:34:04.486630+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1764700986 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/2225657026 2024-07-27T13:34:04.329275+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/3170726419 2024-07-27T13:33:44.073507+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3522272509 2024-07-27T13:34:04.486630+0000 2024-07-26T15:28:21.674 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1883279801 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/18542135 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/3090209485 2024-07-27T13:35:20.260945+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/1983243831 2024-07-27T13:34:04.444674+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/3575903669 2024-07-27T13:34:24.743422+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/2352244306 2024-07-27T13:35:20.290410+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3076436166 2024-07-27T13:33:26.012485+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/3850522012 2024-07-27T13:34:03.880777+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/3814759196 2024-07-27T13:36:34.563230+0000 2024-07-26T15:28:21.675 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/3238351765 2024-07-27T13:35:02.818639+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/2744171288 2024-07-27T13:33:24.471769+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/2744171288 2024-07-27T13:33:24.471769+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/900875035 2024-07-27T13:35:01.645161+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/2225657026 2024-07-27T13:34:04.329275+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/1530476337 2024-07-27T13:34:42.601747+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/2502587932 2024-07-27T13:34:23.851165+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/1025840894 2024-07-27T13:34:42.993852+0000 2024-07-26T15:28:21.676 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/2725372682 2024-07-27T13:35:37.869852+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/2461564853 2024-07-27T13:34:23.910548+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/1374524390 2024-07-27T13:33:42.864787+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/26169584 2024-07-27T13:35:02.298516+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/3220961055 2024-07-27T13:35:55.339632+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/3611914765 2024-07-27T13:34:42.635141+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/3575903669 2024-07-27T13:34:24.743422+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/2583506231 2024-07-27T13:34:25.544135+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3675130860 2024-07-27T13:34:42.399882+0000 2024-07-26T15:28:21.677 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/1530476337 2024-07-27T13:34:42.601747+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2030256837 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/2335337936 2024-07-27T13:35:01.623955+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/2502587932 2024-07-27T13:34:23.851165+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/3611914765 2024-07-27T13:34:42.635141+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/3749083887 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/2335337936 2024-07-27T13:35:01.623955+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3675130860 2024-07-27T13:34:42.399882+0000 2024-07-26T15:28:21.678 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/26169584 2024-07-27T13:35:02.298516+0000 2024-07-26T15:28:21.679 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/1025840894 2024-07-27T13:34:42.993852+0000 2024-07-26T15:28:21.679 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/1229078272 2024-07-27T13:36:11.867962+0000 2024-07-26T15:28:21.679 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/3090209485 2024-07-27T13:35:20.260945+0000 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:listed 102 entries 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa940b3bd0 msgr2=0x7ffa940b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa940b3bd0 0x7ffa940b60e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffa980057c0 tx=0x7ffa98000bc0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 msgr2=0x7ffab0075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 0x7ffab0075140 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d950 tx=0x7ffaa000de10 comp rx=0 tx=0).stop 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 shutdown_connections 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab0109830 0x7ffab0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7ffa940b3bd0 0x7ffa940b60e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab0108ee0 0x7ffab0075680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 --2- 172.21.15.40:0/3003633907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab01035a0 0x7ffab0075140 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:21.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.667+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 >> 172.21.15.40:0/3003633907 conn(0x7ffab00ff010 msgr2=0x7ffab0101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:21.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.668+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 shutdown_connections 2024-07-26T15:28:21.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:21.668+0000 7ffab7c00640 1 -- 172.21.15.40:0/3003633907 wait complete. 2024-07-26T15:28:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6908.159510 secs 2024-07-26T15:28:21.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6908.159510 secs 2024-07-26T15:28:22.355 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-07-26T15:28:22.355 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-26T15:28:22.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e8f88bb1fe0f3b5172ca5b6b08c2be739c07e528 shell --fsid 5cbb9f42-4b47-11ef-bcb7-c7b262605968 -- ceph osd blocklist ls 2024-07-26T15:28:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:22 smithi040 ceph-mon[32397]: pgmap v6159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:22 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/3003633907' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T15:28:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:22 smithi146 ceph-mon[35807]: pgmap v6159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:22 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/3003633907' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T15:28:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:22 smithi076 ceph-mon[35401]: pgmap v6159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:22 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/3003633907' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T15:28:22.919 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/5cbb9f42-4b47-11ef-bcb7-c7b262605968/mon.a/config 2024-07-26T15:28:24.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:24 smithi040 ceph-mon[32397]: pgmap v6160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:24.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:24 smithi146 ceph-mon[35807]: pgmap v6160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:24 smithi076 ceph-mon[35401]: pgmap v6160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:25.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 -- 172.21.15.40:0/3246424671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 msgr2=0x7fd4341028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:25.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 --2- 172.21.15.40:0/3246424671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd4341028a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd424009900 tx=0x7fd42402a3f0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 -- 172.21.15.40:0/3246424671 shutdown_connections 2024-07-26T15:28:25.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 --2- 172.21.15.40:0/3246424671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434108720 0x7fd43410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 --2- 172.21.15.40:0/3246424671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434107dd0 0x7fd4341081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 --2- 172.21.15.40:0/3246424671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd4341028a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 -- 172.21.15.40:0/3246424671 >> 172.21.15.40:0/3246424671 conn(0x7fd434079160 msgr2=0x7fd434079570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:25.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 -- 172.21.15.40:0/3246424671 shutdown_connections 2024-07-26T15:28:25.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.243+0000 7fd43a800640 1 -- 172.21.15.40:0/3246424671 wait complete. 2024-07-26T15:28:25.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 Processor -- start 2024-07-26T15:28:25.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 -- start start 2024-07-26T15:28:25.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd434199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434107dd0 0x7fd43419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434108720 0x7fd43419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd434112250 con 0x7fd434102490 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd4341120d0 con 0x7fd434108720 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.245+0000 7fd43a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4341123d0 con 0x7fd434107dd0 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd434199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd434199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36304/0 (socket says 172.21.15.40:36304) 2024-07-26T15:28:25.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 -- 172.21.15.40:0/480225637 learned_addr learned my addr 172.21.15.40:0/480225637 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd432a00640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434107dd0 0x7fd43419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433e00640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434108720 0x7fd43419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 -- 172.21.15.40:0/480225637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434107dd0 msgr2=0x7fd43419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434107dd0 0x7fd43419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 -- 172.21.15.40:0/480225637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434108720 msgr2=0x7fd43419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434108720 0x7fd43419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.246+0000 7fd433400640 1 -- 172.21.15.40:0/480225637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43419fd40 con 0x7fd434102490 2024-07-26T15:28:25.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.247+0000 7fd433400640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd434199dd0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd424009230 tx=0x7fd424004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:25.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.247+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42403f030 con 0x7fd434102490 2024-07-26T15:28:25.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.247+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd424003a80 con 0x7fd434102490 2024-07-26T15:28:25.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.247+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424035070 con 0x7fd434102490 2024-07-26T15:28:25.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.247+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43419ffd0 con 0x7fd434102490 2024-07-26T15:28:25.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.247+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4341a6790 con 0x7fd434102490 2024-07-26T15:28:25.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.249+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4341028a0 con 0x7fd434102490 2024-07-26T15:28:25.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.251+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd424042030 con 0x7fd434102490 2024-07-26T15:28:25.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.252+0000 7fd42be00640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4180b3bd0 0x7fd4180b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-26T15:28:25.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.253+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 12196+0+0 (secure 0 0 0) 0x7fd4241053e0 con 0x7fd434102490 2024-07-26T15:28:25.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.253+0000 7fd432a00640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4180b3bd0 0x7fd4180b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-26T15:28:25.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.254+0000 7fd432a00640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4180b3bd0 0x7fd4180b60e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd420005fd0 tx=0x7fd420005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-26T15:28:25.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.257+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194024 (secure 0 0 0) 0x7fd4240cba50 con 0x7fd434102490 2024-07-26T15:28:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.472+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4341a6990 con 0x7fd434102490 2024-07-26T15:28:25.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.474+0000 7fd42be00640 1 -- 172.21.15.40:0/480225637 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 102 entries v123) ==== 82+0+6226 (secure 0 0 0) 0x7fd4240cb350 con 0x7fd434102490 2024-07-26T15:28:25.478 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/3675700947 2024-07-27T13:36:54.588237+0000 2024-07-26T15:28:25.478 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/1213846876 2024-07-27T13:36:54.588399+0000 2024-07-26T15:28:25.478 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3809538576 2024-07-27T13:36:34.562953+0000 2024-07-26T15:28:25.478 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3809538576 2024-07-27T13:36:34.562953+0000 2024-07-26T15:28:25.478 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/1974353927 2024-07-27T13:36:34.563144+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/1974353927 2024-07-27T13:36:34.563144+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/2006579107 2024-07-27T13:36:12.941293+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/1223305424 2024-07-27T13:36:12.819061+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/1223305424 2024-07-27T13:36:12.819061+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/2226292800 2024-07-27T13:36:11.916238+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/2226292800 2024-07-27T13:36:11.916238+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/1229078272 2024-07-27T13:36:11.867962+0000 2024-07-26T15:28:25.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/2701751672 2024-07-27T13:35:56.003717+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/961948387 2024-07-27T13:35:55.538357+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/3220961055 2024-07-27T13:35:55.339632+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/2725372682 2024-07-27T13:35:37.869852+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/1429307143 2024-07-27T13:35:37.746476+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/961948387 2024-07-27T13:35:55.538357+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/1429307143 2024-07-27T13:35:37.746476+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/975335928 2024-07-27T13:36:34.563056+0000 2024-07-26T15:28:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/2006579107 2024-07-27T13:36:12.941293+0000 2024-07-26T15:28:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/3279473452 2024-07-27T13:35:36.921782+0000 2024-07-26T15:28:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/3915774179 2024-07-27T13:35:36.892827+0000 2024-07-26T15:28:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/3915774179 2024-07-27T13:35:36.892827+0000 2024-07-26T15:28:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/2160631599 2024-07-27T13:35:20.551038+0000 2024-07-26T15:28:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/2352244306 2024-07-27T13:35:20.290410+0000 2024-07-26T15:28:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/3675700947 2024-07-27T13:36:54.588237+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/694136309 2024-07-27T13:33:44.214919+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/900875035 2024-07-27T13:35:01.645161+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/1213846876 2024-07-27T13:36:54.588399+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/975335928 2024-07-27T13:36:34.563056+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/694136309 2024-07-27T13:33:44.214919+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/1374524390 2024-07-27T13:33:42.864787+0000 2024-07-26T15:28:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/3850522012 2024-07-27T13:34:03.880777+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/2160631599 2024-07-27T13:35:20.551038+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/3482143239 2024-07-27T13:33:42.946815+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/3866154018 2024-07-27T13:33:24.471887+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/2461564853 2024-07-27T13:34:23.910548+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/3279473452 2024-07-27T13:35:36.921782+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3076436166 2024-07-27T13:33:26.012485+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/3238351765 2024-07-27T13:35:02.818639+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3919477759 2024-07-27T13:35:55.573012+0000 2024-07-26T15:28:25.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/3170726419 2024-07-27T13:33:44.073507+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/2701751672 2024-07-27T13:35:56.003717+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/4061759756 2024-07-27T13:33:25.413070+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/3749083887 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3919477759 2024-07-27T13:35:55.573012+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/2583506231 2024-07-27T13:34:25.544135+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/4061759756 2024-07-27T13:33:25.413070+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1334877414 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:25.484 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/1983243831 2024-07-27T13:34:04.444674+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/3482143239 2024-07-27T13:33:42.946815+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/2937347475 2024-07-27T13:35:20.712490+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/3866154018 2024-07-27T13:33:24.471887+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/2937347475 2024-07-27T13:35:20.712490+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3266304279 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/3814759196 2024-07-27T13:36:34.563230+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2685729470 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2685729470 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3522272509 2024-07-27T13:34:04.486630+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1764700986 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/2225657026 2024-07-27T13:34:04.329275+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/3170726419 2024-07-27T13:33:44.073507+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3522272509 2024-07-27T13:34:04.486630+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1883279801 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/18542135 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/3090209485 2024-07-27T13:35:20.260945+0000 2024-07-26T15:28:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/1983243831 2024-07-27T13:34:04.444674+0000 2024-07-26T15:28:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/3575903669 2024-07-27T13:34:24.743422+0000 2024-07-26T15:28:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/2352244306 2024-07-27T13:35:20.290410+0000 2024-07-26T15:28:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3076436166 2024-07-27T13:33:26.012485+0000 2024-07-26T15:28:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/3850522012 2024-07-27T13:34:03.880777+0000 2024-07-26T15:28:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/3814759196 2024-07-27T13:36:34.563230+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/3238351765 2024-07-27T13:35:02.818639+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/2744171288 2024-07-27T13:33:24.471769+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/2744171288 2024-07-27T13:33:24.471769+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/900875035 2024-07-27T13:35:01.645161+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/2225657026 2024-07-27T13:34:04.329275+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6839/1530476337 2024-07-27T13:34:42.601747+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6834/2502587932 2024-07-27T13:34:23.851165+0000 2024-07-26T15:28:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6839/1025840894 2024-07-27T13:34:42.993852+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6840/2725372682 2024-07-27T13:35:37.869852+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/2461564853 2024-07-27T13:34:23.910548+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/1374524390 2024-07-27T13:33:42.864787+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6839/26169584 2024-07-27T13:35:02.298516+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/3220961055 2024-07-27T13:35:55.339632+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6833/3611914765 2024-07-27T13:34:42.635141+0000 2024-07-26T15:28:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6841/3575903669 2024-07-27T13:34:24.743422+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/2583506231 2024-07-27T13:34:25.544135+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6836/3675130860 2024-07-27T13:34:42.399882+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6838/1530476337 2024-07-27T13:34:42.601747+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2030256837 2024-07-27T12:07:27.399390+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/2335337936 2024-07-27T13:35:01.623955+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6835/2502587932 2024-07-27T13:34:23.851165+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/3611914765 2024-07-27T13:34:42.635141+0000 2024-07-26T15:28:25.490 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/3749083887 2024-07-27T12:07:57.642554+0000 2024-07-26T15:28:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6835/2335337936 2024-07-27T13:35:01.623955+0000 2024-07-26T15:28:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.146:6837/3675130860 2024-07-27T13:34:42.399882+0000 2024-07-26T15:28:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6838/26169584 2024-07-27T13:35:02.298516+0000 2024-07-26T15:28:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6838/1025840894 2024-07-27T13:34:42.993852+0000 2024-07-26T15:28:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6834/1229078272 2024-07-27T13:36:11.867962+0000 2024-07-26T15:28:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.76:6832/3090209485 2024-07-27T13:35:20.260945+0000 2024-07-26T15:28:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:listed 102 entries 2024-07-26T15:28:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4180b3bd0 msgr2=0x7fd4180b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4180b3bd0 0x7fd4180b60e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd420005fd0 tx=0x7fd420005850 comp rx=0 tx=0).stop 2024-07-26T15:28:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 msgr2=0x7fd434199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-26T15:28:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd434199dd0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd424009230 tx=0x7fd424004270 comp rx=0 tx=0).stop 2024-07-26T15:28:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 shutdown_connections 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434108720 0x7fd43419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:6800/4031368209,v1:172.21.15.40:6801/4031368209] conn(0x7fd4180b3bd0 0x7fd4180b60e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434107dd0 0x7fd43419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 --2- 172.21.15.40:0/480225637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd434102490 0x7fd434199dd0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 >> 172.21.15.40:0/480225637 conn(0x7fd434079160 msgr2=0x7fd4341015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.478+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 shutdown_connections 2024-07-26T15:28:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-07-26T15:28:25.479+0000 7fd43a800640 1 -- 172.21.15.40:0/480225637 wait complete. 2024-07-26T15:28:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:25 smithi146 ceph-mon[35807]: from='client.? 172.21.15.40:0/480225637' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T15:28:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:25 smithi076 ceph-mon[35401]: from='client.? 172.21.15.40:0/480225637' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T15:28:25.855 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:25 smithi040 ceph-mon[32397]: from='client.? 172.21.15.40:0/480225637' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-07-26T15:28:26.264 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-07-26T15:28:26.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T15:28:26.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-07-26T15:28:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2024-07-26T15:28:26.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-26T15:28:26.374 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi040.front.sepia.ceph.com, aborting... 2024-07-26T15:28:26.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-26T15:28:26.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-07-26T15:28:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:26 smithi040 ceph-mon[32397]: pgmap v6161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6913.159669 secs 2024-07-26T15:28:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:26 smithi146 ceph-mon[35807]: pgmap v6161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6913.159669 secs 2024-07-26T15:28:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:26 smithi076 ceph-mon[35401]: pgmap v6161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6913.159669 secs 2024-07-26T15:28:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:28 smithi146 ceph-mon[35807]: pgmap v6162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:28 smithi076 ceph-mon[35401]: pgmap v6162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:28.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:28 smithi040 ceph-mon[32397]: pgmap v6162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:30 smithi146 ceph-mon[35807]: pgmap v6163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:30 smithi076 ceph-mon[35401]: pgmap v6163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:30 smithi040 ceph-mon[32397]: pgmap v6163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6918.159811 secs 2024-07-26T15:28:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6918.159811 secs 2024-07-26T15:28:31.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6918.159811 secs 2024-07-26T15:28:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:32 smithi146 ceph-mon[35807]: pgmap v6164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:32 smithi076 ceph-mon[35401]: pgmap v6164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:32 smithi040 ceph-mon[32397]: pgmap v6164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:34 smithi146 ceph-mon[35807]: pgmap v6165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:34 smithi076 ceph-mon[35401]: pgmap v6165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:34.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:34 smithi040 ceph-mon[32397]: pgmap v6165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:36 smithi146 ceph-mon[35807]: pgmap v6166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6923.159952 secs 2024-07-26T15:28:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:36 smithi076 ceph-mon[35401]: pgmap v6166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6923.159952 secs 2024-07-26T15:28:36.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:36 smithi040 ceph-mon[32397]: pgmap v6166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6923.159952 secs 2024-07-26T15:28:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:38 smithi146 ceph-mon[35807]: pgmap v6167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:38.832 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:38 smithi076 ceph-mon[35401]: pgmap v6167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:38 smithi040 ceph-mon[32397]: pgmap v6167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:40 smithi076 ceph-mon[35401]: pgmap v6168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:40 smithi040 ceph-mon[32397]: pgmap v6168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:40 smithi146 ceph-mon[35807]: pgmap v6168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6928.160086 secs 2024-07-26T15:28:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6928.160086 secs 2024-07-26T15:28:42.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6928.160086 secs 2024-07-26T15:28:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:42 smithi040 ceph-mon[32397]: pgmap v6169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:42 smithi146 ceph-mon[35807]: pgmap v6169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:42 smithi076 ceph-mon[35401]: pgmap v6169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:44.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:44 smithi040 ceph-mon[32397]: pgmap v6170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:44 smithi146 ceph-mon[35807]: pgmap v6170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:44 smithi076 ceph-mon[35401]: pgmap v6170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:46.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:46 smithi040 ceph-mon[32397]: pgmap v6171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6933.160224 secs 2024-07-26T15:28:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:46 smithi146 ceph-mon[35807]: pgmap v6171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6933.160224 secs 2024-07-26T15:28:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:46 smithi076 ceph-mon[35401]: pgmap v6171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6933.160224 secs 2024-07-26T15:28:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:48 smithi146 ceph-mon[35807]: pgmap v6172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:48 smithi076 ceph-mon[35401]: pgmap v6172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:48 smithi040 ceph-mon[32397]: pgmap v6172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:50 smithi146 ceph-mon[35807]: pgmap v6173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:50 smithi076 ceph-mon[35401]: pgmap v6173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:50 smithi040 ceph-mon[32397]: pgmap v6173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6938.160375 secs 2024-07-26T15:28:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6938.160375 secs 2024-07-26T15:28:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6938.160375 secs 2024-07-26T15:28:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:52 smithi146 ceph-mon[35807]: pgmap v6174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:52 smithi076 ceph-mon[35401]: pgmap v6174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:52 smithi040 ceph-mon[32397]: pgmap v6174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:54 smithi146 ceph-mon[35807]: pgmap v6175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:54 smithi076 ceph-mon[35401]: pgmap v6175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:54 smithi040 ceph-mon[32397]: pgmap v6175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:28:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:56 smithi146 ceph-mon[35807]: pgmap v6176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6943.160503 secs 2024-07-26T15:28:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:56 smithi076 ceph-mon[35401]: pgmap v6176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6943.160503 secs 2024-07-26T15:28:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:56 smithi040 ceph-mon[32397]: pgmap v6176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:28:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6943.160503 secs 2024-07-26T15:28:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:28:58 smithi146 ceph-mon[35807]: pgmap v6177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:28:58 smithi076 ceph-mon[35401]: pgmap v6177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:28:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:28:58 smithi040 ceph-mon[32397]: pgmap v6177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:00 smithi076 ceph-mon[35401]: pgmap v6178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:00 smithi040 ceph-mon[32397]: pgmap v6178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:00 smithi146 ceph-mon[35807]: pgmap v6178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6948.160590 secs 2024-07-26T15:29:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6948.160590 secs 2024-07-26T15:29:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6948.160590 secs 2024-07-26T15:29:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:02 smithi040 ceph-mon[32397]: pgmap v6179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:02 smithi146 ceph-mon[35807]: pgmap v6179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:02 smithi076 ceph-mon[35401]: pgmap v6179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:04 smithi040 ceph-mon[32397]: pgmap v6180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:04 smithi146 ceph-mon[35807]: pgmap v6180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:04 smithi076 ceph-mon[35401]: pgmap v6180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:06 smithi040 ceph-mon[32397]: pgmap v6181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6953.160712 secs 2024-07-26T15:29:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:06 smithi146 ceph-mon[35807]: pgmap v6181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6953.160712 secs 2024-07-26T15:29:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:06 smithi076 ceph-mon[35401]: pgmap v6181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6953.160712 secs 2024-07-26T15:29:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:08 smithi040 ceph-mon[32397]: pgmap v6182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:08 smithi146 ceph-mon[35807]: pgmap v6182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:08 smithi076 ceph-mon[35401]: pgmap v6182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:10 smithi040 ceph-mon[32397]: pgmap v6183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:10 smithi146 ceph-mon[35807]: pgmap v6183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:10 smithi076 ceph-mon[35401]: pgmap v6183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6958.160870 secs 2024-07-26T15:29:12.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6958.160870 secs 2024-07-26T15:29:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6958.160870 secs 2024-07-26T15:29:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:12 smithi040 ceph-mon[32397]: pgmap v6184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:12 smithi146 ceph-mon[35807]: pgmap v6184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:12 smithi076 ceph-mon[35401]: pgmap v6184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:14 smithi040 ceph-mon[32397]: pgmap v6185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:14 smithi146 ceph-mon[35807]: pgmap v6185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:14 smithi076 ceph-mon[35401]: pgmap v6185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:16 smithi040 ceph-mon[32397]: pgmap v6186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6963.161013 secs 2024-07-26T15:29:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:16 smithi146 ceph-mon[35807]: pgmap v6186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6963.161013 secs 2024-07-26T15:29:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:16 smithi076 ceph-mon[35401]: pgmap v6186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6963.161013 secs 2024-07-26T15:29:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:18 smithi040 ceph-mon[32397]: pgmap v6187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:18 smithi146 ceph-mon[35807]: pgmap v6187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:18 smithi076 ceph-mon[35401]: pgmap v6187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:20 smithi040 ceph-mon[32397]: pgmap v6188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:20 smithi146 ceph-mon[35807]: pgmap v6188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:20 smithi076 ceph-mon[35401]: pgmap v6188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6968.161161 secs 2024-07-26T15:29:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6968.161161 secs 2024-07-26T15:29:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6968.161161 secs 2024-07-26T15:29:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:22 smithi040 ceph-mon[32397]: pgmap v6189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:22 smithi146 ceph-mon[35807]: pgmap v6189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:22 smithi076 ceph-mon[35401]: pgmap v6189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:24 smithi040 ceph-mon[32397]: pgmap v6190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:24 smithi146 ceph-mon[35807]: pgmap v6190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:24 smithi076 ceph-mon[35401]: pgmap v6190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:29:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:26 smithi040 ceph-mon[32397]: pgmap v6191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6973.161302 secs 2024-07-26T15:29:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:26 smithi146 ceph-mon[35807]: pgmap v6191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6973.161302 secs 2024-07-26T15:29:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:26 smithi076 ceph-mon[35401]: pgmap v6191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6973.161302 secs 2024-07-26T15:29:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:28 smithi040 ceph-mon[32397]: pgmap v6192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:28 smithi146 ceph-mon[35807]: pgmap v6192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:29.332 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:28 smithi076 ceph-mon[35401]: pgmap v6192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:30 smithi040 ceph-mon[32397]: pgmap v6193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:30 smithi146 ceph-mon[35807]: pgmap v6193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:30 smithi076 ceph-mon[35401]: pgmap v6193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6978.161378 secs 2024-07-26T15:29:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6978.161378 secs 2024-07-26T15:29:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6978.161378 secs 2024-07-26T15:29:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:32 smithi040 ceph-mon[32397]: pgmap v6194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:33.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:32 smithi146 ceph-mon[35807]: pgmap v6194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:32 smithi076 ceph-mon[35401]: pgmap v6194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:34 smithi040 ceph-mon[32397]: pgmap v6195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:34 smithi146 ceph-mon[35807]: pgmap v6195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:34 smithi076 ceph-mon[35401]: pgmap v6195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:36 smithi146 ceph-mon[35807]: pgmap v6196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6983.161516 secs 2024-07-26T15:29:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:36 smithi076 ceph-mon[35401]: pgmap v6196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6983.161516 secs 2024-07-26T15:29:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:36 smithi040 ceph-mon[32397]: pgmap v6196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6983.161516 secs 2024-07-26T15:29:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:38 smithi146 ceph-mon[35807]: pgmap v6197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:38 smithi076 ceph-mon[35401]: pgmap v6197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:38 smithi040 ceph-mon[32397]: pgmap v6197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:41 smithi146 ceph-mon[35807]: pgmap v6198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:41 smithi076 ceph-mon[35401]: pgmap v6198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:40 smithi040 ceph-mon[32397]: pgmap v6198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6988.161659 secs 2024-07-26T15:29:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6988.161659 secs 2024-07-26T15:29:42.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6988.161659 secs 2024-07-26T15:29:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:43 smithi146 ceph-mon[35807]: pgmap v6199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:43 smithi076 ceph-mon[35401]: pgmap v6199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:43 smithi040 ceph-mon[32397]: pgmap v6199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:45 smithi146 ceph-mon[35807]: pgmap v6200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:45 smithi076 ceph-mon[35401]: pgmap v6200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:45 smithi040 ceph-mon[32397]: pgmap v6200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:29:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:46 smithi146 ceph-mon[35807]: pgmap v6201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:46 smithi076 ceph-mon[35401]: pgmap v6201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:46 smithi040 ceph-mon[32397]: pgmap v6201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6993.161789 secs 2024-07-26T15:29:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6993.161789 secs 2024-07-26T15:29:47.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6993.161789 secs 2024-07-26T15:29:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:48 smithi146 ceph-mon[35807]: pgmap v6202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:48 smithi076 ceph-mon[35401]: pgmap v6202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:48.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:48 smithi040 ceph-mon[32397]: pgmap v6202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:50 smithi146 ceph-mon[35807]: pgmap v6203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:50 smithi076 ceph-mon[35401]: pgmap v6203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:50.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:50 smithi040 ceph-mon[32397]: pgmap v6203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:29:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 6998.161925 secs 2024-07-26T15:29:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 6998.161925 secs 2024-07-26T15:29:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 6998.161925 secs 2024-07-26T15:29:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:52 smithi146 ceph-mon[35807]: pgmap v6204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:52 smithi076 ceph-mon[35401]: pgmap v6204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:52 smithi040 ceph-mon[32397]: pgmap v6204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:54 smithi146 ceph-mon[35807]: pgmap v6205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:54.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:54 smithi076 ceph-mon[35401]: pgmap v6205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:54 smithi040 ceph-mon[32397]: pgmap v6205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:56 smithi146 ceph-mon[35807]: pgmap v6206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7003.162094 secs 2024-07-26T15:29:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:56 smithi076 ceph-mon[35401]: pgmap v6206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7003.162094 secs 2024-07-26T15:29:56.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:56 smithi040 ceph-mon[32397]: pgmap v6206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:29:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7003.162094 secs 2024-07-26T15:29:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:29:58 smithi146 ceph-mon[35807]: pgmap v6207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:29:58 smithi076 ceph-mon[35401]: pgmap v6207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:29:58.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:29:58 smithi040 ceph-mon[32397]: pgmap v6207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:00 smithi146 ceph-mon[35807]: pgmap v6208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:30:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:00 smithi076 ceph-mon[35401]: pgmap v6208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:30:00.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:00 smithi040 ceph-mon[32397]: pgmap v6208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:30:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7008.162256 secs 2024-07-26T15:30:01.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7008.162256 secs 2024-07-26T15:30:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7008.162256 secs 2024-07-26T15:30:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:02 smithi076 ceph-mon[35401]: pgmap v6209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:02 smithi040 ceph-mon[32397]: pgmap v6209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:02 smithi146 ceph-mon[35807]: pgmap v6209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:04.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:04 smithi040 ceph-mon[32397]: pgmap v6210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:04 smithi146 ceph-mon[35807]: pgmap v6210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:05.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:04 smithi076 ceph-mon[35401]: pgmap v6210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:06 smithi040 ceph-mon[32397]: pgmap v6211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7013.162329 secs 2024-07-26T15:30:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:06 smithi146 ceph-mon[35807]: pgmap v6211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7013.162329 secs 2024-07-26T15:30:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:06 smithi076 ceph-mon[35401]: pgmap v6211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7013.162329 secs 2024-07-26T15:30:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:08 smithi040 ceph-mon[32397]: pgmap v6212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:08 smithi146 ceph-mon[35807]: pgmap v6212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:08 smithi076 ceph-mon[35401]: pgmap v6212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:10 smithi040 ceph-mon[32397]: pgmap v6213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:10 smithi146 ceph-mon[35807]: pgmap v6213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:10 smithi076 ceph-mon[35401]: pgmap v6213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7018.162476 secs 2024-07-26T15:30:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7018.162476 secs 2024-07-26T15:30:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7018.162476 secs 2024-07-26T15:30:12.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:12 smithi040 ceph-mon[32397]: pgmap v6214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:12 smithi146 ceph-mon[35807]: pgmap v6214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:13.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:12 smithi076 ceph-mon[35401]: pgmap v6214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:14 smithi040 ceph-mon[32397]: pgmap v6215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:14 smithi146 ceph-mon[35807]: pgmap v6215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:14 smithi076 ceph-mon[35401]: pgmap v6215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:16 smithi040 ceph-mon[32397]: pgmap v6216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7023.162614 secs 2024-07-26T15:30:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:16 smithi146 ceph-mon[35807]: pgmap v6216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7023.162614 secs 2024-07-26T15:30:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:16 smithi076 ceph-mon[35401]: pgmap v6216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7023.162614 secs 2024-07-26T15:30:18.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:18 smithi040 ceph-mon[32397]: pgmap v6217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:18 smithi146 ceph-mon[35807]: pgmap v6217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:19.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:18 smithi076 ceph-mon[35401]: pgmap v6217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:20.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:20 smithi040 ceph-mon[32397]: pgmap v6218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:20 smithi146 ceph-mon[35807]: pgmap v6218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:20 smithi076 ceph-mon[35401]: pgmap v6218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:21.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7028.162757 secs 2024-07-26T15:30:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7028.162757 secs 2024-07-26T15:30:21.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7028.162757 secs 2024-07-26T15:30:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:22 smithi040 ceph-mon[32397]: pgmap v6219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:22 smithi146 ceph-mon[35807]: pgmap v6219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:22 smithi076 ceph-mon[35401]: pgmap v6219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:24.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:24 smithi040 ceph-mon[32397]: pgmap v6220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:24 smithi146 ceph-mon[35807]: pgmap v6220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:24 smithi076 ceph-mon[35401]: pgmap v6220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:26 smithi040 ceph-mon[32397]: pgmap v6221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7033.162895 secs 2024-07-26T15:30:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:26 smithi146 ceph-mon[35807]: pgmap v6221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7033.162895 secs 2024-07-26T15:30:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:26 smithi076 ceph-mon[35401]: pgmap v6221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7033.162895 secs 2024-07-26T15:30:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:28 smithi040 ceph-mon[32397]: pgmap v6222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:28 smithi146 ceph-mon[35807]: pgmap v6222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:28 smithi076 ceph-mon[35401]: pgmap v6222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:30 smithi040 ceph-mon[32397]: pgmap v6223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:30 smithi146 ceph-mon[35807]: pgmap v6223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:30 smithi076 ceph-mon[35401]: pgmap v6223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:31.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7038.163035 secs 2024-07-26T15:30:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7038.163035 secs 2024-07-26T15:30:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7038.163035 secs 2024-07-26T15:30:32.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:32 smithi040 ceph-mon[32397]: pgmap v6224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:32 smithi146 ceph-mon[35807]: pgmap v6224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:32 smithi076 ceph-mon[35401]: pgmap v6224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:34 smithi146 ceph-mon[35807]: pgmap v6225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:34 smithi076 ceph-mon[35401]: pgmap v6225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:34 smithi040 ceph-mon[32397]: pgmap v6225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:36 smithi146 ceph-mon[35807]: pgmap v6226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7043.163180 secs 2024-07-26T15:30:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:36 smithi076 ceph-mon[35401]: pgmap v6226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7043.163180 secs 2024-07-26T15:30:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:36 smithi040 ceph-mon[32397]: pgmap v6226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:37.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7043.163180 secs 2024-07-26T15:30:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:38 smithi146 ceph-mon[35807]: pgmap v6227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:38 smithi076 ceph-mon[35401]: pgmap v6227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:38 smithi040 ceph-mon[32397]: pgmap v6227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:40 smithi146 ceph-mon[35807]: pgmap v6228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:40 smithi076 ceph-mon[35401]: pgmap v6228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:40 smithi040 ceph-mon[32397]: pgmap v6228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7048.163344 secs 2024-07-26T15:30:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7048.163344 secs 2024-07-26T15:30:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7048.163344 secs 2024-07-26T15:30:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:42 smithi146 ceph-mon[35807]: pgmap v6229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:42 smithi076 ceph-mon[35401]: pgmap v6229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:42 smithi040 ceph-mon[32397]: pgmap v6229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:44 smithi146 ceph-mon[35807]: pgmap v6230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:44 smithi076 ceph-mon[35401]: pgmap v6230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:44 smithi040 ceph-mon[32397]: pgmap v6230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:46 smithi146 ceph-mon[35807]: pgmap v6231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:47.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7053.163512 secs 2024-07-26T15:30:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:46 smithi076 ceph-mon[35401]: pgmap v6231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7053.163512 secs 2024-07-26T15:30:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:46 smithi040 ceph-mon[32397]: pgmap v6231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7053.163512 secs 2024-07-26T15:30:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:48 smithi146 ceph-mon[35807]: pgmap v6232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:48 smithi076 ceph-mon[35401]: pgmap v6232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:48 smithi040 ceph-mon[32397]: pgmap v6232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:50 smithi146 ceph-mon[35807]: pgmap v6233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:50 smithi076 ceph-mon[35401]: pgmap v6233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:50 smithi040 ceph-mon[32397]: pgmap v6233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7058.163651 secs 2024-07-26T15:30:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7058.163651 secs 2024-07-26T15:30:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7058.163651 secs 2024-07-26T15:30:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:52 smithi146 ceph-mon[35807]: pgmap v6234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:52 smithi076 ceph-mon[35401]: pgmap v6234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:52 smithi040 ceph-mon[32397]: pgmap v6234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:54 smithi076 ceph-mon[35401]: pgmap v6235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:54 smithi040 ceph-mon[32397]: pgmap v6235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:54 smithi146 ceph-mon[35807]: pgmap v6235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:30:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:56 smithi040 ceph-mon[32397]: pgmap v6236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7063.163791 secs 2024-07-26T15:30:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:56 smithi146 ceph-mon[35807]: pgmap v6236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7063.163791 secs 2024-07-26T15:30:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:56 smithi076 ceph-mon[35401]: pgmap v6236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:30:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7063.163791 secs 2024-07-26T15:30:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:30:58 smithi040 ceph-mon[32397]: pgmap v6237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:30:58 smithi146 ceph-mon[35807]: pgmap v6237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:30:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:30:58 smithi076 ceph-mon[35401]: pgmap v6237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:00 smithi040 ceph-mon[32397]: pgmap v6238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:00 smithi146 ceph-mon[35807]: pgmap v6238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:00 smithi076 ceph-mon[35401]: pgmap v6238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7068.163924 secs 2024-07-26T15:31:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7068.163924 secs 2024-07-26T15:31:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7068.163924 secs 2024-07-26T15:31:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:02 smithi040 ceph-mon[32397]: pgmap v6239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:02 smithi146 ceph-mon[35807]: pgmap v6239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:02 smithi076 ceph-mon[35401]: pgmap v6239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:04 smithi040 ceph-mon[32397]: pgmap v6240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:04 smithi146 ceph-mon[35807]: pgmap v6240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:04 smithi076 ceph-mon[35401]: pgmap v6240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:06 smithi040 ceph-mon[32397]: pgmap v6241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7073.164090 secs 2024-07-26T15:31:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:06 smithi146 ceph-mon[35807]: pgmap v6241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7073.164090 secs 2024-07-26T15:31:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:06 smithi076 ceph-mon[35401]: pgmap v6241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7073.164090 secs 2024-07-26T15:31:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:08 smithi040 ceph-mon[32397]: pgmap v6242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:08 smithi146 ceph-mon[35807]: pgmap v6242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:08 smithi076 ceph-mon[35401]: pgmap v6242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:10 smithi040 ceph-mon[32397]: pgmap v6243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:10 smithi146 ceph-mon[35807]: pgmap v6243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:10 smithi076 ceph-mon[35401]: pgmap v6243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7078.164245 secs 2024-07-26T15:31:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7078.164245 secs 2024-07-26T15:31:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7078.164245 secs 2024-07-26T15:31:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:12 smithi040 ceph-mon[32397]: pgmap v6244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:12 smithi146 ceph-mon[35807]: pgmap v6244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:12 smithi076 ceph-mon[35401]: pgmap v6244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:15.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:14 smithi040 ceph-mon[32397]: pgmap v6245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:14 smithi146 ceph-mon[35807]: pgmap v6245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:14 smithi076 ceph-mon[35401]: pgmap v6245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:16 smithi040 ceph-mon[32397]: pgmap v6246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7083.164365 secs 2024-07-26T15:31:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:16 smithi146 ceph-mon[35807]: pgmap v6246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7083.164365 secs 2024-07-26T15:31:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:16 smithi076 ceph-mon[35401]: pgmap v6246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7083.164365 secs 2024-07-26T15:31:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:18 smithi040 ceph-mon[32397]: pgmap v6247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:18 smithi146 ceph-mon[35807]: pgmap v6247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:18 smithi076 ceph-mon[35401]: pgmap v6247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:20 smithi040 ceph-mon[32397]: pgmap v6248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:20 smithi146 ceph-mon[35807]: pgmap v6248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:20 smithi076 ceph-mon[35401]: pgmap v6248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7088.164506 secs 2024-07-26T15:31:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7088.164506 secs 2024-07-26T15:31:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7088.164506 secs 2024-07-26T15:31:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:22 smithi040 ceph-mon[32397]: pgmap v6249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:22 smithi146 ceph-mon[35807]: pgmap v6249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:22 smithi076 ceph-mon[35401]: pgmap v6249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:25.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:24 smithi040 ceph-mon[32397]: pgmap v6250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:24 smithi146 ceph-mon[35807]: pgmap v6250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:24 smithi076 ceph-mon[35401]: pgmap v6250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:26 smithi040 ceph-mon[32397]: pgmap v6251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7093.164642 secs 2024-07-26T15:31:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:26 smithi146 ceph-mon[35807]: pgmap v6251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7093.164642 secs 2024-07-26T15:31:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:26 smithi076 ceph-mon[35401]: pgmap v6251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7093.164642 secs 2024-07-26T15:31:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:28 smithi040 ceph-mon[32397]: pgmap v6252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:28 smithi146 ceph-mon[35807]: pgmap v6252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:28 smithi076 ceph-mon[35401]: pgmap v6252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:30 smithi040 ceph-mon[32397]: pgmap v6253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:30 smithi146 ceph-mon[35807]: pgmap v6253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:30 smithi076 ceph-mon[35401]: pgmap v6253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7098.164802 secs 2024-07-26T15:31:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7098.164802 secs 2024-07-26T15:31:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7098.164802 secs 2024-07-26T15:31:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:32 smithi146 ceph-mon[35807]: pgmap v6254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:32 smithi076 ceph-mon[35401]: pgmap v6254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:32 smithi040 ceph-mon[32397]: pgmap v6254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:35 smithi146 ceph-mon[35807]: pgmap v6255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:35 smithi076 ceph-mon[35401]: pgmap v6255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:35 smithi040 ceph-mon[32397]: pgmap v6255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:37 smithi146 ceph-mon[35807]: pgmap v6256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7103.164943 secs 2024-07-26T15:31:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:37 smithi076 ceph-mon[35401]: pgmap v6256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7103.164943 secs 2024-07-26T15:31:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:37 smithi040 ceph-mon[32397]: pgmap v6256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7103.164943 secs 2024-07-26T15:31:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:39 smithi146 ceph-mon[35807]: pgmap v6257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:39 smithi076 ceph-mon[35401]: pgmap v6257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:39 smithi040 ceph-mon[32397]: pgmap v6257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:41 smithi146 ceph-mon[35807]: pgmap v6258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:41.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:41 smithi076 ceph-mon[35401]: pgmap v6258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:41 smithi040 ceph-mon[32397]: pgmap v6258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7108.165084 secs 2024-07-26T15:31:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7108.165084 secs 2024-07-26T15:31:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7108.165084 secs 2024-07-26T15:31:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:43 smithi146 ceph-mon[35807]: pgmap v6259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:43 smithi076 ceph-mon[35401]: pgmap v6259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:43.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:43 smithi040 ceph-mon[32397]: pgmap v6259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:44.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:44 smithi040 ceph-mon[32397]: pgmap v6260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:44 smithi146 ceph-mon[35807]: pgmap v6260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:44 smithi076 ceph-mon[35401]: pgmap v6260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:46 smithi040 ceph-mon[32397]: pgmap v6261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7113.165242 secs 2024-07-26T15:31:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:46 smithi146 ceph-mon[35807]: pgmap v6261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7113.165242 secs 2024-07-26T15:31:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:46 smithi076 ceph-mon[35401]: pgmap v6261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7113.165242 secs 2024-07-26T15:31:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:48 smithi040 ceph-mon[32397]: pgmap v6262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:48 smithi146 ceph-mon[35807]: pgmap v6262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:48 smithi076 ceph-mon[35401]: pgmap v6262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:50 smithi040 ceph-mon[32397]: pgmap v6263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:50 smithi146 ceph-mon[35807]: pgmap v6263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:50 smithi076 ceph-mon[35401]: pgmap v6263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:51.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7118.165404 secs 2024-07-26T15:31:51.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7118.165404 secs 2024-07-26T15:31:51.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7118.165404 secs 2024-07-26T15:31:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:52 smithi040 ceph-mon[32397]: pgmap v6264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:52 smithi146 ceph-mon[35807]: pgmap v6264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:52 smithi076 ceph-mon[35401]: pgmap v6264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:54.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:54 smithi040 ceph-mon[32397]: pgmap v6265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:54 smithi146 ceph-mon[35807]: pgmap v6265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:54 smithi076 ceph-mon[35401]: pgmap v6265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:31:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:56 smithi040 ceph-mon[32397]: pgmap v6266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7123.165504 secs 2024-07-26T15:31:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:56 smithi146 ceph-mon[35807]: pgmap v6266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7123.165504 secs 2024-07-26T15:31:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:56 smithi076 ceph-mon[35401]: pgmap v6266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:31:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7123.165504 secs 2024-07-26T15:31:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:31:58 smithi040 ceph-mon[32397]: pgmap v6267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:31:58 smithi146 ceph-mon[35807]: pgmap v6267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:31:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:31:58 smithi076 ceph-mon[35401]: pgmap v6267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:00 smithi040 ceph-mon[32397]: pgmap v6268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:00 smithi146 ceph-mon[35807]: pgmap v6268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:00 smithi076 ceph-mon[35401]: pgmap v6268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7128.165646 secs 2024-07-26T15:32:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7128.165646 secs 2024-07-26T15:32:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7128.165646 secs 2024-07-26T15:32:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:02 smithi040 ceph-mon[32397]: pgmap v6269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:02 smithi146 ceph-mon[35807]: pgmap v6269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:02 smithi076 ceph-mon[35401]: pgmap v6269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:04 smithi040 ceph-mon[32397]: pgmap v6270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:04 smithi146 ceph-mon[35807]: pgmap v6270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:04 smithi076 ceph-mon[35401]: pgmap v6270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:06 smithi040 ceph-mon[32397]: pgmap v6271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7133.165785 secs 2024-07-26T15:32:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:06 smithi146 ceph-mon[35807]: pgmap v6271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7133.165785 secs 2024-07-26T15:32:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:06 smithi076 ceph-mon[35401]: pgmap v6271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7133.165785 secs 2024-07-26T15:32:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:08 smithi040 ceph-mon[32397]: pgmap v6272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:08 smithi146 ceph-mon[35807]: pgmap v6272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:08 smithi076 ceph-mon[35401]: pgmap v6272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:10 smithi040 ceph-mon[32397]: pgmap v6273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:10 smithi146 ceph-mon[35807]: pgmap v6273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:10 smithi076 ceph-mon[35401]: pgmap v6273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7138.165930 secs 2024-07-26T15:32:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7138.165930 secs 2024-07-26T15:32:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7138.165930 secs 2024-07-26T15:32:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:12 smithi040 ceph-mon[32397]: pgmap v6274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:12 smithi146 ceph-mon[35807]: pgmap v6274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:12 smithi076 ceph-mon[35401]: pgmap v6274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:14.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:14 smithi040 ceph-mon[32397]: pgmap v6275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:14 smithi146 ceph-mon[35807]: pgmap v6275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:14 smithi076 ceph-mon[35401]: pgmap v6275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:16 smithi040 ceph-mon[32397]: pgmap v6276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7143.166066 secs 2024-07-26T15:32:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:16 smithi146 ceph-mon[35807]: pgmap v6276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7143.166066 secs 2024-07-26T15:32:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:16 smithi076 ceph-mon[35401]: pgmap v6276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7143.166066 secs 2024-07-26T15:32:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:18 smithi040 ceph-mon[32397]: pgmap v6277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:18 smithi146 ceph-mon[35807]: pgmap v6277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:18 smithi076 ceph-mon[35401]: pgmap v6277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:20 smithi146 ceph-mon[35807]: pgmap v6278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:20 smithi076 ceph-mon[35401]: pgmap v6278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:20 smithi040 ceph-mon[32397]: pgmap v6278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7148.166209 secs 2024-07-26T15:32:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7148.166209 secs 2024-07-26T15:32:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7148.166209 secs 2024-07-26T15:32:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:22 smithi146 ceph-mon[35807]: pgmap v6279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:22 smithi076 ceph-mon[35401]: pgmap v6279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:22 smithi040 ceph-mon[32397]: pgmap v6279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:24 smithi146 ceph-mon[35807]: pgmap v6280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:24 smithi076 ceph-mon[35401]: pgmap v6280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:24 smithi040 ceph-mon[32397]: pgmap v6280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:26 smithi146 ceph-mon[35807]: pgmap v6281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7153.166342 secs 2024-07-26T15:32:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:26 smithi076 ceph-mon[35401]: pgmap v6281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7153.166342 secs 2024-07-26T15:32:27.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:26 smithi040 ceph-mon[32397]: pgmap v6281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7153.166342 secs 2024-07-26T15:32:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:28 smithi146 ceph-mon[35807]: pgmap v6282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:28 smithi076 ceph-mon[35401]: pgmap v6282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:29.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:28 smithi040 ceph-mon[32397]: pgmap v6282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:31.035 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:30 smithi040 ceph-mon[32397]: pgmap v6283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:30 smithi146 ceph-mon[35807]: pgmap v6283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:30 smithi076 ceph-mon[35401]: pgmap v6283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7158.166443 secs 2024-07-26T15:32:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7158.166443 secs 2024-07-26T15:32:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7158.166443 secs 2024-07-26T15:32:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:32 smithi146 ceph-mon[35807]: pgmap v6284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:32 smithi076 ceph-mon[35401]: pgmap v6284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:32 smithi040 ceph-mon[32397]: pgmap v6284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:34 smithi146 ceph-mon[35807]: pgmap v6285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:34 smithi076 ceph-mon[35401]: pgmap v6285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:34 smithi040 ceph-mon[32397]: pgmap v6285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:36 smithi146 ceph-mon[35807]: pgmap v6286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7163.166587 secs 2024-07-26T15:32:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:36 smithi076 ceph-mon[35401]: pgmap v6286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7163.166587 secs 2024-07-26T15:32:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:36 smithi040 ceph-mon[32397]: pgmap v6286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7163.166587 secs 2024-07-26T15:32:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:38 smithi076 ceph-mon[35401]: pgmap v6287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:38 smithi040 ceph-mon[32397]: pgmap v6287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:38 smithi146 ceph-mon[35807]: pgmap v6287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:40 smithi076 ceph-mon[35401]: pgmap v6288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:40 smithi040 ceph-mon[32397]: pgmap v6288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:40 smithi146 ceph-mon[35807]: pgmap v6288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7168.166728 secs 2024-07-26T15:32:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7168.166728 secs 2024-07-26T15:32:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7168.166728 secs 2024-07-26T15:32:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:42 smithi040 ceph-mon[32397]: pgmap v6289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:42 smithi146 ceph-mon[35807]: pgmap v6289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:42 smithi076 ceph-mon[35401]: pgmap v6289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:44 smithi040 ceph-mon[32397]: pgmap v6290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:44 smithi146 ceph-mon[35807]: pgmap v6290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:44 smithi076 ceph-mon[35401]: pgmap v6290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:46 smithi040 ceph-mon[32397]: pgmap v6291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7173.166872 secs 2024-07-26T15:32:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:46 smithi146 ceph-mon[35807]: pgmap v6291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7173.166872 secs 2024-07-26T15:32:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:46 smithi076 ceph-mon[35401]: pgmap v6291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7173.166872 secs 2024-07-26T15:32:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:48 smithi040 ceph-mon[32397]: pgmap v6292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:48 smithi146 ceph-mon[35807]: pgmap v6292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:48 smithi076 ceph-mon[35401]: pgmap v6292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:51.125 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:50 smithi146 ceph-mon[35807]: pgmap v6293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:51.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:50 smithi076 ceph-mon[35401]: pgmap v6293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:50 smithi040 ceph-mon[32397]: pgmap v6293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7178.167011 secs 2024-07-26T15:32:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7178.167011 secs 2024-07-26T15:32:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7178.167011 secs 2024-07-26T15:32:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:52 smithi040 ceph-mon[32397]: pgmap v6294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:52 smithi146 ceph-mon[35807]: pgmap v6294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:52 smithi076 ceph-mon[35401]: pgmap v6294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:54 smithi040 ceph-mon[32397]: pgmap v6295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:54 smithi146 ceph-mon[35807]: pgmap v6295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:54 smithi076 ceph-mon[35401]: pgmap v6295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:32:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:56 smithi040 ceph-mon[32397]: pgmap v6296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:57.241 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7183.167168 secs 2024-07-26T15:32:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:56 smithi146 ceph-mon[35807]: pgmap v6296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7183.167168 secs 2024-07-26T15:32:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:56 smithi076 ceph-mon[35401]: pgmap v6296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:32:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7183.167168 secs 2024-07-26T15:32:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:32:58 smithi040 ceph-mon[32397]: pgmap v6297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:32:58 smithi146 ceph-mon[35807]: pgmap v6297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:32:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:32:58 smithi076 ceph-mon[35401]: pgmap v6297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:00 smithi040 ceph-mon[32397]: pgmap v6298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:00 smithi146 ceph-mon[35807]: pgmap v6298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:00 smithi076 ceph-mon[35401]: pgmap v6298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7188.167331 secs 2024-07-26T15:33:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7188.167331 secs 2024-07-26T15:33:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7188.167331 secs 2024-07-26T15:33:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:02 smithi040 ceph-mon[32397]: pgmap v6299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:02 smithi146 ceph-mon[35807]: pgmap v6299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:02 smithi076 ceph-mon[35401]: pgmap v6299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:04 smithi040 ceph-mon[32397]: pgmap v6300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:04 smithi146 ceph-mon[35807]: pgmap v6300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:04 smithi076 ceph-mon[35401]: pgmap v6300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7193.167472 secs 2024-07-26T15:33:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:06 smithi040 ceph-mon[32397]: pgmap v6301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7193.167472 secs 2024-07-26T15:33:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:06 smithi146 ceph-mon[35807]: pgmap v6301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7193.167472 secs 2024-07-26T15:33:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:06 smithi076 ceph-mon[35401]: pgmap v6301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:08 smithi040 ceph-mon[32397]: pgmap v6302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:08 smithi146 ceph-mon[35807]: pgmap v6302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:08 smithi076 ceph-mon[35401]: pgmap v6302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:10 smithi040 ceph-mon[32397]: pgmap v6303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:10 smithi146 ceph-mon[35807]: pgmap v6303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:10 smithi076 ceph-mon[35401]: pgmap v6303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7198.167613 secs 2024-07-26T15:33:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7198.167613 secs 2024-07-26T15:33:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7198.167613 secs 2024-07-26T15:33:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:12 smithi146 ceph-mon[35807]: pgmap v6304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:12 smithi076 ceph-mon[35401]: pgmap v6304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:12 smithi040 ceph-mon[32397]: pgmap v6304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:14 smithi146 ceph-mon[35807]: pgmap v6305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:14 smithi076 ceph-mon[35401]: pgmap v6305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:14 smithi040 ceph-mon[32397]: pgmap v6305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7203.167707 secs 2024-07-26T15:33:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:16 smithi146 ceph-mon[35807]: pgmap v6306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7203.167707 secs 2024-07-26T15:33:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:16 smithi076 ceph-mon[35401]: pgmap v6306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7203.167707 secs 2024-07-26T15:33:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:16 smithi040 ceph-mon[32397]: pgmap v6306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:19 smithi146 ceph-mon[35807]: pgmap v6307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:19 smithi076 ceph-mon[35401]: pgmap v6307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:19 smithi040 ceph-mon[32397]: pgmap v6307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:21 smithi146 ceph-mon[35807]: pgmap v6308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:21 smithi076 ceph-mon[35401]: pgmap v6308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:21 smithi040 ceph-mon[32397]: pgmap v6308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7208.167851 secs 2024-07-26T15:33:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7208.167851 secs 2024-07-26T15:33:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7208.167851 secs 2024-07-26T15:33:23.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:23 smithi146 ceph-mon[35807]: pgmap v6309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:23 smithi076 ceph-mon[35401]: pgmap v6309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:23 smithi040 ceph-mon[32397]: pgmap v6309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:25 smithi146 ceph-mon[35807]: pgmap v6310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:25 smithi076 ceph-mon[35401]: pgmap v6310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:25 smithi040 ceph-mon[32397]: pgmap v6310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:26.383 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() TimeoutError 2024-07-26T15:33:26.393 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() TimeoutError 2024-07-26T15:33:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7213.167991 secs 2024-07-26T15:33:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:27 smithi146 ceph-mon[35807]: pgmap v6311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7213.167991 secs 2024-07-26T15:33:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:27 smithi076 ceph-mon[35401]: pgmap v6311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7213.167991 secs 2024-07-26T15:33:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:27 smithi040 ceph-mon[32397]: pgmap v6311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:29 smithi146 ceph-mon[35807]: pgmap v6312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:29 smithi076 ceph-mon[35401]: pgmap v6312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:29 smithi040 ceph-mon[32397]: pgmap v6312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:31 smithi146 ceph-mon[35807]: pgmap v6313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:31 smithi076 ceph-mon[35401]: pgmap v6313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:31 smithi040 ceph-mon[32397]: pgmap v6313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7218.168148 secs 2024-07-26T15:33:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7218.168148 secs 2024-07-26T15:33:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7218.168148 secs 2024-07-26T15:33:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:33 smithi076 ceph-mon[35401]: pgmap v6314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:33 smithi040 ceph-mon[32397]: pgmap v6314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:33 smithi146 ceph-mon[35807]: pgmap v6314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:34.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:34 smithi040 ceph-mon[32397]: pgmap v6315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:34 smithi146 ceph-mon[35807]: pgmap v6315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:34 smithi076 ceph-mon[35401]: pgmap v6315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7223.168320 secs 2024-07-26T15:33:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:36 smithi040 ceph-mon[32397]: pgmap v6316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7223.168320 secs 2024-07-26T15:33:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:36 smithi146 ceph-mon[35807]: pgmap v6316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7223.168320 secs 2024-07-26T15:33:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:36 smithi076 ceph-mon[35401]: pgmap v6316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:38 smithi040 ceph-mon[32397]: pgmap v6317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:38 smithi146 ceph-mon[35807]: pgmap v6317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:38 smithi076 ceph-mon[35401]: pgmap v6317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:40 smithi040 ceph-mon[32397]: pgmap v6318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:40 smithi146 ceph-mon[35807]: pgmap v6318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:40 smithi076 ceph-mon[35401]: pgmap v6318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:41.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7228.168459 secs 2024-07-26T15:33:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7228.168459 secs 2024-07-26T15:33:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7228.168459 secs 2024-07-26T15:33:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:42 smithi040 ceph-mon[32397]: pgmap v6319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:42 smithi146 ceph-mon[35807]: pgmap v6319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:42 smithi076 ceph-mon[35401]: pgmap v6319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:44 smithi040 ceph-mon[32397]: pgmap v6320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:44 smithi146 ceph-mon[35807]: pgmap v6320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:44 smithi076 ceph-mon[35401]: pgmap v6320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7233.168562 secs 2024-07-26T15:33:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:46 smithi040 ceph-mon[32397]: pgmap v6321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7233.168562 secs 2024-07-26T15:33:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:46 smithi146 ceph-mon[35807]: pgmap v6321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7233.168562 secs 2024-07-26T15:33:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:46 smithi076 ceph-mon[35401]: pgmap v6321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:48 smithi040 ceph-mon[32397]: pgmap v6322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:48 smithi146 ceph-mon[35807]: pgmap v6322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:48 smithi076 ceph-mon[35401]: pgmap v6322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:50 smithi040 ceph-mon[32397]: pgmap v6323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:50 smithi146 ceph-mon[35807]: pgmap v6323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:50 smithi076 ceph-mon[35401]: pgmap v6323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:51.986 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7238.168706 secs 2024-07-26T15:33:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7238.168706 secs 2024-07-26T15:33:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7238.168706 secs 2024-07-26T15:33:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:52 smithi146 ceph-mon[35807]: pgmap v6324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:52 smithi076 ceph-mon[35401]: pgmap v6324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:52 smithi040 ceph-mon[32397]: pgmap v6324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:54 smithi146 ceph-mon[35807]: pgmap v6325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:54 smithi076 ceph-mon[35401]: pgmap v6325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:54 smithi040 ceph-mon[32397]: pgmap v6325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:33:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7243.168862 secs 2024-07-26T15:33:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:56 smithi146 ceph-mon[35807]: pgmap v6326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7243.168862 secs 2024-07-26T15:33:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:56 smithi076 ceph-mon[35401]: pgmap v6326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7243.168862 secs 2024-07-26T15:33:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:56 smithi040 ceph-mon[32397]: pgmap v6326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:33:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:33:58 smithi146 ceph-mon[35807]: pgmap v6327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:33:58 smithi076 ceph-mon[35401]: pgmap v6327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:33:59.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:33:58 smithi040 ceph-mon[32397]: pgmap v6327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:01.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:00 smithi040 ceph-mon[32397]: pgmap v6328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:00 smithi146 ceph-mon[35807]: pgmap v6328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:00 smithi076 ceph-mon[35401]: pgmap v6328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7248.168999 secs 2024-07-26T15:34:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7248.168999 secs 2024-07-26T15:34:02.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7248.168999 secs 2024-07-26T15:34:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:02 smithi146 ceph-mon[35807]: pgmap v6329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:02 smithi076 ceph-mon[35401]: pgmap v6329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:02 smithi040 ceph-mon[32397]: pgmap v6329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:04 smithi146 ceph-mon[35807]: pgmap v6330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:04 smithi076 ceph-mon[35401]: pgmap v6330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:04 smithi040 ceph-mon[32397]: pgmap v6330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7253.169139 secs 2024-07-26T15:34:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:06 smithi146 ceph-mon[35807]: pgmap v6331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7253.169139 secs 2024-07-26T15:34:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:06 smithi076 ceph-mon[35401]: pgmap v6331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7253.169139 secs 2024-07-26T15:34:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:06 smithi040 ceph-mon[32397]: pgmap v6331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:08 smithi146 ceph-mon[35807]: pgmap v6332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:08 smithi076 ceph-mon[35401]: pgmap v6332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:08 smithi040 ceph-mon[32397]: pgmap v6332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:10 smithi076 ceph-mon[35401]: pgmap v6333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:11.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:10 smithi040 ceph-mon[32397]: pgmap v6333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:10 smithi146 ceph-mon[35807]: pgmap v6333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7258.169314 secs 2024-07-26T15:34:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7258.169314 secs 2024-07-26T15:34:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7258.169314 secs 2024-07-26T15:34:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:12 smithi040 ceph-mon[32397]: pgmap v6334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:12 smithi146 ceph-mon[35807]: pgmap v6334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:12 smithi076 ceph-mon[35401]: pgmap v6334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:14 smithi040 ceph-mon[32397]: pgmap v6335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:14 smithi146 ceph-mon[35807]: pgmap v6335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:14 smithi076 ceph-mon[35401]: pgmap v6335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7263.169449 secs 2024-07-26T15:34:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:16 smithi040 ceph-mon[32397]: pgmap v6336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7263.169449 secs 2024-07-26T15:34:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:16 smithi146 ceph-mon[35807]: pgmap v6336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7263.169449 secs 2024-07-26T15:34:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:16 smithi076 ceph-mon[35401]: pgmap v6336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:18 smithi040 ceph-mon[32397]: pgmap v6337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:18 smithi146 ceph-mon[35807]: pgmap v6337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:18 smithi076 ceph-mon[35401]: pgmap v6337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:21.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:20 smithi146 ceph-mon[35807]: pgmap v6338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:21.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:20 smithi076 ceph-mon[35401]: pgmap v6338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:21.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:20 smithi040 ceph-mon[32397]: pgmap v6338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7268.169592 secs 2024-07-26T15:34:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7268.169592 secs 2024-07-26T15:34:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7268.169592 secs 2024-07-26T15:34:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:22 smithi040 ceph-mon[32397]: pgmap v6339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:22 smithi146 ceph-mon[35807]: pgmap v6339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:22 smithi076 ceph-mon[35401]: pgmap v6339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:24 smithi040 ceph-mon[32397]: pgmap v6340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:24 smithi146 ceph-mon[35807]: pgmap v6340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:24 smithi076 ceph-mon[35401]: pgmap v6340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:27.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7273.169694 secs 2024-07-26T15:34:27.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:26 smithi040 ceph-mon[32397]: pgmap v6341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7273.169694 secs 2024-07-26T15:34:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:26 smithi146 ceph-mon[35807]: pgmap v6341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7273.169694 secs 2024-07-26T15:34:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:26 smithi076 ceph-mon[35401]: pgmap v6341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:28 smithi040 ceph-mon[32397]: pgmap v6342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:28 smithi146 ceph-mon[35807]: pgmap v6342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:28 smithi076 ceph-mon[35401]: pgmap v6342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:30 smithi040 ceph-mon[32397]: pgmap v6343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:30 smithi146 ceph-mon[35807]: pgmap v6343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:30 smithi076 ceph-mon[35401]: pgmap v6343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7278.169852 secs 2024-07-26T15:34:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7278.169852 secs 2024-07-26T15:34:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7278.169852 secs 2024-07-26T15:34:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:32 smithi040 ceph-mon[32397]: pgmap v6344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:32 smithi146 ceph-mon[35807]: pgmap v6344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:32 smithi076 ceph-mon[35401]: pgmap v6344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:35.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:34 smithi040 ceph-mon[32397]: pgmap v6345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:34 smithi146 ceph-mon[35807]: pgmap v6345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:34 smithi076 ceph-mon[35401]: pgmap v6345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7283.170012 secs 2024-07-26T15:34:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:36 smithi040 ceph-mon[32397]: pgmap v6346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:34:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7283.170012 secs 2024-07-26T15:34:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:36 smithi146 ceph-mon[35807]: pgmap v6346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7283.170012 secs 2024-07-26T15:34:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:36 smithi076 ceph-mon[35401]: pgmap v6346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:34:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:38 smithi040 ceph-mon[32397]: pgmap v6347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:38 smithi146 ceph-mon[35807]: pgmap v6347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:38 smithi076 ceph-mon[35401]: pgmap v6347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:40 smithi040 ceph-mon[32397]: pgmap v6348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:40 smithi146 ceph-mon[35807]: pgmap v6348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:40 smithi076 ceph-mon[35401]: pgmap v6348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7288.170168 secs 2024-07-26T15:34:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7288.170168 secs 2024-07-26T15:34:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7288.170168 secs 2024-07-26T15:34:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:42 smithi040 ceph-mon[32397]: pgmap v6349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:42 smithi146 ceph-mon[35807]: pgmap v6349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:42 smithi076 ceph-mon[35401]: pgmap v6349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:44 smithi146 ceph-mon[35807]: pgmap v6350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:44 smithi076 ceph-mon[35401]: pgmap v6350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:45.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:44 smithi040 ceph-mon[32397]: pgmap v6350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:34:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7293.170337 secs 2024-07-26T15:34:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:46 smithi146 ceph-mon[35807]: pgmap v6351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:34:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7293.170337 secs 2024-07-26T15:34:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:46 smithi076 ceph-mon[35401]: pgmap v6351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:34:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7293.170337 secs 2024-07-26T15:34:47.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:46 smithi040 ceph-mon[32397]: pgmap v6351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:34:49.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:48 smithi146 ceph-mon[35807]: pgmap v6352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:48 smithi076 ceph-mon[35401]: pgmap v6352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:48 smithi040 ceph-mon[32397]: pgmap v6352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:51 smithi146 ceph-mon[35807]: pgmap v6353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:51 smithi076 ceph-mon[35401]: pgmap v6353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:51 smithi040 ceph-mon[32397]: pgmap v6353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7298.170512 secs 2024-07-26T15:34:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7298.170512 secs 2024-07-26T15:34:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7298.170512 secs 2024-07-26T15:34:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:53 smithi146 ceph-mon[35807]: pgmap v6354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:53 smithi076 ceph-mon[35401]: pgmap v6354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:53 smithi040 ceph-mon[32397]: pgmap v6354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:55 smithi146 ceph-mon[35807]: pgmap v6355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:55 smithi076 ceph-mon[35401]: pgmap v6355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:55 smithi040 ceph-mon[32397]: pgmap v6355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:34:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7303.170605 secs 2024-07-26T15:34:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:57 smithi146 ceph-mon[35807]: pgmap v6356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7303.170605 secs 2024-07-26T15:34:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:57 smithi076 ceph-mon[35401]: pgmap v6356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7303.170605 secs 2024-07-26T15:34:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:57 smithi040 ceph-mon[32397]: pgmap v6356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:34:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:34:59 smithi146 ceph-mon[35807]: pgmap v6357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:34:59 smithi076 ceph-mon[35401]: pgmap v6357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:34:59.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:34:59 smithi040 ceph-mon[32397]: pgmap v6357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:01 smithi146 ceph-mon[35807]: pgmap v6358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:01 smithi076 ceph-mon[35401]: pgmap v6358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:01 smithi040 ceph-mon[32397]: pgmap v6358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7308.170746 secs 2024-07-26T15:35:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7308.170746 secs 2024-07-26T15:35:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7308.170746 secs 2024-07-26T15:35:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:03 smithi146 ceph-mon[35807]: pgmap v6359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:03 smithi076 ceph-mon[35401]: pgmap v6359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:03.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:03 smithi040 ceph-mon[32397]: pgmap v6359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:05 smithi076 ceph-mon[35401]: pgmap v6360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:05 smithi040 ceph-mon[32397]: pgmap v6360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:05 smithi146 ceph-mon[35807]: pgmap v6360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7313.170887 secs 2024-07-26T15:35:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:07 smithi076 ceph-mon[35401]: pgmap v6361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7313.170887 secs 2024-07-26T15:35:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:07 smithi040 ceph-mon[32397]: pgmap v6361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7313.170887 secs 2024-07-26T15:35:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:07 smithi146 ceph-mon[35807]: pgmap v6361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:09 smithi040 ceph-mon[32397]: pgmap v6362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:09 smithi146 ceph-mon[35807]: pgmap v6362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:09 smithi076 ceph-mon[35401]: pgmap v6362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:11 smithi040 ceph-mon[32397]: pgmap v6363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:11 smithi146 ceph-mon[35807]: pgmap v6363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:11 smithi076 ceph-mon[35401]: pgmap v6363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7318.171037 secs 2024-07-26T15:35:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:12 smithi040 ceph-mon[32397]: pgmap v6364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7318.171037 secs 2024-07-26T15:35:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:12 smithi146 ceph-mon[35807]: pgmap v6364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7318.171037 secs 2024-07-26T15:35:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:12 smithi076 ceph-mon[35401]: pgmap v6364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:14 smithi040 ceph-mon[32397]: pgmap v6365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:14 smithi146 ceph-mon[35807]: pgmap v6365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:14 smithi076 ceph-mon[35401]: pgmap v6365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7323.171175 secs 2024-07-26T15:35:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:16 smithi146 ceph-mon[35807]: pgmap v6366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:35:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7323.171175 secs 2024-07-26T15:35:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:16 smithi076 ceph-mon[35401]: pgmap v6366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:35:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7323.171175 secs 2024-07-26T15:35:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:16 smithi040 ceph-mon[32397]: pgmap v6366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:35:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:18 smithi146 ceph-mon[35807]: pgmap v6367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:18 smithi076 ceph-mon[35401]: pgmap v6367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:19.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:18 smithi040 ceph-mon[32397]: pgmap v6367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:20 smithi146 ceph-mon[35807]: pgmap v6368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:20 smithi076 ceph-mon[35401]: pgmap v6368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:20 smithi040 ceph-mon[32397]: pgmap v6368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7328.171340 secs 2024-07-26T15:35:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7328.171340 secs 2024-07-26T15:35:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7328.171340 secs 2024-07-26T15:35:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:22 smithi146 ceph-mon[35807]: pgmap v6369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:22 smithi076 ceph-mon[35401]: pgmap v6369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:22 smithi040 ceph-mon[32397]: pgmap v6369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:24 smithi146 ceph-mon[35807]: pgmap v6370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:24 smithi076 ceph-mon[35401]: pgmap v6370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:24 smithi040 ceph-mon[32397]: pgmap v6370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7333.171482 secs 2024-07-26T15:35:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:26 smithi146 ceph-mon[35807]: pgmap v6371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7333.171482 secs 2024-07-26T15:35:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:26 smithi076 ceph-mon[35401]: pgmap v6371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7333.171482 secs 2024-07-26T15:35:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:26 smithi040 ceph-mon[32397]: pgmap v6371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:28 smithi146 ceph-mon[35807]: pgmap v6372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:28 smithi076 ceph-mon[35401]: pgmap v6372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:28 smithi040 ceph-mon[32397]: pgmap v6372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:30 smithi146 ceph-mon[35807]: pgmap v6373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:30 smithi076 ceph-mon[35401]: pgmap v6373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:30 smithi040 ceph-mon[32397]: pgmap v6373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7338.171624 secs 2024-07-26T15:35:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7338.171624 secs 2024-07-26T15:35:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7338.171624 secs 2024-07-26T15:35:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:32 smithi146 ceph-mon[35807]: pgmap v6374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:32 smithi076 ceph-mon[35401]: pgmap v6374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:33.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:32 smithi040 ceph-mon[32397]: pgmap v6374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:34 smithi146 ceph-mon[35807]: pgmap v6375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:34 smithi076 ceph-mon[35401]: pgmap v6375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:34 smithi040 ceph-mon[32397]: pgmap v6375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7343.171766 secs 2024-07-26T15:35:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:36 smithi076 ceph-mon[35401]: pgmap v6376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7343.171766 secs 2024-07-26T15:35:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:36 smithi040 ceph-mon[32397]: pgmap v6376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7343.171766 secs 2024-07-26T15:35:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:36 smithi146 ceph-mon[35807]: pgmap v6376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:38 smithi076 ceph-mon[35401]: pgmap v6377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:38 smithi040 ceph-mon[32397]: pgmap v6377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:38 smithi146 ceph-mon[35807]: pgmap v6377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:40 smithi040 ceph-mon[32397]: pgmap v6378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:40 smithi146 ceph-mon[35807]: pgmap v6378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:40 smithi076 ceph-mon[35401]: pgmap v6378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7348.171936 secs 2024-07-26T15:35:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7348.171936 secs 2024-07-26T15:35:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7348.171936 secs 2024-07-26T15:35:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:42 smithi040 ceph-mon[32397]: pgmap v6379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:42 smithi146 ceph-mon[35807]: pgmap v6379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:42 smithi076 ceph-mon[35401]: pgmap v6379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:44 smithi040 ceph-mon[32397]: pgmap v6380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:44 smithi146 ceph-mon[35807]: pgmap v6380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:44 smithi076 ceph-mon[35401]: pgmap v6380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7353.172094 secs 2024-07-26T15:35:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:46 smithi040 ceph-mon[32397]: pgmap v6381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7353.172094 secs 2024-07-26T15:35:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:46 smithi146 ceph-mon[35807]: pgmap v6381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7353.172094 secs 2024-07-26T15:35:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:46 smithi076 ceph-mon[35401]: pgmap v6381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:48 smithi040 ceph-mon[32397]: pgmap v6382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:48 smithi146 ceph-mon[35807]: pgmap v6382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:48 smithi076 ceph-mon[35401]: pgmap v6382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:51.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:50 smithi076 ceph-mon[35401]: pgmap v6383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:50 smithi040 ceph-mon[32397]: pgmap v6383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:50 smithi146 ceph-mon[35807]: pgmap v6383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7358.172250 secs 2024-07-26T15:35:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7358.172250 secs 2024-07-26T15:35:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7358.172250 secs 2024-07-26T15:35:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:52 smithi040 ceph-mon[32397]: pgmap v6384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:52 smithi146 ceph-mon[35807]: pgmap v6384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:52 smithi076 ceph-mon[35401]: pgmap v6384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:54 smithi040 ceph-mon[32397]: pgmap v6385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:54 smithi146 ceph-mon[35807]: pgmap v6385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:54 smithi076 ceph-mon[35401]: pgmap v6385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:35:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7363.172363 secs 2024-07-26T15:35:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:56 smithi040 ceph-mon[32397]: pgmap v6386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7363.172363 secs 2024-07-26T15:35:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:56 smithi146 ceph-mon[35807]: pgmap v6386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7363.172363 secs 2024-07-26T15:35:57.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:56 smithi076 ceph-mon[35401]: pgmap v6386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:35:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:35:58 smithi040 ceph-mon[32397]: pgmap v6387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:59.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:35:58 smithi146 ceph-mon[35807]: pgmap v6387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:35:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:35:58 smithi076 ceph-mon[35401]: pgmap v6387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:00 smithi040 ceph-mon[32397]: pgmap v6388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:00 smithi146 ceph-mon[35807]: pgmap v6388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:00 smithi076 ceph-mon[35401]: pgmap v6388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7368.172496 secs 2024-07-26T15:36:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7368.172496 secs 2024-07-26T15:36:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7368.172496 secs 2024-07-26T15:36:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:02 smithi040 ceph-mon[32397]: pgmap v6389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:02 smithi146 ceph-mon[35807]: pgmap v6389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:02 smithi076 ceph-mon[35401]: pgmap v6389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:04 smithi040 ceph-mon[32397]: pgmap v6390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:04 smithi146 ceph-mon[35807]: pgmap v6390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:04 smithi076 ceph-mon[35401]: pgmap v6390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7373.172643 secs 2024-07-26T15:36:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:06 smithi040 ceph-mon[32397]: pgmap v6391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7373.172643 secs 2024-07-26T15:36:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:06 smithi146 ceph-mon[35807]: pgmap v6391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7373.172643 secs 2024-07-26T15:36:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:06 smithi076 ceph-mon[35401]: pgmap v6391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:08 smithi040 ceph-mon[32397]: pgmap v6392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:08 smithi146 ceph-mon[35807]: pgmap v6392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:08 smithi076 ceph-mon[35401]: pgmap v6392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:10 smithi146 ceph-mon[35807]: pgmap v6393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:10 smithi076 ceph-mon[35401]: pgmap v6393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:10 smithi040 ceph-mon[32397]: pgmap v6393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7378.172747 secs 2024-07-26T15:36:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7378.172747 secs 2024-07-26T15:36:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7378.172747 secs 2024-07-26T15:36:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:13 smithi146 ceph-mon[35807]: pgmap v6394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:13 smithi076 ceph-mon[35401]: pgmap v6394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:13 smithi040 ceph-mon[32397]: pgmap v6394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:15 smithi146 ceph-mon[35807]: pgmap v6395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:15 smithi076 ceph-mon[35401]: pgmap v6395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:15 smithi040 ceph-mon[32397]: pgmap v6395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7383.172884 secs 2024-07-26T15:36:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:17 smithi146 ceph-mon[35807]: pgmap v6396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7383.172884 secs 2024-07-26T15:36:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:17 smithi076 ceph-mon[35401]: pgmap v6396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7383.172884 secs 2024-07-26T15:36:17.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:17 smithi040 ceph-mon[32397]: pgmap v6396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:19 smithi146 ceph-mon[35807]: pgmap v6397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:19 smithi076 ceph-mon[35401]: pgmap v6397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:19 smithi040 ceph-mon[32397]: pgmap v6397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:21 smithi146 ceph-mon[35807]: pgmap v6398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:21 smithi076 ceph-mon[35401]: pgmap v6398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:21 smithi040 ceph-mon[32397]: pgmap v6398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7388.172988 secs 2024-07-26T15:36:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7388.172988 secs 2024-07-26T15:36:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7388.172988 secs 2024-07-26T15:36:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:23 smithi146 ceph-mon[35807]: pgmap v6399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:23 smithi076 ceph-mon[35401]: pgmap v6399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:23.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:23 smithi040 ceph-mon[32397]: pgmap v6399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:25 smithi146 ceph-mon[35807]: pgmap v6400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:25 smithi076 ceph-mon[35401]: pgmap v6400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:25 smithi040 ceph-mon[32397]: pgmap v6400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7393.173125 secs 2024-07-26T15:36:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:27 smithi146 ceph-mon[35807]: pgmap v6401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7393.173125 secs 2024-07-26T15:36:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:27 smithi076 ceph-mon[35401]: pgmap v6401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7393.173125 secs 2024-07-26T15:36:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:27 smithi040 ceph-mon[32397]: pgmap v6401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:29 smithi146 ceph-mon[35807]: pgmap v6402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:29 smithi076 ceph-mon[35401]: pgmap v6402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:29 smithi040 ceph-mon[32397]: pgmap v6402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:31 smithi076 ceph-mon[35401]: pgmap v6403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:31 smithi040 ceph-mon[32397]: pgmap v6403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:31 smithi146 ceph-mon[35807]: pgmap v6403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7398.173311 secs 2024-07-26T15:36:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7398.173311 secs 2024-07-26T15:36:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7398.173311 secs 2024-07-26T15:36:33.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:33 smithi040 ceph-mon[32397]: pgmap v6404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:33 smithi146 ceph-mon[35807]: pgmap v6404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:33 smithi076 ceph-mon[35401]: pgmap v6404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:35 smithi040 ceph-mon[32397]: pgmap v6405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:35 smithi146 ceph-mon[35807]: pgmap v6405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:35 smithi076 ceph-mon[35401]: pgmap v6405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7403.173456 secs 2024-07-26T15:36:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:37 smithi040 ceph-mon[32397]: pgmap v6406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:37.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7403.173456 secs 2024-07-26T15:36:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:37 smithi146 ceph-mon[35807]: pgmap v6406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7403.173456 secs 2024-07-26T15:36:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:37 smithi076 ceph-mon[35401]: pgmap v6406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:39 smithi040 ceph-mon[32397]: pgmap v6407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:39 smithi146 ceph-mon[35807]: pgmap v6407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:39 smithi076 ceph-mon[35401]: pgmap v6407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:40 smithi040 ceph-mon[32397]: pgmap v6408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:40 smithi146 ceph-mon[35807]: pgmap v6408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:40 smithi076 ceph-mon[35401]: pgmap v6408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7408.173605 secs 2024-07-26T15:36:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7408.173605 secs 2024-07-26T15:36:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7408.173605 secs 2024-07-26T15:36:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:42 smithi040 ceph-mon[32397]: pgmap v6409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:42 smithi146 ceph-mon[35807]: pgmap v6409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:42 smithi076 ceph-mon[35401]: pgmap v6409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:44 smithi146 ceph-mon[35807]: pgmap v6410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:44 smithi076 ceph-mon[35401]: pgmap v6410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:44 smithi040 ceph-mon[32397]: pgmap v6410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7413.173735 secs 2024-07-26T15:36:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:46 smithi146 ceph-mon[35807]: pgmap v6411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7413.173735 secs 2024-07-26T15:36:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:46 smithi076 ceph-mon[35401]: pgmap v6411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7413.173735 secs 2024-07-26T15:36:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:46 smithi040 ceph-mon[32397]: pgmap v6411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:48 smithi146 ceph-mon[35807]: pgmap v6412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:48 smithi076 ceph-mon[35401]: pgmap v6412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:48 smithi040 ceph-mon[32397]: pgmap v6412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:50 smithi146 ceph-mon[35807]: pgmap v6413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:50 smithi076 ceph-mon[35401]: pgmap v6413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:50 smithi040 ceph-mon[32397]: pgmap v6413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7418.173867 secs 2024-07-26T15:36:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7418.173867 secs 2024-07-26T15:36:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7418.173867 secs 2024-07-26T15:36:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:52 smithi076 ceph-mon[35401]: pgmap v6414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:52 smithi040 ceph-mon[32397]: pgmap v6414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:52 smithi146 ceph-mon[35807]: pgmap v6414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:54 smithi076 ceph-mon[35401]: pgmap v6415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:54 smithi040 ceph-mon[32397]: pgmap v6415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:54 smithi146 ceph-mon[35807]: pgmap v6415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:36:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7423.174035 secs 2024-07-26T15:36:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:56 smithi040 ceph-mon[32397]: pgmap v6416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7423.174035 secs 2024-07-26T15:36:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:56 smithi146 ceph-mon[35807]: pgmap v6416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7423.174035 secs 2024-07-26T15:36:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:56 smithi076 ceph-mon[35401]: pgmap v6416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:36:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:36:58 smithi040 ceph-mon[32397]: pgmap v6417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:36:58 smithi146 ceph-mon[35807]: pgmap v6417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:36:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:36:58 smithi076 ceph-mon[35401]: pgmap v6417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:00 smithi040 ceph-mon[32397]: pgmap v6418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:00 smithi146 ceph-mon[35807]: pgmap v6418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:00 smithi076 ceph-mon[35401]: pgmap v6418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7428.174177 secs 2024-07-26T15:37:02.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7428.174177 secs 2024-07-26T15:37:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7428.174177 secs 2024-07-26T15:37:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:02 smithi040 ceph-mon[32397]: pgmap v6419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:02 smithi146 ceph-mon[35807]: pgmap v6419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:02 smithi076 ceph-mon[35401]: pgmap v6419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:04 smithi040 ceph-mon[32397]: pgmap v6420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:04 smithi146 ceph-mon[35807]: pgmap v6420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:04 smithi076 ceph-mon[35401]: pgmap v6420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7433.174315 secs 2024-07-26T15:37:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:06 smithi040 ceph-mon[32397]: pgmap v6421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7433.174315 secs 2024-07-26T15:37:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:06 smithi146 ceph-mon[35807]: pgmap v6421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7433.174315 secs 2024-07-26T15:37:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:06 smithi076 ceph-mon[35401]: pgmap v6421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:09 smithi146 ceph-mon[35807]: pgmap v6422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:09 smithi076 ceph-mon[35401]: pgmap v6422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:09 smithi040 ceph-mon[32397]: pgmap v6422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:11 smithi146 ceph-mon[35807]: pgmap v6423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:11 smithi076 ceph-mon[35401]: pgmap v6423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:11 smithi040 ceph-mon[32397]: pgmap v6423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7438.174464 secs 2024-07-26T15:37:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7438.174464 secs 2024-07-26T15:37:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7438.174464 secs 2024-07-26T15:37:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:13 smithi146 ceph-mon[35807]: pgmap v6424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:13 smithi076 ceph-mon[35401]: pgmap v6424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:13 smithi040 ceph-mon[32397]: pgmap v6424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:15 smithi146 ceph-mon[35807]: pgmap v6425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:15 smithi076 ceph-mon[35401]: pgmap v6425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:15 smithi040 ceph-mon[32397]: pgmap v6425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7443.174606 secs 2024-07-26T15:37:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:17 smithi146 ceph-mon[35807]: pgmap v6426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7443.174606 secs 2024-07-26T15:37:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:17 smithi076 ceph-mon[35401]: pgmap v6426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7443.174606 secs 2024-07-26T15:37:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:17 smithi040 ceph-mon[32397]: pgmap v6426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:19 smithi146 ceph-mon[35807]: pgmap v6427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:19 smithi076 ceph-mon[35401]: pgmap v6427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:19 smithi040 ceph-mon[32397]: pgmap v6427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:21 smithi146 ceph-mon[35807]: pgmap v6428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:21 smithi076 ceph-mon[35401]: pgmap v6428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:21 smithi040 ceph-mon[32397]: pgmap v6428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7448.174748 secs 2024-07-26T15:37:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7448.174748 secs 2024-07-26T15:37:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7448.174748 secs 2024-07-26T15:37:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:23 smithi076 ceph-mon[35401]: pgmap v6429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:23 smithi040 ceph-mon[32397]: pgmap v6429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:23 smithi146 ceph-mon[35807]: pgmap v6429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:25 smithi040 ceph-mon[32397]: pgmap v6430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:25 smithi146 ceph-mon[35807]: pgmap v6430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:25 smithi076 ceph-mon[35401]: pgmap v6430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7453.174892 secs 2024-07-26T15:37:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:27 smithi040 ceph-mon[32397]: pgmap v6431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7453.174892 secs 2024-07-26T15:37:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:27 smithi146 ceph-mon[35807]: pgmap v6431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7453.174892 secs 2024-07-26T15:37:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:27 smithi076 ceph-mon[35401]: pgmap v6431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:29 smithi040 ceph-mon[32397]: pgmap v6432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:29 smithi146 ceph-mon[35807]: pgmap v6432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:29 smithi076 ceph-mon[35401]: pgmap v6432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:31 smithi040 ceph-mon[32397]: pgmap v6433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:31 smithi146 ceph-mon[35807]: pgmap v6433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:31 smithi076 ceph-mon[35401]: pgmap v6433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7458.175060 secs 2024-07-26T15:37:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7458.175060 secs 2024-07-26T15:37:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7458.175060 secs 2024-07-26T15:37:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:33 smithi040 ceph-mon[32397]: pgmap v6434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:33 smithi146 ceph-mon[35807]: pgmap v6434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:33 smithi076 ceph-mon[35401]: pgmap v6434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:34 smithi040 ceph-mon[32397]: pgmap v6435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:34.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:34 smithi146 ceph-mon[35807]: pgmap v6435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:34 smithi076 ceph-mon[35401]: pgmap v6435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7463.175221 secs 2024-07-26T15:37:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:36 smithi146 ceph-mon[35807]: pgmap v6436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7463.175221 secs 2024-07-26T15:37:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:36 smithi076 ceph-mon[35401]: pgmap v6436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7463.175221 secs 2024-07-26T15:37:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:36 smithi040 ceph-mon[32397]: pgmap v6436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:38 smithi076 ceph-mon[35401]: pgmap v6437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:38 smithi040 ceph-mon[32397]: pgmap v6437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:38 smithi146 ceph-mon[35807]: pgmap v6437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:40 smithi040 ceph-mon[32397]: pgmap v6438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:40 smithi146 ceph-mon[35807]: pgmap v6438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:40 smithi076 ceph-mon[35401]: pgmap v6438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7468.175360 secs 2024-07-26T15:37:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7468.175360 secs 2024-07-26T15:37:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7468.175360 secs 2024-07-26T15:37:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:42 smithi040 ceph-mon[32397]: pgmap v6439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:42 smithi146 ceph-mon[35807]: pgmap v6439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:42 smithi076 ceph-mon[35401]: pgmap v6439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:44 smithi040 ceph-mon[32397]: pgmap v6440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:44 smithi146 ceph-mon[35807]: pgmap v6440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:44 smithi076 ceph-mon[35401]: pgmap v6440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7473.175500 secs 2024-07-26T15:37:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:46 smithi040 ceph-mon[32397]: pgmap v6441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7473.175500 secs 2024-07-26T15:37:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:46 smithi146 ceph-mon[35807]: pgmap v6441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7473.175500 secs 2024-07-26T15:37:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:46 smithi076 ceph-mon[35401]: pgmap v6441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:48 smithi040 ceph-mon[32397]: pgmap v6442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:48 smithi146 ceph-mon[35807]: pgmap v6442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:48 smithi076 ceph-mon[35401]: pgmap v6442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:51.138 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:50 smithi076 ceph-mon[35401]: pgmap v6443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:50 smithi040 ceph-mon[32397]: pgmap v6443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:50 smithi146 ceph-mon[35807]: pgmap v6443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7478.175638 secs 2024-07-26T15:37:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7478.175638 secs 2024-07-26T15:37:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7478.175638 secs 2024-07-26T15:37:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:52 smithi040 ceph-mon[32397]: pgmap v6444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:52 smithi146 ceph-mon[35807]: pgmap v6444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:52 smithi076 ceph-mon[35401]: pgmap v6444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:54 smithi040 ceph-mon[32397]: pgmap v6445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:54 smithi146 ceph-mon[35807]: pgmap v6445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:54 smithi076 ceph-mon[35401]: pgmap v6445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:37:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7483.175778 secs 2024-07-26T15:37:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:56 smithi040 ceph-mon[32397]: pgmap v6446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7483.175778 secs 2024-07-26T15:37:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:56 smithi146 ceph-mon[35807]: pgmap v6446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7483.175778 secs 2024-07-26T15:37:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:56 smithi076 ceph-mon[35401]: pgmap v6446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:37:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:37:58 smithi040 ceph-mon[32397]: pgmap v6447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:59.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:37:58 smithi146 ceph-mon[35807]: pgmap v6447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:37:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:37:58 smithi076 ceph-mon[35401]: pgmap v6447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:00 smithi040 ceph-mon[32397]: pgmap v6448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:00 smithi146 ceph-mon[35807]: pgmap v6448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:00 smithi076 ceph-mon[35401]: pgmap v6448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7488.175922 secs 2024-07-26T15:38:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7488.175922 secs 2024-07-26T15:38:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7488.175922 secs 2024-07-26T15:38:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:02 smithi040 ceph-mon[32397]: pgmap v6449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:02 smithi146 ceph-mon[35807]: pgmap v6449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:02 smithi076 ceph-mon[35401]: pgmap v6449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:04 smithi040 ceph-mon[32397]: pgmap v6450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:04 smithi146 ceph-mon[35807]: pgmap v6450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:04 smithi076 ceph-mon[35401]: pgmap v6450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7493.176062 secs 2024-07-26T15:38:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:06 smithi040 ceph-mon[32397]: pgmap v6451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7493.176062 secs 2024-07-26T15:38:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:06 smithi146 ceph-mon[35807]: pgmap v6451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7493.176062 secs 2024-07-26T15:38:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:06 smithi076 ceph-mon[35401]: pgmap v6451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:08 smithi040 ceph-mon[32397]: pgmap v6452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:08 smithi146 ceph-mon[35807]: pgmap v6452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:08 smithi076 ceph-mon[35401]: pgmap v6452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:10 smithi040 ceph-mon[32397]: pgmap v6453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:10 smithi146 ceph-mon[35807]: pgmap v6453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:10 smithi076 ceph-mon[35401]: pgmap v6453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7498.176201 secs 2024-07-26T15:38:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7498.176201 secs 2024-07-26T15:38:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7498.176201 secs 2024-07-26T15:38:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:12 smithi146 ceph-mon[35807]: pgmap v6454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:12 smithi076 ceph-mon[35401]: pgmap v6454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:12 smithi040 ceph-mon[32397]: pgmap v6454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:15.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:15 smithi146 ceph-mon[35807]: pgmap v6455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:15 smithi076 ceph-mon[35401]: pgmap v6455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:15.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:15 smithi040 ceph-mon[32397]: pgmap v6455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7503.176333 secs 2024-07-26T15:38:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:17 smithi146 ceph-mon[35807]: pgmap v6456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7503.176333 secs 2024-07-26T15:38:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:17 smithi076 ceph-mon[35401]: pgmap v6456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7503.176333 secs 2024-07-26T15:38:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:17 smithi040 ceph-mon[32397]: pgmap v6456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:19 smithi146 ceph-mon[35807]: pgmap v6457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:19 smithi076 ceph-mon[35401]: pgmap v6457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:19 smithi040 ceph-mon[32397]: pgmap v6457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:21 smithi146 ceph-mon[35807]: pgmap v6458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:21 smithi076 ceph-mon[35401]: pgmap v6458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:21 smithi040 ceph-mon[32397]: pgmap v6458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7508.176467 secs 2024-07-26T15:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:38:22.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:38:22.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:38:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7508.176467 secs 2024-07-26T15:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:38:22.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:38:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7508.176467 secs 2024-07-26T15:38:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:38:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:38:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:38:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:23 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:23 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:23 smithi146 ceph-mon[35807]: pgmap v6459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-07-26T15:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:23 smithi146 ceph-mon[35807]: pgmap v6460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:23 smithi146 ceph-mon[35807]: pgmap v6461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-26T15:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:23 smithi146 ceph-mon[35807]: pgmap v6462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:23 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:38:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:23 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:38:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:23 smithi076 ceph-mon[35401]: pgmap v6459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-07-26T15:38:23.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:23 smithi076 ceph-mon[35401]: pgmap v6460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:38:23.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:23 smithi076 ceph-mon[35401]: pgmap v6461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-26T15:38:23.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:23 smithi076 ceph-mon[35401]: pgmap v6462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:23 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:38:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:23 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:38:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:23 smithi040 ceph-mon[32397]: pgmap v6459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-07-26T15:38:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:23 smithi040 ceph-mon[32397]: pgmap v6460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:38:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:23 smithi040 ceph-mon[32397]: pgmap v6461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-07-26T15:38:23.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:23 smithi040 ceph-mon[32397]: pgmap v6462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:25 smithi146 ceph-mon[35807]: pgmap v6463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:25 smithi076 ceph-mon[35401]: pgmap v6463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:25 smithi040 ceph-mon[32397]: pgmap v6463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:27 smithi146 ceph-mon[35807]: pgmap v6464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7513.176608 secs 2024-07-26T15:38:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:27 smithi076 ceph-mon[35401]: pgmap v6464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7513.176608 secs 2024-07-26T15:38:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:27 smithi040 ceph-mon[32397]: pgmap v6464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 937 B/s rd, 1 op/s 2024-07-26T15:38:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7513.176608 secs 2024-07-26T15:38:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:29 smithi146 ceph-mon[35807]: pgmap v6465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:29 smithi076 ceph-mon[35401]: pgmap v6465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:29 smithi040 ceph-mon[32397]: pgmap v6465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:31 smithi076 ceph-mon[35401]: pgmap v6466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T15:38:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:31 smithi040 ceph-mon[32397]: pgmap v6466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T15:38:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:31 smithi146 ceph-mon[35807]: pgmap v6466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T15:38:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7518.176785 secs 2024-07-26T15:38:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7518.176785 secs 2024-07-26T15:38:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7518.176785 secs 2024-07-26T15:38:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:33 smithi040 ceph-mon[32397]: pgmap v6467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:38:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:33 smithi146 ceph-mon[35807]: pgmap v6467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:38:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:33 smithi076 ceph-mon[35401]: pgmap v6467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:38:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:35 smithi040 ceph-mon[32397]: pgmap v6468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:35 smithi146 ceph-mon[35807]: pgmap v6468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:35 smithi076 ceph-mon[35401]: pgmap v6468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:37 smithi040 ceph-mon[32397]: pgmap v6469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7523.176929 secs 2024-07-26T15:38:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:37 smithi146 ceph-mon[35807]: pgmap v6469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7523.176929 secs 2024-07-26T15:38:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:37 smithi076 ceph-mon[35401]: pgmap v6469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7523.176929 secs 2024-07-26T15:38:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:39 smithi040 ceph-mon[32397]: pgmap v6470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:39.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:39 smithi146 ceph-mon[35807]: pgmap v6470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:39 smithi076 ceph-mon[35401]: pgmap v6470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:41 smithi040 ceph-mon[32397]: pgmap v6471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:41.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:41 smithi146 ceph-mon[35807]: pgmap v6471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:41 smithi076 ceph-mon[35401]: pgmap v6471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:42.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7528.177071 secs 2024-07-26T15:38:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7528.177071 secs 2024-07-26T15:38:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7528.177071 secs 2024-07-26T15:38:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:43 smithi040 ceph-mon[32397]: pgmap v6472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:43 smithi146 ceph-mon[35807]: pgmap v6472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:43 smithi076 ceph-mon[35401]: pgmap v6472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:44 smithi040 ceph-mon[32397]: pgmap v6473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:44.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:44 smithi146 ceph-mon[35807]: pgmap v6473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:44 smithi076 ceph-mon[35401]: pgmap v6473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:46 smithi146 ceph-mon[35807]: pgmap v6474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:46 smithi076 ceph-mon[35401]: pgmap v6474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:46 smithi040 ceph-mon[32397]: pgmap v6474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7533.177211 secs 2024-07-26T15:38:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7533.177211 secs 2024-07-26T15:38:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7533.177211 secs 2024-07-26T15:38:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:48 smithi040 ceph-mon[32397]: pgmap v6475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:48 smithi146 ceph-mon[35807]: pgmap v6475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:48 smithi076 ceph-mon[35401]: pgmap v6475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:50 smithi040 ceph-mon[32397]: pgmap v6476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:50 smithi146 ceph-mon[35807]: pgmap v6476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:50 smithi076 ceph-mon[35401]: pgmap v6476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:38:52.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7538.177352 secs 2024-07-26T15:38:52.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:52 smithi146 ceph-mon[35807]: pgmap v6477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:52.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7538.177352 secs 2024-07-26T15:38:52.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:52 smithi076 ceph-mon[35401]: pgmap v6477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7538.177352 secs 2024-07-26T15:38:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:52 smithi040 ceph-mon[32397]: pgmap v6477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:54 smithi040 ceph-mon[32397]: pgmap v6478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:54 smithi146 ceph-mon[35807]: pgmap v6478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:54 smithi076 ceph-mon[35401]: pgmap v6478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:56 smithi040 ceph-mon[32397]: pgmap v6479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:56 smithi146 ceph-mon[35807]: pgmap v6479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:56 smithi076 ceph-mon[35401]: pgmap v6479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:38:57.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7543.177438 secs 2024-07-26T15:38:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7543.177438 secs 2024-07-26T15:38:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7543.177438 secs 2024-07-26T15:38:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:38:58 smithi040 ceph-mon[32397]: pgmap v6480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:38:58 smithi146 ceph-mon[35807]: pgmap v6480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:38:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:38:58 smithi076 ceph-mon[35401]: pgmap v6480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:00 smithi040 ceph-mon[32397]: pgmap v6481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:00 smithi146 ceph-mon[35807]: pgmap v6481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:00 smithi076 ceph-mon[35401]: pgmap v6481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7548.177530 secs 2024-07-26T15:39:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:02 smithi040 ceph-mon[32397]: pgmap v6482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7548.177530 secs 2024-07-26T15:39:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:02 smithi146 ceph-mon[35807]: pgmap v6482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7548.177530 secs 2024-07-26T15:39:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:02 smithi076 ceph-mon[35401]: pgmap v6482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:04 smithi040 ceph-mon[32397]: pgmap v6483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:04 smithi146 ceph-mon[35807]: pgmap v6483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:04 smithi076 ceph-mon[35401]: pgmap v6483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:06 smithi040 ceph-mon[32397]: pgmap v6484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:06 smithi146 ceph-mon[35807]: pgmap v6484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:06 smithi076 ceph-mon[35401]: pgmap v6484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7553.177633 secs 2024-07-26T15:39:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7553.177633 secs 2024-07-26T15:39:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7553.177633 secs 2024-07-26T15:39:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:09 smithi146 ceph-mon[35807]: pgmap v6485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:09 smithi076 ceph-mon[35401]: pgmap v6485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:09 smithi040 ceph-mon[32397]: pgmap v6485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:11 smithi076 ceph-mon[35401]: pgmap v6486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:11 smithi040 ceph-mon[32397]: pgmap v6486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:11 smithi146 ceph-mon[35807]: pgmap v6486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7558.177736 secs 2024-07-26T15:39:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7558.177736 secs 2024-07-26T15:39:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7558.177736 secs 2024-07-26T15:39:13.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:13 smithi040 ceph-mon[32397]: pgmap v6487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:13 smithi146 ceph-mon[35807]: pgmap v6487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:13 smithi076 ceph-mon[35401]: pgmap v6487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:15 smithi040 ceph-mon[32397]: pgmap v6488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:15 smithi146 ceph-mon[35807]: pgmap v6488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:15 smithi076 ceph-mon[35401]: pgmap v6488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:17 smithi040 ceph-mon[32397]: pgmap v6489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7563.177892 secs 2024-07-26T15:39:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:17 smithi146 ceph-mon[35807]: pgmap v6489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7563.177892 secs 2024-07-26T15:39:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:17 smithi076 ceph-mon[35401]: pgmap v6489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7563.177892 secs 2024-07-26T15:39:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:19 smithi040 ceph-mon[32397]: pgmap v6490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:19 smithi146 ceph-mon[35807]: pgmap v6490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:19 smithi076 ceph-mon[35401]: pgmap v6490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:21 smithi040 ceph-mon[32397]: pgmap v6491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:21 smithi146 ceph-mon[35807]: pgmap v6491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:21 smithi076 ceph-mon[35401]: pgmap v6491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:22.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7568.178054 secs 2024-07-26T15:39:22.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:22 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:39:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7568.178054 secs 2024-07-26T15:39:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:22 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:39:22.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7568.178054 secs 2024-07-26T15:39:22.484 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:22 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:39:23.479 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: pgmap v6492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:23.479 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.479 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.479 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.479 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.480 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.480 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:23 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: pgmap v6492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:23 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.546 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: pgmap v6492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:23.546 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.549 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.549 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:23.550 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:23 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:25.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:25 smithi040 ceph-mon[32397]: pgmap v6493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:25 smithi146 ceph-mon[35807]: pgmap v6493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:25.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:25 smithi076 ceph-mon[35401]: pgmap v6493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: pgmap v6494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7573.178169 secs 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:27 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: pgmap v6494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7573.178169 secs 2024-07-26T15:39:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:27 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: pgmap v6494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7573.178169 secs 2024-07-26T15:39:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:27.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:27 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:29.154 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:29 smithi040 ceph-mon[32397]: pgmap v6495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:29 smithi076 ceph-mon[35401]: pgmap v6495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:29.509 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:29 smithi146 ceph-mon[35807]: pgmap v6495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:31.279 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:31 smithi076 ceph-mon[35401]: pgmap v6496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:31.421 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:31 smithi146 ceph-mon[35807]: pgmap v6496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:31 smithi040 ceph-mon[32397]: pgmap v6496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:32.213 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7578.178311 secs 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.214 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.215 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.215 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.215 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.215 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.215 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7578.178311 secs 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7578.178311 secs 2024-07-26T15:39:32.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.387 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:32.388 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:39:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:33 smithi040 ceph-mon[32397]: pgmap v6497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:33 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:39:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:33 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:39:33.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:33 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:39:33.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:33 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:39:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:33 smithi146 ceph-mon[35807]: pgmap v6497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:33 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:39:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:33 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:39:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:33 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:39:33.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:33 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:39:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:33 smithi076 ceph-mon[35401]: pgmap v6497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:33.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:33 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:39:33.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:33 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:39:33.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:33 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:39:33.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:33 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:39:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:35 smithi040 ceph-mon[32397]: pgmap v6498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:35 smithi146 ceph-mon[35807]: pgmap v6498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:35 smithi076 ceph-mon[35401]: pgmap v6498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:37 smithi040 ceph-mon[32397]: pgmap v6499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7583.178453 secs 2024-07-26T15:39:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:37 smithi146 ceph-mon[35807]: pgmap v6499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7583.178453 secs 2024-07-26T15:39:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:37 smithi076 ceph-mon[35401]: pgmap v6499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7583.178453 secs 2024-07-26T15:39:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:39 smithi040 ceph-mon[32397]: pgmap v6500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:39 smithi146 ceph-mon[35807]: pgmap v6500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:39 smithi076 ceph-mon[35401]: pgmap v6500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:40.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:40 smithi040 ceph-mon[32397]: pgmap v6501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:40 smithi146 ceph-mon[35807]: pgmap v6501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:40 smithi076 ceph-mon[35401]: pgmap v6501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7588.178587 secs 2024-07-26T15:39:42.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:42 smithi076 ceph-mon[35401]: pgmap v6502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7588.178587 secs 2024-07-26T15:39:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:42 smithi040 ceph-mon[32397]: pgmap v6502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7588.178587 secs 2024-07-26T15:39:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:42 smithi146 ceph-mon[35807]: pgmap v6502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:44 smithi040 ceph-mon[32397]: pgmap v6503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:44 smithi146 ceph-mon[35807]: pgmap v6503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:44 smithi076 ceph-mon[35401]: pgmap v6503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:46 smithi040 ceph-mon[32397]: pgmap v6504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:46 smithi146 ceph-mon[35807]: pgmap v6504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:46 smithi076 ceph-mon[35401]: pgmap v6504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7593.178683 secs 2024-07-26T15:39:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7593.178683 secs 2024-07-26T15:39:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7593.178683 secs 2024-07-26T15:39:48.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:48 smithi040 ceph-mon[32397]: pgmap v6505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:48 smithi146 ceph-mon[35807]: pgmap v6505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:48 smithi076 ceph-mon[35401]: pgmap v6505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:50 smithi040 ceph-mon[32397]: pgmap v6506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:50 smithi146 ceph-mon[35807]: pgmap v6506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:50 smithi076 ceph-mon[35401]: pgmap v6506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:39:52.663 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7598.178845 secs 2024-07-26T15:39:52.663 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:52 smithi076 ceph-mon[35401]: pgmap v6507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7598.178845 secs 2024-07-26T15:39:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:52 smithi040 ceph-mon[32397]: pgmap v6507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7598.178845 secs 2024-07-26T15:39:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:52 smithi146 ceph-mon[35807]: pgmap v6507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:54 smithi076 ceph-mon[35401]: pgmap v6508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:54 smithi040 ceph-mon[32397]: pgmap v6508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:54 smithi146 ceph-mon[35807]: pgmap v6508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:39:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:56 smithi040 ceph-mon[32397]: pgmap v6509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:56.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:56 smithi146 ceph-mon[35807]: pgmap v6509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:56 smithi076 ceph-mon[35401]: pgmap v6509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:39:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7603.179017 secs 2024-07-26T15:39:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7603.179017 secs 2024-07-26T15:39:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7603.179017 secs 2024-07-26T15:39:58.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:39:58 smithi040 ceph-mon[32397]: pgmap v6510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:39:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:39:58 smithi146 ceph-mon[35807]: pgmap v6510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:39:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:39:58 smithi076 ceph-mon[35401]: pgmap v6510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:00 smithi040 ceph-mon[32397]: pgmap v6511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:40:00.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:00 smithi146 ceph-mon[35807]: pgmap v6511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:40:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:00 smithi076 ceph-mon[35401]: pgmap v6511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:40:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7608.179160 secs 2024-07-26T15:40:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7608.179160 secs 2024-07-26T15:40:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7608.179160 secs 2024-07-26T15:40:02.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:02 smithi040 ceph-mon[32397]: pgmap v6512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:40:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:02 smithi146 ceph-mon[35807]: pgmap v6512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:40:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:02 smithi076 ceph-mon[35401]: pgmap v6512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:40:04.723 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:04 smithi146 ceph-mon[35807]: pgmap v6513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:04.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:04 smithi040 ceph-mon[32397]: pgmap v6513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:04 smithi076 ceph-mon[35401]: pgmap v6513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:40:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:06 smithi040 ceph-mon[32397]: pgmap v6514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7613.179301 secs 2024-07-26T15:40:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:06 smithi146 ceph-mon[35807]: pgmap v6514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7613.179301 secs 2024-07-26T15:40:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:06 smithi076 ceph-mon[35401]: pgmap v6514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7613.179301 secs 2024-07-26T15:40:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:08 smithi040 ceph-mon[32397]: pgmap v6515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:08 smithi146 ceph-mon[35807]: pgmap v6515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:08 smithi076 ceph-mon[35401]: pgmap v6515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:10 smithi146 ceph-mon[35807]: pgmap v6516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:40:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:10 smithi076 ceph-mon[35401]: pgmap v6516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:40:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:10 smithi040 ceph-mon[32397]: pgmap v6516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:40:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7618.179448 secs 2024-07-26T15:40:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7618.179448 secs 2024-07-26T15:40:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7618.179448 secs 2024-07-26T15:40:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:12 smithi146 ceph-mon[35807]: pgmap v6517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:12 smithi076 ceph-mon[35401]: pgmap v6517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:12 smithi040 ceph-mon[32397]: pgmap v6517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:15 smithi040 ceph-mon[32397]: pgmap v6518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:15 smithi146 ceph-mon[35807]: pgmap v6518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:15 smithi076 ceph-mon[35401]: pgmap v6518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:17 smithi040 ceph-mon[32397]: pgmap v6519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7623.179590 secs 2024-07-26T15:40:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:17 smithi146 ceph-mon[35807]: pgmap v6519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7623.179590 secs 2024-07-26T15:40:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:17 smithi076 ceph-mon[35401]: pgmap v6519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7623.179590 secs 2024-07-26T15:40:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:19 smithi040 ceph-mon[32397]: pgmap v6520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:19 smithi146 ceph-mon[35807]: pgmap v6520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:19 smithi076 ceph-mon[35401]: pgmap v6520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:21 smithi040 ceph-mon[32397]: pgmap v6521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:21 smithi146 ceph-mon[35807]: pgmap v6521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:21 smithi076 ceph-mon[35401]: pgmap v6521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:22.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7628.179745 secs 2024-07-26T15:40:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7628.179745 secs 2024-07-26T15:40:22.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7628.179745 secs 2024-07-26T15:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:23 smithi040 ceph-mon[32397]: pgmap v6522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:23 smithi146 ceph-mon[35807]: pgmap v6522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:23 smithi076 ceph-mon[35401]: pgmap v6522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:25 smithi040 ceph-mon[32397]: pgmap v6523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:25 smithi146 ceph-mon[35807]: pgmap v6523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:25 smithi076 ceph-mon[35401]: pgmap v6523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:27 smithi040 ceph-mon[32397]: pgmap v6524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7633.179904 secs 2024-07-26T15:40:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:27 smithi146 ceph-mon[35807]: pgmap v6524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7633.179904 secs 2024-07-26T15:40:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:27 smithi076 ceph-mon[35401]: pgmap v6524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7633.179904 secs 2024-07-26T15:40:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:29 smithi040 ceph-mon[32397]: pgmap v6525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:29 smithi146 ceph-mon[35807]: pgmap v6525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:29 smithi076 ceph-mon[35401]: pgmap v6525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:30.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:30 smithi040 ceph-mon[32397]: pgmap v6526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:30 smithi146 ceph-mon[35807]: pgmap v6526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:30 smithi076 ceph-mon[35401]: pgmap v6526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7638.180044 secs 2024-07-26T15:40:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:32 smithi040 ceph-mon[32397]: pgmap v6527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7638.180044 secs 2024-07-26T15:40:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:32 smithi146 ceph-mon[35807]: pgmap v6527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7638.180044 secs 2024-07-26T15:40:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:32 smithi076 ceph-mon[35401]: pgmap v6527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:34 smithi040 ceph-mon[32397]: pgmap v6528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:34 smithi146 ceph-mon[35807]: pgmap v6528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:34 smithi076 ceph-mon[35401]: pgmap v6528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:36 smithi040 ceph-mon[32397]: pgmap v6529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:36 smithi146 ceph-mon[35807]: pgmap v6529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:36 smithi076 ceph-mon[35401]: pgmap v6529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7643.180189 secs 2024-07-26T15:40:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7643.180189 secs 2024-07-26T15:40:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7643.180189 secs 2024-07-26T15:40:38.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:38 smithi040 ceph-mon[32397]: pgmap v6530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:38 smithi146 ceph-mon[35807]: pgmap v6530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:38 smithi076 ceph-mon[35401]: pgmap v6530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:40 smithi040 ceph-mon[32397]: pgmap v6531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:40 smithi146 ceph-mon[35807]: pgmap v6531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:40 smithi076 ceph-mon[35401]: pgmap v6531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7648.180357 secs 2024-07-26T15:40:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:42 smithi040 ceph-mon[32397]: pgmap v6532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:42.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7648.180357 secs 2024-07-26T15:40:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:42 smithi146 ceph-mon[35807]: pgmap v6532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7648.180357 secs 2024-07-26T15:40:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:42 smithi076 ceph-mon[35401]: pgmap v6532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:44 smithi040 ceph-mon[32397]: pgmap v6533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:44 smithi146 ceph-mon[35807]: pgmap v6533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:44 smithi076 ceph-mon[35401]: pgmap v6533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:46 smithi040 ceph-mon[32397]: pgmap v6534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7653.180448 secs 2024-07-26T15:40:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:46 smithi146 ceph-mon[35807]: pgmap v6534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7653.180448 secs 2024-07-26T15:40:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:46 smithi076 ceph-mon[35401]: pgmap v6534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7653.180448 secs 2024-07-26T15:40:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:48 smithi040 ceph-mon[32397]: pgmap v6535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:48.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:48 smithi146 ceph-mon[35807]: pgmap v6535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:48 smithi076 ceph-mon[35401]: pgmap v6535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:50 smithi040 ceph-mon[32397]: pgmap v6536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:50.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:50 smithi146 ceph-mon[35807]: pgmap v6536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:50 smithi076 ceph-mon[35401]: pgmap v6536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7658.180550 secs 2024-07-26T15:40:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7658.180550 secs 2024-07-26T15:40:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7658.180550 secs 2024-07-26T15:40:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:52 smithi040 ceph-mon[32397]: pgmap v6537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:52.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:52 smithi076 ceph-mon[35401]: pgmap v6537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:52 smithi146 ceph-mon[35807]: pgmap v6537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:54.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:54 smithi040 ceph-mon[32397]: pgmap v6538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:54 smithi146 ceph-mon[35807]: pgmap v6538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:54 smithi076 ceph-mon[35401]: pgmap v6538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:56 smithi146 ceph-mon[35807]: pgmap v6539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7663.180687 secs 2024-07-26T15:40:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:56 smithi076 ceph-mon[35401]: pgmap v6539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7663.180687 secs 2024-07-26T15:40:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:56 smithi040 ceph-mon[32397]: pgmap v6539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:40:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7663.180687 secs 2024-07-26T15:40:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:40:58 smithi146 ceph-mon[35807]: pgmap v6540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:40:58 smithi076 ceph-mon[35401]: pgmap v6540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:40:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:40:58 smithi040 ceph-mon[32397]: pgmap v6540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:00 smithi146 ceph-mon[35807]: pgmap v6541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:00 smithi076 ceph-mon[35401]: pgmap v6541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:00 smithi040 ceph-mon[32397]: pgmap v6541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:01.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7668.180822 secs 2024-07-26T15:41:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7668.180822 secs 2024-07-26T15:41:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7668.180822 secs 2024-07-26T15:41:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:02 smithi146 ceph-mon[35807]: pgmap v6542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:02 smithi076 ceph-mon[35401]: pgmap v6542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:02.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:02 smithi040 ceph-mon[32397]: pgmap v6542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:04.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:04 smithi146 ceph-mon[35807]: pgmap v6543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:04 smithi076 ceph-mon[35401]: pgmap v6543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:04 smithi040 ceph-mon[32397]: pgmap v6543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:06 smithi146 ceph-mon[35807]: pgmap v6544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7673.180970 secs 2024-07-26T15:41:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:06 smithi076 ceph-mon[35401]: pgmap v6544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7673.180970 secs 2024-07-26T15:41:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:06 smithi040 ceph-mon[32397]: pgmap v6544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7673.180970 secs 2024-07-26T15:41:08.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:08 smithi146 ceph-mon[35807]: pgmap v6545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:08 smithi076 ceph-mon[35401]: pgmap v6545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:08.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:08 smithi040 ceph-mon[32397]: pgmap v6545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:10 smithi146 ceph-mon[35807]: pgmap v6546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:10 smithi076 ceph-mon[35401]: pgmap v6546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:10 smithi040 ceph-mon[32397]: pgmap v6546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7678.181109 secs 2024-07-26T15:41:11.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7678.181109 secs 2024-07-26T15:41:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7678.181109 secs 2024-07-26T15:41:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:12 smithi076 ceph-mon[35401]: pgmap v6547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:12 smithi040 ceph-mon[32397]: pgmap v6547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:12 smithi146 ceph-mon[35807]: pgmap v6547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:14 smithi040 ceph-mon[32397]: pgmap v6548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:14 smithi146 ceph-mon[35807]: pgmap v6548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:14 smithi076 ceph-mon[35401]: pgmap v6548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:16 smithi040 ceph-mon[32397]: pgmap v6549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7683.181247 secs 2024-07-26T15:41:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:16 smithi146 ceph-mon[35807]: pgmap v6549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7683.181247 secs 2024-07-26T15:41:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:16 smithi076 ceph-mon[35401]: pgmap v6549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7683.181247 secs 2024-07-26T15:41:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:18 smithi040 ceph-mon[32397]: pgmap v6550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:18 smithi146 ceph-mon[35807]: pgmap v6550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:18 smithi076 ceph-mon[35401]: pgmap v6550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:20 smithi040 ceph-mon[32397]: pgmap v6551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:20 smithi146 ceph-mon[35807]: pgmap v6551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:20 smithi076 ceph-mon[35401]: pgmap v6551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7688.181390 secs 2024-07-26T15:41:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7688.181390 secs 2024-07-26T15:41:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7688.181390 secs 2024-07-26T15:41:22.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:22 smithi146 ceph-mon[35807]: pgmap v6552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:22 smithi040 ceph-mon[32397]: pgmap v6552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:22.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:22 smithi076 ceph-mon[35401]: pgmap v6552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:24 smithi040 ceph-mon[32397]: pgmap v6553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:24 smithi146 ceph-mon[35807]: pgmap v6553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:24 smithi076 ceph-mon[35401]: pgmap v6553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:26 smithi040 ceph-mon[32397]: pgmap v6554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7693.181519 secs 2024-07-26T15:41:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:26 smithi146 ceph-mon[35807]: pgmap v6554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7693.181519 secs 2024-07-26T15:41:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:26 smithi076 ceph-mon[35401]: pgmap v6554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7693.181519 secs 2024-07-26T15:41:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:28 smithi040 ceph-mon[32397]: pgmap v6555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:28 smithi146 ceph-mon[35807]: pgmap v6555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:28 smithi076 ceph-mon[35401]: pgmap v6555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:30.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:30 smithi040 ceph-mon[32397]: pgmap v6556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:30 smithi146 ceph-mon[35807]: pgmap v6556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:30 smithi076 ceph-mon[35401]: pgmap v6556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7698.181659 secs 2024-07-26T15:41:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7698.181659 secs 2024-07-26T15:41:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7698.181659 secs 2024-07-26T15:41:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:32 smithi040 ceph-mon[32397]: pgmap v6557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:32 smithi146 ceph-mon[35807]: pgmap v6557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:32 smithi076 ceph-mon[35401]: pgmap v6557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:34 smithi040 ceph-mon[32397]: pgmap v6558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:34 smithi146 ceph-mon[35807]: pgmap v6558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:34 smithi076 ceph-mon[35401]: pgmap v6558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:36 smithi040 ceph-mon[32397]: pgmap v6559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7703.181804 secs 2024-07-26T15:41:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:36 smithi146 ceph-mon[35807]: pgmap v6559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7703.181804 secs 2024-07-26T15:41:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:36 smithi076 ceph-mon[35401]: pgmap v6559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7703.181804 secs 2024-07-26T15:41:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:38 smithi040 ceph-mon[32397]: pgmap v6560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:38 smithi146 ceph-mon[35807]: pgmap v6560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:38 smithi076 ceph-mon[35401]: pgmap v6560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:40 smithi040 ceph-mon[32397]: pgmap v6561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:40 smithi146 ceph-mon[35807]: pgmap v6561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:40 smithi076 ceph-mon[35401]: pgmap v6561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7708.181943 secs 2024-07-26T15:41:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7708.181943 secs 2024-07-26T15:41:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7708.181943 secs 2024-07-26T15:41:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:42 smithi040 ceph-mon[32397]: pgmap v6562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:42 smithi146 ceph-mon[35807]: pgmap v6562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:42 smithi076 ceph-mon[35401]: pgmap v6562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:44 smithi040 ceph-mon[32397]: pgmap v6563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:44 smithi146 ceph-mon[35807]: pgmap v6563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:44 smithi076 ceph-mon[35401]: pgmap v6563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:46 smithi040 ceph-mon[32397]: pgmap v6564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7713.182081 secs 2024-07-26T15:41:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:46 smithi146 ceph-mon[35807]: pgmap v6564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7713.182081 secs 2024-07-26T15:41:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:46 smithi076 ceph-mon[35401]: pgmap v6564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7713.182081 secs 2024-07-26T15:41:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:48 smithi040 ceph-mon[32397]: pgmap v6565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:48 smithi146 ceph-mon[35807]: pgmap v6565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:48 smithi076 ceph-mon[35401]: pgmap v6565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:50 smithi146 ceph-mon[35807]: pgmap v6566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:50 smithi076 ceph-mon[35401]: pgmap v6566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:51.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:50 smithi040 ceph-mon[32397]: pgmap v6566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7718.182214 secs 2024-07-26T15:41:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7718.182214 secs 2024-07-26T15:41:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7718.182214 secs 2024-07-26T15:41:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:52 smithi146 ceph-mon[35807]: pgmap v6567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:52 smithi076 ceph-mon[35401]: pgmap v6567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:52 smithi040 ceph-mon[32397]: pgmap v6567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:54 smithi146 ceph-mon[35807]: pgmap v6568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:54 smithi076 ceph-mon[35401]: pgmap v6568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:54 smithi040 ceph-mon[32397]: pgmap v6568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:56 smithi146 ceph-mon[35807]: pgmap v6569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7723.182348 secs 2024-07-26T15:41:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:56 smithi076 ceph-mon[35401]: pgmap v6569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7723.182348 secs 2024-07-26T15:41:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:56 smithi040 ceph-mon[32397]: pgmap v6569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:41:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7723.182348 secs 2024-07-26T15:41:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:41:58 smithi146 ceph-mon[35807]: pgmap v6570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:41:58 smithi076 ceph-mon[35401]: pgmap v6570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:41:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:41:58 smithi040 ceph-mon[32397]: pgmap v6570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:00 smithi146 ceph-mon[35807]: pgmap v6571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:00 smithi076 ceph-mon[35401]: pgmap v6571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:00 smithi040 ceph-mon[32397]: pgmap v6571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7728.182493 secs 2024-07-26T15:42:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7728.182493 secs 2024-07-26T15:42:02.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7728.182493 secs 2024-07-26T15:42:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:02 smithi146 ceph-mon[35807]: pgmap v6572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:02 smithi076 ceph-mon[35401]: pgmap v6572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:02 smithi040 ceph-mon[32397]: pgmap v6572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:04 smithi146 ceph-mon[35807]: pgmap v6573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:04 smithi076 ceph-mon[35401]: pgmap v6573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:04 smithi040 ceph-mon[32397]: pgmap v6573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:06 smithi146 ceph-mon[35807]: pgmap v6574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7733.182657 secs 2024-07-26T15:42:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:06 smithi076 ceph-mon[35401]: pgmap v6574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7733.182657 secs 2024-07-26T15:42:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:06 smithi040 ceph-mon[32397]: pgmap v6574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7733.182657 secs 2024-07-26T15:42:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:08 smithi076 ceph-mon[35401]: pgmap v6575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:08 smithi040 ceph-mon[32397]: pgmap v6575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:08 smithi146 ceph-mon[35807]: pgmap v6575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:10 smithi076 ceph-mon[35401]: pgmap v6576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:10 smithi040 ceph-mon[32397]: pgmap v6576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:10 smithi146 ceph-mon[35807]: pgmap v6576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7738.182826 secs 2024-07-26T15:42:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7738.182826 secs 2024-07-26T15:42:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7738.182826 secs 2024-07-26T15:42:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:12 smithi040 ceph-mon[32397]: pgmap v6577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:12 smithi146 ceph-mon[35807]: pgmap v6577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:12 smithi076 ceph-mon[35401]: pgmap v6577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:14 smithi040 ceph-mon[32397]: pgmap v6578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:14 smithi146 ceph-mon[35807]: pgmap v6578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:14 smithi076 ceph-mon[35401]: pgmap v6578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:16 smithi040 ceph-mon[32397]: pgmap v6579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7743.182965 secs 2024-07-26T15:42:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:16 smithi146 ceph-mon[35807]: pgmap v6579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7743.182965 secs 2024-07-26T15:42:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:16 smithi076 ceph-mon[35401]: pgmap v6579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7743.182965 secs 2024-07-26T15:42:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:18 smithi040 ceph-mon[32397]: pgmap v6580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:18 smithi146 ceph-mon[35807]: pgmap v6580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:18 smithi076 ceph-mon[35401]: pgmap v6580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:20 smithi040 ceph-mon[32397]: pgmap v6581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:20 smithi146 ceph-mon[35807]: pgmap v6581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:20 smithi076 ceph-mon[35401]: pgmap v6581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:22.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7748.183049 secs 2024-07-26T15:42:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7748.183049 secs 2024-07-26T15:42:22.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7748.183049 secs 2024-07-26T15:42:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:22 smithi040 ceph-mon[32397]: pgmap v6582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:22 smithi146 ceph-mon[35807]: pgmap v6582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:22 smithi076 ceph-mon[35401]: pgmap v6582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:24 smithi040 ceph-mon[32397]: pgmap v6583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:24 smithi146 ceph-mon[35807]: pgmap v6583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:24 smithi076 ceph-mon[35401]: pgmap v6583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:26 smithi040 ceph-mon[32397]: pgmap v6584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7753.183187 secs 2024-07-26T15:42:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:26 smithi146 ceph-mon[35807]: pgmap v6584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7753.183187 secs 2024-07-26T15:42:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:26 smithi076 ceph-mon[35401]: pgmap v6584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7753.183187 secs 2024-07-26T15:42:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:28 smithi040 ceph-mon[32397]: pgmap v6585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:28 smithi146 ceph-mon[35807]: pgmap v6585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:28 smithi076 ceph-mon[35401]: pgmap v6585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:30 smithi040 ceph-mon[32397]: pgmap v6586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:30 smithi146 ceph-mon[35807]: pgmap v6586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:30 smithi076 ceph-mon[35401]: pgmap v6586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7758.183320 secs 2024-07-26T15:42:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7758.183320 secs 2024-07-26T15:42:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7758.183320 secs 2024-07-26T15:42:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:32 smithi040 ceph-mon[32397]: pgmap v6587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:32 smithi146 ceph-mon[35807]: pgmap v6587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:32 smithi076 ceph-mon[35401]: pgmap v6587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:34 smithi040 ceph-mon[32397]: pgmap v6588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:34 smithi146 ceph-mon[35807]: pgmap v6588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:34 smithi076 ceph-mon[35401]: pgmap v6588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:36 smithi040 ceph-mon[32397]: pgmap v6589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7763.183467 secs 2024-07-26T15:42:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:36 smithi146 ceph-mon[35807]: pgmap v6589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7763.183467 secs 2024-07-26T15:42:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:36 smithi076 ceph-mon[35401]: pgmap v6589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7763.183467 secs 2024-07-26T15:42:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:38 smithi040 ceph-mon[32397]: pgmap v6590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:38 smithi146 ceph-mon[35807]: pgmap v6590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:38 smithi076 ceph-mon[35401]: pgmap v6590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:40 smithi040 ceph-mon[32397]: pgmap v6591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:40 smithi146 ceph-mon[35807]: pgmap v6591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:40 smithi076 ceph-mon[35401]: pgmap v6591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7768.183600 secs 2024-07-26T15:42:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7768.183600 secs 2024-07-26T15:42:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7768.183600 secs 2024-07-26T15:42:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:42 smithi040 ceph-mon[32397]: pgmap v6592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:42 smithi146 ceph-mon[35807]: pgmap v6592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:42 smithi076 ceph-mon[35401]: pgmap v6592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:44 smithi146 ceph-mon[35807]: pgmap v6593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:44 smithi076 ceph-mon[35401]: pgmap v6593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:44 smithi040 ceph-mon[32397]: pgmap v6593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:46 smithi146 ceph-mon[35807]: pgmap v6594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7773.183722 secs 2024-07-26T15:42:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:46 smithi076 ceph-mon[35401]: pgmap v6594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7773.183722 secs 2024-07-26T15:42:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:46 smithi040 ceph-mon[32397]: pgmap v6594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7773.183722 secs 2024-07-26T15:42:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:48 smithi146 ceph-mon[35807]: pgmap v6595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:48 smithi076 ceph-mon[35401]: pgmap v6595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:48 smithi040 ceph-mon[32397]: pgmap v6595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:51 smithi146 ceph-mon[35807]: pgmap v6596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:51 smithi076 ceph-mon[35401]: pgmap v6596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:51 smithi040 ceph-mon[32397]: pgmap v6596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7778.183869 secs 2024-07-26T15:42:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7778.183869 secs 2024-07-26T15:42:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7778.183869 secs 2024-07-26T15:42:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:53 smithi146 ceph-mon[35807]: pgmap v6597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:53 smithi076 ceph-mon[35401]: pgmap v6597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:53 smithi040 ceph-mon[32397]: pgmap v6597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:55 smithi146 ceph-mon[35807]: pgmap v6598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:55 smithi076 ceph-mon[35401]: pgmap v6598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:55 smithi040 ceph-mon[32397]: pgmap v6598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:57 smithi146 ceph-mon[35807]: pgmap v6599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7783.184003 secs 2024-07-26T15:42:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:57 smithi076 ceph-mon[35401]: pgmap v6599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7783.184003 secs 2024-07-26T15:42:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:57 smithi040 ceph-mon[32397]: pgmap v6599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:42:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7783.184003 secs 2024-07-26T15:42:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:42:59 smithi146 ceph-mon[35807]: pgmap v6600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:42:59 smithi076 ceph-mon[35401]: pgmap v6600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:42:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:42:59 smithi040 ceph-mon[32397]: pgmap v6600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:01 smithi146 ceph-mon[35807]: pgmap v6601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:01 smithi076 ceph-mon[35401]: pgmap v6601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:01 smithi040 ceph-mon[32397]: pgmap v6601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7788.184167 secs 2024-07-26T15:43:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7788.184167 secs 2024-07-26T15:43:02.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7788.184167 secs 2024-07-26T15:43:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:03 smithi146 ceph-mon[35807]: pgmap v6602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:03 smithi076 ceph-mon[35401]: pgmap v6602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:03 smithi040 ceph-mon[32397]: pgmap v6602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:05 smithi076 ceph-mon[35401]: pgmap v6603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:05 smithi040 ceph-mon[32397]: pgmap v6603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:05 smithi146 ceph-mon[35807]: pgmap v6603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:07 smithi076 ceph-mon[35401]: pgmap v6604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:07.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7793.184303 secs 2024-07-26T15:43:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:07 smithi040 ceph-mon[32397]: pgmap v6604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7793.184303 secs 2024-07-26T15:43:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:07 smithi146 ceph-mon[35807]: pgmap v6604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7793.184303 secs 2024-07-26T15:43:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:09 smithi040 ceph-mon[32397]: pgmap v6605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:09 smithi146 ceph-mon[35807]: pgmap v6605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:09 smithi076 ceph-mon[35401]: pgmap v6605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:11 smithi040 ceph-mon[32397]: pgmap v6606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:11 smithi146 ceph-mon[35807]: pgmap v6606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:11 smithi076 ceph-mon[35401]: pgmap v6606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7798.184451 secs 2024-07-26T15:43:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7798.184451 secs 2024-07-26T15:43:12.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7798.184451 secs 2024-07-26T15:43:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:13 smithi040 ceph-mon[32397]: pgmap v6607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:13 smithi146 ceph-mon[35807]: pgmap v6607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:13 smithi076 ceph-mon[35401]: pgmap v6607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:14 smithi040 ceph-mon[32397]: pgmap v6608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:14 smithi146 ceph-mon[35807]: pgmap v6608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:14 smithi076 ceph-mon[35401]: pgmap v6608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:16 smithi146 ceph-mon[35807]: pgmap v6609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7803.184581 secs 2024-07-26T15:43:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:16 smithi076 ceph-mon[35401]: pgmap v6609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7803.184581 secs 2024-07-26T15:43:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:16 smithi040 ceph-mon[32397]: pgmap v6609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7803.184581 secs 2024-07-26T15:43:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:18 smithi146 ceph-mon[35807]: pgmap v6610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:18 smithi076 ceph-mon[35401]: pgmap v6610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:18 smithi040 ceph-mon[32397]: pgmap v6610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:20 smithi146 ceph-mon[35807]: pgmap v6611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:20 smithi076 ceph-mon[35401]: pgmap v6611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:20 smithi040 ceph-mon[32397]: pgmap v6611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7808.184722 secs 2024-07-26T15:43:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7808.184722 secs 2024-07-26T15:43:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7808.184722 secs 2024-07-26T15:43:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:22 smithi146 ceph-mon[35807]: pgmap v6612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:22 smithi076 ceph-mon[35401]: pgmap v6612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:22 smithi040 ceph-mon[32397]: pgmap v6612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:24 smithi146 ceph-mon[35807]: pgmap v6613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:24 smithi076 ceph-mon[35401]: pgmap v6613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:24 smithi040 ceph-mon[32397]: pgmap v6613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:26 smithi146 ceph-mon[35807]: pgmap v6614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7813.184862 secs 2024-07-26T15:43:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:26 smithi076 ceph-mon[35401]: pgmap v6614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7813.184862 secs 2024-07-26T15:43:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:26 smithi040 ceph-mon[32397]: pgmap v6614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7813.184862 secs 2024-07-26T15:43:28.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:28 smithi146 ceph-mon[35807]: pgmap v6615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:28 smithi076 ceph-mon[35401]: pgmap v6615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:28 smithi040 ceph-mon[32397]: pgmap v6615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:30.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:30 smithi146 ceph-mon[35807]: pgmap v6616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:30 smithi076 ceph-mon[35401]: pgmap v6616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:30.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:30 smithi040 ceph-mon[32397]: pgmap v6616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:31.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7818.185019 secs 2024-07-26T15:43:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7818.185019 secs 2024-07-26T15:43:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7818.185019 secs 2024-07-26T15:43:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:32 smithi146 ceph-mon[35807]: pgmap v6617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:32 smithi076 ceph-mon[35401]: pgmap v6617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:32.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:32 smithi040 ceph-mon[32397]: pgmap v6617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:34 smithi076 ceph-mon[35401]: pgmap v6618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:34 smithi040 ceph-mon[32397]: pgmap v6618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:34 smithi146 ceph-mon[35807]: pgmap v6618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:36 smithi076 ceph-mon[35401]: pgmap v6619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7823.185165 secs 2024-07-26T15:43:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:36 smithi040 ceph-mon[32397]: pgmap v6619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7823.185165 secs 2024-07-26T15:43:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:36 smithi146 ceph-mon[35807]: pgmap v6619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7823.185165 secs 2024-07-26T15:43:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:38 smithi040 ceph-mon[32397]: pgmap v6620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:38 smithi146 ceph-mon[35807]: pgmap v6620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:38 smithi076 ceph-mon[35401]: pgmap v6620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:40 smithi040 ceph-mon[32397]: pgmap v6621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:40 smithi146 ceph-mon[35807]: pgmap v6621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:40 smithi076 ceph-mon[35401]: pgmap v6621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7828.185257 secs 2024-07-26T15:43:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7828.185257 secs 2024-07-26T15:43:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7828.185257 secs 2024-07-26T15:43:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:42 smithi040 ceph-mon[32397]: pgmap v6622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:42 smithi146 ceph-mon[35807]: pgmap v6622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:42 smithi076 ceph-mon[35401]: pgmap v6622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:44 smithi040 ceph-mon[32397]: pgmap v6623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:43:45.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:44 smithi146 ceph-mon[35807]: pgmap v6623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:43:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:44 smithi076 ceph-mon[35401]: pgmap v6623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:43:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:46 smithi040 ceph-mon[32397]: pgmap v6624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7833.185393 secs 2024-07-26T15:43:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:46 smithi146 ceph-mon[35807]: pgmap v6624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7833.185393 secs 2024-07-26T15:43:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:46 smithi076 ceph-mon[35401]: pgmap v6624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7833.185393 secs 2024-07-26T15:43:48.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:48 smithi040 ceph-mon[32397]: pgmap v6625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:48 smithi146 ceph-mon[35807]: pgmap v6625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:48 smithi076 ceph-mon[35401]: pgmap v6625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:50 smithi040 ceph-mon[32397]: pgmap v6626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:50 smithi146 ceph-mon[35807]: pgmap v6626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:50 smithi076 ceph-mon[35401]: pgmap v6626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7838.185532 secs 2024-07-26T15:43:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7838.185532 secs 2024-07-26T15:43:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7838.185532 secs 2024-07-26T15:43:52.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:52 smithi146 ceph-mon[35807]: pgmap v6627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:52 smithi040 ceph-mon[32397]: pgmap v6627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:52.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:52 smithi076 ceph-mon[35401]: pgmap v6627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:54 smithi040 ceph-mon[32397]: pgmap v6628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:43:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:54 smithi146 ceph-mon[35807]: pgmap v6628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:43:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:54 smithi076 ceph-mon[35401]: pgmap v6628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:56 smithi040 ceph-mon[32397]: pgmap v6629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7843.185624 secs 2024-07-26T15:43:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:56 smithi146 ceph-mon[35807]: pgmap v6629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7843.185624 secs 2024-07-26T15:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:56 smithi076 ceph-mon[35401]: pgmap v6629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:43:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7843.185624 secs 2024-07-26T15:43:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:43:58 smithi040 ceph-mon[32397]: pgmap v6630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:43:58 smithi146 ceph-mon[35807]: pgmap v6630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:43:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:43:58 smithi076 ceph-mon[35401]: pgmap v6630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:00 smithi040 ceph-mon[32397]: pgmap v6631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:00 smithi146 ceph-mon[35807]: pgmap v6631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:00 smithi076 ceph-mon[35401]: pgmap v6631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7848.185763 secs 2024-07-26T15:44:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7848.185763 secs 2024-07-26T15:44:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7848.185763 secs 2024-07-26T15:44:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:02 smithi040 ceph-mon[32397]: pgmap v6632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:02 smithi146 ceph-mon[35807]: pgmap v6632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:02 smithi076 ceph-mon[35401]: pgmap v6632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:04 smithi040 ceph-mon[32397]: pgmap v6633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:04 smithi146 ceph-mon[35807]: pgmap v6633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:04 smithi076 ceph-mon[35401]: pgmap v6633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:06 smithi040 ceph-mon[32397]: pgmap v6634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:44:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7853.185856 secs 2024-07-26T15:44:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:06 smithi146 ceph-mon[35807]: pgmap v6634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:44:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7853.185856 secs 2024-07-26T15:44:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:06 smithi076 ceph-mon[35401]: pgmap v6634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:44:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7853.185856 secs 2024-07-26T15:44:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:08 smithi040 ceph-mon[32397]: pgmap v6635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:08 smithi146 ceph-mon[35807]: pgmap v6635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:08 smithi076 ceph-mon[35401]: pgmap v6635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:10 smithi040 ceph-mon[32397]: pgmap v6636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:10 smithi146 ceph-mon[35807]: pgmap v6636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:11.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:10 smithi076 ceph-mon[35401]: pgmap v6636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7858.185943 secs 2024-07-26T15:44:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7858.185943 secs 2024-07-26T15:44:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7858.185943 secs 2024-07-26T15:44:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:12 smithi146 ceph-mon[35807]: pgmap v6637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:12 smithi076 ceph-mon[35401]: pgmap v6637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:13.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:12 smithi040 ceph-mon[32397]: pgmap v6637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:14 smithi146 ceph-mon[35807]: pgmap v6638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:14 smithi076 ceph-mon[35401]: pgmap v6638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:14 smithi040 ceph-mon[32397]: pgmap v6638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:16 smithi146 ceph-mon[35807]: pgmap v6639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7863.186104 secs 2024-07-26T15:44:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:16 smithi076 ceph-mon[35401]: pgmap v6639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7863.186104 secs 2024-07-26T15:44:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:16 smithi040 ceph-mon[32397]: pgmap v6639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7863.186104 secs 2024-07-26T15:44:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:18 smithi146 ceph-mon[35807]: pgmap v6640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:18 smithi076 ceph-mon[35401]: pgmap v6640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:18 smithi040 ceph-mon[32397]: pgmap v6640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:20 smithi146 ceph-mon[35807]: pgmap v6641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:20 smithi076 ceph-mon[35401]: pgmap v6641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:20 smithi040 ceph-mon[32397]: pgmap v6641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7868.186246 secs 2024-07-26T15:44:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7868.186246 secs 2024-07-26T15:44:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7868.186246 secs 2024-07-26T15:44:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:22 smithi146 ceph-mon[35807]: pgmap v6642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:22 smithi076 ceph-mon[35401]: pgmap v6642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:22 smithi040 ceph-mon[32397]: pgmap v6642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:24 smithi146 ceph-mon[35807]: pgmap v6643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:24 smithi076 ceph-mon[35401]: pgmap v6643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:24 smithi040 ceph-mon[32397]: pgmap v6643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:26 smithi146 ceph-mon[35807]: pgmap v6644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7873.186410 secs 2024-07-26T15:44:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:26 smithi076 ceph-mon[35401]: pgmap v6644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7873.186410 secs 2024-07-26T15:44:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:26 smithi040 ceph-mon[32397]: pgmap v6644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7873.186410 secs 2024-07-26T15:44:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:28 smithi146 ceph-mon[35807]: pgmap v6645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:28 smithi076 ceph-mon[35401]: pgmap v6645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:28 smithi040 ceph-mon[32397]: pgmap v6645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:30 smithi076 ceph-mon[35401]: pgmap v6646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:30 smithi040 ceph-mon[32397]: pgmap v6646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:30 smithi146 ceph-mon[35807]: pgmap v6646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:32.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7878.186575 secs 2024-07-26T15:44:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7878.186575 secs 2024-07-26T15:44:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7878.186575 secs 2024-07-26T15:44:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:32 smithi040 ceph-mon[32397]: pgmap v6647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:32 smithi146 ceph-mon[35807]: pgmap v6647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:32 smithi076 ceph-mon[35401]: pgmap v6647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:34 smithi040 ceph-mon[32397]: pgmap v6648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:34 smithi146 ceph-mon[35807]: pgmap v6648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:34 smithi076 ceph-mon[35401]: pgmap v6648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:36 smithi040 ceph-mon[32397]: pgmap v6649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7883.186716 secs 2024-07-26T15:44:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:36 smithi146 ceph-mon[35807]: pgmap v6649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7883.186716 secs 2024-07-26T15:44:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:36 smithi076 ceph-mon[35401]: pgmap v6649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7883.186716 secs 2024-07-26T15:44:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:38 smithi040 ceph-mon[32397]: pgmap v6650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:38 smithi146 ceph-mon[35807]: pgmap v6650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:38 smithi076 ceph-mon[35401]: pgmap v6650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:40 smithi040 ceph-mon[32397]: pgmap v6651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:40 smithi146 ceph-mon[35807]: pgmap v6651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:40 smithi076 ceph-mon[35401]: pgmap v6651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7888.186856 secs 2024-07-26T15:44:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7888.186856 secs 2024-07-26T15:44:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7888.186856 secs 2024-07-26T15:44:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:42 smithi040 ceph-mon[32397]: pgmap v6652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:42 smithi146 ceph-mon[35807]: pgmap v6652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:42 smithi076 ceph-mon[35401]: pgmap v6652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:44 smithi040 ceph-mon[32397]: pgmap v6653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:44 smithi146 ceph-mon[35807]: pgmap v6653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:44 smithi076 ceph-mon[35401]: pgmap v6653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:46 smithi040 ceph-mon[32397]: pgmap v6654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7893.186998 secs 2024-07-26T15:44:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:46 smithi146 ceph-mon[35807]: pgmap v6654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7893.186998 secs 2024-07-26T15:44:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:46 smithi076 ceph-mon[35401]: pgmap v6654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7893.186998 secs 2024-07-26T15:44:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:48 smithi040 ceph-mon[32397]: pgmap v6655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:48 smithi146 ceph-mon[35807]: pgmap v6655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:48 smithi076 ceph-mon[35401]: pgmap v6655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:50 smithi040 ceph-mon[32397]: pgmap v6656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:50 smithi146 ceph-mon[35807]: pgmap v6656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:50 smithi076 ceph-mon[35401]: pgmap v6656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:52.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7898.187140 secs 2024-07-26T15:44:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7898.187140 secs 2024-07-26T15:44:52.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7898.187140 secs 2024-07-26T15:44:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:52 smithi040 ceph-mon[32397]: pgmap v6657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:52 smithi146 ceph-mon[35807]: pgmap v6657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:52 smithi076 ceph-mon[35401]: pgmap v6657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:54 smithi040 ceph-mon[32397]: pgmap v6658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:54 smithi146 ceph-mon[35807]: pgmap v6658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:54 smithi076 ceph-mon[35401]: pgmap v6658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:44:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:56 smithi040 ceph-mon[32397]: pgmap v6659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7903.187326 secs 2024-07-26T15:44:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:56 smithi146 ceph-mon[35807]: pgmap v6659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7903.187326 secs 2024-07-26T15:44:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:56 smithi076 ceph-mon[35401]: pgmap v6659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:44:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7903.187326 secs 2024-07-26T15:44:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:44:58 smithi040 ceph-mon[32397]: pgmap v6660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:44:58 smithi146 ceph-mon[35807]: pgmap v6660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:44:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:44:58 smithi076 ceph-mon[35401]: pgmap v6660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:00 smithi040 ceph-mon[32397]: pgmap v6661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:00 smithi146 ceph-mon[35807]: pgmap v6661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:00 smithi076 ceph-mon[35401]: pgmap v6661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7908.187462 secs 2024-07-26T15:45:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7908.187462 secs 2024-07-26T15:45:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7908.187462 secs 2024-07-26T15:45:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:02 smithi146 ceph-mon[35807]: pgmap v6662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:02 smithi076 ceph-mon[35401]: pgmap v6662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:02 smithi040 ceph-mon[32397]: pgmap v6662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:05 smithi146 ceph-mon[35807]: pgmap v6663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:05 smithi076 ceph-mon[35401]: pgmap v6663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:04 smithi040 ceph-mon[32397]: pgmap v6663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:07 smithi146 ceph-mon[35807]: pgmap v6664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7913.187606 secs 2024-07-26T15:45:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:07 smithi076 ceph-mon[35401]: pgmap v6664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7913.187606 secs 2024-07-26T15:45:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:07 smithi040 ceph-mon[32397]: pgmap v6664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7913.187606 secs 2024-07-26T15:45:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:09 smithi146 ceph-mon[35807]: pgmap v6665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:09 smithi076 ceph-mon[35401]: pgmap v6665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:09 smithi040 ceph-mon[32397]: pgmap v6665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:11 smithi146 ceph-mon[35807]: pgmap v6666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:11 smithi076 ceph-mon[35401]: pgmap v6666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:11 smithi040 ceph-mon[32397]: pgmap v6666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7918.187713 secs 2024-07-26T15:45:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7918.187713 secs 2024-07-26T15:45:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7918.187713 secs 2024-07-26T15:45:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:13 smithi146 ceph-mon[35807]: pgmap v6667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:13 smithi076 ceph-mon[35401]: pgmap v6667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:13 smithi040 ceph-mon[32397]: pgmap v6667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:15 smithi146 ceph-mon[35807]: pgmap v6668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:15 smithi076 ceph-mon[35401]: pgmap v6668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:15 smithi040 ceph-mon[32397]: pgmap v6668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:17 smithi146 ceph-mon[35807]: pgmap v6669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:45:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7923.187800 secs 2024-07-26T15:45:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:17 smithi076 ceph-mon[35401]: pgmap v6669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:45:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7923.187800 secs 2024-07-26T15:45:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:17 smithi040 ceph-mon[32397]: pgmap v6669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:45:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7923.187800 secs 2024-07-26T15:45:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:19 smithi146 ceph-mon[35807]: pgmap v6670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:19 smithi076 ceph-mon[35401]: pgmap v6670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:19 smithi040 ceph-mon[32397]: pgmap v6670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:21 smithi146 ceph-mon[35807]: pgmap v6671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:21 smithi076 ceph-mon[35401]: pgmap v6671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:21 smithi040 ceph-mon[32397]: pgmap v6671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7928.187938 secs 2024-07-26T15:45:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7928.187938 secs 2024-07-26T15:45:22.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7928.187938 secs 2024-07-26T15:45:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:23 smithi040 ceph-mon[32397]: pgmap v6672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:23 smithi146 ceph-mon[35807]: pgmap v6672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:23 smithi076 ceph-mon[35401]: pgmap v6672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:25 smithi040 ceph-mon[32397]: pgmap v6673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:25 smithi146 ceph-mon[35807]: pgmap v6673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:25 smithi076 ceph-mon[35401]: pgmap v6673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:45:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:27 smithi040 ceph-mon[32397]: pgmap v6674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:45:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7933.188081 secs 2024-07-26T15:45:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:27 smithi146 ceph-mon[35807]: pgmap v6674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:45:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7933.188081 secs 2024-07-26T15:45:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:27 smithi076 ceph-mon[35401]: pgmap v6674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:45:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7933.188081 secs 2024-07-26T15:45:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:29 smithi040 ceph-mon[32397]: pgmap v6675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:29 smithi146 ceph-mon[35807]: pgmap v6675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:29 smithi076 ceph-mon[35401]: pgmap v6675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:31 smithi040 ceph-mon[32397]: pgmap v6676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:31 smithi146 ceph-mon[35807]: pgmap v6676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:31 smithi076 ceph-mon[35401]: pgmap v6676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:32.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7938.188240 secs 2024-07-26T15:45:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7938.188240 secs 2024-07-26T15:45:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7938.188240 secs 2024-07-26T15:45:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:33 smithi040 ceph-mon[32397]: pgmap v6677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:33 smithi146 ceph-mon[35807]: pgmap v6677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:33 smithi076 ceph-mon[35401]: pgmap v6677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:35 smithi040 ceph-mon[32397]: pgmap v6678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:35 smithi146 ceph-mon[35807]: pgmap v6678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:35 smithi076 ceph-mon[35401]: pgmap v6678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:37 smithi040 ceph-mon[32397]: pgmap v6679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7943.188383 secs 2024-07-26T15:45:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:37 smithi146 ceph-mon[35807]: pgmap v6679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7943.188383 secs 2024-07-26T15:45:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:37 smithi076 ceph-mon[35401]: pgmap v6679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7943.188383 secs 2024-07-26T15:45:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:39 smithi040 ceph-mon[32397]: pgmap v6680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:39 smithi146 ceph-mon[35807]: pgmap v6680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:39 smithi076 ceph-mon[35401]: pgmap v6680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:41 smithi040 ceph-mon[32397]: pgmap v6681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:41 smithi146 ceph-mon[35807]: pgmap v6681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:41 smithi076 ceph-mon[35401]: pgmap v6681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7948.188482 secs 2024-07-26T15:45:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7948.188482 secs 2024-07-26T15:45:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7948.188482 secs 2024-07-26T15:45:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:43 smithi040 ceph-mon[32397]: pgmap v6682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:43 smithi146 ceph-mon[35807]: pgmap v6682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:43 smithi076 ceph-mon[35401]: pgmap v6682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:45 smithi040 ceph-mon[32397]: pgmap v6683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:45 smithi146 ceph-mon[35807]: pgmap v6683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:45 smithi076 ceph-mon[35401]: pgmap v6683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:47 smithi040 ceph-mon[32397]: pgmap v6684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7953.188567 secs 2024-07-26T15:45:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:47 smithi146 ceph-mon[35807]: pgmap v6684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7953.188567 secs 2024-07-26T15:45:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:47 smithi076 ceph-mon[35401]: pgmap v6684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7953.188567 secs 2024-07-26T15:45:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:49 smithi040 ceph-mon[32397]: pgmap v6685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:49 smithi146 ceph-mon[35807]: pgmap v6685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:49 smithi076 ceph-mon[35401]: pgmap v6685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:51 smithi040 ceph-mon[32397]: pgmap v6686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:51 smithi146 ceph-mon[35807]: pgmap v6686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:51 smithi076 ceph-mon[35401]: pgmap v6686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:52.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7958.188655 secs 2024-07-26T15:45:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7958.188655 secs 2024-07-26T15:45:52.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7958.188655 secs 2024-07-26T15:45:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:53 smithi040 ceph-mon[32397]: pgmap v6687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:53 smithi146 ceph-mon[35807]: pgmap v6687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:53 smithi076 ceph-mon[35401]: pgmap v6687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:55 smithi040 ceph-mon[32397]: pgmap v6688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:55 smithi146 ceph-mon[35807]: pgmap v6688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:55 smithi076 ceph-mon[35401]: pgmap v6688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:45:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:57 smithi040 ceph-mon[32397]: pgmap v6689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7963.188799 secs 2024-07-26T15:45:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:57 smithi146 ceph-mon[35807]: pgmap v6689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7963.188799 secs 2024-07-26T15:45:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:57 smithi076 ceph-mon[35401]: pgmap v6689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:45:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7963.188799 secs 2024-07-26T15:45:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:45:58 smithi146 ceph-mon[35807]: pgmap v6690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:45:58 smithi076 ceph-mon[35401]: pgmap v6690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:45:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:45:58 smithi040 ceph-mon[32397]: pgmap v6690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:00 smithi040 ceph-mon[32397]: pgmap v6691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:00 smithi146 ceph-mon[35807]: pgmap v6691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:00 smithi076 ceph-mon[35401]: pgmap v6691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7968.188935 secs 2024-07-26T15:46:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7968.188935 secs 2024-07-26T15:46:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7968.188935 secs 2024-07-26T15:46:02.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:02 smithi040 ceph-mon[32397]: pgmap v6692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:02 smithi146 ceph-mon[35807]: pgmap v6692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:02 smithi076 ceph-mon[35401]: pgmap v6692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:04 smithi040 ceph-mon[32397]: pgmap v6693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:04 smithi146 ceph-mon[35807]: pgmap v6693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:04 smithi076 ceph-mon[35401]: pgmap v6693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:06 smithi040 ceph-mon[32397]: pgmap v6694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7973.189065 secs 2024-07-26T15:46:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:06 smithi146 ceph-mon[35807]: pgmap v6694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7973.189065 secs 2024-07-26T15:46:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:06 smithi076 ceph-mon[35401]: pgmap v6694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7973.189065 secs 2024-07-26T15:46:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:08 smithi040 ceph-mon[32397]: pgmap v6695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:08 smithi146 ceph-mon[35807]: pgmap v6695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:08 smithi076 ceph-mon[35401]: pgmap v6695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:10 smithi040 ceph-mon[32397]: pgmap v6696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:10 smithi146 ceph-mon[35807]: pgmap v6696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:10 smithi076 ceph-mon[35401]: pgmap v6696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7978.189207 secs 2024-07-26T15:46:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7978.189207 secs 2024-07-26T15:46:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7978.189207 secs 2024-07-26T15:46:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:12 smithi040 ceph-mon[32397]: pgmap v6697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:12 smithi146 ceph-mon[35807]: pgmap v6697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:12 smithi076 ceph-mon[35401]: pgmap v6697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:14 smithi040 ceph-mon[32397]: pgmap v6698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:14 smithi146 ceph-mon[35807]: pgmap v6698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:14 smithi076 ceph-mon[35401]: pgmap v6698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:16 smithi040 ceph-mon[32397]: pgmap v6699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7983.189351 secs 2024-07-26T15:46:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:16 smithi146 ceph-mon[35807]: pgmap v6699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7983.189351 secs 2024-07-26T15:46:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:16 smithi076 ceph-mon[35401]: pgmap v6699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7983.189351 secs 2024-07-26T15:46:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:18 smithi040 ceph-mon[32397]: pgmap v6700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:18 smithi146 ceph-mon[35807]: pgmap v6700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:18 smithi076 ceph-mon[35401]: pgmap v6700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:20 smithi040 ceph-mon[32397]: pgmap v6701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:20 smithi146 ceph-mon[35807]: pgmap v6701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:20 smithi076 ceph-mon[35401]: pgmap v6701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:21.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7988.189497 secs 2024-07-26T15:46:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7988.189497 secs 2024-07-26T15:46:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7988.189497 secs 2024-07-26T15:46:22.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:22 smithi146 ceph-mon[35807]: pgmap v6702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:22 smithi040 ceph-mon[32397]: pgmap v6702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:22.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:22 smithi076 ceph-mon[35401]: pgmap v6702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:24 smithi040 ceph-mon[32397]: pgmap v6703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:24 smithi146 ceph-mon[35807]: pgmap v6703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:24 smithi076 ceph-mon[35401]: pgmap v6703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:26 smithi040 ceph-mon[32397]: pgmap v6704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7993.189631 secs 2024-07-26T15:46:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:26 smithi146 ceph-mon[35807]: pgmap v6704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7993.189631 secs 2024-07-26T15:46:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:26 smithi076 ceph-mon[35401]: pgmap v6704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7993.189631 secs 2024-07-26T15:46:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:28 smithi040 ceph-mon[32397]: pgmap v6705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:28 smithi146 ceph-mon[35807]: pgmap v6705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:28 smithi076 ceph-mon[35401]: pgmap v6705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:30 smithi040 ceph-mon[32397]: pgmap v6706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:30 smithi146 ceph-mon[35807]: pgmap v6706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:30 smithi076 ceph-mon[35401]: pgmap v6706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 7998.189768 secs 2024-07-26T15:46:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 7998.189768 secs 2024-07-26T15:46:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 7998.189768 secs 2024-07-26T15:46:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:32 smithi146 ceph-mon[35807]: pgmap v6707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:32 smithi076 ceph-mon[35401]: pgmap v6707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:33.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:32 smithi040 ceph-mon[32397]: pgmap v6707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:34 smithi146 ceph-mon[35807]: pgmap v6708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:34 smithi076 ceph-mon[35401]: pgmap v6708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:34 smithi040 ceph-mon[32397]: pgmap v6708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:36 smithi146 ceph-mon[35807]: pgmap v6709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8003.189906 secs 2024-07-26T15:46:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:36 smithi076 ceph-mon[35401]: pgmap v6709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8003.189906 secs 2024-07-26T15:46:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:36 smithi040 ceph-mon[32397]: pgmap v6709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8003.189906 secs 2024-07-26T15:46:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:38 smithi146 ceph-mon[35807]: pgmap v6710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:38 smithi076 ceph-mon[35401]: pgmap v6710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:38 smithi040 ceph-mon[32397]: pgmap v6710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:40 smithi146 ceph-mon[35807]: pgmap v6711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:40 smithi076 ceph-mon[35401]: pgmap v6711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:40 smithi040 ceph-mon[32397]: pgmap v6711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8008.190035 secs 2024-07-26T15:46:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8008.190035 secs 2024-07-26T15:46:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8008.190035 secs 2024-07-26T15:46:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:42 smithi146 ceph-mon[35807]: pgmap v6712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:42 smithi076 ceph-mon[35401]: pgmap v6712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:42 smithi040 ceph-mon[32397]: pgmap v6712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:44 smithi146 ceph-mon[35807]: pgmap v6713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:44 smithi076 ceph-mon[35401]: pgmap v6713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:44 smithi040 ceph-mon[32397]: pgmap v6713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:46 smithi146 ceph-mon[35807]: pgmap v6714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8013.190173 secs 2024-07-26T15:46:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:46 smithi076 ceph-mon[35401]: pgmap v6714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8013.190173 secs 2024-07-26T15:46:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:46 smithi040 ceph-mon[32397]: pgmap v6714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8013.190173 secs 2024-07-26T15:46:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:48 smithi146 ceph-mon[35807]: pgmap v6715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:48 smithi076 ceph-mon[35401]: pgmap v6715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:48 smithi040 ceph-mon[32397]: pgmap v6715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:50 smithi076 ceph-mon[35401]: pgmap v6716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:50 smithi040 ceph-mon[32397]: pgmap v6716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:50 smithi146 ceph-mon[35807]: pgmap v6716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:52.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8018.190331 secs 2024-07-26T15:46:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8018.190331 secs 2024-07-26T15:46:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8018.190331 secs 2024-07-26T15:46:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:52 smithi040 ceph-mon[32397]: pgmap v6717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:53.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:52 smithi076 ceph-mon[35401]: pgmap v6717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:52 smithi146 ceph-mon[35807]: pgmap v6717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:54 smithi040 ceph-mon[32397]: pgmap v6718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:55.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:54 smithi146 ceph-mon[35807]: pgmap v6718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:54 smithi076 ceph-mon[35401]: pgmap v6718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:46:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:56 smithi040 ceph-mon[32397]: pgmap v6719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8023.190474 secs 2024-07-26T15:46:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:56 smithi146 ceph-mon[35807]: pgmap v6719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8023.190474 secs 2024-07-26T15:46:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:56 smithi076 ceph-mon[35401]: pgmap v6719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:46:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8023.190474 secs 2024-07-26T15:46:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:46:58 smithi040 ceph-mon[32397]: pgmap v6720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:46:58 smithi146 ceph-mon[35807]: pgmap v6720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:46:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:46:58 smithi076 ceph-mon[35401]: pgmap v6720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:00 smithi040 ceph-mon[32397]: pgmap v6721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:00 smithi146 ceph-mon[35807]: pgmap v6721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:00 smithi076 ceph-mon[35401]: pgmap v6721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8028.190570 secs 2024-07-26T15:47:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8028.190570 secs 2024-07-26T15:47:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8028.190570 secs 2024-07-26T15:47:03.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:02 smithi040 ceph-mon[32397]: pgmap v6722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:02 smithi146 ceph-mon[35807]: pgmap v6722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:02 smithi076 ceph-mon[35401]: pgmap v6722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:04 smithi040 ceph-mon[32397]: pgmap v6723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:04 smithi146 ceph-mon[35807]: pgmap v6723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:04 smithi076 ceph-mon[35401]: pgmap v6723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:06 smithi040 ceph-mon[32397]: pgmap v6724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8033.190706 secs 2024-07-26T15:47:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:06 smithi146 ceph-mon[35807]: pgmap v6724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8033.190706 secs 2024-07-26T15:47:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:06 smithi076 ceph-mon[35401]: pgmap v6724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8033.190706 secs 2024-07-26T15:47:09.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:08 smithi040 ceph-mon[32397]: pgmap v6725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:08 smithi146 ceph-mon[35807]: pgmap v6725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:08 smithi076 ceph-mon[35401]: pgmap v6725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:10 smithi040 ceph-mon[32397]: pgmap v6726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:10 smithi146 ceph-mon[35807]: pgmap v6726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:10 smithi076 ceph-mon[35401]: pgmap v6726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:12.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8038.190848 secs 2024-07-26T15:47:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8038.190848 secs 2024-07-26T15:47:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8038.190848 secs 2024-07-26T15:47:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:12 smithi040 ceph-mon[32397]: pgmap v6727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:12 smithi146 ceph-mon[35807]: pgmap v6727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:12 smithi076 ceph-mon[35401]: pgmap v6727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:14 smithi146 ceph-mon[35807]: pgmap v6728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:14 smithi076 ceph-mon[35401]: pgmap v6728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:14.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:14 smithi040 ceph-mon[32397]: pgmap v6728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:16 smithi040 ceph-mon[32397]: pgmap v6729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8043.190980 secs 2024-07-26T15:47:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:16 smithi146 ceph-mon[35807]: pgmap v6729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8043.190980 secs 2024-07-26T15:47:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:16 smithi076 ceph-mon[35401]: pgmap v6729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8043.190980 secs 2024-07-26T15:47:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:18 smithi040 ceph-mon[32397]: pgmap v6730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:18 smithi146 ceph-mon[35807]: pgmap v6730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:18 smithi076 ceph-mon[35401]: pgmap v6730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:20 smithi040 ceph-mon[32397]: pgmap v6731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:21.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:20 smithi146 ceph-mon[35807]: pgmap v6731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:20 smithi076 ceph-mon[35401]: pgmap v6731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8048.191121 secs 2024-07-26T15:47:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8048.191121 secs 2024-07-26T15:47:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8048.191121 secs 2024-07-26T15:47:22.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:22 smithi146 ceph-mon[35807]: pgmap v6732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:22 smithi040 ceph-mon[32397]: pgmap v6732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:22 smithi076 ceph-mon[35401]: pgmap v6732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:24 smithi040 ceph-mon[32397]: pgmap v6733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:24 smithi146 ceph-mon[35807]: pgmap v6733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:24 smithi076 ceph-mon[35401]: pgmap v6733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:26 smithi040 ceph-mon[32397]: pgmap v6734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8053.191290 secs 2024-07-26T15:47:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:26 smithi146 ceph-mon[35807]: pgmap v6734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8053.191290 secs 2024-07-26T15:47:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:26 smithi076 ceph-mon[35401]: pgmap v6734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8053.191290 secs 2024-07-26T15:47:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:28 smithi040 ceph-mon[32397]: pgmap v6735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:28 smithi146 ceph-mon[35807]: pgmap v6735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:28 smithi076 ceph-mon[35401]: pgmap v6735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:30 smithi040 ceph-mon[32397]: pgmap v6736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:30 smithi146 ceph-mon[35807]: pgmap v6736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:30 smithi076 ceph-mon[35401]: pgmap v6736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8058.191391 secs 2024-07-26T15:47:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8058.191391 secs 2024-07-26T15:47:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8058.191391 secs 2024-07-26T15:47:32.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:32 smithi040 ceph-mon[32397]: pgmap v6737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:32 smithi146 ceph-mon[35807]: pgmap v6737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:32 smithi076 ceph-mon[35401]: pgmap v6737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:34 smithi040 ceph-mon[32397]: pgmap v6738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:34 smithi146 ceph-mon[35807]: pgmap v6738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:34 smithi076 ceph-mon[35401]: pgmap v6738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:36 smithi040 ceph-mon[32397]: pgmap v6739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8063.191521 secs 2024-07-26T15:47:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:36 smithi146 ceph-mon[35807]: pgmap v6739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8063.191521 secs 2024-07-26T15:47:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:36 smithi076 ceph-mon[35401]: pgmap v6739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8063.191521 secs 2024-07-26T15:47:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:38 smithi146 ceph-mon[35807]: pgmap v6740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:38 smithi076 ceph-mon[35401]: pgmap v6740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:38 smithi040 ceph-mon[32397]: pgmap v6740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:40 smithi146 ceph-mon[35807]: pgmap v6741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:40 smithi076 ceph-mon[35401]: pgmap v6741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:40 smithi040 ceph-mon[32397]: pgmap v6741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8068.191658 secs 2024-07-26T15:47:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8068.191658 secs 2024-07-26T15:47:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8068.191658 secs 2024-07-26T15:47:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:42 smithi146 ceph-mon[35807]: pgmap v6742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:42 smithi076 ceph-mon[35401]: pgmap v6742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:42 smithi040 ceph-mon[32397]: pgmap v6742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:44 smithi146 ceph-mon[35807]: pgmap v6743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:44 smithi076 ceph-mon[35401]: pgmap v6743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:44 smithi040 ceph-mon[32397]: pgmap v6743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:46 smithi146 ceph-mon[35807]: pgmap v6744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8073.191787 secs 2024-07-26T15:47:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:46 smithi076 ceph-mon[35401]: pgmap v6744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8073.191787 secs 2024-07-26T15:47:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:46 smithi040 ceph-mon[32397]: pgmap v6744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8073.191787 secs 2024-07-26T15:47:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:48 smithi146 ceph-mon[35807]: pgmap v6745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:48 smithi076 ceph-mon[35401]: pgmap v6745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:48 smithi040 ceph-mon[32397]: pgmap v6745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:50 smithi146 ceph-mon[35807]: pgmap v6746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:50 smithi076 ceph-mon[35401]: pgmap v6746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:50 smithi040 ceph-mon[32397]: pgmap v6746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8078.191928 secs 2024-07-26T15:47:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8078.191928 secs 2024-07-26T15:47:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8078.191928 secs 2024-07-26T15:47:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:52 smithi146 ceph-mon[35807]: pgmap v6747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:52 smithi076 ceph-mon[35401]: pgmap v6747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:52 smithi040 ceph-mon[32397]: pgmap v6747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:54 smithi146 ceph-mon[35807]: pgmap v6748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:54 smithi076 ceph-mon[35401]: pgmap v6748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:55.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:54 smithi040 ceph-mon[32397]: pgmap v6748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:47:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8083.192075 secs 2024-07-26T15:47:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:56 smithi146 ceph-mon[35807]: pgmap v6749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8083.192075 secs 2024-07-26T15:47:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:56 smithi076 ceph-mon[35401]: pgmap v6749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8083.192075 secs 2024-07-26T15:47:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:56 smithi040 ceph-mon[32397]: pgmap v6749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:47:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:47:58 smithi076 ceph-mon[35401]: pgmap v6750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:47:58 smithi040 ceph-mon[32397]: pgmap v6750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:47:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:47:58 smithi146 ceph-mon[35807]: pgmap v6750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:00 smithi076 ceph-mon[35401]: pgmap v6751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:00 smithi040 ceph-mon[32397]: pgmap v6751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:00 smithi146 ceph-mon[35807]: pgmap v6751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8088.192213 secs 2024-07-26T15:48:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8088.192213 secs 2024-07-26T15:48:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8088.192213 secs 2024-07-26T15:48:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:02 smithi040 ceph-mon[32397]: pgmap v6752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:02 smithi146 ceph-mon[35807]: pgmap v6752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:02 smithi076 ceph-mon[35401]: pgmap v6752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:04 smithi040 ceph-mon[32397]: pgmap v6753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:04 smithi146 ceph-mon[35807]: pgmap v6753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:04 smithi076 ceph-mon[35401]: pgmap v6753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8093.192323 secs 2024-07-26T15:48:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:06 smithi040 ceph-mon[32397]: pgmap v6754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8093.192323 secs 2024-07-26T15:48:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:06 smithi146 ceph-mon[35807]: pgmap v6754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8093.192323 secs 2024-07-26T15:48:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:06 smithi076 ceph-mon[35401]: pgmap v6754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:08 smithi040 ceph-mon[32397]: pgmap v6755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:08 smithi146 ceph-mon[35807]: pgmap v6755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:08 smithi076 ceph-mon[35401]: pgmap v6755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:10 smithi040 ceph-mon[32397]: pgmap v6756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:10 smithi146 ceph-mon[35807]: pgmap v6756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:10 smithi076 ceph-mon[35401]: pgmap v6756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8098.192456 secs 2024-07-26T15:48:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8098.192456 secs 2024-07-26T15:48:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8098.192456 secs 2024-07-26T15:48:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:12 smithi040 ceph-mon[32397]: pgmap v6757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:12 smithi146 ceph-mon[35807]: pgmap v6757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:12 smithi076 ceph-mon[35401]: pgmap v6757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:14 smithi040 ceph-mon[32397]: pgmap v6758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:14 smithi146 ceph-mon[35807]: pgmap v6758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:14 smithi076 ceph-mon[35401]: pgmap v6758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8103.192591 secs 2024-07-26T15:48:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:16 smithi040 ceph-mon[32397]: pgmap v6759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8103.192591 secs 2024-07-26T15:48:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:16 smithi146 ceph-mon[35807]: pgmap v6759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8103.192591 secs 2024-07-26T15:48:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:16 smithi076 ceph-mon[35401]: pgmap v6759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:18 smithi040 ceph-mon[32397]: pgmap v6760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:18 smithi146 ceph-mon[35807]: pgmap v6760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:18 smithi076 ceph-mon[35401]: pgmap v6760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:20 smithi040 ceph-mon[32397]: pgmap v6761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:20 smithi146 ceph-mon[35807]: pgmap v6761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:20 smithi076 ceph-mon[35401]: pgmap v6761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:22.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8108.192725 secs 2024-07-26T15:48:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8108.192725 secs 2024-07-26T15:48:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8108.192725 secs 2024-07-26T15:48:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:22 smithi040 ceph-mon[32397]: pgmap v6762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:22 smithi146 ceph-mon[35807]: pgmap v6762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:22 smithi076 ceph-mon[35401]: pgmap v6762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:24 smithi040 ceph-mon[32397]: pgmap v6763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:24 smithi146 ceph-mon[35807]: pgmap v6763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:24 smithi076 ceph-mon[35401]: pgmap v6763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8113.192867 secs 2024-07-26T15:48:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:26 smithi040 ceph-mon[32397]: pgmap v6764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8113.192867 secs 2024-07-26T15:48:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:26 smithi146 ceph-mon[35807]: pgmap v6764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8113.192867 secs 2024-07-26T15:48:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:26 smithi076 ceph-mon[35401]: pgmap v6764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:28 smithi040 ceph-mon[32397]: pgmap v6765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:28 smithi146 ceph-mon[35807]: pgmap v6765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:28 smithi076 ceph-mon[35401]: pgmap v6765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:30 smithi040 ceph-mon[32397]: pgmap v6766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:30 smithi146 ceph-mon[35807]: pgmap v6766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:30 smithi076 ceph-mon[35401]: pgmap v6766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8118.193014 secs 2024-07-26T15:48:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8118.193014 secs 2024-07-26T15:48:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8118.193014 secs 2024-07-26T15:48:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:32 smithi146 ceph-mon[35807]: pgmap v6767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:32 smithi076 ceph-mon[35401]: pgmap v6767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:32 smithi040 ceph-mon[32397]: pgmap v6767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:35.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:34 smithi040 ceph-mon[32397]: pgmap v6768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:34 smithi146 ceph-mon[35807]: pgmap v6768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:34 smithi076 ceph-mon[35401]: pgmap v6768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8123.193158 secs 2024-07-26T15:48:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:36 smithi146 ceph-mon[35807]: pgmap v6769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8123.193158 secs 2024-07-26T15:48:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:36 smithi076 ceph-mon[35401]: pgmap v6769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8123.193158 secs 2024-07-26T15:48:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:36 smithi040 ceph-mon[32397]: pgmap v6769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:39.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:39 smithi146 ceph-mon[35807]: pgmap v6770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:39 smithi076 ceph-mon[35401]: pgmap v6770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:39 smithi040 ceph-mon[32397]: pgmap v6770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:41 smithi146 ceph-mon[35807]: pgmap v6771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:41 smithi076 ceph-mon[35401]: pgmap v6771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:41 smithi040 ceph-mon[32397]: pgmap v6771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8128.193333 secs 2024-07-26T15:48:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8128.193333 secs 2024-07-26T15:48:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8128.193333 secs 2024-07-26T15:48:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:43 smithi146 ceph-mon[35807]: pgmap v6772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:43 smithi076 ceph-mon[35401]: pgmap v6772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:43 smithi040 ceph-mon[32397]: pgmap v6772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:45 smithi146 ceph-mon[35807]: pgmap v6773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:45 smithi076 ceph-mon[35401]: pgmap v6773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:45 smithi040 ceph-mon[32397]: pgmap v6773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:48:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8133.193434 secs 2024-07-26T15:48:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:47 smithi146 ceph-mon[35807]: pgmap v6774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:48:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8133.193434 secs 2024-07-26T15:48:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:47 smithi076 ceph-mon[35401]: pgmap v6774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:48:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8133.193434 secs 2024-07-26T15:48:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:47 smithi040 ceph-mon[32397]: pgmap v6774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:48:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:49 smithi146 ceph-mon[35807]: pgmap v6775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:49 smithi076 ceph-mon[35401]: pgmap v6775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:49 smithi040 ceph-mon[32397]: pgmap v6775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:51 smithi146 ceph-mon[35807]: pgmap v6776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:51 smithi076 ceph-mon[35401]: pgmap v6776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:51 smithi040 ceph-mon[32397]: pgmap v6776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:48:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8138.193572 secs 2024-07-26T15:48:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8138.193572 secs 2024-07-26T15:48:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8138.193572 secs 2024-07-26T15:48:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:53 smithi076 ceph-mon[35401]: pgmap v6777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:53 smithi040 ceph-mon[32397]: pgmap v6777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:53 smithi146 ceph-mon[35807]: pgmap v6777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:55 smithi040 ceph-mon[32397]: pgmap v6778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:55 smithi146 ceph-mon[35807]: pgmap v6778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:55 smithi076 ceph-mon[35401]: pgmap v6778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:48:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8143.193669 secs 2024-07-26T15:48:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:57 smithi040 ceph-mon[32397]: pgmap v6779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:48:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8143.193669 secs 2024-07-26T15:48:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:57 smithi146 ceph-mon[35807]: pgmap v6779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:48:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8143.193669 secs 2024-07-26T15:48:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:57 smithi076 ceph-mon[35401]: pgmap v6779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:48:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:48:59 smithi040 ceph-mon[32397]: pgmap v6780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:48:59 smithi146 ceph-mon[35807]: pgmap v6780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:48:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:48:59 smithi076 ceph-mon[35401]: pgmap v6780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:01 smithi040 ceph-mon[32397]: pgmap v6781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:01 smithi146 ceph-mon[35807]: pgmap v6781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:01 smithi076 ceph-mon[35401]: pgmap v6781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8148.193812 secs 2024-07-26T15:49:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8148.193812 secs 2024-07-26T15:49:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8148.193812 secs 2024-07-26T15:49:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:03 smithi040 ceph-mon[32397]: pgmap v6782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:03 smithi146 ceph-mon[35807]: pgmap v6782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:03 smithi076 ceph-mon[35401]: pgmap v6782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:05 smithi040 ceph-mon[32397]: pgmap v6783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:05 smithi146 ceph-mon[35807]: pgmap v6783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:05 smithi076 ceph-mon[35401]: pgmap v6783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8153.193949 secs 2024-07-26T15:49:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:07 smithi040 ceph-mon[32397]: pgmap v6784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8153.193949 secs 2024-07-26T15:49:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:07 smithi146 ceph-mon[35807]: pgmap v6784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8153.193949 secs 2024-07-26T15:49:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:07 smithi076 ceph-mon[35401]: pgmap v6784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:09.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:09 smithi040 ceph-mon[32397]: pgmap v6785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:09 smithi146 ceph-mon[35807]: pgmap v6785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:09 smithi076 ceph-mon[35401]: pgmap v6785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:11 smithi040 ceph-mon[32397]: pgmap v6786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:11 smithi146 ceph-mon[35807]: pgmap v6786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:11 smithi076 ceph-mon[35401]: pgmap v6786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8158.194110 secs 2024-07-26T15:49:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8158.194110 secs 2024-07-26T15:49:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8158.194110 secs 2024-07-26T15:49:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:13 smithi040 ceph-mon[32397]: pgmap v6787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:13 smithi146 ceph-mon[35807]: pgmap v6787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:13 smithi076 ceph-mon[35401]: pgmap v6787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:15 smithi040 ceph-mon[32397]: pgmap v6788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:15 smithi146 ceph-mon[35807]: pgmap v6788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:15 smithi076 ceph-mon[35401]: pgmap v6788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8163.194204 secs 2024-07-26T15:49:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:17 smithi040 ceph-mon[32397]: pgmap v6789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8163.194204 secs 2024-07-26T15:49:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:17 smithi146 ceph-mon[35807]: pgmap v6789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8163.194204 secs 2024-07-26T15:49:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:17 smithi076 ceph-mon[35401]: pgmap v6789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:19 smithi040 ceph-mon[32397]: pgmap v6790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:19 smithi146 ceph-mon[35807]: pgmap v6790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:19 smithi076 ceph-mon[35401]: pgmap v6790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:21 smithi040 ceph-mon[32397]: pgmap v6791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:21 smithi146 ceph-mon[35807]: pgmap v6791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:21 smithi076 ceph-mon[35401]: pgmap v6791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:22.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8168.194345 secs 2024-07-26T15:49:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8168.194345 secs 2024-07-26T15:49:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8168.194345 secs 2024-07-26T15:49:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:23 smithi040 ceph-mon[32397]: pgmap v6792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:23.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:23 smithi146 ceph-mon[35807]: pgmap v6792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:23 smithi076 ceph-mon[35401]: pgmap v6792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:25 smithi040 ceph-mon[32397]: pgmap v6793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:25 smithi146 ceph-mon[35807]: pgmap v6793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:25.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:25 smithi076 ceph-mon[35401]: pgmap v6793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8173.194493 secs 2024-07-26T15:49:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:27 smithi040 ceph-mon[32397]: pgmap v6794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:49:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8173.194493 secs 2024-07-26T15:49:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:27 smithi146 ceph-mon[35807]: pgmap v6794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:49:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8173.194493 secs 2024-07-26T15:49:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:27 smithi076 ceph-mon[35401]: pgmap v6794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:49:29.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:29 smithi040 ceph-mon[32397]: pgmap v6795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:29 smithi146 ceph-mon[35807]: pgmap v6795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:29 smithi076 ceph-mon[35401]: pgmap v6795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:31 smithi146 ceph-mon[35807]: pgmap v6796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:31 smithi076 ceph-mon[35401]: pgmap v6796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:31 smithi040 ceph-mon[32397]: pgmap v6796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8178.194638 secs 2024-07-26T15:49:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8178.194638 secs 2024-07-26T15:49:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8178.194638 secs 2024-07-26T15:49:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:33 smithi146 ceph-mon[35807]: pgmap v6797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:33 smithi076 ceph-mon[35401]: pgmap v6797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:33 smithi040 ceph-mon[32397]: pgmap v6797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:35.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:35 smithi040 ceph-mon[32397]: pgmap v6798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:35 smithi146 ceph-mon[35807]: pgmap v6798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:35 smithi076 ceph-mon[35401]: pgmap v6798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8183.194778 secs 2024-07-26T15:49:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:37 smithi146 ceph-mon[35807]: pgmap v6799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8183.194778 secs 2024-07-26T15:49:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:37 smithi076 ceph-mon[35401]: pgmap v6799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8183.194778 secs 2024-07-26T15:49:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:37 smithi040 ceph-mon[32397]: pgmap v6799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:39 smithi146 ceph-mon[35807]: pgmap v6800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:39 smithi076 ceph-mon[35401]: pgmap v6800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:39 smithi040 ceph-mon[32397]: pgmap v6800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:40 smithi076 ceph-mon[35401]: pgmap v6801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:40 smithi040 ceph-mon[32397]: pgmap v6801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:40 smithi146 ceph-mon[35807]: pgmap v6801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8188.194916 secs 2024-07-26T15:49:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8188.194916 secs 2024-07-26T15:49:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8188.194916 secs 2024-07-26T15:49:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:42 smithi040 ceph-mon[32397]: pgmap v6802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:42 smithi146 ceph-mon[35807]: pgmap v6802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:42 smithi076 ceph-mon[35401]: pgmap v6802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:44 smithi146 ceph-mon[35807]: pgmap v6803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:44 smithi076 ceph-mon[35401]: pgmap v6803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:45.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:44 smithi040 ceph-mon[32397]: pgmap v6803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8193.195073 secs 2024-07-26T15:49:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:46 smithi146 ceph-mon[35807]: pgmap v6804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8193.195073 secs 2024-07-26T15:49:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:46 smithi076 ceph-mon[35401]: pgmap v6804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8193.195073 secs 2024-07-26T15:49:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:46 smithi040 ceph-mon[32397]: pgmap v6804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:48 smithi146 ceph-mon[35807]: pgmap v6805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:48 smithi076 ceph-mon[35401]: pgmap v6805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:48 smithi040 ceph-mon[32397]: pgmap v6805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:50 smithi146 ceph-mon[35807]: pgmap v6806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:50 smithi076 ceph-mon[35401]: pgmap v6806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:50 smithi040 ceph-mon[32397]: pgmap v6806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8198.195215 secs 2024-07-26T15:49:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8198.195215 secs 2024-07-26T15:49:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8198.195215 secs 2024-07-26T15:49:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:52 smithi146 ceph-mon[35807]: pgmap v6807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:52 smithi076 ceph-mon[35401]: pgmap v6807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:52 smithi040 ceph-mon[32397]: pgmap v6807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:54 smithi146 ceph-mon[35807]: pgmap v6808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:54 smithi076 ceph-mon[35401]: pgmap v6808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:54 smithi040 ceph-mon[32397]: pgmap v6808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:49:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8203.195351 secs 2024-07-26T15:49:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:56 smithi146 ceph-mon[35807]: pgmap v6809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8203.195351 secs 2024-07-26T15:49:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:56 smithi076 ceph-mon[35401]: pgmap v6809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8203.195351 secs 2024-07-26T15:49:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:56 smithi040 ceph-mon[32397]: pgmap v6809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:49:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:49:58 smithi146 ceph-mon[35807]: pgmap v6810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:49:58 smithi076 ceph-mon[35401]: pgmap v6810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:49:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:49:58 smithi040 ceph-mon[32397]: pgmap v6810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:00 smithi146 ceph-mon[35807]: pgmap v6811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:50:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:00 smithi076 ceph-mon[35401]: pgmap v6811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:50:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:00 smithi040 ceph-mon[32397]: pgmap v6811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T15:50:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8208.195494 secs 2024-07-26T15:50:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8208.195494 secs 2024-07-26T15:50:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8208.195494 secs 2024-07-26T15:50:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:02 smithi076 ceph-mon[35401]: pgmap v6812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:03.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:02 smithi040 ceph-mon[32397]: pgmap v6812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:02 smithi146 ceph-mon[35807]: pgmap v6812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:04 smithi076 ceph-mon[35401]: pgmap v6813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:04 smithi040 ceph-mon[32397]: pgmap v6813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:04 smithi146 ceph-mon[35807]: pgmap v6813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8213.195630 secs 2024-07-26T15:50:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:06 smithi040 ceph-mon[32397]: pgmap v6814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8213.195630 secs 2024-07-26T15:50:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:06 smithi146 ceph-mon[35807]: pgmap v6814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8213.195630 secs 2024-07-26T15:50:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:06 smithi076 ceph-mon[35401]: pgmap v6814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:08 smithi040 ceph-mon[32397]: pgmap v6815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:08 smithi146 ceph-mon[35807]: pgmap v6815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:08 smithi076 ceph-mon[35401]: pgmap v6815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:10 smithi040 ceph-mon[32397]: pgmap v6816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:11.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:10 smithi146 ceph-mon[35807]: pgmap v6816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:10 smithi076 ceph-mon[35401]: pgmap v6816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8218.195729 secs 2024-07-26T15:50:12.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8218.195729 secs 2024-07-26T15:50:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8218.195729 secs 2024-07-26T15:50:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:12 smithi040 ceph-mon[32397]: pgmap v6817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:12 smithi146 ceph-mon[35807]: pgmap v6817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:12 smithi076 ceph-mon[35401]: pgmap v6817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:14 smithi076 ceph-mon[35401]: pgmap v6818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:14 smithi040 ceph-mon[32397]: pgmap v6818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:14 smithi146 ceph-mon[35807]: pgmap v6818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8223.195828 secs 2024-07-26T15:50:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:16 smithi040 ceph-mon[32397]: pgmap v6819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8223.195828 secs 2024-07-26T15:50:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:16 smithi146 ceph-mon[35807]: pgmap v6819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8223.195828 secs 2024-07-26T15:50:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:16 smithi076 ceph-mon[35401]: pgmap v6819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:18 smithi040 ceph-mon[32397]: pgmap v6820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:18 smithi146 ceph-mon[35807]: pgmap v6820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:18 smithi076 ceph-mon[35401]: pgmap v6820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:20 smithi040 ceph-mon[32397]: pgmap v6821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:20 smithi146 ceph-mon[35807]: pgmap v6821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:20 smithi076 ceph-mon[35401]: pgmap v6821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:22.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8228.195962 secs 2024-07-26T15:50:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8228.195962 secs 2024-07-26T15:50:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8228.195962 secs 2024-07-26T15:50:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:22 smithi040 ceph-mon[32397]: pgmap v6822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:22 smithi146 ceph-mon[35807]: pgmap v6822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:22 smithi076 ceph-mon[35401]: pgmap v6822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:24 smithi040 ceph-mon[32397]: pgmap v6823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:24 smithi146 ceph-mon[35807]: pgmap v6823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:24 smithi076 ceph-mon[35401]: pgmap v6823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8233.196102 secs 2024-07-26T15:50:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:26 smithi040 ceph-mon[32397]: pgmap v6824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8233.196102 secs 2024-07-26T15:50:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:26 smithi146 ceph-mon[35807]: pgmap v6824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8233.196102 secs 2024-07-26T15:50:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:26 smithi076 ceph-mon[35401]: pgmap v6824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:28 smithi040 ceph-mon[32397]: pgmap v6825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:28 smithi146 ceph-mon[35807]: pgmap v6825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:28 smithi076 ceph-mon[35401]: pgmap v6825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:30 smithi040 ceph-mon[32397]: pgmap v6826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:30 smithi146 ceph-mon[35807]: pgmap v6826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:30 smithi076 ceph-mon[35401]: pgmap v6826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8238.196229 secs 2024-07-26T15:50:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8238.196229 secs 2024-07-26T15:50:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8238.196229 secs 2024-07-26T15:50:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:32 smithi040 ceph-mon[32397]: pgmap v6827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:32 smithi146 ceph-mon[35807]: pgmap v6827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:32 smithi076 ceph-mon[35401]: pgmap v6827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:34 smithi040 ceph-mon[32397]: pgmap v6828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:34 smithi146 ceph-mon[35807]: pgmap v6828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:34 smithi076 ceph-mon[35401]: pgmap v6828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8243.196358 secs 2024-07-26T15:50:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:36 smithi040 ceph-mon[32397]: pgmap v6829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8243.196358 secs 2024-07-26T15:50:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:36 smithi146 ceph-mon[35807]: pgmap v6829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8243.196358 secs 2024-07-26T15:50:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:36 smithi076 ceph-mon[35401]: pgmap v6829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:38 smithi040 ceph-mon[32397]: pgmap v6830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:38 smithi146 ceph-mon[35807]: pgmap v6830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:38 smithi076 ceph-mon[35401]: pgmap v6830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:40 smithi146 ceph-mon[35807]: pgmap v6831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:40 smithi076 ceph-mon[35401]: pgmap v6831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:40 smithi040 ceph-mon[32397]: pgmap v6831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8248.196493 secs 2024-07-26T15:50:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8248.196493 secs 2024-07-26T15:50:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8248.196493 secs 2024-07-26T15:50:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:43 smithi146 ceph-mon[35807]: pgmap v6832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:43 smithi076 ceph-mon[35401]: pgmap v6832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:43 smithi040 ceph-mon[32397]: pgmap v6832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:45 smithi146 ceph-mon[35807]: pgmap v6833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:45 smithi076 ceph-mon[35401]: pgmap v6833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:45 smithi040 ceph-mon[32397]: pgmap v6833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8253.196615 secs 2024-07-26T15:50:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:47 smithi146 ceph-mon[35807]: pgmap v6834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8253.196615 secs 2024-07-26T15:50:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:47 smithi076 ceph-mon[35401]: pgmap v6834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8253.196615 secs 2024-07-26T15:50:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:47 smithi040 ceph-mon[32397]: pgmap v6834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:49 smithi146 ceph-mon[35807]: pgmap v6835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:49 smithi076 ceph-mon[35401]: pgmap v6835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:49 smithi040 ceph-mon[32397]: pgmap v6835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:51 smithi146 ceph-mon[35807]: pgmap v6836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:51 smithi076 ceph-mon[35401]: pgmap v6836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:51 smithi040 ceph-mon[32397]: pgmap v6836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8258.196724 secs 2024-07-26T15:50:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8258.196724 secs 2024-07-26T15:50:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8258.196724 secs 2024-07-26T15:50:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:53 smithi146 ceph-mon[35807]: pgmap v6837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:53 smithi076 ceph-mon[35401]: pgmap v6837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:53 smithi040 ceph-mon[32397]: pgmap v6837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:55.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:55 smithi146 ceph-mon[35807]: pgmap v6838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:55 smithi076 ceph-mon[35401]: pgmap v6838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:55 smithi040 ceph-mon[32397]: pgmap v6838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:50:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8263.196884 secs 2024-07-26T15:50:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:57 smithi146 ceph-mon[35807]: pgmap v6839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8263.196884 secs 2024-07-26T15:50:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:57 smithi076 ceph-mon[35401]: pgmap v6839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8263.196884 secs 2024-07-26T15:50:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:57 smithi040 ceph-mon[32397]: pgmap v6839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:50:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:50:59 smithi076 ceph-mon[35401]: pgmap v6840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:50:59 smithi040 ceph-mon[32397]: pgmap v6840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:50:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:50:59 smithi146 ceph-mon[35807]: pgmap v6840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:01 smithi076 ceph-mon[35401]: pgmap v6841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:01 smithi040 ceph-mon[32397]: pgmap v6841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:01 smithi146 ceph-mon[35807]: pgmap v6841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8268.197035 secs 2024-07-26T15:51:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8268.197035 secs 2024-07-26T15:51:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8268.197035 secs 2024-07-26T15:51:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:03 smithi040 ceph-mon[32397]: pgmap v6842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:03 smithi146 ceph-mon[35807]: pgmap v6842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:03 smithi076 ceph-mon[35401]: pgmap v6842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:05.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:05 smithi040 ceph-mon[32397]: pgmap v6843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:05 smithi146 ceph-mon[35807]: pgmap v6843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:05 smithi076 ceph-mon[35401]: pgmap v6843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8273.197164 secs 2024-07-26T15:51:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:07 smithi040 ceph-mon[32397]: pgmap v6844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8273.197164 secs 2024-07-26T15:51:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:07 smithi146 ceph-mon[35807]: pgmap v6844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8273.197164 secs 2024-07-26T15:51:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:07 smithi076 ceph-mon[35401]: pgmap v6844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:09 smithi040 ceph-mon[32397]: pgmap v6845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:09 smithi146 ceph-mon[35807]: pgmap v6845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:09 smithi076 ceph-mon[35401]: pgmap v6845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:11 smithi040 ceph-mon[32397]: pgmap v6846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:11 smithi146 ceph-mon[35807]: pgmap v6846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:11 smithi076 ceph-mon[35401]: pgmap v6846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8278.197334 secs 2024-07-26T15:51:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8278.197334 secs 2024-07-26T15:51:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8278.197334 secs 2024-07-26T15:51:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:13 smithi040 ceph-mon[32397]: pgmap v6847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:13 smithi146 ceph-mon[35807]: pgmap v6847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:13 smithi076 ceph-mon[35401]: pgmap v6847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:15 smithi040 ceph-mon[32397]: pgmap v6848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:15 smithi146 ceph-mon[35807]: pgmap v6848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:15 smithi076 ceph-mon[35401]: pgmap v6848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8283.197470 secs 2024-07-26T15:51:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:17 smithi040 ceph-mon[32397]: pgmap v6849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8283.197470 secs 2024-07-26T15:51:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:17 smithi146 ceph-mon[35807]: pgmap v6849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8283.197470 secs 2024-07-26T15:51:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:17 smithi076 ceph-mon[35401]: pgmap v6849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:19.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:19 smithi040 ceph-mon[32397]: pgmap v6850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:19 smithi146 ceph-mon[35807]: pgmap v6850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:19 smithi076 ceph-mon[35401]: pgmap v6850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:21.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:21 smithi040 ceph-mon[32397]: pgmap v6851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:21 smithi146 ceph-mon[35807]: pgmap v6851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:21 smithi076 ceph-mon[35401]: pgmap v6851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:22.472 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8288.197618 secs 2024-07-26T15:51:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8288.197618 secs 2024-07-26T15:51:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8288.197618 secs 2024-07-26T15:51:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:23 smithi040 ceph-mon[32397]: pgmap v6852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:23 smithi146 ceph-mon[35807]: pgmap v6852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:23 smithi076 ceph-mon[35401]: pgmap v6852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:25 smithi040 ceph-mon[32397]: pgmap v6853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:25 smithi146 ceph-mon[35807]: pgmap v6853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:25 smithi076 ceph-mon[35401]: pgmap v6853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8293.197765 secs 2024-07-26T15:51:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:27 smithi040 ceph-mon[32397]: pgmap v6854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8293.197765 secs 2024-07-26T15:51:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:27 smithi146 ceph-mon[35807]: pgmap v6854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8293.197765 secs 2024-07-26T15:51:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:27 smithi076 ceph-mon[35401]: pgmap v6854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:29 smithi040 ceph-mon[32397]: pgmap v6855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:29.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:29 smithi146 ceph-mon[35807]: pgmap v6855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:29 smithi076 ceph-mon[35401]: pgmap v6855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:31 smithi040 ceph-mon[32397]: pgmap v6856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:31.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:31 smithi146 ceph-mon[35807]: pgmap v6856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:31 smithi076 ceph-mon[35401]: pgmap v6856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8298.197911 secs 2024-07-26T15:51:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8298.197911 secs 2024-07-26T15:51:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8298.197911 secs 2024-07-26T15:51:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:33 smithi040 ceph-mon[32397]: pgmap v6857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:33.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:33 smithi146 ceph-mon[35807]: pgmap v6857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:33 smithi076 ceph-mon[35401]: pgmap v6857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:35 smithi146 ceph-mon[35807]: pgmap v6858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:35 smithi076 ceph-mon[35401]: pgmap v6858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:35.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:35 smithi040 ceph-mon[32397]: pgmap v6858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8303.198052 secs 2024-07-26T15:51:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:37 smithi146 ceph-mon[35807]: pgmap v6859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8303.198052 secs 2024-07-26T15:51:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:37 smithi076 ceph-mon[35401]: pgmap v6859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:37.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8303.198052 secs 2024-07-26T15:51:37.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:37 smithi040 ceph-mon[32397]: pgmap v6859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:39 smithi146 ceph-mon[35807]: pgmap v6860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:39 smithi076 ceph-mon[35401]: pgmap v6860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:39.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:39 smithi040 ceph-mon[32397]: pgmap v6860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:41 smithi146 ceph-mon[35807]: pgmap v6861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:41 smithi076 ceph-mon[35401]: pgmap v6861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:41 smithi040 ceph-mon[32397]: pgmap v6861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8308.198217 secs 2024-07-26T15:51:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8308.198217 secs 2024-07-26T15:51:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8308.198217 secs 2024-07-26T15:51:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:43 smithi146 ceph-mon[35807]: pgmap v6862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:43 smithi076 ceph-mon[35401]: pgmap v6862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:43.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:43 smithi040 ceph-mon[32397]: pgmap v6862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:45 smithi146 ceph-mon[35807]: pgmap v6863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:45 smithi076 ceph-mon[35401]: pgmap v6863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:45 smithi040 ceph-mon[32397]: pgmap v6863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8313.198381 secs 2024-07-26T15:51:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:47 smithi146 ceph-mon[35807]: pgmap v6864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8313.198381 secs 2024-07-26T15:51:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:47 smithi076 ceph-mon[35401]: pgmap v6864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8313.198381 secs 2024-07-26T15:51:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:47 smithi040 ceph-mon[32397]: pgmap v6864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:49 smithi146 ceph-mon[35807]: pgmap v6865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:49 smithi076 ceph-mon[35401]: pgmap v6865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:49 smithi040 ceph-mon[32397]: pgmap v6865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:51 smithi146 ceph-mon[35807]: pgmap v6866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:51 smithi076 ceph-mon[35401]: pgmap v6866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:51 smithi040 ceph-mon[32397]: pgmap v6866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:52.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8318.198523 secs 2024-07-26T15:51:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8318.198523 secs 2024-07-26T15:51:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8318.198523 secs 2024-07-26T15:51:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:53 smithi076 ceph-mon[35401]: pgmap v6867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:53 smithi040 ceph-mon[32397]: pgmap v6867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:53 smithi146 ceph-mon[35807]: pgmap v6867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:54 smithi040 ceph-mon[32397]: pgmap v6868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:54.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:54 smithi146 ceph-mon[35807]: pgmap v6868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:54 smithi076 ceph-mon[35401]: pgmap v6868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:51:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8323.198661 secs 2024-07-26T15:51:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:56 smithi076 ceph-mon[35401]: pgmap v6869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8323.198661 secs 2024-07-26T15:51:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:56 smithi040 ceph-mon[32397]: pgmap v6869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8323.198661 secs 2024-07-26T15:51:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:56 smithi146 ceph-mon[35807]: pgmap v6869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:51:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:51:58 smithi040 ceph-mon[32397]: pgmap v6870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:59.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:51:58 smithi146 ceph-mon[35807]: pgmap v6870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:51:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:51:58 smithi076 ceph-mon[35401]: pgmap v6870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:00 smithi040 ceph-mon[32397]: pgmap v6871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:00 smithi146 ceph-mon[35807]: pgmap v6871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:00 smithi076 ceph-mon[35401]: pgmap v6871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8328.198808 secs 2024-07-26T15:52:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8328.198808 secs 2024-07-26T15:52:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8328.198808 secs 2024-07-26T15:52:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:02 smithi040 ceph-mon[32397]: pgmap v6872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:02 smithi146 ceph-mon[35807]: pgmap v6872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:02 smithi076 ceph-mon[35401]: pgmap v6872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:04 smithi040 ceph-mon[32397]: pgmap v6873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:04 smithi146 ceph-mon[35807]: pgmap v6873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:04 smithi076 ceph-mon[35401]: pgmap v6873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:07.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8333.198940 secs 2024-07-26T15:52:07.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:06 smithi040 ceph-mon[32397]: pgmap v6874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8333.198940 secs 2024-07-26T15:52:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:06 smithi146 ceph-mon[35807]: pgmap v6874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8333.198940 secs 2024-07-26T15:52:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:06 smithi076 ceph-mon[35401]: pgmap v6874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:08 smithi040 ceph-mon[32397]: pgmap v6875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:08 smithi146 ceph-mon[35807]: pgmap v6875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:08 smithi076 ceph-mon[35401]: pgmap v6875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:10 smithi040 ceph-mon[32397]: pgmap v6876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:10 smithi146 ceph-mon[35807]: pgmap v6876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:10 smithi076 ceph-mon[35401]: pgmap v6876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8338.199119 secs 2024-07-26T15:52:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8338.199119 secs 2024-07-26T15:52:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8338.199119 secs 2024-07-26T15:52:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:12 smithi040 ceph-mon[32397]: pgmap v6877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:12 smithi146 ceph-mon[35807]: pgmap v6877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:12 smithi076 ceph-mon[35401]: pgmap v6877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:14 smithi040 ceph-mon[32397]: pgmap v6878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:14 smithi146 ceph-mon[35807]: pgmap v6878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:14 smithi076 ceph-mon[35401]: pgmap v6878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8343.199294 secs 2024-07-26T15:52:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:16 smithi040 ceph-mon[32397]: pgmap v6879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8343.199294 secs 2024-07-26T15:52:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:16 smithi146 ceph-mon[35807]: pgmap v6879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8343.199294 secs 2024-07-26T15:52:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:16 smithi076 ceph-mon[35401]: pgmap v6879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:19.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:18 smithi040 ceph-mon[32397]: pgmap v6880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:18 smithi146 ceph-mon[35807]: pgmap v6880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:18 smithi076 ceph-mon[35401]: pgmap v6880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:20 smithi040 ceph-mon[32397]: pgmap v6881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:20 smithi146 ceph-mon[35807]: pgmap v6881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:20 smithi076 ceph-mon[35401]: pgmap v6881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:22.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8348.199430 secs 2024-07-26T15:52:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8348.199430 secs 2024-07-26T15:52:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8348.199430 secs 2024-07-26T15:52:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:22 smithi040 ceph-mon[32397]: pgmap v6882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:22 smithi146 ceph-mon[35807]: pgmap v6882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:22 smithi076 ceph-mon[35401]: pgmap v6882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:24 smithi040 ceph-mon[32397]: pgmap v6883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:24 smithi146 ceph-mon[35807]: pgmap v6883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:24 smithi076 ceph-mon[35401]: pgmap v6883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8353.199572 secs 2024-07-26T15:52:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:26 smithi040 ceph-mon[32397]: pgmap v6884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8353.199572 secs 2024-07-26T15:52:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:26 smithi146 ceph-mon[35807]: pgmap v6884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8353.199572 secs 2024-07-26T15:52:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:26 smithi076 ceph-mon[35401]: pgmap v6884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:28 smithi040 ceph-mon[32397]: pgmap v6885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:28 smithi146 ceph-mon[35807]: pgmap v6885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:28 smithi076 ceph-mon[35401]: pgmap v6885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:30 smithi146 ceph-mon[35807]: pgmap v6886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:30 smithi076 ceph-mon[35401]: pgmap v6886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:30 smithi040 ceph-mon[32397]: pgmap v6886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8358.199720 secs 2024-07-26T15:52:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8358.199720 secs 2024-07-26T15:52:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8358.199720 secs 2024-07-26T15:52:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:33 smithi146 ceph-mon[35807]: pgmap v6887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:33 smithi076 ceph-mon[35401]: pgmap v6887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:33 smithi040 ceph-mon[32397]: pgmap v6887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:35.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:35 smithi040 ceph-mon[32397]: pgmap v6888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:35 smithi146 ceph-mon[35807]: pgmap v6888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:35 smithi076 ceph-mon[35401]: pgmap v6888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8363.199862 secs 2024-07-26T15:52:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:37 smithi146 ceph-mon[35807]: pgmap v6889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8363.199862 secs 2024-07-26T15:52:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:37 smithi076 ceph-mon[35401]: pgmap v6889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8363.199862 secs 2024-07-26T15:52:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:37 smithi040 ceph-mon[32397]: pgmap v6889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:39 smithi146 ceph-mon[35807]: pgmap v6890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:39 smithi076 ceph-mon[35401]: pgmap v6890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:39 smithi040 ceph-mon[32397]: pgmap v6890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:41 smithi146 ceph-mon[35807]: pgmap v6891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:41 smithi076 ceph-mon[35401]: pgmap v6891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:41 smithi040 ceph-mon[32397]: pgmap v6891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8368.200006 secs 2024-07-26T15:52:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8368.200006 secs 2024-07-26T15:52:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8368.200006 secs 2024-07-26T15:52:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:43 smithi146 ceph-mon[35807]: pgmap v6892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:43 smithi076 ceph-mon[35401]: pgmap v6892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:43 smithi040 ceph-mon[32397]: pgmap v6892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:45 smithi146 ceph-mon[35807]: pgmap v6893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:45 smithi076 ceph-mon[35401]: pgmap v6893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:45 smithi040 ceph-mon[32397]: pgmap v6893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8373.200146 secs 2024-07-26T15:52:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:47 smithi146 ceph-mon[35807]: pgmap v6894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8373.200146 secs 2024-07-26T15:52:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:47 smithi076 ceph-mon[35401]: pgmap v6894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8373.200146 secs 2024-07-26T15:52:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:47 smithi040 ceph-mon[32397]: pgmap v6894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:49 smithi076 ceph-mon[35401]: pgmap v6895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:49 smithi040 ceph-mon[32397]: pgmap v6895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:49 smithi146 ceph-mon[35807]: pgmap v6895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:51 smithi076 ceph-mon[35401]: pgmap v6896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:51.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:51 smithi040 ceph-mon[32397]: pgmap v6896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:51.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:51 smithi146 ceph-mon[35807]: pgmap v6896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:52.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8378.200323 secs 2024-07-26T15:52:52.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8378.200323 secs 2024-07-26T15:52:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8378.200323 secs 2024-07-26T15:52:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:53 smithi040 ceph-mon[32397]: pgmap v6897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:53 smithi146 ceph-mon[35807]: pgmap v6897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:53 smithi076 ceph-mon[35401]: pgmap v6897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:55 smithi040 ceph-mon[32397]: pgmap v6898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:55 smithi146 ceph-mon[35807]: pgmap v6898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:55 smithi076 ceph-mon[35401]: pgmap v6898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:52:57.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8383.200458 secs 2024-07-26T15:52:57.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:57 smithi076 ceph-mon[35401]: pgmap v6899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8383.200458 secs 2024-07-26T15:52:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:57 smithi040 ceph-mon[32397]: pgmap v6899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8383.200458 secs 2024-07-26T15:52:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:57 smithi146 ceph-mon[35807]: pgmap v6899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:52:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:52:59 smithi040 ceph-mon[32397]: pgmap v6900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:52:59 smithi146 ceph-mon[35807]: pgmap v6900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:52:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:52:59 smithi076 ceph-mon[35401]: pgmap v6900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:01 smithi040 ceph-mon[32397]: pgmap v6901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:01.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:01 smithi146 ceph-mon[35807]: pgmap v6901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:01 smithi076 ceph-mon[35401]: pgmap v6901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8388.200601 secs 2024-07-26T15:53:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8388.200601 secs 2024-07-26T15:53:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8388.200601 secs 2024-07-26T15:53:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:03 smithi040 ceph-mon[32397]: pgmap v6902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:03 smithi146 ceph-mon[35807]: pgmap v6902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:03 smithi076 ceph-mon[35401]: pgmap v6902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:05 smithi040 ceph-mon[32397]: pgmap v6903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:05 smithi146 ceph-mon[35807]: pgmap v6903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:05 smithi076 ceph-mon[35401]: pgmap v6903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8393.200743 secs 2024-07-26T15:53:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:07 smithi040 ceph-mon[32397]: pgmap v6904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8393.200743 secs 2024-07-26T15:53:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:07 smithi146 ceph-mon[35807]: pgmap v6904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8393.200743 secs 2024-07-26T15:53:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:07 smithi076 ceph-mon[35401]: pgmap v6904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:09 smithi040 ceph-mon[32397]: pgmap v6905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:09.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:09 smithi146 ceph-mon[35807]: pgmap v6905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:09 smithi076 ceph-mon[35401]: pgmap v6905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:11 smithi040 ceph-mon[32397]: pgmap v6906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:11 smithi146 ceph-mon[35807]: pgmap v6906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:11 smithi076 ceph-mon[35401]: pgmap v6906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8398.200888 secs 2024-07-26T15:53:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8398.200888 secs 2024-07-26T15:53:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8398.200888 secs 2024-07-26T15:53:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:13 smithi040 ceph-mon[32397]: pgmap v6907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:13 smithi146 ceph-mon[35807]: pgmap v6907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:13 smithi076 ceph-mon[35401]: pgmap v6907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:15 smithi040 ceph-mon[32397]: pgmap v6908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:15.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:15 smithi146 ceph-mon[35807]: pgmap v6908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:15 smithi076 ceph-mon[35401]: pgmap v6908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8403.201043 secs 2024-07-26T15:53:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:17 smithi040 ceph-mon[32397]: pgmap v6909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8403.201043 secs 2024-07-26T15:53:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:17 smithi146 ceph-mon[35807]: pgmap v6909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8403.201043 secs 2024-07-26T15:53:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:17 smithi076 ceph-mon[35401]: pgmap v6909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:19 smithi040 ceph-mon[32397]: pgmap v6910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:19 smithi146 ceph-mon[35807]: pgmap v6910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:19 smithi076 ceph-mon[35401]: pgmap v6910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:21 smithi040 ceph-mon[32397]: pgmap v6911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:21.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:21 smithi146 ceph-mon[35807]: pgmap v6911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:21 smithi076 ceph-mon[35401]: pgmap v6911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:22.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8408.201182 secs 2024-07-26T15:53:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8408.201182 secs 2024-07-26T15:53:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8408.201182 secs 2024-07-26T15:53:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:23 smithi146 ceph-mon[35807]: pgmap v6912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:23 smithi076 ceph-mon[35401]: pgmap v6912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:23 smithi040 ceph-mon[32397]: pgmap v6912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:25.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:25 smithi146 ceph-mon[35807]: pgmap v6913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:25 smithi076 ceph-mon[35401]: pgmap v6913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:25.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:25 smithi040 ceph-mon[32397]: pgmap v6913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8413.201336 secs 2024-07-26T15:53:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:27 smithi146 ceph-mon[35807]: pgmap v6914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8413.201336 secs 2024-07-26T15:53:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:27 smithi076 ceph-mon[35401]: pgmap v6914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8413.201336 secs 2024-07-26T15:53:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:27 smithi040 ceph-mon[32397]: pgmap v6914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:29 smithi146 ceph-mon[35807]: pgmap v6915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:29 smithi076 ceph-mon[35401]: pgmap v6915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:29.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:29 smithi040 ceph-mon[32397]: pgmap v6915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:31 smithi146 ceph-mon[35807]: pgmap v6916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:31 smithi076 ceph-mon[35401]: pgmap v6916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:31 smithi040 ceph-mon[32397]: pgmap v6916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:32.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8418.201474 secs 2024-07-26T15:53:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8418.201474 secs 2024-07-26T15:53:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8418.201474 secs 2024-07-26T15:53:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:33 smithi146 ceph-mon[35807]: pgmap v6917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:33 smithi076 ceph-mon[35401]: pgmap v6917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:33 smithi040 ceph-mon[32397]: pgmap v6917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:35.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:35 smithi040 ceph-mon[32397]: pgmap v6918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:35.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:35 smithi146 ceph-mon[35807]: pgmap v6918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:35 smithi076 ceph-mon[35401]: pgmap v6918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8423.201613 secs 2024-07-26T15:53:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:37 smithi146 ceph-mon[35807]: pgmap v6919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8423.201613 secs 2024-07-26T15:53:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:37 smithi076 ceph-mon[35401]: pgmap v6919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8423.201613 secs 2024-07-26T15:53:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:37 smithi040 ceph-mon[32397]: pgmap v6919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:39 smithi146 ceph-mon[35807]: pgmap v6920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:39 smithi076 ceph-mon[35401]: pgmap v6920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:39 smithi040 ceph-mon[32397]: pgmap v6920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:41 smithi146 ceph-mon[35807]: pgmap v6921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:41 smithi076 ceph-mon[35401]: pgmap v6921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:41 smithi040 ceph-mon[32397]: pgmap v6921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:42.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8428.201749 secs 2024-07-26T15:53:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8428.201749 secs 2024-07-26T15:53:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8428.201749 secs 2024-07-26T15:53:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:43 smithi076 ceph-mon[35401]: pgmap v6922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:43 smithi040 ceph-mon[32397]: pgmap v6922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:43 smithi146 ceph-mon[35807]: pgmap v6922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:45 smithi076 ceph-mon[35401]: pgmap v6923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:45 smithi040 ceph-mon[32397]: pgmap v6923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:45 smithi146 ceph-mon[35807]: pgmap v6923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:46 smithi040 ceph-mon[32397]: pgmap v6924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:46 smithi146 ceph-mon[35807]: pgmap v6924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:46 smithi076 ceph-mon[35401]: pgmap v6924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8433.201910 secs 2024-07-26T15:53:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8433.201910 secs 2024-07-26T15:53:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8433.201910 secs 2024-07-26T15:53:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:48 smithi040 ceph-mon[32397]: pgmap v6925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:48 smithi146 ceph-mon[35807]: pgmap v6925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:48 smithi076 ceph-mon[35401]: pgmap v6925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:50 smithi040 ceph-mon[32397]: pgmap v6926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:50 smithi146 ceph-mon[35807]: pgmap v6926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:50 smithi076 ceph-mon[35401]: pgmap v6926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:52.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8438.202063 secs 2024-07-26T15:53:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8438.202063 secs 2024-07-26T15:53:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8438.202063 secs 2024-07-26T15:53:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:52 smithi040 ceph-mon[32397]: pgmap v6927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:52 smithi146 ceph-mon[35807]: pgmap v6927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:52 smithi076 ceph-mon[35401]: pgmap v6927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:54 smithi040 ceph-mon[32397]: pgmap v6928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:54 smithi146 ceph-mon[35807]: pgmap v6928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:54 smithi076 ceph-mon[35401]: pgmap v6928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:53:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8443.202202 secs 2024-07-26T15:53:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:56 smithi040 ceph-mon[32397]: pgmap v6929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8443.202202 secs 2024-07-26T15:53:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:56 smithi146 ceph-mon[35807]: pgmap v6929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8443.202202 secs 2024-07-26T15:53:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:56 smithi076 ceph-mon[35401]: pgmap v6929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:53:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:53:58 smithi040 ceph-mon[32397]: pgmap v6930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:53:58 smithi146 ceph-mon[35807]: pgmap v6930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:53:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:53:58 smithi076 ceph-mon[35401]: pgmap v6930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:00 smithi040 ceph-mon[32397]: pgmap v6931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:00 smithi146 ceph-mon[35807]: pgmap v6931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:00 smithi076 ceph-mon[35401]: pgmap v6931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8448.202344 secs 2024-07-26T15:54:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8448.202344 secs 2024-07-26T15:54:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8448.202344 secs 2024-07-26T15:54:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:02 smithi040 ceph-mon[32397]: pgmap v6932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:02 smithi146 ceph-mon[35807]: pgmap v6932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:02 smithi076 ceph-mon[35401]: pgmap v6932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:04 smithi040 ceph-mon[32397]: pgmap v6933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:04 smithi146 ceph-mon[35807]: pgmap v6933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:04 smithi076 ceph-mon[35401]: pgmap v6933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8453.202474 secs 2024-07-26T15:54:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:06 smithi040 ceph-mon[32397]: pgmap v6934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:54:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8453.202474 secs 2024-07-26T15:54:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:06 smithi146 ceph-mon[35807]: pgmap v6934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:54:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8453.202474 secs 2024-07-26T15:54:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:06 smithi076 ceph-mon[35401]: pgmap v6934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:54:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:08 smithi146 ceph-mon[35807]: pgmap v6935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:08 smithi076 ceph-mon[35401]: pgmap v6935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:08 smithi040 ceph-mon[32397]: pgmap v6935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:54:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:10 smithi146 ceph-mon[35807]: pgmap v6936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:10 smithi076 ceph-mon[35401]: pgmap v6936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:10 smithi040 ceph-mon[32397]: pgmap v6936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8458.202610 secs 2024-07-26T15:54:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8458.202610 secs 2024-07-26T15:54:12.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8458.202610 secs 2024-07-26T15:54:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:13 smithi146 ceph-mon[35807]: pgmap v6937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:13 smithi076 ceph-mon[35401]: pgmap v6937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:13 smithi040 ceph-mon[32397]: pgmap v6937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:14 smithi040 ceph-mon[32397]: pgmap v6938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:14.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:14 smithi146 ceph-mon[35807]: pgmap v6938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:14 smithi076 ceph-mon[35401]: pgmap v6938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8463.202748 secs 2024-07-26T15:54:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:16 smithi040 ceph-mon[32397]: pgmap v6939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8463.202748 secs 2024-07-26T15:54:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:16 smithi146 ceph-mon[35807]: pgmap v6939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8463.202748 secs 2024-07-26T15:54:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:16 smithi076 ceph-mon[35401]: pgmap v6939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:18 smithi040 ceph-mon[32397]: pgmap v6940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:18 smithi146 ceph-mon[35807]: pgmap v6940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:18 smithi076 ceph-mon[35401]: pgmap v6940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:20 smithi040 ceph-mon[32397]: pgmap v6941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:20 smithi146 ceph-mon[35807]: pgmap v6941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:20 smithi076 ceph-mon[35401]: pgmap v6941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:22.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8468.202889 secs 2024-07-26T15:54:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8468.202889 secs 2024-07-26T15:54:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8468.202889 secs 2024-07-26T15:54:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:22 smithi040 ceph-mon[32397]: pgmap v6942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:22 smithi146 ceph-mon[35807]: pgmap v6942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:22 smithi076 ceph-mon[35401]: pgmap v6942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: pgmap v6943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:54:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:24 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:54:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: pgmap v6943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:54:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:54:25.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:24 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:54:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: pgmap v6943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:54:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T15:54:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T15:54:25.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:24 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:54:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:25 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:54:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:25 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:54:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:25 smithi040 ceph-mon[32397]: pgmap v6944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T15:54:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:25 smithi040 ceph-mon[32397]: pgmap v6945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:54:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:25 smithi040 ceph-mon[32397]: pgmap v6946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-07-26T15:54:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:25 smithi040 ceph-mon[32397]: pgmap v6947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:25 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:25 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:25 smithi146 ceph-mon[35807]: pgmap v6944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T15:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:25 smithi146 ceph-mon[35807]: pgmap v6945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:25 smithi146 ceph-mon[35807]: pgmap v6946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-07-26T15:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:25 smithi146 ceph-mon[35807]: pgmap v6947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:25 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T15:54:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:25 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T15:54:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:25 smithi076 ceph-mon[35401]: pgmap v6944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T15:54:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:25 smithi076 ceph-mon[35401]: pgmap v6945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T15:54:26.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:25 smithi076 ceph-mon[35401]: pgmap v6946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-07-26T15:54:26.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:25 smithi076 ceph-mon[35401]: pgmap v6947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:27.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8473.203046 secs 2024-07-26T15:54:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8473.203046 secs 2024-07-26T15:54:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8473.203046 secs 2024-07-26T15:54:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:27 smithi146 ceph-mon[35807]: pgmap v6948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:27 smithi076 ceph-mon[35401]: pgmap v6948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:28.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:27 smithi040 ceph-mon[32397]: pgmap v6948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:29 smithi146 ceph-mon[35807]: pgmap v6949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:29 smithi076 ceph-mon[35401]: pgmap v6949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:29 smithi040 ceph-mon[32397]: pgmap v6949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T15:54:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8478.203161 secs 2024-07-26T15:54:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:32 smithi146 ceph-mon[35807]: pgmap v6950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8478.203161 secs 2024-07-26T15:54:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:32 smithi076 ceph-mon[35401]: pgmap v6950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8478.203161 secs 2024-07-26T15:54:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:32 smithi040 ceph-mon[32397]: pgmap v6950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:34 smithi146 ceph-mon[35807]: pgmap v6951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T15:54:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:34 smithi076 ceph-mon[35401]: pgmap v6951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T15:54:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:34 smithi040 ceph-mon[32397]: pgmap v6951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T15:54:36.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:36 smithi040 ceph-mon[32397]: pgmap v6952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:54:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:36 smithi146 ceph-mon[35807]: pgmap v6952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:54:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:36 smithi076 ceph-mon[35401]: pgmap v6952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T15:54:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8483.203331 secs 2024-07-26T15:54:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8483.203331 secs 2024-07-26T15:54:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8483.203331 secs 2024-07-26T15:54:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:38 smithi146 ceph-mon[35807]: pgmap v6953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:38 smithi076 ceph-mon[35401]: pgmap v6953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:38 smithi040 ceph-mon[32397]: pgmap v6953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:40 smithi146 ceph-mon[35807]: pgmap v6954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:40 smithi076 ceph-mon[35401]: pgmap v6954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:40 smithi040 ceph-mon[32397]: pgmap v6954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8488.203496 secs 2024-07-26T15:54:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:42 smithi146 ceph-mon[35807]: pgmap v6955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:54:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8488.203496 secs 2024-07-26T15:54:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:42 smithi076 ceph-mon[35401]: pgmap v6955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:54:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8488.203496 secs 2024-07-26T15:54:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:42 smithi040 ceph-mon[32397]: pgmap v6955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:54:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:44 smithi146 ceph-mon[35807]: pgmap v6956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:44 smithi076 ceph-mon[35401]: pgmap v6956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:44 smithi040 ceph-mon[32397]: pgmap v6956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:46 smithi146 ceph-mon[35807]: pgmap v6957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:46 smithi076 ceph-mon[35401]: pgmap v6957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:46 smithi040 ceph-mon[32397]: pgmap v6957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8493.203635 secs 2024-07-26T15:54:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8493.203635 secs 2024-07-26T15:54:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8493.203635 secs 2024-07-26T15:54:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:48 smithi076 ceph-mon[35401]: pgmap v6958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:48 smithi040 ceph-mon[32397]: pgmap v6958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:48 smithi146 ceph-mon[35807]: pgmap v6958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:50 smithi040 ceph-mon[32397]: pgmap v6959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:50 smithi146 ceph-mon[35807]: pgmap v6959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:50 smithi076 ceph-mon[35401]: pgmap v6959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:54:52.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8498.203782 secs 2024-07-26T15:54:52.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:52 smithi146 ceph-mon[35807]: pgmap v6960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8498.203782 secs 2024-07-26T15:54:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:52 smithi040 ceph-mon[32397]: pgmap v6960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8498.203782 secs 2024-07-26T15:54:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:52 smithi076 ceph-mon[35401]: pgmap v6960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:54 smithi040 ceph-mon[32397]: pgmap v6961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:54 smithi146 ceph-mon[35807]: pgmap v6961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:54 smithi076 ceph-mon[35401]: pgmap v6961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:56 smithi040 ceph-mon[32397]: pgmap v6962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:56 smithi146 ceph-mon[35807]: pgmap v6962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:56 smithi076 ceph-mon[35401]: pgmap v6962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:54:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8503.203935 secs 2024-07-26T15:54:57.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8503.203935 secs 2024-07-26T15:54:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8503.203935 secs 2024-07-26T15:54:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:54:58 smithi040 ceph-mon[32397]: pgmap v6963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:54:58 smithi146 ceph-mon[35807]: pgmap v6963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:54:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:54:58 smithi076 ceph-mon[35401]: pgmap v6963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:00 smithi040 ceph-mon[32397]: pgmap v6964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:00 smithi146 ceph-mon[35807]: pgmap v6964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:00 smithi076 ceph-mon[35401]: pgmap v6964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8508.204077 secs 2024-07-26T15:55:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:02 smithi040 ceph-mon[32397]: pgmap v6965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:02.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8508.204077 secs 2024-07-26T15:55:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:02 smithi146 ceph-mon[35807]: pgmap v6965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8508.204077 secs 2024-07-26T15:55:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:02 smithi076 ceph-mon[35401]: pgmap v6965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:04 smithi040 ceph-mon[32397]: pgmap v6966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:04 smithi146 ceph-mon[35807]: pgmap v6966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:04 smithi076 ceph-mon[35401]: pgmap v6966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:06 smithi040 ceph-mon[32397]: pgmap v6967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:06 smithi146 ceph-mon[35807]: pgmap v6967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:06 smithi076 ceph-mon[35401]: pgmap v6967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8513.204228 secs 2024-07-26T15:55:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8513.204228 secs 2024-07-26T15:55:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8513.204228 secs 2024-07-26T15:55:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:08 smithi040 ceph-mon[32397]: pgmap v6968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:08.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:08 smithi146 ceph-mon[35807]: pgmap v6968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:08 smithi076 ceph-mon[35401]: pgmap v6968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:09 smithi146 ceph-mon[35807]: pgmap v6969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:09 smithi076 ceph-mon[35401]: pgmap v6969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:09 smithi040 ceph-mon[32397]: pgmap v6969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8518.204370 secs 2024-07-26T15:55:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:11 smithi146 ceph-mon[35807]: pgmap v6970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8518.204370 secs 2024-07-26T15:55:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:11 smithi076 ceph-mon[35401]: pgmap v6970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8518.204370 secs 2024-07-26T15:55:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:11 smithi040 ceph-mon[32397]: pgmap v6970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:13 smithi146 ceph-mon[35807]: pgmap v6971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:13 smithi076 ceph-mon[35401]: pgmap v6971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:14.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:13 smithi040 ceph-mon[32397]: pgmap v6971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:15 smithi146 ceph-mon[35807]: pgmap v6972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:15 smithi076 ceph-mon[35401]: pgmap v6972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:15 smithi040 ceph-mon[32397]: pgmap v6972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8523.204770 secs 2024-07-26T15:55:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8523.204770 secs 2024-07-26T15:55:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8523.204770 secs 2024-07-26T15:55:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:17 smithi146 ceph-mon[35807]: pgmap v6973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:17 smithi076 ceph-mon[35401]: pgmap v6973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:17 smithi040 ceph-mon[32397]: pgmap v6973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:20.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:19 smithi146 ceph-mon[35807]: pgmap v6974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:19 smithi076 ceph-mon[35401]: pgmap v6974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:19 smithi040 ceph-mon[32397]: pgmap v6974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8528.204947 secs 2024-07-26T15:55:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:21 smithi146 ceph-mon[35807]: pgmap v6975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8528.204947 secs 2024-07-26T15:55:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:21 smithi076 ceph-mon[35401]: pgmap v6975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8528.204947 secs 2024-07-26T15:55:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:21 smithi040 ceph-mon[32397]: pgmap v6975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:23 smithi076 ceph-mon[35401]: pgmap v6976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:23 smithi040 ceph-mon[32397]: pgmap v6976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:23 smithi146 ceph-mon[35807]: pgmap v6976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: pgmap v6977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:55:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:25 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: pgmap v6977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:25 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: pgmap v6977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:26.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:25 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8533.205055 secs 2024-07-26T15:55:27.161 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8533.205055 secs 2024-07-26T15:55:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8533.205055 secs 2024-07-26T15:55:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:27 smithi076 ceph-mon[35401]: pgmap v6978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:27 smithi040 ceph-mon[32397]: pgmap v6978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:27 smithi146 ceph-mon[35807]: pgmap v6978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: pgmap v6979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: pgmap v6979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: pgmap v6979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8538.205206 secs 2024-07-26T15:55:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: pgmap v6980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:55:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:55:32.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:31 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:55:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8538.205206 secs 2024-07-26T15:55:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: pgmap v6980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:55:32.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.324 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:55:32.324 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:31 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:55:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8538.205206 secs 2024-07-26T15:55:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: pgmap v6980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T15:55:32.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T15:55:32.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T15:55:32.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:31 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T15:55:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:33 smithi040 ceph-mon[32397]: pgmap v6981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:33 smithi146 ceph-mon[35807]: pgmap v6981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:33 smithi076 ceph-mon[35401]: pgmap v6981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:35 smithi146 ceph-mon[35807]: pgmap v6982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:35 smithi076 ceph-mon[35401]: pgmap v6982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:36.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:35 smithi040 ceph-mon[32397]: pgmap v6982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8543.205368 secs 2024-07-26T15:55:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8543.205368 secs 2024-07-26T15:55:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8543.205368 secs 2024-07-26T15:55:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:38 smithi146 ceph-mon[35807]: pgmap v6983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:38 smithi076 ceph-mon[35401]: pgmap v6983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:38 smithi040 ceph-mon[32397]: pgmap v6983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:40 smithi146 ceph-mon[35807]: pgmap v6984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:40 smithi076 ceph-mon[35401]: pgmap v6984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:40 smithi040 ceph-mon[32397]: pgmap v6984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8548.205507 secs 2024-07-26T15:55:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:42 smithi146 ceph-mon[35807]: pgmap v6985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8548.205507 secs 2024-07-26T15:55:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:42 smithi076 ceph-mon[35401]: pgmap v6985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8548.205507 secs 2024-07-26T15:55:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:42 smithi040 ceph-mon[32397]: pgmap v6985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:44 smithi146 ceph-mon[35807]: pgmap v6986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:44 smithi076 ceph-mon[35401]: pgmap v6986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:44 smithi040 ceph-mon[32397]: pgmap v6986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:46 smithi146 ceph-mon[35807]: pgmap v6987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:46 smithi076 ceph-mon[35401]: pgmap v6987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:46 smithi040 ceph-mon[32397]: pgmap v6987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8553.205652 secs 2024-07-26T15:55:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8553.205652 secs 2024-07-26T15:55:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8553.205652 secs 2024-07-26T15:55:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:48 smithi146 ceph-mon[35807]: pgmap v6988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:48 smithi076 ceph-mon[35401]: pgmap v6988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:48 smithi040 ceph-mon[32397]: pgmap v6988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:50 smithi146 ceph-mon[35807]: pgmap v6989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:50 smithi076 ceph-mon[35401]: pgmap v6989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:50 smithi040 ceph-mon[32397]: pgmap v6989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:55:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8558.205797 secs 2024-07-26T15:55:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:52 smithi076 ceph-mon[35401]: pgmap v6990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8558.205797 secs 2024-07-26T15:55:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:52 smithi040 ceph-mon[32397]: pgmap v6990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8558.205797 secs 2024-07-26T15:55:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:52 smithi146 ceph-mon[35807]: pgmap v6990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:54.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:54 smithi146 ceph-mon[35807]: pgmap v6991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:54 smithi040 ceph-mon[32397]: pgmap v6991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:54 smithi076 ceph-mon[35401]: pgmap v6991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:56 smithi146 ceph-mon[35807]: pgmap v6992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:56 smithi040 ceph-mon[32397]: pgmap v6992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:56 smithi076 ceph-mon[35401]: pgmap v6992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:55:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8563.205952 secs 2024-07-26T15:55:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8563.205952 secs 2024-07-26T15:55:57.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8563.205952 secs 2024-07-26T15:55:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:55:58 smithi040 ceph-mon[32397]: pgmap v6993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:58.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:55:58 smithi146 ceph-mon[35807]: pgmap v6993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:55:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:55:58 smithi076 ceph-mon[35401]: pgmap v6993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:00 smithi040 ceph-mon[32397]: pgmap v6994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:00 smithi146 ceph-mon[35807]: pgmap v6994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:00 smithi076 ceph-mon[35401]: pgmap v6994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8568.206111 secs 2024-07-26T15:56:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:02 smithi040 ceph-mon[32397]: pgmap v6995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8568.206111 secs 2024-07-26T15:56:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:02 smithi146 ceph-mon[35807]: pgmap v6995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8568.206111 secs 2024-07-26T15:56:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:02 smithi076 ceph-mon[35401]: pgmap v6995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:04 smithi040 ceph-mon[32397]: pgmap v6996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:04 smithi146 ceph-mon[35807]: pgmap v6996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:04 smithi076 ceph-mon[35401]: pgmap v6996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:06.413 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:06 smithi146 ceph-mon[35807]: pgmap v6997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:06 smithi040 ceph-mon[32397]: pgmap v6997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:06 smithi076 ceph-mon[35401]: pgmap v6997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8573.206247 secs 2024-07-26T15:56:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8573.206247 secs 2024-07-26T15:56:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8573.206247 secs 2024-07-26T15:56:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:08 smithi040 ceph-mon[32397]: pgmap v6998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:08 smithi146 ceph-mon[35807]: pgmap v6998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:08 smithi076 ceph-mon[35401]: pgmap v6998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:10 smithi040 ceph-mon[32397]: pgmap v6999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:10 smithi146 ceph-mon[35807]: pgmap v6999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:10 smithi076 ceph-mon[35401]: pgmap v6999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8578.206371 secs 2024-07-26T15:56:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:12 smithi040 ceph-mon[32397]: pgmap v7000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8578.206371 secs 2024-07-26T15:56:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:12 smithi146 ceph-mon[35807]: pgmap v7000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8578.206371 secs 2024-07-26T15:56:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:12 smithi076 ceph-mon[35401]: pgmap v7000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:14 smithi040 ceph-mon[32397]: pgmap v7001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:14 smithi146 ceph-mon[35807]: pgmap v7001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:14 smithi076 ceph-mon[35401]: pgmap v7001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:16 smithi040 ceph-mon[32397]: pgmap v7002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:16 smithi146 ceph-mon[35807]: pgmap v7002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:16 smithi076 ceph-mon[35401]: pgmap v7002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8583.206521 secs 2024-07-26T15:56:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8583.206521 secs 2024-07-26T15:56:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8583.206521 secs 2024-07-26T15:56:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:18 smithi040 ceph-mon[32397]: pgmap v7003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:18 smithi146 ceph-mon[35807]: pgmap v7003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:18 smithi076 ceph-mon[35401]: pgmap v7003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:20 smithi040 ceph-mon[32397]: pgmap v7004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:20 smithi146 ceph-mon[35807]: pgmap v7004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:20 smithi076 ceph-mon[35401]: pgmap v7004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8588.206657 secs 2024-07-26T15:56:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:22 smithi040 ceph-mon[32397]: pgmap v7005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8588.206657 secs 2024-07-26T15:56:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:22 smithi146 ceph-mon[35807]: pgmap v7005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8588.206657 secs 2024-07-26T15:56:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:22 smithi076 ceph-mon[35401]: pgmap v7005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:24 smithi146 ceph-mon[35807]: pgmap v7006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:24 smithi076 ceph-mon[35401]: pgmap v7006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:24 smithi040 ceph-mon[32397]: pgmap v7006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:26 smithi146 ceph-mon[35807]: pgmap v7007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:26 smithi076 ceph-mon[35401]: pgmap v7007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:26 smithi040 ceph-mon[32397]: pgmap v7007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8593.206791 secs 2024-07-26T15:56:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8593.206791 secs 2024-07-26T15:56:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8593.206791 secs 2024-07-26T15:56:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:28 smithi146 ceph-mon[35807]: pgmap v7008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:28 smithi076 ceph-mon[35401]: pgmap v7008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:28 smithi040 ceph-mon[32397]: pgmap v7008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:30 smithi146 ceph-mon[35807]: pgmap v7009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:30 smithi076 ceph-mon[35401]: pgmap v7009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:30 smithi040 ceph-mon[32397]: pgmap v7009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8598.206883 secs 2024-07-26T15:56:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:32 smithi146 ceph-mon[35807]: pgmap v7010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8598.206883 secs 2024-07-26T15:56:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:32 smithi076 ceph-mon[35401]: pgmap v7010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8598.206883 secs 2024-07-26T15:56:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:32 smithi040 ceph-mon[32397]: pgmap v7010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:34 smithi146 ceph-mon[35807]: pgmap v7011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:34 smithi076 ceph-mon[35401]: pgmap v7011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:34 smithi040 ceph-mon[32397]: pgmap v7011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:36.537 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:36 smithi040 ceph-mon[32397]: pgmap v7012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:36 smithi146 ceph-mon[35807]: pgmap v7012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:36 smithi076 ceph-mon[35401]: pgmap v7012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8603.207050 secs 2024-07-26T15:56:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8603.207050 secs 2024-07-26T15:56:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8603.207050 secs 2024-07-26T15:56:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:38 smithi146 ceph-mon[35807]: pgmap v7013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:38 smithi076 ceph-mon[35401]: pgmap v7013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:38 smithi040 ceph-mon[32397]: pgmap v7013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:40 smithi146 ceph-mon[35807]: pgmap v7014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:40 smithi076 ceph-mon[35401]: pgmap v7014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:40 smithi040 ceph-mon[32397]: pgmap v7014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8608.207180 secs 2024-07-26T15:56:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:42 smithi146 ceph-mon[35807]: pgmap v7015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8608.207180 secs 2024-07-26T15:56:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:42 smithi076 ceph-mon[35401]: pgmap v7015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8608.207180 secs 2024-07-26T15:56:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:42 smithi040 ceph-mon[32397]: pgmap v7015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:44 smithi076 ceph-mon[35401]: pgmap v7016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:44 smithi040 ceph-mon[32397]: pgmap v7016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:44 smithi146 ceph-mon[35807]: pgmap v7016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:46 smithi076 ceph-mon[35401]: pgmap v7017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:46 smithi040 ceph-mon[32397]: pgmap v7017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:46 smithi146 ceph-mon[35807]: pgmap v7017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8613.207330 secs 2024-07-26T15:56:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8613.207330 secs 2024-07-26T15:56:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8613.207330 secs 2024-07-26T15:56:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:48 smithi040 ceph-mon[32397]: pgmap v7018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:48 smithi146 ceph-mon[35807]: pgmap v7018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:48 smithi076 ceph-mon[35401]: pgmap v7018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:50 smithi040 ceph-mon[32397]: pgmap v7019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:50 smithi146 ceph-mon[35807]: pgmap v7019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:50 smithi076 ceph-mon[35401]: pgmap v7019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8618.207473 secs 2024-07-26T15:56:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:52 smithi040 ceph-mon[32397]: pgmap v7020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8618.207473 secs 2024-07-26T15:56:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:52 smithi146 ceph-mon[35807]: pgmap v7020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8618.207473 secs 2024-07-26T15:56:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:52 smithi076 ceph-mon[35401]: pgmap v7020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:54.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:54 smithi146 ceph-mon[35807]: pgmap v7021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:54 smithi040 ceph-mon[32397]: pgmap v7021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:54 smithi076 ceph-mon[35401]: pgmap v7021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:56 smithi040 ceph-mon[32397]: pgmap v7022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:56 smithi146 ceph-mon[35807]: pgmap v7022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:56 smithi076 ceph-mon[35401]: pgmap v7022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:56:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8623.207616 secs 2024-07-26T15:56:57.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8623.207616 secs 2024-07-26T15:56:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8623.207616 secs 2024-07-26T15:56:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:58 smithi040 ceph-mon[32397]: pgmap v7023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:58 smithi146 ceph-mon[35807]: pgmap v7023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:58 smithi076 ceph-mon[35401]: pgmap v7023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:56:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:56:59 smithi040 ceph-mon[32397]: pgmap v7024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:56:59 smithi146 ceph-mon[35807]: pgmap v7024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:56:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:56:59 smithi076 ceph-mon[35401]: pgmap v7024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8628.207756 secs 2024-07-26T15:57:02.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:01 smithi040 ceph-mon[32397]: pgmap v7025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8628.207756 secs 2024-07-26T15:57:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:01 smithi146 ceph-mon[35807]: pgmap v7025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8628.207756 secs 2024-07-26T15:57:02.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:01 smithi076 ceph-mon[35401]: pgmap v7025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:03 smithi040 ceph-mon[32397]: pgmap v7026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:03 smithi146 ceph-mon[35807]: pgmap v7026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:03 smithi076 ceph-mon[35401]: pgmap v7026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:06.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:05 smithi040 ceph-mon[32397]: pgmap v7027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:05 smithi146 ceph-mon[35807]: pgmap v7027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:05 smithi076 ceph-mon[35401]: pgmap v7027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8633.207905 secs 2024-07-26T15:57:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8633.207905 secs 2024-07-26T15:57:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8633.207905 secs 2024-07-26T15:57:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:07 smithi040 ceph-mon[32397]: pgmap v7028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:07 smithi146 ceph-mon[35807]: pgmap v7028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:07 smithi076 ceph-mon[35401]: pgmap v7028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:09 smithi040 ceph-mon[32397]: pgmap v7029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:09 smithi146 ceph-mon[35807]: pgmap v7029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:09 smithi076 ceph-mon[35401]: pgmap v7029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8638.208080 secs 2024-07-26T15:57:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:11 smithi040 ceph-mon[32397]: pgmap v7030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8638.208080 secs 2024-07-26T15:57:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:11 smithi146 ceph-mon[35807]: pgmap v7030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8638.208080 secs 2024-07-26T15:57:12.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:11 smithi076 ceph-mon[35401]: pgmap v7030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:13 smithi040 ceph-mon[32397]: pgmap v7031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:13 smithi146 ceph-mon[35807]: pgmap v7031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:13 smithi076 ceph-mon[35401]: pgmap v7031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:15 smithi040 ceph-mon[32397]: pgmap v7032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:15 smithi146 ceph-mon[35807]: pgmap v7032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:15 smithi076 ceph-mon[35401]: pgmap v7032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8643.208210 secs 2024-07-26T15:57:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8643.208210 secs 2024-07-26T15:57:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8643.208210 secs 2024-07-26T15:57:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:17 smithi040 ceph-mon[32397]: pgmap v7033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:17 smithi146 ceph-mon[35807]: pgmap v7033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:17 smithi076 ceph-mon[35401]: pgmap v7033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:19 smithi040 ceph-mon[32397]: pgmap v7034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:19 smithi146 ceph-mon[35807]: pgmap v7034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:19 smithi076 ceph-mon[35401]: pgmap v7034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8648.208326 secs 2024-07-26T15:57:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:21 smithi040 ceph-mon[32397]: pgmap v7035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8648.208326 secs 2024-07-26T15:57:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:21 smithi146 ceph-mon[35807]: pgmap v7035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8648.208326 secs 2024-07-26T15:57:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:21 smithi076 ceph-mon[35401]: pgmap v7035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:24.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:23 smithi040 ceph-mon[32397]: pgmap v7036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:23 smithi146 ceph-mon[35807]: pgmap v7036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:23 smithi076 ceph-mon[35401]: pgmap v7036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:25 smithi040 ceph-mon[32397]: pgmap v7037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8653.208433 secs 2024-07-26T15:57:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:25 smithi146 ceph-mon[35807]: pgmap v7037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8653.208433 secs 2024-07-26T15:57:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:25 smithi076 ceph-mon[35401]: pgmap v7037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8653.208433 secs 2024-07-26T15:57:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:27 smithi040 ceph-mon[32397]: pgmap v7038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:27 smithi146 ceph-mon[35807]: pgmap v7038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:27 smithi076 ceph-mon[35401]: pgmap v7038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:29 smithi040 ceph-mon[32397]: pgmap v7039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:29 smithi146 ceph-mon[35807]: pgmap v7039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:29 smithi076 ceph-mon[35401]: pgmap v7039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8658.208532 secs 2024-07-26T15:57:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8658.208532 secs 2024-07-26T15:57:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8658.208532 secs 2024-07-26T15:57:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:31 smithi040 ceph-mon[32397]: pgmap v7040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:31 smithi146 ceph-mon[35807]: pgmap v7040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:31 smithi076 ceph-mon[35401]: pgmap v7040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:33 smithi146 ceph-mon[35807]: pgmap v7041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:33 smithi076 ceph-mon[35401]: pgmap v7041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:33 smithi040 ceph-mon[32397]: pgmap v7041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:36.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:35 smithi040 ceph-mon[32397]: pgmap v7042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:36.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8663.208629 secs 2024-07-26T15:57:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:35 smithi146 ceph-mon[35807]: pgmap v7042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8663.208629 secs 2024-07-26T15:57:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:35 smithi076 ceph-mon[35401]: pgmap v7042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8663.208629 secs 2024-07-26T15:57:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:37 smithi146 ceph-mon[35807]: pgmap v7043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:37 smithi076 ceph-mon[35401]: pgmap v7043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:37 smithi040 ceph-mon[32397]: pgmap v7043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:40 smithi146 ceph-mon[35807]: pgmap v7044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:40 smithi076 ceph-mon[35401]: pgmap v7044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:40 smithi040 ceph-mon[32397]: pgmap v7044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8668.208770 secs 2024-07-26T15:57:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8668.208770 secs 2024-07-26T15:57:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8668.208770 secs 2024-07-26T15:57:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:42 smithi146 ceph-mon[35807]: pgmap v7045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:42 smithi076 ceph-mon[35401]: pgmap v7045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:42 smithi040 ceph-mon[32397]: pgmap v7045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:44 smithi146 ceph-mon[35807]: pgmap v7046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:44 smithi076 ceph-mon[35401]: pgmap v7046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:44 smithi040 ceph-mon[32397]: pgmap v7046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:46 smithi146 ceph-mon[35807]: pgmap v7047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8673.208900 secs 2024-07-26T15:57:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:46 smithi076 ceph-mon[35401]: pgmap v7047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8673.208900 secs 2024-07-26T15:57:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:46 smithi040 ceph-mon[32397]: pgmap v7047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8673.208900 secs 2024-07-26T15:57:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:48 smithi146 ceph-mon[35807]: pgmap v7048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:48 smithi076 ceph-mon[35401]: pgmap v7048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:48 smithi040 ceph-mon[32397]: pgmap v7048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:50 smithi146 ceph-mon[35807]: pgmap v7049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:50 smithi076 ceph-mon[35401]: pgmap v7049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:50 smithi040 ceph-mon[32397]: pgmap v7049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:57:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8678.209033 secs 2024-07-26T15:57:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8678.209033 secs 2024-07-26T15:57:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8678.209033 secs 2024-07-26T15:57:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:52 smithi146 ceph-mon[35807]: pgmap v7050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:52 smithi076 ceph-mon[35401]: pgmap v7050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:52 smithi040 ceph-mon[32397]: pgmap v7050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:54 smithi076 ceph-mon[35401]: pgmap v7051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:54 smithi040 ceph-mon[32397]: pgmap v7051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:54 smithi146 ceph-mon[35807]: pgmap v7051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:56 smithi040 ceph-mon[32397]: pgmap v7052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8683.209156 secs 2024-07-26T15:57:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:56 smithi146 ceph-mon[35807]: pgmap v7052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8683.209156 secs 2024-07-26T15:57:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:56 smithi076 ceph-mon[35401]: pgmap v7052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:57:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8683.209156 secs 2024-07-26T15:57:58.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:57:58 smithi076 ceph-mon[35401]: pgmap v7053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:57:58 smithi040 ceph-mon[32397]: pgmap v7053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:57:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:57:58 smithi146 ceph-mon[35807]: pgmap v7053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:00 smithi040 ceph-mon[32397]: pgmap v7054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:00 smithi146 ceph-mon[35807]: pgmap v7054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:00 smithi076 ceph-mon[35401]: pgmap v7054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8688.209297 secs 2024-07-26T15:58:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8688.209297 secs 2024-07-26T15:58:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8688.209297 secs 2024-07-26T15:58:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:02 smithi040 ceph-mon[32397]: pgmap v7055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:02 smithi146 ceph-mon[35807]: pgmap v7055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:02 smithi076 ceph-mon[35401]: pgmap v7055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:04 smithi040 ceph-mon[32397]: pgmap v7056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:04 smithi146 ceph-mon[35807]: pgmap v7056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:04 smithi076 ceph-mon[35401]: pgmap v7056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:06 smithi040 ceph-mon[32397]: pgmap v7057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8693.209434 secs 2024-07-26T15:58:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:06 smithi146 ceph-mon[35807]: pgmap v7057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8693.209434 secs 2024-07-26T15:58:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:06 smithi076 ceph-mon[35401]: pgmap v7057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8693.209434 secs 2024-07-26T15:58:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:08 smithi040 ceph-mon[32397]: pgmap v7058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:08 smithi146 ceph-mon[35807]: pgmap v7058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:08 smithi076 ceph-mon[35401]: pgmap v7058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:09 smithi040 ceph-mon[32397]: pgmap v7059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:09 smithi146 ceph-mon[35807]: pgmap v7059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:09 smithi076 ceph-mon[35401]: pgmap v7059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8698.209581 secs 2024-07-26T15:58:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8698.209581 secs 2024-07-26T15:58:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8698.209581 secs 2024-07-26T15:58:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:11 smithi040 ceph-mon[32397]: pgmap v7060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:11 smithi146 ceph-mon[35807]: pgmap v7060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:11 smithi076 ceph-mon[35401]: pgmap v7060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:13 smithi040 ceph-mon[32397]: pgmap v7061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:13 smithi146 ceph-mon[35807]: pgmap v7061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:13 smithi076 ceph-mon[35401]: pgmap v7061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:15 smithi040 ceph-mon[32397]: pgmap v7062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8703.209752 secs 2024-07-26T15:58:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:15 smithi146 ceph-mon[35807]: pgmap v7062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8703.209752 secs 2024-07-26T15:58:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:15 smithi076 ceph-mon[35401]: pgmap v7062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8703.209752 secs 2024-07-26T15:58:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:17 smithi040 ceph-mon[32397]: pgmap v7063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:17 smithi146 ceph-mon[35807]: pgmap v7063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:17 smithi076 ceph-mon[35401]: pgmap v7063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:19 smithi040 ceph-mon[32397]: pgmap v7064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:19 smithi146 ceph-mon[35807]: pgmap v7064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:19 smithi076 ceph-mon[35401]: pgmap v7064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8708.209932 secs 2024-07-26T15:58:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8708.209932 secs 2024-07-26T15:58:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8708.209932 secs 2024-07-26T15:58:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:21 smithi040 ceph-mon[32397]: pgmap v7065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:21 smithi146 ceph-mon[35807]: pgmap v7065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:21 smithi076 ceph-mon[35401]: pgmap v7065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:23 smithi040 ceph-mon[32397]: pgmap v7066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:23 smithi146 ceph-mon[35807]: pgmap v7066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:23 smithi076 ceph-mon[35401]: pgmap v7066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:25 smithi040 ceph-mon[32397]: pgmap v7067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8713.210064 secs 2024-07-26T15:58:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:25 smithi146 ceph-mon[35807]: pgmap v7067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8713.210064 secs 2024-07-26T15:58:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:25 smithi076 ceph-mon[35401]: pgmap v7067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8713.210064 secs 2024-07-26T15:58:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:27 smithi040 ceph-mon[32397]: pgmap v7068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:27 smithi146 ceph-mon[35807]: pgmap v7068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:27 smithi076 ceph-mon[35401]: pgmap v7068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:29 smithi040 ceph-mon[32397]: pgmap v7069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:29 smithi146 ceph-mon[35807]: pgmap v7069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:29 smithi076 ceph-mon[35401]: pgmap v7069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8718.210205 secs 2024-07-26T15:58:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8718.210205 secs 2024-07-26T15:58:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8718.210205 secs 2024-07-26T15:58:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:31 smithi040 ceph-mon[32397]: pgmap v7070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:31 smithi146 ceph-mon[35807]: pgmap v7070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:31 smithi076 ceph-mon[35401]: pgmap v7070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:33 smithi040 ceph-mon[32397]: pgmap v7071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:33 smithi146 ceph-mon[35807]: pgmap v7071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:33 smithi076 ceph-mon[35401]: pgmap v7071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:35 smithi146 ceph-mon[35807]: pgmap v7072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8723.210341 secs 2024-07-26T15:58:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:35 smithi076 ceph-mon[35401]: pgmap v7072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8723.210341 secs 2024-07-26T15:58:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:35 smithi040 ceph-mon[32397]: pgmap v7072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8723.210341 secs 2024-07-26T15:58:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:37 smithi146 ceph-mon[35807]: pgmap v7073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:37 smithi076 ceph-mon[35401]: pgmap v7073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:37 smithi040 ceph-mon[32397]: pgmap v7073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:40 smithi146 ceph-mon[35807]: pgmap v7074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:40 smithi076 ceph-mon[35401]: pgmap v7074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:40 smithi040 ceph-mon[32397]: pgmap v7074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8728.210470 secs 2024-07-26T15:58:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8728.210470 secs 2024-07-26T15:58:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8728.210470 secs 2024-07-26T15:58:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:42 smithi146 ceph-mon[35807]: pgmap v7075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:42 smithi076 ceph-mon[35401]: pgmap v7075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:42 smithi040 ceph-mon[32397]: pgmap v7075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:44 smithi146 ceph-mon[35807]: pgmap v7076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:44 smithi076 ceph-mon[35401]: pgmap v7076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:44 smithi040 ceph-mon[32397]: pgmap v7076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:46 smithi146 ceph-mon[35807]: pgmap v7077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8733.210614 secs 2024-07-26T15:58:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:46 smithi076 ceph-mon[35401]: pgmap v7077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8733.210614 secs 2024-07-26T15:58:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:46 smithi040 ceph-mon[32397]: pgmap v7077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8733.210614 secs 2024-07-26T15:58:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:48 smithi146 ceph-mon[35807]: pgmap v7078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:48 smithi076 ceph-mon[35401]: pgmap v7078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:48 smithi040 ceph-mon[32397]: pgmap v7078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:50 smithi146 ceph-mon[35807]: pgmap v7079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:50 smithi076 ceph-mon[35401]: pgmap v7079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:50 smithi040 ceph-mon[32397]: pgmap v7079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:58:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8738.210755 secs 2024-07-26T15:58:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8738.210755 secs 2024-07-26T15:58:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8738.210755 secs 2024-07-26T15:58:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:52 smithi146 ceph-mon[35807]: pgmap v7080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:52 smithi076 ceph-mon[35401]: pgmap v7080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:52 smithi040 ceph-mon[32397]: pgmap v7080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:54 smithi076 ceph-mon[35401]: pgmap v7081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:54 smithi040 ceph-mon[32397]: pgmap v7081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:54 smithi146 ceph-mon[35807]: pgmap v7081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:56 smithi076 ceph-mon[35401]: pgmap v7082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8743.210915 secs 2024-07-26T15:58:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:56 smithi040 ceph-mon[32397]: pgmap v7082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8743.210915 secs 2024-07-26T15:58:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:56 smithi146 ceph-mon[35807]: pgmap v7082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:58:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8743.210915 secs 2024-07-26T15:58:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:58:58 smithi040 ceph-mon[32397]: pgmap v7083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:58:58 smithi146 ceph-mon[35807]: pgmap v7083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:58:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:58:58 smithi076 ceph-mon[35401]: pgmap v7083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:00 smithi040 ceph-mon[32397]: pgmap v7084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:00.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:00 smithi146 ceph-mon[35807]: pgmap v7084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:00 smithi076 ceph-mon[35401]: pgmap v7084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8748.211049 secs 2024-07-26T15:59:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8748.211049 secs 2024-07-26T15:59:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8748.211049 secs 2024-07-26T15:59:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:02 smithi040 ceph-mon[32397]: pgmap v7085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:02 smithi146 ceph-mon[35807]: pgmap v7085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:02 smithi076 ceph-mon[35401]: pgmap v7085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:04 smithi040 ceph-mon[32397]: pgmap v7086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:04 smithi146 ceph-mon[35807]: pgmap v7086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:04 smithi076 ceph-mon[35401]: pgmap v7086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:06 smithi040 ceph-mon[32397]: pgmap v7087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8753.211201 secs 2024-07-26T15:59:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:06 smithi146 ceph-mon[35807]: pgmap v7087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8753.211201 secs 2024-07-26T15:59:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:06 smithi076 ceph-mon[35401]: pgmap v7087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8753.211201 secs 2024-07-26T15:59:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:08 smithi040 ceph-mon[32397]: pgmap v7088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:08 smithi146 ceph-mon[35807]: pgmap v7088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:08 smithi076 ceph-mon[35401]: pgmap v7088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:09 smithi040 ceph-mon[32397]: pgmap v7089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:09 smithi146 ceph-mon[35807]: pgmap v7089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:09 smithi076 ceph-mon[35401]: pgmap v7089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8758.211347 secs 2024-07-26T15:59:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8758.211347 secs 2024-07-26T15:59:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8758.211347 secs 2024-07-26T15:59:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:11 smithi040 ceph-mon[32397]: pgmap v7090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:11 smithi146 ceph-mon[35807]: pgmap v7090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:11 smithi076 ceph-mon[35401]: pgmap v7090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:13 smithi040 ceph-mon[32397]: pgmap v7091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:13 smithi146 ceph-mon[35807]: pgmap v7091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:13 smithi076 ceph-mon[35401]: pgmap v7091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:15 smithi040 ceph-mon[32397]: pgmap v7092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:16.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8763.211485 secs 2024-07-26T15:59:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:15 smithi146 ceph-mon[35807]: pgmap v7092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8763.211485 secs 2024-07-26T15:59:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:15 smithi076 ceph-mon[35401]: pgmap v7092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8763.211485 secs 2024-07-26T15:59:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:17 smithi040 ceph-mon[32397]: pgmap v7093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:17 smithi146 ceph-mon[35807]: pgmap v7093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:17 smithi076 ceph-mon[35401]: pgmap v7093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:19 smithi040 ceph-mon[32397]: pgmap v7094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:19 smithi146 ceph-mon[35807]: pgmap v7094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:19 smithi076 ceph-mon[35401]: pgmap v7094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8768.211622 secs 2024-07-26T15:59:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8768.211622 secs 2024-07-26T15:59:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8768.211622 secs 2024-07-26T15:59:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:21 smithi040 ceph-mon[32397]: pgmap v7095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:59:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:21 smithi146 ceph-mon[35807]: pgmap v7095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:59:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:21 smithi076 ceph-mon[35401]: pgmap v7095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:59:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:23 smithi040 ceph-mon[32397]: pgmap v7096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:23 smithi146 ceph-mon[35807]: pgmap v7096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:24.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:23 smithi076 ceph-mon[35401]: pgmap v7096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:25 smithi040 ceph-mon[32397]: pgmap v7097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8773.211758 secs 2024-07-26T15:59:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:25 smithi146 ceph-mon[35807]: pgmap v7097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8773.211758 secs 2024-07-26T15:59:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:25 smithi076 ceph-mon[35401]: pgmap v7097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8773.211758 secs 2024-07-26T15:59:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:27 smithi146 ceph-mon[35807]: pgmap v7098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:27 smithi076 ceph-mon[35401]: pgmap v7098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:27 smithi040 ceph-mon[32397]: pgmap v7098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:29 smithi146 ceph-mon[35807]: pgmap v7099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:29 smithi076 ceph-mon[35401]: pgmap v7099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:29 smithi040 ceph-mon[32397]: pgmap v7099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T15:59:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8778.211901 secs 2024-07-26T15:59:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8778.211901 secs 2024-07-26T15:59:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8778.211901 secs 2024-07-26T15:59:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:32 smithi146 ceph-mon[35807]: pgmap v7100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:59:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:32 smithi076 ceph-mon[35401]: pgmap v7100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:59:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:32 smithi040 ceph-mon[32397]: pgmap v7100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T15:59:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:34 smithi146 ceph-mon[35807]: pgmap v7101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:34 smithi076 ceph-mon[35401]: pgmap v7101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:34 smithi040 ceph-mon[32397]: pgmap v7101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:36.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:36 smithi040 ceph-mon[32397]: pgmap v7102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:36.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8783.212041 secs 2024-07-26T15:59:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:36 smithi146 ceph-mon[35807]: pgmap v7102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8783.212041 secs 2024-07-26T15:59:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:36 smithi076 ceph-mon[35401]: pgmap v7102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8783.212041 secs 2024-07-26T15:59:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:38 smithi146 ceph-mon[35807]: pgmap v7103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:38 smithi076 ceph-mon[35401]: pgmap v7103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:38 smithi040 ceph-mon[32397]: pgmap v7103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:40 smithi146 ceph-mon[35807]: pgmap v7104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:40 smithi076 ceph-mon[35401]: pgmap v7104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:40 smithi040 ceph-mon[32397]: pgmap v7104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8788.212228 secs 2024-07-26T15:59:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8788.212228 secs 2024-07-26T15:59:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8788.212228 secs 2024-07-26T15:59:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:42 smithi076 ceph-mon[35401]: pgmap v7105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:42 smithi040 ceph-mon[32397]: pgmap v7105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:42 smithi146 ceph-mon[35807]: pgmap v7105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:44 smithi076 ceph-mon[35401]: pgmap v7106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:44 smithi040 ceph-mon[32397]: pgmap v7106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:44.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:44 smithi146 ceph-mon[35807]: pgmap v7106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:46 smithi040 ceph-mon[32397]: pgmap v7107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8793.212337 secs 2024-07-26T15:59:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:46 smithi146 ceph-mon[35807]: pgmap v7107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8793.212337 secs 2024-07-26T15:59:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:46 smithi076 ceph-mon[35401]: pgmap v7107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8793.212337 secs 2024-07-26T15:59:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:48 smithi040 ceph-mon[32397]: pgmap v7108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:48 smithi146 ceph-mon[35807]: pgmap v7108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:48 smithi076 ceph-mon[35401]: pgmap v7108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:50 smithi040 ceph-mon[32397]: pgmap v7109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:50 smithi146 ceph-mon[35807]: pgmap v7109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:50 smithi076 ceph-mon[35401]: pgmap v7109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T15:59:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8798.212473 secs 2024-07-26T15:59:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8798.212473 secs 2024-07-26T15:59:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8798.212473 secs 2024-07-26T15:59:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:52 smithi040 ceph-mon[32397]: pgmap v7110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:52 smithi146 ceph-mon[35807]: pgmap v7110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:52 smithi076 ceph-mon[35401]: pgmap v7110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:54.376 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:54 smithi146 ceph-mon[35807]: pgmap v7111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:54 smithi040 ceph-mon[32397]: pgmap v7111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:54 smithi076 ceph-mon[35401]: pgmap v7111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:56 smithi040 ceph-mon[32397]: pgmap v7112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8803.212616 secs 2024-07-26T15:59:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:56 smithi146 ceph-mon[35807]: pgmap v7112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8803.212616 secs 2024-07-26T15:59:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:56 smithi076 ceph-mon[35401]: pgmap v7112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T15:59:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8803.212616 secs 2024-07-26T15:59:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 15:59:58 smithi040 ceph-mon[32397]: pgmap v7113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 15:59:58 smithi146 ceph-mon[35807]: pgmap v7113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T15:59:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 15:59:58 smithi076 ceph-mon[35401]: pgmap v7113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:00 smithi040 ceph-mon[32397]: pgmap v7114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:00:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:00 smithi146 ceph-mon[35807]: pgmap v7114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:00:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:00 smithi076 ceph-mon[35401]: pgmap v7114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:00:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8808.212756 secs 2024-07-26T16:00:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8808.212756 secs 2024-07-26T16:00:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8808.212756 secs 2024-07-26T16:00:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:02 smithi040 ceph-mon[32397]: pgmap v7115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:00:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:02 smithi146 ceph-mon[35807]: pgmap v7115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:00:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:02 smithi076 ceph-mon[35401]: pgmap v7115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:00:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:04 smithi040 ceph-mon[32397]: pgmap v7116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:04 smithi146 ceph-mon[35807]: pgmap v7116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:04 smithi076 ceph-mon[35401]: pgmap v7116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:06 smithi040 ceph-mon[32397]: pgmap v7117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8813.212900 secs 2024-07-26T16:00:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:06 smithi146 ceph-mon[35807]: pgmap v7117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8813.212900 secs 2024-07-26T16:00:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:06 smithi076 ceph-mon[35401]: pgmap v7117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8813.212900 secs 2024-07-26T16:00:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:08 smithi040 ceph-mon[32397]: pgmap v7118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:08 smithi146 ceph-mon[35807]: pgmap v7118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:08 smithi076 ceph-mon[35401]: pgmap v7118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:10 smithi040 ceph-mon[32397]: pgmap v7119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:10 smithi146 ceph-mon[35807]: pgmap v7119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:10 smithi076 ceph-mon[35401]: pgmap v7119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8818.213037 secs 2024-07-26T16:00:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8818.213037 secs 2024-07-26T16:00:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8818.213037 secs 2024-07-26T16:00:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:12 smithi040 ceph-mon[32397]: pgmap v7120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:12.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:12 smithi146 ceph-mon[35807]: pgmap v7120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:12 smithi076 ceph-mon[35401]: pgmap v7120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:14 smithi146 ceph-mon[35807]: pgmap v7121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:14 smithi040 ceph-mon[32397]: pgmap v7121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:14 smithi076 ceph-mon[35401]: pgmap v7121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:16 smithi040 ceph-mon[32397]: pgmap v7122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8823.213187 secs 2024-07-26T16:00:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:16 smithi146 ceph-mon[35807]: pgmap v7122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8823.213187 secs 2024-07-26T16:00:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:16 smithi076 ceph-mon[35401]: pgmap v7122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8823.213187 secs 2024-07-26T16:00:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:18 smithi040 ceph-mon[32397]: pgmap v7123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:18 smithi146 ceph-mon[35807]: pgmap v7123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:18 smithi076 ceph-mon[35401]: pgmap v7123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:20 smithi040 ceph-mon[32397]: pgmap v7124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:20 smithi146 ceph-mon[35807]: pgmap v7124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:20 smithi076 ceph-mon[35401]: pgmap v7124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8828.213334 secs 2024-07-26T16:00:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8828.213334 secs 2024-07-26T16:00:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8828.213334 secs 2024-07-26T16:00:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:22 smithi146 ceph-mon[35807]: pgmap v7125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:22 smithi076 ceph-mon[35401]: pgmap v7125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:22 smithi040 ceph-mon[32397]: pgmap v7125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:24 smithi146 ceph-mon[35807]: pgmap v7126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:24 smithi076 ceph-mon[35401]: pgmap v7126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:24 smithi040 ceph-mon[32397]: pgmap v7126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:26 smithi146 ceph-mon[35807]: pgmap v7127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8833.213471 secs 2024-07-26T16:00:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:26 smithi076 ceph-mon[35401]: pgmap v7127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8833.213471 secs 2024-07-26T16:00:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:26 smithi040 ceph-mon[32397]: pgmap v7127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8833.213471 secs 2024-07-26T16:00:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:28 smithi146 ceph-mon[35807]: pgmap v7128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:28 smithi076 ceph-mon[35401]: pgmap v7128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:28 smithi040 ceph-mon[32397]: pgmap v7128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:30 smithi146 ceph-mon[35807]: pgmap v7129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:30 smithi076 ceph-mon[35401]: pgmap v7129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:30 smithi040 ceph-mon[32397]: pgmap v7129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8838.213576 secs 2024-07-26T16:00:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8838.213576 secs 2024-07-26T16:00:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8838.213576 secs 2024-07-26T16:00:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:32 smithi146 ceph-mon[35807]: pgmap v7130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:32 smithi076 ceph-mon[35401]: pgmap v7130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:32 smithi040 ceph-mon[32397]: pgmap v7130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:34 smithi146 ceph-mon[35807]: pgmap v7131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:34 smithi076 ceph-mon[35401]: pgmap v7131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:34 smithi040 ceph-mon[32397]: pgmap v7131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:36 smithi146 ceph-mon[35807]: pgmap v7132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8843.213734 secs 2024-07-26T16:00:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:36 smithi076 ceph-mon[35401]: pgmap v7132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8843.213734 secs 2024-07-26T16:00:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:36 smithi040 ceph-mon[32397]: pgmap v7132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8843.213734 secs 2024-07-26T16:00:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:38 smithi146 ceph-mon[35807]: pgmap v7133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:38 smithi076 ceph-mon[35401]: pgmap v7133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:38 smithi040 ceph-mon[32397]: pgmap v7133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:40 smithi076 ceph-mon[35401]: pgmap v7134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:40 smithi040 ceph-mon[32397]: pgmap v7134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:40 smithi146 ceph-mon[35807]: pgmap v7134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8848.213874 secs 2024-07-26T16:00:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8848.213874 secs 2024-07-26T16:00:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8848.213874 secs 2024-07-26T16:00:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:42 smithi040 ceph-mon[32397]: pgmap v7135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:42 smithi146 ceph-mon[35807]: pgmap v7135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:42 smithi076 ceph-mon[35401]: pgmap v7135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:44 smithi040 ceph-mon[32397]: pgmap v7136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:44 smithi146 ceph-mon[35807]: pgmap v7136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:44 smithi076 ceph-mon[35401]: pgmap v7136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:46 smithi040 ceph-mon[32397]: pgmap v7137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8853.214013 secs 2024-07-26T16:00:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:46 smithi146 ceph-mon[35807]: pgmap v7137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8853.214013 secs 2024-07-26T16:00:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:46 smithi076 ceph-mon[35401]: pgmap v7137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8853.214013 secs 2024-07-26T16:00:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:48 smithi040 ceph-mon[32397]: pgmap v7138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:48 smithi146 ceph-mon[35807]: pgmap v7138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:48 smithi076 ceph-mon[35401]: pgmap v7138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:50 smithi040 ceph-mon[32397]: pgmap v7139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:50 smithi146 ceph-mon[35807]: pgmap v7139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:50 smithi076 ceph-mon[35401]: pgmap v7139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:00:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8858.214153 secs 2024-07-26T16:00:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8858.214153 secs 2024-07-26T16:00:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8858.214153 secs 2024-07-26T16:00:52.457 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:52 smithi040 ceph-mon[32397]: pgmap v7140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:52 smithi146 ceph-mon[35807]: pgmap v7140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:52 smithi076 ceph-mon[35401]: pgmap v7140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:54 smithi040 ceph-mon[32397]: pgmap v7141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:54 smithi146 ceph-mon[35807]: pgmap v7141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:54 smithi076 ceph-mon[35401]: pgmap v7141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:56 smithi040 ceph-mon[32397]: pgmap v7142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8863.214307 secs 2024-07-26T16:00:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:56 smithi146 ceph-mon[35807]: pgmap v7142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8863.214307 secs 2024-07-26T16:00:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:56 smithi076 ceph-mon[35401]: pgmap v7142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:00:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8863.214307 secs 2024-07-26T16:00:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:00:58 smithi040 ceph-mon[32397]: pgmap v7143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:00:58 smithi146 ceph-mon[35807]: pgmap v7143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:00:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:00:58 smithi076 ceph-mon[35401]: pgmap v7143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:00 smithi040 ceph-mon[32397]: pgmap v7144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:00 smithi146 ceph-mon[35807]: pgmap v7144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:00 smithi076 ceph-mon[35401]: pgmap v7144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8868.214452 secs 2024-07-26T16:01:01.807 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8868.214452 secs 2024-07-26T16:01:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8868.214452 secs 2024-07-26T16:01:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:02 smithi040 ceph-mon[32397]: pgmap v7145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:02 smithi146 ceph-mon[35807]: pgmap v7145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:02 smithi076 ceph-mon[35401]: pgmap v7145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:03 smithi040 ceph-mon[32397]: pgmap v7146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:03 smithi146 ceph-mon[35807]: pgmap v7146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:03 smithi076 ceph-mon[35401]: pgmap v7146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:05 smithi146 ceph-mon[35807]: pgmap v7147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8873.214596 secs 2024-07-26T16:01:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:05 smithi076 ceph-mon[35401]: pgmap v7147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8873.214596 secs 2024-07-26T16:01:06.437 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:05 smithi040 ceph-mon[32397]: pgmap v7147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:06.437 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8873.214596 secs 2024-07-26T16:01:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:08 smithi146 ceph-mon[35807]: pgmap v7148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:08 smithi076 ceph-mon[35401]: pgmap v7148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:08 smithi040 ceph-mon[32397]: pgmap v7148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:10 smithi146 ceph-mon[35807]: pgmap v7149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:10 smithi076 ceph-mon[35401]: pgmap v7149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:10 smithi040 ceph-mon[32397]: pgmap v7149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8878.214681 secs 2024-07-26T16:01:11.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8878.214681 secs 2024-07-26T16:01:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8878.214681 secs 2024-07-26T16:01:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:12 smithi146 ceph-mon[35807]: pgmap v7150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:12 smithi076 ceph-mon[35401]: pgmap v7150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:12 smithi040 ceph-mon[32397]: pgmap v7150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:14 smithi146 ceph-mon[35807]: pgmap v7151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:14 smithi076 ceph-mon[35401]: pgmap v7151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:14 smithi040 ceph-mon[32397]: pgmap v7151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:16 smithi146 ceph-mon[35807]: pgmap v7152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8883.214828 secs 2024-07-26T16:01:16.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:16 smithi076 ceph-mon[35401]: pgmap v7152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:16.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8883.214828 secs 2024-07-26T16:01:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:16 smithi040 ceph-mon[32397]: pgmap v7152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8883.214828 secs 2024-07-26T16:01:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:18 smithi146 ceph-mon[35807]: pgmap v7153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:18 smithi076 ceph-mon[35401]: pgmap v7153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:18 smithi040 ceph-mon[32397]: pgmap v7153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:20 smithi146 ceph-mon[35807]: pgmap v7154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:20 smithi076 ceph-mon[35401]: pgmap v7154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:20 smithi040 ceph-mon[32397]: pgmap v7154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8888.214969 secs 2024-07-26T16:01:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8888.214969 secs 2024-07-26T16:01:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8888.214969 secs 2024-07-26T16:01:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:22 smithi076 ceph-mon[35401]: pgmap v7155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:22 smithi040 ceph-mon[32397]: pgmap v7155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:22 smithi146 ceph-mon[35807]: pgmap v7155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:24 smithi076 ceph-mon[35401]: pgmap v7156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:24.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:24 smithi146 ceph-mon[35807]: pgmap v7156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:24 smithi040 ceph-mon[32397]: pgmap v7156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:26 smithi040 ceph-mon[32397]: pgmap v7157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8893.215102 secs 2024-07-26T16:01:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:26 smithi146 ceph-mon[35807]: pgmap v7157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8893.215102 secs 2024-07-26T16:01:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:26 smithi076 ceph-mon[35401]: pgmap v7157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8893.215102 secs 2024-07-26T16:01:28.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:28 smithi076 ceph-mon[35401]: pgmap v7158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:28 smithi040 ceph-mon[32397]: pgmap v7158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:28 smithi146 ceph-mon[35807]: pgmap v7158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:30 smithi076 ceph-mon[35401]: pgmap v7159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:30 smithi040 ceph-mon[32397]: pgmap v7159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:30 smithi146 ceph-mon[35807]: pgmap v7159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:31.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8898.215171 secs 2024-07-26T16:01:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8898.215171 secs 2024-07-26T16:01:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8898.215171 secs 2024-07-26T16:01:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:32 smithi040 ceph-mon[32397]: pgmap v7160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:32 smithi146 ceph-mon[35807]: pgmap v7160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:32 smithi076 ceph-mon[35401]: pgmap v7160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:34 smithi040 ceph-mon[32397]: pgmap v7161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:34 smithi146 ceph-mon[35807]: pgmap v7161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:34 smithi076 ceph-mon[35401]: pgmap v7161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:36 smithi040 ceph-mon[32397]: pgmap v7162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8903.215315 secs 2024-07-26T16:01:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:36 smithi146 ceph-mon[35807]: pgmap v7162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8903.215315 secs 2024-07-26T16:01:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:36 smithi076 ceph-mon[35401]: pgmap v7162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8903.215315 secs 2024-07-26T16:01:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:38 smithi040 ceph-mon[32397]: pgmap v7163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:38 smithi146 ceph-mon[35807]: pgmap v7163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:38 smithi076 ceph-mon[35401]: pgmap v7163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:40.401 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:40 smithi076 ceph-mon[35401]: pgmap v7164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:40 smithi040 ceph-mon[32397]: pgmap v7164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:40 smithi146 ceph-mon[35807]: pgmap v7164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8908.215454 secs 2024-07-26T16:01:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8908.215454 secs 2024-07-26T16:01:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8908.215454 secs 2024-07-26T16:01:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:42 smithi040 ceph-mon[32397]: pgmap v7165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:42 smithi146 ceph-mon[35807]: pgmap v7165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:42 smithi076 ceph-mon[35401]: pgmap v7165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:44 smithi040 ceph-mon[32397]: pgmap v7166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:44 smithi146 ceph-mon[35807]: pgmap v7166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:44 smithi076 ceph-mon[35401]: pgmap v7166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:46 smithi040 ceph-mon[32397]: pgmap v7167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8913.215598 secs 2024-07-26T16:01:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:46 smithi146 ceph-mon[35807]: pgmap v7167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8913.215598 secs 2024-07-26T16:01:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:46 smithi076 ceph-mon[35401]: pgmap v7167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8913.215598 secs 2024-07-26T16:01:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:48 smithi040 ceph-mon[32397]: pgmap v7168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:48 smithi146 ceph-mon[35807]: pgmap v7168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:48.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:48 smithi076 ceph-mon[35401]: pgmap v7168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:50 smithi040 ceph-mon[32397]: pgmap v7169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:50 smithi146 ceph-mon[35807]: pgmap v7169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:50 smithi076 ceph-mon[35401]: pgmap v7169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:01:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8918.215737 secs 2024-07-26T16:01:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8918.215737 secs 2024-07-26T16:01:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8918.215737 secs 2024-07-26T16:01:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:52 smithi040 ceph-mon[32397]: pgmap v7170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:52 smithi146 ceph-mon[35807]: pgmap v7170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:52 smithi076 ceph-mon[35401]: pgmap v7170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:54 smithi040 ceph-mon[32397]: pgmap v7171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:54 smithi146 ceph-mon[35807]: pgmap v7171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:54 smithi076 ceph-mon[35401]: pgmap v7171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:56 smithi040 ceph-mon[32397]: pgmap v7172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8923.215881 secs 2024-07-26T16:01:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:56 smithi146 ceph-mon[35807]: pgmap v7172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8923.215881 secs 2024-07-26T16:01:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:56 smithi076 ceph-mon[35401]: pgmap v7172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:01:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8923.215881 secs 2024-07-26T16:01:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:01:58 smithi040 ceph-mon[32397]: pgmap v7173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:01:58 smithi146 ceph-mon[35807]: pgmap v7173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:01:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:01:58 smithi076 ceph-mon[35401]: pgmap v7173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:00 smithi146 ceph-mon[35807]: pgmap v7174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:00 smithi076 ceph-mon[35401]: pgmap v7174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:00 smithi040 ceph-mon[32397]: pgmap v7174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8928.216363 secs 2024-07-26T16:02:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8928.216363 secs 2024-07-26T16:02:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8928.216363 secs 2024-07-26T16:02:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:02 smithi146 ceph-mon[35807]: pgmap v7175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:02 smithi076 ceph-mon[35401]: pgmap v7175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:02 smithi040 ceph-mon[32397]: pgmap v7175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:04 smithi146 ceph-mon[35807]: pgmap v7176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:04 smithi076 ceph-mon[35401]: pgmap v7176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:04 smithi040 ceph-mon[32397]: pgmap v7176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:06.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:06 smithi040 ceph-mon[32397]: pgmap v7177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:06.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8933.216531 secs 2024-07-26T16:02:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:06 smithi146 ceph-mon[35807]: pgmap v7177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8933.216531 secs 2024-07-26T16:02:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:06 smithi076 ceph-mon[35401]: pgmap v7177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8933.216531 secs 2024-07-26T16:02:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:08 smithi146 ceph-mon[35807]: pgmap v7178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:08 smithi076 ceph-mon[35401]: pgmap v7178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:08 smithi040 ceph-mon[32397]: pgmap v7178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:09 smithi040 ceph-mon[32397]: pgmap v7179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:09 smithi146 ceph-mon[35807]: pgmap v7179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:09 smithi076 ceph-mon[35401]: pgmap v7179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8938.216680 secs 2024-07-26T16:02:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8938.216680 secs 2024-07-26T16:02:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8938.216680 secs 2024-07-26T16:02:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:11 smithi040 ceph-mon[32397]: pgmap v7180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:11 smithi146 ceph-mon[35807]: pgmap v7180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:11 smithi076 ceph-mon[35401]: pgmap v7180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:14 smithi146 ceph-mon[35807]: pgmap v7181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:14 smithi076 ceph-mon[35401]: pgmap v7181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:14 smithi040 ceph-mon[32397]: pgmap v7181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:16 smithi146 ceph-mon[35807]: pgmap v7182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8943.216833 secs 2024-07-26T16:02:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:16 smithi076 ceph-mon[35401]: pgmap v7182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8943.216833 secs 2024-07-26T16:02:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:16 smithi040 ceph-mon[32397]: pgmap v7182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8943.216833 secs 2024-07-26T16:02:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:18 smithi146 ceph-mon[35807]: pgmap v7183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:18 smithi076 ceph-mon[35401]: pgmap v7183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:18 smithi040 ceph-mon[32397]: pgmap v7183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:20 smithi146 ceph-mon[35807]: pgmap v7184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:20 smithi076 ceph-mon[35401]: pgmap v7184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:20 smithi040 ceph-mon[32397]: pgmap v7184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8948.216978 secs 2024-07-26T16:02:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8948.216978 secs 2024-07-26T16:02:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8948.216978 secs 2024-07-26T16:02:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:22 smithi076 ceph-mon[35401]: pgmap v7185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:22 smithi040 ceph-mon[32397]: pgmap v7185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:22 smithi146 ceph-mon[35807]: pgmap v7185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:24.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:24 smithi146 ceph-mon[35807]: pgmap v7186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:24 smithi040 ceph-mon[32397]: pgmap v7186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:24 smithi076 ceph-mon[35401]: pgmap v7186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:26 smithi040 ceph-mon[32397]: pgmap v7187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8953.217119 secs 2024-07-26T16:02:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:26 smithi146 ceph-mon[35807]: pgmap v7187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8953.217119 secs 2024-07-26T16:02:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:26 smithi076 ceph-mon[35401]: pgmap v7187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8953.217119 secs 2024-07-26T16:02:28.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:28 smithi076 ceph-mon[35401]: pgmap v7188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:28 smithi040 ceph-mon[32397]: pgmap v7188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:28 smithi146 ceph-mon[35807]: pgmap v7188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:30 smithi040 ceph-mon[32397]: pgmap v7189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:30 smithi146 ceph-mon[35807]: pgmap v7189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:30 smithi076 ceph-mon[35401]: pgmap v7189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8958.217323 secs 2024-07-26T16:02:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8958.217323 secs 2024-07-26T16:02:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8958.217323 secs 2024-07-26T16:02:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:32 smithi040 ceph-mon[32397]: pgmap v7190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:32 smithi146 ceph-mon[35807]: pgmap v7190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:32 smithi076 ceph-mon[35401]: pgmap v7190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:34 smithi040 ceph-mon[32397]: pgmap v7191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:34 smithi146 ceph-mon[35807]: pgmap v7191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:34 smithi076 ceph-mon[35401]: pgmap v7191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:36 smithi040 ceph-mon[32397]: pgmap v7192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8963.217468 secs 2024-07-26T16:02:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:36 smithi146 ceph-mon[35807]: pgmap v7192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8963.217468 secs 2024-07-26T16:02:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:36 smithi076 ceph-mon[35401]: pgmap v7192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8963.217468 secs 2024-07-26T16:02:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:38 smithi040 ceph-mon[32397]: pgmap v7193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:38 smithi146 ceph-mon[35807]: pgmap v7193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:38 smithi076 ceph-mon[35401]: pgmap v7193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:40 smithi040 ceph-mon[32397]: pgmap v7194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:40 smithi146 ceph-mon[35807]: pgmap v7194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:40 smithi076 ceph-mon[35401]: pgmap v7194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8968.217644 secs 2024-07-26T16:02:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8968.217644 secs 2024-07-26T16:02:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8968.217644 secs 2024-07-26T16:02:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:42 smithi040 ceph-mon[32397]: pgmap v7195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:42 smithi146 ceph-mon[35807]: pgmap v7195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:42 smithi076 ceph-mon[35401]: pgmap v7195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:44 smithi040 ceph-mon[32397]: pgmap v7196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:44 smithi146 ceph-mon[35807]: pgmap v7196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:44 smithi076 ceph-mon[35401]: pgmap v7196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:46 smithi040 ceph-mon[32397]: pgmap v7197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8973.217804 secs 2024-07-26T16:02:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:46 smithi146 ceph-mon[35807]: pgmap v7197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8973.217804 secs 2024-07-26T16:02:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:46 smithi076 ceph-mon[35401]: pgmap v7197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8973.217804 secs 2024-07-26T16:02:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:48 smithi040 ceph-mon[32397]: pgmap v7198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:48 smithi146 ceph-mon[35807]: pgmap v7198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:48 smithi076 ceph-mon[35401]: pgmap v7198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:50 smithi040 ceph-mon[32397]: pgmap v7199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:50 smithi146 ceph-mon[35807]: pgmap v7199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:50 smithi076 ceph-mon[35401]: pgmap v7199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:02:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8978.217945 secs 2024-07-26T16:02:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8978.217945 secs 2024-07-26T16:02:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8978.217945 secs 2024-07-26T16:02:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:52 smithi040 ceph-mon[32397]: pgmap v7200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:52 smithi146 ceph-mon[35807]: pgmap v7200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:52 smithi076 ceph-mon[35401]: pgmap v7200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:54 smithi040 ceph-mon[32397]: pgmap v7201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:54 smithi146 ceph-mon[35807]: pgmap v7201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:54 smithi076 ceph-mon[35401]: pgmap v7201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:56 smithi040 ceph-mon[32397]: pgmap v7202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8983.218079 secs 2024-07-26T16:02:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:56 smithi146 ceph-mon[35807]: pgmap v7202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8983.218079 secs 2024-07-26T16:02:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:56 smithi076 ceph-mon[35401]: pgmap v7202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:02:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8983.218079 secs 2024-07-26T16:02:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:02:58 smithi146 ceph-mon[35807]: pgmap v7203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:02:58 smithi076 ceph-mon[35401]: pgmap v7203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:02:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:02:58 smithi040 ceph-mon[32397]: pgmap v7203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:00 smithi146 ceph-mon[35807]: pgmap v7204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:00 smithi076 ceph-mon[35401]: pgmap v7204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:00 smithi040 ceph-mon[32397]: pgmap v7204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8988.218216 secs 2024-07-26T16:03:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8988.218216 secs 2024-07-26T16:03:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8988.218216 secs 2024-07-26T16:03:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:02 smithi146 ceph-mon[35807]: pgmap v7205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:02 smithi076 ceph-mon[35401]: pgmap v7205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:02 smithi040 ceph-mon[32397]: pgmap v7205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:04 smithi146 ceph-mon[35807]: pgmap v7206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:04 smithi076 ceph-mon[35401]: pgmap v7206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:04 smithi040 ceph-mon[32397]: pgmap v7206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:06.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:06 smithi040 ceph-mon[32397]: pgmap v7207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:06.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8993.218379 secs 2024-07-26T16:03:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:06 smithi146 ceph-mon[35807]: pgmap v7207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8993.218379 secs 2024-07-26T16:03:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:06 smithi076 ceph-mon[35401]: pgmap v7207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8993.218379 secs 2024-07-26T16:03:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:08 smithi146 ceph-mon[35807]: pgmap v7208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:08 smithi076 ceph-mon[35401]: pgmap v7208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:08 smithi040 ceph-mon[32397]: pgmap v7208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:09 smithi146 ceph-mon[35807]: pgmap v7209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:09 smithi076 ceph-mon[35401]: pgmap v7209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:09 smithi040 ceph-mon[32397]: pgmap v7209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 8998.218523 secs 2024-07-26T16:03:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 8998.218523 secs 2024-07-26T16:03:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 8998.218523 secs 2024-07-26T16:03:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:11 smithi146 ceph-mon[35807]: pgmap v7210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:11 smithi076 ceph-mon[35401]: pgmap v7210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:11 smithi040 ceph-mon[32397]: pgmap v7210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:14 smithi040 ceph-mon[32397]: pgmap v7211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:14 smithi146 ceph-mon[35807]: pgmap v7211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:14 smithi076 ceph-mon[35401]: pgmap v7211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:16 smithi040 ceph-mon[32397]: pgmap v7212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9003.218657 secs 2024-07-26T16:03:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:16 smithi146 ceph-mon[35807]: pgmap v7212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9003.218657 secs 2024-07-26T16:03:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:16 smithi076 ceph-mon[35401]: pgmap v7212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9003.218657 secs 2024-07-26T16:03:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:18 smithi040 ceph-mon[32397]: pgmap v7213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:18 smithi146 ceph-mon[35807]: pgmap v7213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:18 smithi076 ceph-mon[35401]: pgmap v7213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:20 smithi040 ceph-mon[32397]: pgmap v7214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:20 smithi146 ceph-mon[35807]: pgmap v7214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:20 smithi076 ceph-mon[35401]: pgmap v7214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9008.218797 secs 2024-07-26T16:03:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9008.218797 secs 2024-07-26T16:03:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9008.218797 secs 2024-07-26T16:03:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:22 smithi040 ceph-mon[32397]: pgmap v7215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:22 smithi146 ceph-mon[35807]: pgmap v7215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:22 smithi076 ceph-mon[35401]: pgmap v7215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:24 smithi040 ceph-mon[32397]: pgmap v7216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:24 smithi146 ceph-mon[35807]: pgmap v7216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:24 smithi076 ceph-mon[35401]: pgmap v7216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:26 smithi040 ceph-mon[32397]: pgmap v7217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9013.218936 secs 2024-07-26T16:03:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:26 smithi146 ceph-mon[35807]: pgmap v7217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9013.218936 secs 2024-07-26T16:03:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:26 smithi076 ceph-mon[35401]: pgmap v7217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9013.218936 secs 2024-07-26T16:03:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:28 smithi040 ceph-mon[32397]: pgmap v7218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:28 smithi146 ceph-mon[35807]: pgmap v7218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:28 smithi076 ceph-mon[35401]: pgmap v7218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:30 smithi040 ceph-mon[32397]: pgmap v7219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:30 smithi146 ceph-mon[35807]: pgmap v7219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:30 smithi076 ceph-mon[35401]: pgmap v7219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9018.219094 secs 2024-07-26T16:03:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9018.219094 secs 2024-07-26T16:03:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9018.219094 secs 2024-07-26T16:03:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:32 smithi040 ceph-mon[32397]: pgmap v7220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:32 smithi146 ceph-mon[35807]: pgmap v7220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:32 smithi076 ceph-mon[35401]: pgmap v7220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:34 smithi040 ceph-mon[32397]: pgmap v7221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:34 smithi146 ceph-mon[35807]: pgmap v7221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:34 smithi076 ceph-mon[35401]: pgmap v7221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:36 smithi040 ceph-mon[32397]: pgmap v7222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9023.219224 secs 2024-07-26T16:03:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:36 smithi146 ceph-mon[35807]: pgmap v7222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9023.219224 secs 2024-07-26T16:03:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:36 smithi076 ceph-mon[35401]: pgmap v7222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9023.219224 secs 2024-07-26T16:03:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:38 smithi040 ceph-mon[32397]: pgmap v7223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:38 smithi146 ceph-mon[35807]: pgmap v7223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:38 smithi076 ceph-mon[35401]: pgmap v7223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:40 smithi040 ceph-mon[32397]: pgmap v7224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:40 smithi146 ceph-mon[35807]: pgmap v7224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:40 smithi076 ceph-mon[35401]: pgmap v7224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9028.219396 secs 2024-07-26T16:03:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9028.219396 secs 2024-07-26T16:03:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9028.219396 secs 2024-07-26T16:03:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:42 smithi040 ceph-mon[32397]: pgmap v7225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:42 smithi146 ceph-mon[35807]: pgmap v7225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:42 smithi076 ceph-mon[35401]: pgmap v7225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:44 smithi146 ceph-mon[35807]: pgmap v7226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:44 smithi076 ceph-mon[35401]: pgmap v7226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:44 smithi040 ceph-mon[32397]: pgmap v7226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:46 smithi146 ceph-mon[35807]: pgmap v7227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9033.219539 secs 2024-07-26T16:03:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:46 smithi076 ceph-mon[35401]: pgmap v7227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9033.219539 secs 2024-07-26T16:03:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:46 smithi040 ceph-mon[32397]: pgmap v7227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9033.219539 secs 2024-07-26T16:03:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:48 smithi146 ceph-mon[35807]: pgmap v7228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:48 smithi076 ceph-mon[35401]: pgmap v7228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:48 smithi040 ceph-mon[32397]: pgmap v7228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:50 smithi146 ceph-mon[35807]: pgmap v7229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:50 smithi076 ceph-mon[35401]: pgmap v7229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:50 smithi040 ceph-mon[32397]: pgmap v7229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:03:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9038.219699 secs 2024-07-26T16:03:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9038.219699 secs 2024-07-26T16:03:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9038.219699 secs 2024-07-26T16:03:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:52 smithi146 ceph-mon[35807]: pgmap v7230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:52 smithi076 ceph-mon[35401]: pgmap v7230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:52 smithi040 ceph-mon[32397]: pgmap v7230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:54 smithi146 ceph-mon[35807]: pgmap v7231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:54 smithi076 ceph-mon[35401]: pgmap v7231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:54 smithi040 ceph-mon[32397]: pgmap v7231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:56 smithi146 ceph-mon[35807]: pgmap v7232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9043.219837 secs 2024-07-26T16:03:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:56 smithi076 ceph-mon[35401]: pgmap v7232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9043.219837 secs 2024-07-26T16:03:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:56 smithi040 ceph-mon[32397]: pgmap v7232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:03:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9043.219837 secs 2024-07-26T16:03:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:03:58 smithi146 ceph-mon[35807]: pgmap v7233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:03:58 smithi076 ceph-mon[35401]: pgmap v7233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:03:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:03:58 smithi040 ceph-mon[32397]: pgmap v7233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:00 smithi146 ceph-mon[35807]: pgmap v7234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:00 smithi076 ceph-mon[35401]: pgmap v7234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:00 smithi040 ceph-mon[32397]: pgmap v7234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9048.219976 secs 2024-07-26T16:04:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9048.219976 secs 2024-07-26T16:04:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9048.219976 secs 2024-07-26T16:04:02.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:02 smithi146 ceph-mon[35807]: pgmap v7235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:02 smithi076 ceph-mon[35401]: pgmap v7235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:02 smithi040 ceph-mon[32397]: pgmap v7235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:04 smithi076 ceph-mon[35401]: pgmap v7236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:04 smithi040 ceph-mon[32397]: pgmap v7236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:04 smithi146 ceph-mon[35807]: pgmap v7236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:06 smithi076 ceph-mon[35401]: pgmap v7237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9053.220117 secs 2024-07-26T16:04:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:06 smithi040 ceph-mon[32397]: pgmap v7237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9053.220117 secs 2024-07-26T16:04:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:06 smithi146 ceph-mon[35807]: pgmap v7237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9053.220117 secs 2024-07-26T16:04:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:08 smithi040 ceph-mon[32397]: pgmap v7238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:08 smithi146 ceph-mon[35807]: pgmap v7238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:08 smithi076 ceph-mon[35401]: pgmap v7238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:10 smithi040 ceph-mon[32397]: pgmap v7239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:10 smithi146 ceph-mon[35807]: pgmap v7239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:10 smithi076 ceph-mon[35401]: pgmap v7239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9058.220256 secs 2024-07-26T16:04:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9058.220256 secs 2024-07-26T16:04:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9058.220256 secs 2024-07-26T16:04:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:12 smithi040 ceph-mon[32397]: pgmap v7240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:12.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:12 smithi146 ceph-mon[35807]: pgmap v7240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:12 smithi076 ceph-mon[35401]: pgmap v7240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:14 smithi040 ceph-mon[32397]: pgmap v7241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:14 smithi146 ceph-mon[35807]: pgmap v7241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:14 smithi076 ceph-mon[35401]: pgmap v7241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:16 smithi040 ceph-mon[32397]: pgmap v7242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9063.220391 secs 2024-07-26T16:04:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:16 smithi146 ceph-mon[35807]: pgmap v7242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9063.220391 secs 2024-07-26T16:04:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:16 smithi076 ceph-mon[35401]: pgmap v7242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9063.220391 secs 2024-07-26T16:04:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:18 smithi040 ceph-mon[32397]: pgmap v7243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:18 smithi146 ceph-mon[35807]: pgmap v7243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:18 smithi076 ceph-mon[35401]: pgmap v7243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:20 smithi040 ceph-mon[32397]: pgmap v7244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:20 smithi146 ceph-mon[35807]: pgmap v7244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:20 smithi076 ceph-mon[35401]: pgmap v7244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9068.220533 secs 2024-07-26T16:04:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9068.220533 secs 2024-07-26T16:04:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9068.220533 secs 2024-07-26T16:04:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:22 smithi040 ceph-mon[32397]: pgmap v7245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:22 smithi146 ceph-mon[35807]: pgmap v7245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:22 smithi076 ceph-mon[35401]: pgmap v7245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:24 smithi040 ceph-mon[32397]: pgmap v7246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:24 smithi146 ceph-mon[35807]: pgmap v7246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:24 smithi076 ceph-mon[35401]: pgmap v7246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:26 smithi040 ceph-mon[32397]: pgmap v7247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9073.220675 secs 2024-07-26T16:04:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:26 smithi146 ceph-mon[35807]: pgmap v7247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9073.220675 secs 2024-07-26T16:04:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:26 smithi076 ceph-mon[35401]: pgmap v7247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9073.220675 secs 2024-07-26T16:04:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:28 smithi040 ceph-mon[32397]: pgmap v7248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:28 smithi146 ceph-mon[35807]: pgmap v7248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:28 smithi076 ceph-mon[35401]: pgmap v7248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:30 smithi040 ceph-mon[32397]: pgmap v7249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:30 smithi146 ceph-mon[35807]: pgmap v7249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:30 smithi076 ceph-mon[35401]: pgmap v7249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9078.220803 secs 2024-07-26T16:04:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9078.220803 secs 2024-07-26T16:04:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9078.220803 secs 2024-07-26T16:04:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:32 smithi040 ceph-mon[32397]: pgmap v7250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:32 smithi146 ceph-mon[35807]: pgmap v7250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:32 smithi076 ceph-mon[35401]: pgmap v7250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:34 smithi040 ceph-mon[32397]: pgmap v7251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:34 smithi146 ceph-mon[35807]: pgmap v7251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:34 smithi076 ceph-mon[35401]: pgmap v7251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:36 smithi040 ceph-mon[32397]: pgmap v7252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9083.220952 secs 2024-07-26T16:04:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:36 smithi146 ceph-mon[35807]: pgmap v7252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9083.220952 secs 2024-07-26T16:04:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:36 smithi076 ceph-mon[35401]: pgmap v7252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9083.220952 secs 2024-07-26T16:04:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:38 smithi040 ceph-mon[32397]: pgmap v7253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:38 smithi146 ceph-mon[35807]: pgmap v7253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:38 smithi076 ceph-mon[35401]: pgmap v7253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:40 smithi040 ceph-mon[32397]: pgmap v7254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:40 smithi146 ceph-mon[35807]: pgmap v7254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:40 smithi076 ceph-mon[35401]: pgmap v7254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:04:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9088.221092 secs 2024-07-26T16:04:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9088.221092 secs 2024-07-26T16:04:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9088.221092 secs 2024-07-26T16:04:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:42 smithi146 ceph-mon[35807]: pgmap v7255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:04:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:42 smithi076 ceph-mon[35401]: pgmap v7255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:04:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:42 smithi040 ceph-mon[32397]: pgmap v7255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:04:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:43 smithi146 ceph-mon[35807]: pgmap v7256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:43 smithi076 ceph-mon[35401]: pgmap v7256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:43 smithi040 ceph-mon[32397]: pgmap v7256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:46 smithi040 ceph-mon[32397]: pgmap v7257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9093.221251 secs 2024-07-26T16:04:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:46 smithi146 ceph-mon[35807]: pgmap v7257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9093.221251 secs 2024-07-26T16:04:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:46 smithi076 ceph-mon[35401]: pgmap v7257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9093.221251 secs 2024-07-26T16:04:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:48 smithi040 ceph-mon[32397]: pgmap v7258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:48 smithi146 ceph-mon[35807]: pgmap v7258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:48 smithi076 ceph-mon[35401]: pgmap v7258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:50 smithi040 ceph-mon[32397]: pgmap v7259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:50 smithi146 ceph-mon[35807]: pgmap v7259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:50 smithi076 ceph-mon[35401]: pgmap v7259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:04:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9098.221381 secs 2024-07-26T16:04:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9098.221381 secs 2024-07-26T16:04:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9098.221381 secs 2024-07-26T16:04:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:52 smithi040 ceph-mon[32397]: pgmap v7260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:04:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:52 smithi146 ceph-mon[35807]: pgmap v7260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:04:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:52 smithi076 ceph-mon[35401]: pgmap v7260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:04:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:54 smithi040 ceph-mon[32397]: pgmap v7261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:54 smithi146 ceph-mon[35807]: pgmap v7261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:54 smithi076 ceph-mon[35401]: pgmap v7261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:56 smithi040 ceph-mon[32397]: pgmap v7262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:56.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9103.221528 secs 2024-07-26T16:04:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:56 smithi146 ceph-mon[35807]: pgmap v7262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9103.221528 secs 2024-07-26T16:04:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:56 smithi076 ceph-mon[35401]: pgmap v7262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:04:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9103.221528 secs 2024-07-26T16:04:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:04:58 smithi040 ceph-mon[32397]: pgmap v7263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:04:58 smithi146 ceph-mon[35807]: pgmap v7263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:04:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:04:58 smithi076 ceph-mon[35401]: pgmap v7263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:00 smithi040 ceph-mon[32397]: pgmap v7264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:00 smithi146 ceph-mon[35807]: pgmap v7264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:00 smithi076 ceph-mon[35401]: pgmap v7264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9108.221705 secs 2024-07-26T16:05:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9108.221705 secs 2024-07-26T16:05:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9108.221705 secs 2024-07-26T16:05:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:02 smithi040 ceph-mon[32397]: pgmap v7265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:02 smithi146 ceph-mon[35807]: pgmap v7265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:02 smithi076 ceph-mon[35401]: pgmap v7265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:04 smithi040 ceph-mon[32397]: pgmap v7266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:04 smithi146 ceph-mon[35807]: pgmap v7266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:04 smithi076 ceph-mon[35401]: pgmap v7266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:06 smithi146 ceph-mon[35807]: pgmap v7267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9113.221852 secs 2024-07-26T16:05:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:06 smithi076 ceph-mon[35401]: pgmap v7267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9113.221852 secs 2024-07-26T16:05:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:06 smithi040 ceph-mon[32397]: pgmap v7267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9113.221852 secs 2024-07-26T16:05:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:08 smithi146 ceph-mon[35807]: pgmap v7268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:08 smithi076 ceph-mon[35401]: pgmap v7268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:08 smithi040 ceph-mon[32397]: pgmap v7268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:10 smithi146 ceph-mon[35807]: pgmap v7269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:10 smithi076 ceph-mon[35401]: pgmap v7269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:10 smithi040 ceph-mon[32397]: pgmap v7269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9118.222003 secs 2024-07-26T16:05:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9118.222003 secs 2024-07-26T16:05:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9118.222003 secs 2024-07-26T16:05:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:12 smithi146 ceph-mon[35807]: pgmap v7270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:12 smithi076 ceph-mon[35401]: pgmap v7270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:12 smithi040 ceph-mon[32397]: pgmap v7270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:14 smithi146 ceph-mon[35807]: pgmap v7271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:14 smithi076 ceph-mon[35401]: pgmap v7271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:14 smithi040 ceph-mon[32397]: pgmap v7271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:16 smithi146 ceph-mon[35807]: pgmap v7272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9123.222174 secs 2024-07-26T16:05:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:16 smithi076 ceph-mon[35401]: pgmap v7272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9123.222174 secs 2024-07-26T16:05:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:16 smithi040 ceph-mon[32397]: pgmap v7272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9123.222174 secs 2024-07-26T16:05:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:18 smithi146 ceph-mon[35807]: pgmap v7273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:18 smithi076 ceph-mon[35401]: pgmap v7273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:18 smithi040 ceph-mon[32397]: pgmap v7273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:20 smithi146 ceph-mon[35807]: pgmap v7274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:20 smithi076 ceph-mon[35401]: pgmap v7274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:20 smithi040 ceph-mon[32397]: pgmap v7274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9128.222319 secs 2024-07-26T16:05:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9128.222319 secs 2024-07-26T16:05:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9128.222319 secs 2024-07-26T16:05:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:22 smithi146 ceph-mon[35807]: pgmap v7275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:05:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:22 smithi076 ceph-mon[35401]: pgmap v7275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:05:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:22 smithi040 ceph-mon[32397]: pgmap v7275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:05:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:24 smithi076 ceph-mon[35401]: pgmap v7276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:24 smithi040 ceph-mon[32397]: pgmap v7276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:24 smithi146 ceph-mon[35807]: pgmap v7276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:26.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:26 smithi076 ceph-mon[35401]: pgmap v7277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:26.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9133.222496 secs 2024-07-26T16:05:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:26 smithi040 ceph-mon[32397]: pgmap v7277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9133.222496 secs 2024-07-26T16:05:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:26 smithi146 ceph-mon[35807]: pgmap v7277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9133.222496 secs 2024-07-26T16:05:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:28 smithi040 ceph-mon[32397]: pgmap v7278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:28 smithi146 ceph-mon[35807]: pgmap v7278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:28 smithi076 ceph-mon[35401]: pgmap v7278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:30 smithi040 ceph-mon[32397]: pgmap v7279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:30 smithi146 ceph-mon[35807]: pgmap v7279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:30 smithi076 ceph-mon[35401]: pgmap v7279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9138.222601 secs 2024-07-26T16:05:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9138.222601 secs 2024-07-26T16:05:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9138.222601 secs 2024-07-26T16:05:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:32 smithi040 ceph-mon[32397]: pgmap v7280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:32 smithi146 ceph-mon[35807]: pgmap v7280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:32 smithi076 ceph-mon[35401]: pgmap v7280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:34 smithi040 ceph-mon[32397]: pgmap v7281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:34 smithi146 ceph-mon[35807]: pgmap v7281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:34 smithi076 ceph-mon[35401]: pgmap v7281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:36 smithi040 ceph-mon[32397]: pgmap v7282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9143.222747 secs 2024-07-26T16:05:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:36 smithi146 ceph-mon[35807]: pgmap v7282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9143.222747 secs 2024-07-26T16:05:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:36 smithi076 ceph-mon[35401]: pgmap v7282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9143.222747 secs 2024-07-26T16:05:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:38 smithi040 ceph-mon[32397]: pgmap v7283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:38 smithi146 ceph-mon[35807]: pgmap v7283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:38 smithi076 ceph-mon[35401]: pgmap v7283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:40 smithi040 ceph-mon[32397]: pgmap v7284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:40 smithi146 ceph-mon[35807]: pgmap v7284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:40 smithi076 ceph-mon[35401]: pgmap v7284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9148.222880 secs 2024-07-26T16:05:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9148.222880 secs 2024-07-26T16:05:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9148.222880 secs 2024-07-26T16:05:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:42 smithi040 ceph-mon[32397]: pgmap v7285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:42 smithi146 ceph-mon[35807]: pgmap v7285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:42 smithi076 ceph-mon[35401]: pgmap v7285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:44 smithi040 ceph-mon[32397]: pgmap v7286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:44 smithi146 ceph-mon[35807]: pgmap v7286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:44 smithi076 ceph-mon[35401]: pgmap v7286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:46 smithi040 ceph-mon[32397]: pgmap v7287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9153.223021 secs 2024-07-26T16:05:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:46 smithi146 ceph-mon[35807]: pgmap v7287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9153.223021 secs 2024-07-26T16:05:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:46 smithi076 ceph-mon[35401]: pgmap v7287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9153.223021 secs 2024-07-26T16:05:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:48 smithi040 ceph-mon[32397]: pgmap v7288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:48 smithi146 ceph-mon[35807]: pgmap v7288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:48 smithi076 ceph-mon[35401]: pgmap v7288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:50 smithi040 ceph-mon[32397]: pgmap v7289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:50 smithi146 ceph-mon[35807]: pgmap v7289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:50 smithi076 ceph-mon[35401]: pgmap v7289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:05:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9158.223167 secs 2024-07-26T16:05:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9158.223167 secs 2024-07-26T16:05:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9158.223167 secs 2024-07-26T16:05:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:52 smithi040 ceph-mon[32397]: pgmap v7290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:52 smithi146 ceph-mon[35807]: pgmap v7290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:52 smithi076 ceph-mon[35401]: pgmap v7290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:54 smithi040 ceph-mon[32397]: pgmap v7291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:54 smithi146 ceph-mon[35807]: pgmap v7291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:54 smithi076 ceph-mon[35401]: pgmap v7291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:56 smithi040 ceph-mon[32397]: pgmap v7292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9163.223340 secs 2024-07-26T16:05:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:56 smithi146 ceph-mon[35807]: pgmap v7292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9163.223340 secs 2024-07-26T16:05:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:56 smithi076 ceph-mon[35401]: pgmap v7292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:05:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9163.223340 secs 2024-07-26T16:05:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:05:58 smithi040 ceph-mon[32397]: pgmap v7293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:05:58 smithi146 ceph-mon[35807]: pgmap v7293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:05:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:05:58 smithi076 ceph-mon[35401]: pgmap v7293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:00 smithi040 ceph-mon[32397]: pgmap v7294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:00 smithi146 ceph-mon[35807]: pgmap v7294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:00 smithi076 ceph-mon[35401]: pgmap v7294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9168.223438 secs 2024-07-26T16:06:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9168.223438 secs 2024-07-26T16:06:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9168.223438 secs 2024-07-26T16:06:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:02 smithi146 ceph-mon[35807]: pgmap v7295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:02 smithi076 ceph-mon[35401]: pgmap v7295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:02 smithi040 ceph-mon[32397]: pgmap v7295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:03 smithi146 ceph-mon[35807]: pgmap v7296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:03 smithi076 ceph-mon[35401]: pgmap v7296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:03 smithi040 ceph-mon[32397]: pgmap v7296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:06 smithi040 ceph-mon[32397]: pgmap v7297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9173.223569 secs 2024-07-26T16:06:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:06 smithi146 ceph-mon[35807]: pgmap v7297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9173.223569 secs 2024-07-26T16:06:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:06 smithi076 ceph-mon[35401]: pgmap v7297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9173.223569 secs 2024-07-26T16:06:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:08 smithi040 ceph-mon[32397]: pgmap v7298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:08 smithi146 ceph-mon[35807]: pgmap v7298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:08 smithi076 ceph-mon[35401]: pgmap v7298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:10 smithi040 ceph-mon[32397]: pgmap v7299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:10 smithi146 ceph-mon[35807]: pgmap v7299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:10 smithi076 ceph-mon[35401]: pgmap v7299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9178.223671 secs 2024-07-26T16:06:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9178.223671 secs 2024-07-26T16:06:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9178.223671 secs 2024-07-26T16:06:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:12 smithi040 ceph-mon[32397]: pgmap v7300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:12 smithi146 ceph-mon[35807]: pgmap v7300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:12 smithi076 ceph-mon[35401]: pgmap v7300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:14 smithi146 ceph-mon[35807]: pgmap v7301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:14 smithi076 ceph-mon[35401]: pgmap v7301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:14 smithi040 ceph-mon[32397]: pgmap v7301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:16 smithi146 ceph-mon[35807]: pgmap v7302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9183.223813 secs 2024-07-26T16:06:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:16 smithi076 ceph-mon[35401]: pgmap v7302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9183.223813 secs 2024-07-26T16:06:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:16 smithi040 ceph-mon[32397]: pgmap v7302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9183.223813 secs 2024-07-26T16:06:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:18 smithi146 ceph-mon[35807]: pgmap v7303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:18 smithi076 ceph-mon[35401]: pgmap v7303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:18 smithi040 ceph-mon[32397]: pgmap v7303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:20 smithi146 ceph-mon[35807]: pgmap v7304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:20 smithi076 ceph-mon[35401]: pgmap v7304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:20 smithi040 ceph-mon[32397]: pgmap v7304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9188.223955 secs 2024-07-26T16:06:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9188.223955 secs 2024-07-26T16:06:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9188.223955 secs 2024-07-26T16:06:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:22 smithi146 ceph-mon[35807]: pgmap v7305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:22 smithi076 ceph-mon[35401]: pgmap v7305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:22 smithi040 ceph-mon[32397]: pgmap v7305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:24 smithi146 ceph-mon[35807]: pgmap v7306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:24 smithi076 ceph-mon[35401]: pgmap v7306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:24 smithi040 ceph-mon[32397]: pgmap v7306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:26 smithi146 ceph-mon[35807]: pgmap v7307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9193.224095 secs 2024-07-26T16:06:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:26 smithi076 ceph-mon[35401]: pgmap v7307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9193.224095 secs 2024-07-26T16:06:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:26 smithi040 ceph-mon[32397]: pgmap v7307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9193.224095 secs 2024-07-26T16:06:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:28 smithi146 ceph-mon[35807]: pgmap v7308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:28 smithi076 ceph-mon[35401]: pgmap v7308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:28 smithi040 ceph-mon[32397]: pgmap v7308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:30 smithi146 ceph-mon[35807]: pgmap v7309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:30 smithi076 ceph-mon[35401]: pgmap v7309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:30 smithi040 ceph-mon[32397]: pgmap v7309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9198.224250 secs 2024-07-26T16:06:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9198.224250 secs 2024-07-26T16:06:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9198.224250 secs 2024-07-26T16:06:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:32 smithi146 ceph-mon[35807]: pgmap v7310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:32 smithi076 ceph-mon[35401]: pgmap v7310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:32 smithi040 ceph-mon[32397]: pgmap v7310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:34 smithi076 ceph-mon[35401]: pgmap v7311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:34 smithi040 ceph-mon[32397]: pgmap v7311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:34 smithi146 ceph-mon[35807]: pgmap v7311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:36 smithi076 ceph-mon[35401]: pgmap v7312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:36.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9203.224371 secs 2024-07-26T16:06:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:36 smithi040 ceph-mon[32397]: pgmap v7312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9203.224371 secs 2024-07-26T16:06:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:36 smithi146 ceph-mon[35807]: pgmap v7312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9203.224371 secs 2024-07-26T16:06:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:38 smithi040 ceph-mon[32397]: pgmap v7313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:38 smithi146 ceph-mon[35807]: pgmap v7313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:38 smithi076 ceph-mon[35401]: pgmap v7313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:40 smithi040 ceph-mon[32397]: pgmap v7314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:40 smithi146 ceph-mon[35807]: pgmap v7314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:40 smithi076 ceph-mon[35401]: pgmap v7314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9208.224458 secs 2024-07-26T16:06:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9208.224458 secs 2024-07-26T16:06:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9208.224458 secs 2024-07-26T16:06:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:42 smithi040 ceph-mon[32397]: pgmap v7315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:42 smithi146 ceph-mon[35807]: pgmap v7315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:42 smithi076 ceph-mon[35401]: pgmap v7315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:44 smithi040 ceph-mon[32397]: pgmap v7316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:44 smithi146 ceph-mon[35807]: pgmap v7316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:44 smithi076 ceph-mon[35401]: pgmap v7316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:46 smithi040 ceph-mon[32397]: pgmap v7317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9213.224543 secs 2024-07-26T16:06:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:46 smithi146 ceph-mon[35807]: pgmap v7317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9213.224543 secs 2024-07-26T16:06:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:46 smithi076 ceph-mon[35401]: pgmap v7317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9213.224543 secs 2024-07-26T16:06:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:48 smithi040 ceph-mon[32397]: pgmap v7318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:48 smithi146 ceph-mon[35807]: pgmap v7318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:48 smithi076 ceph-mon[35401]: pgmap v7318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:50 smithi040 ceph-mon[32397]: pgmap v7319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:50 smithi146 ceph-mon[35807]: pgmap v7319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:50 smithi076 ceph-mon[35401]: pgmap v7319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:06:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9218.224680 secs 2024-07-26T16:06:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9218.224680 secs 2024-07-26T16:06:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9218.224680 secs 2024-07-26T16:06:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:52 smithi040 ceph-mon[32397]: pgmap v7320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:52 smithi146 ceph-mon[35807]: pgmap v7320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:52 smithi076 ceph-mon[35401]: pgmap v7320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:54 smithi040 ceph-mon[32397]: pgmap v7321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:54 smithi146 ceph-mon[35807]: pgmap v7321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:54 smithi076 ceph-mon[35401]: pgmap v7321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:56 smithi040 ceph-mon[32397]: pgmap v7322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9223.224774 secs 2024-07-26T16:06:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:56 smithi146 ceph-mon[35807]: pgmap v7322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9223.224774 secs 2024-07-26T16:06:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:56 smithi076 ceph-mon[35401]: pgmap v7322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:06:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9223.224774 secs 2024-07-26T16:06:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:06:58 smithi040 ceph-mon[32397]: pgmap v7323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:06:58 smithi146 ceph-mon[35807]: pgmap v7323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:06:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:06:58 smithi076 ceph-mon[35401]: pgmap v7323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:00 smithi040 ceph-mon[32397]: pgmap v7324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:00 smithi146 ceph-mon[35807]: pgmap v7324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:00 smithi076 ceph-mon[35401]: pgmap v7324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9228.224919 secs 2024-07-26T16:07:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9228.224919 secs 2024-07-26T16:07:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9228.224919 secs 2024-07-26T16:07:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:02 smithi040 ceph-mon[32397]: pgmap v7325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:02 smithi146 ceph-mon[35807]: pgmap v7325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:02 smithi076 ceph-mon[35401]: pgmap v7325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:04 smithi040 ceph-mon[32397]: pgmap v7326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:04 smithi146 ceph-mon[35807]: pgmap v7326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:04 smithi076 ceph-mon[35401]: pgmap v7326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:06 smithi040 ceph-mon[32397]: pgmap v7327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:06.743 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9233.225005 secs 2024-07-26T16:07:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:06 smithi146 ceph-mon[35807]: pgmap v7327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9233.225005 secs 2024-07-26T16:07:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:06 smithi076 ceph-mon[35401]: pgmap v7327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9233.225005 secs 2024-07-26T16:07:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:08 smithi040 ceph-mon[32397]: pgmap v7328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:08 smithi146 ceph-mon[35807]: pgmap v7328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:08 smithi076 ceph-mon[35401]: pgmap v7328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:09 smithi040 ceph-mon[32397]: pgmap v7329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:09 smithi146 ceph-mon[35807]: pgmap v7329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:09 smithi076 ceph-mon[35401]: pgmap v7329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9238.225147 secs 2024-07-26T16:07:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9238.225147 secs 2024-07-26T16:07:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9238.225147 secs 2024-07-26T16:07:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:11 smithi040 ceph-mon[32397]: pgmap v7330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:11 smithi146 ceph-mon[35807]: pgmap v7330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:11 smithi076 ceph-mon[35401]: pgmap v7330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:14 smithi146 ceph-mon[35807]: pgmap v7331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:14 smithi076 ceph-mon[35401]: pgmap v7331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:14 smithi040 ceph-mon[32397]: pgmap v7331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:16 smithi146 ceph-mon[35807]: pgmap v7332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9243.225319 secs 2024-07-26T16:07:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:16 smithi076 ceph-mon[35401]: pgmap v7332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9243.225319 secs 2024-07-26T16:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:16 smithi040 ceph-mon[32397]: pgmap v7332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9243.225319 secs 2024-07-26T16:07:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:18 smithi146 ceph-mon[35807]: pgmap v7333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:18 smithi076 ceph-mon[35401]: pgmap v7333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:18 smithi040 ceph-mon[32397]: pgmap v7333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:20 smithi146 ceph-mon[35807]: pgmap v7334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:20 smithi076 ceph-mon[35401]: pgmap v7334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:20 smithi040 ceph-mon[32397]: pgmap v7334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9248.225458 secs 2024-07-26T16:07:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9248.225458 secs 2024-07-26T16:07:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9248.225458 secs 2024-07-26T16:07:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:22 smithi146 ceph-mon[35807]: pgmap v7335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:22 smithi076 ceph-mon[35401]: pgmap v7335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:22 smithi040 ceph-mon[32397]: pgmap v7335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:24 smithi146 ceph-mon[35807]: pgmap v7336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:24 smithi076 ceph-mon[35401]: pgmap v7336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:24 smithi040 ceph-mon[32397]: pgmap v7336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:26 smithi146 ceph-mon[35807]: pgmap v7337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9253.225604 secs 2024-07-26T16:07:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:26 smithi076 ceph-mon[35401]: pgmap v7337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9253.225604 secs 2024-07-26T16:07:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:26 smithi040 ceph-mon[32397]: pgmap v7337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9253.225604 secs 2024-07-26T16:07:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:28 smithi146 ceph-mon[35807]: pgmap v7338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:28 smithi076 ceph-mon[35401]: pgmap v7338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:28 smithi040 ceph-mon[32397]: pgmap v7338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:30 smithi146 ceph-mon[35807]: pgmap v7339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:30 smithi076 ceph-mon[35401]: pgmap v7339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:30 smithi040 ceph-mon[32397]: pgmap v7339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9258.225750 secs 2024-07-26T16:07:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9258.225750 secs 2024-07-26T16:07:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9258.225750 secs 2024-07-26T16:07:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:32 smithi076 ceph-mon[35401]: pgmap v7340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:32 smithi040 ceph-mon[32397]: pgmap v7340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:32 smithi146 ceph-mon[35807]: pgmap v7340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:34 smithi076 ceph-mon[35401]: pgmap v7341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:34 smithi040 ceph-mon[32397]: pgmap v7341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:34 smithi146 ceph-mon[35807]: pgmap v7341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:36 smithi040 ceph-mon[32397]: pgmap v7342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9263.225844 secs 2024-07-26T16:07:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:36 smithi146 ceph-mon[35807]: pgmap v7342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9263.225844 secs 2024-07-26T16:07:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:36 smithi076 ceph-mon[35401]: pgmap v7342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9263.225844 secs 2024-07-26T16:07:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:38 smithi040 ceph-mon[32397]: pgmap v7343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:38 smithi146 ceph-mon[35807]: pgmap v7343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:38 smithi076 ceph-mon[35401]: pgmap v7343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:40 smithi040 ceph-mon[32397]: pgmap v7344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:40 smithi146 ceph-mon[35807]: pgmap v7344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:40 smithi076 ceph-mon[35401]: pgmap v7344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9268.225993 secs 2024-07-26T16:07:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9268.225993 secs 2024-07-26T16:07:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9268.225993 secs 2024-07-26T16:07:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:42 smithi040 ceph-mon[32397]: pgmap v7345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:42 smithi146 ceph-mon[35807]: pgmap v7345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:42 smithi076 ceph-mon[35401]: pgmap v7345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:44 smithi040 ceph-mon[32397]: pgmap v7346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:44 smithi146 ceph-mon[35807]: pgmap v7346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:44.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:44 smithi076 ceph-mon[35401]: pgmap v7346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:46 smithi040 ceph-mon[32397]: pgmap v7347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9273.226134 secs 2024-07-26T16:07:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:46 smithi146 ceph-mon[35807]: pgmap v7347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9273.226134 secs 2024-07-26T16:07:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:46 smithi076 ceph-mon[35401]: pgmap v7347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9273.226134 secs 2024-07-26T16:07:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:48 smithi040 ceph-mon[32397]: pgmap v7348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:48 smithi146 ceph-mon[35807]: pgmap v7348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:48 smithi076 ceph-mon[35401]: pgmap v7348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:50 smithi040 ceph-mon[32397]: pgmap v7349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:50 smithi146 ceph-mon[35807]: pgmap v7349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:50 smithi076 ceph-mon[35401]: pgmap v7349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:07:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9278.226319 secs 2024-07-26T16:07:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9278.226319 secs 2024-07-26T16:07:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9278.226319 secs 2024-07-26T16:07:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:52 smithi040 ceph-mon[32397]: pgmap v7350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:52 smithi146 ceph-mon[35807]: pgmap v7350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:52 smithi076 ceph-mon[35401]: pgmap v7350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:54 smithi040 ceph-mon[32397]: pgmap v7351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:54 smithi146 ceph-mon[35807]: pgmap v7351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:54 smithi076 ceph-mon[35401]: pgmap v7351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:56 smithi040 ceph-mon[32397]: pgmap v7352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9283.226460 secs 2024-07-26T16:07:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:56 smithi146 ceph-mon[35807]: pgmap v7352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9283.226460 secs 2024-07-26T16:07:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:56 smithi076 ceph-mon[35401]: pgmap v7352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:07:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9283.226460 secs 2024-07-26T16:07:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:07:58 smithi040 ceph-mon[32397]: pgmap v7353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:07:58 smithi146 ceph-mon[35807]: pgmap v7353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:07:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:07:58 smithi076 ceph-mon[35401]: pgmap v7353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:00 smithi040 ceph-mon[32397]: pgmap v7354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:00 smithi146 ceph-mon[35807]: pgmap v7354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:00 smithi076 ceph-mon[35401]: pgmap v7354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9288.226605 secs 2024-07-26T16:08:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9288.226605 secs 2024-07-26T16:08:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9288.226605 secs 2024-07-26T16:08:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:02 smithi040 ceph-mon[32397]: pgmap v7355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:02 smithi146 ceph-mon[35807]: pgmap v7355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:02 smithi076 ceph-mon[35401]: pgmap v7355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:04 smithi040 ceph-mon[32397]: pgmap v7356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:04 smithi146 ceph-mon[35807]: pgmap v7356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:04.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:04 smithi076 ceph-mon[35401]: pgmap v7356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:06 smithi040 ceph-mon[32397]: pgmap v7357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9293.226767 secs 2024-07-26T16:08:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:06 smithi146 ceph-mon[35807]: pgmap v7357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9293.226767 secs 2024-07-26T16:08:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:06 smithi076 ceph-mon[35401]: pgmap v7357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9293.226767 secs 2024-07-26T16:08:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:08 smithi040 ceph-mon[32397]: pgmap v7358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:08 smithi146 ceph-mon[35807]: pgmap v7358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:08 smithi076 ceph-mon[35401]: pgmap v7358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:10 smithi040 ceph-mon[32397]: pgmap v7359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:10 smithi146 ceph-mon[35807]: pgmap v7359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:10 smithi076 ceph-mon[35401]: pgmap v7359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:11.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9298.226912 secs 2024-07-26T16:08:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9298.226912 secs 2024-07-26T16:08:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9298.226912 secs 2024-07-26T16:08:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:12 smithi146 ceph-mon[35807]: pgmap v7360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:12 smithi076 ceph-mon[35401]: pgmap v7360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:12 smithi040 ceph-mon[32397]: pgmap v7360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:14 smithi146 ceph-mon[35807]: pgmap v7361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:14 smithi076 ceph-mon[35401]: pgmap v7361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:14 smithi040 ceph-mon[32397]: pgmap v7361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:16 smithi146 ceph-mon[35807]: pgmap v7362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9303.227055 secs 2024-07-26T16:08:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:16 smithi076 ceph-mon[35401]: pgmap v7362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9303.227055 secs 2024-07-26T16:08:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:16 smithi040 ceph-mon[32397]: pgmap v7362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9303.227055 secs 2024-07-26T16:08:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:18 smithi146 ceph-mon[35807]: pgmap v7363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:18 smithi076 ceph-mon[35401]: pgmap v7363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:18 smithi040 ceph-mon[32397]: pgmap v7363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:20 smithi146 ceph-mon[35807]: pgmap v7364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:20 smithi076 ceph-mon[35401]: pgmap v7364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:20 smithi040 ceph-mon[32397]: pgmap v7364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9308.227231 secs 2024-07-26T16:08:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:21 smithi146 ceph-mon[35807]: pgmap v7365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9308.227231 secs 2024-07-26T16:08:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:21 smithi076 ceph-mon[35401]: pgmap v7365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9308.227231 secs 2024-07-26T16:08:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:21 smithi040 ceph-mon[32397]: pgmap v7365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:24 smithi146 ceph-mon[35807]: pgmap v7366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:24 smithi076 ceph-mon[35401]: pgmap v7366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:24 smithi040 ceph-mon[32397]: pgmap v7366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:26 smithi146 ceph-mon[35807]: pgmap v7367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:26.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9313.227367 secs 2024-07-26T16:08:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:26 smithi076 ceph-mon[35401]: pgmap v7367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9313.227367 secs 2024-07-26T16:08:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:26 smithi040 ceph-mon[32397]: pgmap v7367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9313.227367 secs 2024-07-26T16:08:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:28 smithi146 ceph-mon[35807]: pgmap v7368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:28 smithi076 ceph-mon[35401]: pgmap v7368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:28 smithi040 ceph-mon[32397]: pgmap v7368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:30 smithi146 ceph-mon[35807]: pgmap v7369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:30 smithi076 ceph-mon[35401]: pgmap v7369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:30 smithi040 ceph-mon[32397]: pgmap v7369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9318.227514 secs 2024-07-26T16:08:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9318.227514 secs 2024-07-26T16:08:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9318.227514 secs 2024-07-26T16:08:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:32 smithi076 ceph-mon[35401]: pgmap v7370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:32 smithi040 ceph-mon[32397]: pgmap v7370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:32 smithi146 ceph-mon[35807]: pgmap v7370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:34 smithi076 ceph-mon[35401]: pgmap v7371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:34 smithi040 ceph-mon[32397]: pgmap v7371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:34 smithi146 ceph-mon[35807]: pgmap v7371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:36 smithi040 ceph-mon[32397]: pgmap v7372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9323.227657 secs 2024-07-26T16:08:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:36 smithi146 ceph-mon[35807]: pgmap v7372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9323.227657 secs 2024-07-26T16:08:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:36 smithi076 ceph-mon[35401]: pgmap v7372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9323.227657 secs 2024-07-26T16:08:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:38 smithi040 ceph-mon[32397]: pgmap v7373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:38 smithi146 ceph-mon[35807]: pgmap v7373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:38 smithi076 ceph-mon[35401]: pgmap v7373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:40 smithi040 ceph-mon[32397]: pgmap v7374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:40 smithi146 ceph-mon[35807]: pgmap v7374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:40 smithi076 ceph-mon[35401]: pgmap v7374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9328.227800 secs 2024-07-26T16:08:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9328.227800 secs 2024-07-26T16:08:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9328.227800 secs 2024-07-26T16:08:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:42 smithi040 ceph-mon[32397]: pgmap v7375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:42 smithi146 ceph-mon[35807]: pgmap v7375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:42 smithi076 ceph-mon[35401]: pgmap v7375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:44 smithi040 ceph-mon[32397]: pgmap v7376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:44 smithi146 ceph-mon[35807]: pgmap v7376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:44 smithi076 ceph-mon[35401]: pgmap v7376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:46 smithi040 ceph-mon[32397]: pgmap v7377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9333.227940 secs 2024-07-26T16:08:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:46 smithi146 ceph-mon[35807]: pgmap v7377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9333.227940 secs 2024-07-26T16:08:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:46 smithi076 ceph-mon[35401]: pgmap v7377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9333.227940 secs 2024-07-26T16:08:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:48 smithi040 ceph-mon[32397]: pgmap v7378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:48 smithi146 ceph-mon[35807]: pgmap v7378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:48 smithi076 ceph-mon[35401]: pgmap v7378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:50 smithi040 ceph-mon[32397]: pgmap v7379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:50 smithi146 ceph-mon[35807]: pgmap v7379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:50 smithi076 ceph-mon[35401]: pgmap v7379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:08:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9338.228074 secs 2024-07-26T16:08:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9338.228074 secs 2024-07-26T16:08:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9338.228074 secs 2024-07-26T16:08:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:52 smithi040 ceph-mon[32397]: pgmap v7380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:52 smithi146 ceph-mon[35807]: pgmap v7380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:52 smithi076 ceph-mon[35401]: pgmap v7380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:54 smithi040 ceph-mon[32397]: pgmap v7381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:54 smithi146 ceph-mon[35807]: pgmap v7381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:54 smithi076 ceph-mon[35401]: pgmap v7381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:56 smithi040 ceph-mon[32397]: pgmap v7382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9343.228213 secs 2024-07-26T16:08:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:56 smithi146 ceph-mon[35807]: pgmap v7382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9343.228213 secs 2024-07-26T16:08:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:56 smithi076 ceph-mon[35401]: pgmap v7382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:08:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9343.228213 secs 2024-07-26T16:08:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:08:58 smithi040 ceph-mon[32397]: pgmap v7383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:08:58 smithi146 ceph-mon[35807]: pgmap v7383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:08:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:08:58 smithi076 ceph-mon[35401]: pgmap v7383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:00 smithi040 ceph-mon[32397]: pgmap v7384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:00 smithi146 ceph-mon[35807]: pgmap v7384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:00 smithi076 ceph-mon[35401]: pgmap v7384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9348.228358 secs 2024-07-26T16:09:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9348.228358 secs 2024-07-26T16:09:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9348.228358 secs 2024-07-26T16:09:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:02 smithi040 ceph-mon[32397]: pgmap v7385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:02 smithi146 ceph-mon[35807]: pgmap v7385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:02 smithi076 ceph-mon[35401]: pgmap v7385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:04 smithi040 ceph-mon[32397]: pgmap v7386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:04 smithi146 ceph-mon[35807]: pgmap v7386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:04 smithi076 ceph-mon[35401]: pgmap v7386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:06 smithi040 ceph-mon[32397]: pgmap v7387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9353.228500 secs 2024-07-26T16:09:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:06 smithi146 ceph-mon[35807]: pgmap v7387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9353.228500 secs 2024-07-26T16:09:06.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:06 smithi076 ceph-mon[35401]: pgmap v7387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:06.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9353.228500 secs 2024-07-26T16:09:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:08 smithi040 ceph-mon[32397]: pgmap v7388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:08 smithi146 ceph-mon[35807]: pgmap v7388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:08 smithi076 ceph-mon[35401]: pgmap v7388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:09 smithi040 ceph-mon[32397]: pgmap v7389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:09 smithi146 ceph-mon[35807]: pgmap v7389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:09 smithi076 ceph-mon[35401]: pgmap v7389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9358.228641 secs 2024-07-26T16:09:11.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9358.228641 secs 2024-07-26T16:09:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9358.228641 secs 2024-07-26T16:09:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:11 smithi040 ceph-mon[32397]: pgmap v7390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:11 smithi146 ceph-mon[35807]: pgmap v7390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:11 smithi076 ceph-mon[35401]: pgmap v7390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:14 smithi146 ceph-mon[35807]: pgmap v7391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:14 smithi076 ceph-mon[35401]: pgmap v7391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:14 smithi040 ceph-mon[32397]: pgmap v7391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:16 smithi076 ceph-mon[35401]: pgmap v7392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:16.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9363.228783 secs 2024-07-26T16:09:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:16 smithi040 ceph-mon[32397]: pgmap v7392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9363.228783 secs 2024-07-26T16:09:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:16 smithi146 ceph-mon[35807]: pgmap v7392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9363.228783 secs 2024-07-26T16:09:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:18 smithi076 ceph-mon[35401]: pgmap v7393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:18 smithi040 ceph-mon[32397]: pgmap v7393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:18 smithi146 ceph-mon[35807]: pgmap v7393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:20 smithi040 ceph-mon[32397]: pgmap v7394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:20 smithi146 ceph-mon[35807]: pgmap v7394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:20 smithi076 ceph-mon[35401]: pgmap v7394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9368.228924 secs 2024-07-26T16:09:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9368.228924 secs 2024-07-26T16:09:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9368.228924 secs 2024-07-26T16:09:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:22 smithi040 ceph-mon[32397]: pgmap v7395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:22 smithi146 ceph-mon[35807]: pgmap v7395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:22 smithi076 ceph-mon[35401]: pgmap v7395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:24.628 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:24 smithi146 ceph-mon[35807]: pgmap v7396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:24 smithi040 ceph-mon[32397]: pgmap v7396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:24 smithi076 ceph-mon[35401]: pgmap v7396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:26 smithi040 ceph-mon[32397]: pgmap v7397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9373.229058 secs 2024-07-26T16:09:26.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:26 smithi146 ceph-mon[35807]: pgmap v7397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:26.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9373.229058 secs 2024-07-26T16:09:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:26 smithi076 ceph-mon[35401]: pgmap v7397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9373.229058 secs 2024-07-26T16:09:28.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:28 smithi076 ceph-mon[35401]: pgmap v7398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:28 smithi040 ceph-mon[32397]: pgmap v7398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:28 smithi146 ceph-mon[35807]: pgmap v7398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:30 smithi040 ceph-mon[32397]: pgmap v7399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:30 smithi146 ceph-mon[35807]: pgmap v7399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:30 smithi076 ceph-mon[35401]: pgmap v7399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9378.229198 secs 2024-07-26T16:09:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9378.229198 secs 2024-07-26T16:09:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9378.229198 secs 2024-07-26T16:09:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:32 smithi040 ceph-mon[32397]: pgmap v7400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:32 smithi146 ceph-mon[35807]: pgmap v7400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:32 smithi076 ceph-mon[35401]: pgmap v7400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:34 smithi040 ceph-mon[32397]: pgmap v7401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:34 smithi146 ceph-mon[35807]: pgmap v7401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:34 smithi076 ceph-mon[35401]: pgmap v7401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:36 smithi040 ceph-mon[32397]: pgmap v7402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9383.229360 secs 2024-07-26T16:09:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:36 smithi146 ceph-mon[35807]: pgmap v7402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9383.229360 secs 2024-07-26T16:09:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:36 smithi076 ceph-mon[35401]: pgmap v7402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9383.229360 secs 2024-07-26T16:09:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:38 smithi040 ceph-mon[32397]: pgmap v7403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:38 smithi146 ceph-mon[35807]: pgmap v7403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:38 smithi076 ceph-mon[35401]: pgmap v7403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:40 smithi040 ceph-mon[32397]: pgmap v7404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:40 smithi146 ceph-mon[35807]: pgmap v7404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:40 smithi076 ceph-mon[35401]: pgmap v7404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9388.229459 secs 2024-07-26T16:09:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9388.229459 secs 2024-07-26T16:09:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9388.229459 secs 2024-07-26T16:09:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:42 smithi040 ceph-mon[32397]: pgmap v7405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:42 smithi146 ceph-mon[35807]: pgmap v7405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:42 smithi076 ceph-mon[35401]: pgmap v7405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:44 smithi040 ceph-mon[32397]: pgmap v7406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:44 smithi146 ceph-mon[35807]: pgmap v7406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:44 smithi076 ceph-mon[35401]: pgmap v7406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:46 smithi040 ceph-mon[32397]: pgmap v7407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9393.229593 secs 2024-07-26T16:09:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:46 smithi146 ceph-mon[35807]: pgmap v7407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9393.229593 secs 2024-07-26T16:09:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:46 smithi076 ceph-mon[35401]: pgmap v7407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9393.229593 secs 2024-07-26T16:09:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:48 smithi040 ceph-mon[32397]: pgmap v7408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:48 smithi146 ceph-mon[35807]: pgmap v7408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:48 smithi076 ceph-mon[35401]: pgmap v7408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:50 smithi040 ceph-mon[32397]: pgmap v7409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:50 smithi146 ceph-mon[35807]: pgmap v7409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:50 smithi076 ceph-mon[35401]: pgmap v7409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:09:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9398.229742 secs 2024-07-26T16:09:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9398.229742 secs 2024-07-26T16:09:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9398.229742 secs 2024-07-26T16:09:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:52 smithi146 ceph-mon[35807]: pgmap v7410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:52 smithi076 ceph-mon[35401]: pgmap v7410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:52 smithi040 ceph-mon[32397]: pgmap v7410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:54 smithi146 ceph-mon[35807]: pgmap v7411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:54 smithi076 ceph-mon[35401]: pgmap v7411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:54 smithi040 ceph-mon[32397]: pgmap v7411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:56 smithi146 ceph-mon[35807]: pgmap v7412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9403.229888 secs 2024-07-26T16:09:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:56 smithi076 ceph-mon[35401]: pgmap v7412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9403.229888 secs 2024-07-26T16:09:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:56 smithi040 ceph-mon[32397]: pgmap v7412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:09:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9403.229888 secs 2024-07-26T16:09:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:09:58 smithi146 ceph-mon[35807]: pgmap v7413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:09:58 smithi076 ceph-mon[35401]: pgmap v7413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:09:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:09:58 smithi040 ceph-mon[32397]: pgmap v7413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:00 smithi146 ceph-mon[35807]: pgmap v7414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:10:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:10:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:00 smithi076 ceph-mon[35401]: pgmap v7414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:10:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:10:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:00 smithi040 ceph-mon[32397]: pgmap v7414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:10:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:10:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9408.230053 secs 2024-07-26T16:10:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9408.230053 secs 2024-07-26T16:10:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9408.230053 secs 2024-07-26T16:10:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:02 smithi146 ceph-mon[35807]: pgmap v7415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:02 smithi076 ceph-mon[35401]: pgmap v7415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:02 smithi040 ceph-mon[32397]: pgmap v7415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:04 smithi146 ceph-mon[35807]: pgmap v7416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:04 smithi076 ceph-mon[35401]: pgmap v7416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:04 smithi040 ceph-mon[32397]: pgmap v7416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:06 smithi146 ceph-mon[35807]: pgmap v7417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9413.230146 secs 2024-07-26T16:10:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:06 smithi076 ceph-mon[35401]: pgmap v7417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9413.230146 secs 2024-07-26T16:10:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:06 smithi040 ceph-mon[32397]: pgmap v7417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9413.230146 secs 2024-07-26T16:10:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:07 smithi040 ceph-mon[32397]: pgmap v7418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:07 smithi146 ceph-mon[35807]: pgmap v7418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:07 smithi076 ceph-mon[35401]: pgmap v7418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:10 smithi040 ceph-mon[32397]: pgmap v7419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:10 smithi146 ceph-mon[35807]: pgmap v7419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:10 smithi076 ceph-mon[35401]: pgmap v7419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:10:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9418.230325 secs 2024-07-26T16:10:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9418.230325 secs 2024-07-26T16:10:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9418.230325 secs 2024-07-26T16:10:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:12 smithi040 ceph-mon[32397]: pgmap v7420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:12 smithi146 ceph-mon[35807]: pgmap v7420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:12 smithi076 ceph-mon[35401]: pgmap v7420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:14 smithi040 ceph-mon[32397]: pgmap v7421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:14.737 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:14 smithi076 ceph-mon[35401]: pgmap v7421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:14 smithi146 ceph-mon[35807]: pgmap v7421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:16 smithi040 ceph-mon[32397]: pgmap v7422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9423.230466 secs 2024-07-26T16:10:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:16 smithi146 ceph-mon[35807]: pgmap v7422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9423.230466 secs 2024-07-26T16:10:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:16 smithi076 ceph-mon[35401]: pgmap v7422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9423.230466 secs 2024-07-26T16:10:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:18 smithi040 ceph-mon[32397]: pgmap v7423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:18 smithi146 ceph-mon[35807]: pgmap v7423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:18 smithi076 ceph-mon[35401]: pgmap v7423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:20 smithi040 ceph-mon[32397]: pgmap v7424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:10:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:20 smithi146 ceph-mon[35807]: pgmap v7424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:10:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:20 smithi076 ceph-mon[35401]: pgmap v7424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:10:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9428.230606 secs 2024-07-26T16:10:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9428.230606 secs 2024-07-26T16:10:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9428.230606 secs 2024-07-26T16:10:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:22 smithi040 ceph-mon[32397]: pgmap v7425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:22 smithi146 ceph-mon[35807]: pgmap v7425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:22 smithi076 ceph-mon[35401]: pgmap v7425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:24 smithi040 ceph-mon[32397]: pgmap v7426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:24 smithi146 ceph-mon[35807]: pgmap v7426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:24 smithi076 ceph-mon[35401]: pgmap v7426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:26 smithi040 ceph-mon[32397]: pgmap v7427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9433.230746 secs 2024-07-26T16:10:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:26 smithi146 ceph-mon[35807]: pgmap v7427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9433.230746 secs 2024-07-26T16:10:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:26 smithi076 ceph-mon[35401]: pgmap v7427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9433.230746 secs 2024-07-26T16:10:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:28 smithi040 ceph-mon[32397]: pgmap v7428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:28 smithi146 ceph-mon[35807]: pgmap v7428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:28 smithi076 ceph-mon[35401]: pgmap v7428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:29.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:10:29.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:10:29.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:10:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:10:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:10:29.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:10:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:10:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:10:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:10:29.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:10:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:30 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:10:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:30 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:10:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:30 smithi040 ceph-mon[32397]: pgmap v7429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 907 B/s rd, 2 op/s 2024-07-26T16:10:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:30 smithi040 ceph-mon[32397]: pgmap v7430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:10:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:30 smithi040 ceph-mon[32397]: pgmap v7431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 703 B/s rd, 2 op/s 2024-07-26T16:10:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:30 smithi040 ceph-mon[32397]: pgmap v7432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 2 op/s 2024-07-26T16:10:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:30 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:10:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:30 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:10:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:30 smithi146 ceph-mon[35807]: pgmap v7429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 907 B/s rd, 2 op/s 2024-07-26T16:10:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:30 smithi146 ceph-mon[35807]: pgmap v7430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:10:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:30 smithi146 ceph-mon[35807]: pgmap v7431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 703 B/s rd, 2 op/s 2024-07-26T16:10:30.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:30 smithi146 ceph-mon[35807]: pgmap v7432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 2 op/s 2024-07-26T16:10:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:30 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:10:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:30 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:10:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:30 smithi076 ceph-mon[35401]: pgmap v7429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 907 B/s rd, 2 op/s 2024-07-26T16:10:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:30 smithi076 ceph-mon[35401]: pgmap v7430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:10:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:30 smithi076 ceph-mon[35401]: pgmap v7431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 703 B/s rd, 2 op/s 2024-07-26T16:10:30.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:30 smithi076 ceph-mon[35401]: pgmap v7432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 2 op/s 2024-07-26T16:10:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9438.230895 secs 2024-07-26T16:10:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9438.230895 secs 2024-07-26T16:10:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9438.230895 secs 2024-07-26T16:10:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:32 smithi040 ceph-mon[32397]: pgmap v7433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 1 op/s 2024-07-26T16:10:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:32 smithi146 ceph-mon[35807]: pgmap v7433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 1 op/s 2024-07-26T16:10:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:32 smithi076 ceph-mon[35401]: pgmap v7433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 1 op/s 2024-07-26T16:10:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:34 smithi040 ceph-mon[32397]: pgmap v7434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 1 op/s 2024-07-26T16:10:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:34 smithi146 ceph-mon[35807]: pgmap v7434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 1 op/s 2024-07-26T16:10:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:34 smithi076 ceph-mon[35401]: pgmap v7434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 969 B/s rd, 1 op/s 2024-07-26T16:10:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:36 smithi146 ceph-mon[35807]: pgmap v7435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T16:10:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9443.231048 secs 2024-07-26T16:10:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:36 smithi076 ceph-mon[35401]: pgmap v7435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T16:10:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9443.231048 secs 2024-07-26T16:10:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:36 smithi040 ceph-mon[32397]: pgmap v7435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T16:10:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9443.231048 secs 2024-07-26T16:10:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:38 smithi146 ceph-mon[35807]: pgmap v7436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:38 smithi076 ceph-mon[35401]: pgmap v7436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:38 smithi040 ceph-mon[32397]: pgmap v7436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:40 smithi146 ceph-mon[35807]: pgmap v7437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:10:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:40 smithi076 ceph-mon[35401]: pgmap v7437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:10:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:40 smithi040 ceph-mon[32397]: pgmap v7437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:10:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9448.231209 secs 2024-07-26T16:10:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9448.231209 secs 2024-07-26T16:10:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9448.231209 secs 2024-07-26T16:10:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:42 smithi146 ceph-mon[35807]: pgmap v7438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:42 smithi076 ceph-mon[35401]: pgmap v7438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:42 smithi040 ceph-mon[32397]: pgmap v7438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:10:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:44 smithi146 ceph-mon[35807]: pgmap v7439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:44 smithi076 ceph-mon[35401]: pgmap v7439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:44 smithi040 ceph-mon[32397]: pgmap v7439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:46 smithi146 ceph-mon[35807]: pgmap v7440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9453.231369 secs 2024-07-26T16:10:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:46 smithi076 ceph-mon[35401]: pgmap v7440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9453.231369 secs 2024-07-26T16:10:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:46 smithi040 ceph-mon[32397]: pgmap v7440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9453.231369 secs 2024-07-26T16:10:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:48 smithi146 ceph-mon[35807]: pgmap v7441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:48 smithi076 ceph-mon[35401]: pgmap v7441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:48 smithi040 ceph-mon[32397]: pgmap v7441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:50 smithi146 ceph-mon[35807]: pgmap v7442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:50 smithi076 ceph-mon[35401]: pgmap v7442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:50 smithi040 ceph-mon[32397]: pgmap v7442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9458.231516 secs 2024-07-26T16:10:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9458.231516 secs 2024-07-26T16:10:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9458.231516 secs 2024-07-26T16:10:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:52 smithi146 ceph-mon[35807]: pgmap v7443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:52.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:52 smithi076 ceph-mon[35401]: pgmap v7443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:52 smithi040 ceph-mon[32397]: pgmap v7443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:53 smithi040 ceph-mon[32397]: pgmap v7444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:53 smithi146 ceph-mon[35807]: pgmap v7444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:53 smithi076 ceph-mon[35401]: pgmap v7444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:55 smithi040 ceph-mon[32397]: pgmap v7445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:55 smithi146 ceph-mon[35807]: pgmap v7445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:55 smithi076 ceph-mon[35401]: pgmap v7445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:10:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9463.231612 secs 2024-07-26T16:10:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9463.231612 secs 2024-07-26T16:10:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9463.231612 secs 2024-07-26T16:10:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:57 smithi040 ceph-mon[32397]: pgmap v7446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:57 smithi146 ceph-mon[35807]: pgmap v7446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:57 smithi076 ceph-mon[35401]: pgmap v7446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:10:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:10:59 smithi040 ceph-mon[32397]: pgmap v7447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:10:59 smithi146 ceph-mon[35807]: pgmap v7447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:10:59 smithi076 ceph-mon[35401]: pgmap v7447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:01 smithi040 ceph-mon[32397]: pgmap v7448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9468.231772 secs 2024-07-26T16:11:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:01 smithi146 ceph-mon[35807]: pgmap v7448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9468.231772 secs 2024-07-26T16:11:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:01 smithi076 ceph-mon[35401]: pgmap v7448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9468.231772 secs 2024-07-26T16:11:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:03 smithi040 ceph-mon[32397]: pgmap v7449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:03 smithi146 ceph-mon[35807]: pgmap v7449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:03 smithi076 ceph-mon[35401]: pgmap v7449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:05 smithi040 ceph-mon[32397]: pgmap v7450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:05 smithi146 ceph-mon[35807]: pgmap v7450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:05 smithi076 ceph-mon[35401]: pgmap v7450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9473.231853 secs 2024-07-26T16:11:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9473.231853 secs 2024-07-26T16:11:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9473.231853 secs 2024-07-26T16:11:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:07 smithi040 ceph-mon[32397]: pgmap v7451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:07 smithi146 ceph-mon[35807]: pgmap v7451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:07 smithi076 ceph-mon[35401]: pgmap v7451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:09 smithi040 ceph-mon[32397]: pgmap v7452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:09 smithi146 ceph-mon[35807]: pgmap v7452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:09 smithi076 ceph-mon[35401]: pgmap v7452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9478.232012 secs 2024-07-26T16:11:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9478.232012 secs 2024-07-26T16:11:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9478.232012 secs 2024-07-26T16:11:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:11 smithi040 ceph-mon[32397]: pgmap v7453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:11 smithi146 ceph-mon[35807]: pgmap v7453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:11 smithi076 ceph-mon[35401]: pgmap v7453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:13 smithi146 ceph-mon[35807]: pgmap v7454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:13 smithi076 ceph-mon[35401]: pgmap v7454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:13 smithi040 ceph-mon[32397]: pgmap v7454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:15 smithi146 ceph-mon[35807]: pgmap v7455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9483.232152 secs 2024-07-26T16:11:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:15 smithi076 ceph-mon[35401]: pgmap v7455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9483.232152 secs 2024-07-26T16:11:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:15 smithi040 ceph-mon[32397]: pgmap v7455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9483.232152 secs 2024-07-26T16:11:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:17 smithi146 ceph-mon[35807]: pgmap v7456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:17 smithi076 ceph-mon[35401]: pgmap v7456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:17 smithi040 ceph-mon[32397]: pgmap v7456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:20 smithi146 ceph-mon[35807]: pgmap v7457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:20 smithi076 ceph-mon[35401]: pgmap v7457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:20 smithi040 ceph-mon[32397]: pgmap v7457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9488.232313 secs 2024-07-26T16:11:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9488.232313 secs 2024-07-26T16:11:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9488.232313 secs 2024-07-26T16:11:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:22 smithi146 ceph-mon[35807]: pgmap v7458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:22 smithi076 ceph-mon[35401]: pgmap v7458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:22 smithi040 ceph-mon[32397]: pgmap v7458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:24 smithi146 ceph-mon[35807]: pgmap v7459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:24 smithi076 ceph-mon[35401]: pgmap v7459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:24 smithi040 ceph-mon[32397]: pgmap v7459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:26 smithi146 ceph-mon[35807]: pgmap v7460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9493.232453 secs 2024-07-26T16:11:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:26 smithi076 ceph-mon[35401]: pgmap v7460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9493.232453 secs 2024-07-26T16:11:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:26 smithi040 ceph-mon[32397]: pgmap v7460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9493.232453 secs 2024-07-26T16:11:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:28 smithi146 ceph-mon[35807]: pgmap v7461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:28 smithi076 ceph-mon[35401]: pgmap v7461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:28 smithi040 ceph-mon[32397]: pgmap v7461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:29 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:11:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:29 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:11:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:29 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:11:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: pgmap v7462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:30 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: pgmap v7462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:30 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: pgmap v7462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:30 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9498.232550 secs 2024-07-26T16:11:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9498.232550 secs 2024-07-26T16:11:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9498.232550 secs 2024-07-26T16:11:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:32 smithi076 ceph-mon[35401]: pgmap v7463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:32 smithi040 ceph-mon[32397]: pgmap v7463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:32 smithi146 ceph-mon[35807]: pgmap v7463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: pgmap v7464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:34 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: pgmap v7464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:34 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: pgmap v7464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:34.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:34 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:36 smithi146 ceph-mon[35807]: pgmap v7465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9503.232710 secs 2024-07-26T16:11:36.586 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:36 smithi040 ceph-mon[32397]: pgmap v7465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:36.586 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9503.232710 secs 2024-07-26T16:11:36.776 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:36 smithi076 ceph-mon[35401]: pgmap v7465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:36.776 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9503.232710 secs 2024-07-26T16:11:38.556 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:38 smithi146 ceph-mon[35807]: pgmap v7466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:38 smithi040 ceph-mon[32397]: pgmap v7466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:38.763 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:38 smithi076 ceph-mon[35401]: pgmap v7466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: pgmap v7467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:11:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:11:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.487 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.487 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.487 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:11:40.487 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:40 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:11:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: pgmap v7467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:40.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:11:40.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:40 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:11:40.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: pgmap v7467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:40.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:11:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:11:40.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:40 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:11:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9508.232860 secs 2024-07-26T16:11:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9508.232860 secs 2024-07-26T16:11:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9508.232860 secs 2024-07-26T16:11:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:42 smithi040 ceph-mon[32397]: pgmap v7468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:42 smithi146 ceph-mon[35807]: pgmap v7468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:42 smithi076 ceph-mon[35401]: pgmap v7468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:44 smithi040 ceph-mon[32397]: pgmap v7469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:44 smithi146 ceph-mon[35807]: pgmap v7469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:44 smithi076 ceph-mon[35401]: pgmap v7469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:46 smithi040 ceph-mon[32397]: pgmap v7470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9513.232995 secs 2024-07-26T16:11:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:46 smithi146 ceph-mon[35807]: pgmap v7470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9513.232995 secs 2024-07-26T16:11:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:46 smithi076 ceph-mon[35401]: pgmap v7470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9513.232995 secs 2024-07-26T16:11:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:48 smithi040 ceph-mon[32397]: pgmap v7471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:48 smithi146 ceph-mon[35807]: pgmap v7471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:48 smithi076 ceph-mon[35401]: pgmap v7471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:50 smithi040 ceph-mon[32397]: pgmap v7472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:50 smithi146 ceph-mon[35807]: pgmap v7472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:50 smithi076 ceph-mon[35401]: pgmap v7472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:11:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9518.233170 secs 2024-07-26T16:11:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9518.233170 secs 2024-07-26T16:11:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9518.233170 secs 2024-07-26T16:11:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:52 smithi040 ceph-mon[32397]: pgmap v7473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:52 smithi146 ceph-mon[35807]: pgmap v7473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:52 smithi076 ceph-mon[35401]: pgmap v7473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:54 smithi040 ceph-mon[32397]: pgmap v7474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:54 smithi146 ceph-mon[35807]: pgmap v7474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:54 smithi076 ceph-mon[35401]: pgmap v7474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:56 smithi040 ceph-mon[32397]: pgmap v7475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9523.233374 secs 2024-07-26T16:11:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:56 smithi146 ceph-mon[35807]: pgmap v7475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9523.233374 secs 2024-07-26T16:11:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:56 smithi076 ceph-mon[35401]: pgmap v7475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:11:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9523.233374 secs 2024-07-26T16:11:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:11:58 smithi146 ceph-mon[35807]: pgmap v7476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:11:58 smithi040 ceph-mon[32397]: pgmap v7476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:11:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:11:58 smithi076 ceph-mon[35401]: pgmap v7476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:00 smithi040 ceph-mon[32397]: pgmap v7477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:00 smithi146 ceph-mon[35807]: pgmap v7477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:00 smithi076 ceph-mon[35401]: pgmap v7477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9528.233511 secs 2024-07-26T16:12:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9528.233511 secs 2024-07-26T16:12:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9528.233511 secs 2024-07-26T16:12:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:02 smithi040 ceph-mon[32397]: pgmap v7478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:02 smithi146 ceph-mon[35807]: pgmap v7478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:02 smithi076 ceph-mon[35401]: pgmap v7478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:04 smithi040 ceph-mon[32397]: pgmap v7479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:04 smithi146 ceph-mon[35807]: pgmap v7479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:04 smithi076 ceph-mon[35401]: pgmap v7479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:06 smithi040 ceph-mon[32397]: pgmap v7480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9533.233663 secs 2024-07-26T16:12:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:06 smithi146 ceph-mon[35807]: pgmap v7480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9533.233663 secs 2024-07-26T16:12:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:06 smithi076 ceph-mon[35401]: pgmap v7480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9533.233663 secs 2024-07-26T16:12:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:08 smithi040 ceph-mon[32397]: pgmap v7481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:08 smithi146 ceph-mon[35807]: pgmap v7481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:08 smithi076 ceph-mon[35401]: pgmap v7481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:10 smithi146 ceph-mon[35807]: pgmap v7482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:10 smithi076 ceph-mon[35401]: pgmap v7482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:10 smithi040 ceph-mon[32397]: pgmap v7482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9538.233794 secs 2024-07-26T16:12:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9538.233794 secs 2024-07-26T16:12:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9538.233794 secs 2024-07-26T16:12:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:12 smithi146 ceph-mon[35807]: pgmap v7483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:12 smithi076 ceph-mon[35401]: pgmap v7483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:12 smithi040 ceph-mon[32397]: pgmap v7483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:14 smithi146 ceph-mon[35807]: pgmap v7484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:14 smithi076 ceph-mon[35401]: pgmap v7484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:14 smithi040 ceph-mon[32397]: pgmap v7484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:16 smithi146 ceph-mon[35807]: pgmap v7485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9543.233932 secs 2024-07-26T16:12:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:16 smithi076 ceph-mon[35401]: pgmap v7485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9543.233932 secs 2024-07-26T16:12:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:16 smithi040 ceph-mon[32397]: pgmap v7485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9543.233932 secs 2024-07-26T16:12:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:18 smithi146 ceph-mon[35807]: pgmap v7486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:18 smithi076 ceph-mon[35401]: pgmap v7486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:18 smithi040 ceph-mon[32397]: pgmap v7486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:20 smithi146 ceph-mon[35807]: pgmap v7487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:20 smithi076 ceph-mon[35401]: pgmap v7487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:20 smithi040 ceph-mon[32397]: pgmap v7487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9548.234074 secs 2024-07-26T16:12:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9548.234074 secs 2024-07-26T16:12:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9548.234074 secs 2024-07-26T16:12:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:22 smithi146 ceph-mon[35807]: pgmap v7488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:22 smithi076 ceph-mon[35401]: pgmap v7488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:22 smithi040 ceph-mon[32397]: pgmap v7488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:24 smithi146 ceph-mon[35807]: pgmap v7489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:24 smithi076 ceph-mon[35401]: pgmap v7489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:24 smithi040 ceph-mon[32397]: pgmap v7489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:26 smithi076 ceph-mon[35401]: pgmap v7490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:26.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9553.234212 secs 2024-07-26T16:12:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:26 smithi040 ceph-mon[32397]: pgmap v7490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9553.234212 secs 2024-07-26T16:12:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:26 smithi146 ceph-mon[35807]: pgmap v7490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9553.234212 secs 2024-07-26T16:12:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:28 smithi076 ceph-mon[35401]: pgmap v7491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:28 smithi040 ceph-mon[32397]: pgmap v7491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:28 smithi146 ceph-mon[35807]: pgmap v7491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:30 smithi040 ceph-mon[32397]: pgmap v7492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:30 smithi146 ceph-mon[35807]: pgmap v7492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:30 smithi076 ceph-mon[35401]: pgmap v7492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9558.234350 secs 2024-07-26T16:12:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9558.234350 secs 2024-07-26T16:12:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9558.234350 secs 2024-07-26T16:12:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:32 smithi040 ceph-mon[32397]: pgmap v7493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:32 smithi146 ceph-mon[35807]: pgmap v7493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:32 smithi076 ceph-mon[35401]: pgmap v7493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:34 smithi040 ceph-mon[32397]: pgmap v7494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:34 smithi146 ceph-mon[35807]: pgmap v7494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:34 smithi076 ceph-mon[35401]: pgmap v7494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:36 smithi040 ceph-mon[32397]: pgmap v7495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9563.234487 secs 2024-07-26T16:12:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:36 smithi146 ceph-mon[35807]: pgmap v7495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9563.234487 secs 2024-07-26T16:12:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:36 smithi076 ceph-mon[35401]: pgmap v7495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9563.234487 secs 2024-07-26T16:12:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:38 smithi040 ceph-mon[32397]: pgmap v7496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:38 smithi146 ceph-mon[35807]: pgmap v7496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:38 smithi076 ceph-mon[35401]: pgmap v7496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:40 smithi040 ceph-mon[32397]: pgmap v7497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:40 smithi146 ceph-mon[35807]: pgmap v7497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:40 smithi076 ceph-mon[35401]: pgmap v7497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9568.234602 secs 2024-07-26T16:12:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9568.234602 secs 2024-07-26T16:12:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9568.234602 secs 2024-07-26T16:12:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:42 smithi040 ceph-mon[32397]: pgmap v7498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:42 smithi146 ceph-mon[35807]: pgmap v7498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:42 smithi076 ceph-mon[35401]: pgmap v7498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:44 smithi040 ceph-mon[32397]: pgmap v7499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:44 smithi146 ceph-mon[35807]: pgmap v7499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:44 smithi076 ceph-mon[35401]: pgmap v7499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:46 smithi040 ceph-mon[32397]: pgmap v7500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9573.234744 secs 2024-07-26T16:12:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:46 smithi146 ceph-mon[35807]: pgmap v7500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9573.234744 secs 2024-07-26T16:12:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:46 smithi076 ceph-mon[35401]: pgmap v7500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9573.234744 secs 2024-07-26T16:12:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:48 smithi040 ceph-mon[32397]: pgmap v7501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:48 smithi146 ceph-mon[35807]: pgmap v7501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:48 smithi076 ceph-mon[35401]: pgmap v7501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:50 smithi040 ceph-mon[32397]: pgmap v7502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:50 smithi146 ceph-mon[35807]: pgmap v7502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:50 smithi076 ceph-mon[35401]: pgmap v7502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:12:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9578.234887 secs 2024-07-26T16:12:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9578.234887 secs 2024-07-26T16:12:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9578.234887 secs 2024-07-26T16:12:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:52 smithi040 ceph-mon[32397]: pgmap v7503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:52 smithi146 ceph-mon[35807]: pgmap v7503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:52 smithi076 ceph-mon[35401]: pgmap v7503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:54 smithi040 ceph-mon[32397]: pgmap v7504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:54 smithi146 ceph-mon[35807]: pgmap v7504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:54 smithi076 ceph-mon[35401]: pgmap v7504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:56 smithi040 ceph-mon[32397]: pgmap v7505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9583.235041 secs 2024-07-26T16:12:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:56 smithi146 ceph-mon[35807]: pgmap v7505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9583.235041 secs 2024-07-26T16:12:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:56 smithi076 ceph-mon[35401]: pgmap v7505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:12:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9583.235041 secs 2024-07-26T16:12:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:12:58 smithi040 ceph-mon[32397]: pgmap v7506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:12:58 smithi146 ceph-mon[35807]: pgmap v7506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:12:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:12:58 smithi076 ceph-mon[35401]: pgmap v7506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:00 smithi040 ceph-mon[32397]: pgmap v7507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:00 smithi146 ceph-mon[35807]: pgmap v7507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:00 smithi076 ceph-mon[35401]: pgmap v7507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9588.235200 secs 2024-07-26T16:13:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9588.235200 secs 2024-07-26T16:13:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9588.235200 secs 2024-07-26T16:13:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:02 smithi146 ceph-mon[35807]: pgmap v7508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:02 smithi076 ceph-mon[35401]: pgmap v7508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:02 smithi040 ceph-mon[32397]: pgmap v7508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:04 smithi146 ceph-mon[35807]: pgmap v7509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:04 smithi076 ceph-mon[35401]: pgmap v7509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:04 smithi040 ceph-mon[32397]: pgmap v7509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:06.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:06 smithi040 ceph-mon[32397]: pgmap v7510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:06.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9593.235339 secs 2024-07-26T16:13:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:06 smithi146 ceph-mon[35807]: pgmap v7510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9593.235339 secs 2024-07-26T16:13:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:06 smithi076 ceph-mon[35401]: pgmap v7510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9593.235339 secs 2024-07-26T16:13:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:08 smithi146 ceph-mon[35807]: pgmap v7511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:08 smithi076 ceph-mon[35401]: pgmap v7511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:08 smithi040 ceph-mon[32397]: pgmap v7511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:10 smithi146 ceph-mon[35807]: pgmap v7512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:10 smithi076 ceph-mon[35401]: pgmap v7512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:10 smithi040 ceph-mon[32397]: pgmap v7512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9598.235486 secs 2024-07-26T16:13:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9598.235486 secs 2024-07-26T16:13:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9598.235486 secs 2024-07-26T16:13:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:12 smithi146 ceph-mon[35807]: pgmap v7513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:12 smithi076 ceph-mon[35401]: pgmap v7513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:12 smithi040 ceph-mon[32397]: pgmap v7513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:14 smithi146 ceph-mon[35807]: pgmap v7514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:14 smithi076 ceph-mon[35401]: pgmap v7514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:14 smithi040 ceph-mon[32397]: pgmap v7514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:16 smithi146 ceph-mon[35807]: pgmap v7515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9603.235627 secs 2024-07-26T16:13:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:16 smithi076 ceph-mon[35401]: pgmap v7515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9603.235627 secs 2024-07-26T16:13:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:16 smithi040 ceph-mon[32397]: pgmap v7515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9603.235627 secs 2024-07-26T16:13:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:18 smithi146 ceph-mon[35807]: pgmap v7516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:18 smithi076 ceph-mon[35401]: pgmap v7516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:18 smithi040 ceph-mon[32397]: pgmap v7516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:20 smithi146 ceph-mon[35807]: pgmap v7517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:20 smithi076 ceph-mon[35401]: pgmap v7517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:20 smithi040 ceph-mon[32397]: pgmap v7517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9608.235770 secs 2024-07-26T16:13:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9608.235770 secs 2024-07-26T16:13:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9608.235770 secs 2024-07-26T16:13:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:22 smithi040 ceph-mon[32397]: pgmap v7518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:22 smithi146 ceph-mon[35807]: pgmap v7518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:22 smithi076 ceph-mon[35401]: pgmap v7518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:24 smithi040 ceph-mon[32397]: pgmap v7519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:24 smithi146 ceph-mon[35807]: pgmap v7519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:24 smithi076 ceph-mon[35401]: pgmap v7519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:25 smithi040 ceph-mon[32397]: pgmap v7520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:25 smithi146 ceph-mon[35807]: pgmap v7520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:25 smithi076 ceph-mon[35401]: pgmap v7520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:26.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9613.235903 secs 2024-07-26T16:13:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9613.235903 secs 2024-07-26T16:13:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9613.235903 secs 2024-07-26T16:13:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:27 smithi040 ceph-mon[32397]: pgmap v7521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:27 smithi146 ceph-mon[35807]: pgmap v7521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:27 smithi076 ceph-mon[35401]: pgmap v7521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:29 smithi146 ceph-mon[35807]: pgmap v7522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:29 smithi076 ceph-mon[35401]: pgmap v7522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:29 smithi040 ceph-mon[32397]: pgmap v7522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9618.236043 secs 2024-07-26T16:13:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:31 smithi146 ceph-mon[35807]: pgmap v7523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9618.236043 secs 2024-07-26T16:13:32.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:31 smithi076 ceph-mon[35401]: pgmap v7523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9618.236043 secs 2024-07-26T16:13:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:31 smithi040 ceph-mon[32397]: pgmap v7523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:33 smithi146 ceph-mon[35807]: pgmap v7524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:33 smithi076 ceph-mon[35401]: pgmap v7524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:33 smithi040 ceph-mon[32397]: pgmap v7524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:36.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:35 smithi040 ceph-mon[32397]: pgmap v7525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:35 smithi146 ceph-mon[35807]: pgmap v7525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:35 smithi076 ceph-mon[35401]: pgmap v7525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9623.236170 secs 2024-07-26T16:13:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9623.236170 secs 2024-07-26T16:13:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9623.236170 secs 2024-07-26T16:13:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:37 smithi146 ceph-mon[35807]: pgmap v7526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:37 smithi076 ceph-mon[35401]: pgmap v7526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:37 smithi040 ceph-mon[32397]: pgmap v7526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:39 smithi146 ceph-mon[35807]: pgmap v7527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:39 smithi076 ceph-mon[35401]: pgmap v7527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:39 smithi040 ceph-mon[32397]: pgmap v7527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9628.236307 secs 2024-07-26T16:13:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:41 smithi146 ceph-mon[35807]: pgmap v7528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9628.236307 secs 2024-07-26T16:13:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:41 smithi076 ceph-mon[35401]: pgmap v7528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9628.236307 secs 2024-07-26T16:13:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:41 smithi040 ceph-mon[32397]: pgmap v7528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:43 smithi146 ceph-mon[35807]: pgmap v7529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:43 smithi076 ceph-mon[35401]: pgmap v7529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:43 smithi040 ceph-mon[32397]: pgmap v7529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:45 smithi076 ceph-mon[35401]: pgmap v7530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:46.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9633.236400 secs 2024-07-26T16:13:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:45 smithi040 ceph-mon[32397]: pgmap v7530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9633.236400 secs 2024-07-26T16:13:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:45 smithi146 ceph-mon[35807]: pgmap v7530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9633.236400 secs 2024-07-26T16:13:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:47 smithi076 ceph-mon[35401]: pgmap v7531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:47 smithi040 ceph-mon[32397]: pgmap v7531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:47 smithi146 ceph-mon[35807]: pgmap v7531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:49 smithi040 ceph-mon[32397]: pgmap v7532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:49 smithi146 ceph-mon[35807]: pgmap v7532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:49 smithi076 ceph-mon[35401]: pgmap v7532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:13:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9638.236494 secs 2024-07-26T16:13:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9638.236494 secs 2024-07-26T16:13:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9638.236494 secs 2024-07-26T16:13:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:51 smithi040 ceph-mon[32397]: pgmap v7533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:51 smithi146 ceph-mon[35807]: pgmap v7533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:51 smithi076 ceph-mon[35401]: pgmap v7533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:53 smithi040 ceph-mon[32397]: pgmap v7534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:53 smithi146 ceph-mon[35807]: pgmap v7534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:53 smithi076 ceph-mon[35401]: pgmap v7534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:56.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:55 smithi146 ceph-mon[35807]: pgmap v7535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:56.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9643.236626 secs 2024-07-26T16:13:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:55 smithi040 ceph-mon[32397]: pgmap v7535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9643.236626 secs 2024-07-26T16:13:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:55 smithi076 ceph-mon[35401]: pgmap v7535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:13:56.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9643.236626 secs 2024-07-26T16:13:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:57 smithi040 ceph-mon[32397]: pgmap v7536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:57 smithi146 ceph-mon[35807]: pgmap v7536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:13:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:57 smithi076 ceph-mon[35401]: pgmap v7536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:13:59 smithi040 ceph-mon[32397]: pgmap v7537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:13:59 smithi146 ceph-mon[35807]: pgmap v7537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:13:59 smithi076 ceph-mon[35401]: pgmap v7537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9648.236767 secs 2024-07-26T16:14:01.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9648.236767 secs 2024-07-26T16:14:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9648.236767 secs 2024-07-26T16:14:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:01 smithi040 ceph-mon[32397]: pgmap v7538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:01 smithi146 ceph-mon[35807]: pgmap v7538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:01 smithi076 ceph-mon[35401]: pgmap v7538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:03 smithi040 ceph-mon[32397]: pgmap v7539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:03 smithi146 ceph-mon[35807]: pgmap v7539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:03 smithi076 ceph-mon[35401]: pgmap v7539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:05 smithi040 ceph-mon[32397]: pgmap v7540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9653.236888 secs 2024-07-26T16:14:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:05 smithi146 ceph-mon[35807]: pgmap v7540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9653.236888 secs 2024-07-26T16:14:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:05 smithi076 ceph-mon[35401]: pgmap v7540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9653.236888 secs 2024-07-26T16:14:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:07 smithi040 ceph-mon[32397]: pgmap v7541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:07 smithi146 ceph-mon[35807]: pgmap v7541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:07 smithi076 ceph-mon[35401]: pgmap v7541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:09 smithi040 ceph-mon[32397]: pgmap v7542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:09 smithi146 ceph-mon[35807]: pgmap v7542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:09 smithi076 ceph-mon[35401]: pgmap v7542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9658.237051 secs 2024-07-26T16:14:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9658.237051 secs 2024-07-26T16:14:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9658.237051 secs 2024-07-26T16:14:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:11 smithi040 ceph-mon[32397]: pgmap v7543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:14:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:11 smithi146 ceph-mon[35807]: pgmap v7543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:14:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:11 smithi076 ceph-mon[35401]: pgmap v7543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:14:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:13 smithi040 ceph-mon[32397]: pgmap v7544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:13 smithi146 ceph-mon[35807]: pgmap v7544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:13 smithi076 ceph-mon[35401]: pgmap v7544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:15 smithi040 ceph-mon[32397]: pgmap v7545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9663.237205 secs 2024-07-26T16:14:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:15 smithi146 ceph-mon[35807]: pgmap v7545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9663.237205 secs 2024-07-26T16:14:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:15 smithi076 ceph-mon[35401]: pgmap v7545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9663.237205 secs 2024-07-26T16:14:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:17 smithi040 ceph-mon[32397]: pgmap v7546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:17 smithi146 ceph-mon[35807]: pgmap v7546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:17 smithi076 ceph-mon[35401]: pgmap v7546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:19 smithi040 ceph-mon[32397]: pgmap v7547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:19 smithi146 ceph-mon[35807]: pgmap v7547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:19 smithi076 ceph-mon[35401]: pgmap v7547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9668.237347 secs 2024-07-26T16:14:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9668.237347 secs 2024-07-26T16:14:21.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9668.237347 secs 2024-07-26T16:14:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:21 smithi146 ceph-mon[35807]: pgmap v7548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:21 smithi076 ceph-mon[35401]: pgmap v7548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:21 smithi040 ceph-mon[32397]: pgmap v7548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:24 smithi146 ceph-mon[35807]: pgmap v7549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:23 smithi076 ceph-mon[35401]: pgmap v7549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:23 smithi040 ceph-mon[32397]: pgmap v7549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:26 smithi146 ceph-mon[35807]: pgmap v7550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9673.237481 secs 2024-07-26T16:14:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:26 smithi076 ceph-mon[35401]: pgmap v7550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9673.237481 secs 2024-07-26T16:14:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:26 smithi040 ceph-mon[32397]: pgmap v7550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9673.237481 secs 2024-07-26T16:14:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:28 smithi146 ceph-mon[35807]: pgmap v7551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:28 smithi076 ceph-mon[35401]: pgmap v7551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:28 smithi040 ceph-mon[32397]: pgmap v7551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:30 smithi146 ceph-mon[35807]: pgmap v7552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:30 smithi076 ceph-mon[35401]: pgmap v7552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:30 smithi040 ceph-mon[32397]: pgmap v7552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9678.237584 secs 2024-07-26T16:14:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9678.237584 secs 2024-07-26T16:14:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9678.237584 secs 2024-07-26T16:14:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:32 smithi146 ceph-mon[35807]: pgmap v7553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:32 smithi076 ceph-mon[35401]: pgmap v7553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:32 smithi040 ceph-mon[32397]: pgmap v7553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:34 smithi146 ceph-mon[35807]: pgmap v7554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:34 smithi076 ceph-mon[35401]: pgmap v7554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:34 smithi040 ceph-mon[32397]: pgmap v7554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:36 smithi146 ceph-mon[35807]: pgmap v7555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9683.237715 secs 2024-07-26T16:14:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:36 smithi076 ceph-mon[35401]: pgmap v7555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9683.237715 secs 2024-07-26T16:14:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:36 smithi040 ceph-mon[32397]: pgmap v7555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9683.237715 secs 2024-07-26T16:14:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:38 smithi076 ceph-mon[35401]: pgmap v7556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:38 smithi040 ceph-mon[32397]: pgmap v7556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:38 smithi146 ceph-mon[35807]: pgmap v7556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:40 smithi076 ceph-mon[35401]: pgmap v7557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:40 smithi040 ceph-mon[32397]: pgmap v7557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:40 smithi146 ceph-mon[35807]: pgmap v7557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9688.237855 secs 2024-07-26T16:14:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9688.237855 secs 2024-07-26T16:14:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9688.237855 secs 2024-07-26T16:14:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:42 smithi040 ceph-mon[32397]: pgmap v7558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:42 smithi146 ceph-mon[35807]: pgmap v7558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:42 smithi076 ceph-mon[35401]: pgmap v7558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:44 smithi040 ceph-mon[32397]: pgmap v7559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:44 smithi146 ceph-mon[35807]: pgmap v7559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:44 smithi076 ceph-mon[35401]: pgmap v7559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:46 smithi040 ceph-mon[32397]: pgmap v7560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9693.238013 secs 2024-07-26T16:14:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:46 smithi146 ceph-mon[35807]: pgmap v7560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9693.238013 secs 2024-07-26T16:14:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:46 smithi076 ceph-mon[35401]: pgmap v7560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9693.238013 secs 2024-07-26T16:14:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:48 smithi040 ceph-mon[32397]: pgmap v7561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:48 smithi146 ceph-mon[35807]: pgmap v7561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:48 smithi076 ceph-mon[35401]: pgmap v7561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:50 smithi040 ceph-mon[32397]: pgmap v7562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:50 smithi146 ceph-mon[35807]: pgmap v7562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:50 smithi076 ceph-mon[35401]: pgmap v7562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:14:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9698.238178 secs 2024-07-26T16:14:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9698.238178 secs 2024-07-26T16:14:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9698.238178 secs 2024-07-26T16:14:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:52 smithi040 ceph-mon[32397]: pgmap v7563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:52 smithi146 ceph-mon[35807]: pgmap v7563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:52 smithi076 ceph-mon[35401]: pgmap v7563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:54 smithi040 ceph-mon[32397]: pgmap v7564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:54 smithi146 ceph-mon[35807]: pgmap v7564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:54 smithi076 ceph-mon[35401]: pgmap v7564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:56 smithi040 ceph-mon[32397]: pgmap v7565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9703.238351 secs 2024-07-26T16:14:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:56 smithi146 ceph-mon[35807]: pgmap v7565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9703.238351 secs 2024-07-26T16:14:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:56 smithi076 ceph-mon[35401]: pgmap v7565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:14:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9703.238351 secs 2024-07-26T16:14:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:14:58 smithi040 ceph-mon[32397]: pgmap v7566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:14:58 smithi146 ceph-mon[35807]: pgmap v7566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:14:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:14:58 smithi076 ceph-mon[35401]: pgmap v7566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:00 smithi040 ceph-mon[32397]: pgmap v7567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:00 smithi146 ceph-mon[35807]: pgmap v7567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:00 smithi076 ceph-mon[35401]: pgmap v7567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9708.238459 secs 2024-07-26T16:15:01.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9708.238459 secs 2024-07-26T16:15:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9708.238459 secs 2024-07-26T16:15:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:02 smithi040 ceph-mon[32397]: pgmap v7568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:02 smithi146 ceph-mon[35807]: pgmap v7568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:02 smithi076 ceph-mon[35401]: pgmap v7568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:04 smithi040 ceph-mon[32397]: pgmap v7569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:04 smithi146 ceph-mon[35807]: pgmap v7569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:04 smithi076 ceph-mon[35401]: pgmap v7569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:06 smithi040 ceph-mon[32397]: pgmap v7570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9713.238602 secs 2024-07-26T16:15:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:06 smithi146 ceph-mon[35807]: pgmap v7570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9713.238602 secs 2024-07-26T16:15:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:06 smithi076 ceph-mon[35401]: pgmap v7570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9713.238602 secs 2024-07-26T16:15:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:08 smithi040 ceph-mon[32397]: pgmap v7571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:08 smithi146 ceph-mon[35807]: pgmap v7571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:08 smithi076 ceph-mon[35401]: pgmap v7571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:10 smithi040 ceph-mon[32397]: pgmap v7572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:10 smithi146 ceph-mon[35807]: pgmap v7572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:10 smithi076 ceph-mon[35401]: pgmap v7572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9718.238732 secs 2024-07-26T16:15:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9718.238732 secs 2024-07-26T16:15:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9718.238732 secs 2024-07-26T16:15:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:12 smithi146 ceph-mon[35807]: pgmap v7573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:12 smithi076 ceph-mon[35401]: pgmap v7573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:12 smithi040 ceph-mon[32397]: pgmap v7573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:14 smithi146 ceph-mon[35807]: pgmap v7574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:14 smithi076 ceph-mon[35401]: pgmap v7574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:14 smithi040 ceph-mon[32397]: pgmap v7574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:16 smithi146 ceph-mon[35807]: pgmap v7575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9723.238884 secs 2024-07-26T16:15:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:16 smithi076 ceph-mon[35401]: pgmap v7575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9723.238884 secs 2024-07-26T16:15:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:16 smithi040 ceph-mon[32397]: pgmap v7575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9723.238884 secs 2024-07-26T16:15:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:18 smithi146 ceph-mon[35807]: pgmap v7576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:18 smithi076 ceph-mon[35401]: pgmap v7576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:18 smithi040 ceph-mon[32397]: pgmap v7576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:20 smithi146 ceph-mon[35807]: pgmap v7577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:20 smithi076 ceph-mon[35401]: pgmap v7577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:20 smithi040 ceph-mon[32397]: pgmap v7577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9728.239038 secs 2024-07-26T16:15:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9728.239038 secs 2024-07-26T16:15:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9728.239038 secs 2024-07-26T16:15:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:22 smithi146 ceph-mon[35807]: pgmap v7578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:15:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:22 smithi076 ceph-mon[35401]: pgmap v7578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:15:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:22 smithi040 ceph-mon[32397]: pgmap v7578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:15:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:24 smithi146 ceph-mon[35807]: pgmap v7579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:24 smithi076 ceph-mon[35401]: pgmap v7579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:24 smithi040 ceph-mon[32397]: pgmap v7579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:26 smithi146 ceph-mon[35807]: pgmap v7580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9733.239191 secs 2024-07-26T16:15:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:26 smithi076 ceph-mon[35401]: pgmap v7580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9733.239191 secs 2024-07-26T16:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:26 smithi040 ceph-mon[32397]: pgmap v7580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9733.239191 secs 2024-07-26T16:15:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:28 smithi146 ceph-mon[35807]: pgmap v7581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:28 smithi076 ceph-mon[35401]: pgmap v7581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:28 smithi040 ceph-mon[32397]: pgmap v7581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:30 smithi146 ceph-mon[35807]: pgmap v7582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:30 smithi076 ceph-mon[35401]: pgmap v7582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:30 smithi040 ceph-mon[32397]: pgmap v7582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:15:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9738.239334 secs 2024-07-26T16:15:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9738.239334 secs 2024-07-26T16:15:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9738.239334 secs 2024-07-26T16:15:32.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:32 smithi076 ceph-mon[35401]: pgmap v7583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:15:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:32 smithi040 ceph-mon[32397]: pgmap v7583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:15:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:32 smithi146 ceph-mon[35807]: pgmap v7583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:15:34.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:34 smithi076 ceph-mon[35401]: pgmap v7584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:34 smithi040 ceph-mon[32397]: pgmap v7584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:34 smithi146 ceph-mon[35807]: pgmap v7584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:36 smithi040 ceph-mon[32397]: pgmap v7585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9743.239437 secs 2024-07-26T16:15:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:36 smithi146 ceph-mon[35807]: pgmap v7585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9743.239437 secs 2024-07-26T16:15:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:36 smithi076 ceph-mon[35401]: pgmap v7585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9743.239437 secs 2024-07-26T16:15:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:38 smithi040 ceph-mon[32397]: pgmap v7586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:38 smithi146 ceph-mon[35807]: pgmap v7586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:38 smithi076 ceph-mon[35401]: pgmap v7586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:40 smithi040 ceph-mon[32397]: pgmap v7587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:40 smithi146 ceph-mon[35807]: pgmap v7587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:40 smithi076 ceph-mon[35401]: pgmap v7587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9748.239577 secs 2024-07-26T16:15:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9748.239577 secs 2024-07-26T16:15:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9748.239577 secs 2024-07-26T16:15:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:42 smithi040 ceph-mon[32397]: pgmap v7588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:42 smithi146 ceph-mon[35807]: pgmap v7588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:42 smithi076 ceph-mon[35401]: pgmap v7588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:44 smithi040 ceph-mon[32397]: pgmap v7589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:44 smithi146 ceph-mon[35807]: pgmap v7589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:44 smithi076 ceph-mon[35401]: pgmap v7589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:46 smithi040 ceph-mon[32397]: pgmap v7590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9753.239718 secs 2024-07-26T16:15:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:46 smithi146 ceph-mon[35807]: pgmap v7590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9753.239718 secs 2024-07-26T16:15:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:46 smithi076 ceph-mon[35401]: pgmap v7590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9753.239718 secs 2024-07-26T16:15:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:48 smithi040 ceph-mon[32397]: pgmap v7591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:48 smithi146 ceph-mon[35807]: pgmap v7591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:48 smithi076 ceph-mon[35401]: pgmap v7591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:50 smithi040 ceph-mon[32397]: pgmap v7592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:50 smithi146 ceph-mon[35807]: pgmap v7592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:50 smithi076 ceph-mon[35401]: pgmap v7592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:15:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9758.239880 secs 2024-07-26T16:15:51.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9758.239880 secs 2024-07-26T16:15:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9758.239880 secs 2024-07-26T16:15:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:52 smithi040 ceph-mon[32397]: pgmap v7593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:52 smithi146 ceph-mon[35807]: pgmap v7593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:52 smithi076 ceph-mon[35401]: pgmap v7593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:54 smithi040 ceph-mon[32397]: pgmap v7594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:54 smithi146 ceph-mon[35807]: pgmap v7594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:54 smithi076 ceph-mon[35401]: pgmap v7594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:56 smithi040 ceph-mon[32397]: pgmap v7595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9763.239977 secs 2024-07-26T16:15:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:56 smithi146 ceph-mon[35807]: pgmap v7595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9763.239977 secs 2024-07-26T16:15:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:56 smithi076 ceph-mon[35401]: pgmap v7595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:15:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9763.239977 secs 2024-07-26T16:15:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:15:58 smithi040 ceph-mon[32397]: pgmap v7596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:15:58 smithi146 ceph-mon[35807]: pgmap v7596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:15:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:15:58 smithi076 ceph-mon[35401]: pgmap v7596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:00 smithi040 ceph-mon[32397]: pgmap v7597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:00 smithi146 ceph-mon[35807]: pgmap v7597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:00 smithi076 ceph-mon[35401]: pgmap v7597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9768.240076 secs 2024-07-26T16:16:01.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9768.240076 secs 2024-07-26T16:16:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9768.240076 secs 2024-07-26T16:16:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:02 smithi040 ceph-mon[32397]: pgmap v7598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:02 smithi146 ceph-mon[35807]: pgmap v7598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:02 smithi076 ceph-mon[35401]: pgmap v7598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:04 smithi040 ceph-mon[32397]: pgmap v7599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:04 smithi146 ceph-mon[35807]: pgmap v7599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:04 smithi076 ceph-mon[35401]: pgmap v7599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:06 smithi040 ceph-mon[32397]: pgmap v7600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9773.240216 secs 2024-07-26T16:16:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:06 smithi146 ceph-mon[35807]: pgmap v7600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9773.240216 secs 2024-07-26T16:16:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:06 smithi076 ceph-mon[35401]: pgmap v7600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9773.240216 secs 2024-07-26T16:16:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:08 smithi040 ceph-mon[32397]: pgmap v7601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:08 smithi146 ceph-mon[35807]: pgmap v7601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:08 smithi076 ceph-mon[35401]: pgmap v7601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:10 smithi146 ceph-mon[35807]: pgmap v7602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:10 smithi076 ceph-mon[35401]: pgmap v7602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:10 smithi040 ceph-mon[32397]: pgmap v7602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9778.240359 secs 2024-07-26T16:16:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9778.240359 secs 2024-07-26T16:16:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9778.240359 secs 2024-07-26T16:16:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:12 smithi146 ceph-mon[35807]: pgmap v7603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:12 smithi076 ceph-mon[35401]: pgmap v7603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:12 smithi040 ceph-mon[32397]: pgmap v7603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:14 smithi146 ceph-mon[35807]: pgmap v7604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:14 smithi076 ceph-mon[35401]: pgmap v7604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:14 smithi040 ceph-mon[32397]: pgmap v7604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:16 smithi146 ceph-mon[35807]: pgmap v7605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9783.240501 secs 2024-07-26T16:16:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:16 smithi076 ceph-mon[35401]: pgmap v7605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9783.240501 secs 2024-07-26T16:16:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:16 smithi040 ceph-mon[32397]: pgmap v7605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9783.240501 secs 2024-07-26T16:16:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:18 smithi146 ceph-mon[35807]: pgmap v7606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:18 smithi076 ceph-mon[35401]: pgmap v7606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:18 smithi040 ceph-mon[32397]: pgmap v7606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:20 smithi146 ceph-mon[35807]: pgmap v7607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:20 smithi076 ceph-mon[35401]: pgmap v7607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:20 smithi040 ceph-mon[32397]: pgmap v7607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9788.240645 secs 2024-07-26T16:16:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9788.240645 secs 2024-07-26T16:16:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9788.240645 secs 2024-07-26T16:16:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:22 smithi146 ceph-mon[35807]: pgmap v7608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:22 smithi076 ceph-mon[35401]: pgmap v7608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:22 smithi040 ceph-mon[32397]: pgmap v7608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:24 smithi146 ceph-mon[35807]: pgmap v7609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:24 smithi076 ceph-mon[35401]: pgmap v7609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:24 smithi040 ceph-mon[32397]: pgmap v7609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:26 smithi146 ceph-mon[35807]: pgmap v7610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9793.240781 secs 2024-07-26T16:16:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:26 smithi076 ceph-mon[35401]: pgmap v7610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9793.240781 secs 2024-07-26T16:16:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:26 smithi040 ceph-mon[32397]: pgmap v7610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9793.240781 secs 2024-07-26T16:16:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:28 smithi076 ceph-mon[35401]: pgmap v7611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:28 smithi040 ceph-mon[32397]: pgmap v7611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:28 smithi146 ceph-mon[35807]: pgmap v7611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:30 smithi076 ceph-mon[35401]: pgmap v7612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:30 smithi040 ceph-mon[32397]: pgmap v7612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:30 smithi146 ceph-mon[35807]: pgmap v7612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9798.240941 secs 2024-07-26T16:16:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9798.240941 secs 2024-07-26T16:16:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9798.240941 secs 2024-07-26T16:16:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:32 smithi040 ceph-mon[32397]: pgmap v7613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:32 smithi146 ceph-mon[35807]: pgmap v7613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:32 smithi076 ceph-mon[35401]: pgmap v7613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:34 smithi040 ceph-mon[32397]: pgmap v7614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:34 smithi146 ceph-mon[35807]: pgmap v7614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:34 smithi076 ceph-mon[35401]: pgmap v7614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:36 smithi040 ceph-mon[32397]: pgmap v7615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9803.241084 secs 2024-07-26T16:16:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:36 smithi146 ceph-mon[35807]: pgmap v7615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9803.241084 secs 2024-07-26T16:16:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:36 smithi076 ceph-mon[35401]: pgmap v7615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9803.241084 secs 2024-07-26T16:16:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:38 smithi040 ceph-mon[32397]: pgmap v7616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:38 smithi146 ceph-mon[35807]: pgmap v7616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:38 smithi076 ceph-mon[35401]: pgmap v7616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:40 smithi040 ceph-mon[32397]: pgmap v7617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:40 smithi146 ceph-mon[35807]: pgmap v7617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:40 smithi076 ceph-mon[35401]: pgmap v7617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9808.241220 secs 2024-07-26T16:16:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9808.241220 secs 2024-07-26T16:16:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9808.241220 secs 2024-07-26T16:16:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:42 smithi040 ceph-mon[32397]: pgmap v7618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:42 smithi146 ceph-mon[35807]: pgmap v7618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:42 smithi076 ceph-mon[35401]: pgmap v7618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:43 smithi040 ceph-mon[32397]: pgmap v7619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:43 smithi146 ceph-mon[35807]: pgmap v7619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:43 smithi076 ceph-mon[35401]: pgmap v7619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:45 smithi040 ceph-mon[32397]: pgmap v7620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9813.241353 secs 2024-07-26T16:16:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:45 smithi146 ceph-mon[35807]: pgmap v7620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9813.241353 secs 2024-07-26T16:16:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:45 smithi076 ceph-mon[35401]: pgmap v7620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9813.241353 secs 2024-07-26T16:16:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:47 smithi040 ceph-mon[32397]: pgmap v7621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:47 smithi146 ceph-mon[35807]: pgmap v7621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:47 smithi076 ceph-mon[35401]: pgmap v7621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:49 smithi040 ceph-mon[32397]: pgmap v7622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:49 smithi146 ceph-mon[35807]: pgmap v7622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:49 smithi076 ceph-mon[35401]: pgmap v7622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:16:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9818.241490 secs 2024-07-26T16:16:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9818.241490 secs 2024-07-26T16:16:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9818.241490 secs 2024-07-26T16:16:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:51 smithi040 ceph-mon[32397]: pgmap v7623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:51 smithi146 ceph-mon[35807]: pgmap v7623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:51 smithi076 ceph-mon[35401]: pgmap v7623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:53 smithi040 ceph-mon[32397]: pgmap v7624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:53 smithi146 ceph-mon[35807]: pgmap v7624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:53 smithi076 ceph-mon[35401]: pgmap v7624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:55 smithi040 ceph-mon[32397]: pgmap v7625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9823.241633 secs 2024-07-26T16:16:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:55 smithi146 ceph-mon[35807]: pgmap v7625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9823.241633 secs 2024-07-26T16:16:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:55 smithi076 ceph-mon[35401]: pgmap v7625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:16:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9823.241633 secs 2024-07-26T16:16:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:57 smithi040 ceph-mon[32397]: pgmap v7626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:57 smithi146 ceph-mon[35807]: pgmap v7626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:16:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:57 smithi076 ceph-mon[35401]: pgmap v7626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:16:59 smithi040 ceph-mon[32397]: pgmap v7627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:16:59 smithi146 ceph-mon[35807]: pgmap v7627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:16:59 smithi076 ceph-mon[35401]: pgmap v7627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9828.241774 secs 2024-07-26T16:17:01.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9828.241774 secs 2024-07-26T16:17:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9828.241774 secs 2024-07-26T16:17:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:01 smithi040 ceph-mon[32397]: pgmap v7628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:01 smithi146 ceph-mon[35807]: pgmap v7628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:01 smithi076 ceph-mon[35401]: pgmap v7628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:03 smithi040 ceph-mon[32397]: pgmap v7629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:03 smithi146 ceph-mon[35807]: pgmap v7629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:03 smithi076 ceph-mon[35401]: pgmap v7629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:05 smithi040 ceph-mon[32397]: pgmap v7630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:05 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9833.241914 secs 2024-07-26T16:17:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:05 smithi146 ceph-mon[35807]: pgmap v7630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:05 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9833.241914 secs 2024-07-26T16:17:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:05 smithi076 ceph-mon[35401]: pgmap v7630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:05 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9833.241914 secs 2024-07-26T16:17:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:07 smithi040 ceph-mon[32397]: pgmap v7631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:07 smithi146 ceph-mon[35807]: pgmap v7631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:07 smithi076 ceph-mon[35401]: pgmap v7631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:09 smithi146 ceph-mon[35807]: pgmap v7632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:09 smithi076 ceph-mon[35401]: pgmap v7632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:09 smithi040 ceph-mon[32397]: pgmap v7632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9838.242057 secs 2024-07-26T16:17:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9838.242057 secs 2024-07-26T16:17:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9838.242057 secs 2024-07-26T16:17:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:11 smithi146 ceph-mon[35807]: pgmap v7633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:11 smithi076 ceph-mon[35401]: pgmap v7633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:11 smithi040 ceph-mon[32397]: pgmap v7633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:14 smithi146 ceph-mon[35807]: pgmap v7634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:14 smithi076 ceph-mon[35401]: pgmap v7634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:14 smithi040 ceph-mon[32397]: pgmap v7634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:16 smithi146 ceph-mon[35807]: pgmap v7635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9843.242202 secs 2024-07-26T16:17:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:16 smithi076 ceph-mon[35401]: pgmap v7635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9843.242202 secs 2024-07-26T16:17:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:16 smithi040 ceph-mon[32397]: pgmap v7635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9843.242202 secs 2024-07-26T16:17:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:18 smithi146 ceph-mon[35807]: pgmap v7636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:18 smithi076 ceph-mon[35401]: pgmap v7636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:18 smithi040 ceph-mon[32397]: pgmap v7636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:20 smithi146 ceph-mon[35807]: pgmap v7637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:20 smithi076 ceph-mon[35401]: pgmap v7637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:20 smithi040 ceph-mon[32397]: pgmap v7637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9848.242345 secs 2024-07-26T16:17:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9848.242345 secs 2024-07-26T16:17:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9848.242345 secs 2024-07-26T16:17:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:22 smithi146 ceph-mon[35807]: pgmap v7638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:22 smithi076 ceph-mon[35401]: pgmap v7638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:22 smithi040 ceph-mon[32397]: pgmap v7638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:24 smithi146 ceph-mon[35807]: pgmap v7639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:24 smithi076 ceph-mon[35401]: pgmap v7639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:24 smithi040 ceph-mon[32397]: pgmap v7639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:26 smithi146 ceph-mon[35807]: pgmap v7640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9853.242488 secs 2024-07-26T16:17:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:26 smithi076 ceph-mon[35401]: pgmap v7640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9853.242488 secs 2024-07-26T16:17:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:26 smithi040 ceph-mon[32397]: pgmap v7640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9853.242488 secs 2024-07-26T16:17:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:28 smithi146 ceph-mon[35807]: pgmap v7641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:28 smithi076 ceph-mon[35401]: pgmap v7641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:28 smithi040 ceph-mon[32397]: pgmap v7641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:30 smithi076 ceph-mon[35401]: pgmap v7642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:30 smithi040 ceph-mon[32397]: pgmap v7642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:30 smithi146 ceph-mon[35807]: pgmap v7642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9858.242629 secs 2024-07-26T16:17:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9858.242629 secs 2024-07-26T16:17:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9858.242629 secs 2024-07-26T16:17:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:32 smithi040 ceph-mon[32397]: pgmap v7643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:32 smithi146 ceph-mon[35807]: pgmap v7643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:32 smithi076 ceph-mon[35401]: pgmap v7643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:34 smithi040 ceph-mon[32397]: pgmap v7644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:34 smithi146 ceph-mon[35807]: pgmap v7644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:34 smithi076 ceph-mon[35401]: pgmap v7644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:36 smithi040 ceph-mon[32397]: pgmap v7645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9863.242720 secs 2024-07-26T16:17:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:36 smithi146 ceph-mon[35807]: pgmap v7645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9863.242720 secs 2024-07-26T16:17:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:36 smithi076 ceph-mon[35401]: pgmap v7645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9863.242720 secs 2024-07-26T16:17:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:38 smithi040 ceph-mon[32397]: pgmap v7646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:38 smithi146 ceph-mon[35807]: pgmap v7646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:38 smithi076 ceph-mon[35401]: pgmap v7646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:40 smithi040 ceph-mon[32397]: pgmap v7647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:40 smithi146 ceph-mon[35807]: pgmap v7647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:40 smithi076 ceph-mon[35401]: pgmap v7647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9868.242875 secs 2024-07-26T16:17:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9868.242875 secs 2024-07-26T16:17:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9868.242875 secs 2024-07-26T16:17:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:42 smithi040 ceph-mon[32397]: pgmap v7648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:42 smithi146 ceph-mon[35807]: pgmap v7648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:42 smithi076 ceph-mon[35401]: pgmap v7648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:44 smithi040 ceph-mon[32397]: pgmap v7649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:44 smithi146 ceph-mon[35807]: pgmap v7649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:44 smithi076 ceph-mon[35401]: pgmap v7649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:46 smithi040 ceph-mon[32397]: pgmap v7650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9873.243005 secs 2024-07-26T16:17:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:46 smithi146 ceph-mon[35807]: pgmap v7650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9873.243005 secs 2024-07-26T16:17:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:46 smithi076 ceph-mon[35401]: pgmap v7650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9873.243005 secs 2024-07-26T16:17:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:48 smithi040 ceph-mon[32397]: pgmap v7651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:48 smithi146 ceph-mon[35807]: pgmap v7651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:48 smithi076 ceph-mon[35401]: pgmap v7651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:50 smithi040 ceph-mon[32397]: pgmap v7652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:50 smithi146 ceph-mon[35807]: pgmap v7652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:50 smithi076 ceph-mon[35401]: pgmap v7652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:17:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9878.243139 secs 2024-07-26T16:17:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9878.243139 secs 2024-07-26T16:17:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9878.243139 secs 2024-07-26T16:17:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:52 smithi040 ceph-mon[32397]: pgmap v7653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:52 smithi146 ceph-mon[35807]: pgmap v7653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:52 smithi076 ceph-mon[35401]: pgmap v7653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:54 smithi040 ceph-mon[32397]: pgmap v7654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:54 smithi146 ceph-mon[35807]: pgmap v7654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:54 smithi076 ceph-mon[35401]: pgmap v7654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:56 smithi040 ceph-mon[32397]: pgmap v7655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9883.243327 secs 2024-07-26T16:17:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:56 smithi146 ceph-mon[35807]: pgmap v7655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9883.243327 secs 2024-07-26T16:17:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:56 smithi076 ceph-mon[35401]: pgmap v7655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:17:56.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9883.243327 secs 2024-07-26T16:17:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:17:58 smithi040 ceph-mon[32397]: pgmap v7656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:17:58 smithi146 ceph-mon[35807]: pgmap v7656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:17:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:17:58 smithi076 ceph-mon[35401]: pgmap v7656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:00 smithi040 ceph-mon[32397]: pgmap v7657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:00 smithi146 ceph-mon[35807]: pgmap v7657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:00 smithi076 ceph-mon[35401]: pgmap v7657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9888.243471 secs 2024-07-26T16:18:01.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9888.243471 secs 2024-07-26T16:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9888.243471 secs 2024-07-26T16:18:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:02 smithi040 ceph-mon[32397]: pgmap v7658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:02 smithi146 ceph-mon[35807]: pgmap v7658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:02 smithi076 ceph-mon[35401]: pgmap v7658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:04 smithi040 ceph-mon[32397]: pgmap v7659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:04 smithi146 ceph-mon[35807]: pgmap v7659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:04 smithi076 ceph-mon[35401]: pgmap v7659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:06 smithi146 ceph-mon[35807]: pgmap v7660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9893.243611 secs 2024-07-26T16:18:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:06 smithi076 ceph-mon[35401]: pgmap v7660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9893.243611 secs 2024-07-26T16:18:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:06 smithi040 ceph-mon[32397]: pgmap v7660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9893.243611 secs 2024-07-26T16:18:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:08 smithi146 ceph-mon[35807]: pgmap v7661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:08 smithi076 ceph-mon[35401]: pgmap v7661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:08 smithi040 ceph-mon[32397]: pgmap v7661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:10 smithi146 ceph-mon[35807]: pgmap v7662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:10 smithi076 ceph-mon[35401]: pgmap v7662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:10 smithi040 ceph-mon[32397]: pgmap v7662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9898.243752 secs 2024-07-26T16:18:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9898.243752 secs 2024-07-26T16:18:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9898.243752 secs 2024-07-26T16:18:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:12 smithi146 ceph-mon[35807]: pgmap v7663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:12 smithi076 ceph-mon[35401]: pgmap v7663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:12 smithi040 ceph-mon[32397]: pgmap v7663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:14 smithi146 ceph-mon[35807]: pgmap v7664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:14 smithi076 ceph-mon[35401]: pgmap v7664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:14 smithi040 ceph-mon[32397]: pgmap v7664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:16 smithi146 ceph-mon[35807]: pgmap v7665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9903.243894 secs 2024-07-26T16:18:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:16 smithi076 ceph-mon[35401]: pgmap v7665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9903.243894 secs 2024-07-26T16:18:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:16 smithi040 ceph-mon[32397]: pgmap v7665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9903.243894 secs 2024-07-26T16:18:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:18 smithi146 ceph-mon[35807]: pgmap v7666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:18 smithi076 ceph-mon[35401]: pgmap v7666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:18 smithi040 ceph-mon[32397]: pgmap v7666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:20 smithi146 ceph-mon[35807]: pgmap v7667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:20.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:20 smithi076 ceph-mon[35401]: pgmap v7667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:20 smithi040 ceph-mon[32397]: pgmap v7667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9908.244060 secs 2024-07-26T16:18:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9908.244060 secs 2024-07-26T16:18:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9908.244060 secs 2024-07-26T16:18:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:22 smithi076 ceph-mon[35401]: pgmap v7668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:22 smithi040 ceph-mon[32397]: pgmap v7668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:22 smithi146 ceph-mon[35807]: pgmap v7668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:24 smithi040 ceph-mon[32397]: pgmap v7669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:24 smithi146 ceph-mon[35807]: pgmap v7669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:24 smithi076 ceph-mon[35401]: pgmap v7669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:26.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:26 smithi146 ceph-mon[35807]: pgmap v7670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:26.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9913.244203 secs 2024-07-26T16:18:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:26 smithi040 ceph-mon[32397]: pgmap v7670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9913.244203 secs 2024-07-26T16:18:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:26 smithi076 ceph-mon[35401]: pgmap v7670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:26.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9913.244203 secs 2024-07-26T16:18:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:28 smithi040 ceph-mon[32397]: pgmap v7671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:28 smithi146 ceph-mon[35807]: pgmap v7671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:28 smithi076 ceph-mon[35401]: pgmap v7671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:30 smithi040 ceph-mon[32397]: pgmap v7672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:30 smithi146 ceph-mon[35807]: pgmap v7672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:30 smithi076 ceph-mon[35401]: pgmap v7672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9918.244342 secs 2024-07-26T16:18:31.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9918.244342 secs 2024-07-26T16:18:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9918.244342 secs 2024-07-26T16:18:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:32 smithi040 ceph-mon[32397]: pgmap v7673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:32 smithi146 ceph-mon[35807]: pgmap v7673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:32 smithi076 ceph-mon[35401]: pgmap v7673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:34 smithi040 ceph-mon[32397]: pgmap v7674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:34 smithi146 ceph-mon[35807]: pgmap v7674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:34 smithi076 ceph-mon[35401]: pgmap v7674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:36 smithi040 ceph-mon[32397]: pgmap v7675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9923.244484 secs 2024-07-26T16:18:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:36 smithi146 ceph-mon[35807]: pgmap v7675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9923.244484 secs 2024-07-26T16:18:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:36 smithi076 ceph-mon[35401]: pgmap v7675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9923.244484 secs 2024-07-26T16:18:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:38 smithi040 ceph-mon[32397]: pgmap v7676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:38 smithi146 ceph-mon[35807]: pgmap v7676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:38 smithi076 ceph-mon[35401]: pgmap v7676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:40 smithi040 ceph-mon[32397]: pgmap v7677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:40 smithi146 ceph-mon[35807]: pgmap v7677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:40 smithi076 ceph-mon[35401]: pgmap v7677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:18:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9928.244624 secs 2024-07-26T16:18:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9928.244624 secs 2024-07-26T16:18:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9928.244624 secs 2024-07-26T16:18:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:42 smithi040 ceph-mon[32397]: pgmap v7678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:42 smithi146 ceph-mon[35807]: pgmap v7678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:42 smithi076 ceph-mon[35401]: pgmap v7678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:44 smithi040 ceph-mon[32397]: pgmap v7679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:44 smithi146 ceph-mon[35807]: pgmap v7679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:44 smithi076 ceph-mon[35401]: pgmap v7679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:46 smithi040 ceph-mon[32397]: pgmap v7680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9933.244790 secs 2024-07-26T16:18:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:46 smithi146 ceph-mon[35807]: pgmap v7680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9933.244790 secs 2024-07-26T16:18:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:46 smithi076 ceph-mon[35401]: pgmap v7680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9933.244790 secs 2024-07-26T16:18:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:48 smithi040 ceph-mon[32397]: pgmap v7681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:48 smithi146 ceph-mon[35807]: pgmap v7681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:48 smithi076 ceph-mon[35401]: pgmap v7681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:50 smithi040 ceph-mon[32397]: pgmap v7682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:50 smithi146 ceph-mon[35807]: pgmap v7682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:50 smithi076 ceph-mon[35401]: pgmap v7682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9938.244939 secs 2024-07-26T16:18:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9938.244939 secs 2024-07-26T16:18:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9938.244939 secs 2024-07-26T16:18:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:52 smithi040 ceph-mon[32397]: pgmap v7683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:18:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:52 smithi146 ceph-mon[35807]: pgmap v7683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:18:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:52 smithi076 ceph-mon[35401]: pgmap v7683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:18:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:54 smithi040 ceph-mon[32397]: pgmap v7684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:54 smithi146 ceph-mon[35807]: pgmap v7684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:54 smithi076 ceph-mon[35401]: pgmap v7684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:18:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:56 smithi040 ceph-mon[32397]: pgmap v7685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9943.245079 secs 2024-07-26T16:18:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:56 smithi146 ceph-mon[35807]: pgmap v7685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9943.245079 secs 2024-07-26T16:18:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:56 smithi076 ceph-mon[35401]: pgmap v7685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:18:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9943.245079 secs 2024-07-26T16:18:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:18:58 smithi146 ceph-mon[35807]: pgmap v7686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:18:58 smithi076 ceph-mon[35401]: pgmap v7686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:18:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:18:58 smithi040 ceph-mon[32397]: pgmap v7686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:00 smithi146 ceph-mon[35807]: pgmap v7687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:00 smithi076 ceph-mon[35401]: pgmap v7687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:00 smithi040 ceph-mon[32397]: pgmap v7687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9948.245247 secs 2024-07-26T16:19:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9948.245247 secs 2024-07-26T16:19:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9948.245247 secs 2024-07-26T16:19:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:02 smithi146 ceph-mon[35807]: pgmap v7688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:02 smithi076 ceph-mon[35401]: pgmap v7688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:02 smithi040 ceph-mon[32397]: pgmap v7688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:04 smithi146 ceph-mon[35807]: pgmap v7689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:04 smithi076 ceph-mon[35401]: pgmap v7689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:04 smithi040 ceph-mon[32397]: pgmap v7689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:06.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:06 smithi040 ceph-mon[32397]: pgmap v7690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:06.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9953.245387 secs 2024-07-26T16:19:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:06 smithi146 ceph-mon[35807]: pgmap v7690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9953.245387 secs 2024-07-26T16:19:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:06 smithi076 ceph-mon[35401]: pgmap v7690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:06.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9953.245387 secs 2024-07-26T16:19:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:08 smithi146 ceph-mon[35807]: pgmap v7691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:08 smithi076 ceph-mon[35401]: pgmap v7691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:08 smithi040 ceph-mon[32397]: pgmap v7691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:10 smithi146 ceph-mon[35807]: pgmap v7692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:10 smithi076 ceph-mon[35401]: pgmap v7692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:10 smithi040 ceph-mon[32397]: pgmap v7692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9958.245532 secs 2024-07-26T16:19:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9958.245532 secs 2024-07-26T16:19:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9958.245532 secs 2024-07-26T16:19:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:12 smithi146 ceph-mon[35807]: pgmap v7693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:12 smithi076 ceph-mon[35401]: pgmap v7693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:12 smithi040 ceph-mon[32397]: pgmap v7693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:14 smithi146 ceph-mon[35807]: pgmap v7694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:14.898 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:14 smithi076 ceph-mon[35401]: pgmap v7694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:14 smithi040 ceph-mon[32397]: pgmap v7694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:16 smithi146 ceph-mon[35807]: pgmap v7695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9963.245634 secs 2024-07-26T16:19:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:16 smithi076 ceph-mon[35401]: pgmap v7695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9963.245634 secs 2024-07-26T16:19:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:16 smithi040 ceph-mon[32397]: pgmap v7695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9963.245634 secs 2024-07-26T16:19:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:18 smithi076 ceph-mon[35401]: pgmap v7696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:18 smithi040 ceph-mon[32397]: pgmap v7696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:18 smithi146 ceph-mon[35807]: pgmap v7696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:20 smithi076 ceph-mon[35401]: pgmap v7697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:20 smithi040 ceph-mon[32397]: pgmap v7697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:20 smithi146 ceph-mon[35807]: pgmap v7697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9968.245772 secs 2024-07-26T16:19:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9968.245772 secs 2024-07-26T16:19:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9968.245772 secs 2024-07-26T16:19:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:22 smithi040 ceph-mon[32397]: pgmap v7698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:22 smithi146 ceph-mon[35807]: pgmap v7698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:22 smithi076 ceph-mon[35401]: pgmap v7698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:24 smithi040 ceph-mon[32397]: pgmap v7699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:24 smithi146 ceph-mon[35807]: pgmap v7699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:24 smithi076 ceph-mon[35401]: pgmap v7699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:26.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:26 smithi146 ceph-mon[35807]: pgmap v7700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:26.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9973.245903 secs 2024-07-26T16:19:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:26 smithi040 ceph-mon[32397]: pgmap v7700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9973.245903 secs 2024-07-26T16:19:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:26 smithi076 ceph-mon[35401]: pgmap v7700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:27.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9973.245903 secs 2024-07-26T16:19:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:28 smithi040 ceph-mon[32397]: pgmap v7701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:28 smithi146 ceph-mon[35807]: pgmap v7701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:28 smithi076 ceph-mon[35401]: pgmap v7701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:30 smithi040 ceph-mon[32397]: pgmap v7702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:30 smithi146 ceph-mon[35807]: pgmap v7702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:30 smithi076 ceph-mon[35401]: pgmap v7702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9978.246069 secs 2024-07-26T16:19:31.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9978.246069 secs 2024-07-26T16:19:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9978.246069 secs 2024-07-26T16:19:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:32 smithi040 ceph-mon[32397]: pgmap v7703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:19:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:32 smithi146 ceph-mon[35807]: pgmap v7703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:19:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:32 smithi076 ceph-mon[35401]: pgmap v7703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:19:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:34 smithi040 ceph-mon[32397]: pgmap v7704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:34 smithi146 ceph-mon[35807]: pgmap v7704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:34 smithi076 ceph-mon[35401]: pgmap v7704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:36 smithi040 ceph-mon[32397]: pgmap v7705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9983.246198 secs 2024-07-26T16:19:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:36 smithi146 ceph-mon[35807]: pgmap v7705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9983.246198 secs 2024-07-26T16:19:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:36 smithi076 ceph-mon[35401]: pgmap v7705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9983.246198 secs 2024-07-26T16:19:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:38 smithi040 ceph-mon[32397]: pgmap v7706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:38 smithi146 ceph-mon[35807]: pgmap v7706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:38 smithi076 ceph-mon[35401]: pgmap v7706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:39 smithi040 ceph-mon[32397]: pgmap v7707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:39 smithi146 ceph-mon[35807]: pgmap v7707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:39 smithi076 ceph-mon[35401]: pgmap v7707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9988.246365 secs 2024-07-26T16:19:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9988.246365 secs 2024-07-26T16:19:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9988.246365 secs 2024-07-26T16:19:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:41 smithi146 ceph-mon[35807]: pgmap v7708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:41 smithi076 ceph-mon[35401]: pgmap v7708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:41 smithi040 ceph-mon[32397]: pgmap v7708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:43 smithi146 ceph-mon[35807]: pgmap v7709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:43 smithi076 ceph-mon[35401]: pgmap v7709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:43 smithi040 ceph-mon[32397]: pgmap v7709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:46 smithi146 ceph-mon[35807]: pgmap v7710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9993.246500 secs 2024-07-26T16:19:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:46 smithi076 ceph-mon[35401]: pgmap v7710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9993.246500 secs 2024-07-26T16:19:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:46 smithi040 ceph-mon[32397]: pgmap v7710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9993.246500 secs 2024-07-26T16:19:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:48 smithi146 ceph-mon[35807]: pgmap v7711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:48 smithi076 ceph-mon[35401]: pgmap v7711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:48 smithi040 ceph-mon[32397]: pgmap v7711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:50 smithi146 ceph-mon[35807]: pgmap v7712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:50 smithi076 ceph-mon[35401]: pgmap v7712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:50 smithi040 ceph-mon[32397]: pgmap v7712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:19:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 9998.246601 secs 2024-07-26T16:19:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 9998.246601 secs 2024-07-26T16:19:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 9998.246601 secs 2024-07-26T16:19:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:52 smithi146 ceph-mon[35807]: pgmap v7713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:52 smithi076 ceph-mon[35401]: pgmap v7713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:52 smithi040 ceph-mon[32397]: pgmap v7713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:54 smithi146 ceph-mon[35807]: pgmap v7714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:54 smithi076 ceph-mon[35401]: pgmap v7714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:54 smithi040 ceph-mon[32397]: pgmap v7714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:56 smithi146 ceph-mon[35807]: pgmap v7715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10003.246733 secs 2024-07-26T16:19:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:56 smithi076 ceph-mon[35401]: pgmap v7715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10003.246733 secs 2024-07-26T16:19:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:56 smithi040 ceph-mon[32397]: pgmap v7715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:19:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10003.246733 secs 2024-07-26T16:19:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:19:58 smithi146 ceph-mon[35807]: pgmap v7716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:19:58 smithi076 ceph-mon[35401]: pgmap v7716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:19:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:19:58 smithi040 ceph-mon[32397]: pgmap v7716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:00 smithi146 ceph-mon[35807]: pgmap v7717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:20:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:00 smithi076 ceph-mon[35401]: pgmap v7717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:20:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:00 smithi040 ceph-mon[32397]: pgmap v7717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:20:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10008.246871 secs 2024-07-26T16:20:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10008.246871 secs 2024-07-26T16:20:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10008.246871 secs 2024-07-26T16:20:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:02 smithi076 ceph-mon[35401]: pgmap v7718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:02 smithi040 ceph-mon[32397]: pgmap v7718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:02 smithi146 ceph-mon[35807]: pgmap v7718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:04 smithi040 ceph-mon[32397]: pgmap v7719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:04 smithi146 ceph-mon[35807]: pgmap v7719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:04 smithi076 ceph-mon[35401]: pgmap v7719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:06 smithi040 ceph-mon[32397]: pgmap v7720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10013.247029 secs 2024-07-26T16:20:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:06 smithi146 ceph-mon[35807]: pgmap v7720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10013.247029 secs 2024-07-26T16:20:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:06 smithi076 ceph-mon[35401]: pgmap v7720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:06.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10013.247029 secs 2024-07-26T16:20:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:08 smithi040 ceph-mon[32397]: pgmap v7721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:08 smithi146 ceph-mon[35807]: pgmap v7721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:08.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:08 smithi076 ceph-mon[35401]: pgmap v7721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:10 smithi040 ceph-mon[32397]: pgmap v7722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:10 smithi146 ceph-mon[35807]: pgmap v7722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:10 smithi076 ceph-mon[35401]: pgmap v7722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10018.247201 secs 2024-07-26T16:20:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10018.247201 secs 2024-07-26T16:20:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10018.247201 secs 2024-07-26T16:20:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:12 smithi040 ceph-mon[32397]: pgmap v7723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:12 smithi146 ceph-mon[35807]: pgmap v7723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:12 smithi076 ceph-mon[35401]: pgmap v7723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:14 smithi146 ceph-mon[35807]: pgmap v7724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:14 smithi040 ceph-mon[32397]: pgmap v7724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:14 smithi076 ceph-mon[35401]: pgmap v7724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:16 smithi146 ceph-mon[35807]: pgmap v7725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:16.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10023.247299 secs 2024-07-26T16:20:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:16 smithi076 ceph-mon[35401]: pgmap v7725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10023.247299 secs 2024-07-26T16:20:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:16 smithi040 ceph-mon[32397]: pgmap v7725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10023.247299 secs 2024-07-26T16:20:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:18 smithi146 ceph-mon[35807]: pgmap v7726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:18 smithi076 ceph-mon[35401]: pgmap v7726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:18 smithi040 ceph-mon[32397]: pgmap v7726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:20 smithi040 ceph-mon[32397]: pgmap v7727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:20 smithi146 ceph-mon[35807]: pgmap v7727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:20 smithi076 ceph-mon[35401]: pgmap v7727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10028.247438 secs 2024-07-26T16:20:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10028.247438 secs 2024-07-26T16:20:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10028.247438 secs 2024-07-26T16:20:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:22 smithi146 ceph-mon[35807]: pgmap v7728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:22 smithi076 ceph-mon[35401]: pgmap v7728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:22 smithi040 ceph-mon[32397]: pgmap v7728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:24 smithi146 ceph-mon[35807]: pgmap v7729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:24 smithi076 ceph-mon[35401]: pgmap v7729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:24 smithi040 ceph-mon[32397]: pgmap v7729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:26 smithi146 ceph-mon[35807]: pgmap v7730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10033.247580 secs 2024-07-26T16:20:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:26 smithi076 ceph-mon[35401]: pgmap v7730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10033.247580 secs 2024-07-26T16:20:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:26 smithi040 ceph-mon[32397]: pgmap v7730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:26.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10033.247580 secs 2024-07-26T16:20:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:28 smithi146 ceph-mon[35807]: pgmap v7731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:28 smithi076 ceph-mon[35401]: pgmap v7731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:28 smithi040 ceph-mon[32397]: pgmap v7731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:30 smithi146 ceph-mon[35807]: pgmap v7732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:30 smithi076 ceph-mon[35401]: pgmap v7732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:30 smithi040 ceph-mon[32397]: pgmap v7732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10038.247666 secs 2024-07-26T16:20:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10038.247666 secs 2024-07-26T16:20:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10038.247666 secs 2024-07-26T16:20:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:32 smithi146 ceph-mon[35807]: pgmap v7733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:32 smithi076 ceph-mon[35401]: pgmap v7733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:32 smithi040 ceph-mon[32397]: pgmap v7733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:34 smithi076 ceph-mon[35401]: pgmap v7734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:34 smithi040 ceph-mon[32397]: pgmap v7734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:34 smithi146 ceph-mon[35807]: pgmap v7734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:36 smithi076 ceph-mon[35401]: pgmap v7735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:36.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10043.247809 secs 2024-07-26T16:20:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:36 smithi040 ceph-mon[32397]: pgmap v7735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10043.247809 secs 2024-07-26T16:20:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:36 smithi146 ceph-mon[35807]: pgmap v7735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10043.247809 secs 2024-07-26T16:20:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:38 smithi040 ceph-mon[32397]: pgmap v7736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:38 smithi146 ceph-mon[35807]: pgmap v7736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:38 smithi076 ceph-mon[35401]: pgmap v7736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:40 smithi040 ceph-mon[32397]: pgmap v7737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:40 smithi146 ceph-mon[35807]: pgmap v7737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:40 smithi076 ceph-mon[35401]: pgmap v7737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10048.247950 secs 2024-07-26T16:20:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10048.247950 secs 2024-07-26T16:20:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10048.247950 secs 2024-07-26T16:20:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:42 smithi040 ceph-mon[32397]: pgmap v7738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:42 smithi146 ceph-mon[35807]: pgmap v7738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:42 smithi076 ceph-mon[35401]: pgmap v7738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:44 smithi040 ceph-mon[32397]: pgmap v7739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:44 smithi146 ceph-mon[35807]: pgmap v7739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:44 smithi076 ceph-mon[35401]: pgmap v7739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:46 smithi040 ceph-mon[32397]: pgmap v7740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10053.248089 secs 2024-07-26T16:20:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:46 smithi146 ceph-mon[35807]: pgmap v7740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10053.248089 secs 2024-07-26T16:20:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:46 smithi076 ceph-mon[35401]: pgmap v7740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10053.248089 secs 2024-07-26T16:20:48.654 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:48 smithi040 ceph-mon[32397]: pgmap v7741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:48 smithi146 ceph-mon[35807]: pgmap v7741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:48 smithi076 ceph-mon[35401]: pgmap v7741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:50.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:50 smithi040 ceph-mon[32397]: pgmap v7742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:50 smithi146 ceph-mon[35807]: pgmap v7742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:50 smithi076 ceph-mon[35401]: pgmap v7742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:20:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10058.248225 secs 2024-07-26T16:20:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10058.248225 secs 2024-07-26T16:20:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10058.248225 secs 2024-07-26T16:20:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:52 smithi040 ceph-mon[32397]: pgmap v7743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:52 smithi146 ceph-mon[35807]: pgmap v7743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:52 smithi076 ceph-mon[35401]: pgmap v7743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:54 smithi040 ceph-mon[32397]: pgmap v7744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:54 smithi146 ceph-mon[35807]: pgmap v7744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:54 smithi076 ceph-mon[35401]: pgmap v7744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:56 smithi040 ceph-mon[32397]: pgmap v7745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10063.248363 secs 2024-07-26T16:20:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:56 smithi146 ceph-mon[35807]: pgmap v7745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:56.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10063.248363 secs 2024-07-26T16:20:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:56 smithi076 ceph-mon[35401]: pgmap v7745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:20:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10063.248363 secs 2024-07-26T16:20:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:20:58 smithi040 ceph-mon[32397]: pgmap v7746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:20:58 smithi146 ceph-mon[35807]: pgmap v7746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:20:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:20:58 smithi076 ceph-mon[35401]: pgmap v7746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:00 smithi040 ceph-mon[32397]: pgmap v7747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:00 smithi146 ceph-mon[35807]: pgmap v7747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:00 smithi076 ceph-mon[35401]: pgmap v7747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10068.248510 secs 2024-07-26T16:21:01.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10068.248510 secs 2024-07-26T16:21:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10068.248510 secs 2024-07-26T16:21:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:02 smithi040 ceph-mon[32397]: pgmap v7748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:02 smithi146 ceph-mon[35807]: pgmap v7748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:02 smithi076 ceph-mon[35401]: pgmap v7748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:04 smithi040 ceph-mon[32397]: pgmap v7749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:04 smithi146 ceph-mon[35807]: pgmap v7749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:04 smithi076 ceph-mon[35401]: pgmap v7749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:06 smithi040 ceph-mon[32397]: pgmap v7750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10073.248669 secs 2024-07-26T16:21:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:06 smithi146 ceph-mon[35807]: pgmap v7750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10073.248669 secs 2024-07-26T16:21:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:06 smithi076 ceph-mon[35401]: pgmap v7750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10073.248669 secs 2024-07-26T16:21:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:08 smithi040 ceph-mon[32397]: pgmap v7751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:08 smithi146 ceph-mon[35807]: pgmap v7751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:08 smithi076 ceph-mon[35401]: pgmap v7751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:10 smithi040 ceph-mon[32397]: pgmap v7752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:10 smithi146 ceph-mon[35807]: pgmap v7752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:10 smithi076 ceph-mon[35401]: pgmap v7752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10078.248834 secs 2024-07-26T16:21:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10078.248834 secs 2024-07-26T16:21:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10078.248834 secs 2024-07-26T16:21:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:12 smithi146 ceph-mon[35807]: pgmap v7753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:12 smithi076 ceph-mon[35401]: pgmap v7753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:12 smithi040 ceph-mon[32397]: pgmap v7753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:14 smithi146 ceph-mon[35807]: pgmap v7754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:14 smithi076 ceph-mon[35401]: pgmap v7754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:14 smithi040 ceph-mon[32397]: pgmap v7754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:16 smithi146 ceph-mon[35807]: pgmap v7755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10083.248978 secs 2024-07-26T16:21:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:16 smithi076 ceph-mon[35401]: pgmap v7755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10083.248978 secs 2024-07-26T16:21:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:16 smithi040 ceph-mon[32397]: pgmap v7755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10083.248978 secs 2024-07-26T16:21:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:18 smithi146 ceph-mon[35807]: pgmap v7756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:18 smithi076 ceph-mon[35401]: pgmap v7756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:18 smithi040 ceph-mon[32397]: pgmap v7756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:20 smithi146 ceph-mon[35807]: pgmap v7757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:20 smithi076 ceph-mon[35401]: pgmap v7757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:20 smithi040 ceph-mon[32397]: pgmap v7757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10088.249145 secs 2024-07-26T16:21:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10088.249145 secs 2024-07-26T16:21:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10088.249145 secs 2024-07-26T16:21:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:22 smithi146 ceph-mon[35807]: pgmap v7758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:22 smithi076 ceph-mon[35401]: pgmap v7758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:22 smithi040 ceph-mon[32397]: pgmap v7758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:24 smithi146 ceph-mon[35807]: pgmap v7759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:24 smithi076 ceph-mon[35401]: pgmap v7759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:24 smithi040 ceph-mon[32397]: pgmap v7759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:26 smithi146 ceph-mon[35807]: pgmap v7760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10093.249327 secs 2024-07-26T16:21:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:26 smithi076 ceph-mon[35401]: pgmap v7760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:26.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10093.249327 secs 2024-07-26T16:21:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:26 smithi040 ceph-mon[32397]: pgmap v7760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10093.249327 secs 2024-07-26T16:21:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:28 smithi146 ceph-mon[35807]: pgmap v7761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:28 smithi076 ceph-mon[35401]: pgmap v7761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:28 smithi040 ceph-mon[32397]: pgmap v7761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:30 smithi076 ceph-mon[35401]: pgmap v7762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:30 smithi040 ceph-mon[32397]: pgmap v7762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:30 smithi146 ceph-mon[35807]: pgmap v7762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10098.249474 secs 2024-07-26T16:21:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10098.249474 secs 2024-07-26T16:21:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10098.249474 secs 2024-07-26T16:21:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:32 smithi040 ceph-mon[32397]: pgmap v7763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:32 smithi146 ceph-mon[35807]: pgmap v7763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:33.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:32 smithi076 ceph-mon[35401]: pgmap v7763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:34 smithi040 ceph-mon[32397]: pgmap v7764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:34 smithi146 ceph-mon[35807]: pgmap v7764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:34 smithi076 ceph-mon[35401]: pgmap v7764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:36 smithi040 ceph-mon[32397]: pgmap v7765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10103.249616 secs 2024-07-26T16:21:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:36 smithi146 ceph-mon[35807]: pgmap v7765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10103.249616 secs 2024-07-26T16:21:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:36 smithi076 ceph-mon[35401]: pgmap v7765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:37.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10103.249616 secs 2024-07-26T16:21:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:38 smithi040 ceph-mon[32397]: pgmap v7766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:38 smithi146 ceph-mon[35807]: pgmap v7766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:38 smithi076 ceph-mon[35401]: pgmap v7766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:40 smithi040 ceph-mon[32397]: pgmap v7767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:40 smithi146 ceph-mon[35807]: pgmap v7767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:40 smithi076 ceph-mon[35401]: pgmap v7767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10108.249735 secs 2024-07-26T16:21:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10108.249735 secs 2024-07-26T16:21:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10108.249735 secs 2024-07-26T16:21:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:42 smithi040 ceph-mon[32397]: pgmap v7768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:42 smithi146 ceph-mon[35807]: pgmap v7768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:42 smithi076 ceph-mon[35401]: pgmap v7768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:44 smithi040 ceph-mon[32397]: pgmap v7769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:44 smithi146 ceph-mon[35807]: pgmap v7769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:44 smithi076 ceph-mon[35401]: pgmap v7769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:46 smithi040 ceph-mon[32397]: pgmap v7770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10113.249875 secs 2024-07-26T16:21:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:46 smithi146 ceph-mon[35807]: pgmap v7770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10113.249875 secs 2024-07-26T16:21:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:46 smithi076 ceph-mon[35401]: pgmap v7770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:47.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10113.249875 secs 2024-07-26T16:21:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:48 smithi040 ceph-mon[32397]: pgmap v7771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:48 smithi146 ceph-mon[35807]: pgmap v7771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:48 smithi076 ceph-mon[35401]: pgmap v7771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:50 smithi040 ceph-mon[32397]: pgmap v7772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:50 smithi146 ceph-mon[35807]: pgmap v7772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:50 smithi076 ceph-mon[35401]: pgmap v7772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:21:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10118.249966 secs 2024-07-26T16:21:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10118.249966 secs 2024-07-26T16:21:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10118.249966 secs 2024-07-26T16:21:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:52 smithi040 ceph-mon[32397]: pgmap v7773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:52 smithi146 ceph-mon[35807]: pgmap v7773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:52 smithi076 ceph-mon[35401]: pgmap v7773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:54 smithi040 ceph-mon[32397]: pgmap v7774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:54 smithi146 ceph-mon[35807]: pgmap v7774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:54 smithi076 ceph-mon[35401]: pgmap v7774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:55 smithi146 ceph-mon[35807]: pgmap v7775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:55 smithi076 ceph-mon[35401]: pgmap v7775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:55 smithi040 ceph-mon[32397]: pgmap v7775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:21:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10123.250101 secs 2024-07-26T16:21:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10123.250101 secs 2024-07-26T16:21:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10123.250101 secs 2024-07-26T16:21:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:21:57 smithi146 ceph-mon[35807]: pgmap v7776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:21:57 smithi076 ceph-mon[35401]: pgmap v7776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:21:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:21:57 smithi040 ceph-mon[32397]: pgmap v7776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:00 smithi076 ceph-mon[35401]: pgmap v7777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:00 smithi040 ceph-mon[32397]: pgmap v7777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:00 smithi146 ceph-mon[35807]: pgmap v7777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10128.250312 secs 2024-07-26T16:22:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10128.250312 secs 2024-07-26T16:22:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10128.250312 secs 2024-07-26T16:22:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:02 smithi040 ceph-mon[32397]: pgmap v7778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:02 smithi146 ceph-mon[35807]: pgmap v7778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:02 smithi076 ceph-mon[35401]: pgmap v7778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:04 smithi040 ceph-mon[32397]: pgmap v7779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:04 smithi146 ceph-mon[35807]: pgmap v7779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:04 smithi076 ceph-mon[35401]: pgmap v7779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:06 smithi146 ceph-mon[35807]: pgmap v7780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10133.250322 secs 2024-07-26T16:22:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:06 smithi076 ceph-mon[35401]: pgmap v7780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10133.250322 secs 2024-07-26T16:22:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:06 smithi040 ceph-mon[32397]: pgmap v7780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10133.250322 secs 2024-07-26T16:22:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:08 smithi146 ceph-mon[35807]: pgmap v7781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:08 smithi076 ceph-mon[35401]: pgmap v7781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:08 smithi040 ceph-mon[32397]: pgmap v7781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:10 smithi146 ceph-mon[35807]: pgmap v7782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:10 smithi076 ceph-mon[35401]: pgmap v7782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:10 smithi040 ceph-mon[32397]: pgmap v7782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10138.250422 secs 2024-07-26T16:22:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10138.250422 secs 2024-07-26T16:22:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10138.250422 secs 2024-07-26T16:22:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:12 smithi146 ceph-mon[35807]: pgmap v7783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:12 smithi076 ceph-mon[35401]: pgmap v7783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:12 smithi040 ceph-mon[32397]: pgmap v7783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:14 smithi146 ceph-mon[35807]: pgmap v7784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:14 smithi076 ceph-mon[35401]: pgmap v7784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:14 smithi040 ceph-mon[32397]: pgmap v7784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:16 smithi146 ceph-mon[35807]: pgmap v7785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10143.250557 secs 2024-07-26T16:22:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:16 smithi076 ceph-mon[35401]: pgmap v7785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10143.250557 secs 2024-07-26T16:22:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:16 smithi040 ceph-mon[32397]: pgmap v7785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10143.250557 secs 2024-07-26T16:22:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:18 smithi076 ceph-mon[35401]: pgmap v7786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:18 smithi040 ceph-mon[32397]: pgmap v7786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:18 smithi146 ceph-mon[35807]: pgmap v7786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:20 smithi076 ceph-mon[35401]: pgmap v7787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:20 smithi040 ceph-mon[32397]: pgmap v7787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:20 smithi146 ceph-mon[35807]: pgmap v7787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10148.250722 secs 2024-07-26T16:22:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10148.250722 secs 2024-07-26T16:22:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10148.250722 secs 2024-07-26T16:22:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:22 smithi040 ceph-mon[32397]: pgmap v7788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:22 smithi146 ceph-mon[35807]: pgmap v7788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:22 smithi076 ceph-mon[35401]: pgmap v7788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:24 smithi040 ceph-mon[32397]: pgmap v7789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:24 smithi146 ceph-mon[35807]: pgmap v7789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:24 smithi076 ceph-mon[35401]: pgmap v7789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:26.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:26 smithi146 ceph-mon[35807]: pgmap v7790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:26.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10153.250840 secs 2024-07-26T16:22:26.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:26 smithi040 ceph-mon[32397]: pgmap v7790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:26.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10153.250840 secs 2024-07-26T16:22:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:26 smithi076 ceph-mon[35401]: pgmap v7790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:26.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10153.250840 secs 2024-07-26T16:22:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:28 smithi040 ceph-mon[32397]: pgmap v7791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:28 smithi146 ceph-mon[35807]: pgmap v7791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:28 smithi076 ceph-mon[35401]: pgmap v7791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:30 smithi040 ceph-mon[32397]: pgmap v7792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:30 smithi146 ceph-mon[35807]: pgmap v7792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:30 smithi076 ceph-mon[35401]: pgmap v7792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10158.250968 secs 2024-07-26T16:22:31.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10158.250968 secs 2024-07-26T16:22:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10158.250968 secs 2024-07-26T16:22:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:32 smithi040 ceph-mon[32397]: pgmap v7793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:32 smithi146 ceph-mon[35807]: pgmap v7793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:32 smithi076 ceph-mon[35401]: pgmap v7793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:34 smithi040 ceph-mon[32397]: pgmap v7794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:34 smithi146 ceph-mon[35807]: pgmap v7794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:34 smithi076 ceph-mon[35401]: pgmap v7794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:36 smithi040 ceph-mon[32397]: pgmap v7795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10163.251136 secs 2024-07-26T16:22:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:36 smithi146 ceph-mon[35807]: pgmap v7795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10163.251136 secs 2024-07-26T16:22:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:36 smithi076 ceph-mon[35401]: pgmap v7795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10163.251136 secs 2024-07-26T16:22:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:38 smithi040 ceph-mon[32397]: pgmap v7796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:38 smithi146 ceph-mon[35807]: pgmap v7796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:38 smithi076 ceph-mon[35401]: pgmap v7796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:40 smithi040 ceph-mon[32397]: pgmap v7797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:40.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:40 smithi146 ceph-mon[35807]: pgmap v7797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:40 smithi076 ceph-mon[35401]: pgmap v7797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10168.251244 secs 2024-07-26T16:22:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10168.251244 secs 2024-07-26T16:22:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10168.251244 secs 2024-07-26T16:22:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:42 smithi040 ceph-mon[32397]: pgmap v7798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:42 smithi146 ceph-mon[35807]: pgmap v7798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:42 smithi076 ceph-mon[35401]: pgmap v7798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:44 smithi040 ceph-mon[32397]: pgmap v7799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:44 smithi146 ceph-mon[35807]: pgmap v7799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:44 smithi076 ceph-mon[35401]: pgmap v7799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:46 smithi040 ceph-mon[32397]: pgmap v7800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10173.251378 secs 2024-07-26T16:22:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:46 smithi146 ceph-mon[35807]: pgmap v7800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10173.251378 secs 2024-07-26T16:22:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:46 smithi076 ceph-mon[35401]: pgmap v7800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10173.251378 secs 2024-07-26T16:22:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:48 smithi040 ceph-mon[32397]: pgmap v7801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:48 smithi146 ceph-mon[35807]: pgmap v7801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:48 smithi076 ceph-mon[35401]: pgmap v7801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:50 smithi040 ceph-mon[32397]: pgmap v7802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:50 smithi146 ceph-mon[35807]: pgmap v7802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:50 smithi076 ceph-mon[35401]: pgmap v7802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:22:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10178.251528 secs 2024-07-26T16:22:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10178.251528 secs 2024-07-26T16:22:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10178.251528 secs 2024-07-26T16:22:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:52 smithi040 ceph-mon[32397]: pgmap v7803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:52 smithi146 ceph-mon[35807]: pgmap v7803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:52 smithi076 ceph-mon[35401]: pgmap v7803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:54 smithi146 ceph-mon[35807]: pgmap v7804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:54 smithi076 ceph-mon[35401]: pgmap v7804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:54 smithi040 ceph-mon[32397]: pgmap v7804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:56 smithi146 ceph-mon[35807]: pgmap v7805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10183.251671 secs 2024-07-26T16:22:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:56 smithi076 ceph-mon[35401]: pgmap v7805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10183.251671 secs 2024-07-26T16:22:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:56 smithi040 ceph-mon[32397]: pgmap v7805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:22:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10183.251671 secs 2024-07-26T16:22:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:22:58 smithi146 ceph-mon[35807]: pgmap v7806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:22:58 smithi076 ceph-mon[35401]: pgmap v7806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:22:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:22:58 smithi040 ceph-mon[32397]: pgmap v7806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:00 smithi146 ceph-mon[35807]: pgmap v7807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:00 smithi076 ceph-mon[35401]: pgmap v7807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:00 smithi040 ceph-mon[32397]: pgmap v7807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10188.251831 secs 2024-07-26T16:23:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10188.251831 secs 2024-07-26T16:23:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10188.251831 secs 2024-07-26T16:23:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:02 smithi146 ceph-mon[35807]: pgmap v7808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:02 smithi076 ceph-mon[35401]: pgmap v7808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:02 smithi040 ceph-mon[32397]: pgmap v7808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:04 smithi146 ceph-mon[35807]: pgmap v7809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:04 smithi076 ceph-mon[35401]: pgmap v7809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:04 smithi040 ceph-mon[32397]: pgmap v7809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:06.788 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:06 smithi040 ceph-mon[32397]: pgmap v7810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:06.788 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10193.251969 secs 2024-07-26T16:23:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:06 smithi146 ceph-mon[35807]: pgmap v7810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10193.251969 secs 2024-07-26T16:23:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:06 smithi076 ceph-mon[35401]: pgmap v7810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10193.251969 secs 2024-07-26T16:23:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:08 smithi146 ceph-mon[35807]: pgmap v7811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:08 smithi076 ceph-mon[35401]: pgmap v7811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:08 smithi040 ceph-mon[32397]: pgmap v7811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:10 smithi146 ceph-mon[35807]: pgmap v7812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:10 smithi076 ceph-mon[35401]: pgmap v7812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:10 smithi040 ceph-mon[32397]: pgmap v7812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10198.252108 secs 2024-07-26T16:23:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10198.252108 secs 2024-07-26T16:23:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10198.252108 secs 2024-07-26T16:23:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:12 smithi146 ceph-mon[35807]: pgmap v7813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:12 smithi076 ceph-mon[35401]: pgmap v7813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:12 smithi040 ceph-mon[32397]: pgmap v7813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:14 smithi076 ceph-mon[35401]: pgmap v7814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:14 smithi040 ceph-mon[32397]: pgmap v7814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:14 smithi146 ceph-mon[35807]: pgmap v7814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:16 smithi040 ceph-mon[32397]: pgmap v7815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10203.252246 secs 2024-07-26T16:23:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:16 smithi146 ceph-mon[35807]: pgmap v7815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10203.252246 secs 2024-07-26T16:23:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:16 smithi076 ceph-mon[35401]: pgmap v7815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10203.252246 secs 2024-07-26T16:23:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:18 smithi040 ceph-mon[32397]: pgmap v7816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:18 smithi146 ceph-mon[35807]: pgmap v7816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:18 smithi076 ceph-mon[35401]: pgmap v7816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:20 smithi040 ceph-mon[32397]: pgmap v7817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:20 smithi146 ceph-mon[35807]: pgmap v7817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:20 smithi076 ceph-mon[35401]: pgmap v7817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10208.252343 secs 2024-07-26T16:23:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10208.252343 secs 2024-07-26T16:23:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10208.252343 secs 2024-07-26T16:23:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:22 smithi040 ceph-mon[32397]: pgmap v7818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:22 smithi146 ceph-mon[35807]: pgmap v7818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:22 smithi076 ceph-mon[35401]: pgmap v7818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:24 smithi040 ceph-mon[32397]: pgmap v7819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:24 smithi146 ceph-mon[35807]: pgmap v7819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:24 smithi076 ceph-mon[35401]: pgmap v7819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:26 smithi040 ceph-mon[32397]: pgmap v7820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10213.252508 secs 2024-07-26T16:23:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:26 smithi146 ceph-mon[35807]: pgmap v7820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10213.252508 secs 2024-07-26T16:23:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:26 smithi076 ceph-mon[35401]: pgmap v7820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10213.252508 secs 2024-07-26T16:23:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:28 smithi040 ceph-mon[32397]: pgmap v7821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:28 smithi146 ceph-mon[35807]: pgmap v7821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:28 smithi076 ceph-mon[35401]: pgmap v7821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:30 smithi040 ceph-mon[32397]: pgmap v7822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:30 smithi146 ceph-mon[35807]: pgmap v7822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:30 smithi076 ceph-mon[35401]: pgmap v7822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10218.252617 secs 2024-07-26T16:23:31.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10218.252617 secs 2024-07-26T16:23:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10218.252617 secs 2024-07-26T16:23:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:32 smithi040 ceph-mon[32397]: pgmap v7823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:32 smithi146 ceph-mon[35807]: pgmap v7823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:32 smithi076 ceph-mon[35401]: pgmap v7823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:34 smithi040 ceph-mon[32397]: pgmap v7824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:34 smithi146 ceph-mon[35807]: pgmap v7824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:35.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:34 smithi076 ceph-mon[35401]: pgmap v7824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:36 smithi040 ceph-mon[32397]: pgmap v7825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:36.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10223.252711 secs 2024-07-26T16:23:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:36 smithi146 ceph-mon[35807]: pgmap v7825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10223.252711 secs 2024-07-26T16:23:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:36 smithi076 ceph-mon[35401]: pgmap v7825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10223.252711 secs 2024-07-26T16:23:38.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:38 smithi040 ceph-mon[32397]: pgmap v7826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:38 smithi146 ceph-mon[35807]: pgmap v7826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:38 smithi076 ceph-mon[35401]: pgmap v7826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:40 smithi040 ceph-mon[32397]: pgmap v7827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:40 smithi146 ceph-mon[35807]: pgmap v7827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:40 smithi076 ceph-mon[35401]: pgmap v7827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10228.252836 secs 2024-07-26T16:23:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10228.252836 secs 2024-07-26T16:23:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10228.252836 secs 2024-07-26T16:23:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:42 smithi040 ceph-mon[32397]: pgmap v7828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:42 smithi146 ceph-mon[35807]: pgmap v7828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:42 smithi076 ceph-mon[35401]: pgmap v7828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:44 smithi040 ceph-mon[32397]: pgmap v7829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:44 smithi146 ceph-mon[35807]: pgmap v7829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:44 smithi076 ceph-mon[35401]: pgmap v7829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:46 smithi040 ceph-mon[32397]: pgmap v7830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10233.252993 secs 2024-07-26T16:23:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:46 smithi146 ceph-mon[35807]: pgmap v7830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10233.252993 secs 2024-07-26T16:23:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:46 smithi076 ceph-mon[35401]: pgmap v7830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10233.252993 secs 2024-07-26T16:23:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:48 smithi040 ceph-mon[32397]: pgmap v7831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:48 smithi146 ceph-mon[35807]: pgmap v7831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:48 smithi076 ceph-mon[35401]: pgmap v7831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:50 smithi040 ceph-mon[32397]: pgmap v7832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:50 smithi146 ceph-mon[35807]: pgmap v7832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:50 smithi076 ceph-mon[35401]: pgmap v7832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:23:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10238.253133 secs 2024-07-26T16:23:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:51 smithi146 ceph-mon[35807]: pgmap v7833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10238.253133 secs 2024-07-26T16:23:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:51 smithi076 ceph-mon[35401]: pgmap v7833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10238.253133 secs 2024-07-26T16:23:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:51 smithi040 ceph-mon[32397]: pgmap v7833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:54 smithi040 ceph-mon[32397]: pgmap v7834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:54 smithi146 ceph-mon[35807]: pgmap v7834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:54 smithi076 ceph-mon[35401]: pgmap v7834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:56 smithi040 ceph-mon[32397]: pgmap v7835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10243.253308 secs 2024-07-26T16:23:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:56 smithi146 ceph-mon[35807]: pgmap v7835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10243.253308 secs 2024-07-26T16:23:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:56 smithi076 ceph-mon[35401]: pgmap v7835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:23:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10243.253308 secs 2024-07-26T16:23:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:23:58 smithi040 ceph-mon[32397]: pgmap v7836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:23:58 smithi146 ceph-mon[35807]: pgmap v7836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:23:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:23:58 smithi076 ceph-mon[35401]: pgmap v7836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:00 smithi040 ceph-mon[32397]: pgmap v7837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:00 smithi146 ceph-mon[35807]: pgmap v7837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:00 smithi076 ceph-mon[35401]: pgmap v7837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10248.253450 secs 2024-07-26T16:24:01.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10248.253450 secs 2024-07-26T16:24:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10248.253450 secs 2024-07-26T16:24:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:02 smithi040 ceph-mon[32397]: pgmap v7838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:02 smithi146 ceph-mon[35807]: pgmap v7838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:02.701 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:02 smithi076 ceph-mon[35401]: pgmap v7838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:04 smithi040 ceph-mon[32397]: pgmap v7839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:04 smithi146 ceph-mon[35807]: pgmap v7839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:04 smithi076 ceph-mon[35401]: pgmap v7839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:06 smithi040 ceph-mon[32397]: pgmap v7840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10253.253593 secs 2024-07-26T16:24:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:06 smithi146 ceph-mon[35807]: pgmap v7840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10253.253593 secs 2024-07-26T16:24:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:06 smithi076 ceph-mon[35401]: pgmap v7840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10253.253593 secs 2024-07-26T16:24:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:08 smithi040 ceph-mon[32397]: pgmap v7841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:08 smithi146 ceph-mon[35807]: pgmap v7841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:08 smithi076 ceph-mon[35401]: pgmap v7841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:10 smithi040 ceph-mon[32397]: pgmap v7842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:10 smithi146 ceph-mon[35807]: pgmap v7842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:10 smithi076 ceph-mon[35401]: pgmap v7842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10258.253739 secs 2024-07-26T16:24:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10258.253739 secs 2024-07-26T16:24:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10258.253739 secs 2024-07-26T16:24:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:12 smithi146 ceph-mon[35807]: pgmap v7843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:24:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:12 smithi076 ceph-mon[35401]: pgmap v7843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:24:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:12 smithi040 ceph-mon[32397]: pgmap v7843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:24:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:14 smithi146 ceph-mon[35807]: pgmap v7844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:14 smithi076 ceph-mon[35401]: pgmap v7844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:14 smithi040 ceph-mon[32397]: pgmap v7844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:24:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:16 smithi146 ceph-mon[35807]: pgmap v7845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10263.253876 secs 2024-07-26T16:24:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:16 smithi076 ceph-mon[35401]: pgmap v7845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10263.253876 secs 2024-07-26T16:24:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:16 smithi040 ceph-mon[32397]: pgmap v7845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10263.253876 secs 2024-07-26T16:24:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:18 smithi146 ceph-mon[35807]: pgmap v7846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:18 smithi076 ceph-mon[35401]: pgmap v7846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:18 smithi040 ceph-mon[32397]: pgmap v7846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:20.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:20 smithi146 ceph-mon[35807]: pgmap v7847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:20 smithi076 ceph-mon[35401]: pgmap v7847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:20 smithi040 ceph-mon[32397]: pgmap v7847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10268.254018 secs 2024-07-26T16:24:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10268.254018 secs 2024-07-26T16:24:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10268.254018 secs 2024-07-26T16:24:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:22 smithi146 ceph-mon[35807]: pgmap v7848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:22 smithi076 ceph-mon[35401]: pgmap v7848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:22 smithi040 ceph-mon[32397]: pgmap v7848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:24 smithi146 ceph-mon[35807]: pgmap v7849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:24 smithi076 ceph-mon[35401]: pgmap v7849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:24 smithi040 ceph-mon[32397]: pgmap v7849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:26 smithi146 ceph-mon[35807]: pgmap v7850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10273.254179 secs 2024-07-26T16:24:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:26 smithi076 ceph-mon[35401]: pgmap v7850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:26.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10273.254179 secs 2024-07-26T16:24:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:26 smithi040 ceph-mon[32397]: pgmap v7850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10273.254179 secs 2024-07-26T16:24:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:28 smithi146 ceph-mon[35807]: pgmap v7851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:28 smithi076 ceph-mon[35401]: pgmap v7851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:28 smithi040 ceph-mon[32397]: pgmap v7851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:30 smithi146 ceph-mon[35807]: pgmap v7852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:30 smithi076 ceph-mon[35401]: pgmap v7852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:30 smithi040 ceph-mon[32397]: pgmap v7852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10278.254334 secs 2024-07-26T16:24:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10278.254334 secs 2024-07-26T16:24:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10278.254334 secs 2024-07-26T16:24:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:32 smithi076 ceph-mon[35401]: pgmap v7853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:32 smithi040 ceph-mon[32397]: pgmap v7853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:32 smithi146 ceph-mon[35807]: pgmap v7853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:34 smithi040 ceph-mon[32397]: pgmap v7854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:34 smithi146 ceph-mon[35807]: pgmap v7854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:34 smithi076 ceph-mon[35401]: pgmap v7854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:36 smithi040 ceph-mon[32397]: pgmap v7855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:36.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10283.254487 secs 2024-07-26T16:24:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:36 smithi146 ceph-mon[35807]: pgmap v7855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10283.254487 secs 2024-07-26T16:24:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:36 smithi076 ceph-mon[35401]: pgmap v7855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:36.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10283.254487 secs 2024-07-26T16:24:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:38 smithi040 ceph-mon[32397]: pgmap v7856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:38 smithi146 ceph-mon[35807]: pgmap v7856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:38 smithi076 ceph-mon[35401]: pgmap v7856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:40 smithi040 ceph-mon[32397]: pgmap v7857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:40 smithi146 ceph-mon[35807]: pgmap v7857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:40 smithi076 ceph-mon[35401]: pgmap v7857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:24:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10288.254632 secs 2024-07-26T16:24:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10288.254632 secs 2024-07-26T16:24:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10288.254632 secs 2024-07-26T16:24:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:42 smithi040 ceph-mon[32397]: pgmap v7858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:42 smithi146 ceph-mon[35807]: pgmap v7858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:42 smithi076 ceph-mon[35401]: pgmap v7858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:44 smithi040 ceph-mon[32397]: pgmap v7859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:44 smithi146 ceph-mon[35807]: pgmap v7859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:44 smithi076 ceph-mon[35401]: pgmap v7859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:46 smithi040 ceph-mon[32397]: pgmap v7860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10293.254759 secs 2024-07-26T16:24:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:46 smithi146 ceph-mon[35807]: pgmap v7860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10293.254759 secs 2024-07-26T16:24:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:46 smithi076 ceph-mon[35401]: pgmap v7860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10293.254759 secs 2024-07-26T16:24:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:48 smithi040 ceph-mon[32397]: pgmap v7861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:48 smithi146 ceph-mon[35807]: pgmap v7861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:48 smithi076 ceph-mon[35401]: pgmap v7861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:50 smithi040 ceph-mon[32397]: pgmap v7862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:50 smithi146 ceph-mon[35807]: pgmap v7862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:50 smithi076 ceph-mon[35401]: pgmap v7862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10298.254897 secs 2024-07-26T16:24:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10298.254897 secs 2024-07-26T16:24:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10298.254897 secs 2024-07-26T16:24:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:52 smithi040 ceph-mon[32397]: pgmap v7863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:24:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:52 smithi146 ceph-mon[35807]: pgmap v7863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:24:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:52 smithi076 ceph-mon[35401]: pgmap v7863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:24:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:54 smithi040 ceph-mon[32397]: pgmap v7864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:54 smithi146 ceph-mon[35807]: pgmap v7864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:54.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:54 smithi076 ceph-mon[35401]: pgmap v7864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:56 smithi040 ceph-mon[32397]: pgmap v7865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10303.255054 secs 2024-07-26T16:24:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:56 smithi146 ceph-mon[35807]: pgmap v7865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10303.255054 secs 2024-07-26T16:24:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:56 smithi076 ceph-mon[35401]: pgmap v7865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:24:56.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10303.255054 secs 2024-07-26T16:24:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:24:58 smithi040 ceph-mon[32397]: pgmap v7866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:24:58 smithi146 ceph-mon[35807]: pgmap v7866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:24:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:24:58 smithi076 ceph-mon[35401]: pgmap v7866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:00 smithi040 ceph-mon[32397]: pgmap v7867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:25:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:00 smithi146 ceph-mon[35807]: pgmap v7867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:25:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:00 smithi076 ceph-mon[35401]: pgmap v7867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:25:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10308.255195 secs 2024-07-26T16:25:01.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10308.255195 secs 2024-07-26T16:25:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10308.255195 secs 2024-07-26T16:25:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:02 smithi040 ceph-mon[32397]: pgmap v7868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:02 smithi146 ceph-mon[35807]: pgmap v7868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:02 smithi076 ceph-mon[35401]: pgmap v7868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:04 smithi040 ceph-mon[32397]: pgmap v7869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:04 smithi146 ceph-mon[35807]: pgmap v7869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:04 smithi076 ceph-mon[35401]: pgmap v7869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:06 smithi040 ceph-mon[32397]: pgmap v7870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10313.255368 secs 2024-07-26T16:25:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:06 smithi146 ceph-mon[35807]: pgmap v7870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10313.255368 secs 2024-07-26T16:25:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:06 smithi076 ceph-mon[35401]: pgmap v7870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:06.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10313.255368 secs 2024-07-26T16:25:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:08 smithi146 ceph-mon[35807]: pgmap v7871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:08 smithi076 ceph-mon[35401]: pgmap v7871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:08 smithi040 ceph-mon[32397]: pgmap v7871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:10 smithi146 ceph-mon[35807]: pgmap v7872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:25:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:10 smithi076 ceph-mon[35401]: pgmap v7872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:25:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:10 smithi040 ceph-mon[32397]: pgmap v7872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:25:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10318.255507 secs 2024-07-26T16:25:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10318.255507 secs 2024-07-26T16:25:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10318.255507 secs 2024-07-26T16:25:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:12 smithi146 ceph-mon[35807]: pgmap v7873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:12 smithi076 ceph-mon[35401]: pgmap v7873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:12 smithi040 ceph-mon[32397]: pgmap v7873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:14 smithi146 ceph-mon[35807]: pgmap v7874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:14 smithi076 ceph-mon[35401]: pgmap v7874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:14 smithi040 ceph-mon[32397]: pgmap v7874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:16 smithi146 ceph-mon[35807]: pgmap v7875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10323.255640 secs 2024-07-26T16:25:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:16 smithi076 ceph-mon[35401]: pgmap v7875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10323.255640 secs 2024-07-26T16:25:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:16 smithi040 ceph-mon[32397]: pgmap v7875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10323.255640 secs 2024-07-26T16:25:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:18 smithi146 ceph-mon[35807]: pgmap v7876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:18 smithi076 ceph-mon[35401]: pgmap v7876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:18 smithi040 ceph-mon[32397]: pgmap v7876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:20 smithi146 ceph-mon[35807]: pgmap v7877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:20 smithi076 ceph-mon[35401]: pgmap v7877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:20 smithi040 ceph-mon[32397]: pgmap v7877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10328.255790 secs 2024-07-26T16:25:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10328.255790 secs 2024-07-26T16:25:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10328.255790 secs 2024-07-26T16:25:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:22 smithi146 ceph-mon[35807]: pgmap v7878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:22 smithi076 ceph-mon[35401]: pgmap v7878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:22 smithi040 ceph-mon[32397]: pgmap v7878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:24 smithi146 ceph-mon[35807]: pgmap v7879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:24 smithi076 ceph-mon[35401]: pgmap v7879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:24 smithi040 ceph-mon[32397]: pgmap v7879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:26 smithi146 ceph-mon[35807]: pgmap v7880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10333.255932 secs 2024-07-26T16:25:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:26 smithi076 ceph-mon[35401]: pgmap v7880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10333.255932 secs 2024-07-26T16:25:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:26 smithi040 ceph-mon[32397]: pgmap v7880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10333.255932 secs 2024-07-26T16:25:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:28 smithi076 ceph-mon[35401]: pgmap v7881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:28 smithi040 ceph-mon[32397]: pgmap v7881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:28 smithi146 ceph-mon[35807]: pgmap v7881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:30 smithi040 ceph-mon[32397]: pgmap v7882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:30 smithi146 ceph-mon[35807]: pgmap v7882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:30 smithi076 ceph-mon[35401]: pgmap v7882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10338.256092 secs 2024-07-26T16:25:31.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10338.256092 secs 2024-07-26T16:25:32.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10338.256092 secs 2024-07-26T16:25:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:32 smithi040 ceph-mon[32397]: pgmap v7883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:32 smithi146 ceph-mon[35807]: pgmap v7883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:32 smithi076 ceph-mon[35401]: pgmap v7883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:34 smithi040 ceph-mon[32397]: pgmap v7884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:34 smithi146 ceph-mon[35807]: pgmap v7884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:34 smithi076 ceph-mon[35401]: pgmap v7884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:36.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:36 smithi040 ceph-mon[32397]: pgmap v7885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:36.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10343.256230 secs 2024-07-26T16:25:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:36 smithi146 ceph-mon[35807]: pgmap v7885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10343.256230 secs 2024-07-26T16:25:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:36 smithi076 ceph-mon[35401]: pgmap v7885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10343.256230 secs 2024-07-26T16:25:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:38 smithi040 ceph-mon[32397]: pgmap v7886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:38 smithi146 ceph-mon[35807]: pgmap v7886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:38 smithi076 ceph-mon[35401]: pgmap v7886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:40 smithi040 ceph-mon[32397]: pgmap v7887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:40 smithi146 ceph-mon[35807]: pgmap v7887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:40 smithi076 ceph-mon[35401]: pgmap v7887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10348.256354 secs 2024-07-26T16:25:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10348.256354 secs 2024-07-26T16:25:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10348.256354 secs 2024-07-26T16:25:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:42 smithi040 ceph-mon[32397]: pgmap v7888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:42 smithi146 ceph-mon[35807]: pgmap v7888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:42 smithi076 ceph-mon[35401]: pgmap v7888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:44 smithi040 ceph-mon[32397]: pgmap v7889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:44 smithi146 ceph-mon[35807]: pgmap v7889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:44 smithi076 ceph-mon[35401]: pgmap v7889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:46 smithi040 ceph-mon[32397]: pgmap v7890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:46.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10353.256448 secs 2024-07-26T16:25:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:46 smithi146 ceph-mon[35807]: pgmap v7890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10353.256448 secs 2024-07-26T16:25:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:46 smithi076 ceph-mon[35401]: pgmap v7890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10353.256448 secs 2024-07-26T16:25:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:48 smithi040 ceph-mon[32397]: pgmap v7891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:48 smithi146 ceph-mon[35807]: pgmap v7891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:49.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:48 smithi076 ceph-mon[35401]: pgmap v7891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:50 smithi040 ceph-mon[32397]: pgmap v7892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:51.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:50 smithi146 ceph-mon[35807]: pgmap v7892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:50 smithi076 ceph-mon[35401]: pgmap v7892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10358.256574 secs 2024-07-26T16:25:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10358.256574 secs 2024-07-26T16:25:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10358.256574 secs 2024-07-26T16:25:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:52 smithi040 ceph-mon[32397]: pgmap v7893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:52 smithi146 ceph-mon[35807]: pgmap v7893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:52 smithi076 ceph-mon[35401]: pgmap v7893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:54 smithi040 ceph-mon[32397]: pgmap v7894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:54 smithi146 ceph-mon[35807]: pgmap v7894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:54 smithi076 ceph-mon[35401]: pgmap v7894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:56 smithi040 ceph-mon[32397]: pgmap v7895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:56.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10363.256712 secs 2024-07-26T16:25:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:56 smithi146 ceph-mon[35807]: pgmap v7895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10363.256712 secs 2024-07-26T16:25:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:56 smithi076 ceph-mon[35401]: pgmap v7895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:25:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10363.256712 secs 2024-07-26T16:25:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:25:58 smithi040 ceph-mon[32397]: pgmap v7896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:25:58 smithi146 ceph-mon[35807]: pgmap v7896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:25:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:25:58 smithi076 ceph-mon[35401]: pgmap v7896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:00 smithi146 ceph-mon[35807]: pgmap v7897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:00 smithi076 ceph-mon[35401]: pgmap v7897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:00 smithi040 ceph-mon[32397]: pgmap v7897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10368.256862 secs 2024-07-26T16:26:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10368.256862 secs 2024-07-26T16:26:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10368.256862 secs 2024-07-26T16:26:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:02 smithi146 ceph-mon[35807]: pgmap v7898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:02 smithi076 ceph-mon[35401]: pgmap v7898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:02 smithi040 ceph-mon[32397]: pgmap v7898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:04 smithi146 ceph-mon[35807]: pgmap v7899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:04 smithi076 ceph-mon[35401]: pgmap v7899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:04 smithi040 ceph-mon[32397]: pgmap v7899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:05 smithi146 ceph-mon[35807]: pgmap v7900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:05 smithi076 ceph-mon[35401]: pgmap v7900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:06.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:05 smithi040 ceph-mon[32397]: pgmap v7900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10373.257002 secs 2024-07-26T16:26:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10373.257002 secs 2024-07-26T16:26:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10373.257002 secs 2024-07-26T16:26:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:07 smithi146 ceph-mon[35807]: pgmap v7901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:07 smithi076 ceph-mon[35401]: pgmap v7901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:07 smithi040 ceph-mon[32397]: pgmap v7901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:10 smithi146 ceph-mon[35807]: pgmap v7902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:10.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:10 smithi076 ceph-mon[35401]: pgmap v7902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:10 smithi040 ceph-mon[32397]: pgmap v7902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10378.257164 secs 2024-07-26T16:26:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10378.257164 secs 2024-07-26T16:26:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10378.257164 secs 2024-07-26T16:26:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:12 smithi146 ceph-mon[35807]: pgmap v7903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:12 smithi076 ceph-mon[35401]: pgmap v7903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:12 smithi040 ceph-mon[32397]: pgmap v7903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:14 smithi146 ceph-mon[35807]: pgmap v7904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:14 smithi076 ceph-mon[35401]: pgmap v7904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:14 smithi040 ceph-mon[32397]: pgmap v7904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:16 smithi146 ceph-mon[35807]: pgmap v7905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10383.257309 secs 2024-07-26T16:26:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:16 smithi076 ceph-mon[35401]: pgmap v7905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10383.257309 secs 2024-07-26T16:26:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:16 smithi040 ceph-mon[32397]: pgmap v7905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10383.257309 secs 2024-07-26T16:26:18.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:18 smithi146 ceph-mon[35807]: pgmap v7906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:18 smithi076 ceph-mon[35401]: pgmap v7906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:18 smithi040 ceph-mon[32397]: pgmap v7906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:20 smithi146 ceph-mon[35807]: pgmap v7907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:20 smithi076 ceph-mon[35401]: pgmap v7907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:20 smithi040 ceph-mon[32397]: pgmap v7907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10388.257456 secs 2024-07-26T16:26:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10388.257456 secs 2024-07-26T16:26:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10388.257456 secs 2024-07-26T16:26:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:22 smithi146 ceph-mon[35807]: pgmap v7908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:22 smithi076 ceph-mon[35401]: pgmap v7908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:22 smithi040 ceph-mon[32397]: pgmap v7908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:24 smithi146 ceph-mon[35807]: pgmap v7909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:24 smithi076 ceph-mon[35401]: pgmap v7909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:24 smithi040 ceph-mon[32397]: pgmap v7909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:26.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:26 smithi076 ceph-mon[35401]: pgmap v7910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:26.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10393.257593 secs 2024-07-26T16:26:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:26 smithi040 ceph-mon[32397]: pgmap v7910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:26.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10393.257593 secs 2024-07-26T16:26:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:26 smithi146 ceph-mon[35807]: pgmap v7910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10393.257593 secs 2024-07-26T16:26:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:28 smithi076 ceph-mon[35401]: pgmap v7911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:28 smithi040 ceph-mon[32397]: pgmap v7911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:28 smithi146 ceph-mon[35807]: pgmap v7911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:30 smithi040 ceph-mon[32397]: pgmap v7912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:30 smithi146 ceph-mon[35807]: pgmap v7912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:30 smithi076 ceph-mon[35401]: pgmap v7912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10398.257735 secs 2024-07-26T16:26:31.768 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10398.257735 secs 2024-07-26T16:26:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10398.257735 secs 2024-07-26T16:26:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: pgmap v7913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:26:32.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:26:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: pgmap v7913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:26:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:26:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:26:32.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: pgmap v7913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:32.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:26:32.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:26:32.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:26:32.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:26:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:33 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:26:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:33 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:26:33.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:33 smithi040 ceph-mon[32397]: pgmap v7914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s 2024-07-26T16:26:33.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:33 smithi040 ceph-mon[32397]: pgmap v7915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:26:33.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:33 smithi040 ceph-mon[32397]: pgmap v7916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 730 B/s rd, 1 op/s 2024-07-26T16:26:33.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:33 smithi040 ceph-mon[32397]: pgmap v7917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:33 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:26:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:33 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:26:33.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:33 smithi146 ceph-mon[35807]: pgmap v7914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s 2024-07-26T16:26:33.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:33 smithi146 ceph-mon[35807]: pgmap v7915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:26:33.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:33 smithi146 ceph-mon[35807]: pgmap v7916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 730 B/s rd, 1 op/s 2024-07-26T16:26:33.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:33 smithi146 ceph-mon[35807]: pgmap v7917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:33 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:26:33.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:33 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:26:33.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:33 smithi076 ceph-mon[35401]: pgmap v7914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s 2024-07-26T16:26:33.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:33 smithi076 ceph-mon[35401]: pgmap v7915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:26:33.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:33 smithi076 ceph-mon[35401]: pgmap v7916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 730 B/s rd, 1 op/s 2024-07-26T16:26:33.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:33 smithi076 ceph-mon[35401]: pgmap v7917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:35 smithi040 ceph-mon[32397]: pgmap v7918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:35 smithi146 ceph-mon[35807]: pgmap v7918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:35 smithi076 ceph-mon[35401]: pgmap v7918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10403.257877 secs 2024-07-26T16:26:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10403.257877 secs 2024-07-26T16:26:36.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10403.257877 secs 2024-07-26T16:26:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:37 smithi040 ceph-mon[32397]: pgmap v7919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:37 smithi146 ceph-mon[35807]: pgmap v7919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:37 smithi076 ceph-mon[35401]: pgmap v7919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 B/s rd, 1 op/s 2024-07-26T16:26:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:39 smithi040 ceph-mon[32397]: pgmap v7920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:39 smithi146 ceph-mon[35807]: pgmap v7920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:39 smithi076 ceph-mon[35401]: pgmap v7920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:41 smithi040 ceph-mon[32397]: pgmap v7921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:41.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10408.258019 secs 2024-07-26T16:26:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:41 smithi146 ceph-mon[35807]: pgmap v7921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10408.258019 secs 2024-07-26T16:26:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:41 smithi076 ceph-mon[35401]: pgmap v7921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10408.258019 secs 2024-07-26T16:26:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:43 smithi040 ceph-mon[32397]: pgmap v7922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:26:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:43 smithi146 ceph-mon[35807]: pgmap v7922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:26:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:43 smithi076 ceph-mon[35401]: pgmap v7922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:26:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:45 smithi040 ceph-mon[32397]: pgmap v7923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:45 smithi146 ceph-mon[35807]: pgmap v7923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:45 smithi076 ceph-mon[35401]: pgmap v7923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10413.258160 secs 2024-07-26T16:26:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10413.258160 secs 2024-07-26T16:26:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10413.258160 secs 2024-07-26T16:26:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:47 smithi040 ceph-mon[32397]: pgmap v7924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:47 smithi146 ceph-mon[35807]: pgmap v7924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:47 smithi076 ceph-mon[35401]: pgmap v7924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:49 smithi040 ceph-mon[32397]: pgmap v7925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:49 smithi146 ceph-mon[35807]: pgmap v7925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:49.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:49 smithi076 ceph-mon[35401]: pgmap v7925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:51 smithi040 ceph-mon[32397]: pgmap v7926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10418.258302 secs 2024-07-26T16:26:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:51 smithi146 ceph-mon[35807]: pgmap v7926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10418.258302 secs 2024-07-26T16:26:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:51 smithi076 ceph-mon[35401]: pgmap v7926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10418.258302 secs 2024-07-26T16:26:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:53 smithi040 ceph-mon[32397]: pgmap v7927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:53 smithi146 ceph-mon[35807]: pgmap v7927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:53 smithi076 ceph-mon[35401]: pgmap v7927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:55 smithi040 ceph-mon[32397]: pgmap v7928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:55 smithi146 ceph-mon[35807]: pgmap v7928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:55 smithi076 ceph-mon[35401]: pgmap v7928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:26:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10423.258471 secs 2024-07-26T16:26:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10423.258471 secs 2024-07-26T16:26:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10423.258471 secs 2024-07-26T16:26:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:57 smithi146 ceph-mon[35807]: pgmap v7929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:57 smithi076 ceph-mon[35401]: pgmap v7929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:57 smithi040 ceph-mon[32397]: pgmap v7929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:26:59 smithi146 ceph-mon[35807]: pgmap v7930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:26:59 smithi076 ceph-mon[35401]: pgmap v7930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:26:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:26:59 smithi040 ceph-mon[32397]: pgmap v7930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:01 smithi146 ceph-mon[35807]: pgmap v7931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10428.258617 secs 2024-07-26T16:27:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:01 smithi076 ceph-mon[35401]: pgmap v7931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10428.258617 secs 2024-07-26T16:27:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:01 smithi040 ceph-mon[32397]: pgmap v7931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10428.258617 secs 2024-07-26T16:27:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:03 smithi146 ceph-mon[35807]: pgmap v7932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:03 smithi076 ceph-mon[35401]: pgmap v7932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:03 smithi040 ceph-mon[32397]: pgmap v7932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:05 smithi146 ceph-mon[35807]: pgmap v7933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:05 smithi076 ceph-mon[35401]: pgmap v7933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:05 smithi040 ceph-mon[32397]: pgmap v7933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10433.258724 secs 2024-07-26T16:27:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10433.258724 secs 2024-07-26T16:27:06.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10433.258724 secs 2024-07-26T16:27:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:07 smithi146 ceph-mon[35807]: pgmap v7934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:07 smithi076 ceph-mon[35401]: pgmap v7934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:07 smithi040 ceph-mon[32397]: pgmap v7934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:09 smithi146 ceph-mon[35807]: pgmap v7935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:09 smithi076 ceph-mon[35401]: pgmap v7935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:09 smithi040 ceph-mon[32397]: pgmap v7935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:11 smithi146 ceph-mon[35807]: pgmap v7936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10438.258867 secs 2024-07-26T16:27:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:11 smithi076 ceph-mon[35401]: pgmap v7936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10438.258867 secs 2024-07-26T16:27:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:11 smithi040 ceph-mon[32397]: pgmap v7936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:11.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10438.258867 secs 2024-07-26T16:27:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:13 smithi146 ceph-mon[35807]: pgmap v7937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:13 smithi076 ceph-mon[35401]: pgmap v7937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:13 smithi040 ceph-mon[32397]: pgmap v7937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:15 smithi146 ceph-mon[35807]: pgmap v7938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:15 smithi076 ceph-mon[35401]: pgmap v7938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:15 smithi040 ceph-mon[32397]: pgmap v7938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10443.259007 secs 2024-07-26T16:27:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10443.259007 secs 2024-07-26T16:27:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10443.259007 secs 2024-07-26T16:27:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:17 smithi076 ceph-mon[35401]: pgmap v7939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:17 smithi040 ceph-mon[32397]: pgmap v7939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:17 smithi146 ceph-mon[35807]: pgmap v7939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:19.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:19 smithi076 ceph-mon[35401]: pgmap v7940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:19 smithi040 ceph-mon[32397]: pgmap v7940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:19 smithi146 ceph-mon[35807]: pgmap v7940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:21 smithi040 ceph-mon[32397]: pgmap v7941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10448.259146 secs 2024-07-26T16:27:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:21 smithi146 ceph-mon[35807]: pgmap v7941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10448.259146 secs 2024-07-26T16:27:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:21 smithi076 ceph-mon[35401]: pgmap v7941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10448.259146 secs 2024-07-26T16:27:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:23 smithi040 ceph-mon[32397]: pgmap v7942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:23 smithi146 ceph-mon[35807]: pgmap v7942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:23 smithi076 ceph-mon[35401]: pgmap v7942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:25 smithi040 ceph-mon[32397]: pgmap v7943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:25 smithi146 ceph-mon[35807]: pgmap v7943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:25 smithi076 ceph-mon[35401]: pgmap v7943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:26.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10453.259346 secs 2024-07-26T16:27:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10453.259346 secs 2024-07-26T16:27:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10453.259346 secs 2024-07-26T16:27:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:27 smithi040 ceph-mon[32397]: pgmap v7944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:27 smithi146 ceph-mon[35807]: pgmap v7944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:27 smithi076 ceph-mon[35401]: pgmap v7944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:29 smithi040 ceph-mon[32397]: pgmap v7945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:29 smithi146 ceph-mon[35807]: pgmap v7945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:29 smithi076 ceph-mon[35401]: pgmap v7945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:31.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:31 smithi076 ceph-mon[35401]: pgmap v7946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:31.887 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10458.259507 secs 2024-07-26T16:27:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:31 smithi040 ceph-mon[32397]: pgmap v7946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10458.259507 secs 2024-07-26T16:27:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:31 smithi146 ceph-mon[35807]: pgmap v7946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10458.259507 secs 2024-07-26T16:27:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:32 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:27:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:32 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:27:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:32 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:27:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: pgmap v7947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:33.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:33.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:33.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:33 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: pgmap v7947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:33 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: pgmap v7947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:34.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:33 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:35 smithi040 ceph-mon[32397]: pgmap v7948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:35 smithi146 ceph-mon[35807]: pgmap v7948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:35 smithi076 ceph-mon[35401]: pgmap v7948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10463.259579 secs 2024-07-26T16:27:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10463.259579 secs 2024-07-26T16:27:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10463.259579 secs 2024-07-26T16:27:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: pgmap v7949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:37.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:37.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:37.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:37 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: pgmap v7949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:37 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: pgmap v7949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:38.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:37 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:39.879 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: pgmap v7950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:39.879 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:39.880 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:39.880 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:39.880 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.880 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:39.880 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:27:39.881 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:39.882 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:27:39.882 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:27:39.882 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:27:39.882 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:39.882 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:39 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: pgmap v7950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:40.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:27:40.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.075 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:39 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: pgmap v7950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:40.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:40.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:39 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:27:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:41 smithi040 ceph-mon[32397]: pgmap v7951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:41.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10468.259725 secs 2024-07-26T16:27:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:41 smithi146 ceph-mon[35807]: pgmap v7951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10468.259725 secs 2024-07-26T16:27:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:41 smithi076 ceph-mon[35401]: pgmap v7951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10468.259725 secs 2024-07-26T16:27:43.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:43 smithi040 ceph-mon[32397]: pgmap v7952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:43 smithi146 ceph-mon[35807]: pgmap v7952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:43 smithi076 ceph-mon[35401]: pgmap v7952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:45 smithi040 ceph-mon[32397]: pgmap v7953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:45 smithi146 ceph-mon[35807]: pgmap v7953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:45 smithi076 ceph-mon[35401]: pgmap v7953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10473.259864 secs 2024-07-26T16:27:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10473.259864 secs 2024-07-26T16:27:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10473.259864 secs 2024-07-26T16:27:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:47 smithi040 ceph-mon[32397]: pgmap v7954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:47 smithi146 ceph-mon[35807]: pgmap v7954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:47 smithi076 ceph-mon[35401]: pgmap v7954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:49 smithi040 ceph-mon[32397]: pgmap v7955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:49 smithi146 ceph-mon[35807]: pgmap v7955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:49 smithi076 ceph-mon[35401]: pgmap v7955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:51 smithi040 ceph-mon[32397]: pgmap v7956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10478.260000 secs 2024-07-26T16:27:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:51 smithi146 ceph-mon[35807]: pgmap v7956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10478.260000 secs 2024-07-26T16:27:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:51 smithi076 ceph-mon[35401]: pgmap v7956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10478.260000 secs 2024-07-26T16:27:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:53 smithi040 ceph-mon[32397]: pgmap v7957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:53 smithi146 ceph-mon[35807]: pgmap v7957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:53 smithi076 ceph-mon[35401]: pgmap v7957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:55 smithi040 ceph-mon[32397]: pgmap v7958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:55 smithi146 ceph-mon[35807]: pgmap v7958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:55 smithi076 ceph-mon[35401]: pgmap v7958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:27:57.009 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10483.260141 secs 2024-07-26T16:27:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10483.260141 secs 2024-07-26T16:27:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10483.260141 secs 2024-07-26T16:27:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:57 smithi146 ceph-mon[35807]: pgmap v7959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:57 smithi076 ceph-mon[35401]: pgmap v7959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:27:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:57 smithi040 ceph-mon[32397]: pgmap v7959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:27:59 smithi146 ceph-mon[35807]: pgmap v7960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:27:59 smithi076 ceph-mon[35401]: pgmap v7960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:27:59 smithi040 ceph-mon[32397]: pgmap v7960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:01 smithi146 ceph-mon[35807]: pgmap v7961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10488.260302 secs 2024-07-26T16:28:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:01 smithi076 ceph-mon[35401]: pgmap v7961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10488.260302 secs 2024-07-26T16:28:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:01 smithi040 ceph-mon[32397]: pgmap v7961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10488.260302 secs 2024-07-26T16:28:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:03 smithi076 ceph-mon[35401]: pgmap v7962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:03 smithi146 ceph-mon[35807]: pgmap v7962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:03 smithi040 ceph-mon[32397]: pgmap v7962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:06.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:05 smithi040 ceph-mon[32397]: pgmap v7963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:05 smithi146 ceph-mon[35807]: pgmap v7963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:05 smithi076 ceph-mon[35401]: pgmap v7963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:07.069 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10493.260454 secs 2024-07-26T16:28:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10493.260454 secs 2024-07-26T16:28:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10493.260454 secs 2024-07-26T16:28:08.038 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:07 smithi146 ceph-mon[35807]: pgmap v7964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:07 smithi076 ceph-mon[35401]: pgmap v7964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:07 smithi040 ceph-mon[32397]: pgmap v7964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:08 smithi040 ceph-mon[32397]: pgmap v7965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:08 smithi146 ceph-mon[35807]: pgmap v7965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:08 smithi076 ceph-mon[35401]: pgmap v7965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:11 smithi076 ceph-mon[35401]: pgmap v7966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:11.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10498.260596 secs 2024-07-26T16:28:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:11 smithi040 ceph-mon[32397]: pgmap v7966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:11.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10498.260596 secs 2024-07-26T16:28:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:11 smithi146 ceph-mon[35807]: pgmap v7966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10498.260596 secs 2024-07-26T16:28:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:13 smithi040 ceph-mon[32397]: pgmap v7967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:13 smithi146 ceph-mon[35807]: pgmap v7967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:13 smithi076 ceph-mon[35401]: pgmap v7967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:15 smithi040 ceph-mon[32397]: pgmap v7968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:15 smithi146 ceph-mon[35807]: pgmap v7968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:15 smithi076 ceph-mon[35401]: pgmap v7968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10503.260726 secs 2024-07-26T16:28:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10503.260726 secs 2024-07-26T16:28:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10503.260726 secs 2024-07-26T16:28:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:17 smithi040 ceph-mon[32397]: pgmap v7969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:17 smithi146 ceph-mon[35807]: pgmap v7969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:17 smithi076 ceph-mon[35401]: pgmap v7969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:19 smithi040 ceph-mon[32397]: pgmap v7970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:19 smithi146 ceph-mon[35807]: pgmap v7970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:19.839 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:19 smithi076 ceph-mon[35401]: pgmap v7970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:21 smithi040 ceph-mon[32397]: pgmap v7971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10508.260854 secs 2024-07-26T16:28:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:21 smithi146 ceph-mon[35807]: pgmap v7971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10508.260854 secs 2024-07-26T16:28:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:21 smithi076 ceph-mon[35401]: pgmap v7971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10508.260854 secs 2024-07-26T16:28:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:23 smithi040 ceph-mon[32397]: pgmap v7972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:23 smithi146 ceph-mon[35807]: pgmap v7972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:23 smithi076 ceph-mon[35401]: pgmap v7972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:25 smithi040 ceph-mon[32397]: pgmap v7973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:25 smithi146 ceph-mon[35807]: pgmap v7973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:25 smithi076 ceph-mon[35401]: pgmap v7973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:26.723 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10513.260939 secs 2024-07-26T16:28:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10513.260939 secs 2024-07-26T16:28:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10513.260939 secs 2024-07-26T16:28:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:27 smithi040 ceph-mon[32397]: pgmap v7974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:27 smithi146 ceph-mon[35807]: pgmap v7974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:27 smithi076 ceph-mon[35401]: pgmap v7974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:29 smithi040 ceph-mon[32397]: pgmap v7975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:29 smithi146 ceph-mon[35807]: pgmap v7975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:29 smithi076 ceph-mon[35401]: pgmap v7975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:31 smithi040 ceph-mon[32397]: pgmap v7976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:31.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10518.261085 secs 2024-07-26T16:28:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:31 smithi146 ceph-mon[35807]: pgmap v7976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10518.261085 secs 2024-07-26T16:28:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:31 smithi076 ceph-mon[35401]: pgmap v7976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10518.261085 secs 2024-07-26T16:28:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:33 smithi040 ceph-mon[32397]: pgmap v7977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:33 smithi146 ceph-mon[35807]: pgmap v7977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:33 smithi076 ceph-mon[35401]: pgmap v7977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:35 smithi040 ceph-mon[32397]: pgmap v7978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:35 smithi146 ceph-mon[35807]: pgmap v7978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:35 smithi076 ceph-mon[35401]: pgmap v7978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10523.261226 secs 2024-07-26T16:28:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10523.261226 secs 2024-07-26T16:28:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10523.261226 secs 2024-07-26T16:28:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:37 smithi040 ceph-mon[32397]: pgmap v7979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:37 smithi146 ceph-mon[35807]: pgmap v7979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:37 smithi076 ceph-mon[35401]: pgmap v7979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:39 smithi040 ceph-mon[32397]: pgmap v7980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:39 smithi146 ceph-mon[35807]: pgmap v7980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:39 smithi076 ceph-mon[35401]: pgmap v7980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:41 smithi040 ceph-mon[32397]: pgmap v7981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10528.261367 secs 2024-07-26T16:28:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:41 smithi146 ceph-mon[35807]: pgmap v7981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10528.261367 secs 2024-07-26T16:28:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:41 smithi076 ceph-mon[35401]: pgmap v7981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10528.261367 secs 2024-07-26T16:28:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:43 smithi040 ceph-mon[32397]: pgmap v7982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:43 smithi146 ceph-mon[35807]: pgmap v7982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:43 smithi076 ceph-mon[35401]: pgmap v7982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:45 smithi040 ceph-mon[32397]: pgmap v7983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:45 smithi146 ceph-mon[35807]: pgmap v7983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:45 smithi076 ceph-mon[35401]: pgmap v7983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10533.261509 secs 2024-07-26T16:28:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10533.261509 secs 2024-07-26T16:28:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10533.261509 secs 2024-07-26T16:28:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:47 smithi146 ceph-mon[35807]: pgmap v7984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:47 smithi076 ceph-mon[35401]: pgmap v7984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:47 smithi040 ceph-mon[32397]: pgmap v7984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:49 smithi146 ceph-mon[35807]: pgmap v7985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:49 smithi076 ceph-mon[35401]: pgmap v7985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:49 smithi040 ceph-mon[32397]: pgmap v7985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:51 smithi146 ceph-mon[35807]: pgmap v7986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10538.261650 secs 2024-07-26T16:28:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:51 smithi076 ceph-mon[35401]: pgmap v7986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10538.261650 secs 2024-07-26T16:28:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:51 smithi040 ceph-mon[32397]: pgmap v7986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10538.261650 secs 2024-07-26T16:28:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:53 smithi146 ceph-mon[35807]: pgmap v7987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:53 smithi076 ceph-mon[35401]: pgmap v7987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:53 smithi040 ceph-mon[32397]: pgmap v7987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:55 smithi146 ceph-mon[35807]: pgmap v7988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:55 smithi076 ceph-mon[35401]: pgmap v7988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:55 smithi040 ceph-mon[32397]: pgmap v7988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:28:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10543.261811 secs 2024-07-26T16:28:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10543.261811 secs 2024-07-26T16:28:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10543.261811 secs 2024-07-26T16:28:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:57 smithi146 ceph-mon[35807]: pgmap v7989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:57 smithi076 ceph-mon[35401]: pgmap v7989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:57 smithi040 ceph-mon[32397]: pgmap v7989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:28:59 smithi146 ceph-mon[35807]: pgmap v7990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:28:59 smithi076 ceph-mon[35401]: pgmap v7990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:28:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:28:59 smithi040 ceph-mon[32397]: pgmap v7990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:01 smithi146 ceph-mon[35807]: pgmap v7991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10548.261956 secs 2024-07-26T16:29:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:01 smithi076 ceph-mon[35401]: pgmap v7991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10548.261956 secs 2024-07-26T16:29:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:01 smithi040 ceph-mon[32397]: pgmap v7991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10548.261956 secs 2024-07-26T16:29:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:03 smithi076 ceph-mon[35401]: pgmap v7992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:03 smithi040 ceph-mon[32397]: pgmap v7992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:03 smithi146 ceph-mon[35807]: pgmap v7992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:05 smithi040 ceph-mon[32397]: pgmap v7993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:05 smithi146 ceph-mon[35807]: pgmap v7993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:05 smithi076 ceph-mon[35401]: pgmap v7993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:06.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10553.262113 secs 2024-07-26T16:29:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10553.262113 secs 2024-07-26T16:29:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10553.262113 secs 2024-07-26T16:29:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:07 smithi040 ceph-mon[32397]: pgmap v7994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:07 smithi146 ceph-mon[35807]: pgmap v7994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:07 smithi076 ceph-mon[35401]: pgmap v7994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:09 smithi040 ceph-mon[32397]: pgmap v7995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:09 smithi146 ceph-mon[35807]: pgmap v7995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:09 smithi076 ceph-mon[35401]: pgmap v7995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:11 smithi040 ceph-mon[32397]: pgmap v7996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10558.262253 secs 2024-07-26T16:29:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:11 smithi146 ceph-mon[35807]: pgmap v7996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10558.262253 secs 2024-07-26T16:29:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:11 smithi076 ceph-mon[35401]: pgmap v7996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10558.262253 secs 2024-07-26T16:29:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:13 smithi040 ceph-mon[32397]: pgmap v7997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:13 smithi146 ceph-mon[35807]: pgmap v7997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:13 smithi076 ceph-mon[35401]: pgmap v7997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:15 smithi040 ceph-mon[32397]: pgmap v7998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:15 smithi146 ceph-mon[35807]: pgmap v7998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:15 smithi076 ceph-mon[35401]: pgmap v7998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10563.262389 secs 2024-07-26T16:29:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10563.262389 secs 2024-07-26T16:29:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10563.262389 secs 2024-07-26T16:29:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:17 smithi040 ceph-mon[32397]: pgmap v7999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:17 smithi146 ceph-mon[35807]: pgmap v7999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:17 smithi076 ceph-mon[35401]: pgmap v7999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:19 smithi040 ceph-mon[32397]: pgmap v8000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:19 smithi146 ceph-mon[35807]: pgmap v8000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:19 smithi076 ceph-mon[35401]: pgmap v8000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:21 smithi040 ceph-mon[32397]: pgmap v8001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:21.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10568.262494 secs 2024-07-26T16:29:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:21 smithi146 ceph-mon[35807]: pgmap v8001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10568.262494 secs 2024-07-26T16:29:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:21 smithi076 ceph-mon[35401]: pgmap v8001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10568.262494 secs 2024-07-26T16:29:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:23 smithi040 ceph-mon[32397]: pgmap v8002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:23 smithi146 ceph-mon[35807]: pgmap v8002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:23 smithi076 ceph-mon[35401]: pgmap v8002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:25 smithi040 ceph-mon[32397]: pgmap v8003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:25 smithi146 ceph-mon[35807]: pgmap v8003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:25 smithi076 ceph-mon[35401]: pgmap v8003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:26.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10573.262589 secs 2024-07-26T16:29:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10573.262589 secs 2024-07-26T16:29:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10573.262589 secs 2024-07-26T16:29:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:27 smithi040 ceph-mon[32397]: pgmap v8004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:28.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:27 smithi146 ceph-mon[35807]: pgmap v8004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:28.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:27 smithi076 ceph-mon[35401]: pgmap v8004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:29 smithi040 ceph-mon[32397]: pgmap v8005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:29 smithi146 ceph-mon[35807]: pgmap v8005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:29 smithi076 ceph-mon[35401]: pgmap v8005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:31 smithi040 ceph-mon[32397]: pgmap v8006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10578.262730 secs 2024-07-26T16:29:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:31 smithi146 ceph-mon[35807]: pgmap v8006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10578.262730 secs 2024-07-26T16:29:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:31 smithi076 ceph-mon[35401]: pgmap v8006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:32.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10578.262730 secs 2024-07-26T16:29:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:33 smithi040 ceph-mon[32397]: pgmap v8007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:33 smithi146 ceph-mon[35807]: pgmap v8007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:33 smithi076 ceph-mon[35401]: pgmap v8007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:35 smithi040 ceph-mon[32397]: pgmap v8008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:35 smithi146 ceph-mon[35807]: pgmap v8008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:35 smithi076 ceph-mon[35401]: pgmap v8008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10583.262865 secs 2024-07-26T16:29:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10583.262865 secs 2024-07-26T16:29:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10583.262865 secs 2024-07-26T16:29:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:37 smithi146 ceph-mon[35807]: pgmap v8009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:37 smithi076 ceph-mon[35401]: pgmap v8009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:37 smithi040 ceph-mon[32397]: pgmap v8009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:39 smithi146 ceph-mon[35807]: pgmap v8010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:39 smithi076 ceph-mon[35401]: pgmap v8010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:39 smithi040 ceph-mon[32397]: pgmap v8010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:29:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:41 smithi146 ceph-mon[35807]: pgmap v8011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:29:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10588.263007 secs 2024-07-26T16:29:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:41 smithi076 ceph-mon[35401]: pgmap v8011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:29:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10588.263007 secs 2024-07-26T16:29:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:41 smithi040 ceph-mon[32397]: pgmap v8011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:29:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10588.263007 secs 2024-07-26T16:29:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:43 smithi146 ceph-mon[35807]: pgmap v8012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:43 smithi076 ceph-mon[35401]: pgmap v8012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:43 smithi040 ceph-mon[32397]: pgmap v8012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:45 smithi146 ceph-mon[35807]: pgmap v8013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:45 smithi076 ceph-mon[35401]: pgmap v8013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:45 smithi040 ceph-mon[32397]: pgmap v8013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10593.263145 secs 2024-07-26T16:29:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10593.263145 secs 2024-07-26T16:29:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10593.263145 secs 2024-07-26T16:29:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:47 smithi146 ceph-mon[35807]: pgmap v8014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:47 smithi076 ceph-mon[35401]: pgmap v8014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:47 smithi040 ceph-mon[32397]: pgmap v8014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:49 smithi146 ceph-mon[35807]: pgmap v8015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:49 smithi076 ceph-mon[35401]: pgmap v8015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:49 smithi040 ceph-mon[32397]: pgmap v8015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:51 smithi146 ceph-mon[35807]: pgmap v8016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10598.263331 secs 2024-07-26T16:29:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:51 smithi076 ceph-mon[35401]: pgmap v8016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10598.263331 secs 2024-07-26T16:29:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:51 smithi040 ceph-mon[32397]: pgmap v8016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10598.263331 secs 2024-07-26T16:29:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:53 smithi146 ceph-mon[35807]: pgmap v8017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:53 smithi076 ceph-mon[35401]: pgmap v8017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:53 smithi040 ceph-mon[32397]: pgmap v8017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:54 smithi040 ceph-mon[32397]: pgmap v8018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:54 smithi146 ceph-mon[35807]: pgmap v8018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:54 smithi076 ceph-mon[35401]: pgmap v8018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:29:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10603.263461 secs 2024-07-26T16:29:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10603.263461 secs 2024-07-26T16:29:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10603.263461 secs 2024-07-26T16:29:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:57 smithi076 ceph-mon[35401]: pgmap v8019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:57 smithi040 ceph-mon[32397]: pgmap v8019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:57 smithi146 ceph-mon[35807]: pgmap v8019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:29:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:29:59 smithi040 ceph-mon[32397]: pgmap v8020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:29:59 smithi146 ceph-mon[35807]: pgmap v8020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:29:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:29:59 smithi076 ceph-mon[35401]: pgmap v8020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:30:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:30:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:30:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:01 smithi040 ceph-mon[32397]: pgmap v8021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10608.263566 secs 2024-07-26T16:30:01.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:01 smithi076 ceph-mon[35401]: pgmap v8021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:01.736 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10608.263566 secs 2024-07-26T16:30:01.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:01 smithi146 ceph-mon[35807]: pgmap v8021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:01.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10608.263566 secs 2024-07-26T16:30:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:03 smithi040 ceph-mon[32397]: pgmap v8022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:03 smithi146 ceph-mon[35807]: pgmap v8022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:03 smithi076 ceph-mon[35401]: pgmap v8022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:05 smithi040 ceph-mon[32397]: pgmap v8023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:05 smithi146 ceph-mon[35807]: pgmap v8023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:05 smithi076 ceph-mon[35401]: pgmap v8023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10613.263651 secs 2024-07-26T16:30:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10613.263651 secs 2024-07-26T16:30:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10613.263651 secs 2024-07-26T16:30:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:07 smithi040 ceph-mon[32397]: pgmap v8024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:07 smithi146 ceph-mon[35807]: pgmap v8024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:07 smithi076 ceph-mon[35401]: pgmap v8024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:09 smithi040 ceph-mon[32397]: pgmap v8025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:09 smithi146 ceph-mon[35807]: pgmap v8025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:09 smithi076 ceph-mon[35401]: pgmap v8025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:11 smithi040 ceph-mon[32397]: pgmap v8026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:30:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10618.263788 secs 2024-07-26T16:30:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:11 smithi146 ceph-mon[35807]: pgmap v8026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:30:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10618.263788 secs 2024-07-26T16:30:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:11 smithi076 ceph-mon[35401]: pgmap v8026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:30:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10618.263788 secs 2024-07-26T16:30:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:13 smithi040 ceph-mon[32397]: pgmap v8027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:13 smithi146 ceph-mon[35807]: pgmap v8027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:13 smithi076 ceph-mon[35401]: pgmap v8027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:15 smithi040 ceph-mon[32397]: pgmap v8028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:15 smithi146 ceph-mon[35807]: pgmap v8028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:15 smithi076 ceph-mon[35401]: pgmap v8028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10623.263925 secs 2024-07-26T16:30:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10623.263925 secs 2024-07-26T16:30:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10623.263925 secs 2024-07-26T16:30:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:17 smithi146 ceph-mon[35807]: pgmap v8029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:17 smithi076 ceph-mon[35401]: pgmap v8029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:17 smithi040 ceph-mon[32397]: pgmap v8029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:19 smithi146 ceph-mon[35807]: pgmap v8030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:19 smithi076 ceph-mon[35401]: pgmap v8030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:19 smithi040 ceph-mon[32397]: pgmap v8030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:21 smithi146 ceph-mon[35807]: pgmap v8031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:21.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10628.264082 secs 2024-07-26T16:30:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:21 smithi076 ceph-mon[35401]: pgmap v8031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10628.264082 secs 2024-07-26T16:30:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:21 smithi040 ceph-mon[32397]: pgmap v8031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10628.264082 secs 2024-07-26T16:30:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:23 smithi146 ceph-mon[35807]: pgmap v8032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:23 smithi076 ceph-mon[35401]: pgmap v8032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:23 smithi040 ceph-mon[32397]: pgmap v8032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:25 smithi146 ceph-mon[35807]: pgmap v8033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:25 smithi076 ceph-mon[35401]: pgmap v8033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:25 smithi040 ceph-mon[32397]: pgmap v8033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10633.264249 secs 2024-07-26T16:30:26.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10633.264249 secs 2024-07-26T16:30:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10633.264249 secs 2024-07-26T16:30:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:27 smithi146 ceph-mon[35807]: pgmap v8034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:27 smithi076 ceph-mon[35401]: pgmap v8034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:27 smithi040 ceph-mon[32397]: pgmap v8034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:29 smithi146 ceph-mon[35807]: pgmap v8035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:29 smithi076 ceph-mon[35401]: pgmap v8035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:29 smithi040 ceph-mon[32397]: pgmap v8035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:31 smithi146 ceph-mon[35807]: pgmap v8036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10638.264360 secs 2024-07-26T16:30:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:31 smithi076 ceph-mon[35401]: pgmap v8036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10638.264360 secs 2024-07-26T16:30:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:31 smithi040 ceph-mon[32397]: pgmap v8036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10638.264360 secs 2024-07-26T16:30:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:33 smithi146 ceph-mon[35807]: pgmap v8037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:33 smithi076 ceph-mon[35401]: pgmap v8037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:33 smithi040 ceph-mon[32397]: pgmap v8037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:35 smithi146 ceph-mon[35807]: pgmap v8038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:35 smithi076 ceph-mon[35401]: pgmap v8038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:35.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:35 smithi040 ceph-mon[32397]: pgmap v8038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10643.264504 secs 2024-07-26T16:30:36.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10643.264504 secs 2024-07-26T16:30:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10643.264504 secs 2024-07-26T16:30:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:37 smithi076 ceph-mon[35401]: pgmap v8039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:37 smithi040 ceph-mon[32397]: pgmap v8039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:37 smithi146 ceph-mon[35807]: pgmap v8039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:39 smithi040 ceph-mon[32397]: pgmap v8040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:39 smithi146 ceph-mon[35807]: pgmap v8040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:39 smithi076 ceph-mon[35401]: pgmap v8040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:41 smithi040 ceph-mon[32397]: pgmap v8041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10648.264639 secs 2024-07-26T16:30:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:41 smithi146 ceph-mon[35807]: pgmap v8041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10648.264639 secs 2024-07-26T16:30:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:41 smithi076 ceph-mon[35401]: pgmap v8041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:42.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10648.264639 secs 2024-07-26T16:30:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:43 smithi040 ceph-mon[32397]: pgmap v8042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:43 smithi146 ceph-mon[35807]: pgmap v8042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:43 smithi076 ceph-mon[35401]: pgmap v8042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:45 smithi040 ceph-mon[32397]: pgmap v8043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:45 smithi146 ceph-mon[35807]: pgmap v8043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:45 smithi076 ceph-mon[35401]: pgmap v8043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10653.264778 secs 2024-07-26T16:30:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10653.264778 secs 2024-07-26T16:30:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10653.264778 secs 2024-07-26T16:30:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:47 smithi040 ceph-mon[32397]: pgmap v8044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:47 smithi146 ceph-mon[35807]: pgmap v8044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:47 smithi076 ceph-mon[35401]: pgmap v8044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:49 smithi040 ceph-mon[32397]: pgmap v8045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:49 smithi146 ceph-mon[35807]: pgmap v8045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:49 smithi076 ceph-mon[35401]: pgmap v8045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:30:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:51 smithi040 ceph-mon[32397]: pgmap v8046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10658.264934 secs 2024-07-26T16:30:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:51 smithi146 ceph-mon[35807]: pgmap v8046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10658.264934 secs 2024-07-26T16:30:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:51 smithi076 ceph-mon[35401]: pgmap v8046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10658.264934 secs 2024-07-26T16:30:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:53 smithi040 ceph-mon[32397]: pgmap v8047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:53 smithi146 ceph-mon[35807]: pgmap v8047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:53 smithi076 ceph-mon[35401]: pgmap v8047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:55 smithi040 ceph-mon[32397]: pgmap v8048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:55 smithi146 ceph-mon[35807]: pgmap v8048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:55 smithi076 ceph-mon[35401]: pgmap v8048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:30:56.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10663.265072 secs 2024-07-26T16:30:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10663.265072 secs 2024-07-26T16:30:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10663.265072 secs 2024-07-26T16:30:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:57 smithi040 ceph-mon[32397]: pgmap v8049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:57 smithi146 ceph-mon[35807]: pgmap v8049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:57 smithi076 ceph-mon[35401]: pgmap v8049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:30:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:30:59 smithi040 ceph-mon[32397]: pgmap v8050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:30:59 smithi146 ceph-mon[35807]: pgmap v8050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:30:59 smithi076 ceph-mon[35401]: pgmap v8050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:01 smithi040 ceph-mon[32397]: pgmap v8051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10668.265171 secs 2024-07-26T16:31:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:01 smithi146 ceph-mon[35807]: pgmap v8051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10668.265171 secs 2024-07-26T16:31:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:01 smithi076 ceph-mon[35401]: pgmap v8051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10668.265171 secs 2024-07-26T16:31:03.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:03 smithi040 ceph-mon[32397]: pgmap v8052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:03 smithi146 ceph-mon[35807]: pgmap v8052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:03 smithi076 ceph-mon[35401]: pgmap v8052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:05 smithi040 ceph-mon[32397]: pgmap v8053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:05 smithi146 ceph-mon[35807]: pgmap v8053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:05 smithi076 ceph-mon[35401]: pgmap v8053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10673.265334 secs 2024-07-26T16:31:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10673.265334 secs 2024-07-26T16:31:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10673.265334 secs 2024-07-26T16:31:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:07 smithi040 ceph-mon[32397]: pgmap v8054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:07 smithi146 ceph-mon[35807]: pgmap v8054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:07 smithi076 ceph-mon[35401]: pgmap v8054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:09 smithi040 ceph-mon[32397]: pgmap v8055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:09 smithi146 ceph-mon[35807]: pgmap v8055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:09 smithi076 ceph-mon[35401]: pgmap v8055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:11 smithi040 ceph-mon[32397]: pgmap v8056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10678.265437 secs 2024-07-26T16:31:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:11 smithi146 ceph-mon[35807]: pgmap v8056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10678.265437 secs 2024-07-26T16:31:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:11 smithi076 ceph-mon[35401]: pgmap v8056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10678.265437 secs 2024-07-26T16:31:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:13 smithi146 ceph-mon[35807]: pgmap v8057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:13 smithi076 ceph-mon[35401]: pgmap v8057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:13 smithi040 ceph-mon[32397]: pgmap v8057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:15 smithi146 ceph-mon[35807]: pgmap v8058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:15 smithi076 ceph-mon[35401]: pgmap v8058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:15 smithi040 ceph-mon[32397]: pgmap v8058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10683.265573 secs 2024-07-26T16:31:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10683.265573 secs 2024-07-26T16:31:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10683.265573 secs 2024-07-26T16:31:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:17 smithi146 ceph-mon[35807]: pgmap v8059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:17 smithi076 ceph-mon[35401]: pgmap v8059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:17 smithi040 ceph-mon[32397]: pgmap v8059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:19 smithi146 ceph-mon[35807]: pgmap v8060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:19 smithi076 ceph-mon[35401]: pgmap v8060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:19 smithi040 ceph-mon[32397]: pgmap v8060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:21 smithi146 ceph-mon[35807]: pgmap v8061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10688.265712 secs 2024-07-26T16:31:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:21 smithi076 ceph-mon[35401]: pgmap v8061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10688.265712 secs 2024-07-26T16:31:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:21 smithi040 ceph-mon[32397]: pgmap v8061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10688.265712 secs 2024-07-26T16:31:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:23 smithi146 ceph-mon[35807]: pgmap v8062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:23 smithi076 ceph-mon[35401]: pgmap v8062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:23 smithi040 ceph-mon[32397]: pgmap v8062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:26.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:25 smithi146 ceph-mon[35807]: pgmap v8063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:25 smithi076 ceph-mon[35401]: pgmap v8063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:25 smithi040 ceph-mon[32397]: pgmap v8063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10693.265849 secs 2024-07-26T16:31:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10693.265849 secs 2024-07-26T16:31:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10693.265849 secs 2024-07-26T16:31:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:27 smithi146 ceph-mon[35807]: pgmap v8064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:27 smithi076 ceph-mon[35401]: pgmap v8064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:27 smithi040 ceph-mon[32397]: pgmap v8064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:29 smithi146 ceph-mon[35807]: pgmap v8065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:29 smithi076 ceph-mon[35401]: pgmap v8065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:29 smithi040 ceph-mon[32397]: pgmap v8065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:32.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:31 smithi076 ceph-mon[35401]: pgmap v8066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:32.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10698.265991 secs 2024-07-26T16:31:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:31 smithi040 ceph-mon[32397]: pgmap v8066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10698.265991 secs 2024-07-26T16:31:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:31 smithi146 ceph-mon[35807]: pgmap v8066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10698.265991 secs 2024-07-26T16:31:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:33 smithi076 ceph-mon[35401]: pgmap v8067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:33 smithi040 ceph-mon[32397]: pgmap v8067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:33 smithi146 ceph-mon[35807]: pgmap v8067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:34 smithi040 ceph-mon[32397]: pgmap v8068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:34 smithi146 ceph-mon[35807]: pgmap v8068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:34 smithi076 ceph-mon[35401]: pgmap v8068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10703.266134 secs 2024-07-26T16:31:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10703.266134 secs 2024-07-26T16:31:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10703.266134 secs 2024-07-26T16:31:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:37 smithi040 ceph-mon[32397]: pgmap v8069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:37 smithi146 ceph-mon[35807]: pgmap v8069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:37 smithi076 ceph-mon[35401]: pgmap v8069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:39 smithi040 ceph-mon[32397]: pgmap v8070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:39 smithi146 ceph-mon[35807]: pgmap v8070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:39 smithi076 ceph-mon[35401]: pgmap v8070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:41 smithi040 ceph-mon[32397]: pgmap v8071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10708.266308 secs 2024-07-26T16:31:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:41 smithi146 ceph-mon[35807]: pgmap v8071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10708.266308 secs 2024-07-26T16:31:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:41 smithi076 ceph-mon[35401]: pgmap v8071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10708.266308 secs 2024-07-26T16:31:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:43 smithi040 ceph-mon[32397]: pgmap v8072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:43 smithi146 ceph-mon[35807]: pgmap v8072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:43 smithi076 ceph-mon[35401]: pgmap v8072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:45 smithi040 ceph-mon[32397]: pgmap v8073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:45 smithi146 ceph-mon[35807]: pgmap v8073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:45 smithi076 ceph-mon[35401]: pgmap v8073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10713.266444 secs 2024-07-26T16:31:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10713.266444 secs 2024-07-26T16:31:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10713.266444 secs 2024-07-26T16:31:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:47 smithi146 ceph-mon[35807]: pgmap v8074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:47 smithi076 ceph-mon[35401]: pgmap v8074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:47 smithi040 ceph-mon[32397]: pgmap v8074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:49 smithi146 ceph-mon[35807]: pgmap v8075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:49.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:49 smithi076 ceph-mon[35401]: pgmap v8075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:49 smithi040 ceph-mon[32397]: pgmap v8075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:51 smithi146 ceph-mon[35807]: pgmap v8076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10718.266531 secs 2024-07-26T16:31:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:51 smithi076 ceph-mon[35401]: pgmap v8076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10718.266531 secs 2024-07-26T16:31:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:51 smithi040 ceph-mon[32397]: pgmap v8076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10718.266531 secs 2024-07-26T16:31:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:53 smithi146 ceph-mon[35807]: pgmap v8077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:53 smithi076 ceph-mon[35401]: pgmap v8077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:53 smithi040 ceph-mon[32397]: pgmap v8077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:55 smithi146 ceph-mon[35807]: pgmap v8078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:55.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:55 smithi076 ceph-mon[35401]: pgmap v8078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:55 smithi040 ceph-mon[32397]: pgmap v8078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:31:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10723.266672 secs 2024-07-26T16:31:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10723.266672 secs 2024-07-26T16:31:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10723.266672 secs 2024-07-26T16:31:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:57 smithi146 ceph-mon[35807]: pgmap v8079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:57 smithi076 ceph-mon[35401]: pgmap v8079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:57 smithi040 ceph-mon[32397]: pgmap v8079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:31:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:31:59 smithi146 ceph-mon[35807]: pgmap v8080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:31:59 smithi076 ceph-mon[35401]: pgmap v8080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:31:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:31:59 smithi040 ceph-mon[32397]: pgmap v8080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:01 smithi146 ceph-mon[35807]: pgmap v8081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10728.266805 secs 2024-07-26T16:32:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:01 smithi076 ceph-mon[35401]: pgmap v8081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10728.266805 secs 2024-07-26T16:32:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:01 smithi040 ceph-mon[32397]: pgmap v8081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10728.266805 secs 2024-07-26T16:32:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:03 smithi146 ceph-mon[35807]: pgmap v8082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:03 smithi076 ceph-mon[35401]: pgmap v8082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:03 smithi040 ceph-mon[32397]: pgmap v8082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:05 smithi076 ceph-mon[35401]: pgmap v8083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:05 smithi040 ceph-mon[32397]: pgmap v8083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:05 smithi146 ceph-mon[35807]: pgmap v8083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:06.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10733.266946 secs 2024-07-26T16:32:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10733.266946 secs 2024-07-26T16:32:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10733.266946 secs 2024-07-26T16:32:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:07 smithi040 ceph-mon[32397]: pgmap v8084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:07 smithi146 ceph-mon[35807]: pgmap v8084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:07 smithi076 ceph-mon[35401]: pgmap v8084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:09 smithi040 ceph-mon[32397]: pgmap v8085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:09 smithi146 ceph-mon[35807]: pgmap v8085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:09 smithi076 ceph-mon[35401]: pgmap v8085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:11 smithi040 ceph-mon[32397]: pgmap v8086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10738.267033 secs 2024-07-26T16:32:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:11 smithi146 ceph-mon[35807]: pgmap v8086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10738.267033 secs 2024-07-26T16:32:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:11 smithi076 ceph-mon[35401]: pgmap v8086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:12.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10738.267033 secs 2024-07-26T16:32:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:13 smithi040 ceph-mon[32397]: pgmap v8087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:13 smithi146 ceph-mon[35807]: pgmap v8087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:13 smithi076 ceph-mon[35401]: pgmap v8087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:15 smithi040 ceph-mon[32397]: pgmap v8088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:15 smithi146 ceph-mon[35807]: pgmap v8088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:15 smithi076 ceph-mon[35401]: pgmap v8088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10743.267170 secs 2024-07-26T16:32:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10743.267170 secs 2024-07-26T16:32:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10743.267170 secs 2024-07-26T16:32:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:17 smithi040 ceph-mon[32397]: pgmap v8089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:17 smithi146 ceph-mon[35807]: pgmap v8089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:17 smithi076 ceph-mon[35401]: pgmap v8089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:19 smithi040 ceph-mon[32397]: pgmap v8090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:19 smithi146 ceph-mon[35807]: pgmap v8090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:19 smithi076 ceph-mon[35401]: pgmap v8090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:21 smithi040 ceph-mon[32397]: pgmap v8091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10748.267330 secs 2024-07-26T16:32:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:21 smithi146 ceph-mon[35807]: pgmap v8091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10748.267330 secs 2024-07-26T16:32:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:21 smithi076 ceph-mon[35401]: pgmap v8091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10748.267330 secs 2024-07-26T16:32:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:23 smithi040 ceph-mon[32397]: pgmap v8092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:23 smithi146 ceph-mon[35807]: pgmap v8092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:23 smithi076 ceph-mon[35401]: pgmap v8092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:25 smithi040 ceph-mon[32397]: pgmap v8093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:25 smithi146 ceph-mon[35807]: pgmap v8093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:25 smithi076 ceph-mon[35401]: pgmap v8093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:26.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10753.267427 secs 2024-07-26T16:32:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10753.267427 secs 2024-07-26T16:32:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10753.267427 secs 2024-07-26T16:32:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:27 smithi040 ceph-mon[32397]: pgmap v8094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:27 smithi146 ceph-mon[35807]: pgmap v8094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:27 smithi076 ceph-mon[35401]: pgmap v8094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:29 smithi040 ceph-mon[32397]: pgmap v8095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:29 smithi146 ceph-mon[35807]: pgmap v8095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:29 smithi076 ceph-mon[35401]: pgmap v8095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:31 smithi040 ceph-mon[32397]: pgmap v8096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:31.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10758.267568 secs 2024-07-26T16:32:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:31 smithi146 ceph-mon[35807]: pgmap v8096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10758.267568 secs 2024-07-26T16:32:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:31 smithi076 ceph-mon[35401]: pgmap v8096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:32.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10758.267568 secs 2024-07-26T16:32:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:33 smithi040 ceph-mon[32397]: pgmap v8097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:33 smithi146 ceph-mon[35807]: pgmap v8097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:33 smithi076 ceph-mon[35401]: pgmap v8097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:35 smithi040 ceph-mon[32397]: pgmap v8098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:35 smithi146 ceph-mon[35807]: pgmap v8098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:35 smithi076 ceph-mon[35401]: pgmap v8098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10763.267708 secs 2024-07-26T16:32:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10763.267708 secs 2024-07-26T16:32:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10763.267708 secs 2024-07-26T16:32:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:37 smithi040 ceph-mon[32397]: pgmap v8099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:37 smithi146 ceph-mon[35807]: pgmap v8099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:37 smithi076 ceph-mon[35401]: pgmap v8099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:39 smithi040 ceph-mon[32397]: pgmap v8100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:39 smithi146 ceph-mon[35807]: pgmap v8100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:39 smithi076 ceph-mon[35401]: pgmap v8100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:41 smithi146 ceph-mon[35807]: pgmap v8101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10768.267869 secs 2024-07-26T16:32:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:41 smithi076 ceph-mon[35401]: pgmap v8101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10768.267869 secs 2024-07-26T16:32:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:41 smithi040 ceph-mon[32397]: pgmap v8101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10768.267869 secs 2024-07-26T16:32:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:43 smithi146 ceph-mon[35807]: pgmap v8102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:43 smithi076 ceph-mon[35401]: pgmap v8102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:43 smithi040 ceph-mon[32397]: pgmap v8102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:45 smithi146 ceph-mon[35807]: pgmap v8103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:45 smithi076 ceph-mon[35401]: pgmap v8103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:45 smithi040 ceph-mon[32397]: pgmap v8103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10773.268031 secs 2024-07-26T16:32:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10773.268031 secs 2024-07-26T16:32:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10773.268031 secs 2024-07-26T16:32:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:47 smithi146 ceph-mon[35807]: pgmap v8104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:47 smithi076 ceph-mon[35401]: pgmap v8104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:47 smithi040 ceph-mon[32397]: pgmap v8104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:49 smithi146 ceph-mon[35807]: pgmap v8105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:49 smithi076 ceph-mon[35401]: pgmap v8105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:49 smithi040 ceph-mon[32397]: pgmap v8105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:32:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:51 smithi146 ceph-mon[35807]: pgmap v8106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10778.268172 secs 2024-07-26T16:32:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:51 smithi076 ceph-mon[35401]: pgmap v8106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10778.268172 secs 2024-07-26T16:32:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:51 smithi040 ceph-mon[32397]: pgmap v8106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10778.268172 secs 2024-07-26T16:32:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:53 smithi146 ceph-mon[35807]: pgmap v8107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:53 smithi076 ceph-mon[35401]: pgmap v8107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:53 smithi040 ceph-mon[32397]: pgmap v8107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:55 smithi146 ceph-mon[35807]: pgmap v8108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:55 smithi076 ceph-mon[35401]: pgmap v8108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:55 smithi040 ceph-mon[32397]: pgmap v8108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:32:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10783.268340 secs 2024-07-26T16:32:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10783.268340 secs 2024-07-26T16:32:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10783.268340 secs 2024-07-26T16:32:58.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:57 smithi040 ceph-mon[32397]: pgmap v8109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:57 smithi146 ceph-mon[35807]: pgmap v8109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:32:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:57 smithi076 ceph-mon[35401]: pgmap v8109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:32:59 smithi040 ceph-mon[32397]: pgmap v8110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:32:59 smithi146 ceph-mon[35807]: pgmap v8110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:32:59 smithi076 ceph-mon[35401]: pgmap v8110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:02.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:01 smithi076 ceph-mon[35401]: pgmap v8111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:02.137 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10788.268443 secs 2024-07-26T16:33:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:01 smithi040 ceph-mon[32397]: pgmap v8111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10788.268443 secs 2024-07-26T16:33:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:01 smithi146 ceph-mon[35807]: pgmap v8111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10788.268443 secs 2024-07-26T16:33:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:02 smithi040 ceph-mon[32397]: pgmap v8112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:02 smithi146 ceph-mon[35807]: pgmap v8112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:02 smithi076 ceph-mon[35401]: pgmap v8112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:05 smithi146 ceph-mon[35807]: pgmap v8113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:05 smithi076 ceph-mon[35401]: pgmap v8113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:05 smithi040 ceph-mon[32397]: pgmap v8113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10793.268582 secs 2024-07-26T16:33:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10793.268582 secs 2024-07-26T16:33:06.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10793.268582 secs 2024-07-26T16:33:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:07 smithi146 ceph-mon[35807]: pgmap v8114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:07 smithi076 ceph-mon[35401]: pgmap v8114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:07 smithi040 ceph-mon[32397]: pgmap v8114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:09 smithi146 ceph-mon[35807]: pgmap v8115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:09 smithi076 ceph-mon[35401]: pgmap v8115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:09 smithi040 ceph-mon[32397]: pgmap v8115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:11 smithi146 ceph-mon[35807]: pgmap v8116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10798.268715 secs 2024-07-26T16:33:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:11 smithi076 ceph-mon[35401]: pgmap v8116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10798.268715 secs 2024-07-26T16:33:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:11 smithi040 ceph-mon[32397]: pgmap v8116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10798.268715 secs 2024-07-26T16:33:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:13 smithi146 ceph-mon[35807]: pgmap v8117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:13 smithi076 ceph-mon[35401]: pgmap v8117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:13 smithi040 ceph-mon[32397]: pgmap v8117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:15 smithi146 ceph-mon[35807]: pgmap v8118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:15 smithi076 ceph-mon[35401]: pgmap v8118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:15 smithi040 ceph-mon[32397]: pgmap v8118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:16.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10803.268856 secs 2024-07-26T16:33:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10803.268856 secs 2024-07-26T16:33:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10803.268856 secs 2024-07-26T16:33:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:17 smithi076 ceph-mon[35401]: pgmap v8119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:17 smithi040 ceph-mon[32397]: pgmap v8119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:17 smithi146 ceph-mon[35807]: pgmap v8119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:19 smithi040 ceph-mon[32397]: pgmap v8120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:19 smithi146 ceph-mon[35807]: pgmap v8120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:19 smithi076 ceph-mon[35401]: pgmap v8120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:21 smithi040 ceph-mon[32397]: pgmap v8121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:21.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10808.268993 secs 2024-07-26T16:33:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:21 smithi146 ceph-mon[35807]: pgmap v8121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10808.268993 secs 2024-07-26T16:33:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:21 smithi076 ceph-mon[35401]: pgmap v8121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10808.268993 secs 2024-07-26T16:33:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:23 smithi040 ceph-mon[32397]: pgmap v8122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:23 smithi146 ceph-mon[35807]: pgmap v8122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:23 smithi076 ceph-mon[35401]: pgmap v8122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:25 smithi040 ceph-mon[32397]: pgmap v8123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:25 smithi146 ceph-mon[35807]: pgmap v8123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:25 smithi076 ceph-mon[35401]: pgmap v8123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:26.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10813.269135 secs 2024-07-26T16:33:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10813.269135 secs 2024-07-26T16:33:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10813.269135 secs 2024-07-26T16:33:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:27 smithi040 ceph-mon[32397]: pgmap v8124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:27 smithi146 ceph-mon[35807]: pgmap v8124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:27 smithi076 ceph-mon[35401]: pgmap v8124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:29 smithi040 ceph-mon[32397]: pgmap v8125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:29 smithi146 ceph-mon[35807]: pgmap v8125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:29 smithi076 ceph-mon[35401]: pgmap v8125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:31 smithi040 ceph-mon[32397]: pgmap v8126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10818.269314 secs 2024-07-26T16:33:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:31 smithi146 ceph-mon[35807]: pgmap v8126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10818.269314 secs 2024-07-26T16:33:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:31 smithi076 ceph-mon[35401]: pgmap v8126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10818.269314 secs 2024-07-26T16:33:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:33 smithi040 ceph-mon[32397]: pgmap v8127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:33 smithi146 ceph-mon[35807]: pgmap v8127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:33 smithi076 ceph-mon[35401]: pgmap v8127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:35 smithi040 ceph-mon[32397]: pgmap v8128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:35 smithi146 ceph-mon[35807]: pgmap v8128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:35 smithi076 ceph-mon[35401]: pgmap v8128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10823.269455 secs 2024-07-26T16:33:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10823.269455 secs 2024-07-26T16:33:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10823.269455 secs 2024-07-26T16:33:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:37 smithi040 ceph-mon[32397]: pgmap v8129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:37 smithi146 ceph-mon[35807]: pgmap v8129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:37 smithi076 ceph-mon[35401]: pgmap v8129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:39 smithi040 ceph-mon[32397]: pgmap v8130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:39 smithi146 ceph-mon[35807]: pgmap v8130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:39 smithi076 ceph-mon[35401]: pgmap v8130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:41 smithi040 ceph-mon[32397]: pgmap v8131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10828.269583 secs 2024-07-26T16:33:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:41 smithi146 ceph-mon[35807]: pgmap v8131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10828.269583 secs 2024-07-26T16:33:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:41 smithi076 ceph-mon[35401]: pgmap v8131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10828.269583 secs 2024-07-26T16:33:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:43 smithi040 ceph-mon[32397]: pgmap v8132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:43 smithi146 ceph-mon[35807]: pgmap v8132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:43 smithi076 ceph-mon[35401]: pgmap v8132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:45 smithi040 ceph-mon[32397]: pgmap v8133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:45 smithi146 ceph-mon[35807]: pgmap v8133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:45 smithi076 ceph-mon[35401]: pgmap v8133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10833.269672 secs 2024-07-26T16:33:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10833.269672 secs 2024-07-26T16:33:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10833.269672 secs 2024-07-26T16:33:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:47 smithi040 ceph-mon[32397]: pgmap v8134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:47 smithi146 ceph-mon[35807]: pgmap v8134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:47 smithi076 ceph-mon[35401]: pgmap v8134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:49 smithi040 ceph-mon[32397]: pgmap v8135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:49 smithi146 ceph-mon[35807]: pgmap v8135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:49 smithi076 ceph-mon[35401]: pgmap v8135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:33:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:51 smithi040 ceph-mon[32397]: pgmap v8136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10838.269754 secs 2024-07-26T16:33:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:51 smithi146 ceph-mon[35807]: pgmap v8136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10838.269754 secs 2024-07-26T16:33:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:51 smithi076 ceph-mon[35401]: pgmap v8136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10838.269754 secs 2024-07-26T16:33:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:53 smithi040 ceph-mon[32397]: pgmap v8137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:53 smithi146 ceph-mon[35807]: pgmap v8137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:53 smithi076 ceph-mon[35401]: pgmap v8137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:55 smithi146 ceph-mon[35807]: pgmap v8138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:55 smithi076 ceph-mon[35401]: pgmap v8138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:55 smithi040 ceph-mon[32397]: pgmap v8138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:33:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10843.269835 secs 2024-07-26T16:33:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10843.269835 secs 2024-07-26T16:33:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10843.269835 secs 2024-07-26T16:33:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:57 smithi146 ceph-mon[35807]: pgmap v8139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:57 smithi076 ceph-mon[35401]: pgmap v8139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:33:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:57 smithi040 ceph-mon[32397]: pgmap v8139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:33:59 smithi146 ceph-mon[35807]: pgmap v8140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:00.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:33:59 smithi076 ceph-mon[35401]: pgmap v8140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:33:59 smithi040 ceph-mon[32397]: pgmap v8140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:01 smithi146 ceph-mon[35807]: pgmap v8141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10848.269974 secs 2024-07-26T16:34:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:01 smithi076 ceph-mon[35401]: pgmap v8141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10848.269974 secs 2024-07-26T16:34:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:01 smithi040 ceph-mon[32397]: pgmap v8141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10848.269974 secs 2024-07-26T16:34:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:03 smithi146 ceph-mon[35807]: pgmap v8142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:03 smithi076 ceph-mon[35401]: pgmap v8142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:03 smithi040 ceph-mon[32397]: pgmap v8142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:06.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:05 smithi040 ceph-mon[32397]: pgmap v8143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:05 smithi146 ceph-mon[35807]: pgmap v8143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:05 smithi076 ceph-mon[35401]: pgmap v8143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10853.270111 secs 2024-07-26T16:34:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10853.270111 secs 2024-07-26T16:34:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10853.270111 secs 2024-07-26T16:34:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:07 smithi146 ceph-mon[35807]: pgmap v8144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:07 smithi076 ceph-mon[35401]: pgmap v8144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:07 smithi040 ceph-mon[32397]: pgmap v8144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:09 smithi146 ceph-mon[35807]: pgmap v8145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:09 smithi076 ceph-mon[35401]: pgmap v8145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:09 smithi040 ceph-mon[32397]: pgmap v8145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:11 smithi146 ceph-mon[35807]: pgmap v8146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10858.270252 secs 2024-07-26T16:34:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:11 smithi076 ceph-mon[35401]: pgmap v8146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:12.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10858.270252 secs 2024-07-26T16:34:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:11 smithi040 ceph-mon[32397]: pgmap v8146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:12.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10858.270252 secs 2024-07-26T16:34:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:13 smithi146 ceph-mon[35807]: pgmap v8147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:13 smithi076 ceph-mon[35401]: pgmap v8147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:13 smithi040 ceph-mon[32397]: pgmap v8147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:16.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:15 smithi076 ceph-mon[35401]: pgmap v8148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:15 smithi040 ceph-mon[32397]: pgmap v8148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:15 smithi146 ceph-mon[35807]: pgmap v8148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10863.270409 secs 2024-07-26T16:34:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10863.270409 secs 2024-07-26T16:34:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10863.270409 secs 2024-07-26T16:34:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:17 smithi040 ceph-mon[32397]: pgmap v8149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:17 smithi146 ceph-mon[35807]: pgmap v8149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:17 smithi076 ceph-mon[35401]: pgmap v8149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:19 smithi040 ceph-mon[32397]: pgmap v8150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:19 smithi146 ceph-mon[35807]: pgmap v8150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:19 smithi076 ceph-mon[35401]: pgmap v8150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:21 smithi040 ceph-mon[32397]: pgmap v8151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:22.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10868.270505 secs 2024-07-26T16:34:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:21 smithi146 ceph-mon[35807]: pgmap v8151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10868.270505 secs 2024-07-26T16:34:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:21 smithi076 ceph-mon[35401]: pgmap v8151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10868.270505 secs 2024-07-26T16:34:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:23 smithi040 ceph-mon[32397]: pgmap v8152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:23 smithi146 ceph-mon[35807]: pgmap v8152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:23 smithi076 ceph-mon[35401]: pgmap v8152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:26.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:25 smithi146 ceph-mon[35807]: pgmap v8153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:25 smithi040 ceph-mon[32397]: pgmap v8153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:25 smithi076 ceph-mon[35401]: pgmap v8153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10873.270665 secs 2024-07-26T16:34:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:26 smithi040 ceph-mon[32397]: pgmap v8154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10873.270665 secs 2024-07-26T16:34:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:26 smithi146 ceph-mon[35807]: pgmap v8154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10873.270665 secs 2024-07-26T16:34:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:26 smithi076 ceph-mon[35401]: pgmap v8154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:29 smithi146 ceph-mon[35807]: pgmap v8155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:29 smithi076 ceph-mon[35401]: pgmap v8155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:29 smithi040 ceph-mon[32397]: pgmap v8155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:31 smithi076 ceph-mon[35401]: pgmap v8156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10878.270809 secs 2024-07-26T16:34:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:31 smithi040 ceph-mon[32397]: pgmap v8156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:31.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10878.270809 secs 2024-07-26T16:34:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:31 smithi146 ceph-mon[35807]: pgmap v8156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10878.270809 secs 2024-07-26T16:34:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:33 smithi076 ceph-mon[35401]: pgmap v8157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:33 smithi040 ceph-mon[32397]: pgmap v8157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:33 smithi146 ceph-mon[35807]: pgmap v8157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:35 smithi040 ceph-mon[32397]: pgmap v8158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:35 smithi146 ceph-mon[35807]: pgmap v8158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:35 smithi076 ceph-mon[35401]: pgmap v8158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:36.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10883.270948 secs 2024-07-26T16:34:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10883.270948 secs 2024-07-26T16:34:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10883.270948 secs 2024-07-26T16:34:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:37 smithi040 ceph-mon[32397]: pgmap v8159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:37 smithi146 ceph-mon[35807]: pgmap v8159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:37 smithi076 ceph-mon[35401]: pgmap v8159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:39 smithi040 ceph-mon[32397]: pgmap v8160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:39 smithi146 ceph-mon[35807]: pgmap v8160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:39 smithi076 ceph-mon[35401]: pgmap v8160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:34:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:41 smithi040 ceph-mon[32397]: pgmap v8161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:41.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10888.271098 secs 2024-07-26T16:34:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:41 smithi146 ceph-mon[35807]: pgmap v8161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10888.271098 secs 2024-07-26T16:34:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:41 smithi076 ceph-mon[35401]: pgmap v8161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10888.271098 secs 2024-07-26T16:34:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:43 smithi040 ceph-mon[32397]: pgmap v8162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:43 smithi146 ceph-mon[35807]: pgmap v8162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:43 smithi076 ceph-mon[35401]: pgmap v8162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:45 smithi040 ceph-mon[32397]: pgmap v8163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:45 smithi146 ceph-mon[35807]: pgmap v8163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:45 smithi076 ceph-mon[35401]: pgmap v8163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10893.271238 secs 2024-07-26T16:34:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10893.271238 secs 2024-07-26T16:34:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10893.271238 secs 2024-07-26T16:34:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:47 smithi040 ceph-mon[32397]: pgmap v8164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:47 smithi146 ceph-mon[35807]: pgmap v8164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:47 smithi076 ceph-mon[35401]: pgmap v8164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:49 smithi040 ceph-mon[32397]: pgmap v8165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:49 smithi146 ceph-mon[35807]: pgmap v8165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:49 smithi076 ceph-mon[35401]: pgmap v8165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:51 smithi040 ceph-mon[32397]: pgmap v8166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:34:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10898.271395 secs 2024-07-26T16:34:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:51 smithi146 ceph-mon[35807]: pgmap v8166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:34:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10898.271395 secs 2024-07-26T16:34:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:51 smithi076 ceph-mon[35401]: pgmap v8166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:34:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10898.271395 secs 2024-07-26T16:34:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:53 smithi040 ceph-mon[32397]: pgmap v8167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:53 smithi146 ceph-mon[35807]: pgmap v8167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:53 smithi076 ceph-mon[35401]: pgmap v8167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:34:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:55 smithi040 ceph-mon[32397]: pgmap v8168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:55 smithi146 ceph-mon[35807]: pgmap v8168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:55 smithi076 ceph-mon[35401]: pgmap v8168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:34:56.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10903.271491 secs 2024-07-26T16:34:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10903.271491 secs 2024-07-26T16:34:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10903.271491 secs 2024-07-26T16:34:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:57 smithi040 ceph-mon[32397]: pgmap v8169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:57 smithi146 ceph-mon[35807]: pgmap v8169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:58.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:57 smithi076 ceph-mon[35401]: pgmap v8169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:34:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:34:59 smithi040 ceph-mon[32397]: pgmap v8170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:34:59 smithi146 ceph-mon[35807]: pgmap v8170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:34:59 smithi076 ceph-mon[35401]: pgmap v8170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:01 smithi040 ceph-mon[32397]: pgmap v8171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10908.271619 secs 2024-07-26T16:35:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:01 smithi146 ceph-mon[35807]: pgmap v8171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10908.271619 secs 2024-07-26T16:35:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:01 smithi076 ceph-mon[35401]: pgmap v8171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10908.271619 secs 2024-07-26T16:35:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:03 smithi040 ceph-mon[32397]: pgmap v8172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:03 smithi146 ceph-mon[35807]: pgmap v8172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:03 smithi076 ceph-mon[35401]: pgmap v8172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:05 smithi040 ceph-mon[32397]: pgmap v8173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:05 smithi146 ceph-mon[35807]: pgmap v8173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:05 smithi076 ceph-mon[35401]: pgmap v8173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10913.271777 secs 2024-07-26T16:35:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10913.271777 secs 2024-07-26T16:35:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10913.271777 secs 2024-07-26T16:35:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:07 smithi146 ceph-mon[35807]: pgmap v8174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:07 smithi076 ceph-mon[35401]: pgmap v8174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:07 smithi040 ceph-mon[32397]: pgmap v8174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:09 smithi146 ceph-mon[35807]: pgmap v8175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:09 smithi076 ceph-mon[35401]: pgmap v8175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:09 smithi040 ceph-mon[32397]: pgmap v8175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:11 smithi146 ceph-mon[35807]: pgmap v8176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10918.271919 secs 2024-07-26T16:35:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:11 smithi076 ceph-mon[35401]: pgmap v8176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:12.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10918.271919 secs 2024-07-26T16:35:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:11 smithi040 ceph-mon[32397]: pgmap v8176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10918.271919 secs 2024-07-26T16:35:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:13 smithi146 ceph-mon[35807]: pgmap v8177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:13 smithi076 ceph-mon[35401]: pgmap v8177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:13 smithi040 ceph-mon[32397]: pgmap v8177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:15 smithi146 ceph-mon[35807]: pgmap v8178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:15 smithi076 ceph-mon[35401]: pgmap v8178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:15 smithi040 ceph-mon[32397]: pgmap v8178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10923.272058 secs 2024-07-26T16:35:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10923.272058 secs 2024-07-26T16:35:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10923.272058 secs 2024-07-26T16:35:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:17 smithi146 ceph-mon[35807]: pgmap v8179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:17 smithi076 ceph-mon[35401]: pgmap v8179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:17 smithi040 ceph-mon[32397]: pgmap v8179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:19 smithi146 ceph-mon[35807]: pgmap v8180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:19 smithi076 ceph-mon[35401]: pgmap v8180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:19 smithi040 ceph-mon[32397]: pgmap v8180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:21 smithi146 ceph-mon[35807]: pgmap v8181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10928.272207 secs 2024-07-26T16:35:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:21 smithi076 ceph-mon[35401]: pgmap v8181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10928.272207 secs 2024-07-26T16:35:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:21 smithi040 ceph-mon[32397]: pgmap v8181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10928.272207 secs 2024-07-26T16:35:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:23 smithi146 ceph-mon[35807]: pgmap v8182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:23 smithi076 ceph-mon[35401]: pgmap v8182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:23 smithi040 ceph-mon[32397]: pgmap v8182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:25 smithi146 ceph-mon[35807]: pgmap v8183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:25 smithi076 ceph-mon[35401]: pgmap v8183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:25 smithi040 ceph-mon[32397]: pgmap v8183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10933.272350 secs 2024-07-26T16:35:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10933.272350 secs 2024-07-26T16:35:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10933.272350 secs 2024-07-26T16:35:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:27 smithi040 ceph-mon[32397]: pgmap v8184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:27 smithi146 ceph-mon[35807]: pgmap v8184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:27 smithi076 ceph-mon[35401]: pgmap v8184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:29 smithi040 ceph-mon[32397]: pgmap v8185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:29 smithi146 ceph-mon[35807]: pgmap v8185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:29 smithi076 ceph-mon[35401]: pgmap v8185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:31 smithi040 ceph-mon[32397]: pgmap v8186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:35:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10938.272488 secs 2024-07-26T16:35:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:31 smithi146 ceph-mon[35807]: pgmap v8186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:35:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10938.272488 secs 2024-07-26T16:35:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:31 smithi076 ceph-mon[35401]: pgmap v8186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:35:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10938.272488 secs 2024-07-26T16:35:34.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:33 smithi076 ceph-mon[35401]: pgmap v8187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:33 smithi040 ceph-mon[32397]: pgmap v8187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:33 smithi146 ceph-mon[35807]: pgmap v8187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:35 smithi040 ceph-mon[32397]: pgmap v8188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:35 smithi146 ceph-mon[35807]: pgmap v8188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:35 smithi076 ceph-mon[35401]: pgmap v8188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10943.272620 secs 2024-07-26T16:35:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10943.272620 secs 2024-07-26T16:35:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10943.272620 secs 2024-07-26T16:35:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:37 smithi040 ceph-mon[32397]: pgmap v8189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:37 smithi146 ceph-mon[35807]: pgmap v8189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:37 smithi076 ceph-mon[35401]: pgmap v8189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:39 smithi040 ceph-mon[32397]: pgmap v8190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:39 smithi146 ceph-mon[35807]: pgmap v8190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:39 smithi076 ceph-mon[35401]: pgmap v8190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:40 smithi040 ceph-mon[32397]: pgmap v8191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:40 smithi146 ceph-mon[35807]: pgmap v8191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:40 smithi076 ceph-mon[35401]: pgmap v8191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10948.272753 secs 2024-07-26T16:35:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10948.272753 secs 2024-07-26T16:35:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10948.272753 secs 2024-07-26T16:35:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:42 smithi040 ceph-mon[32397]: pgmap v8192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:42 smithi146 ceph-mon[35807]: pgmap v8192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:42 smithi076 ceph-mon[35401]: pgmap v8192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:45 smithi040 ceph-mon[32397]: pgmap v8193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:45 smithi146 ceph-mon[35807]: pgmap v8193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:45 smithi076 ceph-mon[35401]: pgmap v8193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10953.272893 secs 2024-07-26T16:35:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10953.272893 secs 2024-07-26T16:35:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10953.272893 secs 2024-07-26T16:35:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:47 smithi040 ceph-mon[32397]: pgmap v8194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:47 smithi146 ceph-mon[35807]: pgmap v8194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:47 smithi076 ceph-mon[35401]: pgmap v8194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:49 smithi040 ceph-mon[32397]: pgmap v8195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:49 smithi146 ceph-mon[35807]: pgmap v8195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:49 smithi076 ceph-mon[35401]: pgmap v8195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:35:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:51 smithi040 ceph-mon[32397]: pgmap v8196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10958.272988 secs 2024-07-26T16:35:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:51 smithi146 ceph-mon[35807]: pgmap v8196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10958.272988 secs 2024-07-26T16:35:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:51 smithi076 ceph-mon[35401]: pgmap v8196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10958.272988 secs 2024-07-26T16:35:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:53 smithi040 ceph-mon[32397]: pgmap v8197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:53 smithi146 ceph-mon[35807]: pgmap v8197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:53 smithi076 ceph-mon[35401]: pgmap v8197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:55 smithi040 ceph-mon[32397]: pgmap v8198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:55 smithi146 ceph-mon[35807]: pgmap v8198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:55 smithi076 ceph-mon[35401]: pgmap v8198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:35:56.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10963.273125 secs 2024-07-26T16:35:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10963.273125 secs 2024-07-26T16:35:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10963.273125 secs 2024-07-26T16:35:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:57 smithi040 ceph-mon[32397]: pgmap v8199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:57 smithi146 ceph-mon[35807]: pgmap v8199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:57 smithi076 ceph-mon[35401]: pgmap v8199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:35:59 smithi040 ceph-mon[32397]: pgmap v8200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:35:59 smithi146 ceph-mon[35807]: pgmap v8200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:35:59 smithi076 ceph-mon[35401]: pgmap v8200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:01 smithi040 ceph-mon[32397]: pgmap v8201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10968.273309 secs 2024-07-26T16:36:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:01 smithi146 ceph-mon[35807]: pgmap v8201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10968.273309 secs 2024-07-26T16:36:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:01 smithi076 ceph-mon[35401]: pgmap v8201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10968.273309 secs 2024-07-26T16:36:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:03 smithi040 ceph-mon[32397]: pgmap v8202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:03 smithi146 ceph-mon[35807]: pgmap v8202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:03 smithi076 ceph-mon[35401]: pgmap v8202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:05 smithi040 ceph-mon[32397]: pgmap v8203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:05 smithi146 ceph-mon[35807]: pgmap v8203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:05 smithi076 ceph-mon[35401]: pgmap v8203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10973.273399 secs 2024-07-26T16:36:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10973.273399 secs 2024-07-26T16:36:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10973.273399 secs 2024-07-26T16:36:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:07 smithi146 ceph-mon[35807]: pgmap v8204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:07 smithi076 ceph-mon[35401]: pgmap v8204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:07 smithi040 ceph-mon[32397]: pgmap v8204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:09 smithi146 ceph-mon[35807]: pgmap v8205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:09 smithi076 ceph-mon[35401]: pgmap v8205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:09 smithi040 ceph-mon[32397]: pgmap v8205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:11 smithi146 ceph-mon[35807]: pgmap v8206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10978.273501 secs 2024-07-26T16:36:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:11 smithi076 ceph-mon[35401]: pgmap v8206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10978.273501 secs 2024-07-26T16:36:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:11 smithi040 ceph-mon[32397]: pgmap v8206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10978.273501 secs 2024-07-26T16:36:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:13 smithi146 ceph-mon[35807]: pgmap v8207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:13 smithi076 ceph-mon[35401]: pgmap v8207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:13 smithi040 ceph-mon[32397]: pgmap v8207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:15 smithi146 ceph-mon[35807]: pgmap v8208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:15 smithi076 ceph-mon[35401]: pgmap v8208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:15 smithi040 ceph-mon[32397]: pgmap v8208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10983.273635 secs 2024-07-26T16:36:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10983.273635 secs 2024-07-26T16:36:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10983.273635 secs 2024-07-26T16:36:18.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:17 smithi146 ceph-mon[35807]: pgmap v8209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:17 smithi076 ceph-mon[35401]: pgmap v8209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:17 smithi040 ceph-mon[32397]: pgmap v8209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:19 smithi146 ceph-mon[35807]: pgmap v8210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:19 smithi076 ceph-mon[35401]: pgmap v8210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:19 smithi040 ceph-mon[32397]: pgmap v8210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:21 smithi146 ceph-mon[35807]: pgmap v8211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10988.273719 secs 2024-07-26T16:36:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:21 smithi076 ceph-mon[35401]: pgmap v8211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10988.273719 secs 2024-07-26T16:36:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:21 smithi040 ceph-mon[32397]: pgmap v8211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:22.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10988.273719 secs 2024-07-26T16:36:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:23 smithi146 ceph-mon[35807]: pgmap v8212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:23 smithi076 ceph-mon[35401]: pgmap v8212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:23 smithi040 ceph-mon[32397]: pgmap v8212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:25 smithi146 ceph-mon[35807]: pgmap v8213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:25 smithi076 ceph-mon[35401]: pgmap v8213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:25 smithi040 ceph-mon[32397]: pgmap v8213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10993.273889 secs 2024-07-26T16:36:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10993.273889 secs 2024-07-26T16:36:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10993.273889 secs 2024-07-26T16:36:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:27 smithi076 ceph-mon[35401]: pgmap v8214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:27 smithi040 ceph-mon[32397]: pgmap v8214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:27 smithi146 ceph-mon[35807]: pgmap v8214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:29 smithi076 ceph-mon[35401]: pgmap v8215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:29 smithi040 ceph-mon[32397]: pgmap v8215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:29 smithi146 ceph-mon[35807]: pgmap v8215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:31 smithi040 ceph-mon[32397]: pgmap v8216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 10998.274030 secs 2024-07-26T16:36:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:31 smithi146 ceph-mon[35807]: pgmap v8216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 10998.274030 secs 2024-07-26T16:36:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:31 smithi076 ceph-mon[35401]: pgmap v8216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 10998.274030 secs 2024-07-26T16:36:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:33 smithi040 ceph-mon[32397]: pgmap v8217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:33 smithi146 ceph-mon[35807]: pgmap v8217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:33 smithi076 ceph-mon[35401]: pgmap v8217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:36.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:35 smithi076 ceph-mon[35401]: pgmap v8218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:35 smithi040 ceph-mon[32397]: pgmap v8218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:35 smithi146 ceph-mon[35807]: pgmap v8218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11003.274173 secs 2024-07-26T16:36:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11003.274173 secs 2024-07-26T16:36:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11003.274173 secs 2024-07-26T16:36:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:37 smithi040 ceph-mon[32397]: pgmap v8219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:37 smithi146 ceph-mon[35807]: pgmap v8219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:37 smithi076 ceph-mon[35401]: pgmap v8219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:39 smithi040 ceph-mon[32397]: pgmap v8220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:39 smithi146 ceph-mon[35807]: pgmap v8220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:39 smithi076 ceph-mon[35401]: pgmap v8220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:41 smithi040 ceph-mon[32397]: pgmap v8221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11008.274327 secs 2024-07-26T16:36:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:41 smithi146 ceph-mon[35807]: pgmap v8221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11008.274327 secs 2024-07-26T16:36:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:41 smithi076 ceph-mon[35401]: pgmap v8221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11008.274327 secs 2024-07-26T16:36:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:42 smithi040 ceph-mon[32397]: pgmap v8222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:42 smithi146 ceph-mon[35807]: pgmap v8222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:42 smithi076 ceph-mon[35401]: pgmap v8222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:45 smithi040 ceph-mon[32397]: pgmap v8223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:45 smithi146 ceph-mon[35807]: pgmap v8223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:45 smithi076 ceph-mon[35401]: pgmap v8223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11013.274433 secs 2024-07-26T16:36:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11013.274433 secs 2024-07-26T16:36:47.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11013.274433 secs 2024-07-26T16:36:47.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:47 smithi040 ceph-mon[32397]: pgmap v8224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:47 smithi146 ceph-mon[35807]: pgmap v8224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:47 smithi076 ceph-mon[35401]: pgmap v8224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:49 smithi040 ceph-mon[32397]: pgmap v8225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:49 smithi146 ceph-mon[35807]: pgmap v8225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:49 smithi076 ceph-mon[35401]: pgmap v8225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:36:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:51 smithi040 ceph-mon[32397]: pgmap v8226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11018.274537 secs 2024-07-26T16:36:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:51 smithi146 ceph-mon[35807]: pgmap v8226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11018.274537 secs 2024-07-26T16:36:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:51 smithi076 ceph-mon[35401]: pgmap v8226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11018.274537 secs 2024-07-26T16:36:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:53 smithi040 ceph-mon[32397]: pgmap v8227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:53 smithi146 ceph-mon[35807]: pgmap v8227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:53 smithi076 ceph-mon[35401]: pgmap v8227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:55 smithi040 ceph-mon[32397]: pgmap v8228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:55 smithi146 ceph-mon[35807]: pgmap v8228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:55 smithi076 ceph-mon[35401]: pgmap v8228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:36:56.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11023.274673 secs 2024-07-26T16:36:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11023.274673 secs 2024-07-26T16:36:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11023.274673 secs 2024-07-26T16:36:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:57 smithi040 ceph-mon[32397]: pgmap v8229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:57 smithi146 ceph-mon[35807]: pgmap v8229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:57 smithi076 ceph-mon[35401]: pgmap v8229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:36:59.989 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:36:59 smithi040 ceph-mon[32397]: pgmap v8230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:36:59 smithi146 ceph-mon[35807]: pgmap v8230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:36:59 smithi076 ceph-mon[35401]: pgmap v8230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:01 smithi040 ceph-mon[32397]: pgmap v8231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11028.274814 secs 2024-07-26T16:37:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:01 smithi146 ceph-mon[35807]: pgmap v8231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11028.274814 secs 2024-07-26T16:37:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:01 smithi076 ceph-mon[35401]: pgmap v8231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11028.274814 secs 2024-07-26T16:37:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:03 smithi146 ceph-mon[35807]: pgmap v8232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:03 smithi076 ceph-mon[35401]: pgmap v8232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:03 smithi040 ceph-mon[32397]: pgmap v8232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:06.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:05 smithi040 ceph-mon[32397]: pgmap v8233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:05 smithi146 ceph-mon[35807]: pgmap v8233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:05 smithi076 ceph-mon[35401]: pgmap v8233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11033.274952 secs 2024-07-26T16:37:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11033.274952 secs 2024-07-26T16:37:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11033.274952 secs 2024-07-26T16:37:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:07 smithi146 ceph-mon[35807]: pgmap v8234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:07 smithi076 ceph-mon[35401]: pgmap v8234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:07 smithi040 ceph-mon[32397]: pgmap v8234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:09 smithi146 ceph-mon[35807]: pgmap v8235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:09 smithi076 ceph-mon[35401]: pgmap v8235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:09 smithi040 ceph-mon[32397]: pgmap v8235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:11 smithi146 ceph-mon[35807]: pgmap v8236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11038.275089 secs 2024-07-26T16:37:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:11 smithi076 ceph-mon[35401]: pgmap v8236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11038.275089 secs 2024-07-26T16:37:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:11 smithi040 ceph-mon[32397]: pgmap v8236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:12.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11038.275089 secs 2024-07-26T16:37:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:13 smithi146 ceph-mon[35807]: pgmap v8237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:13 smithi076 ceph-mon[35401]: pgmap v8237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:13 smithi040 ceph-mon[32397]: pgmap v8237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:15 smithi146 ceph-mon[35807]: pgmap v8238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:15 smithi076 ceph-mon[35401]: pgmap v8238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:15 smithi040 ceph-mon[32397]: pgmap v8238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11043.275226 secs 2024-07-26T16:37:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11043.275226 secs 2024-07-26T16:37:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11043.275226 secs 2024-07-26T16:37:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:17 smithi146 ceph-mon[35807]: pgmap v8239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:17 smithi076 ceph-mon[35401]: pgmap v8239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:17 smithi040 ceph-mon[32397]: pgmap v8239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:19 smithi146 ceph-mon[35807]: pgmap v8240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:19 smithi076 ceph-mon[35401]: pgmap v8240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:19 smithi040 ceph-mon[32397]: pgmap v8240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:21 smithi146 ceph-mon[35807]: pgmap v8241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11048.275382 secs 2024-07-26T16:37:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:21 smithi076 ceph-mon[35401]: pgmap v8241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11048.275382 secs 2024-07-26T16:37:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:21 smithi040 ceph-mon[32397]: pgmap v8241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11048.275382 secs 2024-07-26T16:37:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:23 smithi076 ceph-mon[35401]: pgmap v8242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:23 smithi040 ceph-mon[32397]: pgmap v8242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:23 smithi146 ceph-mon[35807]: pgmap v8242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:25 smithi076 ceph-mon[35401]: pgmap v8243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:26.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:25 smithi146 ceph-mon[35807]: pgmap v8243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:25 smithi040 ceph-mon[32397]: pgmap v8243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11053.275532 secs 2024-07-26T16:37:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11053.275532 secs 2024-07-26T16:37:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11053.275532 secs 2024-07-26T16:37:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:27 smithi040 ceph-mon[32397]: pgmap v8244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:27 smithi146 ceph-mon[35807]: pgmap v8244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:27 smithi076 ceph-mon[35401]: pgmap v8244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:29 smithi040 ceph-mon[32397]: pgmap v8245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:29 smithi146 ceph-mon[35807]: pgmap v8245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:29 smithi076 ceph-mon[35401]: pgmap v8245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:31 smithi040 ceph-mon[32397]: pgmap v8246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11058.275673 secs 2024-07-26T16:37:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:31 smithi146 ceph-mon[35807]: pgmap v8246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11058.275673 secs 2024-07-26T16:37:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:31 smithi076 ceph-mon[35401]: pgmap v8246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11058.275673 secs 2024-07-26T16:37:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:33 smithi040 ceph-mon[32397]: pgmap v8247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:33 smithi146 ceph-mon[35807]: pgmap v8247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:33 smithi076 ceph-mon[35401]: pgmap v8247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:36.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:35 smithi076 ceph-mon[35401]: pgmap v8248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:35 smithi040 ceph-mon[32397]: pgmap v8248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:35 smithi146 ceph-mon[35807]: pgmap v8248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11063.275823 secs 2024-07-26T16:37:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11063.275823 secs 2024-07-26T16:37:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11063.275823 secs 2024-07-26T16:37:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:37 smithi040 ceph-mon[32397]: pgmap v8249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:37 smithi146 ceph-mon[35807]: pgmap v8249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:37 smithi076 ceph-mon[35401]: pgmap v8249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:39 smithi040 ceph-mon[32397]: pgmap v8250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:39 smithi146 ceph-mon[35807]: pgmap v8250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:39 smithi076 ceph-mon[35401]: pgmap v8250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:41 smithi040 ceph-mon[32397]: pgmap v8251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11068.275970 secs 2024-07-26T16:37:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:41 smithi146 ceph-mon[35807]: pgmap v8251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11068.275970 secs 2024-07-26T16:37:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:41 smithi076 ceph-mon[35401]: pgmap v8251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11068.275970 secs 2024-07-26T16:37:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:43 smithi040 ceph-mon[32397]: pgmap v8252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:43 smithi146 ceph-mon[35807]: pgmap v8252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:43 smithi076 ceph-mon[35401]: pgmap v8252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:44 smithi040 ceph-mon[32397]: pgmap v8253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:44 smithi146 ceph-mon[35807]: pgmap v8253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:44 smithi076 ceph-mon[35401]: pgmap v8253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11073.276127 secs 2024-07-26T16:37:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11073.276127 secs 2024-07-26T16:37:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11073.276127 secs 2024-07-26T16:37:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:47 smithi040 ceph-mon[32397]: pgmap v8254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:47 smithi146 ceph-mon[35807]: pgmap v8254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:47 smithi076 ceph-mon[35401]: pgmap v8254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:49 smithi040 ceph-mon[32397]: pgmap v8255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:49 smithi146 ceph-mon[35807]: pgmap v8255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:49 smithi076 ceph-mon[35401]: pgmap v8255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:37:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:51 smithi040 ceph-mon[32397]: pgmap v8256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11078.276212 secs 2024-07-26T16:37:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:51 smithi146 ceph-mon[35807]: pgmap v8256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:52.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11078.276212 secs 2024-07-26T16:37:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:51 smithi076 ceph-mon[35401]: pgmap v8256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11078.276212 secs 2024-07-26T16:37:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:53 smithi040 ceph-mon[32397]: pgmap v8257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:53 smithi146 ceph-mon[35807]: pgmap v8257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:53 smithi076 ceph-mon[35401]: pgmap v8257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:55 smithi040 ceph-mon[32397]: pgmap v8258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:55 smithi146 ceph-mon[35807]: pgmap v8258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:55 smithi076 ceph-mon[35401]: pgmap v8258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:37:56.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11083.276357 secs 2024-07-26T16:37:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11083.276357 secs 2024-07-26T16:37:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11083.276357 secs 2024-07-26T16:37:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:57 smithi040 ceph-mon[32397]: pgmap v8259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:57 smithi146 ceph-mon[35807]: pgmap v8259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:37:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:57 smithi076 ceph-mon[35401]: pgmap v8259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:37:59 smithi146 ceph-mon[35807]: pgmap v8260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:37:59 smithi076 ceph-mon[35401]: pgmap v8260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:37:59 smithi040 ceph-mon[32397]: pgmap v8260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:01 smithi146 ceph-mon[35807]: pgmap v8261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11088.276461 secs 2024-07-26T16:38:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:01 smithi076 ceph-mon[35401]: pgmap v8261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11088.276461 secs 2024-07-26T16:38:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:01 smithi040 ceph-mon[32397]: pgmap v8261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11088.276461 secs 2024-07-26T16:38:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:03 smithi146 ceph-mon[35807]: pgmap v8262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:03 smithi076 ceph-mon[35401]: pgmap v8262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:03 smithi040 ceph-mon[32397]: pgmap v8262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:06.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:05 smithi040 ceph-mon[32397]: pgmap v8263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:05 smithi146 ceph-mon[35807]: pgmap v8263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:05 smithi076 ceph-mon[35401]: pgmap v8263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11093.276605 secs 2024-07-26T16:38:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11093.276605 secs 2024-07-26T16:38:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11093.276605 secs 2024-07-26T16:38:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:07 smithi146 ceph-mon[35807]: pgmap v8264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:07 smithi076 ceph-mon[35401]: pgmap v8264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:07 smithi040 ceph-mon[32397]: pgmap v8264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:10.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:09 smithi146 ceph-mon[35807]: pgmap v8265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:09 smithi076 ceph-mon[35401]: pgmap v8265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:09 smithi040 ceph-mon[32397]: pgmap v8265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:11 smithi146 ceph-mon[35807]: pgmap v8266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11098.276746 secs 2024-07-26T16:38:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:11 smithi076 ceph-mon[35401]: pgmap v8266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:12.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11098.276746 secs 2024-07-26T16:38:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:11 smithi040 ceph-mon[32397]: pgmap v8266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11098.276746 secs 2024-07-26T16:38:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:13 smithi146 ceph-mon[35807]: pgmap v8267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:13 smithi076 ceph-mon[35401]: pgmap v8267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:13 smithi040 ceph-mon[32397]: pgmap v8267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:15 smithi146 ceph-mon[35807]: pgmap v8268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:15 smithi076 ceph-mon[35401]: pgmap v8268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:15 smithi040 ceph-mon[32397]: pgmap v8268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11103.276887 secs 2024-07-26T16:38:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11103.276887 secs 2024-07-26T16:38:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11103.276887 secs 2024-07-26T16:38:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:17 smithi076 ceph-mon[35401]: pgmap v8269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:17 smithi040 ceph-mon[32397]: pgmap v8269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:17 smithi146 ceph-mon[35807]: pgmap v8269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:19 smithi076 ceph-mon[35401]: pgmap v8270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:19 smithi040 ceph-mon[32397]: pgmap v8270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:19 smithi146 ceph-mon[35807]: pgmap v8270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:21 smithi040 ceph-mon[32397]: pgmap v8271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11108.277026 secs 2024-07-26T16:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:21 smithi146 ceph-mon[35807]: pgmap v8271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11108.277026 secs 2024-07-26T16:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:21 smithi076 ceph-mon[35401]: pgmap v8271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11108.277026 secs 2024-07-26T16:38:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:23 smithi040 ceph-mon[32397]: pgmap v8272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:23 smithi146 ceph-mon[35807]: pgmap v8272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:23 smithi076 ceph-mon[35401]: pgmap v8272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:26.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:25 smithi146 ceph-mon[35807]: pgmap v8273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:25 smithi040 ceph-mon[32397]: pgmap v8273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:25 smithi076 ceph-mon[35401]: pgmap v8273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11113.277166 secs 2024-07-26T16:38:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11113.277166 secs 2024-07-26T16:38:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11113.277166 secs 2024-07-26T16:38:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:27 smithi040 ceph-mon[32397]: pgmap v8274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:27 smithi146 ceph-mon[35807]: pgmap v8274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:27 smithi076 ceph-mon[35401]: pgmap v8274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:29 smithi040 ceph-mon[32397]: pgmap v8275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:29 smithi146 ceph-mon[35807]: pgmap v8275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:29 smithi076 ceph-mon[35401]: pgmap v8275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:31 smithi040 ceph-mon[32397]: pgmap v8276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11118.277310 secs 2024-07-26T16:38:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:31 smithi146 ceph-mon[35807]: pgmap v8276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11118.277310 secs 2024-07-26T16:38:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:31 smithi076 ceph-mon[35401]: pgmap v8276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11118.277310 secs 2024-07-26T16:38:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:33 smithi040 ceph-mon[32397]: pgmap v8277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:33 smithi146 ceph-mon[35807]: pgmap v8277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:33 smithi076 ceph-mon[35401]: pgmap v8277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:35 smithi040 ceph-mon[32397]: pgmap v8278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:35 smithi146 ceph-mon[35807]: pgmap v8278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:35 smithi076 ceph-mon[35401]: pgmap v8278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11123.277451 secs 2024-07-26T16:38:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11123.277451 secs 2024-07-26T16:38:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11123.277451 secs 2024-07-26T16:38:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:37 smithi040 ceph-mon[32397]: pgmap v8279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:37 smithi146 ceph-mon[35807]: pgmap v8279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:37 smithi076 ceph-mon[35401]: pgmap v8279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:39 smithi040 ceph-mon[32397]: pgmap v8280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:39 smithi146 ceph-mon[35807]: pgmap v8280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:39 smithi076 ceph-mon[35401]: pgmap v8280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:40 smithi040 ceph-mon[32397]: pgmap v8281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:40 smithi146 ceph-mon[35807]: pgmap v8281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:40 smithi076 ceph-mon[35401]: pgmap v8281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11128.277594 secs 2024-07-26T16:38:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11128.277594 secs 2024-07-26T16:38:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11128.277594 secs 2024-07-26T16:38:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:42 smithi146 ceph-mon[35807]: pgmap v8282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:42 smithi076 ceph-mon[35401]: pgmap v8282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:42 smithi040 ceph-mon[32397]: pgmap v8282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:45 smithi040 ceph-mon[32397]: pgmap v8283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:45 smithi146 ceph-mon[35807]: pgmap v8283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:45 smithi076 ceph-mon[35401]: pgmap v8283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11133.277690 secs 2024-07-26T16:38:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11133.277690 secs 2024-07-26T16:38:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11133.277690 secs 2024-07-26T16:38:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:47 smithi146 ceph-mon[35807]: pgmap v8284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:47 smithi076 ceph-mon[35401]: pgmap v8284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:47 smithi040 ceph-mon[32397]: pgmap v8284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:49 smithi146 ceph-mon[35807]: pgmap v8285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:49 smithi076 ceph-mon[35401]: pgmap v8285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:49 smithi040 ceph-mon[32397]: pgmap v8285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:38:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:51 smithi146 ceph-mon[35807]: pgmap v8286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11138.277831 secs 2024-07-26T16:38:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:51 smithi076 ceph-mon[35401]: pgmap v8286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11138.277831 secs 2024-07-26T16:38:52.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:51 smithi040 ceph-mon[32397]: pgmap v8286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:52.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11138.277831 secs 2024-07-26T16:38:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:53 smithi146 ceph-mon[35807]: pgmap v8287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:53 smithi076 ceph-mon[35401]: pgmap v8287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:53 smithi040 ceph-mon[32397]: pgmap v8287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:55 smithi146 ceph-mon[35807]: pgmap v8288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:55 smithi076 ceph-mon[35401]: pgmap v8288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:55 smithi040 ceph-mon[32397]: pgmap v8288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:38:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11143.277962 secs 2024-07-26T16:38:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11143.277962 secs 2024-07-26T16:38:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11143.277962 secs 2024-07-26T16:38:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:57 smithi146 ceph-mon[35807]: pgmap v8289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:57 smithi076 ceph-mon[35401]: pgmap v8289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:38:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:57 smithi040 ceph-mon[32397]: pgmap v8289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:38:59 smithi146 ceph-mon[35807]: pgmap v8290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:38:59 smithi076 ceph-mon[35401]: pgmap v8290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:38:59 smithi040 ceph-mon[32397]: pgmap v8290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:01 smithi146 ceph-mon[35807]: pgmap v8291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11148.278103 secs 2024-07-26T16:39:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:01 smithi076 ceph-mon[35401]: pgmap v8291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11148.278103 secs 2024-07-26T16:39:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:01 smithi040 ceph-mon[32397]: pgmap v8291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11148.278103 secs 2024-07-26T16:39:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:03 smithi146 ceph-mon[35807]: pgmap v8292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:03 smithi076 ceph-mon[35401]: pgmap v8292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:03 smithi040 ceph-mon[32397]: pgmap v8292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:05 smithi146 ceph-mon[35807]: pgmap v8293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:05 smithi076 ceph-mon[35401]: pgmap v8293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:05 smithi040 ceph-mon[32397]: pgmap v8293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11153.278240 secs 2024-07-26T16:39:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11153.278240 secs 2024-07-26T16:39:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11153.278240 secs 2024-07-26T16:39:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:07 smithi040 ceph-mon[32397]: pgmap v8294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:07 smithi146 ceph-mon[35807]: pgmap v8294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:07 smithi076 ceph-mon[35401]: pgmap v8294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:09 smithi040 ceph-mon[32397]: pgmap v8295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:09 smithi146 ceph-mon[35807]: pgmap v8295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:09 smithi076 ceph-mon[35401]: pgmap v8295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:11 smithi040 ceph-mon[32397]: pgmap v8296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11158.278380 secs 2024-07-26T16:39:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:11 smithi146 ceph-mon[35807]: pgmap v8296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11158.278380 secs 2024-07-26T16:39:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:11 smithi076 ceph-mon[35401]: pgmap v8296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11158.278380 secs 2024-07-26T16:39:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:13 smithi040 ceph-mon[32397]: pgmap v8297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:13 smithi146 ceph-mon[35807]: pgmap v8297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:13 smithi076 ceph-mon[35401]: pgmap v8297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:15 smithi040 ceph-mon[32397]: pgmap v8298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:15 smithi146 ceph-mon[35807]: pgmap v8298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:15 smithi076 ceph-mon[35401]: pgmap v8298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11163.278469 secs 2024-07-26T16:39:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11163.278469 secs 2024-07-26T16:39:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11163.278469 secs 2024-07-26T16:39:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:17 smithi040 ceph-mon[32397]: pgmap v8299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:17 smithi146 ceph-mon[35807]: pgmap v8299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:17 smithi076 ceph-mon[35401]: pgmap v8299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:19 smithi040 ceph-mon[32397]: pgmap v8300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:19 smithi146 ceph-mon[35807]: pgmap v8300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:19 smithi076 ceph-mon[35401]: pgmap v8300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:21 smithi040 ceph-mon[32397]: pgmap v8301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11168.278565 secs 2024-07-26T16:39:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:21 smithi146 ceph-mon[35807]: pgmap v8301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11168.278565 secs 2024-07-26T16:39:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:21 smithi076 ceph-mon[35401]: pgmap v8301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11168.278565 secs 2024-07-26T16:39:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:23 smithi040 ceph-mon[32397]: pgmap v8302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:23 smithi146 ceph-mon[35807]: pgmap v8302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:23 smithi076 ceph-mon[35401]: pgmap v8302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:25 smithi040 ceph-mon[32397]: pgmap v8303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:25 smithi146 ceph-mon[35807]: pgmap v8303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:25 smithi076 ceph-mon[35401]: pgmap v8303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11173.278698 secs 2024-07-26T16:39:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11173.278698 secs 2024-07-26T16:39:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11173.278698 secs 2024-07-26T16:39:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:27 smithi040 ceph-mon[32397]: pgmap v8304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:27 smithi146 ceph-mon[35807]: pgmap v8304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:27 smithi076 ceph-mon[35401]: pgmap v8304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:29 smithi040 ceph-mon[32397]: pgmap v8305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:29 smithi146 ceph-mon[35807]: pgmap v8305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:29 smithi076 ceph-mon[35401]: pgmap v8305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:30 smithi146 ceph-mon[35807]: pgmap v8306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:30 smithi076 ceph-mon[35401]: pgmap v8306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:30 smithi040 ceph-mon[32397]: pgmap v8306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11178.278840 secs 2024-07-26T16:39:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11178.278840 secs 2024-07-26T16:39:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11178.278840 secs 2024-07-26T16:39:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:33 smithi146 ceph-mon[35807]: pgmap v8307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:33 smithi076 ceph-mon[35401]: pgmap v8307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:33 smithi040 ceph-mon[32397]: pgmap v8307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:36.037 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:35 smithi076 ceph-mon[35401]: pgmap v8308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:35 smithi146 ceph-mon[35807]: pgmap v8308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:35 smithi040 ceph-mon[32397]: pgmap v8308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11183.278975 secs 2024-07-26T16:39:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11183.278975 secs 2024-07-26T16:39:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11183.278975 secs 2024-07-26T16:39:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:37 smithi146 ceph-mon[35807]: pgmap v8309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:37 smithi076 ceph-mon[35401]: pgmap v8309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:37 smithi040 ceph-mon[32397]: pgmap v8309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:39 smithi146 ceph-mon[35807]: pgmap v8310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:39 smithi076 ceph-mon[35401]: pgmap v8310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:39 smithi040 ceph-mon[32397]: pgmap v8310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11188.279120 secs 2024-07-26T16:39:42.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:41 smithi146 ceph-mon[35807]: pgmap v8311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11188.279120 secs 2024-07-26T16:39:42.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:41 smithi076 ceph-mon[35401]: pgmap v8311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11188.279120 secs 2024-07-26T16:39:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:41 smithi040 ceph-mon[32397]: pgmap v8311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:43 smithi146 ceph-mon[35807]: pgmap v8312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:43 smithi076 ceph-mon[35401]: pgmap v8312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:43 smithi040 ceph-mon[32397]: pgmap v8312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:45 smithi146 ceph-mon[35807]: pgmap v8313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:45 smithi076 ceph-mon[35401]: pgmap v8313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:45 smithi040 ceph-mon[32397]: pgmap v8313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11193.279316 secs 2024-07-26T16:39:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11193.279316 secs 2024-07-26T16:39:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11193.279316 secs 2024-07-26T16:39:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:47 smithi076 ceph-mon[35401]: pgmap v8314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:47 smithi040 ceph-mon[32397]: pgmap v8314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:47 smithi146 ceph-mon[35807]: pgmap v8314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:49 smithi076 ceph-mon[35401]: pgmap v8315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:49 smithi040 ceph-mon[32397]: pgmap v8315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:49 smithi146 ceph-mon[35807]: pgmap v8315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:39:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11198.279415 secs 2024-07-26T16:39:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:51 smithi040 ceph-mon[32397]: pgmap v8316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11198.279415 secs 2024-07-26T16:39:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:51 smithi146 ceph-mon[35807]: pgmap v8316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11198.279415 secs 2024-07-26T16:39:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:51 smithi076 ceph-mon[35401]: pgmap v8316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:53 smithi040 ceph-mon[32397]: pgmap v8317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:53 smithi146 ceph-mon[35807]: pgmap v8317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:53 smithi076 ceph-mon[35401]: pgmap v8317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:56.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:55 smithi146 ceph-mon[35807]: pgmap v8318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:55 smithi040 ceph-mon[32397]: pgmap v8318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:55 smithi076 ceph-mon[35401]: pgmap v8318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:39:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11203.279544 secs 2024-07-26T16:39:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11203.279544 secs 2024-07-26T16:39:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11203.279544 secs 2024-07-26T16:39:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:57 smithi040 ceph-mon[32397]: pgmap v8319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:57 smithi146 ceph-mon[35807]: pgmap v8319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:39:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:57 smithi076 ceph-mon[35401]: pgmap v8319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:39:59 smithi040 ceph-mon[32397]: pgmap v8320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:39:59 smithi146 ceph-mon[35807]: pgmap v8320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:39:59 smithi076 ceph-mon[35401]: pgmap v8320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:40:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:40:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:40:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11208.279677 secs 2024-07-26T16:40:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:01 smithi040 ceph-mon[32397]: pgmap v8321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11208.279677 secs 2024-07-26T16:40:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:01 smithi146 ceph-mon[35807]: pgmap v8321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11208.279677 secs 2024-07-26T16:40:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:01 smithi076 ceph-mon[35401]: pgmap v8321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:03 smithi040 ceph-mon[32397]: pgmap v8322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:03 smithi146 ceph-mon[35807]: pgmap v8322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:03 smithi076 ceph-mon[35401]: pgmap v8322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:05 smithi040 ceph-mon[32397]: pgmap v8323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:05 smithi146 ceph-mon[35807]: pgmap v8323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:05 smithi076 ceph-mon[35401]: pgmap v8323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11213.279813 secs 2024-07-26T16:40:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11213.279813 secs 2024-07-26T16:40:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11213.279813 secs 2024-07-26T16:40:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:07 smithi040 ceph-mon[32397]: pgmap v8324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:07 smithi146 ceph-mon[35807]: pgmap v8324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:07 smithi076 ceph-mon[35401]: pgmap v8324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:09 smithi040 ceph-mon[32397]: pgmap v8325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:09 smithi146 ceph-mon[35807]: pgmap v8325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:09 smithi076 ceph-mon[35401]: pgmap v8325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:40:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11218.279953 secs 2024-07-26T16:40:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:11 smithi040 ceph-mon[32397]: pgmap v8326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11218.279953 secs 2024-07-26T16:40:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:11 smithi146 ceph-mon[35807]: pgmap v8326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11218.279953 secs 2024-07-26T16:40:12.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:11 smithi076 ceph-mon[35401]: pgmap v8326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:12 smithi146 ceph-mon[35807]: pgmap v8327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:12 smithi076 ceph-mon[35401]: pgmap v8327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:12 smithi040 ceph-mon[32397]: pgmap v8327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:15 smithi146 ceph-mon[35807]: pgmap v8328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:15 smithi076 ceph-mon[35401]: pgmap v8328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:15 smithi040 ceph-mon[32397]: pgmap v8328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11223.280086 secs 2024-07-26T16:40:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11223.280086 secs 2024-07-26T16:40:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11223.280086 secs 2024-07-26T16:40:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:17 smithi146 ceph-mon[35807]: pgmap v8329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:17 smithi076 ceph-mon[35401]: pgmap v8329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:17 smithi040 ceph-mon[32397]: pgmap v8329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:19 smithi076 ceph-mon[35401]: pgmap v8330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:19 smithi040 ceph-mon[32397]: pgmap v8330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:19 smithi146 ceph-mon[35807]: pgmap v8330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11228.280244 secs 2024-07-26T16:40:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:21 smithi076 ceph-mon[35401]: pgmap v8331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11228.280244 secs 2024-07-26T16:40:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:21 smithi040 ceph-mon[32397]: pgmap v8331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11228.280244 secs 2024-07-26T16:40:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:21 smithi146 ceph-mon[35807]: pgmap v8331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:23 smithi040 ceph-mon[32397]: pgmap v8332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:23 smithi146 ceph-mon[35807]: pgmap v8332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:23 smithi076 ceph-mon[35401]: pgmap v8332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:26.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:25 smithi146 ceph-mon[35807]: pgmap v8333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:25 smithi040 ceph-mon[32397]: pgmap v8333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:25 smithi076 ceph-mon[35401]: pgmap v8333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11233.280408 secs 2024-07-26T16:40:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11233.280408 secs 2024-07-26T16:40:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11233.280408 secs 2024-07-26T16:40:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:27 smithi040 ceph-mon[32397]: pgmap v8334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:27 smithi146 ceph-mon[35807]: pgmap v8334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:27 smithi076 ceph-mon[35401]: pgmap v8334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:29 smithi040 ceph-mon[32397]: pgmap v8335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:29 smithi146 ceph-mon[35807]: pgmap v8335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:29 smithi076 ceph-mon[35401]: pgmap v8335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:40:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11238.280550 secs 2024-07-26T16:40:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:31 smithi040 ceph-mon[32397]: pgmap v8336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11238.280550 secs 2024-07-26T16:40:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:31 smithi146 ceph-mon[35807]: pgmap v8336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11238.280550 secs 2024-07-26T16:40:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:31 smithi076 ceph-mon[35401]: pgmap v8336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:33 smithi040 ceph-mon[32397]: pgmap v8337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:33 smithi146 ceph-mon[35807]: pgmap v8337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:33 smithi076 ceph-mon[35401]: pgmap v8337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:35 smithi040 ceph-mon[32397]: pgmap v8338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:36.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:35 smithi146 ceph-mon[35807]: pgmap v8338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:35 smithi076 ceph-mon[35401]: pgmap v8338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11243.280636 secs 2024-07-26T16:40:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11243.280636 secs 2024-07-26T16:40:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11243.280636 secs 2024-07-26T16:40:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:37 smithi040 ceph-mon[32397]: pgmap v8339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:37 smithi146 ceph-mon[35807]: pgmap v8339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:37 smithi076 ceph-mon[35401]: pgmap v8339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:39 smithi040 ceph-mon[32397]: pgmap v8340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:39 smithi146 ceph-mon[35807]: pgmap v8340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:39 smithi076 ceph-mon[35401]: pgmap v8340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11248.280771 secs 2024-07-26T16:40:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:41 smithi040 ceph-mon[32397]: pgmap v8341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11248.280771 secs 2024-07-26T16:40:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:41 smithi146 ceph-mon[35807]: pgmap v8341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11248.280771 secs 2024-07-26T16:40:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:41 smithi076 ceph-mon[35401]: pgmap v8341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:40:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:43 smithi040 ceph-mon[32397]: pgmap v8342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:43 smithi146 ceph-mon[35807]: pgmap v8342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:43 smithi076 ceph-mon[35401]: pgmap v8342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:45 smithi040 ceph-mon[32397]: pgmap v8343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:45 smithi146 ceph-mon[35807]: pgmap v8343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:45 smithi076 ceph-mon[35401]: pgmap v8343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11253.280913 secs 2024-07-26T16:40:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11253.280913 secs 2024-07-26T16:40:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11253.280913 secs 2024-07-26T16:40:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:47 smithi040 ceph-mon[32397]: pgmap v8344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:47 smithi146 ceph-mon[35807]: pgmap v8344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:47 smithi076 ceph-mon[35401]: pgmap v8344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:48 smithi040 ceph-mon[32397]: pgmap v8345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:48 smithi146 ceph-mon[35807]: pgmap v8345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:48 smithi076 ceph-mon[35401]: pgmap v8345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11258.281056 secs 2024-07-26T16:40:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:51 smithi146 ceph-mon[35807]: pgmap v8346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11258.281056 secs 2024-07-26T16:40:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:51 smithi076 ceph-mon[35401]: pgmap v8346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11258.281056 secs 2024-07-26T16:40:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:51 smithi040 ceph-mon[32397]: pgmap v8346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:53 smithi146 ceph-mon[35807]: pgmap v8347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:53 smithi076 ceph-mon[35401]: pgmap v8347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:53 smithi040 ceph-mon[32397]: pgmap v8347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:55 smithi076 ceph-mon[35401]: pgmap v8348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:55 smithi040 ceph-mon[32397]: pgmap v8348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:55 smithi146 ceph-mon[35807]: pgmap v8348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:40:57.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11263.281197 secs 2024-07-26T16:40:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11263.281197 secs 2024-07-26T16:40:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11263.281197 secs 2024-07-26T16:40:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:57 smithi040 ceph-mon[32397]: pgmap v8349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:57 smithi146 ceph-mon[35807]: pgmap v8349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:40:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:57 smithi076 ceph-mon[35401]: pgmap v8349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:40:59 smithi040 ceph-mon[32397]: pgmap v8350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:40:59 smithi146 ceph-mon[35807]: pgmap v8350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:40:59 smithi076 ceph-mon[35401]: pgmap v8350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11268.281399 secs 2024-07-26T16:41:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:01 smithi040 ceph-mon[32397]: pgmap v8351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11268.281399 secs 2024-07-26T16:41:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:01 smithi146 ceph-mon[35807]: pgmap v8351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11268.281399 secs 2024-07-26T16:41:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:01 smithi076 ceph-mon[35401]: pgmap v8351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:03 smithi040 ceph-mon[32397]: pgmap v8352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:03 smithi146 ceph-mon[35807]: pgmap v8352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:03 smithi076 ceph-mon[35401]: pgmap v8352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:06.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:05 smithi076 ceph-mon[35401]: pgmap v8353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:05 smithi040 ceph-mon[32397]: pgmap v8353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:05 smithi146 ceph-mon[35807]: pgmap v8353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11273.281490 secs 2024-07-26T16:41:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11273.281490 secs 2024-07-26T16:41:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11273.281490 secs 2024-07-26T16:41:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:07 smithi040 ceph-mon[32397]: pgmap v8354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:07 smithi146 ceph-mon[35807]: pgmap v8354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:07 smithi076 ceph-mon[35401]: pgmap v8354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:09 smithi040 ceph-mon[32397]: pgmap v8355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:09 smithi146 ceph-mon[35807]: pgmap v8355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:09 smithi076 ceph-mon[35401]: pgmap v8355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11278.281582 secs 2024-07-26T16:41:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:11 smithi040 ceph-mon[32397]: pgmap v8356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11278.281582 secs 2024-07-26T16:41:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:11 smithi146 ceph-mon[35807]: pgmap v8356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11278.281582 secs 2024-07-26T16:41:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:11 smithi076 ceph-mon[35401]: pgmap v8356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:13 smithi040 ceph-mon[32397]: pgmap v8357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:13 smithi146 ceph-mon[35807]: pgmap v8357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:13 smithi076 ceph-mon[35401]: pgmap v8357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:16.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:15 smithi040 ceph-mon[32397]: pgmap v8358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:15 smithi146 ceph-mon[35807]: pgmap v8358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:15 smithi076 ceph-mon[35401]: pgmap v8358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11283.281679 secs 2024-07-26T16:41:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11283.281679 secs 2024-07-26T16:41:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11283.281679 secs 2024-07-26T16:41:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:17 smithi040 ceph-mon[32397]: pgmap v8359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:17 smithi146 ceph-mon[35807]: pgmap v8359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:17 smithi076 ceph-mon[35401]: pgmap v8359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:19 smithi040 ceph-mon[32397]: pgmap v8360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:19 smithi146 ceph-mon[35807]: pgmap v8360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:20.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:19 smithi076 ceph-mon[35401]: pgmap v8360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11288.281831 secs 2024-07-26T16:41:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:21 smithi040 ceph-mon[32397]: pgmap v8361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11288.281831 secs 2024-07-26T16:41:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:21 smithi146 ceph-mon[35807]: pgmap v8361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11288.281831 secs 2024-07-26T16:41:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:21 smithi076 ceph-mon[35401]: pgmap v8361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:23 smithi040 ceph-mon[32397]: pgmap v8362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:23 smithi146 ceph-mon[35807]: pgmap v8362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:23 smithi076 ceph-mon[35401]: pgmap v8362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:25 smithi040 ceph-mon[32397]: pgmap v8363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:25 smithi146 ceph-mon[35807]: pgmap v8363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:25 smithi076 ceph-mon[35401]: pgmap v8363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:27.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11293.281970 secs 2024-07-26T16:41:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11293.281970 secs 2024-07-26T16:41:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11293.281970 secs 2024-07-26T16:41:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:27 smithi040 ceph-mon[32397]: pgmap v8364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:27 smithi146 ceph-mon[35807]: pgmap v8364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:27 smithi076 ceph-mon[35401]: pgmap v8364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:28 smithi040 ceph-mon[32397]: pgmap v8365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:28 smithi146 ceph-mon[35807]: pgmap v8365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:28 smithi076 ceph-mon[35401]: pgmap v8365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11298.282107 secs 2024-07-26T16:41:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:31 smithi040 ceph-mon[32397]: pgmap v8366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11298.282107 secs 2024-07-26T16:41:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:31 smithi146 ceph-mon[35807]: pgmap v8366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11298.282107 secs 2024-07-26T16:41:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:31 smithi076 ceph-mon[35401]: pgmap v8366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:33 smithi040 ceph-mon[32397]: pgmap v8367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:33 smithi146 ceph-mon[35807]: pgmap v8367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:33 smithi076 ceph-mon[35401]: pgmap v8367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:36.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:35 smithi076 ceph-mon[35401]: pgmap v8368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:35 smithi040 ceph-mon[32397]: pgmap v8368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:35 smithi146 ceph-mon[35807]: pgmap v8368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11303.282297 secs 2024-07-26T16:41:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11303.282297 secs 2024-07-26T16:41:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11303.282297 secs 2024-07-26T16:41:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:37 smithi040 ceph-mon[32397]: pgmap v8369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:37 smithi146 ceph-mon[35807]: pgmap v8369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:37 smithi076 ceph-mon[35401]: pgmap v8369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:39 smithi040 ceph-mon[32397]: pgmap v8370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:39 smithi146 ceph-mon[35807]: pgmap v8370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:39 smithi076 ceph-mon[35401]: pgmap v8370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11308.282432 secs 2024-07-26T16:41:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:41 smithi040 ceph-mon[32397]: pgmap v8371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11308.282432 secs 2024-07-26T16:41:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:41 smithi146 ceph-mon[35807]: pgmap v8371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11308.282432 secs 2024-07-26T16:41:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:41 smithi076 ceph-mon[35401]: pgmap v8371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:43 smithi040 ceph-mon[32397]: pgmap v8372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:43 smithi146 ceph-mon[35807]: pgmap v8372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:43 smithi076 ceph-mon[35401]: pgmap v8372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:45 smithi040 ceph-mon[32397]: pgmap v8373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:45 smithi146 ceph-mon[35807]: pgmap v8373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:45 smithi076 ceph-mon[35401]: pgmap v8373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11313.282592 secs 2024-07-26T16:41:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11313.282592 secs 2024-07-26T16:41:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11313.282592 secs 2024-07-26T16:41:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:47 smithi040 ceph-mon[32397]: pgmap v8374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:47 smithi146 ceph-mon[35807]: pgmap v8374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:47 smithi076 ceph-mon[35401]: pgmap v8374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:49 smithi040 ceph-mon[32397]: pgmap v8375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:49 smithi146 ceph-mon[35807]: pgmap v8375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:49 smithi076 ceph-mon[35401]: pgmap v8375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:41:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11318.282728 secs 2024-07-26T16:41:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:51 smithi040 ceph-mon[32397]: pgmap v8376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11318.282728 secs 2024-07-26T16:41:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:51 smithi146 ceph-mon[35807]: pgmap v8376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11318.282728 secs 2024-07-26T16:41:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:51 smithi076 ceph-mon[35401]: pgmap v8376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:53 smithi040 ceph-mon[32397]: pgmap v8377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:53 smithi146 ceph-mon[35807]: pgmap v8377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:53 smithi076 ceph-mon[35401]: pgmap v8377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:55 smithi040 ceph-mon[32397]: pgmap v8378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:55 smithi146 ceph-mon[35807]: pgmap v8378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:55 smithi076 ceph-mon[35401]: pgmap v8378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:41:57.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11323.282866 secs 2024-07-26T16:41:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11323.282866 secs 2024-07-26T16:41:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11323.282866 secs 2024-07-26T16:41:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:57 smithi040 ceph-mon[32397]: pgmap v8379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:57 smithi146 ceph-mon[35807]: pgmap v8379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:41:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:57 smithi076 ceph-mon[35401]: pgmap v8379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:41:59 smithi040 ceph-mon[32397]: pgmap v8380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:41:59 smithi146 ceph-mon[35807]: pgmap v8380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:41:59 smithi076 ceph-mon[35401]: pgmap v8380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:01 smithi146 ceph-mon[35807]: pgmap v8381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:01 smithi076 ceph-mon[35401]: pgmap v8381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:01 smithi040 ceph-mon[32397]: pgmap v8381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11328.283044 secs 2024-07-26T16:42:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11328.283044 secs 2024-07-26T16:42:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11328.283044 secs 2024-07-26T16:42:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:03 smithi146 ceph-mon[35807]: pgmap v8382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:03 smithi076 ceph-mon[35401]: pgmap v8382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:03 smithi040 ceph-mon[32397]: pgmap v8382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:05 smithi040 ceph-mon[32397]: pgmap v8383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:05 smithi146 ceph-mon[35807]: pgmap v8383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:05 smithi076 ceph-mon[35401]: pgmap v8383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11333.283195 secs 2024-07-26T16:42:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11333.283195 secs 2024-07-26T16:42:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11333.283195 secs 2024-07-26T16:42:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:07 smithi040 ceph-mon[32397]: pgmap v8384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:07 smithi146 ceph-mon[35807]: pgmap v8384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:07 smithi076 ceph-mon[35401]: pgmap v8384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:09 smithi040 ceph-mon[32397]: pgmap v8385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:09 smithi146 ceph-mon[35807]: pgmap v8385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:09 smithi076 ceph-mon[35401]: pgmap v8385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11338.283331 secs 2024-07-26T16:42:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:11 smithi040 ceph-mon[32397]: pgmap v8386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11338.283331 secs 2024-07-26T16:42:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:11 smithi146 ceph-mon[35807]: pgmap v8386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11338.283331 secs 2024-07-26T16:42:12.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:11 smithi076 ceph-mon[35401]: pgmap v8386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:13 smithi040 ceph-mon[32397]: pgmap v8387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:13 smithi146 ceph-mon[35807]: pgmap v8387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:13 smithi076 ceph-mon[35401]: pgmap v8387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:15 smithi040 ceph-mon[32397]: pgmap v8388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:15 smithi146 ceph-mon[35807]: pgmap v8388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:15 smithi076 ceph-mon[35401]: pgmap v8388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11343.283474 secs 2024-07-26T16:42:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11343.283474 secs 2024-07-26T16:42:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11343.283474 secs 2024-07-26T16:42:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:17 smithi040 ceph-mon[32397]: pgmap v8389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:17 smithi146 ceph-mon[35807]: pgmap v8389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:17 smithi076 ceph-mon[35401]: pgmap v8389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:19 smithi040 ceph-mon[32397]: pgmap v8390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:19 smithi146 ceph-mon[35807]: pgmap v8390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:19 smithi076 ceph-mon[35401]: pgmap v8390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11348.283615 secs 2024-07-26T16:42:22.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:21 smithi040 ceph-mon[32397]: pgmap v8391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11348.283615 secs 2024-07-26T16:42:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:21 smithi146 ceph-mon[35807]: pgmap v8391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11348.283615 secs 2024-07-26T16:42:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:21 smithi076 ceph-mon[35401]: pgmap v8391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:23 smithi040 ceph-mon[32397]: pgmap v8392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:23 smithi146 ceph-mon[35807]: pgmap v8392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:23 smithi076 ceph-mon[35401]: pgmap v8392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:25 smithi040 ceph-mon[32397]: pgmap v8393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:25 smithi146 ceph-mon[35807]: pgmap v8393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:25 smithi076 ceph-mon[35401]: pgmap v8393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:27.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11353.283706 secs 2024-07-26T16:42:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11353.283706 secs 2024-07-26T16:42:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11353.283706 secs 2024-07-26T16:42:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:27 smithi040 ceph-mon[32397]: pgmap v8394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:27 smithi146 ceph-mon[35807]: pgmap v8394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:27 smithi076 ceph-mon[35401]: pgmap v8394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:29 smithi040 ceph-mon[32397]: pgmap v8395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:29 smithi146 ceph-mon[35807]: pgmap v8395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:29 smithi076 ceph-mon[35401]: pgmap v8395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:42:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:31 smithi146 ceph-mon[35807]: pgmap v8396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:31 smithi076 ceph-mon[35401]: pgmap v8396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:31 smithi040 ceph-mon[32397]: pgmap v8396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11358.283866 secs 2024-07-26T16:42:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11358.283866 secs 2024-07-26T16:42:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11358.283866 secs 2024-07-26T16:42:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:33 smithi146 ceph-mon[35807]: pgmap v8397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:33 smithi076 ceph-mon[35401]: pgmap v8397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:33 smithi040 ceph-mon[32397]: pgmap v8397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:35 smithi040 ceph-mon[32397]: pgmap v8398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:35 smithi146 ceph-mon[35807]: pgmap v8398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:35 smithi076 ceph-mon[35401]: pgmap v8398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11363.284009 secs 2024-07-26T16:42:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:42:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:42:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:42:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11363.284009 secs 2024-07-26T16:42:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:42:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:42:37.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:42:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11363.284009 secs 2024-07-26T16:42:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:42:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:42:37.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:42:37.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:42:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:37 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:42:38.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:37 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:42:38.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:37 smithi040 ceph-mon[32397]: pgmap v8399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-07-26T16:42:38.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:37 smithi040 ceph-mon[32397]: pgmap v8400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:42:38.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:37 smithi040 ceph-mon[32397]: pgmap v8401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-07-26T16:42:38.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:37 smithi040 ceph-mon[32397]: pgmap v8402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:37 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:42:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:37 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:42:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:37 smithi146 ceph-mon[35807]: pgmap v8399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-07-26T16:42:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:37 smithi146 ceph-mon[35807]: pgmap v8400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:42:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:37 smithi146 ceph-mon[35807]: pgmap v8401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-07-26T16:42:38.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:37 smithi146 ceph-mon[35807]: pgmap v8402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:37 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:42:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:37 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:42:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:37 smithi076 ceph-mon[35401]: pgmap v8399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-07-26T16:42:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:37 smithi076 ceph-mon[35401]: pgmap v8400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:42:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:37 smithi076 ceph-mon[35401]: pgmap v8401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-07-26T16:42:38.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:37 smithi076 ceph-mon[35401]: pgmap v8402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:39 smithi040 ceph-mon[32397]: pgmap v8403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:39 smithi146 ceph-mon[35807]: pgmap v8403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:39 smithi076 ceph-mon[35401]: pgmap v8403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:41 smithi040 ceph-mon[32397]: pgmap v8404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11368.284165 secs 2024-07-26T16:42:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:41 smithi146 ceph-mon[35807]: pgmap v8404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11368.284165 secs 2024-07-26T16:42:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:41 smithi076 ceph-mon[35401]: pgmap v8404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T16:42:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11368.284165 secs 2024-07-26T16:42:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:43 smithi040 ceph-mon[32397]: pgmap v8405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:43 smithi146 ceph-mon[35807]: pgmap v8405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:43 smithi076 ceph-mon[35401]: pgmap v8405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:45 smithi040 ceph-mon[32397]: pgmap v8406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:45 smithi146 ceph-mon[35807]: pgmap v8406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:45 smithi076 ceph-mon[35401]: pgmap v8406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11373.284307 secs 2024-07-26T16:42:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11373.284307 secs 2024-07-26T16:42:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11373.284307 secs 2024-07-26T16:42:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:47 smithi040 ceph-mon[32397]: pgmap v8407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:42:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:47 smithi146 ceph-mon[35807]: pgmap v8407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:42:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:47 smithi076 ceph-mon[35401]: pgmap v8407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:42:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:49 smithi040 ceph-mon[32397]: pgmap v8408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:49 smithi146 ceph-mon[35807]: pgmap v8408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:49 smithi076 ceph-mon[35401]: pgmap v8408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:51 smithi040 ceph-mon[32397]: pgmap v8409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11378.284420 secs 2024-07-26T16:42:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:51 smithi146 ceph-mon[35807]: pgmap v8409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:52.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11378.284420 secs 2024-07-26T16:42:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:51 smithi076 ceph-mon[35401]: pgmap v8409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11378.284420 secs 2024-07-26T16:42:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:53 smithi040 ceph-mon[32397]: pgmap v8410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:53 smithi146 ceph-mon[35807]: pgmap v8410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:53 smithi076 ceph-mon[35401]: pgmap v8410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:55 smithi040 ceph-mon[32397]: pgmap v8411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:55 smithi146 ceph-mon[35807]: pgmap v8411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:55 smithi076 ceph-mon[35401]: pgmap v8411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:42:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11383.284563 secs 2024-07-26T16:42:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11383.284563 secs 2024-07-26T16:42:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11383.284563 secs 2024-07-26T16:42:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:57 smithi040 ceph-mon[32397]: pgmap v8412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:57 smithi146 ceph-mon[35807]: pgmap v8412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:57 smithi076 ceph-mon[35401]: pgmap v8412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:59.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:42:58 smithi146 ceph-mon[35807]: pgmap v8413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:42:58 smithi076 ceph-mon[35401]: pgmap v8413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:42:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:42:58 smithi040 ceph-mon[32397]: pgmap v8413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:01 smithi040 ceph-mon[32397]: pgmap v8414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11388.284712 secs 2024-07-26T16:43:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:01 smithi146 ceph-mon[35807]: pgmap v8414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11388.284712 secs 2024-07-26T16:43:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:01 smithi076 ceph-mon[35401]: pgmap v8414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11388.284712 secs 2024-07-26T16:43:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:03 smithi040 ceph-mon[32397]: pgmap v8415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:03 smithi146 ceph-mon[35807]: pgmap v8415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:03 smithi076 ceph-mon[35401]: pgmap v8415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:05 smithi040 ceph-mon[32397]: pgmap v8416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:05 smithi146 ceph-mon[35807]: pgmap v8416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:05 smithi076 ceph-mon[35401]: pgmap v8416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11393.284852 secs 2024-07-26T16:43:06.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11393.284852 secs 2024-07-26T16:43:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11393.284852 secs 2024-07-26T16:43:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:07 smithi040 ceph-mon[32397]: pgmap v8417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:07 smithi146 ceph-mon[35807]: pgmap v8417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:07 smithi076 ceph-mon[35401]: pgmap v8417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:09 smithi146 ceph-mon[35807]: pgmap v8418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:09 smithi076 ceph-mon[35401]: pgmap v8418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:09 smithi040 ceph-mon[32397]: pgmap v8418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:11 smithi040 ceph-mon[32397]: pgmap v8419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11398.284996 secs 2024-07-26T16:43:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:11 smithi146 ceph-mon[35807]: pgmap v8419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11398.284996 secs 2024-07-26T16:43:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:11 smithi076 ceph-mon[35401]: pgmap v8419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11398.284996 secs 2024-07-26T16:43:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:13 smithi040 ceph-mon[32397]: pgmap v8420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:13 smithi146 ceph-mon[35807]: pgmap v8420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:13 smithi076 ceph-mon[35401]: pgmap v8420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:15 smithi040 ceph-mon[32397]: pgmap v8421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:15 smithi146 ceph-mon[35807]: pgmap v8421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:15 smithi076 ceph-mon[35401]: pgmap v8421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11403.285153 secs 2024-07-26T16:43:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11403.285153 secs 2024-07-26T16:43:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11403.285153 secs 2024-07-26T16:43:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:17 smithi040 ceph-mon[32397]: pgmap v8422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:17 smithi146 ceph-mon[35807]: pgmap v8422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:17 smithi076 ceph-mon[35401]: pgmap v8422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:19 smithi040 ceph-mon[32397]: pgmap v8423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:19 smithi146 ceph-mon[35807]: pgmap v8423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:19 smithi076 ceph-mon[35401]: pgmap v8423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:21 smithi040 ceph-mon[32397]: pgmap v8424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:22.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11408.285318 secs 2024-07-26T16:43:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:21 smithi146 ceph-mon[35807]: pgmap v8424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11408.285318 secs 2024-07-26T16:43:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:21 smithi076 ceph-mon[35401]: pgmap v8424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11408.285318 secs 2024-07-26T16:43:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:23 smithi040 ceph-mon[32397]: pgmap v8425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:23 smithi146 ceph-mon[35807]: pgmap v8425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:23 smithi076 ceph-mon[35401]: pgmap v8425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:25 smithi040 ceph-mon[32397]: pgmap v8426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:25 smithi146 ceph-mon[35807]: pgmap v8426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:25 smithi076 ceph-mon[35401]: pgmap v8426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:27.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11413.285449 secs 2024-07-26T16:43:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11413.285449 secs 2024-07-26T16:43:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11413.285449 secs 2024-07-26T16:43:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:27 smithi040 ceph-mon[32397]: pgmap v8427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:27 smithi146 ceph-mon[35807]: pgmap v8427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:27 smithi076 ceph-mon[35401]: pgmap v8427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:29 smithi040 ceph-mon[32397]: pgmap v8428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:29 smithi146 ceph-mon[35807]: pgmap v8428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:29 smithi076 ceph-mon[35401]: pgmap v8428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:31 smithi040 ceph-mon[32397]: pgmap v8429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11418.285588 secs 2024-07-26T16:43:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:31 smithi146 ceph-mon[35807]: pgmap v8429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11418.285588 secs 2024-07-26T16:43:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:31 smithi076 ceph-mon[35401]: pgmap v8429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11418.285588 secs 2024-07-26T16:43:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:33 smithi040 ceph-mon[32397]: pgmap v8430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:33 smithi146 ceph-mon[35807]: pgmap v8430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:33 smithi076 ceph-mon[35401]: pgmap v8430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:35 smithi146 ceph-mon[35807]: pgmap v8431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:35 smithi076 ceph-mon[35401]: pgmap v8431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:35 smithi040 ceph-mon[32397]: pgmap v8431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11423.285722 secs 2024-07-26T16:43:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:36 smithi146 ceph-mon[35807]: pgmap v8432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:36 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:43:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11423.285722 secs 2024-07-26T16:43:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:36 smithi076 ceph-mon[35401]: pgmap v8432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:36 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:43:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11423.285722 secs 2024-07-26T16:43:37.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:36 smithi040 ceph-mon[32397]: pgmap v8432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:37.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:36 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:43:38.678 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.678 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.678 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.679 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.679 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.679 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:38 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.713 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.714 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:38 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:38.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:38 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:39 smithi040 ceph-mon[32397]: pgmap v8433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:39 smithi146 ceph-mon[35807]: pgmap v8433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:39 smithi076 ceph-mon[35401]: pgmap v8433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: pgmap v8434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:41.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11428.285830 secs 2024-07-26T16:43:41.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: pgmap v8434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11428.285830 secs 2024-07-26T16:43:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: pgmap v8434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11428.285830 secs 2024-07-26T16:43:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:41.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:43.599 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:43 smithi040 ceph-mon[32397]: pgmap v8435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:43 smithi146 ceph-mon[35807]: pgmap v8435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:43 smithi076 ceph-mon[35401]: pgmap v8435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:45.505 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:45 smithi040 ceph-mon[32397]: pgmap v8436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:45 smithi146 ceph-mon[35807]: pgmap v8436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:45.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:45 smithi076 ceph-mon[35401]: pgmap v8436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11433.285910 secs 2024-07-26T16:43:46.669 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11433.285910 secs 2024-07-26T16:43:46.744 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11433.285910 secs 2024-07-26T16:43:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: pgmap v8437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: pgmap v8437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: pgmap v8437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:43:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:43:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:48 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:43:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:48 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:43:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:48 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:43:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:48 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:43:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:48 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:43:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:48 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:43:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:48 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:43:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:48 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:43:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:48 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:43:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:48 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:43:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:48 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:43:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:48 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:43:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:49 smithi146 ceph-mon[35807]: pgmap v8438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:43:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:49 smithi076 ceph-mon[35401]: pgmap v8438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:43:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:49 smithi040 ceph-mon[32397]: pgmap v8438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:43:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:51 smithi040 ceph-mon[32397]: pgmap v8439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:52.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11438.285996 secs 2024-07-26T16:43:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:51 smithi146 ceph-mon[35807]: pgmap v8439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:52.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11438.285996 secs 2024-07-26T16:43:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:51 smithi076 ceph-mon[35401]: pgmap v8439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:52.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11438.285996 secs 2024-07-26T16:43:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:53 smithi040 ceph-mon[32397]: pgmap v8440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:53 smithi146 ceph-mon[35807]: pgmap v8440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:53 smithi076 ceph-mon[35401]: pgmap v8440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:56.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:55 smithi040 ceph-mon[32397]: pgmap v8441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:55 smithi146 ceph-mon[35807]: pgmap v8441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:55 smithi076 ceph-mon[35401]: pgmap v8441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:43:57.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11443.286127 secs 2024-07-26T16:43:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11443.286127 secs 2024-07-26T16:43:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11443.286127 secs 2024-07-26T16:43:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:57 smithi146 ceph-mon[35807]: pgmap v8442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:57 smithi040 ceph-mon[32397]: pgmap v8442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:43:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:57 smithi076 ceph-mon[35401]: pgmap v8442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:43:59 smithi040 ceph-mon[32397]: pgmap v8443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:43:59 smithi146 ceph-mon[35807]: pgmap v8443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:43:59 smithi076 ceph-mon[35401]: pgmap v8443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:01 smithi040 ceph-mon[32397]: pgmap v8444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11448.286307 secs 2024-07-26T16:44:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:01 smithi146 ceph-mon[35807]: pgmap v8444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11448.286307 secs 2024-07-26T16:44:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:01 smithi076 ceph-mon[35401]: pgmap v8444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:02.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11448.286307 secs 2024-07-26T16:44:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:03 smithi040 ceph-mon[32397]: pgmap v8445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:03 smithi146 ceph-mon[35807]: pgmap v8445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:03 smithi076 ceph-mon[35401]: pgmap v8445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:05 smithi040 ceph-mon[32397]: pgmap v8446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:05 smithi146 ceph-mon[35807]: pgmap v8446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:05 smithi076 ceph-mon[35401]: pgmap v8446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11453.286400 secs 2024-07-26T16:44:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11453.286400 secs 2024-07-26T16:44:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11453.286400 secs 2024-07-26T16:44:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:07 smithi076 ceph-mon[35401]: pgmap v8447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:07 smithi040 ceph-mon[32397]: pgmap v8447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:07 smithi146 ceph-mon[35807]: pgmap v8447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:09 smithi146 ceph-mon[35807]: pgmap v8448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:09 smithi076 ceph-mon[35401]: pgmap v8448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:09 smithi040 ceph-mon[32397]: pgmap v8448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:11 smithi146 ceph-mon[35807]: pgmap v8449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:44:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:11 smithi076 ceph-mon[35401]: pgmap v8449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:44:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:11 smithi040 ceph-mon[32397]: pgmap v8449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:44:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11458.286541 secs 2024-07-26T16:44:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11458.286541 secs 2024-07-26T16:44:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11458.286541 secs 2024-07-26T16:44:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:13 smithi146 ceph-mon[35807]: pgmap v8450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:13.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:13 smithi076 ceph-mon[35401]: pgmap v8450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:13 smithi040 ceph-mon[32397]: pgmap v8450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:15 smithi146 ceph-mon[35807]: pgmap v8451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:15 smithi076 ceph-mon[35401]: pgmap v8451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:15 smithi040 ceph-mon[32397]: pgmap v8451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11463.286629 secs 2024-07-26T16:44:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11463.286629 secs 2024-07-26T16:44:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11463.286629 secs 2024-07-26T16:44:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:17 smithi146 ceph-mon[35807]: pgmap v8452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:17 smithi076 ceph-mon[35401]: pgmap v8452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:17 smithi040 ceph-mon[32397]: pgmap v8452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:19 smithi146 ceph-mon[35807]: pgmap v8453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:19 smithi076 ceph-mon[35401]: pgmap v8453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:19 smithi040 ceph-mon[32397]: pgmap v8453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:21 smithi146 ceph-mon[35807]: pgmap v8454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11468.286773 secs 2024-07-26T16:44:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:21 smithi076 ceph-mon[35401]: pgmap v8454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11468.286773 secs 2024-07-26T16:44:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:21 smithi040 ceph-mon[32397]: pgmap v8454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11468.286773 secs 2024-07-26T16:44:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:23 smithi146 ceph-mon[35807]: pgmap v8455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:23 smithi076 ceph-mon[35401]: pgmap v8455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:23 smithi040 ceph-mon[32397]: pgmap v8455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:25 smithi146 ceph-mon[35807]: pgmap v8456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:25 smithi076 ceph-mon[35401]: pgmap v8456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:25 smithi040 ceph-mon[32397]: pgmap v8456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11473.286936 secs 2024-07-26T16:44:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11473.286936 secs 2024-07-26T16:44:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11473.286936 secs 2024-07-26T16:44:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:27 smithi146 ceph-mon[35807]: pgmap v8457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:27 smithi076 ceph-mon[35401]: pgmap v8457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:27 smithi040 ceph-mon[32397]: pgmap v8457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:29 smithi146 ceph-mon[35807]: pgmap v8458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:29 smithi076 ceph-mon[35401]: pgmap v8458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:29 smithi040 ceph-mon[32397]: pgmap v8458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:31 smithi146 ceph-mon[35807]: pgmap v8459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11478.287104 secs 2024-07-26T16:44:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:31 smithi076 ceph-mon[35401]: pgmap v8459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11478.287104 secs 2024-07-26T16:44:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:31 smithi040 ceph-mon[32397]: pgmap v8459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11478.287104 secs 2024-07-26T16:44:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:33 smithi076 ceph-mon[35401]: pgmap v8460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:33 smithi040 ceph-mon[32397]: pgmap v8460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:33 smithi146 ceph-mon[35807]: pgmap v8460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:35 smithi076 ceph-mon[35401]: pgmap v8461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:35 smithi040 ceph-mon[32397]: pgmap v8461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:35 smithi146 ceph-mon[35807]: pgmap v8461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:36.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11483.287249 secs 2024-07-26T16:44:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11483.287249 secs 2024-07-26T16:44:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11483.287249 secs 2024-07-26T16:44:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:37 smithi040 ceph-mon[32397]: pgmap v8462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:37 smithi146 ceph-mon[35807]: pgmap v8462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:37 smithi076 ceph-mon[35401]: pgmap v8462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:39 smithi040 ceph-mon[32397]: pgmap v8463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:39 smithi146 ceph-mon[35807]: pgmap v8463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:39 smithi076 ceph-mon[35401]: pgmap v8463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:41 smithi040 ceph-mon[32397]: pgmap v8464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11488.287396 secs 2024-07-26T16:44:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:41 smithi146 ceph-mon[35807]: pgmap v8464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11488.287396 secs 2024-07-26T16:44:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:41 smithi076 ceph-mon[35401]: pgmap v8464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11488.287396 secs 2024-07-26T16:44:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:43 smithi040 ceph-mon[32397]: pgmap v8465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:43 smithi146 ceph-mon[35807]: pgmap v8465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:43 smithi076 ceph-mon[35401]: pgmap v8465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:45 smithi040 ceph-mon[32397]: pgmap v8466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:45 smithi146 ceph-mon[35807]: pgmap v8466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:45 smithi076 ceph-mon[35401]: pgmap v8466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11493.287569 secs 2024-07-26T16:44:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11493.287569 secs 2024-07-26T16:44:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11493.287569 secs 2024-07-26T16:44:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:47 smithi040 ceph-mon[32397]: pgmap v8467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:47 smithi146 ceph-mon[35807]: pgmap v8467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:47 smithi076 ceph-mon[35401]: pgmap v8467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:49 smithi040 ceph-mon[32397]: pgmap v8468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:49 smithi146 ceph-mon[35807]: pgmap v8468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:49 smithi076 ceph-mon[35401]: pgmap v8468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:44:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:51 smithi040 ceph-mon[32397]: pgmap v8469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11498.287704 secs 2024-07-26T16:44:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:51 smithi146 ceph-mon[35807]: pgmap v8469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11498.287704 secs 2024-07-26T16:44:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:51 smithi076 ceph-mon[35401]: pgmap v8469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11498.287704 secs 2024-07-26T16:44:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:53 smithi040 ceph-mon[32397]: pgmap v8470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:53 smithi146 ceph-mon[35807]: pgmap v8470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:53 smithi076 ceph-mon[35401]: pgmap v8470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:55 smithi040 ceph-mon[32397]: pgmap v8471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:55 smithi146 ceph-mon[35807]: pgmap v8471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:55 smithi076 ceph-mon[35401]: pgmap v8471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:44:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11503.287849 secs 2024-07-26T16:44:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11503.287849 secs 2024-07-26T16:44:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11503.287849 secs 2024-07-26T16:44:57.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:57 smithi146 ceph-mon[35807]: pgmap v8472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:57 smithi040 ceph-mon[32397]: pgmap v8472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:57 smithi076 ceph-mon[35401]: pgmap v8472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:44:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:44:59 smithi040 ceph-mon[32397]: pgmap v8473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:44:59 smithi146 ceph-mon[35807]: pgmap v8473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:44:59 smithi076 ceph-mon[35401]: pgmap v8473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:01 smithi040 ceph-mon[32397]: pgmap v8474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11508.287983 secs 2024-07-26T16:45:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:01 smithi146 ceph-mon[35807]: pgmap v8474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11508.287983 secs 2024-07-26T16:45:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:01 smithi076 ceph-mon[35401]: pgmap v8474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11508.287983 secs 2024-07-26T16:45:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:03 smithi040 ceph-mon[32397]: pgmap v8475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:03 smithi146 ceph-mon[35807]: pgmap v8475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:03 smithi076 ceph-mon[35401]: pgmap v8475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:05 smithi040 ceph-mon[32397]: pgmap v8476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:05 smithi146 ceph-mon[35807]: pgmap v8476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:05 smithi076 ceph-mon[35401]: pgmap v8476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11513.288126 secs 2024-07-26T16:45:06.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11513.288126 secs 2024-07-26T16:45:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11513.288126 secs 2024-07-26T16:45:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:07 smithi040 ceph-mon[32397]: pgmap v8477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:07 smithi146 ceph-mon[35807]: pgmap v8477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:07 smithi076 ceph-mon[35401]: pgmap v8477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:09 smithi146 ceph-mon[35807]: pgmap v8478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:09 smithi076 ceph-mon[35401]: pgmap v8478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:09 smithi040 ceph-mon[32397]: pgmap v8478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:11 smithi146 ceph-mon[35807]: pgmap v8479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11518.288329 secs 2024-07-26T16:45:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:11 smithi076 ceph-mon[35401]: pgmap v8479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11518.288329 secs 2024-07-26T16:45:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:11 smithi040 ceph-mon[32397]: pgmap v8479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11518.288329 secs 2024-07-26T16:45:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:13 smithi146 ceph-mon[35807]: pgmap v8480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:13 smithi076 ceph-mon[35401]: pgmap v8480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:13 smithi040 ceph-mon[32397]: pgmap v8480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:15 smithi146 ceph-mon[35807]: pgmap v8481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:15 smithi076 ceph-mon[35401]: pgmap v8481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:15 smithi040 ceph-mon[32397]: pgmap v8481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:16 smithi146 ceph-mon[35807]: 1 slow requests, 1 included below; oldest blocked for > 11523.288431 secs 2024-07-26T16:45:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:16 smithi146 ceph-mon[35807]: slow request 11523.288430 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T16:45:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:16 smithi076 ceph-mon[35401]: 1 slow requests, 1 included below; oldest blocked for > 11523.288431 secs 2024-07-26T16:45:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:16 smithi076 ceph-mon[35401]: slow request 11523.288430 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T16:45:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:16 smithi040 ceph-mon[32397]: 1 slow requests, 1 included below; oldest blocked for > 11523.288431 secs 2024-07-26T16:45:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:16 smithi040 ceph-mon[32397]: slow request 11523.288430 seconds old, received at 2024-07-26T13:33:12.412110+0000: client_request(client.15327:7895 rmdir #0x100000004d2/data 2024-07-26T13:33:12.411679+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,}) currently acquired locks 2024-07-26T16:45:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:17 smithi146 ceph-mon[35807]: pgmap v8482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:17 smithi076 ceph-mon[35401]: pgmap v8482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:17 smithi040 ceph-mon[32397]: pgmap v8482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:19 smithi146 ceph-mon[35807]: pgmap v8483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:19 smithi076 ceph-mon[35401]: pgmap v8483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:19 smithi040 ceph-mon[32397]: pgmap v8483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:21 smithi146 ceph-mon[35807]: pgmap v8484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:45:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11528.288576 secs 2024-07-26T16:45:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:21 smithi076 ceph-mon[35401]: pgmap v8484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:45:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11528.288576 secs 2024-07-26T16:45:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:21 smithi040 ceph-mon[32397]: pgmap v8484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:45:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11528.288576 secs 2024-07-26T16:45:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:23 smithi146 ceph-mon[35807]: pgmap v8485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:23 smithi076 ceph-mon[35401]: pgmap v8485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:23 smithi040 ceph-mon[32397]: pgmap v8485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:25 smithi146 ceph-mon[35807]: pgmap v8486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:25 smithi076 ceph-mon[35401]: pgmap v8486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:25 smithi040 ceph-mon[32397]: pgmap v8486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11533.288719 secs 2024-07-26T16:45:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11533.288719 secs 2024-07-26T16:45:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11533.288719 secs 2024-07-26T16:45:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:27 smithi146 ceph-mon[35807]: pgmap v8487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:27 smithi076 ceph-mon[35401]: pgmap v8487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:27 smithi040 ceph-mon[32397]: pgmap v8487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:29 smithi076 ceph-mon[35401]: pgmap v8488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:29 smithi040 ceph-mon[32397]: pgmap v8488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:29 smithi146 ceph-mon[35807]: pgmap v8488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:45:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:31 smithi040 ceph-mon[32397]: pgmap v8489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:45:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11538.288878 secs 2024-07-26T16:45:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:31 smithi146 ceph-mon[35807]: pgmap v8489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:45:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11538.288878 secs 2024-07-26T16:45:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:31 smithi076 ceph-mon[35401]: pgmap v8489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:45:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11538.288878 secs 2024-07-26T16:45:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:33 smithi040 ceph-mon[32397]: pgmap v8490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:33 smithi146 ceph-mon[35807]: pgmap v8490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:33 smithi076 ceph-mon[35401]: pgmap v8490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:36.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:35 smithi076 ceph-mon[35401]: pgmap v8491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:35 smithi040 ceph-mon[32397]: pgmap v8491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:35 smithi146 ceph-mon[35807]: pgmap v8491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11543.289032 secs 2024-07-26T16:45:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11543.289032 secs 2024-07-26T16:45:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11543.289032 secs 2024-07-26T16:45:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:37 smithi040 ceph-mon[32397]: pgmap v8492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:37 smithi146 ceph-mon[35807]: pgmap v8492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:37 smithi076 ceph-mon[35401]: pgmap v8492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:39 smithi040 ceph-mon[32397]: pgmap v8493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:39 smithi146 ceph-mon[35807]: pgmap v8493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:39 smithi076 ceph-mon[35401]: pgmap v8493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:41 smithi040 ceph-mon[32397]: pgmap v8494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:42.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11548.289168 secs 2024-07-26T16:45:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:41 smithi146 ceph-mon[35807]: pgmap v8494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11548.289168 secs 2024-07-26T16:45:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:41 smithi076 ceph-mon[35401]: pgmap v8494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11548.289168 secs 2024-07-26T16:45:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:43 smithi040 ceph-mon[32397]: pgmap v8495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:43 smithi146 ceph-mon[35807]: pgmap v8495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:43 smithi076 ceph-mon[35401]: pgmap v8495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:45 smithi040 ceph-mon[32397]: pgmap v8496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:46.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:45 smithi146 ceph-mon[35807]: pgmap v8496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:45 smithi076 ceph-mon[35401]: pgmap v8496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11553.289328 secs 2024-07-26T16:45:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11553.289328 secs 2024-07-26T16:45:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11553.289328 secs 2024-07-26T16:45:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:47 smithi040 ceph-mon[32397]: pgmap v8497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:47 smithi146 ceph-mon[35807]: pgmap v8497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:47 smithi076 ceph-mon[35401]: pgmap v8497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:49 smithi040 ceph-mon[32397]: pgmap v8498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:50.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:49 smithi146 ceph-mon[35807]: pgmap v8498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:49 smithi076 ceph-mon[35401]: pgmap v8498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:45:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:51 smithi040 ceph-mon[32397]: pgmap v8499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11558.289461 secs 2024-07-26T16:45:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:51 smithi146 ceph-mon[35807]: pgmap v8499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11558.289461 secs 2024-07-26T16:45:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:51 smithi076 ceph-mon[35401]: pgmap v8499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11558.289461 secs 2024-07-26T16:45:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:53 smithi040 ceph-mon[32397]: pgmap v8500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:53 smithi146 ceph-mon[35807]: pgmap v8500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:53 smithi076 ceph-mon[35401]: pgmap v8500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:55 smithi040 ceph-mon[32397]: pgmap v8501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:55 smithi146 ceph-mon[35807]: pgmap v8501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:55 smithi076 ceph-mon[35401]: pgmap v8501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:45:57.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11563.289553 secs 2024-07-26T16:45:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11563.289553 secs 2024-07-26T16:45:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11563.289553 secs 2024-07-26T16:45:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:57 smithi040 ceph-mon[32397]: pgmap v8502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:57 smithi146 ceph-mon[35807]: pgmap v8502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:45:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:57 smithi076 ceph-mon[35401]: pgmap v8502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:45:59 smithi040 ceph-mon[32397]: pgmap v8503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:45:59 smithi146 ceph-mon[35807]: pgmap v8503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:45:59 smithi076 ceph-mon[35401]: pgmap v8503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:01 smithi040 ceph-mon[32397]: pgmap v8504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:02.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11568.289685 secs 2024-07-26T16:46:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:01 smithi146 ceph-mon[35807]: pgmap v8504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11568.289685 secs 2024-07-26T16:46:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:01 smithi076 ceph-mon[35401]: pgmap v8504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11568.289685 secs 2024-07-26T16:46:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:03 smithi040 ceph-mon[32397]: pgmap v8505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:03 smithi146 ceph-mon[35807]: pgmap v8505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:03 smithi076 ceph-mon[35401]: pgmap v8505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:05 smithi146 ceph-mon[35807]: pgmap v8506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:05 smithi076 ceph-mon[35401]: pgmap v8506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:05 smithi040 ceph-mon[32397]: pgmap v8506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11573.289826 secs 2024-07-26T16:46:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11573.289826 secs 2024-07-26T16:46:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11573.289826 secs 2024-07-26T16:46:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:08 smithi146 ceph-mon[35807]: pgmap v8507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:08 smithi076 ceph-mon[35401]: pgmap v8507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:08 smithi040 ceph-mon[32397]: pgmap v8507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:10 smithi146 ceph-mon[35807]: pgmap v8508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:10 smithi076 ceph-mon[35401]: pgmap v8508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:10 smithi040 ceph-mon[32397]: pgmap v8508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:12 smithi146 ceph-mon[35807]: pgmap v8509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11578.289990 secs 2024-07-26T16:46:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:12 smithi076 ceph-mon[35401]: pgmap v8509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11578.289990 secs 2024-07-26T16:46:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:12 smithi040 ceph-mon[32397]: pgmap v8509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11578.289990 secs 2024-07-26T16:46:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:13 smithi076 ceph-mon[35401]: pgmap v8510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:13 smithi040 ceph-mon[32397]: pgmap v8510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:13 smithi146 ceph-mon[35807]: pgmap v8510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:15.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:15 smithi076 ceph-mon[35401]: pgmap v8511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:15 smithi040 ceph-mon[32397]: pgmap v8511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:15 smithi146 ceph-mon[35807]: pgmap v8511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11583.290156 secs 2024-07-26T16:46:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11583.290156 secs 2024-07-26T16:46:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11583.290156 secs 2024-07-26T16:46:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:17 smithi040 ceph-mon[32397]: pgmap v8512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:17 smithi146 ceph-mon[35807]: pgmap v8512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:17 smithi076 ceph-mon[35401]: pgmap v8512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:19 smithi040 ceph-mon[32397]: pgmap v8513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:19 smithi146 ceph-mon[35807]: pgmap v8513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:19 smithi076 ceph-mon[35401]: pgmap v8513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:21 smithi040 ceph-mon[32397]: pgmap v8514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:21.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11588.290314 secs 2024-07-26T16:46:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:21 smithi146 ceph-mon[35807]: pgmap v8514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11588.290314 secs 2024-07-26T16:46:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:21 smithi076 ceph-mon[35401]: pgmap v8514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11588.290314 secs 2024-07-26T16:46:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:23 smithi040 ceph-mon[32397]: pgmap v8515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:23 smithi146 ceph-mon[35807]: pgmap v8515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:23 smithi076 ceph-mon[35401]: pgmap v8515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:25 smithi040 ceph-mon[32397]: pgmap v8516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:25 smithi146 ceph-mon[35807]: pgmap v8516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:25 smithi076 ceph-mon[35401]: pgmap v8516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11593.290447 secs 2024-07-26T16:46:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11593.290447 secs 2024-07-26T16:46:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11593.290447 secs 2024-07-26T16:46:27.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:27 smithi146 ceph-mon[35807]: pgmap v8517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:27 smithi040 ceph-mon[32397]: pgmap v8517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:27 smithi076 ceph-mon[35401]: pgmap v8517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:29 smithi040 ceph-mon[32397]: pgmap v8518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:29 smithi146 ceph-mon[35807]: pgmap v8518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:29 smithi076 ceph-mon[35401]: pgmap v8518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:31 smithi040 ceph-mon[32397]: pgmap v8519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:31.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11598.290548 secs 2024-07-26T16:46:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:31 smithi146 ceph-mon[35807]: pgmap v8519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11598.290548 secs 2024-07-26T16:46:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:31 smithi076 ceph-mon[35401]: pgmap v8519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11598.290548 secs 2024-07-26T16:46:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:33 smithi040 ceph-mon[32397]: pgmap v8520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:33 smithi146 ceph-mon[35807]: pgmap v8520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:33 smithi076 ceph-mon[35401]: pgmap v8520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:35 smithi040 ceph-mon[32397]: pgmap v8521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:35 smithi146 ceph-mon[35807]: pgmap v8521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:35 smithi076 ceph-mon[35401]: pgmap v8521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11603.290682 secs 2024-07-26T16:46:36.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11603.290682 secs 2024-07-26T16:46:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11603.290682 secs 2024-07-26T16:46:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:37 smithi040 ceph-mon[32397]: pgmap v8522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:38.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:37 smithi146 ceph-mon[35807]: pgmap v8522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:37 smithi076 ceph-mon[35401]: pgmap v8522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:39 smithi040 ceph-mon[32397]: pgmap v8523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:39 smithi146 ceph-mon[35807]: pgmap v8523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:39 smithi076 ceph-mon[35401]: pgmap v8523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:41 smithi040 ceph-mon[32397]: pgmap v8524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:41.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11608.290819 secs 2024-07-26T16:46:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:41 smithi146 ceph-mon[35807]: pgmap v8524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11608.290819 secs 2024-07-26T16:46:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:41 smithi076 ceph-mon[35401]: pgmap v8524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11608.290819 secs 2024-07-26T16:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:43 smithi040 ceph-mon[32397]: pgmap v8525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:43 smithi146 ceph-mon[35807]: pgmap v8525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:44.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:43 smithi076 ceph-mon[35401]: pgmap v8525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:45 smithi040 ceph-mon[32397]: pgmap v8526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:45 smithi146 ceph-mon[35807]: pgmap v8526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:45 smithi076 ceph-mon[35401]: pgmap v8526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11613.290950 secs 2024-07-26T16:46:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11613.290950 secs 2024-07-26T16:46:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11613.290950 secs 2024-07-26T16:46:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:47 smithi040 ceph-mon[32397]: pgmap v8527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:47 smithi146 ceph-mon[35807]: pgmap v8527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:47 smithi076 ceph-mon[35401]: pgmap v8527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:49 smithi040 ceph-mon[32397]: pgmap v8528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:49 smithi146 ceph-mon[35807]: pgmap v8528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:49 smithi076 ceph-mon[35401]: pgmap v8528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:51 smithi146 ceph-mon[35807]: pgmap v8529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11618.291092 secs 2024-07-26T16:46:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:51 smithi076 ceph-mon[35401]: pgmap v8529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11618.291092 secs 2024-07-26T16:46:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:51 smithi040 ceph-mon[32397]: pgmap v8529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11618.291092 secs 2024-07-26T16:46:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:53 smithi146 ceph-mon[35807]: pgmap v8530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:53 smithi076 ceph-mon[35401]: pgmap v8530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:53 smithi040 ceph-mon[32397]: pgmap v8530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:55 smithi146 ceph-mon[35807]: pgmap v8531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:55 smithi076 ceph-mon[35401]: pgmap v8531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:55 smithi040 ceph-mon[32397]: pgmap v8531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:46:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11623.291225 secs 2024-07-26T16:46:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11623.291225 secs 2024-07-26T16:46:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11623.291225 secs 2024-07-26T16:46:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:57 smithi146 ceph-mon[35807]: pgmap v8532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:57 smithi076 ceph-mon[35401]: pgmap v8532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:46:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:57 smithi040 ceph-mon[32397]: pgmap v8532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:46:59 smithi146 ceph-mon[35807]: pgmap v8533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:46:59 smithi076 ceph-mon[35401]: pgmap v8533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:46:59 smithi040 ceph-mon[32397]: pgmap v8533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:01 smithi146 ceph-mon[35807]: pgmap v8534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11628.291361 secs 2024-07-26T16:47:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:01 smithi076 ceph-mon[35401]: pgmap v8534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11628.291361 secs 2024-07-26T16:47:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:01 smithi040 ceph-mon[32397]: pgmap v8534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11628.291361 secs 2024-07-26T16:47:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:03 smithi146 ceph-mon[35807]: pgmap v8535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:03 smithi076 ceph-mon[35401]: pgmap v8535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:03 smithi040 ceph-mon[32397]: pgmap v8535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:05 smithi146 ceph-mon[35807]: pgmap v8536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:05 smithi076 ceph-mon[35401]: pgmap v8536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:06.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:05 smithi040 ceph-mon[32397]: pgmap v8536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11633.291451 secs 2024-07-26T16:47:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11633.291451 secs 2024-07-26T16:47:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11633.291451 secs 2024-07-26T16:47:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:07 smithi146 ceph-mon[35807]: pgmap v8537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:07 smithi076 ceph-mon[35401]: pgmap v8537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:07 smithi040 ceph-mon[32397]: pgmap v8537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:09 smithi076 ceph-mon[35401]: pgmap v8538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:09 smithi040 ceph-mon[32397]: pgmap v8538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:09 smithi146 ceph-mon[35807]: pgmap v8538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:11 smithi146 ceph-mon[35807]: pgmap v8539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11638.291551 secs 2024-07-26T16:47:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:11 smithi076 ceph-mon[35401]: pgmap v8539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11638.291551 secs 2024-07-26T16:47:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:11 smithi040 ceph-mon[32397]: pgmap v8539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11638.291551 secs 2024-07-26T16:47:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:13 smithi146 ceph-mon[35807]: pgmap v8540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:13 smithi076 ceph-mon[35401]: pgmap v8540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:13 smithi040 ceph-mon[32397]: pgmap v8540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:16 smithi146 ceph-mon[35807]: pgmap v8541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:16 smithi076 ceph-mon[35401]: pgmap v8541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:16 smithi040 ceph-mon[32397]: pgmap v8541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11643.291622 secs 2024-07-26T16:47:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11643.291622 secs 2024-07-26T16:47:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11643.291622 secs 2024-07-26T16:47:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:18 smithi146 ceph-mon[35807]: pgmap v8542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:18 smithi076 ceph-mon[35401]: pgmap v8542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:18 smithi040 ceph-mon[32397]: pgmap v8542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:20 smithi146 ceph-mon[35807]: pgmap v8543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:20 smithi076 ceph-mon[35401]: pgmap v8543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:20 smithi040 ceph-mon[32397]: pgmap v8543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:21 smithi040 ceph-mon[32397]: pgmap v8544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:21 smithi146 ceph-mon[35807]: pgmap v8544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:21 smithi076 ceph-mon[35401]: pgmap v8544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11648.291797 secs 2024-07-26T16:47:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11648.291797 secs 2024-07-26T16:47:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11648.291797 secs 2024-07-26T16:47:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:23 smithi040 ceph-mon[32397]: pgmap v8545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:23 smithi146 ceph-mon[35807]: pgmap v8545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:23 smithi076 ceph-mon[35401]: pgmap v8545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:25 smithi040 ceph-mon[32397]: pgmap v8546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:25 smithi146 ceph-mon[35807]: pgmap v8546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:25 smithi076 ceph-mon[35401]: pgmap v8546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11653.291944 secs 2024-07-26T16:47:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11653.291944 secs 2024-07-26T16:47:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11653.291944 secs 2024-07-26T16:47:27.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:27 smithi146 ceph-mon[35807]: pgmap v8547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:27 smithi040 ceph-mon[32397]: pgmap v8547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:27 smithi076 ceph-mon[35401]: pgmap v8547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:29 smithi040 ceph-mon[32397]: pgmap v8548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:29 smithi146 ceph-mon[35807]: pgmap v8548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:29 smithi076 ceph-mon[35401]: pgmap v8548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:31 smithi040 ceph-mon[32397]: pgmap v8549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:31.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11658.292087 secs 2024-07-26T16:47:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:31 smithi146 ceph-mon[35807]: pgmap v8549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11658.292087 secs 2024-07-26T16:47:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:31 smithi076 ceph-mon[35401]: pgmap v8549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11658.292087 secs 2024-07-26T16:47:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:33 smithi040 ceph-mon[32397]: pgmap v8550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:33 smithi146 ceph-mon[35807]: pgmap v8550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:33 smithi076 ceph-mon[35401]: pgmap v8550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:35 smithi040 ceph-mon[32397]: pgmap v8551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:36.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:35 smithi146 ceph-mon[35807]: pgmap v8551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:35 smithi076 ceph-mon[35401]: pgmap v8551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11663.292249 secs 2024-07-26T16:47:36.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11663.292249 secs 2024-07-26T16:47:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11663.292249 secs 2024-07-26T16:47:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:37 smithi040 ceph-mon[32397]: pgmap v8552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:37 smithi146 ceph-mon[35807]: pgmap v8552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:38.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:37 smithi076 ceph-mon[35401]: pgmap v8552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:39 smithi040 ceph-mon[32397]: pgmap v8553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:39 smithi146 ceph-mon[35807]: pgmap v8553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:39 smithi076 ceph-mon[35401]: pgmap v8553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:41 smithi040 ceph-mon[32397]: pgmap v8554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:41.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11668.292373 secs 2024-07-26T16:47:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:41 smithi146 ceph-mon[35807]: pgmap v8554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11668.292373 secs 2024-07-26T16:47:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:41 smithi076 ceph-mon[35401]: pgmap v8554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11668.292373 secs 2024-07-26T16:47:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:43 smithi040 ceph-mon[32397]: pgmap v8555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:43 smithi146 ceph-mon[35807]: pgmap v8555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:43 smithi076 ceph-mon[35401]: pgmap v8555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:45 smithi040 ceph-mon[32397]: pgmap v8556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:45 smithi146 ceph-mon[35807]: pgmap v8556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:45 smithi076 ceph-mon[35401]: pgmap v8556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11673.292469 secs 2024-07-26T16:47:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11673.292469 secs 2024-07-26T16:47:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11673.292469 secs 2024-07-26T16:47:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:47 smithi146 ceph-mon[35807]: pgmap v8557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:47 smithi076 ceph-mon[35401]: pgmap v8557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:47 smithi040 ceph-mon[32397]: pgmap v8557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:49 smithi146 ceph-mon[35807]: pgmap v8558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:49 smithi076 ceph-mon[35401]: pgmap v8558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:49 smithi040 ceph-mon[32397]: pgmap v8558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:47:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:51 smithi146 ceph-mon[35807]: pgmap v8559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11678.292610 secs 2024-07-26T16:47:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:51 smithi076 ceph-mon[35401]: pgmap v8559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11678.292610 secs 2024-07-26T16:47:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:51 smithi040 ceph-mon[32397]: pgmap v8559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11678.292610 secs 2024-07-26T16:47:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:53 smithi146 ceph-mon[35807]: pgmap v8560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:53 smithi076 ceph-mon[35401]: pgmap v8560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:53 smithi040 ceph-mon[32397]: pgmap v8560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:55 smithi146 ceph-mon[35807]: pgmap v8561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:55 smithi076 ceph-mon[35401]: pgmap v8561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:55 smithi040 ceph-mon[32397]: pgmap v8561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:47:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11683.292749 secs 2024-07-26T16:47:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11683.292749 secs 2024-07-26T16:47:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11683.292749 secs 2024-07-26T16:47:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:57 smithi146 ceph-mon[35807]: pgmap v8562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:57 smithi076 ceph-mon[35401]: pgmap v8562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:47:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:57 smithi040 ceph-mon[32397]: pgmap v8562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:47:59 smithi146 ceph-mon[35807]: pgmap v8563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:47:59 smithi076 ceph-mon[35401]: pgmap v8563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:47:59 smithi040 ceph-mon[32397]: pgmap v8563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:01 smithi146 ceph-mon[35807]: pgmap v8564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11688.292897 secs 2024-07-26T16:48:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:01 smithi076 ceph-mon[35401]: pgmap v8564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11688.292897 secs 2024-07-26T16:48:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:01 smithi040 ceph-mon[32397]: pgmap v8564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11688.292897 secs 2024-07-26T16:48:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:03 smithi146 ceph-mon[35807]: pgmap v8565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:03 smithi076 ceph-mon[35401]: pgmap v8565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:03 smithi040 ceph-mon[32397]: pgmap v8565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:05 smithi146 ceph-mon[35807]: pgmap v8566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:05 smithi076 ceph-mon[35401]: pgmap v8566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:05 smithi040 ceph-mon[32397]: pgmap v8566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11693.293035 secs 2024-07-26T16:48:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11693.293035 secs 2024-07-26T16:48:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11693.293035 secs 2024-07-26T16:48:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:07 smithi076 ceph-mon[35401]: pgmap v8567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:07 smithi040 ceph-mon[32397]: pgmap v8567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:07 smithi146 ceph-mon[35807]: pgmap v8567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:09 smithi040 ceph-mon[32397]: pgmap v8568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:09 smithi146 ceph-mon[35807]: pgmap v8568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:09 smithi076 ceph-mon[35401]: pgmap v8568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:11 smithi040 ceph-mon[32397]: pgmap v8569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11698.293134 secs 2024-07-26T16:48:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:11 smithi146 ceph-mon[35807]: pgmap v8569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11698.293134 secs 2024-07-26T16:48:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:11 smithi076 ceph-mon[35401]: pgmap v8569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11698.293134 secs 2024-07-26T16:48:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:13 smithi040 ceph-mon[32397]: pgmap v8570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:13 smithi146 ceph-mon[35807]: pgmap v8570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:13 smithi076 ceph-mon[35401]: pgmap v8570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:15 smithi040 ceph-mon[32397]: pgmap v8571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:15 smithi146 ceph-mon[35807]: pgmap v8571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:15 smithi076 ceph-mon[35401]: pgmap v8571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11703.293318 secs 2024-07-26T16:48:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11703.293318 secs 2024-07-26T16:48:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11703.293318 secs 2024-07-26T16:48:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:17 smithi040 ceph-mon[32397]: pgmap v8572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:17 smithi146 ceph-mon[35807]: pgmap v8572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:17 smithi076 ceph-mon[35401]: pgmap v8572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:19 smithi040 ceph-mon[32397]: pgmap v8573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:19 smithi146 ceph-mon[35807]: pgmap v8573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:19 smithi076 ceph-mon[35401]: pgmap v8573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:21 smithi040 ceph-mon[32397]: pgmap v8574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11708.293459 secs 2024-07-26T16:48:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:21 smithi146 ceph-mon[35807]: pgmap v8574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11708.293459 secs 2024-07-26T16:48:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:21 smithi076 ceph-mon[35401]: pgmap v8574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11708.293459 secs 2024-07-26T16:48:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:23 smithi040 ceph-mon[32397]: pgmap v8575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:23 smithi146 ceph-mon[35807]: pgmap v8575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:23 smithi076 ceph-mon[35401]: pgmap v8575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:25 smithi040 ceph-mon[32397]: pgmap v8576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:25 smithi146 ceph-mon[35807]: pgmap v8576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:25 smithi076 ceph-mon[35401]: pgmap v8576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:27.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11713.293585 secs 2024-07-26T16:48:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11713.293585 secs 2024-07-26T16:48:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11713.293585 secs 2024-07-26T16:48:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:27 smithi040 ceph-mon[32397]: pgmap v8577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:27 smithi146 ceph-mon[35807]: pgmap v8577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:27 smithi076 ceph-mon[35401]: pgmap v8577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:29 smithi040 ceph-mon[32397]: pgmap v8578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:29 smithi146 ceph-mon[35807]: pgmap v8578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:29 smithi076 ceph-mon[35401]: pgmap v8578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:31 smithi040 ceph-mon[32397]: pgmap v8579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11718.293726 secs 2024-07-26T16:48:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:31 smithi146 ceph-mon[35807]: pgmap v8579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11718.293726 secs 2024-07-26T16:48:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:31 smithi076 ceph-mon[35401]: pgmap v8579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11718.293726 secs 2024-07-26T16:48:34.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:33 smithi040 ceph-mon[32397]: pgmap v8580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:33 smithi146 ceph-mon[35807]: pgmap v8580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:33 smithi076 ceph-mon[35401]: pgmap v8580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:35 smithi040 ceph-mon[32397]: pgmap v8581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:35 smithi146 ceph-mon[35807]: pgmap v8581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:35 smithi076 ceph-mon[35401]: pgmap v8581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11723.293862 secs 2024-07-26T16:48:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11723.293862 secs 2024-07-26T16:48:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11723.293862 secs 2024-07-26T16:48:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:37 smithi040 ceph-mon[32397]: pgmap v8582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:37 smithi146 ceph-mon[35807]: pgmap v8582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:37 smithi076 ceph-mon[35401]: pgmap v8582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:39 smithi040 ceph-mon[32397]: pgmap v8583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:39 smithi146 ceph-mon[35807]: pgmap v8583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:39 smithi076 ceph-mon[35401]: pgmap v8583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:41 smithi040 ceph-mon[32397]: pgmap v8584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11728.293948 secs 2024-07-26T16:48:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:41 smithi146 ceph-mon[35807]: pgmap v8584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11728.293948 secs 2024-07-26T16:48:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:41 smithi076 ceph-mon[35401]: pgmap v8584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11728.293948 secs 2024-07-26T16:48:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:43 smithi146 ceph-mon[35807]: pgmap v8585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:43 smithi076 ceph-mon[35401]: pgmap v8585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:43 smithi040 ceph-mon[32397]: pgmap v8585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:45 smithi146 ceph-mon[35807]: pgmap v8586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:45 smithi076 ceph-mon[35401]: pgmap v8586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:45 smithi040 ceph-mon[32397]: pgmap v8586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11733.294108 secs 2024-07-26T16:48:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11733.294108 secs 2024-07-26T16:48:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11733.294108 secs 2024-07-26T16:48:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:48 smithi146 ceph-mon[35807]: pgmap v8587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:48 smithi076 ceph-mon[35401]: pgmap v8587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:48 smithi040 ceph-mon[32397]: pgmap v8587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:50 smithi146 ceph-mon[35807]: pgmap v8588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:50 smithi076 ceph-mon[35401]: pgmap v8588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:50 smithi040 ceph-mon[32397]: pgmap v8588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:52 smithi146 ceph-mon[35807]: pgmap v8589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:48:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11738.294333 secs 2024-07-26T16:48:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:52 smithi076 ceph-mon[35401]: pgmap v8589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:48:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11738.294333 secs 2024-07-26T16:48:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:52 smithi040 ceph-mon[32397]: pgmap v8589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:48:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11738.294333 secs 2024-07-26T16:48:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:54 smithi146 ceph-mon[35807]: pgmap v8590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:54 smithi076 ceph-mon[35401]: pgmap v8590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:54 smithi040 ceph-mon[32397]: pgmap v8590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:48:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:56 smithi146 ceph-mon[35807]: pgmap v8591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:56 smithi076 ceph-mon[35401]: pgmap v8591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:56 smithi040 ceph-mon[32397]: pgmap v8591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:48:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11743.294428 secs 2024-07-26T16:48:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11743.294428 secs 2024-07-26T16:48:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11743.294428 secs 2024-07-26T16:48:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:58 smithi146 ceph-mon[35807]: pgmap v8592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:58 smithi076 ceph-mon[35401]: pgmap v8592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:58 smithi040 ceph-mon[32397]: pgmap v8592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:48:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:48:59 smithi076 ceph-mon[35401]: pgmap v8593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:48:59 smithi040 ceph-mon[32397]: pgmap v8593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:48:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:48:59 smithi146 ceph-mon[35807]: pgmap v8593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:01 smithi040 ceph-mon[32397]: pgmap v8594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11748.294602 secs 2024-07-26T16:49:02.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:01 smithi146 ceph-mon[35807]: pgmap v8594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:02.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11748.294602 secs 2024-07-26T16:49:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:01 smithi076 ceph-mon[35401]: pgmap v8594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11748.294602 secs 2024-07-26T16:49:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:03 smithi040 ceph-mon[32397]: pgmap v8595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:03 smithi146 ceph-mon[35807]: pgmap v8595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:03 smithi076 ceph-mon[35401]: pgmap v8595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:05 smithi040 ceph-mon[32397]: pgmap v8596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:05 smithi146 ceph-mon[35807]: pgmap v8596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:05 smithi076 ceph-mon[35401]: pgmap v8596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11753.294733 secs 2024-07-26T16:49:06.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11753.294733 secs 2024-07-26T16:49:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11753.294733 secs 2024-07-26T16:49:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:07 smithi040 ceph-mon[32397]: pgmap v8597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:07 smithi146 ceph-mon[35807]: pgmap v8597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:07 smithi076 ceph-mon[35401]: pgmap v8597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:09 smithi040 ceph-mon[32397]: pgmap v8598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:09 smithi146 ceph-mon[35807]: pgmap v8598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:09 smithi076 ceph-mon[35401]: pgmap v8598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:11 smithi040 ceph-mon[32397]: pgmap v8599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11758.294870 secs 2024-07-26T16:49:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:11 smithi146 ceph-mon[35807]: pgmap v8599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11758.294870 secs 2024-07-26T16:49:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:11 smithi076 ceph-mon[35401]: pgmap v8599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:12.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11758.294870 secs 2024-07-26T16:49:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:13 smithi040 ceph-mon[32397]: pgmap v8600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:13 smithi146 ceph-mon[35807]: pgmap v8600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:13 smithi076 ceph-mon[35401]: pgmap v8600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:15 smithi146 ceph-mon[35807]: pgmap v8601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:15 smithi076 ceph-mon[35401]: pgmap v8601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:15 smithi040 ceph-mon[32397]: pgmap v8601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11763.295019 secs 2024-07-26T16:49:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11763.295019 secs 2024-07-26T16:49:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11763.295019 secs 2024-07-26T16:49:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:17 smithi146 ceph-mon[35807]: pgmap v8602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:17 smithi076 ceph-mon[35401]: pgmap v8602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:17 smithi040 ceph-mon[32397]: pgmap v8602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:19 smithi146 ceph-mon[35807]: pgmap v8603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:19 smithi076 ceph-mon[35401]: pgmap v8603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:19 smithi040 ceph-mon[32397]: pgmap v8603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:21.789 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:21 smithi076 ceph-mon[35401]: pgmap v8604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:49:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:21 smithi146 ceph-mon[35807]: pgmap v8604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:49:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11768.295168 secs 2024-07-26T16:49:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11768.295168 secs 2024-07-26T16:49:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:21 smithi040 ceph-mon[32397]: pgmap v8604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:49:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11768.295168 secs 2024-07-26T16:49:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:23 smithi146 ceph-mon[35807]: pgmap v8605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:23 smithi076 ceph-mon[35401]: pgmap v8605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:23 smithi040 ceph-mon[32397]: pgmap v8605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:25 smithi146 ceph-mon[35807]: pgmap v8606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:25 smithi076 ceph-mon[35401]: pgmap v8606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:25 smithi040 ceph-mon[32397]: pgmap v8606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11773.295306 secs 2024-07-26T16:49:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11773.295306 secs 2024-07-26T16:49:27.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11773.295306 secs 2024-07-26T16:49:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:27 smithi146 ceph-mon[35807]: pgmap v8607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:27 smithi076 ceph-mon[35401]: pgmap v8607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:27 smithi040 ceph-mon[32397]: pgmap v8607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:29 smithi146 ceph-mon[35807]: pgmap v8608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:29 smithi076 ceph-mon[35401]: pgmap v8608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:29 smithi040 ceph-mon[32397]: pgmap v8608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:31 smithi146 ceph-mon[35807]: pgmap v8609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11778.295444 secs 2024-07-26T16:49:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:31 smithi076 ceph-mon[35401]: pgmap v8609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:32.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11778.295444 secs 2024-07-26T16:49:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:31 smithi040 ceph-mon[32397]: pgmap v8609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11778.295444 secs 2024-07-26T16:49:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:33 smithi076 ceph-mon[35401]: pgmap v8610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:33 smithi040 ceph-mon[32397]: pgmap v8610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:33 smithi146 ceph-mon[35807]: pgmap v8610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:35 smithi076 ceph-mon[35401]: pgmap v8611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:35 smithi040 ceph-mon[32397]: pgmap v8611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:35 smithi146 ceph-mon[35807]: pgmap v8611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11783.295578 secs 2024-07-26T16:49:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11783.295578 secs 2024-07-26T16:49:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11783.295578 secs 2024-07-26T16:49:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:37 smithi040 ceph-mon[32397]: pgmap v8612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:37 smithi146 ceph-mon[35807]: pgmap v8612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:37 smithi076 ceph-mon[35401]: pgmap v8612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:39 smithi040 ceph-mon[32397]: pgmap v8613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:39 smithi146 ceph-mon[35807]: pgmap v8613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:39 smithi076 ceph-mon[35401]: pgmap v8613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:42 smithi146 ceph-mon[35807]: pgmap v8614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:42.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11788.295715 secs 2024-07-26T16:49:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:42 smithi076 ceph-mon[35401]: pgmap v8614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11788.295715 secs 2024-07-26T16:49:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:42 smithi040 ceph-mon[32397]: pgmap v8614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11788.295715 secs 2024-07-26T16:49:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:43 smithi076 ceph-mon[35401]: pgmap v8615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:43 smithi040 ceph-mon[32397]: pgmap v8615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:43 smithi146 ceph-mon[35807]: pgmap v8615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:45 smithi040 ceph-mon[32397]: pgmap v8616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:45 smithi146 ceph-mon[35807]: pgmap v8616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:45 smithi076 ceph-mon[35401]: pgmap v8616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11793.295885 secs 2024-07-26T16:49:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11793.295885 secs 2024-07-26T16:49:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11793.295885 secs 2024-07-26T16:49:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:47 smithi040 ceph-mon[32397]: pgmap v8617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:47 smithi146 ceph-mon[35807]: pgmap v8617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:47 smithi076 ceph-mon[35401]: pgmap v8617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:49 smithi146 ceph-mon[35807]: pgmap v8618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:49 smithi076 ceph-mon[35401]: pgmap v8618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:49 smithi040 ceph-mon[32397]: pgmap v8618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:49:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:51 smithi146 ceph-mon[35807]: pgmap v8619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11798.296027 secs 2024-07-26T16:49:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:51 smithi076 ceph-mon[35401]: pgmap v8619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11798.296027 secs 2024-07-26T16:49:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:51 smithi040 ceph-mon[32397]: pgmap v8619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:52.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11798.296027 secs 2024-07-26T16:49:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:53 smithi146 ceph-mon[35807]: pgmap v8620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:54.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:53 smithi076 ceph-mon[35401]: pgmap v8620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:53 smithi040 ceph-mon[32397]: pgmap v8620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:55 smithi146 ceph-mon[35807]: pgmap v8621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:55 smithi076 ceph-mon[35401]: pgmap v8621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:55 smithi040 ceph-mon[32397]: pgmap v8621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:49:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11803.296162 secs 2024-07-26T16:49:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11803.296162 secs 2024-07-26T16:49:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11803.296162 secs 2024-07-26T16:49:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:57 smithi146 ceph-mon[35807]: pgmap v8622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:57 smithi076 ceph-mon[35401]: pgmap v8622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:49:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:57 smithi040 ceph-mon[32397]: pgmap v8622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:49:59 smithi146 ceph-mon[35807]: pgmap v8623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:49:59 smithi076 ceph-mon[35401]: pgmap v8623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:49:59 smithi040 ceph-mon[32397]: pgmap v8623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:50:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:50:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T16:50:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:01 smithi146 ceph-mon[35807]: pgmap v8624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11808.296316 secs 2024-07-26T16:50:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:01 smithi076 ceph-mon[35401]: pgmap v8624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11808.296316 secs 2024-07-26T16:50:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:01 smithi040 ceph-mon[32397]: pgmap v8624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11808.296316 secs 2024-07-26T16:50:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:03 smithi146 ceph-mon[35807]: pgmap v8625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:03 smithi076 ceph-mon[35401]: pgmap v8625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:03 smithi040 ceph-mon[32397]: pgmap v8625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:05 smithi146 ceph-mon[35807]: pgmap v8626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:05 smithi076 ceph-mon[35401]: pgmap v8626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:05 smithi040 ceph-mon[32397]: pgmap v8626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11813.296449 secs 2024-07-26T16:50:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11813.296449 secs 2024-07-26T16:50:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11813.296449 secs 2024-07-26T16:50:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:07 smithi076 ceph-mon[35401]: pgmap v8627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:07 smithi040 ceph-mon[32397]: pgmap v8627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:07 smithi146 ceph-mon[35807]: pgmap v8627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:09 smithi040 ceph-mon[32397]: pgmap v8628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:09 smithi146 ceph-mon[35807]: pgmap v8628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:09 smithi076 ceph-mon[35401]: pgmap v8628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:11 smithi040 ceph-mon[32397]: pgmap v8629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11818.296588 secs 2024-07-26T16:50:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:11 smithi146 ceph-mon[35807]: pgmap v8629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11818.296588 secs 2024-07-26T16:50:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:11 smithi076 ceph-mon[35401]: pgmap v8629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11818.296588 secs 2024-07-26T16:50:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:13 smithi040 ceph-mon[32397]: pgmap v8630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:13 smithi146 ceph-mon[35807]: pgmap v8630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:13 smithi076 ceph-mon[35401]: pgmap v8630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:15 smithi040 ceph-mon[32397]: pgmap v8631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:15 smithi146 ceph-mon[35807]: pgmap v8631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:15 smithi076 ceph-mon[35401]: pgmap v8631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11823.296732 secs 2024-07-26T16:50:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11823.296732 secs 2024-07-26T16:50:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11823.296732 secs 2024-07-26T16:50:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:17 smithi040 ceph-mon[32397]: pgmap v8632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:17 smithi146 ceph-mon[35807]: pgmap v8632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:17 smithi076 ceph-mon[35401]: pgmap v8632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:19 smithi040 ceph-mon[32397]: pgmap v8633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:19 smithi146 ceph-mon[35807]: pgmap v8633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:19 smithi076 ceph-mon[35401]: pgmap v8633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:21 smithi040 ceph-mon[32397]: pgmap v8634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11828.296870 secs 2024-07-26T16:50:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:21 smithi146 ceph-mon[35807]: pgmap v8634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11828.296870 secs 2024-07-26T16:50:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:21 smithi076 ceph-mon[35401]: pgmap v8634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11828.296870 secs 2024-07-26T16:50:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:23 smithi040 ceph-mon[32397]: pgmap v8635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:23 smithi146 ceph-mon[35807]: pgmap v8635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:23 smithi076 ceph-mon[35401]: pgmap v8635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:25 smithi040 ceph-mon[32397]: pgmap v8636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:25 smithi146 ceph-mon[35807]: pgmap v8636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:25 smithi076 ceph-mon[35401]: pgmap v8636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:27.226 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11833.297006 secs 2024-07-26T16:50:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11833.297006 secs 2024-07-26T16:50:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11833.297006 secs 2024-07-26T16:50:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:27 smithi040 ceph-mon[32397]: pgmap v8637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:27 smithi146 ceph-mon[35807]: pgmap v8637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:27 smithi076 ceph-mon[35401]: pgmap v8637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:29 smithi040 ceph-mon[32397]: pgmap v8638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:29 smithi146 ceph-mon[35807]: pgmap v8638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:29 smithi076 ceph-mon[35401]: pgmap v8638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:31 smithi040 ceph-mon[32397]: pgmap v8639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11838.297165 secs 2024-07-26T16:50:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:31 smithi146 ceph-mon[35807]: pgmap v8639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11838.297165 secs 2024-07-26T16:50:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:31 smithi076 ceph-mon[35401]: pgmap v8639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11838.297165 secs 2024-07-26T16:50:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:33 smithi040 ceph-mon[32397]: pgmap v8640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:33 smithi146 ceph-mon[35807]: pgmap v8640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:33 smithi076 ceph-mon[35401]: pgmap v8640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:35 smithi040 ceph-mon[32397]: pgmap v8641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:35 smithi146 ceph-mon[35807]: pgmap v8641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:35 smithi076 ceph-mon[35401]: pgmap v8641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11843.297317 secs 2024-07-26T16:50:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11843.297317 secs 2024-07-26T16:50:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11843.297317 secs 2024-07-26T16:50:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:37 smithi040 ceph-mon[32397]: pgmap v8642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:37 smithi146 ceph-mon[35807]: pgmap v8642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:37 smithi076 ceph-mon[35401]: pgmap v8642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:39 smithi040 ceph-mon[32397]: pgmap v8643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:39 smithi146 ceph-mon[35807]: pgmap v8643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:39 smithi076 ceph-mon[35401]: pgmap v8643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:41 smithi040 ceph-mon[32397]: pgmap v8644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11848.297405 secs 2024-07-26T16:50:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:41 smithi146 ceph-mon[35807]: pgmap v8644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11848.297405 secs 2024-07-26T16:50:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:41 smithi076 ceph-mon[35401]: pgmap v8644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11848.297405 secs 2024-07-26T16:50:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:43 smithi040 ceph-mon[32397]: pgmap v8645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:43 smithi146 ceph-mon[35807]: pgmap v8645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:43 smithi076 ceph-mon[35401]: pgmap v8645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:45 smithi146 ceph-mon[35807]: pgmap v8646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:45 smithi076 ceph-mon[35401]: pgmap v8646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:45 smithi040 ceph-mon[32397]: pgmap v8646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11853.297499 secs 2024-07-26T16:50:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11853.297499 secs 2024-07-26T16:50:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11853.297499 secs 2024-07-26T16:50:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:48 smithi146 ceph-mon[35807]: pgmap v8647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:48 smithi076 ceph-mon[35401]: pgmap v8647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:48 smithi040 ceph-mon[32397]: pgmap v8647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:50 smithi146 ceph-mon[35807]: pgmap v8648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:50 smithi076 ceph-mon[35401]: pgmap v8648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:50 smithi040 ceph-mon[32397]: pgmap v8648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:50:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:52 smithi146 ceph-mon[35807]: pgmap v8649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11858.297585 secs 2024-07-26T16:50:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:52 smithi076 ceph-mon[35401]: pgmap v8649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11858.297585 secs 2024-07-26T16:50:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:52 smithi040 ceph-mon[32397]: pgmap v8649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11858.297585 secs 2024-07-26T16:50:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:54 smithi146 ceph-mon[35807]: pgmap v8650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:54 smithi076 ceph-mon[35401]: pgmap v8650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:54 smithi040 ceph-mon[32397]: pgmap v8650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:56 smithi146 ceph-mon[35807]: pgmap v8651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:56 smithi076 ceph-mon[35401]: pgmap v8651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:56 smithi040 ceph-mon[32397]: pgmap v8651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:50:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11863.297721 secs 2024-07-26T16:50:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11863.297721 secs 2024-07-26T16:50:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11863.297721 secs 2024-07-26T16:50:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:50:58 smithi146 ceph-mon[35807]: pgmap v8652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:50:58 smithi076 ceph-mon[35401]: pgmap v8652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:50:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:50:58 smithi040 ceph-mon[32397]: pgmap v8652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:00 smithi146 ceph-mon[35807]: pgmap v8653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:00 smithi076 ceph-mon[35401]: pgmap v8653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:00 smithi040 ceph-mon[32397]: pgmap v8653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:02 smithi146 ceph-mon[35807]: pgmap v8654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11868.297809 secs 2024-07-26T16:51:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:02 smithi076 ceph-mon[35401]: pgmap v8654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11868.297809 secs 2024-07-26T16:51:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:02 smithi040 ceph-mon[32397]: pgmap v8654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11868.297809 secs 2024-07-26T16:51:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:04 smithi076 ceph-mon[35401]: pgmap v8655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:04 smithi040 ceph-mon[32397]: pgmap v8655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:04 smithi146 ceph-mon[35807]: pgmap v8655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:06 smithi076 ceph-mon[35401]: pgmap v8656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:06 smithi040 ceph-mon[32397]: pgmap v8656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:06 smithi146 ceph-mon[35807]: pgmap v8656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11873.297961 secs 2024-07-26T16:51:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11873.297961 secs 2024-07-26T16:51:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11873.297961 secs 2024-07-26T16:51:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:08 smithi040 ceph-mon[32397]: pgmap v8657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:08 smithi146 ceph-mon[35807]: pgmap v8657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:08 smithi076 ceph-mon[35401]: pgmap v8657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:09 smithi040 ceph-mon[32397]: pgmap v8658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:09 smithi146 ceph-mon[35807]: pgmap v8658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:09 smithi076 ceph-mon[35401]: pgmap v8658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:11 smithi040 ceph-mon[32397]: pgmap v8659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:11 smithi146 ceph-mon[35807]: pgmap v8659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:11 smithi076 ceph-mon[35401]: pgmap v8659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11878.298101 secs 2024-07-26T16:51:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11878.298101 secs 2024-07-26T16:51:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11878.298101 secs 2024-07-26T16:51:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:13 smithi040 ceph-mon[32397]: pgmap v8660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:13 smithi146 ceph-mon[35807]: pgmap v8660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:13 smithi076 ceph-mon[35401]: pgmap v8660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:15 smithi146 ceph-mon[35807]: pgmap v8661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:15 smithi076 ceph-mon[35401]: pgmap v8661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:15 smithi040 ceph-mon[32397]: pgmap v8661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11883.298238 secs 2024-07-26T16:51:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11883.298238 secs 2024-07-26T16:51:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11883.298238 secs 2024-07-26T16:51:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:17 smithi146 ceph-mon[35807]: pgmap v8662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:17 smithi076 ceph-mon[35401]: pgmap v8662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:17 smithi040 ceph-mon[32397]: pgmap v8662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:19 smithi146 ceph-mon[35807]: pgmap v8663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:19 smithi076 ceph-mon[35401]: pgmap v8663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:19 smithi040 ceph-mon[32397]: pgmap v8663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11888.298391 secs 2024-07-26T16:51:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:21 smithi146 ceph-mon[35807]: pgmap v8664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11888.298391 secs 2024-07-26T16:51:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:21 smithi076 ceph-mon[35401]: pgmap v8664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11888.298391 secs 2024-07-26T16:51:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:21 smithi040 ceph-mon[32397]: pgmap v8664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:23 smithi146 ceph-mon[35807]: pgmap v8665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:23 smithi076 ceph-mon[35401]: pgmap v8665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:23 smithi040 ceph-mon[32397]: pgmap v8665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:25 smithi146 ceph-mon[35807]: pgmap v8666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:25 smithi076 ceph-mon[35401]: pgmap v8666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:25 smithi040 ceph-mon[32397]: pgmap v8666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11893.298549 secs 2024-07-26T16:51:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11893.298549 secs 2024-07-26T16:51:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11893.298549 secs 2024-07-26T16:51:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:27 smithi076 ceph-mon[35401]: pgmap v8667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:28.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:27 smithi146 ceph-mon[35807]: pgmap v8667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:27 smithi040 ceph-mon[32397]: pgmap v8667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:29 smithi040 ceph-mon[32397]: pgmap v8668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:29 smithi146 ceph-mon[35807]: pgmap v8668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:29 smithi076 ceph-mon[35401]: pgmap v8668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11898.298688 secs 2024-07-26T16:51:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:31 smithi040 ceph-mon[32397]: pgmap v8669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11898.298688 secs 2024-07-26T16:51:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:31 smithi146 ceph-mon[35807]: pgmap v8669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11898.298688 secs 2024-07-26T16:51:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:31 smithi076 ceph-mon[35401]: pgmap v8669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:33 smithi040 ceph-mon[32397]: pgmap v8670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:33 smithi146 ceph-mon[35807]: pgmap v8670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:33 smithi076 ceph-mon[35401]: pgmap v8670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:36.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:35 smithi076 ceph-mon[35401]: pgmap v8671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:35 smithi040 ceph-mon[32397]: pgmap v8671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:35 smithi146 ceph-mon[35807]: pgmap v8671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11903.298810 secs 2024-07-26T16:51:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11903.298810 secs 2024-07-26T16:51:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11903.298810 secs 2024-07-26T16:51:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:37 smithi040 ceph-mon[32397]: pgmap v8672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:37 smithi146 ceph-mon[35807]: pgmap v8672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:37 smithi076 ceph-mon[35401]: pgmap v8672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:39 smithi040 ceph-mon[32397]: pgmap v8673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:39 smithi146 ceph-mon[35807]: pgmap v8673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:39 smithi076 ceph-mon[35401]: pgmap v8673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11908.298962 secs 2024-07-26T16:51:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:41 smithi040 ceph-mon[32397]: pgmap v8674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11908.298962 secs 2024-07-26T16:51:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:41 smithi146 ceph-mon[35807]: pgmap v8674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11908.298962 secs 2024-07-26T16:51:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:41 smithi076 ceph-mon[35401]: pgmap v8674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:43 smithi040 ceph-mon[32397]: pgmap v8675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:43 smithi146 ceph-mon[35807]: pgmap v8675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:43 smithi076 ceph-mon[35401]: pgmap v8675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:45 smithi040 ceph-mon[32397]: pgmap v8676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:45 smithi146 ceph-mon[35807]: pgmap v8676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:45 smithi076 ceph-mon[35401]: pgmap v8676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11913.299097 secs 2024-07-26T16:51:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11913.299097 secs 2024-07-26T16:51:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11913.299097 secs 2024-07-26T16:51:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:47 smithi040 ceph-mon[32397]: pgmap v8677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:47 smithi146 ceph-mon[35807]: pgmap v8677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:47 smithi076 ceph-mon[35401]: pgmap v8677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:49 smithi040 ceph-mon[32397]: pgmap v8678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:49 smithi146 ceph-mon[35807]: pgmap v8678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:49 smithi076 ceph-mon[35401]: pgmap v8678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:51:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11918.299238 secs 2024-07-26T16:51:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:51 smithi040 ceph-mon[32397]: pgmap v8679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11918.299238 secs 2024-07-26T16:51:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:51 smithi146 ceph-mon[35807]: pgmap v8679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11918.299238 secs 2024-07-26T16:51:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:51 smithi076 ceph-mon[35401]: pgmap v8679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:53 smithi040 ceph-mon[32397]: pgmap v8680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:53 smithi146 ceph-mon[35807]: pgmap v8680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:53 smithi076 ceph-mon[35401]: pgmap v8680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:55 smithi040 ceph-mon[32397]: pgmap v8681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:55 smithi146 ceph-mon[35807]: pgmap v8681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:55 smithi076 ceph-mon[35401]: pgmap v8681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:51:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11923.299376 secs 2024-07-26T16:51:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11923.299376 secs 2024-07-26T16:51:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11923.299376 secs 2024-07-26T16:51:58.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:57 smithi146 ceph-mon[35807]: pgmap v8682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:57 smithi040 ceph-mon[32397]: pgmap v8682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:51:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:57 smithi076 ceph-mon[35401]: pgmap v8682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:51:59 smithi040 ceph-mon[32397]: pgmap v8683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:51:59 smithi146 ceph-mon[35807]: pgmap v8683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:51:59 smithi076 ceph-mon[35401]: pgmap v8683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11928.299510 secs 2024-07-26T16:52:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:01 smithi040 ceph-mon[32397]: pgmap v8684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11928.299510 secs 2024-07-26T16:52:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:01 smithi146 ceph-mon[35807]: pgmap v8684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11928.299510 secs 2024-07-26T16:52:02.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:01 smithi076 ceph-mon[35401]: pgmap v8684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:03 smithi146 ceph-mon[35807]: pgmap v8685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:03 smithi076 ceph-mon[35401]: pgmap v8685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:03 smithi040 ceph-mon[32397]: pgmap v8685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:06.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:05 smithi040 ceph-mon[32397]: pgmap v8686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:05 smithi146 ceph-mon[35807]: pgmap v8686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:05 smithi076 ceph-mon[35401]: pgmap v8686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11933.299664 secs 2024-07-26T16:52:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11933.299664 secs 2024-07-26T16:52:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11933.299664 secs 2024-07-26T16:52:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:08 smithi146 ceph-mon[35807]: pgmap v8687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:08 smithi076 ceph-mon[35401]: pgmap v8687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:08 smithi040 ceph-mon[32397]: pgmap v8687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:10 smithi146 ceph-mon[35807]: pgmap v8688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:10 smithi076 ceph-mon[35401]: pgmap v8688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:10 smithi040 ceph-mon[32397]: pgmap v8688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:11 smithi040 ceph-mon[32397]: pgmap v8689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:11 smithi146 ceph-mon[35807]: pgmap v8689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:11 smithi076 ceph-mon[35401]: pgmap v8689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11938.299830 secs 2024-07-26T16:52:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11938.299830 secs 2024-07-26T16:52:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11938.299830 secs 2024-07-26T16:52:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:13 smithi040 ceph-mon[32397]: pgmap v8690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:13 smithi146 ceph-mon[35807]: pgmap v8690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:13 smithi076 ceph-mon[35401]: pgmap v8690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:15 smithi146 ceph-mon[35807]: pgmap v8691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:15 smithi076 ceph-mon[35401]: pgmap v8691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:15 smithi040 ceph-mon[32397]: pgmap v8691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11943.299966 secs 2024-07-26T16:52:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11943.299966 secs 2024-07-26T16:52:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11943.299966 secs 2024-07-26T16:52:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:17 smithi076 ceph-mon[35401]: pgmap v8692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:17 smithi040 ceph-mon[32397]: pgmap v8692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:17 smithi146 ceph-mon[35807]: pgmap v8692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:19 smithi076 ceph-mon[35401]: pgmap v8693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:19 smithi040 ceph-mon[32397]: pgmap v8693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:19 smithi146 ceph-mon[35807]: pgmap v8693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11948.300105 secs 2024-07-26T16:52:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:21 smithi040 ceph-mon[32397]: pgmap v8694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11948.300105 secs 2024-07-26T16:52:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:21 smithi146 ceph-mon[35807]: pgmap v8694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11948.300105 secs 2024-07-26T16:52:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:21 smithi076 ceph-mon[35401]: pgmap v8694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:23 smithi040 ceph-mon[32397]: pgmap v8695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:23 smithi146 ceph-mon[35807]: pgmap v8695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:23 smithi076 ceph-mon[35401]: pgmap v8695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:25 smithi040 ceph-mon[32397]: pgmap v8696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:25 smithi146 ceph-mon[35807]: pgmap v8696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:25 smithi076 ceph-mon[35401]: pgmap v8696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11953.300189 secs 2024-07-26T16:52:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11953.300189 secs 2024-07-26T16:52:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11953.300189 secs 2024-07-26T16:52:28.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:27 smithi146 ceph-mon[35807]: pgmap v8697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:27 smithi040 ceph-mon[32397]: pgmap v8697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:27 smithi076 ceph-mon[35401]: pgmap v8697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:29 smithi040 ceph-mon[32397]: pgmap v8698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:29 smithi146 ceph-mon[35807]: pgmap v8698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:29 smithi076 ceph-mon[35401]: pgmap v8698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11958.300326 secs 2024-07-26T16:52:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:31 smithi040 ceph-mon[32397]: pgmap v8699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11958.300326 secs 2024-07-26T16:52:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:31 smithi146 ceph-mon[35807]: pgmap v8699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11958.300326 secs 2024-07-26T16:52:32.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:31 smithi076 ceph-mon[35401]: pgmap v8699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:33 smithi040 ceph-mon[32397]: pgmap v8700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:33 smithi146 ceph-mon[35807]: pgmap v8700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:33 smithi076 ceph-mon[35401]: pgmap v8700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:35 smithi040 ceph-mon[32397]: pgmap v8701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:35 smithi146 ceph-mon[35807]: pgmap v8701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:35 smithi076 ceph-mon[35401]: pgmap v8701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11963.300462 secs 2024-07-26T16:52:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11963.300462 secs 2024-07-26T16:52:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11963.300462 secs 2024-07-26T16:52:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:37 smithi040 ceph-mon[32397]: pgmap v8702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:37 smithi146 ceph-mon[35807]: pgmap v8702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:37 smithi076 ceph-mon[35401]: pgmap v8702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:39 smithi040 ceph-mon[32397]: pgmap v8703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:39 smithi146 ceph-mon[35807]: pgmap v8703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:39 smithi076 ceph-mon[35401]: pgmap v8703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11968.300597 secs 2024-07-26T16:52:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:41 smithi040 ceph-mon[32397]: pgmap v8704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11968.300597 secs 2024-07-26T16:52:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:41 smithi146 ceph-mon[35807]: pgmap v8704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11968.300597 secs 2024-07-26T16:52:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:41 smithi076 ceph-mon[35401]: pgmap v8704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:43 smithi040 ceph-mon[32397]: pgmap v8705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:43 smithi146 ceph-mon[35807]: pgmap v8705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:43 smithi076 ceph-mon[35401]: pgmap v8705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:45 smithi040 ceph-mon[32397]: pgmap v8706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:45 smithi146 ceph-mon[35807]: pgmap v8706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:45 smithi076 ceph-mon[35401]: pgmap v8706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11973.300757 secs 2024-07-26T16:52:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11973.300757 secs 2024-07-26T16:52:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11973.300757 secs 2024-07-26T16:52:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:47 smithi040 ceph-mon[32397]: pgmap v8707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:47 smithi146 ceph-mon[35807]: pgmap v8707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:47 smithi076 ceph-mon[35401]: pgmap v8707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:49 smithi040 ceph-mon[32397]: pgmap v8708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:49 smithi146 ceph-mon[35807]: pgmap v8708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:49 smithi076 ceph-mon[35401]: pgmap v8708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:52:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11978.300899 secs 2024-07-26T16:52:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:51 smithi040 ceph-mon[32397]: pgmap v8709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11978.300899 secs 2024-07-26T16:52:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:51 smithi146 ceph-mon[35807]: pgmap v8709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11978.300899 secs 2024-07-26T16:52:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:51 smithi076 ceph-mon[35401]: pgmap v8709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:53 smithi040 ceph-mon[32397]: pgmap v8710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:53 smithi146 ceph-mon[35807]: pgmap v8710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:53 smithi076 ceph-mon[35401]: pgmap v8710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:55 smithi146 ceph-mon[35807]: pgmap v8711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:55 smithi076 ceph-mon[35401]: pgmap v8711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:55 smithi040 ceph-mon[32397]: pgmap v8711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:52:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11983.301011 secs 2024-07-26T16:52:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11983.301011 secs 2024-07-26T16:52:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11983.301011 secs 2024-07-26T16:52:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:52:58 smithi146 ceph-mon[35807]: pgmap v8712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:58.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:52:58 smithi076 ceph-mon[35401]: pgmap v8712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:52:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:52:58 smithi040 ceph-mon[32397]: pgmap v8712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:00 smithi146 ceph-mon[35807]: pgmap v8713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:00 smithi076 ceph-mon[35401]: pgmap v8713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:00 smithi040 ceph-mon[32397]: pgmap v8713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11988.301156 secs 2024-07-26T16:53:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:02 smithi146 ceph-mon[35807]: pgmap v8714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11988.301156 secs 2024-07-26T16:53:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:02 smithi076 ceph-mon[35401]: pgmap v8714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11988.301156 secs 2024-07-26T16:53:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:02 smithi040 ceph-mon[32397]: pgmap v8714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:04 smithi146 ceph-mon[35807]: pgmap v8715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:04 smithi076 ceph-mon[35401]: pgmap v8715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:04 smithi040 ceph-mon[32397]: pgmap v8715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:06.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:06 smithi040 ceph-mon[32397]: pgmap v8716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:06 smithi146 ceph-mon[35807]: pgmap v8716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:06 smithi076 ceph-mon[35401]: pgmap v8716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11993.301301 secs 2024-07-26T16:53:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11993.301301 secs 2024-07-26T16:53:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11993.301301 secs 2024-07-26T16:53:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:08 smithi146 ceph-mon[35807]: pgmap v8717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:08 smithi076 ceph-mon[35401]: pgmap v8717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:08 smithi040 ceph-mon[32397]: pgmap v8717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:10 smithi146 ceph-mon[35807]: pgmap v8718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:10 smithi076 ceph-mon[35401]: pgmap v8718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:10 smithi040 ceph-mon[32397]: pgmap v8718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:11 smithi040 ceph-mon[32397]: pgmap v8719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:11 smithi146 ceph-mon[35807]: pgmap v8719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:11 smithi076 ceph-mon[35401]: pgmap v8719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 11998.301443 secs 2024-07-26T16:53:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 11998.301443 secs 2024-07-26T16:53:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 11998.301443 secs 2024-07-26T16:53:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:13 smithi040 ceph-mon[32397]: pgmap v8720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:13 smithi146 ceph-mon[35807]: pgmap v8720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:13 smithi076 ceph-mon[35401]: pgmap v8720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:15 smithi040 ceph-mon[32397]: pgmap v8721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:15 smithi146 ceph-mon[35807]: pgmap v8721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:15 smithi076 ceph-mon[35401]: pgmap v8721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12003.301577 secs 2024-07-26T16:53:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12003.301577 secs 2024-07-26T16:53:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12003.301577 secs 2024-07-26T16:53:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:17 smithi040 ceph-mon[32397]: pgmap v8722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:17 smithi146 ceph-mon[35807]: pgmap v8722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:17 smithi076 ceph-mon[35401]: pgmap v8722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:19 smithi040 ceph-mon[32397]: pgmap v8723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:20.385 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:19 smithi076 ceph-mon[35401]: pgmap v8723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:20.386 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:19 smithi146 ceph-mon[35807]: pgmap v8723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12008.301724 secs 2024-07-26T16:53:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:21 smithi040 ceph-mon[32397]: pgmap v8724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12008.301724 secs 2024-07-26T16:53:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:21 smithi146 ceph-mon[35807]: pgmap v8724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12008.301724 secs 2024-07-26T16:53:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:21 smithi076 ceph-mon[35401]: pgmap v8724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:23 smithi040 ceph-mon[32397]: pgmap v8725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:23 smithi146 ceph-mon[35807]: pgmap v8725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:23 smithi076 ceph-mon[35401]: pgmap v8725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:25 smithi040 ceph-mon[32397]: pgmap v8726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:25 smithi146 ceph-mon[35807]: pgmap v8726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:25 smithi076 ceph-mon[35401]: pgmap v8726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12013.301881 secs 2024-07-26T16:53:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12013.301881 secs 2024-07-26T16:53:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12013.301881 secs 2024-07-26T16:53:28.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:27 smithi146 ceph-mon[35807]: pgmap v8727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:27 smithi040 ceph-mon[32397]: pgmap v8727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:27 smithi076 ceph-mon[35401]: pgmap v8727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:29 smithi040 ceph-mon[32397]: pgmap v8728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:29 smithi146 ceph-mon[35807]: pgmap v8728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:29 smithi076 ceph-mon[35401]: pgmap v8728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12018.302025 secs 2024-07-26T16:53:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:31 smithi040 ceph-mon[32397]: pgmap v8729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12018.302025 secs 2024-07-26T16:53:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:31 smithi146 ceph-mon[35807]: pgmap v8729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12018.302025 secs 2024-07-26T16:53:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:31 smithi076 ceph-mon[35401]: pgmap v8729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:33 smithi040 ceph-mon[32397]: pgmap v8730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:33 smithi146 ceph-mon[35807]: pgmap v8730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:33 smithi076 ceph-mon[35401]: pgmap v8730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:35 smithi040 ceph-mon[32397]: pgmap v8731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:35 smithi146 ceph-mon[35807]: pgmap v8731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:35 smithi076 ceph-mon[35401]: pgmap v8731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12023.302164 secs 2024-07-26T16:53:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12023.302164 secs 2024-07-26T16:53:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12023.302164 secs 2024-07-26T16:53:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:37 smithi040 ceph-mon[32397]: pgmap v8732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:37 smithi146 ceph-mon[35807]: pgmap v8732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:37 smithi076 ceph-mon[35401]: pgmap v8732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:39 smithi040 ceph-mon[32397]: pgmap v8733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:39 smithi146 ceph-mon[35807]: pgmap v8733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:39 smithi076 ceph-mon[35401]: pgmap v8733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12028.302326 secs 2024-07-26T16:53:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:41 smithi040 ceph-mon[32397]: pgmap v8734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12028.302326 secs 2024-07-26T16:53:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:41 smithi146 ceph-mon[35807]: pgmap v8734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12028.302326 secs 2024-07-26T16:53:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:41 smithi076 ceph-mon[35401]: pgmap v8734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:43 smithi040 ceph-mon[32397]: pgmap v8735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:43 smithi146 ceph-mon[35807]: pgmap v8735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:43 smithi076 ceph-mon[35401]: pgmap v8735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:45 smithi040 ceph-mon[32397]: pgmap v8736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:45 smithi146 ceph-mon[35807]: pgmap v8736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:45 smithi076 ceph-mon[35401]: pgmap v8736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12033.302485 secs 2024-07-26T16:53:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12033.302485 secs 2024-07-26T16:53:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12033.302485 secs 2024-07-26T16:53:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:47 smithi146 ceph-mon[35807]: pgmap v8737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:47 smithi076 ceph-mon[35401]: pgmap v8737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:47 smithi040 ceph-mon[32397]: pgmap v8737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:50 smithi146 ceph-mon[35807]: pgmap v8738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:50.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:50 smithi076 ceph-mon[35401]: pgmap v8738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:49 smithi040 ceph-mon[32397]: pgmap v8738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:53:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12038.302627 secs 2024-07-26T16:53:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:52 smithi146 ceph-mon[35807]: pgmap v8739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12038.302627 secs 2024-07-26T16:53:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:52 smithi076 ceph-mon[35401]: pgmap v8739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12038.302627 secs 2024-07-26T16:53:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:52 smithi040 ceph-mon[32397]: pgmap v8739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:54 smithi146 ceph-mon[35807]: pgmap v8740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:54 smithi076 ceph-mon[35401]: pgmap v8740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:54 smithi040 ceph-mon[32397]: pgmap v8740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:56 smithi146 ceph-mon[35807]: pgmap v8741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:56 smithi076 ceph-mon[35401]: pgmap v8741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:56 smithi040 ceph-mon[32397]: pgmap v8741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:53:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12043.302768 secs 2024-07-26T16:53:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12043.302768 secs 2024-07-26T16:53:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12043.302768 secs 2024-07-26T16:53:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:53:58 smithi146 ceph-mon[35807]: pgmap v8742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:53:58 smithi076 ceph-mon[35401]: pgmap v8742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:53:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:53:58 smithi040 ceph-mon[32397]: pgmap v8742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:00 smithi146 ceph-mon[35807]: pgmap v8743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:00 smithi076 ceph-mon[35401]: pgmap v8743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:00 smithi040 ceph-mon[32397]: pgmap v8743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12048.302907 secs 2024-07-26T16:54:02.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:02 smithi146 ceph-mon[35807]: pgmap v8744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12048.302907 secs 2024-07-26T16:54:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:02 smithi076 ceph-mon[35401]: pgmap v8744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12048.302907 secs 2024-07-26T16:54:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:02 smithi040 ceph-mon[32397]: pgmap v8744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:04 smithi146 ceph-mon[35807]: pgmap v8745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:04 smithi076 ceph-mon[35401]: pgmap v8745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:04 smithi040 ceph-mon[32397]: pgmap v8745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:06 smithi146 ceph-mon[35807]: pgmap v8746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:06 smithi076 ceph-mon[35401]: pgmap v8746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:06 smithi040 ceph-mon[32397]: pgmap v8746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12053.303043 secs 2024-07-26T16:54:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12053.303043 secs 2024-07-26T16:54:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12053.303043 secs 2024-07-26T16:54:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:08 smithi076 ceph-mon[35401]: pgmap v8747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:08 smithi040 ceph-mon[32397]: pgmap v8747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:08 smithi146 ceph-mon[35807]: pgmap v8747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:10 smithi040 ceph-mon[32397]: pgmap v8748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:10 smithi146 ceph-mon[35807]: pgmap v8748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:10 smithi076 ceph-mon[35401]: pgmap v8748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:54:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12058.303203 secs 2024-07-26T16:54:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:12 smithi040 ceph-mon[32397]: pgmap v8749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12058.303203 secs 2024-07-26T16:54:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:12 smithi146 ceph-mon[35807]: pgmap v8749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12058.303203 secs 2024-07-26T16:54:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:12 smithi076 ceph-mon[35401]: pgmap v8749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:14 smithi040 ceph-mon[32397]: pgmap v8750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:14 smithi146 ceph-mon[35807]: pgmap v8750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:14 smithi076 ceph-mon[35401]: pgmap v8750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:16 smithi040 ceph-mon[32397]: pgmap v8751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:16 smithi146 ceph-mon[35807]: pgmap v8751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:16 smithi076 ceph-mon[35401]: pgmap v8751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12063.303340 secs 2024-07-26T16:54:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12063.303340 secs 2024-07-26T16:54:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12063.303340 secs 2024-07-26T16:54:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:18 smithi040 ceph-mon[32397]: pgmap v8752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:18 smithi146 ceph-mon[35807]: pgmap v8752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:18 smithi076 ceph-mon[35401]: pgmap v8752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:19 smithi040 ceph-mon[32397]: pgmap v8753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:19 smithi146 ceph-mon[35807]: pgmap v8753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:19 smithi076 ceph-mon[35401]: pgmap v8753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12068.303477 secs 2024-07-26T16:54:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:21 smithi040 ceph-mon[32397]: pgmap v8754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12068.303477 secs 2024-07-26T16:54:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:21 smithi146 ceph-mon[35807]: pgmap v8754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12068.303477 secs 2024-07-26T16:54:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:21 smithi076 ceph-mon[35401]: pgmap v8754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:23 smithi040 ceph-mon[32397]: pgmap v8755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:23 smithi146 ceph-mon[35807]: pgmap v8755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:23 smithi076 ceph-mon[35401]: pgmap v8755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:25 smithi040 ceph-mon[32397]: pgmap v8756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:25 smithi146 ceph-mon[35807]: pgmap v8756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:25 smithi076 ceph-mon[35401]: pgmap v8756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12073.303616 secs 2024-07-26T16:54:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12073.303616 secs 2024-07-26T16:54:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12073.303616 secs 2024-07-26T16:54:28.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:27 smithi146 ceph-mon[35807]: pgmap v8757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:27 smithi040 ceph-mon[32397]: pgmap v8757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:27 smithi076 ceph-mon[35401]: pgmap v8757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:29 smithi040 ceph-mon[32397]: pgmap v8758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:29 smithi146 ceph-mon[35807]: pgmap v8758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:29 smithi076 ceph-mon[35401]: pgmap v8758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12078.303760 secs 2024-07-26T16:54:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:31 smithi040 ceph-mon[32397]: pgmap v8759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12078.303760 secs 2024-07-26T16:54:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:31 smithi146 ceph-mon[35807]: pgmap v8759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12078.303760 secs 2024-07-26T16:54:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:31 smithi076 ceph-mon[35401]: pgmap v8759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:33 smithi040 ceph-mon[32397]: pgmap v8760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:33 smithi146 ceph-mon[35807]: pgmap v8760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:33 smithi076 ceph-mon[35401]: pgmap v8760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:35 smithi040 ceph-mon[32397]: pgmap v8761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:35 smithi146 ceph-mon[35807]: pgmap v8761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:35 smithi076 ceph-mon[35401]: pgmap v8761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12083.303899 secs 2024-07-26T16:54:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12083.303899 secs 2024-07-26T16:54:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12083.303899 secs 2024-07-26T16:54:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:37 smithi040 ceph-mon[32397]: pgmap v8762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:37 smithi146 ceph-mon[35807]: pgmap v8762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:37 smithi076 ceph-mon[35401]: pgmap v8762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:39 smithi040 ceph-mon[32397]: pgmap v8763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:39 smithi146 ceph-mon[35807]: pgmap v8763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:39 smithi076 ceph-mon[35401]: pgmap v8763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12088.304064 secs 2024-07-26T16:54:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:41 smithi040 ceph-mon[32397]: pgmap v8764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12088.304064 secs 2024-07-26T16:54:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:41 smithi146 ceph-mon[35807]: pgmap v8764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12088.304064 secs 2024-07-26T16:54:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:41 smithi076 ceph-mon[35401]: pgmap v8764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:54:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:43 smithi040 ceph-mon[32397]: pgmap v8765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:43 smithi146 ceph-mon[35807]: pgmap v8765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:43 smithi076 ceph-mon[35401]: pgmap v8765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:45 smithi146 ceph-mon[35807]: pgmap v8766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:45 smithi076 ceph-mon[35401]: pgmap v8766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:45 smithi040 ceph-mon[32397]: pgmap v8766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12093.304217 secs 2024-07-26T16:54:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12093.304217 secs 2024-07-26T16:54:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12093.304217 secs 2024-07-26T16:54:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:48 smithi146 ceph-mon[35807]: pgmap v8767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:48 smithi076 ceph-mon[35401]: pgmap v8767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:48 smithi040 ceph-mon[32397]: pgmap v8767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:50 smithi146 ceph-mon[35807]: pgmap v8768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:50 smithi076 ceph-mon[35401]: pgmap v8768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:50 smithi040 ceph-mon[32397]: pgmap v8768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:54:52.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12098.304362 secs 2024-07-26T16:54:52.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:52 smithi146 ceph-mon[35807]: pgmap v8769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12098.304362 secs 2024-07-26T16:54:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:52 smithi076 ceph-mon[35401]: pgmap v8769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12098.304362 secs 2024-07-26T16:54:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:52 smithi040 ceph-mon[32397]: pgmap v8769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:54 smithi146 ceph-mon[35807]: pgmap v8770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:54 smithi076 ceph-mon[35401]: pgmap v8770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:54 smithi040 ceph-mon[32397]: pgmap v8770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:56 smithi146 ceph-mon[35807]: pgmap v8771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:56 smithi076 ceph-mon[35401]: pgmap v8771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:56 smithi040 ceph-mon[32397]: pgmap v8771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:54:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12103.304522 secs 2024-07-26T16:54:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12103.304522 secs 2024-07-26T16:54:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12103.304522 secs 2024-07-26T16:54:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:54:58 smithi146 ceph-mon[35807]: pgmap v8772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:54:58 smithi076 ceph-mon[35401]: pgmap v8772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:54:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:54:58 smithi040 ceph-mon[32397]: pgmap v8772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:00 smithi076 ceph-mon[35401]: pgmap v8773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:00 smithi040 ceph-mon[32397]: pgmap v8773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:00 smithi146 ceph-mon[35807]: pgmap v8773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12108.304667 secs 2024-07-26T16:55:02.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:02 smithi076 ceph-mon[35401]: pgmap v8774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12108.304667 secs 2024-07-26T16:55:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:02 smithi040 ceph-mon[32397]: pgmap v8774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12108.304667 secs 2024-07-26T16:55:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:02 smithi146 ceph-mon[35807]: pgmap v8774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:04 smithi040 ceph-mon[32397]: pgmap v8775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:04 smithi146 ceph-mon[35807]: pgmap v8775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:04 smithi076 ceph-mon[35401]: pgmap v8775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:06.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:06 smithi076 ceph-mon[35401]: pgmap v8776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:06 smithi040 ceph-mon[32397]: pgmap v8776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:06 smithi146 ceph-mon[35807]: pgmap v8776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12113.304804 secs 2024-07-26T16:55:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12113.304804 secs 2024-07-26T16:55:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12113.304804 secs 2024-07-26T16:55:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:08 smithi040 ceph-mon[32397]: pgmap v8777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:08 smithi146 ceph-mon[35807]: pgmap v8777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:08 smithi076 ceph-mon[35401]: pgmap v8777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:10 smithi040 ceph-mon[32397]: pgmap v8778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:10 smithi146 ceph-mon[35807]: pgmap v8778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:10 smithi076 ceph-mon[35401]: pgmap v8778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:11 smithi040 ceph-mon[32397]: pgmap v8779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:11 smithi146 ceph-mon[35807]: pgmap v8779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:11 smithi076 ceph-mon[35401]: pgmap v8779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12118.304941 secs 2024-07-26T16:55:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12118.304941 secs 2024-07-26T16:55:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12118.304941 secs 2024-07-26T16:55:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:13 smithi146 ceph-mon[35807]: pgmap v8780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:13 smithi076 ceph-mon[35401]: pgmap v8780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:13 smithi040 ceph-mon[32397]: pgmap v8780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:15 smithi040 ceph-mon[32397]: pgmap v8781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:15 smithi146 ceph-mon[35807]: pgmap v8781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:15 smithi076 ceph-mon[35401]: pgmap v8781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12123.305073 secs 2024-07-26T16:55:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12123.305073 secs 2024-07-26T16:55:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12123.305073 secs 2024-07-26T16:55:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:17 smithi040 ceph-mon[32397]: pgmap v8782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:17 smithi146 ceph-mon[35807]: pgmap v8782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:17 smithi076 ceph-mon[35401]: pgmap v8782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:19 smithi040 ceph-mon[32397]: pgmap v8783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:19 smithi146 ceph-mon[35807]: pgmap v8783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:19 smithi076 ceph-mon[35401]: pgmap v8783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12128.305205 secs 2024-07-26T16:55:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:21 smithi040 ceph-mon[32397]: pgmap v8784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12128.305205 secs 2024-07-26T16:55:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:21 smithi146 ceph-mon[35807]: pgmap v8784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12128.305205 secs 2024-07-26T16:55:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:21 smithi076 ceph-mon[35401]: pgmap v8784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:23 smithi040 ceph-mon[32397]: pgmap v8785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:23 smithi146 ceph-mon[35807]: pgmap v8785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:23 smithi076 ceph-mon[35401]: pgmap v8785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:25 smithi040 ceph-mon[32397]: pgmap v8786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:25 smithi146 ceph-mon[35807]: pgmap v8786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:25 smithi076 ceph-mon[35401]: pgmap v8786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12133.305373 secs 2024-07-26T16:55:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12133.305373 secs 2024-07-26T16:55:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12133.305373 secs 2024-07-26T16:55:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:27 smithi040 ceph-mon[32397]: pgmap v8787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:27 smithi146 ceph-mon[35807]: pgmap v8787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:27 smithi076 ceph-mon[35401]: pgmap v8787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:29 smithi146 ceph-mon[35807]: pgmap v8788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:29 smithi076 ceph-mon[35401]: pgmap v8788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:29 smithi040 ceph-mon[32397]: pgmap v8788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12138.305507 secs 2024-07-26T16:55:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:31 smithi146 ceph-mon[35807]: pgmap v8789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12138.305507 secs 2024-07-26T16:55:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:31 smithi076 ceph-mon[35401]: pgmap v8789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12138.305507 secs 2024-07-26T16:55:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:31 smithi040 ceph-mon[32397]: pgmap v8789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:34 smithi146 ceph-mon[35807]: pgmap v8790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:34 smithi076 ceph-mon[35401]: pgmap v8790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:34 smithi040 ceph-mon[32397]: pgmap v8790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:36.286 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:36 smithi040 ceph-mon[32397]: pgmap v8791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:36 smithi146 ceph-mon[35807]: pgmap v8791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:36 smithi076 ceph-mon[35401]: pgmap v8791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12143.305604 secs 2024-07-26T16:55:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12143.305604 secs 2024-07-26T16:55:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12143.305604 secs 2024-07-26T16:55:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:38 smithi146 ceph-mon[35807]: pgmap v8792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:38 smithi076 ceph-mon[35401]: pgmap v8792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:38 smithi040 ceph-mon[32397]: pgmap v8792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:40 smithi146 ceph-mon[35807]: pgmap v8793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:40 smithi076 ceph-mon[35401]: pgmap v8793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:40 smithi040 ceph-mon[32397]: pgmap v8793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12148.305701 secs 2024-07-26T16:55:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:42 smithi146 ceph-mon[35807]: pgmap v8794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12148.305701 secs 2024-07-26T16:55:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:42 smithi076 ceph-mon[35401]: pgmap v8794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12148.305701 secs 2024-07-26T16:55:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:42 smithi040 ceph-mon[32397]: pgmap v8794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:44 smithi146 ceph-mon[35807]: pgmap v8795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:44 smithi076 ceph-mon[35401]: pgmap v8795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:44 smithi040 ceph-mon[32397]: pgmap v8795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:46 smithi146 ceph-mon[35807]: pgmap v8796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:46 smithi076 ceph-mon[35401]: pgmap v8796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:46 smithi040 ceph-mon[32397]: pgmap v8796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12153.305848 secs 2024-07-26T16:55:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12153.305848 secs 2024-07-26T16:55:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12153.305848 secs 2024-07-26T16:55:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:48 smithi076 ceph-mon[35401]: pgmap v8797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:48 smithi040 ceph-mon[32397]: pgmap v8797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:48 smithi146 ceph-mon[35807]: pgmap v8797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:50 smithi076 ceph-mon[35401]: pgmap v8798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:50 smithi040 ceph-mon[32397]: pgmap v8798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:50 smithi146 ceph-mon[35807]: pgmap v8798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:55:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12158.305996 secs 2024-07-26T16:55:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:52 smithi040 ceph-mon[32397]: pgmap v8799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12158.305996 secs 2024-07-26T16:55:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:52 smithi146 ceph-mon[35807]: pgmap v8799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12158.305996 secs 2024-07-26T16:55:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:52 smithi076 ceph-mon[35401]: pgmap v8799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:54 smithi040 ceph-mon[32397]: pgmap v8800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:54 smithi146 ceph-mon[35807]: pgmap v8800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:54 smithi076 ceph-mon[35401]: pgmap v8800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:56 smithi040 ceph-mon[32397]: pgmap v8801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:56 smithi146 ceph-mon[35807]: pgmap v8801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:56 smithi076 ceph-mon[35401]: pgmap v8801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:55:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12163.306133 secs 2024-07-26T16:55:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12163.306133 secs 2024-07-26T16:55:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12163.306133 secs 2024-07-26T16:55:58.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:55:58 smithi146 ceph-mon[35807]: pgmap v8802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:55:58 smithi040 ceph-mon[32397]: pgmap v8802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:55:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:55:58 smithi076 ceph-mon[35401]: pgmap v8802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:00 smithi040 ceph-mon[32397]: pgmap v8803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:00 smithi146 ceph-mon[35807]: pgmap v8803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:00 smithi076 ceph-mon[35401]: pgmap v8803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12168.306333 secs 2024-07-26T16:56:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:02 smithi040 ceph-mon[32397]: pgmap v8804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12168.306333 secs 2024-07-26T16:56:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:02 smithi146 ceph-mon[35807]: pgmap v8804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12168.306333 secs 2024-07-26T16:56:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:02 smithi076 ceph-mon[35401]: pgmap v8804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:04 smithi040 ceph-mon[32397]: pgmap v8805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:04 smithi146 ceph-mon[35807]: pgmap v8805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:04 smithi076 ceph-mon[35401]: pgmap v8805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:06 smithi040 ceph-mon[32397]: pgmap v8806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:06 smithi146 ceph-mon[35807]: pgmap v8806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:06 smithi076 ceph-mon[35401]: pgmap v8806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12173.306426 secs 2024-07-26T16:56:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:07 smithi040 ceph-mon[32397]: pgmap v8807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12173.306426 secs 2024-07-26T16:56:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:07 smithi146 ceph-mon[35807]: pgmap v8807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12173.306426 secs 2024-07-26T16:56:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:07 smithi076 ceph-mon[35401]: pgmap v8807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:09 smithi040 ceph-mon[32397]: pgmap v8808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:09 smithi146 ceph-mon[35807]: pgmap v8808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:09 smithi076 ceph-mon[35401]: pgmap v8808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12178.306583 secs 2024-07-26T16:56:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:11 smithi040 ceph-mon[32397]: pgmap v8809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12178.306583 secs 2024-07-26T16:56:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:11 smithi146 ceph-mon[35807]: pgmap v8809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12178.306583 secs 2024-07-26T16:56:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:11 smithi076 ceph-mon[35401]: pgmap v8809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:13 smithi040 ceph-mon[32397]: pgmap v8810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:13 smithi146 ceph-mon[35807]: pgmap v8810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:13 smithi076 ceph-mon[35401]: pgmap v8810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:15 smithi040 ceph-mon[32397]: pgmap v8811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:15 smithi146 ceph-mon[35807]: pgmap v8811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:15 smithi076 ceph-mon[35401]: pgmap v8811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12183.306718 secs 2024-07-26T16:56:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12183.306718 secs 2024-07-26T16:56:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12183.306718 secs 2024-07-26T16:56:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:17 smithi146 ceph-mon[35807]: pgmap v8812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:17 smithi076 ceph-mon[35401]: pgmap v8812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:17 smithi040 ceph-mon[32397]: pgmap v8812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:19 smithi146 ceph-mon[35807]: pgmap v8813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:19 smithi076 ceph-mon[35401]: pgmap v8813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:19 smithi040 ceph-mon[32397]: pgmap v8813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12188.306870 secs 2024-07-26T16:56:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:22 smithi146 ceph-mon[35807]: pgmap v8814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12188.306870 secs 2024-07-26T16:56:22.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:22 smithi076 ceph-mon[35401]: pgmap v8814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12188.306870 secs 2024-07-26T16:56:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:22 smithi040 ceph-mon[32397]: pgmap v8814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:24 smithi146 ceph-mon[35807]: pgmap v8815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:24 smithi076 ceph-mon[35401]: pgmap v8815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:24 smithi040 ceph-mon[32397]: pgmap v8815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:26 smithi146 ceph-mon[35807]: pgmap v8816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:26 smithi076 ceph-mon[35401]: pgmap v8816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:26 smithi040 ceph-mon[32397]: pgmap v8816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12193.307011 secs 2024-07-26T16:56:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12193.307011 secs 2024-07-26T16:56:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12193.307011 secs 2024-07-26T16:56:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:28 smithi146 ceph-mon[35807]: pgmap v8817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:28 smithi076 ceph-mon[35401]: pgmap v8817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:28 smithi040 ceph-mon[32397]: pgmap v8817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:30 smithi146 ceph-mon[35807]: pgmap v8818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:30 smithi076 ceph-mon[35401]: pgmap v8818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:30 smithi040 ceph-mon[32397]: pgmap v8818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:31 smithi146 ceph-mon[35807]: pgmap v8819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:31 smithi076 ceph-mon[35401]: pgmap v8819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:31 smithi040 ceph-mon[32397]: pgmap v8819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12198.307177 secs 2024-07-26T16:56:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12198.307177 secs 2024-07-26T16:56:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12198.307177 secs 2024-07-26T16:56:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:33 smithi146 ceph-mon[35807]: pgmap v8820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:33 smithi076 ceph-mon[35401]: pgmap v8820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:33 smithi040 ceph-mon[32397]: pgmap v8820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:35 smithi040 ceph-mon[32397]: pgmap v8821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:36.287 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:35 smithi076 ceph-mon[35401]: pgmap v8821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:35 smithi146 ceph-mon[35807]: pgmap v8821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12203.307320 secs 2024-07-26T16:56:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12203.307320 secs 2024-07-26T16:56:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12203.307320 secs 2024-07-26T16:56:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:37 smithi146 ceph-mon[35807]: pgmap v8822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:37 smithi076 ceph-mon[35401]: pgmap v8822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:37 smithi040 ceph-mon[32397]: pgmap v8822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:39 smithi146 ceph-mon[35807]: pgmap v8823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:39 smithi076 ceph-mon[35401]: pgmap v8823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:39 smithi040 ceph-mon[32397]: pgmap v8823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12208.307467 secs 2024-07-26T16:56:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:42 smithi146 ceph-mon[35807]: pgmap v8824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12208.307467 secs 2024-07-26T16:56:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:42 smithi076 ceph-mon[35401]: pgmap v8824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12208.307467 secs 2024-07-26T16:56:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:42 smithi040 ceph-mon[32397]: pgmap v8824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:44 smithi146 ceph-mon[35807]: pgmap v8825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:44 smithi076 ceph-mon[35401]: pgmap v8825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:44.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:44 smithi040 ceph-mon[32397]: pgmap v8825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:46 smithi146 ceph-mon[35807]: pgmap v8826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:46 smithi076 ceph-mon[35401]: pgmap v8826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:46 smithi040 ceph-mon[32397]: pgmap v8826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12213.307635 secs 2024-07-26T16:56:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12213.307635 secs 2024-07-26T16:56:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12213.307635 secs 2024-07-26T16:56:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:48 smithi146 ceph-mon[35807]: pgmap v8827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:48 smithi076 ceph-mon[35401]: pgmap v8827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:48 smithi040 ceph-mon[32397]: pgmap v8827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:50 smithi146 ceph-mon[35807]: pgmap v8828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:50 smithi076 ceph-mon[35401]: pgmap v8828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:50 smithi040 ceph-mon[32397]: pgmap v8828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:56:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12218.307797 secs 2024-07-26T16:56:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:52 smithi146 ceph-mon[35807]: pgmap v8829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12218.307797 secs 2024-07-26T16:56:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:52 smithi076 ceph-mon[35401]: pgmap v8829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12218.307797 secs 2024-07-26T16:56:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:52 smithi040 ceph-mon[32397]: pgmap v8829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:54 smithi146 ceph-mon[35807]: pgmap v8830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:54 smithi076 ceph-mon[35401]: pgmap v8830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:54 smithi040 ceph-mon[32397]: pgmap v8830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:56 smithi146 ceph-mon[35807]: pgmap v8831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:56 smithi076 ceph-mon[35401]: pgmap v8831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:56 smithi040 ceph-mon[32397]: pgmap v8831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:56:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12223.307938 secs 2024-07-26T16:56:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12223.307938 secs 2024-07-26T16:56:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12223.307938 secs 2024-07-26T16:56:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:56:58 smithi076 ceph-mon[35401]: pgmap v8832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:58.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:56:58 smithi146 ceph-mon[35807]: pgmap v8832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:56:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:56:58 smithi040 ceph-mon[32397]: pgmap v8832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:00 smithi040 ceph-mon[32397]: pgmap v8833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:00 smithi146 ceph-mon[35807]: pgmap v8833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:00 smithi076 ceph-mon[35401]: pgmap v8833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12228.308086 secs 2024-07-26T16:57:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:02 smithi040 ceph-mon[32397]: pgmap v8834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12228.308086 secs 2024-07-26T16:57:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:02 smithi146 ceph-mon[35807]: pgmap v8834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12228.308086 secs 2024-07-26T16:57:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:02 smithi076 ceph-mon[35401]: pgmap v8834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:04 smithi040 ceph-mon[32397]: pgmap v8835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:04 smithi146 ceph-mon[35807]: pgmap v8835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:04 smithi076 ceph-mon[35401]: pgmap v8835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:06.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:06 smithi076 ceph-mon[35401]: pgmap v8836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:06 smithi040 ceph-mon[32397]: pgmap v8836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:06 smithi146 ceph-mon[35807]: pgmap v8836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12233.308243 secs 2024-07-26T16:57:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12233.308243 secs 2024-07-26T16:57:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12233.308243 secs 2024-07-26T16:57:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:08 smithi040 ceph-mon[32397]: pgmap v8837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:08 smithi146 ceph-mon[35807]: pgmap v8837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:08.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:08 smithi076 ceph-mon[35401]: pgmap v8837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:10 smithi040 ceph-mon[32397]: pgmap v8838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:10 smithi146 ceph-mon[35807]: pgmap v8838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:10 smithi076 ceph-mon[35401]: pgmap v8838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12238.308389 secs 2024-07-26T16:57:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:12 smithi040 ceph-mon[32397]: pgmap v8839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12238.308389 secs 2024-07-26T16:57:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:12 smithi146 ceph-mon[35807]: pgmap v8839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12238.308389 secs 2024-07-26T16:57:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:12 smithi076 ceph-mon[35401]: pgmap v8839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:14 smithi040 ceph-mon[32397]: pgmap v8840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:14 smithi146 ceph-mon[35807]: pgmap v8840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:14 smithi076 ceph-mon[35401]: pgmap v8840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:16 smithi040 ceph-mon[32397]: pgmap v8841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:16 smithi146 ceph-mon[35807]: pgmap v8841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:16 smithi076 ceph-mon[35401]: pgmap v8841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12243.308530 secs 2024-07-26T16:57:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12243.308530 secs 2024-07-26T16:57:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12243.308530 secs 2024-07-26T16:57:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:18 smithi040 ceph-mon[32397]: pgmap v8842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:18 smithi146 ceph-mon[35807]: pgmap v8842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:18 smithi076 ceph-mon[35401]: pgmap v8842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:19 smithi040 ceph-mon[32397]: pgmap v8843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:19 smithi146 ceph-mon[35807]: pgmap v8843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:19 smithi076 ceph-mon[35401]: pgmap v8843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12248.308629 secs 2024-07-26T16:57:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:22 smithi146 ceph-mon[35807]: pgmap v8844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12248.308629 secs 2024-07-26T16:57:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:22 smithi076 ceph-mon[35401]: pgmap v8844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12248.308629 secs 2024-07-26T16:57:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:22 smithi040 ceph-mon[32397]: pgmap v8844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:24.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:24 smithi146 ceph-mon[35807]: pgmap v8845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:24 smithi076 ceph-mon[35401]: pgmap v8845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:24 smithi040 ceph-mon[32397]: pgmap v8845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:26 smithi146 ceph-mon[35807]: pgmap v8846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:26 smithi076 ceph-mon[35401]: pgmap v8846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:26 smithi040 ceph-mon[32397]: pgmap v8846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12253.308761 secs 2024-07-26T16:57:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12253.308761 secs 2024-07-26T16:57:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12253.308761 secs 2024-07-26T16:57:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:28 smithi146 ceph-mon[35807]: pgmap v8847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:28 smithi076 ceph-mon[35401]: pgmap v8847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:28 smithi040 ceph-mon[32397]: pgmap v8847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:30 smithi146 ceph-mon[35807]: pgmap v8848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:30.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:30 smithi076 ceph-mon[35401]: pgmap v8848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:30 smithi040 ceph-mon[32397]: pgmap v8848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12258.308906 secs 2024-07-26T16:57:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:32 smithi146 ceph-mon[35807]: pgmap v8849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12258.308906 secs 2024-07-26T16:57:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:32 smithi076 ceph-mon[35401]: pgmap v8849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12258.308906 secs 2024-07-26T16:57:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:32 smithi040 ceph-mon[32397]: pgmap v8849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:34 smithi146 ceph-mon[35807]: pgmap v8850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:34 smithi076 ceph-mon[35401]: pgmap v8850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:34 smithi040 ceph-mon[32397]: pgmap v8850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:36 smithi146 ceph-mon[35807]: pgmap v8851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:36 smithi076 ceph-mon[35401]: pgmap v8851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:36 smithi040 ceph-mon[32397]: pgmap v8851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12263.309057 secs 2024-07-26T16:57:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12263.309057 secs 2024-07-26T16:57:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12263.309057 secs 2024-07-26T16:57:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:38 smithi076 ceph-mon[35401]: pgmap v8852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:38 smithi040 ceph-mon[32397]: pgmap v8852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:38 smithi146 ceph-mon[35807]: pgmap v8852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:40 smithi040 ceph-mon[32397]: pgmap v8853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:40 smithi146 ceph-mon[35807]: pgmap v8853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:40 smithi076 ceph-mon[35401]: pgmap v8853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12268.309196 secs 2024-07-26T16:57:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:42 smithi040 ceph-mon[32397]: pgmap v8854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12268.309196 secs 2024-07-26T16:57:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:42 smithi146 ceph-mon[35807]: pgmap v8854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12268.309196 secs 2024-07-26T16:57:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:42 smithi076 ceph-mon[35401]: pgmap v8854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:44 smithi040 ceph-mon[32397]: pgmap v8855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:44 smithi146 ceph-mon[35807]: pgmap v8855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:44 smithi076 ceph-mon[35401]: pgmap v8855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:46 smithi040 ceph-mon[32397]: pgmap v8856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:46 smithi146 ceph-mon[35807]: pgmap v8856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:46 smithi076 ceph-mon[35401]: pgmap v8856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12273.309338 secs 2024-07-26T16:57:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12273.309338 secs 2024-07-26T16:57:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12273.309338 secs 2024-07-26T16:57:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:48 smithi040 ceph-mon[32397]: pgmap v8857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:48 smithi146 ceph-mon[35807]: pgmap v8857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:48 smithi076 ceph-mon[35401]: pgmap v8857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:50 smithi040 ceph-mon[32397]: pgmap v8858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:50 smithi146 ceph-mon[35807]: pgmap v8858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:50 smithi076 ceph-mon[35401]: pgmap v8858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12278.309474 secs 2024-07-26T16:57:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:52 smithi040 ceph-mon[32397]: pgmap v8859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12278.309474 secs 2024-07-26T16:57:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:52 smithi146 ceph-mon[35807]: pgmap v8859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12278.309474 secs 2024-07-26T16:57:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:52 smithi076 ceph-mon[35401]: pgmap v8859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:54 smithi040 ceph-mon[32397]: pgmap v8860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:54 smithi146 ceph-mon[35807]: pgmap v8860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:54 smithi076 ceph-mon[35401]: pgmap v8860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:56 smithi040 ceph-mon[32397]: pgmap v8861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:56 smithi146 ceph-mon[35807]: pgmap v8861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:56 smithi076 ceph-mon[35401]: pgmap v8861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:57:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12283.309608 secs 2024-07-26T16:57:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12283.309608 secs 2024-07-26T16:57:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12283.309608 secs 2024-07-26T16:57:58.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:58 smithi146 ceph-mon[35807]: pgmap v8862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:58 smithi040 ceph-mon[32397]: pgmap v8862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:58 smithi076 ceph-mon[35401]: pgmap v8862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:57:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:57:59 smithi040 ceph-mon[32397]: pgmap v8863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:57:59 smithi146 ceph-mon[35807]: pgmap v8863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:57:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:57:59 smithi076 ceph-mon[35401]: pgmap v8863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12288.309707 secs 2024-07-26T16:58:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:02 smithi146 ceph-mon[35807]: pgmap v8864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12288.309707 secs 2024-07-26T16:58:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:02 smithi076 ceph-mon[35401]: pgmap v8864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12288.309707 secs 2024-07-26T16:58:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:02 smithi040 ceph-mon[32397]: pgmap v8864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:04 smithi146 ceph-mon[35807]: pgmap v8865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:04 smithi076 ceph-mon[35401]: pgmap v8865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:04 smithi040 ceph-mon[32397]: pgmap v8865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:06 smithi146 ceph-mon[35807]: pgmap v8866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:06 smithi076 ceph-mon[35401]: pgmap v8866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:06 smithi040 ceph-mon[32397]: pgmap v8866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12293.309846 secs 2024-07-26T16:58:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12293.309846 secs 2024-07-26T16:58:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12293.309846 secs 2024-07-26T16:58:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:08 smithi146 ceph-mon[35807]: pgmap v8867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:08 smithi076 ceph-mon[35401]: pgmap v8867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:08 smithi040 ceph-mon[32397]: pgmap v8867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:10 smithi146 ceph-mon[35807]: pgmap v8868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:10 smithi076 ceph-mon[35401]: pgmap v8868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:10 smithi040 ceph-mon[32397]: pgmap v8868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12298.309980 secs 2024-07-26T16:58:12.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:12 smithi076 ceph-mon[35401]: pgmap v8869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12298.309980 secs 2024-07-26T16:58:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:12 smithi040 ceph-mon[32397]: pgmap v8869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12298.309980 secs 2024-07-26T16:58:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:12 smithi146 ceph-mon[35807]: pgmap v8869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:14 smithi076 ceph-mon[35401]: pgmap v8870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:14 smithi040 ceph-mon[32397]: pgmap v8870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:14 smithi146 ceph-mon[35807]: pgmap v8870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:16 smithi040 ceph-mon[32397]: pgmap v8871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:16 smithi146 ceph-mon[35807]: pgmap v8871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:16 smithi076 ceph-mon[35401]: pgmap v8871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12303.310139 secs 2024-07-26T16:58:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12303.310139 secs 2024-07-26T16:58:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12303.310139 secs 2024-07-26T16:58:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:18 smithi040 ceph-mon[32397]: pgmap v8872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:18 smithi146 ceph-mon[35807]: pgmap v8872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:18 smithi076 ceph-mon[35401]: pgmap v8872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:20 smithi040 ceph-mon[32397]: pgmap v8873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:20 smithi146 ceph-mon[35807]: pgmap v8873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:20 smithi076 ceph-mon[35401]: pgmap v8873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12308.310309 secs 2024-07-26T16:58:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:22 smithi040 ceph-mon[32397]: pgmap v8874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12308.310309 secs 2024-07-26T16:58:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:22 smithi146 ceph-mon[35807]: pgmap v8874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12308.310309 secs 2024-07-26T16:58:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:22 smithi076 ceph-mon[35401]: pgmap v8874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:24 smithi040 ceph-mon[32397]: pgmap v8875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:24 smithi146 ceph-mon[35807]: pgmap v8875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:24 smithi076 ceph-mon[35401]: pgmap v8875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:26 smithi040 ceph-mon[32397]: pgmap v8876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:26 smithi146 ceph-mon[35807]: pgmap v8876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:26 smithi076 ceph-mon[35401]: pgmap v8876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12313.310447 secs 2024-07-26T16:58:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12313.310447 secs 2024-07-26T16:58:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12313.310447 secs 2024-07-26T16:58:28.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:28 smithi146 ceph-mon[35807]: pgmap v8877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:28 smithi040 ceph-mon[32397]: pgmap v8877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:28 smithi076 ceph-mon[35401]: pgmap v8877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:30 smithi040 ceph-mon[32397]: pgmap v8878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:30 smithi146 ceph-mon[35807]: pgmap v8878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:30 smithi076 ceph-mon[35401]: pgmap v8878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12318.310550 secs 2024-07-26T16:58:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:32 smithi040 ceph-mon[32397]: pgmap v8879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12318.310550 secs 2024-07-26T16:58:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:32 smithi146 ceph-mon[35807]: pgmap v8879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12318.310550 secs 2024-07-26T16:58:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:32 smithi076 ceph-mon[35401]: pgmap v8879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:34 smithi040 ceph-mon[32397]: pgmap v8880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:34 smithi146 ceph-mon[35807]: pgmap v8880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:34 smithi076 ceph-mon[35401]: pgmap v8880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:36 smithi040 ceph-mon[32397]: pgmap v8881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:36 smithi146 ceph-mon[35807]: pgmap v8881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:36 smithi076 ceph-mon[35401]: pgmap v8881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12323.310642 secs 2024-07-26T16:58:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:37 smithi040 ceph-mon[32397]: pgmap v8882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12323.310642 secs 2024-07-26T16:58:37.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:37 smithi146 ceph-mon[35807]: pgmap v8882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12323.310642 secs 2024-07-26T16:58:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:37 smithi076 ceph-mon[35401]: pgmap v8882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: pgmap v8883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:58:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:58:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:40 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:58:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: pgmap v8883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:40.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:58:40.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:58:40.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:40 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:58:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: pgmap v8883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:58:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T16:58:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T16:58:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:40 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:58:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:41 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:58:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:41 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:58:41.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:41 smithi146 ceph-mon[35807]: pgmap v8884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T16:58:41.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:41 smithi146 ceph-mon[35807]: pgmap v8885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:58:41.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:41 smithi146 ceph-mon[35807]: pgmap v8886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T16:58:41.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:41 smithi146 ceph-mon[35807]: pgmap v8887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:41 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:58:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:41 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:58:41.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:41 smithi076 ceph-mon[35401]: pgmap v8884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T16:58:41.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:41 smithi076 ceph-mon[35401]: pgmap v8885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:58:41.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:41 smithi076 ceph-mon[35401]: pgmap v8886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T16:58:41.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:41 smithi076 ceph-mon[35401]: pgmap v8887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:41 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T16:58:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:41 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T16:58:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:41 smithi040 ceph-mon[32397]: pgmap v8884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T16:58:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:41 smithi040 ceph-mon[32397]: pgmap v8885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T16:58:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:41 smithi040 ceph-mon[32397]: pgmap v8886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-07-26T16:58:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:41 smithi040 ceph-mon[32397]: pgmap v8887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12328.310793 secs 2024-07-26T16:58:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12328.310793 secs 2024-07-26T16:58:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12328.310793 secs 2024-07-26T16:58:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:43 smithi040 ceph-mon[32397]: pgmap v8888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:43 smithi146 ceph-mon[35807]: pgmap v8888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:43 smithi076 ceph-mon[35401]: pgmap v8888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:45 smithi040 ceph-mon[32397]: pgmap v8889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:45 smithi146 ceph-mon[35807]: pgmap v8889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:45 smithi076 ceph-mon[35401]: pgmap v8889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T16:58:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12333.310924 secs 2024-07-26T16:58:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:47 smithi040 ceph-mon[32397]: pgmap v8890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12333.310924 secs 2024-07-26T16:58:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:47 smithi146 ceph-mon[35807]: pgmap v8890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12333.310924 secs 2024-07-26T16:58:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:47 smithi076 ceph-mon[35401]: pgmap v8890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:49 smithi040 ceph-mon[32397]: pgmap v8891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T16:58:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:49 smithi146 ceph-mon[35807]: pgmap v8891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T16:58:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:49 smithi076 ceph-mon[35401]: pgmap v8891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-07-26T16:58:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:51 smithi040 ceph-mon[32397]: pgmap v8892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:58:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:51 smithi146 ceph-mon[35807]: pgmap v8892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:58:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:51 smithi076 ceph-mon[35401]: pgmap v8892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T16:58:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12338.311054 secs 2024-07-26T16:58:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12338.311054 secs 2024-07-26T16:58:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12338.311054 secs 2024-07-26T16:58:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:53 smithi040 ceph-mon[32397]: pgmap v8893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:53 smithi146 ceph-mon[35807]: pgmap v8893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:53 smithi076 ceph-mon[35401]: pgmap v8893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:55 smithi040 ceph-mon[32397]: pgmap v8894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:55 smithi146 ceph-mon[35807]: pgmap v8894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:55 smithi076 ceph-mon[35401]: pgmap v8894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:58:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12343.311202 secs 2024-07-26T16:58:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:57 smithi040 ceph-mon[32397]: pgmap v8895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12343.311202 secs 2024-07-26T16:58:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:57 smithi146 ceph-mon[35807]: pgmap v8895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12343.311202 secs 2024-07-26T16:58:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:57 smithi076 ceph-mon[35401]: pgmap v8895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:58:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:58:59 smithi040 ceph-mon[32397]: pgmap v8896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:58:59 smithi146 ceph-mon[35807]: pgmap v8896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:58:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:58:59 smithi076 ceph-mon[35401]: pgmap v8896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:01 smithi040 ceph-mon[32397]: pgmap v8897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:01 smithi146 ceph-mon[35807]: pgmap v8897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:01 smithi076 ceph-mon[35401]: pgmap v8897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12348.311349 secs 2024-07-26T16:59:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12348.311349 secs 2024-07-26T16:59:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12348.311349 secs 2024-07-26T16:59:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:03 smithi040 ceph-mon[32397]: pgmap v8898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:03 smithi146 ceph-mon[35807]: pgmap v8898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:03 smithi076 ceph-mon[35401]: pgmap v8898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:05 smithi040 ceph-mon[32397]: pgmap v8899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:05 smithi146 ceph-mon[35807]: pgmap v8899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:05 smithi076 ceph-mon[35401]: pgmap v8899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:06 smithi040 ceph-mon[32397]: pgmap v8900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:06.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:06 smithi076 ceph-mon[35401]: pgmap v8900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:06 smithi146 ceph-mon[35807]: pgmap v8900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12353.311488 secs 2024-07-26T16:59:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12353.311488 secs 2024-07-26T16:59:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12353.311488 secs 2024-07-26T16:59:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:08 smithi040 ceph-mon[32397]: pgmap v8901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:08 smithi146 ceph-mon[35807]: pgmap v8901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:08.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:08 smithi076 ceph-mon[35401]: pgmap v8901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:11 smithi146 ceph-mon[35807]: pgmap v8902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:11 smithi076 ceph-mon[35401]: pgmap v8902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:11 smithi040 ceph-mon[32397]: pgmap v8902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12358.311630 secs 2024-07-26T16:59:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12358.311630 secs 2024-07-26T16:59:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12358.311630 secs 2024-07-26T16:59:13.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:13 smithi146 ceph-mon[35807]: pgmap v8903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:13 smithi076 ceph-mon[35401]: pgmap v8903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:13 smithi040 ceph-mon[32397]: pgmap v8903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:15 smithi146 ceph-mon[35807]: pgmap v8904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:15 smithi076 ceph-mon[35401]: pgmap v8904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:15 smithi040 ceph-mon[32397]: pgmap v8904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12363.311761 secs 2024-07-26T16:59:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:17 smithi146 ceph-mon[35807]: pgmap v8905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12363.311761 secs 2024-07-26T16:59:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:17 smithi076 ceph-mon[35401]: pgmap v8905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12363.311761 secs 2024-07-26T16:59:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:17 smithi040 ceph-mon[32397]: pgmap v8905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:19 smithi146 ceph-mon[35807]: pgmap v8906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:19 smithi076 ceph-mon[35401]: pgmap v8906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:19 smithi040 ceph-mon[32397]: pgmap v8906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:21 smithi146 ceph-mon[35807]: pgmap v8907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:21 smithi076 ceph-mon[35401]: pgmap v8907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:21 smithi040 ceph-mon[32397]: pgmap v8907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12368.311936 secs 2024-07-26T16:59:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12368.311936 secs 2024-07-26T16:59:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12368.311936 secs 2024-07-26T16:59:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:23 smithi076 ceph-mon[35401]: pgmap v8908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:23 smithi040 ceph-mon[32397]: pgmap v8908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:23 smithi146 ceph-mon[35807]: pgmap v8908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:25 smithi040 ceph-mon[32397]: pgmap v8909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:25 smithi146 ceph-mon[35807]: pgmap v8909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:25 smithi076 ceph-mon[35401]: pgmap v8909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12373.312074 secs 2024-07-26T16:59:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:27 smithi040 ceph-mon[32397]: pgmap v8910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:59:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12373.312074 secs 2024-07-26T16:59:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:27 smithi146 ceph-mon[35807]: pgmap v8910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:59:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12373.312074 secs 2024-07-26T16:59:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:27 smithi076 ceph-mon[35401]: pgmap v8910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T16:59:29.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:29 smithi146 ceph-mon[35807]: pgmap v8911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:29 smithi040 ceph-mon[32397]: pgmap v8911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:29 smithi076 ceph-mon[35401]: pgmap v8911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T16:59:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:31 smithi040 ceph-mon[32397]: pgmap v8912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:31 smithi146 ceph-mon[35807]: pgmap v8912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:31 smithi076 ceph-mon[35401]: pgmap v8912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12378.312239 secs 2024-07-26T16:59:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12378.312239 secs 2024-07-26T16:59:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12378.312239 secs 2024-07-26T16:59:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:33 smithi040 ceph-mon[32397]: pgmap v8913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:33 smithi146 ceph-mon[35807]: pgmap v8913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:33 smithi076 ceph-mon[35401]: pgmap v8913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:35 smithi040 ceph-mon[32397]: pgmap v8914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:35 smithi146 ceph-mon[35807]: pgmap v8914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:35 smithi076 ceph-mon[35401]: pgmap v8914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:37.388 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12383.312369 secs 2024-07-26T16:59:37.389 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:37 smithi076 ceph-mon[35401]: pgmap v8915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12383.312369 secs 2024-07-26T16:59:37.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:37 smithi040 ceph-mon[32397]: pgmap v8915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12383.312369 secs 2024-07-26T16:59:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:37 smithi146 ceph-mon[35807]: pgmap v8915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:39 smithi040 ceph-mon[32397]: pgmap v8916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:39 smithi146 ceph-mon[35807]: pgmap v8916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:39 smithi076 ceph-mon[35401]: pgmap v8916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: pgmap v8917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:59:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:41 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: pgmap v8917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:59:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:41 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: pgmap v8917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T16:59:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:41.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:41 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12388.312503 secs 2024-07-26T16:59:42.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12388.312503 secs 2024-07-26T16:59:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12388.312503 secs 2024-07-26T16:59:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:43 smithi040 ceph-mon[32397]: pgmap v8918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:43 smithi146 ceph-mon[35807]: pgmap v8918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:43 smithi076 ceph-mon[35401]: pgmap v8918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: pgmap v8919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: pgmap v8919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: pgmap v8919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12393.312626 secs 2024-07-26T16:59:47.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: pgmap v8920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:47 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12393.312626 secs 2024-07-26T16:59:47.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: pgmap v8920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:47.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:47 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12393.312626 secs 2024-07-26T16:59:47.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: pgmap v8920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:47.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T16:59:47.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:47.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:47 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T16:59:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:48 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:59:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:48 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:59:48.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:48 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:59:48.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:48 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:59:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:48 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:59:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:48 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:59:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:48 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:59:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:48 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:59:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:48 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T16:59:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:48 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:59:48.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:48 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T16:59:48.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:48 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T16:59:49.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:49 smithi040 ceph-mon[32397]: pgmap v8921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:49 smithi146 ceph-mon[35807]: pgmap v8921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:49 smithi076 ceph-mon[35401]: pgmap v8921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:51 smithi040 ceph-mon[32397]: pgmap v8922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:51 smithi146 ceph-mon[35807]: pgmap v8922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:51 smithi076 ceph-mon[35401]: pgmap v8922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12398.312756 secs 2024-07-26T16:59:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:52 smithi040 ceph-mon[32397]: pgmap v8923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12398.312756 secs 2024-07-26T16:59:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:52 smithi146 ceph-mon[35807]: pgmap v8923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12398.312756 secs 2024-07-26T16:59:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:52 smithi076 ceph-mon[35401]: pgmap v8923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:55 smithi146 ceph-mon[35807]: pgmap v8924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:55 smithi076 ceph-mon[35401]: pgmap v8924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:55 smithi040 ceph-mon[32397]: pgmap v8924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T16:59:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12403.312895 secs 2024-07-26T16:59:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:57 smithi146 ceph-mon[35807]: pgmap v8925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12403.312895 secs 2024-07-26T16:59:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:57 smithi076 ceph-mon[35401]: pgmap v8925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12403.312895 secs 2024-07-26T16:59:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:57 smithi040 ceph-mon[32397]: pgmap v8925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T16:59:59.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 16:59:59 smithi146 ceph-mon[35807]: pgmap v8926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 16:59:59 smithi076 ceph-mon[35401]: pgmap v8926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T16:59:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 16:59:59 smithi040 ceph-mon[32397]: pgmap v8926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:00:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:00:00.363 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:00:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:01 smithi076 ceph-mon[35401]: pgmap v8927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:01 smithi040 ceph-mon[32397]: pgmap v8927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:01 smithi146 ceph-mon[35807]: pgmap v8927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12408.313049 secs 2024-07-26T17:00:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12408.313049 secs 2024-07-26T17:00:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12408.313049 secs 2024-07-26T17:00:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:03 smithi040 ceph-mon[32397]: pgmap v8928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:03 smithi146 ceph-mon[35807]: pgmap v8928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:03 smithi076 ceph-mon[35401]: pgmap v8928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:05 smithi040 ceph-mon[32397]: pgmap v8929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:05 smithi146 ceph-mon[35807]: pgmap v8929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:05 smithi076 ceph-mon[35401]: pgmap v8929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:07.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12413.313187 secs 2024-07-26T17:00:07.387 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:07 smithi076 ceph-mon[35401]: pgmap v8930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:00:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12413.313187 secs 2024-07-26T17:00:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:07 smithi040 ceph-mon[32397]: pgmap v8930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:00:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12413.313187 secs 2024-07-26T17:00:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:07 smithi146 ceph-mon[35807]: pgmap v8930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:00:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:09 smithi040 ceph-mon[32397]: pgmap v8931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:09 smithi146 ceph-mon[35807]: pgmap v8931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:09 smithi076 ceph-mon[35401]: pgmap v8931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:11 smithi040 ceph-mon[32397]: pgmap v8932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:11 smithi146 ceph-mon[35807]: pgmap v8932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:11 smithi076 ceph-mon[35401]: pgmap v8932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12418.313384 secs 2024-07-26T17:00:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12418.313384 secs 2024-07-26T17:00:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12418.313384 secs 2024-07-26T17:00:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:13 smithi040 ceph-mon[32397]: pgmap v8933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:13 smithi146 ceph-mon[35807]: pgmap v8933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:13 smithi076 ceph-mon[35401]: pgmap v8933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:15 smithi040 ceph-mon[32397]: pgmap v8934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:15 smithi146 ceph-mon[35807]: pgmap v8934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:15 smithi076 ceph-mon[35401]: pgmap v8934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12423.313538 secs 2024-07-26T17:00:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:17 smithi040 ceph-mon[32397]: pgmap v8935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12423.313538 secs 2024-07-26T17:00:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:17 smithi146 ceph-mon[35807]: pgmap v8935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12423.313538 secs 2024-07-26T17:00:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:17 smithi076 ceph-mon[35401]: pgmap v8935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:19.454 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:19 smithi076 ceph-mon[35401]: pgmap v8936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:19 smithi040 ceph-mon[32397]: pgmap v8936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:19 smithi146 ceph-mon[35807]: pgmap v8936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:21 smithi040 ceph-mon[32397]: pgmap v8937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:21 smithi146 ceph-mon[35807]: pgmap v8937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:21 smithi076 ceph-mon[35401]: pgmap v8937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12428.313629 secs 2024-07-26T17:00:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12428.313629 secs 2024-07-26T17:00:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12428.313629 secs 2024-07-26T17:00:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:23 smithi040 ceph-mon[32397]: pgmap v8938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:23 smithi146 ceph-mon[35807]: pgmap v8938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:23 smithi076 ceph-mon[35401]: pgmap v8938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:25 smithi040 ceph-mon[32397]: pgmap v8939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:25 smithi146 ceph-mon[35807]: pgmap v8939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:25 smithi076 ceph-mon[35401]: pgmap v8939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12433.313759 secs 2024-07-26T17:00:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:27 smithi040 ceph-mon[32397]: pgmap v8940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12433.313759 secs 2024-07-26T17:00:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:27 smithi146 ceph-mon[35807]: pgmap v8940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12433.313759 secs 2024-07-26T17:00:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:27 smithi076 ceph-mon[35401]: pgmap v8940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:29 smithi040 ceph-mon[32397]: pgmap v8941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:29 smithi146 ceph-mon[35807]: pgmap v8941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:29 smithi076 ceph-mon[35401]: pgmap v8941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:30 smithi040 ceph-mon[32397]: pgmap v8942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:30 smithi146 ceph-mon[35807]: pgmap v8942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:30 smithi076 ceph-mon[35401]: pgmap v8942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12438.313920 secs 2024-07-26T17:00:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12438.313920 secs 2024-07-26T17:00:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12438.313920 secs 2024-07-26T17:00:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:32 smithi040 ceph-mon[32397]: pgmap v8943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:32 smithi146 ceph-mon[35807]: pgmap v8943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:32 smithi076 ceph-mon[35401]: pgmap v8943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:35 smithi146 ceph-mon[35807]: pgmap v8944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:35 smithi076 ceph-mon[35401]: pgmap v8944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:35 smithi040 ceph-mon[32397]: pgmap v8944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12443.314082 secs 2024-07-26T17:00:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:37 smithi076 ceph-mon[35401]: pgmap v8945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12443.314082 secs 2024-07-26T17:00:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:37 smithi040 ceph-mon[32397]: pgmap v8945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12443.314082 secs 2024-07-26T17:00:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:37 smithi146 ceph-mon[35807]: pgmap v8945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:39 smithi076 ceph-mon[35401]: pgmap v8946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:39 smithi040 ceph-mon[32397]: pgmap v8946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:39 smithi146 ceph-mon[35807]: pgmap v8946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:41.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:41 smithi040 ceph-mon[32397]: pgmap v8947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:41 smithi146 ceph-mon[35807]: pgmap v8947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:41 smithi076 ceph-mon[35401]: pgmap v8947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12448.314246 secs 2024-07-26T17:00:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12448.314246 secs 2024-07-26T17:00:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12448.314246 secs 2024-07-26T17:00:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:43 smithi040 ceph-mon[32397]: pgmap v8948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:43 smithi146 ceph-mon[35807]: pgmap v8948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:43 smithi076 ceph-mon[35401]: pgmap v8948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:45 smithi040 ceph-mon[32397]: pgmap v8949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:45 smithi146 ceph-mon[35807]: pgmap v8949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:45 smithi076 ceph-mon[35401]: pgmap v8949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12453.314383 secs 2024-07-26T17:00:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:47 smithi040 ceph-mon[32397]: pgmap v8950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12453.314383 secs 2024-07-26T17:00:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:47 smithi146 ceph-mon[35807]: pgmap v8950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12453.314383 secs 2024-07-26T17:00:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:47 smithi076 ceph-mon[35401]: pgmap v8950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:49 smithi040 ceph-mon[32397]: pgmap v8951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:49 smithi146 ceph-mon[35807]: pgmap v8951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:49 smithi076 ceph-mon[35401]: pgmap v8951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:51 smithi040 ceph-mon[32397]: pgmap v8952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:51.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:51 smithi146 ceph-mon[35807]: pgmap v8952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:51 smithi076 ceph-mon[35401]: pgmap v8952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12458.314518 secs 2024-07-26T17:00:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12458.314518 secs 2024-07-26T17:00:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12458.314518 secs 2024-07-26T17:00:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:53 smithi040 ceph-mon[32397]: pgmap v8953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:53 smithi146 ceph-mon[35807]: pgmap v8953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:53 smithi076 ceph-mon[35401]: pgmap v8953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:55 smithi040 ceph-mon[32397]: pgmap v8954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:55 smithi146 ceph-mon[35807]: pgmap v8954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:55 smithi076 ceph-mon[35401]: pgmap v8954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:00:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12463.314677 secs 2024-07-26T17:00:57.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:57 smithi040 ceph-mon[32397]: pgmap v8955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12463.314677 secs 2024-07-26T17:00:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:57 smithi146 ceph-mon[35807]: pgmap v8955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12463.314677 secs 2024-07-26T17:00:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:57 smithi076 ceph-mon[35401]: pgmap v8955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:00:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:00:59 smithi040 ceph-mon[32397]: pgmap v8956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:00:59 smithi146 ceph-mon[35807]: pgmap v8956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:00:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:00:59 smithi076 ceph-mon[35401]: pgmap v8956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:01 smithi040 ceph-mon[32397]: pgmap v8957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:01 smithi146 ceph-mon[35807]: pgmap v8957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:01 smithi076 ceph-mon[35401]: pgmap v8957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12468.314825 secs 2024-07-26T17:01:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12468.314825 secs 2024-07-26T17:01:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12468.314825 secs 2024-07-26T17:01:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:03 smithi040 ceph-mon[32397]: pgmap v8958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:03 smithi146 ceph-mon[35807]: pgmap v8958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:03 smithi076 ceph-mon[35401]: pgmap v8958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:05 smithi040 ceph-mon[32397]: pgmap v8959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:05 smithi146 ceph-mon[35807]: pgmap v8959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:05 smithi076 ceph-mon[35401]: pgmap v8959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12473.314967 secs 2024-07-26T17:01:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:07 smithi040 ceph-mon[32397]: pgmap v8960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12473.314967 secs 2024-07-26T17:01:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:07 smithi146 ceph-mon[35807]: pgmap v8960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12473.314967 secs 2024-07-26T17:01:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:07 smithi076 ceph-mon[35401]: pgmap v8960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:09 smithi040 ceph-mon[32397]: pgmap v8961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:09 smithi146 ceph-mon[35807]: pgmap v8961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:09 smithi076 ceph-mon[35401]: pgmap v8961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:10 smithi040 ceph-mon[32397]: pgmap v8962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:10 smithi146 ceph-mon[35807]: pgmap v8962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:10 smithi076 ceph-mon[35401]: pgmap v8962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12478.315112 secs 2024-07-26T17:01:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12478.315112 secs 2024-07-26T17:01:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12478.315112 secs 2024-07-26T17:01:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:12 smithi040 ceph-mon[32397]: pgmap v8963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:12 smithi146 ceph-mon[35807]: pgmap v8963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:12 smithi076 ceph-mon[35401]: pgmap v8963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:15 smithi040 ceph-mon[32397]: pgmap v8964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:15 smithi146 ceph-mon[35807]: pgmap v8964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:15 smithi076 ceph-mon[35401]: pgmap v8964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12483.315251 secs 2024-07-26T17:01:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:17 smithi040 ceph-mon[32397]: pgmap v8965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12483.315251 secs 2024-07-26T17:01:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:17 smithi146 ceph-mon[35807]: pgmap v8965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12483.315251 secs 2024-07-26T17:01:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:17 smithi076 ceph-mon[35401]: pgmap v8965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:19 smithi040 ceph-mon[32397]: pgmap v8966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:19 smithi146 ceph-mon[35807]: pgmap v8966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:19 smithi076 ceph-mon[35401]: pgmap v8966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:21 smithi040 ceph-mon[32397]: pgmap v8967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:21 smithi146 ceph-mon[35807]: pgmap v8967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:21 smithi076 ceph-mon[35401]: pgmap v8967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12488.315392 secs 2024-07-26T17:01:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12488.315392 secs 2024-07-26T17:01:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12488.315392 secs 2024-07-26T17:01:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:23 smithi040 ceph-mon[32397]: pgmap v8968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:23 smithi146 ceph-mon[35807]: pgmap v8968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:23 smithi076 ceph-mon[35401]: pgmap v8968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:25 smithi040 ceph-mon[32397]: pgmap v8969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:25 smithi146 ceph-mon[35807]: pgmap v8969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:25 smithi076 ceph-mon[35401]: pgmap v8969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12493.315525 secs 2024-07-26T17:01:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:27 smithi040 ceph-mon[32397]: pgmap v8970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12493.315525 secs 2024-07-26T17:01:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:27 smithi146 ceph-mon[35807]: pgmap v8970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12493.315525 secs 2024-07-26T17:01:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:27 smithi076 ceph-mon[35401]: pgmap v8970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:29 smithi040 ceph-mon[32397]: pgmap v8971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:29 smithi146 ceph-mon[35807]: pgmap v8971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:29 smithi076 ceph-mon[35401]: pgmap v8971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:31 smithi146 ceph-mon[35807]: pgmap v8972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:31 smithi040 ceph-mon[32397]: pgmap v8972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:31 smithi076 ceph-mon[35401]: pgmap v8972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12498.315673 secs 2024-07-26T17:01:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12498.315673 secs 2024-07-26T17:01:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12498.315673 secs 2024-07-26T17:01:33.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:33 smithi040 ceph-mon[32397]: pgmap v8973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:33 smithi146 ceph-mon[35807]: pgmap v8973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:33 smithi076 ceph-mon[35401]: pgmap v8973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:35 smithi040 ceph-mon[32397]: pgmap v8974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:35 smithi146 ceph-mon[35807]: pgmap v8974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:35 smithi076 ceph-mon[35401]: pgmap v8974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12503.315808 secs 2024-07-26T17:01:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:37 smithi040 ceph-mon[32397]: pgmap v8975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12503.315808 secs 2024-07-26T17:01:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:37 smithi146 ceph-mon[35807]: pgmap v8975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12503.315808 secs 2024-07-26T17:01:37.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:37 smithi076 ceph-mon[35401]: pgmap v8975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:39 smithi040 ceph-mon[32397]: pgmap v8976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:39 smithi146 ceph-mon[35807]: pgmap v8976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:39 smithi076 ceph-mon[35401]: pgmap v8976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:41 smithi040 ceph-mon[32397]: pgmap v8977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:41 smithi146 ceph-mon[35807]: pgmap v8977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:41 smithi076 ceph-mon[35401]: pgmap v8977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12508.315963 secs 2024-07-26T17:01:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12508.315963 secs 2024-07-26T17:01:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12508.315963 secs 2024-07-26T17:01:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:43 smithi040 ceph-mon[32397]: pgmap v8978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:43 smithi146 ceph-mon[35807]: pgmap v8978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:43 smithi076 ceph-mon[35401]: pgmap v8978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:44 smithi040 ceph-mon[32397]: pgmap v8979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:44 smithi146 ceph-mon[35807]: pgmap v8979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:44 smithi076 ceph-mon[35401]: pgmap v8979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12513.316104 secs 2024-07-26T17:01:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:47 smithi040 ceph-mon[32397]: pgmap v8980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12513.316104 secs 2024-07-26T17:01:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:47 smithi146 ceph-mon[35807]: pgmap v8980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12513.316104 secs 2024-07-26T17:01:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:47 smithi076 ceph-mon[35401]: pgmap v8980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:49 smithi040 ceph-mon[32397]: pgmap v8981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:49 smithi146 ceph-mon[35807]: pgmap v8981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:49 smithi076 ceph-mon[35401]: pgmap v8981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:51 smithi040 ceph-mon[32397]: pgmap v8982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:51 smithi146 ceph-mon[35807]: pgmap v8982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:51 smithi076 ceph-mon[35401]: pgmap v8982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12518.316309 secs 2024-07-26T17:01:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12518.316309 secs 2024-07-26T17:01:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12518.316309 secs 2024-07-26T17:01:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:53 smithi040 ceph-mon[32397]: pgmap v8983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:53 smithi146 ceph-mon[35807]: pgmap v8983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:53 smithi076 ceph-mon[35401]: pgmap v8983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:55 smithi040 ceph-mon[32397]: pgmap v8984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:55 smithi146 ceph-mon[35807]: pgmap v8984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:55 smithi076 ceph-mon[35401]: pgmap v8984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:01:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12523.316448 secs 2024-07-26T17:01:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:57 smithi040 ceph-mon[32397]: pgmap v8985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12523.316448 secs 2024-07-26T17:01:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:57 smithi146 ceph-mon[35807]: pgmap v8985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12523.316448 secs 2024-07-26T17:01:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:57 smithi076 ceph-mon[35401]: pgmap v8985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:01:59.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:01:59 smithi040 ceph-mon[32397]: pgmap v8986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:01:59 smithi146 ceph-mon[35807]: pgmap v8986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:01:59.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:01:59 smithi076 ceph-mon[35401]: pgmap v8986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:01 smithi040 ceph-mon[32397]: pgmap v8987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:01 smithi146 ceph-mon[35807]: pgmap v8987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:01 smithi076 ceph-mon[35401]: pgmap v8987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12528.316596 secs 2024-07-26T17:02:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12528.316596 secs 2024-07-26T17:02:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12528.316596 secs 2024-07-26T17:02:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:03 smithi040 ceph-mon[32397]: pgmap v8988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:03 smithi146 ceph-mon[35807]: pgmap v8988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:03 smithi076 ceph-mon[35401]: pgmap v8988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:05 smithi040 ceph-mon[32397]: pgmap v8989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:05 smithi146 ceph-mon[35807]: pgmap v8989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:05 smithi076 ceph-mon[35401]: pgmap v8989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12533.316734 secs 2024-07-26T17:02:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:07 smithi040 ceph-mon[32397]: pgmap v8990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12533.316734 secs 2024-07-26T17:02:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:07 smithi146 ceph-mon[35807]: pgmap v8990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12533.316734 secs 2024-07-26T17:02:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:07 smithi076 ceph-mon[35401]: pgmap v8990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:09 smithi040 ceph-mon[32397]: pgmap v8991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:09 smithi146 ceph-mon[35807]: pgmap v8991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:09 smithi076 ceph-mon[35401]: pgmap v8991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:10 smithi146 ceph-mon[35807]: pgmap v8992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:10 smithi076 ceph-mon[35401]: pgmap v8992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:10 smithi040 ceph-mon[32397]: pgmap v8992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12538.316872 secs 2024-07-26T17:02:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12538.316872 secs 2024-07-26T17:02:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12538.316872 secs 2024-07-26T17:02:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:12 smithi040 ceph-mon[32397]: pgmap v8993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:12 smithi146 ceph-mon[35807]: pgmap v8993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:12 smithi076 ceph-mon[35401]: pgmap v8993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:15 smithi040 ceph-mon[32397]: pgmap v8994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:15 smithi146 ceph-mon[35807]: pgmap v8994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:15 smithi076 ceph-mon[35401]: pgmap v8994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12543.317002 secs 2024-07-26T17:02:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:17 smithi040 ceph-mon[32397]: pgmap v8995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12543.317002 secs 2024-07-26T17:02:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:17 smithi146 ceph-mon[35807]: pgmap v8995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12543.317002 secs 2024-07-26T17:02:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:17 smithi076 ceph-mon[35401]: pgmap v8995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:19 smithi040 ceph-mon[32397]: pgmap v8996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:19 smithi146 ceph-mon[35807]: pgmap v8996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:19 smithi076 ceph-mon[35401]: pgmap v8996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:21 smithi040 ceph-mon[32397]: pgmap v8997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:21 smithi146 ceph-mon[35807]: pgmap v8997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:21 smithi076 ceph-mon[35401]: pgmap v8997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12548.317150 secs 2024-07-26T17:02:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12548.317150 secs 2024-07-26T17:02:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12548.317150 secs 2024-07-26T17:02:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:23 smithi040 ceph-mon[32397]: pgmap v8998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:23 smithi146 ceph-mon[35807]: pgmap v8998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:23 smithi076 ceph-mon[35401]: pgmap v8998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:25 smithi040 ceph-mon[32397]: pgmap v8999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:25 smithi146 ceph-mon[35807]: pgmap v8999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:25 smithi076 ceph-mon[35401]: pgmap v8999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12553.317328 secs 2024-07-26T17:02:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:27 smithi040 ceph-mon[32397]: pgmap v9000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12553.317328 secs 2024-07-26T17:02:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:27 smithi146 ceph-mon[35807]: pgmap v9000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12553.317328 secs 2024-07-26T17:02:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:27 smithi076 ceph-mon[35401]: pgmap v9000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:29 smithi040 ceph-mon[32397]: pgmap v9001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:29 smithi146 ceph-mon[35807]: pgmap v9001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:29 smithi076 ceph-mon[35401]: pgmap v9001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:31 smithi040 ceph-mon[32397]: pgmap v9002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:31 smithi146 ceph-mon[35807]: pgmap v9002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:31 smithi076 ceph-mon[35401]: pgmap v9002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12558.317478 secs 2024-07-26T17:02:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12558.317478 secs 2024-07-26T17:02:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12558.317478 secs 2024-07-26T17:02:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:33 smithi040 ceph-mon[32397]: pgmap v9003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:33 smithi146 ceph-mon[35807]: pgmap v9003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:33 smithi076 ceph-mon[35401]: pgmap v9003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:35 smithi040 ceph-mon[32397]: pgmap v9004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:35 smithi146 ceph-mon[35807]: pgmap v9004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:35 smithi076 ceph-mon[35401]: pgmap v9004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12563.317624 secs 2024-07-26T17:02:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:37 smithi040 ceph-mon[32397]: pgmap v9005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12563.317624 secs 2024-07-26T17:02:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:37 smithi146 ceph-mon[35807]: pgmap v9005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12563.317624 secs 2024-07-26T17:02:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:37 smithi076 ceph-mon[35401]: pgmap v9005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:39 smithi040 ceph-mon[32397]: pgmap v9006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:39 smithi146 ceph-mon[35807]: pgmap v9006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:39 smithi076 ceph-mon[35401]: pgmap v9006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:40 smithi146 ceph-mon[35807]: pgmap v9007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:40.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:40 smithi076 ceph-mon[35401]: pgmap v9007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:40 smithi040 ceph-mon[32397]: pgmap v9007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12568.317773 secs 2024-07-26T17:02:41.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12568.317773 secs 2024-07-26T17:02:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12568.317773 secs 2024-07-26T17:02:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:42 smithi040 ceph-mon[32397]: pgmap v9008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:42 smithi146 ceph-mon[35807]: pgmap v9008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:42 smithi076 ceph-mon[35401]: pgmap v9008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:45 smithi040 ceph-mon[32397]: pgmap v9009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:45 smithi146 ceph-mon[35807]: pgmap v9009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:45 smithi076 ceph-mon[35401]: pgmap v9009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12573.317937 secs 2024-07-26T17:02:47.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:47 smithi040 ceph-mon[32397]: pgmap v9010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12573.317937 secs 2024-07-26T17:02:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:47 smithi146 ceph-mon[35807]: pgmap v9010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12573.317937 secs 2024-07-26T17:02:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:47 smithi076 ceph-mon[35401]: pgmap v9010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:49 smithi040 ceph-mon[32397]: pgmap v9011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:49 smithi146 ceph-mon[35807]: pgmap v9011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:49.601 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:49 smithi076 ceph-mon[35401]: pgmap v9011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:51 smithi040 ceph-mon[32397]: pgmap v9012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:51 smithi146 ceph-mon[35807]: pgmap v9012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:51 smithi076 ceph-mon[35401]: pgmap v9012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12578.318069 secs 2024-07-26T17:02:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12578.318069 secs 2024-07-26T17:02:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12578.318069 secs 2024-07-26T17:02:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:53 smithi040 ceph-mon[32397]: pgmap v9013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:53 smithi146 ceph-mon[35807]: pgmap v9013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:53 smithi076 ceph-mon[35401]: pgmap v9013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:55 smithi040 ceph-mon[32397]: pgmap v9014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:55 smithi146 ceph-mon[35807]: pgmap v9014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:55 smithi076 ceph-mon[35401]: pgmap v9014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:02:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12583.318203 secs 2024-07-26T17:02:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:57 smithi040 ceph-mon[32397]: pgmap v9015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12583.318203 secs 2024-07-26T17:02:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:57 smithi146 ceph-mon[35807]: pgmap v9015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12583.318203 secs 2024-07-26T17:02:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:57 smithi076 ceph-mon[35401]: pgmap v9015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:02:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:02:59 smithi040 ceph-mon[32397]: pgmap v9016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:02:59 smithi146 ceph-mon[35807]: pgmap v9016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:02:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:02:59 smithi076 ceph-mon[35401]: pgmap v9016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:01 smithi040 ceph-mon[32397]: pgmap v9017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:01 smithi146 ceph-mon[35807]: pgmap v9017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:01 smithi076 ceph-mon[35401]: pgmap v9017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12588.318347 secs 2024-07-26T17:03:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12588.318347 secs 2024-07-26T17:03:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12588.318347 secs 2024-07-26T17:03:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:03 smithi040 ceph-mon[32397]: pgmap v9018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:03 smithi146 ceph-mon[35807]: pgmap v9018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:03 smithi076 ceph-mon[35401]: pgmap v9018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:05.575 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:05 smithi146 ceph-mon[35807]: pgmap v9019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:05 smithi076 ceph-mon[35401]: pgmap v9019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:05 smithi040 ceph-mon[32397]: pgmap v9019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:06 smithi146 ceph-mon[35807]: pgmap v9020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:06 smithi076 ceph-mon[35401]: pgmap v9020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:06 smithi040 ceph-mon[32397]: pgmap v9020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12593.318481 secs 2024-07-26T17:03:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12593.318481 secs 2024-07-26T17:03:07.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12593.318481 secs 2024-07-26T17:03:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:08 smithi146 ceph-mon[35807]: pgmap v9021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:08 smithi076 ceph-mon[35401]: pgmap v9021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:08 smithi040 ceph-mon[32397]: pgmap v9021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:11 smithi040 ceph-mon[32397]: pgmap v9022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:11 smithi146 ceph-mon[35807]: pgmap v9022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:11 smithi076 ceph-mon[35401]: pgmap v9022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12598.318622 secs 2024-07-26T17:03:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12598.318622 secs 2024-07-26T17:03:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12598.318622 secs 2024-07-26T17:03:13.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:13 smithi040 ceph-mon[32397]: pgmap v9023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:13 smithi146 ceph-mon[35807]: pgmap v9023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:13 smithi076 ceph-mon[35401]: pgmap v9023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:15.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:15 smithi040 ceph-mon[32397]: pgmap v9024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:15 smithi146 ceph-mon[35807]: pgmap v9024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:15 smithi076 ceph-mon[35401]: pgmap v9024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12603.318749 secs 2024-07-26T17:03:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:17 smithi040 ceph-mon[32397]: pgmap v9025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12603.318749 secs 2024-07-26T17:03:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:17 smithi146 ceph-mon[35807]: pgmap v9025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12603.318749 secs 2024-07-26T17:03:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:17 smithi076 ceph-mon[35401]: pgmap v9025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:19 smithi040 ceph-mon[32397]: pgmap v9026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:19 smithi146 ceph-mon[35807]: pgmap v9026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:19 smithi076 ceph-mon[35401]: pgmap v9026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:21 smithi040 ceph-mon[32397]: pgmap v9027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:21 smithi146 ceph-mon[35807]: pgmap v9027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:21 smithi076 ceph-mon[35401]: pgmap v9027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12608.318925 secs 2024-07-26T17:03:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12608.318925 secs 2024-07-26T17:03:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12608.318925 secs 2024-07-26T17:03:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:23 smithi040 ceph-mon[32397]: pgmap v9028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:23 smithi146 ceph-mon[35807]: pgmap v9028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:23 smithi076 ceph-mon[35401]: pgmap v9028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:25 smithi146 ceph-mon[35807]: pgmap v9029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:25 smithi076 ceph-mon[35401]: pgmap v9029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:25 smithi040 ceph-mon[32397]: pgmap v9029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12613.319063 secs 2024-07-26T17:03:26.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:26 smithi040 ceph-mon[32397]: pgmap v9030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12613.319063 secs 2024-07-26T17:03:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:26 smithi146 ceph-mon[35807]: pgmap v9030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12613.319063 secs 2024-07-26T17:03:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:26 smithi076 ceph-mon[35401]: pgmap v9030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:29 smithi040 ceph-mon[32397]: pgmap v9031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:29.525 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:29 smithi146 ceph-mon[35807]: pgmap v9031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:29 smithi076 ceph-mon[35401]: pgmap v9031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:31 smithi040 ceph-mon[32397]: pgmap v9032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:31 smithi146 ceph-mon[35807]: pgmap v9032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:31 smithi076 ceph-mon[35401]: pgmap v9032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12618.319200 secs 2024-07-26T17:03:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12618.319200 secs 2024-07-26T17:03:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12618.319200 secs 2024-07-26T17:03:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:33 smithi040 ceph-mon[32397]: pgmap v9033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:33 smithi146 ceph-mon[35807]: pgmap v9033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:33 smithi076 ceph-mon[35401]: pgmap v9033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:35 smithi040 ceph-mon[32397]: pgmap v9034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:35 smithi146 ceph-mon[35807]: pgmap v9034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:35 smithi076 ceph-mon[35401]: pgmap v9034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12623.319338 secs 2024-07-26T17:03:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:37 smithi040 ceph-mon[32397]: pgmap v9035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12623.319338 secs 2024-07-26T17:03:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:37 smithi146 ceph-mon[35807]: pgmap v9035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12623.319338 secs 2024-07-26T17:03:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:37 smithi076 ceph-mon[35401]: pgmap v9035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:39 smithi040 ceph-mon[32397]: pgmap v9036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:39 smithi146 ceph-mon[35807]: pgmap v9036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:39 smithi076 ceph-mon[35401]: pgmap v9036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:41 smithi040 ceph-mon[32397]: pgmap v9037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:41 smithi146 ceph-mon[35807]: pgmap v9037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:41 smithi076 ceph-mon[35401]: pgmap v9037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12628.319477 secs 2024-07-26T17:03:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12628.319477 secs 2024-07-26T17:03:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12628.319477 secs 2024-07-26T17:03:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:43 smithi146 ceph-mon[35807]: pgmap v9038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:43 smithi076 ceph-mon[35401]: pgmap v9038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:43 smithi040 ceph-mon[32397]: pgmap v9038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:44 smithi146 ceph-mon[35807]: pgmap v9039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:44 smithi076 ceph-mon[35401]: pgmap v9039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:44 smithi040 ceph-mon[32397]: pgmap v9039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12633.319608 secs 2024-07-26T17:03:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:47 smithi040 ceph-mon[32397]: pgmap v9040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12633.319608 secs 2024-07-26T17:03:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:47 smithi146 ceph-mon[35807]: pgmap v9040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12633.319608 secs 2024-07-26T17:03:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:47 smithi076 ceph-mon[35401]: pgmap v9040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:49 smithi040 ceph-mon[32397]: pgmap v9041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:49 smithi146 ceph-mon[35807]: pgmap v9041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:49 smithi076 ceph-mon[35401]: pgmap v9041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:51 smithi040 ceph-mon[32397]: pgmap v9042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:51 smithi146 ceph-mon[35807]: pgmap v9042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:51 smithi076 ceph-mon[35401]: pgmap v9042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12638.319759 secs 2024-07-26T17:03:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12638.319759 secs 2024-07-26T17:03:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12638.319759 secs 2024-07-26T17:03:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:53 smithi040 ceph-mon[32397]: pgmap v9043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:53 smithi146 ceph-mon[35807]: pgmap v9043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:53 smithi076 ceph-mon[35401]: pgmap v9043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:55 smithi040 ceph-mon[32397]: pgmap v9044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:55 smithi146 ceph-mon[35807]: pgmap v9044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:55 smithi076 ceph-mon[35401]: pgmap v9044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:03:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12643.319909 secs 2024-07-26T17:03:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:57 smithi146 ceph-mon[35807]: pgmap v9045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12643.319909 secs 2024-07-26T17:03:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:57 smithi076 ceph-mon[35401]: pgmap v9045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12643.319909 secs 2024-07-26T17:03:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:57 smithi040 ceph-mon[32397]: pgmap v9045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:03:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:03:59 smithi146 ceph-mon[35807]: pgmap v9046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:03:59 smithi076 ceph-mon[35401]: pgmap v9046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:03:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:03:59 smithi040 ceph-mon[32397]: pgmap v9046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:01 smithi146 ceph-mon[35807]: pgmap v9047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:01 smithi076 ceph-mon[35401]: pgmap v9047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:01 smithi040 ceph-mon[32397]: pgmap v9047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12648.320048 secs 2024-07-26T17:04:02.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:02 smithi146 ceph-mon[35807]: pgmap v9048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12648.320048 secs 2024-07-26T17:04:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:02 smithi076 ceph-mon[35401]: pgmap v9048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12648.320048 secs 2024-07-26T17:04:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:02 smithi040 ceph-mon[32397]: pgmap v9048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:05 smithi040 ceph-mon[32397]: pgmap v9049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:05 smithi146 ceph-mon[35807]: pgmap v9049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:05 smithi076 ceph-mon[35401]: pgmap v9049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12653.320206 secs 2024-07-26T17:04:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:07 smithi040 ceph-mon[32397]: pgmap v9050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:07.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12653.320206 secs 2024-07-26T17:04:07.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:07 smithi146 ceph-mon[35807]: pgmap v9050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12653.320206 secs 2024-07-26T17:04:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:07 smithi076 ceph-mon[35401]: pgmap v9050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:09 smithi040 ceph-mon[32397]: pgmap v9051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:09 smithi146 ceph-mon[35807]: pgmap v9051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:09 smithi076 ceph-mon[35401]: pgmap v9051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:11 smithi040 ceph-mon[32397]: pgmap v9052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:11 smithi146 ceph-mon[35807]: pgmap v9052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:11 smithi076 ceph-mon[35401]: pgmap v9052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12658.320350 secs 2024-07-26T17:04:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12658.320350 secs 2024-07-26T17:04:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12658.320350 secs 2024-07-26T17:04:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:13 smithi146 ceph-mon[35807]: pgmap v9053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:13 smithi076 ceph-mon[35401]: pgmap v9053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:13 smithi040 ceph-mon[32397]: pgmap v9053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:15 smithi146 ceph-mon[35807]: pgmap v9054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:15 smithi076 ceph-mon[35401]: pgmap v9054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:15 smithi040 ceph-mon[32397]: pgmap v9054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:16 smithi146 ceph-mon[35807]: pgmap v9055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:16 smithi076 ceph-mon[35401]: pgmap v9055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:16 smithi040 ceph-mon[32397]: pgmap v9055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12663.320488 secs 2024-07-26T17:04:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12663.320488 secs 2024-07-26T17:04:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12663.320488 secs 2024-07-26T17:04:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:18 smithi146 ceph-mon[35807]: pgmap v9056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:18 smithi076 ceph-mon[35401]: pgmap v9056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:18 smithi040 ceph-mon[32397]: pgmap v9056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:21 smithi040 ceph-mon[32397]: pgmap v9057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:21 smithi146 ceph-mon[35807]: pgmap v9057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:21 smithi076 ceph-mon[35401]: pgmap v9057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12668.320629 secs 2024-07-26T17:04:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12668.320629 secs 2024-07-26T17:04:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12668.320629 secs 2024-07-26T17:04:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:23 smithi040 ceph-mon[32397]: pgmap v9058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:23 smithi146 ceph-mon[35807]: pgmap v9058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:23 smithi076 ceph-mon[35401]: pgmap v9058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:25 smithi146 ceph-mon[35807]: pgmap v9059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:25 smithi076 ceph-mon[35401]: pgmap v9059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:25 smithi040 ceph-mon[32397]: pgmap v9059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12673.320800 secs 2024-07-26T17:04:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:27 smithi146 ceph-mon[35807]: pgmap v9060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12673.320800 secs 2024-07-26T17:04:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:27 smithi076 ceph-mon[35401]: pgmap v9060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12673.320800 secs 2024-07-26T17:04:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:27 smithi040 ceph-mon[32397]: pgmap v9060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:29 smithi146 ceph-mon[35807]: pgmap v9061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:29 smithi076 ceph-mon[35401]: pgmap v9061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:29 smithi040 ceph-mon[32397]: pgmap v9061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:30 smithi146 ceph-mon[35807]: pgmap v9062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:30 smithi076 ceph-mon[35401]: pgmap v9062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:30 smithi040 ceph-mon[32397]: pgmap v9062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12678.320946 secs 2024-07-26T17:04:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12678.320946 secs 2024-07-26T17:04:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12678.320946 secs 2024-07-26T17:04:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:32 smithi040 ceph-mon[32397]: pgmap v9063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:32 smithi146 ceph-mon[35807]: pgmap v9063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:32 smithi076 ceph-mon[35401]: pgmap v9063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:35 smithi040 ceph-mon[32397]: pgmap v9064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:35 smithi146 ceph-mon[35807]: pgmap v9064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:35 smithi076 ceph-mon[35401]: pgmap v9064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12683.321100 secs 2024-07-26T17:04:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:37 smithi040 ceph-mon[32397]: pgmap v9065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12683.321100 secs 2024-07-26T17:04:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:37 smithi146 ceph-mon[35807]: pgmap v9065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12683.321100 secs 2024-07-26T17:04:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:37 smithi076 ceph-mon[35401]: pgmap v9065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:39 smithi146 ceph-mon[35807]: pgmap v9066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:39 smithi076 ceph-mon[35401]: pgmap v9066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:39 smithi040 ceph-mon[32397]: pgmap v9066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:41 smithi146 ceph-mon[35807]: pgmap v9067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:41 smithi076 ceph-mon[35401]: pgmap v9067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:41 smithi040 ceph-mon[32397]: pgmap v9067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12688.321242 secs 2024-07-26T17:04:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12688.321242 secs 2024-07-26T17:04:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12688.321242 secs 2024-07-26T17:04:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:43 smithi146 ceph-mon[35807]: pgmap v9068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:43 smithi076 ceph-mon[35401]: pgmap v9068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:43 smithi040 ceph-mon[32397]: pgmap v9068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:44 smithi146 ceph-mon[35807]: pgmap v9069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:44 smithi076 ceph-mon[35401]: pgmap v9069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:44 smithi040 ceph-mon[32397]: pgmap v9069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12693.321399 secs 2024-07-26T17:04:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:47 smithi040 ceph-mon[32397]: pgmap v9070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:04:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12693.321399 secs 2024-07-26T17:04:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:47 smithi146 ceph-mon[35807]: pgmap v9070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:04:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12693.321399 secs 2024-07-26T17:04:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:47 smithi076 ceph-mon[35401]: pgmap v9070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:04:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:49 smithi146 ceph-mon[35807]: pgmap v9071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:49 smithi076 ceph-mon[35401]: pgmap v9071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:49 smithi040 ceph-mon[32397]: pgmap v9071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:04:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:51 smithi146 ceph-mon[35807]: pgmap v9072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:51 smithi076 ceph-mon[35401]: pgmap v9072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:51 smithi040 ceph-mon[32397]: pgmap v9072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12698.321544 secs 2024-07-26T17:04:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12698.321544 secs 2024-07-26T17:04:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12698.321544 secs 2024-07-26T17:04:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:53 smithi146 ceph-mon[35807]: pgmap v9073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:53 smithi076 ceph-mon[35401]: pgmap v9073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:53 smithi040 ceph-mon[32397]: pgmap v9073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:54 smithi146 ceph-mon[35807]: pgmap v9074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:54 smithi076 ceph-mon[35401]: pgmap v9074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:54 smithi040 ceph-mon[32397]: pgmap v9074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:04:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12703.321670 secs 2024-07-26T17:04:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:57 smithi146 ceph-mon[35807]: pgmap v9075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12703.321670 secs 2024-07-26T17:04:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:57 smithi076 ceph-mon[35401]: pgmap v9075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12703.321670 secs 2024-07-26T17:04:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:57 smithi040 ceph-mon[32397]: pgmap v9075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:04:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:04:59 smithi146 ceph-mon[35807]: pgmap v9076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:04:59 smithi076 ceph-mon[35401]: pgmap v9076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:04:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:04:59 smithi040 ceph-mon[32397]: pgmap v9076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:01 smithi146 ceph-mon[35807]: pgmap v9077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:01 smithi076 ceph-mon[35401]: pgmap v9077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:01 smithi040 ceph-mon[32397]: pgmap v9077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12708.321817 secs 2024-07-26T17:05:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12708.321817 secs 2024-07-26T17:05:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12708.321817 secs 2024-07-26T17:05:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:03 smithi146 ceph-mon[35807]: pgmap v9078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:03 smithi076 ceph-mon[35401]: pgmap v9078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:03 smithi040 ceph-mon[32397]: pgmap v9078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:04 smithi146 ceph-mon[35807]: pgmap v9079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:04 smithi076 ceph-mon[35401]: pgmap v9079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:04 smithi040 ceph-mon[32397]: pgmap v9079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12713.321971 secs 2024-07-26T17:05:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:07 smithi146 ceph-mon[35807]: pgmap v9080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12713.321971 secs 2024-07-26T17:05:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:07 smithi076 ceph-mon[35401]: pgmap v9080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12713.321971 secs 2024-07-26T17:05:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:07 smithi040 ceph-mon[32397]: pgmap v9080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:09 smithi146 ceph-mon[35807]: pgmap v9081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:09 smithi076 ceph-mon[35401]: pgmap v9081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:09 smithi040 ceph-mon[32397]: pgmap v9081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:11 smithi146 ceph-mon[35807]: pgmap v9082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:11 smithi076 ceph-mon[35401]: pgmap v9082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:11 smithi040 ceph-mon[32397]: pgmap v9082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12718.322123 secs 2024-07-26T17:05:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12718.322123 secs 2024-07-26T17:05:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12718.322123 secs 2024-07-26T17:05:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:13 smithi146 ceph-mon[35807]: pgmap v9083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:13 smithi076 ceph-mon[35401]: pgmap v9083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:13 smithi040 ceph-mon[32397]: pgmap v9083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:14 smithi146 ceph-mon[35807]: pgmap v9084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:14 smithi076 ceph-mon[35401]: pgmap v9084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:14 smithi040 ceph-mon[32397]: pgmap v9084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12723.322322 secs 2024-07-26T17:05:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:17 smithi146 ceph-mon[35807]: pgmap v9085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12723.322322 secs 2024-07-26T17:05:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:17 smithi076 ceph-mon[35401]: pgmap v9085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12723.322322 secs 2024-07-26T17:05:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:17 smithi040 ceph-mon[32397]: pgmap v9085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:19 smithi146 ceph-mon[35807]: pgmap v9086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:19 smithi076 ceph-mon[35401]: pgmap v9086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:19 smithi040 ceph-mon[32397]: pgmap v9086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:21 smithi146 ceph-mon[35807]: pgmap v9087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:21 smithi076 ceph-mon[35401]: pgmap v9087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:21 smithi040 ceph-mon[32397]: pgmap v9087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:22.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12728.322462 secs 2024-07-26T17:05:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12728.322462 secs 2024-07-26T17:05:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12728.322462 secs 2024-07-26T17:05:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:23 smithi146 ceph-mon[35807]: pgmap v9088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:23 smithi076 ceph-mon[35401]: pgmap v9088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:23 smithi040 ceph-mon[32397]: pgmap v9088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:24 smithi146 ceph-mon[35807]: pgmap v9089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:24 smithi076 ceph-mon[35401]: pgmap v9089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:24 smithi040 ceph-mon[32397]: pgmap v9089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12733.322592 secs 2024-07-26T17:05:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:27 smithi146 ceph-mon[35807]: pgmap v9090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:05:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12733.322592 secs 2024-07-26T17:05:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:27 smithi076 ceph-mon[35401]: pgmap v9090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:05:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12733.322592 secs 2024-07-26T17:05:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:27 smithi040 ceph-mon[32397]: pgmap v9090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:05:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:29 smithi146 ceph-mon[35807]: pgmap v9091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:29 smithi076 ceph-mon[35401]: pgmap v9091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:29 smithi040 ceph-mon[32397]: pgmap v9091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:31 smithi146 ceph-mon[35807]: pgmap v9092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:31 smithi076 ceph-mon[35401]: pgmap v9092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:31 smithi040 ceph-mon[32397]: pgmap v9092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12738.322751 secs 2024-07-26T17:05:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:32 smithi146 ceph-mon[35807]: pgmap v9093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12738.322751 secs 2024-07-26T17:05:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:32 smithi076 ceph-mon[35401]: pgmap v9093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12738.322751 secs 2024-07-26T17:05:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:32 smithi040 ceph-mon[32397]: pgmap v9093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:35 smithi146 ceph-mon[35807]: pgmap v9094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:35 smithi076 ceph-mon[35401]: pgmap v9094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:35 smithi040 ceph-mon[32397]: pgmap v9094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:37.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12743.322923 secs 2024-07-26T17:05:37.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:37 smithi040 ceph-mon[32397]: pgmap v9095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12743.322923 secs 2024-07-26T17:05:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:37 smithi146 ceph-mon[35807]: pgmap v9095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12743.322923 secs 2024-07-26T17:05:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:37 smithi076 ceph-mon[35401]: pgmap v9095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:38 smithi076 ceph-mon[35401]: pgmap v9096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:38 smithi040 ceph-mon[32397]: pgmap v9096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:38 smithi146 ceph-mon[35807]: pgmap v9096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:41 smithi146 ceph-mon[35807]: pgmap v9097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:41 smithi076 ceph-mon[35401]: pgmap v9097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:41 smithi040 ceph-mon[32397]: pgmap v9097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12748.323019 secs 2024-07-26T17:05:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12748.323019 secs 2024-07-26T17:05:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12748.323019 secs 2024-07-26T17:05:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:43 smithi146 ceph-mon[35807]: pgmap v9098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:43 smithi076 ceph-mon[35401]: pgmap v9098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:43 smithi040 ceph-mon[32397]: pgmap v9098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:44 smithi146 ceph-mon[35807]: pgmap v9099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:44 smithi076 ceph-mon[35401]: pgmap v9099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:44 smithi040 ceph-mon[32397]: pgmap v9099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12753.323170 secs 2024-07-26T17:05:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:47 smithi146 ceph-mon[35807]: pgmap v9100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12753.323170 secs 2024-07-26T17:05:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:47 smithi076 ceph-mon[35401]: pgmap v9100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12753.323170 secs 2024-07-26T17:05:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:47 smithi040 ceph-mon[32397]: pgmap v9100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:48 smithi076 ceph-mon[35401]: pgmap v9101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:48 smithi040 ceph-mon[32397]: pgmap v9101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:48 smithi146 ceph-mon[35807]: pgmap v9101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:51 smithi146 ceph-mon[35807]: pgmap v9102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:51 smithi076 ceph-mon[35401]: pgmap v9102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:51 smithi040 ceph-mon[32397]: pgmap v9102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12758.323335 secs 2024-07-26T17:05:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12758.323335 secs 2024-07-26T17:05:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12758.323335 secs 2024-07-26T17:05:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:53 smithi146 ceph-mon[35807]: pgmap v9103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:53 smithi076 ceph-mon[35401]: pgmap v9103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:53 smithi040 ceph-mon[32397]: pgmap v9103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:54 smithi146 ceph-mon[35807]: pgmap v9104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:54 smithi076 ceph-mon[35401]: pgmap v9104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:54 smithi040 ceph-mon[32397]: pgmap v9104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:05:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12763.323477 secs 2024-07-26T17:05:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:57 smithi146 ceph-mon[35807]: pgmap v9105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12763.323477 secs 2024-07-26T17:05:57.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:57 smithi076 ceph-mon[35401]: pgmap v9105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12763.323477 secs 2024-07-26T17:05:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:57 smithi040 ceph-mon[32397]: pgmap v9105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:05:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:05:58 smithi146 ceph-mon[35807]: pgmap v9106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:05:58 smithi076 ceph-mon[35401]: pgmap v9106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:05:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:05:58 smithi040 ceph-mon[32397]: pgmap v9106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:00 smithi076 ceph-mon[35401]: pgmap v9107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:00 smithi040 ceph-mon[32397]: pgmap v9107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:00 smithi146 ceph-mon[35807]: pgmap v9107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12768.323612 secs 2024-07-26T17:06:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12768.323612 secs 2024-07-26T17:06:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12768.323612 secs 2024-07-26T17:06:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:02 smithi146 ceph-mon[35807]: pgmap v9108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:02 smithi076 ceph-mon[35401]: pgmap v9108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:02 smithi040 ceph-mon[32397]: pgmap v9108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:04 smithi076 ceph-mon[35401]: pgmap v9109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:04 smithi040 ceph-mon[32397]: pgmap v9109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:04 smithi146 ceph-mon[35807]: pgmap v9109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:06 smithi076 ceph-mon[35401]: pgmap v9110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:06 smithi040 ceph-mon[32397]: pgmap v9110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:06 smithi146 ceph-mon[35807]: pgmap v9110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12773.323755 secs 2024-07-26T17:06:07.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12773.323755 secs 2024-07-26T17:06:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12773.323755 secs 2024-07-26T17:06:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:08 smithi040 ceph-mon[32397]: pgmap v9111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:08 smithi146 ceph-mon[35807]: pgmap v9111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:08 smithi076 ceph-mon[35401]: pgmap v9111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:10 smithi076 ceph-mon[35401]: pgmap v9112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:10 smithi040 ceph-mon[32397]: pgmap v9112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:10 smithi146 ceph-mon[35807]: pgmap v9112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12778.323931 secs 2024-07-26T17:06:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12778.323931 secs 2024-07-26T17:06:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12778.323931 secs 2024-07-26T17:06:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:12 smithi146 ceph-mon[35807]: pgmap v9113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:12 smithi076 ceph-mon[35401]: pgmap v9113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:12 smithi040 ceph-mon[32397]: pgmap v9113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:14 smithi076 ceph-mon[35401]: pgmap v9114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:14 smithi040 ceph-mon[32397]: pgmap v9114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:14 smithi146 ceph-mon[35807]: pgmap v9114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:16 smithi076 ceph-mon[35401]: pgmap v9115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:16 smithi040 ceph-mon[32397]: pgmap v9115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:16 smithi146 ceph-mon[35807]: pgmap v9115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12783.324035 secs 2024-07-26T17:06:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12783.324035 secs 2024-07-26T17:06:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12783.324035 secs 2024-07-26T17:06:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:18 smithi040 ceph-mon[32397]: pgmap v9116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:18 smithi146 ceph-mon[35807]: pgmap v9116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:18 smithi076 ceph-mon[35401]: pgmap v9116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:20 smithi076 ceph-mon[35401]: pgmap v9117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:20 smithi040 ceph-mon[32397]: pgmap v9117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:20 smithi146 ceph-mon[35807]: pgmap v9117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12788.324177 secs 2024-07-26T17:06:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12788.324177 secs 2024-07-26T17:06:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12788.324177 secs 2024-07-26T17:06:22.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:22 smithi146 ceph-mon[35807]: pgmap v9118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:22 smithi076 ceph-mon[35401]: pgmap v9118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:22 smithi040 ceph-mon[32397]: pgmap v9118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:24 smithi076 ceph-mon[35401]: pgmap v9119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:24 smithi040 ceph-mon[32397]: pgmap v9119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:24 smithi146 ceph-mon[35807]: pgmap v9119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:26 smithi076 ceph-mon[35401]: pgmap v9120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:26 smithi040 ceph-mon[32397]: pgmap v9120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:26 smithi146 ceph-mon[35807]: pgmap v9120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12793.324354 secs 2024-07-26T17:06:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12793.324354 secs 2024-07-26T17:06:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12793.324354 secs 2024-07-26T17:06:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:28 smithi040 ceph-mon[32397]: pgmap v9121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:28 smithi146 ceph-mon[35807]: pgmap v9121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:28 smithi076 ceph-mon[35401]: pgmap v9121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:30 smithi076 ceph-mon[35401]: pgmap v9122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:30.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:30 smithi146 ceph-mon[35807]: pgmap v9122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:30 smithi040 ceph-mon[32397]: pgmap v9122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12798.324498 secs 2024-07-26T17:06:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12798.324498 secs 2024-07-26T17:06:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12798.324498 secs 2024-07-26T17:06:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:32 smithi146 ceph-mon[35807]: pgmap v9123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:32 smithi076 ceph-mon[35401]: pgmap v9123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:32 smithi040 ceph-mon[32397]: pgmap v9123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:34 smithi076 ceph-mon[35401]: pgmap v9124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:34 smithi040 ceph-mon[32397]: pgmap v9124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:34 smithi146 ceph-mon[35807]: pgmap v9124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:36 smithi076 ceph-mon[35401]: pgmap v9125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:36 smithi040 ceph-mon[32397]: pgmap v9125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:36 smithi146 ceph-mon[35807]: pgmap v9125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:37.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12803.324638 secs 2024-07-26T17:06:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12803.324638 secs 2024-07-26T17:06:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12803.324638 secs 2024-07-26T17:06:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:38 smithi040 ceph-mon[32397]: pgmap v9126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:38 smithi146 ceph-mon[35807]: pgmap v9126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:38 smithi076 ceph-mon[35401]: pgmap v9126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:40 smithi076 ceph-mon[35401]: pgmap v9127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:40 smithi040 ceph-mon[32397]: pgmap v9127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:40 smithi146 ceph-mon[35807]: pgmap v9127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12808.324783 secs 2024-07-26T17:06:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12808.324783 secs 2024-07-26T17:06:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12808.324783 secs 2024-07-26T17:06:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:42 smithi146 ceph-mon[35807]: pgmap v9128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:42 smithi076 ceph-mon[35401]: pgmap v9128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:42 smithi040 ceph-mon[32397]: pgmap v9128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:44 smithi040 ceph-mon[32397]: pgmap v9129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:44 smithi146 ceph-mon[35807]: pgmap v9129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:44 smithi076 ceph-mon[35401]: pgmap v9129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:46 smithi040 ceph-mon[32397]: pgmap v9130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:46 smithi146 ceph-mon[35807]: pgmap v9130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:46 smithi076 ceph-mon[35401]: pgmap v9130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12813.324939 secs 2024-07-26T17:06:47.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12813.324939 secs 2024-07-26T17:06:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12813.324939 secs 2024-07-26T17:06:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:48 smithi040 ceph-mon[32397]: pgmap v9131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:48 smithi146 ceph-mon[35807]: pgmap v9131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:48 smithi076 ceph-mon[35401]: pgmap v9131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:50 smithi040 ceph-mon[32397]: pgmap v9132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:50 smithi146 ceph-mon[35807]: pgmap v9132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:50 smithi076 ceph-mon[35401]: pgmap v9132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12818.325095 secs 2024-07-26T17:06:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12818.325095 secs 2024-07-26T17:06:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12818.325095 secs 2024-07-26T17:06:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:52 smithi146 ceph-mon[35807]: pgmap v9133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:52 smithi076 ceph-mon[35401]: pgmap v9133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:52 smithi040 ceph-mon[32397]: pgmap v9133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:54 smithi040 ceph-mon[32397]: pgmap v9134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:54 smithi146 ceph-mon[35807]: pgmap v9134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:54 smithi076 ceph-mon[35401]: pgmap v9134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:06:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:56 smithi040 ceph-mon[32397]: pgmap v9135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:56 smithi146 ceph-mon[35807]: pgmap v9135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:56 smithi076 ceph-mon[35401]: pgmap v9135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:06:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12823.325233 secs 2024-07-26T17:06:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12823.325233 secs 2024-07-26T17:06:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12823.325233 secs 2024-07-26T17:06:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:06:58 smithi040 ceph-mon[32397]: pgmap v9136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:06:58 smithi146 ceph-mon[35807]: pgmap v9136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:06:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:06:58 smithi076 ceph-mon[35401]: pgmap v9136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:00.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:00 smithi146 ceph-mon[35807]: pgmap v9137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:00 smithi040 ceph-mon[32397]: pgmap v9137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:00 smithi076 ceph-mon[35401]: pgmap v9137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12828.325376 secs 2024-07-26T17:07:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12828.325376 secs 2024-07-26T17:07:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12828.325376 secs 2024-07-26T17:07:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:02 smithi146 ceph-mon[35807]: pgmap v9138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:02 smithi076 ceph-mon[35401]: pgmap v9138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:02 smithi040 ceph-mon[32397]: pgmap v9138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:04 smithi040 ceph-mon[32397]: pgmap v9139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:04 smithi146 ceph-mon[35807]: pgmap v9139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:04 smithi076 ceph-mon[35401]: pgmap v9139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:06 smithi040 ceph-mon[32397]: pgmap v9140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:06 smithi146 ceph-mon[35807]: pgmap v9140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:06 smithi076 ceph-mon[35401]: pgmap v9140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:07.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12833.325472 secs 2024-07-26T17:07:07.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12833.325472 secs 2024-07-26T17:07:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12833.325472 secs 2024-07-26T17:07:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:08 smithi040 ceph-mon[32397]: pgmap v9141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:08 smithi146 ceph-mon[35807]: pgmap v9141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:08 smithi076 ceph-mon[35401]: pgmap v9141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:10 smithi040 ceph-mon[32397]: pgmap v9142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:10 smithi146 ceph-mon[35807]: pgmap v9142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:10 smithi076 ceph-mon[35401]: pgmap v9142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12838.325617 secs 2024-07-26T17:07:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12838.325617 secs 2024-07-26T17:07:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12838.325617 secs 2024-07-26T17:07:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:12 smithi076 ceph-mon[35401]: pgmap v9143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:12 smithi040 ceph-mon[32397]: pgmap v9143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:12 smithi146 ceph-mon[35807]: pgmap v9143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:14 smithi040 ceph-mon[32397]: pgmap v9144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:14 smithi146 ceph-mon[35807]: pgmap v9144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:14 smithi076 ceph-mon[35401]: pgmap v9144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:16 smithi040 ceph-mon[32397]: pgmap v9145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:16 smithi146 ceph-mon[35807]: pgmap v9145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:16 smithi076 ceph-mon[35401]: pgmap v9145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12843.325759 secs 2024-07-26T17:07:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12843.325759 secs 2024-07-26T17:07:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12843.325759 secs 2024-07-26T17:07:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:18 smithi040 ceph-mon[32397]: pgmap v9146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:18 smithi146 ceph-mon[35807]: pgmap v9146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:18 smithi076 ceph-mon[35401]: pgmap v9146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:20 smithi040 ceph-mon[32397]: pgmap v9147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:20 smithi146 ceph-mon[35807]: pgmap v9147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:20 smithi076 ceph-mon[35401]: pgmap v9147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12848.325917 secs 2024-07-26T17:07:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12848.325917 secs 2024-07-26T17:07:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12848.325917 secs 2024-07-26T17:07:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:22 smithi146 ceph-mon[35807]: pgmap v9148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:22 smithi076 ceph-mon[35401]: pgmap v9148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:22 smithi040 ceph-mon[32397]: pgmap v9148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:24 smithi040 ceph-mon[32397]: pgmap v9149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:24 smithi146 ceph-mon[35807]: pgmap v9149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:24 smithi076 ceph-mon[35401]: pgmap v9149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:26 smithi040 ceph-mon[32397]: pgmap v9150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:26 smithi146 ceph-mon[35807]: pgmap v9150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:26 smithi076 ceph-mon[35401]: pgmap v9150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12853.326079 secs 2024-07-26T17:07:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12853.326079 secs 2024-07-26T17:07:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12853.326079 secs 2024-07-26T17:07:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:28 smithi040 ceph-mon[32397]: pgmap v9151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:28 smithi146 ceph-mon[35807]: pgmap v9151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:28 smithi076 ceph-mon[35401]: pgmap v9151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:30.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:30 smithi146 ceph-mon[35807]: pgmap v9152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:30 smithi040 ceph-mon[32397]: pgmap v9152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:30 smithi076 ceph-mon[35401]: pgmap v9152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12858.326223 secs 2024-07-26T17:07:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12858.326223 secs 2024-07-26T17:07:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12858.326223 secs 2024-07-26T17:07:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:32 smithi146 ceph-mon[35807]: pgmap v9153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:32 smithi076 ceph-mon[35401]: pgmap v9153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:32 smithi040 ceph-mon[32397]: pgmap v9153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:34 smithi040 ceph-mon[32397]: pgmap v9154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:34 smithi146 ceph-mon[35807]: pgmap v9154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:34 smithi076 ceph-mon[35401]: pgmap v9154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:36 smithi040 ceph-mon[32397]: pgmap v9155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:36 smithi146 ceph-mon[35807]: pgmap v9155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:36 smithi076 ceph-mon[35401]: pgmap v9155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:37.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12863.326328 secs 2024-07-26T17:07:37.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12863.326328 secs 2024-07-26T17:07:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12863.326328 secs 2024-07-26T17:07:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:38 smithi040 ceph-mon[32397]: pgmap v9156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:38 smithi146 ceph-mon[35807]: pgmap v9156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:38 smithi076 ceph-mon[35401]: pgmap v9156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:40 smithi040 ceph-mon[32397]: pgmap v9157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:40 smithi146 ceph-mon[35807]: pgmap v9157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:40 smithi076 ceph-mon[35401]: pgmap v9157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12868.326475 secs 2024-07-26T17:07:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12868.326475 secs 2024-07-26T17:07:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12868.326475 secs 2024-07-26T17:07:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:42 smithi146 ceph-mon[35807]: pgmap v9158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:42 smithi076 ceph-mon[35401]: pgmap v9158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:42 smithi040 ceph-mon[32397]: pgmap v9158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:44 smithi040 ceph-mon[32397]: pgmap v9159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:44 smithi146 ceph-mon[35807]: pgmap v9159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:44 smithi076 ceph-mon[35401]: pgmap v9159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:46 smithi040 ceph-mon[32397]: pgmap v9160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:46 smithi146 ceph-mon[35807]: pgmap v9160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:46 smithi076 ceph-mon[35401]: pgmap v9160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12873.326576 secs 2024-07-26T17:07:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12873.326576 secs 2024-07-26T17:07:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12873.326576 secs 2024-07-26T17:07:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:48 smithi040 ceph-mon[32397]: pgmap v9161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:48 smithi146 ceph-mon[35807]: pgmap v9161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:48 smithi076 ceph-mon[35401]: pgmap v9161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:50 smithi040 ceph-mon[32397]: pgmap v9162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:50 smithi146 ceph-mon[35807]: pgmap v9162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:50 smithi076 ceph-mon[35401]: pgmap v9162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12878.326718 secs 2024-07-26T17:07:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12878.326718 secs 2024-07-26T17:07:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12878.326718 secs 2024-07-26T17:07:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:52 smithi146 ceph-mon[35807]: pgmap v9163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:52 smithi076 ceph-mon[35401]: pgmap v9163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:52 smithi040 ceph-mon[32397]: pgmap v9163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:54 smithi040 ceph-mon[32397]: pgmap v9164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:54 smithi146 ceph-mon[35807]: pgmap v9164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:54 smithi076 ceph-mon[35401]: pgmap v9164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:07:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:56 smithi040 ceph-mon[32397]: pgmap v9165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:56 smithi146 ceph-mon[35807]: pgmap v9165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:56 smithi076 ceph-mon[35401]: pgmap v9165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:07:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12883.326857 secs 2024-07-26T17:07:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12883.326857 secs 2024-07-26T17:07:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12883.326857 secs 2024-07-26T17:07:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:07:58 smithi040 ceph-mon[32397]: pgmap v9166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:07:58 smithi146 ceph-mon[35807]: pgmap v9166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:07:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:07:58 smithi076 ceph-mon[35401]: pgmap v9166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:00.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:00 smithi146 ceph-mon[35807]: pgmap v9167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:00 smithi040 ceph-mon[32397]: pgmap v9167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:00 smithi076 ceph-mon[35401]: pgmap v9167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12888.326968 secs 2024-07-26T17:08:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12888.326968 secs 2024-07-26T17:08:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12888.326968 secs 2024-07-26T17:08:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:02 smithi146 ceph-mon[35807]: pgmap v9168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:02 smithi076 ceph-mon[35401]: pgmap v9168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:02 smithi040 ceph-mon[32397]: pgmap v9168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:04 smithi040 ceph-mon[32397]: pgmap v9169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:04 smithi146 ceph-mon[35807]: pgmap v9169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:04 smithi076 ceph-mon[35401]: pgmap v9169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:06 smithi040 ceph-mon[32397]: pgmap v9170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:06 smithi146 ceph-mon[35807]: pgmap v9170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:06 smithi076 ceph-mon[35401]: pgmap v9170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:07.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12893.327125 secs 2024-07-26T17:08:07.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12893.327125 secs 2024-07-26T17:08:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12893.327125 secs 2024-07-26T17:08:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:08 smithi040 ceph-mon[32397]: pgmap v9171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:08 smithi146 ceph-mon[35807]: pgmap v9171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:08 smithi076 ceph-mon[35401]: pgmap v9171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:10 smithi040 ceph-mon[32397]: pgmap v9172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:10 smithi146 ceph-mon[35807]: pgmap v9172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:10 smithi076 ceph-mon[35401]: pgmap v9172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12898.327287 secs 2024-07-26T17:08:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12898.327287 secs 2024-07-26T17:08:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12898.327287 secs 2024-07-26T17:08:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:13 smithi146 ceph-mon[35807]: pgmap v9173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:13 smithi076 ceph-mon[35401]: pgmap v9173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:13 smithi040 ceph-mon[32397]: pgmap v9173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:15 smithi146 ceph-mon[35807]: pgmap v9174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:15 smithi076 ceph-mon[35401]: pgmap v9174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:15 smithi040 ceph-mon[32397]: pgmap v9174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12903.327386 secs 2024-07-26T17:08:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12903.327386 secs 2024-07-26T17:08:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12903.327386 secs 2024-07-26T17:08:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:17 smithi146 ceph-mon[35807]: pgmap v9175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:17 smithi076 ceph-mon[35401]: pgmap v9175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:17 smithi040 ceph-mon[32397]: pgmap v9175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:19 smithi146 ceph-mon[35807]: pgmap v9176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:19 smithi076 ceph-mon[35401]: pgmap v9176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:19 smithi040 ceph-mon[32397]: pgmap v9176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:21 smithi146 ceph-mon[35807]: pgmap v9177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12908.327566 secs 2024-07-26T17:08:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:21 smithi076 ceph-mon[35401]: pgmap v9177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12908.327566 secs 2024-07-26T17:08:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:21 smithi040 ceph-mon[32397]: pgmap v9177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12908.327566 secs 2024-07-26T17:08:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:23 smithi146 ceph-mon[35807]: pgmap v9178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:23 smithi076 ceph-mon[35401]: pgmap v9178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:23 smithi040 ceph-mon[32397]: pgmap v9178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:25 smithi076 ceph-mon[35401]: pgmap v9179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:25.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:25 smithi040 ceph-mon[32397]: pgmap v9179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:25 smithi146 ceph-mon[35807]: pgmap v9179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12913.327692 secs 2024-07-26T17:08:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12913.327692 secs 2024-07-26T17:08:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12913.327692 secs 2024-07-26T17:08:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:27 smithi040 ceph-mon[32397]: pgmap v9180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:27 smithi146 ceph-mon[35807]: pgmap v9180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:27 smithi076 ceph-mon[35401]: pgmap v9180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:29 smithi040 ceph-mon[32397]: pgmap v9181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:29 smithi146 ceph-mon[35807]: pgmap v9181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:29 smithi076 ceph-mon[35401]: pgmap v9181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:31.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:31 smithi146 ceph-mon[35807]: pgmap v9182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:31.875 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12918.327849 secs 2024-07-26T17:08:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:31 smithi040 ceph-mon[32397]: pgmap v9182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12918.327849 secs 2024-07-26T17:08:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:31 smithi076 ceph-mon[35401]: pgmap v9182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12918.327849 secs 2024-07-26T17:08:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:33 smithi040 ceph-mon[32397]: pgmap v9183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:33 smithi146 ceph-mon[35807]: pgmap v9183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:33 smithi076 ceph-mon[35401]: pgmap v9183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:35 smithi040 ceph-mon[32397]: pgmap v9184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:35 smithi146 ceph-mon[35807]: pgmap v9184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:35 smithi076 ceph-mon[35401]: pgmap v9184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:08:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12923.327995 secs 2024-07-26T17:08:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12923.327995 secs 2024-07-26T17:08:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12923.327995 secs 2024-07-26T17:08:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:37 smithi040 ceph-mon[32397]: pgmap v9185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:37.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:37 smithi076 ceph-mon[35401]: pgmap v9185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:37 smithi146 ceph-mon[35807]: pgmap v9185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:39 smithi040 ceph-mon[32397]: pgmap v9186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:39 smithi146 ceph-mon[35807]: pgmap v9186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:39 smithi076 ceph-mon[35401]: pgmap v9186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:41 smithi040 ceph-mon[32397]: pgmap v9187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12928.328088 secs 2024-07-26T17:08:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:41 smithi146 ceph-mon[35807]: pgmap v9187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12928.328088 secs 2024-07-26T17:08:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:41 smithi076 ceph-mon[35401]: pgmap v9187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12928.328088 secs 2024-07-26T17:08:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:43 smithi040 ceph-mon[32397]: pgmap v9188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:43 smithi146 ceph-mon[35807]: pgmap v9188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:43 smithi076 ceph-mon[35401]: pgmap v9188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:45 smithi040 ceph-mon[32397]: pgmap v9189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:45 smithi146 ceph-mon[35807]: pgmap v9189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:45 smithi076 ceph-mon[35401]: pgmap v9189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12933.328248 secs 2024-07-26T17:08:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12933.328248 secs 2024-07-26T17:08:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12933.328248 secs 2024-07-26T17:08:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:47 smithi040 ceph-mon[32397]: pgmap v9190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:47 smithi146 ceph-mon[35807]: pgmap v9190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:47 smithi076 ceph-mon[35401]: pgmap v9190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:49 smithi040 ceph-mon[32397]: pgmap v9191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:49 smithi146 ceph-mon[35807]: pgmap v9191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:49 smithi076 ceph-mon[35401]: pgmap v9191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:51 smithi040 ceph-mon[32397]: pgmap v9192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12938.328399 secs 2024-07-26T17:08:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:51 smithi146 ceph-mon[35807]: pgmap v9192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12938.328399 secs 2024-07-26T17:08:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:51 smithi076 ceph-mon[35401]: pgmap v9192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12938.328399 secs 2024-07-26T17:08:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:53 smithi040 ceph-mon[32397]: pgmap v9193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:53 smithi146 ceph-mon[35807]: pgmap v9193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:53 smithi076 ceph-mon[35401]: pgmap v9193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:55 smithi040 ceph-mon[32397]: pgmap v9194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:55 smithi146 ceph-mon[35807]: pgmap v9194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:55 smithi076 ceph-mon[35401]: pgmap v9194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:08:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12943.328539 secs 2024-07-26T17:08:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12943.328539 secs 2024-07-26T17:08:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12943.328539 secs 2024-07-26T17:08:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:57 smithi040 ceph-mon[32397]: pgmap v9195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:57 smithi146 ceph-mon[35807]: pgmap v9195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:08:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:57 smithi076 ceph-mon[35401]: pgmap v9195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:08:59 smithi146 ceph-mon[35807]: pgmap v9196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:08:59 smithi076 ceph-mon[35401]: pgmap v9196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:08:59 smithi040 ceph-mon[32397]: pgmap v9196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:01 smithi146 ceph-mon[35807]: pgmap v9197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12948.328673 secs 2024-07-26T17:09:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:01 smithi076 ceph-mon[35401]: pgmap v9197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12948.328673 secs 2024-07-26T17:09:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:01 smithi040 ceph-mon[32397]: pgmap v9197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12948.328673 secs 2024-07-26T17:09:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:03 smithi146 ceph-mon[35807]: pgmap v9198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:03 smithi076 ceph-mon[35401]: pgmap v9198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:03 smithi040 ceph-mon[32397]: pgmap v9198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:05 smithi146 ceph-mon[35807]: pgmap v9199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:05 smithi076 ceph-mon[35401]: pgmap v9199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:05 smithi040 ceph-mon[32397]: pgmap v9199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12953.328809 secs 2024-07-26T17:09:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12953.328809 secs 2024-07-26T17:09:07.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12953.328809 secs 2024-07-26T17:09:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:07 smithi146 ceph-mon[35807]: pgmap v9200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:07 smithi076 ceph-mon[35401]: pgmap v9200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:07 smithi040 ceph-mon[32397]: pgmap v9200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:09 smithi146 ceph-mon[35807]: pgmap v9201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:09 smithi076 ceph-mon[35401]: pgmap v9201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:09 smithi040 ceph-mon[32397]: pgmap v9201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:11 smithi146 ceph-mon[35807]: pgmap v9202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12958.328949 secs 2024-07-26T17:09:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:11 smithi076 ceph-mon[35401]: pgmap v9202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12958.328949 secs 2024-07-26T17:09:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:11 smithi040 ceph-mon[32397]: pgmap v9202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12958.328949 secs 2024-07-26T17:09:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:13 smithi146 ceph-mon[35807]: pgmap v9203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:13 smithi076 ceph-mon[35401]: pgmap v9203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:13 smithi040 ceph-mon[32397]: pgmap v9203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:15 smithi146 ceph-mon[35807]: pgmap v9204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:15 smithi076 ceph-mon[35401]: pgmap v9204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:15 smithi040 ceph-mon[32397]: pgmap v9204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12963.329089 secs 2024-07-26T17:09:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12963.329089 secs 2024-07-26T17:09:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12963.329089 secs 2024-07-26T17:09:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:17 smithi146 ceph-mon[35807]: pgmap v9205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:17 smithi076 ceph-mon[35401]: pgmap v9205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:17 smithi040 ceph-mon[32397]: pgmap v9205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:19 smithi076 ceph-mon[35401]: pgmap v9206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:19 smithi040 ceph-mon[32397]: pgmap v9206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:19 smithi146 ceph-mon[35807]: pgmap v9206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:21 smithi076 ceph-mon[35401]: pgmap v9207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12968.329249 secs 2024-07-26T17:09:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:21 smithi040 ceph-mon[32397]: pgmap v9207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12968.329249 secs 2024-07-26T17:09:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:21 smithi146 ceph-mon[35807]: pgmap v9207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12968.329249 secs 2024-07-26T17:09:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:23 smithi040 ceph-mon[32397]: pgmap v9208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:23 smithi146 ceph-mon[35807]: pgmap v9208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:23 smithi076 ceph-mon[35401]: pgmap v9208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:25 smithi040 ceph-mon[32397]: pgmap v9209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:25 smithi146 ceph-mon[35807]: pgmap v9209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:25 smithi076 ceph-mon[35401]: pgmap v9209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12973.329387 secs 2024-07-26T17:09:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12973.329387 secs 2024-07-26T17:09:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12973.329387 secs 2024-07-26T17:09:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:27 smithi040 ceph-mon[32397]: pgmap v9210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:27 smithi146 ceph-mon[35807]: pgmap v9210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:27 smithi076 ceph-mon[35401]: pgmap v9210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:29 smithi040 ceph-mon[32397]: pgmap v9211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:29 smithi146 ceph-mon[35807]: pgmap v9211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:29 smithi076 ceph-mon[35401]: pgmap v9211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:32.126 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:31 smithi146 ceph-mon[35807]: pgmap v9212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:32.126 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12978.329530 secs 2024-07-26T17:09:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:31 smithi040 ceph-mon[32397]: pgmap v9212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12978.329530 secs 2024-07-26T17:09:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:31 smithi076 ceph-mon[35401]: pgmap v9212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12978.329530 secs 2024-07-26T17:09:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:33 smithi040 ceph-mon[32397]: pgmap v9213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:33 smithi146 ceph-mon[35807]: pgmap v9213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:33 smithi076 ceph-mon[35401]: pgmap v9213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:35 smithi040 ceph-mon[32397]: pgmap v9214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:35 smithi146 ceph-mon[35807]: pgmap v9214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:35 smithi076 ceph-mon[35401]: pgmap v9214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12983.329629 secs 2024-07-26T17:09:37.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12983.329629 secs 2024-07-26T17:09:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12983.329629 secs 2024-07-26T17:09:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:37 smithi040 ceph-mon[32397]: pgmap v9215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:37 smithi146 ceph-mon[35807]: pgmap v9215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:37 smithi076 ceph-mon[35401]: pgmap v9215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:39 smithi040 ceph-mon[32397]: pgmap v9216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:39 smithi146 ceph-mon[35807]: pgmap v9216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:39 smithi076 ceph-mon[35401]: pgmap v9216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:41 smithi040 ceph-mon[32397]: pgmap v9217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12988.329790 secs 2024-07-26T17:09:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:41 smithi146 ceph-mon[35807]: pgmap v9217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12988.329790 secs 2024-07-26T17:09:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:41 smithi076 ceph-mon[35401]: pgmap v9217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12988.329790 secs 2024-07-26T17:09:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:43 smithi040 ceph-mon[32397]: pgmap v9218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:43 smithi146 ceph-mon[35807]: pgmap v9218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:43 smithi076 ceph-mon[35401]: pgmap v9218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:45 smithi040 ceph-mon[32397]: pgmap v9219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:45 smithi146 ceph-mon[35807]: pgmap v9219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:45 smithi076 ceph-mon[35401]: pgmap v9219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12993.329924 secs 2024-07-26T17:09:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12993.329924 secs 2024-07-26T17:09:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12993.329924 secs 2024-07-26T17:09:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:47 smithi040 ceph-mon[32397]: pgmap v9220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:47 smithi146 ceph-mon[35807]: pgmap v9220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:47 smithi076 ceph-mon[35401]: pgmap v9220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:49 smithi040 ceph-mon[32397]: pgmap v9221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:49 smithi146 ceph-mon[35807]: pgmap v9221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:49 smithi076 ceph-mon[35401]: pgmap v9221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:51 smithi040 ceph-mon[32397]: pgmap v9222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 12998.330062 secs 2024-07-26T17:09:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:51 smithi146 ceph-mon[35807]: pgmap v9222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 12998.330062 secs 2024-07-26T17:09:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:51 smithi076 ceph-mon[35401]: pgmap v9222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 12998.330062 secs 2024-07-26T17:09:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:53 smithi040 ceph-mon[32397]: pgmap v9223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:53 smithi146 ceph-mon[35807]: pgmap v9223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:53 smithi076 ceph-mon[35401]: pgmap v9223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:55 smithi040 ceph-mon[32397]: pgmap v9224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:55 smithi146 ceph-mon[35807]: pgmap v9224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:55 smithi076 ceph-mon[35401]: pgmap v9224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:09:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13003.330198 secs 2024-07-26T17:09:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13003.330198 secs 2024-07-26T17:09:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13003.330198 secs 2024-07-26T17:09:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:09:57 smithi146 ceph-mon[35807]: pgmap v9225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:09:57 smithi076 ceph-mon[35401]: pgmap v9225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:09:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:09:57 smithi040 ceph-mon[32397]: pgmap v9225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:00 smithi146 ceph-mon[35807]: pgmap v9226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:00 smithi076 ceph-mon[35401]: pgmap v9226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:00 smithi040 ceph-mon[32397]: pgmap v9226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:01 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:10:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:01 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:10:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:01 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:10:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:02 smithi146 ceph-mon[35807]: pgmap v9227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13008.330373 secs 2024-07-26T17:10:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:02 smithi076 ceph-mon[35401]: pgmap v9227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13008.330373 secs 2024-07-26T17:10:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:02 smithi040 ceph-mon[32397]: pgmap v9227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13008.330373 secs 2024-07-26T17:10:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:04 smithi146 ceph-mon[35807]: pgmap v9228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:04 smithi076 ceph-mon[35401]: pgmap v9228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:04 smithi040 ceph-mon[32397]: pgmap v9228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:06 smithi146 ceph-mon[35807]: pgmap v9229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:06 smithi076 ceph-mon[35401]: pgmap v9229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:06 smithi040 ceph-mon[32397]: pgmap v9229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13013.330526 secs 2024-07-26T17:10:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13013.330526 secs 2024-07-26T17:10:07.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13013.330526 secs 2024-07-26T17:10:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:08 smithi146 ceph-mon[35807]: pgmap v9230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:08 smithi076 ceph-mon[35401]: pgmap v9230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:08 smithi040 ceph-mon[32397]: pgmap v9230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:10 smithi146 ceph-mon[35807]: pgmap v9231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:10 smithi076 ceph-mon[35401]: pgmap v9231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:10 smithi040 ceph-mon[32397]: pgmap v9231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:10:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:12 smithi146 ceph-mon[35807]: pgmap v9232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13018.330661 secs 2024-07-26T17:10:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:12 smithi076 ceph-mon[35401]: pgmap v9232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13018.330661 secs 2024-07-26T17:10:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:12 smithi040 ceph-mon[32397]: pgmap v9232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13018.330661 secs 2024-07-26T17:10:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:14 smithi146 ceph-mon[35807]: pgmap v9233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:14 smithi076 ceph-mon[35401]: pgmap v9233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:14 smithi040 ceph-mon[32397]: pgmap v9233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:16 smithi076 ceph-mon[35401]: pgmap v9234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:16 smithi040 ceph-mon[32397]: pgmap v9234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:16 smithi146 ceph-mon[35807]: pgmap v9234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13023.330798 secs 2024-07-26T17:10:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13023.330798 secs 2024-07-26T17:10:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13023.330798 secs 2024-07-26T17:10:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:18 smithi040 ceph-mon[32397]: pgmap v9235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:18 smithi146 ceph-mon[35807]: pgmap v9235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:18 smithi076 ceph-mon[35401]: pgmap v9235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:20 smithi040 ceph-mon[32397]: pgmap v9236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:20 smithi146 ceph-mon[35807]: pgmap v9236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:20 smithi076 ceph-mon[35401]: pgmap v9236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:22 smithi040 ceph-mon[32397]: pgmap v9237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13028.330931 secs 2024-07-26T17:10:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:22 smithi146 ceph-mon[35807]: pgmap v9237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13028.330931 secs 2024-07-26T17:10:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:22 smithi076 ceph-mon[35401]: pgmap v9237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13028.330931 secs 2024-07-26T17:10:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:24 smithi040 ceph-mon[32397]: pgmap v9238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:24 smithi146 ceph-mon[35807]: pgmap v9238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:24 smithi076 ceph-mon[35401]: pgmap v9238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:26 smithi040 ceph-mon[32397]: pgmap v9239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:26 smithi146 ceph-mon[35807]: pgmap v9239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:26 smithi076 ceph-mon[35401]: pgmap v9239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13033.331068 secs 2024-07-26T17:10:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13033.331068 secs 2024-07-26T17:10:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13033.331068 secs 2024-07-26T17:10:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:28 smithi040 ceph-mon[32397]: pgmap v9240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:28 smithi146 ceph-mon[35807]: pgmap v9240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:28 smithi076 ceph-mon[35401]: pgmap v9240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:30 smithi040 ceph-mon[32397]: pgmap v9241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:30 smithi146 ceph-mon[35807]: pgmap v9241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:30 smithi076 ceph-mon[35401]: pgmap v9241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:32 smithi040 ceph-mon[32397]: pgmap v9242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13038.331223 secs 2024-07-26T17:10:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:32 smithi146 ceph-mon[35807]: pgmap v9242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13038.331223 secs 2024-07-26T17:10:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:32 smithi076 ceph-mon[35401]: pgmap v9242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13038.331223 secs 2024-07-26T17:10:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:34 smithi040 ceph-mon[32397]: pgmap v9243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:34 smithi146 ceph-mon[35807]: pgmap v9243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:34.587 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:34 smithi076 ceph-mon[35401]: pgmap v9243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:36 smithi040 ceph-mon[32397]: pgmap v9244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:36 smithi146 ceph-mon[35807]: pgmap v9244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:36 smithi076 ceph-mon[35401]: pgmap v9244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13043.331326 secs 2024-07-26T17:10:37.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13043.331326 secs 2024-07-26T17:10:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13043.331326 secs 2024-07-26T17:10:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:38 smithi040 ceph-mon[32397]: pgmap v9245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:38 smithi146 ceph-mon[35807]: pgmap v9245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:38 smithi076 ceph-mon[35401]: pgmap v9245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:40 smithi040 ceph-mon[32397]: pgmap v9246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:40 smithi146 ceph-mon[35807]: pgmap v9246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:40 smithi076 ceph-mon[35401]: pgmap v9246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:42 smithi040 ceph-mon[32397]: pgmap v9247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13048.331417 secs 2024-07-26T17:10:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:42 smithi146 ceph-mon[35807]: pgmap v9247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:42.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13048.331417 secs 2024-07-26T17:10:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:42 smithi076 ceph-mon[35401]: pgmap v9247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13048.331417 secs 2024-07-26T17:10:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:44 smithi040 ceph-mon[32397]: pgmap v9248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:44 smithi146 ceph-mon[35807]: pgmap v9248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:44 smithi076 ceph-mon[35401]: pgmap v9248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:46 smithi040 ceph-mon[32397]: pgmap v9249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:46 smithi146 ceph-mon[35807]: pgmap v9249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:46 smithi076 ceph-mon[35401]: pgmap v9249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13053.331555 secs 2024-07-26T17:10:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13053.331555 secs 2024-07-26T17:10:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13053.331555 secs 2024-07-26T17:10:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:48 smithi040 ceph-mon[32397]: pgmap v9250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:48 smithi146 ceph-mon[35807]: pgmap v9250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:48 smithi076 ceph-mon[35401]: pgmap v9250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:50 smithi146 ceph-mon[35807]: pgmap v9251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:50 smithi076 ceph-mon[35401]: pgmap v9251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:50 smithi040 ceph-mon[32397]: pgmap v9251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:52 smithi146 ceph-mon[35807]: pgmap v9252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13058.331731 secs 2024-07-26T17:10:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:52 smithi076 ceph-mon[35401]: pgmap v9252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13058.331731 secs 2024-07-26T17:10:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:52 smithi040 ceph-mon[32397]: pgmap v9252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13058.331731 secs 2024-07-26T17:10:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:54 smithi146 ceph-mon[35807]: pgmap v9253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:54 smithi076 ceph-mon[35401]: pgmap v9253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:54 smithi040 ceph-mon[32397]: pgmap v9253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:56 smithi146 ceph-mon[35807]: pgmap v9254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:56 smithi076 ceph-mon[35401]: pgmap v9254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:56 smithi040 ceph-mon[32397]: pgmap v9254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:10:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13063.331870 secs 2024-07-26T17:10:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13063.331870 secs 2024-07-26T17:10:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13063.331870 secs 2024-07-26T17:10:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:10:58 smithi146 ceph-mon[35807]: pgmap v9255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:10:58 smithi076 ceph-mon[35401]: pgmap v9255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:10:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:10:58 smithi040 ceph-mon[32397]: pgmap v9255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:00 smithi146 ceph-mon[35807]: pgmap v9256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:00 smithi076 ceph-mon[35401]: pgmap v9256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:00 smithi040 ceph-mon[32397]: pgmap v9256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:02 smithi146 ceph-mon[35807]: pgmap v9257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13068.332014 secs 2024-07-26T17:11:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:02 smithi076 ceph-mon[35401]: pgmap v9257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13068.332014 secs 2024-07-26T17:11:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:02 smithi040 ceph-mon[32397]: pgmap v9257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13068.332014 secs 2024-07-26T17:11:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:04 smithi146 ceph-mon[35807]: pgmap v9258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:04 smithi076 ceph-mon[35401]: pgmap v9258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:04 smithi040 ceph-mon[32397]: pgmap v9258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:06 smithi146 ceph-mon[35807]: pgmap v9259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:06 smithi076 ceph-mon[35401]: pgmap v9259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:06 smithi040 ceph-mon[32397]: pgmap v9259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13073.332171 secs 2024-07-26T17:11:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13073.332171 secs 2024-07-26T17:11:07.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13073.332171 secs 2024-07-26T17:11:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:08 smithi146 ceph-mon[35807]: pgmap v9260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:08 smithi076 ceph-mon[35401]: pgmap v9260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:08 smithi040 ceph-mon[32397]: pgmap v9260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:10 smithi076 ceph-mon[35401]: pgmap v9261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:10 smithi040 ceph-mon[32397]: pgmap v9261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:10 smithi146 ceph-mon[35807]: pgmap v9261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:12 smithi076 ceph-mon[35401]: pgmap v9262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:12.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13078.332327 secs 2024-07-26T17:11:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:12 smithi040 ceph-mon[32397]: pgmap v9262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13078.332327 secs 2024-07-26T17:11:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:12 smithi146 ceph-mon[35807]: pgmap v9262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13078.332327 secs 2024-07-26T17:11:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:14 smithi040 ceph-mon[32397]: pgmap v9263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:14 smithi146 ceph-mon[35807]: pgmap v9263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:14 smithi076 ceph-mon[35401]: pgmap v9263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:15 smithi040 ceph-mon[32397]: pgmap v9264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:15 smithi146 ceph-mon[35807]: pgmap v9264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:15 smithi076 ceph-mon[35401]: pgmap v9264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13083.332454 secs 2024-07-26T17:11:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:17 smithi040 ceph-mon[32397]: pgmap v9265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13083.332454 secs 2024-07-26T17:11:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:17 smithi146 ceph-mon[35807]: pgmap v9265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13083.332454 secs 2024-07-26T17:11:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:17 smithi076 ceph-mon[35401]: pgmap v9265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:19 smithi040 ceph-mon[32397]: pgmap v9266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:19 smithi146 ceph-mon[35807]: pgmap v9266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:19 smithi076 ceph-mon[35401]: pgmap v9266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:21 smithi146 ceph-mon[35807]: pgmap v9267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:21 smithi076 ceph-mon[35401]: pgmap v9267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:21 smithi040 ceph-mon[32397]: pgmap v9267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13088.332615 secs 2024-07-26T17:11:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13088.332615 secs 2024-07-26T17:11:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13088.332615 secs 2024-07-26T17:11:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:23 smithi146 ceph-mon[35807]: pgmap v9268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:23 smithi076 ceph-mon[35401]: pgmap v9268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:23 smithi040 ceph-mon[32397]: pgmap v9268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:25 smithi146 ceph-mon[35807]: pgmap v9269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:25 smithi076 ceph-mon[35401]: pgmap v9269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:25 smithi040 ceph-mon[32397]: pgmap v9269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13093.332748 secs 2024-07-26T17:11:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13093.332748 secs 2024-07-26T17:11:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13093.332748 secs 2024-07-26T17:11:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:27 smithi146 ceph-mon[35807]: pgmap v9270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:27 smithi076 ceph-mon[35401]: pgmap v9270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:27 smithi040 ceph-mon[32397]: pgmap v9270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:29 smithi146 ceph-mon[35807]: pgmap v9271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:29 smithi076 ceph-mon[35401]: pgmap v9271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:29 smithi040 ceph-mon[32397]: pgmap v9271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:31 smithi146 ceph-mon[35807]: pgmap v9272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13098.332896 secs 2024-07-26T17:11:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:31 smithi076 ceph-mon[35401]: pgmap v9272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13098.332896 secs 2024-07-26T17:11:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:31 smithi040 ceph-mon[32397]: pgmap v9272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13098.332896 secs 2024-07-26T17:11:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:33 smithi146 ceph-mon[35807]: pgmap v9273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:33 smithi076 ceph-mon[35401]: pgmap v9273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:33 smithi040 ceph-mon[32397]: pgmap v9273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:35 smithi146 ceph-mon[35807]: pgmap v9274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:35 smithi076 ceph-mon[35401]: pgmap v9274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:35 smithi040 ceph-mon[32397]: pgmap v9274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13103.333028 secs 2024-07-26T17:11:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13103.333028 secs 2024-07-26T17:11:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13103.333028 secs 2024-07-26T17:11:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:37 smithi076 ceph-mon[35401]: pgmap v9275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:37.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:37 smithi040 ceph-mon[32397]: pgmap v9275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:37 smithi146 ceph-mon[35807]: pgmap v9275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:39 smithi040 ceph-mon[32397]: pgmap v9276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:39 smithi146 ceph-mon[35807]: pgmap v9276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:39 smithi076 ceph-mon[35401]: pgmap v9276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:41 smithi040 ceph-mon[32397]: pgmap v9277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13108.333162 secs 2024-07-26T17:11:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:41 smithi146 ceph-mon[35807]: pgmap v9277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13108.333162 secs 2024-07-26T17:11:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:41 smithi076 ceph-mon[35401]: pgmap v9277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13108.333162 secs 2024-07-26T17:11:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:43 smithi040 ceph-mon[32397]: pgmap v9278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:43 smithi146 ceph-mon[35807]: pgmap v9278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:43 smithi076 ceph-mon[35401]: pgmap v9278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:45 smithi040 ceph-mon[32397]: pgmap v9279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:45 smithi146 ceph-mon[35807]: pgmap v9279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:45 smithi076 ceph-mon[35401]: pgmap v9279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13113.333306 secs 2024-07-26T17:11:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13113.333306 secs 2024-07-26T17:11:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13113.333306 secs 2024-07-26T17:11:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:47 smithi040 ceph-mon[32397]: pgmap v9280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:47 smithi146 ceph-mon[35807]: pgmap v9280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:47 smithi076 ceph-mon[35401]: pgmap v9280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:49 smithi040 ceph-mon[32397]: pgmap v9281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:49 smithi146 ceph-mon[35807]: pgmap v9281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:49 smithi076 ceph-mon[35401]: pgmap v9281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:51 smithi040 ceph-mon[32397]: pgmap v9282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13118.333446 secs 2024-07-26T17:11:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:51 smithi146 ceph-mon[35807]: pgmap v9282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13118.333446 secs 2024-07-26T17:11:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:51 smithi076 ceph-mon[35401]: pgmap v9282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13118.333446 secs 2024-07-26T17:11:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:53 smithi040 ceph-mon[32397]: pgmap v9283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:53 smithi146 ceph-mon[35807]: pgmap v9283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:53 smithi076 ceph-mon[35401]: pgmap v9283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:55 smithi040 ceph-mon[32397]: pgmap v9284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:55 smithi146 ceph-mon[35807]: pgmap v9284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:55 smithi076 ceph-mon[35401]: pgmap v9284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:11:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13123.333580 secs 2024-07-26T17:11:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13123.333580 secs 2024-07-26T17:11:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13123.333580 secs 2024-07-26T17:11:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:57 smithi040 ceph-mon[32397]: pgmap v9285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:57 smithi146 ceph-mon[35807]: pgmap v9285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:57 smithi076 ceph-mon[35401]: pgmap v9285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:11:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:11:59 smithi040 ceph-mon[32397]: pgmap v9286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:11:59 smithi146 ceph-mon[35807]: pgmap v9286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:11:59 smithi076 ceph-mon[35401]: pgmap v9286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:01 smithi040 ceph-mon[32397]: pgmap v9287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13128.333759 secs 2024-07-26T17:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:01 smithi146 ceph-mon[35807]: pgmap v9287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13128.333759 secs 2024-07-26T17:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:01 smithi076 ceph-mon[35401]: pgmap v9287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13128.333759 secs 2024-07-26T17:12:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:03 smithi040 ceph-mon[32397]: pgmap v9288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:03 smithi146 ceph-mon[35807]: pgmap v9288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:03 smithi076 ceph-mon[35401]: pgmap v9288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:05 smithi040 ceph-mon[32397]: pgmap v9289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:05 smithi146 ceph-mon[35807]: pgmap v9289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:05 smithi076 ceph-mon[35401]: pgmap v9289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13133.333908 secs 2024-07-26T17:12:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13133.333908 secs 2024-07-26T17:12:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13133.333908 secs 2024-07-26T17:12:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:07 smithi040 ceph-mon[32397]: pgmap v9290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:07.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:07 smithi076 ceph-mon[35401]: pgmap v9290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:07 smithi146 ceph-mon[35807]: pgmap v9290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:09 smithi040 ceph-mon[32397]: pgmap v9291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:09 smithi146 ceph-mon[35807]: pgmap v9291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:09 smithi076 ceph-mon[35401]: pgmap v9291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:11 smithi040 ceph-mon[32397]: pgmap v9292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13138.334077 secs 2024-07-26T17:12:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:11 smithi146 ceph-mon[35807]: pgmap v9292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13138.334077 secs 2024-07-26T17:12:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:11 smithi076 ceph-mon[35401]: pgmap v9292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13138.334077 secs 2024-07-26T17:12:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:13 smithi146 ceph-mon[35807]: pgmap v9293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:13 smithi076 ceph-mon[35401]: pgmap v9293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:13 smithi040 ceph-mon[32397]: pgmap v9293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:15 smithi146 ceph-mon[35807]: pgmap v9294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:15 smithi076 ceph-mon[35401]: pgmap v9294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:15 smithi040 ceph-mon[32397]: pgmap v9294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13143.334178 secs 2024-07-26T17:12:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13143.334178 secs 2024-07-26T17:12:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13143.334178 secs 2024-07-26T17:12:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:17 smithi146 ceph-mon[35807]: pgmap v9295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:17 smithi076 ceph-mon[35401]: pgmap v9295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:17 smithi040 ceph-mon[32397]: pgmap v9295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:19 smithi146 ceph-mon[35807]: pgmap v9296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:19 smithi076 ceph-mon[35401]: pgmap v9296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:19 smithi040 ceph-mon[32397]: pgmap v9296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:21 smithi146 ceph-mon[35807]: pgmap v9297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13148.334341 secs 2024-07-26T17:12:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:21 smithi076 ceph-mon[35401]: pgmap v9297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13148.334341 secs 2024-07-26T17:12:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:21 smithi040 ceph-mon[32397]: pgmap v9297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13148.334341 secs 2024-07-26T17:12:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:23 smithi146 ceph-mon[35807]: pgmap v9298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:23 smithi076 ceph-mon[35401]: pgmap v9298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:23 smithi040 ceph-mon[32397]: pgmap v9298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:25 smithi146 ceph-mon[35807]: pgmap v9299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:25 smithi076 ceph-mon[35401]: pgmap v9299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:25 smithi040 ceph-mon[32397]: pgmap v9299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13153.334441 secs 2024-07-26T17:12:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13153.334441 secs 2024-07-26T17:12:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13153.334441 secs 2024-07-26T17:12:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:27 smithi146 ceph-mon[35807]: pgmap v9300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:27 smithi076 ceph-mon[35401]: pgmap v9300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:27 smithi040 ceph-mon[32397]: pgmap v9300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:29 smithi146 ceph-mon[35807]: pgmap v9301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:29 smithi076 ceph-mon[35401]: pgmap v9301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:29 smithi040 ceph-mon[32397]: pgmap v9301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:31 smithi146 ceph-mon[35807]: pgmap v9302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13158.334572 secs 2024-07-26T17:12:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:31 smithi076 ceph-mon[35401]: pgmap v9302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13158.334572 secs 2024-07-26T17:12:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:31 smithi040 ceph-mon[32397]: pgmap v9302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13158.334572 secs 2024-07-26T17:12:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:33 smithi076 ceph-mon[35401]: pgmap v9303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:33 smithi040 ceph-mon[32397]: pgmap v9303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:33 smithi146 ceph-mon[35807]: pgmap v9303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:35 smithi040 ceph-mon[32397]: pgmap v9304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:35 smithi146 ceph-mon[35807]: pgmap v9304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:35 smithi076 ceph-mon[35401]: pgmap v9304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:37.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13163.334709 secs 2024-07-26T17:12:37.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13163.334709 secs 2024-07-26T17:12:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13163.334709 secs 2024-07-26T17:12:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:37 smithi040 ceph-mon[32397]: pgmap v9305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:37 smithi146 ceph-mon[35807]: pgmap v9305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:37 smithi076 ceph-mon[35401]: pgmap v9305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:39 smithi040 ceph-mon[32397]: pgmap v9306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:40.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:39 smithi146 ceph-mon[35807]: pgmap v9306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:39 smithi076 ceph-mon[35401]: pgmap v9306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:41 smithi040 ceph-mon[32397]: pgmap v9307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13168.334863 secs 2024-07-26T17:12:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:41 smithi146 ceph-mon[35807]: pgmap v9307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13168.334863 secs 2024-07-26T17:12:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:41 smithi076 ceph-mon[35401]: pgmap v9307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13168.334863 secs 2024-07-26T17:12:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:43 smithi040 ceph-mon[32397]: pgmap v9308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:43 smithi146 ceph-mon[35807]: pgmap v9308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:43 smithi076 ceph-mon[35401]: pgmap v9308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:45 smithi040 ceph-mon[32397]: pgmap v9309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:45 smithi146 ceph-mon[35807]: pgmap v9309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:45 smithi076 ceph-mon[35401]: pgmap v9309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13173.335018 secs 2024-07-26T17:12:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13173.335018 secs 2024-07-26T17:12:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13173.335018 secs 2024-07-26T17:12:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:47 smithi040 ceph-mon[32397]: pgmap v9310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:48.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:47 smithi146 ceph-mon[35807]: pgmap v9310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:47 smithi076 ceph-mon[35401]: pgmap v9310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:49 smithi040 ceph-mon[32397]: pgmap v9311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:49 smithi146 ceph-mon[35807]: pgmap v9311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:49 smithi076 ceph-mon[35401]: pgmap v9311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:51 smithi040 ceph-mon[32397]: pgmap v9312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13178.335175 secs 2024-07-26T17:12:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:51 smithi146 ceph-mon[35807]: pgmap v9312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13178.335175 secs 2024-07-26T17:12:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:51 smithi076 ceph-mon[35401]: pgmap v9312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13178.335175 secs 2024-07-26T17:12:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:53 smithi040 ceph-mon[32397]: pgmap v9313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:53 smithi146 ceph-mon[35807]: pgmap v9313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:53 smithi076 ceph-mon[35401]: pgmap v9313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:55 smithi040 ceph-mon[32397]: pgmap v9314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:55 smithi146 ceph-mon[35807]: pgmap v9314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:55 smithi076 ceph-mon[35401]: pgmap v9314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:12:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13183.335346 secs 2024-07-26T17:12:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13183.335346 secs 2024-07-26T17:12:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13183.335346 secs 2024-07-26T17:12:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:57 smithi040 ceph-mon[32397]: pgmap v9315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:57 smithi146 ceph-mon[35807]: pgmap v9315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:12:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:57 smithi076 ceph-mon[35401]: pgmap v9315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:12:59 smithi040 ceph-mon[32397]: pgmap v9316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:12:59 smithi146 ceph-mon[35807]: pgmap v9316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:12:59 smithi076 ceph-mon[35401]: pgmap v9316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:01 smithi040 ceph-mon[32397]: pgmap v9317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13188.335494 secs 2024-07-26T17:13:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:01 smithi146 ceph-mon[35807]: pgmap v9317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13188.335494 secs 2024-07-26T17:13:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:01 smithi076 ceph-mon[35401]: pgmap v9317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13188.335494 secs 2024-07-26T17:13:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:03 smithi040 ceph-mon[32397]: pgmap v9318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:03 smithi146 ceph-mon[35807]: pgmap v9318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:03 smithi076 ceph-mon[35401]: pgmap v9318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:05 smithi040 ceph-mon[32397]: pgmap v9319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:05 smithi146 ceph-mon[35807]: pgmap v9319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:05 smithi076 ceph-mon[35401]: pgmap v9319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13193.335666 secs 2024-07-26T17:13:07.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13193.335666 secs 2024-07-26T17:13:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13193.335666 secs 2024-07-26T17:13:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:07 smithi146 ceph-mon[35807]: pgmap v9320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:07 smithi076 ceph-mon[35401]: pgmap v9320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:07 smithi040 ceph-mon[32397]: pgmap v9320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:09 smithi146 ceph-mon[35807]: pgmap v9321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:09 smithi076 ceph-mon[35401]: pgmap v9321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:09 smithi040 ceph-mon[32397]: pgmap v9321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:11 smithi146 ceph-mon[35807]: pgmap v9322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13198.335811 secs 2024-07-26T17:13:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:11 smithi076 ceph-mon[35401]: pgmap v9322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13198.335811 secs 2024-07-26T17:13:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:11 smithi040 ceph-mon[32397]: pgmap v9322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13198.335811 secs 2024-07-26T17:13:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:14 smithi146 ceph-mon[35807]: pgmap v9323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:14 smithi076 ceph-mon[35401]: pgmap v9323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:14 smithi040 ceph-mon[32397]: pgmap v9323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:16 smithi146 ceph-mon[35807]: pgmap v9324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:16 smithi076 ceph-mon[35401]: pgmap v9324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:16 smithi040 ceph-mon[32397]: pgmap v9324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13203.335951 secs 2024-07-26T17:13:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13203.335951 secs 2024-07-26T17:13:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13203.335951 secs 2024-07-26T17:13:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:18 smithi146 ceph-mon[35807]: pgmap v9325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:18 smithi076 ceph-mon[35401]: pgmap v9325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:18 smithi040 ceph-mon[32397]: pgmap v9325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:20.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:20 smithi146 ceph-mon[35807]: pgmap v9326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:20 smithi076 ceph-mon[35401]: pgmap v9326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:20 smithi040 ceph-mon[32397]: pgmap v9326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:22 smithi146 ceph-mon[35807]: pgmap v9327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13208.336090 secs 2024-07-26T17:13:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:22 smithi076 ceph-mon[35401]: pgmap v9327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13208.336090 secs 2024-07-26T17:13:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:22 smithi040 ceph-mon[32397]: pgmap v9327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13208.336090 secs 2024-07-26T17:13:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:24 smithi146 ceph-mon[35807]: pgmap v9328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:24 smithi076 ceph-mon[35401]: pgmap v9328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:24 smithi040 ceph-mon[32397]: pgmap v9328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:26.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:26 smithi076 ceph-mon[35401]: pgmap v9329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:26 smithi040 ceph-mon[32397]: pgmap v9329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:26 smithi146 ceph-mon[35807]: pgmap v9329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13213.336228 secs 2024-07-26T17:13:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13213.336228 secs 2024-07-26T17:13:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13213.336228 secs 2024-07-26T17:13:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:28 smithi040 ceph-mon[32397]: pgmap v9330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:28 smithi146 ceph-mon[35807]: pgmap v9330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:28 smithi076 ceph-mon[35401]: pgmap v9330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:30 smithi040 ceph-mon[32397]: pgmap v9331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:30 smithi146 ceph-mon[35807]: pgmap v9331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:30 smithi076 ceph-mon[35401]: pgmap v9331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:32 smithi040 ceph-mon[32397]: pgmap v9332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13218.336382 secs 2024-07-26T17:13:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:32 smithi146 ceph-mon[35807]: pgmap v9332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13218.336382 secs 2024-07-26T17:13:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:32 smithi076 ceph-mon[35401]: pgmap v9332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13218.336382 secs 2024-07-26T17:13:34.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:34 smithi146 ceph-mon[35807]: pgmap v9333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:34 smithi040 ceph-mon[32397]: pgmap v9333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:34 smithi076 ceph-mon[35401]: pgmap v9333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:36 smithi040 ceph-mon[32397]: pgmap v9334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:36 smithi146 ceph-mon[35807]: pgmap v9334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:36 smithi076 ceph-mon[35401]: pgmap v9334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:37.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13223.336521 secs 2024-07-26T17:13:37.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13223.336521 secs 2024-07-26T17:13:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13223.336521 secs 2024-07-26T17:13:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:38 smithi040 ceph-mon[32397]: pgmap v9335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:38 smithi146 ceph-mon[35807]: pgmap v9335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:38 smithi076 ceph-mon[35401]: pgmap v9335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:40 smithi040 ceph-mon[32397]: pgmap v9336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:40 smithi146 ceph-mon[35807]: pgmap v9336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:40 smithi076 ceph-mon[35401]: pgmap v9336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:42 smithi040 ceph-mon[32397]: pgmap v9337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13228.336621 secs 2024-07-26T17:13:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:42 smithi146 ceph-mon[35807]: pgmap v9337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13228.336621 secs 2024-07-26T17:13:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:42 smithi076 ceph-mon[35401]: pgmap v9337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13228.336621 secs 2024-07-26T17:13:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:44 smithi040 ceph-mon[32397]: pgmap v9338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:44 smithi146 ceph-mon[35807]: pgmap v9338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:44 smithi076 ceph-mon[35401]: pgmap v9338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:46 smithi040 ceph-mon[32397]: pgmap v9339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:46 smithi146 ceph-mon[35807]: pgmap v9339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:46 smithi076 ceph-mon[35401]: pgmap v9339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13233.336781 secs 2024-07-26T17:13:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13233.336781 secs 2024-07-26T17:13:47.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13233.336781 secs 2024-07-26T17:13:48.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:48 smithi040 ceph-mon[32397]: pgmap v9340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:48 smithi146 ceph-mon[35807]: pgmap v9340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:48 smithi076 ceph-mon[35401]: pgmap v9340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:50.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:50 smithi040 ceph-mon[32397]: pgmap v9341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:50 smithi146 ceph-mon[35807]: pgmap v9341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:50 smithi076 ceph-mon[35401]: pgmap v9341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:13:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:52 smithi040 ceph-mon[32397]: pgmap v9342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13238.336944 secs 2024-07-26T17:13:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:52 smithi146 ceph-mon[35807]: pgmap v9342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13238.336944 secs 2024-07-26T17:13:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:52 smithi076 ceph-mon[35401]: pgmap v9342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13238.336944 secs 2024-07-26T17:13:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:54 smithi040 ceph-mon[32397]: pgmap v9343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:54 smithi146 ceph-mon[35807]: pgmap v9343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:54 smithi076 ceph-mon[35401]: pgmap v9343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:56 smithi040 ceph-mon[32397]: pgmap v9344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:56 smithi146 ceph-mon[35807]: pgmap v9344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:56 smithi076 ceph-mon[35401]: pgmap v9344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:13:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13243.337094 secs 2024-07-26T17:13:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13243.337094 secs 2024-07-26T17:13:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13243.337094 secs 2024-07-26T17:13:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:13:58 smithi040 ceph-mon[32397]: pgmap v9345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:13:58 smithi146 ceph-mon[35807]: pgmap v9345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:13:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:13:58 smithi076 ceph-mon[35401]: pgmap v9345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:00 smithi040 ceph-mon[32397]: pgmap v9346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:00 smithi146 ceph-mon[35807]: pgmap v9346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:00 smithi076 ceph-mon[35401]: pgmap v9346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:02 smithi146 ceph-mon[35807]: pgmap v9347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:14:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13248.337311 secs 2024-07-26T17:14:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:02 smithi076 ceph-mon[35401]: pgmap v9347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:14:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13248.337311 secs 2024-07-26T17:14:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:02 smithi040 ceph-mon[32397]: pgmap v9347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:14:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13248.337311 secs 2024-07-26T17:14:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:04 smithi146 ceph-mon[35807]: pgmap v9348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:04 smithi076 ceph-mon[35401]: pgmap v9348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:04 smithi040 ceph-mon[32397]: pgmap v9348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:06 smithi146 ceph-mon[35807]: pgmap v9349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:06 smithi076 ceph-mon[35401]: pgmap v9349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:06 smithi040 ceph-mon[32397]: pgmap v9349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13253.337362 secs 2024-07-26T17:14:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13253.337362 secs 2024-07-26T17:14:07.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13253.337362 secs 2024-07-26T17:14:08.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:08 smithi146 ceph-mon[35807]: pgmap v9350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:08.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:08 smithi076 ceph-mon[35401]: pgmap v9350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:08 smithi040 ceph-mon[32397]: pgmap v9350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:10 smithi146 ceph-mon[35807]: pgmap v9351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:10.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:10 smithi076 ceph-mon[35401]: pgmap v9351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:10 smithi040 ceph-mon[32397]: pgmap v9351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:12 smithi146 ceph-mon[35807]: pgmap v9352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13258.337521 secs 2024-07-26T17:14:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:12 smithi076 ceph-mon[35401]: pgmap v9352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13258.337521 secs 2024-07-26T17:14:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:12 smithi040 ceph-mon[32397]: pgmap v9352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13258.337521 secs 2024-07-26T17:14:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:14 smithi146 ceph-mon[35807]: pgmap v9353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:14 smithi076 ceph-mon[35401]: pgmap v9353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:14 smithi040 ceph-mon[32397]: pgmap v9353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:16 smithi146 ceph-mon[35807]: pgmap v9354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:16 smithi076 ceph-mon[35401]: pgmap v9354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:16 smithi040 ceph-mon[32397]: pgmap v9354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13263.337679 secs 2024-07-26T17:14:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13263.337679 secs 2024-07-26T17:14:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13263.337679 secs 2024-07-26T17:14:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:18 smithi146 ceph-mon[35807]: pgmap v9355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:18 smithi076 ceph-mon[35401]: pgmap v9355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:18 smithi040 ceph-mon[32397]: pgmap v9355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:20 smithi146 ceph-mon[35807]: pgmap v9356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:20 smithi076 ceph-mon[35401]: pgmap v9356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:20 smithi040 ceph-mon[32397]: pgmap v9356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:22 smithi076 ceph-mon[35401]: pgmap v9357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:22.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13268.337778 secs 2024-07-26T17:14:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:22 smithi040 ceph-mon[32397]: pgmap v9357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13268.337778 secs 2024-07-26T17:14:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:22 smithi146 ceph-mon[35807]: pgmap v9357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13268.337778 secs 2024-07-26T17:14:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:24 smithi076 ceph-mon[35401]: pgmap v9358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:24 smithi040 ceph-mon[32397]: pgmap v9358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:24 smithi146 ceph-mon[35807]: pgmap v9358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:26 smithi040 ceph-mon[32397]: pgmap v9359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:26 smithi146 ceph-mon[35807]: pgmap v9359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:26 smithi076 ceph-mon[35401]: pgmap v9359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13273.337915 secs 2024-07-26T17:14:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13273.337915 secs 2024-07-26T17:14:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13273.337915 secs 2024-07-26T17:14:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:28 smithi040 ceph-mon[32397]: pgmap v9360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:28 smithi146 ceph-mon[35807]: pgmap v9360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:28 smithi076 ceph-mon[35401]: pgmap v9360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:30 smithi040 ceph-mon[32397]: pgmap v9361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:30 smithi146 ceph-mon[35807]: pgmap v9361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:30 smithi076 ceph-mon[35401]: pgmap v9361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:32 smithi040 ceph-mon[32397]: pgmap v9362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13278.338056 secs 2024-07-26T17:14:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:32 smithi146 ceph-mon[35807]: pgmap v9362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13278.338056 secs 2024-07-26T17:14:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:32 smithi076 ceph-mon[35401]: pgmap v9362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13278.338056 secs 2024-07-26T17:14:34.625 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:34 smithi146 ceph-mon[35807]: pgmap v9363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:34 smithi040 ceph-mon[32397]: pgmap v9363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:34 smithi076 ceph-mon[35401]: pgmap v9363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:36 smithi040 ceph-mon[32397]: pgmap v9364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:36 smithi146 ceph-mon[35807]: pgmap v9364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:36 smithi076 ceph-mon[35401]: pgmap v9364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13283.338217 secs 2024-07-26T17:14:37.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13283.338217 secs 2024-07-26T17:14:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13283.338217 secs 2024-07-26T17:14:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:38 smithi040 ceph-mon[32397]: pgmap v9365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:38 smithi146 ceph-mon[35807]: pgmap v9365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:38 smithi076 ceph-mon[35401]: pgmap v9365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:39 smithi040 ceph-mon[32397]: pgmap v9366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:39 smithi146 ceph-mon[35807]: pgmap v9366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:39 smithi076 ceph-mon[35401]: pgmap v9366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:14:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:41 smithi040 ceph-mon[32397]: pgmap v9367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13288.338363 secs 2024-07-26T17:14:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:41 smithi146 ceph-mon[35807]: pgmap v9367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13288.338363 secs 2024-07-26T17:14:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:41 smithi076 ceph-mon[35401]: pgmap v9367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13288.338363 secs 2024-07-26T17:14:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:43 smithi040 ceph-mon[32397]: pgmap v9368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:43 smithi146 ceph-mon[35807]: pgmap v9368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:43 smithi076 ceph-mon[35401]: pgmap v9368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:14:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:14:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: pgmap v9369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 2 op/s 2024-07-26T17:14:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: pgmap v9370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-07-26T17:14:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: pgmap v9371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 677 B/s rd, 1 op/s 2024-07-26T17:14:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: pgmap v9372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:44 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:14:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:14:45.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:14:45.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: pgmap v9369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 2 op/s 2024-07-26T17:14:45.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: pgmap v9370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-07-26T17:14:45.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: pgmap v9371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 677 B/s rd, 1 op/s 2024-07-26T17:14:45.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: pgmap v9372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:45.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:44 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:14:45.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:14:45.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:14:45.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: pgmap v9369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 2 op/s 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: pgmap v9370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: pgmap v9371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 677 B/s rd, 1 op/s 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: pgmap v9372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:45.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:44 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:14:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13293.338495 secs 2024-07-26T17:14:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:47 smithi040 ceph-mon[32397]: pgmap v9373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13293.338495 secs 2024-07-26T17:14:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:47 smithi146 ceph-mon[35807]: pgmap v9373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13293.338495 secs 2024-07-26T17:14:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:47 smithi076 ceph-mon[35401]: pgmap v9373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:49 smithi040 ceph-mon[32397]: pgmap v9374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:49 smithi146 ceph-mon[35807]: pgmap v9374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:49 smithi076 ceph-mon[35401]: pgmap v9374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-07-26T17:14:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:51 smithi040 ceph-mon[32397]: pgmap v9375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T17:14:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:51 smithi146 ceph-mon[35807]: pgmap v9375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T17:14:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:51 smithi076 ceph-mon[35401]: pgmap v9375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-07-26T17:14:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13298.338599 secs 2024-07-26T17:14:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13298.338599 secs 2024-07-26T17:14:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13298.338599 secs 2024-07-26T17:14:53.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:53 smithi040 ceph-mon[32397]: pgmap v9376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:14:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:53 smithi146 ceph-mon[35807]: pgmap v9376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:14:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:53 smithi076 ceph-mon[35401]: pgmap v9376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:14:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:55 smithi040 ceph-mon[32397]: pgmap v9377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:14:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:55 smithi146 ceph-mon[35807]: pgmap v9377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:14:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:55 smithi076 ceph-mon[35401]: pgmap v9377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:14:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13303.338711 secs 2024-07-26T17:14:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:57 smithi040 ceph-mon[32397]: pgmap v9378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13303.338711 secs 2024-07-26T17:14:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:57 smithi146 ceph-mon[35807]: pgmap v9378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13303.338711 secs 2024-07-26T17:14:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:57 smithi076 ceph-mon[35401]: pgmap v9378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:14:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:14:59 smithi040 ceph-mon[32397]: pgmap v9379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:14:59 smithi146 ceph-mon[35807]: pgmap v9379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:14:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:14:59 smithi076 ceph-mon[35401]: pgmap v9379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:01 smithi040 ceph-mon[32397]: pgmap v9380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:01 smithi146 ceph-mon[35807]: pgmap v9380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:01 smithi076 ceph-mon[35401]: pgmap v9380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13308.338847 secs 2024-07-26T17:15:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13308.338847 secs 2024-07-26T17:15:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13308.338847 secs 2024-07-26T17:15:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:03 smithi146 ceph-mon[35807]: pgmap v9381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:03 smithi076 ceph-mon[35401]: pgmap v9381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:03 smithi040 ceph-mon[32397]: pgmap v9381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:05 smithi146 ceph-mon[35807]: pgmap v9382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:05 smithi076 ceph-mon[35401]: pgmap v9382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:05 smithi040 ceph-mon[32397]: pgmap v9382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:07.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13313.338988 secs 2024-07-26T17:15:07.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:07 smithi040 ceph-mon[32397]: pgmap v9383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13313.338988 secs 2024-07-26T17:15:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:07 smithi146 ceph-mon[35807]: pgmap v9383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13313.338988 secs 2024-07-26T17:15:07.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:07 smithi076 ceph-mon[35401]: pgmap v9383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:09 smithi146 ceph-mon[35807]: pgmap v9384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:09 smithi076 ceph-mon[35401]: pgmap v9384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:09 smithi040 ceph-mon[32397]: pgmap v9384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:11 smithi146 ceph-mon[35807]: pgmap v9385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:11 smithi076 ceph-mon[35401]: pgmap v9385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:11 smithi040 ceph-mon[32397]: pgmap v9385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13318.339144 secs 2024-07-26T17:15:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13318.339144 secs 2024-07-26T17:15:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13318.339144 secs 2024-07-26T17:15:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:13 smithi146 ceph-mon[35807]: pgmap v9386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:13 smithi076 ceph-mon[35401]: pgmap v9386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:13 smithi040 ceph-mon[32397]: pgmap v9386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:15 smithi146 ceph-mon[35807]: pgmap v9387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:15 smithi076 ceph-mon[35401]: pgmap v9387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:15 smithi040 ceph-mon[32397]: pgmap v9387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13323.339226 secs 2024-07-26T17:15:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:17 smithi146 ceph-mon[35807]: pgmap v9388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:15:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13323.339226 secs 2024-07-26T17:15:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:17 smithi076 ceph-mon[35401]: pgmap v9388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:15:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13323.339226 secs 2024-07-26T17:15:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:17 smithi040 ceph-mon[32397]: pgmap v9388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:15:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:19 smithi146 ceph-mon[35807]: pgmap v9389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:19 smithi076 ceph-mon[35401]: pgmap v9389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:19 smithi040 ceph-mon[32397]: pgmap v9389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:21 smithi146 ceph-mon[35807]: pgmap v9390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:21 smithi076 ceph-mon[35401]: pgmap v9390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:21 smithi040 ceph-mon[32397]: pgmap v9390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13328.339365 secs 2024-07-26T17:15:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13328.339365 secs 2024-07-26T17:15:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13328.339365 secs 2024-07-26T17:15:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:23 smithi076 ceph-mon[35401]: pgmap v9391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:23 smithi040 ceph-mon[32397]: pgmap v9391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:23 smithi146 ceph-mon[35807]: pgmap v9391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:25 smithi040 ceph-mon[32397]: pgmap v9392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:25 smithi146 ceph-mon[35807]: pgmap v9392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:25 smithi076 ceph-mon[35401]: pgmap v9392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:15:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13333.339511 secs 2024-07-26T17:15:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:27 smithi040 ceph-mon[32397]: pgmap v9393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:15:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13333.339511 secs 2024-07-26T17:15:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:27 smithi146 ceph-mon[35807]: pgmap v9393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:15:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13333.339511 secs 2024-07-26T17:15:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:27 smithi076 ceph-mon[35401]: pgmap v9393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:15:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:29 smithi040 ceph-mon[32397]: pgmap v9394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:29 smithi146 ceph-mon[35807]: pgmap v9394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:29 smithi076 ceph-mon[35401]: pgmap v9394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:31.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:31 smithi040 ceph-mon[32397]: pgmap v9395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:31 smithi146 ceph-mon[35807]: pgmap v9395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:31 smithi076 ceph-mon[35401]: pgmap v9395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13338.339647 secs 2024-07-26T17:15:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13338.339647 secs 2024-07-26T17:15:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13338.339647 secs 2024-07-26T17:15:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:33 smithi040 ceph-mon[32397]: pgmap v9396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:33 smithi146 ceph-mon[35807]: pgmap v9396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:33 smithi076 ceph-mon[35401]: pgmap v9396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:35 smithi040 ceph-mon[32397]: pgmap v9397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:35 smithi146 ceph-mon[35807]: pgmap v9397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:35 smithi076 ceph-mon[35401]: pgmap v9397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13343.339784 secs 2024-07-26T17:15:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:37 smithi040 ceph-mon[32397]: pgmap v9398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13343.339784 secs 2024-07-26T17:15:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:37 smithi146 ceph-mon[35807]: pgmap v9398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13343.339784 secs 2024-07-26T17:15:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:37 smithi076 ceph-mon[35401]: pgmap v9398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:39 smithi040 ceph-mon[32397]: pgmap v9399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:39 smithi146 ceph-mon[35807]: pgmap v9399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:39 smithi076 ceph-mon[35401]: pgmap v9399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:40 smithi040 ceph-mon[32397]: pgmap v9400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:40 smithi146 ceph-mon[35807]: pgmap v9400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:40 smithi076 ceph-mon[35401]: pgmap v9400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13348.339926 secs 2024-07-26T17:15:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13348.339926 secs 2024-07-26T17:15:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13348.339926 secs 2024-07-26T17:15:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:42 smithi040 ceph-mon[32397]: pgmap v9401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:42 smithi146 ceph-mon[35807]: pgmap v9401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:42 smithi076 ceph-mon[35401]: pgmap v9401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: pgmap v9402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:15:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:45 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: pgmap v9402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:15:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:45 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: pgmap v9402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:15:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:45.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:45 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:46 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:46 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:46 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:47.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13353.340031 secs 2024-07-26T17:15:47.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:47 smithi040 ceph-mon[32397]: pgmap v9403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13353.340031 secs 2024-07-26T17:15:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:47 smithi146 ceph-mon[35807]: pgmap v9403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:47.582 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13353.340031 secs 2024-07-26T17:15:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:47 smithi076 ceph-mon[35401]: pgmap v9403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: pgmap v9404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:49 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: pgmap v9404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:49 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: pgmap v9404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:49.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:49.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:49 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:51 smithi146 ceph-mon[35807]: pgmap v9405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:51 smithi076 ceph-mon[35401]: pgmap v9405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:51 smithi040 ceph-mon[32397]: pgmap v9405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13358.340141 secs 2024-07-26T17:15:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13358.340141 secs 2024-07-26T17:15:52.552 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13358.340141 secs 2024-07-26T17:15:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:53 smithi146 ceph-mon[35807]: pgmap v9406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:53 smithi076 ceph-mon[35401]: pgmap v9406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:53 smithi040 ceph-mon[32397]: pgmap v9406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: pgmap v9407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: pgmap v9407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:55.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: pgmap v9407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:15:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:15:55.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:55.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:15:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:56 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:15:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:56 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:15:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:56 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:15:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:56 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:15:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:56 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:15:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:56 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:15:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:56 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:15:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:56 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:15:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:56 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:15:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:56 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:15:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:56 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:15:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:56 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:15:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13363.340304 secs 2024-07-26T17:15:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:57 smithi146 ceph-mon[35807]: pgmap v9408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13363.340304 secs 2024-07-26T17:15:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:57 smithi076 ceph-mon[35401]: pgmap v9408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13363.340304 secs 2024-07-26T17:15:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:57 smithi040 ceph-mon[32397]: pgmap v9408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:15:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:15:59 smithi146 ceph-mon[35807]: pgmap v9409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:15:59 smithi076 ceph-mon[35401]: pgmap v9409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:15:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:15:59 smithi040 ceph-mon[32397]: pgmap v9409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:01 smithi146 ceph-mon[35807]: pgmap v9410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:01 smithi076 ceph-mon[35401]: pgmap v9410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:01 smithi040 ceph-mon[32397]: pgmap v9410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13368.340465 secs 2024-07-26T17:16:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13368.340465 secs 2024-07-26T17:16:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13368.340465 secs 2024-07-26T17:16:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:03 smithi146 ceph-mon[35807]: pgmap v9411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:03 smithi076 ceph-mon[35401]: pgmap v9411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:03 smithi040 ceph-mon[32397]: pgmap v9411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:05.376 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:05 smithi146 ceph-mon[35807]: pgmap v9412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:05 smithi076 ceph-mon[35401]: pgmap v9412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:05 smithi040 ceph-mon[32397]: pgmap v9412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13373.340601 secs 2024-07-26T17:16:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:07 smithi076 ceph-mon[35401]: pgmap v9413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13373.340601 secs 2024-07-26T17:16:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:07 smithi040 ceph-mon[32397]: pgmap v9413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13373.340601 secs 2024-07-26T17:16:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:07 smithi146 ceph-mon[35807]: pgmap v9413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:09 smithi076 ceph-mon[35401]: pgmap v9414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:09.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:09 smithi040 ceph-mon[32397]: pgmap v9414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:09 smithi146 ceph-mon[35807]: pgmap v9414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:11 smithi040 ceph-mon[32397]: pgmap v9415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:11 smithi146 ceph-mon[35807]: pgmap v9415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:11 smithi076 ceph-mon[35401]: pgmap v9415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13378.340741 secs 2024-07-26T17:16:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13378.340741 secs 2024-07-26T17:16:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13378.340741 secs 2024-07-26T17:16:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:13 smithi040 ceph-mon[32397]: pgmap v9416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:13 smithi146 ceph-mon[35807]: pgmap v9416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:13 smithi076 ceph-mon[35401]: pgmap v9416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:15 smithi040 ceph-mon[32397]: pgmap v9417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:15 smithi146 ceph-mon[35807]: pgmap v9417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:15 smithi076 ceph-mon[35401]: pgmap v9417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13383.340881 secs 2024-07-26T17:16:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:17 smithi040 ceph-mon[32397]: pgmap v9418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13383.340881 secs 2024-07-26T17:16:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:17 smithi146 ceph-mon[35807]: pgmap v9418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13383.340881 secs 2024-07-26T17:16:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:17 smithi076 ceph-mon[35401]: pgmap v9418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:19 smithi076 ceph-mon[35401]: pgmap v9419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:19.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:19 smithi040 ceph-mon[32397]: pgmap v9419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:19 smithi146 ceph-mon[35807]: pgmap v9419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:21 smithi040 ceph-mon[32397]: pgmap v9420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:21 smithi146 ceph-mon[35807]: pgmap v9420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:21 smithi076 ceph-mon[35401]: pgmap v9420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13388.340966 secs 2024-07-26T17:16:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13388.340966 secs 2024-07-26T17:16:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13388.340966 secs 2024-07-26T17:16:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:23 smithi040 ceph-mon[32397]: pgmap v9421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:23 smithi146 ceph-mon[35807]: pgmap v9421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:23 smithi076 ceph-mon[35401]: pgmap v9421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:25 smithi040 ceph-mon[32397]: pgmap v9422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:25 smithi146 ceph-mon[35807]: pgmap v9422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:25 smithi076 ceph-mon[35401]: pgmap v9422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:26 smithi040 ceph-mon[32397]: pgmap v9423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:26 smithi146 ceph-mon[35807]: pgmap v9423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:26 smithi076 ceph-mon[35401]: pgmap v9423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13393.341109 secs 2024-07-26T17:16:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13393.341109 secs 2024-07-26T17:16:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13393.341109 secs 2024-07-26T17:16:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:28 smithi040 ceph-mon[32397]: pgmap v9424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:28 smithi146 ceph-mon[35807]: pgmap v9424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:28 smithi076 ceph-mon[35401]: pgmap v9424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:31 smithi040 ceph-mon[32397]: pgmap v9425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:31 smithi146 ceph-mon[35807]: pgmap v9425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:31 smithi076 ceph-mon[35401]: pgmap v9425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13398.341246 secs 2024-07-26T17:16:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13398.341246 secs 2024-07-26T17:16:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13398.341246 secs 2024-07-26T17:16:33.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:33 smithi146 ceph-mon[35807]: pgmap v9426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:33 smithi076 ceph-mon[35401]: pgmap v9426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:33 smithi040 ceph-mon[32397]: pgmap v9426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:35.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:35 smithi146 ceph-mon[35807]: pgmap v9427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:35.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:35 smithi076 ceph-mon[35401]: pgmap v9427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:35 smithi040 ceph-mon[32397]: pgmap v9427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:37.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13403.341404 secs 2024-07-26T17:16:37.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:37 smithi040 ceph-mon[32397]: pgmap v9428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13403.341404 secs 2024-07-26T17:16:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:37 smithi146 ceph-mon[35807]: pgmap v9428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13403.341404 secs 2024-07-26T17:16:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:37 smithi076 ceph-mon[35401]: pgmap v9428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:39 smithi146 ceph-mon[35807]: pgmap v9429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:39 smithi076 ceph-mon[35401]: pgmap v9429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:39 smithi040 ceph-mon[32397]: pgmap v9429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:41 smithi146 ceph-mon[35807]: pgmap v9430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:41.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:41 smithi076 ceph-mon[35401]: pgmap v9430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:41 smithi040 ceph-mon[32397]: pgmap v9430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13408.341546 secs 2024-07-26T17:16:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13408.341546 secs 2024-07-26T17:16:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13408.341546 secs 2024-07-26T17:16:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:43 smithi146 ceph-mon[35807]: pgmap v9431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:43 smithi076 ceph-mon[35401]: pgmap v9431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:43 smithi040 ceph-mon[32397]: pgmap v9431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:45.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:45 smithi146 ceph-mon[35807]: pgmap v9432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:45 smithi076 ceph-mon[35401]: pgmap v9432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:45 smithi040 ceph-mon[32397]: pgmap v9432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13413.341679 secs 2024-07-26T17:16:47.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:47 smithi146 ceph-mon[35807]: pgmap v9433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13413.341679 secs 2024-07-26T17:16:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:47 smithi076 ceph-mon[35401]: pgmap v9433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13413.341679 secs 2024-07-26T17:16:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:47 smithi040 ceph-mon[32397]: pgmap v9433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:49 smithi076 ceph-mon[35401]: pgmap v9434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:49 smithi040 ceph-mon[32397]: pgmap v9434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:49 smithi146 ceph-mon[35807]: pgmap v9434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:51.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:51 smithi076 ceph-mon[35401]: pgmap v9435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:51 smithi040 ceph-mon[32397]: pgmap v9435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:51 smithi146 ceph-mon[35807]: pgmap v9435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13418.341820 secs 2024-07-26T17:16:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13418.341820 secs 2024-07-26T17:16:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13418.341820 secs 2024-07-26T17:16:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:53 smithi040 ceph-mon[32397]: pgmap v9436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:53 smithi146 ceph-mon[35807]: pgmap v9436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:53 smithi076 ceph-mon[35401]: pgmap v9436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:55 smithi040 ceph-mon[32397]: pgmap v9437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:55 smithi146 ceph-mon[35807]: pgmap v9437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:55 smithi076 ceph-mon[35401]: pgmap v9437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:16:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13423.341960 secs 2024-07-26T17:16:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:56 smithi040 ceph-mon[32397]: pgmap v9438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13423.341960 secs 2024-07-26T17:16:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:56 smithi146 ceph-mon[35807]: pgmap v9438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13423.341960 secs 2024-07-26T17:16:57.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:56 smithi076 ceph-mon[35401]: pgmap v9438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:16:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:16:59 smithi146 ceph-mon[35807]: pgmap v9439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:16:59 smithi076 ceph-mon[35401]: pgmap v9439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:16:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:16:59 smithi040 ceph-mon[32397]: pgmap v9439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:01 smithi146 ceph-mon[35807]: pgmap v9440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:01 smithi076 ceph-mon[35401]: pgmap v9440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:01 smithi040 ceph-mon[32397]: pgmap v9440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13428.342098 secs 2024-07-26T17:17:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13428.342098 secs 2024-07-26T17:17:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13428.342098 secs 2024-07-26T17:17:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:03 smithi146 ceph-mon[35807]: pgmap v9441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:03 smithi076 ceph-mon[35401]: pgmap v9441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:03 smithi040 ceph-mon[32397]: pgmap v9441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:05 smithi146 ceph-mon[35807]: pgmap v9442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:05 smithi076 ceph-mon[35401]: pgmap v9442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:05 smithi040 ceph-mon[32397]: pgmap v9442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:07.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13433.342236 secs 2024-07-26T17:17:07.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:07 smithi040 ceph-mon[32397]: pgmap v9443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13433.342236 secs 2024-07-26T17:17:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:07 smithi146 ceph-mon[35807]: pgmap v9443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13433.342236 secs 2024-07-26T17:17:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:07 smithi076 ceph-mon[35401]: pgmap v9443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:09 smithi146 ceph-mon[35807]: pgmap v9444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:09 smithi076 ceph-mon[35401]: pgmap v9444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:09 smithi040 ceph-mon[32397]: pgmap v9444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:11 smithi146 ceph-mon[35807]: pgmap v9445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:11 smithi076 ceph-mon[35401]: pgmap v9445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:11 smithi040 ceph-mon[32397]: pgmap v9445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13438.342376 secs 2024-07-26T17:17:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13438.342376 secs 2024-07-26T17:17:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13438.342376 secs 2024-07-26T17:17:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:13 smithi146 ceph-mon[35807]: pgmap v9446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:13 smithi076 ceph-mon[35401]: pgmap v9446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:13 smithi040 ceph-mon[32397]: pgmap v9446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:15.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:15 smithi146 ceph-mon[35807]: pgmap v9447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:15 smithi076 ceph-mon[35401]: pgmap v9447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:15 smithi040 ceph-mon[32397]: pgmap v9447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13443.342512 secs 2024-07-26T17:17:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:16 smithi040 ceph-mon[32397]: pgmap v9448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13443.342512 secs 2024-07-26T17:17:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:16 smithi146 ceph-mon[35807]: pgmap v9448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13443.342512 secs 2024-07-26T17:17:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:16 smithi076 ceph-mon[35401]: pgmap v9448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:19 smithi146 ceph-mon[35807]: pgmap v9449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:19 smithi076 ceph-mon[35401]: pgmap v9449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:19 smithi040 ceph-mon[32397]: pgmap v9449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:21 smithi146 ceph-mon[35807]: pgmap v9450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:21 smithi076 ceph-mon[35401]: pgmap v9450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:21 smithi040 ceph-mon[32397]: pgmap v9450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13448.342651 secs 2024-07-26T17:17:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13448.342651 secs 2024-07-26T17:17:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13448.342651 secs 2024-07-26T17:17:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:23 smithi146 ceph-mon[35807]: pgmap v9451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:23 smithi076 ceph-mon[35401]: pgmap v9451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:23 smithi040 ceph-mon[32397]: pgmap v9451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:25 smithi146 ceph-mon[35807]: pgmap v9452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:25 smithi076 ceph-mon[35401]: pgmap v9452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:25 smithi040 ceph-mon[32397]: pgmap v9452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13453.342824 secs 2024-07-26T17:17:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:27 smithi146 ceph-mon[35807]: pgmap v9453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13453.342824 secs 2024-07-26T17:17:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:27 smithi076 ceph-mon[35401]: pgmap v9453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13453.342824 secs 2024-07-26T17:17:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:27 smithi040 ceph-mon[32397]: pgmap v9453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:29 smithi146 ceph-mon[35807]: pgmap v9454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:29 smithi076 ceph-mon[35401]: pgmap v9454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:29 smithi040 ceph-mon[32397]: pgmap v9454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:31.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:31 smithi146 ceph-mon[35807]: pgmap v9455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:31 smithi076 ceph-mon[35401]: pgmap v9455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:31 smithi040 ceph-mon[32397]: pgmap v9455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13458.342964 secs 2024-07-26T17:17:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13458.342964 secs 2024-07-26T17:17:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13458.342964 secs 2024-07-26T17:17:33.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:33 smithi076 ceph-mon[35401]: pgmap v9456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:33 smithi040 ceph-mon[32397]: pgmap v9456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:33 smithi146 ceph-mon[35807]: pgmap v9456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:35.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:35 smithi146 ceph-mon[35807]: pgmap v9457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:35 smithi040 ceph-mon[32397]: pgmap v9457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:35 smithi076 ceph-mon[35401]: pgmap v9457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:37.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13463.343096 secs 2024-07-26T17:17:37.637 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:37 smithi076 ceph-mon[35401]: pgmap v9458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13463.343096 secs 2024-07-26T17:17:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:37 smithi040 ceph-mon[32397]: pgmap v9458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13463.343096 secs 2024-07-26T17:17:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:37 smithi146 ceph-mon[35807]: pgmap v9458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:39 smithi040 ceph-mon[32397]: pgmap v9459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:39 smithi146 ceph-mon[35807]: pgmap v9459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:39 smithi076 ceph-mon[35401]: pgmap v9459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:41 smithi040 ceph-mon[32397]: pgmap v9460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:41 smithi146 ceph-mon[35807]: pgmap v9460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:41 smithi076 ceph-mon[35401]: pgmap v9460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13468.343289 secs 2024-07-26T17:17:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13468.343289 secs 2024-07-26T17:17:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13468.343289 secs 2024-07-26T17:17:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:43 smithi040 ceph-mon[32397]: pgmap v9461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:43 smithi146 ceph-mon[35807]: pgmap v9461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:43 smithi076 ceph-mon[35401]: pgmap v9461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:45 smithi040 ceph-mon[32397]: pgmap v9462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:45 smithi146 ceph-mon[35807]: pgmap v9462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:45 smithi076 ceph-mon[35401]: pgmap v9462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13473.343402 secs 2024-07-26T17:17:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:47 smithi040 ceph-mon[32397]: pgmap v9463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13473.343402 secs 2024-07-26T17:17:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:47 smithi146 ceph-mon[35807]: pgmap v9463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13473.343402 secs 2024-07-26T17:17:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:47 smithi076 ceph-mon[35401]: pgmap v9463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:49 smithi040 ceph-mon[32397]: pgmap v9464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:49 smithi146 ceph-mon[35807]: pgmap v9464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:49 smithi076 ceph-mon[35401]: pgmap v9464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:51 smithi040 ceph-mon[32397]: pgmap v9465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:51 smithi146 ceph-mon[35807]: pgmap v9465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:51 smithi076 ceph-mon[35401]: pgmap v9465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13478.343545 secs 2024-07-26T17:17:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13478.343545 secs 2024-07-26T17:17:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13478.343545 secs 2024-07-26T17:17:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:53 smithi040 ceph-mon[32397]: pgmap v9466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:53 smithi146 ceph-mon[35807]: pgmap v9466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:53 smithi076 ceph-mon[35401]: pgmap v9466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:55 smithi040 ceph-mon[32397]: pgmap v9467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:55 smithi146 ceph-mon[35807]: pgmap v9467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:55 smithi076 ceph-mon[35401]: pgmap v9467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:17:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:56 smithi040 ceph-mon[32397]: pgmap v9468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:56 smithi146 ceph-mon[35807]: pgmap v9468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:56 smithi076 ceph-mon[35401]: pgmap v9468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:17:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13483.343688 secs 2024-07-26T17:17:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13483.343688 secs 2024-07-26T17:17:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13483.343688 secs 2024-07-26T17:17:58.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:17:58 smithi146 ceph-mon[35807]: pgmap v9469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:17:58 smithi076 ceph-mon[35401]: pgmap v9469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:17:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:17:58 smithi040 ceph-mon[32397]: pgmap v9469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:01 smithi146 ceph-mon[35807]: pgmap v9470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:01 smithi076 ceph-mon[35401]: pgmap v9470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:01 smithi040 ceph-mon[32397]: pgmap v9470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13488.343825 secs 2024-07-26T17:18:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13488.343825 secs 2024-07-26T17:18:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13488.343825 secs 2024-07-26T17:18:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:03 smithi146 ceph-mon[35807]: pgmap v9471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:03 smithi076 ceph-mon[35401]: pgmap v9471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:03 smithi040 ceph-mon[32397]: pgmap v9471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:05 smithi146 ceph-mon[35807]: pgmap v9472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:05 smithi076 ceph-mon[35401]: pgmap v9472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:05 smithi040 ceph-mon[32397]: pgmap v9472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13493.343959 secs 2024-07-26T17:18:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:07 smithi146 ceph-mon[35807]: pgmap v9473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:07.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13493.343959 secs 2024-07-26T17:18:07.585 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:07 smithi076 ceph-mon[35401]: pgmap v9473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13493.343959 secs 2024-07-26T17:18:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:07 smithi040 ceph-mon[32397]: pgmap v9473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:09 smithi076 ceph-mon[35401]: pgmap v9474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:09 smithi040 ceph-mon[32397]: pgmap v9474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:09 smithi146 ceph-mon[35807]: pgmap v9474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:11 smithi076 ceph-mon[35401]: pgmap v9475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:11 smithi040 ceph-mon[32397]: pgmap v9475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:11 smithi146 ceph-mon[35807]: pgmap v9475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13498.344116 secs 2024-07-26T17:18:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13498.344116 secs 2024-07-26T17:18:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13498.344116 secs 2024-07-26T17:18:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:13 smithi040 ceph-mon[32397]: pgmap v9476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:13 smithi146 ceph-mon[35807]: pgmap v9476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:13 smithi076 ceph-mon[35401]: pgmap v9476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:15 smithi040 ceph-mon[32397]: pgmap v9477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:15 smithi146 ceph-mon[35807]: pgmap v9477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:15 smithi076 ceph-mon[35401]: pgmap v9477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13503.344240 secs 2024-07-26T17:18:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:17 smithi040 ceph-mon[32397]: pgmap v9478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13503.344240 secs 2024-07-26T17:18:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:17 smithi146 ceph-mon[35807]: pgmap v9478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13503.344240 secs 2024-07-26T17:18:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:17 smithi076 ceph-mon[35401]: pgmap v9478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:19 smithi040 ceph-mon[32397]: pgmap v9479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:19 smithi146 ceph-mon[35807]: pgmap v9479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:19 smithi076 ceph-mon[35401]: pgmap v9479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:21 smithi040 ceph-mon[32397]: pgmap v9480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:21 smithi146 ceph-mon[35807]: pgmap v9480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:21 smithi076 ceph-mon[35401]: pgmap v9480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13508.344379 secs 2024-07-26T17:18:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13508.344379 secs 2024-07-26T17:18:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13508.344379 secs 2024-07-26T17:18:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:23 smithi040 ceph-mon[32397]: pgmap v9481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:23 smithi146 ceph-mon[35807]: pgmap v9481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:23 smithi076 ceph-mon[35401]: pgmap v9481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:25 smithi040 ceph-mon[32397]: pgmap v9482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:25 smithi146 ceph-mon[35807]: pgmap v9482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:25 smithi076 ceph-mon[35401]: pgmap v9482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13513.344499 secs 2024-07-26T17:18:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:27 smithi040 ceph-mon[32397]: pgmap v9483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13513.344499 secs 2024-07-26T17:18:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:27 smithi146 ceph-mon[35807]: pgmap v9483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13513.344499 secs 2024-07-26T17:18:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:27 smithi076 ceph-mon[35401]: pgmap v9483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:29 smithi040 ceph-mon[32397]: pgmap v9484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:29 smithi146 ceph-mon[35807]: pgmap v9484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:29 smithi076 ceph-mon[35401]: pgmap v9484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:31 smithi040 ceph-mon[32397]: pgmap v9485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:31 smithi146 ceph-mon[35807]: pgmap v9485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:31 smithi076 ceph-mon[35401]: pgmap v9485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13518.344571 secs 2024-07-26T17:18:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13518.344571 secs 2024-07-26T17:18:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13518.344571 secs 2024-07-26T17:18:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:33 smithi040 ceph-mon[32397]: pgmap v9486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:33 smithi146 ceph-mon[35807]: pgmap v9486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:33 smithi076 ceph-mon[35401]: pgmap v9486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:34 smithi040 ceph-mon[32397]: pgmap v9487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:34 smithi146 ceph-mon[35807]: pgmap v9487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:34 smithi076 ceph-mon[35401]: pgmap v9487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13523.344719 secs 2024-07-26T17:18:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:37 smithi146 ceph-mon[35807]: pgmap v9488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13523.344719 secs 2024-07-26T17:18:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:37 smithi076 ceph-mon[35401]: pgmap v9488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13523.344719 secs 2024-07-26T17:18:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:37 smithi040 ceph-mon[32397]: pgmap v9488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:39 smithi146 ceph-mon[35807]: pgmap v9489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:39 smithi076 ceph-mon[35401]: pgmap v9489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:39 smithi040 ceph-mon[32397]: pgmap v9489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:41 smithi076 ceph-mon[35401]: pgmap v9490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:18:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:41 smithi040 ceph-mon[32397]: pgmap v9490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:18:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:41 smithi146 ceph-mon[35807]: pgmap v9490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:18:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13528.344859 secs 2024-07-26T17:18:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13528.344859 secs 2024-07-26T17:18:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13528.344859 secs 2024-07-26T17:18:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:43 smithi040 ceph-mon[32397]: pgmap v9491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:43 smithi146 ceph-mon[35807]: pgmap v9491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:43 smithi076 ceph-mon[35401]: pgmap v9491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:45 smithi040 ceph-mon[32397]: pgmap v9492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:45 smithi146 ceph-mon[35807]: pgmap v9492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:45 smithi076 ceph-mon[35401]: pgmap v9492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13533.344995 secs 2024-07-26T17:18:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:47 smithi040 ceph-mon[32397]: pgmap v9493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13533.344995 secs 2024-07-26T17:18:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:47 smithi146 ceph-mon[35807]: pgmap v9493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13533.344995 secs 2024-07-26T17:18:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:47 smithi076 ceph-mon[35401]: pgmap v9493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:49 smithi040 ceph-mon[32397]: pgmap v9494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:49 smithi146 ceph-mon[35807]: pgmap v9494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:49 smithi076 ceph-mon[35401]: pgmap v9494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:18:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:51 smithi040 ceph-mon[32397]: pgmap v9495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:18:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:51 smithi146 ceph-mon[35807]: pgmap v9495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:18:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:51 smithi076 ceph-mon[35401]: pgmap v9495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:18:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13538.345136 secs 2024-07-26T17:18:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13538.345136 secs 2024-07-26T17:18:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13538.345136 secs 2024-07-26T17:18:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:53 smithi040 ceph-mon[32397]: pgmap v9496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:53 smithi146 ceph-mon[35807]: pgmap v9496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:53 smithi076 ceph-mon[35401]: pgmap v9496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:55 smithi040 ceph-mon[32397]: pgmap v9497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:55 smithi146 ceph-mon[35807]: pgmap v9497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:55 smithi076 ceph-mon[35401]: pgmap v9497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:18:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13543.345317 secs 2024-07-26T17:18:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:57 smithi040 ceph-mon[32397]: pgmap v9498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13543.345317 secs 2024-07-26T17:18:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:57 smithi146 ceph-mon[35807]: pgmap v9498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13543.345317 secs 2024-07-26T17:18:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:57 smithi076 ceph-mon[35401]: pgmap v9498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:18:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:18:59 smithi040 ceph-mon[32397]: pgmap v9499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:18:59 smithi146 ceph-mon[35807]: pgmap v9499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:18:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:18:59 smithi076 ceph-mon[35401]: pgmap v9499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:01 smithi040 ceph-mon[32397]: pgmap v9500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:01 smithi146 ceph-mon[35807]: pgmap v9500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:01 smithi076 ceph-mon[35401]: pgmap v9500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13548.345455 secs 2024-07-26T17:19:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13548.345455 secs 2024-07-26T17:19:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13548.345455 secs 2024-07-26T17:19:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:03 smithi040 ceph-mon[32397]: pgmap v9501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:03 smithi146 ceph-mon[35807]: pgmap v9501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:03 smithi076 ceph-mon[35401]: pgmap v9501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:05 smithi040 ceph-mon[32397]: pgmap v9502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:05 smithi146 ceph-mon[35807]: pgmap v9502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:05 smithi076 ceph-mon[35401]: pgmap v9502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13553.345591 secs 2024-07-26T17:19:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:07 smithi040 ceph-mon[32397]: pgmap v9503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13553.345591 secs 2024-07-26T17:19:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:07 smithi146 ceph-mon[35807]: pgmap v9503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13553.345591 secs 2024-07-26T17:19:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:07 smithi076 ceph-mon[35401]: pgmap v9503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:08 smithi146 ceph-mon[35807]: pgmap v9504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:08 smithi076 ceph-mon[35401]: pgmap v9504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:08 smithi040 ceph-mon[32397]: pgmap v9504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:11 smithi076 ceph-mon[35401]: pgmap v9505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:11 smithi040 ceph-mon[32397]: pgmap v9505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:11 smithi146 ceph-mon[35807]: pgmap v9505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13558.345747 secs 2024-07-26T17:19:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13558.345747 secs 2024-07-26T17:19:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13558.345747 secs 2024-07-26T17:19:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:13 smithi040 ceph-mon[32397]: pgmap v9506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:13 smithi146 ceph-mon[35807]: pgmap v9506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:13 smithi076 ceph-mon[35401]: pgmap v9506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:15 smithi040 ceph-mon[32397]: pgmap v9507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:15 smithi146 ceph-mon[35807]: pgmap v9507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:15 smithi076 ceph-mon[35401]: pgmap v9507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13563.345890 secs 2024-07-26T17:19:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:17 smithi040 ceph-mon[32397]: pgmap v9508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13563.345890 secs 2024-07-26T17:19:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:17 smithi146 ceph-mon[35807]: pgmap v9508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13563.345890 secs 2024-07-26T17:19:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:17 smithi076 ceph-mon[35401]: pgmap v9508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:19 smithi040 ceph-mon[32397]: pgmap v9509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:19 smithi146 ceph-mon[35807]: pgmap v9509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:19 smithi076 ceph-mon[35401]: pgmap v9509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:21 smithi040 ceph-mon[32397]: pgmap v9510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:19:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:21 smithi146 ceph-mon[35807]: pgmap v9510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:19:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:21 smithi076 ceph-mon[35401]: pgmap v9510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:19:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13568.346031 secs 2024-07-26T17:19:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13568.346031 secs 2024-07-26T17:19:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13568.346031 secs 2024-07-26T17:19:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:23 smithi040 ceph-mon[32397]: pgmap v9511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:23 smithi146 ceph-mon[35807]: pgmap v9511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:23 smithi076 ceph-mon[35401]: pgmap v9511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:25 smithi040 ceph-mon[32397]: pgmap v9512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:25 smithi146 ceph-mon[35807]: pgmap v9512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:25 smithi076 ceph-mon[35401]: pgmap v9512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13573.346168 secs 2024-07-26T17:19:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:27 smithi040 ceph-mon[32397]: pgmap v9513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13573.346168 secs 2024-07-26T17:19:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:27 smithi146 ceph-mon[35807]: pgmap v9513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13573.346168 secs 2024-07-26T17:19:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:27 smithi076 ceph-mon[35401]: pgmap v9513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:29 smithi040 ceph-mon[32397]: pgmap v9514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:29 smithi146 ceph-mon[35807]: pgmap v9514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:29 smithi076 ceph-mon[35401]: pgmap v9514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:31 smithi040 ceph-mon[32397]: pgmap v9515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:31 smithi146 ceph-mon[35807]: pgmap v9515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:31 smithi076 ceph-mon[35401]: pgmap v9515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13578.346310 secs 2024-07-26T17:19:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13578.346310 secs 2024-07-26T17:19:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13578.346310 secs 2024-07-26T17:19:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:33 smithi040 ceph-mon[32397]: pgmap v9516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:33 smithi146 ceph-mon[35807]: pgmap v9516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:33 smithi076 ceph-mon[35401]: pgmap v9516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:35 smithi040 ceph-mon[32397]: pgmap v9517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:35 smithi146 ceph-mon[35807]: pgmap v9517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:35 smithi076 ceph-mon[35401]: pgmap v9517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13583.346388 secs 2024-07-26T17:19:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:37 smithi040 ceph-mon[32397]: pgmap v9518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13583.346388 secs 2024-07-26T17:19:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:37 smithi146 ceph-mon[35807]: pgmap v9518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13583.346388 secs 2024-07-26T17:19:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:37 smithi076 ceph-mon[35401]: pgmap v9518: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:38 smithi040 ceph-mon[32397]: pgmap v9519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:38 smithi146 ceph-mon[35807]: pgmap v9519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:38 smithi076 ceph-mon[35401]: pgmap v9519: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:41 smithi040 ceph-mon[32397]: pgmap v9520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:41 smithi146 ceph-mon[35807]: pgmap v9520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:41 smithi076 ceph-mon[35401]: pgmap v9520: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13588.346563 secs 2024-07-26T17:19:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13588.346563 secs 2024-07-26T17:19:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13588.346563 secs 2024-07-26T17:19:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:43 smithi040 ceph-mon[32397]: pgmap v9521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:43 smithi146 ceph-mon[35807]: pgmap v9521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:43 smithi076 ceph-mon[35401]: pgmap v9521: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:45 smithi040 ceph-mon[32397]: pgmap v9522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:45 smithi146 ceph-mon[35807]: pgmap v9522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:45 smithi076 ceph-mon[35401]: pgmap v9522: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13593.346691 secs 2024-07-26T17:19:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:47 smithi040 ceph-mon[32397]: pgmap v9523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13593.346691 secs 2024-07-26T17:19:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:47 smithi146 ceph-mon[35807]: pgmap v9523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13593.346691 secs 2024-07-26T17:19:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:47 smithi076 ceph-mon[35401]: pgmap v9523: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:49 smithi040 ceph-mon[32397]: pgmap v9524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:49 smithi146 ceph-mon[35807]: pgmap v9524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:49 smithi076 ceph-mon[35401]: pgmap v9524: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:51 smithi040 ceph-mon[32397]: pgmap v9525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:51 smithi146 ceph-mon[35807]: pgmap v9525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:51 smithi076 ceph-mon[35401]: pgmap v9525: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13598.346853 secs 2024-07-26T17:19:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13598.346853 secs 2024-07-26T17:19:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13598.346853 secs 2024-07-26T17:19:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:53 smithi040 ceph-mon[32397]: pgmap v9526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:53 smithi146 ceph-mon[35807]: pgmap v9526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:53 smithi076 ceph-mon[35401]: pgmap v9526: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:55 smithi040 ceph-mon[32397]: pgmap v9527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:55 smithi146 ceph-mon[35807]: pgmap v9527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:55 smithi076 ceph-mon[35401]: pgmap v9527: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:19:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13603.346989 secs 2024-07-26T17:19:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:57 smithi040 ceph-mon[32397]: pgmap v9528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13603.346989 secs 2024-07-26T17:19:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:57 smithi146 ceph-mon[35807]: pgmap v9528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13603.346989 secs 2024-07-26T17:19:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:57 smithi076 ceph-mon[35401]: pgmap v9528: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:19:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:19:59 smithi040 ceph-mon[32397]: pgmap v9529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:19:59 smithi146 ceph-mon[35807]: pgmap v9529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:19:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:19:59 smithi076 ceph-mon[35401]: pgmap v9529: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:20:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:20:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:20:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:01 smithi040 ceph-mon[32397]: pgmap v9530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:01 smithi146 ceph-mon[35807]: pgmap v9530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:01 smithi076 ceph-mon[35401]: pgmap v9530: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13608.347130 secs 2024-07-26T17:20:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13608.347130 secs 2024-07-26T17:20:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13608.347130 secs 2024-07-26T17:20:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:03 smithi040 ceph-mon[32397]: pgmap v9531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:03 smithi146 ceph-mon[35807]: pgmap v9531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:03 smithi076 ceph-mon[35401]: pgmap v9531: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:04 smithi040 ceph-mon[32397]: pgmap v9532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:04 smithi146 ceph-mon[35807]: pgmap v9532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:04 smithi076 ceph-mon[35401]: pgmap v9532: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13613.347257 secs 2024-07-26T17:20:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:07 smithi040 ceph-mon[32397]: pgmap v9533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13613.347257 secs 2024-07-26T17:20:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:07 smithi146 ceph-mon[35807]: pgmap v9533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13613.347257 secs 2024-07-26T17:20:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:07 smithi076 ceph-mon[35401]: pgmap v9533: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:09 smithi040 ceph-mon[32397]: pgmap v9534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:09 smithi146 ceph-mon[35807]: pgmap v9534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:09 smithi076 ceph-mon[35401]: pgmap v9534: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:11 smithi040 ceph-mon[32397]: pgmap v9535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:11 smithi146 ceph-mon[35807]: pgmap v9535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:11 smithi076 ceph-mon[35401]: pgmap v9535: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13618.347395 secs 2024-07-26T17:20:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13618.347395 secs 2024-07-26T17:20:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13618.347395 secs 2024-07-26T17:20:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:13 smithi040 ceph-mon[32397]: pgmap v9536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:13 smithi146 ceph-mon[35807]: pgmap v9536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:13 smithi076 ceph-mon[35401]: pgmap v9536: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:15 smithi040 ceph-mon[32397]: pgmap v9537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:15 smithi146 ceph-mon[35807]: pgmap v9537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:15 smithi076 ceph-mon[35401]: pgmap v9537: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13623.347533 secs 2024-07-26T17:20:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:17 smithi040 ceph-mon[32397]: pgmap v9538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13623.347533 secs 2024-07-26T17:20:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:17 smithi146 ceph-mon[35807]: pgmap v9538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13623.347533 secs 2024-07-26T17:20:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:17 smithi076 ceph-mon[35401]: pgmap v9538: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:19 smithi040 ceph-mon[32397]: pgmap v9539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:19 smithi146 ceph-mon[35807]: pgmap v9539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:19 smithi076 ceph-mon[35401]: pgmap v9539: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:21.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:21 smithi040 ceph-mon[32397]: pgmap v9540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:21 smithi146 ceph-mon[35807]: pgmap v9540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:21 smithi076 ceph-mon[35401]: pgmap v9540: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13628.347662 secs 2024-07-26T17:20:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13628.347662 secs 2024-07-26T17:20:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13628.347662 secs 2024-07-26T17:20:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:23 smithi040 ceph-mon[32397]: pgmap v9541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:23 smithi146 ceph-mon[35807]: pgmap v9541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:23 smithi076 ceph-mon[35401]: pgmap v9541: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:24 smithi146 ceph-mon[35807]: pgmap v9542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:24 smithi076 ceph-mon[35401]: pgmap v9542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:24 smithi040 ceph-mon[32397]: pgmap v9542: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13633.347799 secs 2024-07-26T17:20:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:27 smithi040 ceph-mon[32397]: pgmap v9543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13633.347799 secs 2024-07-26T17:20:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:27 smithi146 ceph-mon[35807]: pgmap v9543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13633.347799 secs 2024-07-26T17:20:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:27 smithi076 ceph-mon[35401]: pgmap v9543: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:29 smithi040 ceph-mon[32397]: pgmap v9544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:29 smithi146 ceph-mon[35807]: pgmap v9544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:29 smithi076 ceph-mon[35401]: pgmap v9544: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:31 smithi040 ceph-mon[32397]: pgmap v9545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:31 smithi146 ceph-mon[35807]: pgmap v9545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:31 smithi076 ceph-mon[35401]: pgmap v9545: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13638.347943 secs 2024-07-26T17:20:32.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13638.347943 secs 2024-07-26T17:20:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13638.347943 secs 2024-07-26T17:20:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:33 smithi040 ceph-mon[32397]: pgmap v9546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:33 smithi146 ceph-mon[35807]: pgmap v9546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:33 smithi076 ceph-mon[35401]: pgmap v9546: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:35 smithi040 ceph-mon[32397]: pgmap v9547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:35 smithi146 ceph-mon[35807]: pgmap v9547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:35 smithi076 ceph-mon[35401]: pgmap v9547: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13643.348102 secs 2024-07-26T17:20:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:37 smithi040 ceph-mon[32397]: pgmap v9548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13643.348102 secs 2024-07-26T17:20:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:37 smithi146 ceph-mon[35807]: pgmap v9548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13643.348102 secs 2024-07-26T17:20:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:37 smithi076 ceph-mon[35401]: pgmap v9548: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:39.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:39 smithi146 ceph-mon[35807]: pgmap v9549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:39 smithi040 ceph-mon[32397]: pgmap v9549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:39 smithi076 ceph-mon[35401]: pgmap v9549: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:41 smithi040 ceph-mon[32397]: pgmap v9550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:41 smithi146 ceph-mon[35807]: pgmap v9550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:41 smithi076 ceph-mon[35401]: pgmap v9550: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13648.348303 secs 2024-07-26T17:20:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13648.348303 secs 2024-07-26T17:20:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13648.348303 secs 2024-07-26T17:20:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:43 smithi040 ceph-mon[32397]: pgmap v9551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:43 smithi146 ceph-mon[35807]: pgmap v9551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:43 smithi076 ceph-mon[35401]: pgmap v9551: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:45 smithi040 ceph-mon[32397]: pgmap v9552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:45 smithi146 ceph-mon[35807]: pgmap v9552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:45 smithi076 ceph-mon[35401]: pgmap v9552: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13653.348389 secs 2024-07-26T17:20:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:47 smithi040 ceph-mon[32397]: pgmap v9553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13653.348389 secs 2024-07-26T17:20:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:47 smithi146 ceph-mon[35807]: pgmap v9553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13653.348389 secs 2024-07-26T17:20:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:47 smithi076 ceph-mon[35401]: pgmap v9553: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:48 smithi040 ceph-mon[32397]: pgmap v9554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:48 smithi146 ceph-mon[35807]: pgmap v9554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:48 smithi076 ceph-mon[35401]: pgmap v9554: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:51 smithi040 ceph-mon[32397]: pgmap v9555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:51 smithi146 ceph-mon[35807]: pgmap v9555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:51 smithi076 ceph-mon[35401]: pgmap v9555: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13658.348531 secs 2024-07-26T17:20:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13658.348531 secs 2024-07-26T17:20:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13658.348531 secs 2024-07-26T17:20:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:53 smithi040 ceph-mon[32397]: pgmap v9556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:53 smithi146 ceph-mon[35807]: pgmap v9556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:53 smithi076 ceph-mon[35401]: pgmap v9556: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:55 smithi040 ceph-mon[32397]: pgmap v9557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:55 smithi146 ceph-mon[35807]: pgmap v9557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:55 smithi076 ceph-mon[35401]: pgmap v9557: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:20:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13663.348622 secs 2024-07-26T17:20:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:57 smithi040 ceph-mon[32397]: pgmap v9558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13663.348622 secs 2024-07-26T17:20:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:57 smithi146 ceph-mon[35807]: pgmap v9558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13663.348622 secs 2024-07-26T17:20:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:57 smithi076 ceph-mon[35401]: pgmap v9558: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:20:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:20:59 smithi040 ceph-mon[32397]: pgmap v9559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:59.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:20:59 smithi146 ceph-mon[35807]: pgmap v9559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:20:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:20:59 smithi076 ceph-mon[35401]: pgmap v9559: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:01 smithi040 ceph-mon[32397]: pgmap v9560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:01 smithi146 ceph-mon[35807]: pgmap v9560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:01 smithi076 ceph-mon[35401]: pgmap v9560: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13668.348764 secs 2024-07-26T17:21:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13668.348764 secs 2024-07-26T17:21:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13668.348764 secs 2024-07-26T17:21:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:03 smithi040 ceph-mon[32397]: pgmap v9561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:03 smithi146 ceph-mon[35807]: pgmap v9561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:03 smithi076 ceph-mon[35401]: pgmap v9561: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:05 smithi040 ceph-mon[32397]: pgmap v9562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:05 smithi146 ceph-mon[35807]: pgmap v9562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:05 smithi076 ceph-mon[35401]: pgmap v9562: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13673.348854 secs 2024-07-26T17:21:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:07 smithi040 ceph-mon[32397]: pgmap v9563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13673.348854 secs 2024-07-26T17:21:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:07 smithi146 ceph-mon[35807]: pgmap v9563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13673.348854 secs 2024-07-26T17:21:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:07 smithi076 ceph-mon[35401]: pgmap v9563: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:08 smithi146 ceph-mon[35807]: pgmap v9564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:08 smithi076 ceph-mon[35401]: pgmap v9564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:08 smithi040 ceph-mon[32397]: pgmap v9564: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:11 smithi040 ceph-mon[32397]: pgmap v9565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:11 smithi146 ceph-mon[35807]: pgmap v9565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:11 smithi076 ceph-mon[35401]: pgmap v9565: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13678.348996 secs 2024-07-26T17:21:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13678.348996 secs 2024-07-26T17:21:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13678.348996 secs 2024-07-26T17:21:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:13 smithi040 ceph-mon[32397]: pgmap v9566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:13 smithi146 ceph-mon[35807]: pgmap v9566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:13 smithi076 ceph-mon[35401]: pgmap v9566: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:15 smithi040 ceph-mon[32397]: pgmap v9567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:15 smithi146 ceph-mon[35807]: pgmap v9567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:15 smithi076 ceph-mon[35401]: pgmap v9567: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13683.349152 secs 2024-07-26T17:21:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:17 smithi040 ceph-mon[32397]: pgmap v9568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13683.349152 secs 2024-07-26T17:21:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:17 smithi146 ceph-mon[35807]: pgmap v9568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13683.349152 secs 2024-07-26T17:21:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:17 smithi076 ceph-mon[35401]: pgmap v9568: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:19 smithi040 ceph-mon[32397]: pgmap v9569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:19 smithi146 ceph-mon[35807]: pgmap v9569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:19 smithi076 ceph-mon[35401]: pgmap v9569: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:21 smithi040 ceph-mon[32397]: pgmap v9570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:21 smithi146 ceph-mon[35807]: pgmap v9570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:21.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:21 smithi076 ceph-mon[35401]: pgmap v9570: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13688.349323 secs 2024-07-26T17:21:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13688.349323 secs 2024-07-26T17:21:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13688.349323 secs 2024-07-26T17:21:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:23 smithi040 ceph-mon[32397]: pgmap v9571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:23 smithi146 ceph-mon[35807]: pgmap v9571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:23 smithi076 ceph-mon[35401]: pgmap v9571: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:24 smithi146 ceph-mon[35807]: pgmap v9572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:24 smithi076 ceph-mon[35401]: pgmap v9572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:24 smithi040 ceph-mon[32397]: pgmap v9572: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13693.349464 secs 2024-07-26T17:21:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:27 smithi040 ceph-mon[32397]: pgmap v9573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13693.349464 secs 2024-07-26T17:21:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:27 smithi146 ceph-mon[35807]: pgmap v9573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13693.349464 secs 2024-07-26T17:21:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:27 smithi076 ceph-mon[35401]: pgmap v9573: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:29 smithi040 ceph-mon[32397]: pgmap v9574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:29 smithi146 ceph-mon[35807]: pgmap v9574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:29 smithi076 ceph-mon[35401]: pgmap v9574: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:31 smithi040 ceph-mon[32397]: pgmap v9575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:31 smithi146 ceph-mon[35807]: pgmap v9575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:31 smithi076 ceph-mon[35401]: pgmap v9575: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13698.349624 secs 2024-07-26T17:21:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13698.349624 secs 2024-07-26T17:21:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13698.349624 secs 2024-07-26T17:21:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:33 smithi040 ceph-mon[32397]: pgmap v9576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:33 smithi146 ceph-mon[35807]: pgmap v9576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:33 smithi076 ceph-mon[35401]: pgmap v9576: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:35 smithi040 ceph-mon[32397]: pgmap v9577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:35 smithi146 ceph-mon[35807]: pgmap v9577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:35 smithi076 ceph-mon[35401]: pgmap v9577: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13703.349767 secs 2024-07-26T17:21:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:37 smithi040 ceph-mon[32397]: pgmap v9578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13703.349767 secs 2024-07-26T17:21:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:37 smithi146 ceph-mon[35807]: pgmap v9578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13703.349767 secs 2024-07-26T17:21:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:37 smithi076 ceph-mon[35401]: pgmap v9578: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:39 smithi040 ceph-mon[32397]: pgmap v9579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:39 smithi146 ceph-mon[35807]: pgmap v9579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:39 smithi076 ceph-mon[35401]: pgmap v9579: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:41 smithi040 ceph-mon[32397]: pgmap v9580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:41 smithi146 ceph-mon[35807]: pgmap v9580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:41 smithi076 ceph-mon[35401]: pgmap v9580: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13708.349940 secs 2024-07-26T17:21:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13708.349940 secs 2024-07-26T17:21:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13708.349940 secs 2024-07-26T17:21:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:43 smithi146 ceph-mon[35807]: pgmap v9581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:43 smithi076 ceph-mon[35401]: pgmap v9581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:43 smithi040 ceph-mon[32397]: pgmap v9581: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:44 smithi146 ceph-mon[35807]: pgmap v9582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:44 smithi076 ceph-mon[35401]: pgmap v9582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:44 smithi040 ceph-mon[32397]: pgmap v9582: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13713.350077 secs 2024-07-26T17:21:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:47 smithi040 ceph-mon[32397]: pgmap v9583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13713.350077 secs 2024-07-26T17:21:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:47 smithi146 ceph-mon[35807]: pgmap v9583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13713.350077 secs 2024-07-26T17:21:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:47 smithi076 ceph-mon[35401]: pgmap v9583: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:49 smithi040 ceph-mon[32397]: pgmap v9584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:49 smithi146 ceph-mon[35807]: pgmap v9584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:49 smithi076 ceph-mon[35401]: pgmap v9584: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:51 smithi040 ceph-mon[32397]: pgmap v9585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:51 smithi146 ceph-mon[35807]: pgmap v9585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:51 smithi076 ceph-mon[35401]: pgmap v9585: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13718.350163 secs 2024-07-26T17:21:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13718.350163 secs 2024-07-26T17:21:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13718.350163 secs 2024-07-26T17:21:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:53 smithi040 ceph-mon[32397]: pgmap v9586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:53 smithi146 ceph-mon[35807]: pgmap v9586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:53 smithi076 ceph-mon[35401]: pgmap v9586: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:55 smithi040 ceph-mon[32397]: pgmap v9587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:55 smithi146 ceph-mon[35807]: pgmap v9587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:55 smithi076 ceph-mon[35401]: pgmap v9587: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:21:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13723.350301 secs 2024-07-26T17:21:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:57 smithi040 ceph-mon[32397]: pgmap v9588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13723.350301 secs 2024-07-26T17:21:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:57 smithi146 ceph-mon[35807]: pgmap v9588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13723.350301 secs 2024-07-26T17:21:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:57 smithi076 ceph-mon[35401]: pgmap v9588: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:21:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:21:59 smithi040 ceph-mon[32397]: pgmap v9589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:21:59 smithi146 ceph-mon[35807]: pgmap v9589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:21:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:21:59 smithi076 ceph-mon[35401]: pgmap v9589: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:00 smithi146 ceph-mon[35807]: pgmap v9590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:00 smithi076 ceph-mon[35401]: pgmap v9590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:00 smithi040 ceph-mon[32397]: pgmap v9590: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13728.350465 secs 2024-07-26T17:22:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13728.350465 secs 2024-07-26T17:22:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13728.350465 secs 2024-07-26T17:22:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:02 smithi040 ceph-mon[32397]: pgmap v9591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:02 smithi146 ceph-mon[35807]: pgmap v9591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:02 smithi076 ceph-mon[35401]: pgmap v9591: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:05 smithi040 ceph-mon[32397]: pgmap v9592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:05 smithi146 ceph-mon[35807]: pgmap v9592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:05 smithi076 ceph-mon[35401]: pgmap v9592: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13733.350606 secs 2024-07-26T17:22:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:07 smithi040 ceph-mon[32397]: pgmap v9593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13733.350606 secs 2024-07-26T17:22:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:07 smithi146 ceph-mon[35807]: pgmap v9593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13733.350606 secs 2024-07-26T17:22:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:07 smithi076 ceph-mon[35401]: pgmap v9593: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:09 smithi040 ceph-mon[32397]: pgmap v9594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:09 smithi146 ceph-mon[35807]: pgmap v9594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:09 smithi076 ceph-mon[35401]: pgmap v9594: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:11 smithi040 ceph-mon[32397]: pgmap v9595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:11 smithi146 ceph-mon[35807]: pgmap v9595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:11 smithi076 ceph-mon[35401]: pgmap v9595: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13738.350748 secs 2024-07-26T17:22:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13738.350748 secs 2024-07-26T17:22:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13738.350748 secs 2024-07-26T17:22:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:13 smithi040 ceph-mon[32397]: pgmap v9596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:13 smithi146 ceph-mon[35807]: pgmap v9596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:13 smithi076 ceph-mon[35401]: pgmap v9596: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:14 smithi146 ceph-mon[35807]: pgmap v9597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:14 smithi076 ceph-mon[35401]: pgmap v9597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:14 smithi040 ceph-mon[32397]: pgmap v9597: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13743.350886 secs 2024-07-26T17:22:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:17 smithi040 ceph-mon[32397]: pgmap v9598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13743.350886 secs 2024-07-26T17:22:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:17 smithi146 ceph-mon[35807]: pgmap v9598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13743.350886 secs 2024-07-26T17:22:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:17 smithi076 ceph-mon[35401]: pgmap v9598: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:19 smithi040 ceph-mon[32397]: pgmap v9599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:19 smithi146 ceph-mon[35807]: pgmap v9599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:19 smithi076 ceph-mon[35401]: pgmap v9599: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:21 smithi040 ceph-mon[32397]: pgmap v9600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:21 smithi146 ceph-mon[35807]: pgmap v9600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:21 smithi076 ceph-mon[35401]: pgmap v9600: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13748.351026 secs 2024-07-26T17:22:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13748.351026 secs 2024-07-26T17:22:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13748.351026 secs 2024-07-26T17:22:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:23 smithi040 ceph-mon[32397]: pgmap v9601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:23 smithi146 ceph-mon[35807]: pgmap v9601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:23 smithi076 ceph-mon[35401]: pgmap v9601: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:25 smithi146 ceph-mon[35807]: pgmap v9602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:25 smithi076 ceph-mon[35401]: pgmap v9602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:25 smithi040 ceph-mon[32397]: pgmap v9602: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:26 smithi146 ceph-mon[35807]: pgmap v9603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:26 smithi076 ceph-mon[35401]: pgmap v9603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:26 smithi040 ceph-mon[32397]: pgmap v9603: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13753.351164 secs 2024-07-26T17:22:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13753.351164 secs 2024-07-26T17:22:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13753.351164 secs 2024-07-26T17:22:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:28 smithi146 ceph-mon[35807]: pgmap v9604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:28 smithi076 ceph-mon[35401]: pgmap v9604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:28 smithi040 ceph-mon[32397]: pgmap v9604: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:31 smithi040 ceph-mon[32397]: pgmap v9605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:31 smithi146 ceph-mon[35807]: pgmap v9605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:31 smithi076 ceph-mon[35401]: pgmap v9605: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13758.351329 secs 2024-07-26T17:22:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13758.351329 secs 2024-07-26T17:22:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13758.351329 secs 2024-07-26T17:22:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:33 smithi040 ceph-mon[32397]: pgmap v9606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:33 smithi146 ceph-mon[35807]: pgmap v9606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:33 smithi076 ceph-mon[35401]: pgmap v9606: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:35 smithi146 ceph-mon[35807]: pgmap v9607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:35 smithi076 ceph-mon[35401]: pgmap v9607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:35 smithi040 ceph-mon[32397]: pgmap v9607: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:36 smithi146 ceph-mon[35807]: pgmap v9608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:36.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:36 smithi076 ceph-mon[35401]: pgmap v9608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:36 smithi040 ceph-mon[32397]: pgmap v9608: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13763.351472 secs 2024-07-26T17:22:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13763.351472 secs 2024-07-26T17:22:37.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13763.351472 secs 2024-07-26T17:22:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:38 smithi146 ceph-mon[35807]: pgmap v9609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:38 smithi076 ceph-mon[35401]: pgmap v9609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:38 smithi040 ceph-mon[32397]: pgmap v9609: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:41 smithi040 ceph-mon[32397]: pgmap v9610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:41 smithi146 ceph-mon[35807]: pgmap v9610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:41 smithi076 ceph-mon[35401]: pgmap v9610: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13768.351568 secs 2024-07-26T17:22:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13768.351568 secs 2024-07-26T17:22:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13768.351568 secs 2024-07-26T17:22:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:43 smithi146 ceph-mon[35807]: pgmap v9611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:43 smithi076 ceph-mon[35401]: pgmap v9611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:43 smithi040 ceph-mon[32397]: pgmap v9611: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:45 smithi146 ceph-mon[35807]: pgmap v9612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:45 smithi076 ceph-mon[35401]: pgmap v9612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:45 smithi040 ceph-mon[32397]: pgmap v9612: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:46 smithi146 ceph-mon[35807]: pgmap v9613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:46 smithi076 ceph-mon[35401]: pgmap v9613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:46 smithi040 ceph-mon[32397]: pgmap v9613: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13773.351650 secs 2024-07-26T17:22:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13773.351650 secs 2024-07-26T17:22:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13773.351650 secs 2024-07-26T17:22:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:48 smithi146 ceph-mon[35807]: pgmap v9614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:48 smithi076 ceph-mon[35401]: pgmap v9614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:48 smithi040 ceph-mon[32397]: pgmap v9614: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:51 smithi040 ceph-mon[32397]: pgmap v9615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:51 smithi146 ceph-mon[35807]: pgmap v9615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:51 smithi076 ceph-mon[35401]: pgmap v9615: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:52.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13778.351782 secs 2024-07-26T17:22:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13778.351782 secs 2024-07-26T17:22:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13778.351782 secs 2024-07-26T17:22:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:53 smithi146 ceph-mon[35807]: pgmap v9616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:53 smithi076 ceph-mon[35401]: pgmap v9616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:53 smithi040 ceph-mon[32397]: pgmap v9616: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:54 smithi146 ceph-mon[35807]: pgmap v9617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:54 smithi076 ceph-mon[35401]: pgmap v9617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:54 smithi040 ceph-mon[32397]: pgmap v9617: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:22:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13783.351916 secs 2024-07-26T17:22:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:57 smithi040 ceph-mon[32397]: pgmap v9618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13783.351916 secs 2024-07-26T17:22:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:57 smithi146 ceph-mon[35807]: pgmap v9618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13783.351916 secs 2024-07-26T17:22:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:57 smithi076 ceph-mon[35401]: pgmap v9618: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:22:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:22:59 smithi040 ceph-mon[32397]: pgmap v9619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:22:59 smithi146 ceph-mon[35807]: pgmap v9619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:22:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:22:59 smithi076 ceph-mon[35401]: pgmap v9619: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:01 smithi146 ceph-mon[35807]: pgmap v9620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:01 smithi076 ceph-mon[35401]: pgmap v9620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:01 smithi040 ceph-mon[32397]: pgmap v9620: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13788.352075 secs 2024-07-26T17:23:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13788.352075 secs 2024-07-26T17:23:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13788.352075 secs 2024-07-26T17:23:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:03 smithi146 ceph-mon[35807]: pgmap v9621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:03 smithi076 ceph-mon[35401]: pgmap v9621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:03 smithi040 ceph-mon[32397]: pgmap v9621: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:04 smithi146 ceph-mon[35807]: pgmap v9622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:04 smithi076 ceph-mon[35401]: pgmap v9622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:04 smithi040 ceph-mon[32397]: pgmap v9622: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13793.352214 secs 2024-07-26T17:23:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:07 smithi040 ceph-mon[32397]: pgmap v9623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13793.352214 secs 2024-07-26T17:23:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:07 smithi146 ceph-mon[35807]: pgmap v9623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13793.352214 secs 2024-07-26T17:23:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:07 smithi076 ceph-mon[35401]: pgmap v9623: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:09 smithi146 ceph-mon[35807]: pgmap v9624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:09 smithi076 ceph-mon[35401]: pgmap v9624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:09 smithi040 ceph-mon[32397]: pgmap v9624: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:11 smithi146 ceph-mon[35807]: pgmap v9625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:11 smithi076 ceph-mon[35401]: pgmap v9625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:11 smithi040 ceph-mon[32397]: pgmap v9625: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13798.352358 secs 2024-07-26T17:23:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:12 smithi146 ceph-mon[35807]: pgmap v9626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13798.352358 secs 2024-07-26T17:23:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:12 smithi076 ceph-mon[35401]: pgmap v9626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13798.352358 secs 2024-07-26T17:23:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:12 smithi040 ceph-mon[32397]: pgmap v9626: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:15 smithi146 ceph-mon[35807]: pgmap v9627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:15.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:15 smithi076 ceph-mon[35401]: pgmap v9627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:15 smithi040 ceph-mon[32397]: pgmap v9627: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13803.352495 secs 2024-07-26T17:23:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:17 smithi146 ceph-mon[35807]: pgmap v9628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13803.352495 secs 2024-07-26T17:23:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:17 smithi076 ceph-mon[35401]: pgmap v9628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13803.352495 secs 2024-07-26T17:23:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:17 smithi040 ceph-mon[32397]: pgmap v9628: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:18 smithi146 ceph-mon[35807]: pgmap v9629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:18 smithi076 ceph-mon[35401]: pgmap v9629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:18 smithi040 ceph-mon[32397]: pgmap v9629: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:21 smithi146 ceph-mon[35807]: pgmap v9630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:21 smithi076 ceph-mon[35401]: pgmap v9630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:21 smithi040 ceph-mon[32397]: pgmap v9630: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13808.352643 secs 2024-07-26T17:23:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13808.352643 secs 2024-07-26T17:23:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13808.352643 secs 2024-07-26T17:23:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:23 smithi146 ceph-mon[35807]: pgmap v9631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:23 smithi076 ceph-mon[35401]: pgmap v9631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:23 smithi040 ceph-mon[32397]: pgmap v9631: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:24 smithi146 ceph-mon[35807]: pgmap v9632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:24 smithi076 ceph-mon[35401]: pgmap v9632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:24 smithi040 ceph-mon[32397]: pgmap v9632: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13813.352780 secs 2024-07-26T17:23:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:27 smithi146 ceph-mon[35807]: pgmap v9633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13813.352780 secs 2024-07-26T17:23:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:27 smithi076 ceph-mon[35401]: pgmap v9633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13813.352780 secs 2024-07-26T17:23:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:27 smithi040 ceph-mon[32397]: pgmap v9633: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:28 smithi146 ceph-mon[35807]: pgmap v9634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:28 smithi076 ceph-mon[35401]: pgmap v9634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:28 smithi040 ceph-mon[32397]: pgmap v9634: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:31 smithi146 ceph-mon[35807]: pgmap v9635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:31 smithi076 ceph-mon[35401]: pgmap v9635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:31 smithi040 ceph-mon[32397]: pgmap v9635: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13818.352940 secs 2024-07-26T17:23:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13818.352940 secs 2024-07-26T17:23:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13818.352940 secs 2024-07-26T17:23:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:33 smithi146 ceph-mon[35807]: pgmap v9636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:33 smithi076 ceph-mon[35401]: pgmap v9636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:33 smithi040 ceph-mon[32397]: pgmap v9636: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:34 smithi146 ceph-mon[35807]: pgmap v9637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:34 smithi076 ceph-mon[35401]: pgmap v9637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:34 smithi040 ceph-mon[32397]: pgmap v9637: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13823.353097 secs 2024-07-26T17:23:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:37 smithi146 ceph-mon[35807]: pgmap v9638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13823.353097 secs 2024-07-26T17:23:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:37 smithi076 ceph-mon[35401]: pgmap v9638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13823.353097 secs 2024-07-26T17:23:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:37 smithi040 ceph-mon[32397]: pgmap v9638: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:38 smithi146 ceph-mon[35807]: pgmap v9639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:38 smithi076 ceph-mon[35401]: pgmap v9639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:38 smithi040 ceph-mon[32397]: pgmap v9639: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:41 smithi146 ceph-mon[35807]: pgmap v9640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:41 smithi076 ceph-mon[35401]: pgmap v9640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:41 smithi040 ceph-mon[32397]: pgmap v9640: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13828.353221 secs 2024-07-26T17:23:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:42 smithi146 ceph-mon[35807]: pgmap v9641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13828.353221 secs 2024-07-26T17:23:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:42 smithi076 ceph-mon[35401]: pgmap v9641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13828.353221 secs 2024-07-26T17:23:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:42 smithi040 ceph-mon[32397]: pgmap v9641: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:44.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:44 smithi146 ceph-mon[35807]: pgmap v9642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:44 smithi076 ceph-mon[35401]: pgmap v9642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:44 smithi040 ceph-mon[32397]: pgmap v9642: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:46 smithi146 ceph-mon[35807]: pgmap v9643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:46 smithi076 ceph-mon[35401]: pgmap v9643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:46 smithi040 ceph-mon[32397]: pgmap v9643: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13833.353352 secs 2024-07-26T17:23:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13833.353352 secs 2024-07-26T17:23:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13833.353352 secs 2024-07-26T17:23:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:48 smithi076 ceph-mon[35401]: pgmap v9644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:48 smithi040 ceph-mon[32397]: pgmap v9644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:48 smithi146 ceph-mon[35807]: pgmap v9644: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:50 smithi146 ceph-mon[35807]: pgmap v9645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:50 smithi076 ceph-mon[35401]: pgmap v9645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:50 smithi040 ceph-mon[32397]: pgmap v9645: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13838.353492 secs 2024-07-26T17:23:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13838.353492 secs 2024-07-26T17:23:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13838.353492 secs 2024-07-26T17:23:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:53 smithi146 ceph-mon[35807]: pgmap v9646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:53 smithi076 ceph-mon[35401]: pgmap v9646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:53 smithi040 ceph-mon[32397]: pgmap v9646: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:54 smithi146 ceph-mon[35807]: pgmap v9647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:54 smithi076 ceph-mon[35401]: pgmap v9647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:54 smithi040 ceph-mon[32397]: pgmap v9647: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:23:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:56 smithi146 ceph-mon[35807]: pgmap v9648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:56 smithi076 ceph-mon[35401]: pgmap v9648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:56 smithi040 ceph-mon[32397]: pgmap v9648: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:23:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13843.353634 secs 2024-07-26T17:23:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13843.353634 secs 2024-07-26T17:23:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13843.353634 secs 2024-07-26T17:23:58.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:23:58 smithi076 ceph-mon[35401]: pgmap v9649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:23:58 smithi040 ceph-mon[32397]: pgmap v9649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:23:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:23:58 smithi146 ceph-mon[35807]: pgmap v9649: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:00 smithi146 ceph-mon[35807]: pgmap v9650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:00.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:00 smithi076 ceph-mon[35401]: pgmap v9650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:00 smithi040 ceph-mon[32397]: pgmap v9650: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13848.353774 secs 2024-07-26T17:24:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13848.353774 secs 2024-07-26T17:24:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13848.353774 secs 2024-07-26T17:24:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:02 smithi040 ceph-mon[32397]: pgmap v9651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:02 smithi146 ceph-mon[35807]: pgmap v9651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:02 smithi076 ceph-mon[35401]: pgmap v9651: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:04 smithi146 ceph-mon[35807]: pgmap v9652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:04 smithi076 ceph-mon[35401]: pgmap v9652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:04 smithi040 ceph-mon[32397]: pgmap v9652: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:06 smithi146 ceph-mon[35807]: pgmap v9653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:06 smithi076 ceph-mon[35401]: pgmap v9653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:06 smithi040 ceph-mon[32397]: pgmap v9653: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13853.353917 secs 2024-07-26T17:24:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13853.353917 secs 2024-07-26T17:24:07.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13853.353917 secs 2024-07-26T17:24:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:08 smithi076 ceph-mon[35401]: pgmap v9654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:08 smithi040 ceph-mon[32397]: pgmap v9654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:08 smithi146 ceph-mon[35807]: pgmap v9654: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:24:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:10 smithi146 ceph-mon[35807]: pgmap v9655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:10 smithi076 ceph-mon[35401]: pgmap v9655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:10 smithi040 ceph-mon[32397]: pgmap v9655: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13858.354060 secs 2024-07-26T17:24:12.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13858.354060 secs 2024-07-26T17:24:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13858.354060 secs 2024-07-26T17:24:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:12 smithi040 ceph-mon[32397]: pgmap v9656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:12 smithi146 ceph-mon[35807]: pgmap v9656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:12 smithi076 ceph-mon[35401]: pgmap v9656: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:14 smithi146 ceph-mon[35807]: pgmap v9657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:14 smithi076 ceph-mon[35401]: pgmap v9657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:14 smithi040 ceph-mon[32397]: pgmap v9657: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:16 smithi146 ceph-mon[35807]: pgmap v9658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:16 smithi076 ceph-mon[35401]: pgmap v9658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:16 smithi040 ceph-mon[32397]: pgmap v9658: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13863.354216 secs 2024-07-26T17:24:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13863.354216 secs 2024-07-26T17:24:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13863.354216 secs 2024-07-26T17:24:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:18 smithi076 ceph-mon[35401]: pgmap v9659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:18 smithi040 ceph-mon[32397]: pgmap v9659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:18 smithi146 ceph-mon[35807]: pgmap v9659: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:20 smithi146 ceph-mon[35807]: pgmap v9660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:20 smithi076 ceph-mon[35401]: pgmap v9660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:20 smithi040 ceph-mon[32397]: pgmap v9660: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13868.354366 secs 2024-07-26T17:24:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13868.354366 secs 2024-07-26T17:24:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13868.354366 secs 2024-07-26T17:24:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:22 smithi040 ceph-mon[32397]: pgmap v9661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:22 smithi146 ceph-mon[35807]: pgmap v9661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:22 smithi076 ceph-mon[35401]: pgmap v9661: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:24 smithi146 ceph-mon[35807]: pgmap v9662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:24 smithi076 ceph-mon[35401]: pgmap v9662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:24 smithi040 ceph-mon[32397]: pgmap v9662: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:26 smithi146 ceph-mon[35807]: pgmap v9663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:26 smithi076 ceph-mon[35401]: pgmap v9663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:26 smithi040 ceph-mon[32397]: pgmap v9663: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13873.354506 secs 2024-07-26T17:24:27.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13873.354506 secs 2024-07-26T17:24:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13873.354506 secs 2024-07-26T17:24:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:28 smithi076 ceph-mon[35401]: pgmap v9664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:28 smithi040 ceph-mon[32397]: pgmap v9664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:28 smithi146 ceph-mon[35807]: pgmap v9664: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:30 smithi146 ceph-mon[35807]: pgmap v9665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:30 smithi076 ceph-mon[35401]: pgmap v9665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:30 smithi040 ceph-mon[32397]: pgmap v9665: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13878.354646 secs 2024-07-26T17:24:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13878.354646 secs 2024-07-26T17:24:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13878.354646 secs 2024-07-26T17:24:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:32 smithi040 ceph-mon[32397]: pgmap v9666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:32 smithi146 ceph-mon[35807]: pgmap v9666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:32 smithi076 ceph-mon[35401]: pgmap v9666: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:34 smithi146 ceph-mon[35807]: pgmap v9667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:34 smithi076 ceph-mon[35401]: pgmap v9667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:34 smithi040 ceph-mon[32397]: pgmap v9667: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:36 smithi146 ceph-mon[35807]: pgmap v9668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:36 smithi076 ceph-mon[35401]: pgmap v9668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:36 smithi040 ceph-mon[32397]: pgmap v9668: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13883.354782 secs 2024-07-26T17:24:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13883.354782 secs 2024-07-26T17:24:37.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13883.354782 secs 2024-07-26T17:24:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:38 smithi040 ceph-mon[32397]: pgmap v9669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:38 smithi146 ceph-mon[35807]: pgmap v9669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:38 smithi076 ceph-mon[35401]: pgmap v9669: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:40 smithi146 ceph-mon[35807]: pgmap v9670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:40 smithi076 ceph-mon[35401]: pgmap v9670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:40.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:40 smithi040 ceph-mon[32397]: pgmap v9670: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:24:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13888.354923 secs 2024-07-26T17:24:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13888.354923 secs 2024-07-26T17:24:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13888.354923 secs 2024-07-26T17:24:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:42 smithi040 ceph-mon[32397]: pgmap v9671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:42 smithi146 ceph-mon[35807]: pgmap v9671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:42 smithi076 ceph-mon[35401]: pgmap v9671: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:44 smithi146 ceph-mon[35807]: pgmap v9672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:44 smithi076 ceph-mon[35401]: pgmap v9672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:44 smithi040 ceph-mon[32397]: pgmap v9672: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:46 smithi146 ceph-mon[35807]: pgmap v9673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:46 smithi076 ceph-mon[35401]: pgmap v9673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:46 smithi040 ceph-mon[32397]: pgmap v9673: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13893.355069 secs 2024-07-26T17:24:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13893.355069 secs 2024-07-26T17:24:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13893.355069 secs 2024-07-26T17:24:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:48 smithi076 ceph-mon[35401]: pgmap v9674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:48 smithi040 ceph-mon[32397]: pgmap v9674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:48 smithi146 ceph-mon[35807]: pgmap v9674: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:50.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:50 smithi146 ceph-mon[35807]: pgmap v9675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:50.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:50 smithi076 ceph-mon[35401]: pgmap v9675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:50 smithi040 ceph-mon[32397]: pgmap v9675: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13898.355214 secs 2024-07-26T17:24:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13898.355214 secs 2024-07-26T17:24:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13898.355214 secs 2024-07-26T17:24:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:52 smithi040 ceph-mon[32397]: pgmap v9676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:52 smithi146 ceph-mon[35807]: pgmap v9676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:52 smithi076 ceph-mon[35401]: pgmap v9676: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:54.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:54 smithi146 ceph-mon[35807]: pgmap v9677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:54.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:54 smithi076 ceph-mon[35401]: pgmap v9677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:54 smithi040 ceph-mon[32397]: pgmap v9677: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:24:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:56 smithi076 ceph-mon[35401]: pgmap v9678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:56 smithi040 ceph-mon[32397]: pgmap v9678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:56 smithi146 ceph-mon[35807]: pgmap v9678: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:24:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13903.355360 secs 2024-07-26T17:24:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13903.355360 secs 2024-07-26T17:24:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13903.355360 secs 2024-07-26T17:24:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:24:58 smithi040 ceph-mon[32397]: pgmap v9679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:24:58 smithi146 ceph-mon[35807]: pgmap v9679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:24:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:24:58 smithi076 ceph-mon[35401]: pgmap v9679: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:00.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:00 smithi076 ceph-mon[35401]: pgmap v9680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:00 smithi040 ceph-mon[32397]: pgmap v9680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:00 smithi146 ceph-mon[35807]: pgmap v9680: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13908.355500 secs 2024-07-26T17:25:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13908.355500 secs 2024-07-26T17:25:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13908.355500 secs 2024-07-26T17:25:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:02 smithi040 ceph-mon[32397]: pgmap v9681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:02 smithi146 ceph-mon[35807]: pgmap v9681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:02 smithi076 ceph-mon[35401]: pgmap v9681: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:04 smithi076 ceph-mon[35401]: pgmap v9682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:04.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:04 smithi040 ceph-mon[32397]: pgmap v9682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:04 smithi146 ceph-mon[35807]: pgmap v9682: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:06 smithi076 ceph-mon[35401]: pgmap v9683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:06 smithi040 ceph-mon[32397]: pgmap v9683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:06 smithi146 ceph-mon[35807]: pgmap v9683: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13913.355640 secs 2024-07-26T17:25:07.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13913.355640 secs 2024-07-26T17:25:07.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13913.355640 secs 2024-07-26T17:25:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:08 smithi040 ceph-mon[32397]: pgmap v9684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:08 smithi146 ceph-mon[35807]: pgmap v9684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:08 smithi076 ceph-mon[35401]: pgmap v9684: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:10 smithi076 ceph-mon[35401]: pgmap v9685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:10.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:10 smithi040 ceph-mon[32397]: pgmap v9685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:10 smithi146 ceph-mon[35807]: pgmap v9685: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13918.355784 secs 2024-07-26T17:25:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13918.355784 secs 2024-07-26T17:25:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13918.355784 secs 2024-07-26T17:25:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:12 smithi040 ceph-mon[32397]: pgmap v9686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:12 smithi146 ceph-mon[35807]: pgmap v9686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:12 smithi076 ceph-mon[35401]: pgmap v9686: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:14 smithi076 ceph-mon[35401]: pgmap v9687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:14 smithi040 ceph-mon[32397]: pgmap v9687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:14 smithi146 ceph-mon[35807]: pgmap v9687: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:16 smithi076 ceph-mon[35401]: pgmap v9688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:16 smithi040 ceph-mon[32397]: pgmap v9688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:16 smithi146 ceph-mon[35807]: pgmap v9688: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13923.355920 secs 2024-07-26T17:25:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13923.355920 secs 2024-07-26T17:25:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13923.355920 secs 2024-07-26T17:25:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:18 smithi040 ceph-mon[32397]: pgmap v9689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:18 smithi146 ceph-mon[35807]: pgmap v9689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:18 smithi076 ceph-mon[35401]: pgmap v9689: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:20 smithi076 ceph-mon[35401]: pgmap v9690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:20 smithi040 ceph-mon[32397]: pgmap v9690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:20 smithi146 ceph-mon[35807]: pgmap v9690: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13928.356062 secs 2024-07-26T17:25:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13928.356062 secs 2024-07-26T17:25:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13928.356062 secs 2024-07-26T17:25:22.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:22 smithi040 ceph-mon[32397]: pgmap v9691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:22 smithi146 ceph-mon[35807]: pgmap v9691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:22 smithi076 ceph-mon[35401]: pgmap v9691: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:24.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:24 smithi040 ceph-mon[32397]: pgmap v9692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:24 smithi146 ceph-mon[35807]: pgmap v9692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:24 smithi076 ceph-mon[35401]: pgmap v9692: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:26 smithi040 ceph-mon[32397]: pgmap v9693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:26 smithi146 ceph-mon[35807]: pgmap v9693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:26 smithi076 ceph-mon[35401]: pgmap v9693: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13933.356217 secs 2024-07-26T17:25:28.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13933.356217 secs 2024-07-26T17:25:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13933.356217 secs 2024-07-26T17:25:28.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:28 smithi040 ceph-mon[32397]: pgmap v9694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:29.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:28 smithi146 ceph-mon[35807]: pgmap v9694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:28 smithi076 ceph-mon[35401]: pgmap v9694: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:30.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:30 smithi040 ceph-mon[32397]: pgmap v9695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:30 smithi146 ceph-mon[35807]: pgmap v9695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:30 smithi076 ceph-mon[35401]: pgmap v9695: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13938.356367 secs 2024-07-26T17:25:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13938.356367 secs 2024-07-26T17:25:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13938.356367 secs 2024-07-26T17:25:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:32 smithi040 ceph-mon[32397]: pgmap v9696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:32 smithi146 ceph-mon[35807]: pgmap v9696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:32 smithi076 ceph-mon[35401]: pgmap v9696: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:34.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:34 smithi040 ceph-mon[32397]: pgmap v9697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:35.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:34 smithi146 ceph-mon[35807]: pgmap v9697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:34 smithi076 ceph-mon[35401]: pgmap v9697: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13943.356448 secs 2024-07-26T17:25:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:37 smithi040 ceph-mon[32397]: pgmap v9698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13943.356448 secs 2024-07-26T17:25:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:37 smithi146 ceph-mon[35807]: pgmap v9698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13943.356448 secs 2024-07-26T17:25:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:37 smithi076 ceph-mon[35401]: pgmap v9698: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:38 smithi040 ceph-mon[32397]: pgmap v9699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:38 smithi146 ceph-mon[35807]: pgmap v9699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:38 smithi076 ceph-mon[35401]: pgmap v9699: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:40 smithi040 ceph-mon[32397]: pgmap v9700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:41.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:40 smithi146 ceph-mon[35807]: pgmap v9700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:40 smithi076 ceph-mon[35401]: pgmap v9700: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13948.356584 secs 2024-07-26T17:25:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13948.356584 secs 2024-07-26T17:25:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13948.356584 secs 2024-07-26T17:25:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:43 smithi040 ceph-mon[32397]: pgmap v9701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:43 smithi146 ceph-mon[35807]: pgmap v9701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:43 smithi076 ceph-mon[35401]: pgmap v9701: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:45 smithi146 ceph-mon[35807]: pgmap v9702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:45 smithi076 ceph-mon[35401]: pgmap v9702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:45 smithi040 ceph-mon[32397]: pgmap v9702: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13953.356731 secs 2024-07-26T17:25:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13953.356731 secs 2024-07-26T17:25:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13953.356731 secs 2024-07-26T17:25:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:47 smithi146 ceph-mon[35807]: pgmap v9703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:47 smithi076 ceph-mon[35401]: pgmap v9703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:47 smithi040 ceph-mon[32397]: pgmap v9703: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:49 smithi146 ceph-mon[35807]: pgmap v9704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:49 smithi076 ceph-mon[35401]: pgmap v9704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:49 smithi040 ceph-mon[32397]: pgmap v9704: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:25:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:51 smithi146 ceph-mon[35807]: pgmap v9705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13958.356907 secs 2024-07-26T17:25:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:51 smithi076 ceph-mon[35401]: pgmap v9705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13958.356907 secs 2024-07-26T17:25:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:51 smithi040 ceph-mon[32397]: pgmap v9705: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13958.356907 secs 2024-07-26T17:25:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:53 smithi146 ceph-mon[35807]: pgmap v9706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:53 smithi076 ceph-mon[35401]: pgmap v9706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:54.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:53 smithi040 ceph-mon[32397]: pgmap v9706: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:55 smithi146 ceph-mon[35807]: pgmap v9707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:55 smithi076 ceph-mon[35401]: pgmap v9707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:55 smithi040 ceph-mon[32397]: pgmap v9707: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:25:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13963.357042 secs 2024-07-26T17:25:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13963.357042 secs 2024-07-26T17:25:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13963.357042 secs 2024-07-26T17:25:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:57 smithi146 ceph-mon[35807]: pgmap v9708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:57 smithi076 ceph-mon[35401]: pgmap v9708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:25:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:57 smithi040 ceph-mon[32397]: pgmap v9708: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:25:59 smithi146 ceph-mon[35807]: pgmap v9709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:25:59 smithi076 ceph-mon[35401]: pgmap v9709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:25:59 smithi040 ceph-mon[32397]: pgmap v9709: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:01 smithi146 ceph-mon[35807]: pgmap v9710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13968.357199 secs 2024-07-26T17:26:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:01 smithi076 ceph-mon[35401]: pgmap v9710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:02.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13968.357199 secs 2024-07-26T17:26:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:01 smithi040 ceph-mon[32397]: pgmap v9710: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13968.357199 secs 2024-07-26T17:26:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:03 smithi146 ceph-mon[35807]: pgmap v9711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:03 smithi076 ceph-mon[35401]: pgmap v9711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:03 smithi040 ceph-mon[32397]: pgmap v9711: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:05 smithi076 ceph-mon[35401]: pgmap v9712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:05 smithi040 ceph-mon[32397]: pgmap v9712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:05 smithi146 ceph-mon[35807]: pgmap v9712: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:07.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13973.357337 secs 2024-07-26T17:26:07.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13973.357337 secs 2024-07-26T17:26:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13973.357337 secs 2024-07-26T17:26:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:07 smithi040 ceph-mon[32397]: pgmap v9713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:08.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:07 smithi076 ceph-mon[35401]: pgmap v9713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:07 smithi146 ceph-mon[35807]: pgmap v9713: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:09 smithi040 ceph-mon[32397]: pgmap v9714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:10.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:09 smithi146 ceph-mon[35807]: pgmap v9714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:09 smithi076 ceph-mon[35401]: pgmap v9714: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:12 smithi040 ceph-mon[32397]: pgmap v9715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13978.357437 secs 2024-07-26T17:26:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:12 smithi146 ceph-mon[35807]: pgmap v9715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13978.357437 secs 2024-07-26T17:26:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:12 smithi076 ceph-mon[35401]: pgmap v9715: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13978.357437 secs 2024-07-26T17:26:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:14 smithi040 ceph-mon[32397]: pgmap v9716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:14.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:14 smithi146 ceph-mon[35807]: pgmap v9716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:14 smithi076 ceph-mon[35401]: pgmap v9716: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:16 smithi040 ceph-mon[32397]: pgmap v9717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:16 smithi146 ceph-mon[35807]: pgmap v9717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:16 smithi076 ceph-mon[35401]: pgmap v9717: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:17.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13983.357573 secs 2024-07-26T17:26:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13983.357573 secs 2024-07-26T17:26:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13983.357573 secs 2024-07-26T17:26:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:18 smithi040 ceph-mon[32397]: pgmap v9718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:18 smithi146 ceph-mon[35807]: pgmap v9718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:18 smithi076 ceph-mon[35401]: pgmap v9718: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:20 smithi040 ceph-mon[32397]: pgmap v9719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:20 smithi146 ceph-mon[35807]: pgmap v9719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:20 smithi076 ceph-mon[35401]: pgmap v9719: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:22 smithi040 ceph-mon[32397]: pgmap v9720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13988.357737 secs 2024-07-26T17:26:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:22 smithi146 ceph-mon[35807]: pgmap v9720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13988.357737 secs 2024-07-26T17:26:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:22 smithi076 ceph-mon[35401]: pgmap v9720: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13988.357737 secs 2024-07-26T17:26:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:24 smithi040 ceph-mon[32397]: pgmap v9721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:24 smithi146 ceph-mon[35807]: pgmap v9721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:24 smithi076 ceph-mon[35401]: pgmap v9721: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:26 smithi040 ceph-mon[32397]: pgmap v9722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:26 smithi146 ceph-mon[35807]: pgmap v9722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:26 smithi076 ceph-mon[35401]: pgmap v9722: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13993.357867 secs 2024-07-26T17:26:27.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13993.357867 secs 2024-07-26T17:26:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13993.357867 secs 2024-07-26T17:26:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:28 smithi040 ceph-mon[32397]: pgmap v9723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:28.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:28 smithi146 ceph-mon[35807]: pgmap v9723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:28 smithi076 ceph-mon[35401]: pgmap v9723: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:30 smithi040 ceph-mon[32397]: pgmap v9724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:30.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:30 smithi146 ceph-mon[35807]: pgmap v9724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:30 smithi076 ceph-mon[35401]: pgmap v9724: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:32 smithi040 ceph-mon[32397]: pgmap v9725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 13998.357998 secs 2024-07-26T17:26:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:32 smithi146 ceph-mon[35807]: pgmap v9725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 13998.357998 secs 2024-07-26T17:26:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:32 smithi076 ceph-mon[35401]: pgmap v9725: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:32.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 13998.357998 secs 2024-07-26T17:26:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:34 smithi040 ceph-mon[32397]: pgmap v9726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:34 smithi146 ceph-mon[35807]: pgmap v9726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:34 smithi076 ceph-mon[35401]: pgmap v9726: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:36 smithi040 ceph-mon[32397]: pgmap v9727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:36 smithi146 ceph-mon[35807]: pgmap v9727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:36 smithi076 ceph-mon[35401]: pgmap v9727: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:37.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14003.358130 secs 2024-07-26T17:26:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14003.358130 secs 2024-07-26T17:26:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14003.358130 secs 2024-07-26T17:26:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:38 smithi040 ceph-mon[32397]: pgmap v9728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:38.485 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:38 smithi076 ceph-mon[35401]: pgmap v9728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:38.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:38 smithi146 ceph-mon[35807]: pgmap v9728: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:40 smithi040 ceph-mon[32397]: pgmap v9729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:40.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:40 smithi146 ceph-mon[35807]: pgmap v9729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:40 smithi076 ceph-mon[35401]: pgmap v9729: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:42 smithi146 ceph-mon[35807]: pgmap v9730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14008.358304 secs 2024-07-26T17:26:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:42 smithi076 ceph-mon[35401]: pgmap v9730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14008.358304 secs 2024-07-26T17:26:42.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:42 smithi040 ceph-mon[32397]: pgmap v9730: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14008.358304 secs 2024-07-26T17:26:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:44 smithi146 ceph-mon[35807]: pgmap v9731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:44 smithi076 ceph-mon[35401]: pgmap v9731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:44.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:44 smithi040 ceph-mon[32397]: pgmap v9731: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:46 smithi146 ceph-mon[35807]: pgmap v9732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:46 smithi076 ceph-mon[35401]: pgmap v9732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:46 smithi040 ceph-mon[32397]: pgmap v9732: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14013.358441 secs 2024-07-26T17:26:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14013.358441 secs 2024-07-26T17:26:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14013.358441 secs 2024-07-26T17:26:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:48 smithi146 ceph-mon[35807]: pgmap v9733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:48 smithi076 ceph-mon[35401]: pgmap v9733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:48 smithi040 ceph-mon[32397]: pgmap v9733: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:50 smithi146 ceph-mon[35807]: pgmap v9734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:50 smithi076 ceph-mon[35401]: pgmap v9734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:50 smithi040 ceph-mon[32397]: pgmap v9734: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:26:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:52 smithi146 ceph-mon[35807]: pgmap v9735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14018.358608 secs 2024-07-26T17:26:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:52 smithi076 ceph-mon[35401]: pgmap v9735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14018.358608 secs 2024-07-26T17:26:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:52 smithi040 ceph-mon[32397]: pgmap v9735: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14018.358608 secs 2024-07-26T17:26:54.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:54 smithi146 ceph-mon[35807]: pgmap v9736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:54 smithi076 ceph-mon[35401]: pgmap v9736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:54 smithi040 ceph-mon[32397]: pgmap v9736: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:56 smithi146 ceph-mon[35807]: pgmap v9737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:56 smithi076 ceph-mon[35401]: pgmap v9737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:56 smithi040 ceph-mon[32397]: pgmap v9737: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:26:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14023.358764 secs 2024-07-26T17:26:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14023.358764 secs 2024-07-26T17:26:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14023.358764 secs 2024-07-26T17:26:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:26:58 smithi146 ceph-mon[35807]: pgmap v9738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:26:58 smithi076 ceph-mon[35401]: pgmap v9738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:26:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:26:58 smithi040 ceph-mon[32397]: pgmap v9738: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:00 smithi076 ceph-mon[35401]: pgmap v9739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:00 smithi040 ceph-mon[32397]: pgmap v9739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:00.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:00 smithi146 ceph-mon[35807]: pgmap v9739: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:02 smithi076 ceph-mon[35401]: pgmap v9740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:02.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14028.358925 secs 2024-07-26T17:27:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:02 smithi040 ceph-mon[32397]: pgmap v9740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14028.358925 secs 2024-07-26T17:27:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:02 smithi146 ceph-mon[35807]: pgmap v9740: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:02.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14028.358925 secs 2024-07-26T17:27:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:04 smithi040 ceph-mon[32397]: pgmap v9741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:04.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:04 smithi146 ceph-mon[35807]: pgmap v9741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:04.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:04 smithi076 ceph-mon[35401]: pgmap v9741: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:06 smithi040 ceph-mon[32397]: pgmap v9742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:06 smithi146 ceph-mon[35807]: pgmap v9742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:06 smithi076 ceph-mon[35401]: pgmap v9742: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:07.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14033.359071 secs 2024-07-26T17:27:07.723 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14033.359071 secs 2024-07-26T17:27:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14033.359071 secs 2024-07-26T17:27:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:08 smithi040 ceph-mon[32397]: pgmap v9743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:08.734 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:08 smithi076 ceph-mon[35401]: pgmap v9743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:08 smithi146 ceph-mon[35807]: pgmap v9743: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:10 smithi040 ceph-mon[32397]: pgmap v9744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:10 smithi146 ceph-mon[35807]: pgmap v9744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:10.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:10 smithi076 ceph-mon[35401]: pgmap v9744: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:12 smithi040 ceph-mon[32397]: pgmap v9745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14038.359238 secs 2024-07-26T17:27:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:12 smithi146 ceph-mon[35807]: pgmap v9745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14038.359238 secs 2024-07-26T17:27:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:12 smithi076 ceph-mon[35401]: pgmap v9745: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14038.359238 secs 2024-07-26T17:27:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:14 smithi040 ceph-mon[32397]: pgmap v9746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:14 smithi146 ceph-mon[35807]: pgmap v9746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:14.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:14 smithi076 ceph-mon[35401]: pgmap v9746: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:16 smithi040 ceph-mon[32397]: pgmap v9747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:16 smithi146 ceph-mon[35807]: pgmap v9747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:16 smithi076 ceph-mon[35401]: pgmap v9747: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14043.359321 secs 2024-07-26T17:27:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14043.359321 secs 2024-07-26T17:27:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14043.359321 secs 2024-07-26T17:27:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:18 smithi040 ceph-mon[32397]: pgmap v9748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:18 smithi146 ceph-mon[35807]: pgmap v9748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:18 smithi076 ceph-mon[35401]: pgmap v9748: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:20 smithi040 ceph-mon[32397]: pgmap v9749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:20 smithi146 ceph-mon[35807]: pgmap v9749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:20 smithi076 ceph-mon[35401]: pgmap v9749: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:22 smithi040 ceph-mon[32397]: pgmap v9750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14048.359481 secs 2024-07-26T17:27:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:22 smithi146 ceph-mon[35807]: pgmap v9750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14048.359481 secs 2024-07-26T17:27:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:22 smithi076 ceph-mon[35401]: pgmap v9750: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14048.359481 secs 2024-07-26T17:27:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:24 smithi040 ceph-mon[32397]: pgmap v9751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:24 smithi146 ceph-mon[35807]: pgmap v9751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:24 smithi076 ceph-mon[35401]: pgmap v9751: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:26 smithi040 ceph-mon[32397]: pgmap v9752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:26 smithi146 ceph-mon[35807]: pgmap v9752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:26 smithi076 ceph-mon[35401]: pgmap v9752: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:27.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14053.359621 secs 2024-07-26T17:27:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14053.359621 secs 2024-07-26T17:27:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14053.359621 secs 2024-07-26T17:27:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:28 smithi040 ceph-mon[32397]: pgmap v9753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:28 smithi146 ceph-mon[35807]: pgmap v9753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:28 smithi076 ceph-mon[35401]: pgmap v9753: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:30 smithi040 ceph-mon[32397]: pgmap v9754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:30 smithi146 ceph-mon[35807]: pgmap v9754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:30 smithi076 ceph-mon[35401]: pgmap v9754: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:32 smithi040 ceph-mon[32397]: pgmap v9755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14058.359755 secs 2024-07-26T17:27:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:32 smithi146 ceph-mon[35807]: pgmap v9755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14058.359755 secs 2024-07-26T17:27:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:32 smithi076 ceph-mon[35401]: pgmap v9755: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14058.359755 secs 2024-07-26T17:27:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:34 smithi040 ceph-mon[32397]: pgmap v9756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:34.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:34 smithi146 ceph-mon[35807]: pgmap v9756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:34 smithi076 ceph-mon[35401]: pgmap v9756: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:36 smithi146 ceph-mon[35807]: pgmap v9757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:36 smithi076 ceph-mon[35401]: pgmap v9757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:36 smithi040 ceph-mon[32397]: pgmap v9757: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14063.359909 secs 2024-07-26T17:27:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14063.359909 secs 2024-07-26T17:27:37.884 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14063.359909 secs 2024-07-26T17:27:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:38 smithi146 ceph-mon[35807]: pgmap v9758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:38 smithi076 ceph-mon[35401]: pgmap v9758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:38.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:38 smithi040 ceph-mon[32397]: pgmap v9758: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:40.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:40 smithi146 ceph-mon[35807]: pgmap v9759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:40 smithi076 ceph-mon[35401]: pgmap v9759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:40.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:40 smithi040 ceph-mon[32397]: pgmap v9759: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:42 smithi146 ceph-mon[35807]: pgmap v9760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14068.360056 secs 2024-07-26T17:27:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:42 smithi076 ceph-mon[35401]: pgmap v9760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14068.360056 secs 2024-07-26T17:27:42.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:42 smithi040 ceph-mon[32397]: pgmap v9760: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14068.360056 secs 2024-07-26T17:27:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:44 smithi146 ceph-mon[35807]: pgmap v9761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:44 smithi076 ceph-mon[35401]: pgmap v9761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:44 smithi040 ceph-mon[32397]: pgmap v9761: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:46 smithi146 ceph-mon[35807]: pgmap v9762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:46 smithi076 ceph-mon[35401]: pgmap v9762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:46 smithi040 ceph-mon[32397]: pgmap v9762: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14073.360220 secs 2024-07-26T17:27:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14073.360220 secs 2024-07-26T17:27:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14073.360220 secs 2024-07-26T17:27:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:48 smithi146 ceph-mon[35807]: pgmap v9763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:48 smithi076 ceph-mon[35401]: pgmap v9763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:48.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:48 smithi040 ceph-mon[32397]: pgmap v9763: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:49 smithi076 ceph-mon[35401]: pgmap v9764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:49.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:49 smithi040 ceph-mon[32397]: pgmap v9764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:49 smithi146 ceph-mon[35807]: pgmap v9764: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:27:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:51 smithi040 ceph-mon[32397]: pgmap v9765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:51 smithi146 ceph-mon[35807]: pgmap v9765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:51 smithi076 ceph-mon[35401]: pgmap v9765: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14078.360361 secs 2024-07-26T17:27:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14078.360361 secs 2024-07-26T17:27:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14078.360361 secs 2024-07-26T17:27:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:53 smithi040 ceph-mon[32397]: pgmap v9766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:53 smithi146 ceph-mon[35807]: pgmap v9766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:53 smithi076 ceph-mon[35401]: pgmap v9766: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:55 smithi040 ceph-mon[32397]: pgmap v9767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:55 smithi146 ceph-mon[35807]: pgmap v9767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:55 smithi076 ceph-mon[35401]: pgmap v9767: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:27:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14083.360504 secs 2024-07-26T17:27:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14083.360504 secs 2024-07-26T17:27:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14083.360504 secs 2024-07-26T17:27:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:57 smithi146 ceph-mon[35807]: pgmap v9768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:57 smithi076 ceph-mon[35401]: pgmap v9768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:27:58.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:57 smithi040 ceph-mon[32397]: pgmap v9768: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:27:59 smithi146 ceph-mon[35807]: pgmap v9769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:27:59 smithi076 ceph-mon[35401]: pgmap v9769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:27:59 smithi040 ceph-mon[32397]: pgmap v9769: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:01 smithi146 ceph-mon[35807]: pgmap v9770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14088.360658 secs 2024-07-26T17:28:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:01 smithi076 ceph-mon[35401]: pgmap v9770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14088.360658 secs 2024-07-26T17:28:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:01 smithi040 ceph-mon[32397]: pgmap v9770: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14088.360658 secs 2024-07-26T17:28:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:03 smithi146 ceph-mon[35807]: pgmap v9771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:03 smithi076 ceph-mon[35401]: pgmap v9771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:03 smithi040 ceph-mon[32397]: pgmap v9771: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:05 smithi146 ceph-mon[35807]: pgmap v9772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:05 smithi076 ceph-mon[35401]: pgmap v9772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:06.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:05 smithi040 ceph-mon[32397]: pgmap v9772: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14093.360788 secs 2024-07-26T17:28:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14093.360788 secs 2024-07-26T17:28:07.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14093.360788 secs 2024-07-26T17:28:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:07 smithi146 ceph-mon[35807]: pgmap v9773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:07 smithi076 ceph-mon[35401]: pgmap v9773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:07 smithi040 ceph-mon[32397]: pgmap v9773: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:09 smithi146 ceph-mon[35807]: pgmap v9774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:09 smithi076 ceph-mon[35401]: pgmap v9774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:09 smithi040 ceph-mon[32397]: pgmap v9774: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:11 smithi146 ceph-mon[35807]: pgmap v9775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14098.360924 secs 2024-07-26T17:28:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:11 smithi076 ceph-mon[35401]: pgmap v9775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14098.360924 secs 2024-07-26T17:28:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:11 smithi040 ceph-mon[32397]: pgmap v9775: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14098.360924 secs 2024-07-26T17:28:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:13 smithi146 ceph-mon[35807]: pgmap v9776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:13 smithi076 ceph-mon[35401]: pgmap v9776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:13 smithi040 ceph-mon[32397]: pgmap v9776: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:15 smithi076 ceph-mon[35401]: pgmap v9777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:16.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:15 smithi040 ceph-mon[32397]: pgmap v9777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:15 smithi146 ceph-mon[35807]: pgmap v9777: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14103.361066 secs 2024-07-26T17:28:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14103.361066 secs 2024-07-26T17:28:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14103.361066 secs 2024-07-26T17:28:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:17 smithi040 ceph-mon[32397]: pgmap v9778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:18.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:17 smithi146 ceph-mon[35807]: pgmap v9778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:17 smithi076 ceph-mon[35401]: pgmap v9778: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:19 smithi040 ceph-mon[32397]: pgmap v9779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:19 smithi146 ceph-mon[35807]: pgmap v9779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:19 smithi076 ceph-mon[35401]: pgmap v9779: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:21 smithi040 ceph-mon[32397]: pgmap v9780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14108.361165 secs 2024-07-26T17:28:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:21 smithi146 ceph-mon[35807]: pgmap v9780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14108.361165 secs 2024-07-26T17:28:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:21 smithi076 ceph-mon[35401]: pgmap v9780: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14108.361165 secs 2024-07-26T17:28:24.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:23 smithi040 ceph-mon[32397]: pgmap v9781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:23 smithi146 ceph-mon[35807]: pgmap v9781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:23 smithi076 ceph-mon[35401]: pgmap v9781: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:25 smithi040 ceph-mon[32397]: pgmap v9782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:25 smithi146 ceph-mon[35807]: pgmap v9782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:25 smithi076 ceph-mon[35401]: pgmap v9782: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14113.361327 secs 2024-07-26T17:28:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14113.361327 secs 2024-07-26T17:28:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14113.361327 secs 2024-07-26T17:28:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:27 smithi040 ceph-mon[32397]: pgmap v9783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:27 smithi146 ceph-mon[35807]: pgmap v9783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:27 smithi076 ceph-mon[35401]: pgmap v9783: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:29 smithi040 ceph-mon[32397]: pgmap v9784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:29 smithi146 ceph-mon[35807]: pgmap v9784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:29 smithi076 ceph-mon[35401]: pgmap v9784: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:31 smithi040 ceph-mon[32397]: pgmap v9785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14118.361433 secs 2024-07-26T17:28:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:31 smithi146 ceph-mon[35807]: pgmap v9785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:32.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14118.361433 secs 2024-07-26T17:28:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:31 smithi076 ceph-mon[35401]: pgmap v9785: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14118.361433 secs 2024-07-26T17:28:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:33 smithi040 ceph-mon[32397]: pgmap v9786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:34.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:33 smithi146 ceph-mon[35807]: pgmap v9786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:33 smithi076 ceph-mon[35401]: pgmap v9786: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:35 smithi040 ceph-mon[32397]: pgmap v9787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:35 smithi146 ceph-mon[35807]: pgmap v9787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:35 smithi076 ceph-mon[35401]: pgmap v9787: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:37.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14123.361559 secs 2024-07-26T17:28:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14123.361559 secs 2024-07-26T17:28:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14123.361559 secs 2024-07-26T17:28:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:37 smithi040 ceph-mon[32397]: pgmap v9788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:37 smithi146 ceph-mon[35807]: pgmap v9788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:37 smithi076 ceph-mon[35401]: pgmap v9788: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:39 smithi040 ceph-mon[32397]: pgmap v9789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:39 smithi146 ceph-mon[35807]: pgmap v9789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:39 smithi076 ceph-mon[35401]: pgmap v9789: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:41 smithi040 ceph-mon[32397]: pgmap v9790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14128.361658 secs 2024-07-26T17:28:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:41 smithi146 ceph-mon[35807]: pgmap v9790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14128.361658 secs 2024-07-26T17:28:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:41 smithi076 ceph-mon[35401]: pgmap v9790: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:42.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14128.361658 secs 2024-07-26T17:28:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:43 smithi040 ceph-mon[32397]: pgmap v9791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:43 smithi146 ceph-mon[35807]: pgmap v9791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:43 smithi076 ceph-mon[35401]: pgmap v9791: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:45 smithi040 ceph-mon[32397]: pgmap v9792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:46.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:45 smithi146 ceph-mon[35807]: pgmap v9792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:46.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:45 smithi076 ceph-mon[35401]: pgmap v9792: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14133.361810 secs 2024-07-26T17:28:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14133.361810 secs 2024-07-26T17:28:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14133.361810 secs 2024-07-26T17:28:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:47 smithi040 ceph-mon[32397]: pgmap v9793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:47 smithi146 ceph-mon[35807]: pgmap v9793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:47 smithi076 ceph-mon[35401]: pgmap v9793: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:49 smithi040 ceph-mon[32397]: pgmap v9794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:50.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:49 smithi146 ceph-mon[35807]: pgmap v9794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:49 smithi076 ceph-mon[35401]: pgmap v9794: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:28:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:51 smithi146 ceph-mon[35807]: pgmap v9795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14138.361965 secs 2024-07-26T17:28:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:51 smithi076 ceph-mon[35401]: pgmap v9795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14138.361965 secs 2024-07-26T17:28:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:51 smithi040 ceph-mon[32397]: pgmap v9795: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14138.361965 secs 2024-07-26T17:28:54.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:53 smithi146 ceph-mon[35807]: pgmap v9796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:53 smithi076 ceph-mon[35401]: pgmap v9796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:54.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:53 smithi040 ceph-mon[32397]: pgmap v9796: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:56 smithi146 ceph-mon[35807]: pgmap v9797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:56 smithi076 ceph-mon[35401]: pgmap v9797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:56 smithi040 ceph-mon[32397]: pgmap v9797: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:28:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14143.362102 secs 2024-07-26T17:28:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14143.362102 secs 2024-07-26T17:28:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14143.362102 secs 2024-07-26T17:28:58.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:28:58 smithi146 ceph-mon[35807]: pgmap v9798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:28:58 smithi076 ceph-mon[35401]: pgmap v9798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:28:58.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:28:58 smithi040 ceph-mon[32397]: pgmap v9798: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:00.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:00 smithi146 ceph-mon[35807]: pgmap v9799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:00 smithi076 ceph-mon[35401]: pgmap v9799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:00.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:00 smithi040 ceph-mon[32397]: pgmap v9799: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:02 smithi146 ceph-mon[35807]: pgmap v9800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:02.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14148.362250 secs 2024-07-26T17:29:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:02 smithi076 ceph-mon[35401]: pgmap v9800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14148.362250 secs 2024-07-26T17:29:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:02 smithi040 ceph-mon[32397]: pgmap v9800: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14148.362250 secs 2024-07-26T17:29:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:04 smithi146 ceph-mon[35807]: pgmap v9801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:04 smithi076 ceph-mon[35401]: pgmap v9801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:04.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:04 smithi040 ceph-mon[32397]: pgmap v9801: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:06 smithi146 ceph-mon[35807]: pgmap v9802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:06 smithi076 ceph-mon[35401]: pgmap v9802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:06 smithi040 ceph-mon[32397]: pgmap v9802: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14153.362361 secs 2024-07-26T17:29:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14153.362361 secs 2024-07-26T17:29:07.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14153.362361 secs 2024-07-26T17:29:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:08 smithi146 ceph-mon[35807]: pgmap v9803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:08 smithi076 ceph-mon[35401]: pgmap v9803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:08.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:08 smithi040 ceph-mon[32397]: pgmap v9803: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:10 smithi076 ceph-mon[35401]: pgmap v9804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:10.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:10 smithi040 ceph-mon[32397]: pgmap v9804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:10.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:10 smithi146 ceph-mon[35807]: pgmap v9804: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:12 smithi076 ceph-mon[35401]: pgmap v9805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14158.362498 secs 2024-07-26T17:29:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:12 smithi040 ceph-mon[32397]: pgmap v9805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14158.362498 secs 2024-07-26T17:29:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:12 smithi146 ceph-mon[35807]: pgmap v9805: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14158.362498 secs 2024-07-26T17:29:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:14 smithi040 ceph-mon[32397]: pgmap v9806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:14.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:14 smithi146 ceph-mon[35807]: pgmap v9806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:14.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:14 smithi076 ceph-mon[35401]: pgmap v9806: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:16 smithi040 ceph-mon[32397]: pgmap v9807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:16 smithi146 ceph-mon[35807]: pgmap v9807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:16 smithi076 ceph-mon[35401]: pgmap v9807: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14163.362645 secs 2024-07-26T17:29:17.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14163.362645 secs 2024-07-26T17:29:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14163.362645 secs 2024-07-26T17:29:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:18 smithi040 ceph-mon[32397]: pgmap v9808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:18.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:18 smithi146 ceph-mon[35807]: pgmap v9808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:18.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:18 smithi076 ceph-mon[35401]: pgmap v9808: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:20.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:20 smithi040 ceph-mon[32397]: pgmap v9809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:20.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:20 smithi146 ceph-mon[35807]: pgmap v9809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:20.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:20 smithi076 ceph-mon[35401]: pgmap v9809: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:22 smithi040 ceph-mon[32397]: pgmap v9810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:29:22.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14168.362734 secs 2024-07-26T17:29:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:22 smithi146 ceph-mon[35807]: pgmap v9810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:29:22.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14168.362734 secs 2024-07-26T17:29:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:22 smithi076 ceph-mon[35401]: pgmap v9810: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:29:22.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14168.362734 secs 2024-07-26T17:29:24.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:24 smithi040 ceph-mon[32397]: pgmap v9811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:24.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:24 smithi146 ceph-mon[35807]: pgmap v9811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:24.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:24 smithi076 ceph-mon[35401]: pgmap v9811: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:29:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:26 smithi040 ceph-mon[32397]: pgmap v9812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:26 smithi146 ceph-mon[35807]: pgmap v9812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:26 smithi076 ceph-mon[35401]: pgmap v9812: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14173.362878 secs 2024-07-26T17:29:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14173.362878 secs 2024-07-26T17:29:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14173.362878 secs 2024-07-26T17:29:28.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:28 smithi040 ceph-mon[32397]: pgmap v9813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:28.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:28 smithi146 ceph-mon[35807]: pgmap v9813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:28.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:28 smithi076 ceph-mon[35401]: pgmap v9813: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:30.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:30 smithi040 ceph-mon[32397]: pgmap v9814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:30.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:30 smithi146 ceph-mon[35807]: pgmap v9814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:30.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:30 smithi076 ceph-mon[35401]: pgmap v9814: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:32 smithi040 ceph-mon[32397]: pgmap v9815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14178.363026 secs 2024-07-26T17:29:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:32 smithi146 ceph-mon[35807]: pgmap v9815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:32.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14178.363026 secs 2024-07-26T17:29:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:32 smithi076 ceph-mon[35401]: pgmap v9815: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:32.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14178.363026 secs 2024-07-26T17:29:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:34 smithi040 ceph-mon[32397]: pgmap v9816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:34.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:34 smithi146 ceph-mon[35807]: pgmap v9816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:34.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:34 smithi076 ceph-mon[35401]: pgmap v9816: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:36 smithi040 ceph-mon[32397]: pgmap v9817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:36.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:36 smithi146 ceph-mon[35807]: pgmap v9817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:36.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:36 smithi076 ceph-mon[35401]: pgmap v9817: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:37.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14183.363159 secs 2024-07-26T17:29:37.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14183.363159 secs 2024-07-26T17:29:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14183.363159 secs 2024-07-26T17:29:38.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:38 smithi040 ceph-mon[32397]: pgmap v9818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:38.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:38 smithi146 ceph-mon[35807]: pgmap v9818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:38.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:38 smithi076 ceph-mon[35401]: pgmap v9818: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:40.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:40 smithi040 ceph-mon[32397]: pgmap v9819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:40.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:40 smithi146 ceph-mon[35807]: pgmap v9819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:40.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:40 smithi076 ceph-mon[35401]: pgmap v9819: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:42 smithi040 ceph-mon[32397]: pgmap v9820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14188.363302 secs 2024-07-26T17:29:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:42 smithi146 ceph-mon[35807]: pgmap v9820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:42.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14188.363302 secs 2024-07-26T17:29:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:42 smithi076 ceph-mon[35401]: pgmap v9820: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:42.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14188.363302 secs 2024-07-26T17:29:44.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:44 smithi040 ceph-mon[32397]: pgmap v9821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:44.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:44 smithi146 ceph-mon[35807]: pgmap v9821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:44.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:44 smithi076 ceph-mon[35401]: pgmap v9821: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:46 smithi040 ceph-mon[32397]: pgmap v9822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:46.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:46 smithi146 ceph-mon[35807]: pgmap v9822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:46 smithi076 ceph-mon[35401]: pgmap v9822: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14193.363457 secs 2024-07-26T17:29:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14193.363457 secs 2024-07-26T17:29:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14193.363457 secs 2024-07-26T17:29:48.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:48 smithi146 ceph-mon[35807]: pgmap v9823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:48.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:48 smithi076 ceph-mon[35401]: pgmap v9823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:48.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:48 smithi040 ceph-mon[32397]: pgmap v9823: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:50.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:50 smithi146 ceph-mon[35807]: pgmap v9824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:50.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:50 smithi076 ceph-mon[35401]: pgmap v9824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:50.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:50 smithi040 ceph-mon[32397]: pgmap v9824: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:29:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:52 smithi146 ceph-mon[35807]: pgmap v9825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:52.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14198.363594 secs 2024-07-26T17:29:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:52 smithi076 ceph-mon[35401]: pgmap v9825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:52.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14198.363594 secs 2024-07-26T17:29:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:52 smithi040 ceph-mon[32397]: pgmap v9825: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:52.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14198.363594 secs 2024-07-26T17:29:54.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:54 smithi146 ceph-mon[35807]: pgmap v9826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:54.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:54 smithi076 ceph-mon[35401]: pgmap v9826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:54.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:54 smithi040 ceph-mon[32397]: pgmap v9826: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:56 smithi146 ceph-mon[35807]: pgmap v9827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:56 smithi076 ceph-mon[35401]: pgmap v9827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:56 smithi040 ceph-mon[32397]: pgmap v9827: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:29:57.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14203.363714 secs 2024-07-26T17:29:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14203.363714 secs 2024-07-26T17:29:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14203.363714 secs 2024-07-26T17:29:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:29:58 smithi146 ceph-mon[35807]: pgmap v9828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:29:58 smithi076 ceph-mon[35401]: pgmap v9828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:29:58.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:29:58 smithi040 ceph-mon[32397]: pgmap v9828: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:00 smithi146 ceph-mon[35807]: pgmap v9829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:00.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:30:00.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:00 smithi076 ceph-mon[35401]: pgmap v9829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:00.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:30:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:00 smithi040 ceph-mon[32397]: pgmap v9829: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:00.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:30:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:02 smithi146 ceph-mon[35807]: pgmap v9830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:30:02.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14208.363854 secs 2024-07-26T17:30:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:02 smithi076 ceph-mon[35401]: pgmap v9830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:30:02.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14208.363854 secs 2024-07-26T17:30:02.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:02 smithi040 ceph-mon[32397]: pgmap v9830: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:30:02.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14208.363854 secs 2024-07-26T17:30:04.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:04 smithi146 ceph-mon[35807]: pgmap v9831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:04.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:04 smithi076 ceph-mon[35401]: pgmap v9831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:04.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:04 smithi040 ceph-mon[32397]: pgmap v9831: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:06 smithi146 ceph-mon[35807]: pgmap v9832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:06 smithi076 ceph-mon[35401]: pgmap v9832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:06 smithi040 ceph-mon[32397]: pgmap v9832: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:07.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14213.363989 secs 2024-07-26T17:30:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14213.363989 secs 2024-07-26T17:30:07.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14213.363989 secs 2024-07-26T17:30:08.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:08 smithi040 ceph-mon[32397]: pgmap v9833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:08.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:08 smithi146 ceph-mon[35807]: pgmap v9833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:08.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:08 smithi076 ceph-mon[35401]: pgmap v9833: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:10.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:10 smithi076 ceph-mon[35401]: pgmap v9834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:10.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:10 smithi040 ceph-mon[32397]: pgmap v9834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:10.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:10 smithi146 ceph-mon[35807]: pgmap v9834: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:12 smithi040 ceph-mon[32397]: pgmap v9835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14218.364153 secs 2024-07-26T17:30:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:12 smithi146 ceph-mon[35807]: pgmap v9835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:12.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14218.364153 secs 2024-07-26T17:30:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:12 smithi076 ceph-mon[35401]: pgmap v9835: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14218.364153 secs 2024-07-26T17:30:14.731 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:14 smithi076 ceph-mon[35401]: pgmap v9836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:14.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:14 smithi040 ceph-mon[32397]: pgmap v9836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:14.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:14 smithi146 ceph-mon[35807]: pgmap v9836: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:16 smithi040 ceph-mon[32397]: pgmap v9837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:16 smithi146 ceph-mon[35807]: pgmap v9837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:16 smithi076 ceph-mon[35401]: pgmap v9837: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14223.364310 secs 2024-07-26T17:30:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14223.364310 secs 2024-07-26T17:30:17.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14223.364310 secs 2024-07-26T17:30:18.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:18 smithi040 ceph-mon[32397]: pgmap v9838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:18.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:18 smithi146 ceph-mon[35807]: pgmap v9838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:18.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:18 smithi076 ceph-mon[35401]: pgmap v9838: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:20.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:20 smithi040 ceph-mon[32397]: pgmap v9839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:20.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:20 smithi146 ceph-mon[35807]: pgmap v9839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:20.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:20 smithi076 ceph-mon[35401]: pgmap v9839: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:22 smithi040 ceph-mon[32397]: pgmap v9840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14228.364487 secs 2024-07-26T17:30:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:22 smithi146 ceph-mon[35807]: pgmap v9840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:22.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14228.364487 secs 2024-07-26T17:30:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:22 smithi076 ceph-mon[35401]: pgmap v9840: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14228.364487 secs 2024-07-26T17:30:24.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:24 smithi040 ceph-mon[32397]: pgmap v9841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:24.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:24 smithi146 ceph-mon[35807]: pgmap v9841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:24.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:24 smithi076 ceph-mon[35401]: pgmap v9841: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:26 smithi040 ceph-mon[32397]: pgmap v9842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:26.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:26 smithi146 ceph-mon[35807]: pgmap v9842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:26 smithi076 ceph-mon[35401]: pgmap v9842: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14233.364643 secs 2024-07-26T17:30:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14233.364643 secs 2024-07-26T17:30:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14233.364643 secs 2024-07-26T17:30:28.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:28 smithi040 ceph-mon[32397]: pgmap v9843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:28.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:28 smithi146 ceph-mon[35807]: pgmap v9843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:28.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:28 smithi076 ceph-mon[35401]: pgmap v9843: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:30.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:30 smithi040 ceph-mon[32397]: pgmap v9844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:30.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:30 smithi146 ceph-mon[35807]: pgmap v9844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:30.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:30 smithi076 ceph-mon[35401]: pgmap v9844: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:32 smithi040 ceph-mon[32397]: pgmap v9845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:32.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14238.364780 secs 2024-07-26T17:30:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:32 smithi146 ceph-mon[35807]: pgmap v9845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14238.364780 secs 2024-07-26T17:30:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:32 smithi076 ceph-mon[35401]: pgmap v9845: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14238.364780 secs 2024-07-26T17:30:34.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:34 smithi040 ceph-mon[32397]: pgmap v9846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:34.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:34 smithi146 ceph-mon[35807]: pgmap v9846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:34.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:34 smithi076 ceph-mon[35401]: pgmap v9846: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:36 smithi040 ceph-mon[32397]: pgmap v9847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:36 smithi146 ceph-mon[35807]: pgmap v9847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:36 smithi076 ceph-mon[35401]: pgmap v9847: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:37.723 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14243.364913 secs 2024-07-26T17:30:37.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14243.364913 secs 2024-07-26T17:30:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14243.364913 secs 2024-07-26T17:30:38.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:38 smithi040 ceph-mon[32397]: pgmap v9848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:38.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:38 smithi146 ceph-mon[35807]: pgmap v9848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:38.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:38 smithi076 ceph-mon[35401]: pgmap v9848: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:40.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:40 smithi040 ceph-mon[32397]: pgmap v9849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:40.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:40 smithi146 ceph-mon[35807]: pgmap v9849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:40.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:40 smithi076 ceph-mon[35401]: pgmap v9849: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:42 smithi040 ceph-mon[32397]: pgmap v9850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:42.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14248.365051 secs 2024-07-26T17:30:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:42 smithi146 ceph-mon[35807]: pgmap v9850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14248.365051 secs 2024-07-26T17:30:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:42 smithi076 ceph-mon[35401]: pgmap v9850: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14248.365051 secs 2024-07-26T17:30:44.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:44 smithi146 ceph-mon[35807]: pgmap v9851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:44.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:44 smithi076 ceph-mon[35401]: pgmap v9851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:44.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:44 smithi040 ceph-mon[32397]: pgmap v9851: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:46.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:46 smithi146 ceph-mon[35807]: pgmap v9852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:46 smithi076 ceph-mon[35401]: pgmap v9852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:46 smithi040 ceph-mon[32397]: pgmap v9852: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14253.365181 secs 2024-07-26T17:30:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14253.365181 secs 2024-07-26T17:30:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14253.365181 secs 2024-07-26T17:30:48.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: pgmap v9853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:30:48.822 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: pgmap v9854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 945 B/s rd, 1 op/s 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: pgmap v9855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: pgmap v9856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 750 B/s rd, 1 op/s 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: pgmap v9857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:48.823 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:30:48.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: pgmap v9853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:30:48.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:30:48.835 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:30:48.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:30:48.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: pgmap v9854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 945 B/s rd, 1 op/s 2024-07-26T17:30:48.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: pgmap v9855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T17:30:48.836 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: pgmap v9856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 750 B/s rd, 1 op/s 2024-07-26T17:30:48.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: pgmap v9857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:48.837 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:30:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: pgmap v9853: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: pgmap v9854: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 945 B/s rd, 1 op/s 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: pgmap v9855: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: pgmap v9856: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 750 B/s rd, 1 op/s 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: pgmap v9857: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:30:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:49 smithi040 ceph-mon[32397]: pgmap v9858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:49 smithi146 ceph-mon[35807]: pgmap v9858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:49 smithi076 ceph-mon[35401]: pgmap v9858: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:51 smithi040 ceph-mon[32397]: pgmap v9859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:51 smithi146 ceph-mon[35807]: pgmap v9859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:51 smithi076 ceph-mon[35401]: pgmap v9859: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-07-26T17:30:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14258.365319 secs 2024-07-26T17:30:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14258.365319 secs 2024-07-26T17:30:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14258.365319 secs 2024-07-26T17:30:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:53 smithi040 ceph-mon[32397]: pgmap v9860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:53 smithi146 ceph-mon[35807]: pgmap v9860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:53 smithi076 ceph-mon[35401]: pgmap v9860: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:30:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:55 smithi040 ceph-mon[32397]: pgmap v9861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:55 smithi146 ceph-mon[35807]: pgmap v9861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:55 smithi076 ceph-mon[35401]: pgmap v9861: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:30:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14263.365414 secs 2024-07-26T17:30:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14263.365414 secs 2024-07-26T17:30:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14263.365414 secs 2024-07-26T17:30:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:57 smithi146 ceph-mon[35807]: pgmap v9862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:30:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:57 smithi076 ceph-mon[35401]: pgmap v9862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:30:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:57 smithi040 ceph-mon[32397]: pgmap v9862: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:30:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:30:59 smithi040 ceph-mon[32397]: pgmap v9863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:30:59 smithi146 ceph-mon[35807]: pgmap v9863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:30:59 smithi076 ceph-mon[35401]: pgmap v9863: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:01 smithi040 ceph-mon[32397]: pgmap v9864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:01 smithi146 ceph-mon[35807]: pgmap v9864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:01 smithi076 ceph-mon[35401]: pgmap v9864: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14268.365508 secs 2024-07-26T17:31:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14268.365508 secs 2024-07-26T17:31:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14268.365508 secs 2024-07-26T17:31:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:03 smithi040 ceph-mon[32397]: pgmap v9865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:03 smithi146 ceph-mon[35807]: pgmap v9865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:03 smithi076 ceph-mon[35401]: pgmap v9865: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:05 smithi040 ceph-mon[32397]: pgmap v9866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:05 smithi146 ceph-mon[35807]: pgmap v9866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:05 smithi076 ceph-mon[35401]: pgmap v9866: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14273.365652 secs 2024-07-26T17:31:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14273.365652 secs 2024-07-26T17:31:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14273.365652 secs 2024-07-26T17:31:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:07 smithi146 ceph-mon[35807]: pgmap v9867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:07 smithi076 ceph-mon[35401]: pgmap v9867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:08.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:07 smithi040 ceph-mon[32397]: pgmap v9867: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:09 smithi040 ceph-mon[32397]: pgmap v9868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:09 smithi146 ceph-mon[35807]: pgmap v9868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:09 smithi076 ceph-mon[35401]: pgmap v9868: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14278.365793 secs 2024-07-26T17:31:12.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:12 smithi146 ceph-mon[35807]: pgmap v9869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14278.365793 secs 2024-07-26T17:31:12.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:12 smithi076 ceph-mon[35401]: pgmap v9869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14278.365793 secs 2024-07-26T17:31:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:12 smithi040 ceph-mon[32397]: pgmap v9869: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:13.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:13 smithi040 ceph-mon[32397]: pgmap v9870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:13 smithi146 ceph-mon[35807]: pgmap v9870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:13 smithi076 ceph-mon[35401]: pgmap v9870: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:15 smithi040 ceph-mon[32397]: pgmap v9871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:15 smithi146 ceph-mon[35807]: pgmap v9871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:15 smithi076 ceph-mon[35401]: pgmap v9871: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14283.365930 secs 2024-07-26T17:31:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14283.365930 secs 2024-07-26T17:31:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14283.365930 secs 2024-07-26T17:31:18.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:17 smithi146 ceph-mon[35807]: pgmap v9872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:17 smithi076 ceph-mon[35401]: pgmap v9872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:17 smithi040 ceph-mon[32397]: pgmap v9872: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:19 smithi040 ceph-mon[32397]: pgmap v9873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:19 smithi146 ceph-mon[35807]: pgmap v9873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:19 smithi076 ceph-mon[35401]: pgmap v9873: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:21 smithi040 ceph-mon[32397]: pgmap v9874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:21 smithi146 ceph-mon[35807]: pgmap v9874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:21 smithi076 ceph-mon[35401]: pgmap v9874: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:22.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14288.366064 secs 2024-07-26T17:31:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14288.366064 secs 2024-07-26T17:31:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14288.366064 secs 2024-07-26T17:31:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:23 smithi040 ceph-mon[32397]: pgmap v9875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:23 smithi146 ceph-mon[35807]: pgmap v9875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:23 smithi076 ceph-mon[35401]: pgmap v9875: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:25 smithi040 ceph-mon[32397]: pgmap v9876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:25 smithi146 ceph-mon[35807]: pgmap v9876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:25 smithi076 ceph-mon[35401]: pgmap v9876: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14293.366207 secs 2024-07-26T17:31:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14293.366207 secs 2024-07-26T17:31:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14293.366207 secs 2024-07-26T17:31:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:27 smithi146 ceph-mon[35807]: pgmap v9877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:27 smithi076 ceph-mon[35401]: pgmap v9877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:27 smithi040 ceph-mon[32397]: pgmap v9877: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:29 smithi040 ceph-mon[32397]: pgmap v9878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:29 smithi146 ceph-mon[35807]: pgmap v9878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:29 smithi076 ceph-mon[35401]: pgmap v9878: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:31 smithi040 ceph-mon[32397]: pgmap v9879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:31 smithi146 ceph-mon[35807]: pgmap v9879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:31 smithi076 ceph-mon[35401]: pgmap v9879: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14298.366348 secs 2024-07-26T17:31:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14298.366348 secs 2024-07-26T17:31:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14298.366348 secs 2024-07-26T17:31:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:33 smithi040 ceph-mon[32397]: pgmap v9880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:33 smithi146 ceph-mon[35807]: pgmap v9880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:33 smithi076 ceph-mon[35401]: pgmap v9880: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:35 smithi040 ceph-mon[32397]: pgmap v9881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:35 smithi146 ceph-mon[35807]: pgmap v9881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:35 smithi076 ceph-mon[35401]: pgmap v9881: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14303.366500 secs 2024-07-26T17:31:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14303.366500 secs 2024-07-26T17:31:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14303.366500 secs 2024-07-26T17:31:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:37 smithi146 ceph-mon[35807]: pgmap v9882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:37 smithi076 ceph-mon[35401]: pgmap v9882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:38.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:37 smithi040 ceph-mon[32397]: pgmap v9882: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:39 smithi040 ceph-mon[32397]: pgmap v9883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:39 smithi146 ceph-mon[35807]: pgmap v9883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:39 smithi076 ceph-mon[35401]: pgmap v9883: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:41 smithi040 ceph-mon[32397]: pgmap v9884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:41 smithi146 ceph-mon[35807]: pgmap v9884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:41 smithi076 ceph-mon[35401]: pgmap v9884: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14308.366649 secs 2024-07-26T17:31:42.984 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14308.366649 secs 2024-07-26T17:31:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14308.366649 secs 2024-07-26T17:31:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:43 smithi040 ceph-mon[32397]: pgmap v9885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:43 smithi146 ceph-mon[35807]: pgmap v9885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:43 smithi076 ceph-mon[35401]: pgmap v9885: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:45 smithi040 ceph-mon[32397]: pgmap v9886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:45 smithi146 ceph-mon[35807]: pgmap v9886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:45 smithi076 ceph-mon[35401]: pgmap v9886: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14313.366793 secs 2024-07-26T17:31:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14313.366793 secs 2024-07-26T17:31:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14313.366793 secs 2024-07-26T17:31:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:47 smithi146 ceph-mon[35807]: pgmap v9887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:47 smithi076 ceph-mon[35401]: pgmap v9887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:47 smithi040 ceph-mon[32397]: pgmap v9887: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:31:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:48 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:31:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:48 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:31:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:49.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:48 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:49 smithi146 ceph-mon[35807]: pgmap v9888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:49 smithi076 ceph-mon[35401]: pgmap v9888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:50.116 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:49 smithi040 ceph-mon[32397]: pgmap v9888: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:51 smithi040 ceph-mon[32397]: pgmap v9889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:51 smithi146 ceph-mon[35807]: pgmap v9889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:51 smithi076 ceph-mon[35401]: pgmap v9889: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14318.366889 secs 2024-07-26T17:31:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14318.366889 secs 2024-07-26T17:31:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14318.366889 secs 2024-07-26T17:31:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:53 smithi040 ceph-mon[32397]: pgmap v9890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:53 smithi146 ceph-mon[35807]: pgmap v9890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:53 smithi076 ceph-mon[35401]: pgmap v9890: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:31:55.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:31:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:55 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:31:55.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.335 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.336 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.337 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.337 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.337 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:31:55.337 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.337 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.338 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:31:55.338 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.338 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.338 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:31:55.339 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:55 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:31:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.572 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:31:55.573 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:31:55.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:31:55.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:55 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:31:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:56 smithi040 ceph-mon[32397]: pgmap v9891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:56 smithi146 ceph-mon[35807]: pgmap v9891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:56 smithi076 ceph-mon[35401]: pgmap v9891: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:31:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14323.367060 secs 2024-07-26T17:31:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14323.367060 secs 2024-07-26T17:31:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14323.367060 secs 2024-07-26T17:31:58.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:58 smithi146 ceph-mon[35807]: pgmap v9892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:58.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:58 smithi076 ceph-mon[35401]: pgmap v9892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:58 smithi040 ceph-mon[32397]: pgmap v9892: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:31:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:31:59 smithi040 ceph-mon[32397]: pgmap v9893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:31:59 smithi146 ceph-mon[35807]: pgmap v9893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:00.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:31:59 smithi076 ceph-mon[35401]: pgmap v9893: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:01 smithi040 ceph-mon[32397]: pgmap v9894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:01 smithi146 ceph-mon[35807]: pgmap v9894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:01 smithi076 ceph-mon[35401]: pgmap v9894: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14328.367221 secs 2024-07-26T17:32:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14328.367221 secs 2024-07-26T17:32:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14328.367221 secs 2024-07-26T17:32:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:03 smithi040 ceph-mon[32397]: pgmap v9895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:03 smithi146 ceph-mon[35807]: pgmap v9895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:03 smithi076 ceph-mon[35401]: pgmap v9895: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:05 smithi040 ceph-mon[32397]: pgmap v9896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:05 smithi146 ceph-mon[35807]: pgmap v9896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:05 smithi076 ceph-mon[35401]: pgmap v9896: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14333.367359 secs 2024-07-26T17:32:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14333.367359 secs 2024-07-26T17:32:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14333.367359 secs 2024-07-26T17:32:08.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:07 smithi146 ceph-mon[35807]: pgmap v9897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:07 smithi076 ceph-mon[35401]: pgmap v9897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:08.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:07 smithi040 ceph-mon[32397]: pgmap v9897: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:09 smithi040 ceph-mon[32397]: pgmap v9898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:09 smithi146 ceph-mon[35807]: pgmap v9898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:09 smithi076 ceph-mon[35401]: pgmap v9898: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:11 smithi040 ceph-mon[32397]: pgmap v9899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:11 smithi146 ceph-mon[35807]: pgmap v9899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:11 smithi076 ceph-mon[35401]: pgmap v9899: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14338.367499 secs 2024-07-26T17:32:12.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14338.367499 secs 2024-07-26T17:32:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14338.367499 secs 2024-07-26T17:32:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:13 smithi040 ceph-mon[32397]: pgmap v9900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:13 smithi146 ceph-mon[35807]: pgmap v9900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:13 smithi076 ceph-mon[35401]: pgmap v9900: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:15 smithi040 ceph-mon[32397]: pgmap v9901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:15 smithi146 ceph-mon[35807]: pgmap v9901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:15 smithi076 ceph-mon[35401]: pgmap v9901: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14343.367633 secs 2024-07-26T17:32:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14343.367633 secs 2024-07-26T17:32:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14343.367633 secs 2024-07-26T17:32:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:17 smithi146 ceph-mon[35807]: pgmap v9902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:17 smithi076 ceph-mon[35401]: pgmap v9902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:18.222 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:17 smithi040 ceph-mon[32397]: pgmap v9902: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:19 smithi040 ceph-mon[32397]: pgmap v9903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:19 smithi146 ceph-mon[35807]: pgmap v9903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:19 smithi076 ceph-mon[35401]: pgmap v9903: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:21 smithi040 ceph-mon[32397]: pgmap v9904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:21 smithi146 ceph-mon[35807]: pgmap v9904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:21 smithi076 ceph-mon[35401]: pgmap v9904: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:22.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14348.367780 secs 2024-07-26T17:32:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14348.367780 secs 2024-07-26T17:32:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14348.367780 secs 2024-07-26T17:32:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:23 smithi040 ceph-mon[32397]: pgmap v9905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:24.032 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:23 smithi076 ceph-mon[35401]: pgmap v9905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:23 smithi146 ceph-mon[35807]: pgmap v9905: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:25 smithi040 ceph-mon[32397]: pgmap v9906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:25 smithi146 ceph-mon[35807]: pgmap v9906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:25 smithi076 ceph-mon[35401]: pgmap v9906: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14353.367919 secs 2024-07-26T17:32:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14353.367919 secs 2024-07-26T17:32:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14353.367919 secs 2024-07-26T17:32:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:27 smithi146 ceph-mon[35807]: pgmap v9907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:27 smithi076 ceph-mon[35401]: pgmap v9907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:27 smithi040 ceph-mon[32397]: pgmap v9907: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:29 smithi040 ceph-mon[32397]: pgmap v9908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:29 smithi146 ceph-mon[35807]: pgmap v9908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:29 smithi076 ceph-mon[35401]: pgmap v9908: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:31 smithi040 ceph-mon[32397]: pgmap v9909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:31 smithi146 ceph-mon[35807]: pgmap v9909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:31 smithi076 ceph-mon[35401]: pgmap v9909: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14358.368063 secs 2024-07-26T17:32:33.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14358.368063 secs 2024-07-26T17:32:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14358.368063 secs 2024-07-26T17:32:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:33 smithi040 ceph-mon[32397]: pgmap v9910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:33 smithi146 ceph-mon[35807]: pgmap v9910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:33 smithi076 ceph-mon[35401]: pgmap v9910: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:35 smithi040 ceph-mon[32397]: pgmap v9911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:35 smithi146 ceph-mon[35807]: pgmap v9911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:35 smithi076 ceph-mon[35401]: pgmap v9911: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14363.368203 secs 2024-07-26T17:32:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14363.368203 secs 2024-07-26T17:32:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14363.368203 secs 2024-07-26T17:32:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:37 smithi146 ceph-mon[35807]: pgmap v9912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:37 smithi076 ceph-mon[35401]: pgmap v9912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:38.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:37 smithi040 ceph-mon[32397]: pgmap v9912: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:39 smithi040 ceph-mon[32397]: pgmap v9913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:39 smithi146 ceph-mon[35807]: pgmap v9913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:39 smithi076 ceph-mon[35401]: pgmap v9913: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:41 smithi040 ceph-mon[32397]: pgmap v9914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:41 smithi146 ceph-mon[35807]: pgmap v9914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:41 smithi076 ceph-mon[35401]: pgmap v9914: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14368.368381 secs 2024-07-26T17:32:42.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14368.368381 secs 2024-07-26T17:32:43.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14368.368381 secs 2024-07-26T17:32:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:43 smithi040 ceph-mon[32397]: pgmap v9915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:43 smithi146 ceph-mon[35807]: pgmap v9915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:43 smithi076 ceph-mon[35401]: pgmap v9915: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:45 smithi040 ceph-mon[32397]: pgmap v9916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:45 smithi146 ceph-mon[35807]: pgmap v9916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:45 smithi076 ceph-mon[35401]: pgmap v9916: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14373.368539 secs 2024-07-26T17:32:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14373.368539 secs 2024-07-26T17:32:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14373.368539 secs 2024-07-26T17:32:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:47 smithi146 ceph-mon[35807]: pgmap v9917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:47 smithi076 ceph-mon[35401]: pgmap v9917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:47 smithi040 ceph-mon[32397]: pgmap v9917: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:50.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:50 smithi040 ceph-mon[32397]: pgmap v9918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:50 smithi146 ceph-mon[35807]: pgmap v9918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:50 smithi076 ceph-mon[35401]: pgmap v9918: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14378.368704 secs 2024-07-26T17:32:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:52 smithi040 ceph-mon[32397]: pgmap v9919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14378.368704 secs 2024-07-26T17:32:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:52 smithi146 ceph-mon[35807]: pgmap v9919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14378.368704 secs 2024-07-26T17:32:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:52 smithi076 ceph-mon[35401]: pgmap v9919: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:54.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:54 smithi040 ceph-mon[32397]: pgmap v9920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:55.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:54 smithi146 ceph-mon[35807]: pgmap v9920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:54 smithi076 ceph-mon[35401]: pgmap v9920: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:32:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:56 smithi040 ceph-mon[32397]: pgmap v9921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:56 smithi146 ceph-mon[35807]: pgmap v9921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:56 smithi076 ceph-mon[35401]: pgmap v9921: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:32:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14383.368842 secs 2024-07-26T17:32:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14383.368842 secs 2024-07-26T17:32:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14383.368842 secs 2024-07-26T17:32:58.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:32:58 smithi040 ceph-mon[32397]: pgmap v9922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:32:58 smithi146 ceph-mon[35807]: pgmap v9922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:32:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:32:58 smithi076 ceph-mon[35401]: pgmap v9922: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:00 smithi040 ceph-mon[32397]: pgmap v9923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:00 smithi146 ceph-mon[35807]: pgmap v9923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:00 smithi076 ceph-mon[35401]: pgmap v9923: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14388.368989 secs 2024-07-26T17:33:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:02 smithi040 ceph-mon[32397]: pgmap v9924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14388.368989 secs 2024-07-26T17:33:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:02 smithi146 ceph-mon[35807]: pgmap v9924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14388.368989 secs 2024-07-26T17:33:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:02 smithi076 ceph-mon[35401]: pgmap v9924: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:04 smithi146 ceph-mon[35807]: pgmap v9925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:04 smithi076 ceph-mon[35401]: pgmap v9925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:04 smithi040 ceph-mon[32397]: pgmap v9925: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:06 smithi146 ceph-mon[35807]: pgmap v9926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:06 smithi076 ceph-mon[35401]: pgmap v9926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:06 smithi040 ceph-mon[32397]: pgmap v9926: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:08.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14393.369131 secs 2024-07-26T17:33:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14393.369131 secs 2024-07-26T17:33:08.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14393.369131 secs 2024-07-26T17:33:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:08 smithi146 ceph-mon[35807]: pgmap v9927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:08 smithi076 ceph-mon[35401]: pgmap v9927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:08 smithi040 ceph-mon[32397]: pgmap v9927: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:10 smithi146 ceph-mon[35807]: pgmap v9928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:10 smithi076 ceph-mon[35401]: pgmap v9928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:10 smithi040 ceph-mon[32397]: pgmap v9928: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14398.369312 secs 2024-07-26T17:33:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14398.369312 secs 2024-07-26T17:33:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14398.369312 secs 2024-07-26T17:33:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:12 smithi146 ceph-mon[35807]: pgmap v9929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:12 smithi076 ceph-mon[35401]: pgmap v9929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:12 smithi040 ceph-mon[32397]: pgmap v9929: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:14 smithi146 ceph-mon[35807]: pgmap v9930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:14 smithi076 ceph-mon[35401]: pgmap v9930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:14 smithi040 ceph-mon[32397]: pgmap v9930: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:16 smithi146 ceph-mon[35807]: pgmap v9931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14403.369451 secs 2024-07-26T17:33:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:16 smithi076 ceph-mon[35401]: pgmap v9931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14403.369451 secs 2024-07-26T17:33:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:16 smithi040 ceph-mon[32397]: pgmap v9931: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14403.369451 secs 2024-07-26T17:33:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:18 smithi146 ceph-mon[35807]: pgmap v9932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:18 smithi076 ceph-mon[35401]: pgmap v9932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:19.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:18 smithi040 ceph-mon[32397]: pgmap v9932: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:20 smithi146 ceph-mon[35807]: pgmap v9933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:20 smithi076 ceph-mon[35401]: pgmap v9933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:20 smithi040 ceph-mon[32397]: pgmap v9933: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14408.369549 secs 2024-07-26T17:33:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14408.369549 secs 2024-07-26T17:33:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14408.369549 secs 2024-07-26T17:33:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:22 smithi076 ceph-mon[35401]: pgmap v9934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:22 smithi040 ceph-mon[32397]: pgmap v9934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:22 smithi146 ceph-mon[35807]: pgmap v9934: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:24 smithi040 ceph-mon[32397]: pgmap v9935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:24 smithi146 ceph-mon[35807]: pgmap v9935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:24 smithi076 ceph-mon[35401]: pgmap v9935: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:26 smithi040 ceph-mon[32397]: pgmap v9936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14413.369683 secs 2024-07-26T17:33:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:26 smithi146 ceph-mon[35807]: pgmap v9936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14413.369683 secs 2024-07-26T17:33:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:26 smithi076 ceph-mon[35401]: pgmap v9936: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14413.369683 secs 2024-07-26T17:33:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:28 smithi040 ceph-mon[32397]: pgmap v9937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:28 smithi146 ceph-mon[35807]: pgmap v9937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:28 smithi076 ceph-mon[35401]: pgmap v9937: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:30 smithi040 ceph-mon[32397]: pgmap v9938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:30 smithi146 ceph-mon[35807]: pgmap v9938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:30 smithi076 ceph-mon[35401]: pgmap v9938: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14418.369830 secs 2024-07-26T17:33:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14418.369830 secs 2024-07-26T17:33:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14418.369830 secs 2024-07-26T17:33:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:32 smithi040 ceph-mon[32397]: pgmap v9939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:32 smithi146 ceph-mon[35807]: pgmap v9939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:32 smithi076 ceph-mon[35401]: pgmap v9939: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:34 smithi040 ceph-mon[32397]: pgmap v9940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:35.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:34 smithi146 ceph-mon[35807]: pgmap v9940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:34 smithi076 ceph-mon[35401]: pgmap v9940: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:36 smithi040 ceph-mon[32397]: pgmap v9941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14423.369967 secs 2024-07-26T17:33:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:36 smithi146 ceph-mon[35807]: pgmap v9941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14423.369967 secs 2024-07-26T17:33:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:36 smithi076 ceph-mon[35401]: pgmap v9941: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14423.369967 secs 2024-07-26T17:33:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:38 smithi040 ceph-mon[32397]: pgmap v9942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:39.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:38 smithi146 ceph-mon[35807]: pgmap v9942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:38 smithi076 ceph-mon[35401]: pgmap v9942: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:40 smithi040 ceph-mon[32397]: pgmap v9943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:40 smithi146 ceph-mon[35807]: pgmap v9943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:40 smithi076 ceph-mon[35401]: pgmap v9943: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14428.370119 secs 2024-07-26T17:33:42.235 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14428.370119 secs 2024-07-26T17:33:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14428.370119 secs 2024-07-26T17:33:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:42 smithi040 ceph-mon[32397]: pgmap v9944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:42 smithi146 ceph-mon[35807]: pgmap v9944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:42 smithi076 ceph-mon[35401]: pgmap v9944: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:44 smithi040 ceph-mon[32397]: pgmap v9945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:45.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:44 smithi146 ceph-mon[35807]: pgmap v9945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:44 smithi076 ceph-mon[35401]: pgmap v9945: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:46 smithi040 ceph-mon[32397]: pgmap v9946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14433.370300 secs 2024-07-26T17:33:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:46 smithi146 ceph-mon[35807]: pgmap v9946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14433.370300 secs 2024-07-26T17:33:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:46 smithi076 ceph-mon[35401]: pgmap v9946: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14433.370300 secs 2024-07-26T17:33:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:48 smithi040 ceph-mon[32397]: pgmap v9947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:49.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:48 smithi146 ceph-mon[35807]: pgmap v9947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:48 smithi076 ceph-mon[35401]: pgmap v9947: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:50 smithi040 ceph-mon[32397]: pgmap v9948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:50 smithi146 ceph-mon[35807]: pgmap v9948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:50 smithi076 ceph-mon[35401]: pgmap v9948: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14438.370400 secs 2024-07-26T17:33:52.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14438.370400 secs 2024-07-26T17:33:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14438.370400 secs 2024-07-26T17:33:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:52 smithi040 ceph-mon[32397]: pgmap v9949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:52 smithi146 ceph-mon[35807]: pgmap v9949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:52 smithi076 ceph-mon[35401]: pgmap v9949: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:54 smithi040 ceph-mon[32397]: pgmap v9950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:54 smithi146 ceph-mon[35807]: pgmap v9950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:54 smithi076 ceph-mon[35401]: pgmap v9950: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:33:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:57 smithi076 ceph-mon[35401]: pgmap v9951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:57.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14443.370497 secs 2024-07-26T17:33:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:57 smithi040 ceph-mon[32397]: pgmap v9951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14443.370497 secs 2024-07-26T17:33:57.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:57 smithi146 ceph-mon[35807]: pgmap v9951: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:33:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14443.370497 secs 2024-07-26T17:33:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:33:59 smithi040 ceph-mon[32397]: pgmap v9952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:33:59 smithi146 ceph-mon[35807]: pgmap v9952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:33:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:33:59 smithi076 ceph-mon[35401]: pgmap v9952: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:01 smithi040 ceph-mon[32397]: pgmap v9953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:01 smithi146 ceph-mon[35807]: pgmap v9953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:01 smithi076 ceph-mon[35401]: pgmap v9953: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:02.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14448.370646 secs 2024-07-26T17:34:02.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14448.370646 secs 2024-07-26T17:34:02.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14448.370646 secs 2024-07-26T17:34:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:03 smithi040 ceph-mon[32397]: pgmap v9954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:03 smithi146 ceph-mon[35807]: pgmap v9954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:03 smithi076 ceph-mon[35401]: pgmap v9954: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:05 smithi040 ceph-mon[32397]: pgmap v9955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:05 smithi146 ceph-mon[35807]: pgmap v9955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:05.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:05 smithi076 ceph-mon[35401]: pgmap v9955: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:07.623 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:07 smithi146 ceph-mon[35807]: pgmap v9956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:07.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14453.370783 secs 2024-07-26T17:34:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:07 smithi040 ceph-mon[32397]: pgmap v9956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14453.370783 secs 2024-07-26T17:34:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:07 smithi076 ceph-mon[35401]: pgmap v9956: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14453.370783 secs 2024-07-26T17:34:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:09 smithi040 ceph-mon[32397]: pgmap v9957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:09 smithi146 ceph-mon[35807]: pgmap v9957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:09 smithi076 ceph-mon[35401]: pgmap v9957: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:11 smithi040 ceph-mon[32397]: pgmap v9958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:11 smithi146 ceph-mon[35807]: pgmap v9958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:11 smithi076 ceph-mon[35401]: pgmap v9958: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14458.370925 secs 2024-07-26T17:34:12.735 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14458.370925 secs 2024-07-26T17:34:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14458.370925 secs 2024-07-26T17:34:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:13 smithi040 ceph-mon[32397]: pgmap v9959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:13 smithi146 ceph-mon[35807]: pgmap v9959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:13 smithi076 ceph-mon[35401]: pgmap v9959: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:15.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:15 smithi040 ceph-mon[32397]: pgmap v9960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:15 smithi146 ceph-mon[35807]: pgmap v9960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:15 smithi076 ceph-mon[35401]: pgmap v9960: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:17 smithi040 ceph-mon[32397]: pgmap v9961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14463.371061 secs 2024-07-26T17:34:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:17 smithi146 ceph-mon[35807]: pgmap v9961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14463.371061 secs 2024-07-26T17:34:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:17 smithi076 ceph-mon[35401]: pgmap v9961: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14463.371061 secs 2024-07-26T17:34:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:19 smithi040 ceph-mon[32397]: pgmap v9962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:19 smithi146 ceph-mon[35807]: pgmap v9962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:19 smithi076 ceph-mon[35401]: pgmap v9962: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:21 smithi040 ceph-mon[32397]: pgmap v9963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:21.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:21 smithi146 ceph-mon[35807]: pgmap v9963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:21 smithi076 ceph-mon[35401]: pgmap v9963: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:22.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14468.371204 secs 2024-07-26T17:34:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14468.371204 secs 2024-07-26T17:34:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14468.371204 secs 2024-07-26T17:34:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:23 smithi040 ceph-mon[32397]: pgmap v9964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:23 smithi146 ceph-mon[35807]: pgmap v9964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:23 smithi076 ceph-mon[35401]: pgmap v9964: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:25 smithi040 ceph-mon[32397]: pgmap v9965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:25 smithi146 ceph-mon[35807]: pgmap v9965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:25 smithi076 ceph-mon[35401]: pgmap v9965: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:27 smithi040 ceph-mon[32397]: pgmap v9966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14473.371330 secs 2024-07-26T17:34:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:27 smithi146 ceph-mon[35807]: pgmap v9966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14473.371330 secs 2024-07-26T17:34:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:27 smithi076 ceph-mon[35401]: pgmap v9966: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14473.371330 secs 2024-07-26T17:34:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:29 smithi040 ceph-mon[32397]: pgmap v9967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:29 smithi146 ceph-mon[35807]: pgmap v9967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:29 smithi076 ceph-mon[35401]: pgmap v9967: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:31 smithi040 ceph-mon[32397]: pgmap v9968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:31 smithi146 ceph-mon[35807]: pgmap v9968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:31 smithi076 ceph-mon[35401]: pgmap v9968: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:32.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14478.371487 secs 2024-07-26T17:34:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14478.371487 secs 2024-07-26T17:34:32.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14478.371487 secs 2024-07-26T17:34:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:33 smithi146 ceph-mon[35807]: pgmap v9969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:33 smithi076 ceph-mon[35401]: pgmap v9969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:33 smithi040 ceph-mon[32397]: pgmap v9969: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:35 smithi146 ceph-mon[35807]: pgmap v9970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:35 smithi076 ceph-mon[35401]: pgmap v9970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:35 smithi040 ceph-mon[32397]: pgmap v9970: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:37 smithi146 ceph-mon[35807]: pgmap v9971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:34:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14483.371603 secs 2024-07-26T17:34:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:37 smithi076 ceph-mon[35401]: pgmap v9971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:34:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14483.371603 secs 2024-07-26T17:34:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:37 smithi040 ceph-mon[32397]: pgmap v9971: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:34:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14483.371603 secs 2024-07-26T17:34:39.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:39 smithi040 ceph-mon[32397]: pgmap v9972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:39 smithi146 ceph-mon[35807]: pgmap v9972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:39 smithi076 ceph-mon[35401]: pgmap v9972: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:41 smithi146 ceph-mon[35807]: pgmap v9973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:41 smithi076 ceph-mon[35401]: pgmap v9973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:41 smithi040 ceph-mon[32397]: pgmap v9973: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14488.371704 secs 2024-07-26T17:34:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14488.371704 secs 2024-07-26T17:34:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14488.371704 secs 2024-07-26T17:34:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:43 smithi146 ceph-mon[35807]: pgmap v9974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:43 smithi076 ceph-mon[35401]: pgmap v9974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:43 smithi040 ceph-mon[32397]: pgmap v9974: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:45 smithi146 ceph-mon[35807]: pgmap v9975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:45 smithi076 ceph-mon[35401]: pgmap v9975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:45 smithi040 ceph-mon[32397]: pgmap v9975: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:34:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:47 smithi146 ceph-mon[35807]: pgmap v9976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:34:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14493.371843 secs 2024-07-26T17:34:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:47 smithi076 ceph-mon[35401]: pgmap v9976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:34:47.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14493.371843 secs 2024-07-26T17:34:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:47 smithi040 ceph-mon[32397]: pgmap v9976: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:34:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14493.371843 secs 2024-07-26T17:34:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:49 smithi076 ceph-mon[35401]: pgmap v9977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:49 smithi040 ceph-mon[32397]: pgmap v9977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:49 smithi146 ceph-mon[35807]: pgmap v9977: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:51 smithi076 ceph-mon[35401]: pgmap v9978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:51 smithi040 ceph-mon[32397]: pgmap v9978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:51 smithi146 ceph-mon[35807]: pgmap v9978: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:52.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14498.371941 secs 2024-07-26T17:34:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14498.371941 secs 2024-07-26T17:34:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14498.371941 secs 2024-07-26T17:34:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:53 smithi040 ceph-mon[32397]: pgmap v9979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:53 smithi146 ceph-mon[35807]: pgmap v9979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:53 smithi076 ceph-mon[35401]: pgmap v9979: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:34:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:55 smithi040 ceph-mon[32397]: pgmap v9980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:56.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:55 smithi146 ceph-mon[35807]: pgmap v9980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:55 smithi076 ceph-mon[35401]: pgmap v9980: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:34:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:57 smithi040 ceph-mon[32397]: pgmap v9981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14503.372068 secs 2024-07-26T17:34:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:57 smithi146 ceph-mon[35807]: pgmap v9981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14503.372068 secs 2024-07-26T17:34:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:57 smithi076 ceph-mon[35401]: pgmap v9981: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:34:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14503.372068 secs 2024-07-26T17:34:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:34:59 smithi040 ceph-mon[32397]: pgmap v9982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:34:59 smithi146 ceph-mon[35807]: pgmap v9982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:34:59 smithi076 ceph-mon[35401]: pgmap v9982: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:01.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:01 smithi040 ceph-mon[32397]: pgmap v9983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:01 smithi146 ceph-mon[35807]: pgmap v9983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:01 smithi076 ceph-mon[35401]: pgmap v9983: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:02.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14508.372187 secs 2024-07-26T17:35:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14508.372187 secs 2024-07-26T17:35:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14508.372187 secs 2024-07-26T17:35:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:03 smithi040 ceph-mon[32397]: pgmap v9984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:03 smithi146 ceph-mon[35807]: pgmap v9984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:03 smithi076 ceph-mon[35401]: pgmap v9984: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:05 smithi040 ceph-mon[32397]: pgmap v9985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:06.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:05 smithi146 ceph-mon[35807]: pgmap v9985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:05 smithi076 ceph-mon[35401]: pgmap v9985: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:06 smithi040 ceph-mon[32397]: pgmap v9986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:06 smithi146 ceph-mon[35807]: pgmap v9986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:06 smithi076 ceph-mon[35401]: pgmap v9986: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:07.972 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14513.372326 secs 2024-07-26T17:35:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14513.372326 secs 2024-07-26T17:35:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14513.372326 secs 2024-07-26T17:35:08.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:08 smithi040 ceph-mon[32397]: pgmap v9987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:09.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:08 smithi146 ceph-mon[35807]: pgmap v9987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:08 smithi076 ceph-mon[35401]: pgmap v9987: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:11.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:10 smithi146 ceph-mon[35807]: pgmap v9988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:10 smithi076 ceph-mon[35401]: pgmap v9988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:10 smithi040 ceph-mon[32397]: pgmap v9988: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:12.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14518.372470 secs 2024-07-26T17:35:12.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14518.372470 secs 2024-07-26T17:35:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14518.372470 secs 2024-07-26T17:35:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:13 smithi040 ceph-mon[32397]: pgmap v9989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:13 smithi146 ceph-mon[35807]: pgmap v9989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:13 smithi076 ceph-mon[35401]: pgmap v9989: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:15 smithi040 ceph-mon[32397]: pgmap v9990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:15 smithi146 ceph-mon[35807]: pgmap v9990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:15 smithi076 ceph-mon[35401]: pgmap v9990: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:17 smithi040 ceph-mon[32397]: pgmap v9991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:35:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:17 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14523.372607 secs 2024-07-26T17:35:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:17 smithi146 ceph-mon[35807]: pgmap v9991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:35:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:17 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14523.372607 secs 2024-07-26T17:35:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:17 smithi076 ceph-mon[35401]: pgmap v9991: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:35:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:17 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14523.372607 secs 2024-07-26T17:35:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:19 smithi040 ceph-mon[32397]: pgmap v9992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:19 smithi146 ceph-mon[35807]: pgmap v9992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:19 smithi076 ceph-mon[35401]: pgmap v9992: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:21 smithi040 ceph-mon[32397]: pgmap v9993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:21 smithi146 ceph-mon[35807]: pgmap v9993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:21 smithi076 ceph-mon[35401]: pgmap v9993: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:22.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:22 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14528.372750 secs 2024-07-26T17:35:22.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:22 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14528.372750 secs 2024-07-26T17:35:22.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:22 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14528.372750 secs 2024-07-26T17:35:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:23 smithi040 ceph-mon[32397]: pgmap v9994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:23.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:23 smithi146 ceph-mon[35807]: pgmap v9994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:23 smithi076 ceph-mon[35401]: pgmap v9994: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:25 smithi040 ceph-mon[32397]: pgmap v9995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:25 smithi146 ceph-mon[35807]: pgmap v9995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:25 smithi076 ceph-mon[35401]: pgmap v9995: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:27 smithi040 ceph-mon[32397]: pgmap v9996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:27 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14533.372887 secs 2024-07-26T17:35:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:27 smithi146 ceph-mon[35807]: pgmap v9996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:27 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14533.372887 secs 2024-07-26T17:35:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:27 smithi076 ceph-mon[35401]: pgmap v9996: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:27 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14533.372887 secs 2024-07-26T17:35:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:29 smithi040 ceph-mon[32397]: pgmap v9997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:29 smithi146 ceph-mon[35807]: pgmap v9997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:29 smithi076 ceph-mon[35401]: pgmap v9997: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:31 smithi040 ceph-mon[32397]: pgmap v9998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:31 smithi146 ceph-mon[35807]: pgmap v9998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:31 smithi076 ceph-mon[35401]: pgmap v9998: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:32.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:32 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14538.373054 secs 2024-07-26T17:35:32.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:32 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14538.373054 secs 2024-07-26T17:35:32.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:32 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14538.373054 secs 2024-07-26T17:35:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:33 smithi040 ceph-mon[32397]: pgmap v9999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:33 smithi146 ceph-mon[35807]: pgmap v9999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:33 smithi076 ceph-mon[35401]: pgmap v9999: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:35 smithi040 ceph-mon[32397]: pgmap v10000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:35 smithi146 ceph-mon[35807]: pgmap v10000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:35 smithi076 ceph-mon[35401]: pgmap v10000: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:37 smithi040 ceph-mon[32397]: pgmap v10001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:37 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14543.373192 secs 2024-07-26T17:35:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:37 smithi146 ceph-mon[35807]: pgmap v10001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:37 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14543.373192 secs 2024-07-26T17:35:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:37 smithi076 ceph-mon[35401]: pgmap v10001: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:37 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14543.373192 secs 2024-07-26T17:35:39.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:39 smithi146 ceph-mon[35807]: pgmap v10002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:39 smithi076 ceph-mon[35401]: pgmap v10002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:39.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:39 smithi040 ceph-mon[32397]: pgmap v10002: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:41.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:41 smithi040 ceph-mon[32397]: pgmap v10003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:41.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:41 smithi146 ceph-mon[35807]: pgmap v10003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:41 smithi076 ceph-mon[35401]: pgmap v10003: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:42.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:42 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14548.373313 secs 2024-07-26T17:35:42.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:42 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14548.373313 secs 2024-07-26T17:35:42.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:42 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14548.373313 secs 2024-07-26T17:35:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:43 smithi146 ceph-mon[35807]: pgmap v10004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:43 smithi076 ceph-mon[35401]: pgmap v10004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:43 smithi040 ceph-mon[32397]: pgmap v10004: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:45 smithi146 ceph-mon[35807]: pgmap v10005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:45 smithi076 ceph-mon[35401]: pgmap v10005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:45 smithi040 ceph-mon[32397]: pgmap v10005: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:47 smithi146 ceph-mon[35807]: pgmap v10006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:47.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:47 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14553.373446 secs 2024-07-26T17:35:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:47 smithi076 ceph-mon[35401]: pgmap v10006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:47 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14553.373446 secs 2024-07-26T17:35:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:47 smithi040 ceph-mon[32397]: pgmap v10006: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:47 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14553.373446 secs 2024-07-26T17:35:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:49 smithi146 ceph-mon[35807]: pgmap v10007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:49 smithi076 ceph-mon[35401]: pgmap v10007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:49 smithi040 ceph-mon[32397]: pgmap v10007: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:51 smithi146 ceph-mon[35807]: pgmap v10008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:51 smithi076 ceph-mon[35401]: pgmap v10008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:51 smithi040 ceph-mon[32397]: pgmap v10008: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:52.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:52 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14558.373588 secs 2024-07-26T17:35:52.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:52 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14558.373588 secs 2024-07-26T17:35:52.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:52 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14558.373588 secs 2024-07-26T17:35:53.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:53 smithi146 ceph-mon[35807]: pgmap v10009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:53 smithi076 ceph-mon[35401]: pgmap v10009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:53 smithi040 ceph-mon[32397]: pgmap v10009: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:55 smithi146 ceph-mon[35807]: pgmap v10010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:55 smithi076 ceph-mon[35401]: pgmap v10010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:55 smithi040 ceph-mon[32397]: pgmap v10010: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:35:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:57 smithi146 ceph-mon[35807]: pgmap v10011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:57 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14563.373724 secs 2024-07-26T17:35:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:57 smithi076 ceph-mon[35401]: pgmap v10011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:57 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14563.373724 secs 2024-07-26T17:35:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:57 smithi040 ceph-mon[32397]: pgmap v10011: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:35:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:57 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14563.373724 secs 2024-07-26T17:35:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:35:59 smithi076 ceph-mon[35401]: pgmap v10012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:35:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:35:59 smithi040 ceph-mon[32397]: pgmap v10012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:35:59 smithi146 ceph-mon[35807]: pgmap v10012: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:01 smithi076 ceph-mon[35401]: pgmap v10013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:01.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:01 smithi040 ceph-mon[32397]: pgmap v10013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:01 smithi146 ceph-mon[35807]: pgmap v10013: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:02.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:02 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14568.373882 secs 2024-07-26T17:36:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:02 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14568.373882 secs 2024-07-26T17:36:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:02 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14568.373882 secs 2024-07-26T17:36:03.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:03 smithi040 ceph-mon[32397]: pgmap v10014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:03 smithi146 ceph-mon[35807]: pgmap v10014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:03 smithi076 ceph-mon[35401]: pgmap v10014: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:05 smithi040 ceph-mon[32397]: pgmap v10015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:05 smithi146 ceph-mon[35807]: pgmap v10015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:05 smithi076 ceph-mon[35401]: pgmap v10015: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:07.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:07 smithi146 ceph-mon[35807]: pgmap v10016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:07.874 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:07 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14573.374039 secs 2024-07-26T17:36:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:07 smithi040 ceph-mon[32397]: pgmap v10016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:07 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14573.374039 secs 2024-07-26T17:36:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:07 smithi076 ceph-mon[35401]: pgmap v10016: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:07 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14573.374039 secs 2024-07-26T17:36:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:09 smithi040 ceph-mon[32397]: pgmap v10017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:09 smithi146 ceph-mon[35807]: pgmap v10017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:10.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:09 smithi076 ceph-mon[35401]: pgmap v10017: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:11 smithi040 ceph-mon[32397]: pgmap v10018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:11 smithi146 ceph-mon[35807]: pgmap v10018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:11 smithi076 ceph-mon[35401]: pgmap v10018: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:12 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14578.374175 secs 2024-07-26T17:36:12.985 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:12 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14578.374175 secs 2024-07-26T17:36:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:12 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14578.374175 secs 2024-07-26T17:36:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:13 smithi040 ceph-mon[32397]: pgmap v10019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:14.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:13 smithi146 ceph-mon[35807]: pgmap v10019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:13 smithi076 ceph-mon[35401]: pgmap v10019: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:15 smithi040 ceph-mon[32397]: pgmap v10020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:15 smithi146 ceph-mon[35807]: pgmap v10020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:15 smithi076 ceph-mon[35401]: pgmap v10020: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14583.374310 secs 2024-07-26T17:36:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14583.374310 secs 2024-07-26T17:36:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14583.374310 secs 2024-07-26T17:36:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:17 smithi040 ceph-mon[32397]: pgmap v10021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:17 smithi146 ceph-mon[35807]: pgmap v10021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:17 smithi076 ceph-mon[35401]: pgmap v10021: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:18.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:18 smithi040 ceph-mon[32397]: pgmap v10022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:18 smithi146 ceph-mon[35807]: pgmap v10022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:18 smithi076 ceph-mon[35401]: pgmap v10022: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:20 smithi146 ceph-mon[35807]: pgmap v10023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14588.374458 secs 2024-07-26T17:36:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:20 smithi076 ceph-mon[35401]: pgmap v10023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14588.374458 secs 2024-07-26T17:36:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:20 smithi040 ceph-mon[32397]: pgmap v10023: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14588.374458 secs 2024-07-26T17:36:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:22 smithi146 ceph-mon[35807]: pgmap v10024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:22 smithi076 ceph-mon[35401]: pgmap v10024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:22 smithi040 ceph-mon[32397]: pgmap v10024: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:24 smithi076 ceph-mon[35401]: pgmap v10025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:24 smithi040 ceph-mon[32397]: pgmap v10025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:24 smithi146 ceph-mon[35807]: pgmap v10025: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:26.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14593.374587 secs 2024-07-26T17:36:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14593.374587 secs 2024-07-26T17:36:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14593.374587 secs 2024-07-26T17:36:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:26 smithi040 ceph-mon[32397]: pgmap v10026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:26 smithi146 ceph-mon[35807]: pgmap v10026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:26 smithi076 ceph-mon[35401]: pgmap v10026: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:28 smithi040 ceph-mon[32397]: pgmap v10027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:28 smithi146 ceph-mon[35807]: pgmap v10027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:29.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:28 smithi076 ceph-mon[35401]: pgmap v10027: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:30 smithi040 ceph-mon[32397]: pgmap v10028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14598.374731 secs 2024-07-26T17:36:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:30 smithi146 ceph-mon[35807]: pgmap v10028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14598.374731 secs 2024-07-26T17:36:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:30 smithi076 ceph-mon[35401]: pgmap v10028: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14598.374731 secs 2024-07-26T17:36:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:32 smithi040 ceph-mon[32397]: pgmap v10029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:32 smithi146 ceph-mon[35807]: pgmap v10029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:32 smithi076 ceph-mon[35401]: pgmap v10029: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:34 smithi040 ceph-mon[32397]: pgmap v10030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:34 smithi146 ceph-mon[35807]: pgmap v10030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:34 smithi076 ceph-mon[35401]: pgmap v10030: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:35 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14603.374876 secs 2024-07-26T17:36:36.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:35 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14603.374876 secs 2024-07-26T17:36:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:35 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14603.374876 secs 2024-07-26T17:36:37.222 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:36 smithi146 ceph-mon[35807]: pgmap v10031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:36 smithi040 ceph-mon[32397]: pgmap v10031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:37.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:36 smithi076 ceph-mon[35401]: pgmap v10031: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:38 smithi040 ceph-mon[32397]: pgmap v10032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:39.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:38 smithi146 ceph-mon[35807]: pgmap v10032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:38 smithi076 ceph-mon[35401]: pgmap v10032: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:40 smithi040 ceph-mon[32397]: pgmap v10033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:41.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:40 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14608.375024 secs 2024-07-26T17:36:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:40 smithi146 ceph-mon[35807]: pgmap v10033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:40 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14608.375024 secs 2024-07-26T17:36:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:40 smithi076 ceph-mon[35401]: pgmap v10033: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:40 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14608.375024 secs 2024-07-26T17:36:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:42 smithi040 ceph-mon[32397]: pgmap v10034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:42 smithi146 ceph-mon[35807]: pgmap v10034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:42 smithi076 ceph-mon[35401]: pgmap v10034: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:44 smithi040 ceph-mon[32397]: pgmap v10035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:44 smithi146 ceph-mon[35807]: pgmap v10035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:44 smithi076 ceph-mon[35401]: pgmap v10035: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:45 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14613.375159 secs 2024-07-26T17:36:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:45 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14613.375159 secs 2024-07-26T17:36:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:45 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14613.375159 secs 2024-07-26T17:36:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:46 smithi040 ceph-mon[32397]: pgmap v10036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:46 smithi146 ceph-mon[35807]: pgmap v10036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:46 smithi076 ceph-mon[35401]: pgmap v10036: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:48 smithi040 ceph-mon[32397]: pgmap v10037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:48 smithi146 ceph-mon[35807]: pgmap v10037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:48 smithi076 ceph-mon[35401]: pgmap v10037: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:50 smithi040 ceph-mon[32397]: pgmap v10038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:50 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14618.375301 secs 2024-07-26T17:36:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:50 smithi146 ceph-mon[35807]: pgmap v10038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:50 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14618.375301 secs 2024-07-26T17:36:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:50 smithi076 ceph-mon[35401]: pgmap v10038: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:50 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14618.375301 secs 2024-07-26T17:36:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:52 smithi040 ceph-mon[32397]: pgmap v10039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:53.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:52 smithi146 ceph-mon[35807]: pgmap v10039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:52 smithi076 ceph-mon[35401]: pgmap v10039: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:54 smithi040 ceph-mon[32397]: pgmap v10040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:54 smithi146 ceph-mon[35807]: pgmap v10040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:54 smithi076 ceph-mon[35401]: pgmap v10040: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:36:56.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:55 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14623.375440 secs 2024-07-26T17:36:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:55 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14623.375440 secs 2024-07-26T17:36:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:55 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14623.375440 secs 2024-07-26T17:36:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:56 smithi040 ceph-mon[32397]: pgmap v10041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:56 smithi146 ceph-mon[35807]: pgmap v10041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:56 smithi076 ceph-mon[35401]: pgmap v10041: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:36:59.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:36:58 smithi146 ceph-mon[35807]: pgmap v10042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:36:58 smithi076 ceph-mon[35401]: pgmap v10042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:36:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:36:58 smithi040 ceph-mon[32397]: pgmap v10042: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:00 smithi146 ceph-mon[35807]: pgmap v10043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:01.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:00 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14628.375588 secs 2024-07-26T17:37:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:00 smithi076 ceph-mon[35401]: pgmap v10043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:00 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14628.375588 secs 2024-07-26T17:37:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:00 smithi040 ceph-mon[32397]: pgmap v10043: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:00 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14628.375588 secs 2024-07-26T17:37:03.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:03 smithi146 ceph-mon[35807]: pgmap v10044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:03 smithi076 ceph-mon[35401]: pgmap v10044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:02 smithi040 ceph-mon[32397]: pgmap v10044: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:05 smithi146 ceph-mon[35807]: pgmap v10045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:05 smithi076 ceph-mon[35401]: pgmap v10045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:05 smithi040 ceph-mon[32397]: pgmap v10045: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14633.375743 secs 2024-07-26T17:37:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14633.375743 secs 2024-07-26T17:37:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14633.375743 secs 2024-07-26T17:37:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:07 smithi040 ceph-mon[32397]: pgmap v10046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:07 smithi146 ceph-mon[35807]: pgmap v10046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:07 smithi076 ceph-mon[35401]: pgmap v10046: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:09 smithi040 ceph-mon[32397]: pgmap v10047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:09 smithi146 ceph-mon[35807]: pgmap v10047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:09 smithi076 ceph-mon[35401]: pgmap v10047: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:11 smithi040 ceph-mon[32397]: pgmap v10048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14638.375893 secs 2024-07-26T17:37:11.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:11 smithi146 ceph-mon[35807]: pgmap v10048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14638.375893 secs 2024-07-26T17:37:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:11 smithi076 ceph-mon[35401]: pgmap v10048: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14638.375893 secs 2024-07-26T17:37:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:13 smithi040 ceph-mon[32397]: pgmap v10049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:13 smithi146 ceph-mon[35807]: pgmap v10049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:13 smithi076 ceph-mon[35401]: pgmap v10049: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:15 smithi040 ceph-mon[32397]: pgmap v10050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:15 smithi146 ceph-mon[35807]: pgmap v10050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:15 smithi076 ceph-mon[35401]: pgmap v10050: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14643.376029 secs 2024-07-26T17:37:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14643.376029 secs 2024-07-26T17:37:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14643.376029 secs 2024-07-26T17:37:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:17 smithi040 ceph-mon[32397]: pgmap v10051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:17.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:17 smithi146 ceph-mon[35807]: pgmap v10051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:17 smithi076 ceph-mon[35401]: pgmap v10051: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:19 smithi040 ceph-mon[32397]: pgmap v10052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:19.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:19 smithi146 ceph-mon[35807]: pgmap v10052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:19 smithi076 ceph-mon[35401]: pgmap v10052: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:21 smithi040 ceph-mon[32397]: pgmap v10053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14648.376202 secs 2024-07-26T17:37:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:21 smithi146 ceph-mon[35807]: pgmap v10053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14648.376202 secs 2024-07-26T17:37:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:21 smithi076 ceph-mon[35401]: pgmap v10053: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14648.376202 secs 2024-07-26T17:37:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:23 smithi040 ceph-mon[32397]: pgmap v10054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:23 smithi146 ceph-mon[35807]: pgmap v10054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:23 smithi076 ceph-mon[35401]: pgmap v10054: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:25 smithi146 ceph-mon[35807]: pgmap v10055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:25 smithi076 ceph-mon[35401]: pgmap v10055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:25 smithi040 ceph-mon[32397]: pgmap v10055: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14653.376364 secs 2024-07-26T17:37:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14653.376364 secs 2024-07-26T17:37:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14653.376364 secs 2024-07-26T17:37:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:27 smithi146 ceph-mon[35807]: pgmap v10056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:27 smithi076 ceph-mon[35401]: pgmap v10056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:27 smithi040 ceph-mon[32397]: pgmap v10056: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:29.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:29 smithi146 ceph-mon[35807]: pgmap v10057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:29 smithi076 ceph-mon[35401]: pgmap v10057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:29 smithi040 ceph-mon[32397]: pgmap v10057: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:31 smithi146 ceph-mon[35807]: pgmap v10058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14658.376503 secs 2024-07-26T17:37:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:31 smithi076 ceph-mon[35401]: pgmap v10058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14658.376503 secs 2024-07-26T17:37:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:31 smithi040 ceph-mon[32397]: pgmap v10058: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14658.376503 secs 2024-07-26T17:37:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:33 smithi146 ceph-mon[35807]: pgmap v10059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:33 smithi076 ceph-mon[35401]: pgmap v10059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:33 smithi040 ceph-mon[32397]: pgmap v10059: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:35.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:35 smithi146 ceph-mon[35807]: pgmap v10060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:35 smithi076 ceph-mon[35401]: pgmap v10060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:35 smithi040 ceph-mon[32397]: pgmap v10060: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14663.376641 secs 2024-07-26T17:37:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14663.376641 secs 2024-07-26T17:37:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14663.376641 secs 2024-07-26T17:37:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:37 smithi146 ceph-mon[35807]: pgmap v10061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:37 smithi076 ceph-mon[35401]: pgmap v10061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:37 smithi040 ceph-mon[32397]: pgmap v10061: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:39 smithi146 ceph-mon[35807]: pgmap v10062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:39 smithi076 ceph-mon[35401]: pgmap v10062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:39 smithi040 ceph-mon[32397]: pgmap v10062: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:41 smithi146 ceph-mon[35807]: pgmap v10063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14668.376782 secs 2024-07-26T17:37:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:41 smithi076 ceph-mon[35401]: pgmap v10063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14668.376782 secs 2024-07-26T17:37:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:41 smithi040 ceph-mon[32397]: pgmap v10063: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14668.376782 secs 2024-07-26T17:37:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:43 smithi146 ceph-mon[35807]: pgmap v10064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:43 smithi076 ceph-mon[35401]: pgmap v10064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:43 smithi040 ceph-mon[32397]: pgmap v10064: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:45 smithi076 ceph-mon[35401]: pgmap v10065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:45 smithi040 ceph-mon[32397]: pgmap v10065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:45 smithi146 ceph-mon[35807]: pgmap v10065: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14673.376940 secs 2024-07-26T17:37:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14673.376940 secs 2024-07-26T17:37:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14673.376940 secs 2024-07-26T17:37:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:47 smithi040 ceph-mon[32397]: pgmap v10066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:47 smithi146 ceph-mon[35807]: pgmap v10066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:47 smithi076 ceph-mon[35401]: pgmap v10066: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:49 smithi040 ceph-mon[32397]: pgmap v10067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:49 smithi146 ceph-mon[35807]: pgmap v10067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:49 smithi076 ceph-mon[35401]: pgmap v10067: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:51 smithi040 ceph-mon[32397]: pgmap v10068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14678.377099 secs 2024-07-26T17:37:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:51 smithi146 ceph-mon[35807]: pgmap v10068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14678.377099 secs 2024-07-26T17:37:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:51 smithi076 ceph-mon[35401]: pgmap v10068: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14678.377099 secs 2024-07-26T17:37:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:53 smithi040 ceph-mon[32397]: pgmap v10069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:53 smithi146 ceph-mon[35807]: pgmap v10069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:53 smithi076 ceph-mon[35401]: pgmap v10069: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:37:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:55 smithi040 ceph-mon[32397]: pgmap v10070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:55 smithi146 ceph-mon[35807]: pgmap v10070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:55 smithi076 ceph-mon[35401]: pgmap v10070: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:37:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14683.377240 secs 2024-07-26T17:37:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14683.377240 secs 2024-07-26T17:37:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14683.377240 secs 2024-07-26T17:37:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:57 smithi040 ceph-mon[32397]: pgmap v10071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:58.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:57 smithi146 ceph-mon[35807]: pgmap v10071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:57 smithi076 ceph-mon[35401]: pgmap v10071: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:37:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:37:59 smithi040 ceph-mon[32397]: pgmap v10072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:00.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:37:59 smithi146 ceph-mon[35807]: pgmap v10072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:37:59 smithi076 ceph-mon[35401]: pgmap v10072: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:01 smithi040 ceph-mon[32397]: pgmap v10073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14688.377341 secs 2024-07-26T17:38:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:01 smithi146 ceph-mon[35807]: pgmap v10073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14688.377341 secs 2024-07-26T17:38:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:01 smithi076 ceph-mon[35401]: pgmap v10073: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14688.377341 secs 2024-07-26T17:38:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:03 smithi040 ceph-mon[32397]: pgmap v10074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:03 smithi146 ceph-mon[35807]: pgmap v10074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:03 smithi076 ceph-mon[35401]: pgmap v10074: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:05 smithi040 ceph-mon[32397]: pgmap v10075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:05 smithi146 ceph-mon[35807]: pgmap v10075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:05 smithi076 ceph-mon[35401]: pgmap v10075: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14693.377485 secs 2024-07-26T17:38:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14693.377485 secs 2024-07-26T17:38:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14693.377485 secs 2024-07-26T17:38:07.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:07 smithi146 ceph-mon[35807]: pgmap v10076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:07.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:07 smithi040 ceph-mon[32397]: pgmap v10076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:07 smithi076 ceph-mon[35401]: pgmap v10076: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:09 smithi040 ceph-mon[32397]: pgmap v10077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:10.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:09 smithi146 ceph-mon[35807]: pgmap v10077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:09 smithi076 ceph-mon[35401]: pgmap v10077: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:11.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:10 smithi146 ceph-mon[35807]: pgmap v10078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:10 smithi076 ceph-mon[35401]: pgmap v10078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:10 smithi040 ceph-mon[32397]: pgmap v10078: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14698.377589 secs 2024-07-26T17:38:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14698.377589 secs 2024-07-26T17:38:12.135 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14698.377589 secs 2024-07-26T17:38:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:12 smithi146 ceph-mon[35807]: pgmap v10079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:12 smithi076 ceph-mon[35401]: pgmap v10079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:12 smithi040 ceph-mon[32397]: pgmap v10079: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:14 smithi040 ceph-mon[32397]: pgmap v10080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:14 smithi146 ceph-mon[35807]: pgmap v10080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:15.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:14 smithi076 ceph-mon[35401]: pgmap v10080: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14703.377669 secs 2024-07-26T17:38:16.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14703.377669 secs 2024-07-26T17:38:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14703.377669 secs 2024-07-26T17:38:17.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:16 smithi040 ceph-mon[32397]: pgmap v10081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:17.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:16 smithi146 ceph-mon[35807]: pgmap v10081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:16 smithi076 ceph-mon[35401]: pgmap v10081: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:18 smithi040 ceph-mon[32397]: pgmap v10082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:18 smithi146 ceph-mon[35807]: pgmap v10082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:18 smithi076 ceph-mon[35401]: pgmap v10082: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:20 smithi040 ceph-mon[32397]: pgmap v10083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:20 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14708.377807 secs 2024-07-26T17:38:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:20 smithi146 ceph-mon[35807]: pgmap v10083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:20 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14708.377807 secs 2024-07-26T17:38:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:20 smithi076 ceph-mon[35401]: pgmap v10083: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:20 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14708.377807 secs 2024-07-26T17:38:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:22 smithi040 ceph-mon[32397]: pgmap v10084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:22 smithi146 ceph-mon[35807]: pgmap v10084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:22 smithi076 ceph-mon[35401]: pgmap v10084: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:24 smithi040 ceph-mon[32397]: pgmap v10085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:24 smithi146 ceph-mon[35807]: pgmap v10085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:24 smithi076 ceph-mon[35401]: pgmap v10085: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:25 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14713.377942 secs 2024-07-26T17:38:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:25 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14713.377942 secs 2024-07-26T17:38:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:25 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14713.377942 secs 2024-07-26T17:38:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:26 smithi040 ceph-mon[32397]: pgmap v10086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:26 smithi146 ceph-mon[35807]: pgmap v10086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:26 smithi076 ceph-mon[35401]: pgmap v10086: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:28 smithi040 ceph-mon[32397]: pgmap v10087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:28 smithi146 ceph-mon[35807]: pgmap v10087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:28 smithi076 ceph-mon[35401]: pgmap v10087: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:30 smithi040 ceph-mon[32397]: pgmap v10088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14718.378080 secs 2024-07-26T17:38:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:30 smithi146 ceph-mon[35807]: pgmap v10088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14718.378080 secs 2024-07-26T17:38:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:30 smithi076 ceph-mon[35401]: pgmap v10088: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14718.378080 secs 2024-07-26T17:38:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:32 smithi040 ceph-mon[32397]: pgmap v10089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:32 smithi146 ceph-mon[35807]: pgmap v10089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:32 smithi076 ceph-mon[35401]: pgmap v10089: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:34 smithi146 ceph-mon[35807]: pgmap v10090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:34 smithi076 ceph-mon[35401]: pgmap v10090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:35.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:34 smithi040 ceph-mon[32397]: pgmap v10090: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14723.378173 secs 2024-07-26T17:38:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14723.378173 secs 2024-07-26T17:38:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14723.378173 secs 2024-07-26T17:38:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:37 smithi146 ceph-mon[35807]: pgmap v10091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:37 smithi076 ceph-mon[35401]: pgmap v10091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:37 smithi040 ceph-mon[32397]: pgmap v10091: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:39.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:39 smithi146 ceph-mon[35807]: pgmap v10092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:39 smithi076 ceph-mon[35401]: pgmap v10092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:39.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:39 smithi040 ceph-mon[32397]: pgmap v10092: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:41 smithi146 ceph-mon[35807]: pgmap v10093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:41.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14728.378313 secs 2024-07-26T17:38:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:41 smithi076 ceph-mon[35401]: pgmap v10093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14728.378313 secs 2024-07-26T17:38:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:41 smithi040 ceph-mon[32397]: pgmap v10093: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14728.378313 secs 2024-07-26T17:38:43.285 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:43 smithi040 ceph-mon[32397]: pgmap v10094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:43 smithi146 ceph-mon[35807]: pgmap v10094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:43 smithi076 ceph-mon[35401]: pgmap v10094: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:45.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:45 smithi146 ceph-mon[35807]: pgmap v10095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:45.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:45 smithi076 ceph-mon[35401]: pgmap v10095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:45 smithi040 ceph-mon[32397]: pgmap v10095: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14733.378450 secs 2024-07-26T17:38:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14733.378450 secs 2024-07-26T17:38:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14733.378450 secs 2024-07-26T17:38:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:47 smithi146 ceph-mon[35807]: pgmap v10096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:47 smithi076 ceph-mon[35401]: pgmap v10096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:47 smithi040 ceph-mon[32397]: pgmap v10096: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:49 smithi146 ceph-mon[35807]: pgmap v10097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:49.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:49 smithi076 ceph-mon[35401]: pgmap v10097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:49 smithi040 ceph-mon[32397]: pgmap v10097: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:51 smithi146 ceph-mon[35807]: pgmap v10098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:51.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14738.378590 secs 2024-07-26T17:38:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:51 smithi076 ceph-mon[35401]: pgmap v10098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14738.378590 secs 2024-07-26T17:38:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:51 smithi040 ceph-mon[32397]: pgmap v10098: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14738.378590 secs 2024-07-26T17:38:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:53 smithi076 ceph-mon[35401]: pgmap v10099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:53 smithi040 ceph-mon[32397]: pgmap v10099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:53.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:53 smithi146 ceph-mon[35807]: pgmap v10099: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:55 smithi076 ceph-mon[35401]: pgmap v10100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:55 smithi040 ceph-mon[32397]: pgmap v10100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:55 smithi146 ceph-mon[35807]: pgmap v10100: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:38:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14743.378733 secs 2024-07-26T17:38:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14743.378733 secs 2024-07-26T17:38:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14743.378733 secs 2024-07-26T17:38:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:57 smithi040 ceph-mon[32397]: pgmap v10101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:57 smithi146 ceph-mon[35807]: pgmap v10101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:57 smithi076 ceph-mon[35401]: pgmap v10101: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:38:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:38:59 smithi040 ceph-mon[32397]: pgmap v10102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:38:59 smithi146 ceph-mon[35807]: pgmap v10102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:38:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:38:59 smithi076 ceph-mon[35401]: pgmap v10102: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:01 smithi040 ceph-mon[32397]: pgmap v10103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14748.378873 secs 2024-07-26T17:39:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:01 smithi146 ceph-mon[35807]: pgmap v10103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14748.378873 secs 2024-07-26T17:39:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:01 smithi076 ceph-mon[35401]: pgmap v10103: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14748.378873 secs 2024-07-26T17:39:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:03 smithi040 ceph-mon[32397]: pgmap v10104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:03 smithi146 ceph-mon[35807]: pgmap v10104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:03 smithi076 ceph-mon[35401]: pgmap v10104: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:05 smithi040 ceph-mon[32397]: pgmap v10105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:05 smithi146 ceph-mon[35807]: pgmap v10105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:05 smithi076 ceph-mon[35401]: pgmap v10105: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14753.378995 secs 2024-07-26T17:39:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14753.378995 secs 2024-07-26T17:39:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14753.378995 secs 2024-07-26T17:39:07.473 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:07 smithi146 ceph-mon[35807]: pgmap v10106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:07.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:07 smithi040 ceph-mon[32397]: pgmap v10106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:07 smithi076 ceph-mon[35401]: pgmap v10106: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:09 smithi040 ceph-mon[32397]: pgmap v10107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:09 smithi146 ceph-mon[35807]: pgmap v10107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:09 smithi076 ceph-mon[35401]: pgmap v10107: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:11 smithi040 ceph-mon[32397]: pgmap v10108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14758.379132 secs 2024-07-26T17:39:11.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:11 smithi146 ceph-mon[35807]: pgmap v10108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14758.379132 secs 2024-07-26T17:39:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:11 smithi076 ceph-mon[35401]: pgmap v10108: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14758.379132 secs 2024-07-26T17:39:13.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:13 smithi040 ceph-mon[32397]: pgmap v10109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:13.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:13 smithi146 ceph-mon[35807]: pgmap v10109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:13 smithi076 ceph-mon[35401]: pgmap v10109: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:15 smithi146 ceph-mon[35807]: pgmap v10110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:15 smithi076 ceph-mon[35401]: pgmap v10110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:15 smithi040 ceph-mon[32397]: pgmap v10110: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:16.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14763.379311 secs 2024-07-26T17:39:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14763.379311 secs 2024-07-26T17:39:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14763.379311 secs 2024-07-26T17:39:17.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:17 smithi146 ceph-mon[35807]: pgmap v10111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:17 smithi076 ceph-mon[35401]: pgmap v10111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:17 smithi040 ceph-mon[32397]: pgmap v10111: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:19.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:19 smithi146 ceph-mon[35807]: pgmap v10112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:19 smithi076 ceph-mon[35401]: pgmap v10112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:19 smithi040 ceph-mon[32397]: pgmap v10112: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:21 smithi146 ceph-mon[35807]: pgmap v10113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14768.379454 secs 2024-07-26T17:39:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:21 smithi076 ceph-mon[35401]: pgmap v10113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:21.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14768.379454 secs 2024-07-26T17:39:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:21 smithi040 ceph-mon[32397]: pgmap v10113: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14768.379454 secs 2024-07-26T17:39:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:23 smithi146 ceph-mon[35807]: pgmap v10114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:23.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:23 smithi076 ceph-mon[35401]: pgmap v10114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:23 smithi040 ceph-mon[32397]: pgmap v10114: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:25.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:25 smithi146 ceph-mon[35807]: pgmap v10115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:25 smithi076 ceph-mon[35401]: pgmap v10115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:25 smithi040 ceph-mon[32397]: pgmap v10115: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14773.379584 secs 2024-07-26T17:39:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14773.379584 secs 2024-07-26T17:39:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14773.379584 secs 2024-07-26T17:39:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:27 smithi146 ceph-mon[35807]: pgmap v10116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:27 smithi076 ceph-mon[35401]: pgmap v10116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:27.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:27 smithi040 ceph-mon[32397]: pgmap v10116: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:29 smithi146 ceph-mon[35807]: pgmap v10117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:29 smithi076 ceph-mon[35401]: pgmap v10117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:29 smithi040 ceph-mon[32397]: pgmap v10117: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:31 smithi146 ceph-mon[35807]: pgmap v10118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14778.379726 secs 2024-07-26T17:39:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:31 smithi076 ceph-mon[35401]: pgmap v10118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:31.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14778.379726 secs 2024-07-26T17:39:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:31 smithi040 ceph-mon[32397]: pgmap v10118: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14778.379726 secs 2024-07-26T17:39:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:33 smithi146 ceph-mon[35807]: pgmap v10119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:33 smithi076 ceph-mon[35401]: pgmap v10119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:33 smithi040 ceph-mon[32397]: pgmap v10119: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:35.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:35 smithi076 ceph-mon[35401]: pgmap v10120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:35 smithi040 ceph-mon[32397]: pgmap v10120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:35 smithi146 ceph-mon[35807]: pgmap v10120: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14783.379861 secs 2024-07-26T17:39:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14783.379861 secs 2024-07-26T17:39:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14783.379861 secs 2024-07-26T17:39:37.973 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:37 smithi146 ceph-mon[35807]: pgmap v10121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:37 smithi040 ceph-mon[32397]: pgmap v10121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:37 smithi076 ceph-mon[35401]: pgmap v10121: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:39 smithi040 ceph-mon[32397]: pgmap v10122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:40.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:39 smithi146 ceph-mon[35807]: pgmap v10122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:39 smithi076 ceph-mon[35401]: pgmap v10122: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:41 smithi040 ceph-mon[32397]: pgmap v10123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14788.379999 secs 2024-07-26T17:39:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:41 smithi146 ceph-mon[35807]: pgmap v10123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14788.379999 secs 2024-07-26T17:39:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:41 smithi076 ceph-mon[35401]: pgmap v10123: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14788.379999 secs 2024-07-26T17:39:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:43 smithi040 ceph-mon[32397]: pgmap v10124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:43 smithi146 ceph-mon[35807]: pgmap v10124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:43 smithi076 ceph-mon[35401]: pgmap v10124: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:45.886 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:45 smithi076 ceph-mon[35401]: pgmap v10125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:45 smithi040 ceph-mon[32397]: pgmap v10125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:45 smithi146 ceph-mon[35807]: pgmap v10125: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14793.380132 secs 2024-07-26T17:39:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14793.380132 secs 2024-07-26T17:39:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14793.380132 secs 2024-07-26T17:39:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:47 smithi040 ceph-mon[32397]: pgmap v10126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:47 smithi146 ceph-mon[35807]: pgmap v10126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:47 smithi076 ceph-mon[35401]: pgmap v10126: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:49 smithi040 ceph-mon[32397]: pgmap v10127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:49 smithi146 ceph-mon[35807]: pgmap v10127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:49 smithi076 ceph-mon[35401]: pgmap v10127: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:51 smithi040 ceph-mon[32397]: pgmap v10128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14798.380250 secs 2024-07-26T17:39:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:51 smithi146 ceph-mon[35807]: pgmap v10128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14798.380250 secs 2024-07-26T17:39:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:51 smithi076 ceph-mon[35401]: pgmap v10128: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:39:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14798.380250 secs 2024-07-26T17:39:53.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:53 smithi040 ceph-mon[32397]: pgmap v10129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:53 smithi146 ceph-mon[35807]: pgmap v10129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:53 smithi076 ceph-mon[35401]: pgmap v10129: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:39:55.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:55 smithi040 ceph-mon[32397]: pgmap v10130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:55 smithi146 ceph-mon[35807]: pgmap v10130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:55 smithi076 ceph-mon[35401]: pgmap v10130: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:39:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14803.380390 secs 2024-07-26T17:39:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14803.380390 secs 2024-07-26T17:39:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14803.380390 secs 2024-07-26T17:39:57.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:57 smithi040 ceph-mon[32397]: pgmap v10131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:39:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:57 smithi146 ceph-mon[35807]: pgmap v10131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:39:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:57 smithi076 ceph-mon[35401]: pgmap v10131: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:39:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:39:59 smithi040 ceph-mon[32397]: pgmap v10132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:00.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:39:59 smithi146 ceph-mon[35807]: pgmap v10132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:00.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:39:59 smithi076 ceph-mon[35401]: pgmap v10132: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:00.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:40:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:40:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:40:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:01 smithi040 ceph-mon[32397]: pgmap v10133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14808.380523 secs 2024-07-26T17:40:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:01 smithi146 ceph-mon[35807]: pgmap v10133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14808.380523 secs 2024-07-26T17:40:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:01 smithi076 ceph-mon[35401]: pgmap v10133: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14808.380523 secs 2024-07-26T17:40:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:03 smithi040 ceph-mon[32397]: pgmap v10134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:03 smithi146 ceph-mon[35807]: pgmap v10134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:03 smithi076 ceph-mon[35401]: pgmap v10134: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:05 smithi040 ceph-mon[32397]: pgmap v10135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:05 smithi146 ceph-mon[35807]: pgmap v10135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:05 smithi076 ceph-mon[35401]: pgmap v10135: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:40:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14813.380620 secs 2024-07-26T17:40:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:06 smithi040 ceph-mon[32397]: pgmap v10136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:40:07.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14813.380620 secs 2024-07-26T17:40:07.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:06 smithi146 ceph-mon[35807]: pgmap v10136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:40:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14813.380620 secs 2024-07-26T17:40:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:06 smithi076 ceph-mon[35401]: pgmap v10136: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:40:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:08 smithi040 ceph-mon[32397]: pgmap v10137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:09.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:08 smithi146 ceph-mon[35807]: pgmap v10137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:08 smithi076 ceph-mon[35401]: pgmap v10137: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:10 smithi040 ceph-mon[32397]: pgmap v10138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14818.380743 secs 2024-07-26T17:40:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:10 smithi146 ceph-mon[35807]: pgmap v10138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14818.380743 secs 2024-07-26T17:40:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:10 smithi076 ceph-mon[35401]: pgmap v10138: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14818.380743 secs 2024-07-26T17:40:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:12 smithi040 ceph-mon[32397]: pgmap v10139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:12 smithi146 ceph-mon[35807]: pgmap v10139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:12 smithi076 ceph-mon[35401]: pgmap v10139: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:14 smithi076 ceph-mon[35401]: pgmap v10140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:14 smithi040 ceph-mon[32397]: pgmap v10140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:15.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:14 smithi146 ceph-mon[35807]: pgmap v10140: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:15 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14823.380880 secs 2024-07-26T17:40:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:15 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14823.380880 secs 2024-07-26T17:40:16.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:15 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14823.380880 secs 2024-07-26T17:40:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:16 smithi146 ceph-mon[35807]: pgmap v10141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:16 smithi076 ceph-mon[35401]: pgmap v10141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:17.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:16 smithi040 ceph-mon[32397]: pgmap v10141: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:19.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:19 smithi146 ceph-mon[35807]: pgmap v10142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:19 smithi076 ceph-mon[35401]: pgmap v10142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:19.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:19 smithi040 ceph-mon[32397]: pgmap v10142: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:21 smithi146 ceph-mon[35807]: pgmap v10143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:21.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14828.381028 secs 2024-07-26T17:40:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:21 smithi076 ceph-mon[35401]: pgmap v10143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14828.381028 secs 2024-07-26T17:40:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:21 smithi040 ceph-mon[32397]: pgmap v10143: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14828.381028 secs 2024-07-26T17:40:23.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:23 smithi146 ceph-mon[35807]: pgmap v10144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:23 smithi076 ceph-mon[35401]: pgmap v10144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:23.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:23 smithi040 ceph-mon[32397]: pgmap v10144: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:25.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:25 smithi146 ceph-mon[35807]: pgmap v10145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:25 smithi076 ceph-mon[35401]: pgmap v10145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:25.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:25 smithi040 ceph-mon[32397]: pgmap v10145: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14833.381158 secs 2024-07-26T17:40:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14833.381158 secs 2024-07-26T17:40:26.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14833.381158 secs 2024-07-26T17:40:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:27 smithi146 ceph-mon[35807]: pgmap v10146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:27 smithi076 ceph-mon[35401]: pgmap v10146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:27.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:27 smithi040 ceph-mon[32397]: pgmap v10146: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:29 smithi146 ceph-mon[35807]: pgmap v10147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:29 smithi076 ceph-mon[35401]: pgmap v10147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:29.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:29 smithi040 ceph-mon[32397]: pgmap v10147: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:31 smithi146 ceph-mon[35807]: pgmap v10148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14838.381330 secs 2024-07-26T17:40:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:31 smithi076 ceph-mon[35401]: pgmap v10148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14838.381330 secs 2024-07-26T17:40:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:31 smithi040 ceph-mon[32397]: pgmap v10148: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14838.381330 secs 2024-07-26T17:40:33.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:33 smithi146 ceph-mon[35807]: pgmap v10149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:33 smithi076 ceph-mon[35401]: pgmap v10149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:33.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:33 smithi040 ceph-mon[32397]: pgmap v10149: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:35.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:35 smithi146 ceph-mon[35807]: pgmap v10150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:35.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:35 smithi076 ceph-mon[35401]: pgmap v10150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:35.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:35 smithi040 ceph-mon[32397]: pgmap v10150: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14843.381460 secs 2024-07-26T17:40:36.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14843.381460 secs 2024-07-26T17:40:36.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14843.381460 secs 2024-07-26T17:40:37.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:37 smithi040 ceph-mon[32397]: pgmap v10151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:40:37.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:37 smithi146 ceph-mon[35807]: pgmap v10151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:40:37.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:37 smithi076 ceph-mon[35401]: pgmap v10151: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:40:39.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:39 smithi146 ceph-mon[35807]: pgmap v10152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:39.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:39 smithi040 ceph-mon[32397]: pgmap v10152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:39.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:39 smithi076 ceph-mon[35401]: pgmap v10152: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:41 smithi040 ceph-mon[32397]: pgmap v10153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14848.381596 secs 2024-07-26T17:40:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:41 smithi146 ceph-mon[35807]: pgmap v10153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14848.381596 secs 2024-07-26T17:40:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:41 smithi076 ceph-mon[35401]: pgmap v10153: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14848.381596 secs 2024-07-26T17:40:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:43 smithi040 ceph-mon[32397]: pgmap v10154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:43.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:43 smithi146 ceph-mon[35807]: pgmap v10154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:43 smithi076 ceph-mon[35401]: pgmap v10154: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:45.386 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:45 smithi076 ceph-mon[35401]: pgmap v10155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:45 smithi040 ceph-mon[32397]: pgmap v10155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:45 smithi146 ceph-mon[35807]: pgmap v10155: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:46.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14853.381755 secs 2024-07-26T17:40:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14853.381755 secs 2024-07-26T17:40:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14853.381755 secs 2024-07-26T17:40:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:47 smithi040 ceph-mon[32397]: pgmap v10156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:47.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:47 smithi146 ceph-mon[35807]: pgmap v10156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:47 smithi076 ceph-mon[35401]: pgmap v10156: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:49 smithi040 ceph-mon[32397]: pgmap v10157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:49.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:49 smithi146 ceph-mon[35807]: pgmap v10157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:49 smithi076 ceph-mon[35401]: pgmap v10157: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:51 smithi040 ceph-mon[32397]: pgmap v10158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14858.381896 secs 2024-07-26T17:40:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:51 smithi146 ceph-mon[35807]: pgmap v10158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14858.381896 secs 2024-07-26T17:40:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:51 smithi076 ceph-mon[35401]: pgmap v10158: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14858.381896 secs 2024-07-26T17:40:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:53 smithi040 ceph-mon[32397]: pgmap v10159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:53 smithi146 ceph-mon[35807]: pgmap v10159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:53.586 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:53 smithi076 ceph-mon[35401]: pgmap v10159: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:55 smithi040 ceph-mon[32397]: pgmap v10160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:55.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:55 smithi146 ceph-mon[35807]: pgmap v10160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:55 smithi076 ceph-mon[35401]: pgmap v10160: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:40:56.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14863.382038 secs 2024-07-26T17:40:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14863.382038 secs 2024-07-26T17:40:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14863.382038 secs 2024-07-26T17:40:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:57 smithi040 ceph-mon[32397]: pgmap v10161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:57 smithi146 ceph-mon[35807]: pgmap v10161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:57 smithi076 ceph-mon[35401]: pgmap v10161: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:40:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:40:59 smithi040 ceph-mon[32397]: pgmap v10162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:59.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:40:59 smithi146 ceph-mon[35807]: pgmap v10162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:40:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:40:59 smithi076 ceph-mon[35401]: pgmap v10162: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:01 smithi040 ceph-mon[32397]: pgmap v10163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14868.382173 secs 2024-07-26T17:41:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:01 smithi146 ceph-mon[35807]: pgmap v10163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14868.382173 secs 2024-07-26T17:41:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:01 smithi076 ceph-mon[35401]: pgmap v10163: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14868.382173 secs 2024-07-26T17:41:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:03 smithi040 ceph-mon[32397]: pgmap v10164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:03 smithi146 ceph-mon[35807]: pgmap v10164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:03 smithi076 ceph-mon[35401]: pgmap v10164: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:05 smithi040 ceph-mon[32397]: pgmap v10165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:05 smithi146 ceph-mon[35807]: pgmap v10165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:05 smithi076 ceph-mon[35401]: pgmap v10165: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:06.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14873.382347 secs 2024-07-26T17:41:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14873.382347 secs 2024-07-26T17:41:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14873.382347 secs 2024-07-26T17:41:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:07 smithi040 ceph-mon[32397]: pgmap v10166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:07.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:07 smithi146 ceph-mon[35807]: pgmap v10166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:07 smithi076 ceph-mon[35401]: pgmap v10166: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:09 smithi040 ceph-mon[32397]: pgmap v10167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:09 smithi146 ceph-mon[35807]: pgmap v10167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:09 smithi076 ceph-mon[35401]: pgmap v10167: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:11 smithi146 ceph-mon[35807]: pgmap v10168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14878.382483 secs 2024-07-26T17:41:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:11 smithi076 ceph-mon[35401]: pgmap v10168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14878.382483 secs 2024-07-26T17:41:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:11 smithi040 ceph-mon[32397]: pgmap v10168: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14878.382483 secs 2024-07-26T17:41:13.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:13 smithi040 ceph-mon[32397]: pgmap v10169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:13.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:13 smithi146 ceph-mon[35807]: pgmap v10169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:13 smithi076 ceph-mon[35401]: pgmap v10169: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:15 smithi146 ceph-mon[35807]: pgmap v10170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:15 smithi076 ceph-mon[35401]: pgmap v10170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:15 smithi040 ceph-mon[32397]: pgmap v10170: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14883.382562 secs 2024-07-26T17:41:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14883.382562 secs 2024-07-26T17:41:16.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14883.382562 secs 2024-07-26T17:41:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:17 smithi146 ceph-mon[35807]: pgmap v10171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:17 smithi076 ceph-mon[35401]: pgmap v10171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:17.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:17 smithi040 ceph-mon[32397]: pgmap v10171: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:19.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:19 smithi146 ceph-mon[35807]: pgmap v10172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:19 smithi076 ceph-mon[35401]: pgmap v10172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:19.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:19 smithi040 ceph-mon[32397]: pgmap v10172: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:21 smithi146 ceph-mon[35807]: pgmap v10173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:21.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14888.382699 secs 2024-07-26T17:41:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:21 smithi076 ceph-mon[35401]: pgmap v10173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14888.382699 secs 2024-07-26T17:41:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:21 smithi040 ceph-mon[32397]: pgmap v10173: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14888.382699 secs 2024-07-26T17:41:23.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:23 smithi146 ceph-mon[35807]: pgmap v10174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:23 smithi076 ceph-mon[35401]: pgmap v10174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:23 smithi040 ceph-mon[32397]: pgmap v10174: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:25.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:25 smithi146 ceph-mon[35807]: pgmap v10175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:25.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:25 smithi076 ceph-mon[35401]: pgmap v10175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:25 smithi040 ceph-mon[32397]: pgmap v10175: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:26.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14893.382872 secs 2024-07-26T17:41:26.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14893.382872 secs 2024-07-26T17:41:26.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14893.382872 secs 2024-07-26T17:41:27.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:27 smithi146 ceph-mon[35807]: pgmap v10176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:27.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:27 smithi076 ceph-mon[35401]: pgmap v10176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:27 smithi040 ceph-mon[32397]: pgmap v10176: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:29.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:29 smithi146 ceph-mon[35807]: pgmap v10177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:29.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:29 smithi076 ceph-mon[35401]: pgmap v10177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:29 smithi040 ceph-mon[32397]: pgmap v10177: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:31 smithi076 ceph-mon[35401]: pgmap v10178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:31.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14898.383013 secs 2024-07-26T17:41:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:31 smithi040 ceph-mon[32397]: pgmap v10178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14898.383013 secs 2024-07-26T17:41:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:31 smithi146 ceph-mon[35807]: pgmap v10178: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14898.383013 secs 2024-07-26T17:41:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:33 smithi040 ceph-mon[32397]: pgmap v10179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:33.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:33 smithi146 ceph-mon[35807]: pgmap v10179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:33 smithi076 ceph-mon[35401]: pgmap v10179: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:35 smithi040 ceph-mon[32397]: pgmap v10180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:35 smithi146 ceph-mon[35807]: pgmap v10180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:35 smithi076 ceph-mon[35401]: pgmap v10180: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14903.383163 secs 2024-07-26T17:41:36.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14903.383163 secs 2024-07-26T17:41:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14903.383163 secs 2024-07-26T17:41:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:37 smithi040 ceph-mon[32397]: pgmap v10181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:37.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:37 smithi146 ceph-mon[35807]: pgmap v10181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:37 smithi076 ceph-mon[35401]: pgmap v10181: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:39.624 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:39 smithi146 ceph-mon[35807]: pgmap v10182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:39 smithi040 ceph-mon[32397]: pgmap v10182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:39 smithi076 ceph-mon[35401]: pgmap v10182: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:41 smithi040 ceph-mon[32397]: pgmap v10183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14908.383307 secs 2024-07-26T17:41:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:41 smithi146 ceph-mon[35807]: pgmap v10183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14908.383307 secs 2024-07-26T17:41:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:41 smithi076 ceph-mon[35401]: pgmap v10183: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14908.383307 secs 2024-07-26T17:41:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:43 smithi040 ceph-mon[32397]: pgmap v10184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:43.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:43 smithi146 ceph-mon[35807]: pgmap v10184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:43 smithi076 ceph-mon[35401]: pgmap v10184: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:45.636 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:45 smithi076 ceph-mon[35401]: pgmap v10185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:45 smithi040 ceph-mon[32397]: pgmap v10185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:45.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:45 smithi146 ceph-mon[35807]: pgmap v10185: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14913.383448 secs 2024-07-26T17:41:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14913.383448 secs 2024-07-26T17:41:46.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14913.383448 secs 2024-07-26T17:41:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:47 smithi040 ceph-mon[32397]: pgmap v10186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:47 smithi146 ceph-mon[35807]: pgmap v10186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:47 smithi076 ceph-mon[35401]: pgmap v10186: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:49 smithi040 ceph-mon[32397]: pgmap v10187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:49.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:49 smithi146 ceph-mon[35807]: pgmap v10187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:49 smithi076 ceph-mon[35401]: pgmap v10187: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:51 smithi040 ceph-mon[32397]: pgmap v10188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14918.383578 secs 2024-07-26T17:41:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:51 smithi146 ceph-mon[35807]: pgmap v10188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14918.383578 secs 2024-07-26T17:41:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:51 smithi076 ceph-mon[35401]: pgmap v10188: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14918.383578 secs 2024-07-26T17:41:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:53 smithi040 ceph-mon[32397]: pgmap v10189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:53 smithi146 ceph-mon[35807]: pgmap v10189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:53 smithi076 ceph-mon[35401]: pgmap v10189: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:55 smithi040 ceph-mon[32397]: pgmap v10190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:55.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:55 smithi146 ceph-mon[35807]: pgmap v10190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:55 smithi076 ceph-mon[35401]: pgmap v10190: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:41:56.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14923.383717 secs 2024-07-26T17:41:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14923.383717 secs 2024-07-26T17:41:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14923.383717 secs 2024-07-26T17:41:57.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:57 smithi040 ceph-mon[32397]: pgmap v10191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:57 smithi146 ceph-mon[35807]: pgmap v10191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:57 smithi076 ceph-mon[35401]: pgmap v10191: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:41:59.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:41:59 smithi040 ceph-mon[32397]: pgmap v10192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:41:59 smithi146 ceph-mon[35807]: pgmap v10192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:41:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:41:59 smithi076 ceph-mon[35401]: pgmap v10192: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:01 smithi040 ceph-mon[32397]: pgmap v10193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:01.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14928.383874 secs 2024-07-26T17:42:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:01 smithi146 ceph-mon[35807]: pgmap v10193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14928.383874 secs 2024-07-26T17:42:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:01 smithi076 ceph-mon[35401]: pgmap v10193: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14928.383874 secs 2024-07-26T17:42:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:03 smithi040 ceph-mon[32397]: pgmap v10194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:03.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:03 smithi146 ceph-mon[35807]: pgmap v10194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:03 smithi076 ceph-mon[35401]: pgmap v10194: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:05 smithi040 ceph-mon[32397]: pgmap v10195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:05.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:05 smithi146 ceph-mon[35807]: pgmap v10195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:05 smithi076 ceph-mon[35401]: pgmap v10195: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:06.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14933.384051 secs 2024-07-26T17:42:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14933.384051 secs 2024-07-26T17:42:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14933.384051 secs 2024-07-26T17:42:07.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:07 smithi146 ceph-mon[35807]: pgmap v10196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:07 smithi076 ceph-mon[35401]: pgmap v10196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:07 smithi040 ceph-mon[32397]: pgmap v10196: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:09.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:09 smithi146 ceph-mon[35807]: pgmap v10197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:09 smithi076 ceph-mon[35401]: pgmap v10197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:09 smithi040 ceph-mon[32397]: pgmap v10197: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:11 smithi146 ceph-mon[35807]: pgmap v10198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14938.384192 secs 2024-07-26T17:42:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:11 smithi076 ceph-mon[35401]: pgmap v10198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:11.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14938.384192 secs 2024-07-26T17:42:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:11 smithi040 ceph-mon[32397]: pgmap v10198: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14938.384192 secs 2024-07-26T17:42:13.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:13 smithi040 ceph-mon[32397]: pgmap v10199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:13 smithi146 ceph-mon[35807]: pgmap v10199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:13.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:13 smithi076 ceph-mon[35401]: pgmap v10199: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:15.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:15 smithi146 ceph-mon[35807]: pgmap v10200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:15 smithi076 ceph-mon[35401]: pgmap v10200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:15 smithi040 ceph-mon[32397]: pgmap v10200: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:16.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14943.384322 secs 2024-07-26T17:42:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14943.384322 secs 2024-07-26T17:42:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14943.384322 secs 2024-07-26T17:42:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:17 smithi076 ceph-mon[35401]: pgmap v10201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:17 smithi040 ceph-mon[32397]: pgmap v10201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:17 smithi146 ceph-mon[35807]: pgmap v10201: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:19.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:19 smithi076 ceph-mon[35401]: pgmap v10202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:19 smithi040 ceph-mon[32397]: pgmap v10202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:19 smithi146 ceph-mon[35807]: pgmap v10202: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:21 smithi040 ceph-mon[32397]: pgmap v10203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14948.384484 secs 2024-07-26T17:42:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:21 smithi146 ceph-mon[35807]: pgmap v10203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14948.384484 secs 2024-07-26T17:42:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:21 smithi076 ceph-mon[35401]: pgmap v10203: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14948.384484 secs 2024-07-26T17:42:23.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:23 smithi040 ceph-mon[32397]: pgmap v10204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:23 smithi146 ceph-mon[35807]: pgmap v10204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:23 smithi076 ceph-mon[35401]: pgmap v10204: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:25 smithi040 ceph-mon[32397]: pgmap v10205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:25 smithi146 ceph-mon[35807]: pgmap v10205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:25 smithi076 ceph-mon[35401]: pgmap v10205: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14953.384612 secs 2024-07-26T17:42:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14953.384612 secs 2024-07-26T17:42:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14953.384612 secs 2024-07-26T17:42:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:27 smithi040 ceph-mon[32397]: pgmap v10206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:27 smithi146 ceph-mon[35807]: pgmap v10206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:27 smithi076 ceph-mon[35401]: pgmap v10206: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:29 smithi040 ceph-mon[32397]: pgmap v10207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:29 smithi146 ceph-mon[35807]: pgmap v10207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:29 smithi076 ceph-mon[35401]: pgmap v10207: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:31 smithi040 ceph-mon[32397]: pgmap v10208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14958.384754 secs 2024-07-26T17:42:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:31 smithi146 ceph-mon[35807]: pgmap v10208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14958.384754 secs 2024-07-26T17:42:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:31 smithi076 ceph-mon[35401]: pgmap v10208: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14958.384754 secs 2024-07-26T17:42:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:33 smithi040 ceph-mon[32397]: pgmap v10209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:33 smithi146 ceph-mon[35807]: pgmap v10209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:33 smithi076 ceph-mon[35401]: pgmap v10209: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:35 smithi040 ceph-mon[32397]: pgmap v10210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:35 smithi146 ceph-mon[35807]: pgmap v10210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:35 smithi076 ceph-mon[35401]: pgmap v10210: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14963.384834 secs 2024-07-26T17:42:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14963.384834 secs 2024-07-26T17:42:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14963.384834 secs 2024-07-26T17:42:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:37 smithi040 ceph-mon[32397]: pgmap v10211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:37 smithi146 ceph-mon[35807]: pgmap v10211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:38.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:37 smithi076 ceph-mon[35401]: pgmap v10211: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:39 smithi040 ceph-mon[32397]: pgmap v10212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:39 smithi146 ceph-mon[35807]: pgmap v10212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:39 smithi076 ceph-mon[35401]: pgmap v10212: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:41 smithi040 ceph-mon[32397]: pgmap v10213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14968.384974 secs 2024-07-26T17:42:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:41 smithi146 ceph-mon[35807]: pgmap v10213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14968.384974 secs 2024-07-26T17:42:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:41 smithi076 ceph-mon[35401]: pgmap v10213: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14968.384974 secs 2024-07-26T17:42:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:43 smithi040 ceph-mon[32397]: pgmap v10214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:43 smithi146 ceph-mon[35807]: pgmap v10214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:43 smithi076 ceph-mon[35401]: pgmap v10214: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:45 smithi040 ceph-mon[32397]: pgmap v10215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:45 smithi146 ceph-mon[35807]: pgmap v10215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:45 smithi076 ceph-mon[35401]: pgmap v10215: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14973.385113 secs 2024-07-26T17:42:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14973.385113 secs 2024-07-26T17:42:47.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14973.385113 secs 2024-07-26T17:42:47.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:47 smithi040 ceph-mon[32397]: pgmap v10216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:48.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:47 smithi146 ceph-mon[35807]: pgmap v10216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:47 smithi076 ceph-mon[35401]: pgmap v10216: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:49 smithi040 ceph-mon[32397]: pgmap v10217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:49 smithi146 ceph-mon[35807]: pgmap v10217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:49 smithi076 ceph-mon[35401]: pgmap v10217: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:51 smithi040 ceph-mon[32397]: pgmap v10218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14978.385256 secs 2024-07-26T17:42:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:51 smithi146 ceph-mon[35807]: pgmap v10218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14978.385256 secs 2024-07-26T17:42:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:51 smithi076 ceph-mon[35401]: pgmap v10218: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14978.385256 secs 2024-07-26T17:42:53.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:53 smithi040 ceph-mon[32397]: pgmap v10219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:54.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:53 smithi146 ceph-mon[35807]: pgmap v10219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:53 smithi076 ceph-mon[35401]: pgmap v10219: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:56.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:55 smithi146 ceph-mon[35807]: pgmap v10220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:56.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:55 smithi076 ceph-mon[35401]: pgmap v10220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:55 smithi040 ceph-mon[32397]: pgmap v10220: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:42:57.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14983.385397 secs 2024-07-26T17:42:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14983.385397 secs 2024-07-26T17:42:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14983.385397 secs 2024-07-26T17:42:58.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:57 smithi146 ceph-mon[35807]: pgmap v10221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:58.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:57 smithi076 ceph-mon[35401]: pgmap v10221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:57 smithi040 ceph-mon[32397]: pgmap v10221: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:42:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:42:58 smithi146 ceph-mon[35807]: pgmap v10222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:42:58 smithi076 ceph-mon[35401]: pgmap v10222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:42:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:42:58 smithi040 ceph-mon[32397]: pgmap v10222: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:01 smithi076 ceph-mon[35401]: pgmap v10223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14988.385534 secs 2024-07-26T17:43:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:01 smithi040 ceph-mon[32397]: pgmap v10223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14988.385534 secs 2024-07-26T17:43:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:01 smithi146 ceph-mon[35807]: pgmap v10223: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14988.385534 secs 2024-07-26T17:43:03.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:03 smithi076 ceph-mon[35401]: pgmap v10224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:03.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:03 smithi040 ceph-mon[32397]: pgmap v10224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:03.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:03 smithi146 ceph-mon[35807]: pgmap v10224: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:05.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:05 smithi040 ceph-mon[32397]: pgmap v10225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:05.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:05 smithi146 ceph-mon[35807]: pgmap v10225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:05 smithi076 ceph-mon[35401]: pgmap v10225: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:06.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14993.385672 secs 2024-07-26T17:43:06.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14993.385672 secs 2024-07-26T17:43:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14993.385672 secs 2024-07-26T17:43:07.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:07 smithi040 ceph-mon[32397]: pgmap v10226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:07 smithi146 ceph-mon[35807]: pgmap v10226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:07 smithi076 ceph-mon[35401]: pgmap v10226: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:09.374 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:09 smithi146 ceph-mon[35807]: pgmap v10227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:09.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:09 smithi040 ceph-mon[32397]: pgmap v10227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:09 smithi076 ceph-mon[35401]: pgmap v10227: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:11 smithi040 ceph-mon[32397]: pgmap v10228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 14998.385831 secs 2024-07-26T17:43:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:11 smithi146 ceph-mon[35807]: pgmap v10228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 14998.385831 secs 2024-07-26T17:43:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:11 smithi076 ceph-mon[35401]: pgmap v10228: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 14998.385831 secs 2024-07-26T17:43:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:13 smithi040 ceph-mon[32397]: pgmap v10229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:13 smithi146 ceph-mon[35807]: pgmap v10229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:13 smithi076 ceph-mon[35401]: pgmap v10229: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:15.885 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:15 smithi076 ceph-mon[35401]: pgmap v10230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:15 smithi040 ceph-mon[32397]: pgmap v10230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:16.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:15 smithi146 ceph-mon[35807]: pgmap v10230: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:16.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15003.385982 secs 2024-07-26T17:43:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15003.385982 secs 2024-07-26T17:43:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15003.385982 secs 2024-07-26T17:43:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:17 smithi040 ceph-mon[32397]: pgmap v10231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:17 smithi146 ceph-mon[35807]: pgmap v10231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:17 smithi076 ceph-mon[35401]: pgmap v10231: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:19 smithi040 ceph-mon[32397]: pgmap v10232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:19 smithi146 ceph-mon[35807]: pgmap v10232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:19 smithi076 ceph-mon[35401]: pgmap v10232: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:21 smithi040 ceph-mon[32397]: pgmap v10233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15008.386122 secs 2024-07-26T17:43:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:21 smithi146 ceph-mon[35807]: pgmap v10233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15008.386122 secs 2024-07-26T17:43:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:21 smithi076 ceph-mon[35401]: pgmap v10233: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15008.386122 secs 2024-07-26T17:43:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:23 smithi040 ceph-mon[32397]: pgmap v10234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:23 smithi146 ceph-mon[35807]: pgmap v10234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:23 smithi076 ceph-mon[35401]: pgmap v10234: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:25 smithi040 ceph-mon[32397]: pgmap v10235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:26.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:25 smithi146 ceph-mon[35807]: pgmap v10235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:25 smithi076 ceph-mon[35401]: pgmap v10235: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:26.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15013.386300 secs 2024-07-26T17:43:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15013.386300 secs 2024-07-26T17:43:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15013.386300 secs 2024-07-26T17:43:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:27 smithi040 ceph-mon[32397]: pgmap v10236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:27 smithi146 ceph-mon[35807]: pgmap v10236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:27 smithi076 ceph-mon[35401]: pgmap v10236: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:29 smithi040 ceph-mon[32397]: pgmap v10237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:29 smithi146 ceph-mon[35807]: pgmap v10237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:29 smithi076 ceph-mon[35401]: pgmap v10237: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:31 smithi040 ceph-mon[32397]: pgmap v10238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15018.386381 secs 2024-07-26T17:43:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:31 smithi146 ceph-mon[35807]: pgmap v10238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15018.386381 secs 2024-07-26T17:43:32.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:31 smithi076 ceph-mon[35401]: pgmap v10238: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:32.086 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15018.386381 secs 2024-07-26T17:43:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:33 smithi040 ceph-mon[32397]: pgmap v10239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:34.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:33 smithi146 ceph-mon[35807]: pgmap v10239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:33 smithi076 ceph-mon[35401]: pgmap v10239: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:35 smithi040 ceph-mon[32397]: pgmap v10240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:35 smithi146 ceph-mon[35807]: pgmap v10240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:36.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:35 smithi076 ceph-mon[35401]: pgmap v10240: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15023.386518 secs 2024-07-26T17:43:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15023.386518 secs 2024-07-26T17:43:37.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15023.386518 secs 2024-07-26T17:43:37.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:37 smithi040 ceph-mon[32397]: pgmap v10241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:37 smithi146 ceph-mon[35807]: pgmap v10241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:37 smithi076 ceph-mon[35401]: pgmap v10241: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:39 smithi040 ceph-mon[32397]: pgmap v10242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:39 smithi146 ceph-mon[35807]: pgmap v10242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:39 smithi076 ceph-mon[35401]: pgmap v10242: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:41 smithi040 ceph-mon[32397]: pgmap v10243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15028.386656 secs 2024-07-26T17:43:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:41 smithi146 ceph-mon[35807]: pgmap v10243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15028.386656 secs 2024-07-26T17:43:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:41 smithi076 ceph-mon[35401]: pgmap v10243: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15028.386656 secs 2024-07-26T17:43:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:43 smithi040 ceph-mon[32397]: pgmap v10244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:44.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:43 smithi146 ceph-mon[35807]: pgmap v10244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:43 smithi076 ceph-mon[35401]: pgmap v10244: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:46.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:45 smithi146 ceph-mon[35807]: pgmap v10245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:45 smithi076 ceph-mon[35401]: pgmap v10245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:45 smithi040 ceph-mon[32397]: pgmap v10245: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:43:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15033.386796 secs 2024-07-26T17:43:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15033.386796 secs 2024-07-26T17:43:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15033.386796 secs 2024-07-26T17:43:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:47 smithi146 ceph-mon[35807]: pgmap v10246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:47 smithi076 ceph-mon[35401]: pgmap v10246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:47 smithi040 ceph-mon[32397]: pgmap v10246: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:50.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:49 smithi146 ceph-mon[35807]: pgmap v10247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:49 smithi076 ceph-mon[35401]: pgmap v10247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:49 smithi040 ceph-mon[32397]: pgmap v10247: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:51 smithi146 ceph-mon[35807]: pgmap v10248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15038.386967 secs 2024-07-26T17:43:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:51 smithi076 ceph-mon[35401]: pgmap v10248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15038.386967 secs 2024-07-26T17:43:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:51 smithi040 ceph-mon[32397]: pgmap v10248: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:43:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15038.386967 secs 2024-07-26T17:43:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:52 smithi146 ceph-mon[35807]: pgmap v10249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:52 smithi076 ceph-mon[35401]: pgmap v10249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:52 smithi040 ceph-mon[32397]: pgmap v10249: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:55 smithi040 ceph-mon[32397]: pgmap v10250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:55.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:55 smithi146 ceph-mon[35807]: pgmap v10250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:55 smithi076 ceph-mon[35401]: pgmap v10250: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15043.387124 secs 2024-07-26T17:43:56.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15043.387124 secs 2024-07-26T17:43:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15043.387124 secs 2024-07-26T17:43:57.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:57 smithi040 ceph-mon[32397]: pgmap v10251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:43:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:57 smithi146 ceph-mon[35807]: pgmap v10251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:43:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:57 smithi076 ceph-mon[35401]: pgmap v10251: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:43:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:43:59 smithi040 ceph-mon[32397]: pgmap v10252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:43:59 smithi146 ceph-mon[35807]: pgmap v10252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:43:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:43:59 smithi076 ceph-mon[35401]: pgmap v10252: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:01 smithi040 ceph-mon[32397]: pgmap v10253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15048.387298 secs 2024-07-26T17:44:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:01 smithi146 ceph-mon[35807]: pgmap v10253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15048.387298 secs 2024-07-26T17:44:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:01 smithi076 ceph-mon[35401]: pgmap v10253: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15048.387298 secs 2024-07-26T17:44:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:03 smithi040 ceph-mon[32397]: pgmap v10254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:04.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:03 smithi146 ceph-mon[35807]: pgmap v10254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:03 smithi076 ceph-mon[35401]: pgmap v10254: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:05 smithi040 ceph-mon[32397]: pgmap v10255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:06.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:05 smithi146 ceph-mon[35807]: pgmap v10255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:06.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:05 smithi076 ceph-mon[35401]: pgmap v10255: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:06.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15053.387432 secs 2024-07-26T17:44:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15053.387432 secs 2024-07-26T17:44:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15053.387432 secs 2024-07-26T17:44:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:07 smithi040 ceph-mon[32397]: pgmap v10256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:08.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:07 smithi146 ceph-mon[35807]: pgmap v10256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:08.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:07 smithi076 ceph-mon[35401]: pgmap v10256: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:09 smithi040 ceph-mon[32397]: pgmap v10257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:10.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:09 smithi146 ceph-mon[35807]: pgmap v10257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:10.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:09 smithi076 ceph-mon[35401]: pgmap v10257: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:11 smithi040 ceph-mon[32397]: pgmap v10258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15058.387574 secs 2024-07-26T17:44:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:11 smithi146 ceph-mon[35807]: pgmap v10258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:12.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15058.387574 secs 2024-07-26T17:44:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:11 smithi076 ceph-mon[35401]: pgmap v10258: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15058.387574 secs 2024-07-26T17:44:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:13 smithi040 ceph-mon[32397]: pgmap v10259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:14.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:13 smithi146 ceph-mon[35807]: pgmap v10259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:14.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:13 smithi076 ceph-mon[35401]: pgmap v10259: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:15 smithi040 ceph-mon[32397]: pgmap v10260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:16.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:15 smithi146 ceph-mon[35807]: pgmap v10260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:16.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:15 smithi076 ceph-mon[35401]: pgmap v10260: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15063.387732 secs 2024-07-26T17:44:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15063.387732 secs 2024-07-26T17:44:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15063.387732 secs 2024-07-26T17:44:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:17 smithi040 ceph-mon[32397]: pgmap v10261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:18.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:17 smithi146 ceph-mon[35807]: pgmap v10261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:18.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:17 smithi076 ceph-mon[35401]: pgmap v10261: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:19 smithi040 ceph-mon[32397]: pgmap v10262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:19 smithi146 ceph-mon[35807]: pgmap v10262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:19 smithi076 ceph-mon[35401]: pgmap v10262: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:21 smithi040 ceph-mon[32397]: pgmap v10263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15068.387886 secs 2024-07-26T17:44:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:21 smithi146 ceph-mon[35807]: pgmap v10263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15068.387886 secs 2024-07-26T17:44:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:21 smithi076 ceph-mon[35401]: pgmap v10263: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15068.387886 secs 2024-07-26T17:44:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:23 smithi040 ceph-mon[32397]: pgmap v10264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:24.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:23 smithi146 ceph-mon[35807]: pgmap v10264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:23 smithi076 ceph-mon[35401]: pgmap v10264: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:25 smithi040 ceph-mon[32397]: pgmap v10265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:25 smithi146 ceph-mon[35807]: pgmap v10265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:25 smithi076 ceph-mon[35401]: pgmap v10265: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15073.388017 secs 2024-07-26T17:44:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15073.388017 secs 2024-07-26T17:44:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15073.388017 secs 2024-07-26T17:44:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:27 smithi040 ceph-mon[32397]: pgmap v10266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:28.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:27 smithi146 ceph-mon[35807]: pgmap v10266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:27 smithi076 ceph-mon[35401]: pgmap v10266: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:30.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:29 smithi146 ceph-mon[35807]: pgmap v10267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:29 smithi076 ceph-mon[35401]: pgmap v10267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:29 smithi040 ceph-mon[32397]: pgmap v10267: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:31 smithi146 ceph-mon[35807]: pgmap v10268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15078.388179 secs 2024-07-26T17:44:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:31 smithi076 ceph-mon[35401]: pgmap v10268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15078.388179 secs 2024-07-26T17:44:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:31 smithi040 ceph-mon[32397]: pgmap v10268: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15078.388179 secs 2024-07-26T17:44:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:33 smithi146 ceph-mon[35807]: pgmap v10269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:33 smithi076 ceph-mon[35401]: pgmap v10269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:33 smithi040 ceph-mon[32397]: pgmap v10269: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:36.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:35 smithi146 ceph-mon[35807]: pgmap v10270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:35 smithi076 ceph-mon[35401]: pgmap v10270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:35 smithi040 ceph-mon[32397]: pgmap v10270: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15083.388319 secs 2024-07-26T17:44:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15083.388319 secs 2024-07-26T17:44:37.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15083.388319 secs 2024-07-26T17:44:38.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:37 smithi146 ceph-mon[35807]: pgmap v10271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:37 smithi076 ceph-mon[35401]: pgmap v10271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:37 smithi040 ceph-mon[32397]: pgmap v10271: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:38 smithi076 ceph-mon[35401]: pgmap v10272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:38 smithi040 ceph-mon[32397]: pgmap v10272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:38 smithi146 ceph-mon[35807]: pgmap v10272: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:41 smithi040 ceph-mon[32397]: pgmap v10273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15088.388457 secs 2024-07-26T17:44:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:41 smithi146 ceph-mon[35807]: pgmap v10273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:41.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15088.388457 secs 2024-07-26T17:44:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:41 smithi076 ceph-mon[35401]: pgmap v10273: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:41.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15088.388457 secs 2024-07-26T17:44:43.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:43 smithi040 ceph-mon[32397]: pgmap v10274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:43.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:43 smithi146 ceph-mon[35807]: pgmap v10274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:43.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:43 smithi076 ceph-mon[35401]: pgmap v10274: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:45.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:45 smithi040 ceph-mon[32397]: pgmap v10275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:45.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:45 smithi146 ceph-mon[35807]: pgmap v10275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:45.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:45 smithi076 ceph-mon[35401]: pgmap v10275: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:46.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15093.388603 secs 2024-07-26T17:44:46.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15093.388603 secs 2024-07-26T17:44:46.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15093.388603 secs 2024-07-26T17:44:47.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:47 smithi040 ceph-mon[32397]: pgmap v10276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:47.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:47 smithi146 ceph-mon[35807]: pgmap v10276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:47.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:47 smithi076 ceph-mon[35401]: pgmap v10276: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:49.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:49 smithi040 ceph-mon[32397]: pgmap v10277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:49.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:49 smithi146 ceph-mon[35807]: pgmap v10277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:49.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:49 smithi076 ceph-mon[35401]: pgmap v10277: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:51 smithi040 ceph-mon[32397]: pgmap v10278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15098.388745 secs 2024-07-26T17:44:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:51 smithi146 ceph-mon[35807]: pgmap v10278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:51.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15098.388745 secs 2024-07-26T17:44:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:51 smithi076 ceph-mon[35401]: pgmap v10278: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:51.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15098.388745 secs 2024-07-26T17:44:53.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:53 smithi040 ceph-mon[32397]: pgmap v10279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:53.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:53 smithi146 ceph-mon[35807]: pgmap v10279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:53.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:53 smithi076 ceph-mon[35401]: pgmap v10279: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:55.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:55 smithi040 ceph-mon[32397]: pgmap v10280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:55.574 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:55 smithi146 ceph-mon[35807]: pgmap v10280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:55.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:55 smithi076 ceph-mon[35401]: pgmap v10280: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:44:56.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15103.388836 secs 2024-07-26T17:44:56.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15103.388836 secs 2024-07-26T17:44:56.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15103.388836 secs 2024-07-26T17:44:57.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:57 smithi040 ceph-mon[32397]: pgmap v10281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:57.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:57 smithi146 ceph-mon[35807]: pgmap v10281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:57.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:57 smithi076 ceph-mon[35401]: pgmap v10281: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:44:59.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:44:59 smithi040 ceph-mon[32397]: pgmap v10282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:59.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:44:59 smithi146 ceph-mon[35807]: pgmap v10282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:44:59.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:44:59 smithi076 ceph-mon[35401]: pgmap v10282: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:01 smithi040 ceph-mon[32397]: pgmap v10283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:01.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15108.388996 secs 2024-07-26T17:45:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:01 smithi146 ceph-mon[35807]: pgmap v10283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:01.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15108.388996 secs 2024-07-26T17:45:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:01 smithi076 ceph-mon[35401]: pgmap v10283: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:01.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15108.388996 secs 2024-07-26T17:45:03.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:03 smithi146 ceph-mon[35807]: pgmap v10284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:03.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:03 smithi076 ceph-mon[35401]: pgmap v10284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:03.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:03 smithi040 ceph-mon[32397]: pgmap v10284: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:05.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:05 smithi146 ceph-mon[35807]: pgmap v10285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:05.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:05 smithi076 ceph-mon[35401]: pgmap v10285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:05.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:05 smithi040 ceph-mon[32397]: pgmap v10285: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:06.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15113.389134 secs 2024-07-26T17:45:06.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15113.389134 secs 2024-07-26T17:45:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15113.389134 secs 2024-07-26T17:45:07.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:07 smithi146 ceph-mon[35807]: pgmap v10286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:07.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:07 smithi076 ceph-mon[35401]: pgmap v10286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:07.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:07 smithi040 ceph-mon[32397]: pgmap v10286: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:09.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:09 smithi146 ceph-mon[35807]: pgmap v10287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:09.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:09 smithi076 ceph-mon[35401]: pgmap v10287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:09.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:09 smithi040 ceph-mon[32397]: pgmap v10287: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:11 smithi146 ceph-mon[35807]: pgmap v10288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:11.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15118.389317 secs 2024-07-26T17:45:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:11 smithi076 ceph-mon[35401]: pgmap v10288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:11.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15118.389317 secs 2024-07-26T17:45:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:11 smithi040 ceph-mon[32397]: pgmap v10288: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:11.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15118.389317 secs 2024-07-26T17:45:13.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:13 smithi040 ceph-mon[32397]: pgmap v10289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:13.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:13 smithi146 ceph-mon[35807]: pgmap v10289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:13.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:13 smithi076 ceph-mon[35401]: pgmap v10289: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:15.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:15 smithi146 ceph-mon[35807]: pgmap v10290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:15.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:15 smithi076 ceph-mon[35401]: pgmap v10290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:15.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:15 smithi040 ceph-mon[32397]: pgmap v10290: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:16.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15123.389438 secs 2024-07-26T17:45:16.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15123.389438 secs 2024-07-26T17:45:16.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15123.389438 secs 2024-07-26T17:45:17.571 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:17 smithi146 ceph-mon[35807]: pgmap v10291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:45:17.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:17 smithi076 ceph-mon[35401]: pgmap v10291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:45:17.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:17 smithi040 ceph-mon[32397]: pgmap v10291: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:45:19.570 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:19 smithi146 ceph-mon[35807]: pgmap v10292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:19.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:19 smithi076 ceph-mon[35401]: pgmap v10292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:19.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:19 smithi040 ceph-mon[32397]: pgmap v10292: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:21.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:21 smithi076 ceph-mon[35401]: pgmap v10293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:21.584 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15128.389574 secs 2024-07-26T17:45:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:21 smithi040 ceph-mon[32397]: pgmap v10293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:21.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15128.389574 secs 2024-07-26T17:45:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:21 smithi146 ceph-mon[35807]: pgmap v10293: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:21.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15128.389574 secs 2024-07-26T17:45:23.583 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:23 smithi076 ceph-mon[35401]: pgmap v10294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:23.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:23 smithi040 ceph-mon[32397]: pgmap v10294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:23.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:23 smithi146 ceph-mon[35807]: pgmap v10294: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:25.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:25 smithi040 ceph-mon[32397]: pgmap v10295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:25.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:25 smithi146 ceph-mon[35807]: pgmap v10295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:25.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:25 smithi076 ceph-mon[35401]: pgmap v10295: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:45:26.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15133.389657 secs 2024-07-26T17:45:26.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15133.389657 secs 2024-07-26T17:45:26.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15133.389657 secs 2024-07-26T17:45:27.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:27 smithi040 ceph-mon[32397]: pgmap v10296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:45:27.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:27 smithi146 ceph-mon[35807]: pgmap v10296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:45:27.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:27 smithi076 ceph-mon[35401]: pgmap v10296: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:45:29.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:29 smithi040 ceph-mon[32397]: pgmap v10297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:29.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:29 smithi146 ceph-mon[35807]: pgmap v10297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:29.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:29 smithi076 ceph-mon[35401]: pgmap v10297: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:31 smithi040 ceph-mon[32397]: pgmap v10298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:31.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15138.389750 secs 2024-07-26T17:45:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:31 smithi146 ceph-mon[35807]: pgmap v10298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:31.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15138.389750 secs 2024-07-26T17:45:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:31 smithi076 ceph-mon[35401]: pgmap v10298: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:31.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15138.389750 secs 2024-07-26T17:45:33.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:33 smithi040 ceph-mon[32397]: pgmap v10299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:33.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:33 smithi146 ceph-mon[35807]: pgmap v10299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:33.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:33 smithi076 ceph-mon[35401]: pgmap v10299: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:35.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:35 smithi040 ceph-mon[32397]: pgmap v10300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:35.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:35 smithi146 ceph-mon[35807]: pgmap v10300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:35.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:35 smithi076 ceph-mon[35401]: pgmap v10300: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:36.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15143.389889 secs 2024-07-26T17:45:36.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15143.389889 secs 2024-07-26T17:45:36.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15143.389889 secs 2024-07-26T17:45:37.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:37 smithi040 ceph-mon[32397]: pgmap v10301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:37.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:37 smithi146 ceph-mon[35807]: pgmap v10301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:37.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:37 smithi076 ceph-mon[35401]: pgmap v10301: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:39.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:39 smithi040 ceph-mon[32397]: pgmap v10302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:39.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:39 smithi146 ceph-mon[35807]: pgmap v10302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:39.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:39 smithi076 ceph-mon[35401]: pgmap v10302: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:41 smithi040 ceph-mon[32397]: pgmap v10303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:41.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15148.390033 secs 2024-07-26T17:45:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:41 smithi146 ceph-mon[35807]: pgmap v10303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:41.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15148.390033 secs 2024-07-26T17:45:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:41 smithi076 ceph-mon[35401]: pgmap v10303: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:41.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15148.390033 secs 2024-07-26T17:45:43.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:43 smithi040 ceph-mon[32397]: pgmap v10304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:43.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:43 smithi146 ceph-mon[35807]: pgmap v10304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:43.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:43 smithi076 ceph-mon[35401]: pgmap v10304: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:45.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:45 smithi040 ceph-mon[32397]: pgmap v10305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:45.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:45 smithi146 ceph-mon[35807]: pgmap v10305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:45.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:45 smithi076 ceph-mon[35401]: pgmap v10305: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:46.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15153.390190 secs 2024-07-26T17:45:46.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15153.390190 secs 2024-07-26T17:45:46.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15153.390190 secs 2024-07-26T17:45:47.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:47 smithi040 ceph-mon[32397]: pgmap v10306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:47.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:47 smithi146 ceph-mon[35807]: pgmap v10306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:47.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:47 smithi076 ceph-mon[35401]: pgmap v10306: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:49.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:49 smithi040 ceph-mon[32397]: pgmap v10307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:49.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:49 smithi146 ceph-mon[35807]: pgmap v10307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:49.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:49 smithi076 ceph-mon[35401]: pgmap v10307: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:51 smithi040 ceph-mon[32397]: pgmap v10308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:51.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15158.390373 secs 2024-07-26T17:45:51.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:51 smithi146 ceph-mon[35807]: pgmap v10308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:51.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15158.390373 secs 2024-07-26T17:45:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:51 smithi076 ceph-mon[35401]: pgmap v10308: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:51.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15158.390373 secs 2024-07-26T17:45:53.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:53 smithi040 ceph-mon[32397]: pgmap v10309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:53.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:53 smithi146 ceph-mon[35807]: pgmap v10309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:53.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:53 smithi076 ceph-mon[35401]: pgmap v10309: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:55.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:55 smithi040 ceph-mon[32397]: pgmap v10310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:55.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:55 smithi146 ceph-mon[35807]: pgmap v10310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:55.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:55 smithi076 ceph-mon[35401]: pgmap v10310: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:45:56.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15163.390508 secs 2024-07-26T17:45:56.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15163.390508 secs 2024-07-26T17:45:56.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15163.390508 secs 2024-07-26T17:45:57.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:57 smithi146 ceph-mon[35807]: pgmap v10311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:57.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:57 smithi076 ceph-mon[35401]: pgmap v10311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:57.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:57 smithi040 ceph-mon[32397]: pgmap v10311: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:45:59.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:45:59 smithi146 ceph-mon[35807]: pgmap v10312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:59.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:45:59 smithi076 ceph-mon[35401]: pgmap v10312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:45:59.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:45:59 smithi040 ceph-mon[32397]: pgmap v10312: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:01 smithi146 ceph-mon[35807]: pgmap v10313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:01.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15168.390649 secs 2024-07-26T17:46:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:01 smithi076 ceph-mon[35401]: pgmap v10313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:01.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15168.390649 secs 2024-07-26T17:46:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:01 smithi040 ceph-mon[32397]: pgmap v10313: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:01.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15168.390649 secs 2024-07-26T17:46:03.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:03 smithi146 ceph-mon[35807]: pgmap v10314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:03.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:03 smithi076 ceph-mon[35401]: pgmap v10314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:03.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:03 smithi040 ceph-mon[32397]: pgmap v10314: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:05.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:05 smithi146 ceph-mon[35807]: pgmap v10315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:05.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:05 smithi076 ceph-mon[35401]: pgmap v10315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:05.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:05 smithi040 ceph-mon[32397]: pgmap v10315: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:06.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15173.390779 secs 2024-07-26T17:46:06.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15173.390779 secs 2024-07-26T17:46:06.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15173.390779 secs 2024-07-26T17:46:07.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:07 smithi146 ceph-mon[35807]: pgmap v10316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:07.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:07 smithi076 ceph-mon[35401]: pgmap v10316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:07.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:07 smithi040 ceph-mon[32397]: pgmap v10316: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:09.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:09 smithi146 ceph-mon[35807]: pgmap v10317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:09.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:09 smithi076 ceph-mon[35401]: pgmap v10317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:09.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:09 smithi040 ceph-mon[32397]: pgmap v10317: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:11 smithi146 ceph-mon[35807]: pgmap v10318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:11.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15178.390918 secs 2024-07-26T17:46:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:11 smithi076 ceph-mon[35401]: pgmap v10318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:11.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15178.390918 secs 2024-07-26T17:46:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:11 smithi040 ceph-mon[32397]: pgmap v10318: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:11.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15178.390918 secs 2024-07-26T17:46:13.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:13 smithi146 ceph-mon[35807]: pgmap v10319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:13.834 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:13 smithi076 ceph-mon[35401]: pgmap v10319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:13.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:13 smithi040 ceph-mon[32397]: pgmap v10319: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:15.821 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:15 smithi146 ceph-mon[35807]: pgmap v10320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:15.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:15 smithi076 ceph-mon[35401]: pgmap v10320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:15.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:15 smithi040 ceph-mon[32397]: pgmap v10320: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:16.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15183.391064 secs 2024-07-26T17:46:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15183.391064 secs 2024-07-26T17:46:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15183.391064 secs 2024-07-26T17:46:17.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:17 smithi076 ceph-mon[35401]: pgmap v10321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:17.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:17 smithi040 ceph-mon[32397]: pgmap v10321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:18.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:17 smithi146 ceph-mon[35807]: pgmap v10321: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:19.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:19 smithi040 ceph-mon[32397]: pgmap v10322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:20.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:19 smithi146 ceph-mon[35807]: pgmap v10322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:20.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:19 smithi076 ceph-mon[35401]: pgmap v10322: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:21 smithi040 ceph-mon[32397]: pgmap v10323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:21.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15188.391212 secs 2024-07-26T17:46:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:21 smithi146 ceph-mon[35807]: pgmap v10323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15188.391212 secs 2024-07-26T17:46:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:21 smithi076 ceph-mon[35401]: pgmap v10323: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15188.391212 secs 2024-07-26T17:46:23.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:23 smithi040 ceph-mon[32397]: pgmap v10324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:24.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:23 smithi146 ceph-mon[35807]: pgmap v10324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:24.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:23 smithi076 ceph-mon[35401]: pgmap v10324: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:25.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:25 smithi040 ceph-mon[32397]: pgmap v10325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:26.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:25 smithi146 ceph-mon[35807]: pgmap v10325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:26.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:25 smithi076 ceph-mon[35401]: pgmap v10325: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:46:26.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15193.391345 secs 2024-07-26T17:46:27.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15193.391345 secs 2024-07-26T17:46:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15193.391345 secs 2024-07-26T17:46:27.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:27 smithi040 ceph-mon[32397]: pgmap v10326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:28.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:27 smithi146 ceph-mon[35807]: pgmap v10326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:28.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:27 smithi076 ceph-mon[35401]: pgmap v10326: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:29.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:29 smithi040 ceph-mon[32397]: pgmap v10327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:30.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:29 smithi146 ceph-mon[35807]: pgmap v10327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:30.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:29 smithi076 ceph-mon[35401]: pgmap v10327: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:31 smithi040 ceph-mon[32397]: pgmap v10328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:31.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15198.391441 secs 2024-07-26T17:46:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:31 smithi146 ceph-mon[35807]: pgmap v10328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15198.391441 secs 2024-07-26T17:46:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:31 smithi076 ceph-mon[35401]: pgmap v10328: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15198.391441 secs 2024-07-26T17:46:33.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:33 smithi040 ceph-mon[32397]: pgmap v10329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:34.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:33 smithi146 ceph-mon[35807]: pgmap v10329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:34.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:33 smithi076 ceph-mon[35401]: pgmap v10329: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:35.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:35 smithi040 ceph-mon[32397]: pgmap v10330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:36.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:35 smithi146 ceph-mon[35807]: pgmap v10330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:36.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:35 smithi076 ceph-mon[35401]: pgmap v10330: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:36.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15203.391608 secs 2024-07-26T17:46:37.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15203.391608 secs 2024-07-26T17:46:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15203.391608 secs 2024-07-26T17:46:37.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:37 smithi040 ceph-mon[32397]: pgmap v10331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:38.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:37 smithi146 ceph-mon[35807]: pgmap v10331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:38.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:37 smithi076 ceph-mon[35401]: pgmap v10331: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:39.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:39 smithi040 ceph-mon[32397]: pgmap v10332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:40.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:39 smithi146 ceph-mon[35807]: pgmap v10332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:40.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:39 smithi076 ceph-mon[35401]: pgmap v10332: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:41 smithi040 ceph-mon[32397]: pgmap v10333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:41.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15208.391776 secs 2024-07-26T17:46:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:41 smithi146 ceph-mon[35807]: pgmap v10333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:42.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15208.391776 secs 2024-07-26T17:46:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:41 smithi076 ceph-mon[35401]: pgmap v10333: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15208.391776 secs 2024-07-26T17:46:43.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:43 smithi040 ceph-mon[32397]: pgmap v10334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:44.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:43 smithi146 ceph-mon[35807]: pgmap v10334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:44.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:43 smithi076 ceph-mon[35401]: pgmap v10334: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:45.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:45 smithi040 ceph-mon[32397]: pgmap v10335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:46.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:45 smithi146 ceph-mon[35807]: pgmap v10335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:46.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:45 smithi076 ceph-mon[35401]: pgmap v10335: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15213.391923 secs 2024-07-26T17:46:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15213.391923 secs 2024-07-26T17:46:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15213.391923 secs 2024-07-26T17:46:47.982 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:47 smithi040 ceph-mon[32397]: pgmap v10336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:48.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:47 smithi146 ceph-mon[35807]: pgmap v10336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:48.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:47 smithi076 ceph-mon[35401]: pgmap v10336: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:49.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:49 smithi040 ceph-mon[32397]: pgmap v10337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:50.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:49 smithi146 ceph-mon[35807]: pgmap v10337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:50.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:49 smithi076 ceph-mon[35401]: pgmap v10337: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:51.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: pgmap v10338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15218.392065 secs 2024-07-26T17:46:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:51.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:46:51.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:46:51.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:51 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: pgmap v10338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15218.392065 secs 2024-07-26T17:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:46:52.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:46:52.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:51 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:46:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: pgmap v10338: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:46:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15218.392065 secs 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-07-26T17:46:52.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:51 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:46:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:52 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:46:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:52 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:46:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:52 smithi146 ceph-mon[35807]: pgmap v10339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-07-26T17:46:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:52 smithi146 ceph-mon[35807]: pgmap v10340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T17:46:53.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:52 smithi146 ceph-mon[35807]: pgmap v10341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 B/s rd, 1 op/s 2024-07-26T17:46:53.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:52 smithi146 ceph-mon[35807]: pgmap v10342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s 2024-07-26T17:46:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:52 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:46:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:52 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:46:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:52 smithi076 ceph-mon[35401]: pgmap v10339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-07-26T17:46:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:52 smithi076 ceph-mon[35401]: pgmap v10340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T17:46:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:52 smithi076 ceph-mon[35401]: pgmap v10341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 B/s rd, 1 op/s 2024-07-26T17:46:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:52 smithi076 ceph-mon[35401]: pgmap v10342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s 2024-07-26T17:46:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:52 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi040 to 177.5M 2024-07-26T17:46:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:52 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi040 to 186154393: error parsing value: Value '186154393' is below minimum 939524096 2024-07-26T17:46:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:52 smithi040 ceph-mon[32397]: pgmap v10339: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-07-26T17:46:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:52 smithi040 ceph-mon[32397]: pgmap v10340: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-07-26T17:46:53.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:52 smithi040 ceph-mon[32397]: pgmap v10341: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 B/s rd, 1 op/s 2024-07-26T17:46:53.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:52 smithi040 ceph-mon[32397]: pgmap v10342: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s 2024-07-26T17:46:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:54 smithi146 ceph-mon[35807]: pgmap v10343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 2 op/s 2024-07-26T17:46:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:54 smithi076 ceph-mon[35401]: pgmap v10343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 2 op/s 2024-07-26T17:46:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:54 smithi040 ceph-mon[32397]: pgmap v10343: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 2 op/s 2024-07-26T17:46:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:56 smithi146 ceph-mon[35807]: pgmap v10344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s 2024-07-26T17:46:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15223.392188 secs 2024-07-26T17:46:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:56 smithi076 ceph-mon[35401]: pgmap v10344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s 2024-07-26T17:46:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15223.392188 secs 2024-07-26T17:46:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:56 smithi040 ceph-mon[32397]: pgmap v10344: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s 2024-07-26T17:46:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15223.392188 secs 2024-07-26T17:46:59.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:46:58 smithi146 ceph-mon[35807]: pgmap v10345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:46:58 smithi076 ceph-mon[35401]: pgmap v10345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:46:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:46:58 smithi040 ceph-mon[32397]: pgmap v10345: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:00 smithi146 ceph-mon[35807]: pgmap v10346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:00 smithi076 ceph-mon[35401]: pgmap v10346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:00 smithi040 ceph-mon[32397]: pgmap v10346: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:02.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15228.392347 secs 2024-07-26T17:47:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15228.392347 secs 2024-07-26T17:47:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15228.392347 secs 2024-07-26T17:47:03.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:02 smithi146 ceph-mon[35807]: pgmap v10347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:47:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:02 smithi076 ceph-mon[35401]: pgmap v10347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:47:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:02 smithi040 ceph-mon[32397]: pgmap v10347: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-07-26T17:47:05.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:04 smithi146 ceph-mon[35807]: pgmap v10348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:04 smithi076 ceph-mon[35401]: pgmap v10348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:04 smithi040 ceph-mon[32397]: pgmap v10348: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:07.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:06 smithi146 ceph-mon[35807]: pgmap v10349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15233.392480 secs 2024-07-26T17:47:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:06 smithi076 ceph-mon[35401]: pgmap v10349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15233.392480 secs 2024-07-26T17:47:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:06 smithi040 ceph-mon[32397]: pgmap v10349: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15233.392480 secs 2024-07-26T17:47:09.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:08 smithi146 ceph-mon[35807]: pgmap v10350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:08 smithi076 ceph-mon[35401]: pgmap v10350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:08 smithi040 ceph-mon[32397]: pgmap v10350: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:09 smithi040 ceph-mon[32397]: pgmap v10351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:09 smithi146 ceph-mon[35807]: pgmap v10351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:09 smithi076 ceph-mon[35401]: pgmap v10351: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:11.223 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:10 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15238.392627 secs 2024-07-26T17:47:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:10 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15238.392627 secs 2024-07-26T17:47:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:10 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15238.392627 secs 2024-07-26T17:47:12.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:12 smithi040 ceph-mon[32397]: pgmap v10352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:13.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:12 smithi146 ceph-mon[35807]: pgmap v10352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:13.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:12 smithi076 ceph-mon[35401]: pgmap v10352: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:14.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:14 smithi040 ceph-mon[32397]: pgmap v10353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:15.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:14 smithi146 ceph-mon[35807]: pgmap v10353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:14 smithi076 ceph-mon[35401]: pgmap v10353: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:16 smithi040 ceph-mon[32397]: pgmap v10354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:16.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15243.392777 secs 2024-07-26T17:47:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:16 smithi146 ceph-mon[35807]: pgmap v10354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15243.392777 secs 2024-07-26T17:47:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:16 smithi076 ceph-mon[35401]: pgmap v10354: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15243.392777 secs 2024-07-26T17:47:18.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:18 smithi040 ceph-mon[32397]: pgmap v10355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:18 smithi146 ceph-mon[35807]: pgmap v10355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:18 smithi076 ceph-mon[35401]: pgmap v10355: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:20 smithi040 ceph-mon[32397]: pgmap v10356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:20 smithi146 ceph-mon[35807]: pgmap v10356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:20 smithi076 ceph-mon[35401]: pgmap v10356: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15248.392919 secs 2024-07-26T17:47:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15248.392919 secs 2024-07-26T17:47:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15248.392919 secs 2024-07-26T17:47:23.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:22 smithi146 ceph-mon[35807]: pgmap v10357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:22 smithi076 ceph-mon[35401]: pgmap v10357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:22 smithi040 ceph-mon[32397]: pgmap v10357: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:25.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:24 smithi146 ceph-mon[35807]: pgmap v10358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:24 smithi076 ceph-mon[35401]: pgmap v10358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:24 smithi040 ceph-mon[32397]: pgmap v10358: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:26 smithi146 ceph-mon[35807]: pgmap v10359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15253.393062 secs 2024-07-26T17:47:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:26 smithi076 ceph-mon[35401]: pgmap v10359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15253.393062 secs 2024-07-26T17:47:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:26 smithi040 ceph-mon[32397]: pgmap v10359: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15253.393062 secs 2024-07-26T17:47:29.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:28 smithi146 ceph-mon[35807]: pgmap v10360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:28 smithi076 ceph-mon[35401]: pgmap v10360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:28 smithi040 ceph-mon[32397]: pgmap v10360: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:31.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:30 smithi146 ceph-mon[35807]: pgmap v10361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:30 smithi076 ceph-mon[35401]: pgmap v10361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:30 smithi040 ceph-mon[32397]: pgmap v10361: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:32.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15258.393223 secs 2024-07-26T17:47:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15258.393223 secs 2024-07-26T17:47:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15258.393223 secs 2024-07-26T17:47:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:32 smithi146 ceph-mon[35807]: pgmap v10362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:32 smithi076 ceph-mon[35401]: pgmap v10362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:32 smithi040 ceph-mon[32397]: pgmap v10362: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:34 smithi146 ceph-mon[35807]: pgmap v10363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:34 smithi076 ceph-mon[35401]: pgmap v10363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:34 smithi040 ceph-mon[32397]: pgmap v10363: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:36 smithi146 ceph-mon[35807]: pgmap v10364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15263.393362 secs 2024-07-26T17:47:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:36 smithi076 ceph-mon[35401]: pgmap v10364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15263.393362 secs 2024-07-26T17:47:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:36 smithi040 ceph-mon[32397]: pgmap v10364: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15263.393362 secs 2024-07-26T17:47:39.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:38 smithi146 ceph-mon[35807]: pgmap v10365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:38 smithi076 ceph-mon[35401]: pgmap v10365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:38 smithi040 ceph-mon[32397]: pgmap v10365: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:40 smithi146 ceph-mon[35807]: pgmap v10366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:40 smithi076 ceph-mon[35401]: pgmap v10366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:40 smithi040 ceph-mon[32397]: pgmap v10366: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15268.393500 secs 2024-07-26T17:47:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15268.393500 secs 2024-07-26T17:47:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15268.393500 secs 2024-07-26T17:47:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:42 smithi076 ceph-mon[35401]: pgmap v10367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:42 smithi040 ceph-mon[32397]: pgmap v10367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:42 smithi146 ceph-mon[35807]: pgmap v10367: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:44.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:43 smithi040 ceph-mon[32397]: pgmap v10368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:44.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:43 smithi146 ceph-mon[35807]: pgmap v10368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:43 smithi076 ceph-mon[35401]: pgmap v10368: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:46 smithi040 ceph-mon[32397]: pgmap v10369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:46.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15273.393637 secs 2024-07-26T17:47:47.037 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:46 smithi076 ceph-mon[35401]: pgmap v10369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:47.037 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15273.393637 secs 2024-07-26T17:47:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:46 smithi146 ceph-mon[35807]: pgmap v10369: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15273.393637 secs 2024-07-26T17:47:48.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:48 smithi040 ceph-mon[32397]: pgmap v10370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:48 smithi146 ceph-mon[35807]: pgmap v10370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:48 smithi076 ceph-mon[35401]: pgmap v10370: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:50 smithi146 ceph-mon[35807]: pgmap v10371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:50 smithi076 ceph-mon[35401]: pgmap v10371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:50 smithi040 ceph-mon[32397]: pgmap v10371: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:52.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15278.393771 secs 2024-07-26T17:47:52.082 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15278.393771 secs 2024-07-26T17:47:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15278.393771 secs 2024-07-26T17:47:53.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: pgmap v10372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:47:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:52 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: pgmap v10372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:47:53.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:52 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: pgmap v10372: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-07-26T17:47:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:53.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:52 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:54.066 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:53 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:54.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:53 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:54.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:53 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:55.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:54 smithi146 ceph-mon[35807]: pgmap v10373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:55.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:54 smithi076 ceph-mon[35401]: pgmap v10373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:55.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:54 smithi040 ceph-mon[32397]: pgmap v10373: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:47:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: pgmap v10374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15283.393884 secs 2024-07-26T17:47:57.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:56 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: pgmap v10374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15283.393884 secs 2024-07-26T17:47:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:56 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: pgmap v10374: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:47:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15283.393884 secs 2024-07-26T17:47:57.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:56 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:47:58.820 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:47:58 smithi146 ceph-mon[35807]: pgmap v10375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:47:58 smithi076 ceph-mon[35401]: pgmap v10375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:47:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:47:58 smithi040 ceph-mon[32397]: pgmap v10375: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:00 smithi146 ceph-mon[35807]: pgmap v10376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:00 smithi076 ceph-mon[35401]: pgmap v10376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:01.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:00 smithi040 ceph-mon[32397]: pgmap v10376: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:01.952 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15288.394022 secs 2024-07-26T17:48:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15288.394022 secs 2024-07-26T17:48:02.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15288.394022 secs 2024-07-26T17:48:03.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: pgmap v10377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:03.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.072 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.073 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:02 smithi146 ceph-mon[35807]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: pgmap v10377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.085 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:02 smithi076 ceph-mon[35401]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: pgmap v10377: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' 2024-07-26T17:48:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:02 smithi040 ceph-mon[32397]: from='mgr.14150 172.21.15.40:0/1966937120' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-07-26T17:48:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:03 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:48:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:03 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:48:04.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:03 smithi076 ceph-mon[35401]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:48:04.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:03 smithi076 ceph-mon[35401]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:48:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:03 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:48:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:03 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:48:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:03 smithi040 ceph-mon[32397]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:48:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:03 smithi040 ceph-mon[32397]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:48:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:03 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi076 to 176.4M 2024-07-26T17:48:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:03 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi076 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:48:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:03 smithi146 ceph-mon[35807]: Adjusting osd_memory_target on smithi146 to 176.4M 2024-07-26T17:48:04.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:03 smithi146 ceph-mon[35807]: Unable to set osd_memory_target on smithi146 to 185046220: error parsing value: Value '185046220' is below minimum 939524096 2024-07-26T17:48:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:04 smithi076 ceph-mon[35401]: pgmap v10378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:04 smithi040 ceph-mon[32397]: pgmap v10378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:05.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:04 smithi146 ceph-mon[35807]: pgmap v10378: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:05 smithi040 ceph-mon[32397]: pgmap v10379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:06.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:05 smithi146 ceph-mon[35807]: pgmap v10379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:05 smithi076 ceph-mon[35401]: pgmap v10379: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:07.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15293.394157 secs 2024-07-26T17:48:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15293.394157 secs 2024-07-26T17:48:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15293.394157 secs 2024-07-26T17:48:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:07 smithi040 ceph-mon[32397]: pgmap v10380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:08.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:07 smithi146 ceph-mon[35807]: pgmap v10380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:07 smithi076 ceph-mon[35401]: pgmap v10380: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:11.025 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:10 smithi146 ceph-mon[35807]: pgmap v10381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:10 smithi076 ceph-mon[35401]: pgmap v10381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:10 smithi040 ceph-mon[32397]: pgmap v10381: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:12.010 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15298.394325 secs 2024-07-26T17:48:12.064 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15298.394325 secs 2024-07-26T17:48:12.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15298.394325 secs 2024-07-26T17:48:12.833 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:12 smithi076 ceph-mon[35401]: pgmap v10382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:13.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:12 smithi146 ceph-mon[35807]: pgmap v10382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:12 smithi040 ceph-mon[32397]: pgmap v10382: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:15.036 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:14 smithi040 ceph-mon[32397]: pgmap v10383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:14 smithi146 ceph-mon[35807]: pgmap v10383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:14 smithi076 ceph-mon[35401]: pgmap v10383: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:17.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:16 smithi146 ceph-mon[35807]: pgmap v10384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15303.394458 secs 2024-07-26T17:48:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:16 smithi076 ceph-mon[35401]: pgmap v10384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15303.394458 secs 2024-07-26T17:48:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:16 smithi040 ceph-mon[32397]: pgmap v10384: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15303.394458 secs 2024-07-26T17:48:19.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:18 smithi146 ceph-mon[35807]: pgmap v10385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:18 smithi076 ceph-mon[35401]: pgmap v10385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:18 smithi040 ceph-mon[32397]: pgmap v10385: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:20 smithi146 ceph-mon[35807]: pgmap v10386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:20 smithi076 ceph-mon[35401]: pgmap v10386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:20 smithi040 ceph-mon[32397]: pgmap v10386: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:22.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15308.394595 secs 2024-07-26T17:48:22.084 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15308.394595 secs 2024-07-26T17:48:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15308.394595 secs 2024-07-26T17:48:23.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:22 smithi146 ceph-mon[35807]: pgmap v10387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:22 smithi076 ceph-mon[35401]: pgmap v10387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:23.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:22 smithi040 ceph-mon[32397]: pgmap v10387: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:25.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:24 smithi146 ceph-mon[35807]: pgmap v10388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:25.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:24 smithi076 ceph-mon[35401]: pgmap v10388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:24 smithi040 ceph-mon[32397]: pgmap v10388: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:26 smithi146 ceph-mon[35807]: pgmap v10389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:27.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15313.394686 secs 2024-07-26T17:48:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:26 smithi076 ceph-mon[35401]: pgmap v10389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15313.394686 secs 2024-07-26T17:48:27.148 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:26 smithi040 ceph-mon[32397]: pgmap v10389: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:27.148 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15313.394686 secs 2024-07-26T17:48:29.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:28 smithi076 ceph-mon[35401]: pgmap v10390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:28 smithi040 ceph-mon[32397]: pgmap v10390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:29.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:28 smithi146 ceph-mon[35807]: pgmap v10390: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:29 smithi040 ceph-mon[32397]: pgmap v10391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:30.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:29 smithi146 ceph-mon[35807]: pgmap v10391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:29 smithi076 ceph-mon[35401]: pgmap v10391: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:30 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15318.394850 secs 2024-07-26T17:48:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:30 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15318.394850 secs 2024-07-26T17:48:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:30 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15318.394850 secs 2024-07-26T17:48:32.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:31 smithi146 ceph-mon[35807]: pgmap v10392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:31 smithi076 ceph-mon[35401]: pgmap v10392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:31 smithi040 ceph-mon[32397]: pgmap v10392: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:34 smithi146 ceph-mon[35807]: pgmap v10393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:34 smithi076 ceph-mon[35401]: pgmap v10393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:34 smithi040 ceph-mon[32397]: pgmap v10393: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:36 smithi146 ceph-mon[35807]: pgmap v10394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:37.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15323.394991 secs 2024-07-26T17:48:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:36 smithi076 ceph-mon[35401]: pgmap v10394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15323.394991 secs 2024-07-26T17:48:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:36 smithi040 ceph-mon[32397]: pgmap v10394: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15323.394991 secs 2024-07-26T17:48:39.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:38 smithi146 ceph-mon[35807]: pgmap v10395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:38 smithi076 ceph-mon[35401]: pgmap v10395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:38 smithi040 ceph-mon[32397]: pgmap v10395: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:41.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:40 smithi146 ceph-mon[35807]: pgmap v10396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:41.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:40 smithi076 ceph-mon[35401]: pgmap v10396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:40 smithi040 ceph-mon[32397]: pgmap v10396: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:42.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15328.395153 secs 2024-07-26T17:48:42.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15328.395153 secs 2024-07-26T17:48:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15328.395153 secs 2024-07-26T17:48:43.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:42 smithi146 ceph-mon[35807]: pgmap v10397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:43.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:42 smithi076 ceph-mon[35401]: pgmap v10397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:43.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:42 smithi040 ceph-mon[32397]: pgmap v10397: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:45.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:44 smithi146 ceph-mon[35807]: pgmap v10398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:45.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:44 smithi076 ceph-mon[35401]: pgmap v10398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:45.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:44 smithi040 ceph-mon[32397]: pgmap v10398: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:47.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:46 smithi146 ceph-mon[35807]: pgmap v10399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:48:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15333.395313 secs 2024-07-26T17:48:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:46 smithi076 ceph-mon[35401]: pgmap v10399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:48:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15333.395313 secs 2024-07-26T17:48:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:46 smithi040 ceph-mon[32397]: pgmap v10399: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:48:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15333.395313 secs 2024-07-26T17:48:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:48 smithi146 ceph-mon[35807]: pgmap v10400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:48 smithi076 ceph-mon[35401]: pgmap v10400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:48 smithi040 ceph-mon[32397]: pgmap v10400: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-07-26T17:48:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:50 smithi076 ceph-mon[35401]: pgmap v10401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:50 smithi040 ceph-mon[32397]: pgmap v10401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:50 smithi146 ceph-mon[35807]: pgmap v10401: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15338.395462 secs 2024-07-26T17:48:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15338.395462 secs 2024-07-26T17:48:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15338.395462 secs 2024-07-26T17:48:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:52 smithi040 ceph-mon[32397]: pgmap v10402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:52 smithi146 ceph-mon[35807]: pgmap v10402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:52 smithi076 ceph-mon[35401]: pgmap v10402: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:54.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:53 smithi040 ceph-mon[32397]: pgmap v10403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:54.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:53 smithi146 ceph-mon[35807]: pgmap v10403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:53 smithi076 ceph-mon[35401]: pgmap v10403: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:48:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:56 smithi146 ceph-mon[35807]: pgmap v10404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:57.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15343.395622 secs 2024-07-26T17:48:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:56 smithi076 ceph-mon[35401]: pgmap v10404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:57.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15343.395622 secs 2024-07-26T17:48:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:56 smithi040 ceph-mon[32397]: pgmap v10404: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:48:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15343.395622 secs 2024-07-26T17:48:59.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:48:58 smithi146 ceph-mon[35807]: pgmap v10405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:59.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:48:58 smithi076 ceph-mon[35401]: pgmap v10405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:48:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:48:58 smithi040 ceph-mon[32397]: pgmap v10405: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:01.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:00 smithi146 ceph-mon[35807]: pgmap v10406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:00 smithi076 ceph-mon[35401]: pgmap v10406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:00 smithi040 ceph-mon[32397]: pgmap v10406: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:02.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15348.395767 secs 2024-07-26T17:49:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15348.395767 secs 2024-07-26T17:49:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15348.395767 secs 2024-07-26T17:49:03.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:02 smithi146 ceph-mon[35807]: pgmap v10407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:02 smithi076 ceph-mon[35401]: pgmap v10407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:02 smithi040 ceph-mon[32397]: pgmap v10407: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:05.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:04 smithi146 ceph-mon[35807]: pgmap v10408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:05.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:04 smithi076 ceph-mon[35401]: pgmap v10408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:04 smithi040 ceph-mon[32397]: pgmap v10408: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:06 smithi146 ceph-mon[35807]: pgmap v10409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:07.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15353.395897 secs 2024-07-26T17:49:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:06 smithi076 ceph-mon[35401]: pgmap v10409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:07.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15353.395897 secs 2024-07-26T17:49:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:06 smithi040 ceph-mon[32397]: pgmap v10409: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15353.395897 secs 2024-07-26T17:49:09.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:08 smithi076 ceph-mon[35401]: pgmap v10410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:08 smithi040 ceph-mon[32397]: pgmap v10410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:09.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:08 smithi146 ceph-mon[35807]: pgmap v10410: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:11.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:10 smithi076 ceph-mon[35401]: pgmap v10411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:11.124 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:10 smithi146 ceph-mon[35807]: pgmap v10411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:10 smithi040 ceph-mon[32397]: pgmap v10411: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15358.396045 secs 2024-07-26T17:49:12.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15358.396045 secs 2024-07-26T17:49:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15358.396045 secs 2024-07-26T17:49:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:12 smithi040 ceph-mon[32397]: pgmap v10412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:13.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:12 smithi146 ceph-mon[35807]: pgmap v10412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:12 smithi076 ceph-mon[35401]: pgmap v10412: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:13 smithi040 ceph-mon[32397]: pgmap v10413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:13 smithi146 ceph-mon[35807]: pgmap v10413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:13 smithi076 ceph-mon[35401]: pgmap v10413: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:16 smithi146 ceph-mon[35807]: pgmap v10414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:49:17.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15363.396202 secs 2024-07-26T17:49:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:16 smithi076 ceph-mon[35401]: pgmap v10414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:49:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15363.396202 secs 2024-07-26T17:49:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:16 smithi040 ceph-mon[32397]: pgmap v10414: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-07-26T17:49:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15363.396202 secs 2024-07-26T17:49:19.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:18 smithi146 ceph-mon[35807]: pgmap v10415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:19.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:18 smithi076 ceph-mon[35401]: pgmap v10415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:18 smithi040 ceph-mon[32397]: pgmap v10415: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:21.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:20 smithi146 ceph-mon[35807]: pgmap v10416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:21.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:20 smithi076 ceph-mon[35401]: pgmap v10416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:20 smithi040 ceph-mon[32397]: pgmap v10416: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:22.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15368.396372 secs 2024-07-26T17:49:22.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15368.396372 secs 2024-07-26T17:49:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15368.396372 secs 2024-07-26T17:49:23.074 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:22 smithi146 ceph-mon[35807]: pgmap v10417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:23.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:22 smithi076 ceph-mon[35401]: pgmap v10417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:22 smithi040 ceph-mon[32397]: pgmap v10417: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:24 smithi040 ceph-mon[32397]: pgmap v10418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:24 smithi146 ceph-mon[35807]: pgmap v10418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:24 smithi076 ceph-mon[35401]: pgmap v10418: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:25 smithi040 ceph-mon[32397]: pgmap v10419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:26.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:25 smithi146 ceph-mon[35807]: pgmap v10419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:25 smithi076 ceph-mon[35401]: pgmap v10419: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15373.396543 secs 2024-07-26T17:49:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15373.396543 secs 2024-07-26T17:49:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15373.396543 secs 2024-07-26T17:49:28.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:27 smithi040 ceph-mon[32397]: pgmap v10420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:27 smithi146 ceph-mon[35807]: pgmap v10420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:28.334 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:27 smithi076 ceph-mon[35401]: pgmap v10420: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:31.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:30 smithi146 ceph-mon[35807]: pgmap v10421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:31.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:30 smithi076 ceph-mon[35401]: pgmap v10421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:30 smithi040 ceph-mon[32397]: pgmap v10421: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:32.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15378.396700 secs 2024-07-26T17:49:32.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15378.396700 secs 2024-07-26T17:49:32.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15378.396700 secs 2024-07-26T17:49:33.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:32 smithi146 ceph-mon[35807]: pgmap v10422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:33.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:32 smithi076 ceph-mon[35401]: pgmap v10422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:32 smithi040 ceph-mon[32397]: pgmap v10422: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:35.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:34 smithi146 ceph-mon[35807]: pgmap v10423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:35.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:34 smithi076 ceph-mon[35401]: pgmap v10423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:35.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:34 smithi040 ceph-mon[32397]: pgmap v10423: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:36 smithi076 ceph-mon[35401]: pgmap v10424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:37.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15383.396854 secs 2024-07-26T17:49:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:36 smithi040 ceph-mon[32397]: pgmap v10424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15383.396854 secs 2024-07-26T17:49:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:36 smithi146 ceph-mon[35807]: pgmap v10424: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15383.396854 secs 2024-07-26T17:49:39.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:38 smithi076 ceph-mon[35401]: pgmap v10425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:38 smithi040 ceph-mon[32397]: pgmap v10425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:39.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:38 smithi146 ceph-mon[35807]: pgmap v10425: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:41.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:40 smithi146 ceph-mon[35807]: pgmap v10426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:41.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:40 smithi040 ceph-mon[32397]: pgmap v10426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:40 smithi076 ceph-mon[35401]: pgmap v10426: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:42.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15388.396996 secs 2024-07-26T17:49:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15388.396996 secs 2024-07-26T17:49:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15388.396996 secs 2024-07-26T17:49:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:42 smithi040 ceph-mon[32397]: pgmap v10427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:43.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:42 smithi146 ceph-mon[35807]: pgmap v10427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:42 smithi076 ceph-mon[35401]: pgmap v10427: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:43 smithi040 ceph-mon[32397]: pgmap v10428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:43 smithi146 ceph-mon[35807]: pgmap v10428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:43 smithi076 ceph-mon[35401]: pgmap v10428: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:46 smithi146 ceph-mon[35807]: pgmap v10429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:47.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15393.397124 secs 2024-07-26T17:49:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:46 smithi076 ceph-mon[35401]: pgmap v10429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:47.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15393.397124 secs 2024-07-26T17:49:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:46 smithi040 ceph-mon[32397]: pgmap v10429: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15393.397124 secs 2024-07-26T17:49:49.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:48 smithi146 ceph-mon[35807]: pgmap v10430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:49.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:48 smithi076 ceph-mon[35401]: pgmap v10430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:49.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:48 smithi040 ceph-mon[32397]: pgmap v10430: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:51.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:50 smithi146 ceph-mon[35807]: pgmap v10431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:51.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:50 smithi076 ceph-mon[35401]: pgmap v10431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:50 smithi040 ceph-mon[32397]: pgmap v10431: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:52.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15398.397299 secs 2024-07-26T17:49:52.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15398.397299 secs 2024-07-26T17:49:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15398.397299 secs 2024-07-26T17:49:53.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:52 smithi040 ceph-mon[32397]: pgmap v10432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:52 smithi146 ceph-mon[35807]: pgmap v10432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:52 smithi076 ceph-mon[35401]: pgmap v10432: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:55.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:54 smithi040 ceph-mon[32397]: pgmap v10433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:55.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:54 smithi146 ceph-mon[35807]: pgmap v10433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:55.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:54 smithi076 ceph-mon[35401]: pgmap v10433: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:49:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:55 smithi040 ceph-mon[32397]: pgmap v10434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:56.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:55 smithi146 ceph-mon[35807]: pgmap v10434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:55 smithi076 ceph-mon[35401]: pgmap v10434: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:49:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15403.397412 secs 2024-07-26T17:49:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15403.397412 secs 2024-07-26T17:49:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15403.397412 secs 2024-07-26T17:49:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:49:57 smithi040 ceph-mon[32397]: pgmap v10435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:49:57 smithi146 ceph-mon[35807]: pgmap v10435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:49:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:49:57 smithi076 ceph-mon[35401]: pgmap v10435: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:00 smithi146 ceph-mon[35807]: pgmap v10436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:01.071 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:00 smithi146 ceph-mon[35807]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:50:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:00 smithi076 ceph-mon[35401]: pgmap v10436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:01.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:00 smithi076 ceph-mon[35401]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:50:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:00 smithi040 ceph-mon[32397]: pgmap v10436: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:01.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:00 smithi040 ceph-mon[32397]: overall HEALTH_WARN 8 failed cephadm daemon(s); failed to probe daemons or devices; 1 filesystem is degraded; 1 MDSs report slow requests 2024-07-26T17:50:02.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15408.397545 secs 2024-07-26T17:50:02.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15408.397545 secs 2024-07-26T17:50:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15408.397545 secs 2024-07-26T17:50:03.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:02 smithi076 ceph-mon[35401]: pgmap v10437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:03.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:02 smithi040 ceph-mon[32397]: pgmap v10437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:03.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:02 smithi146 ceph-mon[35807]: pgmap v10437: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:05.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:04 smithi040 ceph-mon[32397]: pgmap v10438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:04 smithi146 ceph-mon[35807]: pgmap v10438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:04 smithi076 ceph-mon[35401]: pgmap v10438: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:06 smithi040 ceph-mon[32397]: pgmap v10439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15413.397692 secs 2024-07-26T17:50:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:06 smithi146 ceph-mon[35807]: pgmap v10439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15413.397692 secs 2024-07-26T17:50:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:06 smithi076 ceph-mon[35401]: pgmap v10439: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15413.397692 secs 2024-07-26T17:50:09.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:08 smithi040 ceph-mon[32397]: pgmap v10440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:09.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:08 smithi146 ceph-mon[35807]: pgmap v10440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:09.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:08 smithi076 ceph-mon[35401]: pgmap v10440: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:09 smithi040 ceph-mon[32397]: pgmap v10441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:09 smithi146 ceph-mon[35807]: pgmap v10441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:09 smithi076 ceph-mon[35401]: pgmap v10441: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15418.397813 secs 2024-07-26T17:50:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15418.397813 secs 2024-07-26T17:50:11.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15418.397813 secs 2024-07-26T17:50:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:12 smithi146 ceph-mon[35807]: pgmap v10442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:12 smithi076 ceph-mon[35401]: pgmap v10442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:12 smithi040 ceph-mon[32397]: pgmap v10442: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:15.070 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:14 smithi146 ceph-mon[35807]: pgmap v10443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:15.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:14 smithi076 ceph-mon[35401]: pgmap v10443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:15.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:14 smithi040 ceph-mon[32397]: pgmap v10443: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:16 smithi076 ceph-mon[35401]: pgmap v10444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:17.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15423.397957 secs 2024-07-26T17:50:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:16 smithi040 ceph-mon[32397]: pgmap v10444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15423.397957 secs 2024-07-26T17:50:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:16 smithi146 ceph-mon[35807]: pgmap v10444: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15423.397957 secs 2024-07-26T17:50:19.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:18 smithi040 ceph-mon[32397]: pgmap v10445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:19.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:18 smithi146 ceph-mon[35807]: pgmap v10445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:19.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:18 smithi076 ceph-mon[35401]: pgmap v10445: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:20 smithi040 ceph-mon[32397]: pgmap v10446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:20 smithi146 ceph-mon[35807]: pgmap v10446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:20 smithi076 ceph-mon[35401]: pgmap v10446: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:22.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15428.398094 secs 2024-07-26T17:50:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15428.398094 secs 2024-07-26T17:50:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15428.398094 secs 2024-07-26T17:50:23.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:22 smithi040 ceph-mon[32397]: pgmap v10447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:23.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:22 smithi146 ceph-mon[35807]: pgmap v10447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:23.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:22 smithi076 ceph-mon[35401]: pgmap v10447: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:24.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:23 smithi040 ceph-mon[32397]: pgmap v10448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:24.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:23 smithi146 ceph-mon[35807]: pgmap v10448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:23 smithi076 ceph-mon[35401]: pgmap v10448: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:26 smithi076 ceph-mon[35401]: pgmap v10449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:27.083 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15433.398226 secs 2024-07-26T17:50:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:26 smithi040 ceph-mon[32397]: pgmap v10449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15433.398226 secs 2024-07-26T17:50:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:26 smithi146 ceph-mon[35807]: pgmap v10449: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15433.398226 secs 2024-07-26T17:50:29.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:28 smithi040 ceph-mon[32397]: pgmap v10450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:29.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:28 smithi146 ceph-mon[35807]: pgmap v10450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:29.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:28 smithi076 ceph-mon[35401]: pgmap v10450: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:31.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:30 smithi040 ceph-mon[32397]: pgmap v10451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:30 smithi146 ceph-mon[35807]: pgmap v10451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:30 smithi076 ceph-mon[35401]: pgmap v10451: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:32.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15438.398367 secs 2024-07-26T17:50:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15438.398367 secs 2024-07-26T17:50:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15438.398367 secs 2024-07-26T17:50:33.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:32 smithi040 ceph-mon[32397]: pgmap v10452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:33.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:32 smithi146 ceph-mon[35807]: pgmap v10452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:33.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:32 smithi076 ceph-mon[35401]: pgmap v10452: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:33 smithi040 ceph-mon[32397]: pgmap v10453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:33 smithi146 ceph-mon[35807]: pgmap v10453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:33 smithi076 ceph-mon[35401]: pgmap v10453: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:36 smithi040 ceph-mon[32397]: pgmap v10454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15443.398506 secs 2024-07-26T17:50:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:36 smithi146 ceph-mon[35807]: pgmap v10454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15443.398506 secs 2024-07-26T17:50:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:36 smithi076 ceph-mon[35401]: pgmap v10454: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15443.398506 secs 2024-07-26T17:50:39.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:38 smithi040 ceph-mon[32397]: pgmap v10455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:39.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:38 smithi146 ceph-mon[35807]: pgmap v10455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:39.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:38 smithi076 ceph-mon[35401]: pgmap v10455: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:41.123 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:40 smithi146 ceph-mon[35807]: pgmap v10456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:41.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:40 smithi040 ceph-mon[32397]: pgmap v10456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:40 smithi076 ceph-mon[35401]: pgmap v10456: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:42.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15448.398651 secs 2024-07-26T17:50:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15448.398651 secs 2024-07-26T17:50:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15448.398651 secs 2024-07-26T17:50:43.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:42 smithi040 ceph-mon[32397]: pgmap v10457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:43.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:42 smithi146 ceph-mon[35807]: pgmap v10457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:43.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:42 smithi076 ceph-mon[35401]: pgmap v10457: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:43 smithi040 ceph-mon[32397]: pgmap v10458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:43 smithi146 ceph-mon[35807]: pgmap v10458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:43 smithi076 ceph-mon[35401]: pgmap v10458: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:46 smithi040 ceph-mon[32397]: pgmap v10459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:47.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15453.398793 secs 2024-07-26T17:50:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:46 smithi146 ceph-mon[35807]: pgmap v10459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:47.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15453.398793 secs 2024-07-26T17:50:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:46 smithi076 ceph-mon[35401]: pgmap v10459: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15453.398793 secs 2024-07-26T17:50:49.136 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:48 smithi076 ceph-mon[35401]: pgmap v10460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:49.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:48 smithi040 ceph-mon[32397]: pgmap v10460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:49.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:48 smithi146 ceph-mon[35807]: pgmap v10460: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:51.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:50 smithi040 ceph-mon[32397]: pgmap v10461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:50 smithi146 ceph-mon[35807]: pgmap v10461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:50 smithi076 ceph-mon[35401]: pgmap v10461: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:52.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15458.398951 secs 2024-07-26T17:50:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15458.398951 secs 2024-07-26T17:50:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15458.398951 secs 2024-07-26T17:50:53.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:52 smithi040 ceph-mon[32397]: pgmap v10462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:53.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:52 smithi146 ceph-mon[35807]: pgmap v10462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:53.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:52 smithi076 ceph-mon[35401]: pgmap v10462: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:53 smithi040 ceph-mon[32397]: pgmap v10463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:53 smithi146 ceph-mon[35807]: pgmap v10463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:53 smithi076 ceph-mon[35401]: pgmap v10463: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:50:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:56 smithi040 ceph-mon[32397]: pgmap v10464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:57.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15463.399085 secs 2024-07-26T17:50:57.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:56 smithi146 ceph-mon[35807]: pgmap v10464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15463.399085 secs 2024-07-26T17:50:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:56 smithi076 ceph-mon[35401]: pgmap v10464: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:50:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15463.399085 secs 2024-07-26T17:50:59.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:58 smithi040 ceph-mon[32397]: pgmap v10465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:59.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:58 smithi146 ceph-mon[35807]: pgmap v10465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:50:59.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:58 smithi076 ceph-mon[35401]: pgmap v10465: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:00.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:50:59 smithi040 ceph-mon[32397]: pgmap v10466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:00.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:50:59 smithi146 ceph-mon[35807]: pgmap v10466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:50:59 smithi076 ceph-mon[35401]: pgmap v10466: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15468.399225 secs 2024-07-26T17:51:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15468.399225 secs 2024-07-26T17:51:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15468.399225 secs 2024-07-26T17:51:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:02 smithi146 ceph-mon[35807]: pgmap v10467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:02 smithi076 ceph-mon[35401]: pgmap v10467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:02.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:02 smithi040 ceph-mon[32397]: pgmap v10467: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:05.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:04 smithi040 ceph-mon[32397]: pgmap v10468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:05.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:04 smithi146 ceph-mon[35807]: pgmap v10468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:05.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:04 smithi076 ceph-mon[35401]: pgmap v10468: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:06 smithi040 ceph-mon[32397]: pgmap v10469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15473.399358 secs 2024-07-26T17:51:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:06 smithi146 ceph-mon[35807]: pgmap v10469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:07.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15473.399358 secs 2024-07-26T17:51:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:06 smithi076 ceph-mon[35401]: pgmap v10469: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15473.399358 secs 2024-07-26T17:51:08.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:07 smithi040 ceph-mon[32397]: pgmap v10470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:07 smithi146 ceph-mon[35807]: pgmap v10470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:07 smithi076 ceph-mon[35401]: pgmap v10470: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:11.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:10 smithi040 ceph-mon[32397]: pgmap v10471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:11.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:10 smithi146 ceph-mon[35807]: pgmap v10471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:10 smithi076 ceph-mon[35401]: pgmap v10471: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:12.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15478.399491 secs 2024-07-26T17:51:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15478.399491 secs 2024-07-26T17:51:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15478.399491 secs 2024-07-26T17:51:13.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:12 smithi040 ceph-mon[32397]: pgmap v10472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:13.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:12 smithi146 ceph-mon[35807]: pgmap v10472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:13.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:12 smithi076 ceph-mon[35401]: pgmap v10472: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:13 smithi040 ceph-mon[32397]: pgmap v10473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:14.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:13 smithi146 ceph-mon[35807]: pgmap v10473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:13 smithi076 ceph-mon[35401]: pgmap v10473: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:16 smithi040 ceph-mon[32397]: pgmap v10474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:17.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15483.399649 secs 2024-07-26T17:51:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:16 smithi146 ceph-mon[35807]: pgmap v10474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15483.399649 secs 2024-07-26T17:51:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:16 smithi076 ceph-mon[35401]: pgmap v10474: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15483.399649 secs 2024-07-26T17:51:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:17 smithi040 ceph-mon[32397]: pgmap v10475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:17 smithi146 ceph-mon[35807]: pgmap v10475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:17 smithi076 ceph-mon[35401]: pgmap v10475: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:21.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:20 smithi040 ceph-mon[32397]: pgmap v10476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:20 smithi146 ceph-mon[35807]: pgmap v10476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:20 smithi076 ceph-mon[35401]: pgmap v10476: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15488.399791 secs 2024-07-26T17:51:22.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:21 smithi040 ceph-mon[32397]: pgmap v10477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15488.399791 secs 2024-07-26T17:51:22.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:21 smithi146 ceph-mon[35807]: pgmap v10477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15488.399791 secs 2024-07-26T17:51:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:21 smithi076 ceph-mon[35401]: pgmap v10477: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:25.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:24 smithi040 ceph-mon[32397]: pgmap v10478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:25.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:24 smithi146 ceph-mon[35807]: pgmap v10478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:25.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:24 smithi076 ceph-mon[35401]: pgmap v10478: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:25 smithi040 ceph-mon[32397]: pgmap v10479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:25 smithi146 ceph-mon[35807]: pgmap v10479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:25 smithi076 ceph-mon[35401]: pgmap v10479: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15493.399924 secs 2024-07-26T17:51:27.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15493.399924 secs 2024-07-26T17:51:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15493.399924 secs 2024-07-26T17:51:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:27 smithi040 ceph-mon[32397]: pgmap v10480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:28.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:27 smithi146 ceph-mon[35807]: pgmap v10480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:27 smithi076 ceph-mon[35401]: pgmap v10480: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:30.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:29 smithi040 ceph-mon[32397]: pgmap v10481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:29 smithi146 ceph-mon[35807]: pgmap v10481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:29 smithi076 ceph-mon[35401]: pgmap v10481: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:31.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15498.400090 secs 2024-07-26T17:51:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15498.400090 secs 2024-07-26T17:51:31.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15498.400090 secs 2024-07-26T17:51:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:32 smithi146 ceph-mon[35807]: pgmap v10482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:32 smithi076 ceph-mon[35401]: pgmap v10482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:32.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:32 smithi040 ceph-mon[32397]: pgmap v10482: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:33 smithi040 ceph-mon[32397]: pgmap v10483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:33 smithi146 ceph-mon[35807]: pgmap v10483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:33 smithi076 ceph-mon[35401]: pgmap v10483: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:35 smithi040 ceph-mon[32397]: pgmap v10484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:36.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:35 smithi146 ceph-mon[35807]: pgmap v10484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:35 smithi076 ceph-mon[35401]: pgmap v10484: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15503.400228 secs 2024-07-26T17:51:37.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15503.400228 secs 2024-07-26T17:51:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15503.400228 secs 2024-07-26T17:51:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:37 smithi040 ceph-mon[32397]: pgmap v10485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:38.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:37 smithi146 ceph-mon[35807]: pgmap v10485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:37 smithi076 ceph-mon[35401]: pgmap v10485: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:39 smithi040 ceph-mon[32397]: pgmap v10486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:40.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:39 smithi146 ceph-mon[35807]: pgmap v10486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:39 smithi076 ceph-mon[35401]: pgmap v10486: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15508.400378 secs 2024-07-26T17:51:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15508.400378 secs 2024-07-26T17:51:41.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15508.400378 secs 2024-07-26T17:51:42.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:42 smithi146 ceph-mon[35807]: pgmap v10487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:42 smithi076 ceph-mon[35401]: pgmap v10487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:42 smithi040 ceph-mon[32397]: pgmap v10487: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:44.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:43 smithi040 ceph-mon[32397]: pgmap v10488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:44.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:43 smithi146 ceph-mon[35807]: pgmap v10488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:44.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:43 smithi076 ceph-mon[35401]: pgmap v10488: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:46.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:45 smithi040 ceph-mon[32397]: pgmap v10489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:46.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:45 smithi146 ceph-mon[35807]: pgmap v10489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:46.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:45 smithi076 ceph-mon[35401]: pgmap v10489: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:47.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:46 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15513.400508 secs 2024-07-26T17:51:47.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:46 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15513.400508 secs 2024-07-26T17:51:47.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:46 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15513.400508 secs 2024-07-26T17:51:48.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:47 smithi040 ceph-mon[32397]: pgmap v10490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:48.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:47 smithi146 ceph-mon[35807]: pgmap v10490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:48.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:47 smithi076 ceph-mon[35401]: pgmap v10490: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:50.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:49 smithi040 ceph-mon[32397]: pgmap v10491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:50.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:49 smithi146 ceph-mon[35807]: pgmap v10491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:50.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:49 smithi076 ceph-mon[35401]: pgmap v10491: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:51.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:51 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15518.400639 secs 2024-07-26T17:51:51.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:51 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15518.400639 secs 2024-07-26T17:51:51.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:51 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15518.400639 secs 2024-07-26T17:51:52.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:52 smithi146 ceph-mon[35807]: pgmap v10492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:52.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:52 smithi076 ceph-mon[35401]: pgmap v10492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:52.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:52 smithi040 ceph-mon[32397]: pgmap v10492: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:54.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:53 smithi040 ceph-mon[32397]: pgmap v10493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:54.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:53 smithi146 ceph-mon[35807]: pgmap v10493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:54.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:53 smithi076 ceph-mon[35401]: pgmap v10493: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:51:56.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:55 smithi040 ceph-mon[32397]: pgmap v10494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:56.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:55 smithi146 ceph-mon[35807]: pgmap v10494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:56.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:55 smithi076 ceph-mon[35401]: pgmap v10494: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:51:57.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:56 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15523.400739 secs 2024-07-26T17:51:57.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:56 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15523.400739 secs 2024-07-26T17:51:57.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:56 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15523.400739 secs 2024-07-26T17:51:58.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:57 smithi040 ceph-mon[32397]: pgmap v10495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:58.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:57 smithi146 ceph-mon[35807]: pgmap v10495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:51:58.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:57 smithi076 ceph-mon[35401]: pgmap v10495: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:00.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:51:59 smithi040 ceph-mon[32397]: pgmap v10496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:00.323 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:51:59 smithi146 ceph-mon[35807]: pgmap v10496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:00.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:51:59 smithi076 ceph-mon[35401]: pgmap v10496: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:01.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:01 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15528.400901 secs 2024-07-26T17:52:01.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:01 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15528.400901 secs 2024-07-26T17:52:01.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:01 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15528.400901 secs 2024-07-26T17:52:02.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:02 smithi146 ceph-mon[35807]: pgmap v10497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:02.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:02 smithi076 ceph-mon[35401]: pgmap v10497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:02.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:02 smithi040 ceph-mon[32397]: pgmap v10497: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:04.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:03 smithi040 ceph-mon[32397]: pgmap v10498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:04.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:03 smithi146 ceph-mon[35807]: pgmap v10498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:04.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:03 smithi076 ceph-mon[35401]: pgmap v10498: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:06.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:05 smithi040 ceph-mon[32397]: pgmap v10499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:06.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:05 smithi146 ceph-mon[35807]: pgmap v10499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:06.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:05 smithi076 ceph-mon[35401]: pgmap v10499: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:07.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:06 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15533.401071 secs 2024-07-26T17:52:07.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:06 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15533.401071 secs 2024-07-26T17:52:07.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:06 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15533.401071 secs 2024-07-26T17:52:08.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:07 smithi040 ceph-mon[32397]: pgmap v10500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:08.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:07 smithi146 ceph-mon[35807]: pgmap v10500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:08.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:07 smithi076 ceph-mon[35401]: pgmap v10500: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:10.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:09 smithi040 ceph-mon[32397]: pgmap v10501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:10.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:09 smithi146 ceph-mon[35807]: pgmap v10501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:10.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:09 smithi076 ceph-mon[35401]: pgmap v10501: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:11.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:11 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15538.401213 secs 2024-07-26T17:52:11.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:11 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15538.401213 secs 2024-07-26T17:52:11.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:11 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15538.401213 secs 2024-07-26T17:52:12.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:12 smithi146 ceph-mon[35807]: pgmap v10502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:12.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:12 smithi076 ceph-mon[35401]: pgmap v10502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:12.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:12 smithi040 ceph-mon[32397]: pgmap v10502: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:14.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:13 smithi040 ceph-mon[32397]: pgmap v10503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:14.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:13 smithi146 ceph-mon[35807]: pgmap v10503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:14.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:13 smithi076 ceph-mon[35401]: pgmap v10503: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:16.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:15 smithi040 ceph-mon[32397]: pgmap v10504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:16.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:15 smithi146 ceph-mon[35807]: pgmap v10504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:16.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:15 smithi076 ceph-mon[35401]: pgmap v10504: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:17.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:16 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15543.401344 secs 2024-07-26T17:52:17.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:16 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15543.401344 secs 2024-07-26T17:52:17.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:16 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15543.401344 secs 2024-07-26T17:52:18.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:17 smithi040 ceph-mon[32397]: pgmap v10505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:18.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:17 smithi146 ceph-mon[35807]: pgmap v10505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:18.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:17 smithi076 ceph-mon[35401]: pgmap v10505: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:20.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:19 smithi040 ceph-mon[32397]: pgmap v10506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:20.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:19 smithi146 ceph-mon[35807]: pgmap v10506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:20.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:19 smithi076 ceph-mon[35401]: pgmap v10506: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:21.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:21 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15548.401485 secs 2024-07-26T17:52:21.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:21 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15548.401485 secs 2024-07-26T17:52:21.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:21 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15548.401485 secs 2024-07-26T17:52:22.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:22 smithi146 ceph-mon[35807]: pgmap v10507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:22.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:22 smithi076 ceph-mon[35401]: pgmap v10507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:22.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:22 smithi040 ceph-mon[32397]: pgmap v10507: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:24.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:23 smithi040 ceph-mon[32397]: pgmap v10508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:24.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:23 smithi146 ceph-mon[35807]: pgmap v10508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:24.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:23 smithi076 ceph-mon[35401]: pgmap v10508: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:26.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:25 smithi040 ceph-mon[32397]: pgmap v10509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:26.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:25 smithi146 ceph-mon[35807]: pgmap v10509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:26.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:25 smithi076 ceph-mon[35401]: pgmap v10509: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:27.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:26 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15553.401572 secs 2024-07-26T17:52:27.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:26 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15553.401572 secs 2024-07-26T17:52:27.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:26 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15553.401572 secs 2024-07-26T17:52:28.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:27 smithi040 ceph-mon[32397]: pgmap v10510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:28.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:27 smithi146 ceph-mon[35807]: pgmap v10510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:28.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:27 smithi076 ceph-mon[35401]: pgmap v10510: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:30.232 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:29 smithi040 ceph-mon[32397]: pgmap v10511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:30.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:29 smithi146 ceph-mon[35807]: pgmap v10511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:30.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:29 smithi076 ceph-mon[35401]: pgmap v10511: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:31.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:31 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15558.401748 secs 2024-07-26T17:52:31.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:31 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15558.401748 secs 2024-07-26T17:52:31.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:31 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15558.401748 secs 2024-07-26T17:52:32.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:32 smithi146 ceph-mon[35807]: pgmap v10512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:32.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:32 smithi076 ceph-mon[35401]: pgmap v10512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:32.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:32 smithi040 ceph-mon[32397]: pgmap v10512: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:34.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:33 smithi040 ceph-mon[32397]: pgmap v10513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:34.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:33 smithi146 ceph-mon[35807]: pgmap v10513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:34.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:33 smithi076 ceph-mon[35401]: pgmap v10513: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-07-26T17:52:36.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:35 smithi040 ceph-mon[32397]: pgmap v10514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:36.322 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:35 smithi146 ceph-mon[35807]: pgmap v10514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:36.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:35 smithi076 ceph-mon[35401]: pgmap v10514: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:37.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:36 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15563.401885 secs 2024-07-26T17:52:37.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:36 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15563.401885 secs 2024-07-26T17:52:37.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:36 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15563.401885 secs 2024-07-26T17:52:38.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:37 smithi040 ceph-mon[32397]: pgmap v10515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:38.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:37 smithi146 ceph-mon[35807]: pgmap v10515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:38.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:37 smithi076 ceph-mon[35401]: pgmap v10515: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:40.233 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:39 smithi040 ceph-mon[32397]: pgmap v10516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:40.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:39 smithi146 ceph-mon[35807]: pgmap v10516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:40.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:39 smithi076 ceph-mon[35401]: pgmap v10516: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-07-26T17:52:41.320 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:41 smithi146 ceph-mon[35807]: 1 slow requests, 0 included below; oldest blocked for > 15568.402030 secs 2024-07-26T17:52:41.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:41 smithi076 ceph-mon[35401]: 1 slow requests, 0 included below; oldest blocked for > 15568.402030 secs 2024-07-26T17:52:41.482 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:41 smithi040 ceph-mon[32397]: 1 slow requests, 0 included below; oldest blocked for > 15568.402030 secs 2024-07-26T17:52:42.321 INFO:journalctl@ceph.mon.c.smithi146.stdout:Jul 26 17:52:42 smithi146 ceph-mon[35807]: pgmap v10517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:42.333 INFO:journalctl@ceph.mon.b.smithi076.stdout:Jul 26 17:52:42 smithi076 ceph-mon[35401]: pgmap v10517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:42.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Jul 26 17:52:42 smithi040 ceph-mon[32397]: pgmap v10517: 97 pgs: 97 active+clean; 9.4 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-07-26T17:52:42.543 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-07-26T17:52:42.544 DEBUG:teuthology.task.console_log:Killing console logger for smithi040 2024-07-26T17:52:42.545 DEBUG:teuthology.task.console_log:Killing console logger for smithi076 2024-07-26T17:52:42.545 DEBUG:teuthology.task.console_log:Killing console logger for smithi146 2024-07-26T17:52:42.546 DEBUG:teuthology.exit:Finished running handlers